2023-12-08T08:04:04.213 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-08T08:04:04.213 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_vshankar@teuthology --name vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} --archive /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483775 -- /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483775/orig.config.yaml 2023-12-08T08:04:04.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T08:04:04.338 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483775 branch: wip-vshankar-testing-20231206.125818 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} email: vshankar@redhat.com first_in_suite: false job_id: '7483775' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-vshankar-testing-20231206.125818 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: a2cd52c00149b5caff897ea7f79d0529b62620da ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: a2cd52c00149b5caff897ea7f79d0529b62620da kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20231206.125818 sha1: a2cd52c00149b5caff897ea7f79d0529b62620da owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 4099 sha1: a2cd52c00149b5caff897ea7f79d0529b62620da sleep_before_teardown: 0 subset: 359/1024 suite: fs suite_branch: wip-vshankar-testing-20231206.125818 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a2cd52c00149b5caff897ea7f79d0529b62620da syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi088.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJPCr2txKdrKf9QnVelFuE+wn/m9+lLN+r7qen3FqGpJXpxAxebzzsQ5a4U12llyPIl2twavOnDhInUZ62jUq4Q= smithi148.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEZ4o2xJekQI9+TdCETQ2M9T3DLEpNouMY7fkhItHCoYvLU++jEUfbgjPeq/lGtbmsSFWoZPbDPIFYXVu5sMDvs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_multifs_auth teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: f2de108beb0a6dde7f3e6c96039071828a1f6269 timestamp: 2023-12-08_07:46:48 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-08T08:04:04.338 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa; will attempt to use it 2023-12-08T08:04:04.339 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks 2023-12-08T08:04:04.339 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-08T08:04:04.341 INFO:teuthology.task.internal:Checking packages... 2023-12-08T08:04:04.365 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'a2cd52c00149b5caff897ea7f79d0529b62620da' 2023-12-08T08:04:04.366 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-08T08:04:04.366 INFO:teuthology.packaging:ref: None 2023-12-08T08:04:04.366 INFO:teuthology.packaging:tag: None 2023-12-08T08:04:04.366 INFO:teuthology.packaging:branch: wip-vshankar-testing-20231206.125818 2023-12-08T08:04:04.366 INFO:teuthology.packaging:sha1: a2cd52c00149b5caff897ea7f79d0529b62620da 2023-12-08T08:04:04.366 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-vshankar-testing-20231206.125818 2023-12-08T08:04:04.509 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-46-ga2cd52c0-1jammy 2023-12-08T08:04:04.509 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-08T08:04:04.516 INFO:teuthology.task.internal:no buildpackages task found 2023-12-08T08:04:04.516 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-08T08:04:04.523 INFO:teuthology.task.internal:Saving configuration 2023-12-08T08:04:04.547 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-08T08:04:04.554 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-08T08:04:04.579 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483775', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-08 07:57:53.185587', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFEQYHniFVZYXRs2zRaQp/T1/Tjl4UAXi9GSJZormlf0'} 2023-12-08T08:04:04.602 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483775', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-08 07:57:53.186982', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM2bsmZybqkJukZ/DKurU11zxEhDr4FNzdPTk/c6RRb5'} 2023-12-08T08:04:04.602 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-08T08:04:04.609 INFO:teuthology.task.internal:roles: ubuntu@smithi088.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-12-08T08:04:04.609 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2023-12-08T08:04:04.609 INFO:teuthology.run_tasks:Running task console_log... 2023-12-08T08:04:04.673 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f94b63910d0>, signals=[15]) 2023-12-08T08:04:04.673 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-08T08:04:04.679 INFO:teuthology.task.internal:Opening connections... 2023-12-08T08:04:04.679 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi088.front.sepia.ceph.com 2023-12-08T08:04:04.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T08:04:04.755 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi148.front.sepia.ceph.com 2023-12-08T08:04:04.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T08:04:04.833 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-08T08:04:04.839 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2023-12-08T08:04:04.844 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2023-12-08T08:04:04.845 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-12-08T08:04:04.890 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-08T08:04:04.891 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Ubuntu" 2023-12-08T08:04:04.891 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="22.04" 2023-12-08T08:04:04.891 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-08T08:04:04.891 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_CODENAME=jammy 2023-12-08T08:04:04.891 INFO:teuthology.orchestra.run.smithi088.stdout:ID=ubuntu 2023-12-08T08:04:04.891 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE=debian 2023-12-08T08:04:04.891 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-08T08:04:04.891 INFO:teuthology.orchestra.run.smithi088.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-08T08:04:04.891 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-08T08:04:04.891 INFO:teuthology.orchestra.run.smithi088.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-08T08:04:04.891 INFO:teuthology.orchestra.run.smithi088.stdout:UBUNTU_CODENAME=jammy 2023-12-08T08:04:04.892 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-12-08T08:04:04.913 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2023-12-08T08:04:04.918 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2023-12-08T08:04:04.919 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-12-08T08:04:04.970 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-08T08:04:04.970 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Ubuntu" 2023-12-08T08:04:04.970 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="22.04" 2023-12-08T08:04:04.970 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-08T08:04:04.970 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_CODENAME=jammy 2023-12-08T08:04:04.970 INFO:teuthology.orchestra.run.smithi148.stdout:ID=ubuntu 2023-12-08T08:04:04.970 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE=debian 2023-12-08T08:04:04.971 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-08T08:04:04.971 INFO:teuthology.orchestra.run.smithi148.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-08T08:04:04.971 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-08T08:04:04.971 INFO:teuthology.orchestra.run.smithi148.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-08T08:04:04.971 INFO:teuthology.orchestra.run.smithi148.stdout:UBUNTU_CODENAME=jammy 2023-12-08T08:04:04.971 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-12-08T08:04:05.005 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-08T08:04:05.014 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-08T08:04:05.032 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-08T08:04:05.033 DEBUG:teuthology.orchestra.run.smithi088:> test '!' -e /home/ubuntu/cephtest 2023-12-08T08:04:05.035 DEBUG:teuthology.orchestra.run.smithi148:> test '!' -e /home/ubuntu/cephtest 2023-12-08T08:04:05.039 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-08T08:04:05.046 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-08T08:04:05.046 DEBUG:teuthology.orchestra.run.smithi088:> test -z $(ls -A /var/lib/ceph) 2023-12-08T08:04:05.080 DEBUG:teuthology.orchestra.run.smithi148:> test -z $(ls -A /var/lib/ceph) 2023-12-08T08:04:05.094 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-08T08:04:05.149 INFO:teuthology.run_tasks:Running task kernel... 2023-12-08T08:04:05.164 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-12-08T08:04:05.164 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}} 2023-12-08T08:04:05.164 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-12-08T08:04:05.164 DEBUG:teuthology.orchestra.run.smithi088:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-08T08:04:05.164 DEBUG:teuthology.orchestra.run.smithi148:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-08T08:04:05.169 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:04:05.169 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-12-08T08:04:05.173 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:04:05.173 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-12-08T08:04:05.373 DEBUG:teuthology.task.kernel:sha1 for client.1 is 6bcacf46b7888ce2bf7abad8aec37024810025d4 2023-12-08T08:04:05.373 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6bcacf46b7888ce2bf7abad8aec37024810025d4"... 2023-12-08T08:04:05.373 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2023-12-08T08:04:05.378 INFO:teuthology.orchestra.run.smithi148.stdout:5.15.0-56-generic 2023-12-08T08:04:05.379 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 6bcacf46b7888ce2bf7abad8aec37024810025d4 2023-12-08T08:04:05.379 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-08T08:04:05.379 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-12-08T08:04:05.379 DEBUG:teuthology.orchestra.run.smithi148:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-12-08T08:04:05.382 DEBUG:teuthology.task.kernel:sha1 for client.0 is 6bcacf46b7888ce2bf7abad8aec37024810025d4 2023-12-08T08:04:05.382 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6bcacf46b7888ce2bf7abad8aec37024810025d4"... 2023-12-08T08:04:05.383 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2023-12-08T08:04:05.388 INFO:teuthology.orchestra.run.smithi088.stdout:5.15.0-56-generic 2023-12-08T08:04:05.388 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 6bcacf46b7888ce2bf7abad8aec37024810025d4 2023-12-08T08:04:05.388 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-08T08:04:05.389 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-12-08T08:04:05.389 DEBUG:teuthology.orchestra.run.smithi088:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-12-08T08:04:05.442 INFO:teuthology.orchestra.run.smithi088.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-12-08T08:04:05.447 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-12-08T08:04:05.574 INFO:teuthology.orchestra.run.smithi088.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-12-08T08:04:05.574 INFO:teuthology.orchestra.run.smithi088.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-12-08T08:04:05.574 INFO:teuthology.orchestra.run.smithi088.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-12-08T08:04:05.575 INFO:teuthology.orchestra.run.smithi088.stderr:hint: 2023-12-08T08:04:05.575 INFO:teuthology.orchestra.run.smithi088.stderr:hint: git config --global init.defaultBranch 2023-12-08T08:04:05.575 INFO:teuthology.orchestra.run.smithi088.stderr:hint: 2023-12-08T08:04:05.575 INFO:teuthology.orchestra.run.smithi088.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-12-08T08:04:05.575 INFO:teuthology.orchestra.run.smithi088.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-12-08T08:04:05.575 INFO:teuthology.orchestra.run.smithi088.stderr:hint: 2023-12-08T08:04:05.575 INFO:teuthology.orchestra.run.smithi088.stderr:hint: git branch -m 2023-12-08T08:04:05.576 INFO:teuthology.orchestra.run.smithi088.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-12-08T08:04:05.578 DEBUG:teuthology.orchestra.run.smithi088:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-12-08T08:04:05.596 INFO:teuthology.orchestra.run.smithi148.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-12-08T08:04:05.596 INFO:teuthology.orchestra.run.smithi148.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-12-08T08:04:05.596 INFO:teuthology.orchestra.run.smithi148.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-12-08T08:04:05.596 INFO:teuthology.orchestra.run.smithi148.stderr:hint: 2023-12-08T08:04:05.596 INFO:teuthology.orchestra.run.smithi148.stderr:hint: git config --global init.defaultBranch 2023-12-08T08:04:05.596 INFO:teuthology.orchestra.run.smithi148.stderr:hint: 2023-12-08T08:04:05.596 INFO:teuthology.orchestra.run.smithi148.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-12-08T08:04:05.596 INFO:teuthology.orchestra.run.smithi148.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-12-08T08:04:05.596 INFO:teuthology.orchestra.run.smithi148.stderr:hint: 2023-12-08T08:04:05.596 INFO:teuthology.orchestra.run.smithi148.stderr:hint: git branch -m 2023-12-08T08:04:05.597 INFO:teuthology.orchestra.run.smithi148.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-12-08T08:04:05.599 DEBUG:teuthology.orchestra.run.smithi148:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-12-08T08:04:05.645 DEBUG:teuthology.orchestra.run.smithi088:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-12-08T08:04:05.667 DEBUG:teuthology.orchestra.run.smithi148:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-12-08T08:04:05.699 DEBUG:teuthology.orchestra.run.smithi088:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-12-08T08:04:05.723 DEBUG:teuthology.orchestra.run.smithi148:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-12-08T08:04:58.322 INFO:teuthology.orchestra.run.smithi148.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-12-08T08:04:58.322 INFO:teuthology.orchestra.run.smithi148.stderr: * [new branch] main -> origin/main 2023-12-08T08:04:58.348 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20190312 -> 20190312 2023-12-08T08:04:58.348 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20190416 -> 20190416 2023-12-08T08:04:58.348 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20190514 -> 20190514 2023-12-08T08:04:58.348 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20190618 -> 20190618 2023-12-08T08:04:58.348 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20190717 -> 20190717 2023-12-08T08:04:58.348 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20190815 -> 20190815 2023-12-08T08:04:58.348 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20190923 -> 20190923 2023-12-08T08:04:58.348 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20191022 -> 20191022 2023-12-08T08:04:58.349 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20191215 -> 20191215 2023-12-08T08:04:58.351 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20200122 -> 20200122 2023-12-08T08:04:58.351 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20200316 -> 20200316 2023-12-08T08:04:58.351 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20200421 -> 20200421 2023-12-08T08:04:58.351 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20200519 -> 20200519 2023-12-08T08:04:58.351 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20200619 -> 20200619 2023-12-08T08:04:58.351 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20200721 -> 20200721 2023-12-08T08:04:58.351 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20200817 -> 20200817 2023-12-08T08:04:58.351 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20200918 -> 20200918 2023-12-08T08:04:58.351 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20201022 -> 20201022 2023-12-08T08:04:58.351 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20201118 -> 20201118 2023-12-08T08:04:58.351 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20201218 -> 20201218 2023-12-08T08:04:58.351 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20210208 -> 20210208 2023-12-08T08:04:58.351 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20210315 -> 20210315 2023-12-08T08:04:58.351 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20210511 -> 20210511 2023-12-08T08:04:58.352 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20210716 -> 20210716 2023-12-08T08:04:58.352 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20210818 -> 20210818 2023-12-08T08:04:58.352 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20210919 -> 20210919 2023-12-08T08:04:58.352 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20211027 -> 20211027 2023-12-08T08:04:58.352 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20211216 -> 20211216 2023-12-08T08:04:58.354 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20220209 -> 20220209 2023-12-08T08:04:58.354 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20220310 -> 20220310 2023-12-08T08:04:58.354 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20220411 -> 20220411 2023-12-08T08:04:58.354 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20220509 -> 20220509 2023-12-08T08:04:58.354 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20220610 -> 20220610 2023-12-08T08:04:58.354 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20220708 -> 20220708 2023-12-08T08:04:58.354 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20220815 -> 20220815 2023-12-08T08:04:58.355 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20220913 -> 20220913 2023-12-08T08:04:58.355 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20221012 -> 20221012 2023-12-08T08:04:58.355 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20221109 -> 20221109 2023-12-08T08:04:58.355 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20221214 -> 20221214 2023-12-08T08:04:58.355 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20230117 -> 20230117 2023-12-08T08:04:58.355 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20230210 -> 20230210 2023-12-08T08:04:58.355 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20230310 -> 20230310 2023-12-08T08:04:58.355 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20230404 -> 20230404 2023-12-08T08:04:58.355 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20230515 -> 20230515 2023-12-08T08:04:58.355 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20230625 -> 20230625 2023-12-08T08:04:58.355 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20230804 -> 20230804 2023-12-08T08:04:58.355 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20230919 -> 20230919 2023-12-08T08:04:58.355 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20231030 -> 20231030 2023-12-08T08:04:58.356 INFO:teuthology.orchestra.run.smithi148.stderr: * [new tag] 20231111 -> 20231111 2023-12-08T08:05:02.356 INFO:teuthology.orchestra.run.smithi148.stderr:Updating files: 51% (1672/3254) Updating files: 52% (1693/3254) Updating files: 53% (1725/3254) Updating files: 54% (1758/3254) Updating files: 55% (1790/3254) Updating files: 56% (1823/3254) Updating files: 57% (1855/3254) Updating files: 58% (1888/3254) Updating files: 59% (1920/3254) Updating files: 60% (1953/3254) Updating files: 61% (1985/3254) Updating files: 62% (2018/3254) Updating files: 63% (2051/3254) Updating files: 64% (2083/3254) Updating files: 64% (2115/3254) Updating files: 65% (2116/3254) Updating files: 66% (2148/3254) Updating files: 67% (2181/3254) Updating files: 68% (2213/3254) Updating files: 69% (2246/3254) Updating files: 70% (2278/3254) Updating files: 71% (2311/3254) Updating files: 72% (2343/3254) Updating files: 73% (2376/3254) Updating files: 74% (2408/3254) Updating files: 75% (2441/3254) Updating files: 76% (2474/3254) Updating files: 77% (2506/3254) Updating files: 78% (2539/3254) Updating files: 79% (2571/3254) Updating files: 80% (2604/3254) Updating files: 81% (2636/3254) Updating files: 81% (2653/3254) Updating files: 82% (2669/3254) Updating files: 83% (2701/3254) Updating files: 84% (2734/3254) Updating files: 85% (2766/3254) Updating files: 86% (2799/3254) Updating files: 87% (2831/3254) Updating files: 88% (2864/3254) Updating files: 89% (2897/3254) Updating files: 90% (2929/3254) Updating files: 91% (2962/3254) Updating files: 92% (2994/3254) Updating files: 93% (3027/3254) Updating files: 94% (3059/3254) Updating files: 95% (3092/3254) Updating files: 96% (3124/3254) Updating files: 97% (3157/3254) Updating files: 98% (3189/3254) Updating files: 99% (3222/3254) Updating files: 100% (3254/3254) Updating files: 100% (3254/3254), done. 2023-12-08T08:05:02.360 INFO:teuthology.orchestra.run.smithi148.stdout:HEAD is now at c004dbee Merge branch 'robot/patch-0-1701808157' into 'main' 2023-12-08T08:05:02.381 INFO:teuthology.task.kernel:Downloading kernel 6bcacf46b7888ce2bf7abad8aec37024810025d4 on client.1... 2023-12-08T08:05:02.382 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6bcacf46b7888ce2bf7abad8aec37024810025d4 2023-12-08T08:05:02.607 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/6bcacf46b7888ce2bf7abad8aec37024810025d4/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g6bcacf46b788/ 2023-12-08T08:05:02.608 DEBUG:teuthology.orchestra.run.smithi148:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g6bcacf46b788_6.6.0-g6bcacf46b788-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/6bcacf46b7888ce2bf7abad8aec37024810025d4/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g6bcacf46b788/ --input-file=- 2023-12-08T08:05:02.610 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi148.front.sepia.ceph.com to complete... 2023-12-08T08:05:02.801 INFO:teuthology.orchestra.run.smithi088.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-12-08T08:05:02.801 INFO:teuthology.orchestra.run.smithi088.stderr: * [new branch] main -> origin/main 2023-12-08T08:05:02.831 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20190312 -> 20190312 2023-12-08T08:05:02.832 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20190416 -> 20190416 2023-12-08T08:05:02.832 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20190514 -> 20190514 2023-12-08T08:05:02.832 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20190618 -> 20190618 2023-12-08T08:05:02.832 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20190717 -> 20190717 2023-12-08T08:05:02.832 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20190815 -> 20190815 2023-12-08T08:05:02.832 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20190923 -> 20190923 2023-12-08T08:05:02.832 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20191022 -> 20191022 2023-12-08T08:05:02.832 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20191215 -> 20191215 2023-12-08T08:05:02.834 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20200122 -> 20200122 2023-12-08T08:05:02.834 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20200316 -> 20200316 2023-12-08T08:05:02.834 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20200421 -> 20200421 2023-12-08T08:05:02.834 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20200519 -> 20200519 2023-12-08T08:05:02.835 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20200619 -> 20200619 2023-12-08T08:05:02.835 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20200721 -> 20200721 2023-12-08T08:05:02.835 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20200817 -> 20200817 2023-12-08T08:05:02.835 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20200918 -> 20200918 2023-12-08T08:05:02.835 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20201022 -> 20201022 2023-12-08T08:05:02.835 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20201118 -> 20201118 2023-12-08T08:05:02.835 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20201218 -> 20201218 2023-12-08T08:05:02.835 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20210208 -> 20210208 2023-12-08T08:05:02.835 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20210315 -> 20210315 2023-12-08T08:05:02.835 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20210511 -> 20210511 2023-12-08T08:05:02.835 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20210716 -> 20210716 2023-12-08T08:05:02.835 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20210818 -> 20210818 2023-12-08T08:05:02.835 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20210919 -> 20210919 2023-12-08T08:05:02.835 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20211027 -> 20211027 2023-12-08T08:05:02.835 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20211216 -> 20211216 2023-12-08T08:05:02.836 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20220209 -> 20220209 2023-12-08T08:05:02.838 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20220310 -> 20220310 2023-12-08T08:05:02.838 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20220411 -> 20220411 2023-12-08T08:05:02.838 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20220509 -> 20220509 2023-12-08T08:05:02.838 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20220610 -> 20220610 2023-12-08T08:05:02.838 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20220708 -> 20220708 2023-12-08T08:05:02.838 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20220815 -> 20220815 2023-12-08T08:05:02.838 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20220913 -> 20220913 2023-12-08T08:05:02.838 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20221012 -> 20221012 2023-12-08T08:05:02.838 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20221109 -> 20221109 2023-12-08T08:05:02.838 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20221214 -> 20221214 2023-12-08T08:05:02.838 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20230117 -> 20230117 2023-12-08T08:05:02.838 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20230210 -> 20230210 2023-12-08T08:05:02.838 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20230310 -> 20230310 2023-12-08T08:05:02.839 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20230404 -> 20230404 2023-12-08T08:05:02.839 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20230515 -> 20230515 2023-12-08T08:05:02.839 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20230625 -> 20230625 2023-12-08T08:05:02.839 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20230804 -> 20230804 2023-12-08T08:05:02.839 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20230919 -> 20230919 2023-12-08T08:05:02.839 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20231030 -> 20231030 2023-12-08T08:05:02.839 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20231111 -> 20231111 2023-12-08T08:05:04.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08 08:05:04 URL:https://4.chacra.ceph.com/r/kernel/testing/6bcacf46b7888ce2bf7abad8aec37024810025d4/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g6bcacf46b788/linux-image-6.6.0-g6bcacf46b788_6.6.0-g6bcacf46b788-1_amd64.deb [38938798/38938798] -> "/tmp/linux-image.deb" [1] 2023-12-08T08:05:04.105 INFO:teuthology.orchestra.run.smithi148.stderr:FINISHED --2023-12-08 08:05:04-- 2023-12-08T08:05:04.106 INFO:teuthology.orchestra.run.smithi148.stderr:Total wall clock time: 1.5s 2023-12-08T08:05:04.106 INFO:teuthology.orchestra.run.smithi148.stderr:Downloaded: 1 files, 37M in 1.3s (27.6 MB/s) 2023-12-08T08:05:04.108 INFO:teuthology.task.kernel:Installing kernel 6bcacf46b7888ce2bf7abad8aec37024810025d4 on client.1... 2023-12-08T08:05:04.109 DEBUG:teuthology.orchestra.run.smithi148:> sudo dpkg -i /tmp/linux-image.deb 2023-12-08T08:05:04.351 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package linux-image-6.6.0-g6bcacf46b788. 2023-12-08T08:05:06.351 INFO:teuthology.orchestra.run.smithi148.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-12-08T08:05:06.355 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-12-08T08:05:06.515 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking linux-image-6.6.0-g6bcacf46b788 (6.6.0-g6bcacf46b788-1) ... 2023-12-08T08:05:06.833 INFO:teuthology.orchestra.run.smithi088.stderr:Updating files: 50% (1642/3254) Updating files: 51% (1660/3254) Updating files: 52% (1693/3254) Updating files: 53% (1725/3254) Updating files: 54% (1758/3254) Updating files: 55% (1790/3254) Updating files: 56% (1823/3254) Updating files: 57% (1855/3254) Updating files: 58% (1888/3254) Updating files: 59% (1920/3254) Updating files: 60% (1953/3254) Updating files: 61% (1985/3254) Updating files: 62% (2018/3254) Updating files: 63% (2051/3254) Updating files: 64% (2083/3254) Updating files: 64% (2110/3254) Updating files: 65% (2116/3254) Updating files: 66% (2148/3254) Updating files: 67% (2181/3254) Updating files: 68% (2213/3254) Updating files: 69% (2246/3254) Updating files: 70% (2278/3254) Updating files: 71% (2311/3254) Updating files: 72% (2343/3254) Updating files: 73% (2376/3254) Updating files: 74% (2408/3254) Updating files: 75% (2441/3254) Updating files: 76% (2474/3254) Updating files: 77% (2506/3254) Updating files: 78% (2539/3254) Updating files: 79% (2571/3254) Updating files: 80% (2604/3254) Updating files: 81% (2636/3254) Updating files: 81% (2653/3254) Updating files: 82% (2669/3254) Updating files: 83% (2701/3254) Updating files: 84% (2734/3254) Updating files: 85% (2766/3254) Updating files: 86% (2799/3254) Updating files: 87% (2831/3254) Updating files: 88% (2864/3254) Updating files: 89% (2897/3254) Updating files: 90% (2929/3254) Updating files: 91% (2962/3254) Updating files: 92% (2994/3254) Updating files: 93% (3027/3254) Updating files: 94% (3059/3254) Updating files: 95% (3092/3254) Updating files: 96% (3124/3254) Updating files: 97% (3157/3254) Updating files: 98% (3189/3254) Updating files: 99% (3222/3254) Updating files: 100% (3254/3254) Updating files: 100% (3254/3254), done. 2023-12-08T08:05:06.838 INFO:teuthology.orchestra.run.smithi088.stdout:HEAD is now at c004dbee Merge branch 'robot/patch-0-1701808157' into 'main' 2023-12-08T08:05:06.859 INFO:teuthology.task.kernel:Downloading kernel 6bcacf46b7888ce2bf7abad8aec37024810025d4 on client.0... 2023-12-08T08:05:06.860 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6bcacf46b7888ce2bf7abad8aec37024810025d4 2023-12-08T08:05:07.013 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/6bcacf46b7888ce2bf7abad8aec37024810025d4/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g6bcacf46b788/ 2023-12-08T08:05:07.014 DEBUG:teuthology.orchestra.run.smithi088:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g6bcacf46b788_6.6.0-g6bcacf46b788-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/6bcacf46b7888ce2bf7abad8aec37024810025d4/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g6bcacf46b788/ --input-file=- 2023-12-08T08:05:07.016 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi088.front.sepia.ceph.com to complete... 2023-12-08T08:05:08.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08 08:05:08 URL:https://4.chacra.ceph.com/r/kernel/testing/6bcacf46b7888ce2bf7abad8aec37024810025d4/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g6bcacf46b788/linux-image-6.6.0-g6bcacf46b788_6.6.0-g6bcacf46b788-1_amd64.deb [38938798/38938798] -> "/tmp/linux-image.deb" [1] 2023-12-08T08:05:08.596 INFO:teuthology.orchestra.run.smithi088.stderr:FINISHED --2023-12-08 08:05:08-- 2023-12-08T08:05:08.596 INFO:teuthology.orchestra.run.smithi088.stderr:Total wall clock time: 1.5s 2023-12-08T08:05:08.596 INFO:teuthology.orchestra.run.smithi088.stderr:Downloaded: 1 files, 37M in 1.4s (27.5 MB/s) 2023-12-08T08:05:08.599 INFO:teuthology.task.kernel:Installing kernel 6bcacf46b7888ce2bf7abad8aec37024810025d4 on client.0... 2023-12-08T08:05:08.600 DEBUG:teuthology.orchestra.run.smithi088:> sudo dpkg -i /tmp/linux-image.deb 2023-12-08T08:05:08.828 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package linux-image-6.6.0-g6bcacf46b788. 2023-12-08T08:05:09.945 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up linux-image-6.6.0-g6bcacf46b788 (6.6.0-g6bcacf46b788-1) ... 2023-12-08T08:05:10.054 INFO:teuthology.orchestra.run.smithi148.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g6bcacf46b788 2023-12-08T08:05:10.841 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-12-08T08:05:10.845 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-12-08T08:05:10.953 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking linux-image-6.6.0-g6bcacf46b788 (6.6.0-g6bcacf46b788-1) ... 2023-12-08T08:05:14.397 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up linux-image-6.6.0-g6bcacf46b788 (6.6.0-g6bcacf46b788-1) ... 2023-12-08T08:05:14.494 INFO:teuthology.orchestra.run.smithi088.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g6bcacf46b788 2023-12-08T08:05:31.202 INFO:teuthology.orchestra.run.smithi148.stderr:Sourcing file `/etc/default/grub' 2023-12-08T08:05:31.215 INFO:teuthology.orchestra.run.smithi148.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-08T08:05:31.245 INFO:teuthology.orchestra.run.smithi148.stderr:Generating grub configuration file ... 2023-12-08T08:05:31.550 INFO:teuthology.orchestra.run.smithi148.stderr:Found linux image: /boot/vmlinuz-6.6.0-g6bcacf46b788 2023-12-08T08:05:31.564 INFO:teuthology.orchestra.run.smithi148.stderr:Found initrd image: /boot/initrd.img-6.6.0-g6bcacf46b788 2023-12-08T08:05:31.899 INFO:teuthology.orchestra.run.smithi148.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-08T08:05:31.909 INFO:teuthology.orchestra.run.smithi148.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-08T08:05:31.979 INFO:teuthology.orchestra.run.smithi148.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-08T08:05:31.984 INFO:teuthology.orchestra.run.smithi148.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-08T08:05:32.138 INFO:teuthology.orchestra.run.smithi148.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-08T08:05:32.138 INFO:teuthology.orchestra.run.smithi148.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-08T08:05:32.138 INFO:teuthology.orchestra.run.smithi148.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-08T08:05:32.193 INFO:teuthology.orchestra.run.smithi148.stderr:done 2023-12-08T08:05:32.384 DEBUG:teuthology.orchestra.run.smithi148:> dpkg-deb -c /tmp/linux-image.deb 2023-12-08T08:05:32.392 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./ 2023-12-08T08:05:32.392 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./boot/ 2023-12-08T08:05:32.392 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 4415617 2023-12-08 05:25 ./boot/System.map-6.6.0-g6bcacf46b788 2023-12-08T08:05:32.402 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 169214 2023-12-08 05:25 ./boot/config-6.6.0-g6bcacf46b788 2023-12-08T08:05:32.402 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11352864 2023-12-08 05:25 ./boot/vmlinuz-6.6.0-g6bcacf46b788 2023-12-08T08:05:32.423 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./etc/ 2023-12-08T08:05:32.423 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./etc/kernel/ 2023-12-08T08:05:32.423 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./etc/kernel/postinst.d/ 2023-12-08T08:05:32.423 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./etc/kernel/postrm.d/ 2023-12-08T08:05:32.423 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./etc/kernel/preinst.d/ 2023-12-08T08:05:32.423 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./etc/kernel/prerm.d/ 2023-12-08T08:05:32.423 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/ 2023-12-08T08:05:32.423 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/ 2023-12-08T08:05:32.424 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/ 2023-12-08T08:05:32.424 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/ 2023-12-08T08:05:32.424 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/ 2023-12-08T08:05:32.424 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/ 2023-12-08T08:05:32.424 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/ 2023-12-08T08:05:32.424 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 490233 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/aesni-intel.ko 2023-12-08T08:05:32.424 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-08T08:05:32.424 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-08T08:05:32.424 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-08T08:05:32.424 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 93113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-08T08:05:32.424 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 106729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-08T08:05:32.424 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 152241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-08T08:05:32.424 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12553 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-08T08:05:32.424 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13777 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-08T08:05:32.425 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 83889 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-08T08:05:32.425 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-08T08:05:32.425 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 47225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-08T08:05:32.425 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 47209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-08T08:05:32.425 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 51801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-08T08:05:32.425 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-08T08:05:32.425 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-08T08:05:32.425 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 58585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-08T08:05:32.425 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 50497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-08T08:05:32.425 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-08T08:05:32.425 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-08T08:05:32.425 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kernel/ 2023-12-08T08:05:32.425 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kernel/cpu/ 2023-12-08T08:05:32.425 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kernel/cpu/mce/ 2023-12-08T08:05:32.425 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-08T08:05:32.425 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13353 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kernel/cpuid.ko 2023-12-08T08:05:32.426 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kernel/msr.ko 2023-12-08T08:05:32.426 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kvm/ 2023-12-08T08:05:32.426 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 354433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-08T08:05:32.426 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 881625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-08T08:05:32.426 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 2275865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kvm/kvm.ko 2023-12-08T08:05:32.503 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/ 2023-12-08T08:05:32.504 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 53697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/af_alg.ko 2023-12-08T08:05:32.504 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/algif_hash.ko 2023-12-08T08:05:32.504 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/algif_skcipher.ko 2023-12-08T08:05:32.504 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/ansi_cprng.ko 2023-12-08T08:05:32.504 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19641 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/anubis.ko 2023-12-08T08:05:32.504 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/arc4.ko 2023-12-08T08:05:32.504 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/asymmetric_keys/ 2023-12-08T08:05:32.504 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-12-08T08:05:32.504 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx/ 2023-12-08T08:05:32.504 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11249 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx/async_memcpy.ko 2023-12-08T08:05:32.504 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx/async_pq.ko 2023-12-08T08:05:32.504 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21561 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-08T08:05:32.505 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx/async_tx.ko 2023-12-08T08:05:32.505 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx/async_xor.ko 2023-12-08T08:05:32.505 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx/raid6test.ko 2023-12-08T08:05:32.505 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/authenc.ko 2023-12-08T08:05:32.505 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/authencesn.ko 2023-12-08T08:05:32.505 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/blake2b_generic.ko 2023-12-08T08:05:32.505 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/blowfish_common.ko 2023-12-08T08:05:32.505 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/blowfish_generic.ko 2023-12-08T08:05:32.505 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/camellia_generic.ko 2023-12-08T08:05:32.505 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/cast5_generic.ko 2023-12-08T08:05:32.505 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/cast6_generic.ko 2023-12-08T08:05:32.505 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/cast_common.ko 2023-12-08T08:05:32.505 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/ccm.ko 2023-12-08T08:05:32.505 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14769 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/cmac.ko 2023-12-08T08:05:32.506 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/crc32_generic.ko 2023-12-08T08:05:32.506 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 47505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/cryptd.ko 2023-12-08T08:05:32.506 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 39505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/crypto_engine.ko 2023-12-08T08:05:32.506 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/crypto_simd.ko 2023-12-08T08:05:32.506 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/crypto_user.ko 2023-12-08T08:05:32.506 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/cts.ko 2023-12-08T08:05:32.506 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10913 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/des_generic.ko 2023-12-08T08:05:32.506 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/dh_generic.ko 2023-12-08T08:05:32.506 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11001 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/echainiv.ko 2023-12-08T08:05:32.506 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/essiv.ko 2023-12-08T08:05:32.506 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/fcrypt.ko 2023-12-08T08:05:32.506 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/khazad.ko 2023-12-08T08:05:32.506 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/lrw.ko 2023-12-08T08:05:32.506 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11513 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/lz4.ko 2023-12-08T08:05:32.507 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/lz4hc.ko 2023-12-08T08:05:32.507 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/md4.ko 2023-12-08T08:05:32.507 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/michael_mic.ko 2023-12-08T08:05:32.507 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/pcbc.ko 2023-12-08T08:05:32.507 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/pcrypt.ko 2023-12-08T08:05:32.507 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/rmd160.ko 2023-12-08T08:05:32.507 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/seed.ko 2023-12-08T08:05:32.507 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/serpent_generic.ko 2023-12-08T08:05:32.507 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 149193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/tcrypt.ko 2023-12-08T08:05:32.507 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/tea.ko 2023-12-08T08:05:32.507 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28777 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/twofish_common.ko 2023-12-08T08:05:32.507 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/twofish_generic.ko 2023-12-08T08:05:32.507 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/vmac.ko 2023-12-08T08:05:32.507 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/wp512.ko 2023-12-08T08:05:32.508 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/xcbc.ko 2023-12-08T08:05:32.508 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/xor.ko 2023-12-08T08:05:32.508 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18713 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/xts.ko 2023-12-08T08:05:32.508 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/xxhash_generic.ko 2023-12-08T08:05:32.508 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ 2023-12-08T08:05:32.508 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/ 2023-12-08T08:05:32.508 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18249 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/acpi_extlog.ko 2023-12-08T08:05:32.508 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-08T08:05:32.508 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/acpi_pad.ko 2023-12-08T08:05:32.508 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/apei/ 2023-12-08T08:05:32.508 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/apei/einj.ko 2023-12-08T08:05:32.508 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/ec_sys.ko 2023-12-08T08:05:32.508 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/platform_profile.ko 2023-12-08T08:05:32.508 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/sbs.ko 2023-12-08T08:05:32.509 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/sbshc.ko 2023-12-08T08:05:32.509 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 103025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/video.ko 2023-12-08T08:05:32.509 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/ 2023-12-08T08:05:32.509 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/acard-ahci.ko 2023-12-08T08:05:32.509 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 88865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/ahci.ko 2023-12-08T08:05:32.509 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/ahci_platform.ko 2023-12-08T08:05:32.509 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 88289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/libahci.ko 2023-12-08T08:05:32.509 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/libahci_platform.ko 2023-12-08T08:05:32.509 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_acpi.ko 2023-12-08T08:05:32.509 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_ali.ko 2023-12-08T08:05:32.509 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_amd.ko 2023-12-08T08:05:32.509 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_artop.ko 2023-12-08T08:05:32.509 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_atiixp.ko 2023-12-08T08:05:32.509 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24945 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_atp867x.ko 2023-12-08T08:05:32.509 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_cmd640.ko 2023-12-08T08:05:32.510 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_cmd64x.ko 2023-12-08T08:05:32.510 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_cypress.ko 2023-12-08T08:05:32.510 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_efar.ko 2023-12-08T08:05:32.510 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21945 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_hpt366.ko 2023-12-08T08:05:32.510 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33977 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_hpt37x.ko 2023-12-08T08:05:32.510 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-08T08:05:32.510 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-08T08:05:32.510 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_it8213.ko 2023-12-08T08:05:32.510 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_it821x.ko 2023-12-08T08:05:32.510 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12889 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_jmicron.ko 2023-12-08T08:05:32.510 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 51481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_legacy.ko 2023-12-08T08:05:32.510 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_marvell.ko 2023-12-08T08:05:32.510 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16281 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_mpiix.ko 2023-12-08T08:05:32.510 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_netcell.ko 2023-12-08T08:05:32.511 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_ninja32.ko 2023-12-08T08:05:32.511 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_ns87410.ko 2023-12-08T08:05:32.511 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17361 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_ns87415.ko 2023-12-08T08:05:32.511 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_oldpiix.ko 2023-12-08T08:05:32.511 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15377 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_opti.ko 2023-12-08T08:05:32.511 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_optidma.ko 2023-12-08T08:05:32.511 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_pcmcia.ko 2023-12-08T08:05:32.511 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-08T08:05:32.511 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20561 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-08T08:05:32.511 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_piccolo.ko 2023-12-08T08:05:32.511 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_radisys.ko 2023-12-08T08:05:32.511 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_rdc.ko 2023-12-08T08:05:32.511 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_rz1000.ko 2023-12-08T08:05:32.511 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_sch.ko 2023-12-08T08:05:32.512 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_serverworks.ko 2023-12-08T08:05:32.512 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23457 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_sil680.ko 2023-12-08T08:05:32.512 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_sl82c105.ko 2023-12-08T08:05:32.512 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_triflex.ko 2023-12-08T08:05:32.512 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_via.ko 2023-12-08T08:05:32.512 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pdc_adma.ko 2023-12-08T08:05:32.512 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_inic162x.ko 2023-12-08T08:05:32.512 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 83345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_mv.ko 2023-12-08T08:05:32.512 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 70393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_nv.ko 2023-12-08T08:05:32.512 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37377 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_promise.ko 2023-12-08T08:05:32.512 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23041 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_qstor.ko 2023-12-08T08:05:32.512 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_sil.ko 2023-12-08T08:05:32.512 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_sil24.ko 2023-12-08T08:05:32.512 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17945 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_sis.ko 2023-12-08T08:05:32.512 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20441 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_svw.ko 2023-12-08T08:05:32.513 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_sx4.ko 2023-12-08T08:05:32.513 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_uli.ko 2023-12-08T08:05:32.513 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_via.ko 2023-12-08T08:05:32.513 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_vsc.ko 2023-12-08T08:05:32.513 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/auxdisplay/ 2023-12-08T08:05:32.513 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/auxdisplay/ks0108.ko 2023-12-08T08:05:32.513 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/bcma/ 2023-12-08T08:05:32.513 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 124473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/bcma/bcma.ko 2023-12-08T08:05:32.513 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/ 2023-12-08T08:05:32.513 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/aoe/ 2023-12-08T08:05:32.513 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 113665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/aoe/aoe.ko 2023-12-08T08:05:32.513 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/drbd/ 2023-12-08T08:05:32.513 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 965585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/drbd/drbd.ko 2023-12-08T08:05:32.513 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 173225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/floppy.ko 2023-12-08T08:05:32.513 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/mtip32xx/ 2023-12-08T08:05:32.514 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 94297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-08T08:05:32.514 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 115793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/nbd.ko 2023-12-08T08:05:32.514 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/null_blk/ 2023-12-08T08:05:32.514 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 110385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/null_blk/null_blk.ko 2023-12-08T08:05:32.514 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 98193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/pktcdvd.ko 2023-12-08T08:05:32.514 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 263769 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/rbd.ko 2023-12-08T08:05:32.514 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/xen-blkback/ 2023-12-08T08:05:32.514 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 98145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-08T08:05:32.514 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/zram/ 2023-12-08T08:05:32.514 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 60217 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/zram/zram.ko 2023-12-08T08:05:32.514 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ 2023-12-08T08:05:32.514 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30705 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/applicom.ko 2023-12-08T08:05:32.514 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hangcheck-timer.ko 2023-12-08T08:05:32.514 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hw_random/ 2023-12-08T08:05:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13889 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-08T08:05:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-08T08:05:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-08T08:05:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hw_random/via-rng.ko 2023-12-08T08:05:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-08T08:05:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi/ 2023-12-08T08:05:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30713 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-08T08:05:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 148601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-08T08:05:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-08T08:05:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 139313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-08T08:05:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 70921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-08T08:05:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 53513 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-08T08:05:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/lp.ko 2023-12-08T08:05:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/mwave/ 2023-12-08T08:05:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 84097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/mwave/mwave.ko 2023-12-08T08:05:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/nvram.ko 2023-12-08T08:05:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ppdev.ko 2023-12-08T08:05:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 51113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tlclk.ko 2023-12-08T08:05:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/ 2023-12-08T08:05:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-08T08:05:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-12-08T08:05:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-12-08T08:05:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-12-08T08:05:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-08T08:05:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-08T08:05:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23561 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-12-08T08:05:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/xillybus/ 2023-12-08T08:05:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17001 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/xillybus/xillybus_class.ko 2023-12-08T08:05:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 50945 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/xillybus/xillybus_core.ko 2023-12-08T08:05:32.517 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-12-08T08:05:32.517 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/clk/ 2023-12-08T08:05:32.517 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/clk/clk-palmas.ko 2023-12-08T08:05:32.517 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 47849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/clk/clk-si5351.ko 2023-12-08T08:05:32.517 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11457 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/clk/clk-twl6040.ko 2023-12-08T08:05:32.517 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19249 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/clk/clk-wm831x.ko 2023-12-08T08:05:32.517 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/cpufreq/ 2023-12-08T08:05:32.517 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-08T08:05:32.517 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-08T08:05:32.517 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-08T08:05:32.517 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/ 2023-12-08T08:05:32.517 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/ccp/ 2023-12-08T08:05:32.517 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 70801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-08T08:05:32.517 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 243025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/ccp/ccp.ko 2023-12-08T08:05:32.517 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/intel/ 2023-12-08T08:05:32.518 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/intel/qat/ 2023-12-08T08:05:32.518 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/intel/qat/qat_common/ 2023-12-08T08:05:32.518 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 438761 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-08T08:05:32.518 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-12-08T08:05:32.518 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-08T08:05:32.518 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/padlock-aes.ko 2023-12-08T08:05:32.518 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/padlock-sha.ko 2023-12-08T08:05:32.518 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/virtio/ 2023-12-08T08:05:32.518 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 70273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-08T08:05:32.518 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dca/ 2023-12-08T08:05:32.518 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dca/dca.ko 2023-12-08T08:05:32.518 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dma/ 2023-12-08T08:05:32.518 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dma/dw/ 2023-12-08T08:05:32.518 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-08T08:05:32.519 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dma/ioat/ 2023-12-08T08:05:32.519 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 122569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-08T08:05:32.519 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/ 2023-12-08T08:05:32.519 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 79953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/amd64_edac.ko 2023-12-08T08:05:32.519 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35769 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/e752x_edac.ko 2023-12-08T08:05:32.519 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 63617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/edac_mce_amd.ko 2023-12-08T08:05:32.519 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i3000_edac.ko 2023-12-08T08:05:32.519 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i3200_edac.ko 2023-12-08T08:05:32.519 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i5100_edac.ko 2023-12-08T08:05:32.519 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i5400_edac.ko 2023-12-08T08:05:32.519 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24913 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i7300_edac.ko 2023-12-08T08:05:32.519 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 52041 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i7core_edac.ko 2023-12-08T08:05:32.519 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i82975x_edac.ko 2023-12-08T08:05:32.519 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/ie31200_edac.ko 2023-12-08T08:05:32.519 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 56825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/sb_edac.ko 2023-12-08T08:05:32.520 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/x38_edac.ko 2023-12-08T08:05:32.520 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/extcon/ 2023-12-08T08:05:32.520 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/extcon/extcon-gpio.ko 2023-12-08T08:05:32.520 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/extcon/extcon-max14577.ko 2023-12-08T08:05:32.520 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/extcon/extcon-max77693.ko 2023-12-08T08:05:32.520 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/extcon/extcon-max8997.ko 2023-12-08T08:05:32.520 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/extcon/extcon-palmas.ko 2023-12-08T08:05:32.520 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23713 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/extcon/extcon-rt8973a.ko 2023-12-08T08:05:32.520 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/extcon/extcon-sm5502.ko 2023-12-08T08:05:32.520 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/firmware/ 2023-12-08T08:05:32.520 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34977 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/firmware/dmi-sysfs.ko 2023-12-08T08:05:32.520 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/firmware/efi/ 2023-12-08T08:05:32.520 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/firmware/efi/efi-pstore.ko 2023-12-08T08:05:32.520 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-08T08:05:32.520 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/ 2023-12-08T08:05:32.521 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-adp5520.ko 2023-12-08T08:05:32.521 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20153 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-amd8111.ko 2023-12-08T08:05:32.521 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-arizona.ko 2023-12-08T08:05:32.521 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-da9052.ko 2023-12-08T08:05:32.521 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-da9055.ko 2023-12-08T08:05:32.521 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-dln2.ko 2023-12-08T08:05:32.521 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 77849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-f7188x.ko 2023-12-08T08:05:32.521 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-generic.ko 2023-12-08T08:05:32.521 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-ich.ko 2023-12-08T08:05:32.521 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11905 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-12-08T08:05:32.521 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-kempld.ko 2023-12-08T08:05:32.521 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-lp3943.ko 2023-12-08T08:05:32.521 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-max7300.ko 2023-12-08T08:05:32.521 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11905 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-max730x.ko 2023-12-08T08:05:32.522 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-max732x.ko 2023-12-08T08:05:32.522 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-12-08T08:05:32.522 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 47073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-pca953x.ko 2023-12-08T08:05:32.522 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-pcf857x.ko 2023-12-08T08:05:32.522 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14377 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-rdc321x.ko 2023-12-08T08:05:32.522 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-sch.ko 2023-12-08T08:05:32.522 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-sch311x.ko 2023-12-08T08:05:32.522 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-tps65912.ko 2023-12-08T08:05:32.522 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-twl4030.ko 2023-12-08T08:05:32.522 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-twl6040.ko 2023-12-08T08:05:32.522 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-08T08:05:32.522 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15377 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-vx855.ko 2023-12-08T08:05:32.522 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16281 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-wm831x.ko 2023-12-08T08:05:32.522 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-wm8350.ko 2023-12-08T08:05:32.523 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-wm8994.ko 2023-12-08T08:05:32.523 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/ 2023-12-08T08:05:32.523 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-a4tech.ko 2023-12-08T08:05:32.523 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 39169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-apple.ko 2023-12-08T08:05:32.523 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-appleir.ko 2023-12-08T08:05:32.523 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8353 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-aureal.ko 2023-12-08T08:05:32.523 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-axff.ko 2023-12-08T08:05:32.523 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-belkin.ko 2023-12-08T08:05:32.523 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-cherry.ko 2023-12-08T08:05:32.523 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16041 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-chicony.ko 2023-12-08T08:05:32.523 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 60649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-cp2112.ko 2023-12-08T08:05:32.523 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-cypress.ko 2023-12-08T08:05:32.523 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-dr.ko 2023-12-08T08:05:32.524 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-elecom.ko 2023-12-08T08:05:32.524 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-elo.ko 2023-12-08T08:05:32.524 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13457 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-emsff.ko 2023-12-08T08:05:32.524 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-ezkey.ko 2023-12-08T08:05:32.524 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-gaff.ko 2023-12-08T08:05:32.524 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-generic.ko 2023-12-08T08:05:32.524 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-gt683r.ko 2023-12-08T08:05:32.524 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-gyration.ko 2023-12-08T08:05:32.524 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10161 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-08T08:05:32.524 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10457 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-08T08:05:32.524 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-holtekff.ko 2023-12-08T08:05:32.524 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-hyperv.ko 2023-12-08T08:05:32.524 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-icade.ko 2023-12-08T08:05:32.524 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-kensington.ko 2023-12-08T08:05:32.525 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8545 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-keytouch.ko 2023-12-08T08:05:32.525 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-kye.ko 2023-12-08T08:05:32.525 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-lcpower.ko 2023-12-08T08:05:32.525 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-led.ko 2023-12-08T08:05:32.525 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-lenovo.ko 2023-12-08T08:05:32.525 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-lg-g15.ko 2023-12-08T08:05:32.525 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 58185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-08T08:05:32.525 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 101481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-08T08:05:32.525 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 80993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-logitech.ko 2023-12-08T08:05:32.525 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-magicmouse.ko 2023-12-08T08:05:32.525 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-microsoft.ko 2023-12-08T08:05:32.525 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10361 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-monterey.ko 2023-12-08T08:05:32.525 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 50161 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-multitouch.ko 2023-12-08T08:05:32.525 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-ntrig.ko 2023-12-08T08:05:32.525 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-ortek.ko 2023-12-08T08:05:32.525 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-penmount.ko 2023-12-08T08:05:32.526 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-petalynx.ko 2023-12-08T08:05:32.526 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 72937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-picolcd.ko 2023-12-08T08:05:32.526 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-pl.ko 2023-12-08T08:05:32.526 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-plantronics.ko 2023-12-08T08:05:32.526 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8417 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-primax.ko 2023-12-08T08:05:32.526 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-rmi.ko 2023-12-08T08:05:32.526 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-08T08:05:32.526 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-common.ko 2023-12-08T08:05:32.526 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-08T08:05:32.526 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-08T08:05:32.526 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-08T08:05:32.526 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-08T08:05:32.526 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-08T08:05:32.526 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-08T08:05:32.527 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-08T08:05:32.527 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-08T08:05:32.527 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-08T08:05:32.527 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat.ko 2023-12-08T08:05:32.527 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-saitek.ko 2023-12-08T08:05:32.527 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-samsung.ko 2023-12-08T08:05:32.527 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-08T08:05:32.527 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-sjoy.ko 2023-12-08T08:05:32.527 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 51249 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-sony.ko 2023-12-08T08:05:32.527 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-speedlink.ko 2023-12-08T08:05:32.527 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-steelseries.ko 2023-12-08T08:05:32.527 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-sunplus.ko 2023-12-08T08:05:32.527 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-08T08:05:32.527 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-tivo.ko 2023-12-08T08:05:32.527 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-tmff.ko 2023-12-08T08:05:32.528 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-topseed.ko 2023-12-08T08:05:32.528 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-twinhan.ko 2023-12-08T08:05:32.528 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 71073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-uclogic.ko 2023-12-08T08:05:32.528 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-waltop.ko 2023-12-08T08:05:32.528 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 143473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-wiimote.ko 2023-12-08T08:05:32.528 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8153 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-xinmo.ko 2023-12-08T08:05:32.528 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-zpff.ko 2023-12-08T08:05:32.528 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-zydacron.ko 2023-12-08T08:05:32.528 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 267825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid.ko 2023-12-08T08:05:32.528 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/uhid.ko 2023-12-08T08:05:32.528 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/usbhid/ 2023-12-08T08:05:32.528 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 125721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/usbhid/usbhid.ko 2023-12-08T08:05:32.528 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/usbhid/usbkbd.ko 2023-12-08T08:05:32.528 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/usbhid/usbmouse.ko 2023-12-08T08:05:32.529 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 217873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/wacom.ko 2023-12-08T08:05:32.529 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hv/ 2023-12-08T08:05:32.529 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 64201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hv/hv_balloon.ko 2023-12-08T08:05:32.529 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 89625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hv/hv_utils.ko 2023-12-08T08:05:32.529 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 305465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hv/hv_vmbus.ko 2023-12-08T08:05:32.529 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ 2023-12-08T08:05:32.529 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 66521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/abituguru.ko 2023-12-08T08:05:32.529 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 61393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/abituguru3.ko 2023-12-08T08:05:32.529 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-08T08:05:32.529 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ad7414.ko 2023-12-08T08:05:32.529 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ad7418.ko 2023-12-08T08:05:32.529 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adc128d818.ko 2023-12-08T08:05:32.529 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adm1025.ko 2023-12-08T08:05:32.529 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 97977 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adm1026.ko 2023-12-08T08:05:32.529 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adm1029.ko 2023-12-08T08:05:32.530 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 45553 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adm1031.ko 2023-12-08T08:05:32.530 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adm9240.ko 2023-12-08T08:05:32.530 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14769 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ads7828.ko 2023-12-08T08:05:32.530 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10769 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adt7410.ko 2023-12-08T08:05:32.530 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adt7411.ko 2023-12-08T08:05:32.530 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 74433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adt7462.ko 2023-12-08T08:05:32.530 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 39585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adt7470.ko 2023-12-08T08:05:32.530 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 67929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adt7475.ko 2023-12-08T08:05:32.530 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adt7x10.ko 2023-12-08T08:05:32.530 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 39073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/amc6821.ko 2023-12-08T08:05:32.530 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 55201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/applesmc.ko 2023-12-08T08:05:32.530 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 49913 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/asb100.ko 2023-12-08T08:05:32.530 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 58617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/asc7621.ko 2023-12-08T08:05:32.530 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-08T08:05:32.530 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/atxp1.ko 2023-12-08T08:05:32.531 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28281 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/coretemp.ko 2023-12-08T08:05:32.531 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/da9052-hwmon.ko 2023-12-08T08:05:32.531 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/da9055-hwmon.ko 2023-12-08T08:05:32.531 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-08T08:05:32.531 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 99601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/dme1737.ko 2023-12-08T08:05:32.531 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ds1621.ko 2023-12-08T08:05:32.531 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ds620.ko 2023-12-08T08:05:32.531 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29777 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/emc1403.ko 2023-12-08T08:05:32.531 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/emc2103.ko 2023-12-08T08:05:32.531 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/emc6w201.ko 2023-12-08T08:05:32.531 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 66985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/f71805f.ko 2023-12-08T08:05:32.531 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 94457 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/f71882fg.ko 2023-12-08T08:05:32.531 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/f75375s.ko 2023-12-08T08:05:32.531 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/fam15h_power.ko 2023-12-08T08:05:32.531 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 55449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/fschmd.ko 2023-12-08T08:05:32.531 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/g760a.ko 2023-12-08T08:05:32.532 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/g762.ko 2023-12-08T08:05:32.532 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 46801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/gl518sm.ko 2023-12-08T08:05:32.532 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 45529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/gl520sm.ko 2023-12-08T08:05:32.532 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/hih6130.ko 2023-12-08T08:05:32.532 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-08T08:05:32.532 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11553 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/i5500_temp.ko 2023-12-08T08:05:32.532 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/i5k_amb.ko 2023-12-08T08:05:32.532 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ibmaem.ko 2023-12-08T08:05:32.532 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ibmpex.ko 2023-12-08T08:05:32.532 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ina209.ko 2023-12-08T08:05:32.532 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ina2xx.ko 2023-12-08T08:05:32.532 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 130449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/it87.ko 2023-12-08T08:05:32.532 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/jc42.ko 2023-12-08T08:05:32.532 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/k10temp.ko 2023-12-08T08:05:32.532 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13553 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/k8temp.ko 2023-12-08T08:05:32.533 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lineage-pem.ko 2023-12-08T08:05:32.533 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 48601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm63.ko 2023-12-08T08:05:32.533 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm73.ko 2023-12-08T08:05:32.533 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36777 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm75.ko 2023-12-08T08:05:32.533 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm77.ko 2023-12-08T08:05:32.533 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm78.ko 2023-12-08T08:05:32.533 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm80.ko 2023-12-08T08:05:32.533 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16889 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm83.ko 2023-12-08T08:05:32.533 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 72833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm85.ko 2023-12-08T08:05:32.533 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 46153 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm87.ko 2023-12-08T08:05:32.533 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37913 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm90.ko 2023-12-08T08:05:32.533 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm92.ko 2023-12-08T08:05:32.533 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 108841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm93.ko 2023-12-08T08:05:32.533 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm95234.ko 2023-12-08T08:05:32.533 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm95241.ko 2023-12-08T08:05:32.534 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm95245.ko 2023-12-08T08:05:32.534 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc2945.ko 2023-12-08T08:05:32.534 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc4151.ko 2023-12-08T08:05:32.534 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc4215.ko 2023-12-08T08:05:32.534 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14889 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc4222.ko 2023-12-08T08:05:32.534 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc4245.ko 2023-12-08T08:05:32.534 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13249 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc4260.ko 2023-12-08T08:05:32.534 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc4261.ko 2023-12-08T08:05:32.534 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max16065.ko 2023-12-08T08:05:32.534 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max1619.ko 2023-12-08T08:05:32.534 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24353 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max1668.ko 2023-12-08T08:05:32.534 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max197.ko 2023-12-08T08:05:32.534 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max6639.ko 2023-12-08T08:05:32.534 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max6650.ko 2023-12-08T08:05:32.534 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35777 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max6697.ko 2023-12-08T08:05:32.535 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/mc13783-adc.ko 2023-12-08T08:05:32.535 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/mcp3021.ko 2023-12-08T08:05:32.535 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-12-08T08:05:32.535 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/nct6683.ko 2023-12-08T08:05:32.535 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 119817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/nct6775-core.ko 2023-12-08T08:05:32.535 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 60705 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/nct6775.ko 2023-12-08T08:05:32.535 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 59737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/nct7802.ko 2023-12-08T08:05:32.535 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 82337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pc87360.ko 2023-12-08T08:05:32.535 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 54433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pc87427.ko 2023-12-08T08:05:32.535 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pcf8591.ko 2023-12-08T08:05:32.535 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/ 2023-12-08T08:05:32.535 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21353 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-08T08:05:32.535 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-08T08:05:32.535 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-08T08:05:32.535 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-08T08:05:32.536 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-08T08:05:32.536 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-08T08:05:32.536 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-08T08:05:32.536 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 82577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-08T08:05:32.536 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-08T08:05:32.536 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-08T08:05:32.536 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-08T08:05:32.536 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-08T08:05:32.536 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/powr1220.ko 2023-12-08T08:05:32.536 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18705 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/sch5627.ko 2023-12-08T08:05:32.536 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/sch5636.ko 2023-12-08T08:05:32.536 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-08T08:05:32.536 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/sht15.ko 2023-12-08T08:05:32.536 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/sht21.ko 2023-12-08T08:05:32.536 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/shtc1.ko 2023-12-08T08:05:32.537 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/sis5595.ko 2023-12-08T08:05:32.537 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/smsc47b397.ko 2023-12-08T08:05:32.537 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 39193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/smsc47m1.ko 2023-12-08T08:05:32.537 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/smsc47m192.ko 2023-12-08T08:05:32.537 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26553 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/thmc50.ko 2023-12-08T08:05:32.537 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/tmp102.ko 2023-12-08T08:05:32.537 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/tmp103.ko 2023-12-08T08:05:32.537 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/tmp401.ko 2023-12-08T08:05:32.537 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/tmp421.ko 2023-12-08T08:05:32.537 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/via-cputemp.ko 2023-12-08T08:05:32.537 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41945 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/via686a.ko 2023-12-08T08:05:32.537 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 52457 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/vt1211.ko 2023-12-08T08:05:32.537 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 51545 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/vt8231.ko 2023-12-08T08:05:32.537 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 57449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83627ehf.ko 2023-12-08T08:05:32.537 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 78873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83627hf.ko 2023-12-08T08:05:32.538 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 71345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83781d.ko 2023-12-08T08:05:32.538 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 63225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83791d.ko 2023-12-08T08:05:32.538 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 71321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83792d.ko 2023-12-08T08:05:32.538 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 101473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83793.ko 2023-12-08T08:05:32.538 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 119505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83795.ko 2023-12-08T08:05:32.538 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83l785ts.ko 2023-12-08T08:05:32.538 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83l786ng.ko 2023-12-08T08:05:32.538 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-12-08T08:05:32.538 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-12-08T08:05:32.538 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/ 2023-12-08T08:05:32.538 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/algos/ 2023-12-08T08:05:32.538 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-08T08:05:32.538 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-08T08:05:32.538 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/ 2023-12-08T08:05:32.539 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-12-08T08:05:32.539 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-12-08T08:05:32.539 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27777 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-12-08T08:05:32.539 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-08T08:05:32.539 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-08T08:05:32.539 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-08T08:05:32.539 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15153 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-12-08T08:05:32.539 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 6929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-08T08:05:32.539 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-12-08T08:05:32.539 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 50201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-08T08:05:32.539 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23905 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-08T08:05:32.539 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20001 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-08T08:05:32.539 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-08T08:05:32.539 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-12-08T08:05:32.540 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-12-08T08:05:32.540 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 62817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-08T08:05:32.540 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-08T08:05:32.540 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 47889 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-08T08:05:32.540 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-12-08T08:05:32.540 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-08T08:05:32.540 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-08T08:05:32.540 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-12-08T08:05:32.540 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-08T08:05:32.540 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-08T08:05:32.540 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 47241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-08T08:05:32.540 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-12-08T08:05:32.540 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-08T08:05:32.540 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-08T08:05:32.540 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-12-08T08:05:32.541 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29361 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-12-08T08:05:32.541 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-08T08:05:32.541 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-12-08T08:05:32.541 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-08T08:05:32.541 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-08T08:05:32.541 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-08T08:05:32.541 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19041 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-08T08:05:32.541 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 47657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-12-08T08:05:32.541 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/i2c-mux.ko 2023-12-08T08:05:32.541 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/i2c-smbus.ko 2023-12-08T08:05:32.541 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/i2c-stub.ko 2023-12-08T08:05:32.541 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/muxes/ 2023-12-08T08:05:32.541 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-12-08T08:05:32.541 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13457 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-12-08T08:05:32.541 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-12-08T08:05:32.542 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ 2023-12-08T08:05:32.542 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/ 2023-12-08T08:05:32.542 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 273609 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-08T08:05:32.542 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 879969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/ib_core.ko 2023-12-08T08:05:32.542 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 69273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-08T08:05:32.542 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 324217 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-08T08:05:32.542 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 97985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-08T08:05:32.542 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 282273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-08T08:05:32.542 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 66201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-08T08:05:32.542 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/ 2023-12-08T08:05:32.542 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/cxgb4/ 2023-12-08T08:05:32.542 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 493073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-08T08:05:32.542 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/mlx4/ 2023-12-08T08:05:32.542 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 419737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-08T08:05:32.543 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/mlx5/ 2023-12-08T08:05:32.543 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 739025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-08T08:05:32.543 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/mthca/ 2023-12-08T08:05:32.543 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 296625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-08T08:05:32.543 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/ocrdma/ 2023-12-08T08:05:32.543 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 153697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-12-08T08:05:32.543 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/usnic/ 2023-12-08T08:05:32.543 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 168969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-12-08T08:05:32.543 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/ 2023-12-08T08:05:32.543 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/ipoib/ 2023-12-08T08:05:32.543 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 263081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-08T08:05:32.543 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/iser/ 2023-12-08T08:05:32.543 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 100241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-08T08:05:32.543 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/isert/ 2023-12-08T08:05:32.543 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 111425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-08T08:05:32.544 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/srp/ 2023-12-08T08:05:32.544 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 128753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-08T08:05:32.544 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/srpt/ 2023-12-08T08:05:32.544 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 129529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-08T08:05:32.544 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/ 2023-12-08T08:05:32.544 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/evbug.ko 2023-12-08T08:05:32.544 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/ff-memless.ko 2023-12-08T08:05:32.544 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/gameport/ 2023-12-08T08:05:32.544 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-08T08:05:32.544 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-08T08:05:32.544 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/gameport/gameport.ko 2023-12-08T08:05:32.544 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/joydev.ko 2023-12-08T08:05:32.544 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/ 2023-12-08T08:05:32.544 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-12-08T08:05:32.544 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-12-08T08:05:32.545 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-12-08T08:05:32.545 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24761 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-12-08T08:05:32.545 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-08T08:05:32.545 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-12-08T08:05:32.545 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/lkkbd.ko 2023-12-08T08:05:32.545 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/lm8323.ko 2023-12-08T08:05:32.545 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/lm8333.ko 2023-12-08T08:05:32.545 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-12-08T08:05:32.545 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18217 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-12-08T08:05:32.545 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-12-08T08:05:32.545 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-12-08T08:05:32.545 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/newtonkbd.ko 2023-12-08T08:05:32.545 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-12-08T08:05:32.545 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14161 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/qt1070.ko 2023-12-08T08:05:32.545 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/qt2160.ko 2023-12-08T08:05:32.546 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-12-08T08:05:32.546 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/stowaway.ko 2023-12-08T08:05:32.546 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/sunkbd.ko 2023-12-08T08:05:32.546 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-12-08T08:05:32.546 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16177 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-12-08T08:05:32.546 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-12-08T08:05:32.546 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/xtkbd.ko 2023-12-08T08:05:32.546 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/matrix-keymap.ko 2023-12-08T08:05:32.546 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/ 2023-12-08T08:05:32.546 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/appletouch.ko 2023-12-08T08:05:32.546 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34177 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/bcm5974.ko 2023-12-08T08:05:32.546 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 123681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/cyapatp.ko 2023-12-08T08:05:32.546 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 89449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-08T08:05:32.546 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/gpio_mouse.ko 2023-12-08T08:05:32.547 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 335929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/psmouse.ko 2023-12-08T08:05:32.547 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/sermouse.ko 2023-12-08T08:05:32.547 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-08T08:05:32.547 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-08T08:05:32.547 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-08T08:05:32.547 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/rmi4/ 2023-12-08T08:05:32.547 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 109873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-08T08:05:32.547 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/ 2023-12-08T08:05:32.547 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/altera_ps2.ko 2023-12-08T08:05:32.547 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/arc_ps2.ko 2023-12-08T08:05:32.547 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/ct82c710.ko 2023-12-08T08:05:32.547 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-08T08:05:32.547 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/parkbd.ko 2023-12-08T08:05:32.547 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/pcips2.ko 2023-12-08T08:05:32.548 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20153 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/ps2mult.ko 2023-12-08T08:05:32.548 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24153 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/serio_raw.ko 2023-12-08T08:05:32.548 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17977 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/serport.ko 2023-12-08T08:05:32.548 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/sparse-keymap.ko 2023-12-08T08:05:32.548 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/iommu/ 2023-12-08T08:05:32.548 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/iommu/amd/ 2023-12-08T08:05:32.548 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 39289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-08T08:05:32.548 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/ 2023-12-08T08:05:32.548 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-88pm860x.ko 2023-12-08T08:05:32.548 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-adp5520.ko 2023-12-08T08:05:32.548 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 59753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-bd2802.ko 2023-12-08T08:05:32.548 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-blinkm.ko 2023-12-08T08:05:32.548 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-da903x.ko 2023-12-08T08:05:32.548 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-da9052.ko 2023-12-08T08:05:32.549 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16561 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-gpio.ko 2023-12-08T08:05:32.549 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-lm3530.ko 2023-12-08T08:05:32.549 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-lm3533.ko 2023-12-08T08:05:32.549 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19353 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-lm355x.ko 2023-12-08T08:05:32.549 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-lm3642.ko 2023-12-08T08:05:32.549 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-lp3944.ko 2023-12-08T08:05:32.549 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11233 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-lp8788.ko 2023-12-08T08:05:32.549 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-max8997.ko 2023-12-08T08:05:32.549 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12545 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-mc13783.ko 2023-12-08T08:05:32.549 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-menf21bmc.ko 2023-12-08T08:05:32.549 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-pca9532.ko 2023-12-08T08:05:32.549 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-pca955x.ko 2023-12-08T08:05:32.549 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-pca963x.ko 2023-12-08T08:05:32.549 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-ss4200.ko 2023-12-08T08:05:32.550 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-tca6507.ko 2023-12-08T08:05:32.550 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-wm831x-status.ko 2023-12-08T08:05:32.550 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-wm8350.ko 2023-12-08T08:05:32.550 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ 2023-12-08T08:05:32.550 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-08T08:05:32.550 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-08T08:05:32.550 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-08T08:05:32.550 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-08T08:05:32.550 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14249 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-08T08:05:32.550 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-08T08:05:32.550 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11889 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-08T08:05:32.550 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-08T08:05:32.550 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/ 2023-12-08T08:05:32.550 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/bcache/ 2023-12-08T08:05:32.551 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 654969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/bcache/bcache.ko 2023-12-08T08:05:32.551 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-bio-prison.ko 2023-12-08T08:05:32.551 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 89601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-bufio.ko 2023-12-08T08:05:32.551 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 47529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-cache-smq.ko 2023-12-08T08:05:32.551 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 156009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-cache.ko 2023-12-08T08:05:32.551 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 106897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-crypt.ko 2023-12-08T08:05:32.551 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21545 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-delay.ko 2023-12-08T08:05:32.551 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 53857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-era.ko 2023-12-08T08:05:32.551 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-flakey.ko 2023-12-08T08:05:32.551 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-log-userspace.ko 2023-12-08T08:05:32.551 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-log.ko 2023-12-08T08:05:32.551 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 49545 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-mirror.ko 2023-12-08T08:05:32.551 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 78033 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-multipath.ko 2023-12-08T08:05:32.551 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-queue-length.ko 2023-12-08T08:05:32.551 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 70825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-raid.ko 2023-12-08T08:05:32.552 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-region-hash.ko 2023-12-08T08:05:32.552 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-round-robin.ko 2023-12-08T08:05:32.552 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-service-time.ko 2023-12-08T08:05:32.552 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 109529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-snapshot.ko 2023-12-08T08:05:32.552 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19361 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-switch.ko 2023-12-08T08:05:32.552 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 181865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-thin-pool.ko 2023-12-08T08:05:32.552 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 51737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-verity.ko 2023-12-08T08:05:32.552 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8561 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-zero.ko 2023-12-08T08:05:32.552 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/faulty.ko 2023-12-08T08:05:32.552 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/linear.ko 2023-12-08T08:05:32.552 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32417 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/multipath.ko 2023-12-08T08:05:32.552 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/persistent-data/ 2023-12-08T08:05:32.552 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 199937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-08T08:05:32.552 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/raid0.ko 2023-12-08T08:05:32.552 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 113073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/raid1.ko 2023-12-08T08:05:32.553 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 158681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/raid10.ko 2023-12-08T08:05:32.553 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 395721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/raid456.ko 2023-12-08T08:05:32.553 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/ 2023-12-08T08:05:32.553 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/ 2023-12-08T08:05:32.553 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 178137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptbase.ko 2023-12-08T08:05:32.553 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 63385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptctl.ko 2023-12-08T08:05:32.553 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptfc.ko 2023-12-08T08:05:32.553 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptlan.ko 2023-12-08T08:05:32.553 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 123321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptsas.ko 2023-12-08T08:05:32.553 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 79041 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptscsih.ko 2023-12-08T08:05:32.553 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 53017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptspi.ko 2023-12-08T08:05:32.553 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/ 2023-12-08T08:05:32.553 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/88pm800.ko 2023-12-08T08:05:32.553 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12761 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/88pm805.ko 2023-12-08T08:05:32.554 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/88pm80x.ko 2023-12-08T08:05:32.554 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/arizona-i2c.ko 2023-12-08T08:05:32.554 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 123721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/arizona.ko 2023-12-08T08:05:32.554 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/bcm590xx.ko 2023-12-08T08:05:32.554 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/cros_ec_dev.ko 2023-12-08T08:05:32.554 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/dln2.ko 2023-12-08T08:05:32.554 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16689 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/janz-cmodio.ko 2023-12-08T08:05:32.554 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 53585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/kempld-core.ko 2023-12-08T08:05:32.554 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/lm3533-core.ko 2023-12-08T08:05:32.554 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-12-08T08:05:32.554 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/lp3943.ko 2023-12-08T08:05:32.554 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 54569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/lpc_ich.ko 2023-12-08T08:05:32.554 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/lpc_sch.ko 2023-12-08T08:05:32.554 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/max8907.ko 2023-12-08T08:05:32.555 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/mc13xxx-core.ko 2023-12-08T08:05:32.555 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-12-08T08:05:32.555 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/menf21bmc.ko 2023-12-08T08:05:32.555 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/pcf50633-adc.ko 2023-12-08T08:05:32.555 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9153 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/pcf50633-gpio.ko 2023-12-08T08:05:32.555 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/pcf50633.ko 2023-12-08T08:05:32.555 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-12-08T08:05:32.555 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/retu-mfd.ko 2023-12-08T08:05:32.555 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 80425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/si476x-core.ko 2023-12-08T08:05:32.555 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 48457 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/sm501.ko 2023-12-08T08:05:32.555 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-12-08T08:05:32.555 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 51137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/tps65010.ko 2023-12-08T08:05:32.555 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10353 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/tps6507x.ko 2023-12-08T08:05:32.555 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/viperboard.ko 2023-12-08T08:05:32.556 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/vx855.ko 2023-12-08T08:05:32.556 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/wl1273-core.ko 2023-12-08T08:05:32.556 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/wm8994.ko 2023-12-08T08:05:32.556 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/ 2023-12-08T08:05:32.556 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-12-08T08:05:32.556 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 48489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/ad525x_dpot.ko 2023-12-08T08:05:32.556 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/altera-stapl/ 2023-12-08T08:05:32.556 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 46585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-08T08:05:32.556 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/apds9802als.ko 2023-12-08T08:05:32.556 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/apds990x.ko 2023-12-08T08:05:32.556 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 45593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/bh1770glc.ko 2023-12-08T08:05:32.556 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/c2port/ 2023-12-08T08:05:32.556 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-12-08T08:05:32.556 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35281 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/c2port/core.ko 2023-12-08T08:05:32.556 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/cb710/ 2023-12-08T08:05:32.557 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25161 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/cb710/cb710.ko 2023-12-08T08:05:32.557 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/ds1682.ko 2023-12-08T08:05:32.557 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/dummy-irq.ko 2023-12-08T08:05:32.557 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/echo/ 2023-12-08T08:05:32.557 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/echo/echo.ko 2023-12-08T08:05:32.557 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/eeprom/ 2023-12-08T08:05:32.557 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/eeprom/at24.ko 2023-12-08T08:05:32.557 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-08T08:05:32.557 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14769 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-08T08:05:32.557 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/eeprom/max6875.ko 2023-12-08T08:05:32.557 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/enclosure.ko 2023-12-08T08:05:32.557 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/genwqe/ 2023-12-08T08:05:32.557 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 152201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-12-08T08:05:32.557 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/hmc6352.ko 2023-12-08T08:05:32.557 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/hpilo.ko 2023-12-08T08:05:32.558 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/ibmasm/ 2023-12-08T08:05:32.558 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 72129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-12-08T08:05:32.558 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/ics932s401.ko 2023-12-08T08:05:32.558 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/isl29003.ko 2023-12-08T08:05:32.558 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/isl29020.ko 2023-12-08T08:05:32.558 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/lis3lv02d/ 2023-12-08T08:05:32.558 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42513 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-08T08:05:32.558 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-08T08:05:32.558 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/mei/ 2023-12-08T08:05:32.558 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 125209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/mei/mei-me.ko 2023-12-08T08:05:32.558 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 56521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/mei/mei-txe.ko 2023-12-08T08:05:32.558 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 310113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/mei/mei.ko 2023-12-08T08:05:32.558 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/phantom.ko 2023-12-08T08:05:32.558 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/ti-st/ 2023-12-08T08:05:32.559 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 74265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/ti-st/st_drv.ko 2023-12-08T08:05:32.559 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/tifm_7xx1.ko 2023-12-08T08:05:32.559 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/tifm_core.ko 2023-12-08T08:05:32.559 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/tsl2550.ko 2023-12-08T08:05:32.559 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 48697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/vmw_balloon.ko 2023-12-08T08:05:32.559 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/vmw_vmci/ 2023-12-08T08:05:32.559 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 183609 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-08T08:05:32.559 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ 2023-12-08T08:05:32.559 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/bonding/ 2023-12-08T08:05:32.559 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 490129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/bonding/bonding.ko 2023-12-08T08:05:32.559 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa/ 2023-12-08T08:05:32.559 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa/b53/ 2023-12-08T08:05:32.559 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 106033 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-08T08:05:32.559 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40417 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-08T08:05:32.559 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16041 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-08T08:05:32.560 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa/mv88e6xxx/ 2023-12-08T08:05:32.560 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 453737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-08T08:05:32.560 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dummy.ko 2023-12-08T08:05:32.560 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/eql.ko 2023-12-08T08:05:32.560 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/ 2023-12-08T08:05:32.560 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/3com/ 2023-12-08T08:05:32.560 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 45785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-08T08:05:32.560 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-08T08:05:32.560 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 130553 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-08T08:05:32.560 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 68849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-08T08:05:32.560 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/8390/ 2023-12-08T08:05:32.560 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-08T08:05:32.560 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 59689 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-08T08:05:32.560 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-08T08:05:32.560 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 99049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-08T08:05:32.561 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/adaptec/ 2023-12-08T08:05:32.561 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 54521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-08T08:05:32.561 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/agere/ 2023-12-08T08:05:32.561 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 69137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-08T08:05:32.561 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/alteon/ 2023-12-08T08:05:32.561 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 59585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-08T08:05:32.561 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/altera/ 2023-12-08T08:05:32.561 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-08T08:05:32.561 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/amd/ 2023-12-08T08:05:32.561 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 54609 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-08T08:05:32.561 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 49289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-08T08:05:32.561 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 87297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-08T08:05:32.561 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/ 2023-12-08T08:05:32.561 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/alx/ 2023-12-08T08:05:32.561 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 97337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-08T08:05:32.562 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-12-08T08:05:32.562 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 104673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-08T08:05:32.562 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-12-08T08:05:32.562 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 90257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-08T08:05:32.562 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atlx/ 2023-12-08T08:05:32.562 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 81569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-08T08:05:32.562 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 69729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-08T08:05:32.562 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/ 2023-12-08T08:05:32.562 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 78401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-08T08:05:32.562 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 176761 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-08T08:05:32.562 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-12-08T08:05:32.562 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1421497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-08T08:05:32.562 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 128569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-08T08:05:32.562 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/genet/ 2023-12-08T08:05:32.563 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 132089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-08T08:05:32.563 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 312081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-08T08:05:32.563 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/brocade/ 2023-12-08T08:05:32.563 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/brocade/bna/ 2023-12-08T08:05:32.563 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 323513 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-08T08:05:32.563 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/ 2023-12-08T08:05:32.563 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-12-08T08:05:32.563 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 193497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-08T08:05:32.563 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-12-08T08:05:32.563 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 347417 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-08T08:05:32.563 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-12-08T08:05:32.563 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1044497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-08T08:05:32.563 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-12-08T08:05:32.563 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 166193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-08T08:05:32.564 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-12-08T08:05:32.564 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-08T08:05:32.564 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/cisco/ 2023-12-08T08:05:32.564 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/cisco/enic/ 2023-12-08T08:05:32.564 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 204345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-08T08:05:32.564 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/ 2023-12-08T08:05:32.564 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip/ 2023-12-08T08:05:32.564 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 69449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-08T08:05:32.564 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 61489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-08T08:05:32.564 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 141225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-08T08:05:32.564 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 51497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-08T08:05:32.564 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 62817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-08T08:05:32.564 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31369 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-08T08:05:32.564 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dlink/ 2023-12-08T08:05:32.564 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 60873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-08T08:05:32.565 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 62833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-08T08:05:32.565 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 45721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dnet.ko 2023-12-08T08:05:32.565 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/ec_bhf.ko 2023-12-08T08:05:32.565 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/emulex/ 2023-12-08T08:05:32.565 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/emulex/benet/ 2023-12-08T08:05:32.565 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 281137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-08T08:05:32.565 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 49457 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/ethoc.ko 2023-12-08T08:05:32.565 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 51737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/fealnx.ko 2023-12-08T08:05:32.565 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/fujitsu/ 2023-12-08T08:05:32.565 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 45345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-12-08T08:05:32.565 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/ 2023-12-08T08:05:32.565 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 90465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-08T08:05:32.565 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/e1000/ 2023-12-08T08:05:32.565 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 295577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-08T08:05:32.566 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/e1000e/ 2023-12-08T08:05:32.566 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 584497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-08T08:05:32.566 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/fm10k/ 2023-12-08T08:05:32.566 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 246209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-08T08:05:32.566 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/i40e/ 2023-12-08T08:05:32.566 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 925825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-08T08:05:32.566 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/iavf/ 2023-12-08T08:05:32.566 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 302937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-08T08:05:32.566 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/igb/ 2023-12-08T08:05:32.566 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 514641 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-08T08:05:32.566 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/igbvf/ 2023-12-08T08:05:32.566 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 93593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-08T08:05:32.566 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-12-08T08:05:32.566 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 734305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-08T08:05:32.567 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-12-08T08:05:32.567 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 151769 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-08T08:05:32.567 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 86921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/jme.ko 2023-12-08T08:05:32.567 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/marvell/ 2023-12-08T08:05:32.567 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20977 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-08T08:05:32.567 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 102289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-08T08:05:32.567 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 122649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-08T08:05:32.637 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox/ 2023-12-08T08:05:32.637 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-12-08T08:05:32.637 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 727601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-08T08:05:32.637 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 278937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-08T08:05:32.637 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-12-08T08:05:32.637 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-12-08T08:05:32.637 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1113681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-08T08:05:32.638 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/micrel/ 2023-12-08T08:05:32.638 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 53041 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-12-08T08:05:32.638 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-12-08T08:05:32.638 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-12-08T08:05:32.638 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 95665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-08T08:05:32.638 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/myricom/ 2023-12-08T08:05:32.638 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-12-08T08:05:32.638 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 108649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-08T08:05:32.638 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/natsemi/ 2023-12-08T08:05:32.638 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 73441 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-08T08:05:32.638 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 47777 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-08T08:05:32.638 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/neterion/ 2023-12-08T08:05:32.638 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 150905 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-08T08:05:32.638 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/nvidia/ 2023-12-08T08:05:32.639 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 136721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-08T08:05:32.639 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/packetengines/ 2023-12-08T08:05:32.639 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 50481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-08T08:05:32.639 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 43145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-08T08:05:32.639 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/qlogic/ 2023-12-08T08:05:32.639 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-12-08T08:05:32.639 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 227897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-08T08:05:32.639 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 87081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-08T08:05:32.639 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-12-08T08:05:32.639 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 672049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-08T08:05:32.639 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/rdc/ 2023-12-08T08:05:32.639 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 43017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-08T08:05:32.639 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/realtek/ 2023-12-08T08:05:32.639 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 67385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-08T08:05:32.639 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 83985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-08T08:05:32.640 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-08T08:05:32.640 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 189801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-08T08:05:32.640 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/samsung/ 2023-12-08T08:05:32.640 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-12-08T08:05:32.640 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 104241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-12-08T08:05:32.640 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sfc/ 2023-12-08T08:05:32.640 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1052497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-08T08:05:32.640 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/silan/ 2023-12-08T08:05:32.640 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 47097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-08T08:05:32.640 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sis/ 2023-12-08T08:05:32.640 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 54817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-08T08:05:32.640 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 63337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-08T08:05:32.640 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/smsc/ 2023-12-08T08:05:32.640 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 61537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-08T08:05:32.641 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 67193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-08T08:05:32.641 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 73409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-08T08:05:32.641 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 68177 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-08T08:05:32.641 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/stmicro/ 2023-12-08T08:05:32.641 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-12-08T08:05:32.641 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13441 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-12-08T08:05:32.641 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 39905 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-08T08:05:32.641 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-12-08T08:05:32.641 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 487025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-08T08:05:32.641 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sun/ 2023-12-08T08:05:32.641 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 103337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-08T08:05:32.641 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 166097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-08T08:05:32.641 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 66329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-08T08:05:32.641 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 78801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-08T08:05:32.641 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/tehuti/ 2023-12-08T08:05:32.642 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 50057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-08T08:05:32.642 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/ti/ 2023-12-08T08:05:32.642 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 86529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-08T08:05:32.642 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/via/ 2023-12-08T08:05:32.642 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 80273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-08T08:05:32.642 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 83633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-08T08:05:32.642 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/wiznet/ 2023-12-08T08:05:32.642 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 46241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-08T08:05:32.642 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-08T08:05:32.642 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/xircom/ 2023-12-08T08:05:32.642 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 59993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-08T08:05:32.642 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/fddi/ 2023-12-08T08:05:32.642 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41001 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/fddi/defxx.ko 2023-12-08T08:05:32.642 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/fddi/skfp/ 2023-12-08T08:05:32.643 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 216985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/fddi/skfp/skfp.ko 2023-12-08T08:05:32.643 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 77345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/geneve.ko 2023-12-08T08:05:32.643 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/hyperv/ 2023-12-08T08:05:32.643 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 235521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-08T08:05:32.643 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ieee802154/ 2023-12-08T08:05:32.643 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-08T08:05:32.643 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ifb.ko 2023-12-08T08:05:32.643 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ipvlan/ 2023-12-08T08:05:32.643 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 83769 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-08T08:05:32.643 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 62145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/macvlan.ko 2023-12-08T08:05:32.643 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/macvtap.ko 2023-12-08T08:05:32.643 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/mdio/ 2023-12-08T08:05:32.643 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-08T08:05:32.643 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-08T08:05:32.643 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/mdio/mdio-gpio.ko 2023-12-08T08:05:32.643 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-08T08:05:32.644 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/mdio.ko 2023-12-08T08:05:32.644 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20513 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/mii.ko 2023-12-08T08:05:32.644 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 43953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/netconsole.ko 2023-12-08T08:05:32.644 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/nlmon.ko 2023-12-08T08:05:32.644 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/pcs/ 2023-12-08T08:05:32.644 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-08T08:05:32.644 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38977 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-08T08:05:32.644 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/ 2023-12-08T08:05:32.644 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/amd.ko 2023-12-08T08:05:32.644 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 50033 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-08T08:05:32.644 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-08T08:05:32.644 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/bcm87xx.ko 2023-12-08T08:05:32.644 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/broadcom.ko 2023-12-08T08:05:32.644 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/cicada.ko 2023-12-08T08:05:32.644 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/davicom.ko 2023-12-08T08:05:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/et1011c.ko 2023-12-08T08:05:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/icplus.ko 2023-12-08T08:05:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/lxt.ko 2023-12-08T08:05:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 82049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/marvell.ko 2023-12-08T08:05:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 76113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/micrel.ko 2023-12-08T08:05:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12033 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/national.ko 2023-12-08T08:05:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 97857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/phylink.ko 2023-12-08T08:05:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/qsemi.ko 2023-12-08T08:05:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 50065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/realtek.ko 2023-12-08T08:05:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/smsc.ko 2023-12-08T08:05:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/ste10Xp.ko 2023-12-08T08:05:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/vitesse.ko 2023-12-08T08:05:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/plip/ 2023-12-08T08:05:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 43505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/plip/plip.ko 2023-12-08T08:05:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/ 2023-12-08T08:05:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-08T08:05:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29713 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/ppp_async.ko 2023-12-08T08:05:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-08T08:05:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-08T08:05:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-08T08:05:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42545 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/pppoe.ko 2023-12-08T08:05:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13441 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/pppox.ko 2023-12-08T08:05:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32689 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/pptp.ko 2023-12-08T08:05:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/sb1000.ko 2023-12-08T08:05:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/slip/ 2023-12-08T08:05:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/slip/slip.ko 2023-12-08T08:05:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/sungem_phy.ko 2023-12-08T08:05:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 64449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/tap.ko 2023-12-08T08:05:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team/ 2023-12-08T08:05:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 106169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team/team.ko 2023-12-08T08:05:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-08T08:05:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-08T08:05:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-08T08:05:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9641 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team/team_mode_random.ko 2023-12-08T08:05:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-08T08:05:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 87017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/veth.ko 2023-12-08T08:05:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/vmxnet3/ 2023-12-08T08:05:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 144297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-08T08:05:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/vxlan/ 2023-12-08T08:05:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 297329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/vxlan/vxlan.ko 2023-12-08T08:05:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/xen-netback/ 2023-12-08T08:05:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 144585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-08T08:05:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ntb/ 2023-12-08T08:05:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ntb/ntb.ko 2023-12-08T08:05:32.648 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/nvme/ 2023-12-08T08:05:32.648 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/nvme/host/ 2023-12-08T08:05:32.648 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 265121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/nvme/host/nvme-core.ko 2023-12-08T08:05:32.648 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 102209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/nvme/host/nvme.ko 2023-12-08T08:05:32.648 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/parport/ 2023-12-08T08:05:32.648 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 133841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/parport/parport.ko 2023-12-08T08:05:32.648 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14561 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/parport/parport_cs.ko 2023-12-08T08:05:32.648 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 84465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/parport/parport_pc.ko 2023-12-08T08:05:32.648 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/parport/parport_serial.ko 2023-12-08T08:05:32.648 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pci/ 2023-12-08T08:05:32.648 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pci/hotplug/ 2023-12-08T08:05:32.648 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-08T08:05:32.648 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-12-08T08:05:32.648 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-12-08T08:05:32.648 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pci/pci-stub.ko 2023-12-08T08:05:32.649 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 46465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pci/xen-pcifront.ko 2023-12-08T08:05:32.649 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pcmcia/ 2023-12-08T08:05:32.649 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pcmcia/i82092.ko 2023-12-08T08:05:32.649 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 145809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pcmcia/pcmcia.ko 2023-12-08T08:05:32.649 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 62137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pcmcia/pcmcia_core.ko 2023-12-08T08:05:32.649 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-12-08T08:05:32.649 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pcmcia/pd6729.ko 2023-12-08T08:05:32.649 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 112889 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-08T08:05:32.649 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/phy/ 2023-12-08T08:05:32.649 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/phy/broadcom/ 2023-12-08T08:05:32.649 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-12-08T08:05:32.649 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/phy/samsung/ 2023-12-08T08:05:32.649 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8441 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-12-08T08:05:32.649 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pinctrl/ 2023-12-08T08:05:32.649 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pinctrl/intel/ 2023-12-08T08:05:32.650 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 70153 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-08T08:05:32.650 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/ 2023-12-08T08:05:32.650 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/chrome/ 2023-12-08T08:05:32.650 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 50889 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-12-08T08:05:32.650 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/chrome/cros_ec.ko 2023-12-08T08:05:32.650 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-12-08T08:05:32.650 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25417 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-12-08T08:05:32.650 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-12-08T08:05:32.650 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-12-08T08:05:32.650 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17361 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-12-08T08:05:32.650 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/ 2023-12-08T08:05:32.650 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 67097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-08T08:05:32.650 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 39145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/acerhdf.ko 2023-12-08T08:05:32.650 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-08T08:05:32.651 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 59665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-08T08:05:32.651 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31161 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-08T08:05:32.651 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 127441 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-08T08:05:32.651 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-08T08:05:32.651 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 49121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-08T08:05:32.651 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-08T08:05:32.651 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-08T08:05:32.651 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-08T08:05:32.651 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/hdaps.ko 2023-12-08T08:05:32.651 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/ibm_rtl.ko 2023-12-08T08:05:32.651 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/intel/ 2023-12-08T08:05:32.651 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-08T08:05:32.651 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-12-08T08:05:32.651 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 43497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/intel_ips.ko 2023-12-08T08:05:32.651 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-08T08:05:32.652 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10377 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-08T08:05:32.652 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-08T08:05:32.652 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-08T08:05:32.652 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-08T08:05:32.652 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-08T08:05:32.652 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-08T08:05:32.652 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-08T08:05:32.652 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-08T08:05:32.652 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 57569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/wmi.ko 2023-12-08T08:05:32.652 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/ 2023-12-08T08:05:32.652 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/ 2023-12-08T08:05:32.652 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30281 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/88pm860x_battery.ko 2023-12-08T08:05:32.652 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/88pm860x_charger.ko 2023-12-08T08:05:32.652 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 55057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/bq2415x_charger.ko 2023-12-08T08:05:32.652 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 54081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/bq24190_charger.ko 2023-12-08T08:05:32.653 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21553 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/bq24735-charger.ko 2023-12-08T08:05:32.653 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-12-08T08:05:32.653 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19609 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/da9030_battery.ko 2023-12-08T08:05:32.653 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/da9052-battery.ko 2023-12-08T08:05:32.653 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29281 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/ds2760_battery.ko 2023-12-08T08:05:32.653 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23217 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/ds2780_battery.ko 2023-12-08T08:05:32.653 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23353 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/ds2781_battery.ko 2023-12-08T08:05:32.653 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/ds2782_battery.ko 2023-12-08T08:05:32.653 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20353 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/gpio-charger.ko 2023-12-08T08:05:32.653 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18041 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/isp1704_charger.ko 2023-12-08T08:05:32.653 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/lp8727_charger.ko 2023-12-08T08:05:32.653 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/max14577_charger.ko 2023-12-08T08:05:32.653 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/max17040_battery.ko 2023-12-08T08:05:32.653 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/max17042_battery.ko 2023-12-08T08:05:32.653 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/max8903_charger.ko 2023-12-08T08:05:32.654 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/max8925_power.ko 2023-12-08T08:05:32.654 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/pcf50633-charger.ko 2023-12-08T08:05:32.654 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/sbs-battery.ko 2023-12-08T08:05:32.654 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/test_power.ko 2023-12-08T08:05:32.654 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/tps65090-charger.ko 2023-12-08T08:05:32.654 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/wm831x_backup.ko 2023-12-08T08:05:32.654 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/wm831x_power.ko 2023-12-08T08:05:32.654 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22417 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/wm8350_power.ko 2023-12-08T08:05:32.654 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/powercap/ 2023-12-08T08:05:32.654 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 57729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-08T08:05:32.654 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-08T08:05:32.654 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pps/ 2023-12-08T08:05:32.654 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pps/clients/ 2023-12-08T08:05:32.654 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-08T08:05:32.654 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13249 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-08T08:05:32.655 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15913 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pps/clients/pps_parport.ko 2023-12-08T08:05:32.655 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pps/pps_core.ko 2023-12-08T08:05:32.655 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ptp/ 2023-12-08T08:05:32.655 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 66385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ptp/ptp.ko 2023-12-08T08:05:32.655 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ptp/ptp_kvm.ko 2023-12-08T08:05:32.655 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/ 2023-12-08T08:05:32.655 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-88pm80x.ko 2023-12-08T08:05:32.655 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-88pm860x.ko 2023-12-08T08:05:32.655 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-08T08:05:32.655 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-da9052.ko 2023-12-08T08:05:32.655 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-da9055.ko 2023-12-08T08:05:32.655 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-da9063.ko 2023-12-08T08:05:32.655 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16457 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-08T08:05:32.655 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 68577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-08T08:05:32.656 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-08T08:05:32.656 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18217 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-08T08:05:32.656 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-08T08:05:32.656 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-08T08:05:32.656 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13369 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-08T08:05:32.656 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-08T08:05:32.656 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23705 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-08T08:05:32.656 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-em3027.ko 2023-12-08T08:05:32.656 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-08T08:05:32.656 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-08T08:05:32.656 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-08T08:05:32.656 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-lp8788.ko 2023-12-08T08:05:32.656 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-08T08:05:32.656 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-08T08:05:32.656 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25945 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-08T08:05:32.656 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-m48t86.ko 2023-12-08T08:05:32.657 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-max6900.ko 2023-12-08T08:05:32.657 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-max8907.ko 2023-12-08T08:05:32.657 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-max8925.ko 2023-12-08T08:05:32.657 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-max8997.ko 2023-12-08T08:05:32.657 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-max8998.ko 2023-12-08T08:05:32.657 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18513 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-12-08T08:05:32.657 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-08T08:05:32.657 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-palmas.ko 2023-12-08T08:05:32.657 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 46633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-08T08:05:32.657 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17977 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-pcf50633.ko 2023-12-08T08:05:32.657 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-08T08:05:32.657 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-08T08:05:32.657 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-08T08:05:32.657 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12441 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-08T08:05:32.657 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18033 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-rc5t583.ko 2023-12-08T08:05:32.658 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-08T08:05:32.658 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-08T08:05:32.658 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-08T08:05:32.658 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-08T08:05:32.658 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-08T08:05:32.658 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-s35390a.ko 2023-12-08T08:05:32.658 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-08T08:05:32.658 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17889 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-tps6586x.ko 2023-12-08T08:05:32.658 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-tps65910.ko 2023-12-08T08:05:32.658 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20545 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-wm831x.ko 2023-12-08T08:05:32.658 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-wm8350.ko 2023-12-08T08:05:32.658 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-x1205.ko 2023-12-08T08:05:32.658 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/ 2023-12-08T08:05:32.658 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 77617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/3w-9xxx.ko 2023-12-08T08:05:32.659 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 57665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/3w-sas.ko 2023-12-08T08:05:32.659 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 55105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/3w-xxxx.ko 2023-12-08T08:05:32.659 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 135185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/BusLogic.ko 2023-12-08T08:05:32.659 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/a100u2w.ko 2023-12-08T08:05:32.659 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/aacraid/ 2023-12-08T08:05:32.659 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 272305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-08T08:05:32.659 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 100617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/advansys.ko 2023-12-08T08:05:32.659 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/aic7xxx/ 2023-12-08T08:05:32.659 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 356201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-08T08:05:32.659 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 295801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-08T08:05:32.659 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/aic94xx/ 2023-12-08T08:05:32.659 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 189185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-12-08T08:05:32.659 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/am53c974.ko 2023-12-08T08:05:32.659 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/arcmsr/ 2023-12-08T08:05:32.659 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 106881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-08T08:05:32.659 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/atp870u.ko 2023-12-08T08:05:32.660 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/be2iscsi/ 2023-12-08T08:05:32.660 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 246985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-08T08:05:32.660 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/bfa/ 2023-12-08T08:05:32.660 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1171945 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/bfa/bfa.ko 2023-12-08T08:05:32.660 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/bnx2fc/ 2023-12-08T08:05:32.660 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 237273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-08T08:05:32.660 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/bnx2i/ 2023-12-08T08:05:32.660 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 115369 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-08T08:05:32.660 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/ch.ko 2023-12-08T08:05:32.660 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/csiostor/ 2023-12-08T08:05:32.660 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 308921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-08T08:05:32.660 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/cxgbi/ 2023-12-08T08:05:32.660 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-12-08T08:05:32.660 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 76145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-08T08:05:32.661 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-12-08T08:05:32.661 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 101449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-08T08:05:32.661 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 146689 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-08T08:05:32.661 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 75553 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/dc395x.ko 2023-12-08T08:05:32.661 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/dmx3191d.ko 2023-12-08T08:05:32.661 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/esas2r/ 2023-12-08T08:05:32.661 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 212425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-08T08:05:32.661 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 60505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/esp_scsi.ko 2023-12-08T08:05:32.661 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/fcoe/ 2023-12-08T08:05:32.661 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 78209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-08T08:05:32.661 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 158505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-08T08:05:32.661 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18945 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/fdomain.ko 2023-12-08T08:05:32.661 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/fnic/ 2023-12-08T08:05:32.661 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 263489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/fnic/fnic.ko 2023-12-08T08:05:32.661 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 201817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/hpsa.ko 2023-12-08T08:05:32.662 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 51209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/hptiop.ko 2023-12-08T08:05:32.662 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 49041 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/hv_storvsc.ko 2023-12-08T08:05:32.662 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/imm.ko 2023-12-08T08:05:32.662 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/initio.ko 2023-12-08T08:05:32.662 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 266537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/ipr.ko 2023-12-08T08:05:32.662 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 101881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/ips.ko 2023-12-08T08:05:32.662 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/isci/ 2023-12-08T08:05:32.662 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 317153 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/isci/isci.ko 2023-12-08T08:05:32.662 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-08T08:05:32.662 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 52961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-08T08:05:32.662 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/libfc/ 2023-12-08T08:05:32.662 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 314865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/libfc/libfc.ko 2023-12-08T08:05:32.662 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 145585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/libiscsi.ko 2023-12-08T08:05:32.662 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 53521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-08T08:05:32.662 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/libsas/ 2023-12-08T08:05:32.663 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 216665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/libsas/libsas.ko 2023-12-08T08:05:32.663 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/lpfc/ 2023-12-08T08:05:32.663 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 2197249 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-08T08:05:32.663 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/megaraid/ 2023-12-08T08:05:32.663 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 73569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-08T08:05:32.663 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-08T08:05:32.663 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 310617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-08T08:05:32.663 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 84721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/megaraid.ko 2023-12-08T08:05:32.663 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/mpt3sas/ 2023-12-08T08:05:32.663 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 659825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-08T08:05:32.663 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/mvsas/ 2023-12-08T08:05:32.663 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 119561 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-08T08:05:32.663 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 78129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/mvumi.ko 2023-12-08T08:05:32.663 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/pcmcia/ 2023-12-08T08:05:32.663 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 81625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-12-08T08:05:32.664 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11713 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-12-08T08:05:32.664 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-12-08T08:05:32.664 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-12-08T08:05:32.664 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/pm8001/ 2023-12-08T08:05:32.664 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 364105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-08T08:05:32.664 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 123617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/pmcraid.ko 2023-12-08T08:05:32.664 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34513 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/ppa.ko 2023-12-08T08:05:32.664 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 55361 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/qla1280.ko 2023-12-08T08:05:32.664 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/qla2xxx/ 2023-12-08T08:05:32.664 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1876689 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-08T08:05:32.664 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 85289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-08T08:05:32.664 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/qla4xxx/ 2023-12-08T08:05:32.664 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 559033 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-08T08:05:32.664 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/qlogicfas408.ko 2023-12-08T08:05:32.664 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/raid_class.ko 2023-12-08T08:05:32.665 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 238761 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/scsi_debug.ko 2023-12-08T08:05:32.665 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 173937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-08T08:05:32.665 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 279313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-08T08:05:32.665 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 97729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-08T08:05:32.665 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 73881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-08T08:05:32.665 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-08T08:05:32.665 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26249 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/ses.ko 2023-12-08T08:05:32.665 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 115889 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/st.ko 2023-12-08T08:05:32.665 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 46825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/stex.ko 2023-12-08T08:05:32.665 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/sym53c8xx_2/ 2023-12-08T08:05:32.665 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 162121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-08T08:05:32.665 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/virtio_scsi.ko 2023-12-08T08:05:32.665 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 50321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-08T08:05:32.665 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 39961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/wd719x.ko 2023-12-08T08:05:32.665 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 50025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/xen-scsifront.ko 2023-12-08T08:05:32.666 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ssb/ 2023-12-08T08:05:32.666 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 129441 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ssb/ssb.ko 2023-12-08T08:05:32.666 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/ 2023-12-08T08:05:32.666 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/iscsi/ 2023-12-08T08:05:32.666 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 736601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-08T08:05:32.666 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/loopback/ 2023-12-08T08:05:32.666 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 49985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-08T08:05:32.666 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 39713 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/target_core_file.ko 2023-12-08T08:05:32.666 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 43025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/target_core_iblock.ko 2023-12-08T08:05:32.666 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 930257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/target_core_mod.ko 2023-12-08T08:05:32.666 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/target_core_pscsi.ko 2023-12-08T08:05:32.666 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 122521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/target_core_user.ko 2023-12-08T08:05:32.666 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/tcm_fc/ 2023-12-08T08:05:32.666 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 75593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-08T08:05:32.667 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/ 2023-12-08T08:05:32.667 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/ 2023-12-08T08:05:32.667 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/ 2023-12-08T08:05:32.667 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-08T08:05:32.667 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-08T08:05:32.667 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-08T08:05:32.667 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-08T08:05:32.667 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-08T08:05:32.667 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-08T08:05:32.667 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-08T08:05:32.667 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20281 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-08T08:05:32.667 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-08T08:05:32.667 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-08T08:05:32.667 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13001 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-08T08:05:32.667 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-08T08:05:32.667 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-12-08T08:05:32.668 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-08T08:05:32.668 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-08T08:05:32.668 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-08T08:05:32.668 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/ 2023-12-08T08:05:32.668 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/ipwireless/ 2023-12-08T08:05:32.668 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 78425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-08T08:05:32.668 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 57865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/moxa.ko 2023-12-08T08:05:32.668 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 50953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/mxser.ko 2023-12-08T08:05:32.668 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 108601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/n_gsm.ko 2023-12-08T08:05:32.668 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/n_hdlc.ko 2023-12-08T08:05:32.668 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 67929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/nozomi.ko 2023-12-08T08:05:32.668 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/ 2023-12-08T08:05:32.668 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/8250/ 2023-12-08T08:05:32.668 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-12-08T08:05:32.668 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 59497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-08T08:05:32.669 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-12-08T08:05:32.669 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/altera_uart.ko 2023-12-08T08:05:32.669 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/arc_uart.ko 2023-12-08T08:05:32.669 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 72425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-12-08T08:05:32.669 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/jsm/ 2023-12-08T08:05:32.669 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 103073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-08T08:05:32.669 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/rp2.ko 2023-12-08T08:05:32.669 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 52817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/sc16is7xx.ko 2023-12-08T08:05:32.669 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ufs/ 2023-12-08T08:05:32.669 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ufs/core/ 2023-12-08T08:05:32.669 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 531265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-08T08:05:32.669 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ufs/host/ 2023-12-08T08:05:32.669 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-08T08:05:32.669 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-12-08T08:05:32.669 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/ 2023-12-08T08:05:32.670 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44513 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio.ko 2023-12-08T08:05:32.670 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio_aec.ko 2023-12-08T08:05:32.670 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11281 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio_cif.ko 2023-12-08T08:05:32.670 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio_dmem_genirq.ko 2023-12-08T08:05:32.670 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio_mf624.ko 2023-12-08T08:05:32.670 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12177 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio_netx.ko 2023-12-08T08:05:32.670 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio_pci_generic.ko 2023-12-08T08:05:32.670 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-12-08T08:05:32.670 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio_sercos3.ko 2023-12-08T08:05:32.670 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/ 2023-12-08T08:05:32.670 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/c67x00/ 2023-12-08T08:05:32.670 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 73297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/c67x00/c67x00.ko 2023-12-08T08:05:32.670 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/chipidea/ 2023-12-08T08:05:32.670 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 144377 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-12-08T08:05:32.671 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-12-08T08:05:32.671 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12713 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-12-08T08:05:32.671 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-12-08T08:05:32.671 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/class/ 2023-12-08T08:05:32.671 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 87089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/class/cdc-acm.ko 2023-12-08T08:05:32.671 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 51345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-08T08:05:32.671 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 47305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/class/usblp.ko 2023-12-08T08:05:32.671 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 89857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/class/usbtmc.ko 2023-12-08T08:05:32.671 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/common/ 2023-12-08T08:05:32.671 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/common/ulpi.ko 2023-12-08T08:05:32.671 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/dwc2/ 2023-12-08T08:05:32.671 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-12-08T08:05:32.671 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/dwc3/ 2023-12-08T08:05:32.671 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-12-08T08:05:32.671 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30041 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-12-08T08:05:32.671 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 448505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/dwc3/dwc3.ko 2023-12-08T08:05:32.672 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/ 2023-12-08T08:05:32.672 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/ 2023-12-08T08:05:32.672 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 60177 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/u_ether.ko 2023-12-08T08:05:32.672 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 51881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/u_serial.ko 2023-12-08T08:05:32.672 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-12-08T08:05:32.672 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-12-08T08:05:32.672 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-12-08T08:05:32.672 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36513 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-12-08T08:05:32.672 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 92489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-12-08T08:05:32.672 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 51049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-12-08T08:05:32.672 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 122081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-12-08T08:05:32.672 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 57681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-12-08T08:05:32.672 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-12-08T08:05:32.672 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-12-08T08:05:32.672 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 57729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-12-08T08:05:32.673 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 85609 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-12-08T08:05:32.673 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-12-08T08:05:32.673 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 58113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-12-08T08:05:32.673 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 67337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-12-08T08:05:32.673 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/ 2023-12-08T08:05:32.673 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-12-08T08:05:32.673 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-12-08T08:05:32.673 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-12-08T08:05:32.673 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-12-08T08:05:32.673 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-12-08T08:05:32.673 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-12-08T08:05:32.673 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-12-08T08:05:32.673 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16977 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-12-08T08:05:32.673 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-12-08T08:05:32.673 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-12-08T08:05:32.674 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-12-08T08:05:32.674 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-12-08T08:05:32.674 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 62185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-12-08T08:05:32.674 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-12-08T08:05:32.674 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 161225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/libcomposite.ko 2023-12-08T08:05:32.674 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/ 2023-12-08T08:05:32.674 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17705 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-12-08T08:05:32.674 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/bdc/ 2023-12-08T08:05:32.674 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 157681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-12-08T08:05:32.674 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-12-08T08:05:32.674 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 52721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-12-08T08:05:32.674 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 69705 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-12-08T08:05:32.674 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 56033 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-12-08T08:05:32.674 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 76057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/net2272.ko 2023-12-08T08:05:32.675 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 75073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/net2280.ko 2023-12-08T08:05:32.675 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 73169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-12-08T08:05:32.675 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 65809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-12-08T08:05:32.675 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 66097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-12-08T08:05:32.675 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 81505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-12-08T08:05:32.675 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 156073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-12-08T08:05:32.675 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/host/ 2023-12-08T08:05:32.675 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/host/bcma-hcd.ko 2023-12-08T08:05:32.675 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 80113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/host/isp116x-hcd.ko 2023-12-08T08:05:32.675 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 87353 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-12-08T08:05:32.675 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 78873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-12-08T08:05:32.675 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 51329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-08T08:05:32.675 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/host/sl811_cs.ko 2023-12-08T08:05:32.675 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/host/ssb-hcd.ko 2023-12-08T08:05:32.675 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25945 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-12-08T08:05:32.676 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/image/ 2023-12-08T08:05:32.676 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/image/mdc800.ko 2023-12-08T08:05:32.676 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/image/microtek.ko 2023-12-08T08:05:32.676 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/ 2023-12-08T08:05:32.676 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/adutux.ko 2023-12-08T08:05:32.676 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20713 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/appledisplay.ko 2023-12-08T08:05:32.676 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-12-08T08:05:32.676 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/cytherm.ko 2023-12-08T08:05:32.676 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/ehset.ko 2023-12-08T08:05:32.676 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/emi26.ko 2023-12-08T08:05:32.676 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/emi62.ko 2023-12-08T08:05:32.676 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/ezusb.ko 2023-12-08T08:05:32.676 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/idmouse.ko 2023-12-08T08:05:32.676 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36553 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/iowarrior.ko 2023-12-08T08:05:32.676 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-08T08:05:32.677 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/ldusb.ko 2023-12-08T08:05:32.677 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/legousbtower.ko 2023-12-08T08:05:32.677 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/lvstest.ko 2023-12-08T08:05:32.677 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/sisusbvga/ 2023-12-08T08:05:32.677 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 64841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-08T08:05:32.677 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-08T08:05:32.677 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/usb3503.ko 2023-12-08T08:05:32.677 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/usblcd.ko 2023-12-08T08:05:32.677 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-08T08:05:32.677 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 70809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/usbtest.ko 2023-12-08T08:05:32.677 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41905 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/uss720.ko 2023-12-08T08:05:32.677 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/yurex.ko 2023-12-08T08:05:32.677 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/mon/ 2023-12-08T08:05:32.677 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 72953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/mon/usbmon.ko 2023-12-08T08:05:32.677 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/musb/ 2023-12-08T08:05:32.678 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 301697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/musb/musb_hdrc.ko 2023-12-08T08:05:32.678 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/phy/ 2023-12-08T08:05:32.678 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/phy/phy-generic.ko 2023-12-08T08:05:32.678 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20177 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-12-08T08:05:32.678 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/phy/phy-isp1301.ko 2023-12-08T08:05:32.678 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/phy/phy-tahvo.ko 2023-12-08T08:05:32.678 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ 2023-12-08T08:05:32.678 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/aircable.ko 2023-12-08T08:05:32.678 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ark3116.ko 2023-12-08T08:05:32.678 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-08T08:05:32.678 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ch341.ko 2023-12-08T08:05:32.678 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 70257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/cp210x.ko 2023-12-08T08:05:32.678 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/cyberjack.ko 2023-12-08T08:05:32.678 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 58217 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-08T08:05:32.679 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 49817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-08T08:05:32.679 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/empeg.ko 2023-12-08T08:05:32.679 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/f81232.ko 2023-12-08T08:05:32.679 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 175137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-08T08:05:32.679 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 53113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-08T08:05:32.679 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 137081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-08T08:05:32.679 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 124833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/io_ti.ko 2023-12-08T08:05:32.679 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 67769 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ipaq.ko 2023-12-08T08:05:32.679 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19161 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ipw.ko 2023-12-08T08:05:32.679 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ir-usb.ko 2023-12-08T08:05:32.679 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 58233 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-08T08:05:32.679 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 107521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/keyspan.ko 2023-12-08T08:05:32.679 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-08T08:05:32.679 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-08T08:05:32.679 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33689 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-08T08:05:32.680 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/mct_u232.ko 2023-12-08T08:05:32.680 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22033 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/metro-usb.ko 2023-12-08T08:05:32.680 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 66449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/mos7720.ko 2023-12-08T08:05:32.680 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 78217 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/mos7840.ko 2023-12-08T08:05:32.680 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 56337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/mxuport.ko 2023-12-08T08:05:32.680 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/navman.ko 2023-12-08T08:05:32.680 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/omninet.ko 2023-12-08T08:05:32.680 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/opticon.ko 2023-12-08T08:05:32.680 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 191137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/option.ko 2023-12-08T08:05:32.680 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 39073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/oti6858.ko 2023-12-08T08:05:32.680 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 54353 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/pl2303.ko 2023-12-08T08:05:32.680 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/qcaux.ko 2023-12-08T08:05:32.680 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/qcserial.ko 2023-12-08T08:05:32.680 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/quatech2.ko 2023-12-08T08:05:32.680 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/safe_serial.ko 2023-12-08T08:05:32.681 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 51625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/sierra.ko 2023-12-08T08:05:32.681 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-08T08:05:32.681 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ssu100.ko 2023-12-08T08:05:32.681 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/symbolserial.ko 2023-12-08T08:05:32.681 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 61489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-08T08:05:32.681 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-08T08:05:32.681 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/usb_debug.ko 2023-12-08T08:05:32.681 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-08T08:05:32.681 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 125609 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/usbserial.ko 2023-12-08T08:05:32.681 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/visor.ko 2023-12-08T08:05:32.681 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/whiteheat.ko 2023-12-08T08:05:32.681 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/wishbone-serial.ko 2023-12-08T08:05:32.681 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-08T08:05:32.681 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ 2023-12-08T08:05:32.681 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 52913 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/uas.ko 2023-12-08T08:05:32.682 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-08T08:05:32.682 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-08T08:05:32.682 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-08T08:05:32.682 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-08T08:05:32.682 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-08T08:05:32.682 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19769 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-08T08:05:32.682 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19361 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-08T08:05:32.682 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13713 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-karma.ko 2023-12-08T08:05:32.682 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-08T08:05:32.682 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28441 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-08T08:05:32.682 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28905 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-08T08:05:32.682 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-08T08:05:32.682 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-08T08:05:32.683 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 179969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/usb-storage.ko 2023-12-08T08:05:32.683 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/usbip/ 2023-12-08T08:05:32.683 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 67481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-08T08:05:32.683 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 72177 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-08T08:05:32.683 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 107001 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-08T08:05:32.683 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vfio/ 2023-12-08T08:05:32.683 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vfio/pci/ 2023-12-08T08:05:32.683 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 154297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-08T08:05:32.683 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-08T08:05:32.683 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 108737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vfio/vfio.ko 2023-12-08T08:05:32.683 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 77609 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-08T08:05:32.683 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vhost/ 2023-12-08T08:05:32.683 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 113785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vhost/vhost.ko 2023-12-08T08:05:32.683 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-08T08:05:32.683 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 58089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vhost/vhost_net.ko 2023-12-08T08:05:32.684 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 89249 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vhost/vhost_scsi.ko 2023-12-08T08:05:32.684 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/ 2023-12-08T08:05:32.684 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/ 2023-12-08T08:05:32.684 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15417 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-12-08T08:05:32.684 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/aat2870_bl.ko 2023-12-08T08:05:32.684 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/adp5520_bl.ko 2023-12-08T08:05:32.684 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32609 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/adp8860_bl.ko 2023-12-08T08:05:32.684 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 39993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/adp8870_bl.ko 2023-12-08T08:05:32.684 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/apple_bl.ko 2023-12-08T08:05:32.684 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16777 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/as3711_bl.ko 2023-12-08T08:05:32.684 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12033 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/bd6107.ko 2023-12-08T08:05:32.684 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/da903x_bl.ko 2023-12-08T08:05:32.684 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/da9052_bl.ko 2023-12-08T08:05:32.684 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/gpio_backlight.ko 2023-12-08T08:05:32.684 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14769 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/kb3886_bl.ko 2023-12-08T08:05:32.685 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/lcd.ko 2023-12-08T08:05:32.685 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/lm3533_bl.ko 2023-12-08T08:05:32.685 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/lm3639_bl.ko 2023-12-08T08:05:32.685 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/lv5207lp.ko 2023-12-08T08:05:32.685 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/max8925_bl.ko 2023-12-08T08:05:32.685 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/pandora_bl.ko 2023-12-08T08:05:32.685 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-12-08T08:05:32.685 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-08T08:05:32.685 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/wm831x_bl.ko 2023-12-08T08:05:32.685 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/ 2023-12-08T08:05:32.685 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/masters/ 2023-12-08T08:05:32.685 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/masters/ds2482.ko 2023-12-08T08:05:32.685 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/masters/ds2490.ko 2023-12-08T08:05:32.685 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/masters/matrox_w1.ko 2023-12-08T08:05:32.685 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12417 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/masters/w1-gpio.ko 2023-12-08T08:05:32.686 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/ 2023-12-08T08:05:32.686 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12041 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-08T08:05:32.686 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-08T08:05:32.686 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-08T08:05:32.686 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-08T08:05:32.686 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14153 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-08T08:05:32.686 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-08T08:05:32.686 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-08T08:05:32.686 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-08T08:05:32.686 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-08T08:05:32.686 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-08T08:05:32.686 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 56425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-08T08:05:32.686 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 102673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/wire.ko 2023-12-08T08:05:32.686 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/ 2023-12-08T08:05:32.687 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/acquirewdt.ko 2023-12-08T08:05:32.687 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19977 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/advantechwdt.ko 2023-12-08T08:05:32.687 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18561 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-08T08:05:32.687 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-08T08:05:32.687 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/cpu5wdt.ko 2023-12-08T08:05:32.687 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/da9052_wdt.ko 2023-12-08T08:05:32.687 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12777 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/da9055_wdt.ko 2023-12-08T08:05:32.687 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/da9063_wdt.ko 2023-12-08T08:05:32.687 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/dw_wdt.ko 2023-12-08T08:05:32.687 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/eurotechwdt.ko 2023-12-08T08:05:32.687 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-08T08:05:32.687 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/hpwdt.ko 2023-12-08T08:05:32.687 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/i6300esb.ko 2023-12-08T08:05:32.687 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-08T08:05:32.688 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21913 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-08T08:05:32.688 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/ib700wdt.ko 2023-12-08T08:05:32.688 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18689 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/ibmasr.ko 2023-12-08T08:05:32.688 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19713 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-08T08:05:32.688 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-08T08:05:32.688 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/it87_wdt.ko 2023-12-08T08:05:32.688 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/kempld_wdt.ko 2023-12-08T08:05:32.688 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/machzwd.ko 2023-12-08T08:05:32.688 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/mena21_wdt.ko 2023-12-08T08:05:32.688 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13217 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-12-08T08:05:32.688 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/nv_tco.ko 2023-12-08T08:05:32.689 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-12-08T08:05:32.689 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/pc87413_wdt.ko 2023-12-08T08:05:32.689 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-08T08:05:32.689 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-08T08:05:32.689 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/retu_wdt.ko 2023-12-08T08:05:32.689 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-12-08T08:05:32.689 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-12-08T08:05:32.689 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-08T08:05:32.689 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/sc1200wdt.ko 2023-12-08T08:05:32.689 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-08T08:05:32.689 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-12-08T08:05:32.689 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/softdog.ko 2023-12-08T08:05:32.689 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-08T08:05:32.689 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/twl4030_wdt.ko 2023-12-08T08:05:32.690 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/via_wdt.ko 2023-12-08T08:05:32.690 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19161 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-08T08:05:32.690 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-08T08:05:32.690 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-08T08:05:32.690 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/wafer5823wdt.ko 2023-12-08T08:05:32.690 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/wdt_pci.ko 2023-12-08T08:05:32.690 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/wm831x_wdt.ko 2023-12-08T08:05:32.690 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/wm8350_wdt.ko 2023-12-08T08:05:32.690 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/xen_wdt.ko 2023-12-08T08:05:32.690 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/ 2023-12-08T08:05:32.690 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-evtchn.ko 2023-12-08T08:05:32.690 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26769 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-gntalloc.ko 2023-12-08T08:05:32.690 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 47865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-gntdev.ko 2023-12-08T08:05:32.690 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-pciback/ 2023-12-08T08:05:32.690 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 176377 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-08T08:05:32.691 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-privcmd.ko 2023-12-08T08:05:32.691 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 71249 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-scsiback.ko 2023-12-08T08:05:32.691 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xenfs/ 2023-12-08T08:05:32.691 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-08T08:05:32.691 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ 2023-12-08T08:05:32.691 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/9p/ 2023-12-08T08:05:32.691 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 166425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/9p/9p.ko 2023-12-08T08:05:32.691 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/adfs/ 2023-12-08T08:05:32.691 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 61073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/adfs/adfs.ko 2023-12-08T08:05:32.691 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/affs/ 2023-12-08T08:05:32.691 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 163593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/affs/affs.ko 2023-12-08T08:05:32.691 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/afs/ 2023-12-08T08:05:32.691 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 932817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/afs/kafs.ko 2023-12-08T08:05:32.691 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/autofs/ 2023-12-08T08:05:32.691 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 101057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/autofs/autofs4.ko 2023-12-08T08:05:32.692 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/befs/ 2023-12-08T08:05:32.692 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 64545 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/befs/befs.ko 2023-12-08T08:05:32.692 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/bfs/ 2023-12-08T08:05:32.692 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/bfs/bfs.ko 2023-12-08T08:05:32.692 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/binfmt_misc.ko 2023-12-08T08:05:32.692 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/btrfs/ 2023-12-08T08:05:32.692 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 3402729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/btrfs/btrfs.ko 2023-12-08T08:05:32.692 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/cachefiles/ 2023-12-08T08:05:32.692 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 306009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/cachefiles/cachefiles.ko 2023-12-08T08:05:32.692 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ceph/ 2023-12-08T08:05:32.692 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1333017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ceph/ceph.ko 2023-12-08T08:05:32.692 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/coda/ 2023-12-08T08:05:32.692 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 100801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/coda/coda.ko 2023-12-08T08:05:32.692 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/configfs/ 2023-12-08T08:05:32.692 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 108393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/configfs/configfs.ko 2023-12-08T08:05:32.693 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/cramfs/ 2023-12-08T08:05:32.693 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 29625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/cramfs/cramfs.ko 2023-12-08T08:05:32.693 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/dlm/ 2023-12-08T08:05:32.693 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 642513 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/dlm/dlm.ko 2023-12-08T08:05:32.693 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/efs/ 2023-12-08T08:05:32.693 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/efs/efs.ko 2023-12-08T08:05:32.693 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/f2fs/ 2023-12-08T08:05:32.693 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1505025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/f2fs/f2fs.ko 2023-12-08T08:05:32.693 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fat/ 2023-12-08T08:05:32.693 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fat/msdos.ko 2023-12-08T08:05:32.693 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/freevxfs/ 2023-12-08T08:05:32.693 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42545 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/freevxfs/freevxfs.ko 2023-12-08T08:05:32.693 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fscache/ 2023-12-08T08:05:32.693 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 226481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fscache/fscache.ko 2023-12-08T08:05:32.694 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fuse/ 2023-12-08T08:05:32.694 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fuse/cuse.ko 2023-12-08T08:05:32.694 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/gfs2/ 2023-12-08T08:05:32.694 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1231529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/gfs2/gfs2.ko 2023-12-08T08:05:32.694 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/hfs/ 2023-12-08T08:05:32.694 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 141209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/hfs/hfs.ko 2023-12-08T08:05:32.694 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/hfsplus/ 2023-12-08T08:05:32.694 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 222817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/hfsplus/hfsplus.ko 2023-12-08T08:05:32.694 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/hpfs/ 2023-12-08T08:05:32.694 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 192329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/hpfs/hpfs.ko 2023-12-08T08:05:32.694 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/isofs/ 2023-12-08T08:05:32.694 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 74065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/isofs/isofs.ko 2023-12-08T08:05:32.694 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/jfs/ 2023-12-08T08:05:32.694 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 419497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/jfs/jfs.ko 2023-12-08T08:05:32.695 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/lockd/ 2023-12-08T08:05:32.695 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 280313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/lockd/lockd.ko 2023-12-08T08:05:32.695 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/minix/ 2023-12-08T08:05:32.695 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 89193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/minix/minix.ko 2023-12-08T08:05:32.695 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/netfs/ 2023-12-08T08:05:32.695 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 124649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/netfs/netfs.ko 2023-12-08T08:05:32.695 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/ 2023-12-08T08:05:32.695 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/blocklayout/ 2023-12-08T08:05:32.695 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 81449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-08T08:05:32.695 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/filelayout/ 2023-12-08T08:05:32.695 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 59449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-08T08:05:32.695 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/flexfilelayout/ 2023-12-08T08:05:32.695 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 117465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-08T08:05:32.695 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1055721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/nfs.ko 2023-12-08T08:05:32.695 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 66441 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/nfsv2.ko 2023-12-08T08:05:32.695 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 120177 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/nfsv3.ko 2023-12-08T08:05:32.696 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 2042137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/nfsv4.ko 2023-12-08T08:05:32.696 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs_common/ 2023-12-08T08:05:32.696 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs_common/grace.ko 2023-12-08T08:05:32.696 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs_common/nfs_acl.ko 2023-12-08T08:05:32.696 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfsd/ 2023-12-08T08:05:32.696 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1516873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfsd/nfsd.ko 2023-12-08T08:05:32.696 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nilfs2/ 2023-12-08T08:05:32.696 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 592833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nilfs2/nilfs2.ko 2023-12-08T08:05:32.696 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/ 2023-12-08T08:05:32.696 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-celtic.ko 2023-12-08T08:05:32.696 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-centeuro.ko 2023-12-08T08:05:32.696 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-croatian.ko 2023-12-08T08:05:32.696 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-cyrillic.ko 2023-12-08T08:05:32.696 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-gaelic.ko 2023-12-08T08:05:32.696 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-greek.ko 2023-12-08T08:05:32.697 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-iceland.ko 2023-12-08T08:05:32.697 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-inuit.ko 2023-12-08T08:05:32.697 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-roman.ko 2023-12-08T08:05:32.697 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-romanian.ko 2023-12-08T08:05:32.697 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-turkish.ko 2023-12-08T08:05:32.697 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_ascii.ko 2023-12-08T08:05:32.697 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp1250.ko 2023-12-08T08:05:32.697 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12233 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp1251.ko 2023-12-08T08:05:32.697 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp1255.ko 2023-12-08T08:05:32.697 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp737.ko 2023-12-08T08:05:32.697 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp775.ko 2023-12-08T08:05:32.697 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp850.ko 2023-12-08T08:05:32.697 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp852.ko 2023-12-08T08:05:32.698 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp855.ko 2023-12-08T08:05:32.698 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11913 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp857.ko 2023-12-08T08:05:32.698 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp860.ko 2023-12-08T08:05:32.698 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13161 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp861.ko 2023-12-08T08:05:32.698 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp862.ko 2023-12-08T08:05:32.698 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13161 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp863.ko 2023-12-08T08:05:32.698 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp864.ko 2023-12-08T08:05:32.698 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13161 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp865.ko 2023-12-08T08:05:32.698 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp866.ko 2023-12-08T08:05:32.698 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp869.ko 2023-12-08T08:05:32.698 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp874.ko 2023-12-08T08:05:32.698 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 94137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp932.ko 2023-12-08T08:05:32.698 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 142673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp936.ko 2023-12-08T08:05:32.698 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 165745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp949.ko 2023-12-08T08:05:32.698 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 118121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp950.ko 2023-12-08T08:05:32.699 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12457 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_euc-jp.ko 2023-12-08T08:05:32.699 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-1.ko 2023-12-08T08:05:32.699 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-13.ko 2023-12-08T08:05:32.699 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-14.ko 2023-12-08T08:05:32.699 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-15.ko 2023-12-08T08:05:32.699 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-2.ko 2023-12-08T08:05:32.699 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-3.ko 2023-12-08T08:05:32.699 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-4.ko 2023-12-08T08:05:32.699 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-5.ko 2023-12-08T08:05:32.699 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-6.ko 2023-12-08T08:05:32.699 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12233 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-7.ko 2023-12-08T08:05:32.699 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-9.ko 2023-12-08T08:05:32.699 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_koi8-r.ko 2023-12-08T08:05:32.699 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_koi8-ru.ko 2023-12-08T08:05:32.699 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_koi8-u.ko 2023-12-08T08:05:32.700 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-08T08:05:32.700 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_utf8.ko 2023-12-08T08:05:32.700 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ntfs/ 2023-12-08T08:05:32.700 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 219417 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ntfs/ntfs.ko 2023-12-08T08:05:32.700 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/ 2023-12-08T08:05:32.700 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/cluster/ 2023-12-08T08:05:32.700 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 244409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-08T08:05:32.700 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/dlm/ 2023-12-08T08:05:32.700 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 440737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-08T08:05:32.700 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/dlmfs/ 2023-12-08T08:05:32.700 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 54049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-08T08:05:32.700 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 2592433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/ocfs2.ko 2023-12-08T08:05:32.700 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17905 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-08T08:05:32.700 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-08T08:05:32.700 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-08T08:05:32.701 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/omfs/ 2023-12-08T08:05:32.701 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 53433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/omfs/omfs.ko 2023-12-08T08:05:32.701 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/overlayfs/ 2023-12-08T08:05:32.701 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 352161 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/overlayfs/overlay.ko 2023-12-08T08:05:32.701 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/pstore/ 2023-12-08T08:05:32.701 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 54809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/pstore/ramoops.ko 2023-12-08T08:05:32.701 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/qnx4/ 2023-12-08T08:05:32.701 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/qnx4/qnx4.ko 2023-12-08T08:05:32.701 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/qnx6/ 2023-12-08T08:05:32.701 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 46689 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/qnx6/qnx6.ko 2023-12-08T08:05:32.701 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/quota/ 2023-12-08T08:05:32.701 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/quota/quota_tree.ko 2023-12-08T08:05:32.701 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/quota/quota_v1.ko 2023-12-08T08:05:32.701 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/quota/quota_v2.ko 2023-12-08T08:05:32.701 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/reiserfs/ 2023-12-08T08:05:32.702 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 532673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/reiserfs/reiserfs.ko 2023-12-08T08:05:32.702 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/romfs/ 2023-12-08T08:05:32.702 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28641 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/romfs/romfs.ko 2023-12-08T08:05:32.702 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/smb/ 2023-12-08T08:05:32.702 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/smb/client/ 2023-12-08T08:05:32.702 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 2668401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/smb/client/cifs.ko 2023-12-08T08:05:32.702 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/smb/common/ 2023-12-08T08:05:32.702 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7161 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/smb/common/cifs_arc4.ko 2023-12-08T08:05:32.702 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/smb/common/cifs_md4.ko 2023-12-08T08:05:32.702 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/squashfs/ 2023-12-08T08:05:32.702 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 134641 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/squashfs/squashfs.ko 2023-12-08T08:05:32.702 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/sysv/ 2023-12-08T08:05:32.702 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 90721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/sysv/sysv.ko 2023-12-08T08:05:32.702 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/udf/ 2023-12-08T08:05:32.702 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 247737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/udf/udf.ko 2023-12-08T08:05:32.703 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ufs/ 2023-12-08T08:05:32.703 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 162497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ufs/ufs.ko 2023-12-08T08:05:32.703 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/xfs/ 2023-12-08T08:05:32.703 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 4011017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/xfs/xfs.ko 2023-12-08T08:05:32.740 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/kernel/ 2023-12-08T08:05:32.740 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/kernel/locking/ 2023-12-08T08:05:32.740 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 75489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/kernel/locking/locktorture.ko 2023-12-08T08:05:32.740 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/kernel/time/ 2023-12-08T08:05:32.741 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/kernel/time/test_udelay.ko 2023-12-08T08:05:32.741 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 60553 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/kernel/torture.ko 2023-12-08T08:05:32.741 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/ 2023-12-08T08:05:32.741 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 6833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/crc-itu-t.ko 2023-12-08T08:05:32.741 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 6529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/crc7.ko 2023-12-08T08:05:32.741 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/crc8.ko 2023-12-08T08:05:32.741 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/crypto/ 2023-12-08T08:05:32.741 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/crypto/libarc4.ko 2023-12-08T08:05:32.741 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/crypto/libdes.ko 2023-12-08T08:05:32.741 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/interval_tree_test.ko 2023-12-08T08:05:32.741 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/libcrc32c.ko 2023-12-08T08:05:32.741 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/lru_cache.ko 2023-12-08T08:05:32.741 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/lz4/ 2023-12-08T08:05:32.741 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/lz4/lz4_compress.ko 2023-12-08T08:05:32.741 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/lz4/lz4hc_compress.ko 2023-12-08T08:05:32.742 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/math/ 2023-12-08T08:05:32.742 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 6617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/math/cordic.ko 2023-12-08T08:05:32.742 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8233 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/memory-notifier-error-inject.ko 2023-12-08T08:05:32.742 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/notifier-error-inject.ko 2023-12-08T08:05:32.742 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/percpu_test.ko 2023-12-08T08:05:32.742 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/pm-notifier-error-inject.ko 2023-12-08T08:05:32.742 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/raid6/ 2023-12-08T08:05:32.742 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 143433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/raid6/raid6_pq.ko 2023-12-08T08:05:32.742 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/rbtree_test.ko 2023-12-08T08:05:32.742 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/reed_solomon/ 2023-12-08T08:05:32.742 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-08T08:05:32.742 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/test-kstrtox.ko 2023-12-08T08:05:32.742 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/test-string_helpers.ko 2023-12-08T08:05:32.742 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 4760425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/test_bpf.ko 2023-12-08T08:05:32.743 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 49089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/test_firmware.ko 2023-12-08T08:05:32.743 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 6369 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/test_module.ko 2023-12-08T08:05:32.743 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/test_user_copy.ko 2023-12-08T08:05:32.743 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/ts_bm.ko 2023-12-08T08:05:32.743 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/ts_fsm.ko 2023-12-08T08:05:32.743 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/ts_kmp.ko 2023-12-08T08:05:32.743 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/xz/ 2023-12-08T08:05:32.743 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13545 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/xz/xz_dec_test.ko 2023-12-08T08:05:32.743 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/mm/ 2023-12-08T08:05:32.743 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/mm/hwpoison-inject.ko 2023-12-08T08:05:32.743 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ 2023-12-08T08:05:32.743 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/ 2023-12-08T08:05:32.743 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 55737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/6lowpan.ko 2023-12-08T08:05:32.743 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_dest.ko 2023-12-08T08:05:32.743 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_fragment.ko 2023-12-08T08:05:32.744 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_hop.ko 2023-12-08T08:05:32.744 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 6985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-08T08:05:32.744 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_mobility.ko 2023-12-08T08:05:32.744 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7001 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_routing.ko 2023-12-08T08:05:32.744 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_udp.ko 2023-12-08T08:05:32.744 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/802/ 2023-12-08T08:05:32.744 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/802/garp.ko 2023-12-08T08:05:32.744 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/802/mrp.ko 2023-12-08T08:05:32.744 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8545 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/802/p8022.ko 2023-12-08T08:05:32.744 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/802/psnap.ko 2023-12-08T08:05:32.744 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/802/stp.ko 2023-12-08T08:05:32.744 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/8021q/ 2023-12-08T08:05:32.744 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 81737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/8021q/8021q.ko 2023-12-08T08:05:32.744 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/9p/ 2023-12-08T08:05:32.744 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 198337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/9p/9pnet.ko 2023-12-08T08:05:32.744 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35977 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/9p/9pnet_fd.ko 2023-12-08T08:05:32.745 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/9p/9pnet_rdma.ko 2023-12-08T08:05:32.745 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/9p/9pnet_virtio.ko 2023-12-08T08:05:32.745 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/batman-adv/ 2023-12-08T08:05:32.745 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 649297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/batman-adv/batman-adv.ko 2023-12-08T08:05:32.745 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/ 2023-12-08T08:05:32.745 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 63809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/br_netfilter.ko 2023-12-08T08:05:32.745 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 777689 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/bridge.ko 2023-12-08T08:05:32.745 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ 2023-12-08T08:05:32.745 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-08T08:05:32.745 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-08T08:05:32.745 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-08T08:05:32.745 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-08T08:05:32.745 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-08T08:05:32.745 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-08T08:05:32.746 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-08T08:05:32.746 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-08T08:05:32.746 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13217 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-08T08:05:32.746 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-08T08:05:32.746 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-08T08:05:32.746 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-08T08:05:32.746 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-08T08:05:32.746 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-08T08:05:32.746 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-08T08:05:32.746 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-08T08:05:32.746 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-08T08:05:32.746 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-08T08:05:32.746 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-08T08:05:32.746 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-08T08:05:32.746 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 55929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebtables.ko 2023-12-08T08:05:32.747 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14041 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-08T08:05:32.747 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13945 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-08T08:05:32.747 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ceph/ 2023-12-08T08:05:32.747 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1047025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ceph/libceph.ko 2023-12-08T08:05:32.747 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/core/ 2023-12-08T08:05:32.747 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 125993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/core/pktgen.ko 2023-12-08T08:05:32.747 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/dccp/ 2023-12-08T08:05:32.747 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 194209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/dccp/dccp.ko 2023-12-08T08:05:32.747 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/dccp/dccp_diag.ko 2023-12-08T08:05:32.747 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 57881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/dccp/dccp_ipv4.ko 2023-12-08T08:05:32.747 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 60337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/dccp/dccp_ipv6.ko 2023-12-08T08:05:32.747 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/dsa/ 2023-12-08T08:05:32.747 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 390473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/dsa/dsa_core.ko 2023-12-08T08:05:32.747 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/dsa/tag_brcm.ko 2023-12-08T08:05:32.747 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/dsa/tag_dsa.ko 2023-12-08T08:05:32.748 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/dsa/tag_none.ko 2023-12-08T08:05:32.748 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/dsa/tag_trailer.ko 2023-12-08T08:05:32.748 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/hsr/ 2023-12-08T08:05:32.748 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 99729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/hsr/hsr.ko 2023-12-08T08:05:32.748 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ieee802154/ 2023-12-08T08:05:32.748 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ieee802154/6lowpan/ 2023-12-08T08:05:32.748 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 45233 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-08T08:05:32.748 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 254625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ieee802154/ieee802154.ko 2023-12-08T08:05:32.748 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 47289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-08T08:05:32.748 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/ 2023-12-08T08:05:32.748 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/ah4.ko 2023-12-08T08:05:32.748 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38905 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/esp4.ko 2023-12-08T08:05:32.748 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 48337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/fou.ko 2023-12-08T08:05:32.748 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/gre.ko 2023-12-08T08:05:32.748 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 48657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/inet_diag.ko 2023-12-08T08:05:32.748 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 60633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/ip_gre.ko 2023-12-08T08:05:32.749 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 61225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/ip_tunnel.ko 2023-12-08T08:05:32.749 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/ip_vti.ko 2023-12-08T08:05:32.749 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14001 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/ipcomp.ko 2023-12-08T08:05:32.749 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/ipip.ko 2023-12-08T08:05:32.749 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/ 2023-12-08T08:05:32.749 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37641 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-08T08:05:32.749 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-08T08:05:32.749 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-08T08:05:32.749 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41609 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/ip_tables.ko 2023-12-08T08:05:32.749 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-08T08:05:32.749 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-12-08T08:05:32.749 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-08T08:05:32.749 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11177 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-08T08:05:32.749 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-08T08:05:32.749 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-12-08T08:05:32.750 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-08T08:05:32.750 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14905 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-08T08:05:32.750 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11545 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-08T08:05:32.750 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-08T08:05:32.750 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-08T08:05:32.750 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-08T08:05:32.750 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-08T08:05:32.750 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18161 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-08T08:05:32.750 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-08T08:05:32.750 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20561 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-12-08T08:05:32.750 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-08T08:05:32.750 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15177 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-08T08:05:32.750 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-08T08:05:32.750 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-08T08:05:32.751 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-08T08:05:32.751 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_bic.ko 2023-12-08T08:05:32.751 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_dctcp.ko 2023-12-08T08:05:32.751 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15369 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_diag.ko 2023-12-08T08:05:32.751 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_highspeed.ko 2023-12-08T08:05:32.751 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_htcp.ko 2023-12-08T08:05:32.751 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_hybla.ko 2023-12-08T08:05:32.751 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_illinois.ko 2023-12-08T08:05:32.751 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_lp.ko 2023-12-08T08:05:32.751 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_scalable.ko 2023-12-08T08:05:32.751 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_vegas.ko 2023-12-08T08:05:32.751 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_veno.ko 2023-12-08T08:05:32.751 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_westwood.ko 2023-12-08T08:05:32.751 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_yeah.ko 2023-12-08T08:05:32.751 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tunnel4.ko 2023-12-08T08:05:32.752 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/udp_diag.ko 2023-12-08T08:05:32.752 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 41665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/udp_tunnel.ko 2023-12-08T08:05:32.752 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11361 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-08T08:05:32.752 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/ 2023-12-08T08:05:32.752 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26377 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/ah6.ko 2023-12-08T08:05:32.752 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 39537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/esp6.ko 2023-12-08T08:05:32.752 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/fou6.ko 2023-12-08T08:05:32.752 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 80897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/ip6_gre.ko 2023-12-08T08:05:32.752 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 93577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/ip6_tunnel.ko 2023-12-08T08:05:32.752 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-08T08:05:32.752 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 53273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/ip6_vti.ko 2023-12-08T08:05:32.752 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/ipcomp6.ko 2023-12-08T08:05:32.752 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/mip6.ko 2023-12-08T08:05:32.752 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ 2023-12-08T08:05:32.753 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-08T08:05:32.753 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-12-08T08:05:32.753 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-08T08:05:32.753 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-08T08:05:32.753 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-08T08:05:32.753 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-08T08:05:32.753 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-08T08:05:32.753 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16033 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-08T08:05:32.753 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8913 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-08T08:05:32.753 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-08T08:05:32.753 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-08T08:05:32.753 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-08T08:05:32.753 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-08T08:05:32.754 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-08T08:05:32.754 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-08T08:05:32.754 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11553 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-08T08:05:32.754 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-08T08:05:32.754 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 39113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-08T08:05:32.754 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-08T08:05:32.754 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25945 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-08T08:05:32.754 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-08T08:05:32.754 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-08T08:05:32.754 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-08T08:05:32.754 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-08T08:05:32.754 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-08T08:05:32.754 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 74073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/sit.ko 2023-12-08T08:05:32.755 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/tunnel6.ko 2023-12-08T08:05:32.755 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-08T08:05:32.755 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/key/ 2023-12-08T08:05:32.755 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 82833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/key/af_key.ko 2023-12-08T08:05:32.755 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/ 2023-12-08T08:05:32.755 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 125281 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_core.ko 2023-12-08T08:05:32.755 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20177 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-08T08:05:32.755 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 25953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_eth.ko 2023-12-08T08:05:32.755 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_ip.ko 2023-12-08T08:05:32.755 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36713 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_ip6.ko 2023-12-08T08:05:32.755 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33001 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_netlink.ko 2023-12-08T08:05:32.755 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 53241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_ppp.ko 2023-12-08T08:05:32.755 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/lapb/ 2023-12-08T08:05:32.755 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 47977 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/lapb/lapb.ko 2023-12-08T08:05:32.756 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/llc/ 2023-12-08T08:05:32.756 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/llc/llc.ko 2023-12-08T08:05:32.756 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 267913 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/llc/llc2.ko 2023-12-08T08:05:32.756 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/mac802154/ 2023-12-08T08:05:32.756 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 290417 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/mac802154/mac802154.ko 2023-12-08T08:05:32.756 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/mpls/ 2023-12-08T08:05:32.756 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/mpls/mpls_gso.ko 2023-12-08T08:05:32.756 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ 2023-12-08T08:05:32.756 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ 2023-12-08T08:05:32.756 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 119585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set.ko 2023-12-08T08:05:32.756 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28353 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-08T08:05:32.756 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26913 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-08T08:05:32.756 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26369 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-08T08:05:32.756 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 100297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-08T08:05:32.756 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 101441 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-08T08:05:32.757 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 102817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-08T08:05:32.757 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 103417 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-08T08:05:32.757 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 112849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-08T08:05:32.757 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 60329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-08T08:05:32.757 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 109593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-08T08:05:32.757 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 113129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-08T08:05:32.757 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 112585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-08T08:05:32.757 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 111585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-08T08:05:32.757 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 114465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-08T08:05:32.757 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-08T08:05:32.757 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ 2023-12-08T08:05:32.757 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 411729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-08T08:05:32.757 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-08T08:05:32.757 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-08T08:05:32.757 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-08T08:05:32.758 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17905 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-08T08:05:32.758 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-08T08:05:32.758 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7689 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-08T08:05:32.758 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7689 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-08T08:05:32.758 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-08T08:05:32.758 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9233 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-08T08:05:32.758 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-08T08:05:32.758 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-08T08:05:32.758 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-08T08:05:32.758 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-08T08:05:32.758 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 49257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conncount.ko 2023-12-08T08:05:32.758 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 408257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack.ko 2023-12-08T08:05:32.758 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-08T08:05:32.758 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10177 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-08T08:05:32.758 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33761 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-08T08:05:32.759 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 118145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-08T08:05:32.759 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-08T08:05:32.759 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-08T08:05:32.759 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 107233 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-08T08:05:32.759 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-08T08:05:32.759 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-08T08:05:32.759 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 66641 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-08T08:05:32.759 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11233 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-08T08:05:32.759 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-08T08:05:32.759 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-08T08:05:32.759 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 89425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_flow_table.ko 2023-12-08T08:05:32.759 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-08T08:05:32.759 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 37129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_log_syslog.ko 2023-12-08T08:05:32.759 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 95353 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_nat.ko 2023-12-08T08:05:32.759 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-08T08:05:32.760 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-08T08:05:32.760 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_nat_irc.ko 2023-12-08T08:05:32.760 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_nat_sip.ko 2023-12-08T08:05:32.760 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-08T08:05:32.760 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 44065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-08T08:05:32.760 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 615649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_tables.ko 2023-12-08T08:05:32.760 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 42561 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nfnetlink.ko 2023-12-08T08:05:32.760 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30233 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-08T08:05:32.760 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-12-08T08:05:32.760 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 39785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nfnetlink_log.ko 2023-12-08T08:05:32.760 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-08T08:05:32.760 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 49377 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-08T08:05:32.760 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10457 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_chain_nat.ko 2023-12-08T08:05:32.760 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_compat.ko 2023-12-08T08:05:32.760 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 40721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_ct.ko 2023-12-08T08:05:32.761 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-08T08:05:32.761 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_fib.ko 2023-12-08T08:05:32.761 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-08T08:05:32.761 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_hash.ko 2023-12-08T08:05:32.761 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_limit.ko 2023-12-08T08:05:32.761 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_log.ko 2023-12-08T08:05:32.761 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_masq.ko 2023-12-08T08:05:32.761 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_nat.ko 2023-12-08T08:05:32.761 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_numgen.ko 2023-12-08T08:05:32.761 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_osf.ko 2023-12-08T08:05:32.761 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_queue.ko 2023-12-08T08:05:32.761 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_redir.ko 2023-12-08T08:05:32.761 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_reject.ko 2023-12-08T08:05:32.761 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_reject_inet.ko 2023-12-08T08:05:32.761 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_socket.ko 2023-12-08T08:05:32.762 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20369 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_synproxy.ko 2023-12-08T08:05:32.762 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_tproxy.ko 2023-12-08T08:05:32.762 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 89313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/x_tables.ko 2023-12-08T08:05:32.762 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_AUDIT.ko 2023-12-08T08:05:32.762 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-08T08:05:32.762 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-08T08:05:32.762 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-08T08:05:32.762 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 18169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_CT.ko 2023-12-08T08:05:32.762 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_DSCP.ko 2023-12-08T08:05:32.762 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_HL.ko 2023-12-08T08:05:32.762 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13369 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_HMARK.ko 2023-12-08T08:05:32.762 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-08T08:05:32.762 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13889 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_LED.ko 2023-12-08T08:05:32.762 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_LOG.ko 2023-12-08T08:05:32.763 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-08T08:05:32.763 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_NETMAP.ko 2023-12-08T08:05:32.763 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_NFLOG.ko 2023-12-08T08:05:32.763 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-08T08:05:32.763 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_RATEEST.ko 2023-12-08T08:05:32.763 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-08T08:05:32.763 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 14337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_SECMARK.ko 2023-12-08T08:05:32.763 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-08T08:05:32.763 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-08T08:05:32.763 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17361 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_TEE.ko 2023-12-08T08:05:32.763 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_TPROXY.ko 2023-12-08T08:05:32.763 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_TRACE.ko 2023-12-08T08:05:32.763 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_addrtype.ko 2023-12-08T08:05:32.763 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_bpf.ko 2023-12-08T08:05:32.763 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_cgroup.ko 2023-12-08T08:05:32.764 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_cluster.ko 2023-12-08T08:05:32.764 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_comment.ko 2023-12-08T08:05:32.764 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_connbytes.ko 2023-12-08T08:05:32.764 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_connlabel.ko 2023-12-08T08:05:32.764 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_connlimit.ko 2023-12-08T08:05:32.764 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_connmark.ko 2023-12-08T08:05:32.764 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_conntrack.ko 2023-12-08T08:05:32.764 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_cpu.ko 2023-12-08T08:05:32.764 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_dccp.ko 2023-12-08T08:05:32.764 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_devgroup.ko 2023-12-08T08:05:32.764 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_dscp.ko 2023-12-08T08:05:32.764 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_ecn.ko 2023-12-08T08:05:32.764 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_esp.ko 2023-12-08T08:05:32.764 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 43289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_hashlimit.ko 2023-12-08T08:05:32.765 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_helper.ko 2023-12-08T08:05:32.765 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_hl.ko 2023-12-08T08:05:32.765 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_ipcomp.ko 2023-12-08T08:05:32.765 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_iprange.ko 2023-12-08T08:05:32.765 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_ipvs.ko 2023-12-08T08:05:32.765 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16041 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_l2tp.ko 2023-12-08T08:05:32.765 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8001 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_length.ko 2023-12-08T08:05:32.765 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_limit.ko 2023-12-08T08:05:32.765 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7545 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_mac.ko 2023-12-08T08:05:32.765 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_mark.ko 2023-12-08T08:05:32.765 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_multiport.ko 2023-12-08T08:05:32.765 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_nat.ko 2023-12-08T08:05:32.765 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_nfacct.ko 2023-12-08T08:05:32.765 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_osf.ko 2023-12-08T08:05:32.765 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9553 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_owner.ko 2023-12-08T08:05:32.765 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_physdev.ko 2023-12-08T08:05:32.766 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_pkttype.ko 2023-12-08T08:05:32.766 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_policy.ko 2023-12-08T08:05:32.766 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_quota.ko 2023-12-08T08:05:32.766 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_rateest.ko 2023-12-08T08:05:32.766 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_realm.ko 2023-12-08T08:05:32.766 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_recent.ko 2023-12-08T08:05:32.766 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_sctp.ko 2023-12-08T08:05:32.766 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_set.ko 2023-12-08T08:05:32.766 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 16089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_socket.ko 2023-12-08T08:05:32.766 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_state.ko 2023-12-08T08:05:32.766 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_statistic.ko 2023-12-08T08:05:32.766 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_string.ko 2023-12-08T08:05:32.766 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 8553 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_tcpmss.ko 2023-12-08T08:05:32.766 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15777 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_tcpudp.ko 2023-12-08T08:05:32.767 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_time.ko 2023-12-08T08:05:32.767 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_u32.ko 2023-12-08T08:05:32.767 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netlink/ 2023-12-08T08:05:32.767 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netlink/netlink_diag.ko 2023-12-08T08:05:32.767 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/nsh/ 2023-12-08T08:05:32.767 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 12425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/nsh/nsh.ko 2023-12-08T08:05:32.767 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/openvswitch/ 2023-12-08T08:05:32.767 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 380033 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/openvswitch/openvswitch.ko 2023-12-08T08:05:32.767 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/openvswitch/vport-geneve.ko 2023-12-08T08:05:32.767 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/openvswitch/vport-gre.ko 2023-12-08T08:05:32.767 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 11793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/openvswitch/vport-vxlan.ko 2023-12-08T08:05:32.767 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/packet/ 2023-12-08T08:05:32.767 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/packet/af_packet_diag.ko 2023-12-08T08:05:32.767 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/phonet/ 2023-12-08T08:05:32.767 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 110201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/phonet/phonet.ko 2023-12-08T08:05:32.767 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 54721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/phonet/pn_pep.ko 2023-12-08T08:05:32.768 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/rds/ 2023-12-08T08:05:32.768 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 251481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/rds/rds.ko 2023-12-08T08:05:32.768 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 164937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/rds/rds_rdma.ko 2023-12-08T08:05:32.768 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 67377 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/rds/rds_tcp.ko 2023-12-08T08:05:32.768 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/rxrpc/ 2023-12-08T08:05:32.768 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 819657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/rxrpc/rxrpc.ko 2023-12-08T08:05:32.768 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/ 2023-12-08T08:05:32.768 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_csum.ko 2023-12-08T08:05:32.768 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_gact.ko 2023-12-08T08:05:32.768 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_ipt.ko 2023-12-08T08:05:32.768 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_mirred.ko 2023-12-08T08:05:32.768 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_nat.ko 2023-12-08T08:05:32.768 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 43449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_pedit.ko 2023-12-08T08:05:32.768 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_police.ko 2023-12-08T08:05:32.769 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_simple.ko 2023-12-08T08:05:32.769 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_skbedit.ko 2023-12-08T08:05:32.769 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_vlan.ko 2023-12-08T08:05:32.769 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/cls_basic.ko 2023-12-08T08:05:32.769 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/cls_bpf.ko 2023-12-08T08:05:32.769 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/cls_cgroup.ko 2023-12-08T08:05:32.769 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/cls_flow.ko 2023-12-08T08:05:32.769 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31769 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/cls_fw.ko 2023-12-08T08:05:32.769 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 38425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/cls_route.ko 2023-12-08T08:05:32.769 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 61409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/cls_u32.ko 2023-12-08T08:05:32.769 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7441 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/em_cmp.ko 2023-12-08T08:05:32.769 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 13409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/em_ipset.ko 2023-12-08T08:05:32.769 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/em_meta.ko 2023-12-08T08:05:32.769 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/em_nbyte.ko 2023-12-08T08:05:32.769 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/em_text.ko 2023-12-08T08:05:32.770 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7249 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/em_u32.ko 2023-12-08T08:05:32.770 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 21649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_choke.ko 2023-12-08T08:05:32.770 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_codel.ko 2023-12-08T08:05:32.770 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 34633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_drr.ko 2023-12-08T08:05:32.770 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 33609 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_fq.ko 2023-12-08T08:05:32.770 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_fq_codel.ko 2023-12-08T08:05:32.770 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 35433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_gred.ko 2023-12-08T08:05:32.770 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 49817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_hfsc.ko 2023-12-08T08:05:32.770 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_hhf.ko 2023-12-08T08:05:32.770 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 66393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_htb.ko 2023-12-08T08:05:32.770 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_ingress.ko 2023-12-08T08:05:32.770 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 30273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_mqprio.ko 2023-12-08T08:05:32.770 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_mqprio_lib.ko 2023-12-08T08:05:32.770 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_multiq.ko 2023-12-08T08:05:32.771 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 36137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_netem.ko 2023-12-08T08:05:32.771 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 27497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_pie.ko 2023-12-08T08:05:32.771 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_plug.ko 2023-12-08T08:05:32.771 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 24729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_prio.ko 2023-12-08T08:05:32.771 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 48729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_qfq.ko 2023-12-08T08:05:32.771 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 32905 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_red.ko 2023-12-08T08:05:32.771 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 26881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_sfb.ko 2023-12-08T08:05:32.771 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 31353 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_sfq.ko 2023-12-08T08:05:32.771 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_tbf.ko 2023-12-08T08:05:32.771 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 28105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_teql.ko 2023-12-08T08:05:32.771 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sctp/ 2023-12-08T08:05:32.771 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 929745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sctp/sctp.ko 2023-12-08T08:05:32.771 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 19033 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sctp/sctp_diag.ko 2023-12-08T08:05:32.771 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc/ 2023-12-08T08:05:32.771 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc/auth_gss/ 2023-12-08T08:05:32.772 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 336529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-08T08:05:32.772 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 54737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-08T08:05:32.772 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 1520097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc/sunrpc.ko 2023-12-08T08:05:32.772 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc/xprtrdma/ 2023-12-08T08:05:32.772 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 707657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-08T08:05:32.772 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/tipc/ 2023-12-08T08:05:32.772 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/tipc/diag.ko 2023-12-08T08:05:32.772 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 862665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/tipc/tipc.ko 2023-12-08T08:05:32.772 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/unix/ 2023-12-08T08:05:32.772 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/unix/unix_diag.ko 2023-12-08T08:05:32.772 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/vmw_vsock/ 2023-12-08T08:05:32.772 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 85409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-08T08:05:32.772 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 68049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-08T08:05:32.772 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 96193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/vmw_vsock/vsock.ko 2023-12-08T08:05:32.772 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 10705 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-08T08:05:32.773 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 17521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-08T08:05:32.773 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/x25/ 2023-12-08T08:05:32.773 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 125177 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/x25/x25.ko 2023-12-08T08:05:32.773 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/xfrm/ 2023-12-08T08:05:32.773 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 22657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/xfrm/xfrm_algo.ko 2023-12-08T08:05:32.773 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 20649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-08T08:05:32.773 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 102257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/xfrm/xfrm_user.ko 2023-12-08T08:05:32.773 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/virt/ 2023-12-08T08:05:32.773 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/virt/lib/ 2023-12-08T08:05:32.773 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 15537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/virt/lib/irqbypass.ko 2023-12-08T08:05:32.773 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 640081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/modules.alias 2023-12-08T08:05:32.773 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 624107 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/modules.alias.bin 2023-12-08T08:05:32.773 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 7663 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/modules.builtin 2023-12-08T08:05:32.773 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 23428 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/modules.builtin.alias.bin 2023-12-08T08:05:32.773 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 9821 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/modules.builtin.bin 2023-12-08T08:05:32.774 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 70004 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/modules.builtin.modinfo 2023-12-08T08:05:32.774 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 146313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/modules.dep 2023-12-08T08:05:32.774 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 232548 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/modules.dep.bin 2023-12-08T08:05:32.774 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 210 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/modules.devname 2023-12-08T08:05:32.774 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 72606 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/modules.order 2023-12-08T08:05:32.774 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 879 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/modules.softdep 2023-12-08T08:05:32.774 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 254438 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/modules.symbols 2023-12-08T08:05:32.774 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 309363 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/modules.symbols.bin 2023-12-08T08:05:32.774 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./usr/ 2023-12-08T08:05:32.774 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./usr/share/ 2023-12-08T08:05:32.774 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./usr/share/doc/ 2023-12-08T08:05:32.774 INFO:teuthology.orchestra.run.smithi148.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./usr/share/doc/linux-image-6.6.0-g6bcacf46b788/ 2023-12-08T08:05:32.774 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 171 2023-12-08 05:25 ./usr/share/doc/linux-image-6.6.0-g6bcacf46b788/changelog.Debian.gz 2023-12-08T08:05:32.774 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r-- root/root 691 2023-12-08 05:25 ./usr/share/doc/linux-image-6.6.0-g6bcacf46b788/copyright 2023-12-08T08:05:32.775 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g6bcacf46b788 2023-12-08T08:05:32.776 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g6bcacf46b788 2023-12-08T08:05:32.776 DEBUG:teuthology.orchestra.run.smithi148:> egrep '(submenu|menuentry.*6.6.0-g6bcacf46b788).*{' /boot/grub/grub.cfg 2023-12-08T08:05:32.782 INFO:teuthology.orchestra.run.smithi148.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-08T08:05:32.782 INFO:teuthology.orchestra.run.smithi148.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g6bcacf46b788' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g6bcacf46b788-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-08T08:05:32.782 INFO:teuthology.orchestra.run.smithi148.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g6bcacf46b788 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g6bcacf46b788-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-08T08:05:32.783 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-12-08T08:05:32.783 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g6bcacf46b788 2023-12-08T08:05:32.783 DEBUG:teuthology.orchestra.run.smithi148:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-12-08T08:05:32.827 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi148.front.sepia.ceph.com to complete... 2023-12-08T08:05:33.223 INFO:teuthology.orchestra.run.smithi148.stderr:Sourcing file `/etc/default/grub' 2023-12-08T08:05:33.224 INFO:teuthology.orchestra.run.smithi148.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-08T08:05:33.251 INFO:teuthology.orchestra.run.smithi148.stderr:Generating grub configuration file ... 2023-12-08T08:05:33.463 INFO:teuthology.orchestra.run.smithi148.stderr:Found linux image: /boot/vmlinuz-6.6.0-g6bcacf46b788 2023-12-08T08:05:33.469 INFO:teuthology.orchestra.run.smithi148.stderr:Found initrd image: /boot/initrd.img-6.6.0-g6bcacf46b788 2023-12-08T08:05:33.736 INFO:teuthology.orchestra.run.smithi148.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-08T08:05:33.741 INFO:teuthology.orchestra.run.smithi148.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-08T08:05:33.784 INFO:teuthology.orchestra.run.smithi148.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-08T08:05:33.789 INFO:teuthology.orchestra.run.smithi148.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-08T08:05:33.945 INFO:teuthology.orchestra.run.smithi148.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-08T08:05:33.946 INFO:teuthology.orchestra.run.smithi148.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-08T08:05:33.946 INFO:teuthology.orchestra.run.smithi148.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-08T08:05:33.968 INFO:teuthology.orchestra.run.smithi148.stderr:done 2023-12-08T08:05:34.768 INFO:teuthology.orchestra.run.smithi088.stderr:Sourcing file `/etc/default/grub' 2023-12-08T08:05:34.786 INFO:teuthology.orchestra.run.smithi088.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-08T08:05:34.839 INFO:teuthology.orchestra.run.smithi088.stderr:Generating grub configuration file ... 2023-12-08T08:05:35.191 INFO:teuthology.orchestra.run.smithi088.stderr:Found linux image: /boot/vmlinuz-6.6.0-g6bcacf46b788 2023-12-08T08:05:35.207 INFO:teuthology.orchestra.run.smithi088.stderr:Found initrd image: /boot/initrd.img-6.6.0-g6bcacf46b788 2023-12-08T08:05:35.546 INFO:teuthology.orchestra.run.smithi088.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-08T08:05:35.558 INFO:teuthology.orchestra.run.smithi088.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-08T08:05:35.625 INFO:teuthology.orchestra.run.smithi088.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-08T08:05:35.631 INFO:teuthology.orchestra.run.smithi088.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-08T08:05:35.781 INFO:teuthology.orchestra.run.smithi088.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-08T08:05:35.782 INFO:teuthology.orchestra.run.smithi088.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-08T08:05:35.782 INFO:teuthology.orchestra.run.smithi088.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-08T08:05:35.827 INFO:teuthology.orchestra.run.smithi088.stderr:done 2023-12-08T08:05:36.001 DEBUG:teuthology.orchestra.run.smithi088:> dpkg-deb -c /tmp/linux-image.deb 2023-12-08T08:05:36.008 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./ 2023-12-08T08:05:36.008 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./boot/ 2023-12-08T08:05:36.009 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 4415617 2023-12-08 05:25 ./boot/System.map-6.6.0-g6bcacf46b788 2023-12-08T08:05:36.020 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 169214 2023-12-08 05:25 ./boot/config-6.6.0-g6bcacf46b788 2023-12-08T08:05:36.021 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11352864 2023-12-08 05:25 ./boot/vmlinuz-6.6.0-g6bcacf46b788 2023-12-08T08:05:36.040 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./etc/ 2023-12-08T08:05:36.040 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./etc/kernel/ 2023-12-08T08:05:36.040 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./etc/kernel/postinst.d/ 2023-12-08T08:05:36.040 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./etc/kernel/postrm.d/ 2023-12-08T08:05:36.040 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./etc/kernel/preinst.d/ 2023-12-08T08:05:36.041 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./etc/kernel/prerm.d/ 2023-12-08T08:05:36.041 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/ 2023-12-08T08:05:36.041 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/ 2023-12-08T08:05:36.041 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/ 2023-12-08T08:05:36.041 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/ 2023-12-08T08:05:36.041 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/ 2023-12-08T08:05:36.041 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/ 2023-12-08T08:05:36.041 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/ 2023-12-08T08:05:36.041 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 490233 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/aesni-intel.ko 2023-12-08T08:05:36.043 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-08T08:05:36.043 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-08T08:05:36.043 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-08T08:05:36.044 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 93113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-08T08:05:36.044 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 106729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-08T08:05:36.044 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 152241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-08T08:05:36.044 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12553 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-08T08:05:36.044 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13777 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-08T08:05:36.044 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 83889 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-08T08:05:36.044 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-08T08:05:36.044 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-08T08:05:36.044 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-08T08:05:36.044 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-08T08:05:36.044 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-08T08:05:36.044 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-08T08:05:36.044 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 58585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-08T08:05:36.044 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-08T08:05:36.045 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-08T08:05:36.045 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-08T08:05:36.045 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kernel/ 2023-12-08T08:05:36.045 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kernel/cpu/ 2023-12-08T08:05:36.045 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kernel/cpu/mce/ 2023-12-08T08:05:36.045 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-08T08:05:36.045 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13353 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kernel/cpuid.ko 2023-12-08T08:05:36.045 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kernel/msr.ko 2023-12-08T08:05:36.045 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kvm/ 2023-12-08T08:05:36.045 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 354433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-08T08:05:36.045 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 881625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-08T08:05:36.046 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 2275865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kvm/kvm.ko 2023-12-08T08:05:36.092 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/ 2023-12-08T08:05:36.092 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/af_alg.ko 2023-12-08T08:05:36.092 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/algif_hash.ko 2023-12-08T08:05:36.092 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/algif_skcipher.ko 2023-12-08T08:05:36.092 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/ansi_cprng.ko 2023-12-08T08:05:36.092 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19641 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/anubis.ko 2023-12-08T08:05:36.092 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/arc4.ko 2023-12-08T08:05:36.092 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/asymmetric_keys/ 2023-12-08T08:05:36.093 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-12-08T08:05:36.093 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx/ 2023-12-08T08:05:36.093 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11249 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx/async_memcpy.ko 2023-12-08T08:05:36.093 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx/async_pq.ko 2023-12-08T08:05:36.093 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21561 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-08T08:05:36.093 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx/async_tx.ko 2023-12-08T08:05:36.093 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx/async_xor.ko 2023-12-08T08:05:36.093 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx/raid6test.ko 2023-12-08T08:05:36.093 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/authenc.ko 2023-12-08T08:05:36.093 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/authencesn.ko 2023-12-08T08:05:36.093 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/blake2b_generic.ko 2023-12-08T08:05:36.093 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/blowfish_common.ko 2023-12-08T08:05:36.093 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/blowfish_generic.ko 2023-12-08T08:05:36.093 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/camellia_generic.ko 2023-12-08T08:05:36.093 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/cast5_generic.ko 2023-12-08T08:05:36.094 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/cast6_generic.ko 2023-12-08T08:05:36.094 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/cast_common.ko 2023-12-08T08:05:36.094 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/ccm.ko 2023-12-08T08:05:36.094 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14769 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/cmac.ko 2023-12-08T08:05:36.094 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/crc32_generic.ko 2023-12-08T08:05:36.094 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/cryptd.ko 2023-12-08T08:05:36.094 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/crypto_engine.ko 2023-12-08T08:05:36.094 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/crypto_simd.ko 2023-12-08T08:05:36.094 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/crypto_user.ko 2023-12-08T08:05:36.094 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/cts.ko 2023-12-08T08:05:36.094 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10913 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/des_generic.ko 2023-12-08T08:05:36.094 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/dh_generic.ko 2023-12-08T08:05:36.094 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11001 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/echainiv.ko 2023-12-08T08:05:36.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/essiv.ko 2023-12-08T08:05:36.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/fcrypt.ko 2023-12-08T08:05:36.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/khazad.ko 2023-12-08T08:05:36.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/lrw.ko 2023-12-08T08:05:36.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11513 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/lz4.ko 2023-12-08T08:05:36.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/lz4hc.ko 2023-12-08T08:05:36.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/md4.ko 2023-12-08T08:05:36.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/michael_mic.ko 2023-12-08T08:05:36.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/pcbc.ko 2023-12-08T08:05:36.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/pcrypt.ko 2023-12-08T08:05:36.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/rmd160.ko 2023-12-08T08:05:36.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/seed.ko 2023-12-08T08:05:36.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/serpent_generic.ko 2023-12-08T08:05:36.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 149193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/tcrypt.ko 2023-12-08T08:05:36.095 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/tea.ko 2023-12-08T08:05:36.096 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28777 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/twofish_common.ko 2023-12-08T08:05:36.096 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/twofish_generic.ko 2023-12-08T08:05:36.096 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/vmac.ko 2023-12-08T08:05:36.096 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/wp512.ko 2023-12-08T08:05:36.096 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/xcbc.ko 2023-12-08T08:05:36.096 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/xor.ko 2023-12-08T08:05:36.096 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18713 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/xts.ko 2023-12-08T08:05:36.096 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/xxhash_generic.ko 2023-12-08T08:05:36.096 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ 2023-12-08T08:05:36.096 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/ 2023-12-08T08:05:36.096 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18249 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/acpi_extlog.ko 2023-12-08T08:05:36.096 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-08T08:05:36.096 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/acpi_pad.ko 2023-12-08T08:05:36.096 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/apei/ 2023-12-08T08:05:36.096 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/apei/einj.ko 2023-12-08T08:05:36.097 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/ec_sys.ko 2023-12-08T08:05:36.097 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/platform_profile.ko 2023-12-08T08:05:36.097 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/sbs.ko 2023-12-08T08:05:36.097 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/sbshc.ko 2023-12-08T08:05:36.097 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 103025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/video.ko 2023-12-08T08:05:36.097 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/ 2023-12-08T08:05:36.097 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/acard-ahci.ko 2023-12-08T08:05:36.097 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 88865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/ahci.ko 2023-12-08T08:05:36.097 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/ahci_platform.ko 2023-12-08T08:05:36.097 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 88289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/libahci.ko 2023-12-08T08:05:36.097 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/libahci_platform.ko 2023-12-08T08:05:36.097 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_acpi.ko 2023-12-08T08:05:36.097 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_ali.ko 2023-12-08T08:05:36.097 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_amd.ko 2023-12-08T08:05:36.098 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_artop.ko 2023-12-08T08:05:36.098 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_atiixp.ko 2023-12-08T08:05:36.098 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24945 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_atp867x.ko 2023-12-08T08:05:36.098 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_cmd640.ko 2023-12-08T08:05:36.098 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_cmd64x.ko 2023-12-08T08:05:36.098 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_cypress.ko 2023-12-08T08:05:36.098 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_efar.ko 2023-12-08T08:05:36.098 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21945 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_hpt366.ko 2023-12-08T08:05:36.098 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33977 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_hpt37x.ko 2023-12-08T08:05:36.098 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-08T08:05:36.098 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-08T08:05:36.098 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_it8213.ko 2023-12-08T08:05:36.098 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_it821x.ko 2023-12-08T08:05:36.098 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12889 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_jmicron.ko 2023-12-08T08:05:36.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_legacy.ko 2023-12-08T08:05:36.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_marvell.ko 2023-12-08T08:05:36.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16281 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_mpiix.ko 2023-12-08T08:05:36.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_netcell.ko 2023-12-08T08:05:36.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_ninja32.ko 2023-12-08T08:05:36.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_ns87410.ko 2023-12-08T08:05:36.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17361 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_ns87415.ko 2023-12-08T08:05:36.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_oldpiix.ko 2023-12-08T08:05:36.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15377 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_opti.ko 2023-12-08T08:05:36.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_optidma.ko 2023-12-08T08:05:36.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_pcmcia.ko 2023-12-08T08:05:36.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-08T08:05:36.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20561 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-08T08:05:36.099 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_piccolo.ko 2023-12-08T08:05:36.100 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_radisys.ko 2023-12-08T08:05:36.100 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_rdc.ko 2023-12-08T08:05:36.100 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_rz1000.ko 2023-12-08T08:05:36.100 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_sch.ko 2023-12-08T08:05:36.100 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_serverworks.ko 2023-12-08T08:05:36.100 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23457 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_sil680.ko 2023-12-08T08:05:36.100 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_sl82c105.ko 2023-12-08T08:05:36.100 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_triflex.ko 2023-12-08T08:05:36.100 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_via.ko 2023-12-08T08:05:36.100 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pdc_adma.ko 2023-12-08T08:05:36.100 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_inic162x.ko 2023-12-08T08:05:36.100 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 83345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_mv.ko 2023-12-08T08:05:36.100 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 70393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_nv.ko 2023-12-08T08:05:36.100 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37377 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_promise.ko 2023-12-08T08:05:36.100 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23041 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_qstor.ko 2023-12-08T08:05:36.101 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_sil.ko 2023-12-08T08:05:36.101 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_sil24.ko 2023-12-08T08:05:36.101 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17945 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_sis.ko 2023-12-08T08:05:36.101 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20441 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_svw.ko 2023-12-08T08:05:36.101 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_sx4.ko 2023-12-08T08:05:36.101 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_uli.ko 2023-12-08T08:05:36.101 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_via.ko 2023-12-08T08:05:36.101 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_vsc.ko 2023-12-08T08:05:36.101 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/auxdisplay/ 2023-12-08T08:05:36.101 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/auxdisplay/ks0108.ko 2023-12-08T08:05:36.101 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/bcma/ 2023-12-08T08:05:36.101 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 124473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/bcma/bcma.ko 2023-12-08T08:05:36.101 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/ 2023-12-08T08:05:36.101 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/aoe/ 2023-12-08T08:05:36.102 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 113665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/aoe/aoe.ko 2023-12-08T08:05:36.102 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/drbd/ 2023-12-08T08:05:36.102 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 965585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/drbd/drbd.ko 2023-12-08T08:05:36.102 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 173225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/floppy.ko 2023-12-08T08:05:36.102 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/mtip32xx/ 2023-12-08T08:05:36.102 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 94297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-08T08:05:36.102 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 115793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/nbd.ko 2023-12-08T08:05:36.102 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/null_blk/ 2023-12-08T08:05:36.102 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 110385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/null_blk/null_blk.ko 2023-12-08T08:05:36.102 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 98193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/pktcdvd.ko 2023-12-08T08:05:36.102 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 263769 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/rbd.ko 2023-12-08T08:05:36.102 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/xen-blkback/ 2023-12-08T08:05:36.102 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 98145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-08T08:05:36.103 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/zram/ 2023-12-08T08:05:36.103 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60217 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/zram/zram.ko 2023-12-08T08:05:36.103 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ 2023-12-08T08:05:36.103 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30705 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/applicom.ko 2023-12-08T08:05:36.103 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hangcheck-timer.ko 2023-12-08T08:05:36.103 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hw_random/ 2023-12-08T08:05:36.103 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13889 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-08T08:05:36.103 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-08T08:05:36.103 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-08T08:05:36.103 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hw_random/via-rng.ko 2023-12-08T08:05:36.103 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-08T08:05:36.103 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi/ 2023-12-08T08:05:36.103 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30713 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-08T08:05:36.103 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 148601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-08T08:05:36.104 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-08T08:05:36.104 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 139313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-08T08:05:36.104 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 70921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-08T08:05:36.104 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53513 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-08T08:05:36.104 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/lp.ko 2023-12-08T08:05:36.104 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/mwave/ 2023-12-08T08:05:36.104 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 84097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/mwave/mwave.ko 2023-12-08T08:05:36.104 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/nvram.ko 2023-12-08T08:05:36.104 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ppdev.ko 2023-12-08T08:05:36.104 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tlclk.ko 2023-12-08T08:05:36.104 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/ 2023-12-08T08:05:36.104 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-08T08:05:36.104 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-12-08T08:05:36.104 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-12-08T08:05:36.104 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-12-08T08:05:36.105 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-08T08:05:36.105 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-08T08:05:36.105 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23561 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-12-08T08:05:36.105 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/xillybus/ 2023-12-08T08:05:36.105 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17001 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/xillybus/xillybus_class.ko 2023-12-08T08:05:36.105 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50945 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/xillybus/xillybus_core.ko 2023-12-08T08:05:36.105 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-12-08T08:05:36.105 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/clk/ 2023-12-08T08:05:36.105 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/clk/clk-palmas.ko 2023-12-08T08:05:36.105 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/clk/clk-si5351.ko 2023-12-08T08:05:36.105 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11457 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/clk/clk-twl6040.ko 2023-12-08T08:05:36.105 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19249 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/clk/clk-wm831x.ko 2023-12-08T08:05:36.105 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/cpufreq/ 2023-12-08T08:05:36.105 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-08T08:05:36.106 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-08T08:05:36.106 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-08T08:05:36.106 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/ 2023-12-08T08:05:36.106 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/ccp/ 2023-12-08T08:05:36.106 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 70801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-08T08:05:36.106 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 243025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/ccp/ccp.ko 2023-12-08T08:05:36.106 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/intel/ 2023-12-08T08:05:36.106 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/intel/qat/ 2023-12-08T08:05:36.106 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/intel/qat/qat_common/ 2023-12-08T08:05:36.106 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 438761 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-08T08:05:36.106 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-12-08T08:05:36.106 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-08T08:05:36.106 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/padlock-aes.ko 2023-12-08T08:05:36.106 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/padlock-sha.ko 2023-12-08T08:05:36.107 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/virtio/ 2023-12-08T08:05:36.107 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 70273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-08T08:05:36.107 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dca/ 2023-12-08T08:05:36.107 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dca/dca.ko 2023-12-08T08:05:36.107 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dma/ 2023-12-08T08:05:36.107 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dma/dw/ 2023-12-08T08:05:36.107 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-08T08:05:36.107 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dma/ioat/ 2023-12-08T08:05:36.107 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 122569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-08T08:05:36.107 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/ 2023-12-08T08:05:36.107 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 79953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/amd64_edac.ko 2023-12-08T08:05:36.107 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35769 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/e752x_edac.ko 2023-12-08T08:05:36.107 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 63617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/edac_mce_amd.ko 2023-12-08T08:05:36.107 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i3000_edac.ko 2023-12-08T08:05:36.108 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i3200_edac.ko 2023-12-08T08:05:36.108 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i5100_edac.ko 2023-12-08T08:05:36.108 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i5400_edac.ko 2023-12-08T08:05:36.108 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24913 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i7300_edac.ko 2023-12-08T08:05:36.108 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 52041 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i7core_edac.ko 2023-12-08T08:05:36.108 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i82975x_edac.ko 2023-12-08T08:05:36.108 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/ie31200_edac.ko 2023-12-08T08:05:36.108 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 56825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/sb_edac.ko 2023-12-08T08:05:36.108 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/x38_edac.ko 2023-12-08T08:05:36.108 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/extcon/ 2023-12-08T08:05:36.108 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/extcon/extcon-gpio.ko 2023-12-08T08:05:36.109 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/extcon/extcon-max14577.ko 2023-12-08T08:05:36.109 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/extcon/extcon-max77693.ko 2023-12-08T08:05:36.109 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/extcon/extcon-max8997.ko 2023-12-08T08:05:36.109 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/extcon/extcon-palmas.ko 2023-12-08T08:05:36.109 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23713 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/extcon/extcon-rt8973a.ko 2023-12-08T08:05:36.109 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/extcon/extcon-sm5502.ko 2023-12-08T08:05:36.109 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/firmware/ 2023-12-08T08:05:36.109 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34977 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/firmware/dmi-sysfs.ko 2023-12-08T08:05:36.109 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/firmware/efi/ 2023-12-08T08:05:36.109 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/firmware/efi/efi-pstore.ko 2023-12-08T08:05:36.109 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-08T08:05:36.109 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/ 2023-12-08T08:05:36.109 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-adp5520.ko 2023-12-08T08:05:36.109 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20153 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-amd8111.ko 2023-12-08T08:05:36.110 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-arizona.ko 2023-12-08T08:05:36.110 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-da9052.ko 2023-12-08T08:05:36.110 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-da9055.ko 2023-12-08T08:05:36.110 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-dln2.ko 2023-12-08T08:05:36.110 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 77849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-f7188x.ko 2023-12-08T08:05:36.110 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-generic.ko 2023-12-08T08:05:36.110 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-ich.ko 2023-12-08T08:05:36.110 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11905 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-12-08T08:05:36.110 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-kempld.ko 2023-12-08T08:05:36.110 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-lp3943.ko 2023-12-08T08:05:36.110 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-max7300.ko 2023-12-08T08:05:36.110 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11905 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-max730x.ko 2023-12-08T08:05:36.110 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-max732x.ko 2023-12-08T08:05:36.110 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-12-08T08:05:36.111 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-pca953x.ko 2023-12-08T08:05:36.111 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-pcf857x.ko 2023-12-08T08:05:36.111 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14377 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-rdc321x.ko 2023-12-08T08:05:36.111 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-sch.ko 2023-12-08T08:05:36.111 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-sch311x.ko 2023-12-08T08:05:36.111 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-tps65912.ko 2023-12-08T08:05:36.111 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-twl4030.ko 2023-12-08T08:05:36.111 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-twl6040.ko 2023-12-08T08:05:36.111 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-08T08:05:36.111 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15377 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-vx855.ko 2023-12-08T08:05:36.111 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16281 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-wm831x.ko 2023-12-08T08:05:36.111 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-wm8350.ko 2023-12-08T08:05:36.111 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-wm8994.ko 2023-12-08T08:05:36.111 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/ 2023-12-08T08:05:36.112 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-a4tech.ko 2023-12-08T08:05:36.112 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-apple.ko 2023-12-08T08:05:36.112 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-appleir.ko 2023-12-08T08:05:36.112 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8353 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-aureal.ko 2023-12-08T08:05:36.112 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-axff.ko 2023-12-08T08:05:36.112 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-belkin.ko 2023-12-08T08:05:36.112 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-cherry.ko 2023-12-08T08:05:36.112 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16041 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-chicony.ko 2023-12-08T08:05:36.112 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-cp2112.ko 2023-12-08T08:05:36.112 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-cypress.ko 2023-12-08T08:05:36.112 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-dr.ko 2023-12-08T08:05:36.112 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-elecom.ko 2023-12-08T08:05:36.112 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-elo.ko 2023-12-08T08:05:36.113 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13457 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-emsff.ko 2023-12-08T08:05:36.113 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-ezkey.ko 2023-12-08T08:05:36.113 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-gaff.ko 2023-12-08T08:05:36.113 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-generic.ko 2023-12-08T08:05:36.113 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-gt683r.ko 2023-12-08T08:05:36.113 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-gyration.ko 2023-12-08T08:05:36.113 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10161 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-08T08:05:36.113 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10457 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-08T08:05:36.113 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-holtekff.ko 2023-12-08T08:05:36.113 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-hyperv.ko 2023-12-08T08:05:36.113 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-icade.ko 2023-12-08T08:05:36.113 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-kensington.ko 2023-12-08T08:05:36.113 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8545 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-keytouch.ko 2023-12-08T08:05:36.113 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-kye.ko 2023-12-08T08:05:36.113 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-lcpower.ko 2023-12-08T08:05:36.114 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-led.ko 2023-12-08T08:05:36.114 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-lenovo.ko 2023-12-08T08:05:36.114 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-lg-g15.ko 2023-12-08T08:05:36.114 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 58185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-08T08:05:36.114 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 101481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-08T08:05:36.114 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 80993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-logitech.ko 2023-12-08T08:05:36.114 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-magicmouse.ko 2023-12-08T08:05:36.114 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-microsoft.ko 2023-12-08T08:05:36.114 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10361 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-monterey.ko 2023-12-08T08:05:36.114 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50161 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-multitouch.ko 2023-12-08T08:05:36.114 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-ntrig.ko 2023-12-08T08:05:36.114 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-ortek.ko 2023-12-08T08:05:36.114 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-penmount.ko 2023-12-08T08:05:36.114 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-petalynx.ko 2023-12-08T08:05:36.115 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 72937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-picolcd.ko 2023-12-08T08:05:36.115 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-pl.ko 2023-12-08T08:05:36.115 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-plantronics.ko 2023-12-08T08:05:36.115 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8417 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-primax.ko 2023-12-08T08:05:36.115 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-rmi.ko 2023-12-08T08:05:36.115 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-08T08:05:36.115 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-common.ko 2023-12-08T08:05:36.115 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-08T08:05:36.115 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-08T08:05:36.115 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-08T08:05:36.115 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-08T08:05:36.115 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-08T08:05:36.115 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-08T08:05:36.115 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-08T08:05:36.116 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-08T08:05:36.116 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-08T08:05:36.116 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat.ko 2023-12-08T08:05:36.116 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-saitek.ko 2023-12-08T08:05:36.116 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-samsung.ko 2023-12-08T08:05:36.116 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-08T08:05:36.116 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-sjoy.ko 2023-12-08T08:05:36.116 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51249 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-sony.ko 2023-12-08T08:05:36.116 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-speedlink.ko 2023-12-08T08:05:36.116 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-steelseries.ko 2023-12-08T08:05:36.116 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-sunplus.ko 2023-12-08T08:05:36.116 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-08T08:05:36.116 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-tivo.ko 2023-12-08T08:05:36.116 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-tmff.ko 2023-12-08T08:05:36.117 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-topseed.ko 2023-12-08T08:05:36.117 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-twinhan.ko 2023-12-08T08:05:36.117 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 71073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-uclogic.ko 2023-12-08T08:05:36.117 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-waltop.ko 2023-12-08T08:05:36.117 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 143473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-wiimote.ko 2023-12-08T08:05:36.117 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8153 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-xinmo.ko 2023-12-08T08:05:36.117 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-zpff.ko 2023-12-08T08:05:36.117 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-zydacron.ko 2023-12-08T08:05:36.117 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 267825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid.ko 2023-12-08T08:05:36.117 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/uhid.ko 2023-12-08T08:05:36.117 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/usbhid/ 2023-12-08T08:05:36.117 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 125721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/usbhid/usbhid.ko 2023-12-08T08:05:36.117 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/usbhid/usbkbd.ko 2023-12-08T08:05:36.117 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/usbhid/usbmouse.ko 2023-12-08T08:05:36.118 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 217873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/wacom.ko 2023-12-08T08:05:36.118 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hv/ 2023-12-08T08:05:36.118 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 64201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hv/hv_balloon.ko 2023-12-08T08:05:36.118 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 89625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hv/hv_utils.ko 2023-12-08T08:05:36.118 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 305465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hv/hv_vmbus.ko 2023-12-08T08:05:36.118 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ 2023-12-08T08:05:36.118 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/abituguru.ko 2023-12-08T08:05:36.118 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 61393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/abituguru3.ko 2023-12-08T08:05:36.118 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-08T08:05:36.118 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ad7414.ko 2023-12-08T08:05:36.118 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ad7418.ko 2023-12-08T08:05:36.118 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adc128d818.ko 2023-12-08T08:05:36.118 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adm1025.ko 2023-12-08T08:05:36.118 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 97977 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adm1026.ko 2023-12-08T08:05:36.119 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adm1029.ko 2023-12-08T08:05:36.119 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 45553 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adm1031.ko 2023-12-08T08:05:36.119 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adm9240.ko 2023-12-08T08:05:36.119 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14769 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ads7828.ko 2023-12-08T08:05:36.119 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10769 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adt7410.ko 2023-12-08T08:05:36.119 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adt7411.ko 2023-12-08T08:05:36.119 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 74433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adt7462.ko 2023-12-08T08:05:36.119 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adt7470.ko 2023-12-08T08:05:36.119 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 67929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adt7475.ko 2023-12-08T08:05:36.119 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adt7x10.ko 2023-12-08T08:05:36.119 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/amc6821.ko 2023-12-08T08:05:36.119 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/applesmc.ko 2023-12-08T08:05:36.119 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49913 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/asb100.ko 2023-12-08T08:05:36.119 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 58617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/asc7621.ko 2023-12-08T08:05:36.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-08T08:05:36.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/atxp1.ko 2023-12-08T08:05:36.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28281 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/coretemp.ko 2023-12-08T08:05:36.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/da9052-hwmon.ko 2023-12-08T08:05:36.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/da9055-hwmon.ko 2023-12-08T08:05:36.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-08T08:05:36.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 99601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/dme1737.ko 2023-12-08T08:05:36.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ds1621.ko 2023-12-08T08:05:36.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ds620.ko 2023-12-08T08:05:36.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29777 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/emc1403.ko 2023-12-08T08:05:36.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/emc2103.ko 2023-12-08T08:05:36.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/emc6w201.ko 2023-12-08T08:05:36.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/f71805f.ko 2023-12-08T08:05:36.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 94457 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/f71882fg.ko 2023-12-08T08:05:36.120 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/f75375s.ko 2023-12-08T08:05:36.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/fam15h_power.ko 2023-12-08T08:05:36.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/fschmd.ko 2023-12-08T08:05:36.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/g760a.ko 2023-12-08T08:05:36.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/g762.ko 2023-12-08T08:05:36.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 46801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/gl518sm.ko 2023-12-08T08:05:36.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 45529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/gl520sm.ko 2023-12-08T08:05:36.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/hih6130.ko 2023-12-08T08:05:36.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-08T08:05:36.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11553 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/i5500_temp.ko 2023-12-08T08:05:36.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/i5k_amb.ko 2023-12-08T08:05:36.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ibmaem.ko 2023-12-08T08:05:36.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ibmpex.ko 2023-12-08T08:05:36.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ina209.ko 2023-12-08T08:05:36.121 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ina2xx.ko 2023-12-08T08:05:36.122 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 130449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/it87.ko 2023-12-08T08:05:36.122 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/jc42.ko 2023-12-08T08:05:36.122 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/k10temp.ko 2023-12-08T08:05:36.122 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13553 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/k8temp.ko 2023-12-08T08:05:36.122 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lineage-pem.ko 2023-12-08T08:05:36.122 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 48601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm63.ko 2023-12-08T08:05:36.122 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm73.ko 2023-12-08T08:05:36.122 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36777 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm75.ko 2023-12-08T08:05:36.122 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm77.ko 2023-12-08T08:05:36.122 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm78.ko 2023-12-08T08:05:36.122 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm80.ko 2023-12-08T08:05:36.122 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16889 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm83.ko 2023-12-08T08:05:36.122 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 72833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm85.ko 2023-12-08T08:05:36.122 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 46153 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm87.ko 2023-12-08T08:05:36.123 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37913 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm90.ko 2023-12-08T08:05:36.123 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm92.ko 2023-12-08T08:05:36.123 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 108841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm93.ko 2023-12-08T08:05:36.123 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm95234.ko 2023-12-08T08:05:36.123 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm95241.ko 2023-12-08T08:05:36.123 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm95245.ko 2023-12-08T08:05:36.123 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc2945.ko 2023-12-08T08:05:36.123 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc4151.ko 2023-12-08T08:05:36.123 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc4215.ko 2023-12-08T08:05:36.123 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14889 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc4222.ko 2023-12-08T08:05:36.123 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc4245.ko 2023-12-08T08:05:36.123 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13249 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc4260.ko 2023-12-08T08:05:36.123 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc4261.ko 2023-12-08T08:05:36.123 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max16065.ko 2023-12-08T08:05:36.124 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max1619.ko 2023-12-08T08:05:36.124 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24353 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max1668.ko 2023-12-08T08:05:36.124 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max197.ko 2023-12-08T08:05:36.124 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max6639.ko 2023-12-08T08:05:36.124 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max6650.ko 2023-12-08T08:05:36.124 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35777 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max6697.ko 2023-12-08T08:05:36.124 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/mc13783-adc.ko 2023-12-08T08:05:36.124 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/mcp3021.ko 2023-12-08T08:05:36.124 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-12-08T08:05:36.124 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/nct6683.ko 2023-12-08T08:05:36.124 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 119817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/nct6775-core.ko 2023-12-08T08:05:36.124 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60705 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/nct6775.ko 2023-12-08T08:05:36.124 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/nct7802.ko 2023-12-08T08:05:36.124 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 82337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pc87360.ko 2023-12-08T08:05:36.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pc87427.ko 2023-12-08T08:05:36.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pcf8591.ko 2023-12-08T08:05:36.125 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/ 2023-12-08T08:05:36.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21353 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-08T08:05:36.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-08T08:05:36.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-08T08:05:36.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-08T08:05:36.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-08T08:05:36.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-08T08:05:36.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-08T08:05:36.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 82577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-08T08:05:36.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-08T08:05:36.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-08T08:05:36.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-08T08:05:36.125 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-08T08:05:36.126 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/powr1220.ko 2023-12-08T08:05:36.126 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18705 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/sch5627.ko 2023-12-08T08:05:36.126 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/sch5636.ko 2023-12-08T08:05:36.126 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-08T08:05:36.126 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/sht15.ko 2023-12-08T08:05:36.126 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/sht21.ko 2023-12-08T08:05:36.126 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/shtc1.ko 2023-12-08T08:05:36.126 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/sis5595.ko 2023-12-08T08:05:36.126 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/smsc47b397.ko 2023-12-08T08:05:36.126 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/smsc47m1.ko 2023-12-08T08:05:36.126 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/smsc47m192.ko 2023-12-08T08:05:36.126 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26553 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/thmc50.ko 2023-12-08T08:05:36.126 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/tmp102.ko 2023-12-08T08:05:36.126 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/tmp103.ko 2023-12-08T08:05:36.127 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/tmp401.ko 2023-12-08T08:05:36.127 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/tmp421.ko 2023-12-08T08:05:36.127 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/via-cputemp.ko 2023-12-08T08:05:36.127 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41945 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/via686a.ko 2023-12-08T08:05:36.127 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 52457 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/vt1211.ko 2023-12-08T08:05:36.127 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51545 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/vt8231.ko 2023-12-08T08:05:36.127 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 57449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83627ehf.ko 2023-12-08T08:05:36.127 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 78873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83627hf.ko 2023-12-08T08:05:36.127 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 71345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83781d.ko 2023-12-08T08:05:36.127 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 63225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83791d.ko 2023-12-08T08:05:36.127 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 71321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83792d.ko 2023-12-08T08:05:36.127 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 101473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83793.ko 2023-12-08T08:05:36.127 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 119505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83795.ko 2023-12-08T08:05:36.127 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83l785ts.ko 2023-12-08T08:05:36.128 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83l786ng.ko 2023-12-08T08:05:36.128 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-12-08T08:05:36.128 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-12-08T08:05:36.128 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/ 2023-12-08T08:05:36.128 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/algos/ 2023-12-08T08:05:36.128 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-08T08:05:36.128 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-08T08:05:36.128 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/ 2023-12-08T08:05:36.128 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-12-08T08:05:36.128 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-12-08T08:05:36.128 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27777 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-12-08T08:05:36.128 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-08T08:05:36.128 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-08T08:05:36.128 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-08T08:05:36.128 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15153 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-12-08T08:05:36.129 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 6929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-08T08:05:36.129 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-12-08T08:05:36.129 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-08T08:05:36.129 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23905 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-08T08:05:36.129 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20001 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-08T08:05:36.129 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-08T08:05:36.129 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-12-08T08:05:36.129 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-12-08T08:05:36.129 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 62817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-08T08:05:36.129 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-08T08:05:36.129 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47889 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-08T08:05:36.129 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-12-08T08:05:36.129 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-08T08:05:36.129 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-08T08:05:36.130 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-12-08T08:05:36.130 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-08T08:05:36.130 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-08T08:05:36.130 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-08T08:05:36.130 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-12-08T08:05:36.130 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-08T08:05:36.130 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-08T08:05:36.130 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-12-08T08:05:36.130 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29361 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-12-08T08:05:36.130 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-08T08:05:36.130 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-12-08T08:05:36.130 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-08T08:05:36.130 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-08T08:05:36.130 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-08T08:05:36.131 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19041 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-08T08:05:36.131 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-12-08T08:05:36.131 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/i2c-mux.ko 2023-12-08T08:05:36.131 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/i2c-smbus.ko 2023-12-08T08:05:36.131 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/i2c-stub.ko 2023-12-08T08:05:36.131 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/muxes/ 2023-12-08T08:05:36.131 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-12-08T08:05:36.131 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13457 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-12-08T08:05:36.131 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-12-08T08:05:36.131 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ 2023-12-08T08:05:36.131 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/ 2023-12-08T08:05:36.131 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 273609 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-08T08:05:36.131 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 879969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/ib_core.ko 2023-12-08T08:05:36.131 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 69273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-08T08:05:36.132 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 324217 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-08T08:05:36.132 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 97985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-08T08:05:36.132 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 282273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-08T08:05:36.132 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-08T08:05:36.132 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/ 2023-12-08T08:05:36.132 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/cxgb4/ 2023-12-08T08:05:36.132 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 493073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-08T08:05:36.132 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/mlx4/ 2023-12-08T08:05:36.132 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 419737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-08T08:05:36.132 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/mlx5/ 2023-12-08T08:05:36.132 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 739025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-08T08:05:36.132 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/mthca/ 2023-12-08T08:05:36.132 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 296625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-08T08:05:36.132 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/ocrdma/ 2023-12-08T08:05:36.133 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 153697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-12-08T08:05:36.133 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/usnic/ 2023-12-08T08:05:36.133 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 168969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-12-08T08:05:36.188 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/ 2023-12-08T08:05:36.188 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/ipoib/ 2023-12-08T08:05:36.188 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 263081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-08T08:05:36.188 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/iser/ 2023-12-08T08:05:36.188 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 100241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-08T08:05:36.188 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/isert/ 2023-12-08T08:05:36.188 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 111425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-08T08:05:36.188 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/srp/ 2023-12-08T08:05:36.188 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 128753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-08T08:05:36.188 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/srpt/ 2023-12-08T08:05:36.189 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 129529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-08T08:05:36.189 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/ 2023-12-08T08:05:36.189 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/evbug.ko 2023-12-08T08:05:36.189 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/ff-memless.ko 2023-12-08T08:05:36.189 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/gameport/ 2023-12-08T08:05:36.189 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-08T08:05:36.189 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-08T08:05:36.189 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/gameport/gameport.ko 2023-12-08T08:05:36.189 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/joydev.ko 2023-12-08T08:05:36.189 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/ 2023-12-08T08:05:36.189 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-12-08T08:05:36.189 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-12-08T08:05:36.189 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-12-08T08:05:36.190 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24761 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-12-08T08:05:36.190 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-08T08:05:36.190 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-12-08T08:05:36.190 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/lkkbd.ko 2023-12-08T08:05:36.190 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/lm8323.ko 2023-12-08T08:05:36.190 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/lm8333.ko 2023-12-08T08:05:36.190 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-12-08T08:05:36.190 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18217 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-12-08T08:05:36.190 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-12-08T08:05:36.190 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-12-08T08:05:36.190 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/newtonkbd.ko 2023-12-08T08:05:36.190 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-12-08T08:05:36.190 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14161 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/qt1070.ko 2023-12-08T08:05:36.191 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/qt2160.ko 2023-12-08T08:05:36.191 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-12-08T08:05:36.191 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/stowaway.ko 2023-12-08T08:05:36.191 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/sunkbd.ko 2023-12-08T08:05:36.191 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-12-08T08:05:36.191 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16177 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-12-08T08:05:36.191 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-12-08T08:05:36.191 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/xtkbd.ko 2023-12-08T08:05:36.191 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/matrix-keymap.ko 2023-12-08T08:05:36.191 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/ 2023-12-08T08:05:36.191 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/appletouch.ko 2023-12-08T08:05:36.191 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34177 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/bcm5974.ko 2023-12-08T08:05:36.191 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 123681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/cyapatp.ko 2023-12-08T08:05:36.191 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 89449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-08T08:05:36.192 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/gpio_mouse.ko 2023-12-08T08:05:36.192 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 335929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/psmouse.ko 2023-12-08T08:05:36.192 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/sermouse.ko 2023-12-08T08:05:36.192 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-08T08:05:36.192 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-08T08:05:36.192 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-08T08:05:36.192 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/rmi4/ 2023-12-08T08:05:36.192 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 109873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-08T08:05:36.192 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/ 2023-12-08T08:05:36.192 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/altera_ps2.ko 2023-12-08T08:05:36.192 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/arc_ps2.ko 2023-12-08T08:05:36.192 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/ct82c710.ko 2023-12-08T08:05:36.192 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-08T08:05:36.193 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/parkbd.ko 2023-12-08T08:05:36.193 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/pcips2.ko 2023-12-08T08:05:36.193 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20153 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/ps2mult.ko 2023-12-08T08:05:36.193 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24153 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/serio_raw.ko 2023-12-08T08:05:36.193 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17977 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/serport.ko 2023-12-08T08:05:36.193 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/sparse-keymap.ko 2023-12-08T08:05:36.193 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/iommu/ 2023-12-08T08:05:36.193 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/iommu/amd/ 2023-12-08T08:05:36.193 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-08T08:05:36.193 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/ 2023-12-08T08:05:36.193 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-88pm860x.ko 2023-12-08T08:05:36.193 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-adp5520.ko 2023-12-08T08:05:36.193 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-bd2802.ko 2023-12-08T08:05:36.193 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-blinkm.ko 2023-12-08T08:05:36.194 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-da903x.ko 2023-12-08T08:05:36.194 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-da9052.ko 2023-12-08T08:05:36.194 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16561 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-gpio.ko 2023-12-08T08:05:36.194 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-lm3530.ko 2023-12-08T08:05:36.194 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-lm3533.ko 2023-12-08T08:05:36.194 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19353 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-lm355x.ko 2023-12-08T08:05:36.194 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-lm3642.ko 2023-12-08T08:05:36.194 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-lp3944.ko 2023-12-08T08:05:36.194 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11233 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-lp8788.ko 2023-12-08T08:05:36.194 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-max8997.ko 2023-12-08T08:05:36.194 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12545 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-mc13783.ko 2023-12-08T08:05:36.194 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-menf21bmc.ko 2023-12-08T08:05:36.194 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-pca9532.ko 2023-12-08T08:05:36.194 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-pca955x.ko 2023-12-08T08:05:36.195 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-pca963x.ko 2023-12-08T08:05:36.195 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-ss4200.ko 2023-12-08T08:05:36.195 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-tca6507.ko 2023-12-08T08:05:36.195 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-wm831x-status.ko 2023-12-08T08:05:36.195 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-wm8350.ko 2023-12-08T08:05:36.195 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ 2023-12-08T08:05:36.195 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-08T08:05:36.195 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-08T08:05:36.195 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-08T08:05:36.195 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-08T08:05:36.195 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14249 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-08T08:05:36.195 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-08T08:05:36.195 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11889 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-08T08:05:36.195 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-08T08:05:36.196 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/ 2023-12-08T08:05:36.196 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/bcache/ 2023-12-08T08:05:36.196 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 654969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/bcache/bcache.ko 2023-12-08T08:05:36.196 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-bio-prison.ko 2023-12-08T08:05:36.196 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 89601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-bufio.ko 2023-12-08T08:05:36.196 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-cache-smq.ko 2023-12-08T08:05:36.196 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 156009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-cache.ko 2023-12-08T08:05:36.196 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 106897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-crypt.ko 2023-12-08T08:05:36.196 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21545 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-delay.ko 2023-12-08T08:05:36.196 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-era.ko 2023-12-08T08:05:36.196 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-flakey.ko 2023-12-08T08:05:36.196 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-log-userspace.ko 2023-12-08T08:05:36.196 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-log.ko 2023-12-08T08:05:36.196 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49545 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-mirror.ko 2023-12-08T08:05:36.196 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 78033 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-multipath.ko 2023-12-08T08:05:36.197 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-queue-length.ko 2023-12-08T08:05:36.197 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 70825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-raid.ko 2023-12-08T08:05:36.197 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-region-hash.ko 2023-12-08T08:05:36.197 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-round-robin.ko 2023-12-08T08:05:36.197 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-service-time.ko 2023-12-08T08:05:36.197 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 109529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-snapshot.ko 2023-12-08T08:05:36.197 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19361 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-switch.ko 2023-12-08T08:05:36.197 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 181865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-thin-pool.ko 2023-12-08T08:05:36.197 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-verity.ko 2023-12-08T08:05:36.197 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8561 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-zero.ko 2023-12-08T08:05:36.197 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/faulty.ko 2023-12-08T08:05:36.197 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/linear.ko 2023-12-08T08:05:36.197 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32417 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/multipath.ko 2023-12-08T08:05:36.197 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/persistent-data/ 2023-12-08T08:05:36.197 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 199937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-08T08:05:36.198 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/raid0.ko 2023-12-08T08:05:36.198 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 113073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/raid1.ko 2023-12-08T08:05:36.198 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 158681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/raid10.ko 2023-12-08T08:05:36.198 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 395721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/raid456.ko 2023-12-08T08:05:36.198 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/ 2023-12-08T08:05:36.198 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/ 2023-12-08T08:05:36.198 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 178137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptbase.ko 2023-12-08T08:05:36.198 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 63385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptctl.ko 2023-12-08T08:05:36.198 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptfc.ko 2023-12-08T08:05:36.198 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptlan.ko 2023-12-08T08:05:36.198 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 123321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptsas.ko 2023-12-08T08:05:36.198 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 79041 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptscsih.ko 2023-12-08T08:05:36.198 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptspi.ko 2023-12-08T08:05:36.198 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/ 2023-12-08T08:05:36.199 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/88pm800.ko 2023-12-08T08:05:36.199 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12761 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/88pm805.ko 2023-12-08T08:05:36.199 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/88pm80x.ko 2023-12-08T08:05:36.199 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/arizona-i2c.ko 2023-12-08T08:05:36.199 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 123721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/arizona.ko 2023-12-08T08:05:36.199 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/bcm590xx.ko 2023-12-08T08:05:36.199 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/cros_ec_dev.ko 2023-12-08T08:05:36.199 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/dln2.ko 2023-12-08T08:05:36.199 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16689 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/janz-cmodio.ko 2023-12-08T08:05:36.199 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/kempld-core.ko 2023-12-08T08:05:36.199 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/lm3533-core.ko 2023-12-08T08:05:36.199 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-12-08T08:05:36.199 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/lp3943.ko 2023-12-08T08:05:36.199 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/lpc_ich.ko 2023-12-08T08:05:36.199 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/lpc_sch.ko 2023-12-08T08:05:36.201 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/max8907.ko 2023-12-08T08:05:36.201 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/mc13xxx-core.ko 2023-12-08T08:05:36.201 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-12-08T08:05:36.201 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/menf21bmc.ko 2023-12-08T08:05:36.201 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/pcf50633-adc.ko 2023-12-08T08:05:36.201 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9153 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/pcf50633-gpio.ko 2023-12-08T08:05:36.201 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/pcf50633.ko 2023-12-08T08:05:36.201 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-12-08T08:05:36.201 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/retu-mfd.ko 2023-12-08T08:05:36.202 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 80425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/si476x-core.ko 2023-12-08T08:05:36.202 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 48457 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/sm501.ko 2023-12-08T08:05:36.202 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-12-08T08:05:36.202 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/tps65010.ko 2023-12-08T08:05:36.202 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10353 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/tps6507x.ko 2023-12-08T08:05:36.202 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/viperboard.ko 2023-12-08T08:05:36.202 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/vx855.ko 2023-12-08T08:05:36.202 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/wl1273-core.ko 2023-12-08T08:05:36.202 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/wm8994.ko 2023-12-08T08:05:36.202 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/ 2023-12-08T08:05:36.202 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-12-08T08:05:36.202 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 48489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/ad525x_dpot.ko 2023-12-08T08:05:36.202 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/altera-stapl/ 2023-12-08T08:05:36.202 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 46585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-08T08:05:36.203 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/apds9802als.ko 2023-12-08T08:05:36.203 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/apds990x.ko 2023-12-08T08:05:36.203 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 45593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/bh1770glc.ko 2023-12-08T08:05:36.203 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/c2port/ 2023-12-08T08:05:36.203 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-12-08T08:05:36.203 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35281 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/c2port/core.ko 2023-12-08T08:05:36.203 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/cb710/ 2023-12-08T08:05:36.203 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25161 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/cb710/cb710.ko 2023-12-08T08:05:36.203 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/ds1682.ko 2023-12-08T08:05:36.203 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/dummy-irq.ko 2023-12-08T08:05:36.203 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/echo/ 2023-12-08T08:05:36.203 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/echo/echo.ko 2023-12-08T08:05:36.203 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/eeprom/ 2023-12-08T08:05:36.203 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/eeprom/at24.ko 2023-12-08T08:05:36.203 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-08T08:05:36.204 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14769 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-08T08:05:36.204 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/eeprom/max6875.ko 2023-12-08T08:05:36.204 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/enclosure.ko 2023-12-08T08:05:36.204 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/genwqe/ 2023-12-08T08:05:36.204 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 152201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-12-08T08:05:36.204 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/hmc6352.ko 2023-12-08T08:05:36.204 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/hpilo.ko 2023-12-08T08:05:36.204 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/ibmasm/ 2023-12-08T08:05:36.204 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 72129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-12-08T08:05:36.204 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/ics932s401.ko 2023-12-08T08:05:36.204 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/isl29003.ko 2023-12-08T08:05:36.204 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/isl29020.ko 2023-12-08T08:05:36.204 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/lis3lv02d/ 2023-12-08T08:05:36.204 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42513 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-08T08:05:36.204 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-08T08:05:36.205 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/mei/ 2023-12-08T08:05:36.205 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 125209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/mei/mei-me.ko 2023-12-08T08:05:36.205 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 56521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/mei/mei-txe.ko 2023-12-08T08:05:36.205 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 310113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/mei/mei.ko 2023-12-08T08:05:36.205 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/phantom.ko 2023-12-08T08:05:36.205 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/ti-st/ 2023-12-08T08:05:36.205 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 74265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/ti-st/st_drv.ko 2023-12-08T08:05:36.205 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/tifm_7xx1.ko 2023-12-08T08:05:36.205 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/tifm_core.ko 2023-12-08T08:05:36.205 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/tsl2550.ko 2023-12-08T08:05:36.205 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 48697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/vmw_balloon.ko 2023-12-08T08:05:36.205 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/vmw_vmci/ 2023-12-08T08:05:36.205 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 183609 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-08T08:05:36.205 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ 2023-12-08T08:05:36.206 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/bonding/ 2023-12-08T08:05:36.206 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 490129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/bonding/bonding.ko 2023-12-08T08:05:36.206 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa/ 2023-12-08T08:05:36.206 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa/b53/ 2023-12-08T08:05:36.206 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 106033 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-08T08:05:36.206 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40417 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-08T08:05:36.206 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16041 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-08T08:05:36.206 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa/mv88e6xxx/ 2023-12-08T08:05:36.206 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 453737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-08T08:05:36.206 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dummy.ko 2023-12-08T08:05:36.206 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/eql.ko 2023-12-08T08:05:36.206 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/ 2023-12-08T08:05:36.206 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/3com/ 2023-12-08T08:05:36.206 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 45785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-08T08:05:36.207 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-08T08:05:36.207 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 130553 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-08T08:05:36.207 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 68849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-08T08:05:36.207 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/8390/ 2023-12-08T08:05:36.207 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-08T08:05:36.207 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59689 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-08T08:05:36.207 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-08T08:05:36.207 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 99049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-08T08:05:36.207 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/adaptec/ 2023-12-08T08:05:36.207 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-08T08:05:36.207 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/agere/ 2023-12-08T08:05:36.207 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 69137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-08T08:05:36.207 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/alteon/ 2023-12-08T08:05:36.207 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-08T08:05:36.208 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/altera/ 2023-12-08T08:05:36.208 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-08T08:05:36.208 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/amd/ 2023-12-08T08:05:36.208 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54609 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-08T08:05:36.208 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-08T08:05:36.208 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 87297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-08T08:05:36.208 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/ 2023-12-08T08:05:36.208 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/alx/ 2023-12-08T08:05:36.208 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 97337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-08T08:05:36.208 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-12-08T08:05:36.208 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 104673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-08T08:05:36.209 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-12-08T08:05:36.209 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 90257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-08T08:05:36.209 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atlx/ 2023-12-08T08:05:36.209 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 81569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-08T08:05:36.209 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 69729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-08T08:05:36.209 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/ 2023-12-08T08:05:36.209 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 78401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-08T08:05:36.209 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 176761 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-08T08:05:36.209 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-12-08T08:05:36.209 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1421497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-08T08:05:36.209 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 128569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-08T08:05:36.209 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/genet/ 2023-12-08T08:05:36.209 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 132089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-08T08:05:36.210 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 312081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-08T08:05:36.210 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/brocade/ 2023-12-08T08:05:36.210 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/brocade/bna/ 2023-12-08T08:05:36.210 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 323513 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-08T08:05:36.210 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/ 2023-12-08T08:05:36.210 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-12-08T08:05:36.210 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 193497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-08T08:05:36.210 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-12-08T08:05:36.210 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 347417 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-08T08:05:36.210 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-12-08T08:05:36.210 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1044497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-08T08:05:36.210 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-12-08T08:05:36.210 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 166193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-08T08:05:36.210 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-12-08T08:05:36.211 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-08T08:05:36.211 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/cisco/ 2023-12-08T08:05:36.211 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/cisco/enic/ 2023-12-08T08:05:36.211 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 204345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-08T08:05:36.211 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/ 2023-12-08T08:05:36.211 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip/ 2023-12-08T08:05:36.211 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 69449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-08T08:05:36.211 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 61489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-08T08:05:36.211 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 141225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-08T08:05:36.211 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-08T08:05:36.211 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 62817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-08T08:05:36.211 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31369 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-08T08:05:36.211 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dlink/ 2023-12-08T08:05:36.211 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-08T08:05:36.211 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 62833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-08T08:05:36.212 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 45721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dnet.ko 2023-12-08T08:05:36.212 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/ec_bhf.ko 2023-12-08T08:05:36.212 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/emulex/ 2023-12-08T08:05:36.212 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/emulex/benet/ 2023-12-08T08:05:36.212 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 281137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-08T08:05:36.212 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49457 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/ethoc.ko 2023-12-08T08:05:36.212 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/fealnx.ko 2023-12-08T08:05:36.212 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/fujitsu/ 2023-12-08T08:05:36.212 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 45345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-12-08T08:05:36.212 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/ 2023-12-08T08:05:36.212 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 90465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-08T08:05:36.212 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/e1000/ 2023-12-08T08:05:36.212 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 295577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-08T08:05:36.213 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/e1000e/ 2023-12-08T08:05:36.213 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 584497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-08T08:05:36.213 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/fm10k/ 2023-12-08T08:05:36.213 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 246209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-08T08:05:36.213 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/i40e/ 2023-12-08T08:05:36.213 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 925825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-08T08:05:36.213 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/iavf/ 2023-12-08T08:05:36.213 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 302937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-08T08:05:36.213 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/igb/ 2023-12-08T08:05:36.213 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 514641 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-08T08:05:36.213 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/igbvf/ 2023-12-08T08:05:36.213 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 93593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-08T08:05:36.213 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-12-08T08:05:36.213 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 734305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-08T08:05:36.213 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-12-08T08:05:36.214 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 151769 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-08T08:05:36.214 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 86921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/jme.ko 2023-12-08T08:05:36.214 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/marvell/ 2023-12-08T08:05:36.214 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20977 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-08T08:05:36.214 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 102289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-08T08:05:36.214 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 122649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-08T08:05:36.214 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox/ 2023-12-08T08:05:36.214 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-12-08T08:05:36.214 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 727601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-08T08:05:36.214 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 278937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-08T08:05:36.214 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-12-08T08:05:36.214 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-12-08T08:05:36.214 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1113681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-08T08:05:36.215 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/micrel/ 2023-12-08T08:05:36.215 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53041 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-12-08T08:05:36.215 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-12-08T08:05:36.215 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-12-08T08:05:36.215 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 95665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-08T08:05:36.215 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/myricom/ 2023-12-08T08:05:36.215 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-12-08T08:05:36.215 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 108649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-08T08:05:36.215 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/natsemi/ 2023-12-08T08:05:36.215 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 73441 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-08T08:05:36.215 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47777 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-08T08:05:36.215 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/neterion/ 2023-12-08T08:05:36.215 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 150905 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-08T08:05:36.215 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/nvidia/ 2023-12-08T08:05:36.216 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 136721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-08T08:05:36.216 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/packetengines/ 2023-12-08T08:05:36.216 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-08T08:05:36.216 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-08T08:05:36.216 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/qlogic/ 2023-12-08T08:05:36.216 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-12-08T08:05:36.216 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 227897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-08T08:05:36.216 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 87081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-08T08:05:36.216 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-12-08T08:05:36.216 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 672049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-08T08:05:36.216 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/rdc/ 2023-12-08T08:05:36.216 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-08T08:05:36.216 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/realtek/ 2023-12-08T08:05:36.216 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 67385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-08T08:05:36.217 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 83985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-08T08:05:36.217 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-08T08:05:36.217 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 189801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-08T08:05:36.217 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/samsung/ 2023-12-08T08:05:36.217 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-12-08T08:05:36.217 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 104241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-12-08T08:05:36.217 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sfc/ 2023-12-08T08:05:36.217 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1052497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-08T08:05:36.217 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/silan/ 2023-12-08T08:05:36.217 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-08T08:05:36.217 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sis/ 2023-12-08T08:05:36.217 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-08T08:05:36.217 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 63337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-08T08:05:36.217 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/smsc/ 2023-12-08T08:05:36.217 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 61537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-08T08:05:36.218 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 67193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-08T08:05:36.218 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 73409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-08T08:05:36.218 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 68177 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-08T08:05:36.218 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/stmicro/ 2023-12-08T08:05:36.218 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-12-08T08:05:36.218 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13441 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-12-08T08:05:36.218 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39905 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-08T08:05:36.218 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-12-08T08:05:36.218 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 487025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-08T08:05:36.218 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sun/ 2023-12-08T08:05:36.218 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 103337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-08T08:05:36.218 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 166097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-08T08:05:36.218 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-08T08:05:36.218 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 78801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-08T08:05:36.219 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/tehuti/ 2023-12-08T08:05:36.219 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-08T08:05:36.219 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/ti/ 2023-12-08T08:05:36.219 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 86529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-08T08:05:36.219 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/via/ 2023-12-08T08:05:36.219 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 80273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-08T08:05:36.219 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 83633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-08T08:05:36.219 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/wiznet/ 2023-12-08T08:05:36.219 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 46241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-08T08:05:36.219 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-08T08:05:36.219 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/xircom/ 2023-12-08T08:05:36.219 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-08T08:05:36.219 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/fddi/ 2023-12-08T08:05:36.219 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41001 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/fddi/defxx.ko 2023-12-08T08:05:36.219 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/fddi/skfp/ 2023-12-08T08:05:36.220 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 216985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/fddi/skfp/skfp.ko 2023-12-08T08:05:36.220 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 77345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/geneve.ko 2023-12-08T08:05:36.220 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/hyperv/ 2023-12-08T08:05:36.220 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 235521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-08T08:05:36.220 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ieee802154/ 2023-12-08T08:05:36.220 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-08T08:05:36.220 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ifb.ko 2023-12-08T08:05:36.220 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ipvlan/ 2023-12-08T08:05:36.220 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 83769 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-08T08:05:36.220 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 62145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/macvlan.ko 2023-12-08T08:05:36.220 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/macvtap.ko 2023-12-08T08:05:36.220 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/mdio/ 2023-12-08T08:05:36.220 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-08T08:05:36.220 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-08T08:05:36.221 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/mdio/mdio-gpio.ko 2023-12-08T08:05:36.221 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-08T08:05:36.221 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/mdio.ko 2023-12-08T08:05:36.221 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20513 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/mii.ko 2023-12-08T08:05:36.221 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/netconsole.ko 2023-12-08T08:05:36.221 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/nlmon.ko 2023-12-08T08:05:36.221 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/pcs/ 2023-12-08T08:05:36.221 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-08T08:05:36.221 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38977 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-08T08:05:36.221 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/ 2023-12-08T08:05:36.221 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/amd.ko 2023-12-08T08:05:36.221 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50033 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-08T08:05:36.221 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-08T08:05:36.221 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/bcm87xx.ko 2023-12-08T08:05:36.221 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/broadcom.ko 2023-12-08T08:05:36.222 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/cicada.ko 2023-12-08T08:05:36.222 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/davicom.ko 2023-12-08T08:05:36.222 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/et1011c.ko 2023-12-08T08:05:36.222 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/icplus.ko 2023-12-08T08:05:36.222 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/lxt.ko 2023-12-08T08:05:36.222 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 82049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/marvell.ko 2023-12-08T08:05:36.222 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 76113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/micrel.ko 2023-12-08T08:05:36.222 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12033 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/national.ko 2023-12-08T08:05:36.222 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 97857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/phylink.ko 2023-12-08T08:05:36.222 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/qsemi.ko 2023-12-08T08:05:36.222 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/realtek.ko 2023-12-08T08:05:36.222 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/smsc.ko 2023-12-08T08:05:36.222 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/ste10Xp.ko 2023-12-08T08:05:36.223 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/vitesse.ko 2023-12-08T08:05:36.223 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/plip/ 2023-12-08T08:05:36.223 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/plip/plip.ko 2023-12-08T08:05:36.223 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/ 2023-12-08T08:05:36.223 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-08T08:05:36.223 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29713 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/ppp_async.ko 2023-12-08T08:05:36.223 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-08T08:05:36.223 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-08T08:05:36.223 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-08T08:05:36.223 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42545 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/pppoe.ko 2023-12-08T08:05:36.223 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13441 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/pppox.ko 2023-12-08T08:05:36.223 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32689 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/pptp.ko 2023-12-08T08:05:36.223 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/sb1000.ko 2023-12-08T08:05:36.223 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/slip/ 2023-12-08T08:05:36.224 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/slip/slip.ko 2023-12-08T08:05:36.224 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/sungem_phy.ko 2023-12-08T08:05:36.224 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 64449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/tap.ko 2023-12-08T08:05:36.224 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team/ 2023-12-08T08:05:36.224 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 106169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team/team.ko 2023-12-08T08:05:36.224 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-08T08:05:36.224 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-08T08:05:36.224 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-08T08:05:36.224 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9641 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team/team_mode_random.ko 2023-12-08T08:05:36.224 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-08T08:05:36.224 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 87017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/veth.ko 2023-12-08T08:05:36.224 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/vmxnet3/ 2023-12-08T08:05:36.224 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 144297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-08T08:05:36.224 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/vxlan/ 2023-12-08T08:05:36.224 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 297329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/vxlan/vxlan.ko 2023-12-08T08:05:36.225 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/xen-netback/ 2023-12-08T08:05:36.225 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 144585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-08T08:05:36.225 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ntb/ 2023-12-08T08:05:36.225 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ntb/ntb.ko 2023-12-08T08:05:36.225 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/nvme/ 2023-12-08T08:05:36.225 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/nvme/host/ 2023-12-08T08:05:36.225 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 265121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/nvme/host/nvme-core.ko 2023-12-08T08:05:36.225 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 102209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/nvme/host/nvme.ko 2023-12-08T08:05:36.225 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/parport/ 2023-12-08T08:05:36.225 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 133841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/parport/parport.ko 2023-12-08T08:05:36.225 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14561 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/parport/parport_cs.ko 2023-12-08T08:05:36.225 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 84465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/parport/parport_pc.ko 2023-12-08T08:05:36.225 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/parport/parport_serial.ko 2023-12-08T08:05:36.226 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pci/ 2023-12-08T08:05:36.226 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pci/hotplug/ 2023-12-08T08:05:36.226 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-08T08:05:36.226 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-12-08T08:05:36.226 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-12-08T08:05:36.226 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pci/pci-stub.ko 2023-12-08T08:05:36.226 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 46465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pci/xen-pcifront.ko 2023-12-08T08:05:36.226 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pcmcia/ 2023-12-08T08:05:36.226 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pcmcia/i82092.ko 2023-12-08T08:05:36.226 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 145809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pcmcia/pcmcia.ko 2023-12-08T08:05:36.226 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 62137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pcmcia/pcmcia_core.ko 2023-12-08T08:05:36.226 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-12-08T08:05:36.226 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pcmcia/pd6729.ko 2023-12-08T08:05:36.226 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 112889 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-08T08:05:36.226 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/phy/ 2023-12-08T08:05:36.227 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/phy/broadcom/ 2023-12-08T08:05:36.227 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-12-08T08:05:36.227 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/phy/samsung/ 2023-12-08T08:05:36.227 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8441 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-12-08T08:05:36.227 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pinctrl/ 2023-12-08T08:05:36.227 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pinctrl/intel/ 2023-12-08T08:05:36.227 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 70153 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-08T08:05:36.227 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/ 2023-12-08T08:05:36.227 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/chrome/ 2023-12-08T08:05:36.227 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50889 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-12-08T08:05:36.227 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/chrome/cros_ec.ko 2023-12-08T08:05:36.227 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-12-08T08:05:36.227 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25417 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-12-08T08:05:36.227 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-12-08T08:05:36.228 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-12-08T08:05:36.228 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17361 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-12-08T08:05:36.228 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/ 2023-12-08T08:05:36.228 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 67097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-08T08:05:36.228 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/acerhdf.ko 2023-12-08T08:05:36.228 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-08T08:05:36.228 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-08T08:05:36.228 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31161 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-08T08:05:36.228 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 127441 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-08T08:05:36.228 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-08T08:05:36.228 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-08T08:05:36.228 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-08T08:05:36.228 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-08T08:05:36.228 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-08T08:05:36.229 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/hdaps.ko 2023-12-08T08:05:36.229 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/ibm_rtl.ko 2023-12-08T08:05:36.229 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/intel/ 2023-12-08T08:05:36.229 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-08T08:05:36.229 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-12-08T08:05:36.229 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/intel_ips.ko 2023-12-08T08:05:36.229 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-08T08:05:36.229 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10377 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-08T08:05:36.229 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-08T08:05:36.229 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-08T08:05:36.229 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-08T08:05:36.229 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-08T08:05:36.229 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-08T08:05:36.229 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-08T08:05:36.230 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-08T08:05:36.230 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 57569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/wmi.ko 2023-12-08T08:05:36.230 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/ 2023-12-08T08:05:36.230 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/ 2023-12-08T08:05:36.230 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30281 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/88pm860x_battery.ko 2023-12-08T08:05:36.230 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/88pm860x_charger.ko 2023-12-08T08:05:36.230 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/bq2415x_charger.ko 2023-12-08T08:05:36.230 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/bq24190_charger.ko 2023-12-08T08:05:36.230 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21553 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/bq24735-charger.ko 2023-12-08T08:05:36.230 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-12-08T08:05:36.230 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19609 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/da9030_battery.ko 2023-12-08T08:05:36.230 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/da9052-battery.ko 2023-12-08T08:05:36.230 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29281 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/ds2760_battery.ko 2023-12-08T08:05:36.231 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23217 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/ds2780_battery.ko 2023-12-08T08:05:36.231 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23353 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/ds2781_battery.ko 2023-12-08T08:05:36.231 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/ds2782_battery.ko 2023-12-08T08:05:36.231 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20353 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/gpio-charger.ko 2023-12-08T08:05:36.231 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18041 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/isp1704_charger.ko 2023-12-08T08:05:36.231 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/lp8727_charger.ko 2023-12-08T08:05:36.231 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/max14577_charger.ko 2023-12-08T08:05:36.231 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/max17040_battery.ko 2023-12-08T08:05:36.231 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/max17042_battery.ko 2023-12-08T08:05:36.231 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/max8903_charger.ko 2023-12-08T08:05:36.231 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/max8925_power.ko 2023-12-08T08:05:36.231 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/pcf50633-charger.ko 2023-12-08T08:05:36.231 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/sbs-battery.ko 2023-12-08T08:05:36.231 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/test_power.ko 2023-12-08T08:05:36.232 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/tps65090-charger.ko 2023-12-08T08:05:36.232 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/wm831x_backup.ko 2023-12-08T08:05:36.232 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/wm831x_power.ko 2023-12-08T08:05:36.232 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22417 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/power/supply/wm8350_power.ko 2023-12-08T08:05:36.232 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/powercap/ 2023-12-08T08:05:36.232 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 57729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-08T08:05:36.232 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-08T08:05:36.232 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pps/ 2023-12-08T08:05:36.232 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pps/clients/ 2023-12-08T08:05:36.232 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-08T08:05:36.232 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13249 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-08T08:05:36.232 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15913 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pps/clients/pps_parport.ko 2023-12-08T08:05:36.232 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pps/pps_core.ko 2023-12-08T08:05:36.232 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ptp/ 2023-12-08T08:05:36.232 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ptp/ptp.ko 2023-12-08T08:05:36.233 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ptp/ptp_kvm.ko 2023-12-08T08:05:36.233 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/ 2023-12-08T08:05:36.233 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-88pm80x.ko 2023-12-08T08:05:36.233 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-88pm860x.ko 2023-12-08T08:05:36.233 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-08T08:05:36.233 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-da9052.ko 2023-12-08T08:05:36.233 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-da9055.ko 2023-12-08T08:05:36.233 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-da9063.ko 2023-12-08T08:05:36.233 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16457 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-08T08:05:36.233 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 68577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-08T08:05:36.233 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-08T08:05:36.233 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18217 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-08T08:05:36.233 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-08T08:05:36.233 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-08T08:05:36.234 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13369 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-08T08:05:36.234 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-08T08:05:36.234 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23705 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-08T08:05:36.234 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-em3027.ko 2023-12-08T08:05:36.234 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-08T08:05:36.234 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-08T08:05:36.234 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-08T08:05:36.234 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-lp8788.ko 2023-12-08T08:05:36.234 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-08T08:05:36.234 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-08T08:05:36.234 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25945 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-08T08:05:36.234 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-m48t86.ko 2023-12-08T08:05:36.234 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-max6900.ko 2023-12-08T08:05:36.235 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-max8907.ko 2023-12-08T08:05:36.235 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-max8925.ko 2023-12-08T08:05:36.235 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-max8997.ko 2023-12-08T08:05:36.235 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-max8998.ko 2023-12-08T08:05:36.235 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18513 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-12-08T08:05:36.235 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-08T08:05:36.235 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-palmas.ko 2023-12-08T08:05:36.235 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 46633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-08T08:05:36.235 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17977 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-pcf50633.ko 2023-12-08T08:05:36.235 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-08T08:05:36.235 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-08T08:05:36.235 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-08T08:05:36.235 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12441 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-08T08:05:36.235 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18033 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-rc5t583.ko 2023-12-08T08:05:36.235 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-08T08:05:36.235 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-08T08:05:36.236 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-08T08:05:36.236 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-08T08:05:36.236 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-08T08:05:36.236 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-s35390a.ko 2023-12-08T08:05:36.236 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-08T08:05:36.236 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17889 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-tps6586x.ko 2023-12-08T08:05:36.236 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-tps65910.ko 2023-12-08T08:05:36.236 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20545 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-wm831x.ko 2023-12-08T08:05:36.236 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-wm8350.ko 2023-12-08T08:05:36.236 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-x1205.ko 2023-12-08T08:05:36.236 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/ 2023-12-08T08:05:36.236 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 77617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/3w-9xxx.ko 2023-12-08T08:05:36.236 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 57665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/3w-sas.ko 2023-12-08T08:05:36.236 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/3w-xxxx.ko 2023-12-08T08:05:36.237 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 135185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/BusLogic.ko 2023-12-08T08:05:36.237 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/a100u2w.ko 2023-12-08T08:05:36.237 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/aacraid/ 2023-12-08T08:05:36.237 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 272305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-08T08:05:36.237 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 100617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/advansys.ko 2023-12-08T08:05:36.237 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/aic7xxx/ 2023-12-08T08:05:36.237 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 356201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-08T08:05:36.237 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 295801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-08T08:05:36.237 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/aic94xx/ 2023-12-08T08:05:36.237 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 189185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-12-08T08:05:36.237 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/am53c974.ko 2023-12-08T08:05:36.237 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/arcmsr/ 2023-12-08T08:05:36.237 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 106881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-08T08:05:36.237 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/atp870u.ko 2023-12-08T08:05:36.238 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/be2iscsi/ 2023-12-08T08:05:36.238 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 246985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-08T08:05:36.238 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/bfa/ 2023-12-08T08:05:36.238 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1171945 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/bfa/bfa.ko 2023-12-08T08:05:36.238 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/bnx2fc/ 2023-12-08T08:05:36.238 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 237273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-08T08:05:36.238 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/bnx2i/ 2023-12-08T08:05:36.238 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 115369 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-08T08:05:36.238 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/ch.ko 2023-12-08T08:05:36.238 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/csiostor/ 2023-12-08T08:05:36.238 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 308921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-08T08:05:36.238 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/cxgbi/ 2023-12-08T08:05:36.238 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-12-08T08:05:36.238 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 76145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-08T08:05:36.239 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-12-08T08:05:36.239 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 101449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-08T08:05:36.239 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 146689 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-08T08:05:36.239 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 75553 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/dc395x.ko 2023-12-08T08:05:36.239 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/dmx3191d.ko 2023-12-08T08:05:36.239 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/esas2r/ 2023-12-08T08:05:36.239 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 212425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-08T08:05:36.239 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/esp_scsi.ko 2023-12-08T08:05:36.239 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/fcoe/ 2023-12-08T08:05:36.239 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 78209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-08T08:05:36.239 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 158505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-08T08:05:36.239 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18945 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/fdomain.ko 2023-12-08T08:05:36.239 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/fnic/ 2023-12-08T08:05:36.239 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 263489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/fnic/fnic.ko 2023-12-08T08:05:36.240 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 201817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/hpsa.ko 2023-12-08T08:05:36.240 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/hptiop.ko 2023-12-08T08:05:36.240 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49041 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/hv_storvsc.ko 2023-12-08T08:05:36.240 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/imm.ko 2023-12-08T08:05:36.240 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/initio.ko 2023-12-08T08:05:36.240 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 266537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/ipr.ko 2023-12-08T08:05:36.240 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 101881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/ips.ko 2023-12-08T08:05:36.240 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/isci/ 2023-12-08T08:05:36.240 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 317153 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/isci/isci.ko 2023-12-08T08:05:36.240 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-08T08:05:36.240 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 52961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-08T08:05:36.240 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/libfc/ 2023-12-08T08:05:36.240 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 314865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/libfc/libfc.ko 2023-12-08T08:05:36.240 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 145585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/libiscsi.ko 2023-12-08T08:05:36.240 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-08T08:05:36.241 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/libsas/ 2023-12-08T08:05:36.241 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 216665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/libsas/libsas.ko 2023-12-08T08:05:36.241 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/lpfc/ 2023-12-08T08:05:36.241 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 2197249 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-08T08:05:36.241 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/megaraid/ 2023-12-08T08:05:36.241 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 73569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-08T08:05:36.241 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-08T08:05:36.241 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 310617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-08T08:05:36.241 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 84721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/megaraid.ko 2023-12-08T08:05:36.241 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/mpt3sas/ 2023-12-08T08:05:36.241 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 659825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-08T08:05:36.241 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/mvsas/ 2023-12-08T08:05:36.241 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 119561 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-08T08:05:36.241 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 78129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/mvumi.ko 2023-12-08T08:05:36.241 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/pcmcia/ 2023-12-08T08:05:36.242 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 81625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-12-08T08:05:36.242 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11713 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-12-08T08:05:36.242 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-12-08T08:05:36.242 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-12-08T08:05:36.242 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/pm8001/ 2023-12-08T08:05:36.242 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 364105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-08T08:05:36.242 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 123617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/pmcraid.ko 2023-12-08T08:05:36.242 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34513 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/ppa.ko 2023-12-08T08:05:36.242 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55361 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/qla1280.ko 2023-12-08T08:05:36.242 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/qla2xxx/ 2023-12-08T08:05:36.242 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1876689 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-08T08:05:36.319 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 85289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-08T08:05:36.320 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/qla4xxx/ 2023-12-08T08:05:36.320 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 559033 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-08T08:05:36.320 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/qlogicfas408.ko 2023-12-08T08:05:36.320 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/raid_class.ko 2023-12-08T08:05:36.320 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 238761 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/scsi_debug.ko 2023-12-08T08:05:36.320 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 173937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-08T08:05:36.320 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 279313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-08T08:05:36.320 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 97729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-08T08:05:36.320 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 73881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-08T08:05:36.320 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-08T08:05:36.320 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26249 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/ses.ko 2023-12-08T08:05:36.320 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 115889 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/st.ko 2023-12-08T08:05:36.321 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 46825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/stex.ko 2023-12-08T08:05:36.321 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/sym53c8xx_2/ 2023-12-08T08:05:36.321 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 162121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-08T08:05:36.321 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/virtio_scsi.ko 2023-12-08T08:05:36.321 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-08T08:05:36.321 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/wd719x.ko 2023-12-08T08:05:36.321 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/xen-scsifront.ko 2023-12-08T08:05:36.321 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ssb/ 2023-12-08T08:05:36.321 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 129441 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ssb/ssb.ko 2023-12-08T08:05:36.321 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/ 2023-12-08T08:05:36.321 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/iscsi/ 2023-12-08T08:05:36.321 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 736601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-08T08:05:36.321 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/loopback/ 2023-12-08T08:05:36.321 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-08T08:05:36.322 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39713 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/target_core_file.ko 2023-12-08T08:05:36.322 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/target_core_iblock.ko 2023-12-08T08:05:36.322 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 930257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/target_core_mod.ko 2023-12-08T08:05:36.322 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/target_core_pscsi.ko 2023-12-08T08:05:36.322 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 122521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/target_core_user.ko 2023-12-08T08:05:36.322 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/tcm_fc/ 2023-12-08T08:05:36.322 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 75593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-08T08:05:36.322 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/ 2023-12-08T08:05:36.322 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/ 2023-12-08T08:05:36.322 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/ 2023-12-08T08:05:36.322 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-08T08:05:36.322 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-08T08:05:36.322 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-08T08:05:36.322 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-08T08:05:36.323 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-08T08:05:36.323 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-08T08:05:36.323 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-08T08:05:36.323 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20281 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-08T08:05:36.323 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-08T08:05:36.323 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-08T08:05:36.323 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13001 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-08T08:05:36.323 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-08T08:05:36.323 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-12-08T08:05:36.323 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-08T08:05:36.323 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-08T08:05:36.323 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-08T08:05:36.323 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/ 2023-12-08T08:05:36.323 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/ipwireless/ 2023-12-08T08:05:36.323 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 78425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-08T08:05:36.324 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 57865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/moxa.ko 2023-12-08T08:05:36.324 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/mxser.ko 2023-12-08T08:05:36.324 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 108601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/n_gsm.ko 2023-12-08T08:05:36.324 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/n_hdlc.ko 2023-12-08T08:05:36.324 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 67929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/nozomi.ko 2023-12-08T08:05:36.324 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/ 2023-12-08T08:05:36.324 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/8250/ 2023-12-08T08:05:36.324 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-12-08T08:05:36.324 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-08T08:05:36.324 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-12-08T08:05:36.324 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/altera_uart.ko 2023-12-08T08:05:36.324 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/arc_uart.ko 2023-12-08T08:05:36.324 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 72425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-12-08T08:05:36.324 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/jsm/ 2023-12-08T08:05:36.325 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 103073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-08T08:05:36.325 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/rp2.ko 2023-12-08T08:05:36.325 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 52817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/sc16is7xx.ko 2023-12-08T08:05:36.325 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ufs/ 2023-12-08T08:05:36.325 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ufs/core/ 2023-12-08T08:05:36.325 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 531265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-08T08:05:36.325 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ufs/host/ 2023-12-08T08:05:36.325 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-08T08:05:36.325 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-12-08T08:05:36.325 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/ 2023-12-08T08:05:36.325 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44513 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio.ko 2023-12-08T08:05:36.325 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio_aec.ko 2023-12-08T08:05:36.325 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11281 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio_cif.ko 2023-12-08T08:05:36.325 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio_dmem_genirq.ko 2023-12-08T08:05:36.326 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio_mf624.ko 2023-12-08T08:05:36.326 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12177 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio_netx.ko 2023-12-08T08:05:36.326 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio_pci_generic.ko 2023-12-08T08:05:36.326 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-12-08T08:05:36.326 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio_sercos3.ko 2023-12-08T08:05:36.326 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/ 2023-12-08T08:05:36.326 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/c67x00/ 2023-12-08T08:05:36.326 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 73297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/c67x00/c67x00.ko 2023-12-08T08:05:36.326 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/chipidea/ 2023-12-08T08:05:36.326 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 144377 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-12-08T08:05:36.326 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-12-08T08:05:36.326 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12713 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-12-08T08:05:36.326 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-12-08T08:05:36.326 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/class/ 2023-12-08T08:05:36.326 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 87089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/class/cdc-acm.ko 2023-12-08T08:05:36.327 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-08T08:05:36.327 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/class/usblp.ko 2023-12-08T08:05:36.327 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 89857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/class/usbtmc.ko 2023-12-08T08:05:36.327 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/common/ 2023-12-08T08:05:36.327 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/common/ulpi.ko 2023-12-08T08:05:36.327 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/dwc2/ 2023-12-08T08:05:36.327 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-12-08T08:05:36.327 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/dwc3/ 2023-12-08T08:05:36.327 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-12-08T08:05:36.327 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30041 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-12-08T08:05:36.327 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 448505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/dwc3/dwc3.ko 2023-12-08T08:05:36.327 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/ 2023-12-08T08:05:36.327 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/ 2023-12-08T08:05:36.327 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60177 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/u_ether.ko 2023-12-08T08:05:36.327 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/u_serial.ko 2023-12-08T08:05:36.328 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-12-08T08:05:36.328 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-12-08T08:05:36.328 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-12-08T08:05:36.328 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36513 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-12-08T08:05:36.328 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 92489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-12-08T08:05:36.328 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-12-08T08:05:36.328 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 122081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-12-08T08:05:36.328 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 57681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-12-08T08:05:36.328 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-12-08T08:05:36.328 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-12-08T08:05:36.328 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 57729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-12-08T08:05:36.328 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 85609 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-12-08T08:05:36.328 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-12-08T08:05:36.328 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 58113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-12-08T08:05:36.329 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 67337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-12-08T08:05:36.329 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/ 2023-12-08T08:05:36.329 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-12-08T08:05:36.329 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-12-08T08:05:36.329 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-12-08T08:05:36.329 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-12-08T08:05:36.329 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-12-08T08:05:36.329 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-12-08T08:05:36.329 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-12-08T08:05:36.329 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16977 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-12-08T08:05:36.329 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-12-08T08:05:36.329 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-12-08T08:05:36.329 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-12-08T08:05:36.329 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-12-08T08:05:36.329 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 62185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-12-08T08:05:36.330 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-12-08T08:05:36.330 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 161225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/libcomposite.ko 2023-12-08T08:05:36.330 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/ 2023-12-08T08:05:36.330 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17705 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-12-08T08:05:36.330 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/bdc/ 2023-12-08T08:05:36.330 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 157681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-12-08T08:05:36.330 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-12-08T08:05:36.330 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 52721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-12-08T08:05:36.330 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 69705 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-12-08T08:05:36.330 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 56033 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-12-08T08:05:36.330 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 76057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/net2272.ko 2023-12-08T08:05:36.330 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 75073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/net2280.ko 2023-12-08T08:05:36.330 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 73169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-12-08T08:05:36.330 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 65809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-12-08T08:05:36.331 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-12-08T08:05:36.331 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 81505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-12-08T08:05:36.331 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 156073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-12-08T08:05:36.331 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/host/ 2023-12-08T08:05:36.331 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/host/bcma-hcd.ko 2023-12-08T08:05:36.331 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 80113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/host/isp116x-hcd.ko 2023-12-08T08:05:36.331 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 87353 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-12-08T08:05:36.331 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 78873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-12-08T08:05:36.331 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-08T08:05:36.331 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/host/sl811_cs.ko 2023-12-08T08:05:36.331 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/host/ssb-hcd.ko 2023-12-08T08:05:36.331 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25945 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-12-08T08:05:36.331 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/image/ 2023-12-08T08:05:36.331 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/image/mdc800.ko 2023-12-08T08:05:36.331 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/image/microtek.ko 2023-12-08T08:05:36.332 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/ 2023-12-08T08:05:36.332 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/adutux.ko 2023-12-08T08:05:36.332 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20713 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/appledisplay.ko 2023-12-08T08:05:36.332 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-12-08T08:05:36.332 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/cytherm.ko 2023-12-08T08:05:36.332 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/ehset.ko 2023-12-08T08:05:36.332 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/emi26.ko 2023-12-08T08:05:36.332 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/emi62.ko 2023-12-08T08:05:36.332 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/ezusb.ko 2023-12-08T08:05:36.332 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/idmouse.ko 2023-12-08T08:05:36.332 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36553 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/iowarrior.ko 2023-12-08T08:05:36.332 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-08T08:05:36.332 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/ldusb.ko 2023-12-08T08:05:36.332 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/legousbtower.ko 2023-12-08T08:05:36.332 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/lvstest.ko 2023-12-08T08:05:36.333 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/sisusbvga/ 2023-12-08T08:05:36.333 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 64841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-08T08:05:36.333 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-08T08:05:36.333 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/usb3503.ko 2023-12-08T08:05:36.333 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/usblcd.ko 2023-12-08T08:05:36.333 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-08T08:05:36.333 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 70809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/usbtest.ko 2023-12-08T08:05:36.333 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41905 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/uss720.ko 2023-12-08T08:05:36.333 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/yurex.ko 2023-12-08T08:05:36.333 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/mon/ 2023-12-08T08:05:36.333 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 72953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/mon/usbmon.ko 2023-12-08T08:05:36.333 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/musb/ 2023-12-08T08:05:36.333 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 301697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/musb/musb_hdrc.ko 2023-12-08T08:05:36.333 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/phy/ 2023-12-08T08:05:36.334 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/phy/phy-generic.ko 2023-12-08T08:05:36.334 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20177 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-12-08T08:05:36.334 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/phy/phy-isp1301.ko 2023-12-08T08:05:36.334 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/phy/phy-tahvo.ko 2023-12-08T08:05:36.334 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ 2023-12-08T08:05:36.334 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/aircable.ko 2023-12-08T08:05:36.334 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ark3116.ko 2023-12-08T08:05:36.334 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-08T08:05:36.334 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ch341.ko 2023-12-08T08:05:36.334 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 70257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/cp210x.ko 2023-12-08T08:05:36.334 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/cyberjack.ko 2023-12-08T08:05:36.334 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 58217 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-08T08:05:36.334 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-08T08:05:36.334 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/empeg.ko 2023-12-08T08:05:36.335 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/f81232.ko 2023-12-08T08:05:36.335 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 175137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-08T08:05:36.335 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-08T08:05:36.335 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 137081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-08T08:05:36.335 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 124833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/io_ti.ko 2023-12-08T08:05:36.335 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 67769 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ipaq.ko 2023-12-08T08:05:36.335 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19161 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ipw.ko 2023-12-08T08:05:36.335 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ir-usb.ko 2023-12-08T08:05:36.335 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 58233 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-08T08:05:36.335 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 107521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/keyspan.ko 2023-12-08T08:05:36.335 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-08T08:05:36.335 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-08T08:05:36.335 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33689 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-08T08:05:36.335 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/mct_u232.ko 2023-12-08T08:05:36.336 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22033 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/metro-usb.ko 2023-12-08T08:05:36.336 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/mos7720.ko 2023-12-08T08:05:36.336 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 78217 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/mos7840.ko 2023-12-08T08:05:36.336 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 56337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/mxuport.ko 2023-12-08T08:05:36.336 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/navman.ko 2023-12-08T08:05:36.336 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/omninet.ko 2023-12-08T08:05:36.336 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/opticon.ko 2023-12-08T08:05:36.336 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 191137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/option.ko 2023-12-08T08:05:36.336 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/oti6858.ko 2023-12-08T08:05:36.336 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54353 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/pl2303.ko 2023-12-08T08:05:36.336 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/qcaux.ko 2023-12-08T08:05:36.336 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/qcserial.ko 2023-12-08T08:05:36.336 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/quatech2.ko 2023-12-08T08:05:36.336 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/safe_serial.ko 2023-12-08T08:05:36.337 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/sierra.ko 2023-12-08T08:05:36.337 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-08T08:05:36.337 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ssu100.ko 2023-12-08T08:05:36.337 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/symbolserial.ko 2023-12-08T08:05:36.337 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 61489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-08T08:05:36.337 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-08T08:05:36.337 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/usb_debug.ko 2023-12-08T08:05:36.337 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-08T08:05:36.337 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 125609 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/usbserial.ko 2023-12-08T08:05:36.337 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/visor.ko 2023-12-08T08:05:36.337 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/whiteheat.ko 2023-12-08T08:05:36.337 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/wishbone-serial.ko 2023-12-08T08:05:36.337 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-08T08:05:36.337 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ 2023-12-08T08:05:36.337 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 52913 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/uas.ko 2023-12-08T08:05:36.338 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-08T08:05:36.338 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-08T08:05:36.338 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-08T08:05:36.338 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-08T08:05:36.338 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-08T08:05:36.338 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19769 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-08T08:05:36.338 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19361 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-08T08:05:36.338 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13713 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-karma.ko 2023-12-08T08:05:36.338 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-08T08:05:36.338 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28441 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-08T08:05:36.338 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28905 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-08T08:05:36.338 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-08T08:05:36.338 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-08T08:05:36.338 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 179969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/usb-storage.ko 2023-12-08T08:05:36.339 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/usbip/ 2023-12-08T08:05:36.339 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 67481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-08T08:05:36.339 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 72177 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-08T08:05:36.339 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 107001 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-08T08:05:36.339 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vfio/ 2023-12-08T08:05:36.339 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vfio/pci/ 2023-12-08T08:05:36.339 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 154297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-08T08:05:36.339 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-08T08:05:36.339 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 108737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vfio/vfio.ko 2023-12-08T08:05:36.339 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 77609 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-08T08:05:36.339 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vhost/ 2023-12-08T08:05:36.339 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 113785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vhost/vhost.ko 2023-12-08T08:05:36.339 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-08T08:05:36.339 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 58089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vhost/vhost_net.ko 2023-12-08T08:05:36.339 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 89249 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vhost/vhost_scsi.ko 2023-12-08T08:05:36.340 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/ 2023-12-08T08:05:36.340 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/ 2023-12-08T08:05:36.340 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15417 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-12-08T08:05:36.340 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/aat2870_bl.ko 2023-12-08T08:05:36.340 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/adp5520_bl.ko 2023-12-08T08:05:36.340 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32609 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/adp8860_bl.ko 2023-12-08T08:05:36.340 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/adp8870_bl.ko 2023-12-08T08:05:36.340 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/apple_bl.ko 2023-12-08T08:05:36.340 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16777 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/as3711_bl.ko 2023-12-08T08:05:36.340 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12033 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/bd6107.ko 2023-12-08T08:05:36.340 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/da903x_bl.ko 2023-12-08T08:05:36.340 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/da9052_bl.ko 2023-12-08T08:05:36.340 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/gpio_backlight.ko 2023-12-08T08:05:36.340 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14769 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/kb3886_bl.ko 2023-12-08T08:05:36.341 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/lcd.ko 2023-12-08T08:05:36.341 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/lm3533_bl.ko 2023-12-08T08:05:36.341 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/lm3639_bl.ko 2023-12-08T08:05:36.341 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/lv5207lp.ko 2023-12-08T08:05:36.341 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/max8925_bl.ko 2023-12-08T08:05:36.341 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/pandora_bl.ko 2023-12-08T08:05:36.341 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-12-08T08:05:36.341 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-08T08:05:36.341 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/wm831x_bl.ko 2023-12-08T08:05:36.341 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/ 2023-12-08T08:05:36.341 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/masters/ 2023-12-08T08:05:36.341 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/masters/ds2482.ko 2023-12-08T08:05:36.341 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/masters/ds2490.ko 2023-12-08T08:05:36.341 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/masters/matrox_w1.ko 2023-12-08T08:05:36.341 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12417 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/masters/w1-gpio.ko 2023-12-08T08:05:36.342 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/ 2023-12-08T08:05:36.342 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12041 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-08T08:05:36.342 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-08T08:05:36.342 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-08T08:05:36.342 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-08T08:05:36.342 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14153 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-08T08:05:36.342 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-08T08:05:36.342 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-08T08:05:36.342 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-08T08:05:36.342 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-08T08:05:36.342 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-08T08:05:36.342 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 56425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-08T08:05:36.342 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 102673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/wire.ko 2023-12-08T08:05:36.342 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/ 2023-12-08T08:05:36.343 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/acquirewdt.ko 2023-12-08T08:05:36.343 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19977 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/advantechwdt.ko 2023-12-08T08:05:36.343 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18561 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-08T08:05:36.343 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-08T08:05:36.343 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/cpu5wdt.ko 2023-12-08T08:05:36.343 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/da9052_wdt.ko 2023-12-08T08:05:36.343 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12777 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/da9055_wdt.ko 2023-12-08T08:05:36.343 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/da9063_wdt.ko 2023-12-08T08:05:36.343 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/dw_wdt.ko 2023-12-08T08:05:36.343 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/eurotechwdt.ko 2023-12-08T08:05:36.343 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-08T08:05:36.343 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/hpwdt.ko 2023-12-08T08:05:36.343 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/i6300esb.ko 2023-12-08T08:05:36.343 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-08T08:05:36.344 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21913 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-08T08:05:36.344 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/ib700wdt.ko 2023-12-08T08:05:36.344 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18689 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/ibmasr.ko 2023-12-08T08:05:36.344 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19713 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-08T08:05:36.344 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-08T08:05:36.344 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/it87_wdt.ko 2023-12-08T08:05:36.344 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/kempld_wdt.ko 2023-12-08T08:05:36.344 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/machzwd.ko 2023-12-08T08:05:36.344 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/mena21_wdt.ko 2023-12-08T08:05:36.344 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13217 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-12-08T08:05:36.344 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/nv_tco.ko 2023-12-08T08:05:36.344 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-12-08T08:05:36.344 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22265 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/pc87413_wdt.ko 2023-12-08T08:05:36.344 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-08T08:05:36.344 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-08T08:05:36.345 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/retu_wdt.ko 2023-12-08T08:05:36.345 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-12-08T08:05:36.345 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-12-08T08:05:36.345 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-08T08:05:36.345 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/sc1200wdt.ko 2023-12-08T08:05:36.345 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-08T08:05:36.345 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-12-08T08:05:36.345 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/softdog.ko 2023-12-08T08:05:36.345 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-08T08:05:36.345 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/twl4030_wdt.ko 2023-12-08T08:05:36.345 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/via_wdt.ko 2023-12-08T08:05:36.345 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19161 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-08T08:05:36.345 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-08T08:05:36.345 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-08T08:05:36.345 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/wafer5823wdt.ko 2023-12-08T08:05:36.346 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/wdt_pci.ko 2023-12-08T08:05:36.346 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/wm831x_wdt.ko 2023-12-08T08:05:36.346 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/wm8350_wdt.ko 2023-12-08T08:05:36.346 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/xen_wdt.ko 2023-12-08T08:05:36.346 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/ 2023-12-08T08:05:36.346 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-evtchn.ko 2023-12-08T08:05:36.346 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26769 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-gntalloc.ko 2023-12-08T08:05:36.346 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-gntdev.ko 2023-12-08T08:05:36.346 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-pciback/ 2023-12-08T08:05:36.346 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 176377 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-08T08:05:36.346 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-privcmd.ko 2023-12-08T08:05:36.346 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 71249 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-scsiback.ko 2023-12-08T08:05:36.346 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xenfs/ 2023-12-08T08:05:36.346 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-08T08:05:36.347 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ 2023-12-08T08:05:36.347 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/9p/ 2023-12-08T08:05:36.347 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 166425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/9p/9p.ko 2023-12-08T08:05:36.347 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/adfs/ 2023-12-08T08:05:36.347 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 61073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/adfs/adfs.ko 2023-12-08T08:05:36.347 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/affs/ 2023-12-08T08:05:36.347 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 163593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/affs/affs.ko 2023-12-08T08:05:36.347 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/afs/ 2023-12-08T08:05:36.347 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 932817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/afs/kafs.ko 2023-12-08T08:05:36.347 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/autofs/ 2023-12-08T08:05:36.347 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 101057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/autofs/autofs4.ko 2023-12-08T08:05:36.347 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/befs/ 2023-12-08T08:05:36.347 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 64545 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/befs/befs.ko 2023-12-08T08:05:36.347 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/bfs/ 2023-12-08T08:05:36.347 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/bfs/bfs.ko 2023-12-08T08:05:36.348 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/binfmt_misc.ko 2023-12-08T08:05:36.348 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/btrfs/ 2023-12-08T08:05:36.348 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 3402729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/btrfs/btrfs.ko 2023-12-08T08:05:36.348 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/cachefiles/ 2023-12-08T08:05:36.348 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 306009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/cachefiles/cachefiles.ko 2023-12-08T08:05:36.348 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ceph/ 2023-12-08T08:05:36.348 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1333017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ceph/ceph.ko 2023-12-08T08:05:36.348 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/coda/ 2023-12-08T08:05:36.348 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 100801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/coda/coda.ko 2023-12-08T08:05:36.348 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/configfs/ 2023-12-08T08:05:36.348 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 108393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/configfs/configfs.ko 2023-12-08T08:05:36.348 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/cramfs/ 2023-12-08T08:05:36.348 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/cramfs/cramfs.ko 2023-12-08T08:05:36.348 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/dlm/ 2023-12-08T08:05:36.348 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 642513 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/dlm/dlm.ko 2023-12-08T08:05:36.349 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/efs/ 2023-12-08T08:05:36.349 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/efs/efs.ko 2023-12-08T08:05:36.349 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/f2fs/ 2023-12-08T08:05:36.349 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1505025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/f2fs/f2fs.ko 2023-12-08T08:05:36.349 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fat/ 2023-12-08T08:05:36.349 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fat/msdos.ko 2023-12-08T08:05:36.349 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/freevxfs/ 2023-12-08T08:05:36.349 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42545 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/freevxfs/freevxfs.ko 2023-12-08T08:05:36.349 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fscache/ 2023-12-08T08:05:36.349 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 226481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fscache/fscache.ko 2023-12-08T08:05:36.349 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fuse/ 2023-12-08T08:05:36.349 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fuse/cuse.ko 2023-12-08T08:05:36.349 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/gfs2/ 2023-12-08T08:05:36.349 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1231529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/gfs2/gfs2.ko 2023-12-08T08:05:36.349 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/hfs/ 2023-12-08T08:05:36.349 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 141209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/hfs/hfs.ko 2023-12-08T08:05:36.350 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/hfsplus/ 2023-12-08T08:05:36.350 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 222817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/hfsplus/hfsplus.ko 2023-12-08T08:05:36.350 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/hpfs/ 2023-12-08T08:05:36.350 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 192329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/hpfs/hpfs.ko 2023-12-08T08:05:36.350 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/isofs/ 2023-12-08T08:05:36.350 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 74065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/isofs/isofs.ko 2023-12-08T08:05:36.350 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/jfs/ 2023-12-08T08:05:36.350 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 419497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/jfs/jfs.ko 2023-12-08T08:05:36.350 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/lockd/ 2023-12-08T08:05:36.350 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 280313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/lockd/lockd.ko 2023-12-08T08:05:36.350 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/minix/ 2023-12-08T08:05:36.350 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 89193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/minix/minix.ko 2023-12-08T08:05:36.350 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/netfs/ 2023-12-08T08:05:36.350 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 124649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/netfs/netfs.ko 2023-12-08T08:05:36.351 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/ 2023-12-08T08:05:36.351 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/blocklayout/ 2023-12-08T08:05:36.351 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 81449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-08T08:05:36.351 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/filelayout/ 2023-12-08T08:05:36.351 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-08T08:05:36.351 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/flexfilelayout/ 2023-12-08T08:05:36.351 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 117465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-08T08:05:36.351 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1055721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/nfs.ko 2023-12-08T08:05:36.351 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66441 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/nfsv2.ko 2023-12-08T08:05:36.351 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 120177 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/nfsv3.ko 2023-12-08T08:05:36.351 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 2042137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/nfsv4.ko 2023-12-08T08:05:36.351 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs_common/ 2023-12-08T08:05:36.351 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs_common/grace.ko 2023-12-08T08:05:36.351 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs_common/nfs_acl.ko 2023-12-08T08:05:36.352 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfsd/ 2023-12-08T08:05:36.352 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1516873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfsd/nfsd.ko 2023-12-08T08:05:36.352 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nilfs2/ 2023-12-08T08:05:36.352 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 592833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nilfs2/nilfs2.ko 2023-12-08T08:05:36.352 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/ 2023-12-08T08:05:36.352 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-celtic.ko 2023-12-08T08:05:36.352 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-centeuro.ko 2023-12-08T08:05:36.352 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-croatian.ko 2023-12-08T08:05:36.352 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-cyrillic.ko 2023-12-08T08:05:36.352 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-gaelic.ko 2023-12-08T08:05:36.352 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-greek.ko 2023-12-08T08:05:36.352 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-iceland.ko 2023-12-08T08:05:36.352 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-inuit.ko 2023-12-08T08:05:36.352 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-roman.ko 2023-12-08T08:05:36.352 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-romanian.ko 2023-12-08T08:05:36.353 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-turkish.ko 2023-12-08T08:05:36.353 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_ascii.ko 2023-12-08T08:05:36.353 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp1250.ko 2023-12-08T08:05:36.353 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12233 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp1251.ko 2023-12-08T08:05:36.353 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp1255.ko 2023-12-08T08:05:36.353 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp737.ko 2023-12-08T08:05:36.353 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp775.ko 2023-12-08T08:05:36.353 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp850.ko 2023-12-08T08:05:36.353 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp852.ko 2023-12-08T08:05:36.353 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp855.ko 2023-12-08T08:05:36.353 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11913 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp857.ko 2023-12-08T08:05:36.353 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp860.ko 2023-12-08T08:05:36.353 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13161 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp861.ko 2023-12-08T08:05:36.353 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp862.ko 2023-12-08T08:05:36.353 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13161 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp863.ko 2023-12-08T08:05:36.354 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp864.ko 2023-12-08T08:05:36.354 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13161 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp865.ko 2023-12-08T08:05:36.354 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp866.ko 2023-12-08T08:05:36.354 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp869.ko 2023-12-08T08:05:36.354 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp874.ko 2023-12-08T08:05:36.354 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 94137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp932.ko 2023-12-08T08:05:36.354 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 142673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp936.ko 2023-12-08T08:05:36.354 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 165745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp949.ko 2023-12-08T08:05:36.354 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 118121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp950.ko 2023-12-08T08:05:36.354 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12457 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_euc-jp.ko 2023-12-08T08:05:36.354 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-1.ko 2023-12-08T08:05:36.354 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-13.ko 2023-12-08T08:05:36.354 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-14.ko 2023-12-08T08:05:36.354 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-15.ko 2023-12-08T08:05:36.355 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-2.ko 2023-12-08T08:05:36.355 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-3.ko 2023-12-08T08:05:36.355 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-4.ko 2023-12-08T08:05:36.355 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-5.ko 2023-12-08T08:05:36.355 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-6.ko 2023-12-08T08:05:36.355 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12233 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-7.ko 2023-12-08T08:05:36.355 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-9.ko 2023-12-08T08:05:36.355 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_koi8-r.ko 2023-12-08T08:05:36.355 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_koi8-ru.ko 2023-12-08T08:05:36.355 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_koi8-u.ko 2023-12-08T08:05:36.355 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-08T08:05:36.355 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_utf8.ko 2023-12-08T08:05:36.355 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ntfs/ 2023-12-08T08:05:36.355 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 219417 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ntfs/ntfs.ko 2023-12-08T08:05:36.356 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/ 2023-12-08T08:05:36.356 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/cluster/ 2023-12-08T08:05:36.356 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 244409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-08T08:05:36.356 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/dlm/ 2023-12-08T08:05:36.356 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 440737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-08T08:05:36.356 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/dlmfs/ 2023-12-08T08:05:36.356 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-08T08:05:36.356 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 2592433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/ocfs2.ko 2023-12-08T08:05:36.356 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17905 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-08T08:05:36.356 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-08T08:05:36.356 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-08T08:05:36.356 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/omfs/ 2023-12-08T08:05:36.356 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/omfs/omfs.ko 2023-12-08T08:05:36.356 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/overlayfs/ 2023-12-08T08:05:36.357 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 352161 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/overlayfs/overlay.ko 2023-12-08T08:05:36.357 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/pstore/ 2023-12-08T08:05:36.357 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/pstore/ramoops.ko 2023-12-08T08:05:36.357 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/qnx4/ 2023-12-08T08:05:36.357 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/qnx4/qnx4.ko 2023-12-08T08:05:36.357 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/qnx6/ 2023-12-08T08:05:36.357 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 46689 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/qnx6/qnx6.ko 2023-12-08T08:05:36.357 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/quota/ 2023-12-08T08:05:36.357 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/quota/quota_tree.ko 2023-12-08T08:05:36.357 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/quota/quota_v1.ko 2023-12-08T08:05:36.357 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/quota/quota_v2.ko 2023-12-08T08:05:36.357 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/reiserfs/ 2023-12-08T08:05:36.357 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 532673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/reiserfs/reiserfs.ko 2023-12-08T08:05:36.357 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/romfs/ 2023-12-08T08:05:36.358 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28641 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/romfs/romfs.ko 2023-12-08T08:05:36.358 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/smb/ 2023-12-08T08:05:36.358 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/smb/client/ 2023-12-08T08:05:36.358 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 2668401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/smb/client/cifs.ko 2023-12-08T08:05:36.358 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/smb/common/ 2023-12-08T08:05:36.358 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7161 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/smb/common/cifs_arc4.ko 2023-12-08T08:05:36.358 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/smb/common/cifs_md4.ko 2023-12-08T08:05:36.358 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/squashfs/ 2023-12-08T08:05:36.358 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 134641 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/squashfs/squashfs.ko 2023-12-08T08:05:36.358 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/sysv/ 2023-12-08T08:05:36.358 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 90721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/sysv/sysv.ko 2023-12-08T08:05:36.358 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/udf/ 2023-12-08T08:05:36.358 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 247737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/udf/udf.ko 2023-12-08T08:05:36.358 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ufs/ 2023-12-08T08:05:36.359 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 162497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ufs/ufs.ko 2023-12-08T08:05:36.359 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/xfs/ 2023-12-08T08:05:36.359 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 4011017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/fs/xfs/xfs.ko 2023-12-08T08:05:36.359 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/kernel/ 2023-12-08T08:05:36.359 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/kernel/locking/ 2023-12-08T08:05:36.359 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 75489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/kernel/locking/locktorture.ko 2023-12-08T08:05:36.359 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/kernel/time/ 2023-12-08T08:05:36.359 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/kernel/time/test_udelay.ko 2023-12-08T08:05:36.359 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60553 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/kernel/torture.ko 2023-12-08T08:05:36.359 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/ 2023-12-08T08:05:36.359 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 6833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/crc-itu-t.ko 2023-12-08T08:05:36.359 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 6529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/crc7.ko 2023-12-08T08:05:36.359 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/crc8.ko 2023-12-08T08:05:36.359 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/crypto/ 2023-12-08T08:05:36.360 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/crypto/libarc4.ko 2023-12-08T08:05:36.360 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/crypto/libdes.ko 2023-12-08T08:05:36.360 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/interval_tree_test.ko 2023-12-08T08:05:36.360 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/libcrc32c.ko 2023-12-08T08:05:36.360 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/lru_cache.ko 2023-12-08T08:05:36.360 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/lz4/ 2023-12-08T08:05:36.360 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/lz4/lz4_compress.ko 2023-12-08T08:05:36.360 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/lz4/lz4hc_compress.ko 2023-12-08T08:05:36.360 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/math/ 2023-12-08T08:05:36.360 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 6617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/math/cordic.ko 2023-12-08T08:05:36.360 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8233 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/memory-notifier-error-inject.ko 2023-12-08T08:05:36.360 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/notifier-error-inject.ko 2023-12-08T08:05:36.360 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/percpu_test.ko 2023-12-08T08:05:36.360 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/pm-notifier-error-inject.ko 2023-12-08T08:05:36.361 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/raid6/ 2023-12-08T08:05:36.361 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 143433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/raid6/raid6_pq.ko 2023-12-08T08:05:36.361 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/rbtree_test.ko 2023-12-08T08:05:36.361 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/reed_solomon/ 2023-12-08T08:05:36.361 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-08T08:05:36.361 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/test-kstrtox.ko 2023-12-08T08:05:36.361 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/test-string_helpers.ko 2023-12-08T08:05:36.361 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 4760425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/test_bpf.ko 2023-12-08T08:05:36.361 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/test_firmware.ko 2023-12-08T08:05:36.361 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 6369 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/test_module.ko 2023-12-08T08:05:36.361 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/test_user_copy.ko 2023-12-08T08:05:36.361 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/ts_bm.ko 2023-12-08T08:05:36.361 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/ts_fsm.ko 2023-12-08T08:05:36.361 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/ts_kmp.ko 2023-12-08T08:05:36.361 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/xz/ 2023-12-08T08:05:36.362 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13545 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/lib/xz/xz_dec_test.ko 2023-12-08T08:05:36.362 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/mm/ 2023-12-08T08:05:36.362 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/mm/hwpoison-inject.ko 2023-12-08T08:05:36.362 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ 2023-12-08T08:05:36.362 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/ 2023-12-08T08:05:36.362 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/6lowpan.ko 2023-12-08T08:05:36.362 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_dest.ko 2023-12-08T08:05:36.362 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_fragment.ko 2023-12-08T08:05:36.362 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_hop.ko 2023-12-08T08:05:36.362 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 6985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-08T08:05:36.362 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_mobility.ko 2023-12-08T08:05:36.362 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7001 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_routing.ko 2023-12-08T08:05:36.363 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_udp.ko 2023-12-08T08:05:36.363 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/802/ 2023-12-08T08:05:36.363 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/802/garp.ko 2023-12-08T08:05:36.363 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/802/mrp.ko 2023-12-08T08:05:36.363 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8545 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/802/p8022.ko 2023-12-08T08:05:36.363 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/802/psnap.ko 2023-12-08T08:05:36.363 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/802/stp.ko 2023-12-08T08:05:36.363 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/8021q/ 2023-12-08T08:05:36.363 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 81737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/8021q/8021q.ko 2023-12-08T08:05:36.363 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/9p/ 2023-12-08T08:05:36.363 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 198337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/9p/9pnet.ko 2023-12-08T08:05:36.363 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35977 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/9p/9pnet_fd.ko 2023-12-08T08:05:36.363 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26345 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/9p/9pnet_rdma.ko 2023-12-08T08:05:36.363 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/9p/9pnet_virtio.ko 2023-12-08T08:05:36.363 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/batman-adv/ 2023-12-08T08:05:36.364 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 649297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/batman-adv/batman-adv.ko 2023-12-08T08:05:36.364 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/ 2023-12-08T08:05:36.364 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 63809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/br_netfilter.ko 2023-12-08T08:05:36.364 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 777689 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/bridge.ko 2023-12-08T08:05:36.364 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ 2023-12-08T08:05:36.364 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-08T08:05:36.364 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-08T08:05:36.364 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-08T08:05:36.364 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-08T08:05:36.364 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-08T08:05:36.364 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-08T08:05:36.364 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-08T08:05:36.364 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-08T08:05:36.364 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13217 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-08T08:05:36.365 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-08T08:05:36.365 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-08T08:05:36.365 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8385 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-08T08:05:36.365 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-08T08:05:36.365 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-08T08:05:36.365 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-08T08:05:36.365 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-08T08:05:36.365 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-08T08:05:36.365 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-08T08:05:36.365 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-08T08:05:36.365 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-08T08:05:36.365 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebtables.ko 2023-12-08T08:05:36.365 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14041 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-08T08:05:36.365 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13945 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-08T08:05:36.365 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ceph/ 2023-12-08T08:05:36.366 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1047025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ceph/libceph.ko 2023-12-08T08:05:36.366 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/core/ 2023-12-08T08:05:36.366 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 125993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/core/pktgen.ko 2023-12-08T08:05:36.366 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/dccp/ 2023-12-08T08:05:36.366 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 194209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/dccp/dccp.ko 2023-12-08T08:05:36.366 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/dccp/dccp_diag.ko 2023-12-08T08:05:36.366 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 57881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/dccp/dccp_ipv4.ko 2023-12-08T08:05:36.366 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/dccp/dccp_ipv6.ko 2023-12-08T08:05:36.366 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/dsa/ 2023-12-08T08:05:36.366 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 390473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/dsa/dsa_core.ko 2023-12-08T08:05:36.366 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/dsa/tag_brcm.ko 2023-12-08T08:05:36.366 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/dsa/tag_dsa.ko 2023-12-08T08:05:36.366 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/dsa/tag_none.ko 2023-12-08T08:05:36.366 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/dsa/tag_trailer.ko 2023-12-08T08:05:36.366 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/hsr/ 2023-12-08T08:05:36.367 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 99729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/hsr/hsr.ko 2023-12-08T08:05:36.367 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ieee802154/ 2023-12-08T08:05:36.367 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ieee802154/6lowpan/ 2023-12-08T08:05:36.367 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 45233 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-08T08:05:36.367 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 254625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ieee802154/ieee802154.ko 2023-12-08T08:05:36.367 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-08T08:05:36.367 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/ 2023-12-08T08:05:36.367 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/ah4.ko 2023-12-08T08:05:36.367 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38905 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/esp4.ko 2023-12-08T08:05:36.367 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 48337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/fou.ko 2023-12-08T08:05:36.367 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/gre.ko 2023-12-08T08:05:36.367 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 48657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/inet_diag.ko 2023-12-08T08:05:36.367 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/ip_gre.ko 2023-12-08T08:05:36.367 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 61225 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/ip_tunnel.ko 2023-12-08T08:05:36.367 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/ip_vti.ko 2023-12-08T08:05:36.368 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14001 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/ipcomp.ko 2023-12-08T08:05:36.368 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/ipip.ko 2023-12-08T08:05:36.368 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/ 2023-12-08T08:05:36.368 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37641 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-08T08:05:36.368 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-08T08:05:36.368 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-08T08:05:36.368 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41609 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/ip_tables.ko 2023-12-08T08:05:36.368 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-08T08:05:36.368 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-12-08T08:05:36.368 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-08T08:05:36.368 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11177 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-08T08:05:36.368 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-08T08:05:36.368 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11305 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-12-08T08:05:36.368 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-08T08:05:36.368 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14905 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-08T08:05:36.369 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11545 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-08T08:05:36.369 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-08T08:05:36.369 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-08T08:05:36.369 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-08T08:05:36.369 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-08T08:05:36.369 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18161 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-08T08:05:36.369 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-08T08:05:36.369 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20561 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-12-08T08:05:36.369 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-08T08:05:36.369 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15177 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-08T08:05:36.369 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-08T08:05:36.369 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-08T08:05:36.369 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-08T08:05:36.369 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_bic.ko 2023-12-08T08:05:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_dctcp.ko 2023-12-08T08:05:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15369 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_diag.ko 2023-12-08T08:05:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_highspeed.ko 2023-12-08T08:05:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_htcp.ko 2023-12-08T08:05:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_hybla.ko 2023-12-08T08:05:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_illinois.ko 2023-12-08T08:05:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_lp.ko 2023-12-08T08:05:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_scalable.ko 2023-12-08T08:05:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_vegas.ko 2023-12-08T08:05:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_veno.ko 2023-12-08T08:05:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_westwood.ko 2023-12-08T08:05:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_yeah.ko 2023-12-08T08:05:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tunnel4.ko 2023-12-08T08:05:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/udp_diag.ko 2023-12-08T08:05:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/udp_tunnel.ko 2023-12-08T08:05:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11361 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-08T08:05:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/ 2023-12-08T08:05:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26377 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/ah6.ko 2023-12-08T08:05:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/esp6.ko 2023-12-08T08:05:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/fou6.ko 2023-12-08T08:05:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 80897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/ip6_gre.ko 2023-12-08T08:05:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 93577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/ip6_tunnel.ko 2023-12-08T08:05:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-08T08:05:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/ip6_vti.ko 2023-12-08T08:05:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/ipcomp6.ko 2023-12-08T08:05:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19017 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/mip6.ko 2023-12-08T08:05:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ 2023-12-08T08:05:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-08T08:05:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-12-08T08:05:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-08T08:05:36.372 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-08T08:05:36.372 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-08T08:05:36.372 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-08T08:05:36.372 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-08T08:05:36.372 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16033 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-08T08:05:36.372 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8913 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-08T08:05:36.372 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-08T08:05:36.372 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-08T08:05:36.372 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-08T08:05:36.372 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-08T08:05:36.372 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11121 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-08T08:05:36.372 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-08T08:05:36.372 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11553 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-08T08:05:36.372 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-08T08:05:36.372 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-08T08:05:36.373 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-08T08:05:36.373 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25945 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-08T08:05:36.373 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-08T08:05:36.373 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-08T08:05:36.373 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-08T08:05:36.373 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-08T08:05:36.373 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9009 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-08T08:05:36.373 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 74073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/sit.ko 2023-12-08T08:05:36.373 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/tunnel6.ko 2023-12-08T08:05:36.373 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-08T08:05:36.373 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/key/ 2023-12-08T08:05:36.373 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 82833 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/key/af_key.ko 2023-12-08T08:05:36.373 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/ 2023-12-08T08:05:36.373 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 125281 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_core.ko 2023-12-08T08:05:36.373 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20177 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-08T08:05:36.374 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25953 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_eth.ko 2023-12-08T08:05:36.374 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_ip.ko 2023-12-08T08:05:36.374 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36713 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_ip6.ko 2023-12-08T08:05:36.374 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33001 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_netlink.ko 2023-12-08T08:05:36.374 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_ppp.ko 2023-12-08T08:05:36.374 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/lapb/ 2023-12-08T08:05:36.374 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47977 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/lapb/lapb.ko 2023-12-08T08:05:36.374 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/llc/ 2023-12-08T08:05:36.374 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/llc/llc.ko 2023-12-08T08:05:36.374 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 267913 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/llc/llc2.ko 2023-12-08T08:05:36.374 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/mac802154/ 2023-12-08T08:05:36.374 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 290417 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/mac802154/mac802154.ko 2023-12-08T08:05:36.374 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/mpls/ 2023-12-08T08:05:36.374 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/mpls/mpls_gso.ko 2023-12-08T08:05:36.375 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ 2023-12-08T08:05:36.375 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ 2023-12-08T08:05:36.375 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 119585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set.ko 2023-12-08T08:05:36.375 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28353 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-08T08:05:36.375 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26913 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-08T08:05:36.375 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26369 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-08T08:05:36.375 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 100297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-08T08:05:36.375 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 101441 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-08T08:05:36.375 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 102817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-08T08:05:36.375 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 103417 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-08T08:05:36.375 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 112849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-08T08:05:36.375 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-08T08:05:36.375 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 109593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-08T08:05:36.375 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 113129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-08T08:05:36.375 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 112585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-08T08:05:36.376 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 111585 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-08T08:05:36.376 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 114465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-08T08:05:36.376 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-08T08:05:36.376 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ 2023-12-08T08:05:36.376 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 411729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-08T08:05:36.376 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-08T08:05:36.376 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-08T08:05:36.376 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-08T08:05:36.376 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17905 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-08T08:05:36.376 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-08T08:05:36.376 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7689 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-08T08:05:36.376 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7689 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-08T08:05:36.376 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10681 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-08T08:05:36.376 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9233 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-08T08:05:36.377 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-08T08:05:36.377 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-08T08:05:36.377 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7697 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-08T08:05:36.377 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10993 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-08T08:05:36.377 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conncount.ko 2023-12-08T08:05:36.377 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 408257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack.ko 2023-12-08T08:05:36.377 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-08T08:05:36.377 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10177 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-08T08:05:36.377 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33761 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-08T08:05:36.377 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 118145 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-08T08:05:36.377 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-08T08:05:36.377 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-08T08:05:36.377 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 107233 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-08T08:05:36.377 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-08T08:05:36.377 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-08T08:05:36.378 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66641 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-08T08:05:36.378 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11233 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-08T08:05:36.378 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-08T08:05:36.378 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10113 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-08T08:05:36.378 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 89425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_flow_table.ko 2023-12-08T08:05:36.378 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9593 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-08T08:05:36.378 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_log_syslog.ko 2023-12-08T08:05:36.378 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 95353 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_nat.ko 2023-12-08T08:05:36.378 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-08T08:05:36.378 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-08T08:05:36.378 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11857 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_nat_irc.ko 2023-12-08T08:05:36.378 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28929 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_nat_sip.ko 2023-12-08T08:05:36.378 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-08T08:05:36.378 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-08T08:05:36.378 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 615649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_tables.ko 2023-12-08T08:05:36.379 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42561 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nfnetlink.ko 2023-12-08T08:05:36.379 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30233 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-08T08:05:36.379 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30569 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-12-08T08:05:36.379 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nfnetlink_log.ko 2023-12-08T08:05:36.379 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-08T08:05:36.379 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49377 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-08T08:05:36.379 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10457 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_chain_nat.ko 2023-12-08T08:05:36.379 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_compat.ko 2023-12-08T08:05:36.379 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_ct.ko 2023-12-08T08:05:36.379 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9601 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-08T08:05:36.379 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_fib.ko 2023-12-08T08:05:36.379 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-08T08:05:36.379 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14185 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_hash.ko 2023-12-08T08:05:36.379 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_limit.ko 2023-12-08T08:05:36.379 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_log.ko 2023-12-08T08:05:36.380 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_masq.ko 2023-12-08T08:05:36.380 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_nat.ko 2023-12-08T08:05:36.380 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13673 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_numgen.ko 2023-12-08T08:05:36.380 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11841 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_osf.ko 2023-12-08T08:05:36.380 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_queue.ko 2023-12-08T08:05:36.380 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_redir.ko 2023-12-08T08:05:36.380 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_reject.ko 2023-12-08T08:05:36.380 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_reject_inet.ko 2023-12-08T08:05:36.380 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_socket.ko 2023-12-08T08:05:36.380 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20369 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_synproxy.ko 2023-12-08T08:05:36.380 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_tproxy.ko 2023-12-08T08:05:36.380 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 89313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/x_tables.ko 2023-12-08T08:05:36.380 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_AUDIT.ko 2023-12-08T08:05:36.380 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-08T08:05:36.381 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-08T08:05:36.381 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-08T08:05:36.381 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_CT.ko 2023-12-08T08:05:36.381 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_DSCP.ko 2023-12-08T08:05:36.381 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_HL.ko 2023-12-08T08:05:36.381 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13369 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_HMARK.ko 2023-12-08T08:05:36.381 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-08T08:05:36.381 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13889 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_LED.ko 2023-12-08T08:05:36.381 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11489 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_LOG.ko 2023-12-08T08:05:36.381 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11753 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-08T08:05:36.381 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_NETMAP.ko 2023-12-08T08:05:36.381 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_NFLOG.ko 2023-12-08T08:05:36.381 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-08T08:05:36.381 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_RATEEST.ko 2023-12-08T08:05:36.382 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-08T08:05:36.382 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14337 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_SECMARK.ko 2023-12-08T08:05:36.382 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-08T08:05:36.382 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-08T08:05:36.382 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17361 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_TEE.ko 2023-12-08T08:05:36.382 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_TPROXY.ko 2023-12-08T08:05:36.382 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8321 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_TRACE.ko 2023-12-08T08:05:36.382 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_addrtype.ko 2023-12-08T08:05:36.382 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_bpf.ko 2023-12-08T08:05:36.382 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_cgroup.ko 2023-12-08T08:05:36.382 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_cluster.ko 2023-12-08T08:05:36.382 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_comment.ko 2023-12-08T08:05:36.382 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10465 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_connbytes.ko 2023-12-08T08:05:36.382 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_connlabel.ko 2023-12-08T08:05:36.382 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_connlimit.ko 2023-12-08T08:05:36.383 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13129 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_connmark.ko 2023-12-08T08:05:36.383 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_conntrack.ko 2023-12-08T08:05:36.383 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_cpu.ko 2023-12-08T08:05:36.383 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_dccp.ko 2023-12-08T08:05:36.383 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_devgroup.ko 2023-12-08T08:05:36.383 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8801 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_dscp.ko 2023-12-08T08:05:36.383 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_ecn.ko 2023-12-08T08:05:36.383 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_esp.ko 2023-12-08T08:05:36.383 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_hashlimit.ko 2023-12-08T08:05:36.383 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_helper.ko 2023-12-08T08:05:36.383 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7865 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_hl.ko 2023-12-08T08:05:36.383 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11921 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_ipcomp.ko 2023-12-08T08:05:36.383 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_iprange.ko 2023-12-08T08:05:36.383 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11785 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_ipvs.ko 2023-12-08T08:05:36.384 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16041 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_l2tp.ko 2023-12-08T08:05:36.384 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8001 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_length.ko 2023-12-08T08:05:36.384 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10209 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_limit.ko 2023-12-08T08:05:36.384 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7545 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_mac.ko 2023-12-08T08:05:36.384 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_mark.ko 2023-12-08T08:05:36.384 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11825 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_multiport.ko 2023-12-08T08:05:36.384 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_nat.ko 2023-12-08T08:05:36.384 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_nfacct.ko 2023-12-08T08:05:36.384 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_osf.ko 2023-12-08T08:05:36.384 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9553 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_owner.ko 2023-12-08T08:05:36.384 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_physdev.ko 2023-12-08T08:05:36.384 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_pkttype.ko 2023-12-08T08:05:36.384 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11985 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_policy.ko 2023-12-08T08:05:36.384 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_quota.ko 2023-12-08T08:05:36.384 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_rateest.ko 2023-12-08T08:05:36.385 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_realm.ko 2023-12-08T08:05:36.385 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_recent.ko 2023-12-08T08:05:36.385 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13329 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_sctp.ko 2023-12-08T08:05:36.385 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_set.ko 2023-12-08T08:05:36.385 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_socket.ko 2023-12-08T08:05:36.385 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9505 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_state.ko 2023-12-08T08:05:36.385 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9473 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_statistic.ko 2023-12-08T08:05:36.385 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8809 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_string.ko 2023-12-08T08:05:36.385 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8553 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_tcpmss.ko 2023-12-08T08:05:36.385 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15777 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_tcpudp.ko 2023-12-08T08:05:36.385 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_time.ko 2023-12-08T08:05:36.385 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_u32.ko 2023-12-08T08:05:36.385 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netlink/ 2023-12-08T08:05:36.385 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13969 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/netlink/netlink_diag.ko 2023-12-08T08:05:36.385 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/nsh/ 2023-12-08T08:05:36.386 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/nsh/nsh.ko 2023-12-08T08:05:36.386 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/openvswitch/ 2023-12-08T08:05:36.386 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 380033 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/openvswitch/openvswitch.ko 2023-12-08T08:05:36.386 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/openvswitch/vport-geneve.ko 2023-12-08T08:05:36.386 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/openvswitch/vport-gre.ko 2023-12-08T08:05:36.386 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/openvswitch/vport-vxlan.ko 2023-12-08T08:05:36.386 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/packet/ 2023-12-08T08:05:36.386 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13057 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/packet/af_packet_diag.ko 2023-12-08T08:05:36.386 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/phonet/ 2023-12-08T08:05:36.386 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 110201 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/phonet/phonet.ko 2023-12-08T08:05:36.386 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54721 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/phonet/pn_pep.ko 2023-12-08T08:05:36.386 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/rds/ 2023-12-08T08:05:36.386 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 251481 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/rds/rds.ko 2023-12-08T08:05:36.386 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 164937 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/rds/rds_rdma.ko 2023-12-08T08:05:36.386 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 67377 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/rds/rds_tcp.ko 2023-12-08T08:05:36.387 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/rxrpc/ 2023-12-08T08:05:36.387 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 819657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/rxrpc/rxrpc.ko 2023-12-08T08:05:36.387 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/ 2023-12-08T08:05:36.387 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32241 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_csum.ko 2023-12-08T08:05:36.387 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23577 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_gact.ko 2023-12-08T08:05:36.387 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26873 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_ipt.ko 2023-12-08T08:05:36.387 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_mirred.ko 2023-12-08T08:05:36.387 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_nat.ko 2023-12-08T08:05:36.387 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43449 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_pedit.ko 2023-12-08T08:05:36.387 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_police.ko 2023-12-08T08:05:36.387 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_simple.ko 2023-12-08T08:05:36.387 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35297 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_skbedit.ko 2023-12-08T08:05:36.387 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_vlan.ko 2023-12-08T08:05:36.387 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/cls_basic.ko 2023-12-08T08:05:36.387 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33961 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/cls_bpf.ko 2023-12-08T08:05:36.388 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19169 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/cls_cgroup.ko 2023-12-08T08:05:36.388 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31401 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/cls_flow.ko 2023-12-08T08:05:36.388 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31769 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/cls_fw.ko 2023-12-08T08:05:36.388 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38425 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/cls_route.ko 2023-12-08T08:05:36.388 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 61409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/cls_u32.ko 2023-12-08T08:05:36.388 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7441 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/em_cmp.ko 2023-12-08T08:05:36.388 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/em_ipset.ko 2023-12-08T08:05:36.388 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33289 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/em_meta.ko 2023-12-08T08:05:36.388 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/em_nbyte.ko 2023-12-08T08:05:36.388 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/em_text.ko 2023-12-08T08:05:36.388 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7249 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/em_u32.ko 2023-12-08T08:05:36.388 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_choke.ko 2023-12-08T08:05:36.388 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20849 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_codel.ko 2023-12-08T08:05:36.388 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34633 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_drr.ko 2023-12-08T08:05:36.388 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33609 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_fq.ko 2023-12-08T08:05:36.389 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31617 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_fq_codel.ko 2023-12-08T08:05:36.389 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35433 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_gred.ko 2023-12-08T08:05:36.389 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49817 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_hfsc.ko 2023-12-08T08:05:36.389 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22089 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_hhf.ko 2023-12-08T08:05:36.389 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66393 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_htb.ko 2023-12-08T08:05:36.389 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26073 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_ingress.ko 2023-12-08T08:05:36.389 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30273 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_mqprio.ko 2023-12-08T08:05:36.389 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10793 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_mqprio_lib.ko 2023-12-08T08:05:36.389 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26065 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_multiq.ko 2023-12-08T08:05:36.389 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36137 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_netem.ko 2023-12-08T08:05:36.389 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27497 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_pie.ko 2023-12-08T08:05:36.389 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10625 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_plug.ko 2023-12-08T08:05:36.389 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_prio.ko 2023-12-08T08:05:36.389 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 48729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_qfq.ko 2023-12-08T08:05:36.389 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32905 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_red.ko 2023-12-08T08:05:36.390 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26881 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_sfb.ko 2023-12-08T08:05:36.390 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31353 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_sfq.ko 2023-12-08T08:05:36.390 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28897 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_tbf.ko 2023-12-08T08:05:36.390 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28105 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_teql.ko 2023-12-08T08:05:36.390 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sctp/ 2023-12-08T08:05:36.390 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 929745 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sctp/sctp.ko 2023-12-08T08:05:36.390 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19033 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sctp/sctp_diag.ko 2023-12-08T08:05:36.390 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc/ 2023-12-08T08:05:36.390 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc/auth_gss/ 2023-12-08T08:05:36.390 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 336529 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-08T08:05:36.390 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54737 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-08T08:05:36.390 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1520097 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc/sunrpc.ko 2023-12-08T08:05:36.390 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc/xprtrdma/ 2023-12-08T08:05:36.390 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 707657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-08T08:05:36.391 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/tipc/ 2023-12-08T08:05:36.391 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10025 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/tipc/diag.ko 2023-12-08T08:05:36.391 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 862665 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/tipc/tipc.ko 2023-12-08T08:05:36.391 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/unix/ 2023-12-08T08:05:36.391 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15729 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/unix/unix_diag.ko 2023-12-08T08:05:36.391 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/vmw_vsock/ 2023-12-08T08:05:36.391 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 85409 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-08T08:05:36.391 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 68049 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-08T08:05:36.391 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 96193 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/vmw_vsock/vsock.ko 2023-12-08T08:05:36.391 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10705 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-08T08:05:36.391 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17521 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-08T08:05:36.391 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/x25/ 2023-12-08T08:05:36.391 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 125177 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/x25/x25.ko 2023-12-08T08:05:36.391 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/xfrm/ 2023-12-08T08:05:36.391 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22657 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/xfrm/xfrm_algo.ko 2023-12-08T08:05:36.392 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20649 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-08T08:05:36.392 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 102257 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/net/xfrm/xfrm_user.ko 2023-12-08T08:05:36.392 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/virt/ 2023-12-08T08:05:36.392 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/virt/lib/ 2023-12-08T08:05:36.392 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15537 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/kernel/virt/lib/irqbypass.ko 2023-12-08T08:05:36.392 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 640081 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/modules.alias 2023-12-08T08:05:36.392 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 624107 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/modules.alias.bin 2023-12-08T08:05:36.392 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7663 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/modules.builtin 2023-12-08T08:05:36.392 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23428 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/modules.builtin.alias.bin 2023-12-08T08:05:36.392 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9821 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/modules.builtin.bin 2023-12-08T08:05:36.392 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 70004 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/modules.builtin.modinfo 2023-12-08T08:05:36.392 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 146313 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/modules.dep 2023-12-08T08:05:36.392 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 232548 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/modules.dep.bin 2023-12-08T08:05:36.392 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 210 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/modules.devname 2023-12-08T08:05:36.392 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 72606 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/modules.order 2023-12-08T08:05:36.393 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 879 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/modules.softdep 2023-12-08T08:05:36.393 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 254438 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/modules.symbols 2023-12-08T08:05:36.393 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 309363 2023-12-08 05:25 ./lib/modules/6.6.0-g6bcacf46b788/modules.symbols.bin 2023-12-08T08:05:36.393 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./usr/ 2023-12-08T08:05:36.393 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./usr/share/ 2023-12-08T08:05:36.393 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./usr/share/doc/ 2023-12-08T08:05:36.393 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-12-08 05:25 ./usr/share/doc/linux-image-6.6.0-g6bcacf46b788/ 2023-12-08T08:05:36.393 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 171 2023-12-08 05:25 ./usr/share/doc/linux-image-6.6.0-g6bcacf46b788/changelog.Debian.gz 2023-12-08T08:05:36.393 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 691 2023-12-08 05:25 ./usr/share/doc/linux-image-6.6.0-g6bcacf46b788/copyright 2023-12-08T08:05:36.394 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g6bcacf46b788 2023-12-08T08:05:36.394 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g6bcacf46b788 2023-12-08T08:05:36.394 DEBUG:teuthology.orchestra.run.smithi088:> egrep '(submenu|menuentry.*6.6.0-g6bcacf46b788).*{' /boot/grub/grub.cfg 2023-12-08T08:05:36.401 INFO:teuthology.orchestra.run.smithi088.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-08T08:05:36.401 INFO:teuthology.orchestra.run.smithi088.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g6bcacf46b788' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g6bcacf46b788-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-08T08:05:36.401 INFO:teuthology.orchestra.run.smithi088.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g6bcacf46b788 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g6bcacf46b788-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-08T08:05:36.401 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-12-08T08:05:36.401 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g6bcacf46b788 2023-12-08T08:05:36.402 DEBUG:teuthology.orchestra.run.smithi088:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-12-08T08:05:36.447 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi088.front.sepia.ceph.com to complete... 2023-12-08T08:05:36.920 INFO:teuthology.orchestra.run.smithi088.stderr:Sourcing file `/etc/default/grub' 2023-12-08T08:05:36.921 INFO:teuthology.orchestra.run.smithi088.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-08T08:05:36.950 INFO:teuthology.orchestra.run.smithi088.stderr:Generating grub configuration file ... 2023-12-08T08:05:37.187 INFO:teuthology.orchestra.run.smithi088.stderr:Found linux image: /boot/vmlinuz-6.6.0-g6bcacf46b788 2023-12-08T08:05:37.193 INFO:teuthology.orchestra.run.smithi088.stderr:Found initrd image: /boot/initrd.img-6.6.0-g6bcacf46b788 2023-12-08T08:05:37.484 INFO:teuthology.orchestra.run.smithi088.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-08T08:05:37.490 INFO:teuthology.orchestra.run.smithi088.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-08T08:05:37.529 INFO:teuthology.orchestra.run.smithi088.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-08T08:05:37.534 INFO:teuthology.orchestra.run.smithi088.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-08T08:05:37.647 INFO:teuthology.orchestra.run.smithi088.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-08T08:05:37.647 INFO:teuthology.orchestra.run.smithi088.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-08T08:05:37.647 INFO:teuthology.orchestra.run.smithi088.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-08T08:05:37.667 INFO:teuthology.orchestra.run.smithi088.stderr:done 2023-12-08T08:06:05.110 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-12-08T08:06:05.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-12-08T08:06:05.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T08:06:08.826 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-12-08T08:06:08.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-12-08T08:06:08.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T08:06:23.587 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-12-08T08:06:27.170 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-08T08:06:32.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-12-08T08:06:32.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T08:06:35.654 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-12-08T08:06:36.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-12-08T08:06:36.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T08:06:39.234 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-08T08:06:47.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-12-08T08:06:47.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T08:06:51.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-12-08T08:06:51.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T08:06:54.306 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-08T08:07:06.082 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-12-08T08:07:09.310 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-12-08T08:07:09.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T08:07:21.094 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-12-08T08:07:21.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T08:07:21.098 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-12-08T08:07:27.842 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-08T08:07:39.108 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-12-08T08:07:39.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T08:07:39.345 DEBUG:teuthology.orchestra.run.smithi148:> true 2023-12-08T08:07:40.081 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-12-08T08:07:40.082 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-g6bcacf46b788"... 2023-12-08T08:07:40.082 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2023-12-08T08:07:40.130 INFO:teuthology.orchestra.run.smithi148.stdout:6.6.0-g6bcacf46b788 2023-12-08T08:07:40.130 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g6bcacf46b788 vs 6.6.0-g6bcacf46b788 2023-12-08T08:07:40.130 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-08T08:07:40.130 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-08T08:07:41.132 DEBUG:teuthology.parallel:result is None 2023-12-08T08:07:45.843 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-12-08T08:07:45.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T08:07:46.130 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-12-08T08:07:46.854 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-12-08T08:07:46.854 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-g6bcacf46b788"... 2023-12-08T08:07:46.854 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2023-12-08T08:07:46.903 INFO:teuthology.orchestra.run.smithi088.stdout:6.6.0-g6bcacf46b788 2023-12-08T08:07:46.904 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g6bcacf46b788 vs 6.6.0-g6bcacf46b788 2023-12-08T08:07:46.904 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-08T08:07:46.904 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-08T08:07:47.905 DEBUG:teuthology.parallel:result is None 2023-12-08T08:07:47.905 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-08T08:07:47.914 INFO:teuthology.task.internal:Creating test directory... 2023-12-08T08:07:47.914 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-08T08:07:47.918 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-08T08:07:47.927 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-08T08:07:47.936 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-08T08:07:47.943 INFO:teuthology.task.internal:Creating archive directory... 2023-12-08T08:07:47.943 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-08T08:07:47.970 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-08T08:07:47.996 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-08T08:07:48.003 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-08T08:07:48.003 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-08T08:07:48.030 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-08T08:07:48.099 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-08T08:07:48.126 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-08T08:07:48.127 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-08T08:07:48.133 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-08T08:07:48.135 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-08T08:07:48.174 INFO:teuthology.task.internal:Configuring sudo... 2023-12-08T08:07:48.174 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-08T08:07:48.178 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-08T08:07:48.201 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-08T08:07:48.211 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-08T08:07:48.211 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-08T08:07:48.246 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-08T08:07:48.255 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-08T08:07:48.305 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-08T08:07:48.356 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:07:48.356 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-08T08:07:48.428 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-08T08:07:48.438 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-08T08:07:48.490 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:07:48.491 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-08T08:07:48.565 DEBUG:teuthology.orchestra.run.smithi088:> sudo service rsyslog restart 2023-12-08T08:07:48.568 DEBUG:teuthology.orchestra.run.smithi148:> sudo service rsyslog restart 2023-12-08T08:07:48.695 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-08T08:07:48.704 INFO:teuthology.task.internal:Starting timer... 2023-12-08T08:07:48.704 INFO:teuthology.run_tasks:Running task pcp... 2023-12-08T08:07:48.714 INFO:teuthology.run_tasks:Running task selinux... 2023-12-08T08:07:48.723 DEBUG:teuthology.task.selinux:Excluding smithi088: OS 'ubuntu' does not support SELinux 2023-12-08T08:07:48.723 DEBUG:teuthology.task.selinux:Excluding smithi148: OS 'ubuntu' does not support SELinux 2023-12-08T08:07:48.723 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-08T08:07:48.723 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-12-08T08:07:48.723 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-08T08:07:48.723 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-08T08:07:48.795 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-08T08:07:48.795 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-08T08:07:48.816 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-08T08:07:48.817 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi088.front.sepia.ceph.com,smithi148.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-08T08:16:33.007 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi088.front.sepia.ceph.com'), Remote(name='ubuntu@smithi148.front.sepia.ceph.com')] 2023-12-08T08:16:33.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-12-08T08:16:33.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T08:16:33.132 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-12-08T08:16:33.246 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-12-08T08:16:33.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-12-08T08:16:33.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T08:16:33.385 DEBUG:teuthology.orchestra.run.smithi148:> true 2023-12-08T08:16:33.504 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-12-08T08:16:33.504 INFO:teuthology.run_tasks:Running task clock... 2023-12-08T08:16:33.627 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-08T08:16:33.628 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-08T08:16:33.628 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-08T08:16:33.634 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-08T08:16:33.634 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-08T08:16:33.670 INFO:teuthology.orchestra.run.smithi088.stdout: 8 Dec 08:16:33 ntpd[27963]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-12-08T08:16:33.671 INFO:teuthology.orchestra.run.smithi088.stdout: 8 Dec 08:16:33 ntpd[27963]: Command line: ntpd -gq 2023-12-08T08:16:33.671 INFO:teuthology.orchestra.run.smithi088.stdout: 8 Dec 08:16:33 ntpd[27963]: ---------------------------------------------------- 2023-12-08T08:16:33.671 INFO:teuthology.orchestra.run.smithi088.stdout: 8 Dec 08:16:33 ntpd[27963]: ntp-4 is maintained by Network Time Foundation, 2023-12-08T08:16:33.671 INFO:teuthology.orchestra.run.smithi088.stdout: 8 Dec 08:16:33 ntpd[27963]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-12-08T08:16:33.671 INFO:teuthology.orchestra.run.smithi088.stdout: 8 Dec 08:16:33 ntpd[27963]: corporation. Support and training for ntp-4 are 2023-12-08T08:16:33.671 INFO:teuthology.orchestra.run.smithi088.stdout: 8 Dec 08:16:33 ntpd[27963]: available at https://www.nwtime.org/support 2023-12-08T08:16:33.671 INFO:teuthology.orchestra.run.smithi088.stdout: 8 Dec 08:16:33 ntpd[27963]: ---------------------------------------------------- 2023-12-08T08:16:33.672 INFO:teuthology.orchestra.run.smithi088.stdout: 8 Dec 08:16:33 ntpd[27963]: proto: precision = 0.043 usec (-24) 2023-12-08T08:16:33.672 INFO:teuthology.orchestra.run.smithi088.stdout: 8 Dec 08:16:33 ntpd[27963]: basedate set to 2022-02-04 2023-12-08T08:16:33.672 INFO:teuthology.orchestra.run.smithi088.stdout: 8 Dec 08:16:33 ntpd[27963]: gps base set to 2022-02-06 (week 2196) 2023-12-08T08:16:33.672 INFO:teuthology.orchestra.run.smithi088.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-08T08:16:33.672 INFO:teuthology.orchestra.run.smithi088.stdout: 8 Dec 08:16:33 ntpd[27963]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-08T08:16:33.673 INFO:teuthology.orchestra.run.smithi088.stdout: 8 Dec 08:16:33 ntpd[27963]: restrict ::: KOD does nothing without LIMITED. 2023-12-08T08:16:33.673 INFO:teuthology.orchestra.run.smithi088.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-08T08:16:33.674 INFO:teuthology.orchestra.run.smithi088.stdout: 8 Dec 08:16:33 ntpd[27963]: Listen and drop on 0 v6wildcard [::]:123 2023-12-08T08:16:33.674 INFO:teuthology.orchestra.run.smithi088.stdout: 8 Dec 08:16:33 ntpd[27963]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-08T08:16:33.674 INFO:teuthology.orchestra.run.smithi088.stdout: 8 Dec 08:16:33 ntpd[27963]: Listen normally on 2 lo 127.0.0.1:123 2023-12-08T08:16:33.674 INFO:teuthology.orchestra.run.smithi088.stdout: 8 Dec 08:16:33 ntpd[27963]: Listen normally on 3 enp3s0f1 172.21.15.88:123 2023-12-08T08:16:33.674 INFO:teuthology.orchestra.run.smithi088.stdout: 8 Dec 08:16:33 ntpd[27963]: Listen normally on 4 lo [::1]:123 2023-12-08T08:16:33.674 INFO:teuthology.orchestra.run.smithi088.stdout: 8 Dec 08:16:33 ntpd[27963]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d42d%5]:123 2023-12-08T08:16:33.674 INFO:teuthology.orchestra.run.smithi088.stdout: 8 Dec 08:16:33 ntpd[27963]: Listening on routing socket on fd #22 for interface updates 2023-12-08T08:16:33.678 INFO:teuthology.orchestra.run.smithi148.stdout: 8 Dec 08:16:33 ntpd[27959]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-12-08T08:16:33.678 INFO:teuthology.orchestra.run.smithi148.stdout: 8 Dec 08:16:33 ntpd[27959]: Command line: ntpd -gq 2023-12-08T08:16:33.678 INFO:teuthology.orchestra.run.smithi148.stdout: 8 Dec 08:16:33 ntpd[27959]: ---------------------------------------------------- 2023-12-08T08:16:33.678 INFO:teuthology.orchestra.run.smithi148.stdout: 8 Dec 08:16:33 ntpd[27959]: ntp-4 is maintained by Network Time Foundation, 2023-12-08T08:16:33.679 INFO:teuthology.orchestra.run.smithi148.stdout: 8 Dec 08:16:33 ntpd[27959]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-12-08T08:16:33.679 INFO:teuthology.orchestra.run.smithi148.stdout: 8 Dec 08:16:33 ntpd[27959]: corporation. Support and training for ntp-4 are 2023-12-08T08:16:33.679 INFO:teuthology.orchestra.run.smithi148.stdout: 8 Dec 08:16:33 ntpd[27959]: available at https://www.nwtime.org/support 2023-12-08T08:16:33.679 INFO:teuthology.orchestra.run.smithi148.stdout: 8 Dec 08:16:33 ntpd[27959]: ---------------------------------------------------- 2023-12-08T08:16:33.679 INFO:teuthology.orchestra.run.smithi148.stdout: 8 Dec 08:16:33 ntpd[27959]: proto: precision = 0.043 usec (-24) 2023-12-08T08:16:33.680 INFO:teuthology.orchestra.run.smithi148.stdout: 8 Dec 08:16:33 ntpd[27959]: basedate set to 2022-02-04 2023-12-08T08:16:33.680 INFO:teuthology.orchestra.run.smithi148.stdout: 8 Dec 08:16:33 ntpd[27959]: gps base set to 2022-02-06 (week 2196) 2023-12-08T08:16:33.680 INFO:teuthology.orchestra.run.smithi148.stdout: 8 Dec 08:16:33 ntpd[27959]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-08T08:16:33.680 INFO:teuthology.orchestra.run.smithi148.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-08T08:16:33.680 INFO:teuthology.orchestra.run.smithi148.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-08T08:16:33.681 INFO:teuthology.orchestra.run.smithi148.stdout: 8 Dec 08:16:33 ntpd[27959]: restrict ::: KOD does nothing without LIMITED. 2023-12-08T08:16:33.681 INFO:teuthology.orchestra.run.smithi148.stdout: 8 Dec 08:16:33 ntpd[27959]: Listen and drop on 0 v6wildcard [::]:123 2023-12-08T08:16:33.681 INFO:teuthology.orchestra.run.smithi148.stdout: 8 Dec 08:16:33 ntpd[27959]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-08T08:16:33.681 INFO:teuthology.orchestra.run.smithi148.stdout: 8 Dec 08:16:33 ntpd[27959]: Listen normally on 2 lo 127.0.0.1:123 2023-12-08T08:16:33.681 INFO:teuthology.orchestra.run.smithi148.stdout: 8 Dec 08:16:33 ntpd[27959]: Listen normally on 3 enp3s0f1 172.21.15.148:123 2023-12-08T08:16:33.681 INFO:teuthology.orchestra.run.smithi148.stdout: 8 Dec 08:16:33 ntpd[27959]: Listen normally on 4 lo [::1]:123 2023-12-08T08:16:33.681 INFO:teuthology.orchestra.run.smithi148.stdout: 8 Dec 08:16:33 ntpd[27959]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7257%5]:123 2023-12-08T08:16:33.681 INFO:teuthology.orchestra.run.smithi148.stdout: 8 Dec 08:16:33 ntpd[27959]: Listening on routing socket on fd #22 for interface updates 2023-12-08T08:16:34.671 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:34 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:34.671 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:34 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:34.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:34 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:34.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:34 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:34.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:34 ntpd[27963]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T08:16:34.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:34 ntpd[27963]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T08:16:34.678 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:34 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:34.678 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:34 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:34.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:34 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:34.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:34 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:34.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:34 ntpd[27959]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T08:16:34.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:34 ntpd[27959]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T08:16:35.671 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:35 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:35.671 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:35 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:35.671 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:35 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:35.671 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:35 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:35.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:35 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:35.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:35 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:35.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:35 ntpd[27963]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T08:16:35.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:35 ntpd[27963]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T08:16:35.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:35 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:35.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:35 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:35.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:35 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:35.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:35 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:35.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:35 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:35.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:35 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:35.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:35 ntpd[27959]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T08:16:35.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:35 ntpd[27959]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T08:16:36.671 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:36 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:36.671 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:36 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:36.671 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:36 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:36.671 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:36 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:36.671 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:36 ntpd[27963]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T08:16:36.671 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:36 ntpd[27963]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T08:16:36.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:36 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:36.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:36 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:36.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:36 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:36.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:36 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:36.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:36 ntpd[27959]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T08:16:36.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:36 ntpd[27959]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T08:16:37.671 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:37 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:37.671 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:37 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:37.671 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:37 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:37.671 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:37 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:37.671 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:37 ntpd[27963]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T08:16:37.671 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:37 ntpd[27963]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T08:16:37.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:37 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:37.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:37 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:37.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:37 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:37.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:37 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:37.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:37 ntpd[27959]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T08:16:37.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:37 ntpd[27959]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T08:16:38.671 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:38 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:38.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:38 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:38.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:38 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:38.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:38 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:38.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:38 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:38.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:38 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:38.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:38 ntpd[27963]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T08:16:38.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:38 ntpd[27963]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T08:16:38.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:38 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:38.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:38 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:38.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:38 ntpd[27963]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T08:16:38.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:38 ntpd[27963]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T08:16:38.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:38 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:38.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:38 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:38.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:38 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:38.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:38 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:38.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:38 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:38.680 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:38 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:38.680 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:38 ntpd[27959]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T08:16:38.680 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:38 ntpd[27959]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T08:16:38.680 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:38 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:38.680 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:38 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:38.680 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:38 ntpd[27959]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T08:16:38.680 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:38 ntpd[27959]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T08:16:39.671 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:39 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:39.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:39 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:39.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:39 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:39.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:39 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:39.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:39 ntpd[27963]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T08:16:39.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:39 ntpd[27963]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T08:16:39.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:39 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:39.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:39 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:39.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:39 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:39.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:39 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:39.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:39 ntpd[27959]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T08:16:39.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:39 ntpd[27959]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T08:16:40.671 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:40 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:40.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:40 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:40.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:40 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:40.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:40 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:40.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:40 ntpd[27963]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:40.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:40 ntpd[27963]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:40.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:40 ntpd[27963]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T08:16:40.672 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:40 ntpd[27963]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T08:16:40.672 INFO:teuthology.orchestra.run.smithi088.stdout: 8 Dec 08:16:40 ntpd[27963]: ntpd: time slew -0.001067 s 2023-12-08T08:16:40.672 INFO:teuthology.orchestra.run.smithi088.stdout:ntpd: time slew -0.001067s 2023-12-08T08:16:40.673 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:40 ntpd[27963]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-08T08:16:40.673 INFO:teuthology.orchestra.run.smithi088.stderr: 8 Dec 08:16:40 ntpd[27963]: can't open /var/log/ntpstats/loopstats.20231208: Permission denied 2023-12-08T08:16:40.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:40 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:40.679 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:40 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:40.680 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:40 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:40.680 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:40 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:40.680 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:40 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:40.680 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:40 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:40.680 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:40 ntpd[27959]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T08:16:40.680 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:40 ntpd[27959]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T08:16:40.680 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:40 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-08T08:16:40.680 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:40 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231208: Permission denied 2023-12-08T08:16:40.680 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:40 ntpd[27959]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-08T08:16:40.680 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:40 ntpd[27959]: can't open /var/log/ntpstats/peerstats.20231208: Permission denied 2023-12-08T08:16:40.680 INFO:teuthology.orchestra.run.smithi148.stdout: 8 Dec 08:16:40 ntpd[27959]: ntpd: time slew -0.001655 s 2023-12-08T08:16:40.681 INFO:teuthology.orchestra.run.smithi148.stdout:ntpd: time slew -0.001655s 2023-12-08T08:16:40.681 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:40 ntpd[27959]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-08T08:16:40.681 INFO:teuthology.orchestra.run.smithi148.stderr: 8 Dec 08:16:40 ntpd[27959]: can't open /var/log/ntpstats/loopstats.20231208: Permission denied 2023-12-08T08:16:40.780 INFO:teuthology.orchestra.run.smithi088.stdout: remote refid st t when poll reach delay offset jitter 2023-12-08T08:16:40.780 INFO:teuthology.orchestra.run.smithi088.stdout:============================================================================== 2023-12-08T08:16:40.780 INFO:teuthology.orchestra.run.smithi088.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-08T08:16:40.781 INFO:teuthology.orchestra.run.smithi088.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-08T08:16:40.781 INFO:teuthology.orchestra.run.smithi088.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-08T08:16:40.781 INFO:teuthology.orchestra.run.smithi088.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-08T08:16:40.805 INFO:teuthology.orchestra.run.smithi148.stdout: remote refid st t when poll reach delay offset jitter 2023-12-08T08:16:40.805 INFO:teuthology.orchestra.run.smithi148.stdout:============================================================================== 2023-12-08T08:16:40.805 INFO:teuthology.orchestra.run.smithi148.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-08T08:16:40.805 INFO:teuthology.orchestra.run.smithi148.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-08T08:16:40.805 INFO:teuthology.orchestra.run.smithi148.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-08T08:16:40.805 INFO:teuthology.orchestra.run.smithi148.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-08T08:16:40.806 INFO:teuthology.run_tasks:Running task install... 2023-12-08T08:16:40.815 DEBUG:teuthology.task.install:project ceph 2023-12-08T08:16:40.815 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da'}} 2023-12-08T08:16:40.815 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da'} 2023-12-08T08:16:40.815 INFO:teuthology.task.install:Using flavor: default 2023-12-08T08:16:40.821 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-08T08:16:40.821 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-12-08T08:16:40.822 DEBUG:teuthology.orchestra.run.smithi088:> sudo apt-key list | grep Ceph 2023-12-08T08:16:40.822 DEBUG:teuthology.orchestra.run.smithi148:> sudo apt-key list | grep Ceph 2023-12-08T08:16:40.929 INFO:teuthology.orchestra.run.smithi088.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-12-08T08:16:40.951 INFO:teuthology.orchestra.run.smithi148.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-12-08T08:16:40.981 INFO:teuthology.orchestra.run.smithi088.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-08T08:16:40.981 INFO:teuthology.orchestra.run.smithi088.stdout:uid [ unknown] Ceph.com (release key) 2023-12-08T08:16:40.982 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-08T08:16:40.982 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-12-08T08:16:40.983 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a2cd52c00149b5caff897ea7f79d0529b62620da 2023-12-08T08:16:41.004 INFO:teuthology.orchestra.run.smithi148.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-08T08:16:41.004 INFO:teuthology.orchestra.run.smithi148.stdout:uid [ unknown] Ceph.com (release key) 2023-12-08T08:16:41.005 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-08T08:16:41.005 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-12-08T08:16:41.005 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a2cd52c00149b5caff897ea7f79d0529b62620da 2023-12-08T08:16:41.134 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default/ 2023-12-08T08:16:41.134 INFO:teuthology.task.install.deb:Package version is 19.0.0-46-ga2cd52c0-1jammy 2023-12-08T08:16:41.216 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default/ 2023-12-08T08:16:41.217 INFO:teuthology.task.install.deb:Package version is 19.0.0-46-ga2cd52c0-1jammy 2023-12-08T08:16:41.255 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:16:41.255 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-08T08:16:41.281 DEBUG:teuthology.orchestra.run.smithi088:> sudo apt-get update 2023-12-08T08:16:41.394 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:16:41.394 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-08T08:16:41.414 DEBUG:teuthology.orchestra.run.smithi148:> sudo apt-get update 2023-12-08T08:16:41.473 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-08T08:16:41.479 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-12-08T08:16:41.499 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-12-08T08:16:41.577 INFO:teuthology.orchestra.run.smithi088.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy InRelease 2023-12-08T08:16:41.584 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-12-08T08:16:41.613 INFO:teuthology.orchestra.run.smithi088.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-12-08T08:16:41.650 INFO:teuthology.orchestra.run.smithi088.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy Release.gpg 2023-12-08T08:16:41.687 INFO:teuthology.orchestra.run.smithi088.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,405 B] 2023-12-08T08:16:41.714 INFO:teuthology.orchestra.run.smithi148.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy InRelease 2023-12-08T08:16:41.732 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-08T08:16:41.732 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-12-08T08:16:41.734 INFO:teuthology.orchestra.run.smithi088.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-12-08T08:16:41.750 INFO:teuthology.orchestra.run.smithi148.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-12-08T08:16:41.787 INFO:teuthology.orchestra.run.smithi148.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy Release.gpg 2023-12-08T08:16:41.802 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-12-08T08:16:41.824 INFO:teuthology.orchestra.run.smithi148.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-12-08T08:16:41.883 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-12-08T08:16:41.911 INFO:teuthology.orchestra.run.smithi148.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,405 B] 2023-12-08T08:16:42.075 INFO:teuthology.orchestra.run.smithi088.stdout:Fetched 28.5 kB in 1s (49.7 kB/s) 2023-12-08T08:16:42.345 INFO:teuthology.orchestra.run.smithi148.stdout:Fetched 28.5 kB in 1s (40.5 kB/s) 2023-12-08T08:16:43.002 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2023-12-08T08:16:43.017 DEBUG:teuthology.orchestra.run.smithi088:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-46-ga2cd52c0-1jammy cephadm=19.0.0-46-ga2cd52c0-1jammy ceph-mds=19.0.0-46-ga2cd52c0-1jammy ceph-mgr=19.0.0-46-ga2cd52c0-1jammy ceph-common=19.0.0-46-ga2cd52c0-1jammy ceph-fuse=19.0.0-46-ga2cd52c0-1jammy ceph-test=19.0.0-46-ga2cd52c0-1jammy ceph-volume=19.0.0-46-ga2cd52c0-1jammy radosgw=19.0.0-46-ga2cd52c0-1jammy python3-rados=19.0.0-46-ga2cd52c0-1jammy python3-rgw=19.0.0-46-ga2cd52c0-1jammy python3-cephfs=19.0.0-46-ga2cd52c0-1jammy python3-rbd=19.0.0-46-ga2cd52c0-1jammy libcephfs2=19.0.0-46-ga2cd52c0-1jammy libcephfs-dev=19.0.0-46-ga2cd52c0-1jammy librados2=19.0.0-46-ga2cd52c0-1jammy librbd1=19.0.0-46-ga2cd52c0-1jammy rbd-fuse=19.0.0-46-ga2cd52c0-1jammy python3-cephfs=19.0.0-46-ga2cd52c0-1jammy cephfs-shell=19.0.0-46-ga2cd52c0-1jammy cephfs-top=19.0.0-46-ga2cd52c0-1jammy cephfs-mirror=19.0.0-46-ga2cd52c0-1jammy 2023-12-08T08:16:43.092 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2023-12-08T08:16:43.259 INFO:teuthology.orchestra.run.smithi088.stdout:Building dependency tree... 2023-12-08T08:16:43.260 INFO:teuthology.orchestra.run.smithi088.stdout:Reading state information... 2023-12-08T08:16:43.279 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2023-12-08T08:16:43.294 DEBUG:teuthology.orchestra.run.smithi148:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-46-ga2cd52c0-1jammy cephadm=19.0.0-46-ga2cd52c0-1jammy ceph-mds=19.0.0-46-ga2cd52c0-1jammy ceph-mgr=19.0.0-46-ga2cd52c0-1jammy ceph-common=19.0.0-46-ga2cd52c0-1jammy ceph-fuse=19.0.0-46-ga2cd52c0-1jammy ceph-test=19.0.0-46-ga2cd52c0-1jammy ceph-volume=19.0.0-46-ga2cd52c0-1jammy radosgw=19.0.0-46-ga2cd52c0-1jammy python3-rados=19.0.0-46-ga2cd52c0-1jammy python3-rgw=19.0.0-46-ga2cd52c0-1jammy python3-cephfs=19.0.0-46-ga2cd52c0-1jammy python3-rbd=19.0.0-46-ga2cd52c0-1jammy libcephfs2=19.0.0-46-ga2cd52c0-1jammy libcephfs-dev=19.0.0-46-ga2cd52c0-1jammy librados2=19.0.0-46-ga2cd52c0-1jammy librbd1=19.0.0-46-ga2cd52c0-1jammy rbd-fuse=19.0.0-46-ga2cd52c0-1jammy python3-cephfs=19.0.0-46-ga2cd52c0-1jammy cephfs-shell=19.0.0-46-ga2cd52c0-1jammy cephfs-top=19.0.0-46-ga2cd52c0-1jammy cephfs-mirror=19.0.0-46-ga2cd52c0-1jammy 2023-12-08T08:16:43.369 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2023-12-08T08:16:43.410 INFO:teuthology.orchestra.run.smithi088.stdout:The following packages were automatically installed and are no longer required: 2023-12-08T08:16:43.410 INFO:teuthology.orchestra.run.smithi088.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-08T08:16:43.411 INFO:teuthology.orchestra.run.smithi088.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-08T08:16:43.411 INFO:teuthology.orchestra.run.smithi088.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-08T08:16:43.411 INFO:teuthology.orchestra.run.smithi088.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-08T08:16:43.411 INFO:teuthology.orchestra.run.smithi088.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-08T08:16:43.411 INFO:teuthology.orchestra.run.smithi088.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-08T08:16:43.412 INFO:teuthology.orchestra.run.smithi088.stdout:The following additional packages will be installed: 2023-12-08T08:16:43.413 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-08T08:16:43.413 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-12-08T08:16:43.413 INFO:teuthology.orchestra.run.smithi088.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-12-08T08:16:43.413 INFO:teuthology.orchestra.run.smithi088.stdout: libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2023-12-08T08:16:43.413 INFO:teuthology.orchestra.run.smithi088.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2023-12-08T08:16:43.413 INFO:teuthology.orchestra.run.smithi088.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2023-12-08T08:16:43.413 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2023-12-08T08:16:43.413 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common python3-certifi python3-cheroot python3-cherrypy3 2023-12-08T08:16:43.413 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cmd2 python3-colorama python3-google-auth python3-idna 2023-12-08T08:16:43.413 INFO:teuthology.orchestra.run.smithi088.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2023-12-08T08:16:43.413 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2023-12-08T08:16:43.413 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2023-12-08T08:16:43.413 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2023-12-08T08:16:43.414 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2023-12-08T08:16:43.414 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2023-12-08T08:16:43.414 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pyperclip 2023-12-08T08:16:43.414 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytest python3-repoze.lru python3-requests python3-requests-oauthlib 2023-12-08T08:16:43.414 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-08T08:16:43.414 INFO:teuthology.orchestra.run.smithi088.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-12-08T08:16:43.414 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-12-08T08:16:43.414 INFO:teuthology.orchestra.run.smithi088.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-12-08T08:16:43.414 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-12-08T08:16:43.414 INFO:teuthology.orchestra.run.smithi088.stdout: socat xmlstarlet 2023-12-08T08:16:43.415 INFO:teuthology.orchestra.run.smithi088.stdout:Suggested packages: 2023-12-08T08:16:43.415 INFO:teuthology.orchestra.run.smithi088.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-12-08T08:16:43.415 INFO:teuthology.orchestra.run.smithi088.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-12-08T08:16:43.415 INFO:teuthology.orchestra.run.smithi088.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-12-08T08:16:43.415 INFO:teuthology.orchestra.run.smithi088.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-12-08T08:16:43.415 INFO:teuthology.orchestra.run.smithi088.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-12-08T08:16:43.415 INFO:teuthology.orchestra.run.smithi088.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-12-08T08:16:43.415 INFO:teuthology.orchestra.run.smithi088.stdout: python3-watchdog 2023-12-08T08:16:43.415 INFO:teuthology.orchestra.run.smithi088.stdout:Recommended packages: 2023-12-08T08:16:43.415 INFO:teuthology.orchestra.run.smithi088.stdout: btrfs-tools 2023-12-08T08:16:43.544 INFO:teuthology.orchestra.run.smithi148.stdout:Building dependency tree... 2023-12-08T08:16:43.544 INFO:teuthology.orchestra.run.smithi148.stdout:Reading state information... 2023-12-08T08:16:43.557 INFO:teuthology.orchestra.run.smithi088.stdout:The following NEW packages will be installed: 2023-12-08T08:16:43.557 INFO:teuthology.orchestra.run.smithi088.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-12-08T08:16:43.557 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-12-08T08:16:43.557 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-12-08T08:16:43.557 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-12-08T08:16:43.559 INFO:teuthology.orchestra.run.smithi088.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-12-08T08:16:43.559 INFO:teuthology.orchestra.run.smithi088.stdout: libqt5core5a libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 2023-12-08T08:16:43.559 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-12-08T08:16:43.559 INFO:teuthology.orchestra.run.smithi088.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-12-08T08:16:43.559 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-12-08T08:16:43.559 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-certifi 2023-12-08T08:16:43.559 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2023-12-08T08:16:43.559 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2023-12-08T08:16:43.559 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-12-08T08:16:43.559 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-12-08T08:16:43.559 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-12-08T08:16:43.559 INFO:teuthology.orchestra.run.smithi088.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-08T08:16:43.559 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-12-08T08:16:43.560 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-12-08T08:16:43.560 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyperclip python3-pytest python3-rados python3-rbd 2023-12-08T08:16:43.560 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2023-12-08T08:16:43.560 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-08T08:16:43.560 INFO:teuthology.orchestra.run.smithi088.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-12-08T08:16:43.560 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-12-08T08:16:43.560 INFO:teuthology.orchestra.run.smithi088.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-12-08T08:16:43.560 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-12-08T08:16:43.560 INFO:teuthology.orchestra.run.smithi088.stdout: radosgw rbd-fuse socat xmlstarlet 2023-12-08T08:16:43.700 INFO:teuthology.orchestra.run.smithi148.stdout:The following packages were automatically installed and are no longer required: 2023-12-08T08:16:43.701 INFO:teuthology.orchestra.run.smithi148.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-08T08:16:43.701 INFO:teuthology.orchestra.run.smithi148.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-08T08:16:43.701 INFO:teuthology.orchestra.run.smithi148.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-08T08:16:43.701 INFO:teuthology.orchestra.run.smithi148.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-08T08:16:43.701 INFO:teuthology.orchestra.run.smithi148.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-08T08:16:43.701 INFO:teuthology.orchestra.run.smithi148.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-08T08:16:43.702 INFO:teuthology.orchestra.run.smithi148.stdout:The following additional packages will be installed: 2023-12-08T08:16:43.702 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-08T08:16:43.702 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-12-08T08:16:43.702 INFO:teuthology.orchestra.run.smithi148.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-12-08T08:16:43.702 INFO:teuthology.orchestra.run.smithi148.stdout: libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2023-12-08T08:16:43.703 INFO:teuthology.orchestra.run.smithi148.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2023-12-08T08:16:43.704 INFO:teuthology.orchestra.run.smithi148.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2023-12-08T08:16:43.704 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2023-12-08T08:16:43.704 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common python3-certifi python3-cheroot python3-cherrypy3 2023-12-08T08:16:43.704 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cmd2 python3-colorama python3-google-auth python3-idna 2023-12-08T08:16:43.704 INFO:teuthology.orchestra.run.smithi148.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2023-12-08T08:16:43.704 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2023-12-08T08:16:43.704 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2023-12-08T08:16:43.704 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2023-12-08T08:16:43.704 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2023-12-08T08:16:43.704 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2023-12-08T08:16:43.704 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pyperclip 2023-12-08T08:16:43.704 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytest python3-repoze.lru python3-requests python3-requests-oauthlib 2023-12-08T08:16:43.704 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-08T08:16:43.704 INFO:teuthology.orchestra.run.smithi148.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-12-08T08:16:43.704 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-12-08T08:16:43.705 INFO:teuthology.orchestra.run.smithi148.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-12-08T08:16:43.705 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-12-08T08:16:43.705 INFO:teuthology.orchestra.run.smithi148.stdout: socat xmlstarlet 2023-12-08T08:16:43.705 INFO:teuthology.orchestra.run.smithi148.stdout:Suggested packages: 2023-12-08T08:16:43.705 INFO:teuthology.orchestra.run.smithi148.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-12-08T08:16:43.705 INFO:teuthology.orchestra.run.smithi148.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-12-08T08:16:43.705 INFO:teuthology.orchestra.run.smithi148.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-12-08T08:16:43.705 INFO:teuthology.orchestra.run.smithi148.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-12-08T08:16:43.705 INFO:teuthology.orchestra.run.smithi148.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-12-08T08:16:43.705 INFO:teuthology.orchestra.run.smithi148.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-12-08T08:16:43.705 INFO:teuthology.orchestra.run.smithi148.stdout: python3-watchdog 2023-12-08T08:16:43.706 INFO:teuthology.orchestra.run.smithi148.stdout:Recommended packages: 2023-12-08T08:16:43.706 INFO:teuthology.orchestra.run.smithi148.stdout: btrfs-tools 2023-12-08T08:16:43.706 INFO:teuthology.orchestra.run.smithi088.stdout:0 upgraded, 114 newly installed, 0 to remove and 266 not upgraded. 2023-12-08T08:16:43.706 INFO:teuthology.orchestra.run.smithi088.stdout:Need to get 186 MB of archives. 2023-12-08T08:16:43.706 INFO:teuthology.orchestra.run.smithi088.stdout:After this operation, 829 MB of additional disk space will be used. 2023-12-08T08:16:43.707 INFO:teuthology.orchestra.run.smithi088.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-46-ga2cd52c0-1jammy [3,466 kB] 2023-12-08T08:16:43.754 INFO:teuthology.orchestra.run.smithi088.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-12-08T08:16:43.837 INFO:teuthology.orchestra.run.smithi088.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-12-08T08:16:43.848 INFO:teuthology.orchestra.run.smithi148.stdout:The following NEW packages will be installed: 2023-12-08T08:16:43.848 INFO:teuthology.orchestra.run.smithi148.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-12-08T08:16:43.848 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-12-08T08:16:43.848 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-12-08T08:16:43.848 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-12-08T08:16:43.849 INFO:teuthology.orchestra.run.smithi148.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-12-08T08:16:43.849 INFO:teuthology.orchestra.run.smithi148.stdout: libqt5core5a libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 2023-12-08T08:16:43.849 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-12-08T08:16:43.849 INFO:teuthology.orchestra.run.smithi148.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-12-08T08:16:43.850 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-12-08T08:16:43.850 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-certifi 2023-12-08T08:16:43.850 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2023-12-08T08:16:43.850 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2023-12-08T08:16:43.850 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-12-08T08:16:43.850 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-12-08T08:16:43.850 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-12-08T08:16:43.850 INFO:teuthology.orchestra.run.smithi148.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-08T08:16:43.850 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-12-08T08:16:43.850 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-12-08T08:16:43.850 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyperclip python3-pytest python3-rados python3-rbd 2023-12-08T08:16:43.850 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2023-12-08T08:16:43.850 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-12-08T08:16:43.850 INFO:teuthology.orchestra.run.smithi148.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-12-08T08:16:43.851 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-12-08T08:16:43.851 INFO:teuthology.orchestra.run.smithi148.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-12-08T08:16:43.851 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-12-08T08:16:43.851 INFO:teuthology.orchestra.run.smithi148.stdout: radosgw rbd-fuse socat xmlstarlet 2023-12-08T08:16:43.882 INFO:teuthology.orchestra.run.smithi088.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-12-08T08:16:43.934 INFO:teuthology.orchestra.run.smithi088.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-46-ga2cd52c0-1jammy [3,111 kB] 2023-12-08T08:16:44.028 INFO:teuthology.orchestra.run.smithi088.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-46-ga2cd52c0-1jammy [688 kB] 2023-12-08T08:16:44.045 INFO:teuthology.orchestra.run.smithi148.stdout:0 upgraded, 114 newly installed, 0 to remove and 266 not upgraded. 2023-12-08T08:16:44.046 INFO:teuthology.orchestra.run.smithi148.stdout:Need to get 186 MB of archives. 2023-12-08T08:16:44.046 INFO:teuthology.orchestra.run.smithi148.stdout:After this operation, 829 MB of additional disk space will be used. 2023-12-08T08:16:44.046 INFO:teuthology.orchestra.run.smithi148.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-12-08T08:16:44.050 INFO:teuthology.orchestra.run.smithi088.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-46-ga2cd52c0-1jammy [356 kB] 2023-12-08T08:16:44.061 INFO:teuthology.orchestra.run.smithi088.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-46-ga2cd52c0-1jammy [32.8 kB] 2023-12-08T08:16:44.062 INFO:teuthology.orchestra.run.smithi088.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-46-ga2cd52c0-1jammy [180 kB] 2023-12-08T08:16:44.068 INFO:teuthology.orchestra.run.smithi088.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-46-ga2cd52c0-1jammy [63.5 kB] 2023-12-08T08:16:44.071 INFO:teuthology.orchestra.run.smithi088.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-46-ga2cd52c0-1jammy [330 kB] 2023-12-08T08:16:44.081 INFO:teuthology.orchestra.run.smithi088.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-46-ga2cd52c0-1jammy [6,205 kB] 2023-12-08T08:16:44.084 INFO:teuthology.orchestra.run.smithi088.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-12-08T08:16:44.128 INFO:teuthology.orchestra.run.smithi148.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-12-08T08:16:44.174 INFO:teuthology.orchestra.run.smithi148.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-12-08T08:16:44.178 INFO:teuthology.orchestra.run.smithi088.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-12-08T08:16:44.191 INFO:teuthology.orchestra.run.smithi088.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-12-08T08:16:44.199 INFO:teuthology.orchestra.run.smithi148.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-46-ga2cd52c0-1jammy [3,466 kB] 2023-12-08T08:16:44.243 INFO:teuthology.orchestra.run.smithi088.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-12-08T08:16:44.290 INFO:teuthology.orchestra.run.smithi088.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-46-ga2cd52c0-1jammy [112 kB] 2023-12-08T08:16:44.291 INFO:teuthology.orchestra.run.smithi088.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-46-ga2cd52c0-1jammy [439 kB] 2023-12-08T08:16:44.305 INFO:teuthology.orchestra.run.smithi088.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-46-ga2cd52c0-1jammy [22.5 MB] 2023-12-08T08:16:44.376 INFO:teuthology.orchestra.run.smithi148.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-12-08T08:16:44.417 INFO:teuthology.orchestra.run.smithi088.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-12-08T08:16:44.426 INFO:teuthology.orchestra.run.smithi088.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-12-08T08:16:44.454 INFO:teuthology.orchestra.run.smithi088.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-12-08T08:16:44.462 INFO:teuthology.orchestra.run.smithi088.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-12-08T08:16:44.469 INFO:teuthology.orchestra.run.smithi148.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-12-08T08:16:44.482 INFO:teuthology.orchestra.run.smithi148.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-12-08T08:16:44.534 INFO:teuthology.orchestra.run.smithi148.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-12-08T08:16:44.626 INFO:teuthology.orchestra.run.smithi088.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-12-08T08:16:44.708 INFO:teuthology.orchestra.run.smithi148.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-12-08T08:16:44.717 INFO:teuthology.orchestra.run.smithi148.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-12-08T08:16:44.745 INFO:teuthology.orchestra.run.smithi148.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-12-08T08:16:44.754 INFO:teuthology.orchestra.run.smithi148.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-12-08T08:16:44.917 INFO:teuthology.orchestra.run.smithi148.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-12-08T08:16:45.078 INFO:teuthology.orchestra.run.smithi088.stdout:Get:25 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-46-ga2cd52c0-1jammy [6,901 kB] 2023-12-08T08:16:45.209 INFO:teuthology.orchestra.run.smithi088.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-12-08T08:16:45.213 INFO:teuthology.orchestra.run.smithi088.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-12-08T08:16:45.213 INFO:teuthology.orchestra.run.smithi088.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-12-08T08:16:45.220 INFO:teuthology.orchestra.run.smithi088.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-12-08T08:16:45.220 INFO:teuthology.orchestra.run.smithi088.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-12-08T08:16:45.221 INFO:teuthology.orchestra.run.smithi088.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-12-08T08:16:45.222 INFO:teuthology.orchestra.run.smithi088.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-12-08T08:16:45.223 INFO:teuthology.orchestra.run.smithi088.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-12-08T08:16:45.224 INFO:teuthology.orchestra.run.smithi088.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-12-08T08:16:45.290 INFO:teuthology.orchestra.run.smithi088.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-12-08T08:16:45.310 INFO:teuthology.orchestra.run.smithi088.stdout:Get:36 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-46-ga2cd52c0-1jammy [238 kB] 2023-12-08T08:16:45.315 INFO:teuthology.orchestra.run.smithi088.stdout:Get:37 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-46-ga2cd52c0-1jammy [124 kB] 2023-12-08T08:16:45.319 INFO:teuthology.orchestra.run.smithi088.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-46-ga2cd52c0-1jammy [1,496 kB] 2023-12-08T08:16:45.371 INFO:teuthology.orchestra.run.smithi088.stdout:Get:39 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-46-ga2cd52c0-1jammy [9,953 kB] 2023-12-08T08:16:45.473 INFO:teuthology.orchestra.run.smithi088.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-12-08T08:16:45.499 INFO:teuthology.orchestra.run.smithi148.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-12-08T08:16:45.502 INFO:teuthology.orchestra.run.smithi148.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-12-08T08:16:45.502 INFO:teuthology.orchestra.run.smithi148.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-12-08T08:16:45.509 INFO:teuthology.orchestra.run.smithi148.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-12-08T08:16:45.510 INFO:teuthology.orchestra.run.smithi148.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-12-08T08:16:45.511 INFO:teuthology.orchestra.run.smithi148.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-12-08T08:16:45.511 INFO:teuthology.orchestra.run.smithi148.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-12-08T08:16:45.513 INFO:teuthology.orchestra.run.smithi148.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-12-08T08:16:45.514 INFO:teuthology.orchestra.run.smithi148.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-12-08T08:16:45.579 INFO:teuthology.orchestra.run.smithi148.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-12-08T08:16:45.683 INFO:teuthology.orchestra.run.smithi088.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-12-08T08:16:45.717 INFO:teuthology.orchestra.run.smithi088.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-12-08T08:16:45.719 INFO:teuthology.orchestra.run.smithi088.stdout:Get:43 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-46-ga2cd52c0-1jammy [31.9 MB] 2023-12-08T08:16:45.762 INFO:teuthology.orchestra.run.smithi148.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-12-08T08:16:45.764 INFO:teuthology.orchestra.run.smithi088.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-12-08T08:16:45.862 INFO:teuthology.orchestra.run.smithi088.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-08T08:16:45.872 INFO:teuthology.orchestra.run.smithi088.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-12-08T08:16:45.880 INFO:teuthology.orchestra.run.smithi088.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-12-08T08:16:45.948 INFO:teuthology.orchestra.run.smithi088.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-12-08T08:16:45.971 INFO:teuthology.orchestra.run.smithi088.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-12-08T08:16:45.976 INFO:teuthology.orchestra.run.smithi148.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-12-08T08:16:45.977 INFO:teuthology.orchestra.run.smithi088.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-12-08T08:16:46.012 INFO:teuthology.orchestra.run.smithi148.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-12-08T08:16:46.058 INFO:teuthology.orchestra.run.smithi148.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-12-08T08:16:46.095 INFO:teuthology.orchestra.run.smithi088.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-12-08T08:16:46.155 INFO:teuthology.orchestra.run.smithi148.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-08T08:16:46.165 INFO:teuthology.orchestra.run.smithi148.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-12-08T08:16:46.172 INFO:teuthology.orchestra.run.smithi148.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-12-08T08:16:46.240 INFO:teuthology.orchestra.run.smithi148.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-12-08T08:16:46.259 INFO:teuthology.orchestra.run.smithi088.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-12-08T08:16:46.263 INFO:teuthology.orchestra.run.smithi148.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-12-08T08:16:46.270 INFO:teuthology.orchestra.run.smithi148.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-12-08T08:16:46.390 INFO:teuthology.orchestra.run.smithi148.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-12-08T08:16:46.456 INFO:teuthology.orchestra.run.smithi088.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-12-08T08:16:46.511 INFO:teuthology.orchestra.run.smithi088.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-12-08T08:16:46.550 INFO:teuthology.orchestra.run.smithi148.stdout:Get:35 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-46-ga2cd52c0-1jammy [3,111 kB] 2023-12-08T08:16:46.552 INFO:teuthology.orchestra.run.smithi148.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-12-08T08:16:46.670 INFO:teuthology.orchestra.run.smithi088.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-12-08T08:16:46.743 INFO:teuthology.orchestra.run.smithi148.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-12-08T08:16:46.772 INFO:teuthology.orchestra.run.smithi088.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-12-08T08:16:46.791 INFO:teuthology.orchestra.run.smithi088.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-12-08T08:16:46.796 INFO:teuthology.orchestra.run.smithi148.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-12-08T08:16:46.822 INFO:teuthology.orchestra.run.smithi088.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-12-08T08:16:46.836 INFO:teuthology.orchestra.run.smithi088.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-12-08T08:16:46.859 INFO:teuthology.orchestra.run.smithi088.stdout:Get:60 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-46-ga2cd52c0-1jammy [14.0 kB] 2023-12-08T08:16:46.860 INFO:teuthology.orchestra.run.smithi088.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-46-ga2cd52c0-1jammy [839 kB] 2023-12-08T08:16:46.876 INFO:teuthology.orchestra.run.smithi088.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-12-08T08:16:46.880 INFO:teuthology.orchestra.run.smithi088.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-46-ga2cd52c0-1jammy [2,145 kB] 2023-12-08T08:16:46.882 INFO:teuthology.orchestra.run.smithi088.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-12-08T08:16:46.889 INFO:teuthology.orchestra.run.smithi088.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-12-08T08:16:46.956 INFO:teuthology.orchestra.run.smithi088.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-46-ga2cd52c0-1jammy [828 kB] 2023-12-08T08:16:46.957 INFO:teuthology.orchestra.run.smithi148.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-12-08T08:16:46.992 INFO:teuthology.orchestra.run.smithi088.stdout:Get:67 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-46-ga2cd52c0-1jammy [139 kB] 2023-12-08T08:16:46.996 INFO:teuthology.orchestra.run.smithi088.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-46-ga2cd52c0-1jammy [1,904 kB] 2023-12-08T08:16:47.058 INFO:teuthology.orchestra.run.smithi148.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-12-08T08:16:47.065 INFO:teuthology.orchestra.run.smithi088.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-46-ga2cd52c0-1jammy [8,625 kB] 2023-12-08T08:16:47.077 INFO:teuthology.orchestra.run.smithi148.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-12-08T08:16:47.078 INFO:teuthology.orchestra.run.smithi088.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-12-08T08:16:47.109 INFO:teuthology.orchestra.run.smithi148.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-12-08T08:16:47.123 INFO:teuthology.orchestra.run.smithi148.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-12-08T08:16:47.163 INFO:teuthology.orchestra.run.smithi148.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-12-08T08:16:47.169 INFO:teuthology.orchestra.run.smithi148.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-12-08T08:16:47.176 INFO:teuthology.orchestra.run.smithi148.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-12-08T08:16:47.365 INFO:teuthology.orchestra.run.smithi148.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-12-08T08:16:47.399 INFO:teuthology.orchestra.run.smithi088.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-46-ga2cd52c0-1jammy [14.2 kB] 2023-12-08T08:16:47.400 INFO:teuthology.orchestra.run.smithi088.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-46-ga2cd52c0-1jammy [48.7 MB] 2023-12-08T08:16:47.405 INFO:teuthology.orchestra.run.smithi148.stdout:Get:48 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-46-ga2cd52c0-1jammy [688 kB] 2023-12-08T08:16:47.541 INFO:teuthology.orchestra.run.smithi148.stdout:Get:49 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-46-ga2cd52c0-1jammy [356 kB] 2023-12-08T08:16:47.611 INFO:teuthology.orchestra.run.smithi148.stdout:Get:50 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-46-ga2cd52c0-1jammy [32.8 kB] 2023-12-08T08:16:47.614 INFO:teuthology.orchestra.run.smithi148.stdout:Get:51 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-46-ga2cd52c0-1jammy [180 kB] 2023-12-08T08:16:47.637 INFO:teuthology.orchestra.run.smithi148.stdout:Get:52 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-46-ga2cd52c0-1jammy [63.5 kB] 2023-12-08T08:16:47.645 INFO:teuthology.orchestra.run.smithi148.stdout:Get:53 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-46-ga2cd52c0-1jammy [330 kB] 2023-12-08T08:16:47.707 INFO:teuthology.orchestra.run.smithi148.stdout:Get:54 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-46-ga2cd52c0-1jammy [6,205 kB] 2023-12-08T08:16:47.906 INFO:teuthology.orchestra.run.smithi088.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-12-08T08:16:47.907 INFO:teuthology.orchestra.run.smithi088.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-12-08T08:16:47.908 INFO:teuthology.orchestra.run.smithi088.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-08T08:16:47.908 INFO:teuthology.orchestra.run.smithi088.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-12-08T08:16:47.909 INFO:teuthology.orchestra.run.smithi088.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-12-08T08:16:47.934 INFO:teuthology.orchestra.run.smithi088.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-12-08T08:16:47.936 INFO:teuthology.orchestra.run.smithi088.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-12-08T08:16:47.936 INFO:teuthology.orchestra.run.smithi088.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-12-08T08:16:48.008 INFO:teuthology.orchestra.run.smithi088.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-12-08T08:16:48.008 INFO:teuthology.orchestra.run.smithi088.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-12-08T08:16:48.173 INFO:teuthology.orchestra.run.smithi088.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-12-08T08:16:48.193 INFO:teuthology.orchestra.run.smithi148.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-12-08T08:16:48.194 INFO:teuthology.orchestra.run.smithi148.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-12-08T08:16:48.195 INFO:teuthology.orchestra.run.smithi148.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-08T08:16:48.196 INFO:teuthology.orchestra.run.smithi148.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-12-08T08:16:48.197 INFO:teuthology.orchestra.run.smithi148.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-12-08T08:16:48.220 INFO:teuthology.orchestra.run.smithi148.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-12-08T08:16:48.223 INFO:teuthology.orchestra.run.smithi148.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-12-08T08:16:48.223 INFO:teuthology.orchestra.run.smithi148.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-12-08T08:16:48.293 INFO:teuthology.orchestra.run.smithi148.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-12-08T08:16:48.294 INFO:teuthology.orchestra.run.smithi148.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-12-08T08:16:48.379 INFO:teuthology.orchestra.run.smithi088.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-12-08T08:16:48.434 INFO:teuthology.orchestra.run.smithi088.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-12-08T08:16:48.458 INFO:teuthology.orchestra.run.smithi148.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-12-08T08:16:48.522 INFO:teuthology.orchestra.run.smithi088.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-12-08T08:16:48.550 INFO:teuthology.orchestra.run.smithi088.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-12-08T08:16:48.563 INFO:teuthology.orchestra.run.smithi148.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-46-ga2cd52c0-1jammy [112 kB] 2023-12-08T08:16:48.573 INFO:teuthology.orchestra.run.smithi148.stdout:Get:67 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-46-ga2cd52c0-1jammy [439 kB] 2023-12-08T08:16:48.581 INFO:teuthology.orchestra.run.smithi088.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-12-08T08:16:48.625 INFO:teuthology.orchestra.run.smithi148.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-46-ga2cd52c0-1jammy [22.5 MB] 2023-12-08T08:16:48.653 INFO:teuthology.orchestra.run.smithi148.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-12-08T08:16:48.700 INFO:teuthology.orchestra.run.smithi148.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-12-08T08:16:48.742 INFO:teuthology.orchestra.run.smithi088.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-12-08T08:16:48.779 INFO:teuthology.orchestra.run.smithi088.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-12-08T08:16:48.800 INFO:teuthology.orchestra.run.smithi088.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-12-08T08:16:48.807 INFO:teuthology.orchestra.run.smithi088.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-12-08T08:16:48.816 INFO:teuthology.orchestra.run.smithi148.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-12-08T08:16:48.836 INFO:teuthology.orchestra.run.smithi148.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-12-08T08:16:48.848 INFO:teuthology.orchestra.run.smithi088.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-12-08T08:16:48.867 INFO:teuthology.orchestra.run.smithi148.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-12-08T08:16:49.035 INFO:teuthology.orchestra.run.smithi148.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-12-08T08:16:49.035 INFO:teuthology.orchestra.run.smithi088.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-12-08T08:16:49.073 INFO:teuthology.orchestra.run.smithi148.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-12-08T08:16:49.094 INFO:teuthology.orchestra.run.smithi148.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-12-08T08:16:49.102 INFO:teuthology.orchestra.run.smithi148.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-12-08T08:16:49.142 INFO:teuthology.orchestra.run.smithi148.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-12-08T08:16:49.218 INFO:teuthology.orchestra.run.smithi088.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-12-08T08:16:49.330 INFO:teuthology.orchestra.run.smithi148.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-12-08T08:16:49.518 INFO:teuthology.orchestra.run.smithi148.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-12-08T08:16:49.601 INFO:teuthology.orchestra.run.smithi088.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-12-08T08:16:49.662 INFO:teuthology.orchestra.run.smithi088.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-12-08T08:16:49.663 INFO:teuthology.orchestra.run.smithi088.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-08T08:16:49.670 INFO:teuthology.orchestra.run.smithi088.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-12-08T08:16:49.672 INFO:teuthology.orchestra.run.smithi088.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-12-08T08:16:49.678 INFO:teuthology.orchestra.run.smithi088.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-46-ga2cd52c0-1jammy [120 kB] 2023-12-08T08:16:49.679 INFO:teuthology.orchestra.run.smithi088.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-46-ga2cd52c0-1jammy [226 kB] 2023-12-08T08:16:49.685 INFO:teuthology.orchestra.run.smithi088.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-46-ga2cd52c0-1jammy [34.0 kB] 2023-12-08T08:16:49.687 INFO:teuthology.orchestra.run.smithi088.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-46-ga2cd52c0-1jammy [23.4 kB] 2023-12-08T08:16:49.690 INFO:teuthology.orchestra.run.smithi088.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-46-ga2cd52c0-1jammy [38.3 kB] 2023-12-08T08:16:49.691 INFO:teuthology.orchestra.run.smithi088.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-12-08T08:16:49.692 INFO:teuthology.orchestra.run.smithi088.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-46-ga2cd52c0-1jammy [12.3 MB] 2023-12-08T08:16:49.699 INFO:teuthology.orchestra.run.smithi088.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-12-08T08:16:49.761 INFO:teuthology.orchestra.run.smithi088.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-12-08T08:16:49.762 INFO:teuthology.orchestra.run.smithi088.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-12-08T08:16:49.904 INFO:teuthology.orchestra.run.smithi148.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-12-08T08:16:49.927 INFO:teuthology.orchestra.run.smithi088.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-12-08T08:16:49.965 INFO:teuthology.orchestra.run.smithi148.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-12-08T08:16:49.965 INFO:teuthology.orchestra.run.smithi148.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-08T08:16:49.973 INFO:teuthology.orchestra.run.smithi148.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-12-08T08:16:49.975 INFO:teuthology.orchestra.run.smithi148.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-12-08T08:16:49.995 INFO:teuthology.orchestra.run.smithi148.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-12-08T08:16:50.003 INFO:teuthology.orchestra.run.smithi148.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-12-08T08:16:50.065 INFO:teuthology.orchestra.run.smithi148.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-12-08T08:16:50.066 INFO:teuthology.orchestra.run.smithi148.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-12-08T08:16:50.231 INFO:teuthology.orchestra.run.smithi148.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-12-08T08:16:50.368 INFO:teuthology.orchestra.run.smithi148.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-46-ga2cd52c0-1jammy [6,901 kB] 2023-12-08T08:16:50.381 INFO:teuthology.orchestra.run.smithi088.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-12-08T08:16:50.396 INFO:teuthology.orchestra.run.smithi088.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-12-08T08:16:50.506 INFO:teuthology.orchestra.run.smithi088.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-46-ga2cd52c0-1jammy [91.3 kB] 2023-12-08T08:16:50.669 INFO:teuthology.orchestra.run.smithi148.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-46-ga2cd52c0-1jammy [238 kB] 2023-12-08T08:16:50.674 INFO:teuthology.orchestra.run.smithi148.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-46-ga2cd52c0-1jammy [124 kB] 2023-12-08T08:16:50.679 INFO:teuthology.orchestra.run.smithi148.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-46-ga2cd52c0-1jammy [1,496 kB] 2023-12-08T08:16:50.682 INFO:teuthology.orchestra.run.smithi148.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-12-08T08:16:50.697 INFO:teuthology.orchestra.run.smithi148.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-12-08T08:16:50.728 INFO:teuthology.orchestra.run.smithi148.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-46-ga2cd52c0-1jammy [9,953 kB] 2023-12-08T08:16:51.057 INFO:teuthology.orchestra.run.smithi148.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-46-ga2cd52c0-1jammy [31.9 MB] 2023-12-08T08:16:51.261 INFO:teuthology.orchestra.run.smithi088.stdout:Fetched 186 MB in 7s (26.1 MB/s) 2023-12-08T08:16:51.405 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-08T08:16:51.474 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-12-08T08:16:51.477 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-12-08T08:16:51.521 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-12-08T08:16:51.823 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-08T08:16:51.837 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-12-08T08:16:51.873 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-08T08:16:52.110 INFO:teuthology.orchestra.run.smithi148.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-46-ga2cd52c0-1jammy [14.0 kB] 2023-12-08T08:16:52.111 INFO:teuthology.orchestra.run.smithi148.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-46-ga2cd52c0-1jammy [839 kB] 2023-12-08T08:16:52.128 INFO:teuthology.orchestra.run.smithi148.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-46-ga2cd52c0-1jammy [2,145 kB] 2023-12-08T08:16:52.193 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cmd2. 2023-12-08T08:16:52.201 INFO:teuthology.orchestra.run.smithi148.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-46-ga2cd52c0-1jammy [828 kB] 2023-12-08T08:16:52.206 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-12-08T08:16:52.225 INFO:teuthology.orchestra.run.smithi148.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-46-ga2cd52c0-1jammy [139 kB] 2023-12-08T08:16:52.230 INFO:teuthology.orchestra.run.smithi148.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-46-ga2cd52c0-1jammy [1,904 kB] 2023-12-08T08:16:52.243 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-12-08T08:16:52.292 INFO:teuthology.orchestra.run.smithi148.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-46-ga2cd52c0-1jammy [8,625 kB] 2023-12-08T08:16:52.554 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-12-08T08:16:52.568 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-12-08T08:16:52.578 INFO:teuthology.orchestra.run.smithi148.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-46-ga2cd52c0-1jammy [14.2 kB] 2023-12-08T08:16:52.579 INFO:teuthology.orchestra.run.smithi148.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-46-ga2cd52c0-1jammy [48.7 MB] 2023-12-08T08:16:52.638 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-08T08:16:52.991 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-08T08:16:53.006 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-12-08T08:16:53.041 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-08T08:16:53.411 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-08T08:16:53.426 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-12-08T08:16:53.469 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-08T08:16:53.906 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-08T08:16:53.921 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-08T08:16:53.973 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-08T08:16:54.192 INFO:teuthology.orchestra.run.smithi148.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-46-ga2cd52c0-1jammy [120 kB] 2023-12-08T08:16:54.193 INFO:teuthology.orchestra.run.smithi148.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-46-ga2cd52c0-1jammy [226 kB] 2023-12-08T08:16:54.195 INFO:teuthology.orchestra.run.smithi148.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-46-ga2cd52c0-1jammy [34.0 kB] 2023-12-08T08:16:54.196 INFO:teuthology.orchestra.run.smithi148.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-46-ga2cd52c0-1jammy [23.4 kB] 2023-12-08T08:16:54.196 INFO:teuthology.orchestra.run.smithi148.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-46-ga2cd52c0-1jammy [38.3 kB] 2023-12-08T08:16:54.197 INFO:teuthology.orchestra.run.smithi148.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-46-ga2cd52c0-1jammy [12.3 MB] 2023-12-08T08:16:54.359 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-08T08:16:54.373 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-08T08:16:54.417 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-08T08:16:54.613 INFO:teuthology.orchestra.run.smithi148.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-46-ga2cd52c0-1jammy [91.3 kB] 2023-12-08T08:16:54.745 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-08T08:16:54.760 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-08T08:16:54.804 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-08T08:16:55.165 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-12-08T08:16:55.180 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-12-08T08:16:55.183 INFO:teuthology.orchestra.run.smithi148.stdout:Fetched 186 MB in 11s (17.3 MB/s) 2023-12-08T08:16:55.224 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-08T08:16:55.347 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-08T08:16:55.417 INFO:teuthology.orchestra.run.smithi148.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-12-08T08:16:55.420 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-12-08T08:16:55.471 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-12-08T08:16:55.493 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package librados2. 2023-12-08T08:16:55.507 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../010-librados2_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:16:55.543 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking librados2 (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:16:55.970 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package librbd1. 2023-12-08T08:16:55.984 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../011-librbd1_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:16:56.007 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-08T08:16:56.020 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-12-08T08:16:56.029 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking librbd1 (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:16:56.065 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-08T08:16:56.393 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-cmd2. 2023-12-08T08:16:56.407 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-12-08T08:16:56.443 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-12-08T08:16:56.640 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libcephfs2. 2023-12-08T08:16:56.654 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:16:56.698 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libcephfs2 (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:16:56.796 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-12-08T08:16:56.811 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-12-08T08:16:56.913 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-08T08:16:56.967 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-rados. 2023-12-08T08:16:56.981 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../013-python3-rados_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:16:57.025 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-rados (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:16:57.233 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-08T08:16:57.248 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-12-08T08:16:57.291 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-08T08:16:57.345 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-08T08:16:57.359 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-46-ga2cd52c0-1jammy_all.deb ... 2023-12-08T08:16:57.403 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-ceph-argparse (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:16:57.636 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-08T08:16:57.651 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-12-08T08:16:57.656 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cephfs. 2023-12-08T08:16:57.670 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:16:57.694 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-08T08:16:57.714 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cephfs (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:16:57.992 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-08T08:16:58.007 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-46-ga2cd52c0-1jammy_all.deb ... 2023-12-08T08:16:58.042 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-ceph-common (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:16:58.164 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-08T08:16:58.179 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-08T08:16:58.231 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-08T08:16:58.354 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-prettytable. 2023-12-08T08:16:58.370 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-12-08T08:16:58.403 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-12-08T08:16:58.665 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-rbd. 2023-12-08T08:16:58.667 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-08T08:16:58.680 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:16:58.682 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-08T08:16:58.717 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-08T08:16:58.722 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-rbd (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:16:59.067 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-08T08:16:59.078 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-08T08:16:59.082 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-12-08T08:16:59.093 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-08T08:16:59.137 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-08T08:16:59.142 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-08T08:16:59.414 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package librgw2. 2023-12-08T08:16:59.428 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../020-librgw2_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:16:59.472 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking librgw2 (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:16:59.523 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-12-08T08:16:59.538 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-12-08T08:16:59.581 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-08T08:16:59.926 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package librados2. 2023-12-08T08:16:59.932 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-rgw. 2023-12-08T08:16:59.941 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../010-librados2_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:16:59.946 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../021-python3-rgw_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:16:59.984 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking librados2 (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:16:59.991 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-rgw (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:00.360 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package liboath0:amd64. 2023-12-08T08:17:00.370 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package librbd1. 2023-12-08T08:17:00.375 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../022-liboath0_2.6.7-3build1_amd64.deb ... 2023-12-08T08:17:00.384 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../011-librbd1_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:00.418 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-12-08T08:17:00.462 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking librbd1 (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:00.738 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libradosstriper1. 2023-12-08T08:17:00.753 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../023-libradosstriper1_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:00.788 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libradosstriper1 (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:01.140 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libcephfs2. 2023-12-08T08:17:01.154 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:01.198 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libcephfs2 (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:01.208 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-common. 2023-12-08T08:17:01.222 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../024-ceph-common_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:01.266 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-common (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:01.518 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-rados. 2023-12-08T08:17:01.533 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../013-python3-rados_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:01.576 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-rados (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:01.904 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-08T08:17:01.919 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-46-ga2cd52c0-1jammy_all.deb ... 2023-12-08T08:17:01.954 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-ceph-argparse (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:02.198 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-cephfs. 2023-12-08T08:17:02.212 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:02.256 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-cephfs (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:02.314 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-base. 2023-12-08T08:17:02.328 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../025-ceph-base_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:02.373 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-base (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:02.600 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-08T08:17:02.615 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-46-ga2cd52c0-1jammy_all.deb ... 2023-12-08T08:17:02.658 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-ceph-common (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:02.993 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-12-08T08:17:03.006 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../026-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-12-08T08:17:03.028 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-prettytable. 2023-12-08T08:17:03.043 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-12-08T08:17:03.051 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-12-08T08:17:03.087 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-12-08T08:17:03.348 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-rbd. 2023-12-08T08:17:03.362 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:03.386 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cheroot. 2023-12-08T08:17:03.400 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../027-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-12-08T08:17:03.405 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-rbd (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:03.445 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-08T08:17:03.750 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-08T08:17:03.765 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-12-08T08:17:03.773 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-12-08T08:17:03.787 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../028-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-12-08T08:17:03.808 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-08T08:17:03.831 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-12-08T08:17:04.136 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package librgw2. 2023-12-08T08:17:04.151 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../020-librgw2_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:04.159 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-jaraco.text. 2023-12-08T08:17:04.174 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../029-python3-jaraco.text_3.6.0-2_all.deb ... 2023-12-08T08:17:04.195 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking librgw2 (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:04.217 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-12-08T08:17:04.453 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-12-08T08:17:04.468 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../030-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-12-08T08:17:04.503 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-12-08T08:17:04.680 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-rgw. 2023-12-08T08:17:04.695 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../021-python3-rgw_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:04.739 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-rgw (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:04.806 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-tempora. 2023-12-08T08:17:04.821 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../031-python3-tempora_4.1.2-1_all.deb ... 2023-12-08T08:17:04.864 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-12-08T08:17:05.085 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package liboath0:amd64. 2023-12-08T08:17:05.099 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../022-liboath0_2.6.7-3build1_amd64.deb ... 2023-12-08T08:17:05.141 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-12-08T08:17:05.175 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-portend. 2023-12-08T08:17:05.190 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../032-python3-portend_3.0.0-1_all.deb ... 2023-12-08T08:17:05.233 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-12-08T08:17:05.411 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libradosstriper1. 2023-12-08T08:17:05.426 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../023-libradosstriper1_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:05.469 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libradosstriper1 (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:05.511 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-12-08T08:17:05.526 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../033-python3-zc.lockfile_2.0-1_all.deb ... 2023-12-08T08:17:05.561 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-12-08T08:17:05.856 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-08T08:17:05.870 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../034-python3-cherrypy3_18.6.1-4_all.deb ... 2023-12-08T08:17:05.914 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-12-08T08:17:06.122 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-common. 2023-12-08T08:17:06.137 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../024-ceph-common_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:06.181 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-common (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:06.278 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-natsort. 2023-12-08T08:17:06.290 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../035-python3-natsort_8.0.2-1_all.deb ... 2023-12-08T08:17:06.334 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-12-08T08:17:06.645 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-logutils. 2023-12-08T08:17:06.660 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-8_all.deb ... 2023-12-08T08:17:06.703 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-12-08T08:17:07.065 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-08T08:17:07.079 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../037-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-12-08T08:17:07.148 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-12-08T08:17:07.396 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-base. 2023-12-08T08:17:07.411 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../025-ceph-base_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:07.450 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-mako. 2023-12-08T08:17:07.465 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../038-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-12-08T08:17:07.472 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-base (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:07.509 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-08T08:17:07.820 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-08T08:17:07.836 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-08T08:17:07.870 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-08T08:17:08.200 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-12-08T08:17:08.206 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-08T08:17:08.214 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../026-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-12-08T08:17:08.221 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-12-08T08:17:08.265 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-12-08T08:17:08.292 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-12-08T08:17:08.551 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-webob. 2023-12-08T08:17:08.566 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-12-08T08:17:08.609 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-12-08T08:17:08.628 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-cheroot. 2023-12-08T08:17:08.642 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../027-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-12-08T08:17:08.695 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-08T08:17:08.970 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-waitress. 2023-12-08T08:17:08.985 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../042-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-12-08T08:17:09.031 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-08T08:17:09.081 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-12-08T08:17:09.096 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../028-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-12-08T08:17:09.150 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-12-08T08:17:09.373 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-tempita. 2023-12-08T08:17:09.388 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../043-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-12-08T08:17:09.423 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-12-08T08:17:09.543 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-jaraco.text. 2023-12-08T08:17:09.557 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../029-python3-jaraco.text_3.6.0-2_all.deb ... 2023-12-08T08:17:09.609 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-12-08T08:17:09.709 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-paste. 2023-12-08T08:17:09.724 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../044-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-12-08T08:17:09.767 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-12-08T08:17:09.995 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-12-08T08:17:10.010 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../030-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-12-08T08:17:10.053 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-12-08T08:17:10.079 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-08T08:17:10.093 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../045-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-12-08T08:17:10.161 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-12-08T08:17:10.406 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-tempora. 2023-12-08T08:17:10.421 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../031-python3-tempora_4.1.2-1_all.deb ... 2023-12-08T08:17:10.431 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-08T08:17:10.446 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../046-python3-pastedeploy_2.1.1-1_all.deb ... 2023-12-08T08:17:10.473 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-12-08T08:17:10.489 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-12-08T08:17:10.792 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-webtest. 2023-12-08T08:17:10.807 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../047-python3-webtest_2.0.35-1_all.deb ... 2023-12-08T08:17:10.850 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-portend. 2023-12-08T08:17:10.851 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-12-08T08:17:10.865 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../032-python3-portend_3.0.0-1_all.deb ... 2023-12-08T08:17:10.917 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-12-08T08:17:11.187 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pecan. 2023-12-08T08:17:11.201 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../048-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-12-08T08:17:11.245 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-12-08T08:17:11.288 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-12-08T08:17:11.302 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../033-python3-zc.lockfile_2.0-1_all.deb ... 2023-12-08T08:17:11.378 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-12-08T08:17:11.625 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-certifi. 2023-12-08T08:17:11.639 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../049-python3-certifi_2020.6.20-1_all.deb ... 2023-12-08T08:17:11.706 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-08T08:17:11.721 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../034-python3-cherrypy3_18.6.1-4_all.deb ... 2023-12-08T08:17:11.764 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-12-08T08:17:11.875 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-12-08T08:17:12.160 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-natsort. 2023-12-08T08:17:12.174 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../035-python3-natsort_8.0.2-1_all.deb ... 2023-12-08T08:17:12.185 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-idna. 2023-12-08T08:17:12.201 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../050-python3-idna_3.3-1_all.deb ... 2023-12-08T08:17:12.218 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-12-08T08:17:12.235 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-idna (3.3-1) ... 2023-12-08T08:17:12.538 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-urllib3. 2023-12-08T08:17:12.553 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../051-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-12-08T08:17:12.571 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-logutils. 2023-12-08T08:17:12.586 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-8_all.deb ... 2023-12-08T08:17:12.597 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-08T08:17:12.629 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-12-08T08:17:12.916 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-requests. 2023-12-08T08:17:12.931 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../052-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-12-08T08:17:12.957 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-08T08:17:12.972 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../037-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-12-08T08:17:12.975 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-08T08:17:13.015 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-12-08T08:17:13.276 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-mako. 2023-12-08T08:17:13.277 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-08T08:17:13.291 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../038-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-12-08T08:17:13.292 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../053-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-12-08T08:17:13.326 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-08T08:17:13.327 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-08T08:17:13.622 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-08T08:17:13.637 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../054-ceph-mgr-modules-core_19.0.0-46-ga2cd52c0-1jammy_all.deb ... 2023-12-08T08:17:13.680 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-08T08:17:13.680 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-modules-core (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:13.694 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-08T08:17:13.738 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-08T08:17:14.082 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-08T08:17:14.097 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-12-08T08:17:14.110 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-08T08:17:14.124 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../055-libsqlite3-mod-ceph_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:14.140 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-12-08T08:17:14.168 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:14.462 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-08T08:17:14.468 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-webob. 2023-12-08T08:17:14.477 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../056-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-12-08T08:17:14.483 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-12-08T08:17:14.526 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-12-08T08:17:14.529 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-12-08T08:17:14.806 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-openssl. 2023-12-08T08:17:14.822 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-12-08T08:17:14.845 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-waitress. 2023-12-08T08:17:14.856 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-12-08T08:17:14.860 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../042-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-12-08T08:17:14.932 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-08T08:17:15.176 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr. 2023-12-08T08:17:15.191 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../058-ceph-mgr_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:15.198 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-tempita. 2023-12-08T08:17:15.213 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../043-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-12-08T08:17:15.234 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:15.248 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-12-08T08:17:15.576 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-paste. 2023-12-08T08:17:15.591 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../044-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-12-08T08:17:15.595 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mon. 2023-12-08T08:17:15.611 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../059-ceph-mon_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:15.634 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-12-08T08:17:15.654 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mon (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:15.963 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-08T08:17:15.978 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../045-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-12-08T08:17:16.012 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-12-08T08:17:16.458 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-osd. 2023-12-08T08:17:16.473 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../060-ceph-osd_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:16.515 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-osd (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:16.524 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-08T08:17:16.539 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../046-python3-pastedeploy_2.1.1-1_all.deb ... 2023-12-08T08:17:17.207 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-12-08T08:17:17.510 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-webtest. 2023-12-08T08:17:17.525 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../047-python3-webtest_2.0.35-1_all.deb ... 2023-12-08T08:17:17.568 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-12-08T08:17:17.888 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pecan. 2023-12-08T08:17:17.903 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../048-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-12-08T08:17:17.946 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-12-08T08:17:18.227 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph. 2023-12-08T08:17:18.242 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../061-ceph_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:18.285 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:18.326 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-certifi. 2023-12-08T08:17:18.341 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../049-python3-certifi_2020.6.20-1_all.deb ... 2023-12-08T08:17:18.384 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-12-08T08:17:18.547 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-fuse. 2023-12-08T08:17:18.562 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../062-ceph-fuse_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:18.596 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-fuse (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:18.728 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-idna. 2023-12-08T08:17:18.743 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../050-python3-idna_3.3-1_all.deb ... 2023-12-08T08:17:18.786 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-idna (3.3-1) ... 2023-12-08T08:17:18.983 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mds. 2023-12-08T08:17:18.998 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../063-ceph-mds_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:19.041 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mds (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:19.114 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-urllib3. 2023-12-08T08:17:19.129 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../051-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-12-08T08:17:19.164 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-08T08:17:19.394 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package cephadm. 2023-12-08T08:17:19.409 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../064-cephadm_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:19.452 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking cephadm (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:19.601 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-requests. 2023-12-08T08:17:19.616 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../052-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-12-08T08:17:19.659 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-08T08:17:19.763 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-asyncssh. 2023-12-08T08:17:19.778 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-12-08T08:17:19.813 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-12-08T08:17:19.970 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-08T08:17:19.985 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../053-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-12-08T08:17:20.053 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-08T08:17:20.108 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python-babel-localedata. 2023-12-08T08:17:20.122 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-12-08T08:17:20.166 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-08T08:17:20.348 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-08T08:17:20.363 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../054-ceph-mgr-modules-core_19.0.0-46-ga2cd52c0-1jammy_all.deb ... 2023-12-08T08:17:20.406 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr-modules-core (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:20.836 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-08T08:17:20.851 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../055-libsqlite3-mod-ceph_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:20.886 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:21.171 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-babel. 2023-12-08T08:17:21.185 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-12-08T08:17:21.214 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-08T08:17:21.229 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../056-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-12-08T08:17:21.229 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-12-08T08:17:21.272 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-12-08T08:17:21.548 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-jinja2. 2023-12-08T08:17:21.562 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-12-08T08:17:21.600 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-openssl. 2023-12-08T08:17:21.607 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-12-08T08:17:21.615 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-12-08T08:17:21.658 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-12-08T08:17:21.960 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-08T08:17:21.974 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_19.0.0-46-ga2cd52c0-1jammy_all.deb ... 2023-12-08T08:17:21.994 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr. 2023-12-08T08:17:22.009 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../058-ceph-mgr_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:22.018 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-cephadm (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:22.052 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:22.355 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-08T08:17:22.370 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../070-python3-repoze.lru_0.7-2_all.deb ... 2023-12-08T08:17:22.397 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mon. 2023-12-08T08:17:22.412 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../059-ceph-mon_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:22.413 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-08T08:17:22.447 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mon (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:22.683 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-routes. 2023-12-08T08:17:22.698 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../071-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-12-08T08:17:22.741 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-12-08T08:17:23.094 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-08T08:17:23.109 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_19.0.0-46-ga2cd52c0-1jammy_all.deb ... 2023-12-08T08:17:23.152 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-dashboard (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:23.284 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-osd. 2023-12-08T08:17:23.299 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../060-ceph-osd_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:23.342 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-osd (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:23.564 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-12-08T08:17:23.578 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../073-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-12-08T08:17:23.622 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-08T08:17:24.126 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-joblib. 2023-12-08T08:17:24.140 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../074-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-12-08T08:17:24.184 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-12-08T08:17:24.504 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-12-08T08:17:24.524 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../075-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-12-08T08:17:24.562 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-12-08T08:17:24.586 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph. 2023-12-08T08:17:24.593 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../061-ceph_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:24.647 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:24.915 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-sklearn. 2023-12-08T08:17:24.917 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../076-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-12-08T08:17:24.958 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-fuse. 2023-12-08T08:17:24.958 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-08T08:17:24.973 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../062-ceph-fuse_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:25.006 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-fuse (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:25.393 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mds. 2023-12-08T08:17:25.408 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../063-ceph-mds_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:25.451 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mds (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:25.639 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-08T08:17:25.653 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_19.0.0-46-ga2cd52c0-1jammy_all.deb ... 2023-12-08T08:17:25.698 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:25.837 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package cephadm. 2023-12-08T08:17:25.852 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../064-cephadm_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:25.895 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking cephadm (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:26.224 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-asyncssh. 2023-12-08T08:17:26.239 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-12-08T08:17:26.273 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-12-08T08:17:26.641 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cachetools. 2023-12-08T08:17:26.657 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../078-python3-cachetools_5.0.0-1_all.deb ... 2023-12-08T08:17:26.701 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-12-08T08:17:26.726 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-babel-localedata. 2023-12-08T08:17:26.741 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-12-08T08:17:26.793 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-08T08:17:27.020 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-08T08:17:27.046 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.8-1_all.deb ... 2023-12-08T08:17:27.262 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-12-08T08:17:27.524 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-08T08:17:27.539 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-12-08T08:17:27.573 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-12-08T08:17:27.865 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-babel. 2023-12-08T08:17:27.868 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-rsa. 2023-12-08T08:17:27.879 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-12-08T08:17:27.883 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../081-python3-rsa_4.8-1_all.deb ... 2023-12-08T08:17:27.918 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-rsa (4.8-1) ... 2023-12-08T08:17:27.922 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-12-08T08:17:28.209 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-jinja2. 2023-12-08T08:17:28.223 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-12-08T08:17:28.230 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-google-auth. 2023-12-08T08:17:28.245 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-3_all.deb ... 2023-12-08T08:17:28.287 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-12-08T08:17:28.292 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-12-08T08:17:28.620 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-08T08:17:28.634 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_19.0.0-46-ga2cd52c0-1jammy_all.deb ... 2023-12-08T08:17:28.678 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr-cephadm (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:28.718 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-08T08:17:28.732 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../083-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-12-08T08:17:28.775 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-08T08:17:29.049 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-08T08:17:29.062 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-websocket. 2023-12-08T08:17:29.062 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../070-python3-repoze.lru_0.7-2_all.deb ... 2023-12-08T08:17:29.077 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../084-python3-websocket_1.2.3-1_all.deb ... 2023-12-08T08:17:29.107 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-08T08:17:29.112 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-12-08T08:17:29.398 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-08T08:17:29.414 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../085-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-12-08T08:17:29.435 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-routes. 2023-12-08T08:17:29.449 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../071-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-12-08T08:17:29.456 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-08T08:17:29.493 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-12-08T08:17:29.829 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-08T08:17:29.846 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_19.0.0-46-ga2cd52c0-1jammy_all.deb ... 2023-12-08T08:17:29.879 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr-dashboard (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:30.128 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-08T08:17:30.142 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../086-ceph-mgr-k8sevents_19.0.0-46-ga2cd52c0-1jammy_all.deb ... 2023-12-08T08:17:30.186 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:30.333 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-12-08T08:17:30.348 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../073-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-12-08T08:17:30.391 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-08T08:17:30.506 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-08T08:17:30.520 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../087-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-12-08T08:17:30.564 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-08T08:17:30.909 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-08T08:17:30.911 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-joblib. 2023-12-08T08:17:30.923 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../088-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-12-08T08:17:30.926 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../074-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-12-08T08:17:30.967 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-08T08:17:30.969 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-12-08T08:17:31.211 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package jq. 2023-12-08T08:17:31.225 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../089-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-12-08T08:17:31.262 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-12-08T08:17:31.373 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-12-08T08:17:31.388 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../075-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-12-08T08:17:31.431 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-12-08T08:17:31.497 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package socat. 2023-12-08T08:17:31.511 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../090-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-12-08T08:17:31.555 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-12-08T08:17:31.717 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-sklearn. 2023-12-08T08:17:31.733 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../076-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-12-08T08:17:31.775 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-08T08:17:31.867 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package xmlstarlet. 2023-12-08T08:17:31.881 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../091-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-12-08T08:17:31.925 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-12-08T08:17:32.246 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-test. 2023-12-08T08:17:32.260 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../092-ceph-test_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:32.304 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-test (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:32.543 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-08T08:17:32.557 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_19.0.0-46-ga2cd52c0-1jammy_all.deb ... 2023-12-08T08:17:32.601 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:33.571 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-cachetools. 2023-12-08T08:17:33.586 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../078-python3-cachetools_5.0.0-1_all.deb ... 2023-12-08T08:17:33.629 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-12-08T08:17:33.948 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-08T08:17:33.964 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.8-1_all.deb ... 2023-12-08T08:17:33.998 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-12-08T08:17:34.326 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-08T08:17:34.343 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-12-08T08:17:34.367 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-volume. 2023-12-08T08:17:34.383 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../093-ceph-volume_19.0.0-46-ga2cd52c0-1jammy_all.deb ... 2023-12-08T08:17:34.418 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-12-08T08:17:34.425 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-volume (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:34.779 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-rsa. 2023-12-08T08:17:34.779 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-08T08:17:34.794 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../081-python3-rsa_4.8-1_all.deb ... 2023-12-08T08:17:34.795 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../094-cephfs-mirror_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:34.837 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking cephfs-mirror (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:34.845 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-rsa (4.8-1) ... 2023-12-08T08:17:35.191 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-colorama. 2023-12-08T08:17:35.206 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../095-python3-colorama_0.4.4-1_all.deb ... 2023-12-08T08:17:35.249 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-12-08T08:17:35.249 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-google-auth. 2023-12-08T08:17:35.264 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-3_all.deb ... 2023-12-08T08:17:35.315 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-12-08T08:17:35.510 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package cephfs-shell. 2023-12-08T08:17:35.526 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../096-cephfs-shell_19.0.0-46-ga2cd52c0-1jammy_all.deb ... 2023-12-08T08:17:35.568 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking cephfs-shell (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:35.804 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package cephfs-top. 2023-12-08T08:17:35.812 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-08T08:17:35.819 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../097-cephfs-top_19.0.0-46-ga2cd52c0-1jammy_all.deb ... 2023-12-08T08:17:35.827 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../083-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-12-08T08:17:35.862 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking cephfs-top (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:35.878 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-08T08:17:36.132 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-08T08:17:36.148 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../098-libcephfs-dev_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:36.190 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libcephfs-dev (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:36.215 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-websocket. 2023-12-08T08:17:36.230 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../084-python3-websocket_1.2.3-1_all.deb ... 2023-12-08T08:17:36.273 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-12-08T08:17:36.560 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package nvme-cli. 2023-12-08T08:17:36.575 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-12-08T08:17:36.618 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-12-08T08:17:36.618 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-08T08:17:36.634 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../085-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-12-08T08:17:36.676 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-08T08:17:36.958 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-12-08T08:17:36.973 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-12-08T08:17:37.016 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-12-08T08:17:37.382 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-08T08:17:37.396 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../086-ceph-mgr-k8sevents_19.0.0-46-ga2cd52c0-1jammy_all.deb ... 2023-12-08T08:17:37.440 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:37.619 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-iniconfig. 2023-12-08T08:17:37.634 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../101-python3-iniconfig_1.1.1-2_all.deb ... 2023-12-08T08:17:37.677 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-12-08T08:17:37.734 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-08T08:17:37.748 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../087-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-12-08T08:17:37.784 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-08T08:17:37.980 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pastescript. 2023-12-08T08:17:37.996 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-4_all.deb ... 2023-12-08T08:17:38.063 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-08T08:17:38.145 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-08T08:17:38.160 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../088-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-12-08T08:17:38.203 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-08T08:17:38.383 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pluggy. 2023-12-08T08:17:38.399 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../103-python3-pluggy_0.13.0-7.1_all.deb ... 2023-12-08T08:17:38.441 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-12-08T08:17:38.473 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package jq. 2023-12-08T08:17:38.489 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../089-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-12-08T08:17:38.531 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-12-08T08:17:38.752 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-psutil. 2023-12-08T08:17:38.768 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../104-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-12-08T08:17:38.809 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package socat. 2023-12-08T08:17:38.810 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-12-08T08:17:38.825 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../090-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-12-08T08:17:38.867 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-12-08T08:17:39.113 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-py. 2023-12-08T08:17:39.129 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../105-python3-py_1.10.0-1_all.deb ... 2023-12-08T08:17:39.163 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-py (1.10.0-1) ... 2023-12-08T08:17:39.187 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package xmlstarlet. 2023-12-08T08:17:39.202 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../091-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-12-08T08:17:39.237 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-12-08T08:17:39.433 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pygments. 2023-12-08T08:17:39.448 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../106-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-12-08T08:17:39.491 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-12-08T08:17:39.616 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-test. 2023-12-08T08:17:39.630 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../092-ceph-test_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:39.674 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-test (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:39.953 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-08T08:17:39.968 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-12-08T08:17:40.012 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-12-08T08:17:40.339 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-toml. 2023-12-08T08:17:40.354 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../108-python3-toml_0.10.2-1_all.deb ... 2023-12-08T08:17:40.397 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-12-08T08:17:40.675 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pytest. 2023-12-08T08:17:40.690 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../109-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-12-08T08:17:40.725 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-12-08T08:17:41.078 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-simplejson. 2023-12-08T08:17:41.093 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../110-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-12-08T08:17:41.137 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-12-08T08:17:41.389 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-08T08:17:41.404 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../111-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-12-08T08:17:41.447 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-12-08T08:17:41.478 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-volume. 2023-12-08T08:17:41.493 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../093-ceph-volume_19.0.0-46-ga2cd52c0-1jammy_all.deb ... 2023-12-08T08:17:41.528 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-volume (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:42.101 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package radosgw. 2023-12-08T08:17:42.115 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../112-radosgw_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:42.151 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking radosgw (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:42.176 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-08T08:17:42.192 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../094-cephfs-mirror_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:42.274 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking cephfs-mirror (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:42.585 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-colorama. 2023-12-08T08:17:42.601 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../095-python3-colorama_0.4.4-1_all.deb ... 2023-12-08T08:17:42.643 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-12-08T08:17:42.779 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package rbd-fuse. 2023-12-08T08:17:42.793 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../113-rbd-fuse_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:42.837 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking rbd-fuse (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:42.921 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package cephfs-shell. 2023-12-08T08:17:42.937 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../096-cephfs-shell_19.0.0-46-ga2cd52c0-1jammy_all.deb ... 2023-12-08T08:17:42.979 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking cephfs-shell (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:43.155 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-12-08T08:17:43.224 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package cephfs-top. 2023-12-08T08:17:43.239 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../097-cephfs-top_19.0.0-46-ga2cd52c0-1jammy_all.deb ... 2023-12-08T08:17:43.307 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking cephfs-top (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:43.442 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-08T08:17:43.559 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-08T08:17:43.568 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-12-08T08:17:43.575 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../098-libcephfs-dev_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:43.617 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libcephfs-dev (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:43.820 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-12-08T08:17:44.012 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package nvme-cli. 2023-12-08T08:17:44.028 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-12-08T08:17:44.070 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-12-08T08:17:44.207 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-12-08T08:17:44.425 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-12-08T08:17:44.441 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-12-08T08:17:44.484 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-12-08T08:17:44.797 INFO:teuthology.orchestra.run.smithi088.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-12-08T08:17:44.811 INFO:teuthology.orchestra.run.smithi088.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-12-08T08:17:44.861 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up cephadm (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:44.945 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-iniconfig. 2023-12-08T08:17:44.960 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../101-python3-iniconfig_1.1.1-2_all.deb ... 2023-12-08T08:17:45.003 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-12-08T08:17:45.340 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pastescript. 2023-12-08T08:17:45.355 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-4_all.deb ... 2023-12-08T08:17:45.397 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-08T08:17:45.507 INFO:teuthology.orchestra.run.smithi088.stdout:Adding system user cephadm....done 2023-12-08T08:17:45.668 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-08T08:17:45.675 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pluggy. 2023-12-08T08:17:45.691 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../103-python3-pluggy_0.13.0-7.1_all.deb ... 2023-12-08T08:17:45.734 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-12-08T08:17:46.087 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-psutil. 2023-12-08T08:17:46.103 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../104-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-12-08T08:17:46.145 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-12-08T08:17:46.314 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-12-08T08:17:46.517 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-py. 2023-12-08T08:17:46.533 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../105-python3-py_1.10.0-1_all.deb ... 2023-12-08T08:17:46.571 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-12-08T08:17:46.575 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-py (1.10.0-1) ... 2023-12-08T08:17:46.697 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-12-08T08:17:46.928 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pygments. 2023-12-08T08:17:46.944 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../106-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-12-08T08:17:46.957 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-08T08:17:46.986 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-12-08T08:17:47.224 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-12-08T08:17:47.350 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-py (1.10.0-1) ... 2023-12-08T08:17:47.465 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-08T08:17:47.480 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-12-08T08:17:47.523 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-12-08T08:17:47.661 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-12-08T08:17:47.845 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-toml. 2023-12-08T08:17:47.858 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../108-python3-toml_0.10.2-1_all.deb ... 2023-12-08T08:17:47.909 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-12-08T08:17:48.012 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-12-08T08:17:48.196 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pytest. 2023-12-08T08:17:48.211 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../109-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-12-08T08:17:48.254 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-12-08T08:17:48.313 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-12-08T08:17:48.581 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-12-08T08:17:48.599 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-simplejson. 2023-12-08T08:17:48.615 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../110-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-12-08T08:17:48.657 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-12-08T08:17:48.866 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-12-08T08:17:48.960 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-08T08:17:48.976 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../111-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-12-08T08:17:49.018 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-12-08T08:17:49.125 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-12-08T08:17:49.392 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-12-08T08:17:49.669 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-ceph-argparse (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:49.738 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package radosgw. 2023-12-08T08:17:49.753 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../112-radosgw_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:49.797 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking radosgw (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:49.936 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-08T08:17:50.087 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-12-08T08:17:50.363 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-12-08T08:17:50.400 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package rbd-fuse. 2023-12-08T08:17:50.415 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../113-rbd-fuse_19.0.0-46-ga2cd52c0-1jammy_amd64.deb ... 2023-12-08T08:17:50.474 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking rbd-fuse (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:50.631 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-08T08:17:50.751 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-12-08T08:17:50.757 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-12-08T08:17:51.021 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-08T08:17:51.122 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-12-08T08:17:51.150 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-08T08:17:51.275 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-12-08T08:17:51.381 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-12-08T08:17:51.543 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-12-08T08:17:51.765 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-12-08T08:17:51.803 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-12-08T08:17:52.129 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-12-08T08:17:52.442 INFO:teuthology.orchestra.run.smithi148.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-12-08T08:17:52.457 INFO:teuthology.orchestra.run.smithi148.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-12-08T08:17:52.525 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up cephadm (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:52.906 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-12-08T08:17:53.182 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-12-08T08:17:53.299 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-12-08T08:17:53.400 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-08T08:17:53.446 INFO:teuthology.orchestra.run.smithi148.stdout:Adding system user cephadm....done 2023-12-08T08:17:53.622 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-08T08:17:53.710 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-12-08T08:17:53.907 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-12-08T08:17:54.103 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-12-08T08:17:54.175 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-12-08T08:17:54.301 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-12-08T08:17:54.362 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-12-08T08:17:54.586 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-08T08:17:54.755 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-08T08:17:54.854 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-12-08T08:17:54.979 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-py (1.10.0-1) ... 2023-12-08T08:17:55.065 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-12-08T08:17:55.315 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-12-08T08:17:55.384 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-08T08:17:55.691 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-12-08T08:17:55.734 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-12-08T08:17:55.943 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-12-08T08:17:56.020 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-12-08T08:17:56.144 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-ceph-common (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:56.202 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-12-08T08:17:56.446 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-idna (3.3-1) ... 2023-12-08T08:17:56.486 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-12-08T08:17:56.754 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-12-08T08:17:56.788 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-08T08:17:57.022 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-12-08T08:17:57.581 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-ceph-argparse (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:17:57.891 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-08T08:17:58.000 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-12-08T08:17:58.035 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-08T08:17:58.170 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-toml (0.10.2-1) ... 2023-12-08T08:17:58.260 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-12-08T08:17:58.479 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-08T08:17:58.519 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-08T08:17:58.605 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-12-08T08:17:58.620 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-12-08T08:17:58.731 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-08T08:17:58.996 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-08T08:17:59.041 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-12-08T08:17:59.113 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-12-08T08:17:59.325 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-12-08T08:17:59.423 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-12-08T08:17:59.568 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-08T08:17:59.694 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-12-08T08:17:59.725 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-12-08T08:18:00.012 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-12-08T08:18:00.026 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-12-08T08:18:00.288 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-12-08T08:18:00.556 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-12-08T08:18:00.745 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-12-08T08:18:00.823 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-08T08:18:01.004 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-12-08T08:18:01.082 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-12-08T08:18:01.104 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-12-08T08:18:01.255 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-08T08:18:01.334 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-08T08:18:01.442 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-12-08T08:18:01.573 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-12-08T08:18:01.727 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-08T08:18:01.853 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-08T08:18:01.975 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-12-08T08:18:02.171 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-12-08T08:18:02.268 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-12-08T08:18:02.481 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-12-08T08:18:02.652 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-08T08:18:02.748 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-12-08T08:18:02.937 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-12-08T08:18:03.231 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-12-08T08:18:03.338 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-08T08:18:03.501 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-08T08:18:03.627 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-12-08T08:18:03.698 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-12-08T08:18:03.957 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-12-08T08:18:04.021 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-12-08T08:18:04.083 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-ceph-common (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:04.296 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-portend (3.0.0-1) ... 2023-12-08T08:18:04.385 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-idna (3.3-1) ... 2023-12-08T08:18:04.564 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-08T08:18:04.681 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-12-08T08:18:04.719 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-08T08:18:05.007 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-12-08T08:18:05.309 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-08T08:18:05.593 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-12-08T08:18:05.719 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-rsa (4.8-1) ... 2023-12-08T08:18:05.925 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-08T08:18:06.004 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-12-08T08:18:06.060 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-toml (0.10.2-1) ... 2023-12-08T08:18:06.279 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-08T08:18:06.327 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-08T08:18:06.486 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-12-08T08:18:06.556 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-12-08T08:18:06.612 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-08T08:18:06.930 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-12-08T08:18:06.957 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-08T08:18:07.198 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-12-08T08:18:07.250 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-12-08T08:18:07.466 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-08T08:18:07.584 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-12-08T08:18:07.602 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-08T08:18:07.728 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up librados2 (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:07.854 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up librgw2 (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:07.927 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-12-08T08:18:08.005 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libsqlite3-mod-ceph (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:08.186 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-12-08T08:18:08.208 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libcephfs2 (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:08.462 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-12-08T08:18:08.550 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libradosstriper1 (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:08.677 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-12-08T08:18:08.730 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-08T08:18:08.970 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up librbd1 (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:08.997 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-12-08T08:18:09.096 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-modules-core (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:09.222 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-fuse (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:09.283 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-08T08:18:09.408 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-12-08T08:18:09.428 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-08T08:18:09.428 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-08T08:18:09.726 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-08T08:18:09.852 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-08T08:18:10.048 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libcephfs-dev (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:10.157 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-rados (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:10.170 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-12-08T08:18:10.284 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up cephfs-top (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:10.409 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-08T08:18:10.496 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-12-08T08:18:10.772 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-12-08T08:18:11.157 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-12-08T08:18:11.425 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-08T08:18:11.576 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-12-08T08:18:11.689 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-rbd (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:11.807 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up rbd-fuse (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:11.941 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-rgw (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:11.961 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-12-08T08:18:12.050 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cephfs (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:12.176 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up cephfs-shell (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:12.270 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-portend (3.0.0-1) ... 2023-12-08T08:18:12.302 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-common (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:12.555 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-08T08:18:12.714 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-12-08T08:18:12.884 INFO:teuthology.orchestra.run.smithi088.stdout:Adding group ceph....done 2023-12-08T08:18:13.066 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-12-08T08:18:13.240 INFO:teuthology.orchestra.run.smithi088.stdout:Adding system user ceph....done 2023-12-08T08:18:13.375 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-08T08:18:13.409 INFO:teuthology.orchestra.run.smithi088.stdout:Setting system user ceph properties....done 2023-12-08T08:18:13.426 INFO:teuthology.orchestra.run.smithi088.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-08T08:18:13.569 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-08T08:18:13.659 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-12-08T08:18:13.785 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-rsa (4.8-1) ... 2023-12-08T08:18:13.937 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-08T08:18:14.078 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-12-08T08:18:14.338 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-08T08:18:14.603 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up cephfs-mirror (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:14.614 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-12-08T08:18:14.886 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-08T08:18:14.886 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-08T08:18:15.007 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-08T08:18:15.325 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-12-08T08:18:15.488 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-test (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:15.614 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up radosgw (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:15.694 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-08T08:18:15.820 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up librados2 (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:15.946 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up librgw2 (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:16.096 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libsqlite3-mod-ceph (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:16.152 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-08T08:18:16.153 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-08T08:18:16.300 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libcephfs2 (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:16.426 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libradosstriper1 (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:16.552 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-12-08T08:18:16.873 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-base (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:16.887 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up librbd1 (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:17.013 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr-modules-core (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:17.164 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-fuse (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:17.216 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-08T08:18:17.375 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-08T08:18:17.375 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-08T08:18:17.892 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mds (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:18.032 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libcephfs-dev (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:18.114 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-08T08:18:18.114 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-08T08:18:18.192 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-rados (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:18.318 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up cephfs-top (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:18.444 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-08T08:18:18.757 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:19.274 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-08T08:18:19.274 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-08T08:18:19.793 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-rbd (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:19.942 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-osd (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:20.078 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up rbd-fuse (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:20.275 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-08T08:18:20.275 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-08T08:18:20.314 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-rgw (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:20.441 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-cephfs (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:20.550 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up cephfs-shell (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:20.667 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-common (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:21.035 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-k8sevents (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:21.249 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:21.271 INFO:teuthology.orchestra.run.smithi148.stdout:Adding group ceph....done 2023-12-08T08:18:21.492 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mon (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:21.655 INFO:teuthology.orchestra.run.smithi148.stdout:Adding system user ceph....done 2023-12-08T08:18:21.780 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-08T08:18:21.780 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-08T08:18:21.900 INFO:teuthology.orchestra.run.smithi148.stdout:Setting system user ceph properties....done 2023-12-08T08:18:21.920 INFO:teuthology.orchestra.run.smithi148.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-08T08:18:22.067 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-08T08:18:22.389 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-cephadm (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:22.457 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-08T08:18:22.532 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:22.658 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-dashboard (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:22.801 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-volume (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:23.127 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up cephfs-mirror (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:23.153 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-08T08:18:23.319 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-08T08:18:23.319 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-08T08:18:23.870 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-08T08:18:23.953 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-test (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:24.079 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up radosgw (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:24.487 INFO:teuthology.orchestra.run.smithi088.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-08T08:18:24.492 DEBUG:teuthology.orchestra.run.smithi088:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-12-08T08:18:24.568 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2023-12-08T08:18:24.645 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-08T08:18:24.645 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-08T08:18:24.735 INFO:teuthology.orchestra.run.smithi088.stdout:Building dependency tree... 2023-12-08T08:18:24.735 INFO:teuthology.orchestra.run.smithi088.stdout:Reading state information... 2023-12-08T08:18:24.887 INFO:teuthology.orchestra.run.smithi088.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-12-08T08:18:24.888 INFO:teuthology.orchestra.run.smithi088.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-12-08T08:18:24.888 INFO:teuthology.orchestra.run.smithi088.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-12-08T08:18:24.888 INFO:teuthology.orchestra.run.smithi088.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-12-08T08:18:24.888 INFO:teuthology.orchestra.run.smithi088.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-12-08T08:18:24.888 INFO:teuthology.orchestra.run.smithi088.stdout:The following packages were automatically installed and are no longer required: 2023-12-08T08:18:24.888 INFO:teuthology.orchestra.run.smithi088.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-08T08:18:24.888 INFO:teuthology.orchestra.run.smithi088.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-08T08:18:24.888 INFO:teuthology.orchestra.run.smithi088.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-08T08:18:24.888 INFO:teuthology.orchestra.run.smithi088.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-08T08:18:24.889 INFO:teuthology.orchestra.run.smithi088.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-08T08:18:24.889 INFO:teuthology.orchestra.run.smithi088.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-08T08:18:24.889 INFO:teuthology.orchestra.run.smithi088.stdout:The following additional packages will be installed: 2023-12-08T08:18:24.889 INFO:teuthology.orchestra.run.smithi088.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-12-08T08:18:24.889 INFO:teuthology.orchestra.run.smithi088.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-12-08T08:18:24.890 INFO:teuthology.orchestra.run.smithi088.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-12-08T08:18:24.890 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-12-08T08:18:24.890 INFO:teuthology.orchestra.run.smithi088.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-08T08:18:24.891 INFO:teuthology.orchestra.run.smithi088.stdout:Suggested packages: 2023-12-08T08:18:24.891 INFO:teuthology.orchestra.run.smithi088.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-12-08T08:18:24.891 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-12-08T08:18:24.891 INFO:teuthology.orchestra.run.smithi088.stdout: libengine-pkcs11-openssl 2023-12-08T08:18:24.942 INFO:teuthology.orchestra.run.smithi088.stdout:The following NEW packages will be installed: 2023-12-08T08:18:24.942 INFO:teuthology.orchestra.run.smithi088.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-12-08T08:18:24.942 INFO:teuthology.orchestra.run.smithi088.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-12-08T08:18:24.942 INFO:teuthology.orchestra.run.smithi088.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-12-08T08:18:24.942 INFO:teuthology.orchestra.run.smithi088.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-12-08T08:18:24.942 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-12-08T08:18:24.943 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-12-08T08:18:24.943 INFO:teuthology.orchestra.run.smithi088.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-08T08:18:24.943 INFO:teuthology.orchestra.run.smithi088.stdout:The following packages will be upgraded: 2023-12-08T08:18:24.944 INFO:teuthology.orchestra.run.smithi088.stdout: libssl3 2023-12-08T08:18:25.149 INFO:teuthology.orchestra.run.smithi088.stdout:1 upgraded, 39 newly installed, 0 to remove and 265 not upgraded. 2023-12-08T08:18:25.149 INFO:teuthology.orchestra.run.smithi088.stdout:Need to get 54.6 MB of archives. 2023-12-08T08:18:25.149 INFO:teuthology.orchestra.run.smithi088.stdout:After this operation, 202 MB of additional disk space will be used. 2023-12-08T08:18:25.149 INFO:teuthology.orchestra.run.smithi088.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-12-08T08:18:25.256 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-base (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:25.643 INFO:teuthology.orchestra.run.smithi088.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-12-08T08:18:25.645 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-08T08:18:25.901 INFO:teuthology.orchestra.run.smithi088.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-12-08T08:18:25.935 INFO:teuthology.orchestra.run.smithi088.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-12-08T08:18:25.937 INFO:teuthology.orchestra.run.smithi088.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-12-08T08:18:25.942 INFO:teuthology.orchestra.run.smithi088.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-12-08T08:18:25.945 INFO:teuthology.orchestra.run.smithi088.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-12-08T08:18:25.946 INFO:teuthology.orchestra.run.smithi088.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2023-12-08T08:18:25.950 INFO:teuthology.orchestra.run.smithi088.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-12-08T08:18:25.952 INFO:teuthology.orchestra.run.smithi088.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-12-08T08:18:26.116 INFO:teuthology.orchestra.run.smithi088.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-12-08T08:18:26.117 INFO:teuthology.orchestra.run.smithi088.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-12-08T08:18:26.291 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mds (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:26.377 INFO:teuthology.orchestra.run.smithi088.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-12-08T08:18:26.524 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-08T08:18:26.524 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-08T08:18:27.168 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:27.364 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-08T08:18:27.365 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-08T08:18:27.406 INFO:teuthology.orchestra.run.smithi088.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-12-08T08:18:27.408 INFO:teuthology.orchestra.run.smithi088.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-12-08T08:18:27.408 INFO:teuthology.orchestra.run.smithi088.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-12-08T08:18:27.411 INFO:teuthology.orchestra.run.smithi088.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-12-08T08:18:27.411 INFO:teuthology.orchestra.run.smithi088.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-12-08T08:18:27.415 INFO:teuthology.orchestra.run.smithi088.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2023-12-08T08:18:27.417 INFO:teuthology.orchestra.run.smithi088.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-12-08T08:18:27.443 INFO:teuthology.orchestra.run.smithi088.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-12-08T08:18:27.607 INFO:teuthology.orchestra.run.smithi088.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-12-08T08:18:27.961 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-osd (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:28.352 INFO:teuthology.orchestra.run.smithi088.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-12-08T08:18:28.352 INFO:teuthology.orchestra.run.smithi088.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-12-08T08:18:28.379 INFO:teuthology.orchestra.run.smithi088.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-12-08T08:18:28.457 INFO:teuthology.orchestra.run.smithi088.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-12-08T08:18:28.464 INFO:teuthology.orchestra.run.smithi088.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-12-08T08:18:28.465 INFO:teuthology.orchestra.run.smithi088.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-12-08T08:18:28.466 INFO:teuthology.orchestra.run.smithi088.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-12-08T08:18:28.467 INFO:teuthology.orchestra.run.smithi088.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2023-12-08T08:18:28.495 INFO:teuthology.orchestra.run.smithi088.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-12-08T08:18:28.498 INFO:teuthology.orchestra.run.smithi088.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2023-12-08T08:18:28.653 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-08T08:18:28.654 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-08T08:18:29.124 INFO:teuthology.orchestra.run.smithi088.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-12-08T08:18:29.208 INFO:teuthology.orchestra.run.smithi088.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-12-08T08:18:29.208 INFO:teuthology.orchestra.run.smithi088.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-12-08T08:18:29.208 INFO:teuthology.orchestra.run.smithi088.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-12-08T08:18:29.280 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr-k8sevents (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:29.298 INFO:teuthology.orchestra.run.smithi088.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-12-08T08:18:29.303 INFO:teuthology.orchestra.run.smithi088.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-12-08T08:18:29.439 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:29.582 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mon (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:29.768 INFO:teuthology.orchestra.run.smithi088.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-12-08T08:18:29.770 INFO:teuthology.orchestra.run.smithi088.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-12-08T08:18:29.800 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-08T08:18:29.801 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-08T08:18:30.164 INFO:teuthology.orchestra.run.smithi088.stdout:Preconfiguring packages ... 2023-12-08T08:18:30.312 INFO:teuthology.orchestra.run.smithi088.stdout:Fetched 54.6 MB in 5s (11.3 MB/s) 2023-12-08T08:18:30.446 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package flex. 2023-12-08T08:18:30.466 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr-cephadm (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:30.518 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139845 files and directories currently installed.) 2023-12-08T08:18:30.521 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-12-08T08:18:30.561 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking flex (2.6.4-8build2) ... 2023-12-08T08:18:30.634 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:30.785 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr-dashboard (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:30.979 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-volume (19.0.0-46-ga2cd52c0-1jammy) ... 2023-12-08T08:18:31.122 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-08T08:18:31.292 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-12-08T08:18:31.347 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-08T08:18:31.681 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-08T08:18:32.192 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package bison. 2023-12-08T08:18:32.198 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-08T08:18:32.263 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139918 files and directories currently installed.) 2023-12-08T08:18:32.267 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-12-08T08:18:32.311 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-12-08T08:18:32.684 INFO:teuthology.orchestra.run.smithi148.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-08T08:18:32.689 DEBUG:teuthology.orchestra.run.smithi148:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-12-08T08:18:32.753 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-08T08:18:32.764 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2023-12-08T08:18:32.767 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-12-08T08:18:32.812 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-12-08T08:18:32.933 INFO:teuthology.orchestra.run.smithi148.stdout:Building dependency tree... 2023-12-08T08:18:32.933 INFO:teuthology.orchestra.run.smithi148.stdout:Reading state information... 2023-12-08T08:18:33.085 INFO:teuthology.orchestra.run.smithi148.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-12-08T08:18:33.085 INFO:teuthology.orchestra.run.smithi148.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-12-08T08:18:33.085 INFO:teuthology.orchestra.run.smithi148.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-12-08T08:18:33.086 INFO:teuthology.orchestra.run.smithi148.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-12-08T08:18:33.086 INFO:teuthology.orchestra.run.smithi148.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-12-08T08:18:33.086 INFO:teuthology.orchestra.run.smithi148.stdout:The following packages were automatically installed and are no longer required: 2023-12-08T08:18:33.086 INFO:teuthology.orchestra.run.smithi148.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-08T08:18:33.086 INFO:teuthology.orchestra.run.smithi148.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-08T08:18:33.086 INFO:teuthology.orchestra.run.smithi148.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-08T08:18:33.086 INFO:teuthology.orchestra.run.smithi148.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-08T08:18:33.086 INFO:teuthology.orchestra.run.smithi148.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-08T08:18:33.086 INFO:teuthology.orchestra.run.smithi148.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-08T08:18:33.087 INFO:teuthology.orchestra.run.smithi148.stdout:The following additional packages will be installed: 2023-12-08T08:18:33.087 INFO:teuthology.orchestra.run.smithi148.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-12-08T08:18:33.087 INFO:teuthology.orchestra.run.smithi148.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-12-08T08:18:33.088 INFO:teuthology.orchestra.run.smithi148.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-12-08T08:18:33.088 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-12-08T08:18:33.088 INFO:teuthology.orchestra.run.smithi148.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-08T08:18:33.088 INFO:teuthology.orchestra.run.smithi148.stdout:Suggested packages: 2023-12-08T08:18:33.088 INFO:teuthology.orchestra.run.smithi148.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-12-08T08:18:33.088 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-12-08T08:18:33.088 INFO:teuthology.orchestra.run.smithi148.stdout: libengine-pkcs11-openssl 2023-12-08T08:18:33.137 INFO:teuthology.orchestra.run.smithi148.stdout:The following NEW packages will be installed: 2023-12-08T08:18:33.138 INFO:teuthology.orchestra.run.smithi148.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-12-08T08:18:33.138 INFO:teuthology.orchestra.run.smithi148.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-12-08T08:18:33.138 INFO:teuthology.orchestra.run.smithi148.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-12-08T08:18:33.138 INFO:teuthology.orchestra.run.smithi148.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-12-08T08:18:33.138 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-12-08T08:18:33.139 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-12-08T08:18:33.139 INFO:teuthology.orchestra.run.smithi148.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-08T08:18:33.140 INFO:teuthology.orchestra.run.smithi148.stdout:The following packages will be upgraded: 2023-12-08T08:18:33.140 INFO:teuthology.orchestra.run.smithi148.stdout: libssl3 2023-12-08T08:18:33.164 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package dump. 2023-12-08T08:18:33.179 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-12-08T08:18:33.198 INFO:teuthology.orchestra.run.smithi148.stdout:1 upgraded, 39 newly installed, 0 to remove and 265 not upgraded. 2023-12-08T08:18:33.198 INFO:teuthology.orchestra.run.smithi148.stdout:Need to get 54.6 MB of archives. 2023-12-08T08:18:33.198 INFO:teuthology.orchestra.run.smithi148.stdout:After this operation, 202 MB of additional disk space will be used. 2023-12-08T08:18:33.198 INFO:teuthology.orchestra.run.smithi148.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-12-08T08:18:33.223 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking dump (0.4b47-3) ... 2023-12-08T08:18:33.298 INFO:teuthology.orchestra.run.smithi148.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-12-08T08:18:33.355 INFO:teuthology.orchestra.run.smithi148.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-12-08T08:18:33.368 INFO:teuthology.orchestra.run.smithi148.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-12-08T08:18:33.370 INFO:teuthology.orchestra.run.smithi148.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-12-08T08:18:33.371 INFO:teuthology.orchestra.run.smithi148.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-12-08T08:18:33.373 INFO:teuthology.orchestra.run.smithi148.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-12-08T08:18:33.373 INFO:teuthology.orchestra.run.smithi148.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2023-12-08T08:18:33.374 INFO:teuthology.orchestra.run.smithi148.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-12-08T08:18:33.375 INFO:teuthology.orchestra.run.smithi148.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-12-08T08:18:33.376 INFO:teuthology.orchestra.run.smithi148.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-12-08T08:18:33.376 INFO:teuthology.orchestra.run.smithi148.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-12-08T08:18:33.393 INFO:teuthology.orchestra.run.smithi148.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-12-08T08:18:33.487 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package indent. 2023-12-08T08:18:33.501 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-12-08T08:18:33.545 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-08T08:18:33.610 INFO:teuthology.orchestra.run.smithi148.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-12-08T08:18:33.611 INFO:teuthology.orchestra.run.smithi148.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-12-08T08:18:33.612 INFO:teuthology.orchestra.run.smithi148.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-12-08T08:18:33.614 INFO:teuthology.orchestra.run.smithi148.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-12-08T08:18:33.615 INFO:teuthology.orchestra.run.smithi148.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-12-08T08:18:33.619 INFO:teuthology.orchestra.run.smithi148.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2023-12-08T08:18:33.621 INFO:teuthology.orchestra.run.smithi148.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-12-08T08:18:33.628 INFO:teuthology.orchestra.run.smithi148.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-12-08T08:18:33.628 INFO:teuthology.orchestra.run.smithi148.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-12-08T08:18:33.652 INFO:teuthology.orchestra.run.smithi148.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-12-08T08:18:33.652 INFO:teuthology.orchestra.run.smithi148.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-12-08T08:18:33.662 INFO:teuthology.orchestra.run.smithi148.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-12-08T08:18:33.683 INFO:teuthology.orchestra.run.smithi148.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-12-08T08:18:33.686 INFO:teuthology.orchestra.run.smithi148.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-12-08T08:18:33.687 INFO:teuthology.orchestra.run.smithi148.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-12-08T08:18:33.688 INFO:teuthology.orchestra.run.smithi148.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-12-08T08:18:33.688 INFO:teuthology.orchestra.run.smithi148.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2023-12-08T08:18:33.700 INFO:teuthology.orchestra.run.smithi148.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-12-08T08:18:33.702 INFO:teuthology.orchestra.run.smithi148.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2023-12-08T08:18:33.789 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-08T08:18:33.803 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-12-08T08:18:33.839 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-08T08:18:33.848 INFO:teuthology.orchestra.run.smithi148.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-12-08T08:18:33.848 INFO:teuthology.orchestra.run.smithi148.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-12-08T08:18:33.848 INFO:teuthology.orchestra.run.smithi148.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-12-08T08:18:33.848 INFO:teuthology.orchestra.run.smithi148.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-12-08T08:18:33.848 INFO:teuthology.orchestra.run.smithi148.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-12-08T08:18:33.848 INFO:teuthology.orchestra.run.smithi148.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-12-08T08:18:33.861 INFO:teuthology.orchestra.run.smithi148.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-12-08T08:18:33.862 INFO:teuthology.orchestra.run.smithi148.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-12-08T08:18:34.176 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-08T08:18:34.191 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2023-12-08T08:18:34.234 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-08T08:18:34.241 INFO:teuthology.orchestra.run.smithi148.stdout:Preconfiguring packages ... 2023-12-08T08:18:34.381 INFO:teuthology.orchestra.run.smithi148.stdout:Fetched 54.6 MB in 1s (76.4 MB/s) 2023-12-08T08:18:34.495 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-08T08:18:34.511 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-12-08T08:18:34.545 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-12-08T08:18:34.555 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package flex. 2023-12-08T08:18:34.628 INFO:teuthology.orchestra.run.smithi148.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139845 files and directories currently installed.) 2023-12-08T08:18:34.632 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-12-08T08:18:34.679 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking flex (2.6.4-8build2) ... 2023-12-08T08:18:34.865 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libfl2:amd64. 2023-12-08T08:18:34.880 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-12-08T08:18:34.923 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-12-08T08:18:35.175 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-12-08T08:18:35.191 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-12-08T08:18:35.234 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-08T08:18:35.366 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-08T08:18:35.486 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libjson-perl. 2023-12-08T08:18:35.502 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-12-08T08:18:35.545 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-12-08T08:18:35.618 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-12-08T08:18:35.840 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libllvm14:amd64. 2023-12-08T08:18:35.855 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-12-08T08:18:35.898 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-08T08:18:36.058 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-08T08:18:36.669 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package bison. 2023-12-08T08:18:36.741 INFO:teuthology.orchestra.run.smithi148.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139918 files and directories currently installed.) 2023-12-08T08:18:36.745 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-12-08T08:18:36.805 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-12-08T08:18:37.292 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-08T08:18:37.297 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-08T08:18:37.307 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-08T08:18:37.311 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-12-08T08:18:37.350 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-08T08:18:37.363 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-12-08T08:18:37.611 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-08T08:18:37.629 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-08T08:18:37.670 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-08T08:18:37.808 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package dump. 2023-12-08T08:18:37.823 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-12-08T08:18:37.875 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking dump (0.4b47-3) ... 2023-12-08T08:18:37.989 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-08T08:18:38.004 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-08T08:18:38.064 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-08T08:18:38.195 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package indent. 2023-12-08T08:18:38.210 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-12-08T08:18:38.253 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-08T08:18:38.375 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-08T08:18:38.391 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-12-08T08:18:38.433 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-08T08:18:38.666 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-08T08:18:38.682 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-12-08T08:18:38.741 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-08T08:18:38.778 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-08T08:18:38.794 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-12-08T08:18:38.836 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-08T08:18:39.094 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-08T08:18:39.110 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2023-12-08T08:18:39.177 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-08T08:18:39.206 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libpq5:amd64. 2023-12-08T08:18:39.221 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-08T08:18:39.264 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-08T08:18:39.438 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-08T08:18:39.454 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-12-08T08:18:39.496 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-12-08T08:18:39.575 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-08T08:18:39.591 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-08T08:18:39.625 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-08T08:18:39.835 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libfl2:amd64. 2023-12-08T08:18:39.851 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-12-08T08:18:39.894 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-12-08T08:18:39.919 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-08T08:18:39.935 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-08T08:18:40.005 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-08T08:18:40.170 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-12-08T08:18:40.185 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-12-08T08:18:40.229 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-08T08:18:40.266 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-08T08:18:40.279 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-08T08:18:40.322 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-08T08:18:40.490 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libjson-perl. 2023-12-08T08:18:40.505 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-12-08T08:18:40.548 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-12-08T08:18:40.775 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-08T08:18:40.790 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-12-08T08:18:40.825 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-12-08T08:18:40.893 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libllvm14:amd64. 2023-12-08T08:18:40.908 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-12-08T08:18:40.959 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-08T08:18:41.195 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package modemmanager. 2023-12-08T08:18:41.210 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-08T08:18:41.253 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-08T08:18:41.834 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package network-manager. 2023-12-08T08:18:41.850 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-12-08T08:18:41.903 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-12-08T08:18:42.279 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-08T08:18:42.295 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-08T08:18:42.337 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-08T08:18:42.549 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ppp. 2023-12-08T08:18:42.565 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-12-08T08:18:42.648 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-08T08:18:42.664 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-08T08:18:42.706 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-08T08:18:42.891 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-12-08T08:18:43.058 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-08T08:18:43.074 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-08T08:18:43.116 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-08T08:18:43.229 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package pptp-linux. 2023-12-08T08:18:43.243 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-12-08T08:18:43.279 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-12-08T08:18:43.470 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-08T08:18:43.485 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-12-08T08:18:43.498 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-08T08:18:43.512 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-12-08T08:18:43.554 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-08T08:18:43.556 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-12-08T08:18:43.859 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-client-common. 2023-12-08T08:18:43.873 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-12-08T08:18:43.906 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-08T08:18:43.917 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-client-common (238) ... 2023-12-08T08:18:43.922 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-12-08T08:18:43.964 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-08T08:18:44.255 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-client-14. 2023-12-08T08:18:44.269 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-08T08:18:44.313 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-08T08:18:44.342 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libpq5:amd64. 2023-12-08T08:18:44.358 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-08T08:18:44.400 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-08T08:18:44.770 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-08T08:18:44.785 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-08T08:18:44.817 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-common. 2023-12-08T08:18:44.828 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-08T08:18:44.832 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-12-08T08:18:44.885 INFO:teuthology.orchestra.run.smithi088.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-12-08T08:18:44.916 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-common (238) ... 2023-12-08T08:18:45.139 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-08T08:18:45.155 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-08T08:18:45.189 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-08T08:18:45.408 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-14. 2023-12-08T08:18:45.416 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-08T08:18:45.423 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-08T08:18:45.431 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-08T08:18:45.469 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-08T08:18:45.474 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-08T08:18:45.961 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-08T08:18:45.976 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-12-08T08:18:46.011 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-12-08T08:18:46.372 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package modemmanager. 2023-12-08T08:18:46.388 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-08T08:18:46.430 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-08T08:18:46.545 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql. 2023-12-08T08:18:46.559 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-12-08T08:18:46.603 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql (14+238) ... 2023-12-08T08:18:46.847 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-client. 2023-12-08T08:18:46.861 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-12-08T08:18:46.905 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-client (14+238) ... 2023-12-08T08:18:47.053 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package network-manager. 2023-12-08T08:18:47.069 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-12-08T08:18:47.111 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-12-08T08:18:47.140 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-contrib. 2023-12-08T08:18:47.155 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-12-08T08:18:47.190 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-contrib (14+238) ... 2023-12-08T08:18:47.476 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package tcl8.6. 2023-12-08T08:18:47.491 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-12-08T08:18:47.535 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-08T08:18:47.768 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ppp. 2023-12-08T08:18:47.784 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-12-08T08:18:47.812 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package tcl. 2023-12-08T08:18:47.827 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-12-08T08:18:47.875 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-12-08T08:18:48.119 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-12-08T08:18:48.232 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package wpasupplicant. 2023-12-08T08:18:48.248 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-12-08T08:18:48.290 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-08T08:18:48.606 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package pptp-linux. 2023-12-08T08:18:48.619 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-08T08:18:48.620 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-12-08T08:18:48.634 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-12-08T08:18:48.669 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-12-08T08:18:48.698 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-12-08T08:18:49.001 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-08T08:18:49.016 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-12-08T08:18:49.068 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-12-08T08:18:49.080 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-08T08:18:49.096 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-12-08T08:18:49.147 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-08T08:18:49.395 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package postgresql-client-common. 2023-12-08T08:18:49.410 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-12-08T08:18:49.432 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-client-common (238) ... 2023-12-08T08:18:49.454 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking postgresql-client-common (238) ... 2023-12-08T08:18:49.628 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up flex (2.6.4-8build2) ... 2023-12-08T08:18:49.774 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package postgresql-client-14. 2023-12-08T08:18:49.790 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-08T08:18:49.832 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-08T08:18:50.171 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-08T08:18:50.297 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-08T08:18:50.412 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package postgresql-common. 2023-12-08T08:18:50.423 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-12-08T08:18:50.428 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-12-08T08:18:50.488 INFO:teuthology.orchestra.run.smithi148.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-12-08T08:18:50.520 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking postgresql-common (238) ... 2023-12-08T08:18:50.549 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-08T08:18:50.675 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-08T08:18:50.995 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package postgresql-14. 2023-12-08T08:18:51.010 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-08T08:18:51.056 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-08T08:18:51.679 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-12-08T08:18:51.780 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-08T08:18:52.143 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-08T08:18:52.144 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-08T08:18:52.222 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package postgresql. 2023-12-08T08:18:52.237 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-12-08T08:18:52.272 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking postgresql (14+238) ... 2023-12-08T08:18:52.516 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package postgresql-client. 2023-12-08T08:18:52.531 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-12-08T08:18:52.574 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking postgresql-client (14+238) ... 2023-12-08T08:18:52.800 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-12-08T08:18:52.851 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package postgresql-contrib. 2023-12-08T08:18:52.867 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-12-08T08:18:52.910 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking postgresql-contrib (14+238) ... 2023-12-08T08:18:52.926 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-08T08:18:53.052 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-12-08T08:18:53.211 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-12-08T08:18:53.229 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package tcl8.6. 2023-12-08T08:18:53.245 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-12-08T08:18:53.287 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-08T08:18:53.337 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-12-08T08:18:53.463 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-08T08:18:53.573 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-12-08T08:18:53.615 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package tcl. 2023-12-08T08:18:53.631 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-12-08T08:18:53.678 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-12-08T08:18:54.237 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-08T08:18:54.271 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package wpasupplicant. 2023-12-08T08:18:54.287 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-12-08T08:18:54.330 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-08T08:18:54.362 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up dump (0.4b47-3) ... 2023-12-08T08:18:54.458 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-08T08:18:54.522 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-08T08:18:54.648 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-08T08:18:54.667 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-08T08:18:54.683 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-12-08T08:18:54.717 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-12-08T08:18:54.766 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up tcl (8.6.11+1build2) ... 2023-12-08T08:18:54.892 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libjson-perl (4.04000-1) ... 2023-12-08T08:18:55.018 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-12-08T08:18:55.145 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-08T08:18:55.161 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-12-08T08:18:55.212 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-08T08:18:55.467 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-12-08T08:18:55.529 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up postgresql-client-common (238) ... 2023-12-08T08:18:55.537 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-08T08:18:55.663 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-08T08:18:55.743 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up flex (2.6.4-8build2) ... 2023-12-08T08:18:55.823 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-08T08:18:55.877 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-08T08:18:55.973 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-08T08:18:56.028 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-08T08:18:56.124 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-12-08T08:18:56.154 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-12-08T08:18:56.255 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-08T08:18:56.292 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-client (14+238) ... 2023-12-08T08:18:56.356 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-08T08:18:56.418 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-12-08T08:18:57.023 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:18:57.023 INFO:teuthology.orchestra.run.smithi088.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-08T08:18:57.023 INFO:teuthology.orchestra.run.smithi088.stdout:which means they are currently configured by ifupdown: 2023-12-08T08:18:57.023 INFO:teuthology.orchestra.run.smithi088.stdout:- enp3s0f1 2023-12-08T08:18:57.023 INFO:teuthology.orchestra.run.smithi088.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-08T08:18:57.023 INFO:teuthology.orchestra.run.smithi088.stdout:remove their configuration from /etc/network/interfaces. 2023-12-08T08:18:57.023 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:18:57.156 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-08T08:18:57.374 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-12-08T08:18:57.504 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-08T08:18:57.554 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-08T08:18:57.857 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-08T08:18:57.858 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-08T08:18:57.970 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-08T08:18:58.573 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-12-08T08:18:58.663 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-08T08:18:58.699 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-08T08:18:58.806 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-08T08:18:58.825 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-12-08T08:18:58.932 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-12-08T08:18:59.010 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-12-08T08:18:59.090 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-common (238) ... 2023-12-08T08:18:59.510 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-12-08T08:18:59.637 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-08T08:18:59.754 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-12-08T08:19:00.026 INFO:teuthology.orchestra.run.smithi088.stdout:Adding user postgres to group ssl-cert 2023-12-08T08:19:00.319 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:00.319 INFO:teuthology.orchestra.run.smithi088.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-12-08T08:19:00.409 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-08T08:19:00.570 INFO:teuthology.orchestra.run.smithi088.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-12-08T08:19:00.570 INFO:teuthology.orchestra.run.smithi088.stdout:Removing obsolete dictionary files: 2023-12-08T08:19:00.577 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up dump (0.4b47-3) ... 2023-12-08T08:19:00.672 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-08T08:19:00.737 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-08T08:19:00.863 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-08T08:19:00.964 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up tcl (8.6.11+1build2) ... 2023-12-08T08:19:01.123 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libjson-perl (4.04000-1) ... 2023-12-08T08:19:01.249 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-12-08T08:19:01.305 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-12-08T08:19:01.339 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-12-08T08:19:01.409 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-08T08:19:01.560 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-08T08:19:01.737 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-08T08:19:01.768 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-08T08:19:01.862 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-08T08:19:01.989 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-12-08T08:19:02.114 INFO:teuthology.orchestra.run.smithi088.stdout:Creating new PostgreSQL cluster 14/main ... 2023-12-08T08:19:02.138 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-12-08T08:19:02.156 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up postgresql-client (14+238) ... 2023-12-08T08:19:02.192 INFO:teuthology.orchestra.run.smithi088.stdout:The files belonging to this database system will be owned by user "postgres". 2023-12-08T08:19:02.192 INFO:teuthology.orchestra.run.smithi088.stdout:This user must also own the server process. 2023-12-08T08:19:02.192 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:02.193 INFO:teuthology.orchestra.run.smithi088.stdout:The database cluster will be initialized with locale "en_US". 2023-12-08T08:19:02.193 INFO:teuthology.orchestra.run.smithi088.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-12-08T08:19:02.193 INFO:teuthology.orchestra.run.smithi088.stdout:The default text search configuration will be set to "english". 2023-12-08T08:19:02.193 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:02.193 INFO:teuthology.orchestra.run.smithi088.stdout:Data page checksums are disabled. 2023-12-08T08:19:02.193 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:02.193 INFO:teuthology.orchestra.run.smithi088.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-12-08T08:19:02.194 INFO:teuthology.orchestra.run.smithi088.stdout:creating subdirectories ... ok 2023-12-08T08:19:02.194 INFO:teuthology.orchestra.run.smithi088.stdout:selecting dynamic shared memory implementation ... posix 2023-12-08T08:19:02.218 INFO:teuthology.orchestra.run.smithi088.stdout:selecting default max_connections ... 100 2023-12-08T08:19:02.253 INFO:teuthology.orchestra.run.smithi088.stdout:selecting default shared_buffers ... 128MB 2023-12-08T08:19:02.266 INFO:teuthology.orchestra.run.smithi088.stdout:selecting default time zone ... Etc/UTC 2023-12-08T08:19:02.267 INFO:teuthology.orchestra.run.smithi088.stdout:creating configuration files ... ok 2023-12-08T08:19:02.282 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-12-08T08:19:02.437 INFO:teuthology.orchestra.run.smithi088.stdout:running bootstrap script ... ok 2023-12-08T08:19:02.879 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:02.879 INFO:teuthology.orchestra.run.smithi148.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-08T08:19:02.879 INFO:teuthology.orchestra.run.smithi148.stdout:which means they are currently configured by ifupdown: 2023-12-08T08:19:02.879 INFO:teuthology.orchestra.run.smithi148.stdout:- enp3s0f1 2023-12-08T08:19:02.880 INFO:teuthology.orchestra.run.smithi148.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-08T08:19:02.880 INFO:teuthology.orchestra.run.smithi148.stdout:remove their configuration from /etc/network/interfaces. 2023-12-08T08:19:02.880 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:03.001 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-08T08:19:03.096 INFO:teuthology.orchestra.run.smithi088.stdout:performing post-bootstrap initialization ... ok 2023-12-08T08:19:03.409 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-08T08:19:03.615 INFO:teuthology.orchestra.run.smithi088.stdout:syncing data to disk ... ok 2023-12-08T08:19:03.825 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-08T08:19:04.149 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-12-08T08:19:04.719 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-08T08:19:04.845 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-08T08:19:04.971 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-12-08T08:19:05.123 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up postgresql-common (238) ... 2023-12-08T08:19:06.031 INFO:teuthology.orchestra.run.smithi148.stdout:Adding user postgres to group ssl-cert 2023-12-08T08:19:06.326 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:06.326 INFO:teuthology.orchestra.run.smithi148.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-12-08T08:19:06.574 INFO:teuthology.orchestra.run.smithi148.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-12-08T08:19:06.575 INFO:teuthology.orchestra.run.smithi148.stdout:Removing obsolete dictionary files: 2023-12-08T08:19:07.192 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-08T08:19:07.281 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-12-08T08:19:07.334 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-contrib (14+238) ... 2023-12-08T08:19:07.460 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql (14+238) ... 2023-12-08T08:19:07.586 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-08T08:19:07.713 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-08T08:19:07.765 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-08T08:19:07.947 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-08T08:19:07.948 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-08T08:19:08.108 INFO:teuthology.orchestra.run.smithi148.stdout:Creating new PostgreSQL cluster 14/main ... 2023-12-08T08:19:08.138 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-12-08T08:19:08.188 INFO:teuthology.orchestra.run.smithi148.stdout:The files belonging to this database system will be owned by user "postgres". 2023-12-08T08:19:08.188 INFO:teuthology.orchestra.run.smithi148.stdout:This user must also own the server process. 2023-12-08T08:19:08.188 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:08.188 INFO:teuthology.orchestra.run.smithi148.stdout:The database cluster will be initialized with locale "en_US". 2023-12-08T08:19:08.188 INFO:teuthology.orchestra.run.smithi148.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-12-08T08:19:08.188 INFO:teuthology.orchestra.run.smithi148.stdout:The default text search configuration will be set to "english". 2023-12-08T08:19:08.188 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:08.188 INFO:teuthology.orchestra.run.smithi148.stdout:Data page checksums are disabled. 2023-12-08T08:19:08.188 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:08.188 INFO:teuthology.orchestra.run.smithi148.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-12-08T08:19:08.189 INFO:teuthology.orchestra.run.smithi148.stdout:creating subdirectories ... ok 2023-12-08T08:19:08.189 INFO:teuthology.orchestra.run.smithi148.stdout:selecting dynamic shared memory implementation ... posix 2023-12-08T08:19:08.213 INFO:teuthology.orchestra.run.smithi148.stdout:selecting default max_connections ... 100 2023-12-08T08:19:08.248 INFO:teuthology.orchestra.run.smithi148.stdout:selecting default shared_buffers ... 128MB 2023-12-08T08:19:08.262 INFO:teuthology.orchestra.run.smithi148.stdout:selecting default time zone ... Etc/UTC 2023-12-08T08:19:08.263 INFO:teuthology.orchestra.run.smithi148.stdout:creating configuration files ... ok 2023-12-08T08:19:08.430 INFO:teuthology.orchestra.run.smithi148.stdout:running bootstrap script ... ok 2023-12-08T08:19:08.698 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-08T08:19:09.000 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-08T08:19:09.070 INFO:teuthology.orchestra.run.smithi148.stdout:performing post-bootstrap initialization ... ok 2023-12-08T08:19:09.168 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-08T08:19:09.621 INFO:teuthology.orchestra.run.smithi148.stdout:syncing data to disk ... ok 2023-12-08T08:19:10.171 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-12-08T08:19:10.588 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-12-08T08:19:10.679 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-08T08:19:11.359 INFO:teuthology.orchestra.run.smithi088.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-08T08:19:11.364 DEBUG:teuthology.parallel:result is None 2023-12-08T08:19:13.147 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-08T08:19:13.273 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up postgresql-contrib (14+238) ... 2023-12-08T08:19:13.399 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up postgresql (14+238) ... 2023-12-08T08:19:13.558 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-08T08:19:13.685 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-08T08:19:13.944 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-08T08:19:13.944 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-08T08:19:14.712 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-08T08:19:15.074 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-08T08:19:15.224 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-08T08:19:16.635 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-12-08T08:19:16.744 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-08T08:19:17.439 INFO:teuthology.orchestra.run.smithi148.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-08T08:19:17.444 DEBUG:teuthology.parallel:result is None 2023-12-08T08:19:17.445 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a2cd52c00149b5caff897ea7f79d0529b62620da 2023-12-08T08:19:17.677 DEBUG:teuthology.orchestra.run.smithi088:> dpkg-query -W -f '${Version}' ceph 2023-12-08T08:19:17.701 INFO:teuthology.orchestra.run.smithi088.stdout:19.0.0-46-ga2cd52c0-1jammy 2023-12-08T08:19:17.702 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-46-ga2cd52c0-1jammy 2023-12-08T08:19:17.702 INFO:teuthology.task.install:The correct ceph version 19.0.0-46-ga2cd52c0-1jammy is installed. 2023-12-08T08:19:17.702 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a2cd52c00149b5caff897ea7f79d0529b62620da 2023-12-08T08:19:17.848 DEBUG:teuthology.orchestra.run.smithi148:> dpkg-query -W -f '${Version}' ceph 2023-12-08T08:19:17.870 INFO:teuthology.orchestra.run.smithi148.stdout:19.0.0-46-ga2cd52c0-1jammy 2023-12-08T08:19:17.870 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-46-ga2cd52c0-1jammy 2023-12-08T08:19:17.871 INFO:teuthology.task.install:The correct ceph version 19.0.0-46-ga2cd52c0-1jammy is installed. 2023-12-08T08:19:17.871 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-08T08:19:17.871 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:19:17.871 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-08T08:19:17.893 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:19:17.894 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-08T08:19:17.932 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-08T08:19:17.932 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:19:17.933 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/daemon-helper 2023-12-08T08:19:17.956 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-08T08:19:18.024 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:19:18.024 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/daemon-helper 2023-12-08T08:19:18.045 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-08T08:19:18.111 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-08T08:19:18.111 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:19:18.111 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-08T08:19:18.133 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-08T08:19:18.200 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:19:18.200 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-08T08:19:18.220 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-08T08:19:18.283 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-08T08:19:18.284 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:19:18.284 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/stdin-killer 2023-12-08T08:19:18.305 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-08T08:19:18.368 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:19:18.368 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/stdin-killer 2023-12-08T08:19:18.388 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-08T08:19:18.452 INFO:teuthology.run_tasks:Running task ceph... 2023-12-08T08:19:18.522 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-08T08:19:18.522 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 777 /var/log/ceph 2023-12-08T08:19:18.526 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 777 /var/log/ceph 2023-12-08T08:19:18.546 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-08T08:19:18.546 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-08T08:19:18.590 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-08T08:19:18.610 INFO:tasks.ceph:Creating extra log directories... 2023-12-08T08:19:18.611 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-08T08:19:18.654 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-08T08:19:18.681 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-08T08:19:18.681 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-08T08:19:18.681 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-08T08:19:18.681 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:19:18.681 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-08T08:19:18.723 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-08T08:19:18.817 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:19:18.817 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-08T08:19:18.826 DEBUG:teuthology.orchestra.run.smithi148:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-08T08:19:18.923 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-08T08:19:18.923 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-08T08:19:18.923 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483775', 'branch': 'wip-vshankar-testing-20231206.125818', 'description': 'fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7483775', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20231206.125818'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20231206.125818', 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 4099, 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da', 'sleep_before_teardown': 0, 'subset': '359/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20231206.125818', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi088.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJPCr2txKdrKf9QnVelFuE+wn/m9+lLN+r7qen3FqGpJXpxAxebzzsQ5a4U12llyPIl2twavOnDhInUZ62jUq4Q=', 'smithi148.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEZ4o2xJekQI9+TdCETQ2M9T3DLEpNouMY7fkhItHCoYvLU++jEUfbgjPeq/lGtbmsSFWoZPbDPIFYXVu5sMDvs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_multifs_auth']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'f2de108beb0a6dde7f3e6c96039071828a1f6269', 'timestamp': '2023-12-08_07:46:48', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-12-08T08:19:18.924 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-08T08:19:18.928 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-08T08:19:18.937 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/run/ceph 2023-12-08T08:19:18.982 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/run/ceph 2023-12-08T08:19:19.003 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:19:19.003 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/scratch_devs of=/dev/stdout 2023-12-08T08:19:19.051 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-08T08:19:19.052 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_1 2023-12-08T08:19:19.108 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-08T08:19:19.108 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T08:19:19.108 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 901 Links: 1 2023-12-08T08:19:19.108 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T08:19:19.108 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-12-08 08:12:52.351887910 +0000 2023-12-08T08:19:19.108 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-12-08 08:12:51.959891411 +0000 2023-12-08T08:19:19.108 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-12-08 08:12:51.959891411 +0000 2023-12-08T08:19:19.108 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-12-08 08:12:51.959891411 +0000 2023-12-08T08:19:19.109 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-08T08:19:19.174 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-12-08T08:19:19.174 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-12-08T08:19:19.175 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000380637 s, 1.3 MB/s 2023-12-08T08:19:19.176 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-08T08:19:19.230 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_2 2023-12-08T08:19:19.280 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-08T08:19:19.280 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T08:19:19.281 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 918 Links: 1 2023-12-08T08:19:19.281 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T08:19:19.281 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-12-08 08:12:53.003882086 +0000 2023-12-08T08:19:19.281 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-12-08 08:12:52.643885301 +0000 2023-12-08T08:19:19.281 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-12-08 08:12:52.643885301 +0000 2023-12-08T08:19:19.281 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-12-08 08:12:52.643885301 +0000 2023-12-08T08:19:19.281 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-08T08:19:19.347 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-12-08T08:19:19.347 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-12-08T08:19:19.347 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000389943 s, 1.3 MB/s 2023-12-08T08:19:19.349 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-08T08:19:19.402 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_3 2023-12-08T08:19:19.452 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-08T08:19:19.452 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T08:19:19.452 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 935 Links: 1 2023-12-08T08:19:19.453 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T08:19:19.453 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-12-08 08:12:53.671876119 +0000 2023-12-08T08:19:19.453 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-12-08 08:12:53.267879728 +0000 2023-12-08T08:19:19.453 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-12-08 08:12:53.267879728 +0000 2023-12-08T08:19:19.453 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-12-08 08:12:53.267879728 +0000 2023-12-08T08:19:19.453 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-08T08:19:19.519 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-12-08T08:19:19.519 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-12-08T08:19:19.519 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.00038291 s, 1.3 MB/s 2023-12-08T08:19:19.521 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-08T08:19:19.580 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_4 2023-12-08T08:19:19.632 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-08T08:19:19.632 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T08:19:19.632 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 955 Links: 1 2023-12-08T08:19:19.632 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T08:19:19.633 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-12-08 08:12:54.351870045 +0000 2023-12-08T08:19:19.633 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-12-08 08:12:53.951873618 +0000 2023-12-08T08:19:19.633 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-12-08 08:12:53.951873618 +0000 2023-12-08T08:19:19.633 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-12-08 08:12:53.951873618 +0000 2023-12-08T08:19:19.633 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-08T08:19:19.695 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-12-08T08:19:19.695 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-12-08T08:19:19.695 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000401154 s, 1.3 MB/s 2023-12-08T08:19:19.697 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-08T08:19:19.750 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-08T08:19:19.750 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:19:19.750 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/scratch_devs of=/dev/stdout 2023-12-08T08:19:19.760 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-08T08:19:19.760 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_1 2023-12-08T08:19:19.809 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-08T08:19:19.810 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T08:19:19.810 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 901 Links: 1 2023-12-08T08:19:19.810 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T08:19:19.810 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2023-12-08 08:13:00.276133048 +0000 2023-12-08T08:19:19.810 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2023-12-08 08:13:00.272133084 +0000 2023-12-08T08:19:19.810 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2023-12-08 08:13:00.272133084 +0000 2023-12-08T08:19:19.810 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2023-12-08 08:13:00.272133084 +0000 2023-12-08T08:19:19.811 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-08T08:19:19.871 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2023-12-08T08:19:19.872 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2023-12-08T08:19:19.872 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000378274 s, 1.4 MB/s 2023-12-08T08:19:19.873 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-08T08:19:19.927 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_2 2023-12-08T08:19:19.977 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-08T08:19:19.977 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T08:19:19.977 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 920 Links: 1 2023-12-08T08:19:19.977 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T08:19:19.977 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2023-12-08 08:13:01.360123366 +0000 2023-12-08T08:19:19.977 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2023-12-08 08:13:00.940127117 +0000 2023-12-08T08:19:19.978 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2023-12-08 08:13:00.940127117 +0000 2023-12-08T08:19:19.978 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2023-12-08 08:13:00.940127117 +0000 2023-12-08T08:19:19.978 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-08T08:19:20.040 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2023-12-08T08:19:20.040 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2023-12-08T08:19:20.040 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000383767 s, 1.3 MB/s 2023-12-08T08:19:20.042 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-08T08:19:20.095 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_3 2023-12-08T08:19:20.144 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-08T08:19:20.145 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T08:19:20.145 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 936 Links: 1 2023-12-08T08:19:20.145 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T08:19:20.145 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2023-12-08 08:13:02.012117542 +0000 2023-12-08T08:19:20.145 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2023-12-08 08:13:01.624121008 +0000 2023-12-08T08:19:20.145 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2023-12-08 08:13:01.624121008 +0000 2023-12-08T08:19:20.145 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2023-12-08 08:13:01.624121008 +0000 2023-12-08T08:19:20.145 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-08T08:19:20.207 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2023-12-08T08:19:20.208 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2023-12-08T08:19:20.208 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000383394 s, 1.3 MB/s 2023-12-08T08:19:20.210 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-08T08:19:20.263 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_4 2023-12-08T08:19:20.313 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-08T08:19:20.313 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T08:19:20.313 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 953 Links: 1 2023-12-08T08:19:20.313 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T08:19:20.313 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2023-12-08 08:13:02.672111647 +0000 2023-12-08T08:19:20.313 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2023-12-08 08:13:02.268115255 +0000 2023-12-08T08:19:20.313 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2023-12-08 08:13:02.268115255 +0000 2023-12-08T08:19:20.313 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2023-12-08 08:13:02.268115255 +0000 2023-12-08T08:19:20.313 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-08T08:19:20.379 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2023-12-08T08:19:20.379 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2023-12-08T08:19:20.380 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000398415 s, 1.3 MB/s 2023-12-08T08:19:20.381 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-08T08:19:20.439 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-08T08:19:20.439 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi148.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-08T08:19:20.440 INFO:tasks.ceph:Generating config... 2023-12-08T08:19:20.441 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-08T08:19:20.441 INFO:tasks.ceph:[client] debug client = 20 2023-12-08T08:19:20.441 INFO:tasks.ceph:[client] debug ms = 1 2023-12-08T08:19:20.441 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-08T08:19:20.442 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-08T08:19:20.442 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-12-08T08:19:20.442 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-08T08:19:20.442 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-08T08:19:20.442 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-08T08:19:20.442 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-08T08:19:20.442 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-08T08:19:20.442 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-08T08:19:20.442 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-08T08:19:20.442 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-08T08:19:20.442 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-08T08:19:20.443 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-08T08:19:20.443 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-08T08:19:20.443 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-08T08:19:20.443 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-08T08:19:20.443 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-08T08:19:20.443 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-08T08:19:20.443 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-08T08:19:20.443 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-08T08:19:20.443 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-12-08T08:19:20.443 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-08T08:19:20.443 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-12-08T08:19:20.443 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-12-08T08:19:20.443 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-08T08:19:20.443 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-08T08:19:20.443 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-12-08T08:19:20.443 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-08T08:19:20.444 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-08T08:19:20.444 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-08T08:19:20.444 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-08T08:19:20.444 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-08T08:19:20.444 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-08T08:19:20.444 INFO:tasks.ceph:Setting up mon.a... 2023-12-08T08:19:20.444 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-08T08:19:20.491 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.keyring 2023-12-08T08:19:20.505 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-08T08:19:20.596 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-08T08:19:20.660 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.88'), ('mon.b', '172.21.15.148'), ('mon.c', '[v2:172.21.15.148:3301,v1:172.21.15.148:6790]')] 2023-12-08T08:19:20.660 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.88,172.21.15.148,[v2:172.21.15.148:3301,v1:172.21.15.148:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-08T08:19:20.661 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:19:20.661 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-08T08:19:20.712 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.88 --add b 172.21.15.148 --addv c '[v2:172.21.15.148:3301,v1:172.21.15.148:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:19:20.802 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:19:20.802 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: generated fsid 681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3 2023-12-08T08:19:20.802 INFO:teuthology.orchestra.run.smithi088.stdout:setting min_mon_release = pacific 2023-12-08T08:19:20.802 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 0 2023-12-08T08:19:20.802 INFO:teuthology.orchestra.run.smithi088.stdout:fsid 681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3 2023-12-08T08:19:20.803 INFO:teuthology.orchestra.run.smithi088.stdout:last_changed 2023-12-08T08:19:20.802802+0000 2023-12-08T08:19:20.803 INFO:teuthology.orchestra.run.smithi088.stdout:created 2023-12-08T08:19:20.802802+0000 2023-12-08T08:19:20.803 INFO:teuthology.orchestra.run.smithi088.stdout:min_mon_release 16 (pacific) 2023-12-08T08:19:20.803 INFO:teuthology.orchestra.run.smithi088.stdout:election_strategy: 1 2023-12-08T08:19:20.803 INFO:teuthology.orchestra.run.smithi088.stdout:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2023-12-08T08:19:20.803 INFO:teuthology.orchestra.run.smithi088.stdout:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-08T08:19:20.803 INFO:teuthology.orchestra.run.smithi088.stdout:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2023-12-08T08:19:20.803 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-08T08:19:20.805 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-08T08:19:20.813 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3... 2023-12-08T08:19:20.814 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-08T08:19:20.862 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-08T08:19:20.903 INFO:teuthology.orchestra.run.smithi088.stdout:[global] 2023-12-08T08:19:20.903 INFO:teuthology.orchestra.run.smithi088.stdout: chdir = "" 2023-12-08T08:19:20.903 INFO:teuthology.orchestra.run.smithi088.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-08T08:19:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: auth supported = cephx 2023-12-08T08:19:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: filestore xattr use omap = true 2023-12-08T08:19:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: mon clock drift allowed = 1.000 2023-12-08T08:19:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: osd crush chooseleaf type = 0 2023-12-08T08:19:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: auth debug = true 2023-12-08T08:19:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on old message = true 2023-12-08T08:19:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on bug = true 2023-12-08T08:19:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-08T08:19:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: mon pg warn max object skew = 0 2023-12-08T08:19:20.905 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.905 INFO:teuthology.orchestra.run.smithi088.stdout: # disable pg_autoscaler by default for new pools 2023-12-08T08:19:20.905 INFO:teuthology.orchestra.run.smithi088.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-08T08:19:20.905 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.905 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default size = 2 2023-12-08T08:19:20.905 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.905 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow primary affinity = true 2023-12-08T08:19:20.905 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow pg remap = true 2023-12-08T08:19:20.905 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on legacy crush tunables = false 2023-12-08T08:19:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on crush straw calc version zero = false 2023-12-08T08:19:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on no sortbitwise = false 2023-12-08T08:19:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on osd down out interval zero = false 2023-12-08T08:19:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on too few osds = false 2023-12-08T08:19:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-08T08:19:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-08T08:19:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: mon_allow_pool_size_one = true 2023-12-08T08:19:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-08T08:19:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: osd default data pool replay window = 5 2023-12-08T08:19:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: mon allow pool delete = true 2023-12-08T08:19:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.907 INFO:teuthology.orchestra.run.smithi088.stdout: mon cluster log file level = debug 2023-12-08T08:19:20.907 INFO:teuthology.orchestra.run.smithi088.stdout: debug asserts on shutdown = true 2023-12-08T08:19:20.907 INFO:teuthology.orchestra.run.smithi088.stdout: mon health detail to clog = false 2023-12-08T08:19:20.907 INFO:teuthology.orchestra.run.smithi088.stdout: mon host = "172.21.15.88,172.21.15.148,[v2:172.21.15.148:3301,v1:172.21.15.148:6790]" 2023-12-08T08:19:20.907 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on skipped message = False 2023-12-08T08:19:20.907 INFO:teuthology.orchestra.run.smithi088.stdout: fsid = 681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3 2023-12-08T08:19:20.907 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.907 INFO:teuthology.orchestra.run.smithi088.stdout:[osd] 2023-12-08T08:19:20.907 INFO:teuthology.orchestra.run.smithi088.stdout: osd journal size = 100 2023-12-08T08:19:20.907 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.907 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub load threshold = 5.0 2023-12-08T08:19:20.907 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub max interval = 600 2023-12-08T08:19:20.907 INFO:teuthology.orchestra.run.smithi088.stdout: osd mclock profile = high_recovery_ops 2023-12-08T08:19:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: osd recover clone overlap = true 2023-12-08T08:19:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: osd recovery max chunk = 1048576 2023-12-08T08:19:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug shutdown = true 2023-12-08T08:19:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug op order = true 2023-12-08T08:19:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug verify stray on activate = true 2023-12-08T08:19:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug trim objects = true 2023-12-08T08:19:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: osd open classes on start = true 2023-12-08T08:19:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug pg log writeout = true 2023-12-08T08:19:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: osd deep scrub update digest min age = 30 2023-12-08T08:19:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: osd map max advance = 10 2023-12-08T08:19:20.909 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.909 INFO:teuthology.orchestra.run.smithi088.stdout: journal zero on create = true 2023-12-08T08:19:20.909 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.909 INFO:teuthology.orchestra.run.smithi088.stdout: filestore ondisk finisher threads = 3 2023-12-08T08:19:20.909 INFO:teuthology.orchestra.run.smithi088.stdout: filestore apply finisher threads = 3 2023-12-08T08:19:20.909 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.909 INFO:teuthology.orchestra.run.smithi088.stdout: bdev debug aio = true 2023-12-08T08:19:20.909 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug misdirected ops = true 2023-12-08T08:19:20.909 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore block size = 96636764160 2023-12-08T08:19:20.909 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore compression mode = aggressive 2023-12-08T08:19:20.910 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore fsck on mount = True 2023-12-08T08:19:20.910 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluefs = 20 2023-12-08T08:19:20.910 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluestore = 20 2023-12-08T08:19:20.910 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-12-08T08:19:20.910 INFO:teuthology.orchestra.run.smithi088.stdout: debug osd = 20 2023-12-08T08:19:20.910 INFO:teuthology.orchestra.run.smithi088.stdout: debug rocksdb = 10 2023-12-08T08:19:20.910 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd backfillfull_ratio = 0.85 2023-12-08T08:19:20.910 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd full ratio = 0.9 2023-12-08T08:19:20.910 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd nearfull ratio = 0.8 2023-12-08T08:19:20.910 INFO:teuthology.orchestra.run.smithi088.stdout: osd failsafe full ratio = 0.95 2023-12-08T08:19:20.910 INFO:teuthology.orchestra.run.smithi088.stdout: osd objectstore = bluestore 2023-12-08T08:19:20.910 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2023-12-08T08:19:20.910 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.910 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr] 2023-12-08T08:19:20.911 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-12-08T08:19:20.911 INFO:teuthology.orchestra.run.smithi088.stdout: debug mgr = 20 2023-12-08T08:19:20.911 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2023-12-08T08:19:20.911 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2023-12-08T08:19:20.911 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2023-12-08T08:19:20.911 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2023-12-08T08:19:20.911 INFO:teuthology.orchestra.run.smithi088.stdout: mgr/telemetry/nag = false 2023-12-08T08:19:20.911 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.911 INFO:teuthology.orchestra.run.smithi088.stdout:[mon] 2023-12-08T08:19:20.911 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-12-08T08:19:20.911 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2023-12-08T08:19:20.911 INFO:teuthology.orchestra.run.smithi088.stdout: debug paxos = 20 2023-12-08T08:19:20.911 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2023-12-08T08:19:20.911 INFO:teuthology.orchestra.run.smithi088.stdout: mon data avail warn = 5 2023-12-08T08:19:20.911 INFO:teuthology.orchestra.run.smithi088.stdout: mon mgr mkfs grace = 240 2023-12-08T08:19:20.912 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2023-12-08T08:19:20.912 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd reporter subtree level = osd 2023-12-08T08:19:20.912 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd prime pg temp = true 2023-12-08T08:19:20.912 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2023-12-08T08:19:20.912 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.912 INFO:teuthology.orchestra.run.smithi088.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-08T08:19:20.912 INFO:teuthology.orchestra.run.smithi088.stdout: auth mon ticket ttl = 660 # 11m 2023-12-08T08:19:20.912 INFO:teuthology.orchestra.run.smithi088.stdout: auth service ticket ttl = 240 # 4m 2023-12-08T08:19:20.912 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.912 INFO:teuthology.orchestra.run.smithi088.stdout: # don't complain about insecure global_id in the test suite 2023-12-08T08:19:20.912 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-08T08:19:20.912 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-08T08:19:20.912 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.912 INFO:teuthology.orchestra.run.smithi088.stdout: # 1m isn't quite enough 2023-12-08T08:19:20.912 INFO:teuthology.orchestra.run.smithi088.stdout: mon_down_mkfs_grace = 2m 2023-12-08T08:19:20.913 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.913 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_filestore_osds = false 2023-12-08T08:19:20.913 INFO:teuthology.orchestra.run.smithi088.stdout: mon op complaint time = 120 2023-12-08T08:19:20.913 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:20.913 INFO:teuthology.orchestra.run.smithi088.stdout:[client] 2023-12-08T08:19:20.913 INFO:teuthology.orchestra.run.smithi088.stdout: rgw cache enabled = true 2023-12-08T08:19:20.913 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable ops log = true 2023-12-08T08:19:20.913 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable usage log = true 2023-12-08T08:19:20.913 INFO:teuthology.orchestra.run.smithi088.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-08T08:19:20.913 INFO:teuthology.orchestra.run.smithi088.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-08T08:19:20.913 INFO:teuthology.orchestra.run.smithi088.stdout: client mount timeout = 600 2023-12-08T08:19:20.913 INFO:teuthology.orchestra.run.smithi088.stdout: debug client = 20 2023-12-08T08:19:20.913 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-12-08T08:19:20.913 INFO:teuthology.orchestra.run.smithi088.stdout: rados mon op timeout = 900 2023-12-08T08:19:20.913 INFO:teuthology.orchestra.run.smithi088.stdout: rados osd op timeout = 900 2023-12-08T08:19:20.914 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.a] 2023-12-08T08:19:20.914 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.b] 2023-12-08T08:19:20.914 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.c] 2023-12-08T08:19:20.914 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2023-12-08T08:19:20.914 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.c] 2023-12-08T08:19:20.914 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.b] 2023-12-08T08:19:20.914 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.d] 2023-12-08T08:19:20.914 INFO:teuthology.orchestra.run.smithi088.stdout:[mds] 2023-12-08T08:19:20.914 INFO:teuthology.orchestra.run.smithi088.stdout: debug mds = 20 2023-12-08T08:19:20.914 INFO:teuthology.orchestra.run.smithi088.stdout: debug mds balancer = 20 2023-12-08T08:19:20.914 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-12-08T08:19:20.914 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug frag = True 2023-12-08T08:19:20.914 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug scatterstat = True 2023-12-08T08:19:20.914 INFO:teuthology.orchestra.run.smithi088.stdout: mds op complaint time = 180 2023-12-08T08:19:20.915 INFO:teuthology.orchestra.run.smithi088.stdout: mds verify scatter = True 2023-12-08T08:19:20.915 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2023-12-08T08:19:20.915 INFO:teuthology.orchestra.run.smithi088.stdout: rados mon op timeout = 900 2023-12-08T08:19:20.915 INFO:teuthology.orchestra.run.smithi088.stdout: rados osd op timeout = 900 2023-12-08T08:19:20.916 INFO:teuthology.orchestra.run.smithi148.stdout:[global] 2023-12-08T08:19:20.916 INFO:teuthology.orchestra.run.smithi148.stdout: chdir = "" 2023-12-08T08:19:20.916 INFO:teuthology.orchestra.run.smithi148.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-08T08:19:20.916 INFO:teuthology.orchestra.run.smithi148.stdout: auth supported = cephx 2023-12-08T08:19:20.916 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.916 INFO:teuthology.orchestra.run.smithi148.stdout: filestore xattr use omap = true 2023-12-08T08:19:20.916 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.916 INFO:teuthology.orchestra.run.smithi148.stdout: mon clock drift allowed = 1.000 2023-12-08T08:19:20.916 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.916 INFO:teuthology.orchestra.run.smithi148.stdout: osd crush chooseleaf type = 0 2023-12-08T08:19:20.916 INFO:teuthology.orchestra.run.smithi148.stdout: auth debug = true 2023-12-08T08:19:20.916 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.917 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on old message = true 2023-12-08T08:19:20.917 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on bug = true 2023-12-08T08:19:20.917 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.917 INFO:teuthology.orchestra.run.smithi148.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-08T08:19:20.917 INFO:teuthology.orchestra.run.smithi148.stdout: mon pg warn max object skew = 0 2023-12-08T08:19:20.917 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.917 INFO:teuthology.orchestra.run.smithi148.stdout: # disable pg_autoscaler by default for new pools 2023-12-08T08:19:20.917 INFO:teuthology.orchestra.run.smithi148.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-08T08:19:20.917 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.917 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default size = 2 2023-12-08T08:19:20.917 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.917 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow primary affinity = true 2023-12-08T08:19:20.917 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow pg remap = true 2023-12-08T08:19:20.917 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on legacy crush tunables = false 2023-12-08T08:19:20.918 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on crush straw calc version zero = false 2023-12-08T08:19:20.918 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on no sortbitwise = false 2023-12-08T08:19:20.918 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on osd down out interval zero = false 2023-12-08T08:19:20.918 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on too few osds = false 2023-12-08T08:19:20.918 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-08T08:19:20.918 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-08T08:19:20.918 INFO:teuthology.orchestra.run.smithi148.stdout: mon_allow_pool_size_one = true 2023-12-08T08:19:20.918 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.918 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-08T08:19:20.918 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.918 INFO:teuthology.orchestra.run.smithi148.stdout: osd default data pool replay window = 5 2023-12-08T08:19:20.918 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.918 INFO:teuthology.orchestra.run.smithi148.stdout: mon allow pool delete = true 2023-12-08T08:19:20.918 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.919 INFO:teuthology.orchestra.run.smithi148.stdout: mon cluster log file level = debug 2023-12-08T08:19:20.919 INFO:teuthology.orchestra.run.smithi148.stdout: debug asserts on shutdown = true 2023-12-08T08:19:20.919 INFO:teuthology.orchestra.run.smithi148.stdout: mon health detail to clog = false 2023-12-08T08:19:20.919 INFO:teuthology.orchestra.run.smithi148.stdout: mon host = "172.21.15.88,172.21.15.148,[v2:172.21.15.148:3301,v1:172.21.15.148:6790]" 2023-12-08T08:19:20.919 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on skipped message = False 2023-12-08T08:19:20.919 INFO:teuthology.orchestra.run.smithi148.stdout: fsid = 681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3 2023-12-08T08:19:20.919 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.919 INFO:teuthology.orchestra.run.smithi148.stdout:[osd] 2023-12-08T08:19:20.919 INFO:teuthology.orchestra.run.smithi148.stdout: osd journal size = 100 2023-12-08T08:19:20.919 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.919 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub load threshold = 5.0 2023-12-08T08:19:20.919 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub max interval = 600 2023-12-08T08:19:20.919 INFO:teuthology.orchestra.run.smithi148.stdout: osd mclock profile = high_recovery_ops 2023-12-08T08:19:20.919 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.919 INFO:teuthology.orchestra.run.smithi148.stdout: osd recover clone overlap = true 2023-12-08T08:19:20.920 INFO:teuthology.orchestra.run.smithi148.stdout: osd recovery max chunk = 1048576 2023-12-08T08:19:20.920 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.920 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug shutdown = true 2023-12-08T08:19:20.920 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug op order = true 2023-12-08T08:19:20.920 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug verify stray on activate = true 2023-12-08T08:19:20.920 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug trim objects = true 2023-12-08T08:19:20.920 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.920 INFO:teuthology.orchestra.run.smithi148.stdout: osd open classes on start = true 2023-12-08T08:19:20.920 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug pg log writeout = true 2023-12-08T08:19:20.920 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.920 INFO:teuthology.orchestra.run.smithi148.stdout: osd deep scrub update digest min age = 30 2023-12-08T08:19:20.920 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.920 INFO:teuthology.orchestra.run.smithi148.stdout: osd map max advance = 10 2023-12-08T08:19:20.920 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.921 INFO:teuthology.orchestra.run.smithi148.stdout: journal zero on create = true 2023-12-08T08:19:20.921 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.921 INFO:teuthology.orchestra.run.smithi148.stdout: filestore ondisk finisher threads = 3 2023-12-08T08:19:20.921 INFO:teuthology.orchestra.run.smithi148.stdout: filestore apply finisher threads = 3 2023-12-08T08:19:20.921 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.921 INFO:teuthology.orchestra.run.smithi148.stdout: bdev debug aio = true 2023-12-08T08:19:20.921 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug misdirected ops = true 2023-12-08T08:19:20.921 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore block size = 96636764160 2023-12-08T08:19:20.921 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore compression mode = aggressive 2023-12-08T08:19:20.921 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore fsck on mount = True 2023-12-08T08:19:20.921 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluefs = 20 2023-12-08T08:19:20.921 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluestore = 20 2023-12-08T08:19:20.921 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2023-12-08T08:19:20.921 INFO:teuthology.orchestra.run.smithi148.stdout: debug osd = 20 2023-12-08T08:19:20.921 INFO:teuthology.orchestra.run.smithi148.stdout: debug rocksdb = 10 2023-12-08T08:19:20.922 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd backfillfull_ratio = 0.85 2023-12-08T08:19:20.922 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd full ratio = 0.9 2023-12-08T08:19:20.922 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd nearfull ratio = 0.8 2023-12-08T08:19:20.922 INFO:teuthology.orchestra.run.smithi148.stdout: osd failsafe full ratio = 0.95 2023-12-08T08:19:20.922 INFO:teuthology.orchestra.run.smithi148.stdout: osd objectstore = bluestore 2023-12-08T08:19:20.922 INFO:teuthology.orchestra.run.smithi148.stdout: osd op complaint time = 180 2023-12-08T08:19:20.922 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.922 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr] 2023-12-08T08:19:20.922 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2023-12-08T08:19:20.922 INFO:teuthology.orchestra.run.smithi148.stdout: debug mgr = 20 2023-12-08T08:19:20.922 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2023-12-08T08:19:20.922 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2023-12-08T08:19:20.922 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2023-12-08T08:19:20.922 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2023-12-08T08:19:20.923 INFO:teuthology.orchestra.run.smithi148.stdout: mgr/telemetry/nag = false 2023-12-08T08:19:20.923 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.923 INFO:teuthology.orchestra.run.smithi148.stdout:[mon] 2023-12-08T08:19:20.923 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2023-12-08T08:19:20.923 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2023-12-08T08:19:20.923 INFO:teuthology.orchestra.run.smithi148.stdout: debug paxos = 20 2023-12-08T08:19:20.923 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2023-12-08T08:19:20.923 INFO:teuthology.orchestra.run.smithi148.stdout: mon data avail warn = 5 2023-12-08T08:19:20.923 INFO:teuthology.orchestra.run.smithi148.stdout: mon mgr mkfs grace = 240 2023-12-08T08:19:20.923 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2023-12-08T08:19:20.923 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd reporter subtree level = osd 2023-12-08T08:19:20.923 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd prime pg temp = true 2023-12-08T08:19:20.923 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2023-12-08T08:19:20.923 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.923 INFO:teuthology.orchestra.run.smithi148.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-08T08:19:20.924 INFO:teuthology.orchestra.run.smithi148.stdout: auth mon ticket ttl = 660 # 11m 2023-12-08T08:19:20.924 INFO:teuthology.orchestra.run.smithi148.stdout: auth service ticket ttl = 240 # 4m 2023-12-08T08:19:20.924 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.924 INFO:teuthology.orchestra.run.smithi148.stdout: # don't complain about insecure global_id in the test suite 2023-12-08T08:19:20.924 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-08T08:19:20.924 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-08T08:19:20.924 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.924 INFO:teuthology.orchestra.run.smithi148.stdout: # 1m isn't quite enough 2023-12-08T08:19:20.924 INFO:teuthology.orchestra.run.smithi148.stdout: mon_down_mkfs_grace = 2m 2023-12-08T08:19:20.924 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.924 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_filestore_osds = false 2023-12-08T08:19:20.924 INFO:teuthology.orchestra.run.smithi148.stdout: mon op complaint time = 120 2023-12-08T08:19:20.924 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-08T08:19:20.924 INFO:teuthology.orchestra.run.smithi148.stdout:[client] 2023-12-08T08:19:20.924 INFO:teuthology.orchestra.run.smithi148.stdout: rgw cache enabled = true 2023-12-08T08:19:20.925 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable ops log = true 2023-12-08T08:19:20.925 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable usage log = true 2023-12-08T08:19:20.925 INFO:teuthology.orchestra.run.smithi148.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-08T08:19:20.925 INFO:teuthology.orchestra.run.smithi148.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-08T08:19:20.925 INFO:teuthology.orchestra.run.smithi148.stdout: client mount timeout = 600 2023-12-08T08:19:20.925 INFO:teuthology.orchestra.run.smithi148.stdout: debug client = 20 2023-12-08T08:19:20.925 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2023-12-08T08:19:20.925 INFO:teuthology.orchestra.run.smithi148.stdout: rados mon op timeout = 900 2023-12-08T08:19:20.925 INFO:teuthology.orchestra.run.smithi148.stdout: rados osd op timeout = 900 2023-12-08T08:19:20.925 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.a] 2023-12-08T08:19:20.925 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.b] 2023-12-08T08:19:20.925 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.c] 2023-12-08T08:19:20.925 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.a] 2023-12-08T08:19:20.925 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.c] 2023-12-08T08:19:20.925 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.b] 2023-12-08T08:19:20.926 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.d] 2023-12-08T08:19:20.926 INFO:teuthology.orchestra.run.smithi148.stdout:[mds] 2023-12-08T08:19:20.926 INFO:teuthology.orchestra.run.smithi148.stdout: debug mds = 20 2023-12-08T08:19:20.926 INFO:teuthology.orchestra.run.smithi148.stdout: debug mds balancer = 20 2023-12-08T08:19:20.926 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2023-12-08T08:19:20.926 INFO:teuthology.orchestra.run.smithi148.stdout: mds debug frag = True 2023-12-08T08:19:20.926 INFO:teuthology.orchestra.run.smithi148.stdout: mds debug scatterstat = True 2023-12-08T08:19:20.926 INFO:teuthology.orchestra.run.smithi148.stdout: mds op complaint time = 180 2023-12-08T08:19:20.926 INFO:teuthology.orchestra.run.smithi148.stdout: mds verify scatter = True 2023-12-08T08:19:20.926 INFO:teuthology.orchestra.run.smithi148.stdout: osd op complaint time = 180 2023-12-08T08:19:20.926 INFO:teuthology.orchestra.run.smithi148.stdout: rados mon op timeout = 900 2023-12-08T08:19:20.926 INFO:teuthology.orchestra.run.smithi148.stdout: rados osd op timeout = 900 2023-12-08T08:19:20.928 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-08T08:19:20.928 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-08T08:19:21.028 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-08T08:19:21.028 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:19:21.028 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-08T08:19:21.037 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:19:21.037 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-08T08:19:21.087 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi088.front.sepia.ceph.com 2023-12-08T08:19:21.088 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:19:21.088 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-08T08:19:21.088 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-08T08:19:21.163 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:19:21.163 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:19:21.215 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi148.front.sepia.ceph.com 2023-12-08T08:19:21.215 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:19:21.216 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-08T08:19:21.216 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-08T08:19:21.251 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:19:21.252 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:19:21.301 INFO:tasks.ceph:Setting up mon nodes... 2023-12-08T08:19:21.301 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-08T08:19:21.301 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-08T08:19:21.357 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-08T08:19:21.362 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-08T08:19:21.421 INFO:teuthology.orchestra.run.smithi148.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-08T08:19:21.439 INFO:tasks.ceph:Setting up mds nodes... 2023-12-08T08:19:21.439 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-08T08:19:21.498 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-08T08:19:21.502 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-08T08:19:21.523 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-08T08:19:21.617 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-08T08:19:21.621 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-08T08:19:21.641 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-08T08:19:21.700 INFO:teuthology.orchestra.run.smithi148.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-08T08:19:21.704 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-08T08:19:21.726 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-08T08:19:21.823 INFO:teuthology.orchestra.run.smithi148.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-08T08:19:21.829 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-08T08:19:21.850 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-08T08:19:21.850 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-08T08:19:21.894 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-08T08:19:21.911 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-08T08:19:21.953 INFO:teuthology.orchestra.run.smithi148.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-08T08:19:21.970 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-08T08:19:21.970 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi148.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-08T08:19:21.971 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-08T08:19:21.991 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-08T08:19:21.991 INFO:tasks.ceph:role: osd.0 2023-12-08T08:19:21.991 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com 2023-12-08T08:19:21.991 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-08T08:19:22.059 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T08:19:22.059 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T08:19:22.059 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T08:19:22.059 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-08T08:19:22.059 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T08:19:22.059 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-12-08T08:19:22.059 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T08:19:22.060 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-08T08:19:22.060 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T08:19:22.060 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T08:19:22.514 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-12-08T08:19:22.516 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-12-08T08:19:22.517 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-08T08:19:22.630 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-08T08:19:22.647 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: /sbin/restorecon: command not found 2023-12-08T08:19:22.647 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:19:22.648 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-08T08:19:22.715 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-08T08:19:22.715 INFO:tasks.ceph:role: osd.1 2023-12-08T08:19:22.715 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com 2023-12-08T08:19:22.715 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-08T08:19:22.787 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T08:19:22.788 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T08:19:22.788 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T08:19:22.788 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-08T08:19:22.788 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T08:19:22.788 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-12-08T08:19:22.788 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T08:19:22.788 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-08T08:19:22.788 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T08:19:22.788 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T08:19:23.284 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-12-08T08:19:23.287 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-12-08T08:19:23.287 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-08T08:19:23.427 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-08T08:19:23.445 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: /sbin/restorecon: command not found 2023-12-08T08:19:23.445 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:19:23.446 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-08T08:19:23.509 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-08T08:19:23.509 INFO:tasks.ceph:role: osd.2 2023-12-08T08:19:23.509 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com 2023-12-08T08:19:23.509 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-08T08:19:23.580 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T08:19:23.580 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T08:19:23.580 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T08:19:23.580 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-08T08:19:23.580 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T08:19:23.580 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-12-08T08:19:23.581 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T08:19:23.581 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-08T08:19:23.581 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T08:19:23.581 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T08:19:24.045 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-12-08T08:19:24.048 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-12-08T08:19:24.048 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-08T08:19:24.169 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-08T08:19:24.186 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: /sbin/restorecon: command not found 2023-12-08T08:19:24.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:19:24.187 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-08T08:19:24.252 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-08T08:19:24.252 INFO:tasks.ceph:role: osd.3 2023-12-08T08:19:24.252 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com 2023-12-08T08:19:24.252 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-08T08:19:24.324 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T08:19:24.324 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T08:19:24.324 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T08:19:24.324 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-08T08:19:24.324 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T08:19:24.324 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-12-08T08:19:24.324 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T08:19:24.324 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-08T08:19:24.324 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T08:19:24.324 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T08:19:24.758 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-12-08T08:19:24.761 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-12-08T08:19:24.761 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-08T08:19:24.859 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-08T08:19:24.876 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: /sbin/restorecon: command not found 2023-12-08T08:19:24.877 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:19:24.877 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:19:24.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:24.992+0000 7f538a8e2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-08T08:19:25.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:24.996+0000 7f538a8e2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-08T08:19:25.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:24.996+0000 7f538a8e2640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-08T08:19:25.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:24.996+0000 7f538a8e2640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-08T08:19:25.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:24.996+0000 7f538a8e2640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-08T08:19:25.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:24.996+0000 7f538a8e2640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-08T08:19:27.995 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-08T08:19:28.017 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:19:28.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:28.112+0000 7f92ee42d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-08T08:19:28.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:28.112+0000 7f92ee42d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-08T08:19:28.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:28.112+0000 7f92ee42d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-08T08:19:28.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:28.112+0000 7f92ee42d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-08T08:19:28.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:28.112+0000 7f92ee42d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-08T08:19:28.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:28.116+0000 7f92ee42d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-08T08:19:31.099 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-08T08:19:31.120 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:19:31.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:31.220+0000 7fb06a439640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-08T08:19:31.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:31.220+0000 7fb06a439640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-08T08:19:31.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:31.220+0000 7fb06a439640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-08T08:19:31.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:31.220+0000 7fb06a439640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-08T08:19:31.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:31.220+0000 7fb06a439640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-08T08:19:31.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:31.220+0000 7fb06a439640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-08T08:19:34.211 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-08T08:19:34.232 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:19:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:34.328+0000 7fa520cda640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-08T08:19:34.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:34.328+0000 7fa520cda640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-08T08:19:34.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:34.328+0000 7fa520cda640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-08T08:19:34.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:34.328+0000 7fa520cda640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-08T08:19:34.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:34.328+0000 7fa520cda640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-08T08:19:34.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:34.328+0000 7fa520cda640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-08T08:19:37.337 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-08T08:19:37.358 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-08T08:19:37.381 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-08T08:19:37.381 INFO:tasks.ceph:role: osd.4 2023-12-08T08:19:37.381 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi148.front.sepia.ceph.com 2023-12-08T08:19:37.381 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-08T08:19:37.457 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T08:19:37.457 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T08:19:37.458 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T08:19:37.458 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-08T08:19:37.458 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T08:19:37.458 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2023-12-08T08:19:37.458 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T08:19:37.458 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-08T08:19:37.458 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T08:19:37.458 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T08:19:37.932 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2023-12-08T08:19:37.935 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2023-12-08T08:19:37.935 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-08T08:19:38.083 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-08T08:19:38.101 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: /sbin/restorecon: command not found 2023-12-08T08:19:38.102 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:19:38.102 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-08T08:19:38.165 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-08T08:19:38.165 INFO:tasks.ceph:role: osd.5 2023-12-08T08:19:38.165 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi148.front.sepia.ceph.com 2023-12-08T08:19:38.165 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-08T08:19:38.236 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T08:19:38.237 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T08:19:38.237 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T08:19:38.237 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-08T08:19:38.237 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T08:19:38.237 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2023-12-08T08:19:38.237 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T08:19:38.237 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-08T08:19:38.237 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T08:19:38.237 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T08:19:38.675 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2023-12-08T08:19:38.678 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2023-12-08T08:19:38.678 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-08T08:19:38.777 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-08T08:19:38.795 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: /sbin/restorecon: command not found 2023-12-08T08:19:38.795 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:19:38.796 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-08T08:19:38.866 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-08T08:19:38.866 INFO:tasks.ceph:role: osd.6 2023-12-08T08:19:38.866 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi148.front.sepia.ceph.com 2023-12-08T08:19:38.866 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-08T08:19:38.941 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T08:19:38.942 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T08:19:38.942 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T08:19:38.942 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-08T08:19:38.942 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T08:19:38.942 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2023-12-08T08:19:38.942 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T08:19:38.942 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-08T08:19:38.942 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T08:19:38.942 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T08:19:39.408 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2023-12-08T08:19:39.412 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2023-12-08T08:19:39.412 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-08T08:19:39.574 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-08T08:19:39.592 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: /sbin/restorecon: command not found 2023-12-08T08:19:39.592 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:19:39.593 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-08T08:19:39.658 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-08T08:19:39.658 INFO:tasks.ceph:role: osd.7 2023-12-08T08:19:39.658 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi148.front.sepia.ceph.com 2023-12-08T08:19:39.658 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-08T08:19:39.729 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T08:19:39.729 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T08:19:39.729 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T08:19:39.730 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-08T08:19:39.730 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T08:19:39.730 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2023-12-08T08:19:39.730 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T08:19:39.730 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-08T08:19:39.730 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T08:19:39.730 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T08:19:40.210 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2023-12-08T08:19:40.213 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2023-12-08T08:19:40.214 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-08T08:19:40.383 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-08T08:19:40.402 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: /sbin/restorecon: command not found 2023-12-08T08:19:40.402 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:19:40.403 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:19:40.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:40.527+0000 7ff155b05640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-08T08:19:40.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:40.527+0000 7ff155b05640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-08T08:19:40.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:40.527+0000 7ff155b05640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-08T08:19:40.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:40.527+0000 7ff155b05640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-08T08:19:40.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:40.527+0000 7ff155b05640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-08T08:19:40.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:40.531+0000 7ff155b05640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-08T08:19:43.512 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-08T08:19:43.533 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:19:43.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:43.627+0000 7f2d6cfe8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-08T08:19:43.632 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:43.631+0000 7f2d6cfe8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-08T08:19:43.632 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:43.631+0000 7f2d6cfe8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-08T08:19:43.632 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:43.631+0000 7f2d6cfe8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-08T08:19:43.632 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:43.631+0000 7f2d6cfe8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-08T08:19:43.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:43.631+0000 7f2d6cfe8640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-08T08:19:46.612 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-08T08:19:46.633 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:19:46.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:46.731+0000 7f829f2b6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-08T08:19:46.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:46.731+0000 7f829f2b6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-08T08:19:46.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:46.731+0000 7f829f2b6640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-08T08:19:46.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:46.731+0000 7f829f2b6640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-08T08:19:46.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:46.731+0000 7f829f2b6640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-08T08:19:46.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:46.735+0000 7f829f2b6640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-08T08:19:48.926 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:19:48.930 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:19:49.721 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-08T08:19:49.742 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:19:49.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:49.839+0000 7efc253b0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-08T08:19:49.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:49.839+0000 7efc253b0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-08T08:19:49.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:49.839+0000 7efc253b0640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-08T08:19:49.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:49.839+0000 7efc253b0640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-08T08:19:49.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:49.839+0000 7efc253b0640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-08T08:19:49.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:49.839+0000 7efc253b0640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-08T08:19:52.852 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-08T08:19:52.874 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-08T08:19:52.874 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:19:52.874 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-08T08:19:52.898 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:19:52.898 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-08T08:19:52.960 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:19:52.960 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-08T08:19:53.024 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:19:53.024 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-08T08:19:53.087 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:19:53.088 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-08T08:19:53.151 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:19:53.151 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-08T08:19:53.215 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:19:53.215 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-08T08:19:53.279 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:19:53.279 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-08T08:19:53.301 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:19:53.301 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-08T08:19:53.365 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:19:53.365 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-08T08:19:53.433 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:19:53.433 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-08T08:19:53.497 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:19:53.497 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-08T08:19:53.565 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:19:53.565 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-08T08:19:53.629 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:19:53.629 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-08T08:19:53.693 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:19:53.693 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-08T08:19:53.702 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:19:53.702 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-08T08:19:53.744 INFO:tasks.ceph:Adding keys to all mons... 2023-12-08T08:19:53.744 DEBUG:teuthology.orchestra.run.smithi088:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-08T08:19:53.750 DEBUG:teuthology.orchestra.run.smithi148:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-08T08:19:53.796 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.y] 2023-12-08T08:19:53.796 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCJ0XJlIJRaFRAALL9eP2riyJXD1ZixzxpiWw== 2023-12-08T08:19:53.796 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2023-12-08T08:19:53.796 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCJ0XJloTK6HRAAu8n+gz+R9g+apHf4wBCxeQ== 2023-12-08T08:19:53.796 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.c] 2023-12-08T08:19:53.796 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCJ0XJlDhLZJBAACSOMzN+IeMzMVLNekOe7dw== 2023-12-08T08:19:53.797 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.0] 2023-12-08T08:19:53.797 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCM0XJlWUyMOxAA6Q7lleuO31iXvAYMe7LWNw== 2023-12-08T08:19:53.797 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.1] 2023-12-08T08:19:53.797 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCQ0XJlc0EeBxAA+a5ftRhbAX9Re+hWg9dLsQ== 2023-12-08T08:19:53.797 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.2] 2023-12-08T08:19:53.797 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCT0XJlZAYzDRAAXGdagNNhMTiFIzHDaKgFQg== 2023-12-08T08:19:53.797 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.3] 2023-12-08T08:19:53.797 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCW0XJlGa+gExAA/BQ9Po66U86hYML+eMjuUQ== 2023-12-08T08:19:53.797 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.x] 2023-12-08T08:19:53.797 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCJ0XJl4fEwGRAA7AYI8JM8WALXPX5s5d4ybg== 2023-12-08T08:19:53.797 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.b] 2023-12-08T08:19:53.797 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCJ0XJlrbnLKRAAO9XhdXDMFK67UwNQyAt2gg== 2023-12-08T08:19:53.797 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.d] 2023-12-08T08:19:53.797 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCJ0XJlWdgsMRAAuaC4T6rzN3zYLCszue26tw== 2023-12-08T08:19:53.798 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.4] 2023-12-08T08:19:53.798 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCc0XJlvrSlHxAAEabqt1NzUyyON8/eGwqo1Q== 2023-12-08T08:19:53.798 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.5] 2023-12-08T08:19:53.798 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCf0XJl0W+8JRAA8Twf/r3v6rJWcXMfLT0LCA== 2023-12-08T08:19:53.798 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.6] 2023-12-08T08:19:53.798 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCi0XJljGjUKxAAOgrH0WvuIwuzZsgOki/fsA== 2023-12-08T08:19:53.798 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.7] 2023-12-08T08:19:53.798 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCl0XJl5NI2MhAA2zOJ9DGnD4JtXTfmVjgkmw== 2023-12-08T08:19:53.798 INFO:teuthology.orchestra.run.smithi088.stdout:[client.0] 2023-12-08T08:19:53.798 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCJ0XJlCC1UNRAARGaNCoJFAvsCcXsQY6BjFg== 2023-12-08T08:19:53.798 INFO:teuthology.orchestra.run.smithi088.stdout:[client.1] 2023-12-08T08:19:53.798 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCJ0XJld2rjOBAAUnEIBuqXHktNpqFW/Ikf7g== 2023-12-08T08:19:53.811 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr.y] 2023-12-08T08:19:53.811 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCJ0XJlIJRaFRAALL9eP2riyJXD1ZixzxpiWw== 2023-12-08T08:19:53.811 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.a] 2023-12-08T08:19:53.811 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCJ0XJloTK6HRAAu8n+gz+R9g+apHf4wBCxeQ== 2023-12-08T08:19:53.811 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.c] 2023-12-08T08:19:53.811 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCJ0XJlDhLZJBAACSOMzN+IeMzMVLNekOe7dw== 2023-12-08T08:19:53.811 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.0] 2023-12-08T08:19:53.811 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCM0XJlWUyMOxAA6Q7lleuO31iXvAYMe7LWNw== 2023-12-08T08:19:53.812 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.1] 2023-12-08T08:19:53.812 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCQ0XJlc0EeBxAA+a5ftRhbAX9Re+hWg9dLsQ== 2023-12-08T08:19:53.812 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.2] 2023-12-08T08:19:53.812 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCT0XJlZAYzDRAAXGdagNNhMTiFIzHDaKgFQg== 2023-12-08T08:19:53.812 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.3] 2023-12-08T08:19:53.812 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCW0XJlGa+gExAA/BQ9Po66U86hYML+eMjuUQ== 2023-12-08T08:19:53.812 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr.x] 2023-12-08T08:19:53.812 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCJ0XJl4fEwGRAA7AYI8JM8WALXPX5s5d4ybg== 2023-12-08T08:19:53.812 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.b] 2023-12-08T08:19:53.812 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCJ0XJlrbnLKRAAO9XhdXDMFK67UwNQyAt2gg== 2023-12-08T08:19:53.812 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.d] 2023-12-08T08:19:53.812 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCJ0XJlWdgsMRAAuaC4T6rzN3zYLCszue26tw== 2023-12-08T08:19:53.812 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.4] 2023-12-08T08:19:53.812 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCc0XJlvrSlHxAAEabqt1NzUyyON8/eGwqo1Q== 2023-12-08T08:19:53.813 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.5] 2023-12-08T08:19:53.813 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCf0XJl0W+8JRAA8Twf/r3v6rJWcXMfLT0LCA== 2023-12-08T08:19:53.813 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.6] 2023-12-08T08:19:53.813 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCi0XJljGjUKxAAOgrH0WvuIwuzZsgOki/fsA== 2023-12-08T08:19:53.813 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.7] 2023-12-08T08:19:53.813 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCl0XJl5NI2MhAA2zOJ9DGnD4JtXTfmVjgkmw== 2023-12-08T08:19:53.813 INFO:teuthology.orchestra.run.smithi148.stdout:[client.0] 2023-12-08T08:19:53.813 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCJ0XJlCC1UNRAARGaNCoJFAvsCcXsQY6BjFg== 2023-12-08T08:19:53.813 INFO:teuthology.orchestra.run.smithi148.stdout:[client.1] 2023-12-08T08:19:53.813 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCJ0XJld2rjOBAAUnEIBuqXHktNpqFW/Ikf7g== 2023-12-08T08:19:53.814 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-08T08:19:53.846 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-08T08:19:53.913 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T08:19:53.917 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T08:19:53.976 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T08:19:53.980 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T08:19:54.037 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:19:54.040 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:19:54.094 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:19:54.097 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:19:54.151 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:19:54.155 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:19:54.208 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:19:54.212 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:19:54.265 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-08T08:19:54.269 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-08T08:19:54.323 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T08:19:54.326 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T08:19:54.384 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T08:19:54.388 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T08:19:54.444 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:19:54.447 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:19:54.502 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:19:54.505 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:19:54.560 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:19:54.563 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:19:54.618 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:19:54.622 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:19:54.677 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-08T08:19:54.681 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-08T08:19:54.738 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-08T08:19:54.741 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-08T08:19:54.799 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-08T08:19:54.799 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-08T08:19:54.820 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-08T08:19:54.936 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-08T08:19:54.957 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-08T08:19:54.978 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-08T08:19:55.095 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-08T08:19:55.116 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-08T08:19:55.183 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-08T08:19:55.300 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-08T08:19:55.321 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:19:55.325 DEBUG:teuthology.orchestra.run.smithi148:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:19:55.375 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-08T08:19:55.376 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-08T08:19:55.376 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-08T08:19:55.380 INFO:tasks.ceph.mon.a:Started 2023-12-08T08:19:55.380 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-08T08:19:55.380 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-08T08:19:55.427 INFO:tasks.ceph.mon.b:Started 2023-12-08T08:19:55.427 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-08T08:19:55.428 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-08T08:19:55.431 INFO:tasks.ceph.mon.c:Started 2023-12-08T08:19:55.431 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-08T08:19:55.431 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-08T08:19:55.432 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-08T08:19:55.435 INFO:tasks.ceph.mgr.y:Started 2023-12-08T08:19:55.435 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-08T08:19:55.435 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-08T08:19:55.438 INFO:tasks.ceph.mgr.x:Started 2023-12-08T08:19:55.439 INFO:tasks.ceph:Setting crush tunables to default 2023-12-08T08:19:55.439 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd crush tunables default 2023-12-08T08:19:55.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.576+0000 7fadc759e640 1 Processor -- start 2023-12-08T08:19:55.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.576+0000 7fadc759e640 1 -- start start 2023-12-08T08:19:55.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.576+0000 7fadc759e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fadc80ca330 0x7fadc80ca710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:55.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.576+0000 7fadc759e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc80c45a0 0x7fadc8154e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:55.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.576+0000 7fadc759e640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc8151e40 con 0x7fadc806c480 2023-12-08T08:19:55.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.576+0000 7fadc759e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc80c54b0 con 0x7fadc80ca330 2023-12-08T08:19:55.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.576+0000 7fadc759e640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc81553c0 con 0x7fadc80c45a0 2023-12-08T08:19:55.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.576+0000 7fadc659c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fadc80ca330 0x7fadc80ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:55.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.576+0000 7fadc659c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fadc80ca330 0x7fadc80ca710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37732/0 (socket says 172.21.15.88:37732) 2023-12-08T08:19:55.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.576+0000 7fadc659c640 1 -- 172.21.15.88:0/684245694 learned_addr learned my addr 172.21.15.88:0/684245694 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:19:55.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.576+0000 7fadbdd9b640 1 --2- 172.21.15.88:0/684245694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc80c45a0 0x7fadc8154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:55.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.576+0000 7fadc659c640 1 -- 172.21.15.88:0/684245694 >> v2:172.21.15.88:3300/0 conn(0x7fadc80ca330 msgr2=0x7fadc80ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-08T08:19:55.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.576+0000 7fadc659c640 1 -- 172.21.15.88:0/684245694 >> v2:172.21.15.88:3300/0 conn(0x7fadc80ca330 msgr2=0x7fadc80ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T08:19:55.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.576+0000 7fadc659c640 1 --2- 172.21.15.88:0/684245694 >> v2:172.21.15.88:3300/0 conn(0x7fadc80ca330 0x7fadc80ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T08:19:55.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.576+0000 7fadc659c640 1 --2- 172.21.15.88:0/684245694 >> v2:172.21.15.88:3300/0 conn(0x7fadc80ca330 0x7fadc80ca710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-08T08:19:55.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.576+0000 7fadbdd9b640 1 -- 172.21.15.88:0/684245694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc80c45a0 msgr2=0x7fadc8154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-08T08:19:55.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.576+0000 7fadbdd9b640 1 -- 172.21.15.88:0/684245694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc80c45a0 msgr2=0x7fadc8154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T08:19:55.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.576+0000 7fadbdd9b640 1 --2- 172.21.15.88:0/684245694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc80c45a0 0x7fadc8154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T08:19:55.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.576+0000 7fadbdd9b640 1 --2- 172.21.15.88:0/684245694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc80c45a0 0x7fadc8154e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-08T08:19:55.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.752+0000 7fadc5d9b640 1 -- 172.21.15.88:0/684245694 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937149766 0 0) 0x7fadc8151e40 con 0x7fadc806c480 2023-12-08T08:19:55.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.752+0000 7fadc5d9b640 1 -- 172.21.15.88:0/684245694 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadb4003530 con 0x7fadc806c480 2023-12-08T08:19:55.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.760+0000 7fadc5d9b640 1 -- 172.21.15.88:0/684245694 <== mon.1 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3297863730 0 0) 0x7fadb4003530 con 0x7fadc806c480 2023-12-08T08:19:55.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.760+0000 7fadc5d9b640 1 -- 172.21.15.88:0/684245694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc80c45a0 msgr2=0x7fadc8154e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-08T08:19:55.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.760+0000 7fadc5d9b640 1 --2- 172.21.15.88:0/684245694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc80c45a0 0x7fadc8154e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:55.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.760+0000 7fadc5d9b640 1 -- 172.21.15.88:0/684245694 >> v2:172.21.15.88:3300/0 conn(0x7fadc80ca330 msgr2=0x7fadc80ca710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-08T08:19:55.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.760+0000 7fadc5d9b640 1 --2- 172.21.15.88:0/684245694 >> v2:172.21.15.88:3300/0 conn(0x7fadc80ca330 0x7fadc80ca710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:55.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.760+0000 7fadc5d9b640 1 -- 172.21.15.88:0/684245694 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc806b9e0 con 0x7fadc806c480 2023-12-08T08:19:55.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.760+0000 7fadc5d9b640 1 -- 172.21.15.88:0/684245694 <== mon.1 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7fadc0001680 con 0x7fadc806c480 2023-12-08T08:19:55.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.760+0000 7fadc5d9b640 1 -- 172.21.15.88:0/684245694 >> v1:172.21.15.148:6789/0 conn(0x7fadc806c480 legacy=0x7fadc80c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:55.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.760+0000 7fadc5d9b640 1 --2- 172.21.15.88:0/684245694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadb4003980 0x7fadb4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:55.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.760+0000 7fadc5d9b640 1 --2- 172.21.15.88:0/684245694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc80c45a0 0x7fadb40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:55.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.760+0000 7fadc5d9b640 1 --2- 172.21.15.88:0/684245694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadb4004d10 0x7fadb4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:55.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.760+0000 7fadc5d9b640 1 -- 172.21.15.88:0/684245694 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc80c54b0 con 0x7fadb4004d10 2023-12-08T08:19:55.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.760+0000 7fadc5d9b640 1 -- 172.21.15.88:0/684245694 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc81553c0 con 0x7fadb4003980 2023-12-08T08:19:55.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.760+0000 7fadc5d9b640 1 -- 172.21.15.88:0/684245694 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb400bb50 con 0x7fadc80c45a0 2023-12-08T08:19:55.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.760+0000 7fadc6d9d640 1 --2- 172.21.15.88:0/684245694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadb4004d10 0x7fadb4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:55.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.760+0000 7fadbdd9b640 1 --2- 172.21.15.88:0/684245694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc80c45a0 0x7fadb40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:55.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.760+0000 7fadc659c640 1 --2- 172.21.15.88:0/684245694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadb4003980 0x7fadb4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:55.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.760+0000 7fadc6d9d640 1 -- 172.21.15.88:0/684245694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc80c45a0 msgr2=0x7fadb40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:55.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.760+0000 7fadc6d9d640 1 --2- 172.21.15.88:0/684245694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc80c45a0 0x7fadb40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:55.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.760+0000 7fadc6d9d640 1 -- 172.21.15.88:0/684245694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadb4003980 msgr2=0x7fadb4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:55.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.760+0000 7fadc6d9d640 1 --2- 172.21.15.88:0/684245694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadb4003980 0x7fadb4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:55.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.760+0000 7fadc6d9d640 1 -- 172.21.15.88:0/684245694 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb4003530 con 0x7fadb4004d10 2023-12-08T08:19:55.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.764+0000 7fadc6d9d640 1 --2- 172.21.15.88:0/684245694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadb4004d10 0x7fadb4005190 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fadc0007f30 tx=0x7fadc001cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165e01c412142740 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:55.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.764+0000 7fadc5d9b640 1 -- 172.21.15.88:0/684245694 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc00a59c0 con 0x7fadb4004d10 2023-12-08T08:19:55.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.764+0000 7fadc5d9b640 1 -- 172.21.15.88:0/684245694 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc00a5b20 con 0x7fadb4004d10 2023-12-08T08:19:55.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.764+0000 7fadc5d9b640 1 -- 172.21.15.88:0/684245694 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc00ad440 con 0x7fadb4004d10 2023-12-08T08:19:55.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.764+0000 7fadc759e640 1 -- 172.21.15.88:0/684245694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadb4004d10 msgr2=0x7fadb4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:55.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.764+0000 7fadc759e640 1 --2- 172.21.15.88:0/684245694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadb4004d10 0x7fadb4005190 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fadc0007f30 tx=0x7fadc001cac0 comp rx=0 tx=0).stop 2023-12-08T08:19:55.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.764+0000 7fadc6d9d640 1 -- 172.21.15.88:0/684245694 reap_dead start 2023-12-08T08:19:55.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.764+0000 7fadc759e640 1 -- 172.21.15.88:0/684245694 shutdown_connections 2023-12-08T08:19:55.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.764+0000 7fadc759e640 1 -- 172.21.15.88:0/684245694 >> 172.21.15.88:0/684245694 conn(0x7fadc80abdb0 msgr2=0x7fadc80c9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:55.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.764+0000 7fadc759e640 1 -- 172.21.15.88:0/684245694 shutdown_connections 2023-12-08T08:19:55.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.764+0000 7fadc759e640 1 -- 172.21.15.88:0/684245694 wait complete. 2023-12-08T08:19:55.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.768+0000 7fadc759e640 1 Processor -- start 2023-12-08T08:19:55.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.768+0000 7fadc759e640 1 -- start start 2023-12-08T08:19:55.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.768+0000 7fadc759e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadb4004d10 0x7fadc8156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:55.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.768+0000 7fadc759e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc80c3880 0x7fadc80c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:55.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.768+0000 7fadc759e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadc80c2e10 0x7fadc80c0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:55.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.768+0000 7fadc759e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc80c2480 con 0x7fadc80c2e10 2023-12-08T08:19:55.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.768+0000 7fadc759e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc81580b0 con 0x7fadc80c3880 2023-12-08T08:19:55.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.768+0000 7fadc759e640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc80c0450 con 0x7fadb4004d10 2023-12-08T08:19:55.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.768+0000 7fadc6d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadc80c2e10 0x7fadc80c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:55.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.768+0000 7fadc6d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadc80c2e10 0x7fadc80c0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37768/0 (socket says 172.21.15.88:37768) 2023-12-08T08:19:55.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.768+0000 7fadc6d9d640 1 -- 172.21.15.88:0/3214696271 learned_addr learned my addr 172.21.15.88:0/3214696271 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:19:55.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.768+0000 7fadbdd9b640 1 --2- 172.21.15.88:0/3214696271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc80c3880 0x7fadc80c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:55.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.768+0000 7fadc659c640 1 --2- 172.21.15.88:0/3214696271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadb4004d10 0x7fadc8156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:55.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.768+0000 7fadc6d9d640 1 -- 172.21.15.88:0/3214696271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadb4004d10 msgr2=0x7fadc8156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:55.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.768+0000 7fadc6d9d640 1 --2- 172.21.15.88:0/3214696271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadb4004d10 0x7fadc8156850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:55.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.768+0000 7fadc6d9d640 1 -- 172.21.15.88:0/3214696271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc80c3880 msgr2=0x7fadc80c28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:55.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.768+0000 7fadc6d9d640 1 --2- 172.21.15.88:0/3214696271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc80c3880 0x7fadc80c28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:55.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.768+0000 7fadc6d9d640 1 -- 172.21.15.88:0/3214696271 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc814b030 con 0x7fadc80c2e10 2023-12-08T08:19:55.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.768+0000 7fadbdd9b640 1 --2- 172.21.15.88:0/3214696271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc80c3880 0x7fadc80c28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:55.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.768+0000 7fadc6d9d640 1 --2- 172.21.15.88:0/3214696271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadc80c2e10 0x7fadc80c0cf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fadc00b0040 tx=0x7fadb4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:55.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.768+0000 7fadbf7fe640 1 -- 172.21.15.88:0/3214696271 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc00bc070 con 0x7fadc80c2e10 2023-12-08T08:19:55.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.768+0000 7fadbf7fe640 1 -- 172.21.15.88:0/3214696271 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc00052e0 con 0x7fadc80c2e10 2023-12-08T08:19:55.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.768+0000 7fadbf7fe640 1 -- 172.21.15.88:0/3214696271 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0003600 con 0x7fadc80c2e10 2023-12-08T08:19:55.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.768+0000 7fadc759e640 1 -- 172.21.15.88:0/3214696271 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc80c0660 con 0x7fadc80c2e10 2023-12-08T08:19:55.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.768+0000 7fadc759e640 1 -- 172.21.15.88:0/3214696271 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc814ad10 con 0x7fadc80c2e10 2023-12-08T08:19:55.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.772+0000 7fadbf7fe640 1 -- 172.21.15.88:0/3214696271 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fadc00b4040 con 0x7fadc80c2e10 2023-12-08T08:19:55.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.772+0000 7fadbf7fe640 1 -- 172.21.15.88:0/3214696271 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fadc00ad580 con 0x7fadc80c2e10 2023-12-08T08:19:55.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.772+0000 7fadc759e640 1 -- 172.21.15.88:0/3214696271 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc80c25f0 con 0x7fadc80c2e10 2023-12-08T08:19:55.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.772+0000 7fadbf7fe640 1 -- 172.21.15.88:0/3214696271 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fadc80c25f0 con 0x7fadc80c2e10 2023-12-08T08:19:55.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.832+0000 7fadc759e640 1 -- 172.21.15.88:0/3214696271 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fadc80674b0 con 0x7fadc80c2e10 2023-12-08T08:19:55.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.836+0000 7fadbf7fe640 1 -- 172.21.15.88:0/3214696271 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fadc00b2070 con 0x7fadc80c2e10 2023-12-08T08:19:55.839 INFO:teuthology.orchestra.run.smithi088.stderr:adjusted tunables profile to default 2023-12-08T08:19:55.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.840+0000 7fadc759e640 1 -- 172.21.15.88:0/3214696271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadc80c2e10 msgr2=0x7fadc80c0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:55.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.840+0000 7fadc759e640 1 --2- 172.21.15.88:0/3214696271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadc80c2e10 0x7fadc80c0cf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fadc00b0040 tx=0x7fadb4005800 comp rx=0 tx=0).stop 2023-12-08T08:19:55.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.840+0000 7fadc759e640 1 -- 172.21.15.88:0/3214696271 shutdown_connections 2023-12-08T08:19:55.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.840+0000 7fadc759e640 1 --2- 172.21.15.88:0/3214696271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadc80c2e10 0x7fadc80c0cf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:55.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.840+0000 7fadc759e640 1 --2- 172.21.15.88:0/3214696271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc80c3880 0x7fadc80c28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:55.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.840+0000 7fadc759e640 1 --2- 172.21.15.88:0/3214696271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadb4004d10 0x7fadc8156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:55.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.840+0000 7fadc759e640 1 -- 172.21.15.88:0/3214696271 >> 172.21.15.88:0/3214696271 conn(0x7fadc80abdb0 msgr2=0x7fadc814fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:55.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.840+0000 7fadc759e640 1 -- 172.21.15.88:0/3214696271 shutdown_connections 2023-12-08T08:19:55.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:55.840+0000 7fadc759e640 1 -- 172.21.15.88:0/3214696271 wait complete. 2023-12-08T08:19:55.861 INFO:tasks.ceph:check_enable_crimson: False 2023-12-08T08:19:55.861 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-08T08:19:55.861 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:19:55.861 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-08T08:19:55.881 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:19:55.882 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-08T08:19:55.943 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:19:55.943 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-08T08:19:55.970 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-08T08:19:55.967+0000 7feb7d817180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-08T08:19:55.982 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-12-08T08:19:55.980+0000 7f78eb124180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-08T08:19:56.002 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:19:56.002 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-08T08:19:56.063 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:19:56.063 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-08T08:19:56.085 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:19:56.086 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-08T08:19:56.149 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:19:56.149 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-08T08:19:56.211 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:19:56.212 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-08T08:19:56.276 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 85eae6f9-2b88-49ee-a806-d33aae2ff8e0 0 2023-12-08T08:19:56.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.455+0000 7fa979ff5640 1 Processor -- start 2023-12-08T08:19:56.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.455+0000 7fa979ff5640 1 -- start start 2023-12-08T08:19:56.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.455+0000 7fa979ff5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa9740c6030 0x7fa9740c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.455+0000 7fa979ff5640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa9740c98f0 0x7fa9740c8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.455+0000 7fa979ff5640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa974158780 con 0x7fa9740bf2d0 2023-12-08T08:19:56.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.455+0000 7fa979ff5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9740c0300 con 0x7fa9740c6030 2023-12-08T08:19:56.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.455+0000 7fa979ff5640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa974157b70 con 0x7fa9740c98f0 2023-12-08T08:19:56.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.455+0000 7fa9737fe640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa9740bf2d0 0x7fa974151970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49188/0 (socket says 172.21.15.148:49188) 2023-12-08T08:19:56.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.455+0000 7fa973fff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa9740c98f0 0x7fa9740c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.455+0000 7fa9737fe640 1 -- 172.21.15.148:0/2257780999 learned_addr learned my addr 172.21.15.148:0/2257780999 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-12-08T08:19:56.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.455+0000 7fa972ffd640 1 --2- 172.21.15.148:0/2257780999 >> v2:172.21.15.88:3300/0 conn(0x7fa9740c6030 0x7fa9740c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.455+0000 7fa9727fc640 1 -- 172.21.15.148:0/2257780999 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2091513880 0 0) 0x7fa974158780 con 0x7fa9740bf2d0 2023-12-08T08:19:56.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.455+0000 7fa9727fc640 1 -- 172.21.15.148:0/2257780999 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa95c003530 con 0x7fa9740bf2d0 2023-12-08T08:19:56.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.455+0000 7fa973fff640 1 -- 172.21.15.148:0/2257780999 >> v2:172.21.15.88:3300/0 conn(0x7fa9740c6030 msgr2=0x7fa9740c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:56.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.455+0000 7fa973fff640 1 --2- 172.21.15.148:0/2257780999 >> v2:172.21.15.88:3300/0 conn(0x7fa9740c6030 0x7fa9740c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.455+0000 7fa973fff640 1 -- 172.21.15.148:0/2257780999 >> v1:172.21.15.148:6789/0 conn(0x7fa9740bf2d0 legacy=0x7fa974151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.455+0000 7fa973fff640 1 -- 172.21.15.148:0/2257780999 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa974157e50 con 0x7fa9740c98f0 2023-12-08T08:19:56.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.459+0000 7fa973fff640 1 --2- 172.21.15.148:0/2257780999 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa9740c98f0 0x7fa9740c8200 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009d90 tx=0x7fa96c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d400f661c66fb52 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:56.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.459+0000 7fa9727fc640 1 -- 172.21.15.148:0/2257780999 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c0a59e0 con 0x7fa9740c98f0 2023-12-08T08:19:56.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.459+0000 7fa9727fc640 1 -- 172.21.15.148:0/2257780999 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96c0a5b40 con 0x7fa9740c98f0 2023-12-08T08:19:56.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.459+0000 7fa9727fc640 1 -- 172.21.15.148:0/2257780999 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c0ad440 con 0x7fa9740c98f0 2023-12-08T08:19:56.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.459+0000 7fa979ff5640 1 -- 172.21.15.148:0/2257780999 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa9740c98f0 msgr2=0x7fa9740c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.459+0000 7fa979ff5640 1 --2- 172.21.15.148:0/2257780999 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa9740c98f0 0x7fa9740c8200 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009d90 tx=0x7fa96c01c920 comp rx=0 tx=0).stop 2023-12-08T08:19:56.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.459+0000 7fa979ff5640 1 -- 172.21.15.148:0/2257780999 shutdown_connections 2023-12-08T08:19:56.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.459+0000 7fa979ff5640 1 --2- 172.21.15.148:0/2257780999 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa9740c98f0 0x7fa9740c8200 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.459+0000 7fa979ff5640 1 --2- 172.21.15.148:0/2257780999 >> v2:172.21.15.88:3300/0 conn(0x7fa9740c6030 0x7fa9740c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.459+0000 7fa979ff5640 1 -- 172.21.15.148:0/2257780999 >> 172.21.15.148:0/2257780999 conn(0x7fa9740c9dc0 msgr2=0x7fa9740ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:56.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.459+0000 7fa979ff5640 1 -- 172.21.15.148:0/2257780999 shutdown_connections 2023-12-08T08:19:56.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.459+0000 7fa979ff5640 1 -- 172.21.15.148:0/2257780999 wait complete. 2023-12-08T08:19:56.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.463+0000 7fa979ff5640 1 Processor -- start 2023-12-08T08:19:56.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.463+0000 7fa979ff5640 1 -- start start 2023-12-08T08:19:56.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.463+0000 7fa979ff5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9740bf2d0 0x7fa97406b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.463+0000 7fa979ff5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9740c6030 0x7fa97414df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.463+0000 7fa979ff5640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa9740c98f0 0x7fa97414e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.463+0000 7fa979ff5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97414f670 con 0x7fa9740bf2d0 2023-12-08T08:19:56.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.463+0000 7fa979ff5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97406c500 con 0x7fa9740c6030 2023-12-08T08:19:56.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.463+0000 7fa979ff5640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97406cc80 con 0x7fa9740c98f0 2023-12-08T08:19:56.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.463+0000 7fa972ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9740c6030 0x7fa97414df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.463+0000 7fa973fff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa9740c98f0 0x7fa97414e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.463+0000 7fa973fff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa9740c98f0 0x7fa97414e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.148:44538/0 (socket says 172.21.15.148:44538) 2023-12-08T08:19:56.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.463+0000 7fa973fff640 1 -- 172.21.15.148:0/1420747402 learned_addr learned my addr 172.21.15.148:0/1420747402 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-12-08T08:19:56.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.463+0000 7fa972ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9740c6030 0x7fa97414df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55086/0 (socket says 172.21.15.148:55086) 2023-12-08T08:19:56.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.463+0000 7fa9737fe640 1 --2- 172.21.15.148:0/1420747402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9740bf2d0 0x7fa97406b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.463+0000 7fa973fff640 1 -- 172.21.15.148:0/1420747402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9740c6030 msgr2=0x7fa97414df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.463+0000 7fa973fff640 1 --2- 172.21.15.148:0/1420747402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9740c6030 0x7fa97414df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.463+0000 7fa973fff640 1 -- 172.21.15.148:0/1420747402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9740bf2d0 msgr2=0x7fa97406b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.463+0000 7fa973fff640 1 --2- 172.21.15.148:0/1420747402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9740bf2d0 0x7fa97406b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.463+0000 7fa973fff640 1 -- 172.21.15.148:0/1420747402 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96c009a70 con 0x7fa9740c98f0 2023-12-08T08:19:56.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.463+0000 7fa973fff640 1 --2- 172.21.15.148:0/1420747402 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa9740c98f0 0x7fa97414e490 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa96c01afd0 tx=0x7fa96c0196c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:56.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.463+0000 7fa95bfff640 1 -- 172.21.15.148:0/1420747402 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c0aec30 con 0x7fa9740c98f0 2023-12-08T08:19:56.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.463+0000 7fa95bfff640 1 -- 172.21.15.148:0/1420747402 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96c0aed90 con 0x7fa9740c98f0 2023-12-08T08:19:56.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.463+0000 7fa979ff5640 1 -- 172.21.15.148:0/1420747402 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa97414ffe0 con 0x7fa9740c98f0 2023-12-08T08:19:56.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.463+0000 7fa95bfff640 1 -- 172.21.15.148:0/1420747402 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c0b7630 con 0x7fa9740c98f0 2023-12-08T08:19:56.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.463+0000 7fa979ff5640 1 -- 172.21.15.148:0/1420747402 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa97414d750 con 0x7fa9740c98f0 2023-12-08T08:19:56.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.467+0000 7fa95bfff640 1 -- 172.21.15.148:0/1420747402 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa96c0b4050 con 0x7fa9740c98f0 2023-12-08T08:19:56.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.467+0000 7fa95bfff640 1 -- 172.21.15.148:0/1420747402 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa96c0c2ad0 con 0x7fa9740c98f0 2023-12-08T08:19:56.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.467+0000 7fa979ff5640 1 -- 172.21.15.148:0/1420747402 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa974067630 con 0x7fa9740c98f0 2023-12-08T08:19:56.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.483+0000 7fa95bfff640 1 -- 172.21.15.148:0/1420747402 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fa96c0bd070 con 0x7fa9740c98f0 2023-12-08T08:19:56.519 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-12-08T08:19:56.520+0000 7f78eb124180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-08T08:19:56.543 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-08T08:19:56.539+0000 7feb7d817180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-08T08:19:56.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.551+0000 7fa979ff5640 1 -- 172.21.15.148:0/1420747402 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd new", "uuid": "85eae6f9-2b88-49ee-a806-d33aae2ff8e0", "id": 0} v 0) v1 -- 0x7fa974150f70 con 0x7fa9740c98f0 2023-12-08T08:19:56.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.559+0000 7fa95bfff640 1 -- 172.21.15.148:0/1420747402 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "85eae6f9-2b88-49ee-a806-d33aae2ff8e0", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa96c0b2070 con 0x7fa9740c98f0 2023-12-08T08:19:56.563 INFO:teuthology.orchestra.run.smithi148.stdout:0 2023-12-08T08:19:56.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.559+0000 7fa979ff5640 1 -- 172.21.15.148:0/1420747402 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa9740c98f0 msgr2=0x7fa97414e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.559+0000 7fa979ff5640 1 --2- 172.21.15.148:0/1420747402 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa9740c98f0 0x7fa97414e490 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa96c01afd0 tx=0x7fa96c0196c0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.559+0000 7fa979ff5640 1 -- 172.21.15.148:0/1420747402 shutdown_connections 2023-12-08T08:19:56.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.559+0000 7fa979ff5640 1 --2- 172.21.15.148:0/1420747402 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa9740c98f0 0x7fa97414e490 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.559+0000 7fa979ff5640 1 --2- 172.21.15.148:0/1420747402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9740c6030 0x7fa97414df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.559+0000 7fa979ff5640 1 --2- 172.21.15.148:0/1420747402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9740bf2d0 0x7fa97406b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.559+0000 7fa979ff5640 1 -- 172.21.15.148:0/1420747402 >> 172.21.15.148:0/1420747402 conn(0x7fa9740c9dc0 msgr2=0x7fa974157100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:56.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.563+0000 7fa979ff5640 1 -- 172.21.15.148:0/1420747402 shutdown_connections 2023-12-08T08:19:56.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.563+0000 7fa979ff5640 1 -- 172.21.15.148:0/1420747402 wait complete. 2023-12-08T08:19:56.582 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 7171cf27-1f7f-4981-83bd-764bb42d78e8 1 2023-12-08T08:19:56.717 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-12-08T08:19:56.716+0000 7f78eb124180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-08T08:19:56.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.715+0000 7f632930f640 1 Processor -- start 2023-12-08T08:19:56.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.715+0000 7f632930f640 1 -- start start 2023-12-08T08:19:56.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.715+0000 7f632930f640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f63240c6030 0x7f63240c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.715+0000 7f632930f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f63240c98f0 0x7f63240c8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.715+0000 7f632930f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6324158780 con 0x7f63240bf2d0 2023-12-08T08:19:56.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.715+0000 7f632930f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63240c0300 con 0x7f63240c98f0 2023-12-08T08:19:56.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.715+0000 7f632930f640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6324157b70 con 0x7f63240c6030 2023-12-08T08:19:56.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.719+0000 7f63227fc640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f63240c6030 0x7f63240c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.719+0000 7f63227fc640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f63240c6030 0x7f63240c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55102/0 (socket says 172.21.15.148:55102) 2023-12-08T08:19:56.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.719+0000 7f63227fc640 1 -- 172.21.15.148:0/3694251332 learned_addr learned my addr 172.21.15.148:0/3694251332 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-12-08T08:19:56.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.719+0000 7f63237fe640 1 --2- 172.21.15.148:0/3694251332 >> v2:172.21.15.88:3300/0 conn(0x7f63240c98f0 0x7f63240c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.719+0000 7f63227fc640 1 -- 172.21.15.148:0/3694251332 >> v2:172.21.15.88:3300/0 conn(0x7f63240c98f0 msgr2=0x7f63240c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:56.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.719+0000 7f63227fc640 1 --2- 172.21.15.148:0/3694251332 >> v2:172.21.15.88:3300/0 conn(0x7f63240c98f0 0x7f63240c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.719+0000 7f63227fc640 1 -- 172.21.15.148:0/3694251332 >> v1:172.21.15.88:6789/0 conn(0x7f63240bf2d0 legacy=0x7f6324151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.719+0000 7f63227fc640 1 -- 172.21.15.148:0/3694251332 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6324157e50 con 0x7f63240c6030 2023-12-08T08:19:56.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.719+0000 7f63227fc640 1 --2- 172.21.15.148:0/3694251332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63240c6030 0x7f63240c7cc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f632406cea0 tx=0x7f631801c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=774863b085f1e51e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:56.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.719+0000 7f6321ffb640 1 -- 172.21.15.148:0/3694251332 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63180aa430 con 0x7f63240c6030 2023-12-08T08:19:56.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.719+0000 7f6321ffb640 1 -- 172.21.15.148:0/3694251332 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63180aa590 con 0x7f63240c6030 2023-12-08T08:19:56.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.719+0000 7f6321ffb640 1 -- 172.21.15.148:0/3694251332 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63180aa920 con 0x7f63240c6030 2023-12-08T08:19:56.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.723+0000 7f632930f640 1 -- 172.21.15.148:0/3694251332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63240c6030 msgr2=0x7f63240c7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.723+0000 7f632930f640 1 --2- 172.21.15.148:0/3694251332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63240c6030 0x7f63240c7cc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f632406cea0 tx=0x7f631801c4d0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.723+0000 7f632930f640 1 -- 172.21.15.148:0/3694251332 shutdown_connections 2023-12-08T08:19:56.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.723+0000 7f632930f640 1 --2- 172.21.15.148:0/3694251332 >> v2:172.21.15.88:3300/0 conn(0x7f63240c98f0 0x7f63240c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.723+0000 7f632930f640 1 --2- 172.21.15.148:0/3694251332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63240c6030 0x7f63240c7cc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.723+0000 7f632930f640 1 -- 172.21.15.148:0/3694251332 >> 172.21.15.148:0/3694251332 conn(0x7f63240c9dc0 msgr2=0x7f63240ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:56.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.723+0000 7f632930f640 1 -- 172.21.15.148:0/3694251332 shutdown_connections 2023-12-08T08:19:56.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.723+0000 7f632930f640 1 -- 172.21.15.148:0/3694251332 wait complete. 2023-12-08T08:19:56.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.723+0000 7f632930f640 1 Processor -- start 2023-12-08T08:19:56.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.723+0000 7f632930f640 1 -- start start 2023-12-08T08:19:56.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.723+0000 7f632930f640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63240bf2d0 0x7f63240c3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.723+0000 7f632930f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63240c6030 0x7f63240c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.723+0000 7f632930f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63240c98f0 0x7f632406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.723+0000 7f632930f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63241554b0 con 0x7f63240c98f0 2023-12-08T08:19:56.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.723+0000 7f632930f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6324152ad0 con 0x7f63240c6030 2023-12-08T08:19:56.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.723+0000 7f632930f640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6324153c30 con 0x7f63240bf2d0 2023-12-08T08:19:56.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.723+0000 7f6322ffd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63240bf2d0 0x7f63240c3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.723+0000 7f63227fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63240c6030 0x7f63240c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.723+0000 7f63227fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63240c6030 0x7f63240c38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55108/0 (socket says 172.21.15.148:55108) 2023-12-08T08:19:56.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.723+0000 7f6322ffd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63240bf2d0 0x7f63240c3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.148:44548/0 (socket says 172.21.15.148:44548) 2023-12-08T08:19:56.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.723+0000 7f63227fc640 1 -- 172.21.15.148:0/1446613971 learned_addr learned my addr 172.21.15.148:0/1446613971 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-12-08T08:19:56.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.723+0000 7f63237fe640 1 --2- 172.21.15.148:0/1446613971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63240c98f0 0x7f632406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.727+0000 7f6322ffd640 1 -- 172.21.15.148:0/1446613971 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63240c6030 msgr2=0x7f63240c38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.727+0000 7f6322ffd640 1 --2- 172.21.15.148:0/1446613971 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63240c6030 0x7f63240c38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.727+0000 7f6322ffd640 1 -- 172.21.15.148:0/1446613971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63240c98f0 msgr2=0x7f632406ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.727+0000 7f6322ffd640 1 --2- 172.21.15.148:0/1446613971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63240c98f0 0x7f632406ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.727+0000 7f6322ffd640 1 -- 172.21.15.148:0/1446613971 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63180094d0 con 0x7f63240bf2d0 2023-12-08T08:19:56.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.727+0000 7f6322ffd640 1 --2- 172.21.15.148:0/1446613971 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63240bf2d0 0x7f63240c3390 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f631400c3f0 tx=0x7f631400c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:56.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.727+0000 7f630b7fe640 1 -- 172.21.15.148:0/1446613971 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63140052d0 con 0x7f63240bf2d0 2023-12-08T08:19:56.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.727+0000 7f630b7fe640 1 -- 172.21.15.148:0/1446613971 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6314005430 con 0x7f63240bf2d0 2023-12-08T08:19:56.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.727+0000 7f630b7fe640 1 -- 172.21.15.148:0/1446613971 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6314007260 con 0x7f63240bf2d0 2023-12-08T08:19:56.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.727+0000 7f632930f640 1 -- 172.21.15.148:0/1446613971 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6324154c10 con 0x7f63240bf2d0 2023-12-08T08:19:56.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.727+0000 7f632930f640 1 -- 172.21.15.148:0/1446613971 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63241551d0 con 0x7f63240bf2d0 2023-12-08T08:19:56.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.727+0000 7f630b7fe640 1 -- 172.21.15.148:0/1446613971 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f63140067e0 con 0x7f63240bf2d0 2023-12-08T08:19:56.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.727+0000 7f630b7fe640 1 -- 172.21.15.148:0/1446613971 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f63140039f0 con 0x7f63240bf2d0 2023-12-08T08:19:56.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.727+0000 7f632930f640 1 -- 172.21.15.148:0/1446613971 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f632406a830 con 0x7f63240bf2d0 2023-12-08T08:19:56.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.731+0000 7f630b7fe640 1 -- 172.21.15.148:0/1446613971 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f632406a830 con 0x7f63240bf2d0 2023-12-08T08:19:56.748 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-08T08:19:56.747+0000 7feb7d817180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-08T08:19:56.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.799+0000 7f632930f640 1 -- 172.21.15.148:0/1446613971 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7171cf27-1f7f-4981-83bd-764bb42d78e8", "id": 1} v 0) v1 -- 0x7f6324067630 con 0x7f63240bf2d0 2023-12-08T08:19:56.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.803+0000 7f630b7fe640 1 -- 172.21.15.148:0/1446613971 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7171cf27-1f7f-4981-83bd-764bb42d78e8", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f63140290b0 con 0x7f63240bf2d0 2023-12-08T08:19:56.807 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-12-08T08:19:56.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.803+0000 7f632930f640 1 -- 172.21.15.148:0/1446613971 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63240bf2d0 msgr2=0x7f63240c3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.807+0000 7f632930f640 1 --2- 172.21.15.148:0/1446613971 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63240bf2d0 0x7f63240c3390 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f631400c3f0 tx=0x7f631400c8b0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.807+0000 7f632930f640 1 -- 172.21.15.148:0/1446613971 shutdown_connections 2023-12-08T08:19:56.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.807+0000 7f632930f640 1 --2- 172.21.15.148:0/1446613971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63240c98f0 0x7f632406ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.807+0000 7f632930f640 1 --2- 172.21.15.148:0/1446613971 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63240c6030 0x7f63240c38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.807+0000 7f632930f640 1 --2- 172.21.15.148:0/1446613971 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63240bf2d0 0x7f63240c3390 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.807+0000 7f632930f640 1 -- 172.21.15.148:0/1446613971 >> 172.21.15.148:0/1446613971 conn(0x7f63240c9dc0 msgr2=0x7f6324150af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:56.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.807+0000 7f632930f640 1 -- 172.21.15.148:0/1446613971 shutdown_connections 2023-12-08T08:19:56.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.807+0000 7f632930f640 1 -- 172.21.15.148:0/1446613971 wait complete. 2023-12-08T08:19:56.827 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 19a3387b-9d32-41bf-a244-d153e2edbba6 2 2023-12-08T08:19:56.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.959+0000 7f35827f5640 1 Processor -- start 2023-12-08T08:19:56.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.959+0000 7f35827f5640 1 -- start start 2023-12-08T08:19:56.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.959+0000 7f35827f5640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f357c0c6030 0x7f357c0c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.959+0000 7f35827f5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f357c0c98f0 0x7f357c0c8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.959+0000 7f35827f5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357c158780 con 0x7f357c0bf2d0 2023-12-08T08:19:56.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.959+0000 7f35827f5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357c0c0300 con 0x7f357c0c98f0 2023-12-08T08:19:56.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.959+0000 7f35827f5640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357c157b70 con 0x7f357c0c6030 2023-12-08T08:19:56.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.963+0000 7f357b7fe640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f357c0c6030 0x7f357c0c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.963+0000 7f3580d92640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f357c0c98f0 0x7f357c0c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.963+0000 7f3580d92640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f357c0c98f0 0x7f357c0c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.148:46392/0 (socket says 172.21.15.148:46392) 2023-12-08T08:19:56.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.963+0000 7f357bfff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f357c0bf2d0 0x7f357c151970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.148:37276/0 (socket says 172.21.15.148:37276) 2023-12-08T08:19:56.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.963+0000 7f3580d92640 1 -- 172.21.15.148:0/2549116090 learned_addr learned my addr 172.21.15.148:0/2549116090 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-12-08T08:19:56.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.963+0000 7f3580d92640 1 -- 172.21.15.148:0/2549116090 >> v2:172.21.15.148:3300/0 conn(0x7f357c0c6030 msgr2=0x7f357c0c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:56.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.963+0000 7f3580d92640 1 --2- 172.21.15.148:0/2549116090 >> v2:172.21.15.148:3300/0 conn(0x7f357c0c6030 0x7f357c0c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.963+0000 7f3580d92640 1 -- 172.21.15.148:0/2549116090 >> v1:172.21.15.88:6789/0 conn(0x7f357c0bf2d0 legacy=0x7f357c151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.963+0000 7f3580d92640 1 -- 172.21.15.148:0/2549116090 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c157e50 con 0x7f357c0c98f0 2023-12-08T08:19:56.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.963+0000 7f357affd640 1 -- 172.21.15.148:0/2549116090 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128571469 0 0) 0x7f357c158780 con 0x7f357c0bf2d0 2023-12-08T08:19:56.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.963+0000 7f3580d92640 1 --2- 172.21.15.148:0/2549116090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f357c0c98f0 0x7f357c0c8200 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f357c06cea0 tx=0x7f357401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=558ba8d8b1c73813 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:56.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.963+0000 7f357affd640 1 -- 172.21.15.148:0/2549116090 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35740a5860 con 0x7f357c0c98f0 2023-12-08T08:19:56.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.963+0000 7f357affd640 1 -- 172.21.15.148:0/2549116090 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35740a59c0 con 0x7f357c0c98f0 2023-12-08T08:19:56.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.963+0000 7f357affd640 1 -- 172.21.15.148:0/2549116090 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35740a5d50 con 0x7f357c0c98f0 2023-12-08T08:19:56.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.967+0000 7f35827f5640 1 -- 172.21.15.148:0/2549116090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f357c0c98f0 msgr2=0x7f357c0c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.967+0000 7f35827f5640 1 --2- 172.21.15.148:0/2549116090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f357c0c98f0 0x7f357c0c8200 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f357c06cea0 tx=0x7f357401c9a0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.967+0000 7f35827f5640 1 -- 172.21.15.148:0/2549116090 shutdown_connections 2023-12-08T08:19:56.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.967+0000 7f35827f5640 1 --2- 172.21.15.148:0/2549116090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f357c0c98f0 0x7f357c0c8200 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.967+0000 7f35827f5640 1 --2- 172.21.15.148:0/2549116090 >> v2:172.21.15.148:3300/0 conn(0x7f357c0c6030 0x7f357c0c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.967+0000 7f35827f5640 1 -- 172.21.15.148:0/2549116090 >> 172.21.15.148:0/2549116090 conn(0x7f357c0c9dc0 msgr2=0x7f357c0ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:56.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.967+0000 7f35827f5640 1 -- 172.21.15.148:0/2549116090 shutdown_connections 2023-12-08T08:19:56.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.967+0000 7f35827f5640 1 -- 172.21.15.148:0/2549116090 wait complete. 2023-12-08T08:19:56.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.967+0000 7f35827f5640 1 Processor -- start 2023-12-08T08:19:56.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.967+0000 7f35827f5640 1 -- start start 2023-12-08T08:19:56.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.967+0000 7f35827f5640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f357c0bf2d0 0x7f357c148350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.967+0000 7f35827f5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f357c0c6030 0x7f357c1efdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.967+0000 7f35827f5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f357c0c98f0 0x7f357c0accf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.967+0000 7f35827f5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c1f06b0 con 0x7f357c0c6030 2023-12-08T08:19:56.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.967+0000 7f35827f5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c147870 con 0x7f357c0c98f0 2023-12-08T08:19:56.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.967+0000 7f35827f5640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357c147b50 con 0x7f357c0bf2d0 2023-12-08T08:19:56.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.967+0000 7f357bfff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f357c0bf2d0 0x7f357c148350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.967+0000 7f357bfff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f357c0bf2d0 0x7f357c148350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.148:44560/0 (socket says 172.21.15.148:44560) 2023-12-08T08:19:56.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.967+0000 7f3580d92640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f357c0c98f0 0x7f357c0accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.967+0000 7f357bfff640 1 -- 172.21.15.148:0/4264435825 learned_addr learned my addr 172.21.15.148:0/4264435825 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-12-08T08:19:56.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.967+0000 7f357b7fe640 1 --2- 172.21.15.148:0/4264435825 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f357c0c6030 0x7f357c1efdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.971+0000 7f357bfff640 1 -- 172.21.15.148:0/4264435825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f357c0c98f0 msgr2=0x7f357c0accf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.971+0000 7f357bfff640 1 --2- 172.21.15.148:0/4264435825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f357c0c98f0 0x7f357c0accf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.971+0000 7f357bfff640 1 -- 172.21.15.148:0/4264435825 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f357c0c6030 msgr2=0x7f357c1efdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.971+0000 7f357bfff640 1 --2- 172.21.15.148:0/4264435825 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f357c0c6030 0x7f357c1efdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.971+0000 7f357bfff640 1 -- 172.21.15.148:0/4264435825 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3574009b30 con 0x7f357c0bf2d0 2023-12-08T08:19:56.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.971+0000 7f357b7fe640 1 --2- 172.21.15.148:0/4264435825 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f357c0c6030 0x7f357c1efdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:56.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.971+0000 7f357bfff640 1 --2- 172.21.15.148:0/4264435825 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f357c0bf2d0 0x7f357c148350 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f356c0011f0 tx=0x7f356c00c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:56.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.971+0000 7f3578ff9640 1 -- 172.21.15.148:0/4264435825 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c0074e0 con 0x7f357c0bf2d0 2023-12-08T08:19:56.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.971+0000 7f3578ff9640 1 -- 172.21.15.148:0/4264435825 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356c007640 con 0x7f357c0bf2d0 2023-12-08T08:19:56.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.971+0000 7f35827f5640 1 -- 172.21.15.148:0/4264435825 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f357c147e30 con 0x7f357c0bf2d0 2023-12-08T08:19:56.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.971+0000 7f3578ff9640 1 -- 172.21.15.148:0/4264435825 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c004a10 con 0x7f357c0bf2d0 2023-12-08T08:19:56.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.971+0000 7f35827f5640 1 -- 172.21.15.148:0/4264435825 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f357c1f0990 con 0x7f357c0bf2d0 2023-12-08T08:19:56.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.971+0000 7f3578ff9640 1 -- 172.21.15.148:0/4264435825 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f356c01d440 con 0x7f357c0bf2d0 2023-12-08T08:19:56.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.971+0000 7f3578ff9640 1 -- 172.21.15.148:0/4264435825 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f356c01db10 con 0x7f357c0bf2d0 2023-12-08T08:19:56.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.971+0000 7f35827f5640 1 -- 172.21.15.148:0/4264435825 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f357c067630 con 0x7f357c0bf2d0 2023-12-08T08:19:56.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:56.975+0000 7f3578ff9640 1 -- 172.21.15.148:0/4264435825 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f356c018070 con 0x7f357c0bf2d0 2023-12-08T08:19:57.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.039+0000 7f35827f5640 1 -- 172.21.15.148:0/4264435825 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd new", "uuid": "19a3387b-9d32-41bf-a244-d153e2edbba6", "id": 2} v 0) v1 -- 0x7f357c0c41f0 con 0x7f357c0bf2d0 2023-12-08T08:19:57.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.047+0000 7f3578ff9640 1 -- 172.21.15.148:0/4264435825 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "19a3387b-9d32-41bf-a244-d153e2edbba6", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f356c01d6f0 con 0x7f357c0bf2d0 2023-12-08T08:19:57.049 INFO:teuthology.orchestra.run.smithi148.stdout:2 2023-12-08T08:19:57.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.047+0000 7f35827f5640 1 -- 172.21.15.148:0/4264435825 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f357c0bf2d0 msgr2=0x7f357c148350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.047+0000 7f35827f5640 1 --2- 172.21.15.148:0/4264435825 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f357c0bf2d0 0x7f357c148350 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f356c0011f0 tx=0x7f356c00c9b0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.047+0000 7f35827f5640 1 -- 172.21.15.148:0/4264435825 shutdown_connections 2023-12-08T08:19:57.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.047+0000 7f35827f5640 1 --2- 172.21.15.148:0/4264435825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f357c0c98f0 0x7f357c0accf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.047+0000 7f35827f5640 1 --2- 172.21.15.148:0/4264435825 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f357c0c6030 0x7f357c1efdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.047+0000 7f35827f5640 1 --2- 172.21.15.148:0/4264435825 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f357c0bf2d0 0x7f357c148350 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.047+0000 7f35827f5640 1 -- 172.21.15.148:0/4264435825 >> 172.21.15.148:0/4264435825 conn(0x7f357c0c9dc0 msgr2=0x7f357c156e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:57.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.047+0000 7f35827f5640 1 -- 172.21.15.148:0/4264435825 shutdown_connections 2023-12-08T08:19:57.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.047+0000 7f35827f5640 1 -- 172.21.15.148:0/4264435825 wait complete. 2023-12-08T08:19:57.068 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new fe969642-9698-4f55-b118-08dc96bced0f 3 2023-12-08T08:19:57.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.203+0000 7ff88ea46640 1 Processor -- start 2023-12-08T08:19:57.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.203+0000 7ff88ea46640 1 -- start start 2023-12-08T08:19:57.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.203+0000 7ff88ea46640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff8880c98f0 0x7ff8880c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.203+0000 7ff88ea46640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff888158780 con 0x7ff8880c6030 2023-12-08T08:19:57.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.203+0000 7ff88ea46640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8880c8910 con 0x7ff8880bf2d0 2023-12-08T08:19:57.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.203+0000 7ff88ea46640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8880c0300 con 0x7ff8880c98f0 2023-12-08T08:19:57.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.203+0000 7ff887fff640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ff8880bf2d0 0x7ff888151970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49198/0 (socket says 172.21.15.148:49198) 2023-12-08T08:19:57.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.203+0000 7ff887fff640 1 -- 172.21.15.148:0/520249019 learned_addr learned my addr 172.21.15.148:0/520249019 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-12-08T08:19:57.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.203+0000 7ff88cfe3640 1 --2- 172.21.15.148:0/520249019 >> v2:172.21.15.88:3300/0 conn(0x7ff8880c98f0 0x7ff8880c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.203+0000 7ff886ffd640 1 -- 172.21.15.148:0/520249019 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 237523395 0 0) 0x7ff8880c8910 con 0x7ff8880bf2d0 2023-12-08T08:19:57.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.203+0000 7ff886ffd640 1 -- 172.21.15.148:0/520249019 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff870003530 con 0x7ff8880bf2d0 2023-12-08T08:19:57.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.203+0000 7ff886ffd640 1 -- 172.21.15.148:0/520249019 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373700808 0 0) 0x7ff888158780 con 0x7ff8880c6030 2023-12-08T08:19:57.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.203+0000 7ff886ffd640 1 -- 172.21.15.148:0/520249019 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8880c8910 con 0x7ff8880c6030 2023-12-08T08:19:57.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.203+0000 7ff88cfe3640 1 -- 172.21.15.148:0/520249019 >> v1:172.21.15.148:6789/0 conn(0x7ff8880bf2d0 legacy=0x7ff888151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.203+0000 7ff88cfe3640 1 -- 172.21.15.148:0/520249019 >> v1:172.21.15.88:6789/0 conn(0x7ff8880c6030 legacy=0x7ff8880c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.203+0000 7ff88cfe3640 1 -- 172.21.15.148:0/520249019 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff888157b70 con 0x7ff8880c98f0 2023-12-08T08:19:57.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.207+0000 7ff88cfe3640 1 --2- 172.21.15.148:0/520249019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8880c98f0 0x7ff8880c83d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff880009d90 tx=0x7ff88001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=870c609fdf07e2ac server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:57.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.207+0000 7ff886ffd640 1 -- 172.21.15.148:0/520249019 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8800a59e0 con 0x7ff8880c98f0 2023-12-08T08:19:57.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.207+0000 7ff886ffd640 1 -- 172.21.15.148:0/520249019 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8800a5b40 con 0x7ff8880c98f0 2023-12-08T08:19:57.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.207+0000 7ff886ffd640 1 -- 172.21.15.148:0/520249019 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8800ad440 con 0x7ff8880c98f0 2023-12-08T08:19:57.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.207+0000 7ff88ea46640 1 -- 172.21.15.148:0/520249019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8880c98f0 msgr2=0x7ff8880c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.207+0000 7ff88ea46640 1 --2- 172.21.15.148:0/520249019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8880c98f0 0x7ff8880c83d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff880009d90 tx=0x7ff88001c920 comp rx=0 tx=0).stop 2023-12-08T08:19:57.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.207+0000 7ff88ea46640 1 -- 172.21.15.148:0/520249019 shutdown_connections 2023-12-08T08:19:57.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.207+0000 7ff88ea46640 1 --2- 172.21.15.148:0/520249019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8880c98f0 0x7ff8880c83d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.207+0000 7ff88ea46640 1 -- 172.21.15.148:0/520249019 >> 172.21.15.148:0/520249019 conn(0x7ff8880c9dc0 msgr2=0x7ff8880ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:57.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.207+0000 7ff88ea46640 1 -- 172.21.15.148:0/520249019 shutdown_connections 2023-12-08T08:19:57.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.207+0000 7ff88ea46640 1 -- 172.21.15.148:0/520249019 wait complete. 2023-12-08T08:19:57.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.211+0000 7ff88ea46640 1 Processor -- start 2023-12-08T08:19:57.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.211+0000 7ff88ea46640 1 -- start start 2023-12-08T08:19:57.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.211+0000 7ff88ea46640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8880bf2d0 0x7ff8881ecb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.211+0000 7ff88ea46640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8880c6030 0x7ff888152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.211+0000 7ff88ea46640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8880c98f0 0x7ff888154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.211+0000 7ff88ea46640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff888147320 con 0x7ff8880bf2d0 2023-12-08T08:19:57.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.211+0000 7ff88ea46640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8881463c0 con 0x7ff8880c6030 2023-12-08T08:19:57.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.211+0000 7ff88ea46640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8881466a0 con 0x7ff8880c98f0 2023-12-08T08:19:57.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.211+0000 7ff8877fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8880c6030 0x7ff888152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.211+0000 7ff88cfe3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8880c98f0 0x7ff888154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.211+0000 7ff8877fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8880c6030 0x7ff888152450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55142/0 (socket says 172.21.15.148:55142) 2023-12-08T08:19:57.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.211+0000 7ff88cfe3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8880c98f0 0x7ff888154c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.148:44562/0 (socket says 172.21.15.148:44562) 2023-12-08T08:19:57.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.211+0000 7ff8877fe640 1 -- 172.21.15.148:0/668912004 learned_addr learned my addr 172.21.15.148:0/668912004 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-12-08T08:19:57.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.211+0000 7ff887fff640 1 --2- 172.21.15.148:0/668912004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8880bf2d0 0x7ff8881ecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.211+0000 7ff88cfe3640 1 -- 172.21.15.148:0/668912004 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8880c6030 msgr2=0x7ff888152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.211+0000 7ff88cfe3640 1 --2- 172.21.15.148:0/668912004 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8880c6030 0x7ff888152450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.211+0000 7ff88cfe3640 1 -- 172.21.15.148:0/668912004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8880bf2d0 msgr2=0x7ff8881ecb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.211+0000 7ff88cfe3640 1 --2- 172.21.15.148:0/668912004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8880bf2d0 0x7ff8881ecb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.211+0000 7ff88cfe3640 1 -- 172.21.15.148:0/668912004 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff880009a70 con 0x7ff8880c98f0 2023-12-08T08:19:57.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.211+0000 7ff88cfe3640 1 --2- 172.21.15.148:0/668912004 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8880c98f0 0x7ff888154c80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff8800ac000 tx=0x7ff8800196c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:57.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.211+0000 7ff884ff9640 1 -- 172.21.15.148:0/668912004 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8800add00 con 0x7ff8880c98f0 2023-12-08T08:19:57.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.211+0000 7ff884ff9640 1 -- 172.21.15.148:0/668912004 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8800ade60 con 0x7ff8880c98f0 2023-12-08T08:19:57.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.211+0000 7ff88ea46640 1 -- 172.21.15.148:0/668912004 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff888146980 con 0x7ff8880c98f0 2023-12-08T08:19:57.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.211+0000 7ff884ff9640 1 -- 172.21.15.148:0/668912004 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8800b9650 con 0x7ff8880c98f0 2023-12-08T08:19:57.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.211+0000 7ff88ea46640 1 -- 172.21.15.148:0/668912004 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff888146f40 con 0x7ff8880c98f0 2023-12-08T08:19:57.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.211+0000 7ff884ff9640 1 -- 172.21.15.148:0/668912004 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff8800b9ab0 con 0x7ff8880c98f0 2023-12-08T08:19:57.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.211+0000 7ff884ff9640 1 -- 172.21.15.148:0/668912004 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7ff8800c2d90 con 0x7ff8880c98f0 2023-12-08T08:19:57.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.215+0000 7ff88ea46640 1 -- 172.21.15.148:0/668912004 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff888147460 con 0x7ff8880c98f0 2023-12-08T08:19:57.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.215+0000 7ff884ff9640 1 -- 172.21.15.148:0/668912004 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7ff888147460 con 0x7ff8880c98f0 2023-12-08T08:19:57.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.291+0000 7ff88ea46640 1 -- 172.21.15.148:0/668912004 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fe969642-9698-4f55-b118-08dc96bced0f", "id": 3} v 0) v1 -- 0x7ff888148cc0 con 0x7ff8880c98f0 2023-12-08T08:19:57.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.299+0000 7ff884ff9640 1 -- 172.21.15.148:0/668912004 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fe969642-9698-4f55-b118-08dc96bced0f", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff8800bd020 con 0x7ff8880c98f0 2023-12-08T08:19:57.301 INFO:teuthology.orchestra.run.smithi148.stdout:3 2023-12-08T08:19:57.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.299+0000 7ff88ea46640 1 -- 172.21.15.148:0/668912004 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8880c98f0 msgr2=0x7ff888154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.299+0000 7ff88ea46640 1 --2- 172.21.15.148:0/668912004 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8880c98f0 0x7ff888154c80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff8800ac000 tx=0x7ff8800196c0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.299+0000 7ff88ea46640 1 -- 172.21.15.148:0/668912004 shutdown_connections 2023-12-08T08:19:57.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.299+0000 7ff88ea46640 1 --2- 172.21.15.148:0/668912004 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8880c98f0 0x7ff888154c80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.299+0000 7ff88ea46640 1 --2- 172.21.15.148:0/668912004 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8880c6030 0x7ff888152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.299+0000 7ff88ea46640 1 --2- 172.21.15.148:0/668912004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8880bf2d0 0x7ff8881ecb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.299+0000 7ff88ea46640 1 -- 172.21.15.148:0/668912004 >> 172.21.15.148:0/668912004 conn(0x7ff8880c9dc0 msgr2=0x7ff888156000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:57.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.299+0000 7ff88ea46640 1 -- 172.21.15.148:0/668912004 shutdown_connections 2023-12-08T08:19:57.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.299+0000 7ff88ea46640 1 -- 172.21.15.148:0/668912004 wait complete. 2023-12-08T08:19:57.329 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 1de2647e-90ab-4557-93fa-207ec702c775 4 2023-12-08T08:19:57.353 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-12-08T08:19:57.352+0000 7f78eb124180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-08T08:19:57.422 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-08T08:19:57.419+0000 7feb7d817180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-08T08:19:57.427 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-12-08T08:19:57.428+0000 7f78eb124180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-08T08:19:57.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.463+0000 7fd03765a640 1 Processor -- start 2023-12-08T08:19:57.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.463+0000 7fd03765a640 1 -- start start 2023-12-08T08:19:57.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.463+0000 7fd03765a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd0300704f0 0x7fd0300c2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.463+0000 7fd03765a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd03006e080 0x7fd0300c3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.463+0000 7fd03765a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0301531e0 con 0x7fd0300c7620 2023-12-08T08:19:57.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.463+0000 7fd03765a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd03006ec50 con 0x7fd0300704f0 2023-12-08T08:19:57.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.463+0000 7fd03765a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0300c26b0 con 0x7fd03006e080 2023-12-08T08:19:57.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.463+0000 7fd035bf7640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd03006e080 0x7fd0300c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.463+0000 7fd034bf5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd0300704f0 0x7fd0300c2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.463+0000 7fd035bf7640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd03006e080 0x7fd0300c3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.148:44566/0 (socket says 172.21.15.148:44566) 2023-12-08T08:19:57.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.463+0000 7fd035bf7640 1 -- 172.21.15.148:0/93108318 learned_addr learned my addr 172.21.15.148:0/93108318 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-12-08T08:19:57.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.463+0000 7fd035bf7640 1 -- 172.21.15.148:0/93108318 >> v2:172.21.15.88:3300/0 conn(0x7fd0300704f0 msgr2=0x7fd0300c2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:57.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.463+0000 7fd035bf7640 1 --2- 172.21.15.148:0/93108318 >> v2:172.21.15.88:3300/0 conn(0x7fd0300704f0 0x7fd0300c2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.463+0000 7fd035bf7640 1 -- 172.21.15.148:0/93108318 >> v1:172.21.15.88:6789/0 conn(0x7fd0300c7620 legacy=0x7fd0300a6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.463+0000 7fd035bf7640 1 -- 172.21.15.148:0/93108318 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03014fda0 con 0x7fd03006e080 2023-12-08T08:19:57.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.463+0000 7fd034bf5640 1 --2- 172.21.15.148:0/93108318 >> v2:172.21.15.88:3300/0 conn(0x7fd0300704f0 0x7fd0300c2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:57.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.471+0000 7fd035bf7640 1 --2- 172.21.15.148:0/93108318 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd03006e080 0x7fd0300c3290 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd028009e50 tx=0x7fd02801c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb7268393a6a5a96 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:57.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.471+0000 7fd027fff640 1 -- 172.21.15.148:0/93108318 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0280a5840 con 0x7fd03006e080 2023-12-08T08:19:57.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.471+0000 7fd027fff640 1 -- 172.21.15.148:0/93108318 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0280a59a0 con 0x7fd03006e080 2023-12-08T08:19:57.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.471+0000 7fd027fff640 1 -- 172.21.15.148:0/93108318 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0280a5d30 con 0x7fd03006e080 2023-12-08T08:19:57.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.471+0000 7fd03765a640 1 -- 172.21.15.148:0/93108318 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd03006e080 msgr2=0x7fd0300c3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.471+0000 7fd03765a640 1 --2- 172.21.15.148:0/93108318 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd03006e080 0x7fd0300c3290 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd028009e50 tx=0x7fd02801c980 comp rx=0 tx=0).stop 2023-12-08T08:19:57.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.471+0000 7fd03765a640 1 -- 172.21.15.148:0/93108318 shutdown_connections 2023-12-08T08:19:57.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.471+0000 7fd03765a640 1 --2- 172.21.15.148:0/93108318 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd03006e080 0x7fd0300c3290 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.471+0000 7fd03765a640 1 --2- 172.21.15.148:0/93108318 >> v2:172.21.15.88:3300/0 conn(0x7fd0300704f0 0x7fd0300c2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.471+0000 7fd03765a640 1 -- 172.21.15.148:0/93108318 >> 172.21.15.148:0/93108318 conn(0x7fd0300c7ba0 msgr2=0x7fd0300c7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:57.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.471+0000 7fd03765a640 1 -- 172.21.15.148:0/93108318 shutdown_connections 2023-12-08T08:19:57.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.471+0000 7fd03765a640 1 -- 172.21.15.148:0/93108318 wait complete. 2023-12-08T08:19:57.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.471+0000 7fd03765a640 1 Processor -- start 2023-12-08T08:19:57.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.471+0000 7fd03765a640 1 -- start start 2023-12-08T08:19:57.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.475+0000 7fd03765a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd03006e080 0x7fd03015b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.475+0000 7fd03765a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0300704f0 0x7fd03014c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.475+0000 7fd03765a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0300c7620 0x7fd0301540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.475+0000 7fd03765a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0301568e0 con 0x7fd03006e080 2023-12-08T08:19:57.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.475+0000 7fd03765a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03014ceb0 con 0x7fd0300704f0 2023-12-08T08:19:57.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.475+0000 7fd03765a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03014cbd0 con 0x7fd0300c7620 2023-12-08T08:19:57.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.475+0000 7fd034bf5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0300704f0 0x7fd03014c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.475+0000 7fd034bf5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0300704f0 0x7fd03014c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55156/0 (socket says 172.21.15.148:55156) 2023-12-08T08:19:57.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.475+0000 7fd034bf5640 1 -- 172.21.15.148:0/1763040508 learned_addr learned my addr 172.21.15.148:0/1763040508 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-12-08T08:19:57.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.475+0000 7fd0353f6640 1 --2- 172.21.15.148:0/1763040508 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd03006e080 0x7fd03015b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.475+0000 7fd035bf7640 1 --2- 172.21.15.148:0/1763040508 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0300c7620 0x7fd0301540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.475+0000 7fd034bf5640 1 -- 172.21.15.148:0/1763040508 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0300c7620 msgr2=0x7fd0301540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.475+0000 7fd034bf5640 1 --2- 172.21.15.148:0/1763040508 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0300c7620 0x7fd0301540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.475+0000 7fd034bf5640 1 -- 172.21.15.148:0/1763040508 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd03006e080 msgr2=0x7fd03015b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.475+0000 7fd034bf5640 1 --2- 172.21.15.148:0/1763040508 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd03006e080 0x7fd03015b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.475+0000 7fd034bf5640 1 -- 172.21.15.148:0/1763040508 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd020009420 con 0x7fd0300704f0 2023-12-08T08:19:57.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.475+0000 7fd0353f6640 1 --2- 172.21.15.148:0/1763040508 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd03006e080 0x7fd03015b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:57.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.475+0000 7fd034bf5640 1 --2- 172.21.15.148:0/1763040508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0300704f0 0x7fd03014c2e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd02000ebe0 tx=0x7fd02000c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:57.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.475+0000 7fd025ffb640 1 -- 172.21.15.148:0/1763040508 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02000eee0 con 0x7fd0300704f0 2023-12-08T08:19:57.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.475+0000 7fd025ffb640 1 -- 172.21.15.148:0/1763040508 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02000cc30 con 0x7fd0300704f0 2023-12-08T08:19:57.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.475+0000 7fd025ffb640 1 -- 172.21.15.148:0/1763040508 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd020013470 con 0x7fd0300704f0 2023-12-08T08:19:57.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.475+0000 7fd03765a640 1 -- 172.21.15.148:0/1763040508 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd028009b30 con 0x7fd0300704f0 2023-12-08T08:19:57.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.475+0000 7fd03765a640 1 -- 172.21.15.148:0/1763040508 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd03014bae0 con 0x7fd0300704f0 2023-12-08T08:19:57.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.475+0000 7fd025ffb640 1 -- 172.21.15.148:0/1763040508 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd020005ca0 con 0x7fd0300704f0 2023-12-08T08:19:57.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.475+0000 7fd025ffb640 1 -- 172.21.15.148:0/1763040508 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fd020013ae0 con 0x7fd0300704f0 2023-12-08T08:19:57.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.475+0000 7fd03765a640 1 -- 172.21.15.148:0/1763040508 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd030067630 con 0x7fd0300704f0 2023-12-08T08:19:57.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.479+0000 7fd025ffb640 1 -- 172.21.15.148:0/1763040508 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fd020021060 con 0x7fd0300704f0 2023-12-08T08:19:57.488 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-12-08T08:19:57.488+0000 7f78eb124180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-08T08:19:57.490 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-08T08:19:57.487+0000 7feb7d817180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-08T08:19:57.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.547+0000 7fd03765a640 1 -- 172.21.15.148:0/1763040508 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1de2647e-90ab-4557-93fa-207ec702c775", "id": 4} v 0) v1 -- 0x7fd0300c8a40 con 0x7fd0300704f0 2023-12-08T08:19:57.552 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-08T08:19:57.551+0000 7feb7d817180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-08T08:19:57.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.551+0000 7fd025ffb640 1 -- 172.21.15.148:0/1763040508 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1de2647e-90ab-4557-93fa-207ec702c775", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd020017070 con 0x7fd0300704f0 2023-12-08T08:19:57.555 INFO:teuthology.orchestra.run.smithi148.stdout:4 2023-12-08T08:19:57.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.555+0000 7fd03765a640 1 -- 172.21.15.148:0/1763040508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0300704f0 msgr2=0x7fd03014c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.555+0000 7fd03765a640 1 --2- 172.21.15.148:0/1763040508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0300704f0 0x7fd03014c2e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd02000ebe0 tx=0x7fd02000c520 comp rx=0 tx=0).stop 2023-12-08T08:19:57.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.555+0000 7fd03765a640 1 -- 172.21.15.148:0/1763040508 shutdown_connections 2023-12-08T08:19:57.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.555+0000 7fd03765a640 1 --2- 172.21.15.148:0/1763040508 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0300c7620 0x7fd0301540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.555+0000 7fd03765a640 1 --2- 172.21.15.148:0/1763040508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0300704f0 0x7fd03014c2e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.555+0000 7fd03765a640 1 --2- 172.21.15.148:0/1763040508 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd03006e080 0x7fd03015b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.555+0000 7fd03765a640 1 -- 172.21.15.148:0/1763040508 >> 172.21.15.148:0/1763040508 conn(0x7fd0300c7ba0 msgr2=0x7fd0300733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:57.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.555+0000 7fd03765a640 1 -- 172.21.15.148:0/1763040508 shutdown_connections 2023-12-08T08:19:57.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.555+0000 7fd03765a640 1 -- 172.21.15.148:0/1763040508 wait complete. 2023-12-08T08:19:57.575 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 1d3867e2-c10b-4691-940c-bf0d8fa0ad48 5 2023-12-08T08:19:57.577 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-12-08T08:19:57.576+0000 7f78eb124180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-08T08:19:57.636 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-12-08T08:19:57.636+0000 7f78eb124180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-08T08:19:57.645 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-08T08:19:57.643+0000 7feb7d817180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-08T08:19:57.707 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-08T08:19:57.703+0000 7feb7d817180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-08T08:19:57.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.707+0000 7fc637e32640 1 Processor -- start 2023-12-08T08:19:57.711 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.707+0000 7fc637e32640 1 -- start start 2023-12-08T08:19:57.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.711+0000 7fc637e32640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc6301572f0 0x7fc630154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.711+0000 7fc637e32640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc63006b8f0 0x7fc63006bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.711+0000 7fc637e32640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc6300c64c0 0x7fc6300c6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.711+0000 7fc637e32640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6301554b0 con 0x7fc6301572f0 2023-12-08T08:19:57.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.711+0000 7fc637e32640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc63006b460 con 0x7fc6300c64c0 2023-12-08T08:19:57.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.711+0000 7fc637e32640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63006cd30 con 0x7fc63006b8f0 2023-12-08T08:19:57.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.711+0000 7fc6363cf640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc6300c64c0 0x7fc6300c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.711+0000 7fc6353cd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc63006b8f0 0x7fc63006bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.711+0000 7fc6363cf640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc6300c64c0 0x7fc6300c6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55170/0 (socket says 172.21.15.148:55170) 2023-12-08T08:19:57.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.711+0000 7fc6363cf640 1 -- 172.21.15.148:0/2281191043 learned_addr learned my addr 172.21.15.148:0/2281191043 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-12-08T08:19:57.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.711+0000 7fc635bce640 1 --2- 172.21.15.148:0/2281191043 >> v2:172.21.15.88:3300/0 conn(0x7fc6301572f0 0x7fc630154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.711+0000 7fc6363cf640 1 -- 172.21.15.148:0/2281191043 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc63006b8f0 msgr2=0x7fc63006bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:57.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.711+0000 7fc6363cf640 1 --2- 172.21.15.148:0/2281191043 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc63006b8f0 0x7fc63006bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.711+0000 7fc6363cf640 1 -- 172.21.15.148:0/2281191043 >> v2:172.21.15.88:3300/0 conn(0x7fc6301572f0 msgr2=0x7fc630154ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:57.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.711+0000 7fc6363cf640 1 --2- 172.21.15.148:0/2281191043 >> v2:172.21.15.88:3300/0 conn(0x7fc6301572f0 0x7fc630154ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.711+0000 7fc6363cf640 1 -- 172.21.15.148:0/2281191043 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6300c4b20 con 0x7fc6300c64c0 2023-12-08T08:19:57.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.715+0000 7fc6363cf640 1 --2- 172.21.15.148:0/2281191043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6300c64c0 0x7fc6300c6910 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc6300a99d0 tx=0x7fc62801c9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a18932e166b48aec server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:57.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.715+0000 7fc634bcc640 1 -- 172.21.15.148:0/2281191043 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6280a5760 con 0x7fc6300c64c0 2023-12-08T08:19:57.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.715+0000 7fc634bcc640 1 -- 172.21.15.148:0/2281191043 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6280a58c0 con 0x7fc6300c64c0 2023-12-08T08:19:57.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.715+0000 7fc634bcc640 1 -- 172.21.15.148:0/2281191043 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6280a5c50 con 0x7fc6300c64c0 2023-12-08T08:19:57.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.715+0000 7fc637e32640 1 -- 172.21.15.148:0/2281191043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6300c64c0 msgr2=0x7fc6300c6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.715+0000 7fc637e32640 1 --2- 172.21.15.148:0/2281191043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6300c64c0 0x7fc6300c6910 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc6300a99d0 tx=0x7fc62801c9d0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.715+0000 7fc637e32640 1 -- 172.21.15.148:0/2281191043 shutdown_connections 2023-12-08T08:19:57.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.715+0000 7fc637e32640 1 --2- 172.21.15.148:0/2281191043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6300c64c0 0x7fc6300c6910 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.715+0000 7fc637e32640 1 --2- 172.21.15.148:0/2281191043 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc63006b8f0 0x7fc63006bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.715+0000 7fc637e32640 1 --2- 172.21.15.148:0/2281191043 >> v2:172.21.15.88:3300/0 conn(0x7fc6301572f0 0x7fc630154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.715+0000 7fc637e32640 1 -- 172.21.15.148:0/2281191043 >> 172.21.15.148:0/2281191043 conn(0x7fc6300abbf0 msgr2=0x7fc6300ac000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:57.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.715+0000 7fc637e32640 1 -- 172.21.15.148:0/2281191043 shutdown_connections 2023-12-08T08:19:57.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.715+0000 7fc637e32640 1 -- 172.21.15.148:0/2281191043 wait complete. 2023-12-08T08:19:57.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.715+0000 7fc637e32640 1 Processor -- start 2023-12-08T08:19:57.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.715+0000 7fc637e32640 1 -- start start 2023-12-08T08:19:57.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.715+0000 7fc637e32640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc63006b8f0 0x7fc6300c0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.715+0000 7fc637e32640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6300c64c0 0x7fc630152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.715+0000 7fc637e32640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6301572f0 0x7fc630149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.715+0000 7fc637e32640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc630153290 con 0x7fc6300c64c0 2023-12-08T08:19:57.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.715+0000 7fc637e32640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6301540a0 con 0x7fc6301572f0 2023-12-08T08:19:57.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.715+0000 7fc637e32640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc630154c00 con 0x7fc63006b8f0 2023-12-08T08:19:57.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.719+0000 7fc635bce640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc63006b8f0 0x7fc6300c0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.719+0000 7fc6363cf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6301572f0 0x7fc630149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.719+0000 7fc635bce640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc63006b8f0 0x7fc6300c0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.148:44590/0 (socket says 172.21.15.148:44590) 2023-12-08T08:19:57.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.719+0000 7fc635bce640 1 -- 172.21.15.148:0/3271107770 learned_addr learned my addr 172.21.15.148:0/3271107770 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-12-08T08:19:57.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.719+0000 7fc6353cd640 1 --2- 172.21.15.148:0/3271107770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6300c64c0 0x7fc630152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.719+0000 7fc635bce640 1 -- 172.21.15.148:0/3271107770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6301572f0 msgr2=0x7fc630149510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.719+0000 7fc635bce640 1 --2- 172.21.15.148:0/3271107770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6301572f0 0x7fc630149510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.719+0000 7fc635bce640 1 -- 172.21.15.148:0/3271107770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6300c64c0 msgr2=0x7fc630152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.719+0000 7fc635bce640 1 --2- 172.21.15.148:0/3271107770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6300c64c0 0x7fc630152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.719+0000 7fc635bce640 1 -- 172.21.15.148:0/3271107770 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc628009b30 con 0x7fc63006b8f0 2023-12-08T08:19:57.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.719+0000 7fc6363cf640 1 --2- 172.21.15.148:0/3271107770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6301572f0 0x7fc630149510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:57.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.719+0000 7fc635bce640 1 --2- 172.21.15.148:0/3271107770 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc63006b8f0 0x7fc6300c0930 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc62c00e8a0 tx=0x7fc62c00eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:57.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.719+0000 7fc6267fc640 1 -- 172.21.15.148:0/3271107770 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c009510 con 0x7fc63006b8f0 2023-12-08T08:19:57.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.719+0000 7fc6267fc640 1 -- 172.21.15.148:0/3271107770 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62c00c940 con 0x7fc63006b8f0 2023-12-08T08:19:57.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.719+0000 7fc6267fc640 1 -- 172.21.15.148:0/3271107770 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c00ccb0 con 0x7fc63006b8f0 2023-12-08T08:19:57.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.719+0000 7fc637e32640 1 -- 172.21.15.148:0/3271107770 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6301542d0 con 0x7fc63006b8f0 2023-12-08T08:19:57.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.719+0000 7fc637e32640 1 -- 172.21.15.148:0/3271107770 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc630154890 con 0x7fc63006b8f0 2023-12-08T08:19:57.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.719+0000 7fc6267fc640 1 -- 172.21.15.148:0/3271107770 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc62c005ca0 con 0x7fc63006b8f0 2023-12-08T08:19:57.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.719+0000 7fc6267fc640 1 -- 172.21.15.148:0/3271107770 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fc62c00ce10 con 0x7fc63006b8f0 2023-12-08T08:19:57.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.719+0000 7fc637e32640 1 -- 172.21.15.148:0/3271107770 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc630067630 con 0x7fc63006b8f0 2023-12-08T08:19:57.724 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-12-08T08:19:57.724+0000 7f78eb124180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-08T08:19:57.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.723+0000 7fc6267fc640 1 -- 172.21.15.148:0/3271107770 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fc62c021060 con 0x7fc63006b8f0 2023-12-08T08:19:57.787 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-12-08T08:19:57.788+0000 7f78eb124180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-08T08:19:57.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.803+0000 7fc637e32640 1 -- 172.21.15.148:0/3271107770 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1d3867e2-c10b-4691-940c-bf0d8fa0ad48", "id": 5} v 0) v1 -- 0x7fc63006c880 con 0x7fc63006b8f0 2023-12-08T08:19:57.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.807+0000 7fc6267fc640 1 -- 172.21.15.148:0/3271107770 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1d3867e2-c10b-4691-940c-bf0d8fa0ad48", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc62c029020 con 0x7fc63006b8f0 2023-12-08T08:19:57.810 INFO:teuthology.orchestra.run.smithi148.stdout:5 2023-12-08T08:19:57.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.807+0000 7fc637e32640 1 -- 172.21.15.148:0/3271107770 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc63006b8f0 msgr2=0x7fc6300c0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.807+0000 7fc637e32640 1 --2- 172.21.15.148:0/3271107770 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc63006b8f0 0x7fc6300c0930 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc62c00e8a0 tx=0x7fc62c00eca0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.807+0000 7fc637e32640 1 -- 172.21.15.148:0/3271107770 shutdown_connections 2023-12-08T08:19:57.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.807+0000 7fc637e32640 1 --2- 172.21.15.148:0/3271107770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6301572f0 0x7fc630149510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.807+0000 7fc637e32640 1 --2- 172.21.15.148:0/3271107770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6300c64c0 0x7fc630152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.807+0000 7fc637e32640 1 --2- 172.21.15.148:0/3271107770 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc63006b8f0 0x7fc6300c0930 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.807+0000 7fc637e32640 1 -- 172.21.15.148:0/3271107770 >> 172.21.15.148:0/3271107770 conn(0x7fc6300abbf0 msgr2=0x7fc6300abfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:57.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.807+0000 7fc637e32640 1 -- 172.21.15.148:0/3271107770 shutdown_connections 2023-12-08T08:19:57.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.807+0000 7fc637e32640 1 -- 172.21.15.148:0/3271107770 wait complete. 2023-12-08T08:19:57.813 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-08T08:19:57.811+0000 7feb7d817180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-08T08:19:57.830 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new d716a895-88c0-49c0-944f-69a4dfee3d47 6 2023-12-08T08:19:57.879 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-08T08:19:57.875+0000 7feb7d817180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-08T08:19:57.940 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-12-08T08:19:57.940+0000 7f78eb124180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-08T08:19:57.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.963+0000 7f5ffcb2b640 1 Processor -- start 2023-12-08T08:19:57.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.963+0000 7f5ffcb2b640 1 -- start start 2023-12-08T08:19:57.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.963+0000 7f5ffcb2b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5ff80c7b00 0x7f5ff8154380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.963+0000 7f5ffcb2b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff80c85d0 con 0x7f5ff81585f0 2023-12-08T08:19:57.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.963+0000 7f5ffcb2b640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff8158160 con 0x7f5ff81519f0 2023-12-08T08:19:57.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.963+0000 7f5ffcb2b640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff80c5310 con 0x7f5ff80c7b00 2023-12-08T08:19:57.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.963+0000 7f5ff77fe640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f5ff81519f0 0x7f5ff80ca310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49206/0 (socket says 172.21.15.148:49206) 2023-12-08T08:19:57.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.963+0000 7f5ff77fe640 1 -- 172.21.15.148:0/3322725590 learned_addr learned my addr 172.21.15.148:0/3322725590 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-12-08T08:19:57.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.967+0000 7f5ff6ffd640 1 --2- 172.21.15.148:0/3322725590 >> v2:172.21.15.88:3300/0 conn(0x7f5ff80c7b00 0x7f5ff8154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.967+0000 7f5ff67fc640 1 -- 172.21.15.148:0/3322725590 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747067549 0 0) 0x7f5ff8158160 con 0x7f5ff81519f0 2023-12-08T08:19:57.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.967+0000 7f5ff67fc640 1 -- 172.21.15.148:0/3322725590 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fe0003530 con 0x7f5ff81519f0 2023-12-08T08:19:57.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.967+0000 7f5ff67fc640 1 -- 172.21.15.148:0/3322725590 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3623717690 0 0) 0x7f5ff00014a0 con 0x7f5ff81585f0 2023-12-08T08:19:57.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.967+0000 7f5ff67fc640 1 -- 172.21.15.148:0/3322725590 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ff8158160 con 0x7f5ff81585f0 2023-12-08T08:19:57.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.967+0000 7f5ff6ffd640 1 -- 172.21.15.148:0/3322725590 >> v1:172.21.15.148:6789/0 conn(0x7f5ff81519f0 legacy=0x7f5ff80ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.967+0000 7f5ff6ffd640 1 -- 172.21.15.148:0/3322725590 >> v1:172.21.15.88:6789/0 conn(0x7f5ff81585f0 legacy=0x7f5ff815ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.967+0000 7f5ff6ffd640 1 -- 172.21.15.148:0/3322725590 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff8151dd0 con 0x7f5ff80c7b00 2023-12-08T08:19:57.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.967+0000 7f5ff6ffd640 1 --2- 172.21.15.148:0/3322725590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ff80c7b00 0x7f5ff8154380 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5fec0097c0 tx=0x7f5fec01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9c036eaedc32bb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:57.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.967+0000 7f5ff67fc640 1 -- 172.21.15.148:0/3322725590 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec0ab5f0 con 0x7f5ff80c7b00 2023-12-08T08:19:57.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.967+0000 7f5ff67fc640 1 -- 172.21.15.148:0/3322725590 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fec0ab750 con 0x7f5ff80c7b00 2023-12-08T08:19:57.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.967+0000 7f5ff67fc640 1 -- 172.21.15.148:0/3322725590 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec0abac0 con 0x7f5ff80c7b00 2023-12-08T08:19:57.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.971+0000 7f5ffcb2b640 1 -- 172.21.15.148:0/3322725590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ff80c7b00 msgr2=0x7f5ff8154380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.971+0000 7f5ffcb2b640 1 --2- 172.21.15.148:0/3322725590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ff80c7b00 0x7f5ff8154380 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5fec0097c0 tx=0x7f5fec01c3d0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.971+0000 7f5ffcb2b640 1 -- 172.21.15.148:0/3322725590 shutdown_connections 2023-12-08T08:19:57.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.971+0000 7f5ffcb2b640 1 --2- 172.21.15.148:0/3322725590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ff80c7b00 0x7f5ff8154380 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.971+0000 7f5ffcb2b640 1 -- 172.21.15.148:0/3322725590 >> 172.21.15.148:0/3322725590 conn(0x7f5ff80abd90 msgr2=0x7f5ff80c9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:57.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.971+0000 7f5ffcb2b640 1 -- 172.21.15.148:0/3322725590 shutdown_connections 2023-12-08T08:19:57.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.971+0000 7f5ffcb2b640 1 -- 172.21.15.148:0/3322725590 wait complete. 2023-12-08T08:19:57.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.971+0000 7f5ffcb2b640 1 Processor -- start 2023-12-08T08:19:57.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.971+0000 7f5ffcb2b640 1 -- start start 2023-12-08T08:19:57.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.971+0000 7f5ffcb2b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ff80c7b00 0x7f5ff8143960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.971+0000 7f5ffcb2b640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ff81519f0 0x7f5ff8149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.971+0000 7f5ffcb2b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ff81585f0 0x7f5ff8149c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.971+0000 7f5ffcb2b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff8160240 con 0x7f5ff81585f0 2023-12-08T08:19:57.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.971+0000 7f5ffcb2b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff8154690 con 0x7f5ff80c7b00 2023-12-08T08:19:57.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.971+0000 7f5ffcb2b640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff81540d0 con 0x7f5ff81519f0 2023-12-08T08:19:57.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.971+0000 7f5ff77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ff80c7b00 0x7f5ff8143960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.971+0000 7f5ff6ffd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ff81519f0 0x7f5ff8149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.971+0000 7f5ff6ffd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ff81519f0 0x7f5ff8149710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.148:44602/0 (socket says 172.21.15.148:44602) 2023-12-08T08:19:57.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.971+0000 7f5ff6ffd640 1 -- 172.21.15.148:0/3047617239 learned_addr learned my addr 172.21.15.148:0/3047617239 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-12-08T08:19:57.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.971+0000 7f5ff77fe640 1 --2- 172.21.15.148:0/3047617239 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ff80c7b00 0x7f5ff8143960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55186/0 (socket says 172.21.15.148:55186) 2023-12-08T08:19:57.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.971+0000 7f5ff7fff640 1 --2- 172.21.15.148:0/3047617239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ff81585f0 0x7f5ff8149c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.975+0000 7f5ff6ffd640 1 -- 172.21.15.148:0/3047617239 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ff80c7b00 msgr2=0x7f5ff8143960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.975+0000 7f5ff6ffd640 1 --2- 172.21.15.148:0/3047617239 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ff80c7b00 0x7f5ff8143960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.975+0000 7f5ff6ffd640 1 -- 172.21.15.148:0/3047617239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ff81585f0 msgr2=0x7f5ff8149c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.975+0000 7f5ff6ffd640 1 --2- 172.21.15.148:0/3047617239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ff81585f0 0x7f5ff8149c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.975+0000 7f5ff6ffd640 1 -- 172.21.15.148:0/3047617239 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec009420 con 0x7f5ff81519f0 2023-12-08T08:19:57.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.975+0000 7f5ff77fe640 1 --2- 172.21.15.148:0/3047617239 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ff80c7b00 0x7f5ff8143960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:57.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.975+0000 7f5ff6ffd640 1 --2- 172.21.15.148:0/3047617239 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ff81519f0 0x7f5ff8149710 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5fec000c10 tx=0x7f5fec01ac10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:57.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.975+0000 7f5fdffff640 1 -- 172.21.15.148:0/3047617239 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec0bf610 con 0x7f5ff81519f0 2023-12-08T08:19:57.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.975+0000 7f5fdffff640 1 -- 172.21.15.148:0/3047617239 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fec0bf770 con 0x7f5ff81519f0 2023-12-08T08:19:57.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.975+0000 7f5ffcb2b640 1 -- 172.21.15.148:0/3047617239 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff81543b0 con 0x7f5ff81519f0 2023-12-08T08:19:57.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.975+0000 7f5fdffff640 1 -- 172.21.15.148:0/3047617239 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec0bfae0 con 0x7f5ff81519f0 2023-12-08T08:19:57.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.975+0000 7f5ffcb2b640 1 -- 172.21.15.148:0/3047617239 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff81491f0 con 0x7f5ff81519f0 2023-12-08T08:19:57.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.975+0000 7f5fdffff640 1 -- 172.21.15.148:0/3047617239 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5fec0b5400 con 0x7f5ff81519f0 2023-12-08T08:19:57.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.975+0000 7f5fdffff640 1 -- 172.21.15.148:0/3047617239 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f5fec0a8050 con 0x7f5ff81519f0 2023-12-08T08:19:57.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.975+0000 7f5ffcb2b640 1 -- 172.21.15.148:0/3047617239 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff8157ad0 con 0x7f5ff81519f0 2023-12-08T08:19:57.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:57.979+0000 7f5fdffff640 1 -- 172.21.15.148:0/3047617239 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f5fec006e20 con 0x7f5ff81519f0 2023-12-08T08:19:58.009 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-12-08T08:19:58.008+0000 7f78eb124180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-08T08:19:58.038 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-08T08:19:58.035+0000 7feb7d817180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-08T08:19:58.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.043+0000 7f5ffcb2b640 1 -- 172.21.15.148:0/3047617239 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d716a895-88c0-49c0-944f-69a4dfee3d47", "id": 6} v 0) v1 -- 0x7f5ff8072960 con 0x7f5ff81519f0 2023-12-08T08:19:58.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.047+0000 7f5fdffff640 1 -- 172.21.15.148:0/3047617239 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d716a895-88c0-49c0-944f-69a4dfee3d47", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5fec0b5820 con 0x7f5ff81519f0 2023-12-08T08:19:58.051 INFO:teuthology.orchestra.run.smithi148.stdout:6 2023-12-08T08:19:58.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.051+0000 7f5ffcb2b640 1 -- 172.21.15.148:0/3047617239 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ff81519f0 msgr2=0x7f5ff8149710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.051+0000 7f5ffcb2b640 1 --2- 172.21.15.148:0/3047617239 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ff81519f0 0x7f5ff8149710 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5fec000c10 tx=0x7f5fec01ac10 comp rx=0 tx=0).stop 2023-12-08T08:19:58.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.051+0000 7f5ffcb2b640 1 -- 172.21.15.148:0/3047617239 shutdown_connections 2023-12-08T08:19:58.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.051+0000 7f5ffcb2b640 1 --2- 172.21.15.148:0/3047617239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ff81585f0 0x7f5ff8149c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.051+0000 7f5ffcb2b640 1 --2- 172.21.15.148:0/3047617239 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ff81519f0 0x7f5ff8149710 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.051+0000 7f5ffcb2b640 1 --2- 172.21.15.148:0/3047617239 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ff80c7b00 0x7f5ff8143960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.051+0000 7f5ffcb2b640 1 -- 172.21.15.148:0/3047617239 >> 172.21.15.148:0/3047617239 conn(0x7f5ff80abd90 msgr2=0x7f5ff814ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:58.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.051+0000 7f5ffcb2b640 1 -- 172.21.15.148:0/3047617239 shutdown_connections 2023-12-08T08:19:58.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.051+0000 7f5ffcb2b640 1 -- 172.21.15.148:0/3047617239 wait complete. 2023-12-08T08:19:58.071 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new b0ac65a5-8d00-4df3-b011-053e54a8051d 7 2023-12-08T08:19:58.110 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-08T08:19:58.107+0000 7feb7d817180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-08T08:19:58.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.243+0000 7f091c9d1640 1 Processor -- start 2023-12-08T08:19:58.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.243+0000 7f091c9d1640 1 -- start start 2023-12-08T08:19:58.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.247+0000 7f091c9d1640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f09180c6030 0x7f09180c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.247+0000 7f091c9d1640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0918158780 con 0x7f09180c98f0 2023-12-08T08:19:58.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.247+0000 7f091c9d1640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09180c8910 con 0x7f09180bf2d0 2023-12-08T08:19:58.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.247+0000 7f091c9d1640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09180c0300 con 0x7f09180c6030 2023-12-08T08:19:58.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.247+0000 7f0915d9b640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f09180c6030 0x7f09180c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.247+0000 7f091659c640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f09180bf2d0 0x7f0918151970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49208/0 (socket says 172.21.15.148:49208) 2023-12-08T08:19:58.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.247+0000 7f0915d9b640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f09180c6030 0x7f09180c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55190/0 (socket says 172.21.15.148:55190) 2023-12-08T08:19:58.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.247+0000 7f091659c640 1 -- 172.21.15.148:0/693086688 learned_addr learned my addr 172.21.15.148:0/693086688 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-12-08T08:19:58.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.247+0000 7f0915d9b640 1 -- 172.21.15.148:0/693086688 >> v1:172.21.15.148:6789/0 conn(0x7f09180bf2d0 legacy=0x7f0918151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.247+0000 7f0915d9b640 1 -- 172.21.15.148:0/693086688 >> v1:172.21.15.88:6789/0 conn(0x7f09180c98f0 legacy=0x7f09180c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.247+0000 7f0915d9b640 1 -- 172.21.15.148:0/693086688 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0918157b70 con 0x7f09180c6030 2023-12-08T08:19:58.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.247+0000 7f091559a640 1 -- 172.21.15.148:0/693086688 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595476559 0 0) 0x7f09180c8910 con 0x7f09180bf2d0 2023-12-08T08:19:58.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.251+0000 7f0915d9b640 1 --2- 172.21.15.148:0/693086688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09180c6030 0x7f09180c7cc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f090c0097c0 tx=0x7f090c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29aa7bf2c8b599a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:58.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.251+0000 7f091559a640 1 -- 172.21.15.148:0/693086688 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c0ab650 con 0x7f09180c6030 2023-12-08T08:19:58.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.251+0000 7f091559a640 1 -- 172.21.15.148:0/693086688 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c0ab7b0 con 0x7f09180c6030 2023-12-08T08:19:58.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.251+0000 7f091559a640 1 -- 172.21.15.148:0/693086688 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c0abb40 con 0x7f09180c6030 2023-12-08T08:19:58.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.251+0000 7f091c9d1640 1 -- 172.21.15.148:0/693086688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09180c6030 msgr2=0x7f09180c7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.251+0000 7f091c9d1640 1 --2- 172.21.15.148:0/693086688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09180c6030 0x7f09180c7cc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f090c0097c0 tx=0x7f090c01c450 comp rx=0 tx=0).stop 2023-12-08T08:19:58.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.251+0000 7f091c9d1640 1 -- 172.21.15.148:0/693086688 shutdown_connections 2023-12-08T08:19:58.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.251+0000 7f091c9d1640 1 --2- 172.21.15.148:0/693086688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09180c6030 0x7f09180c7cc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.251+0000 7f091c9d1640 1 -- 172.21.15.148:0/693086688 >> 172.21.15.148:0/693086688 conn(0x7f09180c9dc0 msgr2=0x7f09180ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:58.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.251+0000 7f091c9d1640 1 -- 172.21.15.148:0/693086688 shutdown_connections 2023-12-08T08:19:58.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.251+0000 7f091c9d1640 1 -- 172.21.15.148:0/693086688 wait complete. 2023-12-08T08:19:58.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.251+0000 7f091c9d1640 1 Processor -- start 2023-12-08T08:19:58.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.251+0000 7f091c9d1640 1 -- start start 2023-12-08T08:19:58.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.255+0000 7f091c9d1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09180bf2d0 0x7f09180ae940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.255+0000 7f091c9d1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09180c6030 0x7f09180aee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.255+0000 7f091c9d1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09180c98f0 0x7f0918148480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.255+0000 7f091c9d1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09180ad850 con 0x7f09180c98f0 2023-12-08T08:19:58.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.255+0000 7f091c9d1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0918140eb0 con 0x7f09180c6030 2023-12-08T08:19:58.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.255+0000 7f091c9d1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09181f0c70 con 0x7f09180bf2d0 2023-12-08T08:19:58.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.255+0000 7f091659c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09180bf2d0 0x7f09180ae940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.255+0000 7f0915d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09180c6030 0x7f09180aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.255+0000 7f0915d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09180c6030 0x7f09180aee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55192/0 (socket says 172.21.15.148:55192) 2023-12-08T08:19:58.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.255+0000 7f0915d9b640 1 -- 172.21.15.148:0/1897666724 learned_addr learned my addr 172.21.15.148:0/1897666724 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-12-08T08:19:58.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.255+0000 7f091659c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09180bf2d0 0x7f09180ae940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.148:44604/0 (socket says 172.21.15.148:44604) 2023-12-08T08:19:58.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.255+0000 7f0916d9d640 1 --2- 172.21.15.148:0/1897666724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09180c98f0 0x7f0918148480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.255+0000 7f0915d9b640 1 -- 172.21.15.148:0/1897666724 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09180bf2d0 msgr2=0x7f09180ae940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.255+0000 7f0915d9b640 1 --2- 172.21.15.148:0/1897666724 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09180bf2d0 0x7f09180ae940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.255+0000 7f0915d9b640 1 -- 172.21.15.148:0/1897666724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09180c98f0 msgr2=0x7f0918148480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.255+0000 7f0915d9b640 1 --2- 172.21.15.148:0/1897666724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09180c98f0 0x7f0918148480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.255+0000 7f0915d9b640 1 -- 172.21.15.148:0/1897666724 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c009420 con 0x7f09180c6030 2023-12-08T08:19:58.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.255+0000 7f0915d9b640 1 --2- 172.21.15.148:0/1897666724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09180c6030 0x7f09180aee80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f090c009710 tx=0x7f090c01ac90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:58.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.255+0000 7f0906ffd640 1 -- 172.21.15.148:0/1897666724 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c0b5810 con 0x7f09180c6030 2023-12-08T08:19:58.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.255+0000 7f0906ffd640 1 -- 172.21.15.148:0/1897666724 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c0b5970 con 0x7f09180c6030 2023-12-08T08:19:58.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.255+0000 7f0906ffd640 1 -- 172.21.15.148:0/1897666724 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c0b5d20 con 0x7f09180c6030 2023-12-08T08:19:58.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.255+0000 7f091c9d1640 1 -- 172.21.15.148:0/1897666724 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09180af580 con 0x7f09180c6030 2023-12-08T08:19:58.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.255+0000 7f091c9d1640 1 -- 172.21.15.148:0/1897666724 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09180ace20 con 0x7f09180c6030 2023-12-08T08:19:58.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.255+0000 7f0906ffd640 1 -- 172.21.15.148:0/1897666724 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f090c0bf710 con 0x7f09180c6030 2023-12-08T08:19:58.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.255+0000 7f0906ffd640 1 -- 172.21.15.148:0/1897666724 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f090c0c9af0 con 0x7f09180c6030 2023-12-08T08:19:58.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.255+0000 7f091c9d1640 1 -- 172.21.15.148:0/1897666724 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0918067630 con 0x7f09180c6030 2023-12-08T08:19:58.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.259+0000 7f0906ffd640 1 -- 172.21.15.148:0/1897666724 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f090c0c4020 con 0x7f09180c6030 2023-12-08T08:19:58.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.323+0000 7f091c9d1640 1 -- 172.21.15.148:0/1897666724 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b0ac65a5-8d00-4df3-b011-053e54a8051d", "id": 7} v 0) v1 -- 0x7f0918157210 con 0x7f09180c6030 2023-12-08T08:19:58.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.331+0000 7f0906ffd640 1 -- 172.21.15.148:0/1897666724 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b0ac65a5-8d00-4df3-b011-053e54a8051d", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f090c0c9cb0 con 0x7f09180c6030 2023-12-08T08:19:58.333 INFO:teuthology.orchestra.run.smithi148.stdout:7 2023-12-08T08:19:58.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.331+0000 7f091c9d1640 1 -- 172.21.15.148:0/1897666724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09180c6030 msgr2=0x7f09180aee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.331+0000 7f091c9d1640 1 --2- 172.21.15.148:0/1897666724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09180c6030 0x7f09180aee80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f090c009710 tx=0x7f090c01ac90 comp rx=0 tx=0).stop 2023-12-08T08:19:58.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.331+0000 7f091c9d1640 1 -- 172.21.15.148:0/1897666724 shutdown_connections 2023-12-08T08:19:58.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.331+0000 7f091c9d1640 1 --2- 172.21.15.148:0/1897666724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09180c98f0 0x7f0918148480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.331+0000 7f091c9d1640 1 --2- 172.21.15.148:0/1897666724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09180c6030 0x7f09180aee80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.331+0000 7f091c9d1640 1 --2- 172.21.15.148:0/1897666724 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09180bf2d0 0x7f09180ae940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.331+0000 7f091c9d1640 1 -- 172.21.15.148:0/1897666724 >> 172.21.15.148:0/1897666724 conn(0x7f09180c9dc0 msgr2=0x7f09180c4990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:58.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.331+0000 7f091c9d1640 1 -- 172.21.15.148:0/1897666724 shutdown_connections 2023-12-08T08:19:58.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-08T08:19:58.331+0000 7f091c9d1640 1 -- 172.21.15.148:0/1897666724 wait complete. 2023-12-08T08:19:58.353 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-08T08:19:58.353 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-08T08:19:58.362 INFO:tasks.ceph.osd.0:Started 2023-12-08T08:19:58.362 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-08T08:19:58.362 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-08T08:19:58.383 INFO:tasks.ceph.osd.1:Started 2023-12-08T08:19:58.383 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-08T08:19:58.383 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-08T08:19:58.391 INFO:tasks.ceph.osd.2:Started 2023-12-08T08:19:58.391 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-08T08:19:58.391 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-08T08:19:58.395 INFO:tasks.ceph.osd.3:Started 2023-12-08T08:19:58.395 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-08T08:19:58.395 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-08T08:19:58.399 INFO:tasks.ceph.osd.4:Started 2023-12-08T08:19:58.399 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-08T08:19:58.399 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-08T08:19:58.402 INFO:tasks.ceph.osd.5:Started 2023-12-08T08:19:58.402 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-08T08:19:58.403 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-08T08:19:58.406 INFO:tasks.ceph.osd.6:Started 2023-12-08T08:19:58.406 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-08T08:19:58.406 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-08T08:19:58.409 INFO:tasks.ceph.osd.7:Started 2023-12-08T08:19:58.410 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:58.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.576+0000 7f7e40694640 1 Processor -- start 2023-12-08T08:19:58.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.576+0000 7f7e40694640 1 -- start start 2023-12-08T08:19:58.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.576+0000 7f7e40694640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7e380af4c0 0x7f7e38154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.576+0000 7f7e40694640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7e3806c100 0x7f7e380c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.576+0000 7f7e40694640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e380c4890 con 0x7f7e380c67d0 2023-12-08T08:19:58.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.576+0000 7f7e40694640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e38155460 con 0x7f7e380af4c0 2023-12-08T08:19:58.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.576+0000 7f7e40694640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e380af8a0 con 0x7f7e3806c100 2023-12-08T08:19:58.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.576+0000 7f7e3e430640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7e380af4c0 0x7f7e38154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.576+0000 7f7e3e430640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7e380af4c0 0x7f7e38154f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37806/0 (socket says 172.21.15.88:37806) 2023-12-08T08:19:58.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.576+0000 7f7e3dc2f640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7e380c67d0 0x7f7e3806b9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47974/0 (socket says 172.21.15.88:47974) 2023-12-08T08:19:58.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.576+0000 7f7e3e430640 1 -- 172.21.15.88:0/2026046724 learned_addr learned my addr 172.21.15.88:0/2026046724 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:19:58.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.576+0000 7f7e3ec31640 1 --2- 172.21.15.88:0/2026046724 >> v2:172.21.15.148:3300/0 conn(0x7f7e3806c100 0x7f7e380c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.576+0000 7f7e3e430640 1 -- 172.21.15.88:0/2026046724 >> v2:172.21.15.148:3300/0 conn(0x7f7e3806c100 msgr2=0x7f7e380c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:58.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.576+0000 7f7e3e430640 1 --2- 172.21.15.88:0/2026046724 >> v2:172.21.15.148:3300/0 conn(0x7f7e3806c100 0x7f7e380c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.576+0000 7f7e3e430640 1 -- 172.21.15.88:0/2026046724 >> v1:172.21.15.88:6789/0 conn(0x7f7e380c67d0 legacy=0x7f7e3806b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.576+0000 7f7e3e430640 1 -- 172.21.15.88:0/2026046724 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e380c4b30 con 0x7f7e380af4c0 2023-12-08T08:19:58.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.576+0000 7f7e3d42e640 1 -- 172.21.15.88:0/2026046724 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4198353701 0 0) 0x7f7e380c4890 con 0x7f7e380c67d0 2023-12-08T08:19:58.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.580+0000 7f7e3e430640 1 --2- 172.21.15.88:0/2026046724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e380af4c0 0x7f7e38154f20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7e380c9d90 tx=0x7f7e3401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835107516c2ce2a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:58.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.580+0000 7f7e3d42e640 1 -- 172.21.15.88:0/2026046724 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e340ab640 con 0x7f7e380af4c0 2023-12-08T08:19:58.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.580+0000 7f7e3d42e640 1 -- 172.21.15.88:0/2026046724 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e340a7070 con 0x7f7e380af4c0 2023-12-08T08:19:58.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.580+0000 7f7e3d42e640 1 -- 172.21.15.88:0/2026046724 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e340ab9c0 con 0x7f7e380af4c0 2023-12-08T08:19:58.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.580+0000 7f7e40694640 1 -- 172.21.15.88:0/2026046724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e380af4c0 msgr2=0x7f7e38154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.580+0000 7f7e40694640 1 --2- 172.21.15.88:0/2026046724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e380af4c0 0x7f7e38154f20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7e380c9d90 tx=0x7f7e3401c440 comp rx=0 tx=0).stop 2023-12-08T08:19:58.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.580+0000 7f7e40694640 1 -- 172.21.15.88:0/2026046724 shutdown_connections 2023-12-08T08:19:58.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.580+0000 7f7e40694640 1 --2- 172.21.15.88:0/2026046724 >> v2:172.21.15.148:3300/0 conn(0x7f7e3806c100 0x7f7e380c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.580+0000 7f7e40694640 1 --2- 172.21.15.88:0/2026046724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e380af4c0 0x7f7e38154f20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.580+0000 7f7e40694640 1 -- 172.21.15.88:0/2026046724 >> 172.21.15.88:0/2026046724 conn(0x7f7e380ab9d0 msgr2=0x7f7e380abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:58.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.580+0000 7f7e40694640 1 -- 172.21.15.88:0/2026046724 shutdown_connections 2023-12-08T08:19:58.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.580+0000 7f7e40694640 1 -- 172.21.15.88:0/2026046724 wait complete. 2023-12-08T08:19:58.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.584+0000 7f7e40694640 1 Processor -- start 2023-12-08T08:19:58.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.584+0000 7f7e40694640 1 -- start start 2023-12-08T08:19:58.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.584+0000 7f7e40694640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e3806c100 0x7f7e38151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.584+0000 7f7e40694640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e380af4c0 0x7f7e380bee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.584+0000 7f7e40694640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7e380c67d0 0x7f7e38157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.584+0000 7f7e40694640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e380bf7e0 con 0x7f7e3806c100 2023-12-08T08:19:58.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.584+0000 7f7e40694640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e380c04f0 con 0x7f7e380af4c0 2023-12-08T08:19:58.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.584+0000 7f7e40694640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e38151ac0 con 0x7f7e380c67d0 2023-12-08T08:19:58.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.584+0000 7f7e3e430640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e3806c100 0x7f7e38151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.584+0000 7f7e3e430640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e3806c100 0x7f7e38151580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37816/0 (socket says 172.21.15.88:37816) 2023-12-08T08:19:58.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.584+0000 7f7e3e430640 1 -- 172.21.15.88:0/2344487465 learned_addr learned my addr 172.21.15.88:0/2344487465 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:19:58.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.584+0000 7f7e3e430640 1 -- 172.21.15.88:0/2344487465 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7e380c67d0 msgr2=0x7f7e38157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.584+0000 7f7e3e430640 1 --2- 172.21.15.88:0/2344487465 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7e380c67d0 0x7f7e38157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.584+0000 7f7e3e430640 1 -- 172.21.15.88:0/2344487465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e380af4c0 msgr2=0x7f7e380bee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.584+0000 7f7e3e430640 1 --2- 172.21.15.88:0/2344487465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e380af4c0 0x7f7e380bee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.584+0000 7f7e3e430640 1 -- 172.21.15.88:0/2344487465 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e340094d0 con 0x7f7e3806c100 2023-12-08T08:19:58.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.584+0000 7f7e3e430640 1 --2- 172.21.15.88:0/2344487465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e3806c100 0x7f7e38151580 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7e340ad040 tx=0x7f7e3401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:58.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.584+0000 7f7e2effd640 1 -- 172.21.15.88:0/2344487465 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34004220 con 0x7f7e3806c100 2023-12-08T08:19:58.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.584+0000 7f7e2effd640 1 -- 172.21.15.88:0/2344487465 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e340b8070 con 0x7f7e3806c100 2023-12-08T08:19:58.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.584+0000 7f7e2effd640 1 -- 172.21.15.88:0/2344487465 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e340ab6b0 con 0x7f7e3806c100 2023-12-08T08:19:58.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.584+0000 7f7e40694640 1 -- 172.21.15.88:0/2344487465 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e380bf360 con 0x7f7e3806c100 2023-12-08T08:19:58.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.584+0000 7f7e40694640 1 -- 172.21.15.88:0/2344487465 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e380bfa10 con 0x7f7e3806c100 2023-12-08T08:19:58.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.584+0000 7f7e2effd640 1 -- 172.21.15.88:0/2344487465 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7e340abb10 con 0x7f7e3806c100 2023-12-08T08:19:58.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.584+0000 7f7e2effd640 1 -- 172.21.15.88:0/2344487465 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f7e340abdc0 con 0x7f7e3806c100 2023-12-08T08:19:58.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.584+0000 7f7e40694640 1 -- 172.21.15.88:0/2344487465 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e38067630 con 0x7f7e3806c100 2023-12-08T08:19:58.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.588+0000 7f7e2effd640 1 -- 172.21.15.88:0/2344487465 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f7e340c3020 con 0x7f7e3806c100 2023-12-08T08:19:58.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.644+0000 7f7e40694640 1 -- 172.21.15.88:0/2344487465 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e3806c7a0 con 0x7f7e3806c100 2023-12-08T08:19:58.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.644+0000 7f7e2effd640 1 -- 172.21.15.88:0/2344487465 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f7e340ba070 con 0x7f7e3806c100 2023-12-08T08:19:58.646 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:19:58.646 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":10,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:19:58.328978+0000","last_up_change":"0.000000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:58.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.648+0000 7f7e40694640 1 -- 172.21.15.88:0/2344487465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e3806c100 msgr2=0x7f7e38151580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.648+0000 7f7e40694640 1 --2- 172.21.15.88:0/2344487465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e3806c100 0x7f7e38151580 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7e340ad040 tx=0x7f7e3401ac80 comp rx=0 tx=0).stop 2023-12-08T08:19:58.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.648+0000 7f7e40694640 1 -- 172.21.15.88:0/2344487465 shutdown_connections 2023-12-08T08:19:58.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.648+0000 7f7e40694640 1 --2- 172.21.15.88:0/2344487465 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7e380c67d0 0x7f7e38157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.648+0000 7f7e40694640 1 --2- 172.21.15.88:0/2344487465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e380af4c0 0x7f7e380bee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.648+0000 7f7e40694640 1 --2- 172.21.15.88:0/2344487465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e3806c100 0x7f7e38151580 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.648+0000 7f7e40694640 1 -- 172.21.15.88:0/2344487465 >> 172.21.15.88:0/2344487465 conn(0x7f7e380ab9d0 msgr2=0x7f7e38155cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:58.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.648+0000 7f7e40694640 1 -- 172.21.15.88:0/2344487465 shutdown_connections 2023-12-08T08:19:58.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:19:58.648+0000 7f7e40694640 1 -- 172.21.15.88:0/2344487465 wait complete. 2023-12-08T08:19:58.665 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-08T08:19:58.666 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-08T08:19:58.678 INFO:tasks.ceph.mgr.y.smithi088.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-12-08T08:19:58.678 INFO:tasks.ceph.mgr.y.smithi088.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-12-08T08:19:58.678 INFO:tasks.ceph.mgr.y.smithi088.stderr: from numpy import show_config as show_numpy_config 2023-12-08T08:19:58.726 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-12-08T08:19:58.724+0000 7f78eb124180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-08T08:19:58.790 INFO:tasks.ceph.mgr.x.smithi148.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-12-08T08:19:58.790 INFO:tasks.ceph.mgr.x.smithi148.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-12-08T08:19:58.790 INFO:tasks.ceph.mgr.x.smithi148.stderr: from numpy import show_config as show_numpy_config 2023-12-08T08:19:58.838 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-08T08:19:58.835+0000 7feb7d817180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-08T08:19:58.862 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-12-08T08:19:58.860+0000 7f78eb124180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-08T08:19:58.973 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-08T08:19:58.971+0000 7feb7d817180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-08T08:19:59.039 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-12-08T08:19:59.040+0000 7f78eb124180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-08T08:19:59.040 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-12-08T08:19:59.040+0000 7f74e4236640 -1 Falling back to public interface 2023-12-08T08:19:59.045 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-12-08T08:19:59.044+0000 7f9055ade640 -1 Falling back to public interface 2023-12-08T08:19:59.045 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-12-08T08:19:59.044+0000 7fbbe426b640 -1 Falling back to public interface 2023-12-08T08:19:59.056 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-12-08T08:19:59.056+0000 7fdc16107640 -1 Falling back to public interface 2023-12-08T08:19:59.093 INFO:tasks.ceph.osd.6.smithi148.stderr:2023-12-08T08:19:59.091+0000 7f8bccf19640 -1 Falling back to public interface 2023-12-08T08:19:59.097 INFO:tasks.ceph.osd.5.smithi148.stderr:2023-12-08T08:19:59.095+0000 7f2191367640 -1 Falling back to public interface 2023-12-08T08:19:59.105 INFO:tasks.ceph.osd.4.smithi148.stderr:2023-12-08T08:19:59.103+0000 7fc3862c9640 -1 Falling back to public interface 2023-12-08T08:19:59.117 INFO:tasks.ceph.osd.7.smithi148.stderr:2023-12-08T08:19:59.115+0000 7f821e42b640 -1 Falling back to public interface 2023-12-08T08:19:59.118 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-12-08T08:19:59.116+0000 7f78eb124180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-08T08:19:59.161 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-08T08:19:59.159+0000 7feb7d817180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-08T08:19:59.233 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-08T08:19:59.231+0000 7feb7d817180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-08T08:19:59.256 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-12-08T08:19:59.256+0000 7f78eb124180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-08T08:19:59.370 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-08T08:19:59.367+0000 7feb7d817180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-08T08:19:59.471 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:59.598 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.596+0000 7f793c417640 1 Processor -- start 2023-12-08T08:19:59.598 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.596+0000 7f793c417640 1 -- start start 2023-12-08T08:19:59.600 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.600+0000 7f793c417640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79341559f0 0x7f79340c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.600 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.600+0000 7f793c417640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7934157f90 con 0x7f793406ca00 2023-12-08T08:19:59.600 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.600+0000 7f793c417640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7934155520 con 0x7f7934151c60 2023-12-08T08:19:59.600 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.600+0000 7f793c417640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7934155e60 con 0x7f79341559f0 2023-12-08T08:19:59.600 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.600+0000 7f79399b2640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f793406ca00 0x7f7934154580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47980/0 (socket says 172.21.15.88:47980) 2023-12-08T08:19:59.600 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.600+0000 7f79399b2640 1 -- 172.21.15.88:0/2785492073 learned_addr learned my addr 172.21.15.88:0/2785492073 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:19:59.600 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.600+0000 7f793a9b4640 1 --2- 172.21.15.88:0/2785492073 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79341559f0 0x7f79340c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.601 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.600+0000 7f79391b1640 1 -- 172.21.15.88:0/2785492073 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1867974694 0 0) 0x7f7934157f90 con 0x7f793406ca00 2023-12-08T08:19:59.601 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.600+0000 7f79391b1640 1 -- 172.21.15.88:0/2785492073 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7920003530 con 0x7f793406ca00 2023-12-08T08:19:59.601 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.600+0000 7f79391b1640 1 -- 172.21.15.88:0/2785492073 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342629648 0 0) 0x7f7934155520 con 0x7f7934151c60 2023-12-08T08:19:59.601 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.600+0000 7f79391b1640 1 -- 172.21.15.88:0/2785492073 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7934157f90 con 0x7f7934151c60 2023-12-08T08:19:59.601 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.600+0000 7f793a9b4640 1 -- 172.21.15.88:0/2785492073 >> v1:172.21.15.148:6789/0 conn(0x7f7934151c60 legacy=0x7f7934158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.601 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.600+0000 7f793a9b4640 1 -- 172.21.15.88:0/2785492073 >> v1:172.21.15.88:6789/0 conn(0x7f793406ca00 legacy=0x7f7934154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.601 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.600+0000 7f79391b1640 1 -- 172.21.15.88:0/2785492073 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2199972224 0 0) 0x7f7920003530 con 0x7f793406ca00 2023-12-08T08:19:59.601 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.600+0000 7f793a9b4640 1 -- 172.21.15.88:0/2785492073 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7934154c90 con 0x7f79341559f0 2023-12-08T08:19:59.603 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.604+0000 7f793a9b4640 1 --2- 172.21.15.88:0/2785492073 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79341559f0 0x7f79340c47a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f792c009dc0 tx=0x7f792c01c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8c156bd774969b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:59.603 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.604+0000 7f79391b1640 1 -- 172.21.15.88:0/2785492073 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c0a6700 con 0x7f79341559f0 2023-12-08T08:19:59.604 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.604+0000 7f79391b1640 1 -- 172.21.15.88:0/2785492073 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792c0a6860 con 0x7f79341559f0 2023-12-08T08:19:59.604 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.604+0000 7f79391b1640 1 -- 172.21.15.88:0/2785492073 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c0a6bf0 con 0x7f79341559f0 2023-12-08T08:19:59.604 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.604+0000 7f793c417640 1 -- 172.21.15.88:0/2785492073 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79341559f0 msgr2=0x7f79340c47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.604 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.604+0000 7f793c417640 1 --2- 172.21.15.88:0/2785492073 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79341559f0 0x7f79340c47a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f792c009dc0 tx=0x7f792c01c850 comp rx=0 tx=0).stop 2023-12-08T08:19:59.605 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.604+0000 7f793c417640 1 -- 172.21.15.88:0/2785492073 shutdown_connections 2023-12-08T08:19:59.605 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.604+0000 7f793c417640 1 --2- 172.21.15.88:0/2785492073 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f79341559f0 0x7f79340c47a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.605 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.604+0000 7f793c417640 1 -- 172.21.15.88:0/2785492073 >> 172.21.15.88:0/2785492073 conn(0x7f79340abdd0 msgr2=0x7f79340ac1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:59.605 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.604+0000 7f793c417640 1 -- 172.21.15.88:0/2785492073 shutdown_connections 2023-12-08T08:19:59.605 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.604+0000 7f793c417640 1 -- 172.21.15.88:0/2785492073 wait complete. 2023-12-08T08:19:59.606 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.604+0000 7f793c417640 1 Processor -- start 2023-12-08T08:19:59.606 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.604+0000 7f793c417640 1 -- start start 2023-12-08T08:19:59.608 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.608+0000 7f793c417640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f793406ca00 0x7f79341f0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.608 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.608+0000 7f793c417640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7934151c60 0x7f7934156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.608 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.608+0000 7f793c417640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79341559f0 0x7f793414f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.608 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.608+0000 7f793c417640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79341ecde0 con 0x7f79341559f0 2023-12-08T08:19:59.608 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.608+0000 7f793c417640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7934153b00 con 0x7f793406ca00 2023-12-08T08:19:59.609 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.608+0000 7f793c417640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79341f12a0 con 0x7f7934151c60 2023-12-08T08:19:59.609 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.608+0000 7f793a9b4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79341559f0 0x7f793414f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.609 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.608+0000 7f793a1b3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f793406ca00 0x7f79341f0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.609 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.608+0000 7f79399b2640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7934151c60 0x7f7934156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.609 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.608+0000 7f793a1b3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f793406ca00 0x7f79341f0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:37428/0 (socket says 172.21.15.88:37428) 2023-12-08T08:19:59.609 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.608+0000 7f793a9b4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79341559f0 0x7f793414f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37824/0 (socket says 172.21.15.88:37824) 2023-12-08T08:19:59.609 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.608+0000 7f793a1b3640 1 -- 172.21.15.88:0/1578019932 learned_addr learned my addr 172.21.15.88:0/1578019932 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:19:59.609 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.608+0000 7f793a1b3640 1 -- 172.21.15.88:0/1578019932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7934151c60 msgr2=0x7f7934156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.609 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.608+0000 7f793a1b3640 1 --2- 172.21.15.88:0/1578019932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7934151c60 0x7f7934156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.609 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.608+0000 7f793a1b3640 1 -- 172.21.15.88:0/1578019932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79341559f0 msgr2=0x7f793414f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.609 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.608+0000 7f793a1b3640 1 --2- 172.21.15.88:0/1578019932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79341559f0 0x7f793414f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.609 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.608+0000 7f793a1b3640 1 -- 172.21.15.88:0/1578019932 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792c009a70 con 0x7f793406ca00 2023-12-08T08:19:59.609 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.608+0000 7f793a9b4640 1 --2- 172.21.15.88:0/1578019932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79341559f0 0x7f793414f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:59.609 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.608+0000 7f793a1b3640 1 --2- 172.21.15.88:0/1578019932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f793406ca00 0x7f79341f0d60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f793000c490 tx=0x7f793000c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:59.610 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.608+0000 7f792affd640 1 -- 172.21.15.88:0/1578019932 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79300052d0 con 0x7f793406ca00 2023-12-08T08:19:59.611 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.608+0000 7f792affd640 1 -- 172.21.15.88:0/1578019932 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7930005430 con 0x7f793406ca00 2023-12-08T08:19:59.611 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.608+0000 7f793c417640 1 -- 172.21.15.88:0/1578019932 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79341ed600 con 0x7f793406ca00 2023-12-08T08:19:59.611 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.608+0000 7f792affd640 1 -- 172.21.15.88:0/1578019932 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7930003840 con 0x7f793406ca00 2023-12-08T08:19:59.611 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.608+0000 7f793c417640 1 -- 172.21.15.88:0/1578019932 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7934153820 con 0x7f793406ca00 2023-12-08T08:19:59.611 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.608+0000 7f792affd640 1 -- 172.21.15.88:0/1578019932 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7930003ca0 con 0x7f793406ca00 2023-12-08T08:19:59.611 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.608+0000 7f792affd640 1 -- 172.21.15.88:0/1578019932 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f7930012420 con 0x7f793406ca00 2023-12-08T08:19:59.611 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.608+0000 7f793c417640 1 -- 172.21.15.88:0/1578019932 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7934067630 con 0x7f793406ca00 2023-12-08T08:19:59.612 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.612+0000 7f792affd640 1 -- 172.21.15.88:0/1578019932 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f7930017070 con 0x7f793406ca00 2023-12-08T08:19:59.669 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.668+0000 7f793c417640 1 -- 172.21.15.88:0/1578019932 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79340c7c00 con 0x7f793406ca00 2023-12-08T08:19:59.670 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.668+0000 7f792affd640 1 -- 172.21.15.88:0/1578019932 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f7930011590 con 0x7f793406ca00 2023-12-08T08:19:59.670 INFO:teuthology.misc.health.smithi088.stdout: 2023-12-08T08:19:59.670 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":10,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:19:58.328978+0000","last_up_change":"0.000000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:59.671 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.668+0000 7f793c417640 1 -- 172.21.15.88:0/1578019932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f793406ca00 msgr2=0x7f79341f0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.671 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.668+0000 7f793c417640 1 --2- 172.21.15.88:0/1578019932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f793406ca00 0x7f79341f0d60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f793000c490 tx=0x7f793000c950 comp rx=0 tx=0).stop 2023-12-08T08:19:59.671 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.668+0000 7f793c417640 1 -- 172.21.15.88:0/1578019932 shutdown_connections 2023-12-08T08:19:59.671 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.668+0000 7f793c417640 1 --2- 172.21.15.88:0/1578019932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79341559f0 0x7f793414f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.671 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.668+0000 7f793c417640 1 --2- 172.21.15.88:0/1578019932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7934151c60 0x7f7934156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.671 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.668+0000 7f793c417640 1 --2- 172.21.15.88:0/1578019932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f793406ca00 0x7f79341f0d60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.671 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.668+0000 7f793c417640 1 -- 172.21.15.88:0/1578019932 >> 172.21.15.88:0/1578019932 conn(0x7f79340abdd0 msgr2=0x7f79340ac1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:59.672 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.668+0000 7f793c417640 1 -- 172.21.15.88:0/1578019932 shutdown_connections 2023-12-08T08:19:59.672 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:19:59.668+0000 7f793c417640 1 -- 172.21.15.88:0/1578019932 wait complete. 2023-12-08T08:19:59.688 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-08T08:19:59.966 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-12-08T08:19:59.964+0000 7f78eb124180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-08T08:20:00.053 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-12-08T08:20:00.052+0000 7f78eb124180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-08T08:20:00.059 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-08T08:20:00.055+0000 7feb7d817180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-08T08:20:00.147 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-08T08:20:00.143+0000 7feb7d817180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-08T08:20:00.243 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-12-08T08:20:00.240+0000 7f78eb124180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-08T08:20:00.328 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-12-08T08:20:00.328+0000 7f78eb124180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-08T08:20:00.337 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-08T08:20:00.335+0000 7feb7d817180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-08T08:20:00.422 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-08T08:20:00.419+0000 7feb7d817180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-08T08:20:00.654 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-12-08T08:20:00.651+0000 7f78eb124180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-08T08:20:00.722 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-12-08T08:20:00.719+0000 7f78eb124180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-08T08:20:00.754 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-08T08:20:00.751+0000 7feb7d817180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-08T08:20:00.830 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-08T08:20:00.827+0000 7feb7d817180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-08T08:20:01.746 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-12-08T08:20:01.743+0000 7f7892898640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-08T08:20:01.748 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-12-08T08:20:01.747+0000 7f7892898640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-08T08:20:02.855 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-12-08T08:20:02.851+0000 7f9055ade640 -1 osd.1 0 log_to_monitors true 2023-12-08T08:20:02.863 INFO:tasks.ceph.osd.6.smithi148.stderr:2023-12-08T08:20:02.859+0000 7f8bccf19640 -1 osd.6 0 log_to_monitors true 2023-12-08T08:20:02.997 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-12-08T08:20:02.995+0000 7f74e4236640 -1 osd.3 0 log_to_monitors true 2023-12-08T08:20:03.005 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-12-08T08:20:03.003+0000 7fbbe426b640 -1 osd.0 0 log_to_monitors true 2023-12-08T08:20:03.026 INFO:tasks.ceph.osd.5.smithi148.stderr:2023-12-08T08:20:03.023+0000 7f2191367640 -1 osd.5 0 log_to_monitors true 2023-12-08T08:20:03.045 INFO:tasks.ceph.osd.4.smithi148.stderr:2023-12-08T08:20:03.043+0000 7fc3862c9640 -1 osd.4 0 log_to_monitors true 2023-12-08T08:20:03.063 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-12-08T08:20:03.059+0000 7fdc16107640 -1 osd.2 0 log_to_monitors true 2023-12-08T08:20:03.147 INFO:tasks.ceph.osd.7.smithi148.stderr:2023-12-08T08:20:03.143+0000 7f821e42b640 -1 osd.7 0 log_to_monitors true 2023-12-08T08:20:06.318 INFO:tasks.ceph.osd.4.smithi148.stderr:2023-12-08T08:20:06.314+0000 7fc382273640 -1 osd.4 0 waiting for initial osdmap 2023-12-08T08:20:06.334 INFO:tasks.ceph.osd.6.smithi148.stderr:2023-12-08T08:20:06.330+0000 7f8bc8ec5640 -1 osd.6 0 waiting for initial osdmap 2023-12-08T08:20:06.346 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-12-08T08:20:06.343+0000 7f9051a88640 -1 osd.1 0 waiting for initial osdmap 2023-12-08T08:20:06.350 INFO:tasks.ceph.osd.4.smithi148.stderr:2023-12-08T08:20:06.346+0000 7fc37a0ae640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T08:20:06.356 INFO:tasks.ceph.osd.5.smithi148.stderr:2023-12-08T08:20:06.350+0000 7f218d311640 -1 osd.5 0 waiting for initial osdmap 2023-12-08T08:20:06.362 INFO:tasks.ceph.osd.6.smithi148.stderr:2023-12-08T08:20:06.358+0000 7f8bc0d00640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T08:20:06.364 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-12-08T08:20:06.363+0000 7fbbe0217640 -1 osd.0 0 waiting for initial osdmap 2023-12-08T08:20:06.367 INFO:tasks.ceph.osd.7.smithi148.stderr:2023-12-08T08:20:06.362+0000 7f821986a640 -1 osd.7 0 waiting for initial osdmap 2023-12-08T08:20:06.368 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-12-08T08:20:06.367+0000 7fdc128c3640 -1 osd.2 0 waiting for initial osdmap 2023-12-08T08:20:06.385 INFO:tasks.ceph.osd.5.smithi148.stderr:2023-12-08T08:20:06.382+0000 7f218514c640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T08:20:06.388 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-12-08T08:20:06.387+0000 7f74e01e0640 -1 osd.3 0 waiting for initial osdmap 2023-12-08T08:20:06.389 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-12-08T08:20:06.387+0000 7f90498c3640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T08:20:06.390 INFO:tasks.ceph.osd.7.smithi148.stderr:2023-12-08T08:20:06.386+0000 7f82116a5640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T08:20:06.397 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-12-08T08:20:06.395+0000 7fbbd8052640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T08:20:06.401 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-12-08T08:20:06.399+0000 7fdc09eec640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T08:20:06.425 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-12-08T08:20:06.423+0000 7f74d801b640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T08:20:06.494 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:06.619 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.615+0000 7f73a50e4640 1 Processor -- start 2023-12-08T08:20:06.620 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.615+0000 7f73a50e4640 1 -- start start 2023-12-08T08:20:06.621 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.619+0000 7f73a50e4640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f73a014ed30 0x7f73a006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:06.621 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.619+0000 7f73a50e4640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a006dcf0 con 0x7f73a0151f90 2023-12-08T08:20:06.621 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.619+0000 7f73a50e4640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a006df20 con 0x7f73a014e950 2023-12-08T08:20:06.621 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.619+0000 7f73a50e4640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a0072c60 con 0x7f73a014ed30 2023-12-08T08:20:06.621 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.619+0000 7f739f59e640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f73a0151f90 0x7f73a006c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40360/0 (socket says 172.21.15.88:40360) 2023-12-08T08:20:06.621 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.619+0000 7f739f59e640 1 -- 172.21.15.88:0/1583108922 learned_addr learned my addr 172.21.15.88:0/1583108922 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:06.621 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.619+0000 7f739659c640 1 --2- 172.21.15.88:0/1583108922 >> v2:172.21.15.148:3300/0 conn(0x7f73a014ed30 0x7f73a006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:06.622 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.619+0000 7f739e59c640 1 -- 172.21.15.88:0/1583108922 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2546735317 0 0) 0x7f73a006dcf0 con 0x7f73a0151f90 2023-12-08T08:20:06.622 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.619+0000 7f739e59c640 1 -- 172.21.15.88:0/1583108922 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f738c003530 con 0x7f73a0151f90 2023-12-08T08:20:06.622 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.619+0000 7f739659c640 1 -- 172.21.15.88:0/1583108922 >> v1:172.21.15.148:6789/0 conn(0x7f73a014e950 legacy=0x7f73a00a4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:06.622 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.619+0000 7f739659c640 1 -- 172.21.15.88:0/1583108922 >> v1:172.21.15.88:6789/0 conn(0x7f73a0151f90 legacy=0x7f73a006c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:06.622 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.619+0000 7f739659c640 1 -- 172.21.15.88:0/1583108922 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a006e200 con 0x7f73a014ed30 2023-12-08T08:20:06.624 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.623+0000 7f739659c640 1 --2- 172.21.15.88:0/1583108922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73a014ed30 0x7f73a006d7b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f73900097c0 tx=0x7f739001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6eec9b1d23fd069 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:06.624 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.623+0000 7f739e59c640 1 -- 172.21.15.88:0/1583108922 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73900ab600 con 0x7f73a014ed30 2023-12-08T08:20:06.625 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.623+0000 7f739e59c640 1 -- 172.21.15.88:0/1583108922 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73900a7050 con 0x7f73a014ed30 2023-12-08T08:20:06.625 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.623+0000 7f739e59c640 1 -- 172.21.15.88:0/1583108922 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73900ab980 con 0x7f73a014ed30 2023-12-08T08:20:06.625 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.623+0000 7f73a50e4640 1 -- 172.21.15.88:0/1583108922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73a014ed30 msgr2=0x7f73a006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:06.626 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.623+0000 7f73a50e4640 1 --2- 172.21.15.88:0/1583108922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73a014ed30 0x7f73a006d7b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f73900097c0 tx=0x7f739001c3f0 comp rx=0 tx=0).stop 2023-12-08T08:20:06.626 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.623+0000 7f73a50e4640 1 -- 172.21.15.88:0/1583108922 shutdown_connections 2023-12-08T08:20:06.626 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.623+0000 7f73a50e4640 1 --2- 172.21.15.88:0/1583108922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73a014ed30 0x7f73a006d7b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:06.626 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.623+0000 7f73a50e4640 1 -- 172.21.15.88:0/1583108922 >> 172.21.15.88:0/1583108922 conn(0x7f73a00c5f60 msgr2=0x7f73a00c6370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:06.626 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.623+0000 7f73a50e4640 1 -- 172.21.15.88:0/1583108922 shutdown_connections 2023-12-08T08:20:06.626 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.623+0000 7f73a50e4640 1 -- 172.21.15.88:0/1583108922 wait complete. 2023-12-08T08:20:06.627 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.623+0000 7f73a50e4640 1 Processor -- start 2023-12-08T08:20:06.627 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.623+0000 7f73a50e4640 1 -- start start 2023-12-08T08:20:06.629 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.627+0000 7f73a50e4640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73a014e950 0x7f73a0147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:06.629 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.627+0000 7f73a50e4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a014ed30 0x7f73a014bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:06.629 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.627+0000 7f73a50e4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73a0151f90 0x7f73a014c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:06.629 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.627+0000 7f73a50e4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a01ed1c0 con 0x7f73a014ed30 2023-12-08T08:20:06.629 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.627+0000 7f73a50e4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a01eda00 con 0x7f73a0151f90 2023-12-08T08:20:06.629 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.627+0000 7f73a50e4640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a01f1140 con 0x7f73a014e950 2023-12-08T08:20:06.630 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.627+0000 7f739659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a014ed30 0x7f73a014bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:06.630 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.627+0000 7f739ed9d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73a014e950 0x7f73a0147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:06.630 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.627+0000 7f739f59e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73a0151f90 0x7f73a014c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:06.630 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.627+0000 7f739659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a014ed30 0x7f73a014bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57602/0 (socket says 172.21.15.88:57602) 2023-12-08T08:20:06.630 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.627+0000 7f739659c640 1 -- 172.21.15.88:0/3888718717 learned_addr learned my addr 172.21.15.88:0/3888718717 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:06.630 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.627+0000 7f739f59e640 1 -- 172.21.15.88:0/3888718717 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73a014e950 msgr2=0x7f73a0147370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:06.630 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.627+0000 7f739f59e640 1 --2- 172.21.15.88:0/3888718717 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73a014e950 0x7f73a0147370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:06.630 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.627+0000 7f739f59e640 1 -- 172.21.15.88:0/3888718717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a014ed30 msgr2=0x7f73a014bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:06.630 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.627+0000 7f739f59e640 1 --2- 172.21.15.88:0/3888718717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a014ed30 0x7f73a014bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:06.630 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.627+0000 7f739f59e640 1 -- 172.21.15.88:0/3888718717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7390009420 con 0x7f73a0151f90 2023-12-08T08:20:06.630 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.627+0000 7f739659c640 1 --2- 172.21.15.88:0/3888718717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a014ed30 0x7f73a014bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:06.630 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.627+0000 7f739f59e640 1 --2- 172.21.15.88:0/3888718717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73a0151f90 0x7f73a014c1b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f739800ca70 tx=0x7f739800ce70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:06.631 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.627+0000 7f7397fff640 1 -- 172.21.15.88:0/3888718717 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739800ab10 con 0x7f73a0151f90 2023-12-08T08:20:06.631 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.627+0000 7f7397fff640 1 -- 172.21.15.88:0/3888718717 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f739800ac70 con 0x7f73a0151f90 2023-12-08T08:20:06.632 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.627+0000 7f73a50e4640 1 -- 172.21.15.88:0/3888718717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a01f1420 con 0x7f73a0151f90 2023-12-08T08:20:06.632 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.627+0000 7f7397fff640 1 -- 172.21.15.88:0/3888718717 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7398012600 con 0x7f73a0151f90 2023-12-08T08:20:06.632 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.627+0000 7f73a50e4640 1 -- 172.21.15.88:0/3888718717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a01ed690 con 0x7f73a0151f90 2023-12-08T08:20:06.632 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.627+0000 7f73a50e4640 1 -- 172.21.15.88:0/3888718717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a01edb70 con 0x7f73a0151f90 2023-12-08T08:20:06.632 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.627+0000 7f7397fff640 1 -- 172.21.15.88:0/3888718717 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 85796+0+0 (secure 0 0 0) 0x7f7398007070 con 0x7f73a0151f90 2023-12-08T08:20:06.633 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.631+0000 7f7397fff640 1 --2- 172.21.15.88:0/3888718717 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f73800663e0 0x7f73800688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:06.633 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.631+0000 7f7397fff640 1 -- 172.21.15.88:0/3888718717 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f7398082d70 con 0x7f73a0151f90 2023-12-08T08:20:06.633 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.631+0000 7f739ed9d640 1 --2- 172.21.15.88:0/3888718717 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f73800663e0 0x7f73800688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:06.633 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.631+0000 7f739ed9d640 1 --2- 172.21.15.88:0/3888718717 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f73800663e0 0x7f73800688a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7388007fd0 tx=0x7f7388009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:06.637 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.635+0000 7f7397fff640 1 -- 172.21.15.88:0/3888718717 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7398051100 con 0x7f73a0151f90 2023-12-08T08:20:06.790 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.787+0000 7f73a50e4640 1 -- 172.21.15.88:0/3888718717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73a0067630 con 0x7f73a0151f90 2023-12-08T08:20:06.795 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.791+0000 7f7397fff640 1 -- 172.21.15.88:0/3888718717 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f7398017020 con 0x7f73a0151f90 2023-12-08T08:20:06.795 INFO:teuthology.misc.health.smithi088.stdout: 2023-12-08T08:20:06.795 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":12,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:20:04.766571+0000","last_up_change":"0.000000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:06.797 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.795+0000 7f73a50e4640 1 -- 172.21.15.88:0/3888718717 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f73800663e0 msgr2=0x7f73800688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:06.797 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.795+0000 7f73a50e4640 1 --2- 172.21.15.88:0/3888718717 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f73800663e0 0x7f73800688a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7388007fd0 tx=0x7f7388009040 comp rx=0 tx=0).stop 2023-12-08T08:20:06.797 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.795+0000 7f73a50e4640 1 -- 172.21.15.88:0/3888718717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73a0151f90 msgr2=0x7f73a014c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:06.797 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.795+0000 7f73a50e4640 1 --2- 172.21.15.88:0/3888718717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73a0151f90 0x7f73a014c1b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f739800ca70 tx=0x7f739800ce70 comp rx=0 tx=0).stop 2023-12-08T08:20:06.797 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.795+0000 7f73a50e4640 1 -- 172.21.15.88:0/3888718717 shutdown_connections 2023-12-08T08:20:06.797 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.795+0000 7f73a50e4640 1 --2- 172.21.15.88:0/3888718717 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f73800663e0 0x7f73800688a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:06.797 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.795+0000 7f73a50e4640 1 --2- 172.21.15.88:0/3888718717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73a0151f90 0x7f73a014c1b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:06.797 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.795+0000 7f73a50e4640 1 --2- 172.21.15.88:0/3888718717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a014ed30 0x7f73a014bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:06.798 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.795+0000 7f73a50e4640 1 --2- 172.21.15.88:0/3888718717 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73a014e950 0x7f73a0147370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:06.798 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.795+0000 7f73a50e4640 1 -- 172.21.15.88:0/3888718717 >> 172.21.15.88:0/3888718717 conn(0x7f73a00c5f60 msgr2=0x7f73a00c3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:06.798 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.795+0000 7f73a50e4640 1 -- 172.21.15.88:0/3888718717 shutdown_connections 2023-12-08T08:20:06.798 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:06.795+0000 7f73a50e4640 1 -- 172.21.15.88:0/3888718717 wait complete. 2023-12-08T08:20:06.813 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-08T08:20:13.620 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:13.757 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.754+0000 7fed9db2a640 1 Processor -- start 2023-12-08T08:20:13.757 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.754+0000 7fed9db2a640 1 -- start start 2023-12-08T08:20:13.758 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.754+0000 7fed9db2a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fed9806ca00 0x7fed981559f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.758 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.754+0000 7fed9db2a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed98154580 0x7fed980c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.758 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.754+0000 7fed9db2a640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed98157f90 con 0x7fed98151c60 2023-12-08T08:20:13.758 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.754+0000 7fed9db2a640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed98155520 con 0x7fed9806ca00 2023-12-08T08:20:13.758 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.754+0000 7fed9db2a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed98154f60 con 0x7fed98154580 2023-12-08T08:20:13.759 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.754+0000 7fed977fe640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fed98151c60 0x7fed98158420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:44676/0 (socket says 172.21.15.88:44676) 2023-12-08T08:20:13.759 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.754+0000 7fed977fe640 1 -- 172.21.15.88:0/1805672342 learned_addr learned my addr 172.21.15.88:0/1805672342 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:13.759 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.754+0000 7fed97fff640 1 --2- 172.21.15.88:0/1805672342 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed98154580 0x7fed980c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.759 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.754+0000 7fed8ffff640 1 --2- 172.21.15.88:0/1805672342 >> v2:172.21.15.148:3300/0 conn(0x7fed9806ca00 0x7fed981559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.760 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.754+0000 7fed96ffd640 1 -- 172.21.15.88:0/1805672342 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 374404859 0 0) 0x7fed98157f90 con 0x7fed98151c60 2023-12-08T08:20:13.760 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.754+0000 7fed96ffd640 1 -- 172.21.15.88:0/1805672342 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed84003530 con 0x7fed98151c60 2023-12-08T08:20:13.760 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.754+0000 7fed8ffff640 1 -- 172.21.15.88:0/1805672342 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed98154580 msgr2=0x7fed980c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:13.760 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.754+0000 7fed8ffff640 1 --2- 172.21.15.88:0/1805672342 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed98154580 0x7fed980c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.760 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.754+0000 7fed8ffff640 1 -- 172.21.15.88:0/1805672342 >> v1:172.21.15.148:6789/0 conn(0x7fed98151c60 legacy=0x7fed98158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.760 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.754+0000 7fed8ffff640 1 -- 172.21.15.88:0/1805672342 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed98155240 con 0x7fed9806ca00 2023-12-08T08:20:13.760 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.754+0000 7fed97fff640 1 --2- 172.21.15.88:0/1805672342 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed98154580 0x7fed980c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:13.762 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.758+0000 7fed8ffff640 1 --2- 172.21.15.88:0/1805672342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed9806ca00 0x7fed981559f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fed800097c0 tx=0x7fed8001c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a73fdbc985f05d7e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:13.763 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.758+0000 7fed96ffd640 1 -- 172.21.15.88:0/1805672342 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed800ab600 con 0x7fed9806ca00 2023-12-08T08:20:13.763 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.758+0000 7fed96ffd640 1 -- 172.21.15.88:0/1805672342 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed800a7050 con 0x7fed9806ca00 2023-12-08T08:20:13.763 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.758+0000 7fed96ffd640 1 -- 172.21.15.88:0/1805672342 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed800ab980 con 0x7fed9806ca00 2023-12-08T08:20:13.763 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.758+0000 7fed9db2a640 1 -- 172.21.15.88:0/1805672342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed9806ca00 msgr2=0x7fed981559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.763 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.758+0000 7fed9db2a640 1 --2- 172.21.15.88:0/1805672342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed9806ca00 0x7fed981559f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fed800097c0 tx=0x7fed8001c360 comp rx=0 tx=0).stop 2023-12-08T08:20:13.763 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.758+0000 7fed9db2a640 1 -- 172.21.15.88:0/1805672342 shutdown_connections 2023-12-08T08:20:13.763 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.758+0000 7fed9db2a640 1 --2- 172.21.15.88:0/1805672342 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed98154580 0x7fed980c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.763 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.758+0000 7fed9db2a640 1 --2- 172.21.15.88:0/1805672342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed9806ca00 0x7fed981559f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.763 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.758+0000 7fed9db2a640 1 -- 172.21.15.88:0/1805672342 >> 172.21.15.88:0/1805672342 conn(0x7fed980abdd0 msgr2=0x7fed980ac1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:13.763 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.758+0000 7fed9db2a640 1 -- 172.21.15.88:0/1805672342 shutdown_connections 2023-12-08T08:20:13.764 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.758+0000 7fed9db2a640 1 -- 172.21.15.88:0/1805672342 wait complete. 2023-12-08T08:20:13.764 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.762+0000 7fed9db2a640 1 Processor -- start 2023-12-08T08:20:13.764 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.762+0000 7fed9db2a640 1 -- start start 2023-12-08T08:20:13.767 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.762+0000 7fed9db2a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9806ca00 0x7fed9814a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.767 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.762+0000 7fed9db2a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed98151c60 0x7fed980add90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.767 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.762+0000 7fed9db2a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed98154580 0x7fed981eda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.767 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.762+0000 7fed9db2a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed981ed5d0 con 0x7fed9806ca00 2023-12-08T08:20:13.767 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.762+0000 7fed9db2a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed981ed280 con 0x7fed98154580 2023-12-08T08:20:13.767 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.762+0000 7fed9db2a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed980ad1d0 con 0x7fed98151c60 2023-12-08T08:20:13.768 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.762+0000 7fed977fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9806ca00 0x7fed9814a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.768 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.762+0000 7fed977fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9806ca00 0x7fed9814a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59508/0 (socket says 172.21.15.88:59508) 2023-12-08T08:20:13.768 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.762+0000 7fed977fe640 1 -- 172.21.15.88:0/3413491734 learned_addr learned my addr 172.21.15.88:0/3413491734 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:13.768 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.762+0000 7fed97fff640 1 --2- 172.21.15.88:0/3413491734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed98154580 0x7fed981eda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.768 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.762+0000 7fed8ffff640 1 --2- 172.21.15.88:0/3413491734 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed98151c60 0x7fed980add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.768 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.762+0000 7fed977fe640 1 -- 172.21.15.88:0/3413491734 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed98151c60 msgr2=0x7fed980add90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.768 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.762+0000 7fed977fe640 1 --2- 172.21.15.88:0/3413491734 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed98151c60 0x7fed980add90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.768 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.762+0000 7fed977fe640 1 -- 172.21.15.88:0/3413491734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed98154580 msgr2=0x7fed981eda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.768 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.762+0000 7fed977fe640 1 --2- 172.21.15.88:0/3413491734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed98154580 0x7fed981eda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.768 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.762+0000 7fed977fe640 1 -- 172.21.15.88:0/3413491734 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed90009a70 con 0x7fed9806ca00 2023-12-08T08:20:13.768 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.762+0000 7fed977fe640 1 --2- 172.21.15.88:0/3413491734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9806ca00 0x7fed9814a6a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fed8800c4d0 tx=0x7fed8800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:13.768 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.762+0000 7fed94ff9640 1 -- 172.21.15.88:0/3413491734 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed88005cf0 con 0x7fed9806ca00 2023-12-08T08:20:13.768 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.762+0000 7fed94ff9640 1 -- 172.21.15.88:0/3413491734 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed88005e50 con 0x7fed9806ca00 2023-12-08T08:20:13.768 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.762+0000 7fed9db2a640 1 -- 172.21.15.88:0/3413491734 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed80009420 con 0x7fed9806ca00 2023-12-08T08:20:13.768 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.762+0000 7fed94ff9640 1 -- 172.21.15.88:0/3413491734 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed88007270 con 0x7fed9806ca00 2023-12-08T08:20:13.769 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.762+0000 7fed9db2a640 1 -- 172.21.15.88:0/3413491734 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed980ad790 con 0x7fed9806ca00 2023-12-08T08:20:13.769 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.762+0000 7fed9db2a640 1 -- 172.21.15.88:0/3413491734 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed98067630 con 0x7fed9806ca00 2023-12-08T08:20:13.769 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.766+0000 7fed94ff9640 1 -- 172.21.15.88:0/3413491734 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fed880073d0 con 0x7fed9806ca00 2023-12-08T08:20:13.770 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.766+0000 7fed94ff9640 1 --2- 172.21.15.88:0/3413491734 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fed78066470 0x7fed78068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.770 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.766+0000 7fed94ff9640 1 -- 172.21.15.88:0/3413491734 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fed88082ff0 con 0x7fed9806ca00 2023-12-08T08:20:13.770 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.766+0000 7fed8ffff640 1 --2- 172.21.15.88:0/3413491734 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fed78066470 0x7fed78068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.770 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.766+0000 7fed8ffff640 1 --2- 172.21.15.88:0/3413491734 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fed78066470 0x7fed78068930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fed800ad000 tx=0x7fed80008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:13.775 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.770+0000 7fed94ff9640 1 -- 172.21.15.88:0/3413491734 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fed880508c0 con 0x7fed9806ca00 2023-12-08T08:20:13.924 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.922+0000 7fed9db2a640 1 -- 172.21.15.88:0/3413491734 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed98158870 con 0x7fed9806ca00 2023-12-08T08:20:13.925 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.922+0000 7fed94ff9640 1 -- 172.21.15.88:0/3413491734 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12826 (secure 0 0 0) 0x7fed88017090 con 0x7fed9806ca00 2023-12-08T08:20:13.925 INFO:teuthology.misc.health.smithi088.stdout: 2023-12-08T08:20:13.926 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":16,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:20:10.811990+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:13.927 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.922+0000 7fed9db2a640 1 -- 172.21.15.88:0/3413491734 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fed78066470 msgr2=0x7fed78068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.927 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.922+0000 7fed9db2a640 1 --2- 172.21.15.88:0/3413491734 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fed78066470 0x7fed78068930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fed800ad000 tx=0x7fed80008040 comp rx=0 tx=0).stop 2023-12-08T08:20:13.928 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.922+0000 7fed9db2a640 1 -- 172.21.15.88:0/3413491734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9806ca00 msgr2=0x7fed9814a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.928 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.922+0000 7fed9db2a640 1 --2- 172.21.15.88:0/3413491734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9806ca00 0x7fed9814a6a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fed8800c4d0 tx=0x7fed8800c990 comp rx=0 tx=0).stop 2023-12-08T08:20:13.928 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.922+0000 7fed9db2a640 1 -- 172.21.15.88:0/3413491734 shutdown_connections 2023-12-08T08:20:13.928 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.922+0000 7fed9db2a640 1 --2- 172.21.15.88:0/3413491734 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fed78066470 0x7fed78068930 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.928 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.922+0000 7fed9db2a640 1 --2- 172.21.15.88:0/3413491734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed98154580 0x7fed981eda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.928 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.922+0000 7fed9db2a640 1 --2- 172.21.15.88:0/3413491734 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed98151c60 0x7fed980add90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.928 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.922+0000 7fed9db2a640 1 --2- 172.21.15.88:0/3413491734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9806ca00 0x7fed9814a6a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.928 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.922+0000 7fed9db2a640 1 -- 172.21.15.88:0/3413491734 >> 172.21.15.88:0/3413491734 conn(0x7fed980abdd0 msgr2=0x7fed980ac1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:13.928 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.922+0000 7fed9db2a640 1 -- 172.21.15.88:0/3413491734 shutdown_connections 2023-12-08T08:20:13.928 INFO:teuthology.misc.health.smithi088.stderr:2023-12-08T08:20:13.922+0000 7fed9db2a640 1 -- 172.21.15.88:0/3413491734 wait complete. 2023-12-08T08:20:13.945 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-08T08:20:13.945 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-08T08:20:13.945 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-08T08:20:13.945 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-08T08:20:13.949 INFO:tasks.ceph.mds.a:Started 2023-12-08T08:20:13.949 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-08T08:20:13.949 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-08T08:20:13.952 INFO:tasks.ceph.mds.c:Started 2023-12-08T08:20:13.953 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-08T08:20:13.953 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-08T08:20:13.957 INFO:tasks.ceph.mds.b:Started 2023-12-08T08:20:13.957 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-08T08:20:13.957 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-08T08:20:13.961 INFO:tasks.ceph.mds.d:Started 2023-12-08T08:20:13.961 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-08T08:20:13.961 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:14.049 INFO:tasks.ceph.mds.a.smithi088.stdout:starting mds.a at 2023-12-08T08:20:14.054 INFO:tasks.ceph.mds.c.smithi088.stdout:starting mds.c at 2023-12-08T08:20:14.073 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-12-08T08:20:14.074 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-12-08T08:20:14.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.106+0000 7f961c3df640 1 Processor -- start 2023-12-08T08:20:14.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.106+0000 7f961c3df640 1 -- start start 2023-12-08T08:20:14.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.106+0000 7f961c3df640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f961414fd10 0x7f96140a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.106+0000 7f961c3df640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9614156110 0x7f96141565c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.106+0000 7f961c3df640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96140c5710 con 0x7f96140a5300 2023-12-08T08:20:14.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.106+0000 7f961c3df640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f961406c5e0 con 0x7f9614156110 2023-12-08T08:20:14.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.106+0000 7f961c3df640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9614155c80 con 0x7f961414fd10 2023-12-08T08:20:14.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.106+0000 7f961a97c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9614156110 0x7f96141565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.106+0000 7f961a97c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9614156110 0x7f96141565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59532/0 (socket says 172.21.15.88:59532) 2023-12-08T08:20:14.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.106+0000 7f961a97c640 1 -- 172.21.15.88:0/407372438 learned_addr learned my addr 172.21.15.88:0/407372438 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:14.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.106+0000 7f961a17b640 1 --2- 172.21.15.88:0/407372438 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f961414fd10 0x7f96140a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.106+0000 7f961a97c640 1 -- 172.21.15.88:0/407372438 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f961414fd10 msgr2=0x7f96140a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:14.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.106+0000 7f961a97c640 1 --2- 172.21.15.88:0/407372438 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f961414fd10 0x7f96140a4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.106+0000 7f961a97c640 1 -- 172.21.15.88:0/407372438 >> v1:172.21.15.148:6789/0 conn(0x7f96140a5300 legacy=0x7f9614071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.106+0000 7f961a97c640 1 -- 172.21.15.88:0/407372438 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96140c4e70 con 0x7f9614156110 2023-12-08T08:20:14.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.110+0000 7f961a97c640 1 --2- 172.21.15.88:0/407372438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9614156110 0x7f96141565c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f960c009e50 tx=0x7f960c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86411c7da068ca08 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:14.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.110+0000 7f9619179640 1 -- 172.21.15.88:0/407372438 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c0a5780 con 0x7f9614156110 2023-12-08T08:20:14.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.110+0000 7f9619179640 1 -- 172.21.15.88:0/407372438 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960c0a58e0 con 0x7f9614156110 2023-12-08T08:20:14.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.110+0000 7f9619179640 1 -- 172.21.15.88:0/407372438 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c0a5c70 con 0x7f9614156110 2023-12-08T08:20:14.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.110+0000 7f961c3df640 1 -- 172.21.15.88:0/407372438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9614156110 msgr2=0x7f96141565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.110+0000 7f961c3df640 1 --2- 172.21.15.88:0/407372438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9614156110 0x7f96141565c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f960c009e50 tx=0x7f960c01c8c0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.110+0000 7f961c3df640 1 -- 172.21.15.88:0/407372438 shutdown_connections 2023-12-08T08:20:14.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.110+0000 7f961c3df640 1 --2- 172.21.15.88:0/407372438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9614156110 0x7f96141565c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.110+0000 7f961c3df640 1 --2- 172.21.15.88:0/407372438 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f961414fd10 0x7f96140a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.110+0000 7f961c3df640 1 -- 172.21.15.88:0/407372438 >> 172.21.15.88:0/407372438 conn(0x7f96140a7810 msgr2=0x7f96140a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:14.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.110+0000 7f961c3df640 1 -- 172.21.15.88:0/407372438 shutdown_connections 2023-12-08T08:20:14.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.110+0000 7f961c3df640 1 -- 172.21.15.88:0/407372438 wait complete. 2023-12-08T08:20:14.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.114+0000 7f961c3df640 1 Processor -- start 2023-12-08T08:20:14.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.114+0000 7f961c3df640 1 -- start start 2023-12-08T08:20:14.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.114+0000 7f961c3df640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96140a5300 0x7f9614147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.114+0000 7f961c3df640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f961414fd10 0x7f961413fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.114+0000 7f961c3df640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9614156110 0x7f9614140180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.114+0000 7f961c3df640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96141eb270 con 0x7f9614156110 2023-12-08T08:20:14.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.114+0000 7f961c3df640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96141ea940 con 0x7f96140a5300 2023-12-08T08:20:14.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.114+0000 7f961c3df640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96141eac20 con 0x7f961414fd10 2023-12-08T08:20:14.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.114+0000 7f961a97c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9614156110 0x7f9614140180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.114+0000 7f961a97c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9614156110 0x7f9614140180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59534/0 (socket says 172.21.15.88:59534) 2023-12-08T08:20:14.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.114+0000 7f961a97c640 1 -- 172.21.15.88:0/3248629256 learned_addr learned my addr 172.21.15.88:0/3248629256 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:14.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.114+0000 7f961997a640 1 --2- 172.21.15.88:0/3248629256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f961414fd10 0x7f961413fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.114+0000 7f961a17b640 1 --2- 172.21.15.88:0/3248629256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96140a5300 0x7f9614147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.114+0000 7f961a97c640 1 -- 172.21.15.88:0/3248629256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f961414fd10 msgr2=0x7f961413fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.114+0000 7f961a97c640 1 --2- 172.21.15.88:0/3248629256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f961414fd10 0x7f961413fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.114+0000 7f961a97c640 1 -- 172.21.15.88:0/3248629256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96140a5300 msgr2=0x7f9614147180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.114+0000 7f961a97c640 1 --2- 172.21.15.88:0/3248629256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96140a5300 0x7f9614147180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.114+0000 7f961a97c640 1 -- 172.21.15.88:0/3248629256 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c009b30 con 0x7f9614156110 2023-12-08T08:20:14.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.114+0000 7f961a97c640 1 --2- 172.21.15.88:0/3248629256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9614156110 0x7f9614140180 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f960c0af040 tx=0x7f960c019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:14.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.114+0000 7f960affd640 1 -- 172.21.15.88:0/3248629256 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c0b8670 con 0x7f9614156110 2023-12-08T08:20:14.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.114+0000 7f960affd640 1 -- 172.21.15.88:0/3248629256 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960c0b87d0 con 0x7f9614156110 2023-12-08T08:20:14.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.114+0000 7f961c3df640 1 -- 172.21.15.88:0/3248629256 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96141eaf00 con 0x7f9614156110 2023-12-08T08:20:14.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.114+0000 7f960affd640 1 -- 172.21.15.88:0/3248629256 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c0b8b80 con 0x7f9614156110 2023-12-08T08:20:14.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.114+0000 7f961c3df640 1 -- 172.21.15.88:0/3248629256 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96141ea5f0 con 0x7f9614156110 2023-12-08T08:20:14.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.114+0000 7f961c3df640 1 -- 172.21.15.88:0/3248629256 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96140ab830 con 0x7f9614156110 2023-12-08T08:20:14.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.118+0000 7f960affd640 1 -- 172.21.15.88:0/3248629256 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f960c0b8ce0 con 0x7f9614156110 2023-12-08T08:20:14.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.118+0000 7f960affd640 1 --2- 172.21.15.88:0/3248629256 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f95f8066470 0x7f95f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.118+0000 7f960affd640 1 -- 172.21.15.88:0/3248629256 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f960c11eeb0 con 0x7f9614156110 2023-12-08T08:20:14.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.118+0000 7f961a17b640 1 --2- 172.21.15.88:0/3248629256 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f95f8066470 0x7f95f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.118+0000 7f961a17b640 1 --2- 172.21.15.88:0/3248629256 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f95f8066470 0x7f95f8068930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f961415c330 tx=0x7f9610008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:14.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.122+0000 7f960affd640 1 -- 172.21.15.88:0/3248629256 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f960c0ec840 con 0x7f9614156110 2023-12-08T08:20:14.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.270+0000 7f961c3df640 1 -- 172.21.15.88:0/3248629256 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9614067630 con 0x7f9614156110 2023-12-08T08:20:14.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.274+0000 7f960affd640 1 -- 172.21.15.88:0/3248629256 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12826 (secure 0 0 0) 0x7f960c0bc090 con 0x7f9614156110 2023-12-08T08:20:14.277 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:14.277 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":16,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:20:10.811990+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:14.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.274+0000 7f961c3df640 1 -- 172.21.15.88:0/3248629256 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f95f8066470 msgr2=0x7f95f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.274+0000 7f961c3df640 1 --2- 172.21.15.88:0/3248629256 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f95f8066470 0x7f95f8068930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f961415c330 tx=0x7f9610008040 comp rx=0 tx=0).stop 2023-12-08T08:20:14.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.274+0000 7f961c3df640 1 -- 172.21.15.88:0/3248629256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9614156110 msgr2=0x7f9614140180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.274+0000 7f961c3df640 1 --2- 172.21.15.88:0/3248629256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9614156110 0x7f9614140180 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f960c0af040 tx=0x7f960c019660 comp rx=0 tx=0).stop 2023-12-08T08:20:14.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.274+0000 7f961c3df640 1 -- 172.21.15.88:0/3248629256 shutdown_connections 2023-12-08T08:20:14.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.274+0000 7f961c3df640 1 --2- 172.21.15.88:0/3248629256 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f95f8066470 0x7f95f8068930 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.274+0000 7f961c3df640 1 --2- 172.21.15.88:0/3248629256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9614156110 0x7f9614140180 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.274+0000 7f961c3df640 1 --2- 172.21.15.88:0/3248629256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f961414fd10 0x7f961413fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.274+0000 7f961c3df640 1 --2- 172.21.15.88:0/3248629256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96140a5300 0x7f9614147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.274+0000 7f961c3df640 1 -- 172.21.15.88:0/3248629256 >> 172.21.15.88:0/3248629256 conn(0x7f96140a7810 msgr2=0x7f96140a8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:14.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.274+0000 7f961c3df640 1 -- 172.21.15.88:0/3248629256 shutdown_connections 2023-12-08T08:20:14.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.274+0000 7f961c3df640 1 -- 172.21.15.88:0/3248629256 wait complete. 2023-12-08T08:20:14.297 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:20:14.298 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:20:14.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.434+0000 7f689ba9c640 1 Processor -- start 2023-12-08T08:20:14.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.434+0000 7f689ba9c640 1 -- start start 2023-12-08T08:20:14.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.434+0000 7f689ba9c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68940c1250 0x7f6894150860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.434+0000 7f689ba9c640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f68940c25b0 0x7f689406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.434+0000 7f689ba9c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f689414e310 con 0x7f689414df30 2023-12-08T08:20:14.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.434+0000 7f689ba9c640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68940c1840 con 0x7f68940c25b0 2023-12-08T08:20:14.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.434+0000 7f689ba9c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68940c1ae0 con 0x7f68940c1250 2023-12-08T08:20:14.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.434+0000 7f6899838640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f689414df30 0x7f6894154650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47932/0 (socket says 172.21.15.88:47932) 2023-12-08T08:20:14.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.434+0000 7f6899838640 1 -- 172.21.15.88:0/3984388645 learned_addr learned my addr 172.21.15.88:0/3984388645 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:14.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.434+0000 7f6899037640 1 --2- 172.21.15.88:0/3984388645 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68940c1250 0x7f6894150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.434+0000 7f689a039640 1 --2- 172.21.15.88:0/3984388645 >> v2:172.21.15.148:3300/0 conn(0x7f68940c25b0 0x7f689406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.434+0000 7f6898836640 1 -- 172.21.15.88:0/3984388645 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 570590999 0 0) 0x7f689414e310 con 0x7f689414df30 2023-12-08T08:20:14.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.434+0000 7f6898836640 1 -- 172.21.15.88:0/3984388645 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6880003530 con 0x7f689414df30 2023-12-08T08:20:14.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.434+0000 7f6898836640 1 -- 172.21.15.88:0/3984388645 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1622546026 0 0) 0x7f6880003530 con 0x7f689414df30 2023-12-08T08:20:14.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.434+0000 7f6899037640 1 -- 172.21.15.88:0/3984388645 >> v2:172.21.15.148:3300/0 conn(0x7f68940c25b0 msgr2=0x7f689406b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:14.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.434+0000 7f6899037640 1 --2- 172.21.15.88:0/3984388645 >> v2:172.21.15.148:3300/0 conn(0x7f68940c25b0 0x7f689406b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.434+0000 7f6899037640 1 -- 172.21.15.88:0/3984388645 >> v1:172.21.15.88:6789/0 conn(0x7f689414df30 legacy=0x7f6894154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.434+0000 7f6899037640 1 -- 172.21.15.88:0/3984388645 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68940c1dc0 con 0x7f68940c1250 2023-12-08T08:20:14.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.438+0000 7f6899037640 1 --2- 172.21.15.88:0/3984388645 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68940c1250 0x7f6894150860 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f68840097c0 tx=0x7f688401c280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7694fa6883382e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:14.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.438+0000 7f6898836640 1 -- 172.21.15.88:0/3984388645 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6890001680 con 0x7f68940c1250 2023-12-08T08:20:14.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.438+0000 7f6898836640 1 -- 172.21.15.88:0/3984388645 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68840a7050 con 0x7f68940c1250 2023-12-08T08:20:14.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.438+0000 7f6898836640 1 -- 172.21.15.88:0/3984388645 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68840ab620 con 0x7f68940c1250 2023-12-08T08:20:14.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.438+0000 7f689ba9c640 1 -- 172.21.15.88:0/3984388645 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68940c1250 msgr2=0x7f6894150860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.438+0000 7f689ba9c640 1 --2- 172.21.15.88:0/3984388645 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68940c1250 0x7f6894150860 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f68840097c0 tx=0x7f688401c280 comp rx=0 tx=0).stop 2023-12-08T08:20:14.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.438+0000 7f689ba9c640 1 -- 172.21.15.88:0/3984388645 shutdown_connections 2023-12-08T08:20:14.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.438+0000 7f689ba9c640 1 --2- 172.21.15.88:0/3984388645 >> v2:172.21.15.148:3300/0 conn(0x7f68940c25b0 0x7f689406b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.438+0000 7f689ba9c640 1 --2- 172.21.15.88:0/3984388645 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68940c1250 0x7f6894150860 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.438+0000 7f689ba9c640 1 -- 172.21.15.88:0/3984388645 >> 172.21.15.88:0/3984388645 conn(0x7f68940c2e20 msgr2=0x7f68940c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:14.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.438+0000 7f689ba9c640 1 -- 172.21.15.88:0/3984388645 shutdown_connections 2023-12-08T08:20:14.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.438+0000 7f689ba9c640 1 -- 172.21.15.88:0/3984388645 wait complete. 2023-12-08T08:20:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.442+0000 7f689ba9c640 1 Processor -- start 2023-12-08T08:20:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.442+0000 7f689ba9c640 1 -- start start 2023-12-08T08:20:14.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.442+0000 7f689ba9c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68940c1250 0x7f68941417c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.442+0000 7f689ba9c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68940c25b0 0x7f6894142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.442+0000 7f689ba9c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f689414df30 0x7f68941edc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.442+0000 7f689ba9c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68940c43e0 con 0x7f68940c25b0 2023-12-08T08:20:14.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.442+0000 7f689ba9c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689414d6d0 con 0x7f68940c1250 2023-12-08T08:20:14.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.442+0000 7f689ba9c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68941ed7d0 con 0x7f689414df30 2023-12-08T08:20:14.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.442+0000 7f6899037640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68940c25b0 0x7f6894142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.442+0000 7f6899037640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68940c25b0 0x7f6894142b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59538/0 (socket says 172.21.15.88:59538) 2023-12-08T08:20:14.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.442+0000 7f6899037640 1 -- 172.21.15.88:0/1740780938 learned_addr learned my addr 172.21.15.88:0/1740780938 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:14.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.442+0000 7f689a039640 1 --2- 172.21.15.88:0/1740780938 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f689414df30 0x7f68941edc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.442+0000 7f6899838640 1 --2- 172.21.15.88:0/1740780938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68940c1250 0x7f68941417c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.442+0000 7f6899037640 1 -- 172.21.15.88:0/1740780938 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f689414df30 msgr2=0x7f68941edc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.442+0000 7f6899037640 1 --2- 172.21.15.88:0/1740780938 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f689414df30 0x7f68941edc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.442+0000 7f6899037640 1 -- 172.21.15.88:0/1740780938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68940c1250 msgr2=0x7f68941417c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.442+0000 7f6899037640 1 --2- 172.21.15.88:0/1740780938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68940c1250 0x7f68941417c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.442+0000 7f6899037640 1 -- 172.21.15.88:0/1740780938 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6884009420 con 0x7f68940c25b0 2023-12-08T08:20:14.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.442+0000 7f6899037640 1 --2- 172.21.15.88:0/1740780938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68940c25b0 0x7f6894142b90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f688401a930 tx=0x7f6884019020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:14.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.442+0000 7f688a7fc640 1 -- 172.21.15.88:0/1740780938 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68840b4430 con 0x7f68940c25b0 2023-12-08T08:20:14.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.442+0000 7f688a7fc640 1 -- 172.21.15.88:0/1740780938 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68840b45b0 con 0x7f68940c25b0 2023-12-08T08:20:14.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.442+0000 7f689ba9c640 1 -- 172.21.15.88:0/1740780938 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6894141d00 con 0x7f68940c25b0 2023-12-08T08:20:14.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.442+0000 7f688a7fc640 1 -- 172.21.15.88:0/1740780938 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68840b4960 con 0x7f68940c25b0 2023-12-08T08:20:14.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.442+0000 7f689ba9c640 1 -- 172.21.15.88:0/1740780938 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f689414d110 con 0x7f68940c25b0 2023-12-08T08:20:14.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.446+0000 7f689ba9c640 1 -- 172.21.15.88:0/1740780938 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6894067630 con 0x7f68940c25b0 2023-12-08T08:20:14.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.446+0000 7f688a7fc640 1 -- 172.21.15.88:0/1740780938 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f68840b2040 con 0x7f68940c25b0 2023-12-08T08:20:14.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.446+0000 7f688a7fc640 1 --2- 172.21.15.88:0/1740780938 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f68780664a0 0x7f6878068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.446+0000 7f688a7fc640 1 -- 172.21.15.88:0/1740780938 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f688411d090 con 0x7f68940c25b0 2023-12-08T08:20:14.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.446+0000 7f6899838640 1 --2- 172.21.15.88:0/1740780938 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f68780664a0 0x7f6878068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.446+0000 7f6899838640 1 --2- 172.21.15.88:0/1740780938 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f68780664a0 0x7f6878068960 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6890001190 tx=0x7f6890001120 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:14.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.450+0000 7f688a7fc640 1 -- 172.21.15.88:0/1740780938 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f68840ea900 con 0x7f68940c25b0 2023-12-08T08:20:14.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.598+0000 7f689ba9c640 1 -- 172.21.15.88:0/1740780938 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f689415afc0 con 0x7f68940c25b0 2023-12-08T08:20:14.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.598+0000 7f688a7fc640 1 -- 172.21.15.88:0/1740780938 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f68840edf20 con 0x7f68940c25b0 2023-12-08T08:20:14.604 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:20:14.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.602+0000 7f689ba9c640 1 -- 172.21.15.88:0/1740780938 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f68780664a0 msgr2=0x7f6878068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.602+0000 7f689ba9c640 1 --2- 172.21.15.88:0/1740780938 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f68780664a0 0x7f6878068960 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6890001190 tx=0x7f6890001120 comp rx=0 tx=0).stop 2023-12-08T08:20:14.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.602+0000 7f689ba9c640 1 -- 172.21.15.88:0/1740780938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68940c25b0 msgr2=0x7f6894142b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.602+0000 7f689ba9c640 1 --2- 172.21.15.88:0/1740780938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68940c25b0 0x7f6894142b90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f688401a930 tx=0x7f6884019020 comp rx=0 tx=0).stop 2023-12-08T08:20:14.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.602+0000 7f689ba9c640 1 -- 172.21.15.88:0/1740780938 shutdown_connections 2023-12-08T08:20:14.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.602+0000 7f689ba9c640 1 --2- 172.21.15.88:0/1740780938 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f68780664a0 0x7f6878068960 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.602+0000 7f689ba9c640 1 --2- 172.21.15.88:0/1740780938 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f689414df30 0x7f68941edc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.602+0000 7f689ba9c640 1 --2- 172.21.15.88:0/1740780938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68940c25b0 0x7f6894142b90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.602+0000 7f689ba9c640 1 --2- 172.21.15.88:0/1740780938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68940c1250 0x7f68941417c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.602+0000 7f689ba9c640 1 -- 172.21.15.88:0/1740780938 >> 172.21.15.88:0/1740780938 conn(0x7f68940c2e20 msgr2=0x7f6894154650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:14.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.602+0000 7f689ba9c640 1 -- 172.21.15.88:0/1740780938 shutdown_connections 2023-12-08T08:20:14.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.602+0000 7f689ba9c640 1 -- 172.21.15.88:0/1740780938 wait complete. 2023-12-08T08:20:14.625 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:20:14.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.758+0000 7f602c980640 1 Processor -- start 2023-12-08T08:20:14.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.758+0000 7f602c980640 1 -- start start 2023-12-08T08:20:14.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.758+0000 7f602c980640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60280c3b80 0x7f602806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.758+0000 7f602c980640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f60280c5300 0x7f602806c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.758+0000 7f602c980640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602806bb80 con 0x7f602806d2b0 2023-12-08T08:20:14.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.758+0000 7f602c980640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602806cc70 con 0x7f60280c5300 2023-12-08T08:20:14.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.758+0000 7f602c980640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60280c5790 con 0x7f60280c3b80 2023-12-08T08:20:14.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.762+0000 7f6026d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f60280c5300 0x7f602806c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.762+0000 7f6026d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f60280c5300 0x7f602806c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59540/0 (socket says 172.21.15.88:59540) 2023-12-08T08:20:14.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.762+0000 7f6026d9d640 1 -- 172.21.15.88:0/3885885911 learned_addr learned my addr 172.21.15.88:0/3885885911 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:14.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.762+0000 7f601dd9b640 1 --2- 172.21.15.88:0/3885885911 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60280c3b80 0x7f602806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.762+0000 7f6026d9d640 1 -- 172.21.15.88:0/3885885911 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60280c3b80 msgr2=0x7f602806d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:14.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.762+0000 7f6026d9d640 1 --2- 172.21.15.88:0/3885885911 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60280c3b80 0x7f602806d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.762+0000 7f6026d9d640 1 -- 172.21.15.88:0/3885885911 >> v1:172.21.15.88:6789/0 conn(0x7f602806d2b0 legacy=0x7f602806c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.762+0000 7f6026d9d640 1 -- 172.21.15.88:0/3885885911 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60281515c0 con 0x7f60280c5300 2023-12-08T08:20:14.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.762+0000 7f6026d9d640 1 --2- 172.21.15.88:0/3885885911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60280c5300 0x7f602806c730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f602000bb10 tx=0x7f602001ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cdf4113b6d67b76 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:14.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.762+0000 7f6025d9b640 1 -- 172.21.15.88:0/3885885911 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60200a7ac0 con 0x7f60280c5300 2023-12-08T08:20:14.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.762+0000 7f6025d9b640 1 -- 172.21.15.88:0/3885885911 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60200a7c20 con 0x7f60280c5300 2023-12-08T08:20:14.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.762+0000 7f6025d9b640 1 -- 172.21.15.88:0/3885885911 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60200af440 con 0x7f60280c5300 2023-12-08T08:20:14.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.766+0000 7f602c980640 1 -- 172.21.15.88:0/3885885911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60280c5300 msgr2=0x7f602806c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.766+0000 7f602c980640 1 --2- 172.21.15.88:0/3885885911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60280c5300 0x7f602806c730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f602000bb10 tx=0x7f602001ebe0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.766+0000 7f602c980640 1 -- 172.21.15.88:0/3885885911 shutdown_connections 2023-12-08T08:20:14.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.766+0000 7f602c980640 1 --2- 172.21.15.88:0/3885885911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60280c5300 0x7f602806c730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.766+0000 7f602c980640 1 --2- 172.21.15.88:0/3885885911 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60280c3b80 0x7f602806d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.766+0000 7f602c980640 1 -- 172.21.15.88:0/3885885911 >> 172.21.15.88:0/3885885911 conn(0x7f60280a7810 msgr2=0x7f60280a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:14.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.766+0000 7f602c980640 1 -- 172.21.15.88:0/3885885911 shutdown_connections 2023-12-08T08:20:14.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.766+0000 7f602c980640 1 -- 172.21.15.88:0/3885885911 wait complete. 2023-12-08T08:20:14.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.766+0000 7f602c980640 1 Processor -- start 2023-12-08T08:20:14.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.766+0000 7f602c980640 1 -- start start 2023-12-08T08:20:14.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.766+0000 7f602c980640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f602806d2b0 0x7f6028147500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.766+0000 7f602c980640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60280c3b80 0x7f602813e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.766+0000 7f602c980640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60280c5300 0x7f602813e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.766+0000 7f602c980640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602813ec80 con 0x7f602806d2b0 2023-12-08T08:20:14.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.766+0000 7f602c980640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60280a9980 con 0x7f60280c3b80 2023-12-08T08:20:14.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.766+0000 7f602c980640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60281f1040 con 0x7f60280c5300 2023-12-08T08:20:14.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.766+0000 7f602659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f602806d2b0 0x7f6028147500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.766+0000 7f602659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f602806d2b0 0x7f6028147500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59554/0 (socket says 172.21.15.88:59554) 2023-12-08T08:20:14.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.766+0000 7f602659c640 1 -- 172.21.15.88:0/3135788659 learned_addr learned my addr 172.21.15.88:0/3135788659 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:14.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.766+0000 7f6026d9d640 1 --2- 172.21.15.88:0/3135788659 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60280c5300 0x7f602813e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.766+0000 7f601dd9b640 1 --2- 172.21.15.88:0/3135788659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60280c3b80 0x7f602813e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.770+0000 7f602659c640 1 -- 172.21.15.88:0/3135788659 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60280c5300 msgr2=0x7f602813e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.770+0000 7f602659c640 1 --2- 172.21.15.88:0/3135788659 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60280c5300 0x7f602813e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.770+0000 7f602659c640 1 -- 172.21.15.88:0/3135788659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60280c3b80 msgr2=0x7f602813e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.770+0000 7f602659c640 1 --2- 172.21.15.88:0/3135788659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60280c3b80 0x7f602813e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.770+0000 7f602659c640 1 -- 172.21.15.88:0/3135788659 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602000b770 con 0x7f602806d2b0 2023-12-08T08:20:14.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.770+0000 7f602659c640 1 --2- 172.21.15.88:0/3135788659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f602806d2b0 0x7f6028147500 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f601800c820 tx=0x7f601800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:14.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.770+0000 7f601f7fe640 1 -- 172.21.15.88:0/3135788659 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018003b80 con 0x7f602806d2b0 2023-12-08T08:20:14.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.770+0000 7f601f7fe640 1 -- 172.21.15.88:0/3135788659 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6018003ce0 con 0x7f602806d2b0 2023-12-08T08:20:14.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.770+0000 7f602c980640 1 -- 172.21.15.88:0/3135788659 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602814ef80 con 0x7f602806d2b0 2023-12-08T08:20:14.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.770+0000 7f601f7fe640 1 -- 172.21.15.88:0/3135788659 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601800aa90 con 0x7f602806d2b0 2023-12-08T08:20:14.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.770+0000 7f602c980640 1 -- 172.21.15.88:0/3135788659 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60281f0710 con 0x7f602806d2b0 2023-12-08T08:20:14.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.770+0000 7f602c980640 1 -- 172.21.15.88:0/3135788659 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6028067630 con 0x7f602806d2b0 2023-12-08T08:20:14.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.770+0000 7f601f7fe640 1 -- 172.21.15.88:0/3135788659 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f601800abf0 con 0x7f602806d2b0 2023-12-08T08:20:14.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.774+0000 7f601f7fe640 1 --2- 172.21.15.88:0/3135788659 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6008066470 0x7f6008068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.774+0000 7f601f7fe640 1 -- 172.21.15.88:0/3135788659 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f60180839b0 con 0x7f602806d2b0 2023-12-08T08:20:14.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.774+0000 7f601dd9b640 1 --2- 172.21.15.88:0/3135788659 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6008066470 0x7f6008068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.774+0000 7f601dd9b640 1 --2- 172.21.15.88:0/3135788659 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6008066470 0x7f6008068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f602814c390 tx=0x7f6010009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:14.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.778+0000 7f601f7fe640 1 -- 172.21.15.88:0/3135788659 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6018051220 con 0x7f602806d2b0 2023-12-08T08:20:14.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.954+0000 7f602c980640 1 -- 172.21.15.88:0/3135788659 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f602806bd70 con 0x7f602806d2b0 2023-12-08T08:20:14.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.954+0000 7f601f7fe640 1 -- 172.21.15.88:0/3135788659 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f6018054840 con 0x7f602806d2b0 2023-12-08T08:20:14.960 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:14.960 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/3793971563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":3793971563},{"type":"v1","addr":"172.21.15.88:6835","nonce":3793971563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-12-08T08:20:14.960 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 2 2023-12-08T08:20:14.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.958+0000 7f602c980640 1 -- 172.21.15.88:0/3135788659 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6008066470 msgr2=0x7f6008068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.958+0000 7f602c980640 1 --2- 172.21.15.88:0/3135788659 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6008066470 0x7f6008068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f602814c390 tx=0x7f6010009190 comp rx=0 tx=0).stop 2023-12-08T08:20:14.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.958+0000 7f602c980640 1 -- 172.21.15.88:0/3135788659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f602806d2b0 msgr2=0x7f6028147500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.958+0000 7f602c980640 1 --2- 172.21.15.88:0/3135788659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f602806d2b0 0x7f6028147500 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f601800c820 tx=0x7f601800cce0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.958+0000 7f602c980640 1 -- 172.21.15.88:0/3135788659 shutdown_connections 2023-12-08T08:20:14.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.958+0000 7f602c980640 1 --2- 172.21.15.88:0/3135788659 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6008066470 0x7f6008068930 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.958+0000 7f602c980640 1 --2- 172.21.15.88:0/3135788659 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60280c5300 0x7f602813e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.958+0000 7f602c980640 1 --2- 172.21.15.88:0/3135788659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60280c3b80 0x7f602813e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.958+0000 7f602c980640 1 --2- 172.21.15.88:0/3135788659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f602806d2b0 0x7f6028147500 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.958+0000 7f602c980640 1 -- 172.21.15.88:0/3135788659 >> 172.21.15.88:0/3135788659 conn(0x7f60280a7810 msgr2=0x7f602806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:14.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.958+0000 7f602c980640 1 -- 172.21.15.88:0/3135788659 shutdown_connections 2023-12-08T08:20:14.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:14.958+0000 7f602c980640 1 -- 172.21.15.88:0/3135788659 wait complete. 2023-12-08T08:20:16.981 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:20:17.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.122+0000 7f65bc2e3640 1 Processor -- start 2023-12-08T08:20:17.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.122+0000 7f65bc2e3640 1 -- start start 2023-12-08T08:20:17.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.122+0000 7f65bc2e3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f65b4071e30 0x7f65b40722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.122+0000 7f65bc2e3640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b40c5710 con 0x7f65b414fd10 2023-12-08T08:20:17.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.122+0000 7f65bc2e3640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b4155c80 con 0x7f65b4156110 2023-12-08T08:20:17.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.122+0000 7f65bc2e3640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65b406c5e0 con 0x7f65b4071e30 2023-12-08T08:20:17.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.122+0000 7f65b987e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f65b4071e30 0x7f65b40722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.122+0000 7f65b987e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f65b4071e30 0x7f65b40722c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59558/0 (socket says 172.21.15.88:59558) 2023-12-08T08:20:17.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.122+0000 7f65b987e640 1 -- 172.21.15.88:0/3394907622 learned_addr learned my addr 172.21.15.88:0/3394907622 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:17.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.122+0000 7f65ba07f640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f65b414fd10 0x7f65b40a4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47960/0 (socket says 172.21.15.88:47960) 2023-12-08T08:20:17.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.126+0000 7f65b987e640 1 -- 172.21.15.88:0/3394907622 >> v1:172.21.15.148:6789/0 conn(0x7f65b4156110 legacy=0x7f65b415ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:17.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.126+0000 7f65b987e640 1 -- 172.21.15.88:0/3394907622 >> v1:172.21.15.88:6789/0 conn(0x7f65b414fd10 legacy=0x7f65b40a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.126+0000 7f65b987e640 1 -- 172.21.15.88:0/3394907622 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b40c4e70 con 0x7f65b4071e30 2023-12-08T08:20:17.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.126+0000 7f65b907d640 1 -- 172.21.15.88:0/3394907622 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3296382649 0 0) 0x7f65b40c5710 con 0x7f65b414fd10 2023-12-08T08:20:17.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.126+0000 7f65b987e640 1 --2- 172.21.15.88:0/3394907622 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65b4071e30 0x7f65b40722c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f65a4009870 tx=0x7f65a401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1448088939312ab4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:17.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.126+0000 7f65b907d640 1 -- 172.21.15.88:0/3394907622 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a40ac410 con 0x7f65b4071e30 2023-12-08T08:20:17.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.126+0000 7f65b907d640 1 -- 172.21.15.88:0/3394907622 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a40ac570 con 0x7f65b4071e30 2023-12-08T08:20:17.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.126+0000 7f65b907d640 1 -- 172.21.15.88:0/3394907622 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a40ac900 con 0x7f65b4071e30 2023-12-08T08:20:17.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.126+0000 7f65bc2e3640 1 -- 172.21.15.88:0/3394907622 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65b4071e30 msgr2=0x7f65b40722c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.126+0000 7f65bc2e3640 1 --2- 172.21.15.88:0/3394907622 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65b4071e30 0x7f65b40722c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f65a4009870 tx=0x7f65a401c3b0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65bc2e3640 1 -- 172.21.15.88:0/3394907622 shutdown_connections 2023-12-08T08:20:17.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65bc2e3640 1 --2- 172.21.15.88:0/3394907622 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65b4071e30 0x7f65b40722c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65bc2e3640 1 -- 172.21.15.88:0/3394907622 >> 172.21.15.88:0/3394907622 conn(0x7f65b40a7810 msgr2=0x7f65b40a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:17.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65bc2e3640 1 -- 172.21.15.88:0/3394907622 shutdown_connections 2023-12-08T08:20:17.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65bc2e3640 1 -- 172.21.15.88:0/3394907622 wait complete. 2023-12-08T08:20:17.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65bc2e3640 1 Processor -- start 2023-12-08T08:20:17.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65bc2e3640 1 -- start start 2023-12-08T08:20:17.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65bc2e3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65b4071e30 0x7f65b40716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65bc2e3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65b414fd10 0x7f65b41460a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65bc2e3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65b4156110 0x7f65b4148290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65bc2e3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b41f0b90 con 0x7f65b4156110 2023-12-08T08:20:17.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65bc2e3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b41f10c0 con 0x7f65b4071e30 2023-12-08T08:20:17.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65bc2e3640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b4142e60 con 0x7f65b414fd10 2023-12-08T08:20:17.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65ba880640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65b4156110 0x7f65b4148290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65ba880640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65b4156110 0x7f65b4148290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59568/0 (socket says 172.21.15.88:59568) 2023-12-08T08:20:17.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65ba880640 1 -- 172.21.15.88:0/2217219811 learned_addr learned my addr 172.21.15.88:0/2217219811 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:17.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65b987e640 1 --2- 172.21.15.88:0/2217219811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65b414fd10 0x7f65b41460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65ba07f640 1 --2- 172.21.15.88:0/2217219811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65b4071e30 0x7f65b40716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65ba880640 1 -- 172.21.15.88:0/2217219811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65b414fd10 msgr2=0x7f65b41460a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65ba880640 1 --2- 172.21.15.88:0/2217219811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65b414fd10 0x7f65b41460a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65ba880640 1 -- 172.21.15.88:0/2217219811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65b4071e30 msgr2=0x7f65b40716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65ba880640 1 --2- 172.21.15.88:0/2217219811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65b4071e30 0x7f65b40716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65ba880640 1 -- 172.21.15.88:0/2217219811 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a40094d0 con 0x7f65b4156110 2023-12-08T08:20:17.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65ba880640 1 --2- 172.21.15.88:0/2217219811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65b4156110 0x7f65b4148290 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00b9e0 tx=0x7f65ac00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:17.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65aaffd640 1 -- 172.21.15.88:0/2217219811 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac003b80 con 0x7f65b4156110 2023-12-08T08:20:17.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65aaffd640 1 -- 172.21.15.88:0/2217219811 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac003ce0 con 0x7f65b4156110 2023-12-08T08:20:17.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65bc2e3640 1 -- 172.21.15.88:0/2217219811 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b41f0de0 con 0x7f65b4156110 2023-12-08T08:20:17.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.130+0000 7f65aaffd640 1 -- 172.21.15.88:0/2217219811 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac00cae0 con 0x7f65b4156110 2023-12-08T08:20:17.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.134+0000 7f65bc2e3640 1 -- 172.21.15.88:0/2217219811 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b41465e0 con 0x7f65b4156110 2023-12-08T08:20:17.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.134+0000 7f65bc2e3640 1 -- 172.21.15.88:0/2217219811 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b40ab9c0 con 0x7f65b4156110 2023-12-08T08:20:17.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.134+0000 7f65aaffd640 1 -- 172.21.15.88:0/2217219811 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f65ac00cc40 con 0x7f65b4156110 2023-12-08T08:20:17.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.134+0000 7f65aaffd640 1 --2- 172.21.15.88:0/2217219811 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6598066470 0x7f6598068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.134+0000 7f65aaffd640 1 -- 172.21.15.88:0/2217219811 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f65ac083820 con 0x7f65b4156110 2023-12-08T08:20:17.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.134+0000 7f65ba07f640 1 --2- 172.21.15.88:0/2217219811 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6598066470 0x7f6598068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.134+0000 7f65ba07f640 1 --2- 172.21.15.88:0/2217219811 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6598066470 0x7f6598068930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f65b0000f70 tx=0x7f65b0007b80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:17.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.138+0000 7f65aaffd640 1 -- 172.21.15.88:0/2217219811 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f65ac050fe0 con 0x7f65b4156110 2023-12-08T08:20:17.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.318+0000 7f65bc2e3640 1 -- 172.21.15.88:0/2217219811 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65b4067630 con 0x7f65b4156110 2023-12-08T08:20:17.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.318+0000 7f65aaffd640 1 -- 172.21.15.88:0/2217219811 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3697 (secure 0 0 0) 0x7f65ac054600 con 0x7f65b4156110 2023-12-08T08:20:17.323 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:17.323 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/1946795737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":1946795737},{"type":"v1","addr":"172.21.15.88:6837","nonce":1946795737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/140150927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":140150927},{"type":"v1","addr":"172.21.15.148:6834","nonce":140150927}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2399327235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2399327235},{"type":"v1","addr":"172.21.15.148:6835","nonce":2399327235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/3793971563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":3793971563},{"type":"v1","addr":"172.21.15.88:6835","nonce":3793971563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-12-08T08:20:17.323 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 3 2023-12-08T08:20:17.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.322+0000 7f65bc2e3640 1 -- 172.21.15.88:0/2217219811 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6598066470 msgr2=0x7f6598068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.322+0000 7f65bc2e3640 1 --2- 172.21.15.88:0/2217219811 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6598066470 0x7f6598068930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f65b0000f70 tx=0x7f65b0007b80 comp rx=0 tx=0).stop 2023-12-08T08:20:17.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.322+0000 7f65bc2e3640 1 -- 172.21.15.88:0/2217219811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65b4156110 msgr2=0x7f65b4148290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.322+0000 7f65bc2e3640 1 --2- 172.21.15.88:0/2217219811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65b4156110 0x7f65b4148290 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00b9e0 tx=0x7f65ac00bea0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.322+0000 7f65bc2e3640 1 -- 172.21.15.88:0/2217219811 shutdown_connections 2023-12-08T08:20:17.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.322+0000 7f65bc2e3640 1 --2- 172.21.15.88:0/2217219811 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6598066470 0x7f6598068930 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.322+0000 7f65bc2e3640 1 --2- 172.21.15.88:0/2217219811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65b4156110 0x7f65b4148290 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.322+0000 7f65bc2e3640 1 --2- 172.21.15.88:0/2217219811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65b414fd10 0x7f65b41460a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.322+0000 7f65bc2e3640 1 --2- 172.21.15.88:0/2217219811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65b4071e30 0x7f65b40716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.322+0000 7f65bc2e3640 1 -- 172.21.15.88:0/2217219811 >> 172.21.15.88:0/2217219811 conn(0x7f65b40a7810 msgr2=0x7f65b406d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:17.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.322+0000 7f65bc2e3640 1 -- 172.21.15.88:0/2217219811 shutdown_connections 2023-12-08T08:20:17.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.322+0000 7f65bc2e3640 1 -- 172.21.15.88:0/2217219811 wait complete. 2023-12-08T08:20:17.343 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:17.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.478+0000 7fa608453640 1 Processor -- start 2023-12-08T08:20:17.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.478+0000 7fa608453640 1 -- start start 2023-12-08T08:20:17.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.478+0000 7fa608453640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa60014fd10 0x7fa6000a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.478+0000 7fa608453640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa600156110 0x7fa600156580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.478+0000 7fa608453640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6000c5710 con 0x7fa6000a5300 2023-12-08T08:20:17.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.478+0000 7fa608453640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60006c5e0 con 0x7fa600156110 2023-12-08T08:20:17.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.478+0000 7fa608453640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa600155c80 con 0x7fa60014fd10 2023-12-08T08:20:17.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.478+0000 7fa6069f0640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa600156110 0x7fa600156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.478+0000 7fa6059ee640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa6000a5300 0x7fa600071e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47976/0 (socket says 172.21.15.88:47976) 2023-12-08T08:20:17.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.478+0000 7fa6059ee640 1 -- 172.21.15.88:0/3580929460 learned_addr learned my addr 172.21.15.88:0/3580929460 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:17.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.478+0000 7fa6061ef640 1 --2- 172.21.15.88:0/3580929460 >> v2:172.21.15.148:3300/0 conn(0x7fa60014fd10 0x7fa6000a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.478+0000 7fa6069f0640 1 -- 172.21.15.88:0/3580929460 >> v2:172.21.15.148:3300/0 conn(0x7fa60014fd10 msgr2=0x7fa6000a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:17.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.478+0000 7fa6069f0640 1 --2- 172.21.15.88:0/3580929460 >> v2:172.21.15.148:3300/0 conn(0x7fa60014fd10 0x7fa6000a4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.478+0000 7fa6069f0640 1 -- 172.21.15.88:0/3580929460 >> v1:172.21.15.88:6789/0 conn(0x7fa6000a5300 legacy=0x7fa600071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.478+0000 7fa6069f0640 1 -- 172.21.15.88:0/3580929460 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6000c4e70 con 0x7fa600156110 2023-12-08T08:20:17.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.478+0000 7fa6051ed640 1 -- 172.21.15.88:0/3580929460 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1446879320 0 0) 0x7fa6000c5710 con 0x7fa6000a5300 2023-12-08T08:20:17.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.482+0000 7fa6069f0640 1 --2- 172.21.15.88:0/3580929460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa600156110 0x7fa600156580 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa60006b5a0 tx=0x7fa5f801c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20afcb2967c759ad server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:17.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.482+0000 7fa6051ed640 1 -- 172.21.15.88:0/3580929460 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80a58b0 con 0x7fa600156110 2023-12-08T08:20:17.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.482+0000 7fa6051ed640 1 -- 172.21.15.88:0/3580929460 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f80a5a10 con 0x7fa600156110 2023-12-08T08:20:17.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.482+0000 7fa6051ed640 1 -- 172.21.15.88:0/3580929460 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80a5da0 con 0x7fa600156110 2023-12-08T08:20:17.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.482+0000 7fa608453640 1 -- 172.21.15.88:0/3580929460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa600156110 msgr2=0x7fa600156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.482+0000 7fa608453640 1 --2- 172.21.15.88:0/3580929460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa600156110 0x7fa600156580 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa60006b5a0 tx=0x7fa5f801c7f0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.482+0000 7fa608453640 1 -- 172.21.15.88:0/3580929460 shutdown_connections 2023-12-08T08:20:17.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.482+0000 7fa608453640 1 --2- 172.21.15.88:0/3580929460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa600156110 0x7fa600156580 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.482+0000 7fa608453640 1 --2- 172.21.15.88:0/3580929460 >> v2:172.21.15.148:3300/0 conn(0x7fa60014fd10 0x7fa6000a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.482+0000 7fa608453640 1 -- 172.21.15.88:0/3580929460 >> 172.21.15.88:0/3580929460 conn(0x7fa6000a7810 msgr2=0x7fa6000a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:17.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.482+0000 7fa608453640 1 -- 172.21.15.88:0/3580929460 shutdown_connections 2023-12-08T08:20:17.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.482+0000 7fa608453640 1 -- 172.21.15.88:0/3580929460 wait complete. 2023-12-08T08:20:17.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.486+0000 7fa608453640 1 Processor -- start 2023-12-08T08:20:17.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.486+0000 7fa608453640 1 -- start start 2023-12-08T08:20:17.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.486+0000 7fa608453640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6000a5300 0x7fa6000bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.486+0000 7fa608453640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa60014fd10 0x7fa6000a9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.486+0000 7fa608453640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa600156110 0x7fa60014ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.486+0000 7fa608453640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6001efb80 con 0x7fa600156110 2023-12-08T08:20:17.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.486+0000 7fa608453640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6001efdd0 con 0x7fa6000a5300 2023-12-08T08:20:17.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.486+0000 7fa608453640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6001f00b0 con 0x7fa60014fd10 2023-12-08T08:20:17.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.486+0000 7fa6069f0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa600156110 0x7fa60014ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.486+0000 7fa6069f0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa600156110 0x7fa60014ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59588/0 (socket says 172.21.15.88:59588) 2023-12-08T08:20:17.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.486+0000 7fa6069f0640 1 -- 172.21.15.88:0/2344513339 learned_addr learned my addr 172.21.15.88:0/2344513339 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:17.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.486+0000 7fa6061ef640 1 --2- 172.21.15.88:0/2344513339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6000a5300 0x7fa6000bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.486+0000 7fa6059ee640 1 --2- 172.21.15.88:0/2344513339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa60014fd10 0x7fa6000a9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.486+0000 7fa6069f0640 1 -- 172.21.15.88:0/2344513339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa60014fd10 msgr2=0x7fa6000a9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.486+0000 7fa6069f0640 1 --2- 172.21.15.88:0/2344513339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa60014fd10 0x7fa6000a9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.486+0000 7fa6069f0640 1 -- 172.21.15.88:0/2344513339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6000a5300 msgr2=0x7fa6000bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.486+0000 7fa6069f0640 1 --2- 172.21.15.88:0/2344513339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6000a5300 0x7fa6000bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.486+0000 7fa6069f0640 1 -- 172.21.15.88:0/2344513339 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f8009a70 con 0x7fa600156110 2023-12-08T08:20:17.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.486+0000 7fa6059ee640 1 --2- 172.21.15.88:0/2344513339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa60014fd10 0x7fa6000a9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:17.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.486+0000 7fa6069f0640 1 --2- 172.21.15.88:0/2344513339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa600156110 0x7fa60014ed40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80b0040 tx=0x7fa5f8019590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:17.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.486+0000 7fa5f6ffd640 1 -- 172.21.15.88:0/2344513339 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80b9650 con 0x7fa600156110 2023-12-08T08:20:17.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.486+0000 7fa5f6ffd640 1 -- 172.21.15.88:0/2344513339 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f80b97b0 con 0x7fa600156110 2023-12-08T08:20:17.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.486+0000 7fa5f6ffd640 1 -- 172.21.15.88:0/2344513339 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80b9b80 con 0x7fa600156110 2023-12-08T08:20:17.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.486+0000 7fa608453640 1 -- 172.21.15.88:0/2344513339 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6001f0390 con 0x7fa600156110 2023-12-08T08:20:17.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.486+0000 7fa608453640 1 -- 172.21.15.88:0/2344513339 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6001f0950 con 0x7fa600156110 2023-12-08T08:20:17.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.486+0000 7fa608453640 1 -- 172.21.15.88:0/2344513339 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa600067630 con 0x7fa600156110 2023-12-08T08:20:17.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.490+0000 7fa5f6ffd640 1 -- 172.21.15.88:0/2344513339 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa5f80b9ce0 con 0x7fa600156110 2023-12-08T08:20:17.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.490+0000 7fa5f6ffd640 1 --2- 172.21.15.88:0/2344513339 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa5e4066470 0x7fa5e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.490+0000 7fa5f6ffd640 1 -- 172.21.15.88:0/2344513339 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa5f811ebc0 con 0x7fa600156110 2023-12-08T08:20:17.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.490+0000 7fa6061ef640 1 --2- 172.21.15.88:0/2344513339 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa5e4066470 0x7fa5e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.490+0000 7fa6061ef640 1 --2- 172.21.15.88:0/2344513339 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa5e4066470 0x7fa5e4068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa600155a60 tx=0x7fa5fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:17.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.494+0000 7fa5f6ffd640 1 -- 172.21.15.88:0/2344513339 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa5f80ec420 con 0x7fa600156110 2023-12-08T08:20:17.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.646+0000 7fa608453640 1 -- 172.21.15.88:0/2344513339 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6000c4b20 con 0x7fa600156110 2023-12-08T08:20:17.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.646+0000 7fa5f6ffd640 1 -- 172.21.15.88:0/2344513339 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12826 (secure 0 0 0) 0x7fa5f80efa40 con 0x7fa600156110 2023-12-08T08:20:17.650 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:17.650 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":16,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:20:10.811990+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:17.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.646+0000 7fa608453640 1 -- 172.21.15.88:0/2344513339 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa5e4066470 msgr2=0x7fa5e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.646+0000 7fa608453640 1 --2- 172.21.15.88:0/2344513339 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa5e4066470 0x7fa5e4068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa600155a60 tx=0x7fa5fc008040 comp rx=0 tx=0).stop 2023-12-08T08:20:17.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.646+0000 7fa608453640 1 -- 172.21.15.88:0/2344513339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa600156110 msgr2=0x7fa60014ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.646+0000 7fa608453640 1 --2- 172.21.15.88:0/2344513339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa600156110 0x7fa60014ed40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80b0040 tx=0x7fa5f8019590 comp rx=0 tx=0).stop 2023-12-08T08:20:17.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.646+0000 7fa608453640 1 -- 172.21.15.88:0/2344513339 shutdown_connections 2023-12-08T08:20:17.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.646+0000 7fa608453640 1 --2- 172.21.15.88:0/2344513339 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa5e4066470 0x7fa5e4068930 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.646+0000 7fa608453640 1 --2- 172.21.15.88:0/2344513339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa600156110 0x7fa60014ed40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.646+0000 7fa608453640 1 --2- 172.21.15.88:0/2344513339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa60014fd10 0x7fa6000a9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.646+0000 7fa608453640 1 --2- 172.21.15.88:0/2344513339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6000a5300 0x7fa6000bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.646+0000 7fa608453640 1 -- 172.21.15.88:0/2344513339 >> 172.21.15.88:0/2344513339 conn(0x7fa6000a7810 msgr2=0x7fa60015c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:17.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.646+0000 7fa608453640 1 -- 172.21.15.88:0/2344513339 shutdown_connections 2023-12-08T08:20:17.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.646+0000 7fa608453640 1 -- 172.21.15.88:0/2344513339 wait complete. 2023-12-08T08:20:17.670 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:20:17.671 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:20:17.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.806+0000 7fc1153f5640 1 Processor -- start 2023-12-08T08:20:17.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.806+0000 7fc1153f5640 1 -- start start 2023-12-08T08:20:17.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc1153f5640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc110151c50 0x7fc1100c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc1153f5640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc1100c8040 0x7fc11015ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc1153f5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1100c4cd0 con 0x7fc1100c6130 2023-12-08T08:20:17.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc1153f5640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1101584b0 con 0x7fc1100c8040 2023-12-08T08:20:17.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc1153f5640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1100c5200 con 0x7fc110151c50 2023-12-08T08:20:17.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc1067fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc1100c6130 0x7fc110157a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47978/0 (socket says 172.21.15.88:47978) 2023-12-08T08:20:17.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc1067fc640 1 -- 172.21.15.88:0/4230697874 learned_addr learned my addr 172.21.15.88:0/4230697874 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:17.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc10e7fc640 1 -- 172.21.15.88:0/4230697874 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580982125 0 0) 0x7fc1100c4cd0 con 0x7fc1100c6130 2023-12-08T08:20:17.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc10e7fc640 1 -- 172.21.15.88:0/4230697874 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0fc003530 con 0x7fc1100c6130 2023-12-08T08:20:17.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc10effd640 1 --2- 172.21.15.88:0/4230697874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc110151c50 0x7fc1100c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc10f7fe640 1 --2- 172.21.15.88:0/4230697874 >> v2:172.21.15.148:3300/0 conn(0x7fc1100c8040 0x7fc11015ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc10e7fc640 1 -- 172.21.15.88:0/4230697874 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4014320836 0 0) 0x7fc0fc003530 con 0x7fc1100c6130 2023-12-08T08:20:17.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc10e7fc640 1 -- 172.21.15.88:0/4230697874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc110151c50 msgr2=0x7fc1100c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:17.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc10e7fc640 1 --2- 172.21.15.88:0/4230697874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc110151c50 0x7fc1100c7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc10e7fc640 1 -- 172.21.15.88:0/4230697874 >> v2:172.21.15.148:3300/0 conn(0x7fc1100c8040 msgr2=0x7fc11015ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:17.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc10e7fc640 1 --2- 172.21.15.88:0/4230697874 >> v2:172.21.15.148:3300/0 conn(0x7fc1100c8040 0x7fc11015ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc10e7fc640 1 -- 172.21.15.88:0/4230697874 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc110158750 con 0x7fc1100c6130 2023-12-08T08:20:17.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc10e7fc640 1 -- 172.21.15.88:0/4230697874 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7fc0f8001a00 con 0x7fc1100c6130 2023-12-08T08:20:17.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc10effd640 1 --2- 172.21.15.88:0/4230697874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc110151c50 0x7fc1100c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:17.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc10e7fc640 1 -- 172.21.15.88:0/4230697874 >> v1:172.21.15.88:6789/0 conn(0x7fc1100c6130 legacy=0x7fc110157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc10e7fc640 1 --2- 172.21.15.88:0/4230697874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0fc003980 0x7fc0fc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc10e7fc640 1 --2- 172.21.15.88:0/4230697874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc110151c50 0x7fc0fc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc10e7fc640 1 --2- 172.21.15.88:0/4230697874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0fc004d10 0x7fc0fc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc10e7fc640 1 -- 172.21.15.88:0/4230697874 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1101584b0 con 0x7fc0fc003980 2023-12-08T08:20:17.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc10e7fc640 1 -- 172.21.15.88:0/4230697874 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1100c5200 con 0x7fc0fc004d10 2023-12-08T08:20:17.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc10e7fc640 1 -- 172.21.15.88:0/4230697874 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc00baf0 con 0x7fc110151c50 2023-12-08T08:20:17.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc10f7fe640 1 --2- 172.21.15.88:0/4230697874 >> v2:172.21.15.148:3300/0 conn(0x7fc1100c8040 0x7fc11015ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:17.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc10effd640 1 --2- 172.21.15.88:0/4230697874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0fc003980 0x7fc0fc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc10f7fe640 1 --2- 172.21.15.88:0/4230697874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0fc004d10 0x7fc0fc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc1067fc640 1 --2- 172.21.15.88:0/4230697874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc110151c50 0x7fc0fc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc10effd640 1 -- 172.21.15.88:0/4230697874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc110151c50 msgr2=0x7fc0fc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:17.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc10effd640 1 --2- 172.21.15.88:0/4230697874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc110151c50 0x7fc0fc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc10effd640 1 -- 172.21.15.88:0/4230697874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0fc004d10 msgr2=0x7fc0fc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:17.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc10effd640 1 --2- 172.21.15.88:0/4230697874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0fc004d10 0x7fc0fc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.810+0000 7fc10effd640 1 -- 172.21.15.88:0/4230697874 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0fc003530 con 0x7fc0fc003980 2023-12-08T08:20:17.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.814+0000 7fc10effd640 1 --2- 172.21.15.88:0/4230697874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0fc003980 0x7fc0fc003da0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc1000098a0 tx=0x7fc10001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7385aacc4b0bc35b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:17.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.814+0000 7fc10e7fc640 1 -- 172.21.15.88:0/4230697874 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1000aa660 con 0x7fc0fc003980 2023-12-08T08:20:17.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.814+0000 7fc10e7fc640 1 -- 172.21.15.88:0/4230697874 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1000aa7c0 con 0x7fc0fc003980 2023-12-08T08:20:17.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.814+0000 7fc10e7fc640 1 -- 172.21.15.88:0/4230697874 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1000aab30 con 0x7fc0fc003980 2023-12-08T08:20:17.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.814+0000 7fc1153f5640 1 -- 172.21.15.88:0/4230697874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0fc003980 msgr2=0x7fc0fc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.814+0000 7fc1153f5640 1 --2- 172.21.15.88:0/4230697874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0fc003980 0x7fc0fc003da0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc1000098a0 tx=0x7fc10001c540 comp rx=0 tx=0).stop 2023-12-08T08:20:17.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.814+0000 7fc10f7fe640 1 -- 172.21.15.88:0/4230697874 reap_dead start 2023-12-08T08:20:17.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.814+0000 7fc1153f5640 1 -- 172.21.15.88:0/4230697874 shutdown_connections 2023-12-08T08:20:17.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.814+0000 7fc1153f5640 1 -- 172.21.15.88:0/4230697874 >> 172.21.15.88:0/4230697874 conn(0x7fc1100c9dd0 msgr2=0x7fc1100ca1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:17.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.814+0000 7fc1153f5640 1 -- 172.21.15.88:0/4230697874 shutdown_connections 2023-12-08T08:20:17.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.814+0000 7fc1153f5640 1 -- 172.21.15.88:0/4230697874 wait complete. 2023-12-08T08:20:17.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.814+0000 7fc1153f5640 1 Processor -- start 2023-12-08T08:20:17.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.814+0000 7fc1153f5640 1 -- start start 2023-12-08T08:20:17.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.818+0000 7fc1153f5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0fc003980 0x7fc110148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.818+0000 7fc1153f5640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc110152300 0x7fc110145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.818+0000 7fc1153f5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc110152780 0x7fc1101ed060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.818+0000 7fc1153f5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc110153050 con 0x7fc0fc003980 2023-12-08T08:20:17.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.818+0000 7fc1153f5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc110152ce0 con 0x7fc110152780 2023-12-08T08:20:17.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.818+0000 7fc1153f5640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1101f05d0 con 0x7fc110152300 2023-12-08T08:20:17.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.818+0000 7fc10effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0fc003980 0x7fc110148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.818+0000 7fc10effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0fc003980 0x7fc110148c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59612/0 (socket says 172.21.15.88:59612) 2023-12-08T08:20:17.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.818+0000 7fc10effd640 1 -- 172.21.15.88:0/1991032866 learned_addr learned my addr 172.21.15.88:0/1991032866 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:17.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.818+0000 7fc10f7fe640 1 --2- 172.21.15.88:0/1991032866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc110152780 0x7fc1101ed060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.818+0000 7fc1067fc640 1 --2- 172.21.15.88:0/1991032866 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc110152300 0x7fc110145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.818+0000 7fc10effd640 1 -- 172.21.15.88:0/1991032866 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc110152300 msgr2=0x7fc110145610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.818+0000 7fc10effd640 1 --2- 172.21.15.88:0/1991032866 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc110152300 0x7fc110145610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.818+0000 7fc10effd640 1 -- 172.21.15.88:0/1991032866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc110152780 msgr2=0x7fc1101ed060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.818+0000 7fc10effd640 1 --2- 172.21.15.88:0/1991032866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc110152780 0x7fc1101ed060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.818+0000 7fc10effd640 1 -- 172.21.15.88:0/1991032866 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1101f1150 con 0x7fc0fc003980 2023-12-08T08:20:17.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.818+0000 7fc1067fc640 1 --2- 172.21.15.88:0/1991032866 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc110152300 0x7fc110145610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:17.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.818+0000 7fc10f7fe640 1 --2- 172.21.15.88:0/1991032866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc110152780 0x7fc1101ed060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:17.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.818+0000 7fc10effd640 1 --2- 172.21.15.88:0/1991032866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0fc003980 0x7fc110148c80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc1000ac040 tx=0x7fc0fc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:17.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.818+0000 7fc107fff640 1 -- 172.21.15.88:0/1991032866 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc100004220 con 0x7fc0fc003980 2023-12-08T08:20:17.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.818+0000 7fc107fff640 1 -- 172.21.15.88:0/1991032866 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc100004380 con 0x7fc0fc003980 2023-12-08T08:20:17.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.818+0000 7fc107fff640 1 -- 172.21.15.88:0/1991032866 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1000aab50 con 0x7fc0fc003980 2023-12-08T08:20:17.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.818+0000 7fc1153f5640 1 -- 172.21.15.88:0/1991032866 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1101f0820 con 0x7fc0fc003980 2023-12-08T08:20:17.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.818+0000 7fc1153f5640 1 -- 172.21.15.88:0/1991032866 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1101f0de0 con 0x7fc0fc003980 2023-12-08T08:20:17.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.818+0000 7fc1153f5640 1 -- 172.21.15.88:0/1991032866 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1100679d0 con 0x7fc0fc003980 2023-12-08T08:20:17.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.818+0000 7fc107fff640 1 -- 172.21.15.88:0/1991032866 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc1000aacb0 con 0x7fc0fc003980 2023-12-08T08:20:17.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.822+0000 7fc107fff640 1 --2- 172.21.15.88:0/1991032866 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc0f0066470 0x7fc0f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.822+0000 7fc107fff640 1 -- 172.21.15.88:0/1991032866 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc1000a6040 con 0x7fc0fc003980 2023-12-08T08:20:17.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.822+0000 7fc1067fc640 1 --2- 172.21.15.88:0/1991032866 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc0f0066470 0x7fc0f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.822+0000 7fc1067fc640 1 --2- 172.21.15.88:0/1991032866 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc0f0066470 0x7fc0f0068930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80013e0 tx=0x7fc0f80017c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:17.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.826+0000 7fc107fff640 1 -- 172.21.15.88:0/1991032866 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc1000eb0d0 con 0x7fc0fc003980 2023-12-08T08:20:17.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.974+0000 7fc1153f5640 1 -- 172.21.15.88:0/1991032866 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc11004e8c0 con 0x7fc0fc003980 2023-12-08T08:20:17.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.974+0000 7fc107fff640 1 -- 172.21.15.88:0/1991032866 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc10000f040 con 0x7fc0fc003980 2023-12-08T08:20:17.978 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:20:17.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.974+0000 7fc1153f5640 1 -- 172.21.15.88:0/1991032866 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc0f0066470 msgr2=0x7fc0f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.974+0000 7fc1153f5640 1 --2- 172.21.15.88:0/1991032866 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc0f0066470 0x7fc0f0068930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80013e0 tx=0x7fc0f80017c0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.974+0000 7fc1153f5640 1 -- 172.21.15.88:0/1991032866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0fc003980 msgr2=0x7fc110148c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.974+0000 7fc1153f5640 1 --2- 172.21.15.88:0/1991032866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0fc003980 0x7fc110148c80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc1000ac040 tx=0x7fc0fc005800 comp rx=0 tx=0).stop 2023-12-08T08:20:17.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.974+0000 7fc1153f5640 1 -- 172.21.15.88:0/1991032866 shutdown_connections 2023-12-08T08:20:17.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.974+0000 7fc1153f5640 1 --2- 172.21.15.88:0/1991032866 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc0f0066470 0x7fc0f0068930 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.974+0000 7fc1153f5640 1 --2- 172.21.15.88:0/1991032866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc110152780 0x7fc1101ed060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.974+0000 7fc1153f5640 1 --2- 172.21.15.88:0/1991032866 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc110152300 0x7fc110145610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.974+0000 7fc1153f5640 1 --2- 172.21.15.88:0/1991032866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0fc003980 0x7fc110148c80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.974+0000 7fc1153f5640 1 -- 172.21.15.88:0/1991032866 >> 172.21.15.88:0/1991032866 conn(0x7fc1100c9dd0 msgr2=0x7fc11014e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:17.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.974+0000 7fc1153f5640 1 -- 172.21.15.88:0/1991032866 shutdown_connections 2023-12-08T08:20:17.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:17.978+0000 7fc1153f5640 1 -- 172.21.15.88:0/1991032866 wait complete. 2023-12-08T08:20:17.999 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-08T08:20:18.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.134+0000 7fd6ce2f7640 1 Processor -- start 2023-12-08T08:20:18.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.134+0000 7fd6ce2f7640 1 -- start start 2023-12-08T08:20:18.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.134+0000 7fd6ce2f7640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6c80c5e10 0x7fd6c80a6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.134+0000 7fd6ce2f7640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c8155110 con 0x7fd6c80a7420 2023-12-08T08:20:18.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.134+0000 7fd6ce2f7640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c80c2f20 con 0x7fd6c814e7e0 2023-12-08T08:20:18.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.134+0000 7fd6ce2f7640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c8154520 con 0x7fd6c80c5e10 2023-12-08T08:20:18.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.134+0000 7fd6cc894640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd6c80a7420 0x7fd6c8157b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47994/0 (socket says 172.21.15.88:47994) 2023-12-08T08:20:18.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.134+0000 7fd6cc894640 1 -- 172.21.15.88:0/3823697164 learned_addr learned my addr 172.21.15.88:0/3823697164 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:18.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.134+0000 7fd6c77fe640 1 --2- 172.21.15.88:0/3823697164 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6c80c5e10 0x7fd6c80a6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.134+0000 7fd6c6ffd640 1 -- 172.21.15.88:0/3823697164 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552469318 0 0) 0x7fd6c8155110 con 0x7fd6c80a7420 2023-12-08T08:20:18.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.134+0000 7fd6c6ffd640 1 -- 172.21.15.88:0/3823697164 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6b0003530 con 0x7fd6c80a7420 2023-12-08T08:20:18.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.134+0000 7fd6c6ffd640 1 -- 172.21.15.88:0/3823697164 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1313591562 0 0) 0x7fd6b0003530 con 0x7fd6c80a7420 2023-12-08T08:20:18.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.134+0000 7fd6c6ffd640 1 -- 172.21.15.88:0/3823697164 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6c80c5e10 msgr2=0x7fd6c80a6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:18.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.134+0000 7fd6c6ffd640 1 --2- 172.21.15.88:0/3823697164 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6c80c5e10 0x7fd6c80a6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.134+0000 7fd6c6ffd640 1 -- 172.21.15.88:0/3823697164 >> v1:172.21.15.148:6789/0 conn(0x7fd6c814e7e0 legacy=0x7fd6c80c2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:18.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.134+0000 7fd6c6ffd640 1 -- 172.21.15.88:0/3823697164 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c81547e0 con 0x7fd6c80a7420 2023-12-08T08:20:18.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.134+0000 7fd6c6ffd640 1 -- 172.21.15.88:0/3823697164 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7fd6c0001a00 con 0x7fd6c80a7420 2023-12-08T08:20:18.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.134+0000 7fd6c6ffd640 1 -- 172.21.15.88:0/3823697164 >> v1:172.21.15.88:6789/0 conn(0x7fd6c80a7420 legacy=0x7fd6c8157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:18.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.134+0000 7fd6c6ffd640 1 --2- 172.21.15.88:0/3823697164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6b00039b0 0x7fd6b0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.134+0000 7fd6c6ffd640 1 --2- 172.21.15.88:0/3823697164 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6c80c5e10 0x7fd6b00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.134+0000 7fd6c6ffd640 1 --2- 172.21.15.88:0/3823697164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6b0004d10 0x7fd6b0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.134+0000 7fd6c6ffd640 1 -- 172.21.15.88:0/3823697164 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c8154520 con 0x7fd6b00039b0 2023-12-08T08:20:18.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.134+0000 7fd6c6ffd640 1 -- 172.21.15.88:0/3823697164 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b000bb50 con 0x7fd6b0004d10 2023-12-08T08:20:18.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.134+0000 7fd6c6ffd640 1 -- 172.21.15.88:0/3823697164 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b000bd10 con 0x7fd6c80c5e10 2023-12-08T08:20:18.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.134+0000 7fd6c7fff640 1 --2- 172.21.15.88:0/3823697164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6b00039b0 0x7fd6b0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.138+0000 7fd6c77fe640 1 --2- 172.21.15.88:0/3823697164 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6c80c5e10 0x7fd6b00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.138+0000 7fd6cc894640 1 --2- 172.21.15.88:0/3823697164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6b0004d10 0x7fd6b0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.138+0000 7fd6c7fff640 1 -- 172.21.15.88:0/3823697164 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6c80c5e10 msgr2=0x7fd6b00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:18.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.138+0000 7fd6c7fff640 1 --2- 172.21.15.88:0/3823697164 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6c80c5e10 0x7fd6b00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.138+0000 7fd6c7fff640 1 -- 172.21.15.88:0/3823697164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6b0004d10 msgr2=0x7fd6b0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:18.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.138+0000 7fd6c7fff640 1 --2- 172.21.15.88:0/3823697164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6b0004d10 0x7fd6b0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.138+0000 7fd6c7fff640 1 -- 172.21.15.88:0/3823697164 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b0003530 con 0x7fd6b00039b0 2023-12-08T08:20:18.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.138+0000 7fd6cc894640 1 --2- 172.21.15.88:0/3823697164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6b0004d10 0x7fd6b0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:18.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.138+0000 7fd6c7fff640 1 --2- 172.21.15.88:0/3823697164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6b00039b0 0x7fd6b0003dd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8001780 tx=0x7fd6b801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cea1fd369f83603 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:18.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.138+0000 7fd6c6ffd640 1 -- 172.21.15.88:0/3823697164 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b80052d0 con 0x7fd6b00039b0 2023-12-08T08:20:18.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.138+0000 7fd6c6ffd640 1 -- 172.21.15.88:0/3823697164 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b80a7050 con 0x7fd6b00039b0 2023-12-08T08:20:18.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.138+0000 7fd6c6ffd640 1 -- 172.21.15.88:0/3823697164 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8003600 con 0x7fd6b00039b0 2023-12-08T08:20:18.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.138+0000 7fd6ce2f7640 1 -- 172.21.15.88:0/3823697164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6b00039b0 msgr2=0x7fd6b0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:18.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.138+0000 7fd6ce2f7640 1 --2- 172.21.15.88:0/3823697164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6b00039b0 0x7fd6b0003dd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8001780 tx=0x7fd6b801c3d0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.138+0000 7fd6cc894640 1 -- 172.21.15.88:0/3823697164 reap_dead start 2023-12-08T08:20:18.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.142+0000 7fd6ce2f7640 1 -- 172.21.15.88:0/3823697164 shutdown_connections 2023-12-08T08:20:18.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.142+0000 7fd6ce2f7640 1 -- 172.21.15.88:0/3823697164 >> 172.21.15.88:0/3823697164 conn(0x7fd6c80c7c60 msgr2=0x7fd6c80c8070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:18.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.142+0000 7fd6ce2f7640 1 -- 172.21.15.88:0/3823697164 shutdown_connections 2023-12-08T08:20:18.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.142+0000 7fd6ce2f7640 1 -- 172.21.15.88:0/3823697164 wait complete. 2023-12-08T08:20:18.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.142+0000 7fd6ce2f7640 1 Processor -- start 2023-12-08T08:20:18.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.142+0000 7fd6ce2f7640 1 -- start start 2023-12-08T08:20:18.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.142+0000 7fd6ce2f7640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6b00039b0 0x7fd6c815e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.142+0000 7fd6ce2f7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6c8153610 0x7fd6c8155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.142+0000 7fd6ce2f7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6c8155e50 0x7fd6c806b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.142+0000 7fd6ce2f7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c81f1c80 con 0x7fd6c8153610 2023-12-08T08:20:18.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.142+0000 7fd6ce2f7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c815f110 con 0x7fd6c8155e50 2023-12-08T08:20:18.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.142+0000 7fd6ce2f7640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c8145550 con 0x7fd6b00039b0 2023-12-08T08:20:18.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.142+0000 7fd6c77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6c8153610 0x7fd6c8155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.142+0000 7fd6c77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6c8153610 0x7fd6c8155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59642/0 (socket says 172.21.15.88:59642) 2023-12-08T08:20:18.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.142+0000 7fd6c77fe640 1 -- 172.21.15.88:0/1942584800 learned_addr learned my addr 172.21.15.88:0/1942584800 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:18.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.142+0000 7fd6c7fff640 1 --2- 172.21.15.88:0/1942584800 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6b00039b0 0x7fd6c815e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.142+0000 7fd6cc894640 1 --2- 172.21.15.88:0/1942584800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6c8155e50 0x7fd6c806b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.142+0000 7fd6c77fe640 1 -- 172.21.15.88:0/1942584800 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6b00039b0 msgr2=0x7fd6c815e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:18.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.142+0000 7fd6c77fe640 1 --2- 172.21.15.88:0/1942584800 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6b00039b0 0x7fd6c815e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.142+0000 7fd6c77fe640 1 -- 172.21.15.88:0/1942584800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6c8155e50 msgr2=0x7fd6c806b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:18.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.142+0000 7fd6c77fe640 1 --2- 172.21.15.88:0/1942584800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6c8155e50 0x7fd6c806b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.142+0000 7fd6c77fe640 1 -- 172.21.15.88:0/1942584800 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c81f0f00 con 0x7fd6c8153610 2023-12-08T08:20:18.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.142+0000 7fd6cc894640 1 --2- 172.21.15.88:0/1942584800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6c8155e50 0x7fd6c806b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:18.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.142+0000 7fd6c77fe640 1 --2- 172.21.15.88:0/1942584800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6c8153610 0x7fd6c8155910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc011960 tx=0x7fd6bc011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:18.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.146+0000 7fd6c4ff9640 1 -- 172.21.15.88:0/1942584800 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc00faf0 con 0x7fd6c8153610 2023-12-08T08:20:18.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.146+0000 7fd6c4ff9640 1 -- 172.21.15.88:0/1942584800 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6bc00fc50 con 0x7fd6c8153610 2023-12-08T08:20:18.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.146+0000 7fd6ce2f7640 1 -- 172.21.15.88:0/1942584800 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c81f11a0 con 0x7fd6c8153610 2023-12-08T08:20:18.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.146+0000 7fd6c4ff9640 1 -- 172.21.15.88:0/1942584800 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc014440 con 0x7fd6c8153610 2023-12-08T08:20:18.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.146+0000 7fd6ce2f7640 1 -- 172.21.15.88:0/1942584800 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c81f1760 con 0x7fd6c8153610 2023-12-08T08:20:18.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.146+0000 7fd6ce2f7640 1 -- 172.21.15.88:0/1942584800 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c8067630 con 0x7fd6c8153610 2023-12-08T08:20:18.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.146+0000 7fd6c4ff9640 1 -- 172.21.15.88:0/1942584800 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd6bc0145a0 con 0x7fd6c8153610 2023-12-08T08:20:18.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.146+0000 7fd6c4ff9640 1 --2- 172.21.15.88:0/1942584800 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd6b4066470 0x7fd6b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.146+0000 7fd6c4ff9640 1 -- 172.21.15.88:0/1942584800 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd6bc0842e0 con 0x7fd6c8153610 2023-12-08T08:20:18.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.146+0000 7fd6c7fff640 1 --2- 172.21.15.88:0/1942584800 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd6b4066470 0x7fd6b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.146+0000 7fd6c7fff640 1 --2- 172.21.15.88:0/1942584800 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd6b4066470 0x7fd6b4068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8001750 tx=0x7fd6b80011a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:18.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.150+0000 7fd6c4ff9640 1 -- 172.21.15.88:0/1942584800 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd6bc051aa0 con 0x7fd6c8153610 2023-12-08T08:20:18.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.302+0000 7fd6ce2f7640 1 -- 172.21.15.88:0/1942584800 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd6c80c5390 con 0x7fd6c8153610 2023-12-08T08:20:18.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.302+0000 7fd6c4ff9640 1 -- 172.21.15.88:0/1942584800 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd6bc0550c0 con 0x7fd6c8153610 2023-12-08T08:20:18.307 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:18.307 INFO:teuthology.orchestra.run.smithi088.stdout:[ 2023-12-08T08:20:18.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:20:18.307 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 1, 2023-12-08T08:20:18.307 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": ".mgr" 2023-12-08T08:20:18.307 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:20:18.307 INFO:teuthology.orchestra.run.smithi088.stdout:] 2023-12-08T08:20:18.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.302+0000 7fd6ce2f7640 1 -- 172.21.15.88:0/1942584800 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd6b4066470 msgr2=0x7fd6b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:18.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.302+0000 7fd6ce2f7640 1 --2- 172.21.15.88:0/1942584800 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd6b4066470 0x7fd6b4068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8001750 tx=0x7fd6b80011a0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.302+0000 7fd6ce2f7640 1 -- 172.21.15.88:0/1942584800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6c8153610 msgr2=0x7fd6c8155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:18.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.302+0000 7fd6ce2f7640 1 --2- 172.21.15.88:0/1942584800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6c8153610 0x7fd6c8155910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc011960 tx=0x7fd6bc011e20 comp rx=0 tx=0).stop 2023-12-08T08:20:18.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.302+0000 7fd6ce2f7640 1 -- 172.21.15.88:0/1942584800 shutdown_connections 2023-12-08T08:20:18.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.302+0000 7fd6ce2f7640 1 --2- 172.21.15.88:0/1942584800 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd6b4066470 0x7fd6b4068930 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.302+0000 7fd6ce2f7640 1 --2- 172.21.15.88:0/1942584800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6c8155e50 0x7fd6c806b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.302+0000 7fd6ce2f7640 1 --2- 172.21.15.88:0/1942584800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6c8153610 0x7fd6c8155910 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.302+0000 7fd6ce2f7640 1 --2- 172.21.15.88:0/1942584800 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6b00039b0 0x7fd6c815e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.302+0000 7fd6ce2f7640 1 -- 172.21.15.88:0/1942584800 >> 172.21.15.88:0/1942584800 conn(0x7fd6c80c7c60 msgr2=0x7fd6c8159680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:18.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.302+0000 7fd6ce2f7640 1 -- 172.21.15.88:0/1942584800 shutdown_connections 2023-12-08T08:20:18.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.302+0000 7fd6ce2f7640 1 -- 172.21.15.88:0/1942584800 wait complete. 2023-12-08T08:20:18.327 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-08T08:20:18.327 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-08T08:20:18.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.462+0000 7f0235a68640 1 Processor -- start 2023-12-08T08:20:18.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.462+0000 7f0235a68640 1 -- start start 2023-12-08T08:20:18.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.466+0000 7f0235a68640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f023014b1e0 0x7f02300c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.466+0000 7f0235a68640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f02300c5300 0x7f02300a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.466+0000 7f0235a68640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02300a4e20 con 0x7f0230151280 2023-12-08T08:20:18.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.466+0000 7f0235a68640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02301558d0 con 0x7f023014b1e0 2023-12-08T08:20:18.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.466+0000 7f0235a68640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02300a50e0 con 0x7f02300c5300 2023-12-08T08:20:18.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.466+0000 7f022f7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f023014b1e0 0x7f02300c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.466+0000 7f022f7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f023014b1e0 0x7f02300c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59656/0 (socket says 172.21.15.88:59656) 2023-12-08T08:20:18.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.466+0000 7f022ffff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0230151280 0x7f02301516f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47998/0 (socket says 172.21.15.88:47998) 2023-12-08T08:20:18.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.466+0000 7f022f7fe640 1 -- 172.21.15.88:0/454678497 learned_addr learned my addr 172.21.15.88:0/454678497 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:18.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.466+0000 7f022effd640 1 --2- 172.21.15.88:0/454678497 >> v2:172.21.15.148:3300/0 conn(0x7f02300c5300 0x7f02300a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.466+0000 7f022f7fe640 1 -- 172.21.15.88:0/454678497 >> v2:172.21.15.148:3300/0 conn(0x7f02300c5300 msgr2=0x7f02300a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:18.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.466+0000 7f022f7fe640 1 --2- 172.21.15.88:0/454678497 >> v2:172.21.15.148:3300/0 conn(0x7f02300c5300 0x7f02300a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.466+0000 7f022f7fe640 1 -- 172.21.15.88:0/454678497 >> v1:172.21.15.88:6789/0 conn(0x7f0230151280 legacy=0x7f02301516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:18.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.466+0000 7f022f7fe640 1 -- 172.21.15.88:0/454678497 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02300c0f00 con 0x7f023014b1e0 2023-12-08T08:20:18.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.466+0000 7f022e7fc640 1 -- 172.21.15.88:0/454678497 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1785927481 0 0) 0x7f02300a4e20 con 0x7f0230151280 2023-12-08T08:20:18.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.470+0000 7f022f7fe640 1 --2- 172.21.15.88:0/454678497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f023014b1e0 0x7f02300c1700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f02300a9650 tx=0x7f022001ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7fed7ed3845b40 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:18.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.470+0000 7f022e7fc640 1 -- 172.21.15.88:0/454678497 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02200a79a0 con 0x7f023014b1e0 2023-12-08T08:20:18.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.470+0000 7f022e7fc640 1 -- 172.21.15.88:0/454678497 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02200a7b00 con 0x7f023014b1e0 2023-12-08T08:20:18.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.470+0000 7f022e7fc640 1 -- 172.21.15.88:0/454678497 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02200a7e90 con 0x7f023014b1e0 2023-12-08T08:20:18.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.470+0000 7f0235a68640 1 -- 172.21.15.88:0/454678497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f023014b1e0 msgr2=0x7f02300c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:18.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.470+0000 7f0235a68640 1 --2- 172.21.15.88:0/454678497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f023014b1e0 0x7f02300c1700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f02300a9650 tx=0x7f022001ebd0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.470+0000 7f0235a68640 1 -- 172.21.15.88:0/454678497 shutdown_connections 2023-12-08T08:20:18.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.470+0000 7f0235a68640 1 --2- 172.21.15.88:0/454678497 >> v2:172.21.15.148:3300/0 conn(0x7f02300c5300 0x7f02300a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.470+0000 7f0235a68640 1 --2- 172.21.15.88:0/454678497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f023014b1e0 0x7f02300c1700 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.470+0000 7f0235a68640 1 -- 172.21.15.88:0/454678497 >> 172.21.15.88:0/454678497 conn(0x7f02300c59f0 msgr2=0x7f02300c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:18.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.470+0000 7f0235a68640 1 -- 172.21.15.88:0/454678497 shutdown_connections 2023-12-08T08:20:18.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.470+0000 7f0235a68640 1 -- 172.21.15.88:0/454678497 wait complete. 2023-12-08T08:20:18.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.470+0000 7f0235a68640 1 Processor -- start 2023-12-08T08:20:18.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.470+0000 7f0235a68640 1 -- start start 2023-12-08T08:20:18.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.474+0000 7f0235a68640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02300c5300 0x7f0230147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.474+0000 7f0235a68640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f023014b1e0 0x7f02301ec1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.474+0000 7f0235a68640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0230151280 0x7f02300a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.474+0000 7f0235a68640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02301ec700 con 0x7f02300c5300 2023-12-08T08:20:18.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.474+0000 7f0235a68640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02301e8c50 con 0x7f0230151280 2023-12-08T08:20:18.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.474+0000 7f0235a68640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02301ec930 con 0x7f023014b1e0 2023-12-08T08:20:18.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.474+0000 7f022f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02300c5300 0x7f0230147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.474+0000 7f022f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02300c5300 0x7f0230147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59668/0 (socket says 172.21.15.88:59668) 2023-12-08T08:20:18.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.474+0000 7f022f7fe640 1 -- 172.21.15.88:0/2000598338 learned_addr learned my addr 172.21.15.88:0/2000598338 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:18.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.474+0000 7f022effd640 1 --2- 172.21.15.88:0/2000598338 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f023014b1e0 0x7f02301ec1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.474+0000 7f022ffff640 1 --2- 172.21.15.88:0/2000598338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0230151280 0x7f02300a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.474+0000 7f022f7fe640 1 -- 172.21.15.88:0/2000598338 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f023014b1e0 msgr2=0x7f02301ec1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:18.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.474+0000 7f022f7fe640 1 --2- 172.21.15.88:0/2000598338 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f023014b1e0 0x7f02301ec1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.474+0000 7f022f7fe640 1 -- 172.21.15.88:0/2000598338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0230151280 msgr2=0x7f02300a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:18.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.474+0000 7f022f7fe640 1 --2- 172.21.15.88:0/2000598338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0230151280 0x7f02300a6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.474+0000 7f022f7fe640 1 -- 172.21.15.88:0/2000598338 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022000b770 con 0x7f02300c5300 2023-12-08T08:20:18.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.474+0000 7f022f7fe640 1 --2- 172.21.15.88:0/2000598338 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02300c5300 0x7f0230147980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f022001b7e0 tx=0x7f022001b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:18.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.474+0000 7f0217fff640 1 -- 172.21.15.88:0/2000598338 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02200afdf0 con 0x7f02300c5300 2023-12-08T08:20:18.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.474+0000 7f0217fff640 1 -- 172.21.15.88:0/2000598338 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0220004020 con 0x7f02300c5300 2023-12-08T08:20:18.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.474+0000 7f0235a68640 1 -- 172.21.15.88:0/2000598338 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02301ecc10 con 0x7f02300c5300 2023-12-08T08:20:18.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.474+0000 7f0217fff640 1 -- 172.21.15.88:0/2000598338 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220004390 con 0x7f02300c5300 2023-12-08T08:20:18.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.474+0000 7f0235a68640 1 -- 172.21.15.88:0/2000598338 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02301e8f10 con 0x7f02300c5300 2023-12-08T08:20:18.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.474+0000 7f0235a68640 1 -- 172.21.15.88:0/2000598338 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02301e9100 con 0x7f02300c5300 2023-12-08T08:20:18.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.474+0000 7f0217fff640 1 -- 172.21.15.88:0/2000598338 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f02200b6050 con 0x7f02300c5300 2023-12-08T08:20:18.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.478+0000 7f0217fff640 1 --2- 172.21.15.88:0/2000598338 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f021c066470 0x7f021c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.478+0000 7f0217fff640 1 -- 172.21.15.88:0/2000598338 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0220120230 con 0x7f02300c5300 2023-12-08T08:20:18.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.478+0000 7f022effd640 1 --2- 172.21.15.88:0/2000598338 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f021c066470 0x7f021c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.478+0000 7f022effd640 1 --2- 172.21.15.88:0/2000598338 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f021c066470 0x7f021c068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f02300c5740 tx=0x7f0224009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:18.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.482+0000 7f0217fff640 1 -- 172.21.15.88:0/2000598338 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f02200edbd0 con 0x7f02300c5300 2023-12-08T08:20:18.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:18.630+0000 7f0235a68640 1 -- 172.21.15.88:0/2000598338 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f02300c35a0 con 0x7f02300c5300 2023-12-08T08:20:19.006 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:20:19.010 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:20:19.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.082+0000 7f0217fff640 1 -- 172.21.15.88:0/2000598338 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f02200b40b0 con 0x7f02300c5300 2023-12-08T08:20:19.086 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' created 2023-12-08T08:20:19.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.082+0000 7f0235a68640 1 -- 172.21.15.88:0/2000598338 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f021c066470 msgr2=0x7f021c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:19.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.082+0000 7f0235a68640 1 --2- 172.21.15.88:0/2000598338 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f021c066470 0x7f021c068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f02300c5740 tx=0x7f0224009190 comp rx=0 tx=0).stop 2023-12-08T08:20:19.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.082+0000 7f0235a68640 1 -- 172.21.15.88:0/2000598338 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02300c5300 msgr2=0x7f0230147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:19.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.082+0000 7f0235a68640 1 --2- 172.21.15.88:0/2000598338 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02300c5300 0x7f0230147980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f022001b7e0 tx=0x7f022001b970 comp rx=0 tx=0).stop 2023-12-08T08:20:19.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.082+0000 7f0235a68640 1 -- 172.21.15.88:0/2000598338 shutdown_connections 2023-12-08T08:20:19.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.082+0000 7f0235a68640 1 --2- 172.21.15.88:0/2000598338 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f021c066470 0x7f021c068930 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:19.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.082+0000 7f0235a68640 1 --2- 172.21.15.88:0/2000598338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0230151280 0x7f02300a6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:19.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.082+0000 7f0235a68640 1 --2- 172.21.15.88:0/2000598338 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f023014b1e0 0x7f02301ec1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:19.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.082+0000 7f0235a68640 1 --2- 172.21.15.88:0/2000598338 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02300c5300 0x7f0230147980 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:19.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.082+0000 7f0235a68640 1 -- 172.21.15.88:0/2000598338 >> 172.21.15.88:0/2000598338 conn(0x7f02300c59f0 msgr2=0x7f0230149a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:19.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.086+0000 7f0235a68640 1 -- 172.21.15.88:0/2000598338 shutdown_connections 2023-12-08T08:20:19.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.086+0000 7f0235a68640 1 -- 172.21.15.88:0/2000598338 wait complete. 2023-12-08T08:20:19.114 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-08T08:20:19.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.294+0000 7fbffb59e640 1 Processor -- start 2023-12-08T08:20:19.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.294+0000 7fbffb59e640 1 -- start start 2023-12-08T08:20:19.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.298+0000 7fbffb59e640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbffc14e700 0x7fbffc0c1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:19.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.298+0000 7fbffb59e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbffc0c18a0 0x7fbffc1517c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:19.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.298+0000 7fbffb59e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbffc1547a0 0x7fbffc151d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:19.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.298+0000 7fbffb59e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbffc151330 con 0x7fbffc0c18a0 2023-12-08T08:20:19.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.298+0000 7fbffb59e640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbffc154d10 con 0x7fbffc14e700 2023-12-08T08:20:19.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.298+0000 7fbffb59e640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc154ff0 con 0x7fbffc1547a0 2023-12-08T08:20:19.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.298+0000 7fbff1d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbffc0c18a0 0x7fbffc1517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:19.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.298+0000 7fbff1d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbffc0c18a0 0x7fbffc1517c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59674/0 (socket says 172.21.15.88:59674) 2023-12-08T08:20:19.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.298+0000 7fbff1d9b640 1 -- 172.21.15.88:0/878603998 learned_addr learned my addr 172.21.15.88:0/878603998 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:19.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.298+0000 7fbffad9d640 1 --2- 172.21.15.88:0/878603998 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbffc1547a0 0x7fbffc151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:19.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.298+0000 7fbffa59c640 1 --2- 172.21.15.88:0/878603998 >> v2:172.21.15.148:3300/0 conn(0x7fbffc14e700 0x7fbffc0c1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:19.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.298+0000 7fbff1d9b640 1 -- 172.21.15.88:0/878603998 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbffc1547a0 msgr2=0x7fbffc151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:19.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.298+0000 7fbff1d9b640 1 --2- 172.21.15.88:0/878603998 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbffc1547a0 0x7fbffc151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:19.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.298+0000 7fbff1d9b640 1 -- 172.21.15.88:0/878603998 >> v2:172.21.15.148:3300/0 conn(0x7fbffc14e700 msgr2=0x7fbffc0c1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:19.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.298+0000 7fbff1d9b640 1 --2- 172.21.15.88:0/878603998 >> v2:172.21.15.148:3300/0 conn(0x7fbffc14e700 0x7fbffc0c1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:19.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.298+0000 7fbff1d9b640 1 -- 172.21.15.88:0/878603998 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbffc1552d0 con 0x7fbffc0c18a0 2023-12-08T08:20:19.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.298+0000 7fbff1d9b640 1 --2- 172.21.15.88:0/878603998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbffc0c18a0 0x7fbffc1517c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbffc06ddb0 tx=0x7fbfec01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17527a87f2c178c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:19.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.298+0000 7fbff9d9b640 1 -- 172.21.15.88:0/878603998 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0ac640 con 0x7fbffc0c18a0 2023-12-08T08:20:19.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.302+0000 7fbff9d9b640 1 -- 172.21.15.88:0/878603998 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfec0ac7a0 con 0x7fbffc0c18a0 2023-12-08T08:20:19.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.302+0000 7fbff9d9b640 1 -- 172.21.15.88:0/878603998 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0acb30 con 0x7fbffc0c18a0 2023-12-08T08:20:19.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.302+0000 7fbffb59e640 1 -- 172.21.15.88:0/878603998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbffc0c18a0 msgr2=0x7fbffc1517c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:19.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.302+0000 7fbffb59e640 1 --2- 172.21.15.88:0/878603998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbffc0c18a0 0x7fbffc1517c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbffc06ddb0 tx=0x7fbfec01c440 comp rx=0 tx=0).stop 2023-12-08T08:20:19.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.302+0000 7fbffb59e640 1 -- 172.21.15.88:0/878603998 shutdown_connections 2023-12-08T08:20:19.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.302+0000 7fbffb59e640 1 --2- 172.21.15.88:0/878603998 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbffc1547a0 0x7fbffc151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:19.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.302+0000 7fbffb59e640 1 --2- 172.21.15.88:0/878603998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbffc0c18a0 0x7fbffc1517c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:19.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.302+0000 7fbffb59e640 1 --2- 172.21.15.88:0/878603998 >> v2:172.21.15.148:3300/0 conn(0x7fbffc14e700 0x7fbffc0c1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:19.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.302+0000 7fbffb59e640 1 -- 172.21.15.88:0/878603998 >> 172.21.15.88:0/878603998 conn(0x7fbffc06b0d0 msgr2=0x7fbffc0a7600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:19.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.302+0000 7fbffb59e640 1 -- 172.21.15.88:0/878603998 shutdown_connections 2023-12-08T08:20:19.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.302+0000 7fbffb59e640 1 -- 172.21.15.88:0/878603998 wait complete. 2023-12-08T08:20:19.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.302+0000 7fbffb59e640 1 Processor -- start 2023-12-08T08:20:19.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.302+0000 7fbffb59e640 1 -- start start 2023-12-08T08:20:19.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.302+0000 7fbffb59e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbffc0c18a0 0x7fbffc153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:19.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.302+0000 7fbffb59e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbffc14e700 0x7fbffc143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:19.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.302+0000 7fbffb59e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbffc1547a0 0x7fbffc1440e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:19.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.302+0000 7fbffb59e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc15add0 con 0x7fbffc0c18a0 2023-12-08T08:20:19.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.302+0000 7fbffb59e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc147e40 con 0x7fbffc14e700 2023-12-08T08:20:19.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.302+0000 7fbffb59e640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc148120 con 0x7fbffc1547a0 2023-12-08T08:20:19.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.302+0000 7fbffa59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbffc0c18a0 0x7fbffc153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:19.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.302+0000 7fbffa59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbffc0c18a0 0x7fbffc153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59684/0 (socket says 172.21.15.88:59684) 2023-12-08T08:20:19.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.302+0000 7fbffa59c640 1 -- 172.21.15.88:0/933255822 learned_addr learned my addr 172.21.15.88:0/933255822 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:19.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.306+0000 7fbff1d9b640 1 --2- 172.21.15.88:0/933255822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbffc14e700 0x7fbffc143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:19.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.306+0000 7fbffad9d640 1 --2- 172.21.15.88:0/933255822 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbffc1547a0 0x7fbffc1440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:19.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.306+0000 7fbffa59c640 1 -- 172.21.15.88:0/933255822 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbffc1547a0 msgr2=0x7fbffc1440e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:19.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.306+0000 7fbffa59c640 1 --2- 172.21.15.88:0/933255822 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbffc1547a0 0x7fbffc1440e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:19.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.306+0000 7fbffa59c640 1 -- 172.21.15.88:0/933255822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbffc14e700 msgr2=0x7fbffc143ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:19.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.306+0000 7fbffa59c640 1 --2- 172.21.15.88:0/933255822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbffc14e700 0x7fbffc143ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:19.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.306+0000 7fbffa59c640 1 -- 172.21.15.88:0/933255822 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfec0094d0 con 0x7fbffc0c18a0 2023-12-08T08:20:19.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.306+0000 7fbffa59c640 1 --2- 172.21.15.88:0/933255822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbffc0c18a0 0x7fbffc153cd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbfe400d800 tx=0x7fbfe400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:19.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.306+0000 7fbff37fe640 1 -- 172.21.15.88:0/933255822 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe40096a0 con 0x7fbffc0c18a0 2023-12-08T08:20:19.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.306+0000 7fbff37fe640 1 -- 172.21.15.88:0/933255822 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe4009800 con 0x7fbffc0c18a0 2023-12-08T08:20:19.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.306+0000 7fbffb59e640 1 -- 172.21.15.88:0/933255822 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbffc148400 con 0x7fbffc0c18a0 2023-12-08T08:20:19.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.306+0000 7fbff37fe640 1 -- 172.21.15.88:0/933255822 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4009b70 con 0x7fbffc0c18a0 2023-12-08T08:20:19.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.306+0000 7fbffb59e640 1 -- 172.21.15.88:0/933255822 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbffc154210 con 0x7fbffc0c18a0 2023-12-08T08:20:19.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.306+0000 7fbffb59e640 1 -- 172.21.15.88:0/933255822 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbffc0674b0 con 0x7fbffc0c18a0 2023-12-08T08:20:19.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.306+0000 7fbff37fe640 1 -- 172.21.15.88:0/933255822 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbfe4009cd0 con 0x7fbffc0c18a0 2023-12-08T08:20:19.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.306+0000 7fbff37fe640 1 --2- 172.21.15.88:0/933255822 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbfdc0664a0 0x7fbfdc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:19.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.310+0000 7fbff37fe640 1 -- 172.21.15.88:0/933255822 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fbfe4084380 con 0x7fbffc0c18a0 2023-12-08T08:20:19.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.310+0000 7fbff1d9b640 1 --2- 172.21.15.88:0/933255822 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbfdc0664a0 0x7fbfdc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:19.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.310+0000 7fbff1d9b640 1 --2- 172.21.15.88:0/933255822 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbfdc0664a0 0x7fbfdc068960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbfec0ae000 tx=0x7fbfec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:19.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.314+0000 7fbff37fe640 1 -- 172.21.15.88:0/933255822 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbfe40519f0 con 0x7fbffc0c18a0 2023-12-08T08:20:19.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:19.462+0000 7fbffb59e640 1 -- 172.21.15.88:0/933255822 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fbffc0c3be0 con 0x7fbffc0c18a0 2023-12-08T08:20:20.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.086+0000 7fbff37fe640 1 -- 172.21.15.88:0/933255822 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7fbfe4055010 con 0x7fbffc0c18a0 2023-12-08T08:20:20.089 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' created 2023-12-08T08:20:20.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.086+0000 7fbffb59e640 1 -- 172.21.15.88:0/933255822 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbfdc0664a0 msgr2=0x7fbfdc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:20.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.086+0000 7fbffb59e640 1 --2- 172.21.15.88:0/933255822 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbfdc0664a0 0x7fbfdc068960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbfec0ae000 tx=0x7fbfec008040 comp rx=0 tx=0).stop 2023-12-08T08:20:20.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.086+0000 7fbffb59e640 1 -- 172.21.15.88:0/933255822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbffc0c18a0 msgr2=0x7fbffc153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:20.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.086+0000 7fbffb59e640 1 --2- 172.21.15.88:0/933255822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbffc0c18a0 0x7fbffc153cd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbfe400d800 tx=0x7fbfe400dcc0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.086+0000 7fbffb59e640 1 -- 172.21.15.88:0/933255822 shutdown_connections 2023-12-08T08:20:20.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.086+0000 7fbffb59e640 1 --2- 172.21.15.88:0/933255822 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbfdc0664a0 0x7fbfdc068960 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.086+0000 7fbffb59e640 1 --2- 172.21.15.88:0/933255822 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbffc1547a0 0x7fbffc1440e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.086+0000 7fbffb59e640 1 --2- 172.21.15.88:0/933255822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbffc14e700 0x7fbffc143ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.086+0000 7fbffb59e640 1 --2- 172.21.15.88:0/933255822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbffc0c18a0 0x7fbffc153cd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.086+0000 7fbffb59e640 1 -- 172.21.15.88:0/933255822 >> 172.21.15.88:0/933255822 conn(0x7fbffc06b0d0 msgr2=0x7fbffc0bffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:20.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.086+0000 7fbffb59e640 1 -- 172.21.15.88:0/933255822 shutdown_connections 2023-12-08T08:20:20.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.090+0000 7fbffb59e640 1 -- 172.21.15.88:0/933255822 wait complete. 2023-12-08T08:20:20.138 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-08T08:20:20.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.274+0000 7f6aefba1640 1 Processor -- start 2023-12-08T08:20:20.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.274+0000 7f6aefba1640 1 -- start start 2023-12-08T08:20:20.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.278+0000 7f6aefba1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6ae814fc30 0x7f6ae80c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:20.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.278+0000 7f6aefba1640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6ae806d840 0x7f6ae80c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:20.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.278+0000 7f6aefba1640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae8152910 con 0x7f6ae814f850 2023-12-08T08:20:20.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.278+0000 7f6aefba1640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae80c2240 con 0x7f6ae814fc30 2023-12-08T08:20:20.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.278+0000 7f6aefba1640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae8152bf0 con 0x7f6ae806d840 2023-12-08T08:20:20.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.278+0000 7f6aed13c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6ae814fc30 0x7f6ae80c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:20.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.278+0000 7f6aed13c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6ae814fc30 0x7f6ae80c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39700/0 (socket says 172.21.15.88:39700) 2023-12-08T08:20:20.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.278+0000 7f6aed13c640 1 -- 172.21.15.88:0/2933663991 learned_addr learned my addr 172.21.15.88:0/2933663991 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:20.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.278+0000 7f6aee13e640 1 --2- 172.21.15.88:0/2933663991 >> v2:172.21.15.148:3300/0 conn(0x7f6ae806d840 0x7f6ae80c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:20.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.278+0000 7f6aed13c640 1 -- 172.21.15.88:0/2933663991 >> v2:172.21.15.148:3300/0 conn(0x7f6ae806d840 msgr2=0x7f6ae80c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:20.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.278+0000 7f6aed13c640 1 --2- 172.21.15.88:0/2933663991 >> v2:172.21.15.148:3300/0 conn(0x7f6ae806d840 0x7f6ae80c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.278+0000 7f6aed13c640 1 -- 172.21.15.88:0/2933663991 >> v1:172.21.15.88:6789/0 conn(0x7f6ae814f850 legacy=0x7f6ae80aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:20.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.278+0000 7f6aec93b640 1 -- 172.21.15.88:0/2933663991 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497111802 0 0) 0x7f6ae8152910 con 0x7f6ae814f850 2023-12-08T08:20:20.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.278+0000 7f6aed13c640 1 -- 172.21.15.88:0/2933663991 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae8152ed0 con 0x7f6ae814fc30 2023-12-08T08:20:20.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.282+0000 7f6aed13c640 1 --2- 172.21.15.88:0/2933663991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ae814fc30 0x7f6ae80c3cd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6ae80c2440 tx=0x7f6ad801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df48426f84e5f9e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:20.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.282+0000 7f6aec93b640 1 -- 172.21.15.88:0/2933663991 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad80a7070 con 0x7f6ae814fc30 2023-12-08T08:20:20.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.282+0000 7f6aec93b640 1 -- 172.21.15.88:0/2933663991 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad80ab430 con 0x7f6ae814fc30 2023-12-08T08:20:20.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.282+0000 7f6aec93b640 1 -- 172.21.15.88:0/2933663991 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad80ab7c0 con 0x7f6ae814fc30 2023-12-08T08:20:20.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.282+0000 7f6aefba1640 1 -- 172.21.15.88:0/2933663991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ae814fc30 msgr2=0x7f6ae80c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:20.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.282+0000 7f6aefba1640 1 --2- 172.21.15.88:0/2933663991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ae814fc30 0x7f6ae80c3cd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6ae80c2440 tx=0x7f6ad801c500 comp rx=0 tx=0).stop 2023-12-08T08:20:20.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.282+0000 7f6aefba1640 1 -- 172.21.15.88:0/2933663991 shutdown_connections 2023-12-08T08:20:20.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.282+0000 7f6aefba1640 1 --2- 172.21.15.88:0/2933663991 >> v2:172.21.15.148:3300/0 conn(0x7f6ae806d840 0x7f6ae80c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.282+0000 7f6aefba1640 1 --2- 172.21.15.88:0/2933663991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ae814fc30 0x7f6ae80c3cd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.282+0000 7f6aefba1640 1 -- 172.21.15.88:0/2933663991 >> 172.21.15.88:0/2933663991 conn(0x7f6ae80c59f0 msgr2=0x7f6ae80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:20.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.282+0000 7f6aefba1640 1 -- 172.21.15.88:0/2933663991 shutdown_connections 2023-12-08T08:20:20.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.282+0000 7f6aefba1640 1 -- 172.21.15.88:0/2933663991 wait complete. 2023-12-08T08:20:20.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.282+0000 7f6aefba1640 1 Processor -- start 2023-12-08T08:20:20.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.282+0000 7f6aefba1640 1 -- start start 2023-12-08T08:20:20.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.286+0000 7f6aefba1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ae806d840 0x7f6ae80aaa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:20.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.286+0000 7f6aefba1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ae814f850 0x7f6ae80a6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:20.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.286+0000 7f6aefba1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ae814fc30 0x7f6ae80a8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:20.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.286+0000 7f6aefba1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae814a970 con 0x7f6ae806d840 2023-12-08T08:20:20.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.286+0000 7f6aefba1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae80a9940 con 0x7f6ae814f850 2023-12-08T08:20:20.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.286+0000 7f6aefba1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae81f19b0 con 0x7f6ae814fc30 2023-12-08T08:20:20.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.286+0000 7f6aed93d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ae806d840 0x7f6ae80aaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:20.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.286+0000 7f6aed93d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ae806d840 0x7f6ae80aaa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39702/0 (socket says 172.21.15.88:39702) 2023-12-08T08:20:20.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.286+0000 7f6aed93d640 1 -- 172.21.15.88:0/1808792842 learned_addr learned my addr 172.21.15.88:0/1808792842 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:20.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.286+0000 7f6aed13c640 1 --2- 172.21.15.88:0/1808792842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ae814f850 0x7f6ae80a6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:20.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.286+0000 7f6aed93d640 1 -- 172.21.15.88:0/1808792842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ae814fc30 msgr2=0x7f6ae80a8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:20.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.286+0000 7f6aee13e640 1 --2- 172.21.15.88:0/1808792842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ae814fc30 0x7f6ae80a8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:20.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.286+0000 7f6aed93d640 1 --2- 172.21.15.88:0/1808792842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ae814fc30 0x7f6ae80a8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.286+0000 7f6aed93d640 1 -- 172.21.15.88:0/1808792842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ae814f850 msgr2=0x7f6ae80a6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:20.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.286+0000 7f6aed93d640 1 --2- 172.21.15.88:0/1808792842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ae814f850 0x7f6ae80a6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.286+0000 7f6aed93d640 1 -- 172.21.15.88:0/1808792842 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad80094d0 con 0x7f6ae806d840 2023-12-08T08:20:20.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.286+0000 7f6aee13e640 1 --2- 172.21.15.88:0/1808792842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ae814fc30 0x7f6ae80a8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:20.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.286+0000 7f6aed93d640 1 --2- 172.21.15.88:0/1808792842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ae806d840 0x7f6ae80aaa30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400c4d0 tx=0x7f6ae400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:20.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.286+0000 7f6ade7fc640 1 -- 172.21.15.88:0/1808792842 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4005480 con 0x7f6ae806d840 2023-12-08T08:20:20.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.286+0000 7f6ade7fc640 1 -- 172.21.15.88:0/1808792842 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae4003600 con 0x7f6ae806d840 2023-12-08T08:20:20.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.286+0000 7f6ade7fc640 1 -- 172.21.15.88:0/1808792842 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae40039b0 con 0x7f6ae806d840 2023-12-08T08:20:20.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.286+0000 7f6aefba1640 1 -- 172.21.15.88:0/1808792842 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae80a63c0 con 0x7f6ae806d840 2023-12-08T08:20:20.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.286+0000 7f6aefba1640 1 -- 172.21.15.88:0/1808792842 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae80a60e0 con 0x7f6ae806d840 2023-12-08T08:20:20.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.286+0000 7f6aefba1640 1 -- 172.21.15.88:0/1808792842 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae8067630 con 0x7f6ae806d840 2023-12-08T08:20:20.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.286+0000 7f6ade7fc640 1 -- 172.21.15.88:0/1808792842 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6ae4003b10 con 0x7f6ae806d840 2023-12-08T08:20:20.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.290+0000 7f6ade7fc640 1 --2- 172.21.15.88:0/1808792842 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6acc0664a0 0x7f6acc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:20.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.290+0000 7f6ade7fc640 1 -- 172.21.15.88:0/1808792842 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f6ae4083710 con 0x7f6ae806d840 2023-12-08T08:20:20.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.290+0000 7f6aed13c640 1 --2- 172.21.15.88:0/1808792842 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6acc0664a0 0x7f6acc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:20.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.290+0000 7f6aed13c640 1 --2- 172.21.15.88:0/1808792842 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6acc0664a0 0x7f6acc068960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6ad80af000 tx=0x7f6ad80a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:20.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.290+0000 7f6ade7fc640 1 -- 172.21.15.88:0/1808792842 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6ae4050e20 con 0x7f6ae806d840 2023-12-08T08:20:20.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:20.474+0000 7f6aefba1640 1 -- 172.21.15.88:0/1808792842 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6ae8156950 con 0x7f6ae806d840 2023-12-08T08:20:21.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.106+0000 7f6ade7fc640 1 -- 172.21.15.88:0/1808792842 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6ae4081e60 con 0x7f6ae806d840 2023-12-08T08:20:21.111 INFO:teuthology.orchestra.run.smithi088.stderr:new fs with metadata pool 2 and data pool 3 2023-12-08T08:20:21.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.110+0000 7f6aefba1640 1 -- 172.21.15.88:0/1808792842 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6acc0664a0 msgr2=0x7f6acc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:21.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.110+0000 7f6aefba1640 1 --2- 172.21.15.88:0/1808792842 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6acc0664a0 0x7f6acc068960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6ad80af000 tx=0x7f6ad80a7000 comp rx=0 tx=0).stop 2023-12-08T08:20:21.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.110+0000 7f6aefba1640 1 -- 172.21.15.88:0/1808792842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ae806d840 msgr2=0x7f6ae80aaa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:21.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.110+0000 7f6aefba1640 1 --2- 172.21.15.88:0/1808792842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ae806d840 0x7f6ae80aaa30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400c4d0 tx=0x7f6ae400c990 comp rx=0 tx=0).stop 2023-12-08T08:20:21.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.110+0000 7f6aefba1640 1 -- 172.21.15.88:0/1808792842 shutdown_connections 2023-12-08T08:20:21.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.110+0000 7f6aefba1640 1 --2- 172.21.15.88:0/1808792842 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6acc0664a0 0x7f6acc068960 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.110+0000 7f6aefba1640 1 --2- 172.21.15.88:0/1808792842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6ae814fc30 0x7f6ae80a8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.110+0000 7f6aefba1640 1 --2- 172.21.15.88:0/1808792842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ae814f850 0x7f6ae80a6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.110+0000 7f6aefba1640 1 --2- 172.21.15.88:0/1808792842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ae806d840 0x7f6ae80aaa30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.110+0000 7f6aefba1640 1 -- 172.21.15.88:0/1808792842 >> 172.21.15.88:0/1808792842 conn(0x7f6ae80c59f0 msgr2=0x7f6ae806cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:21.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.110+0000 7f6aefba1640 1 -- 172.21.15.88:0/1808792842 shutdown_connections 2023-12-08T08:20:21.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.110+0000 7f6aefba1640 1 -- 172.21.15.88:0/1808792842 wait complete. 2023-12-08T08:20:21.141 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:21.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.274+0000 7f4fc87f8640 1 Processor -- start 2023-12-08T08:20:21.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.274+0000 7f4fc87f8640 1 -- start start 2023-12-08T08:20:21.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.278+0000 7f4fc87f8640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4fc00bee90 0x7f4fc00bf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:21.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.278+0000 7f4fc87f8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc0154740 0x7f4fc0154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:21.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.278+0000 7f4fc87f8640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc0157cf0 con 0x7f4fc014b2a0 2023-12-08T08:20:21.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.278+0000 7f4fc87f8640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc006c3a0 con 0x7f4fc00bee90 2023-12-08T08:20:21.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.278+0000 7f4fc87f8640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc00a55d0 con 0x7f4fc0154740 2023-12-08T08:20:21.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.278+0000 7f4fc6d95640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc0154740 0x7f4fc0154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:21.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.278+0000 7f4fc5d93640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4fc00bee90 0x7f4fc00bf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:21.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.278+0000 7f4fc6594640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f4fc014b2a0 0x7f4fc00a4ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:33818/0 (socket says 172.21.15.88:33818) 2023-12-08T08:20:21.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.278+0000 7f4fc6d95640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc0154740 0x7f4fc0154bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:55524/0 (socket says 172.21.15.88:55524) 2023-12-08T08:20:21.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.278+0000 7f4fc6594640 1 -- 172.21.15.88:0/2380605530 learned_addr learned my addr 172.21.15.88:0/2380605530 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:21.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.278+0000 7f4fc5592640 1 -- 172.21.15.88:0/2380605530 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3969821456 0 0) 0x7f4fc0157cf0 con 0x7f4fc014b2a0 2023-12-08T08:20:21.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.278+0000 7f4fc6d95640 1 -- 172.21.15.88:0/2380605530 >> v2:172.21.15.148:3300/0 conn(0x7f4fc00bee90 msgr2=0x7f4fc00bf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:21.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.278+0000 7f4fc6d95640 1 --2- 172.21.15.88:0/2380605530 >> v2:172.21.15.148:3300/0 conn(0x7f4fc00bee90 0x7f4fc00bf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.278+0000 7f4fc6d95640 1 -- 172.21.15.88:0/2380605530 >> v1:172.21.15.148:6789/0 conn(0x7f4fc014b2a0 legacy=0x7f4fc00a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:21.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.278+0000 7f4fc6d95640 1 -- 172.21.15.88:0/2380605530 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc0157fd0 con 0x7f4fc0154740 2023-12-08T08:20:21.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.278+0000 7f4fc5d93640 1 --2- 172.21.15.88:0/2380605530 >> v2:172.21.15.148:3300/0 conn(0x7f4fc00bee90 0x7f4fc00bf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:21.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.282+0000 7f4fc6d95640 1 --2- 172.21.15.88:0/2380605530 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc0154740 0x7f4fc0154bb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8009d90 tx=0x7f4fb801c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e247eca236f0914 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:21.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.282+0000 7f4fc5592640 1 -- 172.21.15.88:0/2380605530 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb80a57e0 con 0x7f4fc0154740 2023-12-08T08:20:21.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.282+0000 7f4fc5592640 1 -- 172.21.15.88:0/2380605530 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb80a5940 con 0x7f4fc0154740 2023-12-08T08:20:21.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.282+0000 7f4fc5592640 1 -- 172.21.15.88:0/2380605530 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb80a5cd0 con 0x7f4fc0154740 2023-12-08T08:20:21.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.282+0000 7f4fc87f8640 1 -- 172.21.15.88:0/2380605530 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc0154740 msgr2=0x7f4fc0154bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:21.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.282+0000 7f4fc87f8640 1 --2- 172.21.15.88:0/2380605530 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc0154740 0x7f4fc0154bb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8009d90 tx=0x7f4fb801c830 comp rx=0 tx=0).stop 2023-12-08T08:20:21.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.282+0000 7f4fc87f8640 1 -- 172.21.15.88:0/2380605530 shutdown_connections 2023-12-08T08:20:21.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.282+0000 7f4fc87f8640 1 --2- 172.21.15.88:0/2380605530 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc0154740 0x7f4fc0154bb0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.282+0000 7f4fc87f8640 1 --2- 172.21.15.88:0/2380605530 >> v2:172.21.15.148:3300/0 conn(0x7f4fc00bee90 0x7f4fc00bf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.282+0000 7f4fc87f8640 1 -- 172.21.15.88:0/2380605530 >> 172.21.15.88:0/2380605530 conn(0x7f4fc00a7810 msgr2=0x7f4fc00a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:21.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.282+0000 7f4fc87f8640 1 -- 172.21.15.88:0/2380605530 shutdown_connections 2023-12-08T08:20:21.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.282+0000 7f4fc87f8640 1 -- 172.21.15.88:0/2380605530 wait complete. 2023-12-08T08:20:21.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.282+0000 7f4fc87f8640 1 Processor -- start 2023-12-08T08:20:21.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.282+0000 7f4fc87f8640 1 -- start start 2023-12-08T08:20:21.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.286+0000 7f4fc87f8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc00bee90 0x7f4fc0153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:21.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.286+0000 7f4fc87f8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc014b2a0 0x7f4fc0157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:21.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.286+0000 7f4fc87f8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc0154740 0x7f4fc00a6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:21.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.286+0000 7f4fc87f8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc0157a70 con 0x7f4fc014b2a0 2023-12-08T08:20:21.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.286+0000 7f4fc87f8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc01f17a0 con 0x7f4fc00bee90 2023-12-08T08:20:21.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.286+0000 7f4fc87f8640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc0155c80 con 0x7f4fc0154740 2023-12-08T08:20:21.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.286+0000 7f4fc5d93640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc014b2a0 0x7f4fc0157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:21.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.286+0000 7f4fc5d93640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc014b2a0 0x7f4fc0157530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39708/0 (socket says 172.21.15.88:39708) 2023-12-08T08:20:21.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.286+0000 7f4fc5d93640 1 -- 172.21.15.88:0/4254800561 learned_addr learned my addr 172.21.15.88:0/4254800561 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:21.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.286+0000 7f4fc6594640 1 --2- 172.21.15.88:0/4254800561 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc00bee90 0x7f4fc0153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:21.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.286+0000 7f4fc6d95640 1 --2- 172.21.15.88:0/4254800561 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc0154740 0x7f4fc00a6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:21.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.286+0000 7f4fc5d93640 1 -- 172.21.15.88:0/4254800561 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc0154740 msgr2=0x7f4fc00a6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:21.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.286+0000 7f4fc5d93640 1 --2- 172.21.15.88:0/4254800561 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc0154740 0x7f4fc00a6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.286+0000 7f4fc5d93640 1 -- 172.21.15.88:0/4254800561 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc00bee90 msgr2=0x7f4fc0153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:21.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.286+0000 7f4fc5d93640 1 --2- 172.21.15.88:0/4254800561 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc00bee90 0x7f4fc0153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.286+0000 7f4fc5d93640 1 -- 172.21.15.88:0/4254800561 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb0009420 con 0x7f4fc014b2a0 2023-12-08T08:20:21.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.286+0000 7f4fc6d95640 1 --2- 172.21.15.88:0/4254800561 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc0154740 0x7f4fc00a6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:21.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.286+0000 7f4fc5d93640 1 --2- 172.21.15.88:0/4254800561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc014b2a0 0x7f4fc0157530 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4fb000e980 tx=0x7f4fb000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:21.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.286+0000 7f4fb6ffd640 1 -- 172.21.15.88:0/4254800561 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb000ca00 con 0x7f4fc014b2a0 2023-12-08T08:20:21.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.286+0000 7f4fb6ffd640 1 -- 172.21.15.88:0/4254800561 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb000cb60 con 0x7f4fc014b2a0 2023-12-08T08:20:21.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.286+0000 7f4fb6ffd640 1 -- 172.21.15.88:0/4254800561 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb0013470 con 0x7f4fc014b2a0 2023-12-08T08:20:21.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.286+0000 7f4fc87f8640 1 -- 172.21.15.88:0/4254800561 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb8009a70 con 0x7f4fc014b2a0 2023-12-08T08:20:21.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.286+0000 7f4fc87f8640 1 -- 172.21.15.88:0/4254800561 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc00c45a0 con 0x7f4fc014b2a0 2023-12-08T08:20:21.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.286+0000 7f4fc87f8640 1 -- 172.21.15.88:0/4254800561 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc0067630 con 0x7f4fc014b2a0 2023-12-08T08:20:21.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.286+0000 7f4fb6ffd640 1 -- 172.21.15.88:0/4254800561 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4fb00135d0 con 0x7f4fc014b2a0 2023-12-08T08:20:21.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.290+0000 7f4fb6ffd640 1 --2- 172.21.15.88:0/4254800561 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4fa4066470 0x7f4fa4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:21.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.290+0000 7f4fb6ffd640 1 -- 172.21.15.88:0/4254800561 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4fb0083ff0 con 0x7f4fc014b2a0 2023-12-08T08:20:21.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.290+0000 7f4fc6594640 1 --2- 172.21.15.88:0/4254800561 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4fa4066470 0x7f4fa4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:21.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.290+0000 7f4fc6594640 1 --2- 172.21.15.88:0/4254800561 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4fa4066470 0x7f4fa4068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc007bc0 tx=0x7f4fbc007b10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:21.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.294+0000 7f4fb6ffd640 1 -- 172.21.15.88:0/4254800561 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4fb0051570 con 0x7f4fc014b2a0 2023-12-08T08:20:21.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.442+0000 7f4fc87f8640 1 -- 172.21.15.88:0/4254800561 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4fc00c0010 con 0x7f4fc014b2a0 2023-12-08T08:20:21.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.446+0000 7f4fb6ffd640 1 -- 172.21.15.88:0/4254800561 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16494 (secure 0 0 0) 0x7f4fb0054b90 con 0x7f4fc014b2a0 2023-12-08T08:20:21.448 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:21.449 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":19,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:20:20.478968+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:18.675917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:19.511013+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:21.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.446+0000 7f4fc87f8640 1 -- 172.21.15.88:0/4254800561 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4fa4066470 msgr2=0x7f4fa4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:21.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.446+0000 7f4fc87f8640 1 --2- 172.21.15.88:0/4254800561 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4fa4066470 0x7f4fa4068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc007bc0 tx=0x7f4fbc007b10 comp rx=0 tx=0).stop 2023-12-08T08:20:21.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.446+0000 7f4fc87f8640 1 -- 172.21.15.88:0/4254800561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc014b2a0 msgr2=0x7f4fc0157530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:21.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.446+0000 7f4fc87f8640 1 --2- 172.21.15.88:0/4254800561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc014b2a0 0x7f4fc0157530 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4fb000e980 tx=0x7f4fb000ee40 comp rx=0 tx=0).stop 2023-12-08T08:20:21.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.446+0000 7f4fc87f8640 1 -- 172.21.15.88:0/4254800561 shutdown_connections 2023-12-08T08:20:21.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.446+0000 7f4fc87f8640 1 --2- 172.21.15.88:0/4254800561 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4fa4066470 0x7f4fa4068930 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.446+0000 7f4fc87f8640 1 --2- 172.21.15.88:0/4254800561 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc0154740 0x7f4fc00a6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.446+0000 7f4fc87f8640 1 --2- 172.21.15.88:0/4254800561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc014b2a0 0x7f4fc0157530 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.446+0000 7f4fc87f8640 1 --2- 172.21.15.88:0/4254800561 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc00bee90 0x7f4fc0153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.446+0000 7f4fc87f8640 1 -- 172.21.15.88:0/4254800561 >> 172.21.15.88:0/4254800561 conn(0x7f4fc00a7810 msgr2=0x7f4fc0141cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:21.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.446+0000 7f4fc87f8640 1 -- 172.21.15.88:0/4254800561 shutdown_connections 2023-12-08T08:20:21.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.446+0000 7f4fc87f8640 1 -- 172.21.15.88:0/4254800561 wait complete. 2023-12-08T08:20:21.469 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:21.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.602+0000 7f2c33694640 1 Processor -- start 2023-12-08T08:20:21.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.602+0000 7f2c33694640 1 -- start start 2023-12-08T08:20:21.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.606+0000 7f2c33694640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2c2c14b2a0 0x7f2c2c0a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:21.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.606+0000 7f2c33694640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2c157cf0 con 0x7f2c2c0bee90 2023-12-08T08:20:21.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.606+0000 7f2c33694640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2c157fd0 con 0x7f2c2c0bf310 2023-12-08T08:20:21.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.606+0000 7f2c33694640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c2c06c3a0 con 0x7f2c2c14b2a0 2023-12-08T08:20:21.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.606+0000 7f2c31430640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2c2c14b2a0 0x7f2c2c0a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:21.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.606+0000 7f2c31430640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2c2c14b2a0 0x7f2c2c0a4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39714/0 (socket says 172.21.15.88:39714) 2023-12-08T08:20:21.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.606+0000 7f2c30c2f640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2c2c0bee90 0x7f2c2c154740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60978/0 (socket says 172.21.15.88:60978) 2023-12-08T08:20:21.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.606+0000 7f2c31430640 1 -- 172.21.15.88:0/1905019467 learned_addr learned my addr 172.21.15.88:0/1905019467 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:21.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.606+0000 7f2c31430640 1 -- 172.21.15.88:0/1905019467 >> v1:172.21.15.148:6789/0 conn(0x7f2c2c0bf310 legacy=0x7f2c2c154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:21.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.606+0000 7f2c31430640 1 -- 172.21.15.88:0/1905019467 >> v1:172.21.15.88:6789/0 conn(0x7f2c2c0bee90 legacy=0x7f2c2c154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:21.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.606+0000 7f2c31430640 1 -- 172.21.15.88:0/1905019467 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2c1582b0 con 0x7f2c2c14b2a0 2023-12-08T08:20:21.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.606+0000 7f2c23fff640 1 -- 172.21.15.88:0/1905019467 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 975747823 0 0) 0x7f2c2c157cf0 con 0x7f2c2c0bee90 2023-12-08T08:20:21.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.610+0000 7f2c31430640 1 --2- 172.21.15.88:0/1905019467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c2c14b2a0 0x7f2c2c0a4ec0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009870 tx=0x7f2c2801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5cdf9dcf489685 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:21.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.610+0000 7f2c23fff640 1 -- 172.21.15.88:0/1905019467 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c280ab600 con 0x7f2c2c14b2a0 2023-12-08T08:20:21.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.610+0000 7f2c23fff640 1 -- 172.21.15.88:0/1905019467 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c280a7050 con 0x7f2c2c14b2a0 2023-12-08T08:20:21.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.610+0000 7f2c23fff640 1 -- 172.21.15.88:0/1905019467 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c280ab980 con 0x7f2c2c14b2a0 2023-12-08T08:20:21.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.610+0000 7f2c33694640 1 -- 172.21.15.88:0/1905019467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c2c14b2a0 msgr2=0x7f2c2c0a4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:21.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.610+0000 7f2c33694640 1 --2- 172.21.15.88:0/1905019467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c2c14b2a0 0x7f2c2c0a4ec0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009870 tx=0x7f2c2801c3e0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.610+0000 7f2c33694640 1 -- 172.21.15.88:0/1905019467 shutdown_connections 2023-12-08T08:20:21.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.610+0000 7f2c33694640 1 --2- 172.21.15.88:0/1905019467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c2c14b2a0 0x7f2c2c0a4ec0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.610+0000 7f2c33694640 1 -- 172.21.15.88:0/1905019467 >> 172.21.15.88:0/1905019467 conn(0x7f2c2c0a7810 msgr2=0x7f2c2c0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:21.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.610+0000 7f2c33694640 1 -- 172.21.15.88:0/1905019467 shutdown_connections 2023-12-08T08:20:21.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.610+0000 7f2c33694640 1 -- 172.21.15.88:0/1905019467 wait complete. 2023-12-08T08:20:21.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.610+0000 7f2c33694640 1 Processor -- start 2023-12-08T08:20:21.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.610+0000 7f2c33694640 1 -- start start 2023-12-08T08:20:21.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.614+0000 7f2c33694640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c2c0bee90 0x7f2c2c0a3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:21.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.614+0000 7f2c33694640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c2c0bf310 0x7f2c2c153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.614+0000 7f2c33694640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c2c14b2a0 0x7f2c2c153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.614+0000 7f2c33694640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c1524b0 con 0x7f2c2c0bf310 2023-12-08T08:20:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.614+0000 7f2c33694640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c1559c0 con 0x7f2c2c14b2a0 2023-12-08T08:20:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.614+0000 7f2c33694640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c137960 con 0x7f2c2c0bee90 2023-12-08T08:20:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.614+0000 7f2c30c2f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c2c0bf310 0x7f2c2c153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.614+0000 7f2c30c2f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c2c0bf310 0x7f2c2c153a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39722/0 (socket says 172.21.15.88:39722) 2023-12-08T08:20:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.614+0000 7f2c30c2f640 1 -- 172.21.15.88:0/1276232895 learned_addr learned my addr 172.21.15.88:0/1276232895 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.614+0000 7f2c31430640 1 --2- 172.21.15.88:0/1276232895 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c2c0bee90 0x7f2c2c0a3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.614+0000 7f2c31c31640 1 --2- 172.21.15.88:0/1276232895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c2c14b2a0 0x7f2c2c153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.614+0000 7f2c30c2f640 1 -- 172.21.15.88:0/1276232895 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c2c0bee90 msgr2=0x7f2c2c0a3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.614+0000 7f2c30c2f640 1 --2- 172.21.15.88:0/1276232895 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c2c0bee90 0x7f2c2c0a3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.614+0000 7f2c30c2f640 1 -- 172.21.15.88:0/1276232895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c2c14b2a0 msgr2=0x7f2c2c153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.614+0000 7f2c30c2f640 1 --2- 172.21.15.88:0/1276232895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c2c14b2a0 0x7f2c2c153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.614+0000 7f2c30c2f640 1 -- 172.21.15.88:0/1276232895 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c280094d0 con 0x7f2c2c0bf310 2023-12-08T08:20:21.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.614+0000 7f2c30c2f640 1 --2- 172.21.15.88:0/1276232895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c2c0bf310 0x7f2c2c153a90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00c480 tx=0x7f2c1c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:21.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.614+0000 7f2c21ffb640 1 -- 172.21.15.88:0/1276232895 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c0074e0 con 0x7f2c2c0bf310 2023-12-08T08:20:21.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.614+0000 7f2c21ffb640 1 -- 172.21.15.88:0/1276232895 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1c007660 con 0x7f2c2c0bf310 2023-12-08T08:20:21.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.614+0000 7f2c33694640 1 -- 172.21.15.88:0/1276232895 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c2c0a6a70 con 0x7f2c2c0bf310 2023-12-08T08:20:21.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.614+0000 7f2c21ffb640 1 -- 172.21.15.88:0/1276232895 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c004a30 con 0x7f2c2c0bf310 2023-12-08T08:20:21.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.614+0000 7f2c33694640 1 -- 172.21.15.88:0/1276232895 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c2c0a7030 con 0x7f2c2c0bf310 2023-12-08T08:20:21.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.614+0000 7f2c33694640 1 -- 172.21.15.88:0/1276232895 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c2c067630 con 0x7f2c2c0bf310 2023-12-08T08:20:21.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.614+0000 7f2c21ffb640 1 -- 172.21.15.88:0/1276232895 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2c1c004b90 con 0x7f2c2c0bf310 2023-12-08T08:20:21.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.618+0000 7f2c21ffb640 1 --2- 172.21.15.88:0/1276232895 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2c100664a0 0x7f2c10068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:21.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.618+0000 7f2c21ffb640 1 -- 172.21.15.88:0/1276232895 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c1c083300 con 0x7f2c2c0bf310 2023-12-08T08:20:21.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.618+0000 7f2c31430640 1 --2- 172.21.15.88:0/1276232895 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2c100664a0 0x7f2c10068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:21.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.618+0000 7f2c31430640 1 --2- 172.21.15.88:0/1276232895 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2c100664a0 0x7f2c10068960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2c280ad000 tx=0x7f2c280a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:21.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.622+0000 7f2c21ffb640 1 -- 172.21.15.88:0/1276232895 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2c1c050820 con 0x7f2c2c0bf310 2023-12-08T08:20:21.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.774+0000 7f2c33694640 1 -- 172.21.15.88:0/1276232895 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c2c0c0010 con 0x7f2c2c0bf310 2023-12-08T08:20:21.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.774+0000 7f2c21ffb640 1 -- 172.21.15.88:0/1276232895 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7f2c1c053e40 con 0x7f2c2c0bf310 2023-12-08T08:20:21.779 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:21.779 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:20:21.492555+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:18.675917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:19.511013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:21.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.778+0000 7f2c33694640 1 -- 172.21.15.88:0/1276232895 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2c100664a0 msgr2=0x7f2c10068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:21.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.778+0000 7f2c33694640 1 --2- 172.21.15.88:0/1276232895 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2c100664a0 0x7f2c10068960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2c280ad000 tx=0x7f2c280a6000 comp rx=0 tx=0).stop 2023-12-08T08:20:21.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.778+0000 7f2c33694640 1 -- 172.21.15.88:0/1276232895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c2c0bf310 msgr2=0x7f2c2c153a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:21.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.778+0000 7f2c33694640 1 --2- 172.21.15.88:0/1276232895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c2c0bf310 0x7f2c2c153a90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00c480 tx=0x7f2c1c00c940 comp rx=0 tx=0).stop 2023-12-08T08:20:21.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.778+0000 7f2c33694640 1 -- 172.21.15.88:0/1276232895 shutdown_connections 2023-12-08T08:20:21.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.778+0000 7f2c33694640 1 --2- 172.21.15.88:0/1276232895 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2c100664a0 0x7f2c10068960 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.778+0000 7f2c33694640 1 --2- 172.21.15.88:0/1276232895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c2c14b2a0 0x7f2c2c153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.778+0000 7f2c33694640 1 --2- 172.21.15.88:0/1276232895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c2c0bf310 0x7f2c2c153a90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.778+0000 7f2c33694640 1 --2- 172.21.15.88:0/1276232895 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c2c0bee90 0x7f2c2c0a3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.778+0000 7f2c33694640 1 -- 172.21.15.88:0/1276232895 >> 172.21.15.88:0/1276232895 conn(0x7f2c2c0a7810 msgr2=0x7f2c2c14a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:21.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.778+0000 7f2c33694640 1 -- 172.21.15.88:0/1276232895 shutdown_connections 2023-12-08T08:20:21.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.778+0000 7f2c33694640 1 -- 172.21.15.88:0/1276232895 wait complete. 2023-12-08T08:20:21.800 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-08T08:20:21.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.934+0000 7f932ecad640 1 Processor -- start 2023-12-08T08:20:21.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.934+0000 7f932ecad640 1 -- start start 2023-12-08T08:20:21.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932ecad640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f93280c0250 0x7f932806c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:21.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932ecad640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f932806cbb0 0x7f932806d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:21.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932ecad640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93280a53c0 con 0x7f932814e8e0 2023-12-08T08:20:21.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932ecad640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93280a9140 con 0x7f93280c0250 2023-12-08T08:20:21.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932ecad640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f932814ecc0 con 0x7f932806cbb0 2023-12-08T08:20:21.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932dcab640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f932814e8e0 0x7f9328154f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60988/0 (socket says 172.21.15.88:60988) 2023-12-08T08:20:21.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932dcab640 1 -- 172.21.15.88:0/1519237440 learned_addr learned my addr 172.21.15.88:0/1519237440 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:21.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932d4aa640 1 --2- 172.21.15.88:0/1519237440 >> v2:172.21.15.148:3300/0 conn(0x7f93280c0250 0x7f932806c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:21.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932e4ac640 1 --2- 172.21.15.88:0/1519237440 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f932806cbb0 0x7f932806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:21.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932cca9640 1 -- 172.21.15.88:0/1519237440 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3727833144 0 0) 0x7f93280a53c0 con 0x7f932814e8e0 2023-12-08T08:20:21.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932cca9640 1 -- 172.21.15.88:0/1519237440 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9314003530 con 0x7f932814e8e0 2023-12-08T08:20:21.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932cca9640 1 -- 172.21.15.88:0/1519237440 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2194235202 0 0) 0x7f9314003530 con 0x7f932814e8e0 2023-12-08T08:20:21.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932cca9640 1 -- 172.21.15.88:0/1519237440 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f932806cbb0 msgr2=0x7f932806d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:21.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932cca9640 1 --2- 172.21.15.88:0/1519237440 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f932806cbb0 0x7f932806d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932cca9640 1 -- 172.21.15.88:0/1519237440 >> v2:172.21.15.148:3300/0 conn(0x7f93280c0250 msgr2=0x7f932806c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:21.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932cca9640 1 --2- 172.21.15.88:0/1519237440 >> v2:172.21.15.148:3300/0 conn(0x7f93280c0250 0x7f932806c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932cca9640 1 -- 172.21.15.88:0/1519237440 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93280a4e20 con 0x7f932814e8e0 2023-12-08T08:20:21.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932cca9640 1 -- 172.21.15.88:0/1519237440 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f9324001680 con 0x7f932814e8e0 2023-12-08T08:20:21.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932cca9640 1 -- 172.21.15.88:0/1519237440 >> v1:172.21.15.88:6789/0 conn(0x7f932814e8e0 legacy=0x7f9328154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:21.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932cca9640 1 --2- 172.21.15.88:0/1519237440 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f932806cbb0 0x7f9314003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:21.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932cca9640 1 --2- 172.21.15.88:0/1519237440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9314003f50 0x7f93140047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:21.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932cca9640 1 --2- 172.21.15.88:0/1519237440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9314004d10 0x7f9314005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:21.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932cca9640 1 -- 172.21.15.88:0/1519237440 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93280a9140 con 0x7f9314004d10 2023-12-08T08:20:21.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932cca9640 1 -- 172.21.15.88:0/1519237440 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932814ecc0 con 0x7f9314003f50 2023-12-08T08:20:21.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932cca9640 1 -- 172.21.15.88:0/1519237440 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f931400dcd0 con 0x7f932806cbb0 2023-12-08T08:20:21.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932d4aa640 1 --2- 172.21.15.88:0/1519237440 >> v2:172.21.15.148:3300/0 conn(0x7f93280c0250 0x7f932806c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:21.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932e4ac640 1 --2- 172.21.15.88:0/1519237440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9314004d10 0x7f9314005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:21.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932dcab640 1 --2- 172.21.15.88:0/1519237440 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f932806cbb0 0x7f9314003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:21.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932d4aa640 1 --2- 172.21.15.88:0/1519237440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9314003f50 0x7f93140047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:21.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932e4ac640 1 -- 172.21.15.88:0/1519237440 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f932806cbb0 msgr2=0x7f9314003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:21.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932e4ac640 1 --2- 172.21.15.88:0/1519237440 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f932806cbb0 0x7f9314003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932e4ac640 1 -- 172.21.15.88:0/1519237440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9314003f50 msgr2=0x7f93140047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:21.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932e4ac640 1 --2- 172.21.15.88:0/1519237440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9314003f50 0x7f93140047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.938+0000 7f932e4ac640 1 -- 172.21.15.88:0/1519237440 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9314003530 con 0x7f9314004d10 2023-12-08T08:20:21.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.942+0000 7f932e4ac640 1 --2- 172.21.15.88:0/1519237440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9314004d10 0x7f9314005190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9320009fc0 tx=0x7f932001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897ccd221b0e0a66 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:21.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.942+0000 7f932cca9640 1 -- 172.21.15.88:0/1519237440 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93200a5a20 con 0x7f9314004d10 2023-12-08T08:20:21.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.942+0000 7f932cca9640 1 -- 172.21.15.88:0/1519237440 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932000f040 con 0x7f9314004d10 2023-12-08T08:20:21.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.942+0000 7f932cca9640 1 -- 172.21.15.88:0/1519237440 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93200a5dc0 con 0x7f9314004d10 2023-12-08T08:20:21.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.942+0000 7f932ecad640 1 -- 172.21.15.88:0/1519237440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9314004d10 msgr2=0x7f9314005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:21.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.942+0000 7f932ecad640 1 --2- 172.21.15.88:0/1519237440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9314004d10 0x7f9314005190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9320009fc0 tx=0x7f932001cc30 comp rx=0 tx=0).stop 2023-12-08T08:20:21.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.942+0000 7f932e4ac640 1 -- 172.21.15.88:0/1519237440 reap_dead start 2023-12-08T08:20:21.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.942+0000 7f932ecad640 1 -- 172.21.15.88:0/1519237440 shutdown_connections 2023-12-08T08:20:21.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.942+0000 7f932ecad640 1 -- 172.21.15.88:0/1519237440 >> 172.21.15.88:0/1519237440 conn(0x7f93280c2350 msgr2=0x7f93280c2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:21.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.942+0000 7f932ecad640 1 -- 172.21.15.88:0/1519237440 shutdown_connections 2023-12-08T08:20:21.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.942+0000 7f932ecad640 1 -- 172.21.15.88:0/1519237440 wait complete. 2023-12-08T08:20:21.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.942+0000 7f932ecad640 1 Processor -- start 2023-12-08T08:20:21.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.942+0000 7f932ecad640 1 -- start start 2023-12-08T08:20:21.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.946+0000 7f932ecad640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9314004d10 0x7f9328070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:21.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.946+0000 7f932ecad640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93281e41a0 0x7f9328148970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:21.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.946+0000 7f932ecad640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9328148eb0 0x7f93281ece20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:21.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.946+0000 7f932ecad640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9328070680 con 0x7f93281e41a0 2023-12-08T08:20:21.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.946+0000 7f932ecad640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9328071880 con 0x7f9314004d10 2023-12-08T08:20:21.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.946+0000 7f932ecad640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9328072b80 con 0x7f9328148eb0 2023-12-08T08:20:21.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.946+0000 7f932d4aa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93281e41a0 0x7f9328148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:21.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.946+0000 7f932d4aa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93281e41a0 0x7f9328148970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39730/0 (socket says 172.21.15.88:39730) 2023-12-08T08:20:21.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.946+0000 7f932d4aa640 1 -- 172.21.15.88:0/161365144 learned_addr learned my addr 172.21.15.88:0/161365144 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:21.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.946+0000 7f932dcab640 1 --2- 172.21.15.88:0/161365144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9314004d10 0x7f9328070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:21.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.946+0000 7f932e4ac640 1 --2- 172.21.15.88:0/161365144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9328148eb0 0x7f93281ece20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:21.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.946+0000 7f932d4aa640 1 -- 172.21.15.88:0/161365144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9328148eb0 msgr2=0x7f93281ece20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:21.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.946+0000 7f932d4aa640 1 --2- 172.21.15.88:0/161365144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9328148eb0 0x7f93281ece20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.946+0000 7f932d4aa640 1 -- 172.21.15.88:0/161365144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9314004d10 msgr2=0x7f9328070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:21.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.946+0000 7f932d4aa640 1 --2- 172.21.15.88:0/161365144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9314004d10 0x7f9328070ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.946+0000 7f932d4aa640 1 -- 172.21.15.88:0/161365144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932806ff00 con 0x7f93281e41a0 2023-12-08T08:20:21.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.946+0000 7f932d4aa640 1 --2- 172.21.15.88:0/161365144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93281e41a0 0x7f9328148970 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9318011930 tx=0x7f9318011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:21.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.946+0000 7f931e7fc640 1 -- 172.21.15.88:0/161365144 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318004220 con 0x7f93281e41a0 2023-12-08T08:20:21.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.946+0000 7f931e7fc640 1 -- 172.21.15.88:0/161365144 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9318004380 con 0x7f93281e41a0 2023-12-08T08:20:21.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.946+0000 7f932ecad640 1 -- 172.21.15.88:0/161365144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93281497e0 con 0x7f93281e41a0 2023-12-08T08:20:21.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.946+0000 7f931e7fc640 1 -- 172.21.15.88:0/161365144 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931800fbd0 con 0x7f93281e41a0 2023-12-08T08:20:21.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.946+0000 7f932ecad640 1 -- 172.21.15.88:0/161365144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932806fb90 con 0x7f93281e41a0 2023-12-08T08:20:21.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.946+0000 7f932ecad640 1 -- 172.21.15.88:0/161365144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93280674b0 con 0x7f93281e41a0 2023-12-08T08:20:21.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.946+0000 7f931e7fc640 1 -- 172.21.15.88:0/161365144 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f931800fd30 con 0x7f93281e41a0 2023-12-08T08:20:21.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.950+0000 7f931e7fc640 1 --2- 172.21.15.88:0/161365144 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f930c066470 0x7f930c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:21.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.950+0000 7f931e7fc640 1 -- 172.21.15.88:0/161365144 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93180841f0 con 0x7f93281e41a0 2023-12-08T08:20:21.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.950+0000 7f932dcab640 1 --2- 172.21.15.88:0/161365144 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f930c066470 0x7f930c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:21.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.950+0000 7f932dcab640 1 --2- 172.21.15.88:0/161365144 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f930c066470 0x7f930c068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f93281eaaf0 tx=0x7f9324007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:21.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:21.954+0000 7f931e7fc640 1 -- 172.21.15.88:0/161365144 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9318051740 con 0x7f93281e41a0 2023-12-08T08:20:22.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:22.134+0000 7f932ecad640 1 -- 172.21.15.88:0/161365144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9328073b10 con 0x7f93281e41a0 2023-12-08T08:20:23.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.130+0000 7f931e7fc640 1 -- 172.21.15.88:0/161365144 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9318054d60 con 0x7f93281e41a0 2023-12-08T08:20:23.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.134+0000 7f932ecad640 1 -- 172.21.15.88:0/161365144 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f930c066470 msgr2=0x7f930c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:23.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.134+0000 7f932ecad640 1 --2- 172.21.15.88:0/161365144 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f930c066470 0x7f930c068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f93281eaaf0 tx=0x7f9324007040 comp rx=0 tx=0).stop 2023-12-08T08:20:23.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.134+0000 7f932ecad640 1 -- 172.21.15.88:0/161365144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93281e41a0 msgr2=0x7f9328148970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:23.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.134+0000 7f932ecad640 1 --2- 172.21.15.88:0/161365144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93281e41a0 0x7f9328148970 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9318011930 tx=0x7f9318011df0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.134+0000 7f932ecad640 1 -- 172.21.15.88:0/161365144 shutdown_connections 2023-12-08T08:20:23.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.134+0000 7f932ecad640 1 --2- 172.21.15.88:0/161365144 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f930c066470 0x7f930c068930 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.134+0000 7f932ecad640 1 --2- 172.21.15.88:0/161365144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9328148eb0 0x7f93281ece20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.134+0000 7f932ecad640 1 --2- 172.21.15.88:0/161365144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93281e41a0 0x7f9328148970 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.134+0000 7f932ecad640 1 --2- 172.21.15.88:0/161365144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9314004d10 0x7f9328070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.134+0000 7f932ecad640 1 -- 172.21.15.88:0/161365144 >> 172.21.15.88:0/161365144 conn(0x7f93280c2350 msgr2=0x7f93280c1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:23.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.134+0000 7f932ecad640 1 -- 172.21.15.88:0/161365144 shutdown_connections 2023-12-08T08:20:23.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.134+0000 7f932ecad640 1 -- 172.21.15.88:0/161365144 wait complete. 2023-12-08T08:20:23.157 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-08T08:20:23.157 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-08T08:20:23.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.294+0000 7f1b25894640 1 Processor -- start 2023-12-08T08:20:23.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.294+0000 7f1b25894640 1 -- start start 2023-12-08T08:20:23.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.294+0000 7f1b25894640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1b200c6030 0x7f1b200c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:23.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.294+0000 7f1b25894640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1b200c98f0 0x7f1b200c8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:23.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.294+0000 7f1b25894640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b20158780 con 0x7f1b200bf2d0 2023-12-08T08:20:23.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.294+0000 7f1b25894640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b200c0300 con 0x7f1b200c6030 2023-12-08T08:20:23.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.294+0000 7f1b25894640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b20157b70 con 0x7f1b200c98f0 2023-12-08T08:20:23.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.294+0000 7f1b167fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1b200c6030 0x7f1b200c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:23.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.294+0000 7f1b167fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1b200c6030 0x7f1b200c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39744/0 (socket says 172.21.15.88:39744) 2023-12-08T08:20:23.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.294+0000 7f1b167fc640 1 -- 172.21.15.88:0/3265244859 learned_addr learned my addr 172.21.15.88:0/3265244859 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:23.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.294+0000 7f1b167fc640 1 -- 172.21.15.88:0/3265244859 >> v2:172.21.15.148:3300/0 conn(0x7f1b200c98f0 msgr2=0x7f1b200c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:23.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.294+0000 7f1b1f7fe640 1 --2- 172.21.15.88:0/3265244859 >> v2:172.21.15.148:3300/0 conn(0x7f1b200c98f0 0x7f1b200c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:23.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.294+0000 7f1b167fc640 1 --2- 172.21.15.88:0/3265244859 >> v2:172.21.15.148:3300/0 conn(0x7f1b200c98f0 0x7f1b200c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.294+0000 7f1b167fc640 1 -- 172.21.15.88:0/3265244859 >> v1:172.21.15.148:6789/0 conn(0x7f1b200bf2d0 legacy=0x7f1b20151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:23.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.294+0000 7f1b167fc640 1 -- 172.21.15.88:0/3265244859 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b20157e50 con 0x7f1b200c6030 2023-12-08T08:20:23.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.294+0000 7f1b1f7fe640 1 --2- 172.21.15.88:0/3265244859 >> v2:172.21.15.148:3300/0 conn(0x7f1b200c98f0 0x7f1b200c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:23.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.298+0000 7f1b167fc640 1 --2- 172.21.15.88:0/3265244859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b200c6030 0x7f1b200c7cc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1b200a9720 tx=0x7f1b0801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ea7286ae6349e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:23.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.298+0000 7f1b1e7fc640 1 -- 172.21.15.88:0/3265244859 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b080a5820 con 0x7f1b200c6030 2023-12-08T08:20:23.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.298+0000 7f1b1e7fc640 1 -- 172.21.15.88:0/3265244859 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b080a5980 con 0x7f1b200c6030 2023-12-08T08:20:23.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.298+0000 7f1b1e7fc640 1 -- 172.21.15.88:0/3265244859 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b080a5d10 con 0x7f1b200c6030 2023-12-08T08:20:23.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.298+0000 7f1b25894640 1 -- 172.21.15.88:0/3265244859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b200c6030 msgr2=0x7f1b200c7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:23.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.298+0000 7f1b25894640 1 --2- 172.21.15.88:0/3265244859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b200c6030 0x7f1b200c7cc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1b200a9720 tx=0x7f1b0801c960 comp rx=0 tx=0).stop 2023-12-08T08:20:23.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.298+0000 7f1b25894640 1 -- 172.21.15.88:0/3265244859 shutdown_connections 2023-12-08T08:20:23.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.298+0000 7f1b25894640 1 --2- 172.21.15.88:0/3265244859 >> v2:172.21.15.148:3300/0 conn(0x7f1b200c98f0 0x7f1b200c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.298+0000 7f1b25894640 1 --2- 172.21.15.88:0/3265244859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b200c6030 0x7f1b200c7cc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.298+0000 7f1b25894640 1 -- 172.21.15.88:0/3265244859 >> 172.21.15.88:0/3265244859 conn(0x7f1b200c9dc0 msgr2=0x7f1b200ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:23.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.298+0000 7f1b25894640 1 -- 172.21.15.88:0/3265244859 shutdown_connections 2023-12-08T08:20:23.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.298+0000 7f1b25894640 1 -- 172.21.15.88:0/3265244859 wait complete. 2023-12-08T08:20:23.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.302+0000 7f1b25894640 1 Processor -- start 2023-12-08T08:20:23.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.302+0000 7f1b25894640 1 -- start start 2023-12-08T08:20:23.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.302+0000 7f1b25894640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b200bf2d0 0x7f1b201f0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:23.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.302+0000 7f1b25894640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b200c6030 0x7f1b20143e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.302+0000 7f1b25894640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b200c98f0 0x7f1b201476f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.302+0000 7f1b25894640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2006c390 con 0x7f1b200bf2d0 2023-12-08T08:20:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.302+0000 7f1b25894640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b20153d10 con 0x7f1b200c98f0 2023-12-08T08:20:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.302+0000 7f1b25894640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b201541a0 con 0x7f1b200c6030 2023-12-08T08:20:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.302+0000 7f1b1effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b200bf2d0 0x7f1b201f0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.302+0000 7f1b1effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b200bf2d0 0x7f1b201f0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39750/0 (socket says 172.21.15.88:39750) 2023-12-08T08:20:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.302+0000 7f1b1effd640 1 -- 172.21.15.88:0/470642944 learned_addr learned my addr 172.21.15.88:0/470642944 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.302+0000 7f1b167fc640 1 --2- 172.21.15.88:0/470642944 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b200c6030 0x7f1b20143e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.302+0000 7f1b1f7fe640 1 --2- 172.21.15.88:0/470642944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b200c98f0 0x7f1b201476f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.302+0000 7f1b1effd640 1 -- 172.21.15.88:0/470642944 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b200c6030 msgr2=0x7f1b20143e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.302+0000 7f1b1effd640 1 --2- 172.21.15.88:0/470642944 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b200c6030 0x7f1b20143e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.302+0000 7f1b1effd640 1 -- 172.21.15.88:0/470642944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b200c98f0 msgr2=0x7f1b201476f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.302+0000 7f1b1effd640 1 --2- 172.21.15.88:0/470642944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b200c98f0 0x7f1b201476f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.302+0000 7f1b1effd640 1 -- 172.21.15.88:0/470642944 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b08009b30 con 0x7f1b200bf2d0 2023-12-08T08:20:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.302+0000 7f1b1f7fe640 1 --2- 172.21.15.88:0/470642944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b200c98f0 0x7f1b201476f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:23.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.302+0000 7f1b1effd640 1 --2- 172.21.15.88:0/470642944 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b200bf2d0 0x7f1b201f0990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1b1000c480 tx=0x7f1b1000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:23.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.302+0000 7f1b1cff9640 1 -- 172.21.15.88:0/470642944 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b10012830 con 0x7f1b200bf2d0 2023-12-08T08:20:23.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.302+0000 7f1b1cff9640 1 -- 172.21.15.88:0/470642944 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b100129b0 con 0x7f1b200bf2d0 2023-12-08T08:20:23.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.302+0000 7f1b1cff9640 1 -- 172.21.15.88:0/470642944 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b10012d60 con 0x7f1b200bf2d0 2023-12-08T08:20:23.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.302+0000 7f1b25894640 1 -- 172.21.15.88:0/470642944 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b201f0ed0 con 0x7f1b200bf2d0 2023-12-08T08:20:23.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.302+0000 7f1b25894640 1 -- 172.21.15.88:0/470642944 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b2006c0b0 con 0x7f1b200bf2d0 2023-12-08T08:20:23.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.306+0000 7f1b25894640 1 -- 172.21.15.88:0/470642944 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b20067630 con 0x7f1b200bf2d0 2023-12-08T08:20:23.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.306+0000 7f1b1cff9640 1 -- 172.21.15.88:0/470642944 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1b1001c460 con 0x7f1b200bf2d0 2023-12-08T08:20:23.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.306+0000 7f1b1cff9640 1 --2- 172.21.15.88:0/470642944 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1b00066470 0x7f1b00068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:23.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.306+0000 7f1b1cff9640 1 -- 172.21.15.88:0/470642944 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b10083cc0 con 0x7f1b200bf2d0 2023-12-08T08:20:23.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.306+0000 7f1b167fc640 1 --2- 172.21.15.88:0/470642944 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1b00066470 0x7f1b00068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:23.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.306+0000 7f1b167fc640 1 --2- 172.21.15.88:0/470642944 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1b00066470 0x7f1b00068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1b080ae000 tx=0x7f1b080a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:23.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.310+0000 7f1b1cff9640 1 -- 172.21.15.88:0/470642944 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1b100511d0 con 0x7f1b200bf2d0 2023-12-08T08:20:23.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:23.490+0000 7f1b25894640 1 -- 172.21.15.88:0/470642944 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1b20156ab0 con 0x7f1b200bf2d0 2023-12-08T08:20:24.066 INFO:tasks.ceph.mds.a.smithi088.stderr:2023-12-08T08:20:24.062+0000 7f10a1c0a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:20:24.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.130+0000 7f1b1cff9640 1 -- 172.21.15.88:0/470642944 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1b100547f0 con 0x7f1b200bf2d0 2023-12-08T08:20:24.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.134+0000 7f1b25894640 1 -- 172.21.15.88:0/470642944 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1b00066470 msgr2=0x7f1b00068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:24.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.134+0000 7f1b25894640 1 --2- 172.21.15.88:0/470642944 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1b00066470 0x7f1b00068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1b080ae000 tx=0x7f1b080a7070 comp rx=0 tx=0).stop 2023-12-08T08:20:24.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.134+0000 7f1b25894640 1 -- 172.21.15.88:0/470642944 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b200bf2d0 msgr2=0x7f1b201f0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:24.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.134+0000 7f1b25894640 1 --2- 172.21.15.88:0/470642944 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b200bf2d0 0x7f1b201f0990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1b1000c480 tx=0x7f1b1000c940 comp rx=0 tx=0).stop 2023-12-08T08:20:24.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.134+0000 7f1b25894640 1 -- 172.21.15.88:0/470642944 shutdown_connections 2023-12-08T08:20:24.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.134+0000 7f1b25894640 1 --2- 172.21.15.88:0/470642944 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1b00066470 0x7f1b00068930 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.134+0000 7f1b25894640 1 --2- 172.21.15.88:0/470642944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b200c98f0 0x7f1b201476f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.134+0000 7f1b25894640 1 --2- 172.21.15.88:0/470642944 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1b200c6030 0x7f1b20143e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.134+0000 7f1b25894640 1 --2- 172.21.15.88:0/470642944 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b200bf2d0 0x7f1b201f0990 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.134+0000 7f1b25894640 1 -- 172.21.15.88:0/470642944 >> 172.21.15.88:0/470642944 conn(0x7f1b200c9dc0 msgr2=0x7f1b201558d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:24.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.134+0000 7f1b25894640 1 -- 172.21.15.88:0/470642944 shutdown_connections 2023-12-08T08:20:24.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.134+0000 7f1b25894640 1 -- 172.21.15.88:0/470642944 wait complete. 2023-12-08T08:20:24.160 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-08T08:20:24.160 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:20:24.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.294+0000 7fc59ded6640 1 Processor -- start 2023-12-08T08:20:24.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.294+0000 7fc59ded6640 1 -- start start 2023-12-08T08:20:24.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.294+0000 7fc59ded6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc5980af4c0 0x7fc598154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:24.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.294+0000 7fc59ded6640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc59806c100 0x7fc5980c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:24.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.294+0000 7fc59ded6640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5980c4890 con 0x7fc5980c67d0 2023-12-08T08:20:24.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.294+0000 7fc59ded6640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc598155460 con 0x7fc5980af4c0 2023-12-08T08:20:24.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.294+0000 7fc59ded6640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5980af8a0 con 0x7fc59806c100 2023-12-08T08:20:24.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.294+0000 7fc58ffff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc5980c67d0 0x7fc59806b9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60992/0 (socket says 172.21.15.88:60992) 2023-12-08T08:20:24.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.294+0000 7fc5977fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc5980af4c0 0x7fc598154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:24.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.294+0000 7fc58ffff640 1 -- 172.21.15.88:0/3364491853 learned_addr learned my addr 172.21.15.88:0/3364491853 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:24.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.294+0000 7fc597fff640 1 --2- 172.21.15.88:0/3364491853 >> v2:172.21.15.148:3300/0 conn(0x7fc59806c100 0x7fc5980c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:24.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.294+0000 7fc5977fe640 1 -- 172.21.15.88:0/3364491853 >> v2:172.21.15.148:3300/0 conn(0x7fc59806c100 msgr2=0x7fc5980c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:24.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.294+0000 7fc5977fe640 1 --2- 172.21.15.88:0/3364491853 >> v2:172.21.15.148:3300/0 conn(0x7fc59806c100 0x7fc5980c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.294+0000 7fc5977fe640 1 -- 172.21.15.88:0/3364491853 >> v1:172.21.15.88:6789/0 conn(0x7fc5980c67d0 legacy=0x7fc59806b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:24.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.294+0000 7fc5977fe640 1 -- 172.21.15.88:0/3364491853 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5980c4b30 con 0x7fc5980af4c0 2023-12-08T08:20:24.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.294+0000 7fc596ffd640 1 -- 172.21.15.88:0/3364491853 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3960160020 0 0) 0x7fc5980c4890 con 0x7fc5980c67d0 2023-12-08T08:20:24.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.294+0000 7fc597fff640 1 --2- 172.21.15.88:0/3364491853 >> v2:172.21.15.148:3300/0 conn(0x7fc59806c100 0x7fc5980c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:24.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.298+0000 7fc5977fe640 1 --2- 172.21.15.88:0/3364491853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5980af4c0 0x7fc598154f20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc5980c9d90 tx=0x7fc58801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f5408180ea59fe server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:24.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.298+0000 7fc596ffd640 1 -- 172.21.15.88:0/3364491853 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5880ac600 con 0x7fc5980af4c0 2023-12-08T08:20:24.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.298+0000 7fc596ffd640 1 -- 172.21.15.88:0/3364491853 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5880a8050 con 0x7fc5980af4c0 2023-12-08T08:20:24.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.298+0000 7fc596ffd640 1 -- 172.21.15.88:0/3364491853 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5880ac980 con 0x7fc5980af4c0 2023-12-08T08:20:24.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.298+0000 7fc59ded6640 1 -- 172.21.15.88:0/3364491853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5980af4c0 msgr2=0x7fc598154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:24.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.298+0000 7fc59ded6640 1 --2- 172.21.15.88:0/3364491853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5980af4c0 0x7fc598154f20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc5980c9d90 tx=0x7fc58801c3a0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.298+0000 7fc59ded6640 1 -- 172.21.15.88:0/3364491853 shutdown_connections 2023-12-08T08:20:24.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.298+0000 7fc59ded6640 1 --2- 172.21.15.88:0/3364491853 >> v2:172.21.15.148:3300/0 conn(0x7fc59806c100 0x7fc5980c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.298+0000 7fc59ded6640 1 --2- 172.21.15.88:0/3364491853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5980af4c0 0x7fc598154f20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.298+0000 7fc59ded6640 1 -- 172.21.15.88:0/3364491853 >> 172.21.15.88:0/3364491853 conn(0x7fc5980ab9d0 msgr2=0x7fc5980abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:24.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.298+0000 7fc59ded6640 1 -- 172.21.15.88:0/3364491853 shutdown_connections 2023-12-08T08:20:24.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.298+0000 7fc59ded6640 1 -- 172.21.15.88:0/3364491853 wait complete. 2023-12-08T08:20:24.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.302+0000 7fc59ded6640 1 Processor -- start 2023-12-08T08:20:24.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.302+0000 7fc59ded6640 1 -- start start 2023-12-08T08:20:24.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.302+0000 7fc59ded6640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc59806c100 0x7fc5980c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:24.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.302+0000 7fc59ded6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5980af4c0 0x7fc5981ef580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:24.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.302+0000 7fc59ded6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5980c67d0 0x7fc598150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:24.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.302+0000 7fc59ded6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5981eded0 con 0x7fc5980af4c0 2023-12-08T08:20:24.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.302+0000 7fc59ded6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59814d1f0 con 0x7fc5980c67d0 2023-12-08T08:20:24.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.302+0000 7fc59ded6640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5980c29b0 con 0x7fc59806c100 2023-12-08T08:20:24.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.302+0000 7fc58ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5980af4c0 0x7fc5981ef580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:24.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.302+0000 7fc58ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5980af4c0 0x7fc5981ef580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39762/0 (socket says 172.21.15.88:39762) 2023-12-08T08:20:24.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.302+0000 7fc58ffff640 1 -- 172.21.15.88:0/2260390080 learned_addr learned my addr 172.21.15.88:0/2260390080 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:24.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.302+0000 7fc597fff640 1 --2- 172.21.15.88:0/2260390080 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5980c67d0 0x7fc598150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:24.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.302+0000 7fc5977fe640 1 --2- 172.21.15.88:0/2260390080 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc59806c100 0x7fc5980c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:24.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.302+0000 7fc58ffff640 1 -- 172.21.15.88:0/2260390080 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc59806c100 msgr2=0x7fc5980c37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:24.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.302+0000 7fc58ffff640 1 --2- 172.21.15.88:0/2260390080 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc59806c100 0x7fc5980c37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.302+0000 7fc58ffff640 1 -- 172.21.15.88:0/2260390080 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5980c67d0 msgr2=0x7fc598150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:24.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.302+0000 7fc58ffff640 1 --2- 172.21.15.88:0/2260390080 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5980c67d0 0x7fc598150f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.302+0000 7fc58ffff640 1 -- 172.21.15.88:0/2260390080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc588009420 con 0x7fc5980af4c0 2023-12-08T08:20:24.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.302+0000 7fc5977fe640 1 --2- 172.21.15.88:0/2260390080 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc59806c100 0x7fc5980c37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:24.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.302+0000 7fc58ffff640 1 --2- 172.21.15.88:0/2260390080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5980af4c0 0x7fc5981ef580 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc5800011f0 tx=0x7fc58000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:24.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.302+0000 7fc594ff9640 1 -- 172.21.15.88:0/2260390080 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5800074e0 con 0x7fc5980af4c0 2023-12-08T08:20:24.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.302+0000 7fc594ff9640 1 -- 172.21.15.88:0/2260390080 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc580007640 con 0x7fc5980af4c0 2023-12-08T08:20:24.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.302+0000 7fc59ded6640 1 -- 172.21.15.88:0/2260390080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5980c3ce0 con 0x7fc5980af4c0 2023-12-08T08:20:24.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.302+0000 7fc594ff9640 1 -- 172.21.15.88:0/2260390080 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc580004a10 con 0x7fc5980af4c0 2023-12-08T08:20:24.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.302+0000 7fc59ded6640 1 -- 172.21.15.88:0/2260390080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5980c2f30 con 0x7fc5980af4c0 2023-12-08T08:20:24.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.306+0000 7fc59ded6640 1 -- 172.21.15.88:0/2260390080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc598067630 con 0x7fc5980af4c0 2023-12-08T08:20:24.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.306+0000 7fc594ff9640 1 -- 172.21.15.88:0/2260390080 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc580004b70 con 0x7fc5980af4c0 2023-12-08T08:20:24.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.306+0000 7fc594ff9640 1 --2- 172.21.15.88:0/2260390080 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc578066470 0x7fc578068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:24.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.306+0000 7fc594ff9640 1 -- 172.21.15.88:0/2260390080 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc580083190 con 0x7fc5980af4c0 2023-12-08T08:20:24.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.306+0000 7fc5977fe640 1 --2- 172.21.15.88:0/2260390080 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc578066470 0x7fc578068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:24.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.306+0000 7fc5977fe640 1 --2- 172.21.15.88:0/2260390080 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc578066470 0x7fc578068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc5880ae000 tx=0x7fc588008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:24.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.310+0000 7fc594ff9640 1 -- 172.21.15.88:0/2260390080 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc580050600 con 0x7fc5980af4c0 2023-12-08T08:20:24.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.490+0000 7fc59ded6640 1 -- 172.21.15.88:0/2260390080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc59806c7a0 con 0x7fc5980af4c0 2023-12-08T08:20:24.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.490+0000 7fc594ff9640 1 -- 172.21.15.88:0/2260390080 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4910 (secure 0 0 0) 0x7fc580018090 con 0x7fc5980af4c0 2023-12-08T08:20:24.495 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:24.495 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/1946795737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":1946795737},{"type":"v1","addr":"172.21.15.88:6837","nonce":1946795737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/140150927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":140150927},{"type":"v1","addr":"172.21.15.148:6834","nonce":140150927}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2399327235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2399327235},{"type":"v1","addr":"172.21.15.148:6835","nonce":2399327235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:20:20.479364+0000","modified":"2023-12-08T08:20:23.493737+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/3793971563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":3793971563},{"type":"v1","addr":"172.21.15.88:6835","nonce":3793971563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T08:20:24.495 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 8 2023-12-08T08:20:24.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.494+0000 7fc59ded6640 1 -- 172.21.15.88:0/2260390080 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc578066470 msgr2=0x7fc578068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:24.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.494+0000 7fc59ded6640 1 --2- 172.21.15.88:0/2260390080 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc578066470 0x7fc578068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc5880ae000 tx=0x7fc588008040 comp rx=0 tx=0).stop 2023-12-08T08:20:24.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.494+0000 7fc59ded6640 1 -- 172.21.15.88:0/2260390080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5980af4c0 msgr2=0x7fc5981ef580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:24.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.494+0000 7fc59ded6640 1 --2- 172.21.15.88:0/2260390080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5980af4c0 0x7fc5981ef580 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc5800011f0 tx=0x7fc58000c9b0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.494+0000 7fc59ded6640 1 -- 172.21.15.88:0/2260390080 shutdown_connections 2023-12-08T08:20:24.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.494+0000 7fc59ded6640 1 --2- 172.21.15.88:0/2260390080 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc578066470 0x7fc578068930 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.494+0000 7fc59ded6640 1 --2- 172.21.15.88:0/2260390080 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5980c67d0 0x7fc598150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.494+0000 7fc59ded6640 1 --2- 172.21.15.88:0/2260390080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5980af4c0 0x7fc5981ef580 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.494+0000 7fc59ded6640 1 --2- 172.21.15.88:0/2260390080 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc59806c100 0x7fc5980c37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.494+0000 7fc59ded6640 1 -- 172.21.15.88:0/2260390080 >> 172.21.15.88:0/2260390080 conn(0x7fc5980ab9d0 msgr2=0x7fc5980aa440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:24.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.494+0000 7fc59ded6640 1 -- 172.21.15.88:0/2260390080 shutdown_connections 2023-12-08T08:20:24.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.494+0000 7fc59ded6640 1 -- 172.21.15.88:0/2260390080 wait complete. 2023-12-08T08:20:24.516 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:24.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.650+0000 7f4d21616640 1 Processor -- start 2023-12-08T08:20:24.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.650+0000 7f4d21616640 1 -- start start 2023-12-08T08:20:24.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.650+0000 7f4d21616640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4d1c0ca3c0 0x7f4d1c154580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:24.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.650+0000 7f4d21616640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d1c0c7dd0 0x7f4d1c158210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:24.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.650+0000 7f4d21616640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d1c06bc80 con 0x7f4d1c158750 2023-12-08T08:20:24.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.650+0000 7f4d21616640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d1c157e10 con 0x7f4d1c0ca3c0 2023-12-08T08:20:24.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.650+0000 7f4d21616640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c0c5120 con 0x7f4d1c0c7dd0 2023-12-08T08:20:24.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.650+0000 7f4d1a7fc640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d1c0c7dd0 0x7f4d1c158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:24.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.650+0000 7f4d1affd640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4d1c0ca3c0 0x7f4d1c154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:24.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.650+0000 7f4d1a7fc640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d1c0c7dd0 0x7f4d1c158210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:55586/0 (socket says 172.21.15.88:55586) 2023-12-08T08:20:24.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.650+0000 7f4d1a7fc640 1 -- 172.21.15.88:0/3295961126 learned_addr learned my addr 172.21.15.88:0/3295961126 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:24.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.650+0000 7f4d1affd640 1 -- 172.21.15.88:0/3295961126 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d1c0c7dd0 msgr2=0x7f4d1c158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:24.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.650+0000 7f4d1affd640 1 --2- 172.21.15.88:0/3295961126 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d1c0c7dd0 0x7f4d1c158210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.650+0000 7f4d1affd640 1 -- 172.21.15.88:0/3295961126 >> v1:172.21.15.148:6789/0 conn(0x7f4d1c158750 legacy=0x7f4d1c14aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:24.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.650+0000 7f4d1affd640 1 -- 172.21.15.88:0/3295961126 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c154ac0 con 0x7f4d1c0ca3c0 2023-12-08T08:20:24.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.650+0000 7f4d1a7fc640 1 --2- 172.21.15.88:0/3295961126 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d1c0c7dd0 0x7f4d1c158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:24.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.654+0000 7f4d1affd640 1 --2- 172.21.15.88:0/3295961126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d1c0ca3c0 0x7f4d1c154580 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0097c0 tx=0x7f4d0c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1d3836ea3684d09 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:24.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.654+0000 7f4d19ffb640 1 -- 172.21.15.88:0/3295961126 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c0ab5f0 con 0x7f4d1c0ca3c0 2023-12-08T08:20:24.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.654+0000 7f4d19ffb640 1 -- 172.21.15.88:0/3295961126 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0c0ab750 con 0x7f4d1c0ca3c0 2023-12-08T08:20:24.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.654+0000 7f4d19ffb640 1 -- 172.21.15.88:0/3295961126 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c0abae0 con 0x7f4d1c0ca3c0 2023-12-08T08:20:24.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.654+0000 7f4d21616640 1 -- 172.21.15.88:0/3295961126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d1c0ca3c0 msgr2=0x7f4d1c154580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:24.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.654+0000 7f4d21616640 1 --2- 172.21.15.88:0/3295961126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d1c0ca3c0 0x7f4d1c154580 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0097c0 tx=0x7f4d0c01c3f0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.654+0000 7f4d21616640 1 -- 172.21.15.88:0/3295961126 shutdown_connections 2023-12-08T08:20:24.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.654+0000 7f4d21616640 1 --2- 172.21.15.88:0/3295961126 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d1c0c7dd0 0x7f4d1c158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.654+0000 7f4d21616640 1 --2- 172.21.15.88:0/3295961126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d1c0ca3c0 0x7f4d1c154580 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.654+0000 7f4d21616640 1 -- 172.21.15.88:0/3295961126 >> 172.21.15.88:0/3295961126 conn(0x7f4d1c0666a0 msgr2=0x7f4d1c066ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:24.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.654+0000 7f4d21616640 1 -- 172.21.15.88:0/3295961126 shutdown_connections 2023-12-08T08:20:24.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.654+0000 7f4d21616640 1 -- 172.21.15.88:0/3295961126 wait complete. 2023-12-08T08:20:24.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.658+0000 7f4d21616640 1 Processor -- start 2023-12-08T08:20:24.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.658+0000 7f4d21616640 1 -- start start 2023-12-08T08:20:24.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.658+0000 7f4d21616640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d1c0c7dd0 0x7f4d1c1567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:24.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.658+0000 7f4d21616640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d1c0ca3c0 0x7f4d1c0abec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:24.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.658+0000 7f4d21616640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d1c158750 0x7f4d1c143180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:24.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.658+0000 7f4d21616640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c0c13e0 con 0x7f4d1c158750 2023-12-08T08:20:24.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.658+0000 7f4d21616640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c0c0e20 con 0x7f4d1c0c7dd0 2023-12-08T08:20:24.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.658+0000 7f4d21616640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c0c1100 con 0x7f4d1c0ca3c0 2023-12-08T08:20:24.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.658+0000 7f4d1b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d1c158750 0x7f4d1c143180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:24.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.658+0000 7f4d1b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d1c158750 0x7f4d1c143180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39778/0 (socket says 172.21.15.88:39778) 2023-12-08T08:20:24.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.658+0000 7f4d1b7fe640 1 -- 172.21.15.88:0/3288040600 learned_addr learned my addr 172.21.15.88:0/3288040600 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:24.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.658+0000 7f4d1a7fc640 1 --2- 172.21.15.88:0/3288040600 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d1c0ca3c0 0x7f4d1c0abec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:24.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.658+0000 7f4d1affd640 1 --2- 172.21.15.88:0/3288040600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d1c0c7dd0 0x7f4d1c1567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:24.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.658+0000 7f4d1b7fe640 1 -- 172.21.15.88:0/3288040600 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d1c0ca3c0 msgr2=0x7f4d1c0abec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:24.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.658+0000 7f4d1b7fe640 1 --2- 172.21.15.88:0/3288040600 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d1c0ca3c0 0x7f4d1c0abec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.658+0000 7f4d1b7fe640 1 -- 172.21.15.88:0/3288040600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d1c0c7dd0 msgr2=0x7f4d1c1567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:24.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.658+0000 7f4d1b7fe640 1 --2- 172.21.15.88:0/3288040600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d1c0c7dd0 0x7f4d1c1567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.658+0000 7f4d1b7fe640 1 -- 172.21.15.88:0/3288040600 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d100094d0 con 0x7f4d1c158750 2023-12-08T08:20:24.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.658+0000 7f4d1b7fe640 1 --2- 172.21.15.88:0/3288040600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d1c158750 0x7f4d1c143180 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4d1400c730 tx=0x7f4d1400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:24.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.658+0000 7f4d037fe640 1 -- 172.21.15.88:0/3288040600 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d14003b80 con 0x7f4d1c158750 2023-12-08T08:20:24.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.658+0000 7f4d037fe640 1 -- 172.21.15.88:0/3288040600 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d14003ce0 con 0x7f4d1c158750 2023-12-08T08:20:24.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.658+0000 7f4d037fe640 1 -- 172.21.15.88:0/3288040600 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1400aa30 con 0x7f4d1c158750 2023-12-08T08:20:24.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.658+0000 7f4d21616640 1 -- 172.21.15.88:0/3288040600 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d0c009420 con 0x7f4d1c158750 2023-12-08T08:20:24.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.658+0000 7f4d21616640 1 -- 172.21.15.88:0/3288040600 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1c0ab9a0 con 0x7f4d1c158750 2023-12-08T08:20:24.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.658+0000 7f4d21616640 1 -- 172.21.15.88:0/3288040600 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d1c0abbc0 con 0x7f4d1c158750 2023-12-08T08:20:24.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.662+0000 7f4d037fe640 1 -- 172.21.15.88:0/3288040600 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4d1400ab90 con 0x7f4d1c158750 2023-12-08T08:20:24.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.662+0000 7f4d037fe640 1 --2- 172.21.15.88:0/3288040600 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4d08066470 0x7f4d08068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:24.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.662+0000 7f4d037fe640 1 -- 172.21.15.88:0/3288040600 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d14083cb0 con 0x7f4d1c158750 2023-12-08T08:20:24.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.662+0000 7f4d1affd640 1 --2- 172.21.15.88:0/3288040600 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4d08066470 0x7f4d08068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:24.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.662+0000 7f4d1affd640 1 --2- 172.21.15.88:0/3288040600 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4d08066470 0x7f4d08068930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0af000 tx=0x7f4d0c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:24.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.666+0000 7f4d037fe640 1 -- 172.21.15.88:0/3288040600 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4d14051120 con 0x7f4d1c158750 2023-12-08T08:20:24.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.818+0000 7f4d21616640 1 -- 172.21.15.88:0/3288040600 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d1c0674b0 con 0x7f4d1c158750 2023-12-08T08:20:24.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.818+0000 7f4d037fe640 1 -- 172.21.15.88:0/3288040600 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7f4d14054740 con 0x7f4d1c158750 2023-12-08T08:20:24.824 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:24.824 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:20:21.492555+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:18.675917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:19.511013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:24.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.822+0000 7f4d21616640 1 -- 172.21.15.88:0/3288040600 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4d08066470 msgr2=0x7f4d08068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:24.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.822+0000 7f4d21616640 1 --2- 172.21.15.88:0/3288040600 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4d08066470 0x7f4d08068930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0af000 tx=0x7f4d0c0a7000 comp rx=0 tx=0).stop 2023-12-08T08:20:24.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.822+0000 7f4d21616640 1 -- 172.21.15.88:0/3288040600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d1c158750 msgr2=0x7f4d1c143180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:24.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.822+0000 7f4d21616640 1 --2- 172.21.15.88:0/3288040600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d1c158750 0x7f4d1c143180 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4d1400c730 tx=0x7f4d1400cbf0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.822+0000 7f4d21616640 1 -- 172.21.15.88:0/3288040600 shutdown_connections 2023-12-08T08:20:24.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.822+0000 7f4d21616640 1 --2- 172.21.15.88:0/3288040600 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4d08066470 0x7f4d08068930 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.822+0000 7f4d21616640 1 --2- 172.21.15.88:0/3288040600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d1c158750 0x7f4d1c143180 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.822+0000 7f4d21616640 1 --2- 172.21.15.88:0/3288040600 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d1c0ca3c0 0x7f4d1c0abec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.822+0000 7f4d21616640 1 --2- 172.21.15.88:0/3288040600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d1c0c7dd0 0x7f4d1c1567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.822+0000 7f4d21616640 1 -- 172.21.15.88:0/3288040600 >> 172.21.15.88:0/3288040600 conn(0x7f4d1c0666a0 msgr2=0x7f4d1c0c8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:24.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.822+0000 7f4d21616640 1 -- 172.21.15.88:0/3288040600 shutdown_connections 2023-12-08T08:20:24.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.822+0000 7f4d21616640 1 -- 172.21.15.88:0/3288040600 wait complete. 2023-12-08T08:20:24.847 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-08T08:20:24.847 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:20:24.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.982+0000 7fd17c832640 1 Processor -- start 2023-12-08T08:20:24.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.982+0000 7fd17c832640 1 -- start start 2023-12-08T08:20:24.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.982+0000 7fd17c832640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd17806bef0 0x7fd1780bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:24.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.982+0000 7fd17c832640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd17806c5b0 0x7fd17806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:24.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.982+0000 7fd17c832640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd178151690 con 0x7fd17814e3f0 2023-12-08T08:20:24.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.982+0000 7fd17c832640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd178151bc0 con 0x7fd17806c5b0 2023-12-08T08:20:24.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.982+0000 7fd17c832640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1781518e0 con 0x7fd17806bef0 2023-12-08T08:20:24.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.982+0000 7fd176d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd17806c5b0 0x7fd17806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:24.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.982+0000 7fd176d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd17806c5b0 0x7fd17806ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39794/0 (socket says 172.21.15.88:39794) 2023-12-08T08:20:24.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.982+0000 7fd176d9d640 1 -- 172.21.15.88:0/1407527430 learned_addr learned my addr 172.21.15.88:0/1407527430 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:24.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.982+0000 7fd16dd9b640 1 --2- 172.21.15.88:0/1407527430 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd17806bef0 0x7fd1780bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:24.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.982+0000 7fd176d9d640 1 -- 172.21.15.88:0/1407527430 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd17806bef0 msgr2=0x7fd1780bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:24.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.982+0000 7fd176d9d640 1 --2- 172.21.15.88:0/1407527430 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd17806bef0 0x7fd1780bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.982+0000 7fd176d9d640 1 -- 172.21.15.88:0/1407527430 >> v1:172.21.15.148:6789/0 conn(0x7fd17814e3f0 legacy=0x7fd1780c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:24.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.982+0000 7fd176d9d640 1 -- 172.21.15.88:0/1407527430 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1780c1de0 con 0x7fd17806c5b0 2023-12-08T08:20:24.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.986+0000 7fd176d9d640 1 --2- 172.21.15.88:0/1407527430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd17806c5b0 0x7fd17806ca40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd170009e50 tx=0x7fd17001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87eaa82fdde74330 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:24.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.986+0000 7fd175d9b640 1 -- 172.21.15.88:0/1407527430 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1700a5590 con 0x7fd17806c5b0 2023-12-08T08:20:24.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.986+0000 7fd175d9b640 1 -- 172.21.15.88:0/1407527430 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1700a56f0 con 0x7fd17806c5b0 2023-12-08T08:20:24.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.986+0000 7fd175d9b640 1 -- 172.21.15.88:0/1407527430 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1700a5a80 con 0x7fd17806c5b0 2023-12-08T08:20:24.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.986+0000 7fd17c832640 1 -- 172.21.15.88:0/1407527430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd17806c5b0 msgr2=0x7fd17806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:24.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.986+0000 7fd17c832640 1 --2- 172.21.15.88:0/1407527430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd17806c5b0 0x7fd17806ca40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd170009e50 tx=0x7fd17001c950 comp rx=0 tx=0).stop 2023-12-08T08:20:24.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.986+0000 7fd17c832640 1 -- 172.21.15.88:0/1407527430 shutdown_connections 2023-12-08T08:20:24.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.986+0000 7fd17c832640 1 --2- 172.21.15.88:0/1407527430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd17806c5b0 0x7fd17806ca40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.986+0000 7fd17c832640 1 --2- 172.21.15.88:0/1407527430 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd17806bef0 0x7fd1780bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.986+0000 7fd17c832640 1 -- 172.21.15.88:0/1407527430 >> 172.21.15.88:0/1407527430 conn(0x7fd1780a7810 msgr2=0x7fd1780a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:24.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.986+0000 7fd17c832640 1 -- 172.21.15.88:0/1407527430 shutdown_connections 2023-12-08T08:20:24.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.986+0000 7fd17c832640 1 -- 172.21.15.88:0/1407527430 wait complete. 2023-12-08T08:20:24.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.990+0000 7fd17c832640 1 Processor -- start 2023-12-08T08:20:24.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.990+0000 7fd17c832640 1 -- start start 2023-12-08T08:20:24.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.990+0000 7fd17c832640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd17806bef0 0x7fd178141ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:24.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.990+0000 7fd17c832640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd17806c5b0 0x7fd17813fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:24.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.990+0000 7fd17c832640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd17814e3f0 0x7fd1781402b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:24.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.990+0000 7fd17c832640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd178150680 con 0x7fd17806bef0 2023-12-08T08:20:24.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.990+0000 7fd17c832640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17815d5d0 con 0x7fd17814e3f0 2023-12-08T08:20:24.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.990+0000 7fd17c832640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1781407f0 con 0x7fd17806c5b0 2023-12-08T08:20:24.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.990+0000 7fd17659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd17806bef0 0x7fd178141ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:24.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.990+0000 7fd17659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd17806bef0 0x7fd178141ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39806/0 (socket says 172.21.15.88:39806) 2023-12-08T08:20:24.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.990+0000 7fd17659c640 1 -- 172.21.15.88:0/853444202 learned_addr learned my addr 172.21.15.88:0/853444202 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:24.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.990+0000 7fd16dd9b640 1 --2- 172.21.15.88:0/853444202 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd17806c5b0 0x7fd17813fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:24.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.990+0000 7fd176d9d640 1 --2- 172.21.15.88:0/853444202 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd17814e3f0 0x7fd1781402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:24.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.990+0000 7fd17659c640 1 -- 172.21.15.88:0/853444202 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd17806c5b0 msgr2=0x7fd17813fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:24.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.990+0000 7fd17659c640 1 --2- 172.21.15.88:0/853444202 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd17806c5b0 0x7fd17813fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.990+0000 7fd17659c640 1 -- 172.21.15.88:0/853444202 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd17814e3f0 msgr2=0x7fd1781402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:24.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.990+0000 7fd17659c640 1 --2- 172.21.15.88:0/853444202 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd17814e3f0 0x7fd1781402b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.990+0000 7fd17659c640 1 -- 172.21.15.88:0/853444202 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd170009b30 con 0x7fd17806bef0 2023-12-08T08:20:24.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.990+0000 7fd17659c640 1 --2- 172.21.15.88:0/853444202 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd17806bef0 0x7fd178141ea0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd16000c3f0 tx=0x7fd16000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:24.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.990+0000 7fd16f7fe640 1 -- 172.21.15.88:0/853444202 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1600052d0 con 0x7fd17806bef0 2023-12-08T08:20:24.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.990+0000 7fd16f7fe640 1 -- 172.21.15.88:0/853444202 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd160005430 con 0x7fd17806bef0 2023-12-08T08:20:24.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.990+0000 7fd16f7fe640 1 -- 172.21.15.88:0/853444202 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd160003840 con 0x7fd17806bef0 2023-12-08T08:20:24.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.990+0000 7fd17c832640 1 -- 172.21.15.88:0/853444202 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd178150b70 con 0x7fd17806bef0 2023-12-08T08:20:24.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.990+0000 7fd17c832640 1 -- 172.21.15.88:0/853444202 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd178150890 con 0x7fd17806bef0 2023-12-08T08:20:24.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.994+0000 7fd17c832640 1 -- 172.21.15.88:0/853444202 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1780c1760 con 0x7fd17806bef0 2023-12-08T08:20:24.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.994+0000 7fd16f7fe640 1 -- 172.21.15.88:0/853444202 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd1600039a0 con 0x7fd17806bef0 2023-12-08T08:20:24.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.994+0000 7fd16f7fe640 1 --2- 172.21.15.88:0/853444202 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd158066470 0x7fd158068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:24.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.994+0000 7fd16f7fe640 1 -- 172.21.15.88:0/853444202 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1600833b0 con 0x7fd17806bef0 2023-12-08T08:20:24.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.994+0000 7fd16dd9b640 1 --2- 172.21.15.88:0/853444202 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd158066470 0x7fd158068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:24.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.994+0000 7fd16dd9b640 1 --2- 172.21.15.88:0/853444202 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd158066470 0x7fd158068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd17815e7b0 tx=0x7fd168008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:25.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:24.998+0000 7fd16f7fe640 1 -- 172.21.15.88:0/853444202 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd1600508a0 con 0x7fd17806bef0 2023-12-08T08:20:25.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.146+0000 7fd17c832640 1 -- 172.21.15.88:0/853444202 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd17815f7e0 con 0x7fd158066470 2023-12-08T08:20:25.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.154+0000 7fd16f7fe640 1 -- 172.21.15.88:0/853444202 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264742 (secure 0 0 0) 0x7fd16800b670 con 0x7fd158066470 2023-12-08T08:20:25.160 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:25.165 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:20:25.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.158+0000 7fd17c832640 1 -- 172.21.15.88:0/853444202 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd158066470 msgr2=0x7fd158068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:25.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.158+0000 7fd17c832640 1 --2- 172.21.15.88:0/853444202 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd158066470 0x7fd158068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd17815e7b0 tx=0x7fd168008040 comp rx=0 tx=0).stop 2023-12-08T08:20:25.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.158+0000 7fd17c832640 1 -- 172.21.15.88:0/853444202 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd17806bef0 msgr2=0x7fd178141ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:25.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.158+0000 7fd17c832640 1 --2- 172.21.15.88:0/853444202 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd17806bef0 0x7fd178141ea0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd16000c3f0 tx=0x7fd16000c8b0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.158+0000 7fd17c832640 1 -- 172.21.15.88:0/853444202 shutdown_connections 2023-12-08T08:20:25.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.158+0000 7fd17c832640 1 --2- 172.21.15.88:0/853444202 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd158066470 0x7fd158068930 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.158+0000 7fd17c832640 1 --2- 172.21.15.88:0/853444202 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd17814e3f0 0x7fd1781402b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.158+0000 7fd17c832640 1 --2- 172.21.15.88:0/853444202 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd17806c5b0 0x7fd17813fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.158+0000 7fd17c832640 1 --2- 172.21.15.88:0/853444202 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd17806bef0 0x7fd178141ea0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.158+0000 7fd17c832640 1 -- 172.21.15.88:0/853444202 >> 172.21.15.88:0/853444202 conn(0x7fd1780a7810 msgr2=0x7fd17814cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:25.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.158+0000 7fd17c832640 1 -- 172.21.15.88:0/853444202 shutdown_connections 2023-12-08T08:20:25.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.158+0000 7fd17c832640 1 -- 172.21.15.88:0/853444202 wait complete. 2023-12-08T08:20:25.183 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-12-08T08:20:24.742268+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":144,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":217972,"kb_used_data":1780,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756748,"statfs":{"total":773094113280,"available":772870909952,"internally_reserved":0,"allocated":1822720,"data_stored":1746536,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.655799"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957451+0000","last_change":"2023-12-08T08:20:20.526014+0000","last_active":"2023-12-08T08:20:21.957451+0000","last_peered":"2023-12-08T08:20:21.957451+0000","last_clean":"2023-12-08T08:20:21.957451+0000","last_became_active":"2023-12-08T08:20:20.525310+0000","last_became_peered":"2023-12-08T08:20:20.525310+0000","last_unstale":"2023-12-08T08:20:21.957451+0000","last_undegraded":"2023-12-08T08:20:21.957451+0000","last_fullsized":"2023-12-08T08:20:21.957451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:04.925519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503721+0000","last_change":"2023-12-08T08:20:20.515314+0000","last_active":"2023-12-08T08:20:21.503721+0000","last_peered":"2023-12-08T08:20:21.503721+0000","last_clean":"2023-12-08T08:20:21.503721+0000","last_became_active":"2023-12-08T08:20:20.512640+0000","last_became_peered":"2023-12-08T08:20:20.512640+0000","last_unstale":"2023-12-08T08:20:21.503721+0000","last_undegraded":"2023-12-08T08:20:21.503721+0000","last_fullsized":"2023-12-08T08:20:21.503721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:58.484542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713375+0000","last_change":"2023-12-08T08:20:20.506916+0000","last_active":"2023-12-08T08:20:21.713375+0000","last_peered":"2023-12-08T08:20:21.713375+0000","last_clean":"2023-12-08T08:20:21.713375+0000","last_became_active":"2023-12-08T08:20:20.506640+0000","last_became_peered":"2023-12-08T08:20:20.506640+0000","last_unstale":"2023-12-08T08:20:21.713375+0000","last_undegraded":"2023-12-08T08:20:21.713375+0000","last_fullsized":"2023-12-08T08:20:21.713375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:35:49.495548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214804+0000","last_change":"2023-12-08T08:20:20.526830+0000","last_active":"2023-12-08T08:20:22.214804+0000","last_peered":"2023-12-08T08:20:22.214804+0000","last_clean":"2023-12-08T08:20:22.214804+0000","last_became_active":"2023-12-08T08:20:20.522810+0000","last_became_peered":"2023-12-08T08:20:20.522810+0000","last_unstale":"2023-12-08T08:20:22.214804+0000","last_undegraded":"2023-12-08T08:20:22.214804+0000","last_fullsized":"2023-12-08T08:20:22.214804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:12:06.866332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957064+0000","last_change":"2023-12-08T08:20:20.515029+0000","last_active":"2023-12-08T08:20:21.957064+0000","last_peered":"2023-12-08T08:20:21.957064+0000","last_clean":"2023-12-08T08:20:21.957064+0000","last_became_active":"2023-12-08T08:20:20.514648+0000","last_became_peered":"2023-12-08T08:20:20.514648+0000","last_unstale":"2023-12-08T08:20:21.957064+0000","last_undegraded":"2023-12-08T08:20:21.957064+0000","last_fullsized":"2023-12-08T08:20:21.957064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:35:44.144209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214602+0000","last_change":"2023-12-08T08:20:20.519487+0000","last_active":"2023-12-08T08:20:22.214602+0000","last_peered":"2023-12-08T08:20:22.214602+0000","last_clean":"2023-12-08T08:20:22.214602+0000","last_became_active":"2023-12-08T08:20:20.518543+0000","last_became_peered":"2023-12-08T08:20:20.518543+0000","last_unstale":"2023-12-08T08:20:22.214602+0000","last_undegraded":"2023-12-08T08:20:22.214602+0000","last_fullsized":"2023-12-08T08:20:22.214602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:58.484542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.956995+0000","last_change":"2023-12-08T08:20:20.522151+0000","last_active":"2023-12-08T08:20:21.956995+0000","last_peered":"2023-12-08T08:20:21.956995+0000","last_clean":"2023-12-08T08:20:21.956995+0000","last_became_active":"2023-12-08T08:20:20.521736+0000","last_became_peered":"2023-12-08T08:20:20.521736+0000","last_unstale":"2023-12-08T08:20:21.956995+0000","last_undegraded":"2023-12-08T08:20:21.956995+0000","last_fullsized":"2023-12-08T08:20:21.956995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:12:06.866332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213278+0000","last_change":"2023-12-08T08:20:20.529673+0000","last_active":"2023-12-08T08:20:22.213278+0000","last_peered":"2023-12-08T08:20:22.213278+0000","last_clean":"2023-12-08T08:20:22.213278+0000","last_became_active":"2023-12-08T08:20:20.529379+0000","last_became_peered":"2023-12-08T08:20:20.529379+0000","last_unstale":"2023-12-08T08:20:22.213278+0000","last_undegraded":"2023-12-08T08:20:22.213278+0000","last_fullsized":"2023-12-08T08:20:22.213278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:35:49.495548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957552+0000","last_change":"2023-12-08T08:20:20.525718+0000","last_active":"2023-12-08T08:20:21.957552+0000","last_peered":"2023-12-08T08:20:21.957552+0000","last_clean":"2023-12-08T08:20:21.957552+0000","last_became_active":"2023-12-08T08:20:20.524881+0000","last_became_peered":"2023-12-08T08:20:20.524881+0000","last_unstale":"2023-12-08T08:20:21.957552+0000","last_undegraded":"2023-12-08T08:20:21.957552+0000","last_fullsized":"2023-12-08T08:20:21.957552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:18:00.048146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672553+0000","last_change":"2023-12-08T08:20:20.527390+0000","last_active":"2023-12-08T08:20:21.672553+0000","last_peered":"2023-12-08T08:20:21.672553+0000","last_clean":"2023-12-08T08:20:21.672553+0000","last_became_active":"2023-12-08T08:20:20.527081+0000","last_became_peered":"2023-12-08T08:20:20.527081+0000","last_unstale":"2023-12-08T08:20:21.672553+0000","last_undegraded":"2023-12-08T08:20:21.672553+0000","last_fullsized":"2023-12-08T08:20:21.672553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:58.484542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672274+0000","last_change":"2023-12-08T08:20:20.529477+0000","last_active":"2023-12-08T08:20:21.672274+0000","last_peered":"2023-12-08T08:20:21.672274+0000","last_clean":"2023-12-08T08:20:21.672274+0000","last_became_active":"2023-12-08T08:20:20.529203+0000","last_became_peered":"2023-12-08T08:20:20.529203+0000","last_unstale":"2023-12-08T08:20:21.672274+0000","last_undegraded":"2023-12-08T08:20:21.672274+0000","last_fullsized":"2023-12-08T08:20:21.672274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:55.605759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.510398+0000","last_change":"2023-12-08T08:20:20.513949+0000","last_active":"2023-12-08T08:20:21.510398+0000","last_peered":"2023-12-08T08:20:21.510398+0000","last_clean":"2023-12-08T08:20:21.510398+0000","last_became_active":"2023-12-08T08:20:20.509753+0000","last_became_peered":"2023-12-08T08:20:20.509753+0000","last_unstale":"2023-12-08T08:20:21.510398+0000","last_undegraded":"2023-12-08T08:20:21.510398+0000","last_fullsized":"2023-12-08T08:20:21.510398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:14:24.713628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213771+0000","last_change":"2023-12-08T08:20:20.528560+0000","last_active":"2023-12-08T08:20:22.213771+0000","last_peered":"2023-12-08T08:20:22.213771+0000","last_clean":"2023-12-08T08:20:22.213771+0000","last_became_active":"2023-12-08T08:20:20.528307+0000","last_became_peered":"2023-12-08T08:20:20.528307+0000","last_unstale":"2023-12-08T08:20:22.213771+0000","last_undegraded":"2023-12-08T08:20:22.213771+0000","last_fullsized":"2023-12-08T08:20:22.213771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:58.484542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713275+0000","last_change":"2023-12-08T08:20:20.512007+0000","last_active":"2023-12-08T08:20:21.713275+0000","last_peered":"2023-12-08T08:20:21.713275+0000","last_clean":"2023-12-08T08:20:21.713275+0000","last_became_active":"2023-12-08T08:20:20.511687+0000","last_became_peered":"2023-12-08T08:20:20.511687+0000","last_unstale":"2023-12-08T08:20:21.713275+0000","last_undegraded":"2023-12-08T08:20:21.713275+0000","last_fullsized":"2023-12-08T08:20:21.713275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:07:36.889410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503433+0000","last_change":"2023-12-08T08:20:20.515089+0000","last_active":"2023-12-08T08:20:21.503433+0000","last_peered":"2023-12-08T08:20:21.503433+0000","last_clean":"2023-12-08T08:20:21.503433+0000","last_became_active":"2023-12-08T08:20:20.514657+0000","last_became_peered":"2023-12-08T08:20:20.514657+0000","last_unstale":"2023-12-08T08:20:21.503433+0000","last_undegraded":"2023-12-08T08:20:21.503433+0000","last_fullsized":"2023-12-08T08:20:21.503433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:55.605759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214490+0000","last_change":"2023-12-08T08:20:20.518410+0000","last_active":"2023-12-08T08:20:22.214490+0000","last_peered":"2023-12-08T08:20:22.214490+0000","last_clean":"2023-12-08T08:20:22.214490+0000","last_became_active":"2023-12-08T08:20:20.518144+0000","last_became_peered":"2023-12-08T08:20:20.518144+0000","last_unstale":"2023-12-08T08:20:22.214490+0000","last_undegraded":"2023-12-08T08:20:22.214490+0000","last_fullsized":"2023-12-08T08:20:22.214490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:16:30.037506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.215317+0000","last_change":"2023-12-08T08:20:20.524234+0000","last_active":"2023-12-08T08:20:22.215317+0000","last_peered":"2023-12-08T08:20:22.215317+0000","last_clean":"2023-12-08T08:20:22.215317+0000","last_became_active":"2023-12-08T08:20:20.523988+0000","last_became_peered":"2023-12-08T08:20:20.523988+0000","last_unstale":"2023-12-08T08:20:22.215317+0000","last_undegraded":"2023-12-08T08:20:22.215317+0000","last_fullsized":"2023-12-08T08:20:22.215317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:04.925519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213689+0000","last_change":"2023-12-08T08:20:20.509163+0000","last_active":"2023-12-08T08:20:22.213689+0000","last_peered":"2023-12-08T08:20:22.213689+0000","last_clean":"2023-12-08T08:20:22.213689+0000","last_became_active":"2023-12-08T08:20:20.508891+0000","last_became_peered":"2023-12-08T08:20:20.508891+0000","last_unstale":"2023-12-08T08:20:22.213689+0000","last_undegraded":"2023-12-08T08:20:22.213689+0000","last_fullsized":"2023-12-08T08:20:22.213689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:14:24.713628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957438+0000","last_change":"2023-12-08T08:20:20.523793+0000","last_active":"2023-12-08T08:20:21.957438+0000","last_peered":"2023-12-08T08:20:21.957438+0000","last_clean":"2023-12-08T08:20:21.957438+0000","last_became_active":"2023-12-08T08:20:20.523526+0000","last_became_peered":"2023-12-08T08:20:20.523526+0000","last_unstale":"2023-12-08T08:20:21.957438+0000","last_undegraded":"2023-12-08T08:20:21.957438+0000","last_fullsized":"2023-12-08T08:20:21.957438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:52:56.239687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672374+0000","last_change":"2023-12-08T08:20:20.515864+0000","last_active":"2023-12-08T08:20:21.672374+0000","last_peered":"2023-12-08T08:20:21.672374+0000","last_clean":"2023-12-08T08:20:21.672374+0000","last_became_active":"2023-12-08T08:20:20.515572+0000","last_became_peered":"2023-12-08T08:20:20.515572+0000","last_unstale":"2023-12-08T08:20:21.672374+0000","last_undegraded":"2023-12-08T08:20:21.672374+0000","last_fullsized":"2023-12-08T08:20:21.672374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:16:30.037506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713276+0000","last_change":"2023-12-08T08:20:20.514531+0000","last_active":"2023-12-08T08:20:21.713276+0000","last_peered":"2023-12-08T08:20:21.713276+0000","last_clean":"2023-12-08T08:20:21.713276+0000","last_became_active":"2023-12-08T08:20:20.514275+0000","last_became_peered":"2023-12-08T08:20:20.514275+0000","last_unstale":"2023-12-08T08:20:21.713276+0000","last_undegraded":"2023-12-08T08:20:21.713276+0000","last_fullsized":"2023-12-08T08:20:21.713276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:24:45.197087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214695+0000","last_change":"2023-12-08T08:20:20.523484+0000","last_active":"2023-12-08T08:20:22.214695+0000","last_peered":"2023-12-08T08:20:22.214695+0000","last_clean":"2023-12-08T08:20:22.214695+0000","last_became_active":"2023-12-08T08:20:20.523161+0000","last_became_peered":"2023-12-08T08:20:20.523161+0000","last_unstale":"2023-12-08T08:20:22.214695+0000","last_undegraded":"2023-12-08T08:20:22.214695+0000","last_fullsized":"2023-12-08T08:20:22.214695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:34:40.228006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213314+0000","last_change":"2023-12-08T08:20:20.530871+0000","last_active":"2023-12-08T08:20:22.213314+0000","last_peered":"2023-12-08T08:20:22.213314+0000","last_clean":"2023-12-08T08:20:22.213314+0000","last_became_active":"2023-12-08T08:20:20.530604+0000","last_became_peered":"2023-12-08T08:20:20.530604+0000","last_unstale":"2023-12-08T08:20:22.213314+0000","last_undegraded":"2023-12-08T08:20:22.213314+0000","last_fullsized":"2023-12-08T08:20:22.213314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:55.605759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214573+0000","last_change":"2023-12-08T08:20:20.522332+0000","last_active":"2023-12-08T08:20:22.214573+0000","last_peered":"2023-12-08T08:20:22.214573+0000","last_clean":"2023-12-08T08:20:22.214573+0000","last_became_active":"2023-12-08T08:20:20.522036+0000","last_became_peered":"2023-12-08T08:20:20.522036+0000","last_unstale":"2023-12-08T08:20:22.214573+0000","last_undegraded":"2023-12-08T08:20:22.214573+0000","last_fullsized":"2023-12-08T08:20:22.214573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:41:18.155537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213974+0000","last_change":"2023-12-08T08:20:20.528859+0000","last_active":"2023-12-08T08:20:22.213974+0000","last_peered":"2023-12-08T08:20:22.213974+0000","last_clean":"2023-12-08T08:20:22.213974+0000","last_became_active":"2023-12-08T08:20:20.528595+0000","last_became_peered":"2023-12-08T08:20:20.528595+0000","last_unstale":"2023-12-08T08:20:22.213974+0000","last_undegraded":"2023-12-08T08:20:22.213974+0000","last_fullsized":"2023-12-08T08:20:22.213974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:12:06.866332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672548+0000","last_change":"2023-12-08T08:20:20.519122+0000","last_active":"2023-12-08T08:20:21.672548+0000","last_peered":"2023-12-08T08:20:21.672548+0000","last_clean":"2023-12-08T08:20:21.672548+0000","last_became_active":"2023-12-08T08:20:20.518790+0000","last_became_peered":"2023-12-08T08:20:20.518790+0000","last_unstale":"2023-12-08T08:20:21.672548+0000","last_undegraded":"2023-12-08T08:20:21.672548+0000","last_fullsized":"2023-12-08T08:20:21.672548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:41:18.155537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503627+0000","last_change":"2023-12-08T08:20:20.511207+0000","last_active":"2023-12-08T08:20:21.503627+0000","last_peered":"2023-12-08T08:20:21.503627+0000","last_clean":"2023-12-08T08:20:21.503627+0000","last_became_active":"2023-12-08T08:20:20.509613+0000","last_became_peered":"2023-12-08T08:20:20.509613+0000","last_unstale":"2023-12-08T08:20:21.503627+0000","last_undegraded":"2023-12-08T08:20:21.503627+0000","last_fullsized":"2023-12-08T08:20:21.503627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:41:18.155537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213986+0000","last_change":"2023-12-08T08:20:20.529699+0000","last_active":"2023-12-08T08:20:22.213986+0000","last_peered":"2023-12-08T08:20:22.213986+0000","last_clean":"2023-12-08T08:20:22.213986+0000","last_became_active":"2023-12-08T08:20:20.528976+0000","last_became_peered":"2023-12-08T08:20:20.528976+0000","last_unstale":"2023-12-08T08:20:22.213986+0000","last_undegraded":"2023-12-08T08:20:22.213986+0000","last_fullsized":"2023-12-08T08:20:22.213986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:35:44.144209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713583+0000","last_change":"2023-12-08T08:20:20.513060+0000","last_active":"2023-12-08T08:20:21.713583+0000","last_peered":"2023-12-08T08:20:21.713583+0000","last_clean":"2023-12-08T08:20:21.713583+0000","last_became_active":"2023-12-08T08:20:20.512637+0000","last_became_peered":"2023-12-08T08:20:20.512637+0000","last_unstale":"2023-12-08T08:20:21.713583+0000","last_undegraded":"2023-12-08T08:20:21.713583+0000","last_fullsized":"2023-12-08T08:20:21.713583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:58.484542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214832+0000","last_change":"2023-12-08T08:20:20.521987+0000","last_active":"2023-12-08T08:20:22.214832+0000","last_peered":"2023-12-08T08:20:22.214832+0000","last_clean":"2023-12-08T08:20:22.214832+0000","last_became_active":"2023-12-08T08:20:20.521639+0000","last_became_peered":"2023-12-08T08:20:20.521639+0000","last_unstale":"2023-12-08T08:20:22.214832+0000","last_undegraded":"2023-12-08T08:20:22.214832+0000","last_fullsized":"2023-12-08T08:20:22.214832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:35:44.144209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213304+0000","last_change":"2023-12-08T08:20:20.518482+0000","last_active":"2023-12-08T08:20:22.213304+0000","last_peered":"2023-12-08T08:20:22.213304+0000","last_clean":"2023-12-08T08:20:22.213304+0000","last_became_active":"2023-12-08T08:20:20.518190+0000","last_became_peered":"2023-12-08T08:20:20.518190+0000","last_unstale":"2023-12-08T08:20:22.213304+0000","last_undegraded":"2023-12-08T08:20:22.213304+0000","last_fullsized":"2023-12-08T08:20:22.213304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:14:43.007025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672162+0000","last_change":"2023-12-08T08:20:20.515939+0000","last_active":"2023-12-08T08:20:21.672162+0000","last_peered":"2023-12-08T08:20:21.672162+0000","last_clean":"2023-12-08T08:20:21.672162+0000","last_became_active":"2023-12-08T08:20:20.515314+0000","last_became_peered":"2023-12-08T08:20:20.515314+0000","last_unstale":"2023-12-08T08:20:21.672162+0000","last_undegraded":"2023-12-08T08:20:21.672162+0000","last_fullsized":"2023-12-08T08:20:21.672162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:35:49.495548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.510090+0000","last_change":"2023-12-08T08:20:20.517465+0000","last_active":"2023-12-08T08:20:21.510090+0000","last_peered":"2023-12-08T08:20:21.510090+0000","last_clean":"2023-12-08T08:20:21.510090+0000","last_became_active":"2023-12-08T08:20:20.517151+0000","last_became_peered":"2023-12-08T08:20:20.517151+0000","last_unstale":"2023-12-08T08:20:21.510090+0000","last_undegraded":"2023-12-08T08:20:21.510090+0000","last_fullsized":"2023-12-08T08:20:21.510090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:17:32.867357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213861+0000","last_change":"2023-12-08T08:20:20.127114+0000","last_active":"2023-12-08T08:20:22.213861+0000","last_peered":"2023-12-08T08:20:22.213861+0000","last_clean":"2023-12-08T08:20:22.213861+0000","last_became_active":"2023-12-08T08:20:20.126718+0000","last_became_peered":"2023-12-08T08:20:20.126718+0000","last_unstale":"2023-12-08T08:20:22.213861+0000","last_undegraded":"2023-12-08T08:20:22.213861+0000","last_fullsized":"2023-12-08T08:20:22.213861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:06:20.375858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713403+0000","last_change":"2023-12-08T08:20:20.511756+0000","last_active":"2023-12-08T08:20:21.713403+0000","last_peered":"2023-12-08T08:20:21.713403+0000","last_clean":"2023-12-08T08:20:21.713403+0000","last_became_active":"2023-12-08T08:20:20.511411+0000","last_became_peered":"2023-12-08T08:20:20.511411+0000","last_unstale":"2023-12-08T08:20:21.713403+0000","last_undegraded":"2023-12-08T08:20:21.713403+0000","last_fullsized":"2023-12-08T08:20:21.713403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:55.605759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672137+0000","last_change":"2023-12-08T08:20:20.119404+0000","last_active":"2023-12-08T08:20:21.672137+0000","last_peered":"2023-12-08T08:20:21.672137+0000","last_clean":"2023-12-08T08:20:21.672137+0000","last_became_active":"2023-12-08T08:20:20.119117+0000","last_became_peered":"2023-12-08T08:20:20.119117+0000","last_unstale":"2023-12-08T08:20:21.672137+0000","last_undegraded":"2023-12-08T08:20:21.672137+0000","last_fullsized":"2023-12-08T08:20:21.672137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:06:20.375858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213309+0000","last_change":"2023-12-08T08:20:20.118455+0000","last_active":"2023-12-08T08:20:22.213309+0000","last_peered":"2023-12-08T08:20:22.213309+0000","last_clean":"2023-12-08T08:20:22.213309+0000","last_became_active":"2023-12-08T08:20:20.118187+0000","last_became_peered":"2023-12-08T08:20:20.118187+0000","last_unstale":"2023-12-08T08:20:22.213309+0000","last_undegraded":"2023-12-08T08:20:22.213309+0000","last_fullsized":"2023-12-08T08:20:22.213309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:50:44.025429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213363+0000","last_change":"2023-12-08T08:20:20.519950+0000","last_active":"2023-12-08T08:20:22.213363+0000","last_peered":"2023-12-08T08:20:22.213363+0000","last_clean":"2023-12-08T08:20:22.213363+0000","last_became_active":"2023-12-08T08:20:20.519682+0000","last_became_peered":"2023-12-08T08:20:20.519682+0000","last_unstale":"2023-12-08T08:20:22.213363+0000","last_undegraded":"2023-12-08T08:20:22.213363+0000","last_fullsized":"2023-12-08T08:20:22.213363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:22.960211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214641+0000","last_change":"2023-12-08T08:20:20.125917+0000","last_active":"2023-12-08T08:20:22.214641+0000","last_peered":"2023-12-08T08:20:22.214641+0000","last_clean":"2023-12-08T08:20:22.214641+0000","last_became_active":"2023-12-08T08:20:20.125471+0000","last_became_peered":"2023-12-08T08:20:20.125471+0000","last_unstale":"2023-12-08T08:20:22.214641+0000","last_undegraded":"2023-12-08T08:20:22.214641+0000","last_fullsized":"2023-12-08T08:20:22.214641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:07:35.883797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503438+0000","last_change":"2023-12-08T08:20:20.514082+0000","last_active":"2023-12-08T08:20:21.503438+0000","last_peered":"2023-12-08T08:20:21.503438+0000","last_clean":"2023-12-08T08:20:21.503438+0000","last_became_active":"2023-12-08T08:20:20.511617+0000","last_became_peered":"2023-12-08T08:20:20.511617+0000","last_unstale":"2023-12-08T08:20:21.503438+0000","last_undegraded":"2023-12-08T08:20:21.503438+0000","last_fullsized":"2023-12-08T08:20:21.503438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:35:49.495548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672445+0000","last_change":"2023-12-08T08:20:20.117986+0000","last_active":"2023-12-08T08:20:21.672445+0000","last_peered":"2023-12-08T08:20:21.672445+0000","last_clean":"2023-12-08T08:20:21.672445+0000","last_became_active":"2023-12-08T08:20:20.117643+0000","last_became_peered":"2023-12-08T08:20:20.117643+0000","last_unstale":"2023-12-08T08:20:21.672445+0000","last_undegraded":"2023-12-08T08:20:21.672445+0000","last_fullsized":"2023-12-08T08:20:21.672445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:51:02.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.215153+0000","last_change":"2023-12-08T08:20:20.526658+0000","last_active":"2023-12-08T08:20:22.215153+0000","last_peered":"2023-12-08T08:20:22.215153+0000","last_clean":"2023-12-08T08:20:22.215153+0000","last_became_active":"2023-12-08T08:20:20.525963+0000","last_became_peered":"2023-12-08T08:20:20.525963+0000","last_unstale":"2023-12-08T08:20:22.215153+0000","last_undegraded":"2023-12-08T08:20:22.215153+0000","last_fullsized":"2023-12-08T08:20:22.215153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:34:32.364346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.215087+0000","last_change":"2023-12-08T08:20:20.119060+0000","last_active":"2023-12-08T08:20:22.215087+0000","last_peered":"2023-12-08T08:20:22.215087+0000","last_clean":"2023-12-08T08:20:22.215087+0000","last_became_active":"2023-12-08T08:20:20.118701+0000","last_became_peered":"2023-12-08T08:20:20.118701+0000","last_unstale":"2023-12-08T08:20:22.215087+0000","last_undegraded":"2023-12-08T08:20:22.215087+0000","last_fullsized":"2023-12-08T08:20:22.215087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:21.954598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713519+0000","last_change":"2023-12-08T08:20:20.530125+0000","last_active":"2023-12-08T08:20:21.713519+0000","last_peered":"2023-12-08T08:20:21.713519+0000","last_clean":"2023-12-08T08:20:21.713519+0000","last_became_active":"2023-12-08T08:20:20.529601+0000","last_became_peered":"2023-12-08T08:20:20.529601+0000","last_unstale":"2023-12-08T08:20:21.713519+0000","last_undegraded":"2023-12-08T08:20:21.713519+0000","last_fullsized":"2023-12-08T08:20:21.713519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:16:30.037506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503623+0000","last_change":"2023-12-08T08:20:20.118338+0000","last_active":"2023-12-08T08:20:21.503623+0000","last_peered":"2023-12-08T08:20:21.503623+0000","last_clean":"2023-12-08T08:20:21.503623+0000","last_became_active":"2023-12-08T08:20:20.118032+0000","last_became_peered":"2023-12-08T08:20:20.118032+0000","last_unstale":"2023-12-08T08:20:21.503623+0000","last_undegraded":"2023-12-08T08:20:21.503623+0000","last_fullsized":"2023-12-08T08:20:21.503623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:14:41.931523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.510480+0000","last_change":"2023-12-08T08:20:20.521236+0000","last_active":"2023-12-08T08:20:21.510480+0000","last_peered":"2023-12-08T08:20:21.510480+0000","last_clean":"2023-12-08T08:20:21.510480+0000","last_became_active":"2023-12-08T08:20:20.520900+0000","last_became_peered":"2023-12-08T08:20:20.520900+0000","last_unstale":"2023-12-08T08:20:21.510480+0000","last_undegraded":"2023-12-08T08:20:21.510480+0000","last_fullsized":"2023-12-08T08:20:21.510480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:51:03.805815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672410+0000","last_change":"2023-12-08T08:20:20.126955+0000","last_active":"2023-12-08T08:20:21.672410+0000","last_peered":"2023-12-08T08:20:21.672410+0000","last_clean":"2023-12-08T08:20:21.672410+0000","last_became_active":"2023-12-08T08:20:20.126629+0000","last_became_peered":"2023-12-08T08:20:20.126629+0000","last_unstale":"2023-12-08T08:20:21.672410+0000","last_undegraded":"2023-12-08T08:20:21.672410+0000","last_fullsized":"2023-12-08T08:20:21.672410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:14:41.931523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957190+0000","last_change":"2023-12-08T08:20:20.518442+0000","last_active":"2023-12-08T08:20:21.957190+0000","last_peered":"2023-12-08T08:20:21.957190+0000","last_clean":"2023-12-08T08:20:21.957190+0000","last_became_active":"2023-12-08T08:20:20.518033+0000","last_became_peered":"2023-12-08T08:20:20.518033+0000","last_unstale":"2023-12-08T08:20:21.957190+0000","last_undegraded":"2023-12-08T08:20:21.957190+0000","last_fullsized":"2023-12-08T08:20:21.957190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:34:32.364346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713480+0000","last_change":"2023-12-08T08:20:20.110330+0000","last_active":"2023-12-08T08:20:21.713480+0000","last_peered":"2023-12-08T08:20:21.713480+0000","last_clean":"2023-12-08T08:20:21.713480+0000","last_became_active":"2023-12-08T08:20:20.109870+0000","last_became_peered":"2023-12-08T08:20:20.109870+0000","last_unstale":"2023-12-08T08:20:21.713480+0000","last_undegraded":"2023-12-08T08:20:21.713480+0000","last_fullsized":"2023-12-08T08:20:21.713480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:01:11.293463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713167+0000","last_change":"2023-12-08T08:20:20.514723+0000","last_active":"2023-12-08T08:20:21.713167+0000","last_peered":"2023-12-08T08:20:21.713167+0000","last_clean":"2023-12-08T08:20:21.713167+0000","last_became_active":"2023-12-08T08:20:20.514377+0000","last_became_peered":"2023-12-08T08:20:20.514377+0000","last_unstale":"2023-12-08T08:20:21.713167+0000","last_undegraded":"2023-12-08T08:20:21.713167+0000","last_fullsized":"2023-12-08T08:20:21.713167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:06:21.381472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214843+0000","last_change":"2023-12-08T08:20:20.129684+0000","last_active":"2023-12-08T08:20:22.214843+0000","last_peered":"2023-12-08T08:20:22.214843+0000","last_clean":"2023-12-08T08:20:22.214843+0000","last_became_active":"2023-12-08T08:20:20.129423+0000","last_became_peered":"2023-12-08T08:20:20.129423+0000","last_unstale":"2023-12-08T08:20:22.214843+0000","last_undegraded":"2023-12-08T08:20:22.214843+0000","last_fullsized":"2023-12-08T08:20:22.214843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:24:44.191473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957171+0000","last_change":"2023-12-08T08:20:20.533071+0000","last_active":"2023-12-08T08:20:21.957171+0000","last_peered":"2023-12-08T08:20:21.957171+0000","last_clean":"2023-12-08T08:20:21.957171+0000","last_became_active":"2023-12-08T08:20:20.532811+0000","last_became_peered":"2023-12-08T08:20:20.532811+0000","last_unstale":"2023-12-08T08:20:21.957171+0000","last_undegraded":"2023-12-08T08:20:21.957171+0000","last_fullsized":"2023-12-08T08:20:21.957171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:06.439860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672150+0000","last_change":"2023-12-08T08:20:20.113477+0000","last_active":"2023-12-08T08:20:21.672150+0000","last_peered":"2023-12-08T08:20:21.672150+0000","last_clean":"2023-12-08T08:20:21.672150+0000","last_became_active":"2023-12-08T08:20:20.113149+0000","last_became_peered":"2023-12-08T08:20:20.113149+0000","last_unstale":"2023-12-08T08:20:21.672150+0000","last_undegraded":"2023-12-08T08:20:21.672150+0000","last_fullsized":"2023-12-08T08:20:21.672150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:14:23.708015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672290+0000","last_change":"2023-12-08T08:20:20.519693+0000","last_active":"2023-12-08T08:20:21.672290+0000","last_peered":"2023-12-08T08:20:21.672290+0000","last_clean":"2023-12-08T08:20:21.672290+0000","last_became_active":"2023-12-08T08:20:20.519418+0000","last_became_peered":"2023-12-08T08:20:20.519418+0000","last_unstale":"2023-12-08T08:20:21.672290+0000","last_undegraded":"2023-12-08T08:20:21.672290+0000","last_fullsized":"2023-12-08T08:20:21.672290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:22.960211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213194+0000","last_change":"2023-12-08T08:20:20.106359+0000","last_active":"2023-12-08T08:20:22.213194+0000","last_peered":"2023-12-08T08:20:22.213194+0000","last_clean":"2023-12-08T08:20:22.213194+0000","last_became_active":"2023-12-08T08:20:20.106095+0000","last_became_peered":"2023-12-08T08:20:20.106095+0000","last_unstale":"2023-12-08T08:20:22.213194+0000","last_undegraded":"2023-12-08T08:20:22.213194+0000","last_fullsized":"2023-12-08T08:20:22.213194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:00:11.928203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957117+0000","last_change":"2023-12-08T08:20:20.528783+0000","last_active":"2023-12-08T08:20:21.957117+0000","last_peered":"2023-12-08T08:20:21.957117+0000","last_clean":"2023-12-08T08:20:21.957117+0000","last_became_active":"2023-12-08T08:20:20.528463+0000","last_became_peered":"2023-12-08T08:20:20.528463+0000","last_unstale":"2023-12-08T08:20:21.957117+0000","last_undegraded":"2023-12-08T08:20:21.957117+0000","last_fullsized":"2023-12-08T08:20:21.957117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:43:55.983858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.510372+0000","last_change":"2023-12-08T08:20:20.109998+0000","last_active":"2023-12-08T08:20:21.510372+0000","last_peered":"2023-12-08T08:20:21.510372+0000","last_clean":"2023-12-08T08:20:21.510372+0000","last_became_active":"2023-12-08T08:20:20.109580+0000","last_became_peered":"2023-12-08T08:20:20.109580+0000","last_unstale":"2023-12-08T08:20:21.510372+0000","last_undegraded":"2023-12-08T08:20:21.510372+0000","last_fullsized":"2023-12-08T08:20:21.510372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:17:10.702274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957486+0000","last_change":"2023-12-08T08:20:20.533736+0000","last_active":"2023-12-08T08:20:21.957486+0000","last_peered":"2023-12-08T08:20:21.957486+0000","last_clean":"2023-12-08T08:20:21.957486+0000","last_became_active":"2023-12-08T08:20:20.533508+0000","last_became_peered":"2023-12-08T08:20:20.533508+0000","last_unstale":"2023-12-08T08:20:21.957486+0000","last_undegraded":"2023-12-08T08:20:21.957486+0000","last_fullsized":"2023-12-08T08:20:21.957486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:22:44.822453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213618+0000","last_change":"2023-12-08T08:20:20.121251+0000","last_active":"2023-12-08T08:20:22.213618+0000","last_peered":"2023-12-08T08:20:22.213618+0000","last_clean":"2023-12-08T08:20:22.213618+0000","last_became_active":"2023-12-08T08:20:20.120767+0000","last_became_peered":"2023-12-08T08:20:20.120767+0000","last_unstale":"2023-12-08T08:20:22.213618+0000","last_undegraded":"2023-12-08T08:20:22.213618+0000","last_fullsized":"2023-12-08T08:20:22.213618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:17:31.861743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957582+0000","last_change":"2023-12-08T08:20:20.532439+0000","last_active":"2023-12-08T08:20:21.957582+0000","last_peered":"2023-12-08T08:20:21.957582+0000","last_clean":"2023-12-08T08:20:21.957582+0000","last_became_active":"2023-12-08T08:20:20.532120+0000","last_became_peered":"2023-12-08T08:20:20.532120+0000","last_unstale":"2023-12-08T08:20:21.957582+0000","last_undegraded":"2023-12-08T08:20:21.957582+0000","last_fullsized":"2023-12-08T08:20:21.957582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:54:51.364740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503714+0000","last_change":"2023-12-08T08:20:20.112322+0000","last_active":"2023-12-08T08:20:21.503714+0000","last_peered":"2023-12-08T08:20:21.503714+0000","last_clean":"2023-12-08T08:20:21.503714+0000","last_became_active":"2023-12-08T08:20:20.112023+0000","last_became_peered":"2023-12-08T08:20:20.112023+0000","last_unstale":"2023-12-08T08:20:21.503714+0000","last_undegraded":"2023-12-08T08:20:21.503714+0000","last_fullsized":"2023-12-08T08:20:21.503714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:50:44.025429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.215085+0000","last_change":"2023-12-08T08:20:20.524988+0000","last_active":"2023-12-08T08:20:22.215085+0000","last_peered":"2023-12-08T08:20:22.215085+0000","last_clean":"2023-12-08T08:20:22.215085+0000","last_became_active":"2023-12-08T08:20:20.522486+0000","last_became_peered":"2023-12-08T08:20:20.522486+0000","last_unstale":"2023-12-08T08:20:22.215085+0000","last_undegraded":"2023-12-08T08:20:22.215085+0000","last_fullsized":"2023-12-08T08:20:22.215085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:06.439860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213544+0000","last_change":"2023-12-08T08:20:20.112210+0000","last_active":"2023-12-08T08:20:22.213544+0000","last_peered":"2023-12-08T08:20:22.213544+0000","last_clean":"2023-12-08T08:20:22.213544+0000","last_became_active":"2023-12-08T08:20:20.111888+0000","last_became_peered":"2023-12-08T08:20:20.111888+0000","last_unstale":"2023-12-08T08:20:22.213544+0000","last_undegraded":"2023-12-08T08:20:22.213544+0000","last_fullsized":"2023-12-08T08:20:22.213544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:17:10.702274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957276+0000","last_change":"2023-12-08T08:20:20.530738+0000","last_active":"2023-12-08T08:20:21.957276+0000","last_peered":"2023-12-08T08:20:21.957276+0000","last_clean":"2023-12-08T08:20:21.957276+0000","last_became_active":"2023-12-08T08:20:20.530478+0000","last_became_peered":"2023-12-08T08:20:20.530478+0000","last_unstale":"2023-12-08T08:20:21.957276+0000","last_undegraded":"2023-12-08T08:20:21.957276+0000","last_fullsized":"2023-12-08T08:20:21.957276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:18.441827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-08T08:20:20.505097+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:20:20.505097+0000","last_peered":"2023-12-08T08:20:20.505097+0000","last_clean":"2023-12-08T08:20:20.505097+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:20:20.505097+0000","last_undegraded":"2023-12-08T08:20:20.505097+0000","last_fullsized":"2023-12-08T08:20:20.505097+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214696+0000","last_change":"2023-12-08T08:20:20.115839+0000","last_active":"2023-12-08T08:20:22.214696+0000","last_peered":"2023-12-08T08:20:22.214696+0000","last_clean":"2023-12-08T08:20:22.214696+0000","last_became_active":"2023-12-08T08:20:20.113312+0000","last_became_peered":"2023-12-08T08:20:20.113312+0000","last_unstale":"2023-12-08T08:20:22.214696+0000","last_undegraded":"2023-12-08T08:20:22.214696+0000","last_fullsized":"2023-12-08T08:20:22.214696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:35:48.489934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213600+0000","last_change":"2023-12-08T08:20:20.529095+0000","last_active":"2023-12-08T08:20:22.213600+0000","last_peered":"2023-12-08T08:20:22.213600+0000","last_clean":"2023-12-08T08:20:22.213600+0000","last_became_active":"2023-12-08T08:20:20.528833+0000","last_became_peered":"2023-12-08T08:20:20.528833+0000","last_unstale":"2023-12-08T08:20:22.213600+0000","last_undegraded":"2023-12-08T08:20:22.213600+0000","last_fullsized":"2023-12-08T08:20:22.213600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:41:18.155537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.956800+0000","last_change":"2023-12-08T08:20:20.127208+0000","last_active":"2023-12-08T08:20:21.956800+0000","last_peered":"2023-12-08T08:20:21.956800+0000","last_clean":"2023-12-08T08:20:21.956800+0000","last_became_active":"2023-12-08T08:20:20.126756+0000","last_became_peered":"2023-12-08T08:20:20.126756+0000","last_unstale":"2023-12-08T08:20:21.956800+0000","last_undegraded":"2023-12-08T08:20:21.956800+0000","last_fullsized":"2023-12-08T08:20:21.956800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:17:31.861743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713208+0000","last_change":"2023-12-08T08:20:20.505416+0000","last_active":"2023-12-08T08:20:21.713208+0000","last_peered":"2023-12-08T08:20:21.713208+0000","last_clean":"2023-12-08T08:20:21.713208+0000","last_became_active":"2023-12-08T08:20:20.505234+0000","last_became_peered":"2023-12-08T08:20:20.505234+0000","last_unstale":"2023-12-08T08:20:21.713208+0000","last_undegraded":"2023-12-08T08:20:21.713208+0000","last_fullsized":"2023-12-08T08:20:21.713208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:50:45.031043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213398+0000","last_change":"2023-12-08T08:20:20.124516+0000","last_active":"2023-12-08T08:20:22.213398+0000","last_peered":"2023-12-08T08:20:22.213398+0000","last_clean":"2023-12-08T08:20:22.213398+0000","last_became_active":"2023-12-08T08:20:20.119912+0000","last_became_peered":"2023-12-08T08:20:20.119912+0000","last_unstale":"2023-12-08T08:20:22.213398+0000","last_undegraded":"2023-12-08T08:20:22.213398+0000","last_fullsized":"2023-12-08T08:20:22.213398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:01:11.293463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503488+0000","last_change":"2023-12-08T08:20:20.514055+0000","last_active":"2023-12-08T08:20:21.503488+0000","last_peered":"2023-12-08T08:20:21.503488+0000","last_clean":"2023-12-08T08:20:21.503488+0000","last_became_active":"2023-12-08T08:20:20.511185+0000","last_became_peered":"2023-12-08T08:20:20.511185+0000","last_unstale":"2023-12-08T08:20:21.503488+0000","last_undegraded":"2023-12-08T08:20:21.503488+0000","last_fullsized":"2023-12-08T08:20:21.503488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:22.960211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214950+0000","last_change":"2023-12-08T08:20:20.129124+0000","last_active":"2023-12-08T08:20:22.214950+0000","last_peered":"2023-12-08T08:20:22.214950+0000","last_clean":"2023-12-08T08:20:22.214950+0000","last_became_active":"2023-12-08T08:20:20.128851+0000","last_became_peered":"2023-12-08T08:20:20.128851+0000","last_unstale":"2023-12-08T08:20:22.214950+0000","last_undegraded":"2023-12-08T08:20:22.214950+0000","last_fullsized":"2023-12-08T08:20:22.214950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:54.600146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.510286+0000","last_change":"2023-12-08T08:20:20.518546+0000","last_active":"2023-12-08T08:20:21.510286+0000","last_peered":"2023-12-08T08:20:21.510286+0000","last_clean":"2023-12-08T08:20:21.510286+0000","last_became_active":"2023-12-08T08:20:20.516272+0000","last_became_peered":"2023-12-08T08:20:20.516272+0000","last_unstale":"2023-12-08T08:20:21.510286+0000","last_undegraded":"2023-12-08T08:20:21.510286+0000","last_fullsized":"2023-12-08T08:20:21.510286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:14:43.007025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503676+0000","last_change":"2023-12-08T08:20:20.106320+0000","last_active":"2023-12-08T08:20:21.503676+0000","last_peered":"2023-12-08T08:20:21.503676+0000","last_clean":"2023-12-08T08:20:21.503676+0000","last_became_active":"2023-12-08T08:20:20.106039+0000","last_became_peered":"2023-12-08T08:20:20.106039+0000","last_unstale":"2023-12-08T08:20:21.503676+0000","last_undegraded":"2023-12-08T08:20:21.503676+0000","last_fullsized":"2023-12-08T08:20:21.503676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:51:02.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.215173+0000","last_change":"2023-12-08T08:20:20.520730+0000","last_active":"2023-12-08T08:20:22.215173+0000","last_peered":"2023-12-08T08:20:22.215173+0000","last_clean":"2023-12-08T08:20:22.215173+0000","last_became_active":"2023-12-08T08:20:20.520084+0000","last_became_peered":"2023-12-08T08:20:20.520084+0000","last_unstale":"2023-12-08T08:20:22.215173+0000","last_undegraded":"2023-12-08T08:20:22.215173+0000","last_fullsized":"2023-12-08T08:20:22.215173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:18.441827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957458+0000","last_change":"2023-12-08T08:20:20.131234+0000","last_active":"2023-12-08T08:20:21.957458+0000","last_peered":"2023-12-08T08:20:21.957458+0000","last_clean":"2023-12-08T08:20:21.957458+0000","last_became_active":"2023-12-08T08:20:20.130858+0000","last_became_peered":"2023-12-08T08:20:20.130858+0000","last_unstale":"2023-12-08T08:20:21.957458+0000","last_undegraded":"2023-12-08T08:20:21.957458+0000","last_fullsized":"2023-12-08T08:20:21.957458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:41:17.149923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503584+0000","last_change":"2023-12-08T08:20:20.513590+0000","last_active":"2023-12-08T08:20:21.503584+0000","last_peered":"2023-12-08T08:20:21.503584+0000","last_clean":"2023-12-08T08:20:21.503584+0000","last_became_active":"2023-12-08T08:20:20.513254+0000","last_became_peered":"2023-12-08T08:20:20.513254+0000","last_unstale":"2023-12-08T08:20:21.503584+0000","last_undegraded":"2023-12-08T08:20:21.503584+0000","last_fullsized":"2023-12-08T08:20:21.503584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:16:30.037506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503806+0000","last_change":"2023-12-08T08:20:20.119102+0000","last_active":"2023-12-08T08:20:21.503806+0000","last_peered":"2023-12-08T08:20:21.503806+0000","last_clean":"2023-12-08T08:20:21.503806+0000","last_became_active":"2023-12-08T08:20:20.118810+0000","last_became_peered":"2023-12-08T08:20:20.118810+0000","last_unstale":"2023-12-08T08:20:21.503806+0000","last_undegraded":"2023-12-08T08:20:21.503806+0000","last_fullsized":"2023-12-08T08:20:21.503806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:07:35.883797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214019+0000","last_change":"2023-12-08T08:20:20.517408+0000","last_active":"2023-12-08T08:20:22.214019+0000","last_peered":"2023-12-08T08:20:22.214019+0000","last_clean":"2023-12-08T08:20:22.214019+0000","last_became_active":"2023-12-08T08:20:20.517128+0000","last_became_peered":"2023-12-08T08:20:20.517128+0000","last_unstale":"2023-12-08T08:20:22.214019+0000","last_undegraded":"2023-12-08T08:20:22.214019+0000","last_fullsized":"2023-12-08T08:20:22.214019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:43:55.983858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672543+0000","last_change":"2023-12-08T08:20:20.123921+0000","last_active":"2023-12-08T08:20:21.672543+0000","last_peered":"2023-12-08T08:20:21.672543+0000","last_clean":"2023-12-08T08:20:21.672543+0000","last_became_active":"2023-12-08T08:20:20.123647+0000","last_became_peered":"2023-12-08T08:20:20.123647+0000","last_unstale":"2023-12-08T08:20:21.672543+0000","last_undegraded":"2023-12-08T08:20:21.672543+0000","last_fullsized":"2023-12-08T08:20:21.672543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:50:44.025429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713522+0000","last_change":"2023-12-08T08:20:20.512961+0000","last_active":"2023-12-08T08:20:21.713522+0000","last_peered":"2023-12-08T08:20:21.713522+0000","last_clean":"2023-12-08T08:20:21.713522+0000","last_became_active":"2023-12-08T08:20:20.512658+0000","last_became_peered":"2023-12-08T08:20:20.512658+0000","last_unstale":"2023-12-08T08:20:21.713522+0000","last_undegraded":"2023-12-08T08:20:21.713522+0000","last_fullsized":"2023-12-08T08:20:21.713522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:41:18.155537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.956795+0000","last_change":"2023-12-08T08:20:20.127034+0000","last_active":"2023-12-08T08:20:21.956795+0000","last_peered":"2023-12-08T08:20:21.956795+0000","last_clean":"2023-12-08T08:20:21.956795+0000","last_became_active":"2023-12-08T08:20:20.126738+0000","last_became_peered":"2023-12-08T08:20:20.126738+0000","last_unstale":"2023-12-08T08:20:21.956795+0000","last_undegraded":"2023-12-08T08:20:21.956795+0000","last_fullsized":"2023-12-08T08:20:21.956795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:01:11.293463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.510200+0000","last_change":"2023-12-08T08:20:20.508042+0000","last_active":"2023-12-08T08:20:21.510200+0000","last_peered":"2023-12-08T08:20:21.510200+0000","last_clean":"2023-12-08T08:20:21.510200+0000","last_became_active":"2023-12-08T08:20:20.507604+0000","last_became_peered":"2023-12-08T08:20:20.507604+0000","last_unstale":"2023-12-08T08:20:21.510200+0000","last_undegraded":"2023-12-08T08:20:21.510200+0000","last_fullsized":"2023-12-08T08:20:21.510200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:50:19.617575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503521+0000","last_change":"2023-12-08T08:20:20.114773+0000","last_active":"2023-12-08T08:20:21.503521+0000","last_peered":"2023-12-08T08:20:21.503521+0000","last_clean":"2023-12-08T08:20:21.503521+0000","last_became_active":"2023-12-08T08:20:20.114031+0000","last_became_peered":"2023-12-08T08:20:20.114031+0000","last_unstale":"2023-12-08T08:20:21.503521+0000","last_undegraded":"2023-12-08T08:20:21.503521+0000","last_fullsized":"2023-12-08T08:20:21.503521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:14:23.708015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213446+0000","last_change":"2023-12-08T08:20:20.517325+0000","last_active":"2023-12-08T08:20:22.213446+0000","last_peered":"2023-12-08T08:20:22.213446+0000","last_clean":"2023-12-08T08:20:22.213446+0000","last_became_active":"2023-12-08T08:20:20.517052+0000","last_became_peered":"2023-12-08T08:20:20.517052+0000","last_unstale":"2023-12-08T08:20:22.213446+0000","last_undegraded":"2023-12-08T08:20:22.213446+0000","last_fullsized":"2023-12-08T08:20:22.213446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:16:30.037506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503677+0000","last_change":"2023-12-08T08:20:20.125369+0000","last_active":"2023-12-08T08:20:21.503677+0000","last_peered":"2023-12-08T08:20:21.503677+0000","last_clean":"2023-12-08T08:20:21.503677+0000","last_became_active":"2023-12-08T08:20:20.124307+0000","last_became_peered":"2023-12-08T08:20:20.124307+0000","last_unstale":"2023-12-08T08:20:21.503677+0000","last_undegraded":"2023-12-08T08:20:21.503677+0000","last_fullsized":"2023-12-08T08:20:21.503677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:06:20.375858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213848+0000","last_change":"2023-12-08T08:20:20.517511+0000","last_active":"2023-12-08T08:20:22.213848+0000","last_peered":"2023-12-08T08:20:22.213848+0000","last_clean":"2023-12-08T08:20:22.213848+0000","last_became_active":"2023-12-08T08:20:20.517230+0000","last_became_peered":"2023-12-08T08:20:20.517230+0000","last_unstale":"2023-12-08T08:20:22.213848+0000","last_undegraded":"2023-12-08T08:20:22.213848+0000","last_fullsized":"2023-12-08T08:20:22.213848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:34:40.228006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957287+0000","last_change":"2023-12-08T08:20:20.131143+0000","last_active":"2023-12-08T08:20:21.957287+0000","last_peered":"2023-12-08T08:20:21.957287+0000","last_clean":"2023-12-08T08:20:21.957287+0000","last_became_active":"2023-12-08T08:20:20.130764+0000","last_became_peered":"2023-12-08T08:20:20.130764+0000","last_unstale":"2023-12-08T08:20:21.957287+0000","last_undegraded":"2023-12-08T08:20:21.957287+0000","last_fullsized":"2023-12-08T08:20:21.957287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:50:44.025429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672139+0000","last_change":"2023-12-08T08:20:20.512488+0000","last_active":"2023-12-08T08:20:21.672139+0000","last_peered":"2023-12-08T08:20:21.672139+0000","last_clean":"2023-12-08T08:20:21.672139+0000","last_became_active":"2023-12-08T08:20:20.512025+0000","last_became_peered":"2023-12-08T08:20:20.512025+0000","last_unstale":"2023-12-08T08:20:21.672139+0000","last_undegraded":"2023-12-08T08:20:21.672139+0000","last_fullsized":"2023-12-08T08:20:21.672139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:24:45.197087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.215175+0000","last_change":"2023-12-08T08:20:20.520916+0000","last_active":"2023-12-08T08:20:22.215175+0000","last_peered":"2023-12-08T08:20:22.215175+0000","last_clean":"2023-12-08T08:20:22.215175+0000","last_became_active":"2023-12-08T08:20:20.520425+0000","last_became_peered":"2023-12-08T08:20:20.520425+0000","last_unstale":"2023-12-08T08:20:22.215175+0000","last_undegraded":"2023-12-08T08:20:22.215175+0000","last_fullsized":"2023-12-08T08:20:22.215175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:52:56.239687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957134+0000","last_change":"2023-12-08T08:20:20.131174+0000","last_active":"2023-12-08T08:20:21.957134+0000","last_peered":"2023-12-08T08:20:21.957134+0000","last_clean":"2023-12-08T08:20:21.957134+0000","last_became_active":"2023-12-08T08:20:20.130872+0000","last_became_peered":"2023-12-08T08:20:20.130872+0000","last_unstale":"2023-12-08T08:20:21.957134+0000","last_undegraded":"2023-12-08T08:20:21.957134+0000","last_fullsized":"2023-12-08T08:20:21.957134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:51:02.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214974+0000","last_change":"2023-12-08T08:20:20.521452+0000","last_active":"2023-12-08T08:20:22.214974+0000","last_peered":"2023-12-08T08:20:22.214974+0000","last_clean":"2023-12-08T08:20:22.214974+0000","last_became_active":"2023-12-08T08:20:20.521159+0000","last_became_peered":"2023-12-08T08:20:20.521159+0000","last_unstale":"2023-12-08T08:20:22.214974+0000","last_undegraded":"2023-12-08T08:20:22.214974+0000","last_fullsized":"2023-12-08T08:20:22.214974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:43:55.983858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957295+0000","last_change":"2023-12-08T08:20:20.133530+0000","last_active":"2023-12-08T08:20:21.957295+0000","last_peered":"2023-12-08T08:20:21.957295+0000","last_clean":"2023-12-08T08:20:21.957295+0000","last_became_active":"2023-12-08T08:20:20.133275+0000","last_became_peered":"2023-12-08T08:20:20.133275+0000","last_unstale":"2023-12-08T08:20:21.957295+0000","last_undegraded":"2023-12-08T08:20:21.957295+0000","last_fullsized":"2023-12-08T08:20:21.957295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:21.954598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713403+0000","last_change":"2023-12-08T08:20:20.529914+0000","last_active":"2023-12-08T08:20:21.713403+0000","last_peered":"2023-12-08T08:20:21.713403+0000","last_clean":"2023-12-08T08:20:21.713403+0000","last_became_active":"2023-12-08T08:20:20.529197+0000","last_became_peered":"2023-12-08T08:20:20.529197+0000","last_unstale":"2023-12-08T08:20:21.713403+0000","last_undegraded":"2023-12-08T08:20:21.713403+0000","last_fullsized":"2023-12-08T08:20:21.713403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:22.960211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214115+0000","last_change":"2023-12-08T08:20:20.122629+0000","last_active":"2023-12-08T08:20:22.214115+0000","last_peered":"2023-12-08T08:20:22.214115+0000","last_clean":"2023-12-08T08:20:22.214115+0000","last_became_active":"2023-12-08T08:20:20.122354+0000","last_became_peered":"2023-12-08T08:20:20.122354+0000","last_unstale":"2023-12-08T08:20:22.214115+0000","last_undegraded":"2023-12-08T08:20:22.214115+0000","last_fullsized":"2023-12-08T08:20:22.214115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:07:35.883797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214035+0000","last_change":"2023-12-08T08:20:20.524585+0000","last_active":"2023-12-08T08:20:22.214035+0000","last_peered":"2023-12-08T08:20:22.214035+0000","last_clean":"2023-12-08T08:20:22.214035+0000","last_became_active":"2023-12-08T08:20:20.524328+0000","last_became_peered":"2023-12-08T08:20:20.524328+0000","last_unstale":"2023-12-08T08:20:22.214035+0000","last_undegraded":"2023-12-08T08:20:22.214035+0000","last_fullsized":"2023-12-08T08:20:22.214035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:06.439860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713606+0000","last_change":"2023-12-08T08:20:20.123711+0000","last_active":"2023-12-08T08:20:21.713606+0000","last_peered":"2023-12-08T08:20:21.713606+0000","last_clean":"2023-12-08T08:20:21.713606+0000","last_became_active":"2023-12-08T08:20:20.123409+0000","last_became_peered":"2023-12-08T08:20:20.123409+0000","last_unstale":"2023-12-08T08:20:21.713606+0000","last_undegraded":"2023-12-08T08:20:21.713606+0000","last_fullsized":"2023-12-08T08:20:21.713606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:14:23.708015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":661860,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4219999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.379}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4650000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5489999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.573}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":661916,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:20:25.188 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:20:25.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.354+0000 7efe55409640 1 Processor -- start 2023-12-08T08:20:25.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.358+0000 7efe55409640 1 -- start start 2023-12-08T08:20:25.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.358+0000 7efe55409640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efe500c7fd0 0x7efe50157910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:25.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.358+0000 7efe55409640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe500c8460 con 0x7efe50157e50 2023-12-08T08:20:25.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.358+0000 7efe55409640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe50154530 con 0x7efe50151b40 2023-12-08T08:20:25.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.358+0000 7efe55409640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe50154320 con 0x7efe500c7fd0 2023-12-08T08:20:25.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.358+0000 7efe4f7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efe500c7fd0 0x7efe50157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:25.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.358+0000 7efe4f7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efe500c7fd0 0x7efe50157910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39810/0 (socket says 172.21.15.88:39810) 2023-12-08T08:20:25.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.358+0000 7efe4f7fe640 1 -- 172.21.15.88:0/1513927881 learned_addr learned my addr 172.21.15.88:0/1513927881 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:25.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.358+0000 7efe4f7fe640 1 -- 172.21.15.88:0/1513927881 >> v1:172.21.15.148:6789/0 conn(0x7efe50151b40 legacy=0x7efe500c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:25.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.358+0000 7efe4f7fe640 1 -- 172.21.15.88:0/1513927881 >> v1:172.21.15.88:6789/0 conn(0x7efe50157e50 legacy=0x7efe5015eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:25.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.358+0000 7efe4f7fe640 1 -- 172.21.15.88:0/1513927881 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe50154810 con 0x7efe500c7fd0 2023-12-08T08:20:25.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.362+0000 7efe4f7fe640 1 --2- 172.21.15.88:0/1513927881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe500c7fd0 0x7efe50157910 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efe44009870 tx=0x7efe4401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7601fe1721d0918 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:25.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.362+0000 7efe4effd640 1 -- 172.21.15.88:0/1513927881 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe440ad680 con 0x7efe500c7fd0 2023-12-08T08:20:25.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.362+0000 7efe4effd640 1 -- 172.21.15.88:0/1513927881 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe440ad7e0 con 0x7efe500c7fd0 2023-12-08T08:20:25.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.362+0000 7efe4effd640 1 -- 172.21.15.88:0/1513927881 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe440adb70 con 0x7efe500c7fd0 2023-12-08T08:20:25.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.362+0000 7efe55409640 1 -- 172.21.15.88:0/1513927881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe500c7fd0 msgr2=0x7efe50157910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:25.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.362+0000 7efe55409640 1 --2- 172.21.15.88:0/1513927881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe500c7fd0 0x7efe50157910 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efe44009870 tx=0x7efe4401c470 comp rx=0 tx=0).stop 2023-12-08T08:20:25.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.362+0000 7efe55409640 1 -- 172.21.15.88:0/1513927881 shutdown_connections 2023-12-08T08:20:25.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.362+0000 7efe55409640 1 --2- 172.21.15.88:0/1513927881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe500c7fd0 0x7efe50157910 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.362+0000 7efe55409640 1 -- 172.21.15.88:0/1513927881 >> 172.21.15.88:0/1513927881 conn(0x7efe50066470 msgr2=0x7efe50066880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:25.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.362+0000 7efe55409640 1 -- 172.21.15.88:0/1513927881 shutdown_connections 2023-12-08T08:20:25.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.362+0000 7efe55409640 1 -- 172.21.15.88:0/1513927881 wait complete. 2023-12-08T08:20:25.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.362+0000 7efe55409640 1 Processor -- start 2023-12-08T08:20:25.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.362+0000 7efe55409640 1 -- start start 2023-12-08T08:20:25.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.366+0000 7efe55409640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe500c7fd0 0x7efe501503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:25.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.366+0000 7efe55409640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe50151b40 0x7efe50144930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:25.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.366+0000 7efe55409640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe50157e50 0x7efe50144e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:25.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.366+0000 7efe55409640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe50156b60 con 0x7efe500c7fd0 2023-12-08T08:20:25.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.366+0000 7efe55409640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5014b0f0 con 0x7efe50151b40 2023-12-08T08:20:25.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.366+0000 7efe55409640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe50156530 con 0x7efe50157e50 2023-12-08T08:20:25.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.366+0000 7efe4ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe500c7fd0 0x7efe501503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:25.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.366+0000 7efe4ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe500c7fd0 0x7efe501503c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39814/0 (socket says 172.21.15.88:39814) 2023-12-08T08:20:25.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.366+0000 7efe4ffff640 1 -- 172.21.15.88:0/1604161066 learned_addr learned my addr 172.21.15.88:0/1604161066 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:25.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.366+0000 7efe4ffff640 1 -- 172.21.15.88:0/1604161066 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe50157e50 msgr2=0x7efe50144e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:25.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.366+0000 7efe4f7fe640 1 --2- 172.21.15.88:0/1604161066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe50151b40 0x7efe50144930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:25.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.366+0000 7efe54c08640 1 --2- 172.21.15.88:0/1604161066 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe50157e50 0x7efe50144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:25.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.366+0000 7efe4ffff640 1 --2- 172.21.15.88:0/1604161066 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe50157e50 0x7efe50144e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.366+0000 7efe4ffff640 1 -- 172.21.15.88:0/1604161066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe50151b40 msgr2=0x7efe50144930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:25.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.366+0000 7efe4ffff640 1 --2- 172.21.15.88:0/1604161066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe50151b40 0x7efe50144930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.366+0000 7efe4ffff640 1 -- 172.21.15.88:0/1604161066 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe440094d0 con 0x7efe500c7fd0 2023-12-08T08:20:25.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.366+0000 7efe4f7fe640 1 --2- 172.21.15.88:0/1604161066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe50151b40 0x7efe50144930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:25.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.366+0000 7efe54c08640 1 --2- 172.21.15.88:0/1604161066 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe50157e50 0x7efe50144e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:25.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.366+0000 7efe4ffff640 1 --2- 172.21.15.88:0/1604161066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe500c7fd0 0x7efe501503c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efe4000c490 tx=0x7efe40001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:25.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.366+0000 7efe4cff9640 1 -- 172.21.15.88:0/1604161066 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe40003600 con 0x7efe500c7fd0 2023-12-08T08:20:25.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.366+0000 7efe4cff9640 1 -- 172.21.15.88:0/1604161066 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe40003780 con 0x7efe500c7fd0 2023-12-08T08:20:25.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.366+0000 7efe4cff9640 1 -- 172.21.15.88:0/1604161066 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe40003b30 con 0x7efe500c7fd0 2023-12-08T08:20:25.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.366+0000 7efe55409640 1 -- 172.21.15.88:0/1604161066 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5014ace0 con 0x7efe500c7fd0 2023-12-08T08:20:25.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.366+0000 7efe55409640 1 -- 172.21.15.88:0/1604161066 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe501f1030 con 0x7efe500c7fd0 2023-12-08T08:20:25.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.366+0000 7efe55409640 1 -- 172.21.15.88:0/1604161066 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe50067bc0 con 0x7efe500c7fd0 2023-12-08T08:20:25.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.366+0000 7efe4cff9640 1 -- 172.21.15.88:0/1604161066 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efe40003c90 con 0x7efe500c7fd0 2023-12-08T08:20:25.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.370+0000 7efe4cff9640 1 --2- 172.21.15.88:0/1604161066 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efe3c066470 0x7efe3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:25.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.370+0000 7efe4cff9640 1 -- 172.21.15.88:0/1604161066 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe40083000 con 0x7efe500c7fd0 2023-12-08T08:20:25.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.370+0000 7efe4f7fe640 1 --2- 172.21.15.88:0/1604161066 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efe3c066470 0x7efe3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:25.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.370+0000 7efe4f7fe640 1 --2- 172.21.15.88:0/1604161066 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efe3c066470 0x7efe3c068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efe440af000 tx=0x7efe44008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:25.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.374+0000 7efe4cff9640 1 -- 172.21.15.88:0/1604161066 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efe40050510 con 0x7efe500c7fd0 2023-12-08T08:20:25.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.518+0000 7efe55409640 1 -- 172.21.15.88:0/1604161066 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efe500c7c10 con 0x7efe3c066470 2023-12-08T08:20:25.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.526+0000 7efe4cff9640 1 -- 172.21.15.88:0/1604161066 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264742 (secure 0 0 0) 0x7efe440bc090 con 0x7efe3c066470 2023-12-08T08:20:25.534 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:25.536 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:20:25.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.530+0000 7efe55409640 1 -- 172.21.15.88:0/1604161066 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efe3c066470 msgr2=0x7efe3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:25.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.530+0000 7efe55409640 1 --2- 172.21.15.88:0/1604161066 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efe3c066470 0x7efe3c068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efe440af000 tx=0x7efe44008040 comp rx=0 tx=0).stop 2023-12-08T08:20:25.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.530+0000 7efe55409640 1 -- 172.21.15.88:0/1604161066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe500c7fd0 msgr2=0x7efe501503c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:25.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.530+0000 7efe55409640 1 --2- 172.21.15.88:0/1604161066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe500c7fd0 0x7efe501503c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efe4000c490 tx=0x7efe40001e80 comp rx=0 tx=0).stop 2023-12-08T08:20:25.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.530+0000 7efe55409640 1 -- 172.21.15.88:0/1604161066 shutdown_connections 2023-12-08T08:20:25.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.530+0000 7efe55409640 1 --2- 172.21.15.88:0/1604161066 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efe3c066470 0x7efe3c068930 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.530+0000 7efe55409640 1 --2- 172.21.15.88:0/1604161066 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe50157e50 0x7efe50144e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.530+0000 7efe55409640 1 --2- 172.21.15.88:0/1604161066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe50151b40 0x7efe50144930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.530+0000 7efe55409640 1 --2- 172.21.15.88:0/1604161066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe500c7fd0 0x7efe501503c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.530+0000 7efe55409640 1 -- 172.21.15.88:0/1604161066 >> 172.21.15.88:0/1604161066 conn(0x7efe50066470 msgr2=0x7efe50158260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:25.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.530+0000 7efe55409640 1 -- 172.21.15.88:0/1604161066 shutdown_connections 2023-12-08T08:20:25.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.530+0000 7efe55409640 1 -- 172.21.15.88:0/1604161066 wait complete. 2023-12-08T08:20:25.554 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-12-08T08:20:24.742268+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":144,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":217972,"kb_used_data":1780,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756748,"statfs":{"total":773094113280,"available":772870909952,"internally_reserved":0,"allocated":1822720,"data_stored":1746536,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.655799"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957451+0000","last_change":"2023-12-08T08:20:20.526014+0000","last_active":"2023-12-08T08:20:21.957451+0000","last_peered":"2023-12-08T08:20:21.957451+0000","last_clean":"2023-12-08T08:20:21.957451+0000","last_became_active":"2023-12-08T08:20:20.525310+0000","last_became_peered":"2023-12-08T08:20:20.525310+0000","last_unstale":"2023-12-08T08:20:21.957451+0000","last_undegraded":"2023-12-08T08:20:21.957451+0000","last_fullsized":"2023-12-08T08:20:21.957451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:04.925519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503721+0000","last_change":"2023-12-08T08:20:20.515314+0000","last_active":"2023-12-08T08:20:21.503721+0000","last_peered":"2023-12-08T08:20:21.503721+0000","last_clean":"2023-12-08T08:20:21.503721+0000","last_became_active":"2023-12-08T08:20:20.512640+0000","last_became_peered":"2023-12-08T08:20:20.512640+0000","last_unstale":"2023-12-08T08:20:21.503721+0000","last_undegraded":"2023-12-08T08:20:21.503721+0000","last_fullsized":"2023-12-08T08:20:21.503721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:58.484542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713375+0000","last_change":"2023-12-08T08:20:20.506916+0000","last_active":"2023-12-08T08:20:21.713375+0000","last_peered":"2023-12-08T08:20:21.713375+0000","last_clean":"2023-12-08T08:20:21.713375+0000","last_became_active":"2023-12-08T08:20:20.506640+0000","last_became_peered":"2023-12-08T08:20:20.506640+0000","last_unstale":"2023-12-08T08:20:21.713375+0000","last_undegraded":"2023-12-08T08:20:21.713375+0000","last_fullsized":"2023-12-08T08:20:21.713375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:35:49.495548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214804+0000","last_change":"2023-12-08T08:20:20.526830+0000","last_active":"2023-12-08T08:20:22.214804+0000","last_peered":"2023-12-08T08:20:22.214804+0000","last_clean":"2023-12-08T08:20:22.214804+0000","last_became_active":"2023-12-08T08:20:20.522810+0000","last_became_peered":"2023-12-08T08:20:20.522810+0000","last_unstale":"2023-12-08T08:20:22.214804+0000","last_undegraded":"2023-12-08T08:20:22.214804+0000","last_fullsized":"2023-12-08T08:20:22.214804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:12:06.866332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957064+0000","last_change":"2023-12-08T08:20:20.515029+0000","last_active":"2023-12-08T08:20:21.957064+0000","last_peered":"2023-12-08T08:20:21.957064+0000","last_clean":"2023-12-08T08:20:21.957064+0000","last_became_active":"2023-12-08T08:20:20.514648+0000","last_became_peered":"2023-12-08T08:20:20.514648+0000","last_unstale":"2023-12-08T08:20:21.957064+0000","last_undegraded":"2023-12-08T08:20:21.957064+0000","last_fullsized":"2023-12-08T08:20:21.957064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:35:44.144209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214602+0000","last_change":"2023-12-08T08:20:20.519487+0000","last_active":"2023-12-08T08:20:22.214602+0000","last_peered":"2023-12-08T08:20:22.214602+0000","last_clean":"2023-12-08T08:20:22.214602+0000","last_became_active":"2023-12-08T08:20:20.518543+0000","last_became_peered":"2023-12-08T08:20:20.518543+0000","last_unstale":"2023-12-08T08:20:22.214602+0000","last_undegraded":"2023-12-08T08:20:22.214602+0000","last_fullsized":"2023-12-08T08:20:22.214602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:58.484542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.956995+0000","last_change":"2023-12-08T08:20:20.522151+0000","last_active":"2023-12-08T08:20:21.956995+0000","last_peered":"2023-12-08T08:20:21.956995+0000","last_clean":"2023-12-08T08:20:21.956995+0000","last_became_active":"2023-12-08T08:20:20.521736+0000","last_became_peered":"2023-12-08T08:20:20.521736+0000","last_unstale":"2023-12-08T08:20:21.956995+0000","last_undegraded":"2023-12-08T08:20:21.956995+0000","last_fullsized":"2023-12-08T08:20:21.956995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:12:06.866332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213278+0000","last_change":"2023-12-08T08:20:20.529673+0000","last_active":"2023-12-08T08:20:22.213278+0000","last_peered":"2023-12-08T08:20:22.213278+0000","last_clean":"2023-12-08T08:20:22.213278+0000","last_became_active":"2023-12-08T08:20:20.529379+0000","last_became_peered":"2023-12-08T08:20:20.529379+0000","last_unstale":"2023-12-08T08:20:22.213278+0000","last_undegraded":"2023-12-08T08:20:22.213278+0000","last_fullsized":"2023-12-08T08:20:22.213278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:35:49.495548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957552+0000","last_change":"2023-12-08T08:20:20.525718+0000","last_active":"2023-12-08T08:20:21.957552+0000","last_peered":"2023-12-08T08:20:21.957552+0000","last_clean":"2023-12-08T08:20:21.957552+0000","last_became_active":"2023-12-08T08:20:20.524881+0000","last_became_peered":"2023-12-08T08:20:20.524881+0000","last_unstale":"2023-12-08T08:20:21.957552+0000","last_undegraded":"2023-12-08T08:20:21.957552+0000","last_fullsized":"2023-12-08T08:20:21.957552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:18:00.048146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672553+0000","last_change":"2023-12-08T08:20:20.527390+0000","last_active":"2023-12-08T08:20:21.672553+0000","last_peered":"2023-12-08T08:20:21.672553+0000","last_clean":"2023-12-08T08:20:21.672553+0000","last_became_active":"2023-12-08T08:20:20.527081+0000","last_became_peered":"2023-12-08T08:20:20.527081+0000","last_unstale":"2023-12-08T08:20:21.672553+0000","last_undegraded":"2023-12-08T08:20:21.672553+0000","last_fullsized":"2023-12-08T08:20:21.672553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:58.484542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672274+0000","last_change":"2023-12-08T08:20:20.529477+0000","last_active":"2023-12-08T08:20:21.672274+0000","last_peered":"2023-12-08T08:20:21.672274+0000","last_clean":"2023-12-08T08:20:21.672274+0000","last_became_active":"2023-12-08T08:20:20.529203+0000","last_became_peered":"2023-12-08T08:20:20.529203+0000","last_unstale":"2023-12-08T08:20:21.672274+0000","last_undegraded":"2023-12-08T08:20:21.672274+0000","last_fullsized":"2023-12-08T08:20:21.672274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:55.605759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.510398+0000","last_change":"2023-12-08T08:20:20.513949+0000","last_active":"2023-12-08T08:20:21.510398+0000","last_peered":"2023-12-08T08:20:21.510398+0000","last_clean":"2023-12-08T08:20:21.510398+0000","last_became_active":"2023-12-08T08:20:20.509753+0000","last_became_peered":"2023-12-08T08:20:20.509753+0000","last_unstale":"2023-12-08T08:20:21.510398+0000","last_undegraded":"2023-12-08T08:20:21.510398+0000","last_fullsized":"2023-12-08T08:20:21.510398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:14:24.713628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213771+0000","last_change":"2023-12-08T08:20:20.528560+0000","last_active":"2023-12-08T08:20:22.213771+0000","last_peered":"2023-12-08T08:20:22.213771+0000","last_clean":"2023-12-08T08:20:22.213771+0000","last_became_active":"2023-12-08T08:20:20.528307+0000","last_became_peered":"2023-12-08T08:20:20.528307+0000","last_unstale":"2023-12-08T08:20:22.213771+0000","last_undegraded":"2023-12-08T08:20:22.213771+0000","last_fullsized":"2023-12-08T08:20:22.213771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:58.484542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713275+0000","last_change":"2023-12-08T08:20:20.512007+0000","last_active":"2023-12-08T08:20:21.713275+0000","last_peered":"2023-12-08T08:20:21.713275+0000","last_clean":"2023-12-08T08:20:21.713275+0000","last_became_active":"2023-12-08T08:20:20.511687+0000","last_became_peered":"2023-12-08T08:20:20.511687+0000","last_unstale":"2023-12-08T08:20:21.713275+0000","last_undegraded":"2023-12-08T08:20:21.713275+0000","last_fullsized":"2023-12-08T08:20:21.713275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:07:36.889410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503433+0000","last_change":"2023-12-08T08:20:20.515089+0000","last_active":"2023-12-08T08:20:21.503433+0000","last_peered":"2023-12-08T08:20:21.503433+0000","last_clean":"2023-12-08T08:20:21.503433+0000","last_became_active":"2023-12-08T08:20:20.514657+0000","last_became_peered":"2023-12-08T08:20:20.514657+0000","last_unstale":"2023-12-08T08:20:21.503433+0000","last_undegraded":"2023-12-08T08:20:21.503433+0000","last_fullsized":"2023-12-08T08:20:21.503433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:55.605759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214490+0000","last_change":"2023-12-08T08:20:20.518410+0000","last_active":"2023-12-08T08:20:22.214490+0000","last_peered":"2023-12-08T08:20:22.214490+0000","last_clean":"2023-12-08T08:20:22.214490+0000","last_became_active":"2023-12-08T08:20:20.518144+0000","last_became_peered":"2023-12-08T08:20:20.518144+0000","last_unstale":"2023-12-08T08:20:22.214490+0000","last_undegraded":"2023-12-08T08:20:22.214490+0000","last_fullsized":"2023-12-08T08:20:22.214490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:16:30.037506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.215317+0000","last_change":"2023-12-08T08:20:20.524234+0000","last_active":"2023-12-08T08:20:22.215317+0000","last_peered":"2023-12-08T08:20:22.215317+0000","last_clean":"2023-12-08T08:20:22.215317+0000","last_became_active":"2023-12-08T08:20:20.523988+0000","last_became_peered":"2023-12-08T08:20:20.523988+0000","last_unstale":"2023-12-08T08:20:22.215317+0000","last_undegraded":"2023-12-08T08:20:22.215317+0000","last_fullsized":"2023-12-08T08:20:22.215317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:04.925519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213689+0000","last_change":"2023-12-08T08:20:20.509163+0000","last_active":"2023-12-08T08:20:22.213689+0000","last_peered":"2023-12-08T08:20:22.213689+0000","last_clean":"2023-12-08T08:20:22.213689+0000","last_became_active":"2023-12-08T08:20:20.508891+0000","last_became_peered":"2023-12-08T08:20:20.508891+0000","last_unstale":"2023-12-08T08:20:22.213689+0000","last_undegraded":"2023-12-08T08:20:22.213689+0000","last_fullsized":"2023-12-08T08:20:22.213689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:14:24.713628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957438+0000","last_change":"2023-12-08T08:20:20.523793+0000","last_active":"2023-12-08T08:20:21.957438+0000","last_peered":"2023-12-08T08:20:21.957438+0000","last_clean":"2023-12-08T08:20:21.957438+0000","last_became_active":"2023-12-08T08:20:20.523526+0000","last_became_peered":"2023-12-08T08:20:20.523526+0000","last_unstale":"2023-12-08T08:20:21.957438+0000","last_undegraded":"2023-12-08T08:20:21.957438+0000","last_fullsized":"2023-12-08T08:20:21.957438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:52:56.239687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672374+0000","last_change":"2023-12-08T08:20:20.515864+0000","last_active":"2023-12-08T08:20:21.672374+0000","last_peered":"2023-12-08T08:20:21.672374+0000","last_clean":"2023-12-08T08:20:21.672374+0000","last_became_active":"2023-12-08T08:20:20.515572+0000","last_became_peered":"2023-12-08T08:20:20.515572+0000","last_unstale":"2023-12-08T08:20:21.672374+0000","last_undegraded":"2023-12-08T08:20:21.672374+0000","last_fullsized":"2023-12-08T08:20:21.672374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:16:30.037506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713276+0000","last_change":"2023-12-08T08:20:20.514531+0000","last_active":"2023-12-08T08:20:21.713276+0000","last_peered":"2023-12-08T08:20:21.713276+0000","last_clean":"2023-12-08T08:20:21.713276+0000","last_became_active":"2023-12-08T08:20:20.514275+0000","last_became_peered":"2023-12-08T08:20:20.514275+0000","last_unstale":"2023-12-08T08:20:21.713276+0000","last_undegraded":"2023-12-08T08:20:21.713276+0000","last_fullsized":"2023-12-08T08:20:21.713276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:24:45.197087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214695+0000","last_change":"2023-12-08T08:20:20.523484+0000","last_active":"2023-12-08T08:20:22.214695+0000","last_peered":"2023-12-08T08:20:22.214695+0000","last_clean":"2023-12-08T08:20:22.214695+0000","last_became_active":"2023-12-08T08:20:20.523161+0000","last_became_peered":"2023-12-08T08:20:20.523161+0000","last_unstale":"2023-12-08T08:20:22.214695+0000","last_undegraded":"2023-12-08T08:20:22.214695+0000","last_fullsized":"2023-12-08T08:20:22.214695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:34:40.228006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213314+0000","last_change":"2023-12-08T08:20:20.530871+0000","last_active":"2023-12-08T08:20:22.213314+0000","last_peered":"2023-12-08T08:20:22.213314+0000","last_clean":"2023-12-08T08:20:22.213314+0000","last_became_active":"2023-12-08T08:20:20.530604+0000","last_became_peered":"2023-12-08T08:20:20.530604+0000","last_unstale":"2023-12-08T08:20:22.213314+0000","last_undegraded":"2023-12-08T08:20:22.213314+0000","last_fullsized":"2023-12-08T08:20:22.213314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:55.605759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214573+0000","last_change":"2023-12-08T08:20:20.522332+0000","last_active":"2023-12-08T08:20:22.214573+0000","last_peered":"2023-12-08T08:20:22.214573+0000","last_clean":"2023-12-08T08:20:22.214573+0000","last_became_active":"2023-12-08T08:20:20.522036+0000","last_became_peered":"2023-12-08T08:20:20.522036+0000","last_unstale":"2023-12-08T08:20:22.214573+0000","last_undegraded":"2023-12-08T08:20:22.214573+0000","last_fullsized":"2023-12-08T08:20:22.214573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:41:18.155537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213974+0000","last_change":"2023-12-08T08:20:20.528859+0000","last_active":"2023-12-08T08:20:22.213974+0000","last_peered":"2023-12-08T08:20:22.213974+0000","last_clean":"2023-12-08T08:20:22.213974+0000","last_became_active":"2023-12-08T08:20:20.528595+0000","last_became_peered":"2023-12-08T08:20:20.528595+0000","last_unstale":"2023-12-08T08:20:22.213974+0000","last_undegraded":"2023-12-08T08:20:22.213974+0000","last_fullsized":"2023-12-08T08:20:22.213974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:12:06.866332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672548+0000","last_change":"2023-12-08T08:20:20.519122+0000","last_active":"2023-12-08T08:20:21.672548+0000","last_peered":"2023-12-08T08:20:21.672548+0000","last_clean":"2023-12-08T08:20:21.672548+0000","last_became_active":"2023-12-08T08:20:20.518790+0000","last_became_peered":"2023-12-08T08:20:20.518790+0000","last_unstale":"2023-12-08T08:20:21.672548+0000","last_undegraded":"2023-12-08T08:20:21.672548+0000","last_fullsized":"2023-12-08T08:20:21.672548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:41:18.155537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503627+0000","last_change":"2023-12-08T08:20:20.511207+0000","last_active":"2023-12-08T08:20:21.503627+0000","last_peered":"2023-12-08T08:20:21.503627+0000","last_clean":"2023-12-08T08:20:21.503627+0000","last_became_active":"2023-12-08T08:20:20.509613+0000","last_became_peered":"2023-12-08T08:20:20.509613+0000","last_unstale":"2023-12-08T08:20:21.503627+0000","last_undegraded":"2023-12-08T08:20:21.503627+0000","last_fullsized":"2023-12-08T08:20:21.503627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:41:18.155537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213986+0000","last_change":"2023-12-08T08:20:20.529699+0000","last_active":"2023-12-08T08:20:22.213986+0000","last_peered":"2023-12-08T08:20:22.213986+0000","last_clean":"2023-12-08T08:20:22.213986+0000","last_became_active":"2023-12-08T08:20:20.528976+0000","last_became_peered":"2023-12-08T08:20:20.528976+0000","last_unstale":"2023-12-08T08:20:22.213986+0000","last_undegraded":"2023-12-08T08:20:22.213986+0000","last_fullsized":"2023-12-08T08:20:22.213986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:35:44.144209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713583+0000","last_change":"2023-12-08T08:20:20.513060+0000","last_active":"2023-12-08T08:20:21.713583+0000","last_peered":"2023-12-08T08:20:21.713583+0000","last_clean":"2023-12-08T08:20:21.713583+0000","last_became_active":"2023-12-08T08:20:20.512637+0000","last_became_peered":"2023-12-08T08:20:20.512637+0000","last_unstale":"2023-12-08T08:20:21.713583+0000","last_undegraded":"2023-12-08T08:20:21.713583+0000","last_fullsized":"2023-12-08T08:20:21.713583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:58.484542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214832+0000","last_change":"2023-12-08T08:20:20.521987+0000","last_active":"2023-12-08T08:20:22.214832+0000","last_peered":"2023-12-08T08:20:22.214832+0000","last_clean":"2023-12-08T08:20:22.214832+0000","last_became_active":"2023-12-08T08:20:20.521639+0000","last_became_peered":"2023-12-08T08:20:20.521639+0000","last_unstale":"2023-12-08T08:20:22.214832+0000","last_undegraded":"2023-12-08T08:20:22.214832+0000","last_fullsized":"2023-12-08T08:20:22.214832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:35:44.144209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213304+0000","last_change":"2023-12-08T08:20:20.518482+0000","last_active":"2023-12-08T08:20:22.213304+0000","last_peered":"2023-12-08T08:20:22.213304+0000","last_clean":"2023-12-08T08:20:22.213304+0000","last_became_active":"2023-12-08T08:20:20.518190+0000","last_became_peered":"2023-12-08T08:20:20.518190+0000","last_unstale":"2023-12-08T08:20:22.213304+0000","last_undegraded":"2023-12-08T08:20:22.213304+0000","last_fullsized":"2023-12-08T08:20:22.213304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:14:43.007025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672162+0000","last_change":"2023-12-08T08:20:20.515939+0000","last_active":"2023-12-08T08:20:21.672162+0000","last_peered":"2023-12-08T08:20:21.672162+0000","last_clean":"2023-12-08T08:20:21.672162+0000","last_became_active":"2023-12-08T08:20:20.515314+0000","last_became_peered":"2023-12-08T08:20:20.515314+0000","last_unstale":"2023-12-08T08:20:21.672162+0000","last_undegraded":"2023-12-08T08:20:21.672162+0000","last_fullsized":"2023-12-08T08:20:21.672162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:35:49.495548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.510090+0000","last_change":"2023-12-08T08:20:20.517465+0000","last_active":"2023-12-08T08:20:21.510090+0000","last_peered":"2023-12-08T08:20:21.510090+0000","last_clean":"2023-12-08T08:20:21.510090+0000","last_became_active":"2023-12-08T08:20:20.517151+0000","last_became_peered":"2023-12-08T08:20:20.517151+0000","last_unstale":"2023-12-08T08:20:21.510090+0000","last_undegraded":"2023-12-08T08:20:21.510090+0000","last_fullsized":"2023-12-08T08:20:21.510090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:17:32.867357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213861+0000","last_change":"2023-12-08T08:20:20.127114+0000","last_active":"2023-12-08T08:20:22.213861+0000","last_peered":"2023-12-08T08:20:22.213861+0000","last_clean":"2023-12-08T08:20:22.213861+0000","last_became_active":"2023-12-08T08:20:20.126718+0000","last_became_peered":"2023-12-08T08:20:20.126718+0000","last_unstale":"2023-12-08T08:20:22.213861+0000","last_undegraded":"2023-12-08T08:20:22.213861+0000","last_fullsized":"2023-12-08T08:20:22.213861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:06:20.375858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713403+0000","last_change":"2023-12-08T08:20:20.511756+0000","last_active":"2023-12-08T08:20:21.713403+0000","last_peered":"2023-12-08T08:20:21.713403+0000","last_clean":"2023-12-08T08:20:21.713403+0000","last_became_active":"2023-12-08T08:20:20.511411+0000","last_became_peered":"2023-12-08T08:20:20.511411+0000","last_unstale":"2023-12-08T08:20:21.713403+0000","last_undegraded":"2023-12-08T08:20:21.713403+0000","last_fullsized":"2023-12-08T08:20:21.713403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:55.605759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672137+0000","last_change":"2023-12-08T08:20:20.119404+0000","last_active":"2023-12-08T08:20:21.672137+0000","last_peered":"2023-12-08T08:20:21.672137+0000","last_clean":"2023-12-08T08:20:21.672137+0000","last_became_active":"2023-12-08T08:20:20.119117+0000","last_became_peered":"2023-12-08T08:20:20.119117+0000","last_unstale":"2023-12-08T08:20:21.672137+0000","last_undegraded":"2023-12-08T08:20:21.672137+0000","last_fullsized":"2023-12-08T08:20:21.672137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:06:20.375858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213309+0000","last_change":"2023-12-08T08:20:20.118455+0000","last_active":"2023-12-08T08:20:22.213309+0000","last_peered":"2023-12-08T08:20:22.213309+0000","last_clean":"2023-12-08T08:20:22.213309+0000","last_became_active":"2023-12-08T08:20:20.118187+0000","last_became_peered":"2023-12-08T08:20:20.118187+0000","last_unstale":"2023-12-08T08:20:22.213309+0000","last_undegraded":"2023-12-08T08:20:22.213309+0000","last_fullsized":"2023-12-08T08:20:22.213309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:50:44.025429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213363+0000","last_change":"2023-12-08T08:20:20.519950+0000","last_active":"2023-12-08T08:20:22.213363+0000","last_peered":"2023-12-08T08:20:22.213363+0000","last_clean":"2023-12-08T08:20:22.213363+0000","last_became_active":"2023-12-08T08:20:20.519682+0000","last_became_peered":"2023-12-08T08:20:20.519682+0000","last_unstale":"2023-12-08T08:20:22.213363+0000","last_undegraded":"2023-12-08T08:20:22.213363+0000","last_fullsized":"2023-12-08T08:20:22.213363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:22.960211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214641+0000","last_change":"2023-12-08T08:20:20.125917+0000","last_active":"2023-12-08T08:20:22.214641+0000","last_peered":"2023-12-08T08:20:22.214641+0000","last_clean":"2023-12-08T08:20:22.214641+0000","last_became_active":"2023-12-08T08:20:20.125471+0000","last_became_peered":"2023-12-08T08:20:20.125471+0000","last_unstale":"2023-12-08T08:20:22.214641+0000","last_undegraded":"2023-12-08T08:20:22.214641+0000","last_fullsized":"2023-12-08T08:20:22.214641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:07:35.883797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503438+0000","last_change":"2023-12-08T08:20:20.514082+0000","last_active":"2023-12-08T08:20:21.503438+0000","last_peered":"2023-12-08T08:20:21.503438+0000","last_clean":"2023-12-08T08:20:21.503438+0000","last_became_active":"2023-12-08T08:20:20.511617+0000","last_became_peered":"2023-12-08T08:20:20.511617+0000","last_unstale":"2023-12-08T08:20:21.503438+0000","last_undegraded":"2023-12-08T08:20:21.503438+0000","last_fullsized":"2023-12-08T08:20:21.503438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:35:49.495548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672445+0000","last_change":"2023-12-08T08:20:20.117986+0000","last_active":"2023-12-08T08:20:21.672445+0000","last_peered":"2023-12-08T08:20:21.672445+0000","last_clean":"2023-12-08T08:20:21.672445+0000","last_became_active":"2023-12-08T08:20:20.117643+0000","last_became_peered":"2023-12-08T08:20:20.117643+0000","last_unstale":"2023-12-08T08:20:21.672445+0000","last_undegraded":"2023-12-08T08:20:21.672445+0000","last_fullsized":"2023-12-08T08:20:21.672445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:51:02.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.215153+0000","last_change":"2023-12-08T08:20:20.526658+0000","last_active":"2023-12-08T08:20:22.215153+0000","last_peered":"2023-12-08T08:20:22.215153+0000","last_clean":"2023-12-08T08:20:22.215153+0000","last_became_active":"2023-12-08T08:20:20.525963+0000","last_became_peered":"2023-12-08T08:20:20.525963+0000","last_unstale":"2023-12-08T08:20:22.215153+0000","last_undegraded":"2023-12-08T08:20:22.215153+0000","last_fullsized":"2023-12-08T08:20:22.215153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:34:32.364346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.215087+0000","last_change":"2023-12-08T08:20:20.119060+0000","last_active":"2023-12-08T08:20:22.215087+0000","last_peered":"2023-12-08T08:20:22.215087+0000","last_clean":"2023-12-08T08:20:22.215087+0000","last_became_active":"2023-12-08T08:20:20.118701+0000","last_became_peered":"2023-12-08T08:20:20.118701+0000","last_unstale":"2023-12-08T08:20:22.215087+0000","last_undegraded":"2023-12-08T08:20:22.215087+0000","last_fullsized":"2023-12-08T08:20:22.215087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:21.954598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713519+0000","last_change":"2023-12-08T08:20:20.530125+0000","last_active":"2023-12-08T08:20:21.713519+0000","last_peered":"2023-12-08T08:20:21.713519+0000","last_clean":"2023-12-08T08:20:21.713519+0000","last_became_active":"2023-12-08T08:20:20.529601+0000","last_became_peered":"2023-12-08T08:20:20.529601+0000","last_unstale":"2023-12-08T08:20:21.713519+0000","last_undegraded":"2023-12-08T08:20:21.713519+0000","last_fullsized":"2023-12-08T08:20:21.713519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:16:30.037506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503623+0000","last_change":"2023-12-08T08:20:20.118338+0000","last_active":"2023-12-08T08:20:21.503623+0000","last_peered":"2023-12-08T08:20:21.503623+0000","last_clean":"2023-12-08T08:20:21.503623+0000","last_became_active":"2023-12-08T08:20:20.118032+0000","last_became_peered":"2023-12-08T08:20:20.118032+0000","last_unstale":"2023-12-08T08:20:21.503623+0000","last_undegraded":"2023-12-08T08:20:21.503623+0000","last_fullsized":"2023-12-08T08:20:21.503623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:14:41.931523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.510480+0000","last_change":"2023-12-08T08:20:20.521236+0000","last_active":"2023-12-08T08:20:21.510480+0000","last_peered":"2023-12-08T08:20:21.510480+0000","last_clean":"2023-12-08T08:20:21.510480+0000","last_became_active":"2023-12-08T08:20:20.520900+0000","last_became_peered":"2023-12-08T08:20:20.520900+0000","last_unstale":"2023-12-08T08:20:21.510480+0000","last_undegraded":"2023-12-08T08:20:21.510480+0000","last_fullsized":"2023-12-08T08:20:21.510480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:51:03.805815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672410+0000","last_change":"2023-12-08T08:20:20.126955+0000","last_active":"2023-12-08T08:20:21.672410+0000","last_peered":"2023-12-08T08:20:21.672410+0000","last_clean":"2023-12-08T08:20:21.672410+0000","last_became_active":"2023-12-08T08:20:20.126629+0000","last_became_peered":"2023-12-08T08:20:20.126629+0000","last_unstale":"2023-12-08T08:20:21.672410+0000","last_undegraded":"2023-12-08T08:20:21.672410+0000","last_fullsized":"2023-12-08T08:20:21.672410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:14:41.931523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957190+0000","last_change":"2023-12-08T08:20:20.518442+0000","last_active":"2023-12-08T08:20:21.957190+0000","last_peered":"2023-12-08T08:20:21.957190+0000","last_clean":"2023-12-08T08:20:21.957190+0000","last_became_active":"2023-12-08T08:20:20.518033+0000","last_became_peered":"2023-12-08T08:20:20.518033+0000","last_unstale":"2023-12-08T08:20:21.957190+0000","last_undegraded":"2023-12-08T08:20:21.957190+0000","last_fullsized":"2023-12-08T08:20:21.957190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:34:32.364346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713480+0000","last_change":"2023-12-08T08:20:20.110330+0000","last_active":"2023-12-08T08:20:21.713480+0000","last_peered":"2023-12-08T08:20:21.713480+0000","last_clean":"2023-12-08T08:20:21.713480+0000","last_became_active":"2023-12-08T08:20:20.109870+0000","last_became_peered":"2023-12-08T08:20:20.109870+0000","last_unstale":"2023-12-08T08:20:21.713480+0000","last_undegraded":"2023-12-08T08:20:21.713480+0000","last_fullsized":"2023-12-08T08:20:21.713480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:01:11.293463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713167+0000","last_change":"2023-12-08T08:20:20.514723+0000","last_active":"2023-12-08T08:20:21.713167+0000","last_peered":"2023-12-08T08:20:21.713167+0000","last_clean":"2023-12-08T08:20:21.713167+0000","last_became_active":"2023-12-08T08:20:20.514377+0000","last_became_peered":"2023-12-08T08:20:20.514377+0000","last_unstale":"2023-12-08T08:20:21.713167+0000","last_undegraded":"2023-12-08T08:20:21.713167+0000","last_fullsized":"2023-12-08T08:20:21.713167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:06:21.381472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214843+0000","last_change":"2023-12-08T08:20:20.129684+0000","last_active":"2023-12-08T08:20:22.214843+0000","last_peered":"2023-12-08T08:20:22.214843+0000","last_clean":"2023-12-08T08:20:22.214843+0000","last_became_active":"2023-12-08T08:20:20.129423+0000","last_became_peered":"2023-12-08T08:20:20.129423+0000","last_unstale":"2023-12-08T08:20:22.214843+0000","last_undegraded":"2023-12-08T08:20:22.214843+0000","last_fullsized":"2023-12-08T08:20:22.214843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:24:44.191473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957171+0000","last_change":"2023-12-08T08:20:20.533071+0000","last_active":"2023-12-08T08:20:21.957171+0000","last_peered":"2023-12-08T08:20:21.957171+0000","last_clean":"2023-12-08T08:20:21.957171+0000","last_became_active":"2023-12-08T08:20:20.532811+0000","last_became_peered":"2023-12-08T08:20:20.532811+0000","last_unstale":"2023-12-08T08:20:21.957171+0000","last_undegraded":"2023-12-08T08:20:21.957171+0000","last_fullsized":"2023-12-08T08:20:21.957171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:06.439860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672150+0000","last_change":"2023-12-08T08:20:20.113477+0000","last_active":"2023-12-08T08:20:21.672150+0000","last_peered":"2023-12-08T08:20:21.672150+0000","last_clean":"2023-12-08T08:20:21.672150+0000","last_became_active":"2023-12-08T08:20:20.113149+0000","last_became_peered":"2023-12-08T08:20:20.113149+0000","last_unstale":"2023-12-08T08:20:21.672150+0000","last_undegraded":"2023-12-08T08:20:21.672150+0000","last_fullsized":"2023-12-08T08:20:21.672150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:14:23.708015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672290+0000","last_change":"2023-12-08T08:20:20.519693+0000","last_active":"2023-12-08T08:20:21.672290+0000","last_peered":"2023-12-08T08:20:21.672290+0000","last_clean":"2023-12-08T08:20:21.672290+0000","last_became_active":"2023-12-08T08:20:20.519418+0000","last_became_peered":"2023-12-08T08:20:20.519418+0000","last_unstale":"2023-12-08T08:20:21.672290+0000","last_undegraded":"2023-12-08T08:20:21.672290+0000","last_fullsized":"2023-12-08T08:20:21.672290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:22.960211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213194+0000","last_change":"2023-12-08T08:20:20.106359+0000","last_active":"2023-12-08T08:20:22.213194+0000","last_peered":"2023-12-08T08:20:22.213194+0000","last_clean":"2023-12-08T08:20:22.213194+0000","last_became_active":"2023-12-08T08:20:20.106095+0000","last_became_peered":"2023-12-08T08:20:20.106095+0000","last_unstale":"2023-12-08T08:20:22.213194+0000","last_undegraded":"2023-12-08T08:20:22.213194+0000","last_fullsized":"2023-12-08T08:20:22.213194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:00:11.928203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957117+0000","last_change":"2023-12-08T08:20:20.528783+0000","last_active":"2023-12-08T08:20:21.957117+0000","last_peered":"2023-12-08T08:20:21.957117+0000","last_clean":"2023-12-08T08:20:21.957117+0000","last_became_active":"2023-12-08T08:20:20.528463+0000","last_became_peered":"2023-12-08T08:20:20.528463+0000","last_unstale":"2023-12-08T08:20:21.957117+0000","last_undegraded":"2023-12-08T08:20:21.957117+0000","last_fullsized":"2023-12-08T08:20:21.957117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:43:55.983858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.510372+0000","last_change":"2023-12-08T08:20:20.109998+0000","last_active":"2023-12-08T08:20:21.510372+0000","last_peered":"2023-12-08T08:20:21.510372+0000","last_clean":"2023-12-08T08:20:21.510372+0000","last_became_active":"2023-12-08T08:20:20.109580+0000","last_became_peered":"2023-12-08T08:20:20.109580+0000","last_unstale":"2023-12-08T08:20:21.510372+0000","last_undegraded":"2023-12-08T08:20:21.510372+0000","last_fullsized":"2023-12-08T08:20:21.510372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:17:10.702274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957486+0000","last_change":"2023-12-08T08:20:20.533736+0000","last_active":"2023-12-08T08:20:21.957486+0000","last_peered":"2023-12-08T08:20:21.957486+0000","last_clean":"2023-12-08T08:20:21.957486+0000","last_became_active":"2023-12-08T08:20:20.533508+0000","last_became_peered":"2023-12-08T08:20:20.533508+0000","last_unstale":"2023-12-08T08:20:21.957486+0000","last_undegraded":"2023-12-08T08:20:21.957486+0000","last_fullsized":"2023-12-08T08:20:21.957486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:22:44.822453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213618+0000","last_change":"2023-12-08T08:20:20.121251+0000","last_active":"2023-12-08T08:20:22.213618+0000","last_peered":"2023-12-08T08:20:22.213618+0000","last_clean":"2023-12-08T08:20:22.213618+0000","last_became_active":"2023-12-08T08:20:20.120767+0000","last_became_peered":"2023-12-08T08:20:20.120767+0000","last_unstale":"2023-12-08T08:20:22.213618+0000","last_undegraded":"2023-12-08T08:20:22.213618+0000","last_fullsized":"2023-12-08T08:20:22.213618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:17:31.861743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957582+0000","last_change":"2023-12-08T08:20:20.532439+0000","last_active":"2023-12-08T08:20:21.957582+0000","last_peered":"2023-12-08T08:20:21.957582+0000","last_clean":"2023-12-08T08:20:21.957582+0000","last_became_active":"2023-12-08T08:20:20.532120+0000","last_became_peered":"2023-12-08T08:20:20.532120+0000","last_unstale":"2023-12-08T08:20:21.957582+0000","last_undegraded":"2023-12-08T08:20:21.957582+0000","last_fullsized":"2023-12-08T08:20:21.957582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:54:51.364740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503714+0000","last_change":"2023-12-08T08:20:20.112322+0000","last_active":"2023-12-08T08:20:21.503714+0000","last_peered":"2023-12-08T08:20:21.503714+0000","last_clean":"2023-12-08T08:20:21.503714+0000","last_became_active":"2023-12-08T08:20:20.112023+0000","last_became_peered":"2023-12-08T08:20:20.112023+0000","last_unstale":"2023-12-08T08:20:21.503714+0000","last_undegraded":"2023-12-08T08:20:21.503714+0000","last_fullsized":"2023-12-08T08:20:21.503714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:50:44.025429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.215085+0000","last_change":"2023-12-08T08:20:20.524988+0000","last_active":"2023-12-08T08:20:22.215085+0000","last_peered":"2023-12-08T08:20:22.215085+0000","last_clean":"2023-12-08T08:20:22.215085+0000","last_became_active":"2023-12-08T08:20:20.522486+0000","last_became_peered":"2023-12-08T08:20:20.522486+0000","last_unstale":"2023-12-08T08:20:22.215085+0000","last_undegraded":"2023-12-08T08:20:22.215085+0000","last_fullsized":"2023-12-08T08:20:22.215085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:06.439860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213544+0000","last_change":"2023-12-08T08:20:20.112210+0000","last_active":"2023-12-08T08:20:22.213544+0000","last_peered":"2023-12-08T08:20:22.213544+0000","last_clean":"2023-12-08T08:20:22.213544+0000","last_became_active":"2023-12-08T08:20:20.111888+0000","last_became_peered":"2023-12-08T08:20:20.111888+0000","last_unstale":"2023-12-08T08:20:22.213544+0000","last_undegraded":"2023-12-08T08:20:22.213544+0000","last_fullsized":"2023-12-08T08:20:22.213544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:17:10.702274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957276+0000","last_change":"2023-12-08T08:20:20.530738+0000","last_active":"2023-12-08T08:20:21.957276+0000","last_peered":"2023-12-08T08:20:21.957276+0000","last_clean":"2023-12-08T08:20:21.957276+0000","last_became_active":"2023-12-08T08:20:20.530478+0000","last_became_peered":"2023-12-08T08:20:20.530478+0000","last_unstale":"2023-12-08T08:20:21.957276+0000","last_undegraded":"2023-12-08T08:20:21.957276+0000","last_fullsized":"2023-12-08T08:20:21.957276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:18.441827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-08T08:20:20.505097+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:20:20.505097+0000","last_peered":"2023-12-08T08:20:20.505097+0000","last_clean":"2023-12-08T08:20:20.505097+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:20:20.505097+0000","last_undegraded":"2023-12-08T08:20:20.505097+0000","last_fullsized":"2023-12-08T08:20:20.505097+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214696+0000","last_change":"2023-12-08T08:20:20.115839+0000","last_active":"2023-12-08T08:20:22.214696+0000","last_peered":"2023-12-08T08:20:22.214696+0000","last_clean":"2023-12-08T08:20:22.214696+0000","last_became_active":"2023-12-08T08:20:20.113312+0000","last_became_peered":"2023-12-08T08:20:20.113312+0000","last_unstale":"2023-12-08T08:20:22.214696+0000","last_undegraded":"2023-12-08T08:20:22.214696+0000","last_fullsized":"2023-12-08T08:20:22.214696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:35:48.489934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213600+0000","last_change":"2023-12-08T08:20:20.529095+0000","last_active":"2023-12-08T08:20:22.213600+0000","last_peered":"2023-12-08T08:20:22.213600+0000","last_clean":"2023-12-08T08:20:22.213600+0000","last_became_active":"2023-12-08T08:20:20.528833+0000","last_became_peered":"2023-12-08T08:20:20.528833+0000","last_unstale":"2023-12-08T08:20:22.213600+0000","last_undegraded":"2023-12-08T08:20:22.213600+0000","last_fullsized":"2023-12-08T08:20:22.213600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:41:18.155537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.956800+0000","last_change":"2023-12-08T08:20:20.127208+0000","last_active":"2023-12-08T08:20:21.956800+0000","last_peered":"2023-12-08T08:20:21.956800+0000","last_clean":"2023-12-08T08:20:21.956800+0000","last_became_active":"2023-12-08T08:20:20.126756+0000","last_became_peered":"2023-12-08T08:20:20.126756+0000","last_unstale":"2023-12-08T08:20:21.956800+0000","last_undegraded":"2023-12-08T08:20:21.956800+0000","last_fullsized":"2023-12-08T08:20:21.956800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:17:31.861743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713208+0000","last_change":"2023-12-08T08:20:20.505416+0000","last_active":"2023-12-08T08:20:21.713208+0000","last_peered":"2023-12-08T08:20:21.713208+0000","last_clean":"2023-12-08T08:20:21.713208+0000","last_became_active":"2023-12-08T08:20:20.505234+0000","last_became_peered":"2023-12-08T08:20:20.505234+0000","last_unstale":"2023-12-08T08:20:21.713208+0000","last_undegraded":"2023-12-08T08:20:21.713208+0000","last_fullsized":"2023-12-08T08:20:21.713208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:50:45.031043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213398+0000","last_change":"2023-12-08T08:20:20.124516+0000","last_active":"2023-12-08T08:20:22.213398+0000","last_peered":"2023-12-08T08:20:22.213398+0000","last_clean":"2023-12-08T08:20:22.213398+0000","last_became_active":"2023-12-08T08:20:20.119912+0000","last_became_peered":"2023-12-08T08:20:20.119912+0000","last_unstale":"2023-12-08T08:20:22.213398+0000","last_undegraded":"2023-12-08T08:20:22.213398+0000","last_fullsized":"2023-12-08T08:20:22.213398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:01:11.293463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503488+0000","last_change":"2023-12-08T08:20:20.514055+0000","last_active":"2023-12-08T08:20:21.503488+0000","last_peered":"2023-12-08T08:20:21.503488+0000","last_clean":"2023-12-08T08:20:21.503488+0000","last_became_active":"2023-12-08T08:20:20.511185+0000","last_became_peered":"2023-12-08T08:20:20.511185+0000","last_unstale":"2023-12-08T08:20:21.503488+0000","last_undegraded":"2023-12-08T08:20:21.503488+0000","last_fullsized":"2023-12-08T08:20:21.503488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:22.960211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214950+0000","last_change":"2023-12-08T08:20:20.129124+0000","last_active":"2023-12-08T08:20:22.214950+0000","last_peered":"2023-12-08T08:20:22.214950+0000","last_clean":"2023-12-08T08:20:22.214950+0000","last_became_active":"2023-12-08T08:20:20.128851+0000","last_became_peered":"2023-12-08T08:20:20.128851+0000","last_unstale":"2023-12-08T08:20:22.214950+0000","last_undegraded":"2023-12-08T08:20:22.214950+0000","last_fullsized":"2023-12-08T08:20:22.214950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:54.600146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.510286+0000","last_change":"2023-12-08T08:20:20.518546+0000","last_active":"2023-12-08T08:20:21.510286+0000","last_peered":"2023-12-08T08:20:21.510286+0000","last_clean":"2023-12-08T08:20:21.510286+0000","last_became_active":"2023-12-08T08:20:20.516272+0000","last_became_peered":"2023-12-08T08:20:20.516272+0000","last_unstale":"2023-12-08T08:20:21.510286+0000","last_undegraded":"2023-12-08T08:20:21.510286+0000","last_fullsized":"2023-12-08T08:20:21.510286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:14:43.007025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503676+0000","last_change":"2023-12-08T08:20:20.106320+0000","last_active":"2023-12-08T08:20:21.503676+0000","last_peered":"2023-12-08T08:20:21.503676+0000","last_clean":"2023-12-08T08:20:21.503676+0000","last_became_active":"2023-12-08T08:20:20.106039+0000","last_became_peered":"2023-12-08T08:20:20.106039+0000","last_unstale":"2023-12-08T08:20:21.503676+0000","last_undegraded":"2023-12-08T08:20:21.503676+0000","last_fullsized":"2023-12-08T08:20:21.503676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:51:02.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.215173+0000","last_change":"2023-12-08T08:20:20.520730+0000","last_active":"2023-12-08T08:20:22.215173+0000","last_peered":"2023-12-08T08:20:22.215173+0000","last_clean":"2023-12-08T08:20:22.215173+0000","last_became_active":"2023-12-08T08:20:20.520084+0000","last_became_peered":"2023-12-08T08:20:20.520084+0000","last_unstale":"2023-12-08T08:20:22.215173+0000","last_undegraded":"2023-12-08T08:20:22.215173+0000","last_fullsized":"2023-12-08T08:20:22.215173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:18.441827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957458+0000","last_change":"2023-12-08T08:20:20.131234+0000","last_active":"2023-12-08T08:20:21.957458+0000","last_peered":"2023-12-08T08:20:21.957458+0000","last_clean":"2023-12-08T08:20:21.957458+0000","last_became_active":"2023-12-08T08:20:20.130858+0000","last_became_peered":"2023-12-08T08:20:20.130858+0000","last_unstale":"2023-12-08T08:20:21.957458+0000","last_undegraded":"2023-12-08T08:20:21.957458+0000","last_fullsized":"2023-12-08T08:20:21.957458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:41:17.149923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503584+0000","last_change":"2023-12-08T08:20:20.513590+0000","last_active":"2023-12-08T08:20:21.503584+0000","last_peered":"2023-12-08T08:20:21.503584+0000","last_clean":"2023-12-08T08:20:21.503584+0000","last_became_active":"2023-12-08T08:20:20.513254+0000","last_became_peered":"2023-12-08T08:20:20.513254+0000","last_unstale":"2023-12-08T08:20:21.503584+0000","last_undegraded":"2023-12-08T08:20:21.503584+0000","last_fullsized":"2023-12-08T08:20:21.503584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:16:30.037506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503806+0000","last_change":"2023-12-08T08:20:20.119102+0000","last_active":"2023-12-08T08:20:21.503806+0000","last_peered":"2023-12-08T08:20:21.503806+0000","last_clean":"2023-12-08T08:20:21.503806+0000","last_became_active":"2023-12-08T08:20:20.118810+0000","last_became_peered":"2023-12-08T08:20:20.118810+0000","last_unstale":"2023-12-08T08:20:21.503806+0000","last_undegraded":"2023-12-08T08:20:21.503806+0000","last_fullsized":"2023-12-08T08:20:21.503806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:07:35.883797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214019+0000","last_change":"2023-12-08T08:20:20.517408+0000","last_active":"2023-12-08T08:20:22.214019+0000","last_peered":"2023-12-08T08:20:22.214019+0000","last_clean":"2023-12-08T08:20:22.214019+0000","last_became_active":"2023-12-08T08:20:20.517128+0000","last_became_peered":"2023-12-08T08:20:20.517128+0000","last_unstale":"2023-12-08T08:20:22.214019+0000","last_undegraded":"2023-12-08T08:20:22.214019+0000","last_fullsized":"2023-12-08T08:20:22.214019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:43:55.983858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672543+0000","last_change":"2023-12-08T08:20:20.123921+0000","last_active":"2023-12-08T08:20:21.672543+0000","last_peered":"2023-12-08T08:20:21.672543+0000","last_clean":"2023-12-08T08:20:21.672543+0000","last_became_active":"2023-12-08T08:20:20.123647+0000","last_became_peered":"2023-12-08T08:20:20.123647+0000","last_unstale":"2023-12-08T08:20:21.672543+0000","last_undegraded":"2023-12-08T08:20:21.672543+0000","last_fullsized":"2023-12-08T08:20:21.672543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:50:44.025429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713522+0000","last_change":"2023-12-08T08:20:20.512961+0000","last_active":"2023-12-08T08:20:21.713522+0000","last_peered":"2023-12-08T08:20:21.713522+0000","last_clean":"2023-12-08T08:20:21.713522+0000","last_became_active":"2023-12-08T08:20:20.512658+0000","last_became_peered":"2023-12-08T08:20:20.512658+0000","last_unstale":"2023-12-08T08:20:21.713522+0000","last_undegraded":"2023-12-08T08:20:21.713522+0000","last_fullsized":"2023-12-08T08:20:21.713522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:41:18.155537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.956795+0000","last_change":"2023-12-08T08:20:20.127034+0000","last_active":"2023-12-08T08:20:21.956795+0000","last_peered":"2023-12-08T08:20:21.956795+0000","last_clean":"2023-12-08T08:20:21.956795+0000","last_became_active":"2023-12-08T08:20:20.126738+0000","last_became_peered":"2023-12-08T08:20:20.126738+0000","last_unstale":"2023-12-08T08:20:21.956795+0000","last_undegraded":"2023-12-08T08:20:21.956795+0000","last_fullsized":"2023-12-08T08:20:21.956795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:01:11.293463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.510200+0000","last_change":"2023-12-08T08:20:20.508042+0000","last_active":"2023-12-08T08:20:21.510200+0000","last_peered":"2023-12-08T08:20:21.510200+0000","last_clean":"2023-12-08T08:20:21.510200+0000","last_became_active":"2023-12-08T08:20:20.507604+0000","last_became_peered":"2023-12-08T08:20:20.507604+0000","last_unstale":"2023-12-08T08:20:21.510200+0000","last_undegraded":"2023-12-08T08:20:21.510200+0000","last_fullsized":"2023-12-08T08:20:21.510200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:50:19.617575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503521+0000","last_change":"2023-12-08T08:20:20.114773+0000","last_active":"2023-12-08T08:20:21.503521+0000","last_peered":"2023-12-08T08:20:21.503521+0000","last_clean":"2023-12-08T08:20:21.503521+0000","last_became_active":"2023-12-08T08:20:20.114031+0000","last_became_peered":"2023-12-08T08:20:20.114031+0000","last_unstale":"2023-12-08T08:20:21.503521+0000","last_undegraded":"2023-12-08T08:20:21.503521+0000","last_fullsized":"2023-12-08T08:20:21.503521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:14:23.708015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213446+0000","last_change":"2023-12-08T08:20:20.517325+0000","last_active":"2023-12-08T08:20:22.213446+0000","last_peered":"2023-12-08T08:20:22.213446+0000","last_clean":"2023-12-08T08:20:22.213446+0000","last_became_active":"2023-12-08T08:20:20.517052+0000","last_became_peered":"2023-12-08T08:20:20.517052+0000","last_unstale":"2023-12-08T08:20:22.213446+0000","last_undegraded":"2023-12-08T08:20:22.213446+0000","last_fullsized":"2023-12-08T08:20:22.213446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:16:30.037506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503677+0000","last_change":"2023-12-08T08:20:20.125369+0000","last_active":"2023-12-08T08:20:21.503677+0000","last_peered":"2023-12-08T08:20:21.503677+0000","last_clean":"2023-12-08T08:20:21.503677+0000","last_became_active":"2023-12-08T08:20:20.124307+0000","last_became_peered":"2023-12-08T08:20:20.124307+0000","last_unstale":"2023-12-08T08:20:21.503677+0000","last_undegraded":"2023-12-08T08:20:21.503677+0000","last_fullsized":"2023-12-08T08:20:21.503677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:06:20.375858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213848+0000","last_change":"2023-12-08T08:20:20.517511+0000","last_active":"2023-12-08T08:20:22.213848+0000","last_peered":"2023-12-08T08:20:22.213848+0000","last_clean":"2023-12-08T08:20:22.213848+0000","last_became_active":"2023-12-08T08:20:20.517230+0000","last_became_peered":"2023-12-08T08:20:20.517230+0000","last_unstale":"2023-12-08T08:20:22.213848+0000","last_undegraded":"2023-12-08T08:20:22.213848+0000","last_fullsized":"2023-12-08T08:20:22.213848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:34:40.228006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957287+0000","last_change":"2023-12-08T08:20:20.131143+0000","last_active":"2023-12-08T08:20:21.957287+0000","last_peered":"2023-12-08T08:20:21.957287+0000","last_clean":"2023-12-08T08:20:21.957287+0000","last_became_active":"2023-12-08T08:20:20.130764+0000","last_became_peered":"2023-12-08T08:20:20.130764+0000","last_unstale":"2023-12-08T08:20:21.957287+0000","last_undegraded":"2023-12-08T08:20:21.957287+0000","last_fullsized":"2023-12-08T08:20:21.957287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:50:44.025429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672139+0000","last_change":"2023-12-08T08:20:20.512488+0000","last_active":"2023-12-08T08:20:21.672139+0000","last_peered":"2023-12-08T08:20:21.672139+0000","last_clean":"2023-12-08T08:20:21.672139+0000","last_became_active":"2023-12-08T08:20:20.512025+0000","last_became_peered":"2023-12-08T08:20:20.512025+0000","last_unstale":"2023-12-08T08:20:21.672139+0000","last_undegraded":"2023-12-08T08:20:21.672139+0000","last_fullsized":"2023-12-08T08:20:21.672139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:24:45.197087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.215175+0000","last_change":"2023-12-08T08:20:20.520916+0000","last_active":"2023-12-08T08:20:22.215175+0000","last_peered":"2023-12-08T08:20:22.215175+0000","last_clean":"2023-12-08T08:20:22.215175+0000","last_became_active":"2023-12-08T08:20:20.520425+0000","last_became_peered":"2023-12-08T08:20:20.520425+0000","last_unstale":"2023-12-08T08:20:22.215175+0000","last_undegraded":"2023-12-08T08:20:22.215175+0000","last_fullsized":"2023-12-08T08:20:22.215175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:52:56.239687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957134+0000","last_change":"2023-12-08T08:20:20.131174+0000","last_active":"2023-12-08T08:20:21.957134+0000","last_peered":"2023-12-08T08:20:21.957134+0000","last_clean":"2023-12-08T08:20:21.957134+0000","last_became_active":"2023-12-08T08:20:20.130872+0000","last_became_peered":"2023-12-08T08:20:20.130872+0000","last_unstale":"2023-12-08T08:20:21.957134+0000","last_undegraded":"2023-12-08T08:20:21.957134+0000","last_fullsized":"2023-12-08T08:20:21.957134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:51:02.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214974+0000","last_change":"2023-12-08T08:20:20.521452+0000","last_active":"2023-12-08T08:20:22.214974+0000","last_peered":"2023-12-08T08:20:22.214974+0000","last_clean":"2023-12-08T08:20:22.214974+0000","last_became_active":"2023-12-08T08:20:20.521159+0000","last_became_peered":"2023-12-08T08:20:20.521159+0000","last_unstale":"2023-12-08T08:20:22.214974+0000","last_undegraded":"2023-12-08T08:20:22.214974+0000","last_fullsized":"2023-12-08T08:20:22.214974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:43:55.983858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957295+0000","last_change":"2023-12-08T08:20:20.133530+0000","last_active":"2023-12-08T08:20:21.957295+0000","last_peered":"2023-12-08T08:20:21.957295+0000","last_clean":"2023-12-08T08:20:21.957295+0000","last_became_active":"2023-12-08T08:20:20.133275+0000","last_became_peered":"2023-12-08T08:20:20.133275+0000","last_unstale":"2023-12-08T08:20:21.957295+0000","last_undegraded":"2023-12-08T08:20:21.957295+0000","last_fullsized":"2023-12-08T08:20:21.957295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:21.954598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713403+0000","last_change":"2023-12-08T08:20:20.529914+0000","last_active":"2023-12-08T08:20:21.713403+0000","last_peered":"2023-12-08T08:20:21.713403+0000","last_clean":"2023-12-08T08:20:21.713403+0000","last_became_active":"2023-12-08T08:20:20.529197+0000","last_became_peered":"2023-12-08T08:20:20.529197+0000","last_unstale":"2023-12-08T08:20:21.713403+0000","last_undegraded":"2023-12-08T08:20:21.713403+0000","last_fullsized":"2023-12-08T08:20:21.713403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:22.960211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214115+0000","last_change":"2023-12-08T08:20:20.122629+0000","last_active":"2023-12-08T08:20:22.214115+0000","last_peered":"2023-12-08T08:20:22.214115+0000","last_clean":"2023-12-08T08:20:22.214115+0000","last_became_active":"2023-12-08T08:20:20.122354+0000","last_became_peered":"2023-12-08T08:20:20.122354+0000","last_unstale":"2023-12-08T08:20:22.214115+0000","last_undegraded":"2023-12-08T08:20:22.214115+0000","last_fullsized":"2023-12-08T08:20:22.214115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:07:35.883797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214035+0000","last_change":"2023-12-08T08:20:20.524585+0000","last_active":"2023-12-08T08:20:22.214035+0000","last_peered":"2023-12-08T08:20:22.214035+0000","last_clean":"2023-12-08T08:20:22.214035+0000","last_became_active":"2023-12-08T08:20:20.524328+0000","last_became_peered":"2023-12-08T08:20:20.524328+0000","last_unstale":"2023-12-08T08:20:22.214035+0000","last_undegraded":"2023-12-08T08:20:22.214035+0000","last_fullsized":"2023-12-08T08:20:22.214035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:06.439860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713606+0000","last_change":"2023-12-08T08:20:20.123711+0000","last_active":"2023-12-08T08:20:21.713606+0000","last_peered":"2023-12-08T08:20:21.713606+0000","last_clean":"2023-12-08T08:20:21.713606+0000","last_became_active":"2023-12-08T08:20:20.123409+0000","last_became_peered":"2023-12-08T08:20:20.123409+0000","last_unstale":"2023-12-08T08:20:21.713606+0000","last_undegraded":"2023-12-08T08:20:21.713606+0000","last_fullsized":"2023-12-08T08:20:21.713606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:14:23.708015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":661860,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4219999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.379}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4650000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5489999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.573}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":661916,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:20:25.558 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-08T08:20:25.558 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-08T08:20:25.558 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-08T08:20:25.558 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-08T08:20:25.559 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-08T08:20:25.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.726+0000 7fb8902c9640 1 Processor -- start 2023-12-08T08:20:25.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.730+0000 7fb8902c9640 1 -- start start 2023-12-08T08:20:25.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.730+0000 7fb8902c9640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb888154f20 0x7fb88806b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:25.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.730+0000 7fb8902c9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8880c4890 con 0x7fb8880af4c0 2023-12-08T08:20:25.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.730+0000 7fb8902c9640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8881553d0 con 0x7fb88806bf30 2023-12-08T08:20:25.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.730+0000 7fb8902c9640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb88806c340 con 0x7fb888154f20 2023-12-08T08:20:25.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.730+0000 7fb88e065640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb8880af4c0 0x7fb8880c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:32782/0 (socket says 172.21.15.88:32782) 2023-12-08T08:20:25.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.730+0000 7fb88e065640 1 -- 172.21.15.88:0/3471752268 learned_addr learned my addr 172.21.15.88:0/3471752268 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:25.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.730+0000 7fb88d864640 1 --2- 172.21.15.88:0/3471752268 >> v2:172.21.15.148:3300/0 conn(0x7fb888154f20 0x7fb88806b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:25.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.730+0000 7fb88d063640 1 -- 172.21.15.88:0/3471752268 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753840981 0 0) 0x7fb8880c4890 con 0x7fb8880af4c0 2023-12-08T08:20:25.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.730+0000 7fb88d063640 1 -- 172.21.15.88:0/3471752268 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb874003530 con 0x7fb8880af4c0 2023-12-08T08:20:25.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.730+0000 7fb88d864640 1 -- 172.21.15.88:0/3471752268 >> v1:172.21.15.148:6789/0 conn(0x7fb88806bf30 legacy=0x7fb88815ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:25.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.730+0000 7fb88d864640 1 -- 172.21.15.88:0/3471752268 >> v1:172.21.15.88:6789/0 conn(0x7fb8880af4c0 legacy=0x7fb8880c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:25.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.730+0000 7fb88d063640 1 -- 172.21.15.88:0/3471752268 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4284451814 0 0) 0x7fb874003530 con 0x7fb8880af4c0 2023-12-08T08:20:25.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.730+0000 7fb88d864640 1 -- 172.21.15.88:0/3471752268 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8880af8a0 con 0x7fb888154f20 2023-12-08T08:20:25.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.734+0000 7fb88d864640 1 --2- 172.21.15.88:0/3471752268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb888154f20 0x7fb88806b9f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb8780097c0 tx=0x7fb87801c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57053ca0d744f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:25.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.734+0000 7fb88d063640 1 -- 172.21.15.88:0/3471752268 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb884001680 con 0x7fb888154f20 2023-12-08T08:20:25.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.734+0000 7fb88d063640 1 -- 172.21.15.88:0/3471752268 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8780a7050 con 0x7fb888154f20 2023-12-08T08:20:25.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.734+0000 7fb88d063640 1 -- 172.21.15.88:0/3471752268 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8780ab620 con 0x7fb888154f20 2023-12-08T08:20:25.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.734+0000 7fb8902c9640 1 -- 172.21.15.88:0/3471752268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb888154f20 msgr2=0x7fb88806b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:25.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.734+0000 7fb8902c9640 1 --2- 172.21.15.88:0/3471752268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb888154f20 0x7fb88806b9f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb8780097c0 tx=0x7fb87801c2e0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.734+0000 7fb8902c9640 1 -- 172.21.15.88:0/3471752268 shutdown_connections 2023-12-08T08:20:25.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.734+0000 7fb8902c9640 1 --2- 172.21.15.88:0/3471752268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb888154f20 0x7fb88806b9f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.734+0000 7fb8902c9640 1 -- 172.21.15.88:0/3471752268 >> 172.21.15.88:0/3471752268 conn(0x7fb8880ab9d0 msgr2=0x7fb8880abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:25.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.734+0000 7fb8902c9640 1 -- 172.21.15.88:0/3471752268 shutdown_connections 2023-12-08T08:20:25.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.734+0000 7fb8902c9640 1 -- 172.21.15.88:0/3471752268 wait complete. 2023-12-08T08:20:25.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.734+0000 7fb8902c9640 1 Processor -- start 2023-12-08T08:20:25.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.738+0000 7fb8902c9640 1 -- start start 2023-12-08T08:20:25.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.738+0000 7fb8902c9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb88806bf30 0x7fb8880c0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:25.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.738+0000 7fb8902c9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8880af4c0 0x7fb888156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:25.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.738+0000 7fb8902c9640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb888154f20 0x7fb8881488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:25.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.738+0000 7fb8902c9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8880c05b0 con 0x7fb8880af4c0 2023-12-08T08:20:25.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.738+0000 7fb8902c9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8880c9a00 con 0x7fb88806bf30 2023-12-08T08:20:25.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.738+0000 7fb8902c9640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8880c8670 con 0x7fb888154f20 2023-12-08T08:20:25.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.738+0000 7fb88d864640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8880af4c0 0x7fb888156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:25.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.738+0000 7fb88d864640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8880af4c0 0x7fb888156100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39826/0 (socket says 172.21.15.88:39826) 2023-12-08T08:20:25.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.738+0000 7fb88d864640 1 -- 172.21.15.88:0/1143034044 learned_addr learned my addr 172.21.15.88:0/1143034044 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:25.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.738+0000 7fb88e065640 1 --2- 172.21.15.88:0/1143034044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb88806bf30 0x7fb8880c0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:25.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.738+0000 7fb88e866640 1 --2- 172.21.15.88:0/1143034044 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb888154f20 0x7fb8881488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:25.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.738+0000 7fb88d864640 1 -- 172.21.15.88:0/1143034044 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb888154f20 msgr2=0x7fb8881488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:25.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.738+0000 7fb88d864640 1 --2- 172.21.15.88:0/1143034044 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb888154f20 0x7fb8881488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.738+0000 7fb88d864640 1 -- 172.21.15.88:0/1143034044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb88806bf30 msgr2=0x7fb8880c0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:25.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.738+0000 7fb88d864640 1 --2- 172.21.15.88:0/1143034044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb88806bf30 0x7fb8880c0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.738+0000 7fb88d864640 1 -- 172.21.15.88:0/1143034044 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb878009420 con 0x7fb8880af4c0 2023-12-08T08:20:25.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.738+0000 7fb88d864640 1 --2- 172.21.15.88:0/1143034044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8880af4c0 0x7fb888156100 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb8780ae040 tx=0x7fb878019080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:25.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.738+0000 7fb87effd640 1 -- 172.21.15.88:0/1143034044 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb878004020 con 0x7fb8880af4c0 2023-12-08T08:20:25.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.738+0000 7fb87effd640 1 -- 172.21.15.88:0/1143034044 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb878004180 con 0x7fb8880af4c0 2023-12-08T08:20:25.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.738+0000 7fb87effd640 1 -- 172.21.15.88:0/1143034044 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8780044f0 con 0x7fb8880af4c0 2023-12-08T08:20:25.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.738+0000 7fb8902c9640 1 -- 172.21.15.88:0/1143034044 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8880c8950 con 0x7fb8880af4c0 2023-12-08T08:20:25.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.738+0000 7fb8902c9640 1 -- 172.21.15.88:0/1143034044 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb888146b50 con 0x7fb8880af4c0 2023-12-08T08:20:25.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.738+0000 7fb8902c9640 1 -- 172.21.15.88:0/1143034044 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb888067630 con 0x7fb8880af4c0 2023-12-08T08:20:25.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.742+0000 7fb87effd640 1 -- 172.21.15.88:0/1143034044 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb8780b2040 con 0x7fb8880af4c0 2023-12-08T08:20:25.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.742+0000 7fb87effd640 1 --2- 172.21.15.88:0/1143034044 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb86c066470 0x7fb86c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:25.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.742+0000 7fb87effd640 1 -- 172.21.15.88:0/1143034044 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb87811dc30 con 0x7fb8880af4c0 2023-12-08T08:20:25.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.742+0000 7fb88e065640 1 --2- 172.21.15.88:0/1143034044 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb86c066470 0x7fb86c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:25.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.742+0000 7fb88e065640 1 --2- 172.21.15.88:0/1143034044 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb86c066470 0x7fb86c068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb884000f70 tx=0x7fb884001e10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:25.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.746+0000 7fb87effd640 1 -- 172.21.15.88:0/1143034044 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb8780eb150 con 0x7fb8880af4c0 2023-12-08T08:20:25.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.930+0000 7fb8902c9640 1 -- 172.21.15.88:0/1143034044 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb888146830 con 0x7fb8880af4c0 2023-12-08T08:20:25.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.934+0000 7fb87effd640 1 -- 172.21.15.88:0/1143034044 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164427 (secure 0 0 0) 0x7fb8780ee770 con 0x7fb8880af4c0 2023-12-08T08:20:25.940 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:25.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.938+0000 7fb8902c9640 1 -- 172.21.15.88:0/1143034044 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb86c066470 msgr2=0x7fb86c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:25.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.938+0000 7fb8902c9640 1 --2- 172.21.15.88:0/1143034044 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb86c066470 0x7fb86c068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb884000f70 tx=0x7fb884001e10 comp rx=0 tx=0).stop 2023-12-08T08:20:25.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.938+0000 7fb8902c9640 1 -- 172.21.15.88:0/1143034044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8880af4c0 msgr2=0x7fb888156100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:25.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.938+0000 7fb8902c9640 1 --2- 172.21.15.88:0/1143034044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8880af4c0 0x7fb888156100 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb8780ae040 tx=0x7fb878019080 comp rx=0 tx=0).stop 2023-12-08T08:20:25.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.938+0000 7fb8902c9640 1 -- 172.21.15.88:0/1143034044 shutdown_connections 2023-12-08T08:20:25.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.938+0000 7fb8902c9640 1 --2- 172.21.15.88:0/1143034044 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb86c066470 0x7fb86c068930 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.938+0000 7fb8902c9640 1 --2- 172.21.15.88:0/1143034044 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb888154f20 0x7fb8881488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.938+0000 7fb8902c9640 1 --2- 172.21.15.88:0/1143034044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8880af4c0 0x7fb888156100 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.938+0000 7fb8902c9640 1 --2- 172.21.15.88:0/1143034044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb88806bf30 0x7fb8880c0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.938+0000 7fb8902c9640 1 -- 172.21.15.88:0/1143034044 >> 172.21.15.88:0/1143034044 conn(0x7fb8880ab9d0 msgr2=0x7fb8881532a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:25.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.938+0000 7fb8902c9640 1 -- 172.21.15.88:0/1143034044 shutdown_connections 2023-12-08T08:20:25.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:25.938+0000 7fb8902c9640 1 -- 172.21.15.88:0/1143034044 wait complete. 2023-12-08T08:20:25.959 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":5,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":187352875},{"type":"v1","addr":"172.21.15.88:6833","nonce":187352875}]},"active_addr":"172.21.15.88:6833/187352875","active_change":"2023-12-08T08:20:00.725003+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4102,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":262636074}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":3496769203}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":1267376651}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":508633294}]}]} 2023-12-08T08:20:25.963 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-08T08:20:25.963 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-08T08:20:25.963 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:26.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.094+0000 7fbb1218d640 1 Processor -- start 2023-12-08T08:20:26.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.094+0000 7fbb1218d640 1 -- start start 2023-12-08T08:20:26.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.098+0000 7fbb1218d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb0c157b10 0x7fbb0c157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.098+0000 7fbb1218d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb0c155110 con 0x7fbb0c14e7e0 2023-12-08T08:20:26.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.098+0000 7fbb1218d640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb0c0c2f20 con 0x7fbb0c0c5e10 2023-12-08T08:20:26.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.098+0000 7fbb1218d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c154520 con 0x7fbb0c157b10 2023-12-08T08:20:26.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.098+0000 7fbb0b7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbb0c14e7e0 0x7fbb0c0c2810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:32790/0 (socket says 172.21.15.88:32790) 2023-12-08T08:20:26.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.098+0000 7fbb0b7fe640 1 -- 172.21.15.88:0/1917382178 learned_addr learned my addr 172.21.15.88:0/1917382178 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:26.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.098+0000 7fbb0bfff640 1 --2- 172.21.15.88:0/1917382178 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb0c157b10 0x7fbb0c157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.098+0000 7fbb0affd640 1 -- 172.21.15.88:0/1917382178 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137340003 0 0) 0x7fbb0c155110 con 0x7fbb0c14e7e0 2023-12-08T08:20:26.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.098+0000 7fbb0affd640 1 -- 172.21.15.88:0/1917382178 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaf8003530 con 0x7fbb0c14e7e0 2023-12-08T08:20:26.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.098+0000 7fbb0affd640 1 -- 172.21.15.88:0/1917382178 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882766993 0 0) 0x7fbb0c0c2f20 con 0x7fbb0c0c5e10 2023-12-08T08:20:26.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.098+0000 7fbb0affd640 1 -- 172.21.15.88:0/1917382178 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb0c155110 con 0x7fbb0c0c5e10 2023-12-08T08:20:26.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.098+0000 7fbb0affd640 1 -- 172.21.15.88:0/1917382178 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3590316290 0 0) 0x7fbaf8003530 con 0x7fbb0c14e7e0 2023-12-08T08:20:26.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.098+0000 7fbb0bfff640 1 -- 172.21.15.88:0/1917382178 >> v1:172.21.15.148:6789/0 conn(0x7fbb0c0c5e10 legacy=0x7fbb0c0a6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.098+0000 7fbb0bfff640 1 -- 172.21.15.88:0/1917382178 >> v1:172.21.15.88:6789/0 conn(0x7fbb0c14e7e0 legacy=0x7fbb0c0c2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.098+0000 7fbb0bfff640 1 -- 172.21.15.88:0/1917382178 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c1547e0 con 0x7fbb0c157b10 2023-12-08T08:20:26.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.102+0000 7fbb0bfff640 1 --2- 172.21.15.88:0/1917382178 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb0c157b10 0x7fbb0c157fc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbb04009dc0 tx=0x7fbb0401c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25c86a7c7a6d278b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.102+0000 7fbb0affd640 1 -- 172.21.15.88:0/1917382178 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc001680 con 0x7fbb0c157b10 2023-12-08T08:20:26.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.102+0000 7fbb0affd640 1 -- 172.21.15.88:0/1917382178 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb040a5580 con 0x7fbb0c157b10 2023-12-08T08:20:26.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.102+0000 7fbb0affd640 1 -- 172.21.15.88:0/1917382178 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb040a5910 con 0x7fbb0c157b10 2023-12-08T08:20:26.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.102+0000 7fbb1218d640 1 -- 172.21.15.88:0/1917382178 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb0c157b10 msgr2=0x7fbb0c157fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.102+0000 7fbb1218d640 1 --2- 172.21.15.88:0/1917382178 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb0c157b10 0x7fbb0c157fc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbb04009dc0 tx=0x7fbb0401c740 comp rx=0 tx=0).stop 2023-12-08T08:20:26.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.102+0000 7fbb1218d640 1 -- 172.21.15.88:0/1917382178 shutdown_connections 2023-12-08T08:20:26.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.102+0000 7fbb1218d640 1 --2- 172.21.15.88:0/1917382178 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb0c157b10 0x7fbb0c157fc0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.102+0000 7fbb1218d640 1 -- 172.21.15.88:0/1917382178 >> 172.21.15.88:0/1917382178 conn(0x7fbb0c0c7c60 msgr2=0x7fbb0c0c8070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:26.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.102+0000 7fbb1218d640 1 -- 172.21.15.88:0/1917382178 shutdown_connections 2023-12-08T08:20:26.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.102+0000 7fbb1218d640 1 -- 172.21.15.88:0/1917382178 wait complete. 2023-12-08T08:20:26.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.102+0000 7fbb1218d640 1 Processor -- start 2023-12-08T08:20:26.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.102+0000 7fbb1218d640 1 -- start start 2023-12-08T08:20:26.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.106+0000 7fbb1218d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb0c0c5e10 0x7fbb0c14cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.106+0000 7fbb1218d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb0c14e7e0 0x7fbb0c06c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.106+0000 7fbb1218d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb0c157b10 0x7fbb0c06cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.106+0000 7fbb1218d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c06ff30 con 0x7fbb0c157b10 2023-12-08T08:20:26.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.106+0000 7fbb1218d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c06f970 con 0x7fbb0c0c5e10 2023-12-08T08:20:26.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.106+0000 7fbb1218d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c06fc50 con 0x7fbb0c14e7e0 2023-12-08T08:20:26.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.106+0000 7fbb0bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb0c157b10 0x7fbb0c06cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.106+0000 7fbb0bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb0c157b10 0x7fbb0c06cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39838/0 (socket says 172.21.15.88:39838) 2023-12-08T08:20:26.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.106+0000 7fbb0bfff640 1 -- 172.21.15.88:0/3914113937 learned_addr learned my addr 172.21.15.88:0/3914113937 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:26.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.106+0000 7fbb0b7fe640 1 --2- 172.21.15.88:0/3914113937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb0c0c5e10 0x7fbb0c14cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.106+0000 7fbb03fff640 1 --2- 172.21.15.88:0/3914113937 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb0c14e7e0 0x7fbb0c06c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.106+0000 7fbb0bfff640 1 -- 172.21.15.88:0/3914113937 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb0c14e7e0 msgr2=0x7fbb0c06c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.106+0000 7fbb0bfff640 1 --2- 172.21.15.88:0/3914113937 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb0c14e7e0 0x7fbb0c06c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.106+0000 7fbb0bfff640 1 -- 172.21.15.88:0/3914113937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb0c0c5e10 msgr2=0x7fbb0c14cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.106+0000 7fbb0bfff640 1 --2- 172.21.15.88:0/3914113937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb0c0c5e10 0x7fbb0c14cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.106+0000 7fbb0bfff640 1 -- 172.21.15.88:0/3914113937 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb04009a70 con 0x7fbb0c157b10 2023-12-08T08:20:26.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.106+0000 7fbb03fff640 1 --2- 172.21.15.88:0/3914113937 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb0c14e7e0 0x7fbb0c06c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:26.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.106+0000 7fbb0bfff640 1 --2- 172.21.15.88:0/3914113937 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb0c157b10 0x7fbb0c06cc50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbb040b0040 tx=0x7fbb040194e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.106+0000 7fbb08ff9640 1 -- 172.21.15.88:0/3914113937 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb04003ba0 con 0x7fbb0c157b10 2023-12-08T08:20:26.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.106+0000 7fbb08ff9640 1 -- 172.21.15.88:0/3914113937 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb04003d20 con 0x7fbb0c157b10 2023-12-08T08:20:26.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.106+0000 7fbb08ff9640 1 -- 172.21.15.88:0/3914113937 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb04004270 con 0x7fbb0c157b10 2023-12-08T08:20:26.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.106+0000 7fbb1218d640 1 -- 172.21.15.88:0/3914113937 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb0c155a70 con 0x7fbb0c157b10 2023-12-08T08:20:26.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.106+0000 7fbb1218d640 1 -- 172.21.15.88:0/3914113937 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb0c14d420 con 0x7fbb0c157b10 2023-12-08T08:20:26.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.106+0000 7fbb1218d640 1 -- 172.21.15.88:0/3914113937 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb0c1558d0 con 0x7fbb0c157b10 2023-12-08T08:20:26.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.106+0000 7fbb08ff9640 1 -- 172.21.15.88:0/3914113937 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbb040b4050 con 0x7fbb0c157b10 2023-12-08T08:20:26.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.110+0000 7fbb08ff9640 1 --2- 172.21.15.88:0/3914113937 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbaec066470 0x7fbaec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.110+0000 7fbb08ff9640 1 -- 172.21.15.88:0/3914113937 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb0411e9f0 con 0x7fbb0c157b10 2023-12-08T08:20:26.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.110+0000 7fbb0b7fe640 1 --2- 172.21.15.88:0/3914113937 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbaec066470 0x7fbaec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.110+0000 7fbb0b7fe640 1 --2- 172.21.15.88:0/3914113937 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbaec066470 0x7fbaec068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbafc000f70 tx=0x7fbafc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.114+0000 7fbb08ff9640 1 -- 172.21.15.88:0/3914113937 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbb0c1558d0 con 0x7fbb0c157b10 2023-12-08T08:20:26.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.262+0000 7fbb1218d640 1 -- 172.21.15.88:0/3914113937 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb0c1558d0 con 0x7fbb0c157b10 2023-12-08T08:20:26.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.266+0000 7fbb08ff9640 1 -- 172.21.15.88:0/3914113937 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7fbb0c1558d0 con 0x7fbb0c157b10 2023-12-08T08:20:26.269 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:26.269 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:20:21.492555+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:18.675917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:19.511013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:26.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.266+0000 7fbb1218d640 1 -- 172.21.15.88:0/3914113937 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbaec066470 msgr2=0x7fbaec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.266+0000 7fbb1218d640 1 --2- 172.21.15.88:0/3914113937 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbaec066470 0x7fbaec068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbafc000f70 tx=0x7fbafc009040 comp rx=0 tx=0).stop 2023-12-08T08:20:26.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.266+0000 7fbb1218d640 1 -- 172.21.15.88:0/3914113937 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb0c157b10 msgr2=0x7fbb0c06cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.266+0000 7fbb1218d640 1 --2- 172.21.15.88:0/3914113937 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb0c157b10 0x7fbb0c06cc50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbb040b0040 tx=0x7fbb040194e0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.266+0000 7fbb1218d640 1 -- 172.21.15.88:0/3914113937 shutdown_connections 2023-12-08T08:20:26.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.266+0000 7fbb1218d640 1 --2- 172.21.15.88:0/3914113937 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbaec066470 0x7fbaec068930 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.266+0000 7fbb1218d640 1 --2- 172.21.15.88:0/3914113937 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb0c157b10 0x7fbb0c06cc50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.266+0000 7fbb1218d640 1 --2- 172.21.15.88:0/3914113937 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb0c14e7e0 0x7fbb0c06c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.266+0000 7fbb1218d640 1 --2- 172.21.15.88:0/3914113937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb0c0c5e10 0x7fbb0c14cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.266+0000 7fbb1218d640 1 -- 172.21.15.88:0/3914113937 >> 172.21.15.88:0/3914113937 conn(0x7fbb0c0c7c60 msgr2=0x7fbb0c0c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:26.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.266+0000 7fbb1218d640 1 -- 172.21.15.88:0/3914113937 shutdown_connections 2023-12-08T08:20:26.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.266+0000 7fbb1218d640 1 -- 172.21.15.88:0/3914113937 wait complete. 2023-12-08T08:20:26.290 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-08T08:20:26.290 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:26.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.422+0000 7f632e006640 1 Processor -- start 2023-12-08T08:20:26.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.422+0000 7f632e006640 1 -- start start 2023-12-08T08:20:26.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.426+0000 7f632e006640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6328158020 0x7f632815fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.426+0000 7f632e006640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6328158490 con 0x7f6328151b40 2023-12-08T08:20:26.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.426+0000 7f632e006640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63280c8460 con 0x7f63280c7fd0 2023-12-08T08:20:26.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.426+0000 7f632e006640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6328154320 con 0x7f6328158020 2023-12-08T08:20:26.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.426+0000 7f632d805640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6328158020 0x7f632815fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.426+0000 7f632d004640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6328151b40 0x7f63280c9f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:32804/0 (socket says 172.21.15.88:32804) 2023-12-08T08:20:26.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.426+0000 7f632d004640 1 -- 172.21.15.88:0/601119403 learned_addr learned my addr 172.21.15.88:0/601119403 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:26.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.426+0000 7f631ffff640 1 -- 172.21.15.88:0/601119403 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2887989181 0 0) 0x7f6328158490 con 0x7f6328151b40 2023-12-08T08:20:26.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.426+0000 7f631ffff640 1 -- 172.21.15.88:0/601119403 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6314003530 con 0x7f6328151b40 2023-12-08T08:20:26.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.426+0000 7f632d805640 1 -- 172.21.15.88:0/601119403 >> v1:172.21.15.148:6789/0 conn(0x7f63280c7fd0 legacy=0x7f6328157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.426+0000 7f632d805640 1 -- 172.21.15.88:0/601119403 >> v1:172.21.15.88:6789/0 conn(0x7f6328151b40 legacy=0x7f63280c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.426+0000 7f632d805640 1 -- 172.21.15.88:0/601119403 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6328154530 con 0x7f6328158020 2023-12-08T08:20:26.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.430+0000 7f632d805640 1 --2- 172.21.15.88:0/601119403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6328158020 0x7f632815fcb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6320009d90 tx=0x7f632001c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd5ac88fb0e2790c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.430+0000 7f631ffff640 1 -- 172.21.15.88:0/601119403 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63200a5890 con 0x7f6328158020 2023-12-08T08:20:26.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.430+0000 7f631ffff640 1 -- 172.21.15.88:0/601119403 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63200a59f0 con 0x7f6328158020 2023-12-08T08:20:26.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.430+0000 7f631ffff640 1 -- 172.21.15.88:0/601119403 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63200a5d80 con 0x7f6328158020 2023-12-08T08:20:26.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.430+0000 7f632e006640 1 -- 172.21.15.88:0/601119403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6328158020 msgr2=0x7f632815fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.430+0000 7f632e006640 1 --2- 172.21.15.88:0/601119403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6328158020 0x7f632815fcb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6320009d90 tx=0x7f632001c8c0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.430+0000 7f632e006640 1 -- 172.21.15.88:0/601119403 shutdown_connections 2023-12-08T08:20:26.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.430+0000 7f632e006640 1 --2- 172.21.15.88:0/601119403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6328158020 0x7f632815fcb0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.430+0000 7f632e006640 1 -- 172.21.15.88:0/601119403 >> 172.21.15.88:0/601119403 conn(0x7f6328066470 msgr2=0x7f6328066880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:26.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.430+0000 7f632e006640 1 -- 172.21.15.88:0/601119403 shutdown_connections 2023-12-08T08:20:26.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.430+0000 7f632e006640 1 -- 172.21.15.88:0/601119403 wait complete. 2023-12-08T08:20:26.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.430+0000 7f632e006640 1 Processor -- start 2023-12-08T08:20:26.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.430+0000 7f632e006640 1 -- start start 2023-12-08T08:20:26.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.434+0000 7f632e006640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63280c7fd0 0x7f6328155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.434+0000 7f632e006640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6328151b40 0x7f63281539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.434+0000 7f632e006640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6328158020 0x7f63281ed940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.434+0000 7f632e006640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63280c3d80 con 0x7f63280c7fd0 2023-12-08T08:20:26.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.434+0000 7f632e006640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6328155aa0 con 0x7f6328158020 2023-12-08T08:20:26.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.434+0000 7f632e006640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6328155470 con 0x7f6328151b40 2023-12-08T08:20:26.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.434+0000 7f632d004640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63280c7fd0 0x7f6328155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.434+0000 7f632d004640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63280c7fd0 0x7f6328155f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39840/0 (socket says 172.21.15.88:39840) 2023-12-08T08:20:26.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.434+0000 7f632d004640 1 -- 172.21.15.88:0/818305358 learned_addr learned my addr 172.21.15.88:0/818305358 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:26.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.434+0000 7f632d805640 1 --2- 172.21.15.88:0/818305358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6328158020 0x7f63281ed940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.434+0000 7f632c803640 1 --2- 172.21.15.88:0/818305358 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6328151b40 0x7f63281539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.434+0000 7f632d004640 1 -- 172.21.15.88:0/818305358 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6328151b40 msgr2=0x7f63281539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.434+0000 7f632d004640 1 --2- 172.21.15.88:0/818305358 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6328151b40 0x7f63281539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.434+0000 7f632d004640 1 -- 172.21.15.88:0/818305358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6328158020 msgr2=0x7f63281ed940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.434+0000 7f632d004640 1 --2- 172.21.15.88:0/818305358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6328158020 0x7f63281ed940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.434+0000 7f632d004640 1 -- 172.21.15.88:0/818305358 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6320009a70 con 0x7f63280c7fd0 2023-12-08T08:20:26.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.434+0000 7f632d004640 1 --2- 172.21.15.88:0/818305358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63280c7fd0 0x7f6328155f30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f63240011f0 tx=0x7f632400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.434+0000 7f631dffb640 1 -- 172.21.15.88:0/818305358 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6324005cf0 con 0x7f63280c7fd0 2023-12-08T08:20:26.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.434+0000 7f631dffb640 1 -- 172.21.15.88:0/818305358 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6324005e50 con 0x7f63280c7fd0 2023-12-08T08:20:26.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.434+0000 7f631dffb640 1 -- 172.21.15.88:0/818305358 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6324007290 con 0x7f63280c7fd0 2023-12-08T08:20:26.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.434+0000 7f632e006640 1 -- 172.21.15.88:0/818305358 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6328157230 con 0x7f63280c7fd0 2023-12-08T08:20:26.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.434+0000 7f632e006640 1 -- 172.21.15.88:0/818305358 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6328155730 con 0x7f63280c7fd0 2023-12-08T08:20:26.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.434+0000 7f632e006640 1 -- 172.21.15.88:0/818305358 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6328067bc0 con 0x7f63280c7fd0 2023-12-08T08:20:26.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.434+0000 7f631dffb640 1 -- 172.21.15.88:0/818305358 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f63240073f0 con 0x7f63280c7fd0 2023-12-08T08:20:26.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.438+0000 7f631dffb640 1 --2- 172.21.15.88:0/818305358 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f630c066470 0x7f630c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.438+0000 7f631dffb640 1 -- 172.21.15.88:0/818305358 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6324083890 con 0x7f63280c7fd0 2023-12-08T08:20:26.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.438+0000 7f632c803640 1 --2- 172.21.15.88:0/818305358 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f630c066470 0x7f630c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.438+0000 7f632c803640 1 --2- 172.21.15.88:0/818305358 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f630c066470 0x7f630c068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f63280aaff0 tx=0x7f6318009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.442+0000 7f631dffb640 1 -- 172.21.15.88:0/818305358 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6324050dc0 con 0x7f63280c7fd0 2023-12-08T08:20:26.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.594+0000 7f632e006640 1 -- 172.21.15.88:0/818305358 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6328066850 con 0x7f63280c7fd0 2023-12-08T08:20:26.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.594+0000 7f631dffb640 1 -- 172.21.15.88:0/818305358 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7f63240543e0 con 0x7f63280c7fd0 2023-12-08T08:20:26.600 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:26.600 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:20:21.492555+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:18.675917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:19.511013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:26.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.598+0000 7f632e006640 1 -- 172.21.15.88:0/818305358 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f630c066470 msgr2=0x7f630c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.598+0000 7f632e006640 1 --2- 172.21.15.88:0/818305358 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f630c066470 0x7f630c068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f63280aaff0 tx=0x7f6318009040 comp rx=0 tx=0).stop 2023-12-08T08:20:26.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.598+0000 7f632e006640 1 -- 172.21.15.88:0/818305358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63280c7fd0 msgr2=0x7f6328155f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.598+0000 7f632e006640 1 --2- 172.21.15.88:0/818305358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63280c7fd0 0x7f6328155f30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f63240011f0 tx=0x7f632400c980 comp rx=0 tx=0).stop 2023-12-08T08:20:26.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.598+0000 7f632e006640 1 -- 172.21.15.88:0/818305358 shutdown_connections 2023-12-08T08:20:26.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.598+0000 7f632e006640 1 --2- 172.21.15.88:0/818305358 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f630c066470 0x7f630c068930 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.598+0000 7f632e006640 1 --2- 172.21.15.88:0/818305358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6328158020 0x7f63281ed940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.598+0000 7f632e006640 1 --2- 172.21.15.88:0/818305358 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6328151b40 0x7f63281539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.598+0000 7f632e006640 1 --2- 172.21.15.88:0/818305358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63280c7fd0 0x7f6328155f30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.598+0000 7f632e006640 1 -- 172.21.15.88:0/818305358 >> 172.21.15.88:0/818305358 conn(0x7f6328066470 msgr2=0x7f63280ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:26.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.598+0000 7f632e006640 1 -- 172.21.15.88:0/818305358 shutdown_connections 2023-12-08T08:20:26.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.598+0000 7f632e006640 1 -- 172.21.15.88:0/818305358 wait complete. 2023-12-08T08:20:26.621 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-08T08:20:26.622 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-08T08:20:26.622 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-08T08:20:26.623 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-08T08:20:26.623 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-08T08:20:26.623 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-08T08:20:26.624 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-08T08:20:26.624 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-08T08:20:26.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.854+0000 7f3ea5993640 1 Processor -- start 2023-12-08T08:20:26.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.854+0000 7f3ea5993640 1 -- start start 2023-12-08T08:20:26.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.858+0000 7f3ea5993640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3ea0151070 0x7f3ea00c5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.858+0000 7f3ea5993640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ea0152b60 0x7f3ea0152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.858+0000 7f3ea5993640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea00a52d0 con 0x7f3ea00c3a60 2023-12-08T08:20:26.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.858+0000 7f3ea5993640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea00c15f0 con 0x7f3ea0151070 2023-12-08T08:20:26.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.858+0000 7f3ea5993640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea00c61c0 con 0x7f3ea0152b60 2023-12-08T08:20:26.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.858+0000 7f3ea4991640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3ea0151070 0x7f3ea00c5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.858+0000 7f3ea4991640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3ea0151070 0x7f3ea00c5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:45256/0 (socket says 172.21.15.88:45256) 2023-12-08T08:20:26.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.858+0000 7f3ea4991640 1 -- 172.21.15.88:0/1437968164 learned_addr learned my addr 172.21.15.88:0/1437968164 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:26.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.858+0000 7f3ea4991640 1 -- 172.21.15.88:0/1437968164 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ea0152b60 msgr2=0x7f3ea0152fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-08T08:20:26.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.858+0000 7f3ea4991640 1 --2- 172.21.15.88:0/1437968164 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ea0152b60 0x7f3ea0152fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.858+0000 7f3ea4991640 1 -- 172.21.15.88:0/1437968164 >> v1:172.21.15.88:6789/0 conn(0x7f3ea00c3a60 legacy=0x7f3ea00c5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.858+0000 7f3ea4991640 1 -- 172.21.15.88:0/1437968164 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea00ab540 con 0x7f3ea0151070 2023-12-08T08:20:26.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.866+0000 7f3ea4991640 1 --2- 172.21.15.88:0/1437968164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ea0151070 0x7f3ea00c5570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3e94008870 tx=0x7f3e9401e950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e28cc77c86ca1a02 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.866+0000 7f3e9f7fe640 1 -- 172.21.15.88:0/1437968164 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e940a7820 con 0x7f3ea0151070 2023-12-08T08:20:26.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.866+0000 7f3e9f7fe640 1 -- 172.21.15.88:0/1437968164 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e940ab070 con 0x7f3ea0151070 2023-12-08T08:20:26.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.866+0000 7f3e9f7fe640 1 -- 172.21.15.88:0/1437968164 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e940a7ba0 con 0x7f3ea0151070 2023-12-08T08:20:26.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.866+0000 7f3ea5993640 1 -- 172.21.15.88:0/1437968164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ea0151070 msgr2=0x7f3ea00c5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.866+0000 7f3ea5993640 1 --2- 172.21.15.88:0/1437968164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ea0151070 0x7f3ea00c5570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3e94008870 tx=0x7f3e9401e950 comp rx=0 tx=0).stop 2023-12-08T08:20:26.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.866+0000 7f3ea5993640 1 -- 172.21.15.88:0/1437968164 shutdown_connections 2023-12-08T08:20:26.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.866+0000 7f3ea5993640 1 --2- 172.21.15.88:0/1437968164 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ea0152b60 0x7f3ea0152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.866+0000 7f4fc7479640 1 Processor -- start 2023-12-08T08:20:26.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.866+0000 7f3ea5993640 1 --2- 172.21.15.88:0/1437968164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ea0151070 0x7f3ea00c5570 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.866+0000 7f3ea5993640 1 -- 172.21.15.88:0/1437968164 >> 172.21.15.88:0/1437968164 conn(0x7f3ea00c2270 msgr2=0x7f3ea00c2680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:26.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.866+0000 7f4fc7479640 1 -- start start 2023-12-08T08:20:26.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.866+0000 7f3ea5993640 1 -- 172.21.15.88:0/1437968164 shutdown_connections 2023-12-08T08:20:26.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.866+0000 7f3ea5993640 1 -- 172.21.15.88:0/1437968164 wait complete. 2023-12-08T08:20:26.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fc7479640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4fc00bd550 0x7f4fc00c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fc7479640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc0155950 0x7f4fc01582f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fc7479640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc00c6840 con 0x7f4fc00c47b0 2023-12-08T08:20:26.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fc7479640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc0155da0 con 0x7f4fc00bd550 2023-12-08T08:20:26.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fc7479640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc00af870 con 0x7f4fc0155950 2023-12-08T08:20:26.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fc5215640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f4fc00c47b0 0x7f4fc0154ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:33924/0 (socket says 172.21.15.88:33924) 2023-12-08T08:20:26.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fc5215640 1 -- 172.21.15.88:0/2056562964 learned_addr learned my addr 172.21.15.88:0/2056562964 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:26.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f3ea5993640 1 Processor -- start 2023-12-08T08:20:26.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fbffff640 1 -- 172.21.15.88:0/2056562964 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3681725920 0 0) 0x7f4fc00c6840 con 0x7f4fc00c47b0 2023-12-08T08:20:26.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fbffff640 1 -- 172.21.15.88:0/2056562964 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fb0003530 con 0x7f4fc00c47b0 2023-12-08T08:20:26.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fbffff640 1 -- 172.21.15.88:0/2056562964 <== mon.1 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2268729453 0 0) 0x7f4fb0003530 con 0x7f4fc00c47b0 2023-12-08T08:20:26.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fbffff640 1 -- 172.21.15.88:0/2056562964 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc0155950 msgr2=0x7f4fc01582f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-08T08:20:26.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fbffff640 1 --2- 172.21.15.88:0/2056562964 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc0155950 0x7f4fc01582f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fbffff640 1 -- 172.21.15.88:0/2056562964 >> v2:172.21.15.148:3300/0 conn(0x7f4fc00bd550 msgr2=0x7f4fc00c4b90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-08T08:20:26.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fbffff640 1 --2- 172.21.15.88:0/2056562964 >> v2:172.21.15.148:3300/0 conn(0x7f4fc00bd550 0x7f4fc00c4b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fbffff640 1 -- 172.21.15.88:0/2056562964 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc00c6a70 con 0x7f4fc00c47b0 2023-12-08T08:20:26.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fbffff640 1 -- 172.21.15.88:0/2056562964 <== mon.1 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f4fb4001a00 con 0x7f4fc00c47b0 2023-12-08T08:20:26.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fbffff640 1 -- 172.21.15.88:0/2056562964 >> v1:172.21.15.148:6789/0 conn(0x7f4fc00c47b0 legacy=0x7f4fc0154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fbffff640 1 --2- 172.21.15.88:0/2056562964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fb0003980 0x7f4fb0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fbffff640 1 --2- 172.21.15.88:0/2056562964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fb00047d0 0x7f4fb0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fbffff640 1 --2- 172.21.15.88:0/2056562964 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fb0005390 0x7f4fb000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fbffff640 1 -- 172.21.15.88:0/2056562964 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc0155da0 con 0x7f4fb0003980 2023-12-08T08:20:26.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fbffff640 1 -- 172.21.15.88:0/2056562964 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc00af870 con 0x7f4fb00047d0 2023-12-08T08:20:26.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fbffff640 1 -- 172.21.15.88:0/2056562964 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb000c260 con 0x7f4fb0005390 2023-12-08T08:20:26.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fc5215640 1 --2- 172.21.15.88:0/2056562964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fb0003980 0x7f4fb0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f3ea5993640 1 -- start start 2023-12-08T08:20:26.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fc5215640 1 -- 172.21.15.88:0/2056562964 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fb0005390 msgr2=0x7f4fb000b990 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-08T08:20:26.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fc5215640 1 --2- 172.21.15.88:0/2056562964 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fb0005390 0x7f4fb000b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fc5215640 1 -- 172.21.15.88:0/2056562964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fb00047d0 msgr2=0x7f4fb0004c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-08T08:20:26.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fc5215640 1 --2- 172.21.15.88:0/2056562964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fb00047d0 0x7f4fb0004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f4fc5215640 1 -- 172.21.15.88:0/2056562964 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb0003530 con 0x7f4fb0003980 2023-12-08T08:20:26.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f3ea5993640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ea00c3a60 0x7f3ea014fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f3ea5993640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ea0152b60 0x7f3ea01e9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f3ea5993640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ea00a8ee0 0x7f3ea01e9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f3ea5993640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea0070930 con 0x7f3ea0152b60 2023-12-08T08:20:26.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f3ea5993640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea0071740 con 0x7f3ea00a8ee0 2023-12-08T08:20:26.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f3ea5993640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea00701e0 con 0x7f3ea00c3a60 2023-12-08T08:20:26.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f64baf80640 1 Processor -- start 2023-12-08T08:20:26.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7f64baf80640 1 -- start start 2023-12-08T08:20:26.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.870+0000 7fa0a7e32640 1 Processor -- start 2023-12-08T08:20:26.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f3e9ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ea0152b60 0x7f3ea01e9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f3ea4991640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ea00c3a60 0x7f3ea014fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f3ea5192640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ea00a8ee0 0x7f3ea01e9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f3ea4991640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ea00c3a60 0x7f3ea014fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:55694/0 (socket says 172.21.15.88:55694) 2023-12-08T08:20:26.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f3e9ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ea0152b60 0x7f3ea01e9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39850/0 (socket says 172.21.15.88:39850) 2023-12-08T08:20:26.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f3ea4991640 1 -- 172.21.15.88:0/1285493197 learned_addr learned my addr 172.21.15.88:0/1285493197 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:26.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7fa0a7e32640 1 -- start start 2023-12-08T08:20:26.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f3ea5192640 1 -- 172.21.15.88:0/1285493197 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ea00c3a60 msgr2=0x7f3ea014fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f3ea5192640 1 --2- 172.21.15.88:0/1285493197 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ea00c3a60 0x7f3ea014fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f3ea5192640 1 -- 172.21.15.88:0/1285493197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ea0152b60 msgr2=0x7f3ea01e9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f3ea5192640 1 --2- 172.21.15.88:0/1285493197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ea0152b60 0x7f3ea01e9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f64baf80640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f64b4152d30 0x7f64b415cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f3ea5192640 1 -- 172.21.15.88:0/1285493197 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e94008550 con 0x7f3ea00a8ee0 2023-12-08T08:20:26.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f3ea4991640 1 --2- 172.21.15.88:0/1285493197 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ea00c3a60 0x7f3ea014fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:26.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f64baf80640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f64b40c3930 0x7f64b406d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f64baf80640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b415c710 con 0x7f64b40c3dc0 2023-12-08T08:20:26.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f64baf80640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b406c360 con 0x7f64b40c3930 2023-12-08T08:20:26.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f64baf80640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b40aa820 con 0x7f64b4152d30 2023-12-08T08:20:26.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f64b8d1c640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f64b4152d30 0x7f64b415cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f64b3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f64b40c3930 0x7f64b406d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7fa0a7e32640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa0a00af580 0x7fa0a00c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7fa0a7e32640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa0a00c6180 0x7fa0a00c9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f3ea5192640 1 --2- 172.21.15.88:0/1285493197 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ea00a8ee0 0x7f3ea01e9670 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3e9000b3e0 tx=0x7f3e9000b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f64b3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f64b40c3930 0x7f64b406d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39862/0 (socket says 172.21.15.88:39862) 2023-12-08T08:20:26.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f64b3fff640 1 -- 172.21.15.88:0/530194556 learned_addr learned my addr 172.21.15.88:0/530194556 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:26.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7fa0a7e32640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a00bfeb0 con 0x7fa0a00c5da0 2023-12-08T08:20:26.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7fa0a7e32640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a00c65d0 con 0x7fa0a00af580 2023-12-08T08:20:26.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7fa0a7e32640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a00bfbf0 con 0x7fa0a00c6180 2023-12-08T08:20:26.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7fa0a5bce640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa0a00c5da0 0x7fa0a00c8bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:32832/0 (socket says 172.21.15.88:32832) 2023-12-08T08:20:26.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f3e9d7fa640 1 -- 172.21.15.88:0/1285493197 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e90011830 con 0x7f3ea00a8ee0 2023-12-08T08:20:26.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f3e9d7fa640 1 -- 172.21.15.88:0/1285493197 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e90011990 con 0x7f3ea00a8ee0 2023-12-08T08:20:26.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f3e9d7fa640 1 -- 172.21.15.88:0/1285493197 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e90011d40 con 0x7f3ea00a8ee0 2023-12-08T08:20:26.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f3ea5993640 1 -- 172.21.15.88:0/1285493197 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea01ecd80 con 0x7f3ea00a8ee0 2023-12-08T08:20:26.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f64b3fff640 1 -- 172.21.15.88:0/530194556 >> v2:172.21.15.148:3300/0 conn(0x7f64b4152d30 msgr2=0x7f64b415cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:26.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f64b3fff640 1 --2- 172.21.15.88:0/530194556 >> v2:172.21.15.148:3300/0 conn(0x7f64b4152d30 0x7f64b415cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f64b3fff640 1 -- 172.21.15.88:0/530194556 >> v1:172.21.15.88:6789/0 conn(0x7f64b40c3dc0 legacy=0x7f64b40a9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7fa0a5bce640 1 -- 172.21.15.88:0/1114048619 learned_addr learned my addr 172.21.15.88:0/1114048619 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:26.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f64b3fff640 1 -- 172.21.15.88:0/530194556 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b415c0c0 con 0x7f64b40c3930 2023-12-08T08:20:26.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7f3ea5993640 1 -- 172.21.15.88:0/1285493197 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea006fb90 con 0x7f3ea00a8ee0 2023-12-08T08:20:26.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.874+0000 7fa0a53cd640 1 --2- 172.21.15.88:0/1114048619 >> v2:172.21.15.88:3300/0 conn(0x7fa0a00af580 0x7fa0a00c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.878+0000 7fa0a63cf640 1 --2- 172.21.15.88:0/1114048619 >> v2:172.21.15.148:3300/0 conn(0x7fa0a00c6180 0x7fa0a00c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.878+0000 7f4fc5215640 1 --2- 172.21.15.88:0/2056562964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fb0003980 0x7f4fb0003da0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400a7d0 tx=0x7f4fb401d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e303b7a48633e4e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.878+0000 7fa0a63cf640 1 -- 172.21.15.88:0/1114048619 >> v2:172.21.15.88:3300/0 conn(0x7fa0a00af580 msgr2=0x7fa0a00c4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:26.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.878+0000 7fa0a63cf640 1 --2- 172.21.15.88:0/1114048619 >> v2:172.21.15.88:3300/0 conn(0x7fa0a00af580 0x7fa0a00c4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.878+0000 7fa0a63cf640 1 -- 172.21.15.88:0/1114048619 >> v1:172.21.15.88:6789/0 conn(0x7fa0a00c5da0 legacy=0x7fa0a00c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.878+0000 7fa0a63cf640 1 -- 172.21.15.88:0/1114048619 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a00befb0 con 0x7fa0a00c6180 2023-12-08T08:20:26.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.878+0000 7f3ea5993640 1 -- 172.21.15.88:0/1285493197 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3ea015d6c0 con 0x7f3ea00a8ee0 2023-12-08T08:20:26.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.878+0000 7f4fbffff640 1 -- 172.21.15.88:0/2056562964 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb40ad630 con 0x7f4fb0003980 2023-12-08T08:20:26.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.878+0000 7f4fbffff640 1 -- 172.21.15.88:0/2056562964 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb40a8070 con 0x7f4fb0003980 2023-12-08T08:20:26.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.878+0000 7f4fbffff640 1 -- 172.21.15.88:0/2056562964 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb40ada70 con 0x7f4fb0003980 2023-12-08T08:20:26.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.878+0000 7f3e9d7fa640 1 -- 172.21.15.88:0/1285493197 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3e9001a400 con 0x7f3ea00a8ee0 2023-12-08T08:20:26.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.882+0000 7f3e9d7fa640 1 --2- 172.21.15.88:0/1285493197 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3e8c066540 0x7f3e8c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.882+0000 7f3e9d7fa640 1 -- 172.21.15.88:0/1285493197 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e90083da0 con 0x7f3ea00a8ee0 2023-12-08T08:20:26.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.882+0000 7f3ea4991640 1 --2- 172.21.15.88:0/1285493197 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3e8c066540 0x7f3e8c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.882+0000 7f3e9d7fa640 1 --2- 172.21.15.88:0/1285493197 >> [v2:172.21.15.88:6808/1011316311,v1:172.21.15.88:6810/1011316311] conn(0x7f3e8c06e6e0 0x7f3e8c070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.882+0000 7f3e9d7fa640 1 -- 172.21.15.88:0/1285493197 --> [v2:172.21.15.88:6808/1011316311,v1:172.21.15.88:6810/1011316311] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3e8c0711b0 con 0x7f3e8c06e6e0 2023-12-08T08:20:26.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.878+0000 7f64b3fff640 1 --2- 172.21.15.88:0/530194556 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b40c3930 0x7f64b406d160 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f64b40c5210 tx=0x7f64ac01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b44a853040371c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.878+0000 7f64b37fe640 1 -- 172.21.15.88:0/530194556 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac0a5770 con 0x7f64b40c3930 2023-12-08T08:20:26.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.882+0000 7f64b37fe640 1 -- 172.21.15.88:0/530194556 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ac0a58d0 con 0x7f64b40c3930 2023-12-08T08:20:26.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.882+0000 7f64b37fe640 1 -- 172.21.15.88:0/530194556 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac0a5770 con 0x7f64b40c3930 2023-12-08T08:20:26.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.882+0000 7f64baf80640 1 -- 172.21.15.88:0/530194556 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b40c3930 msgr2=0x7f64b406d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.882+0000 7f64baf80640 1 --2- 172.21.15.88:0/530194556 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b40c3930 0x7f64b406d160 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f64b40c5210 tx=0x7f64ac01c9a0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.882+0000 7f64baf80640 1 -- 172.21.15.88:0/530194556 shutdown_connections 2023-12-08T08:20:26.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.882+0000 7f64baf80640 1 --2- 172.21.15.88:0/530194556 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b40c3930 0x7f64b406d160 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.882+0000 7f64baf80640 1 --2- 172.21.15.88:0/530194556 >> v2:172.21.15.148:3300/0 conn(0x7f64b4152d30 0x7f64b415cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.882+0000 7f64baf80640 1 -- 172.21.15.88:0/530194556 >> 172.21.15.88:0/530194556 conn(0x7f64b406b220 msgr2=0x7f64b40a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:26.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.878+0000 7f4fc7479640 1 -- 172.21.15.88:0/2056562964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fb0003980 msgr2=0x7f4fb0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.878+0000 7f4fc7479640 1 --2- 172.21.15.88:0/2056562964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fb0003980 0x7f4fb0003da0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400a7d0 tx=0x7f4fb401d2c0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.878+0000 7f4fc5a16640 1 -- 172.21.15.88:0/2056562964 reap_dead start 2023-12-08T08:20:26.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.878+0000 7f4fc7479640 1 -- 172.21.15.88:0/2056562964 shutdown_connections 2023-12-08T08:20:26.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.878+0000 7f4fc7479640 1 -- 172.21.15.88:0/2056562964 >> 172.21.15.88:0/2056562964 conn(0x7f4fc00aba00 msgr2=0x7f4fc00abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:26.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.882+0000 7f4fc7479640 1 -- 172.21.15.88:0/2056562964 shutdown_connections 2023-12-08T08:20:26.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.882+0000 7f4fc7479640 1 -- 172.21.15.88:0/2056562964 wait complete. 2023-12-08T08:20:26.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.882+0000 7f3e9d7fa640 1 -- 172.21.15.88:0/1285493197 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e90011ea0 con 0x7f3ea00a8ee0 2023-12-08T08:20:26.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.882+0000 7f64baf80640 1 -- 172.21.15.88:0/530194556 shutdown_connections 2023-12-08T08:20:26.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.882+0000 7f64baf80640 1 -- 172.21.15.88:0/530194556 wait complete. 2023-12-08T08:20:26.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.882+0000 7f3ea4991640 1 --2- 172.21.15.88:0/1285493197 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3e8c066540 0x7f3e8c068a00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3e9401e990 tx=0x7f3e9400a040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.882+0000 7f3e9ffff640 1 --2- 172.21.15.88:0/1285493197 >> [v2:172.21.15.88:6808/1011316311,v1:172.21.15.88:6810/1011316311] conn(0x7f3e8c06e6e0 0x7f3e8c070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f64baf80640 1 Processor -- start 2023-12-08T08:20:26.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f3e9ffff640 1 --2- 172.21.15.88:0/1285493197 >> [v2:172.21.15.88:6808/1011316311,v1:172.21.15.88:6810/1011316311] conn(0x7f3e8c06e6e0 0x7f3e8c070b00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f64baf80640 1 -- start start 2023-12-08T08:20:26.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f69ac72a640 1 Processor -- start 2023-12-08T08:20:26.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7fa0a63cf640 1 --2- 172.21.15.88:0/1114048619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0a00c6180 0x7fa0a00c9300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa09c0097c0 tx=0x7fa09c01c2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=356475fc576b0a8e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f69ac72a640 1 -- start start 2023-12-08T08:20:26.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7fa0a4bcc640 1 -- 172.21.15.88:0/1114048619 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c0ab600 con 0x7fa0a00c6180 2023-12-08T08:20:26.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7fa0a4bcc640 1 -- 172.21.15.88:0/1114048619 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09c0a7050 con 0x7fa0a00c6180 2023-12-08T08:20:26.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7fa0a4bcc640 1 -- 172.21.15.88:0/1114048619 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c0ab980 con 0x7fa0a00c6180 2023-12-08T08:20:26.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f3e9d7fa640 1 -- 172.21.15.88:0/1285493197 <== osd.1 v2:172.21.15.88:6808/1011316311 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3e8c0711b0 con 0x7f3e8c06e6e0 2023-12-08T08:20:26.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f64baf80640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64b40c3930 0x7f64b40a6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f64baf80640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b40c3dc0 0x7f64b414b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7fa0a7e32640 1 -- 172.21.15.88:0/1114048619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0a00c6180 msgr2=0x7fa0a00c9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7fa0a7e32640 1 --2- 172.21.15.88:0/1114048619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0a00c6180 0x7fa0a00c9300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa09c0097c0 tx=0x7fa09c01c2f0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f64baf80640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64b4152d30 0x7f64b414beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f64b8d1c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64b40c3930 0x7f64b40a6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f64b8d1c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64b40c3930 0x7f64b40a6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:45300/0 (socket says 172.21.15.88:45300) 2023-12-08T08:20:26.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f4fc7479640 1 Processor -- start 2023-12-08T08:20:26.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f4fc7479640 1 -- start start 2023-12-08T08:20:26.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f4fc7479640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc014d3f0 0x7f4fc0159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f4fc7479640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc00acad0 0x7f4fc0159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f4fc7479640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc015a080 0x7f4fc00adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f64b8d1c640 1 -- 172.21.15.88:0/3771795980 learned_addr learned my addr 172.21.15.88:0/3771795980 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:26.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f64baf80640 1 -- 172.21.15.88:0/3771795980 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b40a5f40 con 0x7f64b40c3dc0 2023-12-08T08:20:26.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f64baf80640 1 -- 172.21.15.88:0/3771795980 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b4151630 con 0x7f64b40c3930 2023-12-08T08:20:26.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f64b3fff640 1 --2- 172.21.15.88:0/3771795980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b40c3dc0 0x7f64b414b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f4fc5215640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc014d3f0 0x7f4fc0159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f4fc5215640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc014d3f0 0x7f4fc0159600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:45306/0 (socket says 172.21.15.88:45306) 2023-12-08T08:20:26.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f4fc4a14640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc00acad0 0x7f4fc0159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f4fc4a14640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc00acad0 0x7f4fc0159b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:55710/0 (socket says 172.21.15.88:55710) 2023-12-08T08:20:26.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f2d08d1c640 1 Processor -- start 2023-12-08T08:20:26.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f64b951d640 1 --2- 172.21.15.88:0/3771795980 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64b4152d30 0x7f64b414beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f69ac72a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69a40bd550 0x7f69a40c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f69ac72a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f69a4155950 0x7f69a41582f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f69ac72a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a40c6840 con 0x7f69a40c47b0 2023-12-08T08:20:26.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f69ac72a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69a40af870 con 0x7f69a4155950 2023-12-08T08:20:26.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f69ac72a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a4155d80 con 0x7f69a40bd550 2023-12-08T08:20:26.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f69aa4c6640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f69a40c47b0 0x7f69a4154ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:32846/0 (socket says 172.21.15.88:32846) 2023-12-08T08:20:26.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.886+0000 7f69aa4c6640 1 -- 172.21.15.88:0/842950879 learned_addr learned my addr 172.21.15.88:0/842950879 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:26.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f69a9cc5640 1 --2- 172.21.15.88:0/842950879 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69a40bd550 0x7f69a40c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f64baf80640 1 -- 172.21.15.88:0/3771795980 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b40a5730 con 0x7f64b4152d30 2023-12-08T08:20:26.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f2d08d1c640 1 -- start start 2023-12-08T08:20:26.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f4fc7479640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc015ba20 con 0x7f4fc015a080 2023-12-08T08:20:26.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f4fc7479640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc0159170 con 0x7f4fc014d3f0 2023-12-08T08:20:26.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f4fc7479640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc00ad090 con 0x7f4fc00acad0 2023-12-08T08:20:26.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f4fc5215640 1 -- 172.21.15.88:0/1489307156 learned_addr learned my addr 172.21.15.88:0/1489307156 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:26.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f69aacc7640 1 --2- 172.21.15.88:0/842950879 >> v2:172.21.15.88:3300/0 conn(0x7f69a4155950 0x7f69a41582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f69a94c4640 1 -- 172.21.15.88:0/842950879 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 425957907 0 0) 0x7f69a40c6840 con 0x7f69a40c47b0 2023-12-08T08:20:26.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f69a94c4640 1 -- 172.21.15.88:0/842950879 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6990003530 con 0x7f69a40c47b0 2023-12-08T08:20:26.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f69a94c4640 1 -- 172.21.15.88:0/842950879 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3082872638 0 0) 0x7f6990003530 con 0x7f69a40c47b0 2023-12-08T08:20:26.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f69a94c4640 1 -- 172.21.15.88:0/842950879 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69a40bd550 msgr2=0x7f69a40c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:26.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f69a94c4640 1 --2- 172.21.15.88:0/842950879 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69a40bd550 0x7f69a40c4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f69a94c4640 1 -- 172.21.15.88:0/842950879 >> v2:172.21.15.88:3300/0 conn(0x7f69a4155950 msgr2=0x7f69a41582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:26.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f69a94c4640 1 --2- 172.21.15.88:0/842950879 >> v2:172.21.15.88:3300/0 conn(0x7f69a4155950 0x7f69a41582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f69a94c4640 1 -- 172.21.15.88:0/842950879 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a40c6a70 con 0x7f69a40c47b0 2023-12-08T08:20:26.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f4fc4a14640 1 -- 172.21.15.88:0/1489307156 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc014d3f0 msgr2=0x7f4fc0159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f4fc4a14640 1 --2- 172.21.15.88:0/1489307156 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc014d3f0 0x7f4fc0159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f4fc4a14640 1 -- 172.21.15.88:0/1489307156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc015a080 msgr2=0x7f4fc00adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f4fc4a14640 1 --2- 172.21.15.88:0/1489307156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc015a080 0x7f4fc00adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f4fc4a14640 1 -- 172.21.15.88:0/1489307156 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc00ad370 con 0x7f4fc00acad0 2023-12-08T08:20:26.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f64b8d1c640 1 -- 172.21.15.88:0/3771795980 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64b4152d30 msgr2=0x7f64b414beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f64b8d1c640 1 --2- 172.21.15.88:0/3771795980 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64b4152d30 0x7f64b414beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f64b8d1c640 1 -- 172.21.15.88:0/3771795980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b40c3dc0 msgr2=0x7f64b414b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f64b8d1c640 1 --2- 172.21.15.88:0/3771795980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b40c3dc0 0x7f64b414b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f64b8d1c640 1 -- 172.21.15.88:0/3771795980 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ac009b30 con 0x7f64b40c3930 2023-12-08T08:20:26.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7fa0a7e32640 1 -- 172.21.15.88:0/1114048619 shutdown_connections 2023-12-08T08:20:26.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7fa0a7e32640 1 --2- 172.21.15.88:0/1114048619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0a00c6180 0x7fa0a00c9300 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7fa0a7e32640 1 --2- 172.21.15.88:0/1114048619 >> v2:172.21.15.88:3300/0 conn(0x7fa0a00af580 0x7fa0a00c4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7fa0a7e32640 1 -- 172.21.15.88:0/1114048619 >> 172.21.15.88:0/1114048619 conn(0x7fa0a00ca000 msgr2=0x7fa0a00ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:26.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f69a94c4640 1 -- 172.21.15.88:0/842950879 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f69a0001680 con 0x7f69a40c47b0 2023-12-08T08:20:26.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f69a94c4640 1 -- 172.21.15.88:0/842950879 >> v1:172.21.15.88:6789/0 conn(0x7f69a40c47b0 legacy=0x7f69a4154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f69a94c4640 1 --2- 172.21.15.88:0/842950879 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6990003980 0x7f6990003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f69a94c4640 1 --2- 172.21.15.88:0/842950879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69900047d0 0x7f6990004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f69a94c4640 1 --2- 172.21.15.88:0/842950879 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6990005190 0x7f699000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f69a94c4640 1 -- 172.21.15.88:0/842950879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a40af870 con 0x7f69900047d0 2023-12-08T08:20:26.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f69a94c4640 1 -- 172.21.15.88:0/842950879 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a4155d80 con 0x7f6990003980 2023-12-08T08:20:26.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f69a94c4640 1 -- 172.21.15.88:0/842950879 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699000bf00 con 0x7f6990005190 2023-12-08T08:20:26.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f69a9cc5640 1 --2- 172.21.15.88:0/842950879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69900047d0 0x7f6990004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f327d4d6640 1 Processor -- start 2023-12-08T08:20:26.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f327d4d6640 1 -- start start 2023-12-08T08:20:26.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f327d4d6640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32780c5f60 0x7f32780c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f327d4d6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f327806dfa0 0x7f32780c3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f69aa4c6640 1 --2- 172.21.15.88:0/842950879 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6990003980 0x7f6990003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f2d08d1c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d040c60d0 0x7f2d040a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f2d08d1c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2d040a51e0 0x7f2d0414d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f2d08d1c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d041514b0 con 0x7f2d040c5140 2023-12-08T08:20:26.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f2d08d1c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d040c0bd0 con 0x7f2d040a51e0 2023-12-08T08:20:26.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f2d08d1c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d041511d0 con 0x7f2d040c60d0 2023-12-08T08:20:26.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f4fc4a14640 1 --2- 172.21.15.88:0/1489307156 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc00acad0 0x7f4fc0159b40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4fac00b3e0 tx=0x7f4fac00b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f69aacc7640 1 --2- 172.21.15.88:0/842950879 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6990005190 0x7f699000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f64b8d1c640 1 --2- 172.21.15.88:0/3771795980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64b40c3930 0x7f64b40a6a70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f64a800e8a0 tx=0x7f64a800eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f64b17fa640 1 -- 172.21.15.88:0/3771795980 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a8009510 con 0x7f64b40c3930 2023-12-08T08:20:26.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f64b17fa640 1 -- 172.21.15.88:0/3771795980 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a800c940 con 0x7f64b40c3930 2023-12-08T08:20:26.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f64b17fa640 1 -- 172.21.15.88:0/3771795980 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a800ccb0 con 0x7f64b40c3930 2023-12-08T08:20:26.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f327d4d6640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3278153c00 con 0x7f327814da80 2023-12-08T08:20:26.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f327d4d6640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3278153ee0 con 0x7f327806dfa0 2023-12-08T08:20:26.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f327d4d6640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32781541c0 con 0x7f32780c5f60 2023-12-08T08:20:26.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f32767fc640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32780c5f60 0x7f32780c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f32767fc640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32780c5f60 0x7f32780c39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:55738/0 (socket says 172.21.15.88:55738) 2023-12-08T08:20:26.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f32767fc640 1 -- 172.21.15.88:0/500295389 learned_addr learned my addr 172.21.15.88:0/500295389 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:26.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f4fbdffb640 1 -- 172.21.15.88:0/1489307156 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac011830 con 0x7f4fc00acad0 2023-12-08T08:20:26.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f4fbdffb640 1 -- 172.21.15.88:0/1489307156 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fac011990 con 0x7f4fc00acad0 2023-12-08T08:20:26.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f4fbdffb640 1 -- 172.21.15.88:0/1489307156 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac011d40 con 0x7f4fc00acad0 2023-12-08T08:20:26.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.894+0000 7f4fc7479640 1 -- 172.21.15.88:0/1489307156 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc00ad650 con 0x7f4fc00acad0 2023-12-08T08:20:26.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.894+0000 7f4fc7479640 1 -- 172.21.15.88:0/1489307156 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc0156df0 con 0x7f4fc00acad0 2023-12-08T08:20:26.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f64baf80640 1 -- 172.21.15.88:0/3771795980 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b40a7c40 con 0x7f64b40c3930 2023-12-08T08:20:26.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.894+0000 7f64baf80640 1 -- 172.21.15.88:0/3771795980 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b40a5c60 con 0x7f64b40c3930 2023-12-08T08:20:26.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7fa0a7e32640 1 -- 172.21.15.88:0/1114048619 shutdown_connections 2023-12-08T08:20:26.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7fa0a7e32640 1 -- 172.21.15.88:0/1114048619 wait complete. 2023-12-08T08:20:26.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.894+0000 7f2d0259c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d040c60d0 0x7f2d040a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.894+0000 7f2d0259c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d040c60d0 0x7f2d040a4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:55734/0 (socket says 172.21.15.88:55734) 2023-12-08T08:20:26.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.894+0000 7f2d0259c640 1 -- 172.21.15.88:0/1462808615 learned_addr learned my addr 172.21.15.88:0/1462808615 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:26.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.894+0000 7f32767fc640 1 -- 172.21.15.88:0/500295389 >> v2:172.21.15.88:3300/0 conn(0x7f327806dfa0 msgr2=0x7f32780c3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:26.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f69a9cc5640 1 -- 172.21.15.88:0/842950879 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6990005190 msgr2=0x7f699000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:26.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f69a9cc5640 1 --2- 172.21.15.88:0/842950879 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6990005190 0x7f699000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f69a9cc5640 1 -- 172.21.15.88:0/842950879 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6990003980 msgr2=0x7f6990003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:26.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f69a9cc5640 1 --2- 172.21.15.88:0/842950879 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6990003980 0x7f6990003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.890+0000 7f69a9cc5640 1 -- 172.21.15.88:0/842950879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6990003530 con 0x7f69900047d0 2023-12-08T08:20:26.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.894+0000 7f32767fc640 1 --2- 172.21.15.88:0/500295389 >> v2:172.21.15.88:3300/0 conn(0x7f327806dfa0 0x7f32780c3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.894+0000 7f32767fc640 1 -- 172.21.15.88:0/500295389 >> v1:172.21.15.88:6789/0 conn(0x7f327814da80 legacy=0x7f327806ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:26.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.894+0000 7f32767fc640 1 -- 172.21.15.88:0/500295389 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32781544a0 con 0x7f32780c5f60 2023-12-08T08:20:26.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.894+0000 7f2d0259c640 1 -- 172.21.15.88:0/1462808615 >> v2:172.21.15.88:3300/0 conn(0x7f2d040a51e0 msgr2=0x7f2d0414d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:26.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.894+0000 7f2d0259c640 1 --2- 172.21.15.88:0/1462808615 >> v2:172.21.15.88:3300/0 conn(0x7f2d040a51e0 0x7f2d0414d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.894+0000 7f2d0259c640 1 -- 172.21.15.88:0/1462808615 >> v1:172.21.15.88:6789/0 conn(0x7f2d040c5140 legacy=0x7f2d040c3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:26.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.894+0000 7f2d0259c640 1 -- 172.21.15.88:0/1462808615 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0406bac0 con 0x7f2d040c60d0 2023-12-08T08:20:26.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.894+0000 7fa0a7e32640 1 Processor -- start 2023-12-08T08:20:26.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f64baf80640 1 -- 172.21.15.88:0/3771795980 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f64b4153110 con 0x7f64b40c3930 2023-12-08T08:20:26.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f64b17fa640 1 -- 172.21.15.88:0/3771795980 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f64a8013470 con 0x7f64b40c3930 2023-12-08T08:20:26.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f57fe7e7640 1 Processor -- start 2023-12-08T08:20:26.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f69a9cc5640 1 --2- 172.21.15.88:0/842950879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69900047d0 0x7f6990004c50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f69a40ab9b0 tx=0x7f699401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73122e7b910c607a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f57fe7e7640 1 -- start start 2023-12-08T08:20:26.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f69a94c4640 1 -- 172.21.15.88:0/842950879 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69940a8420 con 0x7f69900047d0 2023-12-08T08:20:26.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f32767fc640 1 --2- 172.21.15.88:0/500295389 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32780c5f60 0x7f32780c39c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3260009870 tx=0x7f326001e5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50216d51449ba6da server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f69a94c4640 1 -- 172.21.15.88:0/842950879 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69940a8580 con 0x7f69900047d0 2023-12-08T08:20:26.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f4fbdffb640 1 -- 172.21.15.88:0/1489307156 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4fac01a400 con 0x7f4fc00acad0 2023-12-08T08:20:26.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f4fc7479640 1 -- 172.21.15.88:0/1489307156 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4fc0157dd0 con 0x7f4fc00acad0 2023-12-08T08:20:26.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f4fbdffb640 1 --2- 172.21.15.88:0/1489307156 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4fa40664f0 0x7f4fa40689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f4fbdffb640 1 -- 172.21.15.88:0/1489307156 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4fac083d70 con 0x7f4fc00acad0 2023-12-08T08:20:26.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f4fbdffb640 1 --2- 172.21.15.88:0/1489307156 >> [v2:172.21.15.88:6809/1840118353,v1:172.21.15.88:6811/1840118353] conn(0x7f4fa406e690 0x7f4fa4070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f4fbdffb640 1 -- 172.21.15.88:0/1489307156 --> [v2:172.21.15.88:6809/1840118353,v1:172.21.15.88:6811/1840118353] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4fa4071160 con 0x7f4fa406e690 2023-12-08T08:20:26.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f4fbdffb640 1 -- 172.21.15.88:0/1489307156 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fac011ea0 con 0x7f4fc00acad0 2023-12-08T08:20:26.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f3275ffb640 1 -- 172.21.15.88:0/500295389 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32600ad600 con 0x7f32780c5f60 2023-12-08T08:20:26.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f3275ffb640 1 -- 172.21.15.88:0/500295389 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32600a9050 con 0x7f32780c5f60 2023-12-08T08:20:26.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f3275ffb640 1 -- 172.21.15.88:0/500295389 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32600ad980 con 0x7f32780c5f60 2023-12-08T08:20:26.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f64b17fa640 1 --2- 172.21.15.88:0/3771795980 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f64a00664c0 0x7f64a0068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f69a94c4640 1 -- 172.21.15.88:0/842950879 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69940a8970 con 0x7f69900047d0 2023-12-08T08:20:26.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f4fc5215640 1 --2- 172.21.15.88:0/1489307156 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4fa40664f0 0x7f4fa40689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7fa0a7e32640 1 -- start start 2023-12-08T08:20:26.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f4fc5a16640 1 --2- 172.21.15.88:0/1489307156 >> [v2:172.21.15.88:6809/1840118353,v1:172.21.15.88:6811/1840118353] conn(0x7f4fa406e690 0x7f4fa4070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f64b17fa640 1 -- 172.21.15.88:0/3771795980 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64a8054f90 con 0x7f64b40c3930 2023-12-08T08:20:26.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f64b3fff640 1 --2- 172.21.15.88:0/3771795980 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f64a00664c0 0x7f64a0068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f64b17fa640 1 --2- 172.21.15.88:0/3771795980 >> [v2:172.21.15.88:6824/4207137329,v1:172.21.15.88:6825/4207137329] conn(0x7f64a006e660 0x7f64a0070a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f64b17fa640 1 -- 172.21.15.88:0/3771795980 --> [v2:172.21.15.88:6824/4207137329,v1:172.21.15.88:6825/4207137329] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f64a0071130 con 0x7f64a006e660 2023-12-08T08:20:26.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7fa0a7e32640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0a00af580 0x7fa0a0148bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7fa0a7e32640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0a00c5da0 0x7fa0a00ab360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7fa0a7e32640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0a00c6180 0x7fa0a0152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7fa0a7e32640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a0149100 con 0x7fa0a00af580 2023-12-08T08:20:26.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7fa0a7e32640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a014bbe0 con 0x7fa0a00c6180 2023-12-08T08:20:26.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7fa0a7e32640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a014bec0 con 0x7fa0a00c5da0 2023-12-08T08:20:26.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f57fe7e7640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f57f80c47b0 0x7f57f80c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f57fe7e7640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f80c6840 con 0x7f57f80bd550 2023-12-08T08:20:26.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f57fe7e7640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f8158a00 con 0x7f57f8155950 2023-12-08T08:20:26.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f57fe7e7640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57f80af870 con 0x7f57f80c47b0 2023-12-08T08:20:26.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f57f77fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f57f80bd550 0x7f57f8154ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:32880/0 (socket says 172.21.15.88:32880) 2023-12-08T08:20:26.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f57f77fe640 1 -- 172.21.15.88:0/2972924454 learned_addr learned my addr 172.21.15.88:0/2972924454 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:26.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f69ac72a640 1 -- 172.21.15.88:0/842950879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69900047d0 msgr2=0x7f6990004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f69ac72a640 1 --2- 172.21.15.88:0/842950879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69900047d0 0x7f6990004c50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f69a40ab9b0 tx=0x7f699401c870 comp rx=0 tx=0).stop 2023-12-08T08:20:26.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f69aacc7640 1 -- 172.21.15.88:0/842950879 reap_dead start 2023-12-08T08:20:26.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f2d0259c640 1 --2- 172.21.15.88:0/1462808615 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d040c60d0 0x7f2d040a4ca0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2cec009870 tx=0x7f2cec01c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5d8806d3a50a468 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f327d4d6640 1 -- 172.21.15.88:0/500295389 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32780c5f60 msgr2=0x7f32780c39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f327d4d6640 1 --2- 172.21.15.88:0/500295389 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32780c5f60 0x7f32780c39c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3260009870 tx=0x7f326001e5f0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f327d4d6640 1 -- 172.21.15.88:0/500295389 shutdown_connections 2023-12-08T08:20:26.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f327d4d6640 1 --2- 172.21.15.88:0/500295389 >> v2:172.21.15.88:3300/0 conn(0x7f327806dfa0 0x7f32780c3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f327d4d6640 1 --2- 172.21.15.88:0/500295389 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32780c5f60 0x7f32780c39c0 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3260009870 tx=0x7f326001e5f0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f327d4d6640 1 -- 172.21.15.88:0/500295389 >> 172.21.15.88:0/500295389 conn(0x7f327806b220 msgr2=0x7f32780a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:26.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f327d4d6640 1 -- 172.21.15.88:0/500295389 shutdown_connections 2023-12-08T08:20:26.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f327d4d6640 1 -- 172.21.15.88:0/500295389 wait complete. 2023-12-08T08:20:26.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.898+0000 7f64b951d640 1 --2- 172.21.15.88:0/3771795980 >> [v2:172.21.15.88:6824/4207137329,v1:172.21.15.88:6825/4207137329] conn(0x7f64a006e660 0x7f64a0070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f57f7fff640 1 --2- 172.21.15.88:0/2972924454 >> v2:172.21.15.88:3300/0 conn(0x7f57f80c47b0 0x7f57f80c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f57f6ffd640 1 -- 172.21.15.88:0/2972924454 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 878283211 0 0) 0x7f57f00014a0 con 0x7f57f8155950 2023-12-08T08:20:26.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f69ac72a640 1 -- 172.21.15.88:0/842950879 shutdown_connections 2023-12-08T08:20:26.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f69ac72a640 1 -- 172.21.15.88:0/842950879 >> 172.21.15.88:0/842950879 conn(0x7f69a40aba00 msgr2=0x7f69a40abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:26.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f64b17fa640 1 -- 172.21.15.88:0/3771795980 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64a8050bd0 con 0x7f64b40c3930 2023-12-08T08:20:26.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f64b951d640 1 --2- 172.21.15.88:0/3771795980 >> [v2:172.21.15.88:6824/4207137329,v1:172.21.15.88:6825/4207137329] conn(0x7f64a006e660 0x7f64a0070a80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f57f6ffd640 1 -- 172.21.15.88:0/2972924454 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57e0003530 con 0x7f57f8155950 2023-12-08T08:20:26.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f57f6ffd640 1 -- 172.21.15.88:0/2972924454 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325029280 0 0) 0x7f57f80c6840 con 0x7f57f80bd550 2023-12-08T08:20:26.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f57f6ffd640 1 -- 172.21.15.88:0/2972924454 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57f00014a0 con 0x7f57f80bd550 2023-12-08T08:20:26.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f57f6ffd640 1 -- 172.21.15.88:0/2972924454 <== mon.1 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 410943456 0 0) 0x7f57e0003530 con 0x7f57f8155950 2023-12-08T08:20:26.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f57f6ffd640 1 -- 172.21.15.88:0/2972924454 >> v2:172.21.15.88:3300/0 conn(0x7f57f80c47b0 msgr2=0x7f57f80c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:26.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f57f6ffd640 1 --2- 172.21.15.88:0/2972924454 >> v2:172.21.15.88:3300/0 conn(0x7f57f80c47b0 0x7f57f80c4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f57f6ffd640 1 -- 172.21.15.88:0/2972924454 >> v1:172.21.15.88:6789/0 conn(0x7f57f80bd550 legacy=0x7f57f8154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f57f6ffd640 1 -- 172.21.15.88:0/2972924454 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f80c6a70 con 0x7f57f8155950 2023-12-08T08:20:26.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f57f6ffd640 1 -- 172.21.15.88:0/2972924454 <== mon.1 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f57f0001b90 con 0x7f57f8155950 2023-12-08T08:20:26.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f57f6ffd640 1 -- 172.21.15.88:0/2972924454 >> v1:172.21.15.148:6789/0 conn(0x7f57f8155950 legacy=0x7f57f81582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f57f6ffd640 1 --2- 172.21.15.88:0/2972924454 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57e0003b60 0x7f57e0003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f57f6ffd640 1 --2- 172.21.15.88:0/2972924454 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57e00047d0 0x7f57e0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f57f6ffd640 1 --2- 172.21.15.88:0/2972924454 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57e00051e0 0x7f57e000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f57f6ffd640 1 -- 172.21.15.88:0/2972924454 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f80af870 con 0x7f57e0003b60 2023-12-08T08:20:26.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f57f6ffd640 1 -- 172.21.15.88:0/2972924454 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e000c110 con 0x7f57e00047d0 2023-12-08T08:20:26.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f57f6ffd640 1 -- 172.21.15.88:0/2972924454 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e000c2d0 con 0x7f57e00051e0 2023-12-08T08:20:26.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f4fc5215640 1 --2- 172.21.15.88:0/1489307156 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4fa40664f0 0x7f4fa40689b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4fb401d300 tx=0x7f4fb4007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f4fc5a16640 1 --2- 172.21.15.88:0/1489307156 >> [v2:172.21.15.88:6809/1840118353,v1:172.21.15.88:6811/1840118353] conn(0x7f4fa406e690 0x7f4fa4070ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f57f77fe640 1 --2- 172.21.15.88:0/2972924454 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57e00047d0 0x7f57e0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f57f7fff640 1 --2- 172.21.15.88:0/2972924454 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57e0003b60 0x7f57e0003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f64b3fff640 1 --2- 172.21.15.88:0/3771795980 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f64a00664c0 0x7f64a0068980 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f64ac0ae000 tx=0x7f64ac0a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f327d4d6640 1 Processor -- start 2023-12-08T08:20:26.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f327d4d6640 1 -- start start 2023-12-08T08:20:26.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f64b17fa640 1 -- 172.21.15.88:0/3771795980 <== osd.2 v2:172.21.15.88:6824/4207137329 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f64a0071130 con 0x7f64a006e660 2023-12-08T08:20:26.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7fa0a63cf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0a00c6180 0x7fa0a0152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7fa0a53cd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0a00c5da0 0x7fa0a00ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7fa0a63cf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0a00c6180 0x7fa0a0152420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:45320/0 (socket says 172.21.15.88:45320) 2023-12-08T08:20:26.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7fa0a63cf640 1 -- 172.21.15.88:0/2934207804 learned_addr learned my addr 172.21.15.88:0/2934207804 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:26.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7fa0a5bce640 1 --2- 172.21.15.88:0/2934207804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0a00af580 0x7fa0a0148bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7fa0a53cd640 1 -- 172.21.15.88:0/2934207804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0a00c6180 msgr2=0x7fa0a0152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7fa0a53cd640 1 --2- 172.21.15.88:0/2934207804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0a00c6180 0x7fa0a0152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7fa0a53cd640 1 -- 172.21.15.88:0/2934207804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0a00af580 msgr2=0x7fa0a0148bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7fa0a53cd640 1 --2- 172.21.15.88:0/2934207804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0a00af580 0x7fa0a0148bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7fa0a53cd640 1 -- 172.21.15.88:0/2934207804 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c009420 con 0x7fa0a00c5da0 2023-12-08T08:20:26.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7fa0a5bce640 1 --2- 172.21.15.88:0/2934207804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0a00af580 0x7fa0a0148bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:26.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7fa0a53cd640 1 --2- 172.21.15.88:0/2934207804 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0a00c5da0 0x7fa0a00ab360 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa09000e870 tx=0x7fa09000ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7fa0967fc640 1 -- 172.21.15.88:0/2934207804 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09000eec0 con 0x7fa0a00c5da0 2023-12-08T08:20:26.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7fa0967fc640 1 -- 172.21.15.88:0/2934207804 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09000c940 con 0x7fa0a00c5da0 2023-12-08T08:20:26.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7fa0967fc640 1 -- 172.21.15.88:0/2934207804 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09000ccb0 con 0x7fa0a00c5da0 2023-12-08T08:20:26.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7fa0a7e32640 1 -- 172.21.15.88:0/2934207804 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a0159b40 con 0x7fa0a00c5da0 2023-12-08T08:20:26.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7fa0a7e32640 1 -- 172.21.15.88:0/2934207804 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a014c480 con 0x7fa0a00c5da0 2023-12-08T08:20:26.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f57f7fff640 1 -- 172.21.15.88:0/2972924454 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57e00051e0 msgr2=0x7f57e000b990 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-08T08:20:26.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f57f7fff640 1 --2- 172.21.15.88:0/2972924454 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57e00051e0 0x7f57e000b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f57f7fff640 1 -- 172.21.15.88:0/2972924454 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57e00047d0 msgr2=0x7f57e0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:26.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f57f7fff640 1 --2- 172.21.15.88:0/2972924454 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57e00047d0 0x7f57e0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f57f7fff640 1 -- 172.21.15.88:0/2972924454 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e0003530 con 0x7f57e0003b60 2023-12-08T08:20:26.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f57fcd84640 1 -- 172.21.15.88:0/2972924454 reap_dead start 2023-12-08T08:20:26.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f69ac72a640 1 -- 172.21.15.88:0/842950879 shutdown_connections 2023-12-08T08:20:26.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f2d0159a640 1 -- 172.21.15.88:0/1462808615 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec0ac640 con 0x7f2d040c60d0 2023-12-08T08:20:26.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f2d0159a640 1 -- 172.21.15.88:0/1462808615 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cec0ac7a0 con 0x7f2d040c60d0 2023-12-08T08:20:26.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.902+0000 7f2d0159a640 1 -- 172.21.15.88:0/1462808615 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec0acb30 con 0x7f2d040c60d0 2023-12-08T08:20:26.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7fa0a7e32640 1 -- 172.21.15.88:0/2934207804 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa0a01599c0 con 0x7fa0a00c5da0 2023-12-08T08:20:26.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f327d4d6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f327806dfa0 0x7f32780a91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f327d4d6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f327814da80 0x7f3278149390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f2d08d1c640 1 -- 172.21.15.88:0/1462808615 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d040c60d0 msgr2=0x7f2d040a4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f2d08d1c640 1 --2- 172.21.15.88:0/1462808615 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d040c60d0 0x7f2d040a4ca0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2cec009870 tx=0x7f2cec01c440 comp rx=0 tx=0).stop 2023-12-08T08:20:26.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f327d4d6640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32781498d0 0x7f32780a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f3276ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f327806dfa0 0x7f32780a91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f327d4d6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327814a440 con 0x7f327806dfa0 2023-12-08T08:20:26.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f3276ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f327806dfa0 0x7f32780a91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39944/0 (socket says 172.21.15.88:39944) 2023-12-08T08:20:26.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f327d4d6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327814a080 con 0x7f327814da80 2023-12-08T08:20:26.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f3276ffd640 1 -- 172.21.15.88:0/2285787078 learned_addr learned my addr 172.21.15.88:0/2285787078 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:26.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f327d4d6640 1 -- 172.21.15.88:0/2285787078 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32781e9cd0 con 0x7f32781498d0 2023-12-08T08:20:26.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f32767fc640 1 --2- 172.21.15.88:0/2285787078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f327814da80 0x7f3278149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f32777fe640 1 --2- 172.21.15.88:0/2285787078 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32781498d0 0x7f32780a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f3276ffd640 1 -- 172.21.15.88:0/2285787078 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32781498d0 msgr2=0x7f32780a6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f3276ffd640 1 --2- 172.21.15.88:0/2285787078 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f32781498d0 0x7f32780a6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f3276ffd640 1 -- 172.21.15.88:0/2285787078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f327814da80 msgr2=0x7f3278149390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f3276ffd640 1 --2- 172.21.15.88:0/2285787078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f327814da80 0x7f3278149390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f3276ffd640 1 -- 172.21.15.88:0/2285787078 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32600094d0 con 0x7f327806dfa0 2023-12-08T08:20:26.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f32767fc640 1 --2- 172.21.15.88:0/2285787078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f327814da80 0x7f3278149390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:26.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7fa0967fc640 1 -- 172.21.15.88:0/2934207804 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa090026480 con 0x7fa0a00c5da0 2023-12-08T08:20:26.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f3276ffd640 1 --2- 172.21.15.88:0/2285787078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f327806dfa0 0x7f32780a91c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f327000c490 tx=0x7f3270001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f326f7fe640 1 -- 172.21.15.88:0/2285787078 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270003600 con 0x7f327806dfa0 2023-12-08T08:20:26.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f326f7fe640 1 -- 172.21.15.88:0/2285787078 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3270003780 con 0x7f327806dfa0 2023-12-08T08:20:26.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f326f7fe640 1 -- 172.21.15.88:0/2285787078 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270003b70 con 0x7f327806dfa0 2023-12-08T08:20:26.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f327d4d6640 1 -- 172.21.15.88:0/2285787078 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32781e9fb0 con 0x7f327806dfa0 2023-12-08T08:20:26.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f327d4d6640 1 -- 172.21.15.88:0/2285787078 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3278158b20 con 0x7f327806dfa0 2023-12-08T08:20:26.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f327d4d6640 1 -- 172.21.15.88:0/2285787078 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3278149f00 con 0x7f327806dfa0 2023-12-08T08:20:26.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7fa0967fc640 1 --2- 172.21.15.88:0/2934207804 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa0840664a0 0x7fa084068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7fa0967fc640 1 -- 172.21.15.88:0/2934207804 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa090084660 con 0x7fa0a00c5da0 2023-12-08T08:20:26.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7fa0967fc640 1 --2- 172.21.15.88:0/2934207804 >> [v2:172.21.15.88:6800/22961328,v1:172.21.15.88:6801/22961328] conn(0x7fa08406e640 0x7fa084070a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7fa0967fc640 1 -- 172.21.15.88:0/2934207804 --> [v2:172.21.15.88:6800/22961328,v1:172.21.15.88:6801/22961328] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa084071110 con 0x7fa08406e640 2023-12-08T08:20:26.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7fa0967fc640 1 -- 172.21.15.88:0/2934207804 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa090084ab0 con 0x7fa0a00c5da0 2023-12-08T08:20:26.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.910+0000 7fa0a63cf640 1 --2- 172.21.15.88:0/2934207804 >> [v2:172.21.15.88:6800/22961328,v1:172.21.15.88:6801/22961328] conn(0x7fa08406e640 0x7fa084070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f2d08d1c640 1 -- 172.21.15.88:0/1462808615 shutdown_connections 2023-12-08T08:20:26.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.910+0000 7f2d08d1c640 1 --2- 172.21.15.88:0/1462808615 >> v2:172.21.15.88:3300/0 conn(0x7f2d040a51e0 0x7f2d0414d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.910+0000 7f2d08d1c640 1 --2- 172.21.15.88:0/1462808615 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d040c60d0 0x7f2d040a4ca0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.910+0000 7f2d08d1c640 1 -- 172.21.15.88:0/1462808615 >> 172.21.15.88:0/1462808615 conn(0x7f2d0406acf0 msgr2=0x7f2d040c59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:26.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.910+0000 7fa0a63cf640 1 --2- 172.21.15.88:0/2934207804 >> [v2:172.21.15.88:6800/22961328,v1:172.21.15.88:6801/22961328] conn(0x7fa08406e640 0x7fa084070a60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.910+0000 7f57f7fff640 1 --2- 172.21.15.88:0/2972924454 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57e0003b60 0x7f57e0003f60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f57e8009ae0 tx=0x7f57e801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81fbb691613149c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f4fbdffb640 1 -- 172.21.15.88:0/1489307156 <== osd.0 v2:172.21.15.88:6809/1840118353 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4fa4071160 con 0x7f4fa406e690 2023-12-08T08:20:26.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.910+0000 7f57f6ffd640 1 -- 172.21.15.88:0/2972924454 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e80a5530 con 0x7f57e0003b60 2023-12-08T08:20:26.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.910+0000 7f57f6ffd640 1 -- 172.21.15.88:0/2972924454 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e80a5690 con 0x7f57e0003b60 2023-12-08T08:20:26.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.910+0000 7f57f6ffd640 1 -- 172.21.15.88:0/2972924454 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e80a5a40 con 0x7f57e0003b60 2023-12-08T08:20:26.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.906+0000 7f69ac72a640 1 -- 172.21.15.88:0/842950879 wait complete. 2023-12-08T08:20:26.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.910+0000 7f69ac72a640 1 Processor -- start 2023-12-08T08:20:26.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.910+0000 7f326f7fe640 1 -- 172.21.15.88:0/2285787078 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3270003cd0 con 0x7f327806dfa0 2023-12-08T08:20:26.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.910+0000 7f69ac72a640 1 -- start start 2023-12-08T08:20:26.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.910+0000 7fa0a5bce640 1 --2- 172.21.15.88:0/2934207804 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa0840664a0 0x7fa084068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.910+0000 7fa0967fc640 1 -- 172.21.15.88:0/2934207804 <== osd.3 v2:172.21.15.88:6800/22961328 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa084071110 con 0x7fa08406e640 2023-12-08T08:20:26.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.910+0000 7f326f7fe640 1 --2- 172.21.15.88:0/2285787078 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3258066470 0x7f3258068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.910+0000 7f326f7fe640 1 -- 172.21.15.88:0/2285787078 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32700837f0 con 0x7f327806dfa0 2023-12-08T08:20:26.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.914+0000 7f326f7fe640 1 --2- 172.21.15.88:0/2285787078 >> [v2:172.21.15.148:6824/227078704,v1:172.21.15.148:6825/227078704] conn(0x7f325806e610 0x7f3258070a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.914+0000 7f326f7fe640 1 -- 172.21.15.88:0/2285787078 --> [v2:172.21.15.148:6824/227078704,v1:172.21.15.148:6825/227078704] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f32580710e0 con 0x7f325806e610 2023-12-08T08:20:26.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.914+0000 7f326f7fe640 1 -- 172.21.15.88:0/2285787078 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3270083c40 con 0x7f327806dfa0 2023-12-08T08:20:26.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.914+0000 7f69ac72a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69900047d0 0x7f69a40ae740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.914+0000 7f69ac72a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69a40c31a0 0x7f69a41f9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.914+0000 7f32777fe640 1 --2- 172.21.15.88:0/2285787078 >> [v2:172.21.15.148:6824/227078704,v1:172.21.15.148:6825/227078704] conn(0x7f325806e610 0x7f3258070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.914+0000 7f32767fc640 1 --2- 172.21.15.88:0/2285787078 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3258066470 0x7f3258068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.914+0000 7f69ac72a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69a40add80 0x7f69a41525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.914+0000 7f69ac72a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a41fa280 con 0x7f69a40add80 2023-12-08T08:20:26.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.914+0000 7f69ac72a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a40c2550 con 0x7f69a40c31a0 2023-12-08T08:20:26.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.914+0000 7f69ac72a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a40c2d60 con 0x7f69900047d0 2023-12-08T08:20:26.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.914+0000 7f69a9cc5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69a40c31a0 0x7f69a41f9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.914+0000 7f69aacc7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69a40add80 0x7f69a41525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.914+0000 7f69a9cc5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69a40c31a0 0x7f69a41f9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:45332/0 (socket says 172.21.15.88:45332) 2023-12-08T08:20:26.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.914+0000 7f2d08d1c640 1 -- 172.21.15.88:0/1462808615 shutdown_connections 2023-12-08T08:20:26.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.914+0000 7f69a9cc5640 1 -- 172.21.15.88:0/4268659625 learned_addr learned my addr 172.21.15.88:0/4268659625 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:26.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.914+0000 7f2d08d1c640 1 -- 172.21.15.88:0/1462808615 wait complete. 2023-12-08T08:20:26.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.914+0000 7f32777fe640 1 --2- 172.21.15.88:0/2285787078 >> [v2:172.21.15.148:6824/227078704,v1:172.21.15.148:6825/227078704] conn(0x7f325806e610 0x7f3258070a30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.914+0000 7fa0a5bce640 1 --2- 172.21.15.88:0/2934207804 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa0840664a0 0x7fa084068960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa098005c10 tx=0x7fa098009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.914+0000 7f326f7fe640 1 -- 172.21.15.88:0/2285787078 <== osd.7 v2:172.21.15.148:6824/227078704 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f32580710e0 con 0x7f325806e610 2023-12-08T08:20:26.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.914+0000 7f69aacc7640 1 -- 172.21.15.88:0/4268659625 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69900047d0 msgr2=0x7f69a40ae740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-08T08:20:26.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.914+0000 7f69aacc7640 1 --2- 172.21.15.88:0/4268659625 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69900047d0 0x7f69a40ae740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.914+0000 7f69aacc7640 1 -- 172.21.15.88:0/4268659625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69a40c31a0 msgr2=0x7f69a41f9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.914+0000 7f69aacc7640 1 --2- 172.21.15.88:0/4268659625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69a40c31a0 0x7f69a41f9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.914+0000 7f69aacc7640 1 -- 172.21.15.88:0/4268659625 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a40c3710 con 0x7f69a40add80 2023-12-08T08:20:26.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.914+0000 7f32767fc640 1 --2- 172.21.15.88:0/2285787078 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3258066470 0x7f3258068930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f32600af000 tx=0x7f3260008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.910+0000 7f57fe7e7640 1 -- 172.21.15.88:0/2972924454 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57e0003b60 msgr2=0x7f57e0003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.910+0000 7f57fe7e7640 1 --2- 172.21.15.88:0/2972924454 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57e0003b60 0x7f57e0003f60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f57e8009ae0 tx=0x7f57e801ca50 comp rx=0 tx=0).stop 2023-12-08T08:20:26.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.910+0000 7f57fe7e7640 1 -- 172.21.15.88:0/2972924454 shutdown_connections 2023-12-08T08:20:26.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.910+0000 7f57fe7e7640 1 --2- 172.21.15.88:0/2972924454 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57e0003b60 0x7f57e0003f60 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f57e8009ae0 tx=0x7f57e801ca50 comp rx=0 tx=0).stop 2023-12-08T08:20:26.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.910+0000 7f57fe7e7640 1 -- 172.21.15.88:0/2972924454 >> 172.21.15.88:0/2972924454 conn(0x7f57f80aba00 msgr2=0x7f57f80abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:26.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.918+0000 7f2d08d1c640 1 Processor -- start 2023-12-08T08:20:26.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.918+0000 7f57fe7e7640 1 -- 172.21.15.88:0/2972924454 shutdown_connections 2023-12-08T08:20:26.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.918+0000 7f57fe7e7640 1 -- 172.21.15.88:0/2972924454 wait complete. 2023-12-08T08:20:26.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.918+0000 7f2d08d1c640 1 -- start start 2023-12-08T08:20:26.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.918+0000 7f2d08d1c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d040a51e0 0x7f2d041f5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.918+0000 7f2d08d1c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d040c5140 0x7f2d040a71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.918+0000 7f2d08d1c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d040c60d0 0x7f2d040a76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.918+0000 7f2d08d1c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d040a5fb0 con 0x7f2d040a51e0 2023-12-08T08:20:26.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.918+0000 7f2d08d1c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d040a6d10 con 0x7f2d040c5140 2023-12-08T08:20:26.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.918+0000 7f2d08d1c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d041f5b10 con 0x7f2d040c60d0 2023-12-08T08:20:26.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.918+0000 7f2d01d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d040c5140 0x7f2d040a71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.918+0000 7f2d01d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d040c5140 0x7f2d040a71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:45346/0 (socket says 172.21.15.88:45346) 2023-12-08T08:20:26.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.918+0000 7f2d01d9b640 1 -- 172.21.15.88:0/576107166 learned_addr learned my addr 172.21.15.88:0/576107166 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:26.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.918+0000 7f2d02d9d640 1 --2- 172.21.15.88:0/576107166 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d040c60d0 0x7f2d040a76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.918+0000 7f57fe7e7640 1 Processor -- start 2023-12-08T08:20:26.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.918+0000 7f2d01d9b640 1 -- 172.21.15.88:0/576107166 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d040c60d0 msgr2=0x7f2d040a76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.918+0000 7f2d01d9b640 1 --2- 172.21.15.88:0/576107166 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d040c60d0 0x7f2d040a76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.918+0000 7f2d01d9b640 1 -- 172.21.15.88:0/576107166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d040a51e0 msgr2=0x7f2d041f5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.918+0000 7f2d01d9b640 1 --2- 172.21.15.88:0/576107166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d040a51e0 0x7f2d041f5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.918+0000 7f2d01d9b640 1 -- 172.21.15.88:0/576107166 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cec0094d0 con 0x7f2d040c5140 2023-12-08T08:20:26.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.918+0000 7f69aacc7640 1 --2- 172.21.15.88:0/4268659625 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69a40add80 0x7f69a41525b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f69a406a890 tx=0x7f699c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f2d01d9b640 1 --2- 172.21.15.88:0/576107166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d040c5140 0x7f2d040a71a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2cf400b550 tx=0x7f2cf400ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f57fe7e7640 1 -- start start 2023-12-08T08:20:26.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f3ea5993640 1 -- 172.21.15.88:0/1285493197 --> [v2:172.21.15.88:6808/1011316311,v1:172.21.15.88:6810/1011316311] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3ea00674b0 con 0x7f3e8c06e6e0 2023-12-08T08:20:26.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f2cfaffd640 1 -- 172.21.15.88:0/576107166 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4010870 con 0x7f2d040c5140 2023-12-08T08:20:26.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f2cfaffd640 1 -- 172.21.15.88:0/576107166 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf40109f0 con 0x7f2d040c5140 2023-12-08T08:20:26.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f2d08d1c640 1 -- 172.21.15.88:0/576107166 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d040a66c0 con 0x7f2d040c5140 2023-12-08T08:20:26.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f2cfaffd640 1 -- 172.21.15.88:0/576107166 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4010da0 con 0x7f2d040c5140 2023-12-08T08:20:26.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f699affd640 1 -- 172.21.15.88:0/4268659625 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699c00e040 con 0x7f69a40add80 2023-12-08T08:20:26.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f699affd640 1 -- 172.21.15.88:0/4268659625 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f699c00f040 con 0x7f69a40add80 2023-12-08T08:20:26.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f69ac72a640 1 -- 172.21.15.88:0/4268659625 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a40c27a0 con 0x7f69a40add80 2023-12-08T08:20:26.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f699affd640 1 -- 172.21.15.88:0/4268659625 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699c015430 con 0x7f69a40add80 2023-12-08T08:20:26.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f2d08d1c640 1 -- 172.21.15.88:0/576107166 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d040aaea0 con 0x7f2d040c5140 2023-12-08T08:20:26.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f2d08d1c640 1 -- 172.21.15.88:0/576107166 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2d040674b0 con 0x7f2d040c5140 2023-12-08T08:20:26.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f57fe7e7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f81dfd30 0x7f57f81ee130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f57fe7e7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57f80c9710 0x7f57f81f1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f57fe7e7640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57f81eeb20 0x7f57f814ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f57fe7e7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f81ee670 con 0x7f57f81dfd30 2023-12-08T08:20:26.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f57fe7e7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f81ed6b0 con 0x7f57f80c9710 2023-12-08T08:20:26.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f57fe7e7640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f81e0b80 con 0x7f57f81eeb20 2023-12-08T08:20:26.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f57f7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f81dfd30 0x7f57f81ee130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f57f7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f81dfd30 0x7f57f81ee130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39978/0 (socket says 172.21.15.88:39978) 2023-12-08T08:20:26.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f57fcd84640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57f81eeb20 0x7f57f814ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f57f7fff640 1 -- 172.21.15.88:0/2942288858 learned_addr learned my addr 172.21.15.88:0/2942288858 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:26.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f57f77fe640 1 --2- 172.21.15.88:0/2942288858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57f80c9710 0x7f57f81f1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f57f7fff640 1 -- 172.21.15.88:0/2942288858 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57f81eeb20 msgr2=0x7f57f814ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f57f7fff640 1 --2- 172.21.15.88:0/2942288858 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57f81eeb20 0x7f57f814ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f57f7fff640 1 -- 172.21.15.88:0/2942288858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57f80c9710 msgr2=0x7f57f81f1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f57f7fff640 1 --2- 172.21.15.88:0/2942288858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57f80c9710 0x7f57f81f1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f57f7fff640 1 -- 172.21.15.88:0/2942288858 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f81e0e60 con 0x7f57f81dfd30 2023-12-08T08:20:26.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f57fcd84640 1 --2- 172.21.15.88:0/2942288858 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57f81eeb20 0x7f57f814ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:26.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.926+0000 7f3e9d7fa640 1 -- 172.21.15.88:0/1285493197 <== osd.1 v2:172.21.15.88:6808/1011316311 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3ea00674b0 con 0x7f3e8c06e6e0 2023-12-08T08:20:26.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f69ac72a640 1 -- 172.21.15.88:0/4268659625 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a41552d0 con 0x7f69a40add80 2023-12-08T08:20:26.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.922+0000 7f6998ff9640 1 -- 172.21.15.88:0/4268659625 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6980000fd0 con 0x7f69a40add80 2023-12-08T08:20:26.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.926+0000 7f2cfaffd640 1 -- 172.21.15.88:0/576107166 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2cf400f3c0 con 0x7f2d040c5140 2023-12-08T08:20:26.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.926+0000 7f57f7fff640 1 --2- 172.21.15.88:0/2942288858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f81dfd30 0x7f57f81ee130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f57e801d2f0 tx=0x7f57e80197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.926+0000 7f2cfaffd640 1 --2- 172.21.15.88:0/576107166 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2ce40664f0 0x7f2ce40689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.926+0000 7f2cfaffd640 1 -- 172.21.15.88:0/576107166 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2cf40842a0 con 0x7f2d040c5140 2023-12-08T08:20:26.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.926+0000 7f2cfaffd640 1 --2- 172.21.15.88:0/576107166 >> [v2:172.21.15.148:6800/2515642018,v1:172.21.15.148:6801/2515642018] conn(0x7f2ce406e710 0x7f2ce4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.926+0000 7f3ea5993640 1 -- 172.21.15.88:0/1285493197 >> [v2:172.21.15.88:6808/1011316311,v1:172.21.15.88:6810/1011316311] conn(0x7f3e8c06e6e0 msgr2=0x7f3e8c070b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.926+0000 7f2cfaffd640 1 -- 172.21.15.88:0/576107166 --> [v2:172.21.15.148:6800/2515642018,v1:172.21.15.148:6801/2515642018] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2ce40711e0 con 0x7f2ce406e710 2023-12-08T08:20:26.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.926+0000 7f2cfaffd640 1 -- 172.21.15.88:0/576107166 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cf4084610 con 0x7f2d040c5140 2023-12-08T08:20:26.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.926+0000 7f3ea5993640 1 --2- 172.21.15.88:0/1285493197 >> [v2:172.21.15.88:6808/1011316311,v1:172.21.15.88:6810/1011316311] conn(0x7f3e8c06e6e0 0x7f3e8c070b00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.926+0000 7f3ea5993640 1 -- 172.21.15.88:0/1285493197 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3e8c066540 msgr2=0x7f3e8c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.926+0000 7f3ea5993640 1 --2- 172.21.15.88:0/1285493197 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3e8c066540 0x7f3e8c068a00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3e9401e990 tx=0x7f3e9400a040 comp rx=0 tx=0).stop 2023-12-08T08:20:26.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.926+0000 7f3ea5993640 1 -- 172.21.15.88:0/1285493197 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ea00a8ee0 msgr2=0x7f3ea01e9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.926+0000 7f3ea5993640 1 --2- 172.21.15.88:0/1285493197 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ea00a8ee0 0x7f3ea01e9670 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3e9000b3e0 tx=0x7f3e9000b8a0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.926+0000 7f3ea5192640 1 -- 172.21.15.88:0/1285493197 reap_dead start 2023-12-08T08:20:26.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.926+0000 7f3ea5993640 1 -- 172.21.15.88:0/1285493197 shutdown_connections 2023-12-08T08:20:26.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.926+0000 7f3ea5993640 1 -- 172.21.15.88:0/1285493197 >> 172.21.15.88:0/1285493197 conn(0x7f3ea00c2270 msgr2=0x7f3ea015a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:26.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.926+0000 7f57f4ff9640 1 -- 172.21.15.88:0/2942288858 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e80a5ea0 con 0x7f57f81dfd30 2023-12-08T08:20:26.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.926+0000 7f57f4ff9640 1 -- 172.21.15.88:0/2942288858 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e8004020 con 0x7f57f81dfd30 2023-12-08T08:20:26.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.926+0000 7f2d02d9d640 1 --2- 172.21.15.88:0/576107166 >> [v2:172.21.15.148:6800/2515642018,v1:172.21.15.148:6801/2515642018] conn(0x7f2ce406e710 0x7f2ce4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.926+0000 7f2d0259c640 1 --2- 172.21.15.88:0/576107166 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2ce40664f0 0x7f2ce40689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.926+0000 7f3ea5993640 1 -- 172.21.15.88:0/1285493197 shutdown_connections 2023-12-08T08:20:26.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.926+0000 7f3ea5993640 1 -- 172.21.15.88:0/1285493197 wait complete. 2023-12-08T08:20:26.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.926+0000 7f57f4ff9640 1 -- 172.21.15.88:0/2942288858 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e80a5530 con 0x7f57f81dfd30 2023-12-08T08:20:26.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.930+0000 7f2d02d9d640 1 --2- 172.21.15.88:0/576107166 >> [v2:172.21.15.148:6800/2515642018,v1:172.21.15.148:6801/2515642018] conn(0x7f2ce406e710 0x7f2ce4070b30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.930+0000 7f57fe7e7640 1 -- 172.21.15.88:0/2942288858 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f81ed930 con 0x7f57f81dfd30 2023-12-08T08:20:26.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.930+0000 7f2cfaffd640 1 -- 172.21.15.88:0/576107166 <== osd.6 v2:172.21.15.148:6800/2515642018 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2ce40711e0 con 0x7f2ce406e710 2023-12-08T08:20:26.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.930+0000 7f2d0259c640 1 --2- 172.21.15.88:0/576107166 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2ce40664f0 0x7f2ce40689b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0ae000 tx=0x7f2cec004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.930+0000 7f699affd640 1 -- 172.21.15.88:0/4268659625 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f699c015590 con 0x7f69a40add80 2023-12-08T08:20:26.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.930+0000 7f57fe7e7640 1 -- 172.21.15.88:0/2942288858 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f81f1a70 con 0x7f57f81dfd30 2023-12-08T08:20:26.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.930+0000 7f699affd640 1 --2- 172.21.15.88:0/4268659625 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6988066470 0x7f6988068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.930+0000 7f69aa4c6640 1 --2- 172.21.15.88:0/4268659625 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6988066470 0x7f6988068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.930+0000 7f699affd640 1 -- 172.21.15.88:0/4268659625 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f699c085140 con 0x7f69a40add80 2023-12-08T08:20:26.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.934+0000 7f699affd640 1 --2- 172.21.15.88:0/4268659625 >> [v2:172.21.15.148:6808/1016572025,v1:172.21.15.148:6809/1016572025] conn(0x7f698806e610 0x7f6988070a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.934+0000 7f699affd640 1 -- 172.21.15.88:0/4268659625 --> [v2:172.21.15.148:6808/1016572025,v1:172.21.15.148:6809/1016572025] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f69880710e0 con 0x7f698806e610 2023-12-08T08:20:26.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.934+0000 7f699affd640 1 -- 172.21.15.88:0/4268659625 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f699c085590 con 0x7f69a40add80 2023-12-08T08:20:26.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.934+0000 7f69a9cc5640 1 --2- 172.21.15.88:0/4268659625 >> [v2:172.21.15.148:6808/1016572025,v1:172.21.15.148:6809/1016572025] conn(0x7f698806e610 0x7f6988070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.934+0000 7f69aa4c6640 1 --2- 172.21.15.88:0/4268659625 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6988066470 0x7f6988068930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f69a0007fc0 tx=0x7f69a0007900 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.934+0000 7f69a9cc5640 1 --2- 172.21.15.88:0/4268659625 >> [v2:172.21.15.148:6808/1016572025,v1:172.21.15.148:6809/1016572025] conn(0x7f698806e610 0x7f6988070a30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.934+0000 7f57fe7e7640 1 -- 172.21.15.88:0/2942288858 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f57f8157dd0 con 0x7f57f81dfd30 2023-12-08T08:20:26.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.934+0000 7f4fc7479640 1 -- 172.21.15.88:0/1489307156 --> [v2:172.21.15.88:6809/1840118353,v1:172.21.15.88:6811/1840118353] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4fc0067630 con 0x7f4fa406e690 2023-12-08T08:20:26.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.934+0000 7f699affd640 1 -- 172.21.15.88:0/4268659625 <== osd.5 v2:172.21.15.148:6808/1016572025 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f69880710e0 con 0x7f698806e610 2023-12-08T08:20:26.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.934+0000 7f4fbdffb640 1 -- 172.21.15.88:0/1489307156 <== osd.0 v2:172.21.15.88:6809/1840118353 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4fc0067630 con 0x7f4fa406e690 2023-12-08T08:20:26.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.934+0000 7f57f4ff9640 1 -- 172.21.15.88:0/2942288858 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f57e80b4070 con 0x7f57f81dfd30 2023-12-08T08:20:26.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f4fc7479640 1 -- 172.21.15.88:0/1489307156 >> [v2:172.21.15.88:6809/1840118353,v1:172.21.15.88:6811/1840118353] conn(0x7f4fa406e690 msgr2=0x7f4fa4070ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f4fc7479640 1 --2- 172.21.15.88:0/1489307156 >> [v2:172.21.15.88:6809/1840118353,v1:172.21.15.88:6811/1840118353] conn(0x7f4fa406e690 0x7f4fa4070ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f4fc7479640 1 -- 172.21.15.88:0/1489307156 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4fa40664f0 msgr2=0x7f4fa40689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f4fc7479640 1 --2- 172.21.15.88:0/1489307156 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4fa40664f0 0x7f4fa40689b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4fb401d300 tx=0x7f4fb4007040 comp rx=0 tx=0).stop 2023-12-08T08:20:26.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f4fc7479640 1 -- 172.21.15.88:0/1489307156 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc00acad0 msgr2=0x7f4fc0159b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f4fc7479640 1 --2- 172.21.15.88:0/1489307156 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc00acad0 0x7f4fc0159b40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4fac00b3e0 tx=0x7f4fac00b8a0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f4fc5a16640 1 -- 172.21.15.88:0/1489307156 reap_dead start 2023-12-08T08:20:26.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f57f4ff9640 1 --2- 172.21.15.88:0/2942288858 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f57e40664f0 0x7f57e40689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f57f4ff9640 1 -- 172.21.15.88:0/2942288858 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57e811e140 con 0x7f57f81dfd30 2023-12-08T08:20:26.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f57f4ff9640 1 --2- 172.21.15.88:0/2942288858 >> [v2:172.21.15.148:6816/3755626047,v1:172.21.15.148:6817/3755626047] conn(0x7f57e406e690 0x7f57e4070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f57f4ff9640 1 -- 172.21.15.88:0/2942288858 --> [v2:172.21.15.148:6816/3755626047,v1:172.21.15.148:6817/3755626047] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f57e4071160 con 0x7f57e406e690 2023-12-08T08:20:26.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f57f4ff9640 1 -- 172.21.15.88:0/2942288858 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57e8120800 con 0x7f57f81dfd30 2023-12-08T08:20:26.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f57fcd84640 1 --2- 172.21.15.88:0/2942288858 >> [v2:172.21.15.148:6816/3755626047,v1:172.21.15.148:6817/3755626047] conn(0x7f57e406e690 0x7f57e4070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f327d4d6640 1 -- 172.21.15.88:0/2285787078 --> [v2:172.21.15.148:6824/227078704,v1:172.21.15.148:6825/227078704] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f327814a580 con 0x7f325806e610 2023-12-08T08:20:26.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f57f77fe640 1 --2- 172.21.15.88:0/2942288858 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f57e40664f0 0x7f57e40689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f57fcd84640 1 --2- 172.21.15.88:0/2942288858 >> [v2:172.21.15.148:6816/3755626047,v1:172.21.15.148:6817/3755626047] conn(0x7f57e406e690 0x7f57e4070ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f326f7fe640 1 -- 172.21.15.88:0/2285787078 <== osd.7 v2:172.21.15.148:6824/227078704 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f327814a580 con 0x7f325806e610 2023-12-08T08:20:26.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f57f77fe640 1 --2- 172.21.15.88:0/2942288858 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f57e40664f0 0x7f57e40689b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f57f80c59c0 tx=0x7f57ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f4fc7479640 1 -- 172.21.15.88:0/1489307156 shutdown_connections 2023-12-08T08:20:26.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f4fc7479640 1 -- 172.21.15.88:0/1489307156 >> 172.21.15.88:0/1489307156 conn(0x7f4fc00aba00 msgr2=0x7f4fc00abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:26.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f4fc7479640 1 -- 172.21.15.88:0/1489307156 shutdown_connections 2023-12-08T08:20:26.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f4fc7479640 1 -- 172.21.15.88:0/1489307156 wait complete. 2023-12-08T08:20:26.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f326d7fa640 1 -- 172.21.15.88:0/2285787078 >> [v2:172.21.15.148:6824/227078704,v1:172.21.15.148:6825/227078704] conn(0x7f325806e610 msgr2=0x7f3258070a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f326d7fa640 1 --2- 172.21.15.88:0/2285787078 >> [v2:172.21.15.148:6824/227078704,v1:172.21.15.148:6825/227078704] conn(0x7f325806e610 0x7f3258070a30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7fa0a7e32640 1 -- 172.21.15.88:0/2934207804 --> [v2:172.21.15.88:6800/22961328,v1:172.21.15.88:6801/22961328] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa0a00a9ed0 con 0x7fa08406e640 2023-12-08T08:20:26.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f326d7fa640 1 -- 172.21.15.88:0/2285787078 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3258066470 msgr2=0x7f3258068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f326d7fa640 1 --2- 172.21.15.88:0/2285787078 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3258066470 0x7f3258068930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f32600af000 tx=0x7f3260008040 comp rx=0 tx=0).stop 2023-12-08T08:20:26.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f326d7fa640 1 -- 172.21.15.88:0/2285787078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f327806dfa0 msgr2=0x7f32780a91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f326d7fa640 1 --2- 172.21.15.88:0/2285787078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f327806dfa0 0x7f32780a91c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f327000c490 tx=0x7f3270001e80 comp rx=0 tx=0).stop 2023-12-08T08:20:26.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.938+0000 7f32777fe640 1 -- 172.21.15.88:0/2285787078 reap_dead start 2023-12-08T08:20:26.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.942+0000 7f326d7fa640 1 -- 172.21.15.88:0/2285787078 shutdown_connections 2023-12-08T08:20:26.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.942+0000 7f326d7fa640 1 -- 172.21.15.88:0/2285787078 >> 172.21.15.88:0/2285787078 conn(0x7f327806b220 msgr2=0x7f327806ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:26.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.942+0000 7f57f4ff9640 1 -- 172.21.15.88:0/2942288858 <== osd.4 v2:172.21.15.148:6816/3755626047 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f57e4071160 con 0x7f57e406e690 2023-12-08T08:20:26.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.942+0000 7f326d7fa640 1 -- 172.21.15.88:0/2285787078 shutdown_connections 2023-12-08T08:20:26.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.942+0000 7f64baf80640 1 -- 172.21.15.88:0/3771795980 --> [v2:172.21.15.88:6824/4207137329,v1:172.21.15.88:6825/4207137329] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f64b40aa610 con 0x7f64a006e660 2023-12-08T08:20:26.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.942+0000 7f326d7fa640 1 -- 172.21.15.88:0/2285787078 wait complete. 2023-12-08T08:20:26.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.942+0000 7f64b17fa640 1 -- 172.21.15.88:0/3771795980 <== osd.2 v2:172.21.15.88:6824/4207137329 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f64a40012f0 con 0x7f64a006e660 2023-12-08T08:20:26.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.942+0000 7f64baf80640 1 -- 172.21.15.88:0/3771795980 >> [v2:172.21.15.88:6824/4207137329,v1:172.21.15.88:6825/4207137329] conn(0x7f64a006e660 msgr2=0x7f64a0070a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.942+0000 7f64baf80640 1 --2- 172.21.15.88:0/3771795980 >> [v2:172.21.15.88:6824/4207137329,v1:172.21.15.88:6825/4207137329] conn(0x7f64a006e660 0x7f64a0070a80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.942+0000 7f64baf80640 1 -- 172.21.15.88:0/3771795980 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f64a00664c0 msgr2=0x7f64a0068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.946+0000 7f64baf80640 1 --2- 172.21.15.88:0/3771795980 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f64a00664c0 0x7f64a0068980 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f64ac0ae000 tx=0x7f64ac0a7070 comp rx=0 tx=0).stop 2023-12-08T08:20:26.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.946+0000 7f64baf80640 1 -- 172.21.15.88:0/3771795980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64b40c3930 msgr2=0x7f64b40a6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.946+0000 7f64baf80640 1 --2- 172.21.15.88:0/3771795980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64b40c3930 0x7f64b40a6a70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f64a800e8a0 tx=0x7f64a800eca0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.946+0000 7f64b951d640 1 -- 172.21.15.88:0/3771795980 reap_dead start 2023-12-08T08:20:26.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.946+0000 7fa0967fc640 1 -- 172.21.15.88:0/2934207804 <== osd.3 v2:172.21.15.88:6800/22961328 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa0a00a9ed0 con 0x7fa08406e640 2023-12-08T08:20:26.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.946+0000 7f64baf80640 1 -- 172.21.15.88:0/3771795980 shutdown_connections 2023-12-08T08:20:26.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.946+0000 7f64baf80640 1 -- 172.21.15.88:0/3771795980 >> 172.21.15.88:0/3771795980 conn(0x7f64b406b220 msgr2=0x7f64b40a96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:26.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.946+0000 7f64baf80640 1 -- 172.21.15.88:0/3771795980 shutdown_connections 2023-12-08T08:20:26.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.946+0000 7f64baf80640 1 -- 172.21.15.88:0/3771795980 wait complete. 2023-12-08T08:20:26.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.946+0000 7fa083fff640 1 -- 172.21.15.88:0/2934207804 >> [v2:172.21.15.88:6800/22961328,v1:172.21.15.88:6801/22961328] conn(0x7fa08406e640 msgr2=0x7fa084070a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.946+0000 7fa083fff640 1 --2- 172.21.15.88:0/2934207804 >> [v2:172.21.15.88:6800/22961328,v1:172.21.15.88:6801/22961328] conn(0x7fa08406e640 0x7fa084070a60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.946+0000 7fa083fff640 1 -- 172.21.15.88:0/2934207804 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa0840664a0 msgr2=0x7fa084068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.946+0000 7fa083fff640 1 --2- 172.21.15.88:0/2934207804 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa0840664a0 0x7fa084068960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa098005c10 tx=0x7fa098009040 comp rx=0 tx=0).stop 2023-12-08T08:20:26.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.946+0000 7fa083fff640 1 -- 172.21.15.88:0/2934207804 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0a00c5da0 msgr2=0x7fa0a00ab360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.946+0000 7fa083fff640 1 --2- 172.21.15.88:0/2934207804 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0a00c5da0 0x7fa0a00ab360 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa09000e870 tx=0x7fa09000ec70 comp rx=0 tx=0).stop 2023-12-08T08:20:26.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.946+0000 7fa0a63cf640 1 -- 172.21.15.88:0/2934207804 reap_dead start 2023-12-08T08:20:26.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.946+0000 7fa083fff640 1 -- 172.21.15.88:0/2934207804 shutdown_connections 2023-12-08T08:20:26.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.946+0000 7fa083fff640 1 -- 172.21.15.88:0/2934207804 >> 172.21.15.88:0/2934207804 conn(0x7fa0a00ca000 msgr2=0x7fa0a0162430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:26.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.954+0000 7fa083fff640 1 -- 172.21.15.88:0/2934207804 shutdown_connections 2023-12-08T08:20:26.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.954+0000 7fa083fff640 1 -- 172.21.15.88:0/2934207804 wait complete. 2023-12-08T08:20:26.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.958+0000 7f2d08d1c640 1 -- 172.21.15.88:0/576107166 --> [v2:172.21.15.148:6800/2515642018,v1:172.21.15.148:6801/2515642018] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2d040a6e50 con 0x7f2ce406e710 2023-12-08T08:20:26.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.958+0000 7f2cfaffd640 1 -- 172.21.15.88:0/576107166 <== osd.6 v2:172.21.15.148:6800/2515642018 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2d040a6e50 con 0x7f2ce406e710 2023-12-08T08:20:26.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.958+0000 7f2d08d1c640 1 -- 172.21.15.88:0/576107166 >> [v2:172.21.15.148:6800/2515642018,v1:172.21.15.148:6801/2515642018] conn(0x7f2ce406e710 msgr2=0x7f2ce4070b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.958+0000 7f2d08d1c640 1 --2- 172.21.15.88:0/576107166 >> [v2:172.21.15.148:6800/2515642018,v1:172.21.15.148:6801/2515642018] conn(0x7f2ce406e710 0x7f2ce4070b30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.958+0000 7f2d08d1c640 1 -- 172.21.15.88:0/576107166 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2ce40664f0 msgr2=0x7f2ce40689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.958+0000 7f2d08d1c640 1 --2- 172.21.15.88:0/576107166 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2ce40664f0 0x7f2ce40689b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0ae000 tx=0x7f2cec004740 comp rx=0 tx=0).stop 2023-12-08T08:20:26.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.958+0000 7f2d08d1c640 1 -- 172.21.15.88:0/576107166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d040c5140 msgr2=0x7f2d040a71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.958+0000 7f2d08d1c640 1 --2- 172.21.15.88:0/576107166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d040c5140 0x7f2d040a71a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2cf400b550 tx=0x7f2cf400ba10 comp rx=0 tx=0).stop 2023-12-08T08:20:26.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.958+0000 7f2d02d9d640 1 -- 172.21.15.88:0/576107166 reap_dead start 2023-12-08T08:20:26.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.958+0000 7f2d08d1c640 1 -- 172.21.15.88:0/576107166 shutdown_connections 2023-12-08T08:20:26.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.958+0000 7f2d08d1c640 1 -- 172.21.15.88:0/576107166 >> 172.21.15.88:0/576107166 conn(0x7f2d0406acf0 msgr2=0x7f2d040c5830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:26.975 INFO:teuthology.orchestra.run.smithi088.stdout:55834574856 2023-12-08T08:20:26.975 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-08T08:20:26.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.966+0000 7f2d08d1c640 1 -- 172.21.15.88:0/576107166 shutdown_connections 2023-12-08T08:20:26.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.966+0000 7f2d08d1c640 1 -- 172.21.15.88:0/576107166 wait complete. 2023-12-08T08:20:26.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.966+0000 7f6998ff9640 1 -- 172.21.15.88:0/4268659625 --> [v2:172.21.15.148:6808/1016572025,v1:172.21.15.148:6809/1016572025] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6980002cc0 con 0x7f698806e610 2023-12-08T08:20:26.977 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2023-12-08T08:20:26.977 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-08T08:20:26.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.966+0000 7f699affd640 1 -- 172.21.15.88:0/4268659625 <== osd.5 v2:172.21.15.148:6808/1016572025 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6980002cc0 con 0x7f698806e610 2023-12-08T08:20:26.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.970+0000 7f6998ff9640 1 -- 172.21.15.88:0/4268659625 >> [v2:172.21.15.148:6808/1016572025,v1:172.21.15.148:6809/1016572025] conn(0x7f698806e610 msgr2=0x7f6988070a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.970+0000 7f6998ff9640 1 --2- 172.21.15.88:0/4268659625 >> [v2:172.21.15.148:6808/1016572025,v1:172.21.15.148:6809/1016572025] conn(0x7f698806e610 0x7f6988070a30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.970+0000 7f6998ff9640 1 -- 172.21.15.88:0/4268659625 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6988066470 msgr2=0x7f6988068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.970+0000 7f6998ff9640 1 --2- 172.21.15.88:0/4268659625 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6988066470 0x7f6988068930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f69a0007fc0 tx=0x7f69a0007900 comp rx=0 tx=0).stop 2023-12-08T08:20:26.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.970+0000 7f6998ff9640 1 -- 172.21.15.88:0/4268659625 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69a40add80 msgr2=0x7f69a41525b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.970+0000 7f6998ff9640 1 --2- 172.21.15.88:0/4268659625 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69a40add80 0x7f69a41525b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f69a406a890 tx=0x7f699c00f580 comp rx=0 tx=0).stop 2023-12-08T08:20:26.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.970+0000 7f69aacc7640 1 -- 172.21.15.88:0/4268659625 reap_dead start 2023-12-08T08:20:26.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.970+0000 7f6998ff9640 1 -- 172.21.15.88:0/4268659625 shutdown_connections 2023-12-08T08:20:26.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.970+0000 7f6998ff9640 1 -- 172.21.15.88:0/4268659625 >> 172.21.15.88:0/4268659625 conn(0x7f69a40aba00 msgr2=0x7f69a40aaf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:26.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.970+0000 7f6998ff9640 1 -- 172.21.15.88:0/4268659625 shutdown_connections 2023-12-08T08:20:26.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.970+0000 7f6998ff9640 1 -- 172.21.15.88:0/4268659625 wait complete. 2023-12-08T08:20:26.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.970+0000 7f57fe7e7640 1 -- 172.21.15.88:0/2942288858 --> [v2:172.21.15.148:6816/3755626047,v1:172.21.15.148:6817/3755626047] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f57f8157af0 con 0x7f57e406e690 2023-12-08T08:20:26.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.970+0000 7f57f4ff9640 1 -- 172.21.15.88:0/2942288858 <== osd.4 v2:172.21.15.148:6816/3755626047 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f57f0001bb0 con 0x7f57e406e690 2023-12-08T08:20:26.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.970+0000 7f57fe7e7640 1 -- 172.21.15.88:0/2942288858 >> [v2:172.21.15.148:6816/3755626047,v1:172.21.15.148:6817/3755626047] conn(0x7f57e406e690 msgr2=0x7f57e4070ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.970+0000 7f57fe7e7640 1 --2- 172.21.15.88:0/2942288858 >> [v2:172.21.15.148:6816/3755626047,v1:172.21.15.148:6817/3755626047] conn(0x7f57e406e690 0x7f57e4070ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.970+0000 7f57fe7e7640 1 -- 172.21.15.88:0/2942288858 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f57e40664f0 msgr2=0x7f57e40689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.970+0000 7f57fe7e7640 1 --2- 172.21.15.88:0/2942288858 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f57e40664f0 0x7f57e40689b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f57f80c59c0 tx=0x7f57ec009040 comp rx=0 tx=0).stop 2023-12-08T08:20:26.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.970+0000 7f57fe7e7640 1 -- 172.21.15.88:0/2942288858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f81dfd30 msgr2=0x7f57f81ee130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.970+0000 7f57fe7e7640 1 --2- 172.21.15.88:0/2942288858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57f81dfd30 0x7f57f81ee130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f57e801d2f0 tx=0x7f57e80197f0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.970+0000 7f57fcd84640 1 -- 172.21.15.88:0/2942288858 reap_dead start 2023-12-08T08:20:26.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.970+0000 7f57fe7e7640 1 -- 172.21.15.88:0/2942288858 shutdown_connections 2023-12-08T08:20:26.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.970+0000 7f57fe7e7640 1 -- 172.21.15.88:0/2942288858 >> 172.21.15.88:0/2942288858 conn(0x7f57f80aba00 msgr2=0x7f57f8155f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:26.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.974+0000 7f57fe7e7640 1 -- 172.21.15.88:0/2942288858 shutdown_connections 2023-12-08T08:20:26.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:26.974+0000 7f57fe7e7640 1 -- 172.21.15.88:0/2942288858 wait complete. 2023-12-08T08:20:26.986 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2023-12-08T08:20:26.986 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-08T08:20:26.991 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2023-12-08T08:20:26.991 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-08T08:20:26.997 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2023-12-08T08:20:26.997 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-08T08:20:27.005 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2023-12-08T08:20:27.006 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-08T08:20:27.012 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2023-12-08T08:20:27.012 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-08T08:20:27.013 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2023-12-08T08:20:27.013 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-08T08:20:27.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.206+0000 7fbacfe68640 1 Processor -- start 2023-12-08T08:20:27.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.206+0000 7fbacfe68640 1 -- start start 2023-12-08T08:20:27.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.210+0000 7fbacfe68640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbac80a8040 0x7fbac8150320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.210+0000 7fbacfe68640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbac814da10 0x7fbac806bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.210+0000 7fbace405640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbac814da10 0x7fbac806bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.210+0000 7fbace405640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbac814da10 0x7fbac806bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:55796/0 (socket says 172.21.15.88:55796) 2023-12-08T08:20:27.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.210+0000 7fbacdc04640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fbac80a5050 0x7fbac80c49c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:33938/0 (socket says 172.21.15.88:33938) 2023-12-08T08:20:27.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.210+0000 7fbacd403640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbac80a8040 0x7fbac8150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.210+0000 7fbace405640 1 -- 172.21.15.88:0/850722783 learned_addr learned my addr 172.21.15.88:0/850722783 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:27.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.210+0000 7fbacfe68640 1 -- 172.21.15.88:0/850722783 --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac80c36d0 con 0x7fbac80a5050 2023-12-08T08:20:27.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.210+0000 7fbacfe68640 1 -- 172.21.15.88:0/850722783 --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac814de40 con 0x7fbac80a8040 2023-12-08T08:20:27.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.210+0000 7fbacfe68640 1 -- 172.21.15.88:0/850722783 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac80c3920 con 0x7fbac814da10 2023-12-08T08:20:27.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.210+0000 7fbace405640 1 -- 172.21.15.88:0/850722783 >> v2:172.21.15.148:3300/0 conn(0x7fbac80a8040 msgr2=0x7fbac8150320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:27.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.210+0000 7fbace405640 1 --2- 172.21.15.88:0/850722783 >> v2:172.21.15.148:3300/0 conn(0x7fbac80a8040 0x7fbac8150320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.210+0000 7fbace405640 1 -- 172.21.15.88:0/850722783 >> v1:172.21.15.148:6789/0 conn(0x7fbac80a5050 legacy=0x7fbac80c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.210+0000 7fbace405640 1 -- 172.21.15.88:0/850722783 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac80c3c00 con 0x7fbac814da10 2023-12-08T08:20:27.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.218+0000 7fbace405640 1 --2- 172.21.15.88:0/850722783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbac814da10 0x7fbac806bb40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbab8007fd0 tx=0x7fbab801c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb4b789dc28c84fb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.218+0000 7fbaccc02640 1 -- 172.21.15.88:0/850722783 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab8005ac0 con 0x7fbac814da10 2023-12-08T08:20:27.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.218+0000 7fe6f6279640 1 Processor -- start 2023-12-08T08:20:27.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.218+0000 7fe6f6279640 1 -- start start 2023-12-08T08:20:27.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.218+0000 7fbaccc02640 1 -- 172.21.15.88:0/850722783 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab8005c20 con 0x7fbac814da10 2023-12-08T08:20:27.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.218+0000 7fbaccc02640 1 -- 172.21.15.88:0/850722783 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab8007110 con 0x7fbac814da10 2023-12-08T08:20:27.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.218+0000 7fbacfe68640 1 -- 172.21.15.88:0/850722783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbac814da10 msgr2=0x7fbac806bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.218+0000 7fbacfe68640 1 --2- 172.21.15.88:0/850722783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbac814da10 0x7fbac806bb40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbab8007fd0 tx=0x7fbab801c780 comp rx=0 tx=0).stop 2023-12-08T08:20:27.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.218+0000 7fbacfe68640 1 -- 172.21.15.88:0/850722783 shutdown_connections 2023-12-08T08:20:27.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.218+0000 7fbacfe68640 1 --2- 172.21.15.88:0/850722783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbac814da10 0x7fbac806bb40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.218+0000 7fbacfe68640 1 --2- 172.21.15.88:0/850722783 >> v2:172.21.15.148:3300/0 conn(0x7fbac80a8040 0x7fbac8150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.218+0000 7fbacfe68640 1 -- 172.21.15.88:0/850722783 >> 172.21.15.88:0/850722783 conn(0x7fbac80a7520 msgr2=0x7fbac80a7930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:27.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.222+0000 7fe6f6279640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe6f00a5050 0x7fe6f0150320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.222+0000 7fe6f6279640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe6f00a8040 0x7fe6f014da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.222+0000 7fe6f6279640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f00c36d0 con 0x7fe6f00c49c0 2023-12-08T08:20:27.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.222+0000 7fe6f6279640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f00c3920 con 0x7fe6f00a8040 2023-12-08T08:20:27.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.222+0000 7fbacfe68640 1 -- 172.21.15.88:0/850722783 shutdown_connections 2023-12-08T08:20:27.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.222+0000 7fe6f6279640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f00c3c00 con 0x7fe6f00a5050 2023-12-08T08:20:27.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.222+0000 7fe6f4816640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe6f00c49c0 0x7fe6f006bb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:33940/0 (socket says 172.21.15.88:33940) 2023-12-08T08:20:27.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.222+0000 7fe6f4816640 1 -- 172.21.15.88:0/1880898885 learned_addr learned my addr 172.21.15.88:0/1880898885 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:27.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.222+0000 7fe6ef7fe640 1 --2- 172.21.15.88:0/1880898885 >> v2:172.21.15.88:3300/0 conn(0x7fe6f00a8040 0x7fe6f014da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.222+0000 7fe6ef7fe640 1 -- 172.21.15.88:0/1880898885 >> v2:172.21.15.148:3300/0 conn(0x7fe6f00a5050 msgr2=0x7fe6f0150320 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-08T08:20:27.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.222+0000 7fe6ef7fe640 1 --2- 172.21.15.88:0/1880898885 >> v2:172.21.15.148:3300/0 conn(0x7fe6f00a5050 0x7fe6f0150320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.222+0000 7fe6ef7fe640 1 -- 172.21.15.88:0/1880898885 >> v1:172.21.15.148:6789/0 conn(0x7fe6f00c49c0 legacy=0x7fe6f006bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.222+0000 7fe6ef7fe640 1 -- 172.21.15.88:0/1880898885 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f00c3ee0 con 0x7fe6f00a8040 2023-12-08T08:20:27.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.222+0000 7fe6eeffd640 1 -- 172.21.15.88:0/1880898885 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717186997 0 0) 0x7fe6f00c36d0 con 0x7fe6f00c49c0 2023-12-08T08:20:27.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.222+0000 7fbacfe68640 1 -- 172.21.15.88:0/850722783 wait complete. 2023-12-08T08:20:27.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.222+0000 7fbacfe68640 1 Processor -- start 2023-12-08T08:20:27.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.222+0000 7fbacfe68640 1 -- start start 2023-12-08T08:20:27.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.226+0000 7fb9d7580640 1 Processor -- start 2023-12-08T08:20:27.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.226+0000 7fb9d7580640 1 -- start start 2023-12-08T08:20:27.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.226+0000 7fbacfe68640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbac80a5050 0x7fbac80a66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.226+0000 7fbacfe68640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbac80a8040 0x7fbac814a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.226+0000 7fb9d7580640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb9c8006e80 0x7fb9c80072f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.226+0000 7fb9d7580640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c804ac60 con 0x7fb9c80d46b0 2023-12-08T08:20:27.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.226+0000 7fb9d7580640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c804af40 con 0x7fb9c8049d00 2023-12-08T08:20:27.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.226+0000 7fb9d7580640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c804b500 con 0x7fb9c8006e80 2023-12-08T08:20:27.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.226+0000 7fbacdc04640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbac80a5050 0x7fbac80a66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.226+0000 7fbacdc04640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbac80a5050 0x7fbac80a66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:45382/0 (socket says 172.21.15.88:45382) 2023-12-08T08:20:27.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.226+0000 7fb9d4b1b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb9c8006e80 0x7fb9c80072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.226+0000 7fb9d531c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb9c80d46b0 0x7fb9c80d79f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:32894/0 (socket says 172.21.15.88:32894) 2023-12-08T08:20:27.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.226+0000 7fb9d531c640 1 -- 172.21.15.88:0/1820668464 learned_addr learned my addr 172.21.15.88:0/1820668464 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:27.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.226+0000 7fbacdc04640 1 -- 172.21.15.88:0/2128837298 learned_addr learned my addr 172.21.15.88:0/2128837298 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:27.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.226+0000 7fe6ef7fe640 1 --2- 172.21.15.88:0/1880898885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f00a8040 0x7fe6f014da10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe6f00a8520 tx=0x7fe6e001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef29b8f77bdc427 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.226+0000 7fbacfe68640 1 --2- 172.21.15.88:0/2128837298 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbac814da10 0x7fbac814a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.226+0000 7fb9c7fff640 1 -- 172.21.15.88:0/1820668464 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3496639590 0 0) 0x7fb9c804af40 con 0x7fb9c8049d00 2023-12-08T08:20:27.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.226+0000 7fb9d4b1b640 1 -- 172.21.15.88:0/1820668464 >> v1:172.21.15.148:6789/0 conn(0x7fb9c8049d00 legacy=0x7fb9c80e1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.226+0000 7fb9d4b1b640 1 -- 172.21.15.88:0/1820668464 >> v1:172.21.15.88:6789/0 conn(0x7fb9c80d46b0 legacy=0x7fb9c80d79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.226+0000 7fbacfe68640 1 -- 172.21.15.88:0/2128837298 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac814ad50 con 0x7fbac80a8040 2023-12-08T08:20:27.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.226+0000 7fbacfe68640 1 -- 172.21.15.88:0/2128837298 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac81546c0 con 0x7fbac80a5050 2023-12-08T08:20:27.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.230+0000 7fbacd403640 1 --2- 172.21.15.88:0/2128837298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbac80a8040 0x7fbac814a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.230+0000 7fbacfe68640 1 -- 172.21.15.88:0/2128837298 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac814afa0 con 0x7fbac814da10 2023-12-08T08:20:27.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.230+0000 7fbace405640 1 --2- 172.21.15.88:0/2128837298 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbac814da10 0x7fbac814a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.230+0000 7fb9d4b1b640 1 -- 172.21.15.88:0/1820668464 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c804b220 con 0x7fb9c8006e80 2023-12-08T08:20:27.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.230+0000 7fe6eeffd640 1 -- 172.21.15.88:0/1880898885 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e00a8050 con 0x7fe6f00a8040 2023-12-08T08:20:27.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.230+0000 7fe6eeffd640 1 -- 172.21.15.88:0/1880898885 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e00ac3f0 con 0x7fe6f00a8040 2023-12-08T08:20:27.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.230+0000 7fe6eeffd640 1 -- 172.21.15.88:0/1880898885 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e00a8050 con 0x7fe6f00a8040 2023-12-08T08:20:27.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.230+0000 7fbacdc04640 1 -- 172.21.15.88:0/2128837298 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbac814da10 msgr2=0x7fbac814a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.230+0000 7fbacdc04640 1 --2- 172.21.15.88:0/2128837298 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbac814da10 0x7fbac814a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.230+0000 7fbacdc04640 1 -- 172.21.15.88:0/2128837298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbac80a8040 msgr2=0x7fbac814a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.230+0000 7fbacdc04640 1 --2- 172.21.15.88:0/2128837298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbac80a8040 0x7fbac814a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.230+0000 7fbacdc04640 1 -- 172.21.15.88:0/2128837298 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab8009280 con 0x7fbac80a5050 2023-12-08T08:20:27.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.230+0000 7fbacdc04640 1 --2- 172.21.15.88:0/2128837298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbac80a5050 0x7fbac80a66c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbac400c780 tx=0x7fbac400cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.230+0000 7fbabe7fc640 1 -- 172.21.15.88:0/2128837298 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac40074e0 con 0x7fbac80a5050 2023-12-08T08:20:27.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.230+0000 7fbabe7fc640 1 -- 172.21.15.88:0/2128837298 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac4007640 con 0x7fbac80a5050 2023-12-08T08:20:27.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.230+0000 7fbabe7fc640 1 -- 172.21.15.88:0/2128837298 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4004a30 con 0x7fbac80a5050 2023-12-08T08:20:27.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.230+0000 7fbacfe68640 1 -- 172.21.15.88:0/2128837298 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac8151680 con 0x7fbac80a5050 2023-12-08T08:20:27.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.230+0000 7fbacfe68640 1 -- 172.21.15.88:0/2128837298 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac8072980 con 0x7fbac80a5050 2023-12-08T08:20:27.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.230+0000 7fe6f6279640 1 -- 172.21.15.88:0/1880898885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f00a8040 msgr2=0x7fe6f014da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.230+0000 7fe6f6279640 1 --2- 172.21.15.88:0/1880898885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f00a8040 0x7fe6f014da10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe6f00a8520 tx=0x7fe6e001c480 comp rx=0 tx=0).stop 2023-12-08T08:20:27.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.230+0000 7fe6f6279640 1 -- 172.21.15.88:0/1880898885 shutdown_connections 2023-12-08T08:20:27.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.230+0000 7fe6f6279640 1 --2- 172.21.15.88:0/1880898885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f00a8040 0x7fe6f014da10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.230+0000 7fe6f6279640 1 --2- 172.21.15.88:0/1880898885 >> v2:172.21.15.148:3300/0 conn(0x7fe6f00a5050 0x7fe6f0150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.230+0000 7fe6f6279640 1 -- 172.21.15.88:0/1880898885 >> 172.21.15.88:0/1880898885 conn(0x7fe6f00a7520 msgr2=0x7fe6f00a7930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:27.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.234+0000 7fe6f6279640 1 -- 172.21.15.88:0/1880898885 shutdown_connections 2023-12-08T08:20:27.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.234+0000 7fe6f6279640 1 -- 172.21.15.88:0/1880898885 wait complete. 2023-12-08T08:20:27.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.234+0000 7fbacfe68640 1 -- 172.21.15.88:0/2128837298 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac81eb720 con 0x7fbac80a5050 2023-12-08T08:20:27.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.234+0000 7fb9d4b1b640 1 --2- 172.21.15.88:0/1820668464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c8006e80 0x7fb9c80072f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00ba60 tx=0x7fb9cc01e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758c167a2a00efbb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.234+0000 7fb9c7fff640 1 -- 172.21.15.88:0/1820668464 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc0a77d0 con 0x7fb9c8006e80 2023-12-08T08:20:27.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.234+0000 7fbabe7fc640 1 -- 172.21.15.88:0/2128837298 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbac4004b90 con 0x7fbac80a5050 2023-12-08T08:20:27.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.234+0000 7fb9c7fff640 1 -- 172.21.15.88:0/1820668464 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc0a7930 con 0x7fb9c8006e80 2023-12-08T08:20:27.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.234+0000 7fb9c7fff640 1 -- 172.21.15.88:0/1820668464 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc0a77d0 con 0x7fb9c8006e80 2023-12-08T08:20:27.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.234+0000 7f59c93d0640 1 Processor -- start 2023-12-08T08:20:27.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.234+0000 7f59c93d0640 1 -- start start 2023-12-08T08:20:27.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.234+0000 7fe6f6279640 1 Processor -- start 2023-12-08T08:20:27.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fbabe7fc640 1 --2- 172.21.15.88:0/2128837298 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbaac066540 0x7fbaac068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fb9d7580640 1 -- 172.21.15.88:0/1820668464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c8006e80 msgr2=0x7fb9c80072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fb9d7580640 1 --2- 172.21.15.88:0/1820668464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c8006e80 0x7fb9c80072f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00ba60 tx=0x7fb9cc01e970 comp rx=0 tx=0).stop 2023-12-08T08:20:27.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fb9d7580640 1 -- 172.21.15.88:0/1820668464 shutdown_connections 2023-12-08T08:20:27.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fb9d7580640 1 --2- 172.21.15.88:0/1820668464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c8006e80 0x7fb9c80072f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fb9d7580640 1 -- 172.21.15.88:0/1820668464 >> 172.21.15.88:0/1820668464 conn(0x7fb9c8048230 msgr2=0x7fb9c8048640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:27.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fe6f6279640 1 -- start start 2023-12-08T08:20:27.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fbabe7fc640 1 -- 172.21.15.88:0/2128837298 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbac4083630 con 0x7fbac80a5050 2023-12-08T08:20:27.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fbacd403640 1 --2- 172.21.15.88:0/2128837298 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbaac066540 0x7fbaac068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fb9d7580640 1 -- 172.21.15.88:0/1820668464 shutdown_connections 2023-12-08T08:20:27.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7f59c93d0640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f59bc02ae70 0x7f59bc0d75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7f59c93d0640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59bc0dac00 con 0x7f59bc0db090 2023-12-08T08:20:27.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7f59c93d0640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59bc0071b0 con 0x7f59bc046390 2023-12-08T08:20:27.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7f59c93d0640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59bc046f20 con 0x7f59bc02ae70 2023-12-08T08:20:27.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fb9d7580640 1 -- 172.21.15.88:0/1820668464 wait complete. 2023-12-08T08:20:27.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fe6f6279640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6f00a5050 0x7fe6f01fcd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fe6f6279640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6f00a8040 0x7fe6f01fbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fe6f6279640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f00c49c0 0x7fe6f01fc300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fe6f6279640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f00728b0 con 0x7fe6f00c49c0 2023-12-08T08:20:27.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fe6f6279640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f01fa9f0 con 0x7fe6f00a8040 2023-12-08T08:20:27.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fe6f6279640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f01fda30 con 0x7fe6f00a5050 2023-12-08T08:20:27.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7f080a7e4640 1 Processor -- start 2023-12-08T08:20:27.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7f59c3fff640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f59bc046390 0x7f59bc0db890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:33946/0 (socket says 172.21.15.88:33946) 2023-12-08T08:20:27.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7f59c3fff640 1 -- 172.21.15.88:0/3032435446 learned_addr learned my addr 172.21.15.88:0/3032435446 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:27.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7f59c37fe640 1 --2- 172.21.15.88:0/3032435446 >> v2:172.21.15.148:3300/0 conn(0x7f59bc02ae70 0x7f59bc0d75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fe6effff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6f00a5050 0x7fe6f01fcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fe6effff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6f00a5050 0x7fe6f01fcd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:55808/0 (socket says 172.21.15.88:55808) 2023-12-08T08:20:27.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fe6effff640 1 -- 172.21.15.88:0/3661556702 learned_addr learned my addr 172.21.15.88:0/3661556702 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:27.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fe6ef7fe640 1 --2- 172.21.15.88:0/3661556702 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6f00a8040 0x7fe6f01fbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fbacd403640 1 --2- 172.21.15.88:0/2128837298 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbaac066540 0x7fbaac068a00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbac80a70c0 tx=0x7fbac0009750 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7f080a7e4640 1 -- start start 2023-12-08T08:20:27.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fe6effff640 1 -- 172.21.15.88:0/3661556702 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6f00a8040 msgr2=0x7fe6f01fbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fe6effff640 1 --2- 172.21.15.88:0/3661556702 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6f00a8040 0x7fe6f01fbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fe6effff640 1 -- 172.21.15.88:0/3661556702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f00c49c0 msgr2=0x7fe6f01fc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fe6effff640 1 --2- 172.21.15.88:0/3661556702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f00c49c0 0x7fe6f01fc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fe6effff640 1 -- 172.21.15.88:0/3661556702 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e0009420 con 0x7fe6f00a5050 2023-12-08T08:20:27.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7fe6effff640 1 --2- 172.21.15.88:0/3661556702 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6f00a5050 0x7fe6f01fcd50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe6e800ba50 tx=0x7fe6e800bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7f59c2ffd640 1 -- 172.21.15.88:0/3032435446 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1340553172 0 0) 0x7f59bc0dac00 con 0x7f59bc0db090 2023-12-08T08:20:27.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.238+0000 7f59c2ffd640 1 -- 172.21.15.88:0/3032435446 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59b4003530 con 0x7f59bc0db090 2023-12-08T08:20:27.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.242+0000 7fe6ecff9640 1 -- 172.21.15.88:0/3661556702 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e800cc10 con 0x7fe6f00a5050 2023-12-08T08:20:27.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.242+0000 7fe6ecff9640 1 -- 172.21.15.88:0/3661556702 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e800cd70 con 0x7fe6f00a5050 2023-12-08T08:20:27.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.242+0000 7fe6ecff9640 1 -- 172.21.15.88:0/3661556702 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8014680 con 0x7fe6f00a5050 2023-12-08T08:20:27.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.242+0000 7fe6f6279640 1 -- 172.21.15.88:0/3661556702 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f01fd750 con 0x7fe6f00a5050 2023-12-08T08:20:27.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.242+0000 7fe6f6279640 1 -- 172.21.15.88:0/3661556702 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f00a9ce0 con 0x7fe6f00a5050 2023-12-08T08:20:27.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.242+0000 7f080a7e4640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f08040c6680 0x7f080406c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.242+0000 7f080a7e4640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f080406b930 con 0x7f0804154f00 2023-12-08T08:20:27.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.242+0000 7f080a7e4640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f080406bef0 con 0x7f08041519f0 2023-12-08T08:20:27.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.242+0000 7f080a7e4640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08040c53f0 con 0x7f08040c6680 2023-12-08T08:20:27.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.242+0000 7f59c37fe640 1 -- 172.21.15.88:0/3032435446 >> v1:172.21.15.148:6789/0 conn(0x7f59bc046390 legacy=0x7f59bc0db890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.242+0000 7f59c37fe640 1 -- 172.21.15.88:0/3032435446 >> v1:172.21.15.88:6789/0 conn(0x7f59bc0db090 legacy=0x7f59bc0e4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.242+0000 7f59c37fe640 1 -- 172.21.15.88:0/3032435446 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59bc0da5b0 con 0x7f59bc02ae70 2023-12-08T08:20:27.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.242+0000 7fbabe7fc640 1 -- 172.21.15.88:0/2128837298 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbac4050bd0 con 0x7fbac80a5050 2023-12-08T08:20:27.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.242+0000 7f0808fe1640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f08040c6680 0x7f080406c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.242+0000 7f08097e2640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f08041519f0 0x7f08040c7b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:33954/0 (socket says 172.21.15.88:33954) 2023-12-08T08:20:27.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.242+0000 7f08097e2640 1 -- 172.21.15.88:0/1804628871 learned_addr learned my addr 172.21.15.88:0/1804628871 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:27.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.242+0000 7fb9d7580640 1 Processor -- start 2023-12-08T08:20:27.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.242+0000 7fb9d7580640 1 -- start start 2023-12-08T08:20:27.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.242+0000 7f07fbfff640 1 -- 172.21.15.88:0/1804628871 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1149237074 0 0) 0x7f080406bef0 con 0x7f08041519f0 2023-12-08T08:20:27.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.242+0000 7f07fbfff640 1 -- 172.21.15.88:0/1804628871 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07f0003530 con 0x7f08041519f0 2023-12-08T08:20:27.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.242+0000 7f0808fe1640 1 -- 172.21.15.88:0/1804628871 >> v1:172.21.15.148:6789/0 conn(0x7f08041519f0 legacy=0x7f08040c7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.242+0000 7f0808fe1640 1 -- 172.21.15.88:0/1804628871 >> v1:172.21.15.88:6789/0 conn(0x7f0804154f00 legacy=0x7f08040c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:27.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.242+0000 7f0808fe1640 1 -- 172.21.15.88:0/1804628871 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08040c6c60 con 0x7f08040c6680 2023-12-08T08:20:27.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fe6f6279640 1 -- 172.21.15.88:0/3661556702 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f00a9ed0 con 0x7fe6f00a5050 2023-12-08T08:20:27.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.242+0000 7f1e714ea640 1 Processor -- start 2023-12-08T08:20:27.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7f1e714ea640 1 -- start start 2023-12-08T08:20:27.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fb9d7580640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c8049d00 0x7fb9c817ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fb9d7580640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9c80d46b0 0x7fb9c8043be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fb9d7580640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb9c8044e30 0x7fb9c8044120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fb9d531c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c8049d00 0x7fb9c817ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fb9d531c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c8049d00 0x7fb9c817ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40008/0 (socket says 172.21.15.88:40008) 2023-12-08T08:20:27.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fb9d7580640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c8045850 con 0x7fb9c8049d00 2023-12-08T08:20:27.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fb9d7580640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c80d0b20 con 0x7fb9c80d46b0 2023-12-08T08:20:27.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fb9d7580640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c80cec70 con 0x7fb9c8044e30 2023-12-08T08:20:27.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fb9d4b1b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9c80d46b0 0x7fb9c8043be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fb9d4b1b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9c80d46b0 0x7fb9c8043be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:45418/0 (socket says 172.21.15.88:45418) 2023-12-08T08:20:27.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fb9d4b1b640 1 -- 172.21.15.88:0/36456597 learned_addr learned my addr 172.21.15.88:0/36456597 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:27.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fb9d5b1d640 1 --2- 172.21.15.88:0/36456597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb9c8044e30 0x7fb9c8044120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7f59c37fe640 1 --2- 172.21.15.88:0/3032435446 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59bc02ae70 0x7f59bc0d75a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f59b00097c0 tx=0x7f59b001c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=277effea67aba519 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fe6ecff9640 1 -- 172.21.15.88:0/3661556702 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe6e80147e0 con 0x7fe6f00a5050 2023-12-08T08:20:27.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fb9d4b1b640 1 -- 172.21.15.88:0/36456597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb9c8044e30 msgr2=0x7fb9c8044120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fb9d4b1b640 1 --2- 172.21.15.88:0/36456597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb9c8044e30 0x7fb9c8044120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fb9d4b1b640 1 -- 172.21.15.88:0/36456597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c8049d00 msgr2=0x7fb9c817ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fb9d4b1b640 1 --2- 172.21.15.88:0/36456597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c8049d00 0x7fb9c817ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fb9d4b1b640 1 -- 172.21.15.88:0/36456597 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9cc00b6c0 con 0x7fb9c80d46b0 2023-12-08T08:20:27.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fb9d531c640 1 --2- 172.21.15.88:0/36456597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c8049d00 0x7fb9c817ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:27.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7f1e714ea640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e6c151ae0 0x7f1e6c155070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7f59c2ffd640 1 -- 172.21.15.88:0/3032435446 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b00ab600 con 0x7f59bc02ae70 2023-12-08T08:20:27.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7f59c2ffd640 1 -- 172.21.15.88:0/3032435446 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b00a7050 con 0x7f59bc02ae70 2023-12-08T08:20:27.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7f59c2ffd640 1 -- 172.21.15.88:0/3032435446 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b00ab600 con 0x7f59bc02ae70 2023-12-08T08:20:27.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fb9d4b1b640 1 --2- 172.21.15.88:0/36456597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9c80d46b0 0x7fb9c8043be0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00ba60 tx=0x7fb9cc01b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fb9c5ffb640 1 -- 172.21.15.88:0/36456597 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc0a77d0 con 0x7fb9c80d46b0 2023-12-08T08:20:27.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fb9c5ffb640 1 -- 172.21.15.88:0/36456597 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc004030 con 0x7fb9c80d46b0 2023-12-08T08:20:27.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fb9c5ffb640 1 -- 172.21.15.88:0/36456597 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc0043a0 con 0x7fb9c80d46b0 2023-12-08T08:20:27.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fb9d7580640 1 -- 172.21.15.88:0/36456597 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c80cf230 con 0x7fb9c80d46b0 2023-12-08T08:20:27.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7f1e714ea640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1e6c0c8000 0x7f1e6c0c8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fe6ecff9640 1 --2- 172.21.15.88:0/3661556702 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe6d0066570 0x7fe6d0068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fe6ecff9640 1 -- 172.21.15.88:0/3661556702 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6e8083aa0 con 0x7fe6f00a5050 2023-12-08T08:20:27.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fb9d7580640 1 -- 172.21.15.88:0/36456597 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c80ceec0 con 0x7fb9c80d46b0 2023-12-08T08:20:27.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7fe6ef7fe640 1 --2- 172.21.15.88:0/3661556702 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe6d0066570 0x7fe6d0068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7f1e6affd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e6c151ae0 0x7f1e6c155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7f1e6affd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e6c151ae0 0x7f1e6c155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:55830/0 (socket says 172.21.15.88:55830) 2023-12-08T08:20:27.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.246+0000 7f1e714ea640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e6c151ec0 con 0x7f1e6c0c5520 2023-12-08T08:20:27.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7f1e714ea640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6c0c08f0 con 0x7f1e6c0c8000 2023-12-08T08:20:27.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7f1e6affd640 1 -- 172.21.15.88:0/2055685824 learned_addr learned my addr 172.21.15.88:0/2055685824 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:27.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7f1e6b7fe640 1 --2- 172.21.15.88:0/2055685824 >> v2:172.21.15.88:3300/0 conn(0x7f1e6c0c8000 0x7f1e6c0c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7f1e714ea640 1 -- 172.21.15.88:0/2055685824 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c0c5a90 con 0x7f1e6c151ae0 2023-12-08T08:20:27.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7fb9d7580640 1 -- 172.21.15.88:0/36456597 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c80cf3c0 con 0x7fb9c80d46b0 2023-12-08T08:20:27.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7f0808fe1640 1 --2- 172.21.15.88:0/1804628871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08040c6680 0x7f080406c380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f07f40097f0 tx=0x7f07f401c320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2029e614bd17710 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7f1e6affd640 1 -- 172.21.15.88:0/2055685824 >> v2:172.21.15.88:3300/0 conn(0x7f1e6c0c8000 msgr2=0x7f1e6c0c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:27.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7f59c93d0640 1 -- 172.21.15.88:0/3032435446 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59bc02ae70 msgr2=0x7f59bc0d75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7f59c93d0640 1 --2- 172.21.15.88:0/3032435446 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59bc02ae70 0x7f59bc0d75a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f59b00097c0 tx=0x7f59b001c360 comp rx=0 tx=0).stop 2023-12-08T08:20:27.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7fe6ef7fe640 1 --2- 172.21.15.88:0/3661556702 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe6d0066570 0x7fe6d0068a30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe6e00ae000 tx=0x7fe6e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7f59c93d0640 1 -- 172.21.15.88:0/3032435446 shutdown_connections 2023-12-08T08:20:27.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7f59c93d0640 1 --2- 172.21.15.88:0/3032435446 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59bc02ae70 0x7f59bc0d75a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7f59c93d0640 1 -- 172.21.15.88:0/3032435446 >> 172.21.15.88:0/3032435446 conn(0x7f59bc005e70 msgr2=0x7f59bc006280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:27.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7f07fbfff640 1 -- 172.21.15.88:0/1804628871 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f40ab600 con 0x7f08040c6680 2023-12-08T08:20:27.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7f07fbfff640 1 -- 172.21.15.88:0/1804628871 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f40a7050 con 0x7f08040c6680 2023-12-08T08:20:27.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7f07fbfff640 1 -- 172.21.15.88:0/1804628871 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f40ab600 con 0x7f08040c6680 2023-12-08T08:20:27.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7f59c93d0640 1 -- 172.21.15.88:0/3032435446 shutdown_connections 2023-12-08T08:20:27.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7f1e6affd640 1 --2- 172.21.15.88:0/2055685824 >> v2:172.21.15.88:3300/0 conn(0x7f1e6c0c8000 0x7f1e6c0c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7f1e6affd640 1 -- 172.21.15.88:0/2055685824 >> v1:172.21.15.88:6789/0 conn(0x7f1e6c0c5520 legacy=0x7f1e6c0bf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7f1e6affd640 1 -- 172.21.15.88:0/2055685824 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c0c5d70 con 0x7f1e6c151ae0 2023-12-08T08:20:27.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7f1e6b7fe640 1 --2- 172.21.15.88:0/2055685824 >> v2:172.21.15.88:3300/0 conn(0x7f1e6c0c8000 0x7f1e6c0c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:27.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7f1e69ffb640 1 -- 172.21.15.88:0/2055685824 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3068925242 0 0) 0x7f1e640014f0 con 0x7f1e6c0c5520 2023-12-08T08:20:27.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7fb9c5ffb640 1 -- 172.21.15.88:0/36456597 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb9cc0af870 con 0x7fb9c80d46b0 2023-12-08T08:20:27.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7f59c93d0640 1 -- 172.21.15.88:0/3032435446 wait complete. 2023-12-08T08:20:27.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7f080a7e4640 1 -- 172.21.15.88:0/1804628871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08040c6680 msgr2=0x7f080406c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7f080a7e4640 1 --2- 172.21.15.88:0/1804628871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08040c6680 0x7f080406c380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f07f40097f0 tx=0x7f07f401c320 comp rx=0 tx=0).stop 2023-12-08T08:20:27.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7f080a7e4640 1 -- 172.21.15.88:0/1804628871 shutdown_connections 2023-12-08T08:20:27.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7f080a7e4640 1 --2- 172.21.15.88:0/1804628871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08040c6680 0x7f080406c380 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.250+0000 7f080a7e4640 1 -- 172.21.15.88:0/1804628871 >> 172.21.15.88:0/1804628871 conn(0x7f08040ab9d0 msgr2=0x7f08040abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:27.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.254+0000 7fb9c5ffb640 1 --2- 172.21.15.88:0/36456597 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb9b4066470 0x7fb9b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.254+0000 7fe6ecff9640 1 -- 172.21.15.88:0/3661556702 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe6e8050f90 con 0x7fe6f00a5050 2023-12-08T08:20:27.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.254+0000 7fb9c5ffb640 1 -- 172.21.15.88:0/36456597 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9cc11eaf0 con 0x7fb9c80d46b0 2023-12-08T08:20:27.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.254+0000 7f59c93d0640 1 Processor -- start 2023-12-08T08:20:27.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.254+0000 7fb9d531c640 1 --2- 172.21.15.88:0/36456597 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb9b4066470 0x7fb9b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.254+0000 7f080a7e4640 1 -- 172.21.15.88:0/1804628871 shutdown_connections 2023-12-08T08:20:27.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.254+0000 7f080a7e4640 1 -- 172.21.15.88:0/1804628871 wait complete. 2023-12-08T08:20:27.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.254+0000 7f59c93d0640 1 -- start start 2023-12-08T08:20:27.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.254+0000 7fb9d531c640 1 --2- 172.21.15.88:0/36456597 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb9b4066470 0x7fb9b4068930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0000f70 tx=0x7fb9c0007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.254+0000 7f1e6affd640 1 --2- 172.21.15.88:0/2055685824 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e6c151ae0 0x7f1e6c155070 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c009870 tx=0x7f1e5c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45f127859ef00b6e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.254+0000 7f080a7e4640 1 Processor -- start 2023-12-08T08:20:27.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.254+0000 7f1e69ffb640 1 -- 172.21.15.88:0/2055685824 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c0ab680 con 0x7f1e6c151ae0 2023-12-08T08:20:27.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.254+0000 7f1e69ffb640 1 -- 172.21.15.88:0/2055685824 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5c0ab7e0 con 0x7f1e6c151ae0 2023-12-08T08:20:27.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.254+0000 7f1e69ffb640 1 -- 172.21.15.88:0/2055685824 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c0abb70 con 0x7f1e6c151ae0 2023-12-08T08:20:27.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.254+0000 7f080a7e4640 1 -- start start 2023-12-08T08:20:27.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7fb9c5ffb640 1 -- 172.21.15.88:0/36456597 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb9cc0ec010 con 0x7fb9c80d46b0 2023-12-08T08:20:27.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f1e714ea640 1 -- 172.21.15.88:0/2055685824 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e6c151ae0 msgr2=0x7f1e6c155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f1e714ea640 1 --2- 172.21.15.88:0/2055685824 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e6c151ae0 0x7f1e6c155070 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c009870 tx=0x7f1e5c01c480 comp rx=0 tx=0).stop 2023-12-08T08:20:27.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f1e714ea640 1 -- 172.21.15.88:0/2055685824 shutdown_connections 2023-12-08T08:20:27.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f1e714ea640 1 --2- 172.21.15.88:0/2055685824 >> v2:172.21.15.88:3300/0 conn(0x7f1e6c0c8000 0x7f1e6c0c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f1e714ea640 1 --2- 172.21.15.88:0/2055685824 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e6c151ae0 0x7f1e6c155070 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f1e714ea640 1 -- 172.21.15.88:0/2055685824 >> 172.21.15.88:0/2055685824 conn(0x7f1e6c0ca000 msgr2=0x7f1e6c0ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:27.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f59c93d0640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f59bc02ae70 0x7f59bc044e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f59c93d0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59bc046390 0x7f59bc0dcaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f59c93d0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59bc0db090 0x7f59bc0dcfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f59c93d0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc0434b0 con 0x7f59bc046390 2023-12-08T08:20:27.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f59c93d0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc043160 con 0x7f59bc0db090 2023-12-08T08:20:27.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f59c93d0640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc177e50 con 0x7f59bc02ae70 2023-12-08T08:20:27.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f1e714ea640 1 -- 172.21.15.88:0/2055685824 shutdown_connections 2023-12-08T08:20:27.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f1e714ea640 1 -- 172.21.15.88:0/2055685824 wait complete. 2023-12-08T08:20:27.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f080a7e4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08040c6680 0x7f08041efd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f080a7e4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08041519f0 0x7f08040c1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f08097e2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08040c6680 0x7f08041efd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f59c37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59bc046390 0x7f59bc0dcaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f59c8bcf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59bc0db090 0x7f59bc0dcfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f59c8bcf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59bc0db090 0x7f59bc0dcfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:45432/0 (socket says 172.21.15.88:45432) 2023-12-08T08:20:27.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f59c8bcf640 1 -- 172.21.15.88:0/1930181378 learned_addr learned my addr 172.21.15.88:0/1930181378 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:27.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f59c3fff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f59bc02ae70 0x7f59bc044e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f080a7e4640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0804154f00 0x7f0804143c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f080a7e4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08041582a0 con 0x7f08041519f0 2023-12-08T08:20:27.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f080a7e4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08041ec990 con 0x7f08040c6680 2023-12-08T08:20:27.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f080a7e4640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08041f0340 con 0x7f0804154f00 2023-12-08T08:20:27.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f59c8bcf640 1 -- 172.21.15.88:0/1930181378 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f59bc02ae70 msgr2=0x7f59bc044e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f59c8bcf640 1 --2- 172.21.15.88:0/1930181378 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f59bc02ae70 0x7f59bc044e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f59c8bcf640 1 -- 172.21.15.88:0/1930181378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59bc046390 msgr2=0x7f59bc0dcaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f59c8bcf640 1 --2- 172.21.15.88:0/1930181378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59bc046390 0x7f59bc0dcaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f59c8bcf640 1 -- 172.21.15.88:0/1930181378 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b0009420 con 0x7f59bc0db090 2023-12-08T08:20:27.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.262+0000 7f59c8bcf640 1 --2- 172.21.15.88:0/1930181378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59bc0db090 0x7f59bc0dcfe0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f59c4050190 tx=0x7f59c4074900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.262+0000 7f59c3fff640 1 --2- 172.21.15.88:0/1930181378 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f59bc02ae70 0x7f59bc044e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:27.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.262+0000 7f1e714ea640 1 Processor -- start 2023-12-08T08:20:27.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.262+0000 7f59c0ff9640 1 -- 172.21.15.88:0/1930181378 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c406bd00 con 0x7f59bc0db090 2023-12-08T08:20:27.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.262+0000 7f59c0ff9640 1 -- 172.21.15.88:0/1930181378 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c406be80 con 0x7f59bc0db090 2023-12-08T08:20:27.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.262+0000 7f59c0ff9640 1 -- 172.21.15.88:0/1930181378 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4092640 con 0x7f59bc0db090 2023-12-08T08:20:27.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.262+0000 7f1e714ea640 1 -- start start 2023-12-08T08:20:27.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.262+0000 7f59c93d0640 1 -- 172.21.15.88:0/1930181378 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59bc178130 con 0x7f59bc0db090 2023-12-08T08:20:27.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.262+0000 7f59c93d0640 1 -- 172.21.15.88:0/1930181378 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59bc041840 con 0x7f59bc0db090 2023-12-08T08:20:27.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f0808fe1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08041519f0 0x7f08040c1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f0808fe1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08041519f0 0x7f08040c1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40020/0 (socket says 172.21.15.88:40020) 2023-12-08T08:20:27.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.258+0000 7f0808fe1640 1 -- 172.21.15.88:0/4253697222 learned_addr learned my addr 172.21.15.88:0/4253697222 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:27.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.262+0000 7f08097e2640 1 -- 172.21.15.88:0/4253697222 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0804154f00 msgr2=0x7f0804143c00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-08T08:20:27.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.262+0000 7f08097e2640 1 --2- 172.21.15.88:0/4253697222 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0804154f00 0x7f0804143c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.262+0000 7f08097e2640 1 -- 172.21.15.88:0/4253697222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08041519f0 msgr2=0x7f08040c1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.262+0000 7f08097e2640 1 --2- 172.21.15.88:0/4253697222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08041519f0 0x7f08040c1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.262+0000 7f08097e2640 1 -- 172.21.15.88:0/4253697222 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f4009420 con 0x7f08040c6680 2023-12-08T08:20:27.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.262+0000 7f08097e2640 1 --2- 172.21.15.88:0/4253697222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08040c6680 0x7f08041efd60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f07fc00cbc0 tx=0x7f07fc00a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.262+0000 7f07f9ffb640 1 -- 172.21.15.88:0/4253697222 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc00aca0 con 0x7f08040c6680 2023-12-08T08:20:27.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.262+0000 7f07f9ffb640 1 -- 172.21.15.88:0/4253697222 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07fc00ae00 con 0x7f08040c6680 2023-12-08T08:20:27.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.262+0000 7f07f9ffb640 1 -- 172.21.15.88:0/4253697222 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc012600 con 0x7f08040c6680 2023-12-08T08:20:27.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.262+0000 7f59c93d0640 1 -- 172.21.15.88:0/1930181378 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59bc005370 con 0x7f59bc0db090 2023-12-08T08:20:27.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.262+0000 7f080a7e4640 1 -- 172.21.15.88:0/4253697222 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08041f0620 con 0x7f08040c6680 2023-12-08T08:20:27.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.266+0000 7f080a7e4640 1 -- 172.21.15.88:0/4253697222 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08041f0be0 con 0x7f08040c6680 2023-12-08T08:20:27.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.266+0000 7f59c0ff9640 1 -- 172.21.15.88:0/1930181378 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f59c40927a0 con 0x7f59bc0db090 2023-12-08T08:20:27.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.266+0000 7f1e714ea640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e6c0c5520 0x7f1e6c0c1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.266+0000 7f1e714ea640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e6c0c8000 0x7f1e6c0c3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.266+0000 7f1e6affd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e6c0c5520 0x7f1e6c0c1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.266+0000 7f59c0ff9640 1 --2- 172.21.15.88:0/1930181378 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f59a8066540 0x7f59a8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.266+0000 7f1e6affd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e6c0c5520 0x7f1e6c0c1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:55862/0 (socket says 172.21.15.88:55862) 2023-12-08T08:20:27.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.266+0000 7f1e714ea640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e6c151ae0 0x7f1e6c0c3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.266+0000 7f59c0ff9640 1 -- 172.21.15.88:0/1930181378 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f59c40fda10 con 0x7f59bc0db090 2023-12-08T08:20:27.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.266+0000 7f1e714ea640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c1f4750 con 0x7f1e6c0c8000 2023-12-08T08:20:27.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.266+0000 7f1e714ea640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c1f55b0 con 0x7f1e6c151ae0 2023-12-08T08:20:27.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.266+0000 7f1e714ea640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c1f49a0 con 0x7f1e6c0c5520 2023-12-08T08:20:27.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.266+0000 7f1e6b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e6c151ae0 0x7f1e6c0c3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.266+0000 7f1e6b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e6c151ae0 0x7f1e6c0c3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:45436/0 (socket says 172.21.15.88:45436) 2023-12-08T08:20:27.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.266+0000 7f1e6b7fe640 1 -- 172.21.15.88:0/1759281205 learned_addr learned my addr 172.21.15.88:0/1759281205 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:27.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.266+0000 7f59c3fff640 1 --2- 172.21.15.88:0/1930181378 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f59a8066540 0x7f59a8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.270+0000 7f07f9ffb640 1 -- 172.21.15.88:0/4253697222 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f07fc007070 con 0x7f08040c6680 2023-12-08T08:20:27.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.266+0000 7f1e6b7fe640 1 -- 172.21.15.88:0/1759281205 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e6c0c5520 msgr2=0x7f1e6c0c1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.266+0000 7f1e6b7fe640 1 --2- 172.21.15.88:0/1759281205 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e6c0c5520 0x7f1e6c0c1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.266+0000 7f1e6b7fe640 1 -- 172.21.15.88:0/1759281205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e6c0c8000 msgr2=0x7f1e6c0c3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.266+0000 7f1e6b7fe640 1 --2- 172.21.15.88:0/1759281205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e6c0c8000 0x7f1e6c0c3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.266+0000 7f1e6b7fe640 1 -- 172.21.15.88:0/1759281205 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e60009420 con 0x7f1e6c151ae0 2023-12-08T08:20:27.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.270+0000 7f59c3fff640 1 --2- 172.21.15.88:0/1930181378 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f59a8066540 0x7f59a8068a00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f59b8005890 tx=0x7f59b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.270+0000 7f1e6b7fe640 1 --2- 172.21.15.88:0/1759281205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e6c151ae0 0x7f1e6c0c3860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1e6000e930 tx=0x7f1e6000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.270+0000 7f1e6affd640 1 --2- 172.21.15.88:0/1759281205 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e6c0c5520 0x7f1e6c0c1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-12-08T08:20:27.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.270+0000 7f080a7e4640 1 -- 172.21.15.88:0/4253697222 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0804067bc0 con 0x7f08040c6680 2023-12-08T08:20:27.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.270+0000 7f07f9ffb640 1 --2- 172.21.15.88:0/4253697222 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f07e8066540 0x7f07e8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.270+0000 7f07f9ffb640 1 -- 172.21.15.88:0/4253697222 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07fc083cc0 con 0x7f08040c6680 2023-12-08T08:20:27.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.270+0000 7f1e537fe640 1 -- 172.21.15.88:0/1759281205 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e60004020 con 0x7f1e6c151ae0 2023-12-08T08:20:27.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.270+0000 7f1e714ea640 1 -- 172.21.15.88:0/1759281205 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e5c0094d0 con 0x7f1e6c151ae0 2023-12-08T08:20:27.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.270+0000 7f1e714ea640 1 -- 172.21.15.88:0/1759281205 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e6c1f4f60 con 0x7f1e6c151ae0 2023-12-08T08:20:27.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.270+0000 7f0808fe1640 1 --2- 172.21.15.88:0/4253697222 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f07e8066540 0x7f07e8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.270+0000 7f59c0ff9640 1 -- 172.21.15.88:0/1930181378 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f59c40caf00 con 0x7f59bc0db090 2023-12-08T08:20:27.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.270+0000 7f1e714ea640 1 -- 172.21.15.88:0/1759281205 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e6c067630 con 0x7f1e6c151ae0 2023-12-08T08:20:27.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.270+0000 7f0808fe1640 1 --2- 172.21.15.88:0/4253697222 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f07e8066540 0x7f07e8068a00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f07f40097f0 tx=0x7f07f40a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.274+0000 7f07f9ffb640 1 -- 172.21.15.88:0/4253697222 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f07fc0511d0 con 0x7f08040c6680 2023-12-08T08:20:27.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.274+0000 7f1e537fe640 1 -- 172.21.15.88:0/1759281205 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e60004180 con 0x7f1e6c151ae0 2023-12-08T08:20:27.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.274+0000 7f1e537fe640 1 -- 172.21.15.88:0/1759281205 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e600044f0 con 0x7f1e6c151ae0 2023-12-08T08:20:27.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.278+0000 7f1e537fe640 1 -- 172.21.15.88:0/1759281205 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1e6000c940 con 0x7f1e6c151ae0 2023-12-08T08:20:27.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.278+0000 7f1e537fe640 1 --2- 172.21.15.88:0/1759281205 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1e58066470 0x7f1e58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.278+0000 7f1e537fe640 1 -- 172.21.15.88:0/1759281205 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e60084510 con 0x7f1e6c151ae0 2023-12-08T08:20:27.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.278+0000 7f1e6affd640 1 --2- 172.21.15.88:0/1759281205 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1e58066470 0x7f1e58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.282+0000 7f1e537fe640 1 -- 172.21.15.88:0/1759281205 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1e60051a00 con 0x7f1e6c151ae0 2023-12-08T08:20:27.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.282+0000 7f1e6affd640 1 --2- 172.21.15.88:0/1759281205 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1e58066470 0x7f1e58068930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c0af000 tx=0x7f1e5c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.306+0000 7f137359e640 1 Processor -- start 2023-12-08T08:20:27.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.306+0000 7f137359e640 1 -- start start 2023-12-08T08:20:27.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.306+0000 7f05c94f5640 1 Processor -- start 2023-12-08T08:20:27.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.306+0000 7f05c94f5640 1 -- start start 2023-12-08T08:20:27.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.310+0000 7f137359e640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f13740c0b80 0x7f1374153540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.310+0000 7f137359e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1374154090 0x7f13741544e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.310+0000 7f137359e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1374153c00 con 0x7f1374150fe0 2023-12-08T08:20:27.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.310+0000 7f137359e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1374154a20 con 0x7f1374154090 2023-12-08T08:20:27.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.310+0000 7f137359e640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13740c1040 con 0x7f13740c0b80 2023-12-08T08:20:27.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.310+0000 7f05c94f5640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f05c41519f0 0x7f05c40c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.310+0000 7f05c94f5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f05c40c5f60 0x7f05c40c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.310+0000 7f05c94f5640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c406e3d0 con 0x7f05c40c3ac0 2023-12-08T08:20:27.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.310+0000 7f05c94f5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c4158670 con 0x7f05c40c5f60 2023-12-08T08:20:27.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.310+0000 7f05c94f5640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c406d9d0 con 0x7f05c41519f0 2023-12-08T08:20:27.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.310+0000 7f05c8cf4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f05c40c5f60 0x7f05c40c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.310+0000 7f05c3fff640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f05c41519f0 0x7f05c40c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.310+0000 7f05c8cf4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f05c40c5f60 0x7f05c40c47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40042/0 (socket says 172.21.15.88:40042) 2023-12-08T08:20:27.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.310+0000 7f05c8cf4640 1 -- 172.21.15.88:0/1838421507 learned_addr learned my addr 172.21.15.88:0/1838421507 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:27.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.310+0000 7f137259c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1374150fe0 0x7f13740c5b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:32906/0 (socket says 172.21.15.88:32906) 2023-12-08T08:20:27.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.310+0000 7f05c3fff640 1 -- 172.21.15.88:0/1838421507 >> v2:172.21.15.88:3300/0 conn(0x7f05c40c5f60 msgr2=0x7f05c40c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:27.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.314+0000 7f05c2ffd640 1 -- 172.21.15.88:0/1838421507 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798807463 0 0) 0x7f05c406e3d0 con 0x7f05c40c3ac0 2023-12-08T08:20:27.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.310+0000 7f137259c640 1 -- 172.21.15.88:0/3032309930 learned_addr learned my addr 172.21.15.88:0/3032309930 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:27.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.310+0000 7f1371d9b640 1 --2- 172.21.15.88:0/3032309930 >> v2:172.21.15.148:3300/0 conn(0x7f13740c0b80 0x7f1374153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.310+0000 7f1372d9d640 1 --2- 172.21.15.88:0/3032309930 >> v2:172.21.15.88:3300/0 conn(0x7f1374154090 0x7f13741544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.310+0000 7f1371d9b640 1 -- 172.21.15.88:0/3032309930 >> v2:172.21.15.88:3300/0 conn(0x7f1374154090 msgr2=0x7f13741544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:27.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.310+0000 7f1371d9b640 1 --2- 172.21.15.88:0/3032309930 >> v2:172.21.15.88:3300/0 conn(0x7f1374154090 0x7f13741544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.310+0000 7f1371d9b640 1 -- 172.21.15.88:0/3032309930 >> v1:172.21.15.88:6789/0 conn(0x7f1374150fe0 legacy=0x7f13740c5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.310+0000 7f1371d9b640 1 -- 172.21.15.88:0/3032309930 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13740c3690 con 0x7f13740c0b80 2023-12-08T08:20:27.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.314+0000 7f05c3fff640 1 --2- 172.21.15.88:0/1838421507 >> v2:172.21.15.88:3300/0 conn(0x7f05c40c5f60 0x7f05c40c47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.314+0000 7f05c3fff640 1 -- 172.21.15.88:0/1838421507 >> v1:172.21.15.148:6789/0 conn(0x7f05c40c3ac0 legacy=0x7f05c40c40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.314+0000 7f05c3fff640 1 -- 172.21.15.88:0/1838421507 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c406dcb0 con 0x7f05c41519f0 2023-12-08T08:20:27.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.314+0000 7f05c8cf4640 1 --2- 172.21.15.88:0/1838421507 >> v2:172.21.15.88:3300/0 conn(0x7f05c40c5f60 0x7f05c40c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:27.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.318+0000 7f1371d9b640 1 --2- 172.21.15.88:0/3032309930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13740c0b80 0x7f1374153540 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f13740a5430 tx=0x7f136c01e9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9931f5d8d943500 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.318+0000 7f137159a640 1 -- 172.21.15.88:0/3032309930 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c0a7940 con 0x7f13740c0b80 2023-12-08T08:20:27.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.318+0000 7f137159a640 1 -- 172.21.15.88:0/3032309930 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136c0ab070 con 0x7f13740c0b80 2023-12-08T08:20:27.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.318+0000 7f137159a640 1 -- 172.21.15.88:0/3032309930 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c0a7cc0 con 0x7f13740c0b80 2023-12-08T08:20:27.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.318+0000 7f05c3fff640 1 --2- 172.21.15.88:0/1838421507 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05c41519f0 0x7f05c40c5a20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f05c40c30b0 tx=0x7f05bc01c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b16b961f56f19c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.318+0000 7f137359e640 1 -- 172.21.15.88:0/3032309930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13740c0b80 msgr2=0x7f1374153540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.318+0000 7f137359e640 1 --2- 172.21.15.88:0/3032309930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13740c0b80 0x7f1374153540 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f13740a5430 tx=0x7f136c01e9a0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.318+0000 7f05c2ffd640 1 -- 172.21.15.88:0/1838421507 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc0a5850 con 0x7f05c41519f0 2023-12-08T08:20:27.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.318+0000 7f137359e640 1 -- 172.21.15.88:0/3032309930 shutdown_connections 2023-12-08T08:20:27.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.318+0000 7f137359e640 1 --2- 172.21.15.88:0/3032309930 >> v2:172.21.15.88:3300/0 conn(0x7f1374154090 0x7f13741544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.318+0000 7f137359e640 1 --2- 172.21.15.88:0/3032309930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13740c0b80 0x7f1374153540 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.318+0000 7f137359e640 1 -- 172.21.15.88:0/3032309930 >> 172.21.15.88:0/3032309930 conn(0x7f13740c2270 msgr2=0x7f13740c2680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:27.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.318+0000 7f137359e640 1 -- 172.21.15.88:0/3032309930 shutdown_connections 2023-12-08T08:20:27.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.318+0000 7f137359e640 1 -- 172.21.15.88:0/3032309930 wait complete. 2023-12-08T08:20:27.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.318+0000 7f05c2ffd640 1 -- 172.21.15.88:0/1838421507 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05bc0a59b0 con 0x7f05c41519f0 2023-12-08T08:20:27.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.318+0000 7f05c94f5640 1 -- 172.21.15.88:0/1838421507 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05c41519f0 msgr2=0x7f05c40c5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.318+0000 7f05c2ffd640 1 -- 172.21.15.88:0/1838421507 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc0a5850 con 0x7f05c41519f0 2023-12-08T08:20:27.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.318+0000 7f05c94f5640 1 --2- 172.21.15.88:0/1838421507 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05c41519f0 0x7f05c40c5a20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f05c40c30b0 tx=0x7f05bc01c860 comp rx=0 tx=0).stop 2023-12-08T08:20:27.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.322+0000 7f137359e640 1 Processor -- start 2023-12-08T08:20:27.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.322+0000 7f137359e640 1 -- start start 2023-12-08T08:20:27.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.322+0000 7f137359e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13740c0b80 0x7f13741e80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.326+0000 7f05c94f5640 1 -- 172.21.15.88:0/1838421507 shutdown_connections 2023-12-08T08:20:27.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.326+0000 7f137359e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1374150fe0 0x7f13741fbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.326+0000 7f05c94f5640 1 --2- 172.21.15.88:0/1838421507 >> v2:172.21.15.88:3300/0 conn(0x7f05c40c5f60 0x7f05c40c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.326+0000 7f05c94f5640 1 --2- 172.21.15.88:0/1838421507 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05c41519f0 0x7f05c40c5a20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.326+0000 7f05c94f5640 1 -- 172.21.15.88:0/1838421507 >> 172.21.15.88:0/1838421507 conn(0x7f05c40c2270 msgr2=0x7f05c40c2680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:27.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.326+0000 7f137359e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1374154090 0x7f13741fc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.326+0000 7f137259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13740c0b80 0x7f13741e80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.326+0000 7f137259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13740c0b80 0x7f13741e80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:45472/0 (socket says 172.21.15.88:45472) 2023-12-08T08:20:27.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.326+0000 7f05c94f5640 1 -- 172.21.15.88:0/1838421507 shutdown_connections 2023-12-08T08:20:27.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.326+0000 7f1371d9b640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1374150fe0 0x7f13741fbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.326+0000 7f1371d9b640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1374150fe0 0x7f13741fbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:55876/0 (socket says 172.21.15.88:55876) 2023-12-08T08:20:27.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.326+0000 7f137259c640 1 -- 172.21.15.88:0/3270936766 learned_addr learned my addr 172.21.15.88:0/3270936766 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:27.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.326+0000 7f137359e640 1 -- 172.21.15.88:0/3270936766 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137414ba70 con 0x7f1374154090 2023-12-08T08:20:27.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.326+0000 7f05c94f5640 1 -- 172.21.15.88:0/1838421507 wait complete. 2023-12-08T08:20:27.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.326+0000 7f137359e640 1 -- 172.21.15.88:0/3270936766 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13741fd370 con 0x7f13740c0b80 2023-12-08T08:20:27.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.326+0000 7f1372d9d640 1 --2- 172.21.15.88:0/3270936766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1374154090 0x7f13741fc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.326+0000 7f137359e640 1 -- 172.21.15.88:0/3270936766 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13741fd840 con 0x7f1374150fe0 2023-12-08T08:20:27.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.326+0000 7f137259c640 1 -- 172.21.15.88:0/3270936766 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1374150fe0 msgr2=0x7f13741fbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.326+0000 7f137259c640 1 --2- 172.21.15.88:0/3270936766 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1374150fe0 0x7f13741fbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.326+0000 7f137259c640 1 -- 172.21.15.88:0/3270936766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1374154090 msgr2=0x7f13741fc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.326+0000 7f137259c640 1 --2- 172.21.15.88:0/3270936766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1374154090 0x7f13741fc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.326+0000 7f137259c640 1 -- 172.21.15.88:0/3270936766 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c00bb70 con 0x7f13740c0b80 2023-12-08T08:20:27.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.326+0000 7f1371d9b640 1 --2- 172.21.15.88:0/3270936766 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1374150fe0 0x7f13741fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:27.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.330+0000 7f137259c640 1 --2- 172.21.15.88:0/3270936766 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13740c0b80 0x7f13741e80f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f136400c8e0 tx=0x7f136400cda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.330+0000 7f05c94f5640 1 Processor -- start 2023-12-08T08:20:27.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.330+0000 7f1362ffd640 1 -- 172.21.15.88:0/3270936766 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1364007b70 con 0x7f13740c0b80 2023-12-08T08:20:27.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.330+0000 7f05c94f5640 1 -- start start 2023-12-08T08:20:27.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.330+0000 7f05c94f5640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f05c40c3ac0 0x7f05c4156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.330+0000 7f05c94f5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05c40c5f60 0x7f05c4144590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.330+0000 7f05c94f5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05c41519f0 0x7f05c4144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.330+0000 7f05c37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05c40c5f60 0x7f05c4144590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.330+0000 7f05c37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05c40c5f60 0x7f05c4144590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40070/0 (socket says 172.21.15.88:40070) 2023-12-08T08:20:27.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.330+0000 7f05c37fe640 1 -- 172.21.15.88:0/3626244717 learned_addr learned my addr 172.21.15.88:0/3626244717 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:27.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.330+0000 7f05c94f5640 1 -- 172.21.15.88:0/3626244717 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c40a3d60 con 0x7f05c40c5f60 2023-12-08T08:20:27.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.330+0000 7f05c94f5640 1 -- 172.21.15.88:0/3626244717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c40ab690 con 0x7f05c41519f0 2023-12-08T08:20:27.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.330+0000 7f05c94f5640 1 -- 172.21.15.88:0/3626244717 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c40a3fb0 con 0x7f05c40c3ac0 2023-12-08T08:20:27.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.330+0000 7f05c8cf4640 1 --2- 172.21.15.88:0/3626244717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05c41519f0 0x7f05c4144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.330+0000 7f05c3fff640 1 --2- 172.21.15.88:0/3626244717 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f05c40c3ac0 0x7f05c4156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.330+0000 7f1362ffd640 1 -- 172.21.15.88:0/3270936766 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1364007cd0 con 0x7f13740c0b80 2023-12-08T08:20:27.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.330+0000 7f1362ffd640 1 -- 172.21.15.88:0/3270936766 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136400f610 con 0x7f13740c0b80 2023-12-08T08:20:27.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.330+0000 7f137359e640 1 -- 172.21.15.88:0/3270936766 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13741fd560 con 0x7f13740c0b80 2023-12-08T08:20:27.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.330+0000 7f137359e640 1 -- 172.21.15.88:0/3270936766 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f137406fd90 con 0x7f13740c0b80 2023-12-08T08:20:27.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.334+0000 7f05c8cf4640 1 -- 172.21.15.88:0/3626244717 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f05c40c3ac0 msgr2=0x7f05c4156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.334+0000 7f05c8cf4640 1 --2- 172.21.15.88:0/3626244717 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f05c40c3ac0 0x7f05c4156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.334+0000 7f05c8cf4640 1 -- 172.21.15.88:0/3626244717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05c40c5f60 msgr2=0x7f05c4144590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.334+0000 7f05c8cf4640 1 --2- 172.21.15.88:0/3626244717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05c40c5f60 0x7f05c4144590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.334+0000 7f05c8cf4640 1 -- 172.21.15.88:0/3626244717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b80094d0 con 0x7f05c41519f0 2023-12-08T08:20:27.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.334+0000 7f05c37fe640 1 --2- 172.21.15.88:0/3626244717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05c40c5f60 0x7f05c4144590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:27.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.334+0000 7f05c3fff640 1 --2- 172.21.15.88:0/3626244717 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f05c40c3ac0 0x7f05c4156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:27.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.334+0000 7f05c8cf4640 1 --2- 172.21.15.88:0/3626244717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05c41519f0 0x7f05c4144ad0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f05b800e880 tx=0x7f05b800ed40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.334+0000 7f05c0ff9640 1 -- 172.21.15.88:0/3626244717 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b8004020 con 0x7f05c41519f0 2023-12-08T08:20:27.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.334+0000 7f05c0ff9640 1 -- 172.21.15.88:0/3626244717 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b80041a0 con 0x7f05c41519f0 2023-12-08T08:20:27.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.334+0000 7f05c94f5640 1 -- 172.21.15.88:0/3626244717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05bc009a70 con 0x7f05c41519f0 2023-12-08T08:20:27.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.334+0000 7f05c0ff9640 1 -- 172.21.15.88:0/3626244717 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b800c940 con 0x7f05c41519f0 2023-12-08T08:20:27.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.334+0000 7f05c94f5640 1 -- 172.21.15.88:0/3626244717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c4144070 con 0x7f05c41519f0 2023-12-08T08:20:27.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.334+0000 7f1362ffd640 1 -- 172.21.15.88:0/3270936766 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f136400f770 con 0x7f13740c0b80 2023-12-08T08:20:27.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.334+0000 7f137359e640 1 -- 172.21.15.88:0/3270936766 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1358005260 con 0x7f13740c0b80 2023-12-08T08:20:27.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.334+0000 7f05c94f5640 1 -- 172.21.15.88:0/3626244717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c4144290 con 0x7f05c41519f0 2023-12-08T08:20:27.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.338+0000 7f1362ffd640 1 --2- 172.21.15.88:0/3270936766 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f13540664c0 0x7f1354068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.342+0000 7f05c0ff9640 1 -- 172.21.15.88:0/3626244717 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f05b800caa0 con 0x7f05c41519f0 2023-12-08T08:20:27.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.338+0000 7f1362ffd640 1 -- 172.21.15.88:0/3270936766 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1364083ff0 con 0x7f13740c0b80 2023-12-08T08:20:27.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.342+0000 7f1371d9b640 1 --2- 172.21.15.88:0/3270936766 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f13540664c0 0x7f1354068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.342+0000 7f1362ffd640 1 -- 172.21.15.88:0/3270936766 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f13640b5280 con 0x7f13740c0b80 2023-12-08T08:20:27.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.342+0000 7f05c0ff9640 1 --2- 172.21.15.88:0/3626244717 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f05b00664a0 0x7f05b0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.342+0000 7f05c3fff640 1 --2- 172.21.15.88:0/3626244717 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f05b00664a0 0x7f05b0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.342+0000 7f05c3fff640 1 --2- 172.21.15.88:0/3626244717 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f05b00664a0 0x7f05b0068960 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0af000 tx=0x7f05bc0a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.342+0000 7f05c0ff9640 1 -- 172.21.15.88:0/3626244717 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05b8083c40 con 0x7f05c41519f0 2023-12-08T08:20:27.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.346+0000 7f05c0ff9640 1 -- 172.21.15.88:0/3626244717 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f05b8051160 con 0x7f05c41519f0 2023-12-08T08:20:27.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.350+0000 7f1371d9b640 1 --2- 172.21.15.88:0/3270936766 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f13540664c0 0x7f1354068980 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f136c0b2000 tx=0x7f136c0a9070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.570+0000 7fbacfe68640 1 -- 172.21.15.88:0/2128837298 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbac8151ba0 con 0x7fbac80a5050 2023-12-08T08:20:27.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.570+0000 7fbabe7fc640 1 -- 172.21.15.88:0/2128837298 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbac40541f0 con 0x7fbac80a5050 2023-12-08T08:20:27.576 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2023-12-08T08:20:27.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.574+0000 7fbacfe68640 1 -- 172.21.15.88:0/2128837298 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbaac066540 msgr2=0x7fbaac068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.574+0000 7fbacfe68640 1 --2- 172.21.15.88:0/2128837298 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbaac066540 0x7fbaac068a00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbac80a70c0 tx=0x7fbac0009750 comp rx=0 tx=0).stop 2023-12-08T08:20:27.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.574+0000 7fbacfe68640 1 -- 172.21.15.88:0/2128837298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbac80a5050 msgr2=0x7fbac80a66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.574+0000 7fbacfe68640 1 --2- 172.21.15.88:0/2128837298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbac80a5050 0x7fbac80a66c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbac400c780 tx=0x7fbac400cc40 comp rx=0 tx=0).stop 2023-12-08T08:20:27.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.574+0000 7fbacfe68640 1 -- 172.21.15.88:0/2128837298 shutdown_connections 2023-12-08T08:20:27.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.574+0000 7fbacfe68640 1 --2- 172.21.15.88:0/2128837298 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbaac066540 0x7fbaac068a00 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbac80a70c0 tx=0x7fbac0009750 comp rx=0 tx=0).stop 2023-12-08T08:20:27.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.574+0000 7fbacfe68640 1 --2- 172.21.15.88:0/2128837298 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbac814da10 0x7fbac814a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.574+0000 7fbacfe68640 1 --2- 172.21.15.88:0/2128837298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbac80a8040 0x7fbac814a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.574+0000 7fbacfe68640 1 --2- 172.21.15.88:0/2128837298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbac80a5050 0x7fbac80a66c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.574+0000 7fbacfe68640 1 -- 172.21.15.88:0/2128837298 >> 172.21.15.88:0/2128837298 conn(0x7fbac80a7520 msgr2=0x7fbac814e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:27.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.574+0000 7fbacfe68640 1 -- 172.21.15.88:0/2128837298 shutdown_connections 2023-12-08T08:20:27.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.574+0000 7fbacfe68640 1 -- 172.21.15.88:0/2128837298 wait complete. 2023-12-08T08:20:27.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.578+0000 7fb9d7580640 1 -- 172.21.15.88:0/36456597 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb9c8005370 con 0x7fb9c80d46b0 2023-12-08T08:20:27.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.578+0000 7fb9c5ffb640 1 -- 172.21.15.88:0/36456597 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb9cc0c6020 con 0x7fb9c80d46b0 2023-12-08T08:20:27.582 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2023-12-08T08:20:27.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.582+0000 7fb9d7580640 1 -- 172.21.15.88:0/36456597 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb9b4066470 msgr2=0x7fb9b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.582+0000 7fb9d7580640 1 --2- 172.21.15.88:0/36456597 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb9b4066470 0x7fb9b4068930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0000f70 tx=0x7fb9c0007e30 comp rx=0 tx=0).stop 2023-12-08T08:20:27.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.582+0000 7fb9d7580640 1 -- 172.21.15.88:0/36456597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9c80d46b0 msgr2=0x7fb9c8043be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.582+0000 7fb9d7580640 1 --2- 172.21.15.88:0/36456597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9c80d46b0 0x7fb9c8043be0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00ba60 tx=0x7fb9cc01b710 comp rx=0 tx=0).stop 2023-12-08T08:20:27.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.582+0000 7fb9d7580640 1 -- 172.21.15.88:0/36456597 shutdown_connections 2023-12-08T08:20:27.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.582+0000 7fb9d7580640 1 --2- 172.21.15.88:0/36456597 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb9b4066470 0x7fb9b4068930 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.582+0000 7fb9d7580640 1 --2- 172.21.15.88:0/36456597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb9c8044e30 0x7fb9c8044120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.582+0000 7fb9d7580640 1 --2- 172.21.15.88:0/36456597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9c80d46b0 0x7fb9c8043be0 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00ba60 tx=0x7fb9cc01b710 comp rx=0 tx=0).stop 2023-12-08T08:20:27.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.582+0000 7fb9d7580640 1 --2- 172.21.15.88:0/36456597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c8049d00 0x7fb9c817ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.582+0000 7fb9d7580640 1 -- 172.21.15.88:0/36456597 >> 172.21.15.88:0/36456597 conn(0x7fb9c8048230 msgr2=0x7fb9c80d7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:27.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.582+0000 7fb9d7580640 1 -- 172.21.15.88:0/36456597 shutdown_connections 2023-12-08T08:20:27.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.582+0000 7fb9d7580640 1 -- 172.21.15.88:0/36456597 wait complete. 2023-12-08T08:20:27.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.590+0000 7fe6f6279640 1 -- 172.21.15.88:0/3661556702 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe6f00674b0 con 0x7fe6f00a5050 2023-12-08T08:20:27.596 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2023-12-08T08:20:27.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.590+0000 7fe6ecff9640 1 -- 172.21.15.88:0/3661556702 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe6e8019090 con 0x7fe6f00a5050 2023-12-08T08:20:27.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.590+0000 7f59c93d0640 1 -- 172.21.15.88:0/1930181378 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f59bc0432a0 con 0x7f59bc0db090 2023-12-08T08:20:27.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.594+0000 7fe6f6279640 1 -- 172.21.15.88:0/3661556702 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe6d0066570 msgr2=0x7fe6d0068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.594+0000 7fe6f6279640 1 --2- 172.21.15.88:0/3661556702 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe6d0066570 0x7fe6d0068a30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe6e00ae000 tx=0x7fe6e0008040 comp rx=0 tx=0).stop 2023-12-08T08:20:27.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.594+0000 7fe6f6279640 1 -- 172.21.15.88:0/3661556702 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6f00a5050 msgr2=0x7fe6f01fcd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.594+0000 7fe6f6279640 1 --2- 172.21.15.88:0/3661556702 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6f00a5050 0x7fe6f01fcd50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe6e800ba50 tx=0x7fe6e800bf10 comp rx=0 tx=0).stop 2023-12-08T08:20:27.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.594+0000 7fe6f6279640 1 -- 172.21.15.88:0/3661556702 shutdown_connections 2023-12-08T08:20:27.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.594+0000 7fe6f6279640 1 --2- 172.21.15.88:0/3661556702 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe6d0066570 0x7fe6d0068a30 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe6e00ae000 tx=0x7fe6e0008040 comp rx=0 tx=0).stop 2023-12-08T08:20:27.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.594+0000 7fe6f6279640 1 --2- 172.21.15.88:0/3661556702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f00c49c0 0x7fe6f01fc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.594+0000 7fe6f6279640 1 --2- 172.21.15.88:0/3661556702 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6f00a8040 0x7fe6f01fbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.594+0000 7fe6f6279640 1 --2- 172.21.15.88:0/3661556702 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6f00a5050 0x7fe6f01fcd50 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe6e800ba50 tx=0x7fe6e800bf10 comp rx=0 tx=0).stop 2023-12-08T08:20:27.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.594+0000 7fe6f6279640 1 -- 172.21.15.88:0/3661556702 >> 172.21.15.88:0/3661556702 conn(0x7fe6f00a7520 msgr2=0x7fe6f014e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:27.600 INFO:teuthology.orchestra.run.smithi088.stdout:55834574852 2023-12-08T08:20:27.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.594+0000 7f59c0ff9640 1 -- 172.21.15.88:0/1930181378 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f59c40ce520 con 0x7f59bc0db090 2023-12-08T08:20:27.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.594+0000 7fe6f6279640 1 -- 172.21.15.88:0/3661556702 shutdown_connections 2023-12-08T08:20:27.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.594+0000 7fe6f6279640 1 -- 172.21.15.88:0/3661556702 wait complete. 2023-12-08T08:20:27.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.594+0000 7f59ae7fc640 1 -- 172.21.15.88:0/1930181378 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f59a8066540 msgr2=0x7f59a8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.594+0000 7f59ae7fc640 1 --2- 172.21.15.88:0/1930181378 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f59a8066540 0x7f59a8068a00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f59b8005890 tx=0x7f59b8009040 comp rx=0 tx=0).stop 2023-12-08T08:20:27.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.594+0000 7f59ae7fc640 1 -- 172.21.15.88:0/1930181378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59bc0db090 msgr2=0x7f59bc0dcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.594+0000 7f59ae7fc640 1 --2- 172.21.15.88:0/1930181378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59bc0db090 0x7f59bc0dcfe0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f59c4050190 tx=0x7f59c4074900 comp rx=0 tx=0).stop 2023-12-08T08:20:27.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.598+0000 7f59ae7fc640 1 -- 172.21.15.88:0/1930181378 shutdown_connections 2023-12-08T08:20:27.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.598+0000 7f59ae7fc640 1 --2- 172.21.15.88:0/1930181378 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f59a8066540 0x7f59a8068a00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.598+0000 7f59ae7fc640 1 --2- 172.21.15.88:0/1930181378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59bc0db090 0x7f59bc0dcfe0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.598+0000 7f59ae7fc640 1 --2- 172.21.15.88:0/1930181378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59bc046390 0x7f59bc0dcaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.598+0000 7f59ae7fc640 1 --2- 172.21.15.88:0/1930181378 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f59bc02ae70 0x7f59bc044e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.598+0000 7f59ae7fc640 1 -- 172.21.15.88:0/1930181378 >> 172.21.15.88:0/1930181378 conn(0x7f59bc005e70 msgr2=0x7f59bc0d4420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:27.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.598+0000 7f59ae7fc640 1 -- 172.21.15.88:0/1930181378 shutdown_connections 2023-12-08T08:20:27.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.598+0000 7f59ae7fc640 1 -- 172.21.15.88:0/1930181378 wait complete. 2023-12-08T08:20:27.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.606+0000 7f080a7e4640 1 -- 172.21.15.88:0/4253697222 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f08040c7320 con 0x7f08040c6680 2023-12-08T08:20:27.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.610+0000 7f07f9ffb640 1 -- 172.21.15.88:0/4253697222 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f07fc0547f0 con 0x7f08040c6680 2023-12-08T08:20:27.613 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2023-12-08T08:20:27.617 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-12-08T08:20:27.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.614+0000 7f080a7e4640 1 -- 172.21.15.88:0/4253697222 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f07e8066540 msgr2=0x7f07e8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.614+0000 7f080a7e4640 1 --2- 172.21.15.88:0/4253697222 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f07e8066540 0x7f07e8068a00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f07f40097f0 tx=0x7f07f40a6000 comp rx=0 tx=0).stop 2023-12-08T08:20:27.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.614+0000 7f080a7e4640 1 -- 172.21.15.88:0/4253697222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08040c6680 msgr2=0x7f08041efd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.614+0000 7f080a7e4640 1 --2- 172.21.15.88:0/4253697222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08040c6680 0x7f08041efd60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f07fc00cbc0 tx=0x7f07fc00a060 comp rx=0 tx=0).stop 2023-12-08T08:20:27.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.614+0000 7f080a7e4640 1 -- 172.21.15.88:0/4253697222 shutdown_connections 2023-12-08T08:20:27.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.614+0000 7f080a7e4640 1 --2- 172.21.15.88:0/4253697222 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f07e8066540 0x7f07e8068a00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.614+0000 7f080a7e4640 1 --2- 172.21.15.88:0/4253697222 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0804154f00 0x7f0804143c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.614+0000 7f080a7e4640 1 --2- 172.21.15.88:0/4253697222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08041519f0 0x7f08040c1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.614+0000 7f080a7e4640 1 --2- 172.21.15.88:0/4253697222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08040c6680 0x7f08041efd60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.614+0000 7f080a7e4640 1 -- 172.21.15.88:0/4253697222 >> 172.21.15.88:0/4253697222 conn(0x7f08040ab9d0 msgr2=0x7f0804153cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:27.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.614+0000 7f080a7e4640 1 -- 172.21.15.88:0/4253697222 shutdown_connections 2023-12-08T08:20:27.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.614+0000 7f080a7e4640 1 -- 172.21.15.88:0/4253697222 wait complete. 2023-12-08T08:20:27.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.618+0000 7f1e714ea640 1 -- 172.21.15.88:0/1759281205 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1e6c06ad00 con 0x7f1e6c151ae0 2023-12-08T08:20:27.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-12-08T08:20:27.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.618+0000 7f1e537fe640 1 -- 172.21.15.88:0/1759281205 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1e60055020 con 0x7f1e6c151ae0 2023-12-08T08:20:27.623 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2023-12-08T08:20:27.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.622+0000 7f1e714ea640 1 -- 172.21.15.88:0/1759281205 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1e58066470 msgr2=0x7f1e58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.622+0000 7f1e714ea640 1 --2- 172.21.15.88:0/1759281205 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1e58066470 0x7f1e58068930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c0af000 tx=0x7f1e5c0a7000 comp rx=0 tx=0).stop 2023-12-08T08:20:27.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.622+0000 7f1e714ea640 1 -- 172.21.15.88:0/1759281205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e6c151ae0 msgr2=0x7f1e6c0c3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.622+0000 7f1e714ea640 1 --2- 172.21.15.88:0/1759281205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e6c151ae0 0x7f1e6c0c3860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1e6000e930 tx=0x7f1e6000edf0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.622+0000 7f1e714ea640 1 -- 172.21.15.88:0/1759281205 shutdown_connections 2023-12-08T08:20:27.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.622+0000 7f1e714ea640 1 --2- 172.21.15.88:0/1759281205 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1e58066470 0x7f1e58068930 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.622+0000 7f1e714ea640 1 --2- 172.21.15.88:0/1759281205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e6c151ae0 0x7f1e6c0c3860 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.622+0000 7f1e714ea640 1 --2- 172.21.15.88:0/1759281205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e6c0c8000 0x7f1e6c0c3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.622+0000 7f1e714ea640 1 --2- 172.21.15.88:0/1759281205 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e6c0c5520 0x7f1e6c0c1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.622+0000 7f1e714ea640 1 -- 172.21.15.88:0/1759281205 >> 172.21.15.88:0/1759281205 conn(0x7f1e6c0ca000 msgr2=0x7f1e6c0bf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:27.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.622+0000 7f1e714ea640 1 -- 172.21.15.88:0/1759281205 shutdown_connections 2023-12-08T08:20:27.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.622+0000 7f1e714ea640 1 -- 172.21.15.88:0/1759281205 wait complete. 2023-12-08T08:20:27.634 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2023-12-08T08:20:27.640 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-12-08T08:20:27.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-12-08T08:20:27.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.650+0000 7f05c94f5640 1 -- 172.21.15.88:0/3626244717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f05c40674b0 con 0x7f05c41519f0 2023-12-08T08:20:27.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.650+0000 7f05c0ff9640 1 -- 172.21.15.88:0/3626244717 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f05b8054780 con 0x7f05c41519f0 2023-12-08T08:20:27.656 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2023-12-08T08:20:27.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.654+0000 7f05c94f5640 1 -- 172.21.15.88:0/3626244717 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f05b00664a0 msgr2=0x7f05b0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.654+0000 7f05c94f5640 1 --2- 172.21.15.88:0/3626244717 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f05b00664a0 0x7f05b0068960 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0af000 tx=0x7f05bc0a7070 comp rx=0 tx=0).stop 2023-12-08T08:20:27.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.654+0000 7f05c94f5640 1 -- 172.21.15.88:0/3626244717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05c41519f0 msgr2=0x7f05c4144ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.654+0000 7f05c94f5640 1 --2- 172.21.15.88:0/3626244717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05c41519f0 0x7f05c4144ad0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f05b800e880 tx=0x7f05b800ed40 comp rx=0 tx=0).stop 2023-12-08T08:20:27.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.654+0000 7f05c94f5640 1 -- 172.21.15.88:0/3626244717 shutdown_connections 2023-12-08T08:20:27.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.654+0000 7f05c94f5640 1 --2- 172.21.15.88:0/3626244717 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f05b00664a0 0x7f05b0068960 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.654+0000 7f05c94f5640 1 --2- 172.21.15.88:0/3626244717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05c41519f0 0x7f05c4144ad0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.654+0000 7f05c94f5640 1 --2- 172.21.15.88:0/3626244717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05c40c5f60 0x7f05c4144590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.654+0000 7f05c94f5640 1 --2- 172.21.15.88:0/3626244717 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f05c40c3ac0 0x7f05c4156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.654+0000 7f05c94f5640 1 -- 172.21.15.88:0/3626244717 >> 172.21.15.88:0/3626244717 conn(0x7f05c40c2270 msgr2=0x7f05c4150040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:27.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.654+0000 7f05c94f5640 1 -- 172.21.15.88:0/3626244717 shutdown_connections 2023-12-08T08:20:27.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.654+0000 7f05c94f5640 1 -- 172.21.15.88:0/3626244717 wait complete. 2023-12-08T08:20:27.660 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-12-08T08:20:27.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.658+0000 7f137359e640 1 -- 172.21.15.88:0/3270936766 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f13580057e0 con 0x7f13740c0b80 2023-12-08T08:20:27.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.662+0000 7f1362ffd640 1 -- 172.21.15.88:0/3270936766 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f136401d070 con 0x7f13740c0b80 2023-12-08T08:20:27.665 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2023-12-08T08:20:27.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.662+0000 7f137359e640 1 -- 172.21.15.88:0/3270936766 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f13540664c0 msgr2=0x7f1354068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.662+0000 7f137359e640 1 --2- 172.21.15.88:0/3270936766 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f13540664c0 0x7f1354068980 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f136c0b2000 tx=0x7f136c0a9070 comp rx=0 tx=0).stop 2023-12-08T08:20:27.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.662+0000 7f137359e640 1 -- 172.21.15.88:0/3270936766 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13740c0b80 msgr2=0x7f13741e80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.662+0000 7f137359e640 1 --2- 172.21.15.88:0/3270936766 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13740c0b80 0x7f13741e80f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f136400c8e0 tx=0x7f136400cda0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.662+0000 7f137359e640 1 -- 172.21.15.88:0/3270936766 shutdown_connections 2023-12-08T08:20:27.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.662+0000 7f137359e640 1 --2- 172.21.15.88:0/3270936766 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f13540664c0 0x7f1354068980 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.662+0000 7f137359e640 1 --2- 172.21.15.88:0/3270936766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1374154090 0x7f13741fc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.662+0000 7f137359e640 1 --2- 172.21.15.88:0/3270936766 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1374150fe0 0x7f13741fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.662+0000 7f137359e640 1 --2- 172.21.15.88:0/3270936766 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13740c0b80 0x7f13741e80f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.662+0000 7f137359e640 1 -- 172.21.15.88:0/3270936766 >> 172.21.15.88:0/3270936766 conn(0x7f13740c2270 msgr2=0x7f13740c4840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:27.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.662+0000 7f137359e640 1 -- 172.21.15.88:0/3270936766 shutdown_connections 2023-12-08T08:20:27.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:27.662+0000 7f137359e640 1 -- 172.21.15.88:0/3270936766 wait complete. 2023-12-08T08:20:27.679 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2023-12-08T08:20:27.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-12-08T08:20:28.619 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-08T08:20:28.624 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-08T08:20:28.635 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-08T08:20:28.641 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-08T08:20:28.646 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-08T08:20:28.661 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-08T08:20:28.680 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-08T08:20:28.688 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-08T08:20:28.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.806+0000 7fd8c8757640 1 Processor -- start 2023-12-08T08:20:28.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.806+0000 7fd8c8757640 1 -- start start 2023-12-08T08:20:28.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.810+0000 7fd8c8757640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd8c00a5050 0x7fd8c0150320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.810+0000 7fd8c8757640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd8c006bb40 0x7fd8c00c16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.810+0000 7fd8c8757640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c00c36d0 con 0x7fd8c014daa0 2023-12-08T08:20:28.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.810+0000 7fd8c8757640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c00c3920 con 0x7fd8c006bb40 2023-12-08T08:20:28.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.810+0000 7fd8c8757640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c00c3c00 con 0x7fd8c00a5050 2023-12-08T08:20:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.810+0000 7fd8c64f3640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd8c014daa0 0x7fd8c00c49c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:32920/0 (socket says 172.21.15.88:32920) 2023-12-08T08:20:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.810+0000 7fd8c64f3640 1 -- 172.21.15.88:0/2439717609 learned_addr learned my addr 172.21.15.88:0/2439717609 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.810+0000 7fd8c54f1640 1 -- 172.21.15.88:0/2439717609 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2339994367 0 0) 0x7fd8c00c36d0 con 0x7fd8c014daa0 2023-12-08T08:20:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.810+0000 7fd8c54f1640 1 -- 172.21.15.88:0/2439717609 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8ac003510 con 0x7fd8c014daa0 2023-12-08T08:20:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.810+0000 7fd8c54f1640 1 -- 172.21.15.88:0/2439717609 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2252588241 0 0) 0x7fd8ac003510 con 0x7fd8c014daa0 2023-12-08T08:20:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.810+0000 7fd8c54f1640 1 -- 172.21.15.88:0/2439717609 >> v2:172.21.15.148:3300/0 conn(0x7fd8c00a5050 msgr2=0x7fd8c0150320 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-08T08:20:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.810+0000 7fd8c54f1640 1 --2- 172.21.15.88:0/2439717609 >> v2:172.21.15.148:3300/0 conn(0x7fd8c00a5050 0x7fd8c0150320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.810+0000 7fd8c54f1640 1 -- 172.21.15.88:0/2439717609 >> v2:172.21.15.88:3300/0 conn(0x7fd8c006bb40 msgr2=0x7fd8c00c16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.810+0000 7fd8c54f1640 1 --2- 172.21.15.88:0/2439717609 >> v2:172.21.15.88:3300/0 conn(0x7fd8c006bb40 0x7fd8c00c16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.810+0000 7fd8c54f1640 1 -- 172.21.15.88:0/2439717609 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c00c3ee0 con 0x7fd8c014daa0 2023-12-08T08:20:28.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.810+0000 7fd8c54f1640 1 -- 172.21.15.88:0/2439717609 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7fd8bc004cc0 con 0x7fd8c014daa0 2023-12-08T08:20:28.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.814+0000 7fd8c54f1640 1 -- 172.21.15.88:0/2439717609 >> v1:172.21.15.88:6789/0 conn(0x7fd8c014daa0 legacy=0x7fd8c00c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.814+0000 7fd8c54f1640 1 --2- 172.21.15.88:0/2439717609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8ac003b90 0x7fd8ac003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.814+0000 7fd8c54f1640 1 --2- 172.21.15.88:0/2439717609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8ac0068d0 0x7fd8ac008d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.814+0000 7fd8c54f1640 1 --2- 172.21.15.88:0/2439717609 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8ac009600 0x7fd8ac009a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.814+0000 7fd8c54f1640 1 -- 172.21.15.88:0/2439717609 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c00c3920 con 0x7fd8ac0068d0 2023-12-08T08:20:28.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.814+0000 7fd8c54f1640 1 -- 172.21.15.88:0/2439717609 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c00c3c00 con 0x7fd8ac003b90 2023-12-08T08:20:28.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.814+0000 7fd8c54f1640 1 -- 172.21.15.88:0/2439717609 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac00a3e0 con 0x7fd8ac009600 2023-12-08T08:20:28.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.814+0000 7fd8c64f3640 1 --2- 172.21.15.88:0/2439717609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8ac003b90 0x7fd8ac003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.814+0000 7fd8c6cf4640 1 --2- 172.21.15.88:0/2439717609 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8ac009600 0x7fd8ac009a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.814+0000 7fd8c5cf2640 1 --2- 172.21.15.88:0/2439717609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8ac0068d0 0x7fd8ac008d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.814+0000 7fd8c64f3640 1 -- 172.21.15.88:0/2439717609 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8ac009600 msgr2=0x7fd8ac009a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:28.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.814+0000 7fd8c64f3640 1 --2- 172.21.15.88:0/2439717609 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8ac009600 0x7fd8ac009a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.814+0000 7fd8c64f3640 1 -- 172.21.15.88:0/2439717609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8ac0068d0 msgr2=0x7fd8ac008d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:28.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.814+0000 7fd8c64f3640 1 --2- 172.21.15.88:0/2439717609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8ac0068d0 0x7fd8ac008d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.814+0000 7fd8c64f3640 1 -- 172.21.15.88:0/2439717609 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ac00a660 con 0x7fd8ac003b90 2023-12-08T08:20:28.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.814+0000 7fd8c6cf4640 1 -- 172.21.15.88:0/2439717609 reap_dead start 2023-12-08T08:20:28.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.814+0000 7fd8c5cf2640 1 --2- 172.21.15.88:0/2439717609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8ac0068d0 0x7fd8ac008d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:28.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.822+0000 7fd8c64f3640 1 --2- 172.21.15.88:0/2439717609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8ac003b90 0x7fd8ac003fd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc001e80 tx=0x7fd8bc01d1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6ff485d87d69305 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:28.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.822+0000 7fd8c54f1640 1 -- 172.21.15.88:0/2439717609 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc0ac620 con 0x7fd8ac003b90 2023-12-08T08:20:28.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.822+0000 7fd8c54f1640 1 -- 172.21.15.88:0/2439717609 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8bc0a8070 con 0x7fd8ac003b90 2023-12-08T08:20:28.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.822+0000 7fd8c8757640 1 -- 172.21.15.88:0/2439717609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8ac003b90 msgr2=0x7fd8ac003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.822+0000 7fd8c8757640 1 --2- 172.21.15.88:0/2439717609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8ac003b90 0x7fd8ac003fd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc001e80 tx=0x7fd8bc01d1e0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.822+0000 7fd8c8757640 1 -- 172.21.15.88:0/2439717609 shutdown_connections 2023-12-08T08:20:28.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.822+0000 7fd8c8757640 1 --2- 172.21.15.88:0/2439717609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8ac003b90 0x7fd8ac003fd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.822+0000 7fd8c8757640 1 -- 172.21.15.88:0/2439717609 >> 172.21.15.88:0/2439717609 conn(0x7fd8c00a7520 msgr2=0x7fd8c00a7930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:28.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.822+0000 7fd8c8757640 1 -- 172.21.15.88:0/2439717609 shutdown_connections 2023-12-08T08:20:28.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.830+0000 7fd8c8757640 1 -- 172.21.15.88:0/2439717609 wait complete. 2023-12-08T08:20:28.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.830+0000 7fd8c8757640 1 Processor -- start 2023-12-08T08:20:28.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.830+0000 7fd8c8757640 1 -- start start 2023-12-08T08:20:28.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.834+0000 7fd8c8757640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8ac003b90 0x7fd8c0070ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.834+0000 7fd8c8757640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c0071880 0x7fd8c006fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.834+0000 7fd8c8757640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8c01e05e0 0x7fd8c0144940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.834+0000 7fd8c8757640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c0071da0 con 0x7fd8c0071880 2023-12-08T08:20:28.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.834+0000 7fd8c8757640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c0072080 con 0x7fd8ac003b90 2023-12-08T08:20:28.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.834+0000 7fd8c8757640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c0072360 con 0x7fd8c01e05e0 2023-12-08T08:20:28.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.834+0000 7fd8c6cf4640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8c01e05e0 0x7fd8c0144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.834+0000 7fd8c6cf4640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8c01e05e0 0x7fd8c0144940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:55898/0 (socket says 172.21.15.88:55898) 2023-12-08T08:20:28.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.834+0000 7fd8c6cf4640 1 -- 172.21.15.88:0/3654335461 learned_addr learned my addr 172.21.15.88:0/3654335461 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:28.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.834+0000 7fd8c64f3640 1 --2- 172.21.15.88:0/3654335461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8ac003b90 0x7fd8c0070ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.834+0000 7fd8c6cf4640 1 -- 172.21.15.88:0/3654335461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8ac003b90 msgr2=0x7fd8c0070ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.834+0000 7fd8c6cf4640 1 --2- 172.21.15.88:0/3654335461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8ac003b90 0x7fd8c0070ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.834+0000 7fd8c6cf4640 1 -- 172.21.15.88:0/3654335461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c0071880 msgr2=0x7fd8c006fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.834+0000 7fd8c6cf4640 1 --2- 172.21.15.88:0/3654335461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c0071880 0x7fd8c006fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.834+0000 7fd8c6cf4640 1 -- 172.21.15.88:0/3654335461 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c0072640 con 0x7fd8c01e05e0 2023-12-08T08:20:28.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.834+0000 7fd8c6cf4640 1 --2- 172.21.15.88:0/3654335461 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8c01e05e0 0x7fd8c0144940 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0006fd0 tx=0x7fd8b000d8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:28.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.838+0000 7fd8b6ffd640 1 -- 172.21.15.88:0/3654335461 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b0004240 con 0x7fd8c01e05e0 2023-12-08T08:20:28.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.838+0000 7fd8b6ffd640 1 -- 172.21.15.88:0/3654335461 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b00043a0 con 0x7fd8c01e05e0 2023-12-08T08:20:28.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.838+0000 7fd8b6ffd640 1 -- 172.21.15.88:0/3654335461 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b0003840 con 0x7fd8c01e05e0 2023-12-08T08:20:28.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.838+0000 7fd8c8757640 1 -- 172.21.15.88:0/3654335461 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c00701f0 con 0x7fd8c01e05e0 2023-12-08T08:20:28.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.838+0000 7fd8c8757640 1 -- 172.21.15.88:0/3654335461 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c0145050 con 0x7fd8c01e05e0 2023-12-08T08:20:28.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.838+0000 7fd8c8757640 1 -- 172.21.15.88:0/3654335461 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c00674b0 con 0x7fd8c01e05e0 2023-12-08T08:20:28.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.842+0000 7fd8b6ffd640 1 -- 172.21.15.88:0/3654335461 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd8b00039a0 con 0x7fd8c01e05e0 2023-12-08T08:20:28.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.842+0000 7fd8b6ffd640 1 --2- 172.21.15.88:0/3654335461 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd8a4066570 0x7fd8a4068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.842+0000 7fd8c64f3640 1 --2- 172.21.15.88:0/3654335461 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd8a4066570 0x7fd8a4068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.842+0000 7fd8b6ffd640 1 -- 172.21.15.88:0/3654335461 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8b0083bc0 con 0x7fd8c01e05e0 2023-12-08T08:20:28.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.842+0000 7fd8c64f3640 1 --2- 172.21.15.88:0/3654335461 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd8a4066570 0x7fd8a4068a30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc0ae000 tx=0x7fd8bc001220 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:28.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.846+0000 7fd8b6ffd640 1 -- 172.21.15.88:0/3654335461 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd8b00510b0 con 0x7fd8c01e05e0 2023-12-08T08:20:28.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.898+0000 7eff0e65a640 1 Processor -- start 2023-12-08T08:20:28.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.898+0000 7eff0e65a640 1 -- start start 2023-12-08T08:20:28.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.902+0000 7ff9e2679640 1 Processor -- start 2023-12-08T08:20:28.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.902+0000 7ff9e2679640 1 -- start start 2023-12-08T08:20:28.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.902+0000 7eff0e65a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7eff000d4330 0x7eff00007190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.902+0000 7eff0e65a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff000076d0 0x7eff0000ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.902+0000 7eff0e65a640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0000e140 con 0x7eff0004dac0 2023-12-08T08:20:28.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.902+0000 7eff0e65a640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff000db300 con 0x7eff000d4330 2023-12-08T08:20:28.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.902+0000 7eff0e65a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0004a6c0 con 0x7eff000076d0 2023-12-08T08:20:28.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.902+0000 7eff07fff640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7eff000d4330 0x7eff00007190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.902+0000 7eff07fff640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7eff000d4330 0x7eff00007190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:45514/0 (socket says 172.21.15.88:45514) 2023-12-08T08:20:28.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.902+0000 7eff07fff640 1 -- 172.21.15.88:0/1208248792 learned_addr learned my addr 172.21.15.88:0/1208248792 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:28.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.902+0000 7eff0cbf7640 1 --2- 172.21.15.88:0/1208248792 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff000076d0 0x7eff0000ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.902+0000 7ff9e2679640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9d400b0b0 0x7ff9d4031290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.902+0000 7ff9e2679640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d40071f0 con 0x7ff9d403e9e0 2023-12-08T08:20:28.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.902+0000 7ff9e2679640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d4030fb0 con 0x7ff9d40de9b0 2023-12-08T08:20:28.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.902+0000 7ff9e2679640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d4046990 con 0x7ff9d400b0b0 2023-12-08T08:20:28.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.902+0000 7ff9dbfff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff9d403e9e0 0x7ff9d404ac20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:32930/0 (socket says 172.21.15.88:32930) 2023-12-08T08:20:28.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.902+0000 7ff9dbfff640 1 -- 172.21.15.88:0/4189687955 learned_addr learned my addr 172.21.15.88:0/4189687955 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:28.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.902+0000 7ff9db7fe640 1 --2- 172.21.15.88:0/4189687955 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9d400b0b0 0x7ff9d4031290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.902+0000 7eff07fff640 1 -- 172.21.15.88:0/1208248792 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff000076d0 msgr2=0x7eff0000ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:28.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.902+0000 7eff07fff640 1 --2- 172.21.15.88:0/1208248792 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff000076d0 0x7eff0000ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.902+0000 7eff07fff640 1 -- 172.21.15.88:0/1208248792 >> v1:172.21.15.148:6789/0 conn(0x7eff0004dac0 legacy=0x7eff0000e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.902+0000 7eff07fff640 1 -- 172.21.15.88:0/1208248792 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0004a9a0 con 0x7eff000d4330 2023-12-08T08:20:28.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.902+0000 7fe8a552a640 1 Processor -- start 2023-12-08T08:20:28.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.902+0000 7fe8a552a640 1 -- start start 2023-12-08T08:20:28.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.906+0000 7ff9daffd640 1 -- 172.21.15.88:0/4189687955 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555574866 0 0) 0x7ff9d4030fb0 con 0x7ff9d40de9b0 2023-12-08T08:20:28.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.906+0000 7f12b769c640 1 Processor -- start 2023-12-08T08:20:28.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.906+0000 7ff9daffd640 1 -- 172.21.15.88:0/4189687955 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9cc003530 con 0x7ff9d40de9b0 2023-12-08T08:20:28.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.906+0000 7ff9daffd640 1 -- 172.21.15.88:0/4189687955 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2767761695 0 0) 0x7ff9d40071f0 con 0x7ff9d403e9e0 2023-12-08T08:20:28.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.906+0000 7ff9daffd640 1 -- 172.21.15.88:0/4189687955 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9d4030fb0 con 0x7ff9d403e9e0 2023-12-08T08:20:28.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.906+0000 7f12b769c640 1 -- start start 2023-12-08T08:20:28.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.906+0000 7fe8a552a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8a00a4f90 0x7fe8a00c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.906+0000 7fe8a552a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe8a00a5370 0x7fe8a014f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.906+0000 7fe8a552a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a01524b0 con 0x7fe8a0072810 2023-12-08T08:20:28.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.906+0000 7fe8a552a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a00c62f0 con 0x7fe8a00a5370 2023-12-08T08:20:28.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.906+0000 7fe8a552a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a0152770 con 0x7fe8a00a4f90 2023-12-08T08:20:28.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.906+0000 7f21b45d1640 1 Processor -- start 2023-12-08T08:20:28.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.906+0000 7f21b45d1640 1 -- start start 2023-12-08T08:20:28.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.906+0000 7fe89effd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8a00a4f90 0x7fe8a00c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.906+0000 7ff9db7fe640 1 -- 172.21.15.88:0/4189687955 >> v1:172.21.15.148:6789/0 conn(0x7ff9d40de9b0 legacy=0x7ff9d40dee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.906+0000 7ff9db7fe640 1 -- 172.21.15.88:0/4189687955 >> v1:172.21.15.88:6789/0 conn(0x7ff9d403e9e0 legacy=0x7ff9d404ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.906+0000 7ff9db7fe640 1 -- 172.21.15.88:0/4189687955 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d4006ba0 con 0x7ff9d400b0b0 2023-12-08T08:20:28.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.906+0000 7f12b769c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12b00c5f80 0x7f12b00c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7f12b769c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b00a55c0 con 0x7f12b014dce0 2023-12-08T08:20:28.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7f12b769c640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b01507d0 con 0x7f12b00a7ef0 2023-12-08T08:20:28.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7f12b769c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b01505c0 con 0x7f12b00c5f80 2023-12-08T08:20:28.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7f12b5c39640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f12b00a7ef0 0x7f12b00c3f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:33984/0 (socket says 172.21.15.88:33984) 2023-12-08T08:20:28.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7f12b5c39640 1 -- 172.21.15.88:0/3002777543 learned_addr learned my addr 172.21.15.88:0/3002777543 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:28.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7f12b4c37640 1 --2- 172.21.15.88:0/3002777543 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12b00c5f80 0x7f12b00c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7f12affff640 1 -- 172.21.15.88:0/3002777543 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321736652 0 0) 0x7f12b01507d0 con 0x7f12b00a7ef0 2023-12-08T08:20:28.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7f12affff640 1 -- 172.21.15.88:0/3002777543 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1298003530 con 0x7f12b00a7ef0 2023-12-08T08:20:28.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7eff07fff640 1 --2- 172.21.15.88:0/1208248792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff000d4330 0x7eff00007190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7eff08062150 tx=0x7eff08096940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d4e8c9fcaaaf660 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:28.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7fe89f7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe8a0072810 0x7fe8a00c0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:32940/0 (socket says 172.21.15.88:32940) 2023-12-08T08:20:28.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7fe89f7fe640 1 -- 172.21.15.88:0/719693521 learned_addr learned my addr 172.21.15.88:0/719693521 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:28.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7fe89dffb640 1 -- 172.21.15.88:0/719693521 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3360278087 0 0) 0x7fe8a01524b0 con 0x7fe8a0072810 2023-12-08T08:20:28.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7fe89dffb640 1 -- 172.21.15.88:0/719693521 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe888003530 con 0x7fe8a0072810 2023-12-08T08:20:28.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7fe89e7fc640 1 --2- 172.21.15.88:0/719693521 >> v2:172.21.15.88:3300/0 conn(0x7fe8a00a5370 0x7fe8a014f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7fe89effd640 1 -- 172.21.15.88:0/719693521 >> v2:172.21.15.88:3300/0 conn(0x7fe8a00a5370 msgr2=0x7fe8a014f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:28.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7fe89effd640 1 --2- 172.21.15.88:0/719693521 >> v2:172.21.15.88:3300/0 conn(0x7fe8a00a5370 0x7fe8a014f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7fe89effd640 1 -- 172.21.15.88:0/719693521 >> v1:172.21.15.88:6789/0 conn(0x7fe8a0072810 legacy=0x7fe8a00c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7fe89effd640 1 -- 172.21.15.88:0/719693521 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a0152a50 con 0x7fe8a00a4f90 2023-12-08T08:20:28.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7fe89e7fc640 1 --2- 172.21.15.88:0/719693521 >> v2:172.21.15.88:3300/0 conn(0x7fe8a00a5370 0x7fe8a014f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:28.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7f21b45d1640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f21ac0c5950 0x7f21ac159530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7ff9db7fe640 1 --2- 172.21.15.88:0/4189687955 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9d400b0b0 0x7ff9d4031290 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc0643d0 tx=0x7ff9dc0969a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb4f1bd6201f9cd4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:28.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7ff9daffd640 1 -- 172.21.15.88:0/4189687955 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc1226e0 con 0x7ff9d400b0b0 2023-12-08T08:20:28.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7f21b236d640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f21ac156120 0x7f21ac0c0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:33990/0 (socket says 172.21.15.88:33990) 2023-12-08T08:20:28.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7f21b1b6c640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f21ac0c5950 0x7f21ac159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7f21b1b6c640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f21ac0c5950 0x7f21ac159530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:45530/0 (socket says 172.21.15.88:45530) 2023-12-08T08:20:28.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7ff9daffd640 1 -- 172.21.15.88:0/4189687955 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9dc122840 con 0x7ff9d400b0b0 2023-12-08T08:20:28.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7ff9daffd640 1 -- 172.21.15.88:0/4189687955 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc1226e0 con 0x7ff9d400b0b0 2023-12-08T08:20:28.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7f21b236d640 1 -- 172.21.15.88:0/2918360642 learned_addr learned my addr 172.21.15.88:0/2918360642 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:28.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7f21b45d1640 1 -- 172.21.15.88:0/2918360642 --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21ac159a70 con 0x7f21ac0c1b20 2023-12-08T08:20:28.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7f21b45d1640 1 -- 172.21.15.88:0/2918360642 --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21ac1590a0 con 0x7f21ac156120 2023-12-08T08:20:28.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7f21b45d1640 1 -- 172.21.15.88:0/2918360642 --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21ac06c520 con 0x7f21ac0c5950 2023-12-08T08:20:28.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7f21b136b640 1 -- 172.21.15.88:0/2918360642 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3220967129 0 0) 0x7f21ac1590a0 con 0x7f21ac156120 2023-12-08T08:20:28.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7ff9e2679640 1 -- 172.21.15.88:0/4189687955 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9d400b0b0 msgr2=0x7ff9d4031290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7ff9e2679640 1 --2- 172.21.15.88:0/4189687955 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9d400b0b0 0x7ff9d4031290 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc0643d0 tx=0x7ff9dc0969a0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7f21b136b640 1 -- 172.21.15.88:0/2918360642 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2198003530 con 0x7f21ac156120 2023-12-08T08:20:28.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7f21b136b640 1 -- 172.21.15.88:0/2918360642 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2420886541 0 0) 0x7f21a40014a0 con 0x7f21ac0c1b20 2023-12-08T08:20:28.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7f21b136b640 1 -- 172.21.15.88:0/2918360642 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21ac1590a0 con 0x7f21ac0c1b20 2023-12-08T08:20:28.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.914+0000 7ff9e2679640 1 -- 172.21.15.88:0/4189687955 shutdown_connections 2023-12-08T08:20:28.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.914+0000 7ff9e2679640 1 --2- 172.21.15.88:0/4189687955 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9d400b0b0 0x7ff9d4031290 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.914+0000 7ff9e2679640 1 -- 172.21.15.88:0/4189687955 >> 172.21.15.88:0/4189687955 conn(0x7ff9d4005e70 msgr2=0x7ff9d4006280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:28.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7f12b4c37640 1 -- 172.21.15.88:0/3002777543 >> v1:172.21.15.148:6789/0 conn(0x7f12b00a7ef0 legacy=0x7f12b00c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7f12b4c37640 1 -- 172.21.15.88:0/3002777543 >> v1:172.21.15.88:6789/0 conn(0x7f12b014dce0 legacy=0x7f12b006ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:28.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7f12b4c37640 1 -- 172.21.15.88:0/3002777543 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b0150ab0 con 0x7f12b00c5f80 2023-12-08T08:20:28.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.910+0000 7eff06ffd640 1 -- 172.21.15.88:0/1208248792 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff081226c0 con 0x7eff000d4330 2023-12-08T08:20:28.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.914+0000 7eff06ffd640 1 -- 172.21.15.88:0/1208248792 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff08122820 con 0x7eff000d4330 2023-12-08T08:20:28.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.914+0000 7eff06ffd640 1 -- 172.21.15.88:0/1208248792 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff08122bf0 con 0x7eff000d4330 2023-12-08T08:20:28.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.914+0000 7f21b1b6c640 1 -- 172.21.15.88:0/2918360642 >> v1:172.21.15.148:6789/0 conn(0x7f21ac156120 legacy=0x7f21ac0c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.914+0000 7f21b136b640 1 -- 172.21.15.88:0/2918360642 <== mon.1 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1425684830 0 0) 0x7f2198003530 con 0x7f21ac156120 2023-12-08T08:20:28.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.914+0000 7f21b1b6c640 1 -- 172.21.15.88:0/2918360642 >> v1:172.21.15.88:6789/0 conn(0x7f21ac0c1b20 legacy=0x7f21ac1633d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.914+0000 7ff9e2679640 1 -- 172.21.15.88:0/4189687955 shutdown_connections 2023-12-08T08:20:28.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.914+0000 7ff9e2679640 1 -- 172.21.15.88:0/4189687955 wait complete. 2023-12-08T08:20:28.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.914+0000 7f12b4c37640 1 --2- 172.21.15.88:0/3002777543 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12b00c5f80 0x7f12b00c3a30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f12a400f9e0 tx=0x7f12a40206e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5e6a4019a9af4b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:28.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.914+0000 7f12affff640 1 -- 172.21.15.88:0/3002777543 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a40aa6c0 con 0x7f12b00c5f80 2023-12-08T08:20:28.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.914+0000 7f12affff640 1 -- 172.21.15.88:0/3002777543 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a40aa820 con 0x7f12b00c5f80 2023-12-08T08:20:28.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.914+0000 7ff9e2679640 1 Processor -- start 2023-12-08T08:20:28.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.914+0000 7f12affff640 1 -- 172.21.15.88:0/3002777543 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a40aab90 con 0x7f12b00c5f80 2023-12-08T08:20:28.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.914+0000 7ff9e2679640 1 -- start start 2023-12-08T08:20:28.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.914+0000 7fe89effd640 1 --2- 172.21.15.88:0/719693521 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8a00a4f90 0x7fe8a00c59c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe8900097c0 tx=0x7fe890020800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6782dc73e2d1a87 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:28.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.914+0000 7f21b1b6c640 1 -- 172.21.15.88:0/2918360642 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ac156500 con 0x7f21ac0c5950 2023-12-08T08:20:28.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.914+0000 7f12b769c640 1 -- 172.21.15.88:0/3002777543 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12b00c5f80 msgr2=0x7f12b00c3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.914+0000 7f12b769c640 1 --2- 172.21.15.88:0/3002777543 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12b00c5f80 0x7f12b00c3a30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f12a400f9e0 tx=0x7f12a40206e0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7fe89dffb640 1 -- 172.21.15.88:0/719693521 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8900ac630 con 0x7fe8a00a4f90 2023-12-08T08:20:28.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7fe89dffb640 1 -- 172.21.15.88:0/719693521 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8900ac790 con 0x7fe8a00a4f90 2023-12-08T08:20:28.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7fe89dffb640 1 -- 172.21.15.88:0/719693521 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8900acb20 con 0x7fe8a00a4f90 2023-12-08T08:20:28.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7f12b769c640 1 -- 172.21.15.88:0/3002777543 shutdown_connections 2023-12-08T08:20:28.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7f12b769c640 1 --2- 172.21.15.88:0/3002777543 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12b00c5f80 0x7f12b00c3a30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7f12b769c640 1 -- 172.21.15.88:0/3002777543 >> 172.21.15.88:0/3002777543 conn(0x7f12b006ad70 msgr2=0x7f12b00a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:28.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7eff0e65a640 1 -- 172.21.15.88:0/1208248792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff000d4330 msgr2=0x7eff00007190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7eff0e65a640 1 --2- 172.21.15.88:0/1208248792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff000d4330 0x7eff00007190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7eff08062150 tx=0x7eff08096940 comp rx=0 tx=0).stop 2023-12-08T08:20:28.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7eff0e65a640 1 -- 172.21.15.88:0/1208248792 shutdown_connections 2023-12-08T08:20:28.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7eff0e65a640 1 --2- 172.21.15.88:0/1208248792 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff000076d0 0x7eff0000ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7eff0e65a640 1 --2- 172.21.15.88:0/1208248792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff000d4330 0x7eff00007190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7eff0e65a640 1 -- 172.21.15.88:0/1208248792 >> 172.21.15.88:0/1208248792 conn(0x7eff0004c640 msgr2=0x7eff0004ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:28.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7eff0e65a640 1 -- 172.21.15.88:0/1208248792 shutdown_connections 2023-12-08T08:20:28.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7eff0e65a640 1 -- 172.21.15.88:0/1208248792 wait complete. 2023-12-08T08:20:28.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7f12b769c640 1 -- 172.21.15.88:0/3002777543 shutdown_connections 2023-12-08T08:20:28.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7f12b769c640 1 -- 172.21.15.88:0/3002777543 wait complete. 2023-12-08T08:20:28.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7fe8a552a640 1 -- 172.21.15.88:0/719693521 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8a00a4f90 msgr2=0x7fe8a00c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7fe8a552a640 1 --2- 172.21.15.88:0/719693521 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8a00a4f90 0x7fe8a00c59c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe8900097c0 tx=0x7fe890020800 comp rx=0 tx=0).stop 2023-12-08T08:20:28.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7ff9e2679640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9d400b0b0 0x7ff9d40da070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7ff9e2679640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9d403e9e0 0x7ff9d40d57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7ff9e2679640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9d40de9b0 0x7ff9d40dbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7f21b1b6c640 1 --2- 172.21.15.88:0/2918360642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21ac0c5950 0x7f21ac159530 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f219c0097c0 tx=0x7f219c01c1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86e5ddfe9f0dbcfb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:28.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7fe8a552a640 1 -- 172.21.15.88:0/719693521 shutdown_connections 2023-12-08T08:20:28.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7fe8a552a640 1 --2- 172.21.15.88:0/719693521 >> v2:172.21.15.88:3300/0 conn(0x7fe8a00a5370 0x7fe8a014f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7fe8a552a640 1 --2- 172.21.15.88:0/719693521 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8a00a4f90 0x7fe8a00c59c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7fe8a552a640 1 -- 172.21.15.88:0/719693521 >> 172.21.15.88:0/719693521 conn(0x7fe8a006b220 msgr2=0x7fe8a00a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:28.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7ff9db7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9d403e9e0 0x7ff9d40d57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7ff9e0c16640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9d40de9b0 0x7ff9d40dbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7ff9e0c16640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9d40de9b0 0x7ff9d40dbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:45534/0 (socket says 172.21.15.88:45534) 2023-12-08T08:20:28.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7ff9e0c16640 1 -- 172.21.15.88:0/2734437759 learned_addr learned my addr 172.21.15.88:0/2734437759 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:28.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7fe8a552a640 1 -- 172.21.15.88:0/719693521 shutdown_connections 2023-12-08T08:20:28.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7fe8a552a640 1 -- 172.21.15.88:0/719693521 wait complete. 2023-12-08T08:20:28.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7f21b136b640 1 -- 172.21.15.88:0/2918360642 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a4001b10 con 0x7f21ac0c5950 2023-12-08T08:20:28.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7f21b136b640 1 -- 172.21.15.88:0/2918360642 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219c0a7050 con 0x7f21ac0c5950 2023-12-08T08:20:28.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7ff9e2679640 1 -- 172.21.15.88:0/2734437759 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d40da9c0 con 0x7ff9d403e9e0 2023-12-08T08:20:28.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7ff9e2679640 1 -- 172.21.15.88:0/2734437759 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d40d5330 con 0x7ff9d40de9b0 2023-12-08T08:20:28.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7ff9e2679640 1 -- 172.21.15.88:0/2734437759 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d4030c90 con 0x7ff9d400b0b0 2023-12-08T08:20:28.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7ff9dbfff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9d400b0b0 0x7ff9d40da070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7ff9e0c16640 1 -- 172.21.15.88:0/2734437759 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9d400b0b0 msgr2=0x7ff9d40da070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7ff9e0c16640 1 --2- 172.21.15.88:0/2734437759 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9d400b0b0 0x7ff9d40da070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7ff9e0c16640 1 -- 172.21.15.88:0/2734437759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9d403e9e0 msgr2=0x7ff9d40d57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7ff9e0c16640 1 --2- 172.21.15.88:0/2734437759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9d403e9e0 0x7ff9d40d57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7ff9e0c16640 1 -- 172.21.15.88:0/2734437759 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9dc04f7e0 con 0x7ff9d40de9b0 2023-12-08T08:20:28.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7ff9db7fe640 1 --2- 172.21.15.88:0/2734437759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9d403e9e0 0x7ff9d40d57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:28.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7ff9dbfff640 1 --2- 172.21.15.88:0/2734437759 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9d400b0b0 0x7ff9d40da070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:28.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7f12b769c640 1 Processor -- start 2023-12-08T08:20:28.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7ff9e0c16640 1 --2- 172.21.15.88:0/2734437759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9d40de9b0 0x7ff9d40dbda0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000c430 tx=0x7ff9d000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:28.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7f21b45d1640 1 -- 172.21.15.88:0/2918360642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21ac0c5950 msgr2=0x7f21ac159530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7f21b45d1640 1 --2- 172.21.15.88:0/2918360642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21ac0c5950 0x7f21ac159530 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f219c0097c0 tx=0x7f219c01c1c0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.918+0000 7eff0e65a640 1 Processor -- start 2023-12-08T08:20:28.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7f12b769c640 1 -- start start 2023-12-08T08:20:28.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7eff0e65a640 1 -- start start 2023-12-08T08:20:28.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7f21b45d1640 1 -- 172.21.15.88:0/2918360642 shutdown_connections 2023-12-08T08:20:28.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7f21b45d1640 1 --2- 172.21.15.88:0/2918360642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21ac0c5950 0x7f21ac159530 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7f21b45d1640 1 -- 172.21.15.88:0/2918360642 >> 172.21.15.88:0/2918360642 conn(0x7f21ac06ad70 msgr2=0x7f21ac0a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:28.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7fe8a552a640 1 Processor -- start 2023-12-08T08:20:28.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7f21b45d1640 1 -- 172.21.15.88:0/2918360642 shutdown_connections 2023-12-08T08:20:28.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7f21b45d1640 1 -- 172.21.15.88:0/2918360642 wait complete. 2023-12-08T08:20:28.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7fe8a552a640 1 -- start start 2023-12-08T08:20:28.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7eff0e65a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff000076d0 0x7eff000d2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7f12b769c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12b00a7ef0 0x7f12b014c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7f12b769c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12b00c5f80 0x7f12b00a21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7f12b769c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12b014dce0 0x7f12b00a2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7eff0e65a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff0004dac0 0x7eff000dbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7eff0e65a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff000d4330 0x7eff000dc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7eff0e65a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff000db6b0 con 0x7eff0004dac0 2023-12-08T08:20:28.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7eff0e65a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff000d4980 con 0x7eff000076d0 2023-12-08T08:20:28.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7eff0e65a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff00173180 con 0x7eff000d4330 2023-12-08T08:20:28.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7ff9d8ff9640 1 -- 172.21.15.88:0/2734437759 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d00052d0 con 0x7ff9d40de9b0 2023-12-08T08:20:28.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7ff9d8ff9640 1 -- 172.21.15.88:0/2734437759 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d0005430 con 0x7ff9d40de9b0 2023-12-08T08:20:28.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7ff9d8ff9640 1 -- 172.21.15.88:0/2734437759 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0003840 con 0x7ff9d40de9b0 2023-12-08T08:20:28.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7f12b5438640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12b00a7ef0 0x7f12b014c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7f12b4c37640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12b00c5f80 0x7f12b00a21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7f12b5438640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12b00a7ef0 0x7f12b014c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:45550/0 (socket says 172.21.15.88:45550) 2023-12-08T08:20:28.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7f12b4c37640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12b00c5f80 0x7f12b00a21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:55932/0 (socket says 172.21.15.88:55932) 2023-12-08T08:20:28.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7f12b5c39640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12b014dce0 0x7f12b00a2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7f12b5c39640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12b014dce0 0x7f12b00a2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40138/0 (socket says 172.21.15.88:40138) 2023-12-08T08:20:28.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7ff9e2679640 1 -- 172.21.15.88:0/2734437759 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d40309b0 con 0x7ff9d40de9b0 2023-12-08T08:20:28.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7eff077fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff0004dac0 0x7eff000dbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7eff077fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff0004dac0 0x7eff000dbb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40140/0 (socket says 172.21.15.88:40140) 2023-12-08T08:20:28.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7eff077fe640 1 -- 172.21.15.88:0/986255797 learned_addr learned my addr 172.21.15.88:0/986255797 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:28.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7eff0cbf7640 1 --2- 172.21.15.88:0/986255797 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff000d4330 0x7eff000dc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7ff9e2679640 1 -- 172.21.15.88:0/2734437759 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d40d4fc0 con 0x7ff9d40de9b0 2023-12-08T08:20:28.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7eff07fff640 1 --2- 172.21.15.88:0/986255797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff000076d0 0x7eff000d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7f12b5438640 1 -- 172.21.15.88:0/601404373 learned_addr learned my addr 172.21.15.88:0/601404373 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:28.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7f12b769c640 1 -- 172.21.15.88:0/601404373 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b015c3c0 con 0x7f12b014dce0 2023-12-08T08:20:28.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7f12b769c640 1 -- 172.21.15.88:0/601404373 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b014bc50 con 0x7f12b00a7ef0 2023-12-08T08:20:28.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.922+0000 7f12b769c640 1 -- 172.21.15.88:0/601404373 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b015c7e0 con 0x7f12b00c5f80 2023-12-08T08:20:28.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7f12b4c37640 1 -- 172.21.15.88:0/601404373 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12b00a7ef0 msgr2=0x7f12b014c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7f12b4c37640 1 --2- 172.21.15.88:0/601404373 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12b00a7ef0 0x7f12b014c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7f12b4c37640 1 -- 172.21.15.88:0/601404373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12b014dce0 msgr2=0x7f12b00a2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7f12b4c37640 1 --2- 172.21.15.88:0/601404373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12b014dce0 0x7f12b00a2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7f12b4c37640 1 -- 172.21.15.88:0/601404373 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a400f610 con 0x7f12b00c5f80 2023-12-08T08:20:28.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7eff07fff640 1 -- 172.21.15.88:0/986255797 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff000d4330 msgr2=0x7eff000dc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7eff07fff640 1 --2- 172.21.15.88:0/986255797 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff000d4330 0x7eff000dc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7eff07fff640 1 -- 172.21.15.88:0/986255797 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff0004dac0 msgr2=0x7eff000dbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7eff07fff640 1 --2- 172.21.15.88:0/986255797 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff0004dac0 0x7eff000dbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7eff07fff640 1 -- 172.21.15.88:0/986255797 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0804f7e0 con 0x7eff000076d0 2023-12-08T08:20:28.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7f12b4c37640 1 --2- 172.21.15.88:0/601404373 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12b00c5f80 0x7f12b00a21f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f12a40b0000 tx=0x7f12a401d480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:28.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7fe8a552a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8a0072810 0x7fe8a00bf900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7fe8a552a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8a00a4f90 0x7fe8a00c3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7eff07fff640 1 --2- 172.21.15.88:0/986255797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff000076d0 0x7eff000d2870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7eff08079830 tx=0x7eff080936e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:28.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7fe89effd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8a0072810 0x7fe8a00bf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7fe89effd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8a0072810 0x7fe8a00bf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:55960/0 (socket says 172.21.15.88:55960) 2023-12-08T08:20:28.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7eff04ff9640 1 -- 172.21.15.88:0/986255797 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff08122dd0 con 0x7eff000076d0 2023-12-08T08:20:28.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7eff04ff9640 1 -- 172.21.15.88:0/986255797 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0812a440 con 0x7eff000076d0 2023-12-08T08:20:28.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7eff04ff9640 1 -- 172.21.15.88:0/986255797 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0812a7b0 con 0x7eff000076d0 2023-12-08T08:20:28.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7f21b45d1640 1 Processor -- start 2023-12-08T08:20:28.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7eff0e65a640 1 -- 172.21.15.88:0/986255797 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff00173460 con 0x7eff000076d0 2023-12-08T08:20:28.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7eff0e65a640 1 -- 172.21.15.88:0/986255797 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff00173a20 con 0x7eff000076d0 2023-12-08T08:20:28.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7f21b45d1640 1 -- start start 2023-12-08T08:20:28.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7ff9d8ff9640 1 -- 172.21.15.88:0/2734437759 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff9d00039a0 con 0x7ff9d40de9b0 2023-12-08T08:20:28.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7eff0e65a640 1 -- 172.21.15.88:0/986255797 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff000057c0 con 0x7eff000076d0 2023-12-08T08:20:28.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7fe89e7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8a00a4f90 0x7fe8a00c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7fe89e7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8a00a4f90 0x7fe8a00c3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40144/0 (socket says 172.21.15.88:40144) 2023-12-08T08:20:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.926+0000 7ff9e2679640 1 -- 172.21.15.88:0/2734437759 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d40d5180 con 0x7ff9d40de9b0 2023-12-08T08:20:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7fe89effd640 1 -- 172.21.15.88:0/2803909858 learned_addr learned my addr 172.21.15.88:0/2803909858 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7f12adffb640 1 -- 172.21.15.88:0/601404373 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a40aab90 con 0x7f12b00c5f80 2023-12-08T08:20:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7f12adffb640 1 -- 172.21.15.88:0/601404373 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a400c050 con 0x7f12b00c5f80 2023-12-08T08:20:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7f12adffb640 1 -- 172.21.15.88:0/601404373 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4003620 con 0x7f12b00c5f80 2023-12-08T08:20:28.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7fe8a552a640 1 --2- 172.21.15.88:0/2803909858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8a00a5370 0x7fe8a0158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7f21b45d1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21ac0c1b20 0x7f21ac14d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7f21b45d1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21ac0c5950 0x7f21ac1f4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7fe8a552a640 1 -- 172.21.15.88:0/2803909858 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a015a7e0 con 0x7fe8a00a4f90 2023-12-08T08:20:28.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7fe8a552a640 1 -- 172.21.15.88:0/2803909858 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a01ec9a0 con 0x7fe8a00a5370 2023-12-08T08:20:28.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7f12b769c640 1 -- 172.21.15.88:0/601404373 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b01f5c10 con 0x7f12b00c5f80 2023-12-08T08:20:28.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7f12b769c640 1 -- 172.21.15.88:0/601404373 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b014ce50 con 0x7f12b00c5f80 2023-12-08T08:20:28.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7fe89f7fe640 1 --2- 172.21.15.88:0/2803909858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8a00a5370 0x7fe8a0158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7fe8a552a640 1 -- 172.21.15.88:0/2803909858 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a01580e0 con 0x7fe8a0072810 2023-12-08T08:20:28.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7ff9d8ff9640 1 --2- 172.21.15.88:0/2734437759 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff9c0066570 0x7ff9c0068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7ff9d8ff9640 1 -- 172.21.15.88:0/2734437759 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9d0083320 con 0x7ff9d40de9b0 2023-12-08T08:20:28.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7f21b45d1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21ac156120 0x7f21ac1f53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7f21b236d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21ac0c1b20 0x7f21ac14d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7f21b236d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21ac0c1b20 0x7f21ac14d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:45578/0 (socket says 172.21.15.88:45578) 2023-12-08T08:20:28.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7f21b236d640 1 -- 172.21.15.88:0/1912284289 learned_addr learned my addr 172.21.15.88:0/1912284289 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:28.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7f21b1b6c640 1 --2- 172.21.15.88:0/1912284289 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21ac0c5950 0x7f21ac1f4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7f21b45d1640 1 -- 172.21.15.88:0/1912284289 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac070880 con 0x7f21ac156120 2023-12-08T08:20:28.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7f21b45d1640 1 -- 172.21.15.88:0/1912284289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac154a90 con 0x7f21ac0c1b20 2023-12-08T08:20:28.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7f21b45d1640 1 -- 172.21.15.88:0/1912284289 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac1545f0 con 0x7f21ac0c5950 2023-12-08T08:20:28.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7eff04ff9640 1 -- 172.21.15.88:0/986255797 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7eff081203a0 con 0x7eff000076d0 2023-12-08T08:20:28.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7fe89f7fe640 1 -- 172.21.15.88:0/2803909858 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8a0072810 msgr2=0x7fe8a00bf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7fe89f7fe640 1 --2- 172.21.15.88:0/2803909858 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8a0072810 0x7fe8a00bf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7fe89f7fe640 1 -- 172.21.15.88:0/2803909858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8a00a4f90 msgr2=0x7fe8a00c3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7fe89f7fe640 1 --2- 172.21.15.88:0/2803909858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8a00a4f90 0x7fe8a00c3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7fe89f7fe640 1 -- 172.21.15.88:0/2803909858 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe890009420 con 0x7fe8a00a5370 2023-12-08T08:20:28.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7f21b1b6c640 1 -- 172.21.15.88:0/1912284289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21ac0c1b20 msgr2=0x7f21ac14d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7f21b1b6c640 1 --2- 172.21.15.88:0/1912284289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21ac0c1b20 0x7f21ac14d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7f21b1b6c640 1 -- 172.21.15.88:0/1912284289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21ac156120 msgr2=0x7f21ac1f53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7f21b1b6c640 1 --2- 172.21.15.88:0/1912284289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21ac156120 0x7f21ac1f53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7f21b1b6c640 1 -- 172.21.15.88:0/1912284289 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219c009420 con 0x7f21ac0c5950 2023-12-08T08:20:28.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7f21b1b6c640 1 --2- 172.21.15.88:0/1912284289 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21ac0c5950 0x7f21ac1f4e70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f219c0ab000 tx=0x7f219c018f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:28.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7ff9dbfff640 1 --2- 172.21.15.88:0/2734437759 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff9c0066570 0x7ff9c0068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7ff9dbfff640 1 --2- 172.21.15.88:0/2734437759 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff9c0066570 0x7ff9c0068a30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8007fd0 tx=0x7ff9c8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:28.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7f21a2ffd640 1 -- 172.21.15.88:0/1912284289 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c0b4600 con 0x7f21ac0c5950 2023-12-08T08:20:28.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7f12977fe640 1 -- 172.21.15.88:0/601404373 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1288005260 con 0x7f12b00c5f80 2023-12-08T08:20:28.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7f21a2ffd640 1 -- 172.21.15.88:0/1912284289 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219c0b4760 con 0x7f21ac0c5950 2023-12-08T08:20:28.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7f21a2ffd640 1 -- 172.21.15.88:0/1912284289 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c0b4b10 con 0x7f21ac0c5950 2023-12-08T08:20:28.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7fe89f7fe640 1 --2- 172.21.15.88:0/2803909858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8a00a5370 0x7fe8a0158890 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe89400c3f0 tx=0x7fe89400c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:28.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7f21b45d1640 1 -- 172.21.15.88:0/1912284289 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21ac154ce0 con 0x7f21ac0c5950 2023-12-08T08:20:28.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7f21b45d1640 1 -- 172.21.15.88:0/1912284289 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21ac1552a0 con 0x7f21ac0c5950 2023-12-08T08:20:28.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.930+0000 7eff04ff9640 1 --2- 172.21.15.88:0/986255797 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efeec066470 0x7efeec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.934+0000 7eff04ff9640 1 -- 172.21.15.88:0/986255797 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff08197cb0 con 0x7eff000076d0 2023-12-08T08:20:28.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.934+0000 7eff077fe640 1 --2- 172.21.15.88:0/986255797 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efeec066470 0x7efeec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.934+0000 7f21b45d1640 1 -- 172.21.15.88:0/1912284289 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21ac155490 con 0x7f21ac0c5950 2023-12-08T08:20:28.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.934+0000 7eff077fe640 1 --2- 172.21.15.88:0/986255797 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efeec066470 0x7efeec068930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7eff00005620 tx=0x7efef4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:28.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.934+0000 7f12adffb640 1 -- 172.21.15.88:0/601404373 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f12a4003780 con 0x7f12b00c5f80 2023-12-08T08:20:28.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.934+0000 7f12adffb640 1 --2- 172.21.15.88:0/601404373 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f129c0664c0 0x7f129c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.934+0000 7f12adffb640 1 -- 172.21.15.88:0/601404373 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12a40ae070 con 0x7f12b00c5f80 2023-12-08T08:20:28.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.934+0000 7f12b5438640 1 --2- 172.21.15.88:0/601404373 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f129c0664c0 0x7f129c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.934+0000 7f12b5438640 1 --2- 172.21.15.88:0/601404373 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f129c0664c0 0x7f129c068980 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f12b014d550 tx=0x7f12a00090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:28.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.934+0000 7eff04ff9640 1 -- 172.21.15.88:0/986255797 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7eff08165270 con 0x7eff000076d0 2023-12-08T08:20:28.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.938+0000 7f21a2ffd640 1 -- 172.21.15.88:0/1912284289 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f219c0b2040 con 0x7f21ac0c5950 2023-12-08T08:20:28.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.938+0000 7f21a2ffd640 1 --2- 172.21.15.88:0/1912284289 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f21900664f0 0x7f21900689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.938+0000 7f12adffb640 1 -- 172.21.15.88:0/601404373 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f12a40eb8b0 con 0x7f12b00c5f80 2023-12-08T08:20:28.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.938+0000 7f21a2ffd640 1 -- 172.21.15.88:0/1912284289 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f219c11e0b0 con 0x7f21ac0c5950 2023-12-08T08:20:28.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.938+0000 7f21b236d640 1 --2- 172.21.15.88:0/1912284289 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f21900664f0 0x7f21900689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.938+0000 7fe8877fe640 1 -- 172.21.15.88:0/2803909858 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe894005cf0 con 0x7fe8a00a5370 2023-12-08T08:20:28.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.942+0000 7fe8877fe640 1 -- 172.21.15.88:0/2803909858 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe894005e50 con 0x7fe8a00a5370 2023-12-08T08:20:28.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.942+0000 7fe8a552a640 1 -- 172.21.15.88:0/2803909858 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a00bfee0 con 0x7fe8a00a5370 2023-12-08T08:20:28.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.942+0000 7fe8a552a640 1 -- 172.21.15.88:0/2803909858 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a01ec350 con 0x7fe8a00a5370 2023-12-08T08:20:28.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.942+0000 7fe8877fe640 1 -- 172.21.15.88:0/2803909858 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8940072d0 con 0x7fe8a00a5370 2023-12-08T08:20:28.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.942+0000 7f21b236d640 1 --2- 172.21.15.88:0/1912284289 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f21900664f0 0x7f21900689b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f21a8000c10 tx=0x7f21a8001bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:28.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.942+0000 7ff9d8ff9640 1 -- 172.21.15.88:0/2734437759 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff9d00508c0 con 0x7ff9d40de9b0 2023-12-08T08:20:28.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.942+0000 7fe8a552a640 1 -- 172.21.15.88:0/2803909858 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe880005260 con 0x7fe8a00a5370 2023-12-08T08:20:28.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.942+0000 7f21a2ffd640 1 -- 172.21.15.88:0/1912284289 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f219c0eb5a0 con 0x7f21ac0c5950 2023-12-08T08:20:28.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.946+0000 7fe8877fe640 1 -- 172.21.15.88:0/2803909858 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe894007430 con 0x7fe8a00a5370 2023-12-08T08:20:28.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.946+0000 7fe8877fe640 1 --2- 172.21.15.88:0/2803909858 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe88c066470 0x7fe88c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.946+0000 7fe8877fe640 1 -- 172.21.15.88:0/2803909858 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe894083360 con 0x7fe8a00a5370 2023-12-08T08:20:28.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.950+0000 7fe8877fe640 1 -- 172.21.15.88:0/2803909858 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe8940507f0 con 0x7fe8a00a5370 2023-12-08T08:20:28.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.950+0000 7fe89effd640 1 --2- 172.21.15.88:0/2803909858 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe88c066470 0x7fe88c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.950+0000 7fe89effd640 1 --2- 172.21.15.88:0/2803909858 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe88c066470 0x7fe88c068930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe890020840 tx=0x7fe890008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.970+0000 7fd3dc817640 1 Processor -- start 2023-12-08T08:20:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.970+0000 7fd3dc817640 1 -- start start 2023-12-08T08:20:28.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.970+0000 7fc1d5baa640 1 Processor -- start 2023-12-08T08:20:28.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.970+0000 7fd3dc817640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd3d80c45b0 0x7fd3d8154520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.970+0000 7fd3dc817640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd3d80c94b0 0x7fd3d8154a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.970+0000 7fd3dc817640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d8151d90 con 0x7fd3d81519b0 2023-12-08T08:20:28.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.970+0000 7fd3dc817640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d81588c0 con 0x7fd3d80c94b0 2023-12-08T08:20:28.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.970+0000 7fd3dc817640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d80adfe0 con 0x7fd3d80c45b0 2023-12-08T08:20:28.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.970+0000 7fc1d5baa640 1 -- start start 2023-12-08T08:20:28.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.970+0000 7fc1d5baa640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1d015cba0 0x7fc1d006d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.970+0000 7fc1d5baa640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc1d006d6a0 0x7fc1d00a9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.970+0000 7fc1d5baa640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d015c710 con 0x7fc1d0152d30 2023-12-08T08:20:28.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.970+0000 7fc1d5baa640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d006c360 con 0x7fc1d006d6a0 2023-12-08T08:20:28.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.970+0000 7fc1d5baa640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d015d000 con 0x7fc1d015cba0 2023-12-08T08:20:28.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.970+0000 7fd3d77fe640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fd3d81519b0 0x7fd3d80ae6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:33994/0 (socket says 172.21.15.88:33994) 2023-12-08T08:20:28.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.970+0000 7fd3d77fe640 1 -- 172.21.15.88:0/3482705474 learned_addr learned my addr 172.21.15.88:0/3482705474 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:28.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fd3d7fff640 1 --2- 172.21.15.88:0/3482705474 >> v2:172.21.15.148:3300/0 conn(0x7fd3d80c94b0 0x7fd3d8154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fd3ceffd640 1 --2- 172.21.15.88:0/3482705474 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd3d80c45b0 0x7fd3d8154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fd3d6ffd640 1 -- 172.21.15.88:0/3482705474 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3070930304 0 0) 0x7fd3d8151d90 con 0x7fd3d81519b0 2023-12-08T08:20:28.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fd3d6ffd640 1 -- 172.21.15.88:0/3482705474 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3c4003530 con 0x7fd3d81519b0 2023-12-08T08:20:28.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fc1cffff640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc1d006d6a0 0x7fc1d00a9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fc1ceffd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1d015cba0 0x7fc1d006d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fc1cffff640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc1d006d6a0 0x7fc1d00a9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:45606/0 (socket says 172.21.15.88:45606) 2023-12-08T08:20:28.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fc1cffff640 1 -- 172.21.15.88:0/746872432 learned_addr learned my addr 172.21.15.88:0/746872432 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:28.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fc1ceffd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1d015cba0 0x7fc1d006d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:55982/0 (socket says 172.21.15.88:55982) 2023-12-08T08:20:28.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fd3d6ffd640 1 -- 172.21.15.88:0/3482705474 <== mon.1 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1828295517 0 0) 0x7fd3c4003530 con 0x7fd3d81519b0 2023-12-08T08:20:28.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fd3d6ffd640 1 -- 172.21.15.88:0/3482705474 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd3d80c45b0 msgr2=0x7fd3d8154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:28.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fd3d6ffd640 1 --2- 172.21.15.88:0/3482705474 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd3d80c45b0 0x7fd3d8154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fd3d6ffd640 1 -- 172.21.15.88:0/3482705474 >> v2:172.21.15.148:3300/0 conn(0x7fd3d80c94b0 msgr2=0x7fd3d8154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:28.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fd3d6ffd640 1 --2- 172.21.15.88:0/3482705474 >> v2:172.21.15.148:3300/0 conn(0x7fd3d80c94b0 0x7fd3d8154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fd3d6ffd640 1 -- 172.21.15.88:0/3482705474 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d80acd40 con 0x7fd3d81519b0 2023-12-08T08:20:28.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fd3d6ffd640 1 -- 172.21.15.88:0/3482705474 <== mon.1 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7fd3c8001680 con 0x7fd3d81519b0 2023-12-08T08:20:28.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fd3d6ffd640 1 -- 172.21.15.88:0/3482705474 >> v1:172.21.15.148:6789/0 conn(0x7fd3d81519b0 legacy=0x7fd3d80ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fd3d6ffd640 1 --2- 172.21.15.88:0/3482705474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3c4003980 0x7fd3c4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fd3d6ffd640 1 --2- 172.21.15.88:0/3482705474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3c40047d0 0x7fd3c4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fd3d6ffd640 1 --2- 172.21.15.88:0/3482705474 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd3c4005190 0x7fd3c400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fd3d6ffd640 1 -- 172.21.15.88:0/3482705474 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d81588c0 con 0x7fd3c4003980 2023-12-08T08:20:28.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fd3d6ffd640 1 -- 172.21.15.88:0/3482705474 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d80adfe0 con 0x7fd3c40047d0 2023-12-08T08:20:28.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fd3d6ffd640 1 -- 172.21.15.88:0/3482705474 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c400bf80 con 0x7fd3c4005190 2023-12-08T08:20:28.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fd3d77fe640 1 --2- 172.21.15.88:0/3482705474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3c4003980 0x7fd3c4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fd3ceffd640 1 --2- 172.21.15.88:0/3482705474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3c40047d0 0x7fd3c4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fd3d77fe640 1 -- 172.21.15.88:0/3482705474 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd3c4005190 msgr2=0x7fd3c400b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-08T08:20:28.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fd3d77fe640 1 --2- 172.21.15.88:0/3482705474 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd3c4005190 0x7fd3c400b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fd3d77fe640 1 -- 172.21.15.88:0/3482705474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3c40047d0 msgr2=0x7fd3c4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:28.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fd3d77fe640 1 --2- 172.21.15.88:0/3482705474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3c40047d0 0x7fd3c4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fd3d77fe640 1 -- 172.21.15.88:0/3482705474 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c4003530 con 0x7fd3c4003980 2023-12-08T08:20:28.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fc1ceffd640 1 -- 172.21.15.88:0/746872432 >> v2:172.21.15.148:3300/0 conn(0x7fc1d006d6a0 msgr2=0x7fc1d00a9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:28.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fc1ceffd640 1 --2- 172.21.15.88:0/746872432 >> v2:172.21.15.148:3300/0 conn(0x7fc1d006d6a0 0x7fc1d00a9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fc1ceffd640 1 -- 172.21.15.88:0/746872432 >> v1:172.21.15.148:6789/0 conn(0x7fc1d0152d30 legacy=0x7fc1d00c3930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-08T08:20:28.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.974+0000 7fc1ceffd640 1 -- 172.21.15.88:0/746872432 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d00c4040 con 0x7fc1d015cba0 2023-12-08T08:20:28.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.978+0000 7fd3d77fe640 1 --2- 172.21.15.88:0/3482705474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3c4003980 0x7fd3c4003da0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd3c800c190 tx=0x7fd3c801cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d075a118f373c28b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:28.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.982+0000 7fc1ceffd640 1 --2- 172.21.15.88:0/746872432 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1d015cba0 0x7fc1d006d160 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80097c0 tx=0x7fc1b801c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e19832e5980de061 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:28.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.982+0000 7fd3d6ffd640 1 -- 172.21.15.88:0/3482705474 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c80058e0 con 0x7fd3c4003980 2023-12-08T08:20:28.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.982+0000 7fd3d6ffd640 1 -- 172.21.15.88:0/3482705474 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c8005a40 con 0x7fd3c4003980 2023-12-08T08:20:28.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.982+0000 7fd3d6ffd640 1 -- 172.21.15.88:0/3482705474 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c8005dd0 con 0x7fd3c4003980 2023-12-08T08:20:28.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.982+0000 7fc1ce7fc640 1 -- 172.21.15.88:0/746872432 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b80ab600 con 0x7fc1d015cba0 2023-12-08T08:20:28.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.982+0000 7fc1ce7fc640 1 -- 172.21.15.88:0/746872432 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b80ab760 con 0x7fc1d015cba0 2023-12-08T08:20:28.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.982+0000 7fc1ce7fc640 1 -- 172.21.15.88:0/746872432 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b80abaf0 con 0x7fc1d015cba0 2023-12-08T08:20:28.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.982+0000 7fd3dc817640 1 -- 172.21.15.88:0/3482705474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3c4003980 msgr2=0x7fd3c4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.982+0000 7fd3dc817640 1 --2- 172.21.15.88:0/3482705474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3c4003980 0x7fd3c4003da0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd3c800c190 tx=0x7fd3c801cbc0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.982+0000 7fd3d7fff640 1 -- 172.21.15.88:0/3482705474 reap_dead start 2023-12-08T08:20:28.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.982+0000 7fd3dc817640 1 -- 172.21.15.88:0/3482705474 shutdown_connections 2023-12-08T08:20:28.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.982+0000 7fc1d5baa640 1 -- 172.21.15.88:0/746872432 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1d015cba0 msgr2=0x7fc1d006d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.982+0000 7fc1d5baa640 1 --2- 172.21.15.88:0/746872432 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1d015cba0 0x7fc1d006d160 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80097c0 tx=0x7fc1b801c460 comp rx=0 tx=0).stop 2023-12-08T08:20:28.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.982+0000 7fd3dc817640 1 -- 172.21.15.88:0/3482705474 >> 172.21.15.88:0/3482705474 conn(0x7fd3d8066cd0 msgr2=0x7fd3d80ab8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:28.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.982+0000 7fd3dc817640 1 -- 172.21.15.88:0/3482705474 shutdown_connections 2023-12-08T08:20:28.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.982+0000 7fc1d5baa640 1 -- 172.21.15.88:0/746872432 shutdown_connections 2023-12-08T08:20:28.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.982+0000 7fc1d5baa640 1 --2- 172.21.15.88:0/746872432 >> v2:172.21.15.148:3300/0 conn(0x7fc1d006d6a0 0x7fc1d00a9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.982+0000 7fc1d5baa640 1 --2- 172.21.15.88:0/746872432 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1d015cba0 0x7fc1d006d160 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.982+0000 7fc1d5baa640 1 -- 172.21.15.88:0/746872432 >> 172.21.15.88:0/746872432 conn(0x7fc1d006b220 msgr2=0x7fc1d00a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:28.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.982+0000 7fd3dc817640 1 -- 172.21.15.88:0/3482705474 wait complete. 2023-12-08T08:20:28.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.982+0000 7fc1d5baa640 1 -- 172.21.15.88:0/746872432 shutdown_connections 2023-12-08T08:20:28.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.982+0000 7fc1d5baa640 1 -- 172.21.15.88:0/746872432 wait complete. 2023-12-08T08:20:28.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.986+0000 7fd3dc817640 1 Processor -- start 2023-12-08T08:20:28.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.986+0000 7fd3dc817640 1 -- start start 2023-12-08T08:20:28.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.986+0000 7fc1d5baa640 1 Processor -- start 2023-12-08T08:20:28.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.986+0000 7fc1d5baa640 1 -- start start 2023-12-08T08:20:28.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.986+0000 7fd3dc817640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3d806c4e0 0x7fd3d806c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fd3dc817640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd3d81eda80 0x7fd3d80c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fd3dc817640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3d80c67b0 0x7fd3d81ee170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fd3dc817640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d8152cf0 con 0x7fd3d806c4e0 2023-12-08T08:20:28.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fd3dc817640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d80c6d20 con 0x7fd3d80c67b0 2023-12-08T08:20:28.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fd3dc817640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d8152170 con 0x7fd3d81eda80 2023-12-08T08:20:28.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fc1d5baa640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1d006d6a0 0x7fc1d0148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fc1d5baa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1d0152d30 0x7fc1d0070610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fc1d5baa640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1d015cba0 0x7fc1d01533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fd3ceffd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd3d81eda80 0x7fd3d80c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fd3ceffd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd3d81eda80 0x7fd3d80c51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:55994/0 (socket says 172.21.15.88:55994) 2023-12-08T08:20:28.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fd3ceffd640 1 -- 172.21.15.88:0/555218981 learned_addr learned my addr 172.21.15.88:0/555218981 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:28.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fc1cf7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1d006d6a0 0x7fc1d0148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fc1cf7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1d006d6a0 0x7fc1d0148f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:45636/0 (socket says 172.21.15.88:45636) 2023-12-08T08:20:28.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fd3d7fff640 1 --2- 172.21.15.88:0/555218981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3d80c67b0 0x7fd3d81ee170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fd3d77fe640 1 --2- 172.21.15.88:0/555218981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3d806c4e0 0x7fd3d806c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fc1cf7fe640 1 -- 172.21.15.88:0/2332846099 learned_addr learned my addr 172.21.15.88:0/2332846099 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:28.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fc1d5baa640 1 -- 172.21.15.88:0/2332846099 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d0146690 con 0x7fc1d0152d30 2023-12-08T08:20:28.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fd3ceffd640 1 -- 172.21.15.88:0/555218981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3d80c67b0 msgr2=0x7fd3d81ee170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fd3ceffd640 1 --2- 172.21.15.88:0/555218981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3d80c67b0 0x7fd3d81ee170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fd3ceffd640 1 -- 172.21.15.88:0/555218981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3d806c4e0 msgr2=0x7fd3d806c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fd3ceffd640 1 --2- 172.21.15.88:0/555218981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3d806c4e0 0x7fd3d806c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fd3ceffd640 1 -- 172.21.15.88:0/555218981 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d8152450 con 0x7fd3d81eda80 2023-12-08T08:20:28.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fc1d5baa640 1 -- 172.21.15.88:0/2332846099 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d00a4c90 con 0x7fc1d006d6a0 2023-12-08T08:20:28.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fc1cffff640 1 --2- 172.21.15.88:0/2332846099 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1d015cba0 0x7fc1d01533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fc1d5baa640 1 -- 172.21.15.88:0/2332846099 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d0152910 con 0x7fc1d015cba0 2023-12-08T08:20:28.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fc1cffff640 1 -- 172.21.15.88:0/2332846099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1d006d6a0 msgr2=0x7fc1d0148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fc1ceffd640 1 --2- 172.21.15.88:0/2332846099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1d0152d30 0x7fc1d0070610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fc1cffff640 1 --2- 172.21.15.88:0/2332846099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1d006d6a0 0x7fc1d0148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fc1cffff640 1 -- 172.21.15.88:0/2332846099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1d0152d30 msgr2=0x7fc1d0070610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fc1cffff640 1 --2- 172.21.15.88:0/2332846099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1d0152d30 0x7fc1d0070610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fc1cffff640 1 -- 172.21.15.88:0/2332846099 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b8009420 con 0x7fc1d015cba0 2023-12-08T08:20:28.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fc1cf7fe640 1 --2- 172.21.15.88:0/2332846099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1d006d6a0 0x7fc1d0148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:28.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.990+0000 7fc1ceffd640 1 --2- 172.21.15.88:0/2332846099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1d0152d30 0x7fc1d0070610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:28.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.994+0000 7fd3ceffd640 1 --2- 172.21.15.88:0/555218981 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd3d81eda80 0x7fd3d80c51b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd3c00108a0 tx=0x7fd3c0010d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:28.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.994+0000 7fc1cffff640 1 --2- 172.21.15.88:0/2332846099 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1d015cba0 0x7fc1d01533e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8007aa0 tx=0x7fc1c8007f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:28.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.994+0000 7fc1c7fff640 1 -- 172.21.15.88:0/2332846099 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c800dc70 con 0x7fc1d015cba0 2023-12-08T08:20:28.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.994+0000 7fd3d4ff9640 1 -- 172.21.15.88:0/555218981 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0004240 con 0x7fd3d81eda80 2023-12-08T08:20:28.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.994+0000 7fd3dc817640 1 -- 172.21.15.88:0/555218981 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d8152730 con 0x7fd3d81eda80 2023-12-08T08:20:29.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.994+0000 7fd3dc817640 1 -- 172.21.15.88:0/555218981 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d81540c0 con 0x7fd3d81eda80 2023-12-08T08:20:29.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.994+0000 7fc1c7fff640 1 -- 172.21.15.88:0/2332846099 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c800f040 con 0x7fc1d015cba0 2023-12-08T08:20:29.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.994+0000 7fc1c7fff640 1 -- 172.21.15.88:0/2332846099 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8015400 con 0x7fc1d015cba0 2023-12-08T08:20:29.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.994+0000 7fc1d5baa640 1 -- 172.21.15.88:0/2332846099 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d0152390 con 0x7fc1d015cba0 2023-12-08T08:20:29.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.994+0000 7fd3d4ff9640 1 -- 172.21.15.88:0/555218981 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c00043a0 con 0x7fd3d81eda80 2023-12-08T08:20:29.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.994+0000 7fd3d4ff9640 1 -- 172.21.15.88:0/555218981 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0004240 con 0x7fd3d81eda80 2023-12-08T08:20:29.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.994+0000 7fc1d5baa640 1 -- 172.21.15.88:0/2332846099 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d0152630 con 0x7fc1d015cba0 2023-12-08T08:20:29.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.994+0000 7fd3dc817640 1 -- 172.21.15.88:0/555218981 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3bc005260 con 0x7fd3d81eda80 2023-12-08T08:20:29.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.998+0000 7fd3d4ff9640 1 -- 172.21.15.88:0/555218981 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd3c000e750 con 0x7fd3d81eda80 2023-12-08T08:20:29.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.998+0000 7fc1c7fff640 1 -- 172.21.15.88:0/2332846099 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc1c801e3b0 con 0x7fc1d015cba0 2023-12-08T08:20:29.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.998+0000 7fd3d4ff9640 1 --2- 172.21.15.88:0/555218981 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd3b8066530 0x7fd3b80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:29.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.998+0000 7fd3d4ff9640 1 -- 172.21.15.88:0/555218981 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3c00842a0 con 0x7fd3d81eda80 2023-12-08T08:20:29.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:28.998+0000 7fc1d5baa640 1 -- 172.21.15.88:0/2332846099 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d0067630 con 0x7fc1d015cba0 2023-12-08T08:20:29.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.002+0000 7fd3d77fe640 1 --2- 172.21.15.88:0/555218981 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd3b8066530 0x7fd3b80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:29.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.002+0000 7fc1c7fff640 1 --2- 172.21.15.88:0/2332846099 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc1b0066470 0x7fc1b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:29.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.002+0000 7fc1c7fff640 1 -- 172.21.15.88:0/2332846099 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1c8083e10 con 0x7fc1d015cba0 2023-12-08T08:20:29.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.002+0000 7fc1cf7fe640 1 --2- 172.21.15.88:0/2332846099 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc1b0066470 0x7fc1b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:29.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.002+0000 7fd3d4ff9640 1 -- 172.21.15.88:0/555218981 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd3c0051690 con 0x7fd3d81eda80 2023-12-08T08:20:29.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.002+0000 7fd3d77fe640 1 --2- 172.21.15.88:0/555218981 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd3b8066530 0x7fd3b80689f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd3c80aa000 tx=0x7fd3c80019b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:29.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.002+0000 7fc1cf7fe640 1 --2- 172.21.15.88:0/2332846099 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc1b0066470 0x7fc1b0068930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009e20 tx=0x7fc1c0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:29.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.014+0000 7fc1c7fff640 1 -- 172.21.15.88:0/2332846099 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc1c80512a0 con 0x7fc1d015cba0 2023-12-08T08:20:29.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.166+0000 7fd8c8757640 1 -- 172.21.15.88:0/3654335461 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd8c00727d0 con 0x7fd8c01e05e0 2023-12-08T08:20:29.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.166+0000 7fd8b6ffd640 1 -- 172.21.15.88:0/3654335461 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd8b00510b0 con 0x7fd8c01e05e0 2023-12-08T08:20:29.171 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2023-12-08T08:20:29.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.170+0000 7fd8c8757640 1 -- 172.21.15.88:0/3654335461 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd8a4066570 msgr2=0x7fd8a4068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.170+0000 7fd8c8757640 1 --2- 172.21.15.88:0/3654335461 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd8a4066570 0x7fd8a4068a30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc0ae000 tx=0x7fd8bc001220 comp rx=0 tx=0).stop 2023-12-08T08:20:29.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.170+0000 7fd8c8757640 1 -- 172.21.15.88:0/3654335461 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8c01e05e0 msgr2=0x7fd8c0144940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.170+0000 7fd8c8757640 1 --2- 172.21.15.88:0/3654335461 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8c01e05e0 0x7fd8c0144940 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0006fd0 tx=0x7fd8b000d8a0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.170+0000 7fd8c8757640 1 -- 172.21.15.88:0/3654335461 shutdown_connections 2023-12-08T08:20:29.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.170+0000 7fd8c8757640 1 --2- 172.21.15.88:0/3654335461 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd8a4066570 0x7fd8a4068a30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.170+0000 7fd8c8757640 1 --2- 172.21.15.88:0/3654335461 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd8c01e05e0 0x7fd8c0144940 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.170+0000 7fd8c8757640 1 --2- 172.21.15.88:0/3654335461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8c0071880 0x7fd8c006fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.170+0000 7fd8c8757640 1 --2- 172.21.15.88:0/3654335461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8ac003b90 0x7fd8c0070ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.170+0000 7fd8c8757640 1 -- 172.21.15.88:0/3654335461 >> 172.21.15.88:0/3654335461 conn(0x7fd8c00a7520 msgr2=0x7fd8c006cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:29.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.174+0000 7fd8c8757640 1 -- 172.21.15.88:0/3654335461 shutdown_connections 2023-12-08T08:20:29.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.174+0000 7fd8c8757640 1 -- 172.21.15.88:0/3654335461 wait complete. 2023-12-08T08:20:29.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-12-08T08:20:29.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.262+0000 7fd3dc817640 1 -- 172.21.15.88:0/555218981 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fd3bc005510 con 0x7fd3d81eda80 2023-12-08T08:20:29.265 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2023-12-08T08:20:29.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.262+0000 7fd3d4ff9640 1 -- 172.21.15.88:0/555218981 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd3c0054cb0 con 0x7fd3d81eda80 2023-12-08T08:20:29.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.262+0000 7f12977fe640 1 -- 172.21.15.88:0/601404373 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1288005510 con 0x7f12b00c5f80 2023-12-08T08:20:29.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.262+0000 7f12adffb640 1 -- 172.21.15.88:0/601404373 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f12a40eeed0 con 0x7f12b00c5f80 2023-12-08T08:20:29.267 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2023-12-08T08:20:29.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.262+0000 7fd3dc817640 1 -- 172.21.15.88:0/555218981 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd3b8066530 msgr2=0x7fd3b80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.262+0000 7eff0e65a640 1 -- 172.21.15.88:0/986255797 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7eff000db7f0 con 0x7eff000076d0 2023-12-08T08:20:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.262+0000 7fd3dc817640 1 --2- 172.21.15.88:0/555218981 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd3b8066530 0x7fd3b80689f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd3c80aa000 tx=0x7fd3c80019b0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.262+0000 7fd3dc817640 1 -- 172.21.15.88:0/555218981 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd3d81eda80 msgr2=0x7fd3d80c51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.262+0000 7fd3dc817640 1 --2- 172.21.15.88:0/555218981 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd3d81eda80 0x7fd3d80c51b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd3c00108a0 tx=0x7fd3c0010d60 comp rx=0 tx=0).stop 2023-12-08T08:20:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.262+0000 7fd3dc817640 1 -- 172.21.15.88:0/555218981 shutdown_connections 2023-12-08T08:20:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.262+0000 7fd3dc817640 1 --2- 172.21.15.88:0/555218981 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd3b8066530 0x7fd3b80689f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.262+0000 7fd3dc817640 1 --2- 172.21.15.88:0/555218981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3d80c67b0 0x7fd3d81ee170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.262+0000 7fd3dc817640 1 --2- 172.21.15.88:0/555218981 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd3d81eda80 0x7fd3d80c51b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.262+0000 7fd3dc817640 1 --2- 172.21.15.88:0/555218981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3d806c4e0 0x7fd3d806c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.262+0000 7fd3dc817640 1 -- 172.21.15.88:0/555218981 >> 172.21.15.88:0/555218981 conn(0x7fd3d8066cd0 msgr2=0x7fd3d80c7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:29.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.266+0000 7eff04ff9640 1 -- 172.21.15.88:0/986255797 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7eff08168890 con 0x7eff000076d0 2023-12-08T08:20:29.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.266+0000 7fd3dc817640 1 -- 172.21.15.88:0/555218981 shutdown_connections 2023-12-08T08:20:29.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.266+0000 7fd3dc817640 1 -- 172.21.15.88:0/555218981 wait complete. 2023-12-08T08:20:29.270 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2023-12-08T08:20:29.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.266+0000 7f12977fe640 1 -- 172.21.15.88:0/601404373 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f129c0664c0 msgr2=0x7f129c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.266+0000 7f12977fe640 1 --2- 172.21.15.88:0/601404373 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f129c0664c0 0x7f129c068980 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f12b014d550 tx=0x7f12a00090e0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.266+0000 7f12977fe640 1 -- 172.21.15.88:0/601404373 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12b00c5f80 msgr2=0x7f12b00a21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.266+0000 7f12977fe640 1 --2- 172.21.15.88:0/601404373 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12b00c5f80 0x7f12b00a21f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f12a40b0000 tx=0x7f12a401d480 comp rx=0 tx=0).stop 2023-12-08T08:20:29.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.266+0000 7f12977fe640 1 -- 172.21.15.88:0/601404373 shutdown_connections 2023-12-08T08:20:29.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.266+0000 7f12977fe640 1 --2- 172.21.15.88:0/601404373 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f129c0664c0 0x7f129c068980 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f12b014d550 tx=0x7f12a00090e0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.266+0000 7f12977fe640 1 --2- 172.21.15.88:0/601404373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12b014dce0 0x7f12b00a2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.266+0000 7f12977fe640 1 --2- 172.21.15.88:0/601404373 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f12b00c5f80 0x7f12b00a21f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.266+0000 7f12977fe640 1 --2- 172.21.15.88:0/601404373 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12b00a7ef0 0x7f12b014c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.266+0000 7f12977fe640 1 -- 172.21.15.88:0/601404373 >> 172.21.15.88:0/601404373 conn(0x7f12b006ad70 msgr2=0x7f12b00c3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:29.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.266+0000 7f12977fe640 1 -- 172.21.15.88:0/601404373 shutdown_connections 2023-12-08T08:20:29.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.266+0000 7f12977fe640 1 -- 172.21.15.88:0/601404373 wait complete. 2023-12-08T08:20:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.270+0000 7ff9e2679640 1 -- 172.21.15.88:0/2734437759 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff9d4005370 con 0x7ff9d40de9b0 2023-12-08T08:20:29.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.270+0000 7eff0e65a640 1 -- 172.21.15.88:0/986255797 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efeec066470 msgr2=0x7efeec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.270+0000 7eff0e65a640 1 --2- 172.21.15.88:0/986255797 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efeec066470 0x7efeec068930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7eff00005620 tx=0x7efef4009040 comp rx=0 tx=0).stop 2023-12-08T08:20:29.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.270+0000 7eff0e65a640 1 -- 172.21.15.88:0/986255797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff000076d0 msgr2=0x7eff000d2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.270+0000 7eff0e65a640 1 --2- 172.21.15.88:0/986255797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff000076d0 0x7eff000d2870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7eff08079830 tx=0x7eff080936e0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.270+0000 7eff0e65a640 1 -- 172.21.15.88:0/986255797 shutdown_connections 2023-12-08T08:20:29.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.270+0000 7eff0e65a640 1 --2- 172.21.15.88:0/986255797 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efeec066470 0x7efeec068930 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.270+0000 7eff0e65a640 1 --2- 172.21.15.88:0/986255797 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7eff000d4330 0x7eff000dc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.270+0000 7eff0e65a640 1 --2- 172.21.15.88:0/986255797 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff0004dac0 0x7eff000dbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.270+0000 7eff0e65a640 1 --2- 172.21.15.88:0/986255797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff000076d0 0x7eff000d2870 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.270+0000 7eff0e65a640 1 -- 172.21.15.88:0/986255797 >> 172.21.15.88:0/986255797 conn(0x7eff0004c640 msgr2=0x7eff0002f590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:29.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.270+0000 7ff9d8ff9640 1 -- 172.21.15.88:0/2734437759 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff9d0017030 con 0x7ff9d40de9b0 2023-12-08T08:20:29.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.270+0000 7eff0e65a640 1 -- 172.21.15.88:0/986255797 shutdown_connections 2023-12-08T08:20:29.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.270+0000 7eff0e65a640 1 -- 172.21.15.88:0/986255797 wait complete. 2023-12-08T08:20:29.275 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2023-12-08T08:20:29.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.274+0000 7ff9e2679640 1 -- 172.21.15.88:0/2734437759 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff9c0066570 msgr2=0x7ff9c0068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.274+0000 7ff9e2679640 1 --2- 172.21.15.88:0/2734437759 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff9c0066570 0x7ff9c0068a30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8007fd0 tx=0x7ff9c8009040 comp rx=0 tx=0).stop 2023-12-08T08:20:29.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.274+0000 7ff9e2679640 1 -- 172.21.15.88:0/2734437759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9d40de9b0 msgr2=0x7ff9d40dbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.274+0000 7ff9e2679640 1 --2- 172.21.15.88:0/2734437759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9d40de9b0 0x7ff9d40dbda0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000c430 tx=0x7ff9d000c8f0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.274+0000 7ff9e2679640 1 -- 172.21.15.88:0/2734437759 shutdown_connections 2023-12-08T08:20:29.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.274+0000 7ff9e2679640 1 --2- 172.21.15.88:0/2734437759 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff9c0066570 0x7ff9c0068a30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.274+0000 7ff9e2679640 1 --2- 172.21.15.88:0/2734437759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9d40de9b0 0x7ff9d40dbda0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.274+0000 7ff9e2679640 1 --2- 172.21.15.88:0/2734437759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9d403e9e0 0x7ff9d40d57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.274+0000 7ff9e2679640 1 --2- 172.21.15.88:0/2734437759 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff9d400b0b0 0x7ff9d40da070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.274+0000 7ff9e2679640 1 -- 172.21.15.88:0/2734437759 >> 172.21.15.88:0/2734437759 conn(0x7ff9d4005e70 msgr2=0x7ff9d40ddf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:29.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.278+0000 7f21b45d1640 1 -- 172.21.15.88:0/1912284289 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f21ac067630 con 0x7f21ac0c5950 2023-12-08T08:20:29.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.278+0000 7ff9e2679640 1 -- 172.21.15.88:0/2734437759 shutdown_connections 2023-12-08T08:20:29.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.278+0000 7ff9e2679640 1 -- 172.21.15.88:0/2734437759 wait complete. 2023-12-08T08:20:29.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.278+0000 7f21a2ffd640 1 -- 172.21.15.88:0/1912284289 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f219c0eebc0 con 0x7f21ac0c5950 2023-12-08T08:20:29.282 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2023-12-08T08:20:29.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.282+0000 7f21b45d1640 1 -- 172.21.15.88:0/1912284289 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f21900664f0 msgr2=0x7f21900689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.282+0000 7f21b45d1640 1 --2- 172.21.15.88:0/1912284289 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f21900664f0 0x7f21900689b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f21a8000c10 tx=0x7f21a8001bc0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.282+0000 7f21b45d1640 1 -- 172.21.15.88:0/1912284289 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21ac0c5950 msgr2=0x7f21ac1f4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.282+0000 7f21b45d1640 1 --2- 172.21.15.88:0/1912284289 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21ac0c5950 0x7f21ac1f4e70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f219c0ab000 tx=0x7f219c018f60 comp rx=0 tx=0).stop 2023-12-08T08:20:29.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.282+0000 7fe8a552a640 1 -- 172.21.15.88:0/2803909858 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe880005510 con 0x7fe8a00a5370 2023-12-08T08:20:29.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.282+0000 7f21b45d1640 1 -- 172.21.15.88:0/1912284289 shutdown_connections 2023-12-08T08:20:29.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.282+0000 7f21b45d1640 1 --2- 172.21.15.88:0/1912284289 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f21900664f0 0x7f21900689b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.282+0000 7f21b45d1640 1 --2- 172.21.15.88:0/1912284289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21ac156120 0x7f21ac1f53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.282+0000 7f21b45d1640 1 --2- 172.21.15.88:0/1912284289 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21ac0c5950 0x7f21ac1f4e70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.282+0000 7f21b45d1640 1 --2- 172.21.15.88:0/1912284289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21ac0c1b20 0x7f21ac14d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.282+0000 7f21b45d1640 1 -- 172.21.15.88:0/1912284289 >> 172.21.15.88:0/1912284289 conn(0x7f21ac06ad70 msgr2=0x7f21ac151870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:29.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.282+0000 7f21b45d1640 1 -- 172.21.15.88:0/1912284289 shutdown_connections 2023-12-08T08:20:29.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.282+0000 7fe8877fe640 1 -- 172.21.15.88:0/2803909858 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe894053e10 con 0x7fe8a00a5370 2023-12-08T08:20:29.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.282+0000 7f21b45d1640 1 -- 172.21.15.88:0/1912284289 wait complete. 2023-12-08T08:20:29.287 INFO:teuthology.orchestra.run.smithi088.stdout:55834574852 2023-12-08T08:20:29.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.286+0000 7fe8a552a640 1 -- 172.21.15.88:0/2803909858 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe88c066470 msgr2=0x7fe88c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.286+0000 7fe8a552a640 1 --2- 172.21.15.88:0/2803909858 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe88c066470 0x7fe88c068930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe890020840 tx=0x7fe890008040 comp rx=0 tx=0).stop 2023-12-08T08:20:29.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.286+0000 7fe8a552a640 1 -- 172.21.15.88:0/2803909858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8a00a5370 msgr2=0x7fe8a0158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.286+0000 7fe8a552a640 1 --2- 172.21.15.88:0/2803909858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8a00a5370 0x7fe8a0158890 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe89400c3f0 tx=0x7fe89400c8b0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.286+0000 7fe8a552a640 1 -- 172.21.15.88:0/2803909858 shutdown_connections 2023-12-08T08:20:29.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.286+0000 7fe8a552a640 1 --2- 172.21.15.88:0/2803909858 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe88c066470 0x7fe88c068930 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.286+0000 7fe8a552a640 1 --2- 172.21.15.88:0/2803909858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8a00a5370 0x7fe8a0158890 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.286+0000 7fe8a552a640 1 --2- 172.21.15.88:0/2803909858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8a00a4f90 0x7fe8a00c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.286+0000 7fe8a552a640 1 --2- 172.21.15.88:0/2803909858 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8a0072810 0x7fe8a00bf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.286+0000 7fe8a552a640 1 -- 172.21.15.88:0/2803909858 >> 172.21.15.88:0/2803909858 conn(0x7fe8a006b220 msgr2=0x7fe8a00a77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:29.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.286+0000 7fe8a552a640 1 -- 172.21.15.88:0/2803909858 shutdown_connections 2023-12-08T08:20:29.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.286+0000 7fe8a552a640 1 -- 172.21.15.88:0/2803909858 wait complete. 2023-12-08T08:20:29.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-12-08T08:20:29.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2023-12-08T08:20:29.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-12-08T08:20:29.321 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-12-08T08:20:29.324 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-12-08T08:20:29.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2023-12-08T08:20:29.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.326+0000 7fc1d5baa640 1 -- 172.21.15.88:0/2332846099 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc1d00a7cd0 con 0x7fc1d015cba0 2023-12-08T08:20:29.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.326+0000 7fc1c7fff640 1 -- 172.21.15.88:0/2332846099 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc1c801a090 con 0x7fc1d015cba0 2023-12-08T08:20:29.331 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2023-12-08T08:20:29.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.330+0000 7fc1d5baa640 1 -- 172.21.15.88:0/2332846099 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc1b0066470 msgr2=0x7fc1b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.330+0000 7fc1d5baa640 1 --2- 172.21.15.88:0/2332846099 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc1b0066470 0x7fc1b0068930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009e20 tx=0x7fc1c0009190 comp rx=0 tx=0).stop 2023-12-08T08:20:29.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.330+0000 7fc1d5baa640 1 -- 172.21.15.88:0/2332846099 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1d015cba0 msgr2=0x7fc1d01533e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.330+0000 7fc1d5baa640 1 --2- 172.21.15.88:0/2332846099 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1d015cba0 0x7fc1d01533e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8007aa0 tx=0x7fc1c8007f60 comp rx=0 tx=0).stop 2023-12-08T08:20:29.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.330+0000 7fc1d5baa640 1 -- 172.21.15.88:0/2332846099 shutdown_connections 2023-12-08T08:20:29.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.330+0000 7fc1d5baa640 1 --2- 172.21.15.88:0/2332846099 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc1b0066470 0x7fc1b0068930 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.330+0000 7fc1d5baa640 1 --2- 172.21.15.88:0/2332846099 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc1d015cba0 0x7fc1d01533e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.330+0000 7fc1d5baa640 1 --2- 172.21.15.88:0/2332846099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1d0152d30 0x7fc1d0070610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.330+0000 7fc1d5baa640 1 --2- 172.21.15.88:0/2332846099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1d006d6a0 0x7fc1d0148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.330+0000 7fc1d5baa640 1 -- 172.21.15.88:0/2332846099 >> 172.21.15.88:0/2332846099 conn(0x7fc1d006b220 msgr2=0x7fc1d00c24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:29.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.330+0000 7fc1d5baa640 1 -- 172.21.15.88:0/2332846099 shutdown_connections 2023-12-08T08:20:29.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:29.330+0000 7fc1d5baa640 1 -- 172.21.15.88:0/2332846099 wait complete. 2023-12-08T08:20:29.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-12-08T08:20:30.208 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-08T08:20:30.306 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-08T08:20:30.315 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-08T08:20:30.321 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-08T08:20:30.321 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-08T08:20:30.325 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-08T08:20:30.325 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-08T08:20:30.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.350+0000 7f96287df640 1 Processor -- start 2023-12-08T08:20:30.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.350+0000 7f96287df640 1 -- start start 2023-12-08T08:20:30.354 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-08T08:20:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.350+0000 7f96287df640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f96200c5520 0x7f9620155070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.350+0000 7f96287df640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96200c8000 0x7f96200c8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.350+0000 7f96287df640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9620151ec0 con 0x7f9620151ae0 2023-12-08T08:20:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.350+0000 7f96287df640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96200c08f0 con 0x7f96200c5520 2023-12-08T08:20:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.350+0000 7f96287df640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96200c5a90 con 0x7f96200c8000 2023-12-08T08:20:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.350+0000 7f9625d7a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f96200c5520 0x7f9620155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.350+0000 7f9625d7a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f96200c5520 0x7f9620155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:55420/0 (socket says 172.21.15.88:55420) 2023-12-08T08:20:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.350+0000 7f9625d7a640 1 -- 172.21.15.88:0/3372878568 learned_addr learned my addr 172.21.15.88:0/3372878568 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.350+0000 7f9626d7c640 1 --2- 172.21.15.88:0/3372878568 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96200c8000 0x7f96200c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.350+0000 7f9625d7a640 1 -- 172.21.15.88:0/3372878568 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96200c8000 msgr2=0x7f96200c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:30.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.350+0000 7f9625d7a640 1 --2- 172.21.15.88:0/3372878568 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96200c8000 0x7f96200c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.350+0000 7f9625d7a640 1 -- 172.21.15.88:0/3372878568 >> v1:172.21.15.148:6789/0 conn(0x7f9620151ae0 legacy=0x7f96200bf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.350+0000 7f9625d7a640 1 -- 172.21.15.88:0/3372878568 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96200c5d70 con 0x7f96200c5520 2023-12-08T08:20:30.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.354+0000 7f9625d7a640 1 --2- 172.21.15.88:0/3372878568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96200c5520 0x7f9620155070 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9610006fd0 tx=0x7f961001c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=734c7737f51ddcb3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.354+0000 7f9625579640 1 -- 172.21.15.88:0/3372878568 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96100ab660 con 0x7f96200c5520 2023-12-08T08:20:30.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.354+0000 7f9625579640 1 -- 172.21.15.88:0/3372878568 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96100ab7c0 con 0x7f96200c5520 2023-12-08T08:20:30.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.354+0000 7f9625579640 1 -- 172.21.15.88:0/3372878568 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96100abb50 con 0x7f96200c5520 2023-12-08T08:20:30.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.354+0000 7f96287df640 1 -- 172.21.15.88:0/3372878568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96200c5520 msgr2=0x7f9620155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.354+0000 7f96287df640 1 --2- 172.21.15.88:0/3372878568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96200c5520 0x7f9620155070 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9610006fd0 tx=0x7f961001c460 comp rx=0 tx=0).stop 2023-12-08T08:20:30.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.358+0000 7f96287df640 1 -- 172.21.15.88:0/3372878568 shutdown_connections 2023-12-08T08:20:30.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.358+0000 7f96287df640 1 --2- 172.21.15.88:0/3372878568 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f96200c8000 0x7f96200c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.358+0000 7f96287df640 1 --2- 172.21.15.88:0/3372878568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96200c5520 0x7f9620155070 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.358+0000 7f96287df640 1 -- 172.21.15.88:0/3372878568 >> 172.21.15.88:0/3372878568 conn(0x7f96200ca000 msgr2=0x7f96200ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:30.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.358+0000 7f96287df640 1 -- 172.21.15.88:0/3372878568 shutdown_connections 2023-12-08T08:20:30.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.358+0000 7f96287df640 1 -- 172.21.15.88:0/3372878568 wait complete. 2023-12-08T08:20:30.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.358+0000 7f96287df640 1 Processor -- start 2023-12-08T08:20:30.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.358+0000 7f96287df640 1 -- start start 2023-12-08T08:20:30.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.362+0000 7f96287df640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96200c5520 0x7f96201f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.362+0000 7f96287df640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96200c8000 0x7f9620153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.362+0000 7f96287df640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9620151ae0 0x7f96200c3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.362+0000 7f96287df640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9620148000 con 0x7f96200c5520 2023-12-08T08:20:30.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.362+0000 7f96287df640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96201f4a20 con 0x7f96200c8000 2023-12-08T08:20:30.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.362+0000 7f96287df640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96201f46f0 con 0x7f9620151ae0 2023-12-08T08:20:30.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.362+0000 7f9626d7c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9620151ae0 0x7f96200c3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.362+0000 7f9626d7c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9620151ae0 0x7f96200c3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:59922/0 (socket says 172.21.15.88:59922) 2023-12-08T08:20:30.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.362+0000 7f9626d7c640 1 -- 172.21.15.88:0/163082063 learned_addr learned my addr 172.21.15.88:0/163082063 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:30.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.362+0000 7f9625d7a640 1 --2- 172.21.15.88:0/163082063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96200c8000 0x7f9620153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.362+0000 7f9626d7c640 1 -- 172.21.15.88:0/163082063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96200c8000 msgr2=0x7f9620153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.362+0000 7f9626d7c640 1 --2- 172.21.15.88:0/163082063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96200c8000 0x7f9620153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.362+0000 7f9626d7c640 1 -- 172.21.15.88:0/163082063 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96200c5520 msgr2=0x7f96201f4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.362+0000 7f9626d7c640 1 --2- 172.21.15.88:0/163082063 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96200c5520 0x7f96201f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.362+0000 7f9626d7c640 1 -- 172.21.15.88:0/163082063 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9610009480 con 0x7f9620151ae0 2023-12-08T08:20:30.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.362+0000 7f9626d7c640 1 --2- 172.21.15.88:0/163082063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9620151ae0 0x7f96200c3030 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f961800efc0 tx=0x7f961800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.362+0000 7f9616ffd640 1 -- 172.21.15.88:0/163082063 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9618009ba0 con 0x7f9620151ae0 2023-12-08T08:20:30.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.362+0000 7f9616ffd640 1 -- 172.21.15.88:0/163082063 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961800f040 con 0x7f9620151ae0 2023-12-08T08:20:30.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.362+0000 7f9616ffd640 1 -- 172.21.15.88:0/163082063 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96180146c0 con 0x7f9620151ae0 2023-12-08T08:20:30.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.362+0000 7f96287df640 1 -- 172.21.15.88:0/163082063 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96200c10d0 con 0x7f9620151ae0 2023-12-08T08:20:30.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.366+0000 7f96287df640 1 -- 172.21.15.88:0/163082063 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96200c1690 con 0x7f9620151ae0 2023-12-08T08:20:30.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.366+0000 7f96287df640 1 -- 172.21.15.88:0/163082063 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96200c1880 con 0x7f9620151ae0 2023-12-08T08:20:30.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.366+0000 7f9616ffd640 1 -- 172.21.15.88:0/163082063 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9618014820 con 0x7f9620151ae0 2023-12-08T08:20:30.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.370+0000 7f9616ffd640 1 --2- 172.21.15.88:0/163082063 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9604066470 0x7f9604068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.370+0000 7f9616ffd640 1 -- 172.21.15.88:0/163082063 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96180560b0 con 0x7f9620151ae0 2023-12-08T08:20:30.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.370+0000 7f962657b640 1 --2- 172.21.15.88:0/163082063 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9604066470 0x7f9604068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.370+0000 7f962657b640 1 --2- 172.21.15.88:0/163082063 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9604066470 0x7f9604068930 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f961c000f70 tx=0x7f961c0079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.374+0000 7f9616ffd640 1 -- 172.21.15.88:0/163082063 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9618052480 con 0x7f9620151ae0 2023-12-08T08:20:30.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.514+0000 7f48f2074640 1 Processor -- start 2023-12-08T08:20:30.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.514+0000 7f48f2074640 1 -- start start 2023-12-08T08:20:30.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.518+0000 7f48f2074640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f48ec14dac0 0x7f48ec06d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.518+0000 7f48f2074640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48ec1518c0 0x7f48ec151d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.518+0000 7f48f2074640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f48ec152260 0x7f48ec1539c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.518+0000 7f48f2074640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48ec06bf10 con 0x7f48ec14dac0 2023-12-08T08:20:30.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.518+0000 7f48f2074640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48ec14dea0 con 0x7f48ec152260 2023-12-08T08:20:30.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.518+0000 7f48f2074640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec0c5390 con 0x7f48ec1518c0 2023-12-08T08:20:30.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.518+0000 7f48f1873640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f48ec152260 0x7f48ec1539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.518+0000 7f48f1873640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f48ec152260 0x7f48ec1539c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:55438/0 (socket says 172.21.15.88:55438) 2023-12-08T08:20:30.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.518+0000 7f48f0871640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48ec1518c0 0x7f48ec151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.518+0000 7f48f1873640 1 -- 172.21.15.88:0/3287256736 learned_addr learned my addr 172.21.15.88:0/3287256736 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:30.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.518+0000 7f48f1072640 1 --2- 172.21.15.88:0/3287256736 >> v2:172.21.15.88:3300/0 conn(0x7f48ec14dac0 0x7f48ec06d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.518+0000 7f48f0871640 1 -- 172.21.15.88:0/3287256736 >> v2:172.21.15.148:3300/0 conn(0x7f48ec152260 msgr2=0x7f48ec1539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:30.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.518+0000 7f48f0871640 1 --2- 172.21.15.88:0/3287256736 >> v2:172.21.15.148:3300/0 conn(0x7f48ec152260 0x7f48ec1539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.518+0000 7f48f0871640 1 -- 172.21.15.88:0/3287256736 >> v2:172.21.15.88:3300/0 conn(0x7f48ec14dac0 msgr2=0x7f48ec06d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:30.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.518+0000 7f48f0871640 1 --2- 172.21.15.88:0/3287256736 >> v2:172.21.15.88:3300/0 conn(0x7f48ec14dac0 0x7f48ec06d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.518+0000 7f48f0871640 1 -- 172.21.15.88:0/3287256736 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ec0c4300 con 0x7f48ec1518c0 2023-12-08T08:20:30.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.518+0000 7f48f1072640 1 --2- 172.21.15.88:0/3287256736 >> v2:172.21.15.88:3300/0 conn(0x7f48ec14dac0 0x7f48ec06d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:30.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.526+0000 7f48f0871640 1 --2- 172.21.15.88:0/3287256736 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48ec1518c0 0x7f48ec151d20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f48ec151560 tx=0x7f48e401eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a199e2c7758a1579 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.526+0000 7f48e3fff640 1 -- 172.21.15.88:0/3287256736 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e400a0d0 con 0x7f48ec1518c0 2023-12-08T08:20:30.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.526+0000 7f48e3fff640 1 -- 172.21.15.88:0/3287256736 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e40aa050 con 0x7f48ec1518c0 2023-12-08T08:20:30.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.526+0000 7f48e3fff640 1 -- 172.21.15.88:0/3287256736 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e400a450 con 0x7f48ec1518c0 2023-12-08T08:20:30.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.526+0000 7f48f2074640 1 -- 172.21.15.88:0/3287256736 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48ec1518c0 msgr2=0x7f48ec151d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.526+0000 7f48f2074640 1 --2- 172.21.15.88:0/3287256736 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48ec1518c0 0x7f48ec151d20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f48ec151560 tx=0x7f48e401eef0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.526+0000 7f48f2074640 1 -- 172.21.15.88:0/3287256736 shutdown_connections 2023-12-08T08:20:30.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.526+0000 7f48f2074640 1 --2- 172.21.15.88:0/3287256736 >> v2:172.21.15.148:3300/0 conn(0x7f48ec152260 0x7f48ec1539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.526+0000 7f48f2074640 1 --2- 172.21.15.88:0/3287256736 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48ec1518c0 0x7f48ec151d20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.526+0000 7f48f2074640 1 --2- 172.21.15.88:0/3287256736 >> v2:172.21.15.88:3300/0 conn(0x7f48ec14dac0 0x7f48ec06d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.526+0000 7f48f2074640 1 -- 172.21.15.88:0/3287256736 >> 172.21.15.88:0/3287256736 conn(0x7f48ec06a5b0 msgr2=0x7f48ec06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:30.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.526+0000 7f48f2074640 1 -- 172.21.15.88:0/3287256736 shutdown_connections 2023-12-08T08:20:30.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.526+0000 7f48f2074640 1 -- 172.21.15.88:0/3287256736 wait complete. 2023-12-08T08:20:30.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.530+0000 7f48f2074640 1 Processor -- start 2023-12-08T08:20:30.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.530+0000 7f48f2074640 1 -- start start 2023-12-08T08:20:30.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.534+0000 7f48f2074640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48ec14dac0 0x7f48ec156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.534+0000 7f48f2074640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48ec1518c0 0x7f48ec1ec310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.534+0000 7f48f2074640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48ec152260 0x7f48ec0a9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.534+0000 7f48f2074640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec0bf630 con 0x7f48ec1518c0 2023-12-08T08:20:30.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.534+0000 7f48f2074640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec0aad10 con 0x7f48ec152260 2023-12-08T08:20:30.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.534+0000 7f48f2074640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec1ec850 con 0x7f48ec14dac0 2023-12-08T08:20:30.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.534+0000 7f48f0871640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48ec1518c0 0x7f48ec1ec310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.534+0000 7f48f0871640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48ec1518c0 0x7f48ec1ec310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41148/0 (socket says 172.21.15.88:41148) 2023-12-08T08:20:30.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.534+0000 7f48f0871640 1 -- 172.21.15.88:0/1737300216 learned_addr learned my addr 172.21.15.88:0/1737300216 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:30.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.534+0000 7f48f1072640 1 --2- 172.21.15.88:0/1737300216 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48ec14dac0 0x7f48ec156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.534+0000 7f48f1873640 1 --2- 172.21.15.88:0/1737300216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48ec152260 0x7f48ec0a9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.534+0000 7f48f1072640 1 -- 172.21.15.88:0/1737300216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48ec152260 msgr2=0x7f48ec0a9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.534+0000 7f48f1072640 1 --2- 172.21.15.88:0/1737300216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48ec152260 0x7f48ec0a9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.534+0000 7f48f1072640 1 -- 172.21.15.88:0/1737300216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48ec1518c0 msgr2=0x7f48ec1ec310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.534+0000 7f48f1072640 1 --2- 172.21.15.88:0/1737300216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48ec1518c0 0x7f48ec1ec310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.534+0000 7f48f1072640 1 -- 172.21.15.88:0/1737300216 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e400c050 con 0x7f48ec14dac0 2023-12-08T08:20:30.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.538+0000 7f48f1072640 1 --2- 172.21.15.88:0/1737300216 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48ec14dac0 0x7f48ec156220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f48e800c7f0 tx=0x7f48e800ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.538+0000 7f48e1ffb640 1 -- 172.21.15.88:0/1737300216 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e8004220 con 0x7f48ec14dac0 2023-12-08T08:20:30.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.538+0000 7f48e1ffb640 1 -- 172.21.15.88:0/1737300216 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e8004380 con 0x7f48ec14dac0 2023-12-08T08:20:30.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.538+0000 7f48f2074640 1 -- 172.21.15.88:0/1737300216 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48ec0bf300 con 0x7f48ec14dac0 2023-12-08T08:20:30.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.538+0000 7f48e1ffb640 1 -- 172.21.15.88:0/1737300216 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e8003840 con 0x7f48ec14dac0 2023-12-08T08:20:30.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.538+0000 7f48f2074640 1 -- 172.21.15.88:0/1737300216 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48ec0aa750 con 0x7f48ec14dac0 2023-12-08T08:20:30.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.538+0000 7f48f2074640 1 -- 172.21.15.88:0/1737300216 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48ec0bf7a0 con 0x7f48ec14dac0 2023-12-08T08:20:30.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.542+0000 7f48e1ffb640 1 -- 172.21.15.88:0/1737300216 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f48e80039a0 con 0x7f48ec14dac0 2023-12-08T08:20:30.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.542+0000 7f48e1ffb640 1 --2- 172.21.15.88:0/1737300216 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f48d00664f0 0x7f48d00689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.542+0000 7f48e1ffb640 1 -- 172.21.15.88:0/1737300216 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48e80541b0 con 0x7f48ec14dac0 2023-12-08T08:20:30.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.546+0000 7f48f0871640 1 --2- 172.21.15.88:0/1737300216 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f48d00664f0 0x7f48d00689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.546+0000 7f48f0871640 1 --2- 172.21.15.88:0/1737300216 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f48d00664f0 0x7f48d00689b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f48e401cb20 tx=0x7f48e400e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.546+0000 7f48e1ffb640 1 -- 172.21.15.88:0/1737300216 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f48e8088060 con 0x7f48ec14dac0 2023-12-08T08:20:30.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.598+0000 7fb3307c1640 1 Processor -- start 2023-12-08T08:20:30.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.598+0000 7fb3307c1640 1 -- start start 2023-12-08T08:20:30.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.598+0000 7fb3307c1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3280a4f90 0x7fb3280c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.598+0000 7fb3307c1640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb3280a5370 0x7fb32814f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.598+0000 7fb3307c1640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3281524b0 con 0x7fb328072810 2023-12-08T08:20:30.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.598+0000 7fb3307c1640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3280c62f0 con 0x7fb3280a5370 2023-12-08T08:20:30.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.598+0000 7fb3307c1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb328152770 con 0x7fb3280a4f90 2023-12-08T08:20:30.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.598+0000 7fb32ed5e640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb328072810 0x7fb3280c0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34398/0 (socket says 172.21.15.88:34398) 2023-12-08T08:20:30.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.598+0000 7fb32ed5e640 1 -- 172.21.15.88:0/2719496935 learned_addr learned my addr 172.21.15.88:0/2719496935 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:30.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.598+0000 7fb32dd5c640 1 --2- 172.21.15.88:0/2719496935 >> v2:172.21.15.148:3300/0 conn(0x7fb3280a5370 0x7fb32814f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.602+0000 7fb32e55d640 1 --2- 172.21.15.88:0/2719496935 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3280a4f90 0x7fb3280c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.602+0000 7f73a759e640 1 Processor -- start 2023-12-08T08:20:30.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.602+0000 7fb32d55b640 1 -- 172.21.15.88:0/2719496935 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 350933071 0 0) 0x7fb3281524b0 con 0x7fb328072810 2023-12-08T08:20:30.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.602+0000 7fb32d55b640 1 -- 172.21.15.88:0/2719496935 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb314003530 con 0x7fb328072810 2023-12-08T08:20:30.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.602+0000 7fb32e55d640 1 -- 172.21.15.88:0/2719496935 >> v2:172.21.15.148:3300/0 conn(0x7fb3280a5370 msgr2=0x7fb32814f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:30.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.602+0000 7fb32e55d640 1 --2- 172.21.15.88:0/2719496935 >> v2:172.21.15.148:3300/0 conn(0x7fb3280a5370 0x7fb32814f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.602+0000 7fb32e55d640 1 -- 172.21.15.88:0/2719496935 >> v1:172.21.15.88:6789/0 conn(0x7fb328072810 legacy=0x7fb3280c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.602+0000 7fb32e55d640 1 -- 172.21.15.88:0/2719496935 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb328152a50 con 0x7fb3280a4f90 2023-12-08T08:20:30.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.602+0000 7f73a759e640 1 -- start start 2023-12-08T08:20:30.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.602+0000 7f52ca93e640 1 Processor -- start 2023-12-08T08:20:30.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.602+0000 7f52ca93e640 1 -- start start 2023-12-08T08:20:30.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.602+0000 7f73a759e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f73a00dbcb0 0x7f73a00e26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.602+0000 7f73a759e640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f73a000b090 0x7f73a0006e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.602+0000 7f73a759e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a00e2c20 con 0x7f73a00073c0 2023-12-08T08:20:30.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.602+0000 7f73a759e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a00de840 con 0x7f73a00dbcb0 2023-12-08T08:20:30.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.602+0000 7f73a759e640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a00475f0 con 0x7f73a000b090 2023-12-08T08:20:30.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.602+0000 7f73a659c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f73a00dbcb0 0x7f73a00e26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.602+0000 7f73a6d9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f73a00073c0 0x7f73a00decf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34402/0 (socket says 172.21.15.88:34402) 2023-12-08T08:20:30.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.602+0000 7f73a6d9d640 1 -- 172.21.15.88:0/47403734 learned_addr learned my addr 172.21.15.88:0/47403734 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:30.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.606+0000 7f73a659c640 1 -- 172.21.15.88:0/47403734 >> v2:172.21.15.148:3300/0 conn(0x7f73a000b090 msgr2=0x7f73a0006e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:30.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.606+0000 7f73a659c640 1 --2- 172.21.15.88:0/47403734 >> v2:172.21.15.148:3300/0 conn(0x7f73a000b090 0x7f73a0006e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.606+0000 7f73a659c640 1 -- 172.21.15.88:0/47403734 >> v1:172.21.15.88:6789/0 conn(0x7f73a00073c0 legacy=0x7f73a00decf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.606+0000 7f52ca93e640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f52c406dfa0 0x7f52c414da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.606+0000 7f2d9d432640 1 Processor -- start 2023-12-08T08:20:30.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.606+0000 7f73a659c640 1 -- 172.21.15.88:0/47403734 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a00478d0 con 0x7f73a00dbcb0 2023-12-08T08:20:30.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.606+0000 7f52ca93e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f52c40c5f60 0x7f52c406ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.606+0000 7f52ca93e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52c406bf50 0x7f52c40c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.606+0000 7f2d9d432640 1 -- start start 2023-12-08T08:20:30.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.606+0000 7f52c3fff640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f52c406dfa0 0x7f52c414da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.606+0000 7f52c3fff640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f52c406dfa0 0x7f52c414da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:55468/0 (socket says 172.21.15.88:55468) 2023-12-08T08:20:30.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.606+0000 7f52c3fff640 1 -- 172.21.15.88:0/1811245032 learned_addr learned my addr 172.21.15.88:0/1811245032 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:30.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.606+0000 7f52ca93e640 1 -- 172.21.15.88:0/1811245032 --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c414dfc0 con 0x7f52c40c5f60 2023-12-08T08:20:30.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.606+0000 7f52ca93e640 1 -- 172.21.15.88:0/1811245032 --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c4153c00 con 0x7f52c406dfa0 2023-12-08T08:20:30.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.606+0000 7f52ca93e640 1 -- 172.21.15.88:0/1811245032 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c4153ee0 con 0x7f52c406bf50 2023-12-08T08:20:30.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.606+0000 7f52c8edb640 1 --2- 172.21.15.88:0/1811245032 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52c406bf50 0x7f52c40c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.606+0000 7fb32e55d640 1 --2- 172.21.15.88:0/2719496935 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3280a4f90 0x7fb3280c59c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb3180097c0 tx=0x7fb31801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4081bce109528fe server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.606+0000 7fb32d55b640 1 -- 172.21.15.88:0/2719496935 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3180ab600 con 0x7fb3280a4f90 2023-12-08T08:20:30.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.606+0000 7fb32d55b640 1 -- 172.21.15.88:0/2719496935 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3180a7050 con 0x7fb3280a4f90 2023-12-08T08:20:30.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.606+0000 7fb32d55b640 1 -- 172.21.15.88:0/2719496935 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3180ab980 con 0x7fb3280a4f90 2023-12-08T08:20:30.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.606+0000 7fa05159d640 1 Processor -- start 2023-12-08T08:20:30.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.606+0000 7fb3307c1640 1 -- 172.21.15.88:0/2719496935 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3280a4f90 msgr2=0x7fb3280c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.606+0000 7fb3307c1640 1 --2- 172.21.15.88:0/2719496935 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3280a4f90 0x7fb3280c59c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb3180097c0 tx=0x7fb31801c410 comp rx=0 tx=0).stop 2023-12-08T08:20:30.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.606+0000 7fa05159d640 1 -- start start 2023-12-08T08:20:30.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.606+0000 7f52c37fe640 1 --2- 172.21.15.88:0/1811245032 >> v2:172.21.15.88:3300/0 conn(0x7f52c40c5f60 0x7f52c406ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7fb3307c1640 1 -- 172.21.15.88:0/2719496935 shutdown_connections 2023-12-08T08:20:30.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7fb3307c1640 1 --2- 172.21.15.88:0/2719496935 >> v2:172.21.15.148:3300/0 conn(0x7fb3280a5370 0x7fb32814f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7fb3307c1640 1 --2- 172.21.15.88:0/2719496935 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3280a4f90 0x7fb3280c59c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7fb3307c1640 1 -- 172.21.15.88:0/2719496935 >> 172.21.15.88:0/2719496935 conn(0x7fb32806b220 msgr2=0x7fb3280a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:30.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7fb3307c1640 1 -- 172.21.15.88:0/2719496935 shutdown_connections 2023-12-08T08:20:30.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7fb3307c1640 1 -- 172.21.15.88:0/2719496935 wait complete. 2023-12-08T08:20:30.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.606+0000 7f52c8edb640 1 -- 172.21.15.88:0/1811245032 >> v2:172.21.15.148:3300/0 conn(0x7f52c406dfa0 msgr2=0x7f52c414da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:30.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.606+0000 7f52c8edb640 1 --2- 172.21.15.88:0/1811245032 >> v2:172.21.15.148:3300/0 conn(0x7f52c406dfa0 0x7f52c414da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7f52c8edb640 1 -- 172.21.15.88:0/1811245032 >> v2:172.21.15.88:3300/0 conn(0x7f52c40c5f60 msgr2=0x7f52c406ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:30.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7f52c8edb640 1 --2- 172.21.15.88:0/1811245032 >> v2:172.21.15.88:3300/0 conn(0x7f52c40c5f60 0x7f52c406ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7f52c8edb640 1 -- 172.21.15.88:0/1811245032 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c41541c0 con 0x7f52c406bf50 2023-12-08T08:20:30.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7f52c37fe640 1 --2- 172.21.15.88:0/1811245032 >> v2:172.21.15.88:3300/0 conn(0x7f52c40c5f60 0x7f52c406ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:30.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7f2d9d432640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d9814daa0 0x7f2d98150320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7f73a659c640 1 --2- 172.21.15.88:0/47403734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a00dbcb0 0x7f73a00e26e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f73a80732e0 tx=0x7f73a8096910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f2213212fdfeeb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7f2d967fc640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2d980a5050 0x7f2d980c49c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:57692/0 (socket says 172.21.15.88:57692) 2023-12-08T08:20:30.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7f2d96ffd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d9814daa0 0x7f2d98150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7f2d977fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2d9806bb40 0x7f2d980c16d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34418/0 (socket says 172.21.15.88:34418) 2023-12-08T08:20:30.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7f73a559a640 1 -- 172.21.15.88:0/47403734 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a8120710 con 0x7f73a00dbcb0 2023-12-08T08:20:30.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7f73a559a640 1 -- 172.21.15.88:0/47403734 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a8120870 con 0x7f73a00dbcb0 2023-12-08T08:20:30.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7fa05159d640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa04c0c5520 0x7fa04c155070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7fa05159d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04c151ec0 con 0x7fa04c151ae0 2023-12-08T08:20:30.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7fa05159d640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04c0c5a90 con 0x7fa04c0c8000 2023-12-08T08:20:30.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7fa05159d640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa04c0c08f0 con 0x7fa04c0c5520 2023-12-08T08:20:30.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7f73a559a640 1 -- 172.21.15.88:0/47403734 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a8120710 con 0x7f73a00dbcb0 2023-12-08T08:20:30.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7fa04affd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa04c151ae0 0x7fa04c0bf570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34426/0 (socket says 172.21.15.88:34426) 2023-12-08T08:20:30.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7fa04affd640 1 -- 172.21.15.88:0/3589255649 learned_addr learned my addr 172.21.15.88:0/3589255649 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:30.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7fb3307c1640 1 Processor -- start 2023-12-08T08:20:30.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7fa04a7fc640 1 --2- 172.21.15.88:0/3589255649 >> v2:172.21.15.148:3300/0 conn(0x7fa04c0c5520 0x7fa04c155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7fb3307c1640 1 -- start start 2023-12-08T08:20:30.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7fa049ffb640 1 -- 172.21.15.88:0/3589255649 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4133935131 0 0) 0x7fa03c001120 con 0x7fa04c151ae0 2023-12-08T08:20:30.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7fa049ffb640 1 -- 172.21.15.88:0/3589255649 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa034003530 con 0x7fa04c151ae0 2023-12-08T08:20:30.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7f73a759e640 1 -- 172.21.15.88:0/47403734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a00dbcb0 msgr2=0x7f73a00e26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7f73a759e640 1 --2- 172.21.15.88:0/47403734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a00dbcb0 0x7f73a00e26e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f73a80732e0 tx=0x7f73a8096910 comp rx=0 tx=0).stop 2023-12-08T08:20:30.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7fa049ffb640 1 -- 172.21.15.88:0/3589255649 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 956194353 0 0) 0x7fa04c0c5a90 con 0x7fa04c0c8000 2023-12-08T08:20:30.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7fa049ffb640 1 -- 172.21.15.88:0/3589255649 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa03c001120 con 0x7fa04c0c8000 2023-12-08T08:20:30.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7f73a759e640 1 -- 172.21.15.88:0/47403734 shutdown_connections 2023-12-08T08:20:30.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7fa04a7fc640 1 -- 172.21.15.88:0/3589255649 >> v1:172.21.15.148:6789/0 conn(0x7fa04c0c8000 legacy=0x7fa04c0c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7fa04a7fc640 1 -- 172.21.15.88:0/3589255649 >> v1:172.21.15.88:6789/0 conn(0x7fa04c151ae0 legacy=0x7fa04c0bf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7f73a759e640 1 --2- 172.21.15.88:0/47403734 >> v2:172.21.15.148:3300/0 conn(0x7f73a000b090 0x7f73a0006e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7f73a759e640 1 --2- 172.21.15.88:0/47403734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a00dbcb0 0x7f73a00e26e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7f73a759e640 1 -- 172.21.15.88:0/47403734 >> 172.21.15.88:0/47403734 conn(0x7f73a0048230 msgr2=0x7f73a0048640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:30.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7f73a759e640 1 -- 172.21.15.88:0/47403734 shutdown_connections 2023-12-08T08:20:30.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7fa04a7fc640 1 -- 172.21.15.88:0/3589255649 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04c0c5d70 con 0x7fa04c0c5520 2023-12-08T08:20:30.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7f2d96ffd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d9814daa0 0x7f2d98150320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:59974/0 (socket says 172.21.15.88:59974) 2023-12-08T08:20:30.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7f73a759e640 1 -- 172.21.15.88:0/47403734 wait complete. 2023-12-08T08:20:30.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.610+0000 7f2d967fc640 1 -- 172.21.15.88:0/4027170874 learned_addr learned my addr 172.21.15.88:0/4027170874 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:30.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7f52c8edb640 1 --2- 172.21.15.88:0/1811245032 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52c406bf50 0x7f52c40c39c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f52c40a85d0 tx=0x7f52bc01c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64811ac11e042e20 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7f2d9d432640 1 -- 172.21.15.88:0/4027170874 --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d980c36d0 con 0x7f2d9806bb40 2023-12-08T08:20:30.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7f2d9d432640 1 -- 172.21.15.88:0/4027170874 --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d980c3920 con 0x7f2d980a5050 2023-12-08T08:20:30.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7f2d9d432640 1 -- 172.21.15.88:0/4027170874 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d980c3c00 con 0x7f2d9814daa0 2023-12-08T08:20:30.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7fb3307c1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb328072810 0x7fb3281429d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7fb3307c1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3280a4f90 0x7fb328142f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7fb3307c1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3280a5370 0x7fb328070c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7f2d96ffd640 1 -- 172.21.15.88:0/4027170874 >> v1:172.21.15.148:6789/0 conn(0x7f2d980a5050 legacy=0x7f2d980c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7fb3307c1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3281edaf0 con 0x7fb3280a4f90 2023-12-08T08:20:30.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7fb3307c1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb328143450 con 0x7fb328072810 2023-12-08T08:20:30.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7f73a759e640 1 Processor -- start 2023-12-08T08:20:30.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7f52c2ffd640 1 -- 172.21.15.88:0/1811245032 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c40c4710 con 0x7f52c406bf50 2023-12-08T08:20:30.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7fb3307c1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb328151dd0 con 0x7fb3280a5370 2023-12-08T08:20:30.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7fb32ed5e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3280a5370 0x7fb328070c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7f52c2ffd640 1 -- 172.21.15.88:0/1811245032 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc0a6710 con 0x7f52c406bf50 2023-12-08T08:20:30.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7f52c2ffd640 1 -- 172.21.15.88:0/1811245032 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc0a6aa0 con 0x7f52c406bf50 2023-12-08T08:20:30.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7f2d95ffb640 1 -- 172.21.15.88:0/4027170874 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2233189169 0 0) 0x7f2d980c3920 con 0x7f2d980a5050 2023-12-08T08:20:30.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7fb32ed5e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3280a5370 0x7fb328070c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:59982/0 (socket says 172.21.15.88:59982) 2023-12-08T08:20:30.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7fb32ed5e640 1 -- 172.21.15.88:0/1576763577 learned_addr learned my addr 172.21.15.88:0/1576763577 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:30.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7f73a759e640 1 -- start start 2023-12-08T08:20:30.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7fb32ed5e640 1 -- 172.21.15.88:0/1576763577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb328072810 msgr2=0x7fb3281429d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-08T08:20:30.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7fb32ed5e640 1 --2- 172.21.15.88:0/1576763577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb328072810 0x7fb3281429d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7fb32ed5e640 1 -- 172.21.15.88:0/1576763577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3280a4f90 msgr2=0x7fb328142f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7fb32ed5e640 1 --2- 172.21.15.88:0/1576763577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3280a4f90 0x7fb328142f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7fb32ed5e640 1 -- 172.21.15.88:0/1576763577 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb318009420 con 0x7fb3280a5370 2023-12-08T08:20:30.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f52ca93e640 1 -- 172.21.15.88:0/1811245032 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52c406bf50 msgr2=0x7f52c40c39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f52ca93e640 1 --2- 172.21.15.88:0/1811245032 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52c406bf50 0x7f52c40c39c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f52c40a85d0 tx=0x7f52bc01c880 comp rx=0 tx=0).stop 2023-12-08T08:20:30.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f52ca93e640 1 -- 172.21.15.88:0/1811245032 shutdown_connections 2023-12-08T08:20:30.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f52ca93e640 1 --2- 172.21.15.88:0/1811245032 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52c406bf50 0x7f52c40c39c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f52ca93e640 1 --2- 172.21.15.88:0/1811245032 >> v2:172.21.15.88:3300/0 conn(0x7f52c40c5f60 0x7f52c406ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f52ca93e640 1 --2- 172.21.15.88:0/1811245032 >> v2:172.21.15.148:3300/0 conn(0x7f52c406dfa0 0x7f52c414da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f52ca93e640 1 -- 172.21.15.88:0/1811245032 >> 172.21.15.88:0/1811245032 conn(0x7f52c406b220 msgr2=0x7f52c40a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:30.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f73a759e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73a00073c0 0x7f73a00d5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f73a759e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a000b090 0x7f73a004a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f73a759e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73a00dbcb0 0x7f73a004add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f73a759e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a0049cb0 con 0x7f73a000b090 2023-12-08T08:20:30.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f73a5d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a000b090 0x7f73a004a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f73a5d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a000b090 0x7f73a004a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41188/0 (socket says 172.21.15.88:41188) 2023-12-08T08:20:30.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f73a759e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a00de510 con 0x7f73a00dbcb0 2023-12-08T08:20:30.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f73a759e640 1 -- 172.21.15.88:0/2509733474 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a0049380 con 0x7f73a00073c0 2023-12-08T08:20:30.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f73a5d9b640 1 -- 172.21.15.88:0/2509733474 learned_addr learned my addr 172.21.15.88:0/2509733474 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:30.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f73a6d9d640 1 --2- 172.21.15.88:0/2509733474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73a00dbcb0 0x7f73a004add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f73a659c640 1 --2- 172.21.15.88:0/2509733474 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73a00073c0 0x7f73a00d5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7fb32ed5e640 1 --2- 172.21.15.88:0/1576763577 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3280a5370 0x7fb328070c20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb32000cb40 tx=0x7fb32000a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7f2d96ffd640 1 -- 172.21.15.88:0/4027170874 >> v1:172.21.15.88:6789/0 conn(0x7f2d9806bb40 legacy=0x7f2d980c16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.614+0000 7f2d96ffd640 1 -- 172.21.15.88:0/4027170874 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d980c3ee0 con 0x7f2d9814daa0 2023-12-08T08:20:30.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7fcfd99f8640 1 Processor -- start 2023-12-08T08:20:30.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7fb31effd640 1 -- 172.21.15.88:0/1576763577 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32000aca0 con 0x7fb3280a5370 2023-12-08T08:20:30.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7fb31effd640 1 -- 172.21.15.88:0/1576763577 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32000ae00 con 0x7fb3280a5370 2023-12-08T08:20:30.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f73a6d9d640 1 -- 172.21.15.88:0/2509733474 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73a00073c0 msgr2=0x7f73a00d5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f73a6d9d640 1 --2- 172.21.15.88:0/2509733474 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73a00073c0 0x7f73a00d5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f73a6d9d640 1 -- 172.21.15.88:0/2509733474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a000b090 msgr2=0x7f73a004a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f73a6d9d640 1 --2- 172.21.15.88:0/2509733474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a000b090 0x7f73a004a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f73a6d9d640 1 -- 172.21.15.88:0/2509733474 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a804f7e0 con 0x7f73a00dbcb0 2023-12-08T08:20:30.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7fcfd99f8640 1 -- start start 2023-12-08T08:20:30.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7fb31effd640 1 -- 172.21.15.88:0/1576763577 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb320012620 con 0x7fb3280a5370 2023-12-08T08:20:30.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7fb3307c1640 1 -- 172.21.15.88:0/1576763577 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3281edfe0 con 0x7fb3280a5370 2023-12-08T08:20:30.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7fb3307c1640 1 -- 172.21.15.88:0/1576763577 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb328143670 con 0x7fb3280a5370 2023-12-08T08:20:30.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f73a6d9d640 1 --2- 172.21.15.88:0/2509733474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73a00dbcb0 0x7f73a004add0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f739c00c390 tx=0x7f739c00c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f7396ffd640 1 -- 172.21.15.88:0/2509733474 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c001d90 con 0x7f73a00dbcb0 2023-12-08T08:20:30.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f7396ffd640 1 -- 172.21.15.88:0/2509733474 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f739c005d10 con 0x7f73a00dbcb0 2023-12-08T08:20:30.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f7396ffd640 1 -- 172.21.15.88:0/2509733474 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c007310 con 0x7f73a00dbcb0 2023-12-08T08:20:30.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f73a759e640 1 -- 172.21.15.88:0/2509733474 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a0049660 con 0x7f73a00dbcb0 2023-12-08T08:20:30.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.618+0000 7f73a759e640 1 -- 172.21.15.88:0/2509733474 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a00d4a20 con 0x7f73a00dbcb0 2023-12-08T08:20:30.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7f52ca93e640 1 -- 172.21.15.88:0/1811245032 shutdown_connections 2023-12-08T08:20:30.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7f52ca93e640 1 -- 172.21.15.88:0/1811245032 wait complete. 2023-12-08T08:20:30.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7fcfd99f8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcfd40c5520 0x7fcfd4155070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7fcfd99f8640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcfd40c8000 0x7fcfd40c8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7fcfd2ffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcfd4151ae0 0x7fcfd40bf570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34442/0 (socket says 172.21.15.88:34442) 2023-12-08T08:20:30.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7fcfd27fc640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcfd40c5520 0x7fcfd4155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7fcfd27fc640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcfd40c5520 0x7fcfd4155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:60006/0 (socket says 172.21.15.88:60006) 2023-12-08T08:20:30.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7fcfd2ffd640 1 -- 172.21.15.88:0/250918951 learned_addr learned my addr 172.21.15.88:0/250918951 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:30.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7fb31effd640 1 -- 172.21.15.88:0/1576763577 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb320007070 con 0x7fb3280a5370 2023-12-08T08:20:30.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7fcfd99f8640 1 -- 172.21.15.88:0/250918951 --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd4151ec0 con 0x7fcfd4151ae0 2023-12-08T08:20:30.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7fcfd99f8640 1 -- 172.21.15.88:0/250918951 --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd40c08f0 con 0x7fcfd40c8000 2023-12-08T08:20:30.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7fcfd99f8640 1 -- 172.21.15.88:0/250918951 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd40c5a90 con 0x7fcfd40c5520 2023-12-08T08:20:30.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7fcfd37fe640 1 --2- 172.21.15.88:0/250918951 >> v2:172.21.15.148:3300/0 conn(0x7fcfd40c8000 0x7fcfd40c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7fa04a7fc640 1 --2- 172.21.15.88:0/3589255649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa04c0c5520 0x7fa04c155070 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa0400097a0 tx=0x7fa04001c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4549f38e5f035eb7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7f73a759e640 1 -- 172.21.15.88:0/2509733474 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a0008c50 con 0x7f73a00dbcb0 2023-12-08T08:20:30.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7fb3307c1640 1 -- 172.21.15.88:0/1576763577 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb328148300 con 0x7fb3280a5370 2023-12-08T08:20:30.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7fb31effd640 1 --2- 172.21.15.88:0/1576763577 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb30c066540 0x7fb30c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7f2d96ffd640 1 --2- 172.21.15.88:0/4027170874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d9814daa0 0x7f2d98150320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c00ba80 tx=0x7f2d8c020c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ca1bde9caf06522 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7f2d95ffb640 1 -- 172.21.15.88:0/4027170874 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c0a9c20 con 0x7f2d9814daa0 2023-12-08T08:20:30.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7f2d95ffb640 1 -- 172.21.15.88:0/4027170874 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c0ad070 con 0x7f2d9814daa0 2023-12-08T08:20:30.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7f2d95ffb640 1 -- 172.21.15.88:0/4027170874 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c0b3400 con 0x7f2d9814daa0 2023-12-08T08:20:30.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7f52ca93e640 1 Processor -- start 2023-12-08T08:20:30.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7f52ca93e640 1 -- start start 2023-12-08T08:20:30.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7f7396ffd640 1 -- 172.21.15.88:0/2509733474 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f739c007470 con 0x7f73a00dbcb0 2023-12-08T08:20:30.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7fcfd37fe640 1 -- 172.21.15.88:0/250918951 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcfd40c5520 msgr2=0x7fcfd4155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:30.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7fcfd37fe640 1 --2- 172.21.15.88:0/250918951 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcfd40c5520 0x7fcfd4155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7fcfd37fe640 1 -- 172.21.15.88:0/250918951 >> v1:172.21.15.88:6789/0 conn(0x7fcfd4151ae0 legacy=0x7fcfd40bf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7fcfd37fe640 1 -- 172.21.15.88:0/250918951 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd40c5d70 con 0x7fcfd40c8000 2023-12-08T08:20:30.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.622+0000 7fcfd27fc640 1 --2- 172.21.15.88:0/250918951 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcfd40c5520 0x7fcfd4155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:30.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7fa049ffb640 1 -- 172.21.15.88:0/3589255649 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0400ad660 con 0x7fa04c0c5520 2023-12-08T08:20:30.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7fa049ffb640 1 -- 172.21.15.88:0/3589255649 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0400ad7c0 con 0x7fa04c0c5520 2023-12-08T08:20:30.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7fa049ffb640 1 -- 172.21.15.88:0/3589255649 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0400adb50 con 0x7fa04c0c5520 2023-12-08T08:20:30.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7f7396ffd640 1 --2- 172.21.15.88:0/2509733474 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7388066540 0x7f7388068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7f2d9d432640 1 -- 172.21.15.88:0/4027170874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d9814daa0 msgr2=0x7f2d98150320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7f2d9d432640 1 --2- 172.21.15.88:0/4027170874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d9814daa0 0x7f2d98150320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c00ba80 tx=0x7f2d8c020c60 comp rx=0 tx=0).stop 2023-12-08T08:20:30.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7f7396ffd640 1 -- 172.21.15.88:0/2509733474 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f739c083200 con 0x7f73a00dbcb0 2023-12-08T08:20:30.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7f2d9d432640 1 -- 172.21.15.88:0/4027170874 shutdown_connections 2023-12-08T08:20:30.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7f2d9d432640 1 --2- 172.21.15.88:0/4027170874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d9814daa0 0x7f2d98150320 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7f2d9d432640 1 -- 172.21.15.88:0/4027170874 >> 172.21.15.88:0/4027170874 conn(0x7f2d980a7520 msgr2=0x7f2d980a7930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:30.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7f52ca93e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52c406bf50 0x7f52c4143b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7f2d9d432640 1 -- 172.21.15.88:0/4027170874 shutdown_connections 2023-12-08T08:20:30.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7f2d9d432640 1 -- 172.21.15.88:0/4027170874 wait complete. 2023-12-08T08:20:30.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7f73a659c640 1 --2- 172.21.15.88:0/2509733474 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7388066540 0x7f7388068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7fa05159d640 1 -- 172.21.15.88:0/3589255649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa04c0c5520 msgr2=0x7fa04c155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7fa05159d640 1 --2- 172.21.15.88:0/3589255649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa04c0c5520 0x7fa04c155070 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa0400097a0 tx=0x7fa04001c360 comp rx=0 tx=0).stop 2023-12-08T08:20:30.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7fa05159d640 1 -- 172.21.15.88:0/3589255649 shutdown_connections 2023-12-08T08:20:30.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7fa05159d640 1 --2- 172.21.15.88:0/3589255649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa04c0c5520 0x7fa04c155070 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7fa05159d640 1 -- 172.21.15.88:0/3589255649 >> 172.21.15.88:0/3589255649 conn(0x7fa04c0ca000 msgr2=0x7fa04c0ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:30.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7fb32e55d640 1 --2- 172.21.15.88:0/1576763577 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb30c066540 0x7fb30c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7f52c3fff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52c406bf50 0x7f52c4143b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7f52c3fff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52c406bf50 0x7f52c4143b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:60016/0 (socket says 172.21.15.88:60016) 2023-12-08T08:20:30.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7f52c3fff640 1 -- 172.21.15.88:0/859076703 learned_addr learned my addr 172.21.15.88:0/859076703 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:30.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7fa05159d640 1 -- 172.21.15.88:0/3589255649 shutdown_connections 2023-12-08T08:20:30.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7f52ca93e640 1 --2- 172.21.15.88:0/859076703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52c406dfa0 0x7f52c40a67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7fb31effd640 1 -- 172.21.15.88:0/1576763577 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb320083e30 con 0x7fb3280a5370 2023-12-08T08:20:30.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7f73a659c640 1 --2- 172.21.15.88:0/2509733474 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7388066540 0x7f7388068a00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f73a000c000 tx=0x7f73a80685c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7f52ca93e640 1 --2- 172.21.15.88:0/859076703 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52c40c5f60 0x7f52c40a6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7f52ca93e640 1 -- 172.21.15.88:0/859076703 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40a7220 con 0x7f52c40c5f60 2023-12-08T08:20:30.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7f52ca93e640 1 -- 172.21.15.88:0/859076703 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c41ee790 con 0x7f52c406dfa0 2023-12-08T08:20:30.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7f52ca93e640 1 -- 172.21.15.88:0/859076703 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c41eed10 con 0x7f52c406bf50 2023-12-08T08:20:30.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7f52c8edb640 1 --2- 172.21.15.88:0/859076703 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52c40c5f60 0x7f52c40a6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7fcfd37fe640 1 --2- 172.21.15.88:0/250918951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfd40c8000 0x7fcfd40c8470 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc009d90 tx=0x7fcfcc01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f21626c95049c18 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7f52c37fe640 1 --2- 172.21.15.88:0/859076703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52c406dfa0 0x7f52c40a67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7f52c3fff640 1 -- 172.21.15.88:0/859076703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52c406dfa0 msgr2=0x7f52c40a67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7f52c3fff640 1 --2- 172.21.15.88:0/859076703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52c406dfa0 0x7f52c40a67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7f52c3fff640 1 -- 172.21.15.88:0/859076703 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52c40c5f60 msgr2=0x7f52c40a6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7f52c3fff640 1 --2- 172.21.15.88:0/859076703 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52c40c5f60 0x7f52c40a6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7f52c3fff640 1 -- 172.21.15.88:0/859076703 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc009a70 con 0x7f52c406bf50 2023-12-08T08:20:30.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7fb32e55d640 1 --2- 172.21.15.88:0/1576763577 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb30c066540 0x7fb30c068a00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb3180ad000 tx=0x7fb3180a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7fcfd1ffb640 1 -- 172.21.15.88:0/250918951 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc0a5950 con 0x7fcfd40c8000 2023-12-08T08:20:30.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.626+0000 7fa05159d640 1 -- 172.21.15.88:0/3589255649 wait complete. 2023-12-08T08:20:30.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7f2d9d432640 1 Processor -- start 2023-12-08T08:20:30.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7f52c3fff640 1 --2- 172.21.15.88:0/859076703 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52c406bf50 0x7f52c4143b10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f52b400e8e0 tx=0x7f52b400eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7f7396ffd640 1 -- 172.21.15.88:0/2509733474 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f739c0507d0 con 0x7f73a00dbcb0 2023-12-08T08:20:30.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7fcfd1ffb640 1 -- 172.21.15.88:0/250918951 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfcc0a5ab0 con 0x7fcfd40c8000 2023-12-08T08:20:30.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7fcfd1ffb640 1 -- 172.21.15.88:0/250918951 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc0a5e40 con 0x7fcfd40c8000 2023-12-08T08:20:30.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7fa05159d640 1 Processor -- start 2023-12-08T08:20:30.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7f2d9d432640 1 -- start start 2023-12-08T08:20:30.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7fb31effd640 1 -- 172.21.15.88:0/1576763577 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb328148300 con 0x7fb3280a5370 2023-12-08T08:20:30.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7fa05159d640 1 -- start start 2023-12-08T08:20:30.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7fa05159d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa04c0c5520 0x7fa04c0c1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7fa05159d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa04c0c8000 0x7fa04c0c2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7fa05159d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa04c151ae0 0x7fa04c150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7fa05159d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c0c3b80 con 0x7fa04c0c5520 2023-12-08T08:20:30.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7fa05159d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c0c10d0 con 0x7fa04c0c8000 2023-12-08T08:20:30.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7fa05159d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c1fa140 con 0x7fa04c151ae0 2023-12-08T08:20:30.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7f2d9d432640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d9806bb40 0x7f2d980713e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7f2d9d432640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d980a5050 0x7f2d980aa190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7f2d9d432640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d9814daa0 0x7f2d98072230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7f2d9d432640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9814d700 con 0x7f2d9814daa0 2023-12-08T08:20:30.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7f2d9d432640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d98071dc0 con 0x7f2d980a5050 2023-12-08T08:20:30.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7f2d9d432640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9814cb80 con 0x7f2d9806bb40 2023-12-08T08:20:30.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7f52c0ff9640 1 -- 172.21.15.88:0/859076703 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b400ca00 con 0x7f52c406bf50 2023-12-08T08:20:30.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7f52c0ff9640 1 -- 172.21.15.88:0/859076703 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b400cb60 con 0x7f52c406bf50 2023-12-08T08:20:30.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7f52c0ff9640 1 -- 172.21.15.88:0/859076703 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b400ced0 con 0x7f52c406bf50 2023-12-08T08:20:30.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7fcfd99f8640 1 -- 172.21.15.88:0/250918951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfd40c8000 msgr2=0x7fcfd40c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7fcfd99f8640 1 --2- 172.21.15.88:0/250918951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfd40c8000 0x7fcfd40c8470 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc009d90 tx=0x7fcfcc01c890 comp rx=0 tx=0).stop 2023-12-08T08:20:30.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7fcfd99f8640 1 -- 172.21.15.88:0/250918951 shutdown_connections 2023-12-08T08:20:30.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7fcfd99f8640 1 --2- 172.21.15.88:0/250918951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfd40c8000 0x7fcfd40c8470 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7fcfd99f8640 1 --2- 172.21.15.88:0/250918951 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcfd40c5520 0x7fcfd4155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7fcfd99f8640 1 -- 172.21.15.88:0/250918951 >> 172.21.15.88:0/250918951 conn(0x7fcfd40ca000 msgr2=0x7fcfd40ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:30.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7f2d96ffd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d9806bb40 0x7f2d980713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7f2d96ffd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d9806bb40 0x7f2d980713e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:60018/0 (socket says 172.21.15.88:60018) 2023-12-08T08:20:30.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7f52ca93e640 1 -- 172.21.15.88:0/859076703 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c4145550 con 0x7f52c406bf50 2023-12-08T08:20:30.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7f2d96ffd640 1 -- 172.21.15.88:0/4147064943 learned_addr learned my addr 172.21.15.88:0/4147064943 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:30.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7fa04a7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa04c0c8000 0x7fa04c0c2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7fa04a7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa04c0c8000 0x7fa04c0c2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:55514/0 (socket says 172.21.15.88:55514) 2023-12-08T08:20:30.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7fa04a7fc640 1 -- 172.21.15.88:0/3204569493 learned_addr learned my addr 172.21.15.88:0/3204569493 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:30.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7f2d967fc640 1 --2- 172.21.15.88:0/4147064943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d980a5050 0x7f2d980aa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7f2d96ffd640 1 -- 172.21.15.88:0/4147064943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d980a5050 msgr2=0x7f2d980aa190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7f2d96ffd640 1 --2- 172.21.15.88:0/4147064943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d980a5050 0x7f2d980aa190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7f2d96ffd640 1 -- 172.21.15.88:0/4147064943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d9814daa0 msgr2=0x7f2d98072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7f2d96ffd640 1 --2- 172.21.15.88:0/4147064943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d9814daa0 0x7f2d98072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7f2d96ffd640 1 -- 172.21.15.88:0/4147064943 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8c00b6b0 con 0x7f2d9806bb40 2023-12-08T08:20:30.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7f52ca93e640 1 -- 172.21.15.88:0/859076703 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c41f0260 con 0x7f52c406bf50 2023-12-08T08:20:30.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7fcfd99f8640 1 -- 172.21.15.88:0/250918951 shutdown_connections 2023-12-08T08:20:30.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.630+0000 7fcfd99f8640 1 -- 172.21.15.88:0/250918951 wait complete. 2023-12-08T08:20:30.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7fcfd99f8640 1 Processor -- start 2023-12-08T08:20:30.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7f2d96ffd640 1 --2- 172.21.15.88:0/4147064943 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d9806bb40 0x7f2d980713e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c00ba80 tx=0x7f2d8c01da00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7fcfd99f8640 1 -- start start 2023-12-08T08:20:30.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7fa04affd640 1 --2- 172.21.15.88:0/3204569493 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa04c0c5520 0x7fa04c0c1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7fcfd99f8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfd40c5520 0x7fcfd41f14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7fcfd99f8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfd40c8000 0x7fcfd41541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7fcfd99f8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcfd4151ae0 0x7fcfd41418a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7fcfd2ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfd40c5520 0x7fcfd41f14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7fcfd99f8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd4157cd0 con 0x7fcfd40c8000 2023-12-08T08:20:30.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7fcfd99f8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd4158830 con 0x7fcfd40c5520 2023-12-08T08:20:30.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7fcfd99f8640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd4142660 con 0x7fcfd4151ae0 2023-12-08T08:20:30.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7fcfd2ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfd40c5520 0x7fcfd41f14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:55534/0 (socket says 172.21.15.88:55534) 2023-12-08T08:20:30.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7fcfd2ffd640 1 -- 172.21.15.88:0/2703985854 learned_addr learned my addr 172.21.15.88:0/2703985854 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:30.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7fcfd27fc640 1 --2- 172.21.15.88:0/2703985854 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfd40c8000 0x7fcfd41541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7f2d7f7fe640 1 -- 172.21.15.88:0/4147064943 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c0116a0 con 0x7f2d9806bb40 2023-12-08T08:20:30.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7f52ca93e640 1 -- 172.21.15.88:0/859076703 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c4067630 con 0x7f52c406bf50 2023-12-08T08:20:30.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7fcfd37fe640 1 --2- 172.21.15.88:0/2703985854 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcfd4151ae0 0x7fcfd41418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7f2d7f7fe640 1 -- 172.21.15.88:0/4147064943 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c0b36f0 con 0x7f2d9806bb40 2023-12-08T08:20:30.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7f2d7f7fe640 1 -- 172.21.15.88:0/4147064943 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c0b3a60 con 0x7f2d9806bb40 2023-12-08T08:20:30.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7f52c0ff9640 1 -- 172.21.15.88:0/859076703 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f52b4013470 con 0x7f52c406bf50 2023-12-08T08:20:30.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.634+0000 7fa04b7fe640 1 --2- 172.21.15.88:0/3204569493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa04c151ae0 0x7fa04c150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7fa04a7fc640 1 -- 172.21.15.88:0/3204569493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa04c151ae0 msgr2=0x7fa04c150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7fa04a7fc640 1 --2- 172.21.15.88:0/3204569493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa04c151ae0 0x7fa04c150890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7fa04a7fc640 1 -- 172.21.15.88:0/3204569493 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa04c0c5520 msgr2=0x7fa04c0c1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7fa04a7fc640 1 --2- 172.21.15.88:0/3204569493 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa04c0c5520 0x7fa04c0c1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7fa04a7fc640 1 -- 172.21.15.88:0/3204569493 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0400093b0 con 0x7fa04c0c8000 2023-12-08T08:20:30.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7fa04b7fe640 1 --2- 172.21.15.88:0/3204569493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa04c151ae0 0x7fa04c150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:30.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7fa04affd640 1 --2- 172.21.15.88:0/3204569493 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa04c0c5520 0x7fa04c0c1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:30.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7fa04a7fc640 1 --2- 172.21.15.88:0/3204569493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa04c0c8000 0x7fa04c0c2310 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa040019f90 tx=0x7fa040019100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7fcfd2ffd640 1 -- 172.21.15.88:0/2703985854 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcfd4151ae0 msgr2=0x7fcfd41418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7fcfd2ffd640 1 --2- 172.21.15.88:0/2703985854 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcfd4151ae0 0x7fcfd41418a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7fcfd2ffd640 1 -- 172.21.15.88:0/2703985854 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfd40c8000 msgr2=0x7fcfd41541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7fcfd2ffd640 1 --2- 172.21.15.88:0/2703985854 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfd40c8000 0x7fcfd41541e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7fcfd2ffd640 1 -- 172.21.15.88:0/2703985854 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc80093b0 con 0x7fcfd40c5520 2023-12-08T08:20:30.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7f2d9d432640 1 -- 172.21.15.88:0/4147064943 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d9814ce60 con 0x7f2d9806bb40 2023-12-08T08:20:30.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7f2d9d432640 1 -- 172.21.15.88:0/4147064943 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9814d420 con 0x7f2d9806bb40 2023-12-08T08:20:30.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7fcfd2ffd640 1 --2- 172.21.15.88:0/2703985854 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfd40c5520 0x7fcfd41f14e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400c500 tx=0x7fcfc400c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7fa0337fe640 1 -- 172.21.15.88:0/3204569493 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0400059a0 con 0x7fa04c0c8000 2023-12-08T08:20:30.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7fa0337fe640 1 -- 172.21.15.88:0/3204569493 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa040005b00 con 0x7fa04c0c8000 2023-12-08T08:20:30.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7fa0337fe640 1 -- 172.21.15.88:0/3204569493 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa040006020 con 0x7fa04c0c8000 2023-12-08T08:20:30.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7fa05159d640 1 -- 172.21.15.88:0/3204569493 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa04c1fa420 con 0x7fa04c0c8000 2023-12-08T08:20:30.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7fa05159d640 1 -- 172.21.15.88:0/3204569493 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa04c0c1320 con 0x7fa04c0c8000 2023-12-08T08:20:30.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7f52c0ff9640 1 --2- 172.21.15.88:0/859076703 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f52b0066570 0x7f52b0068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7f52c0ff9640 1 -- 172.21.15.88:0/859076703 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52b4084060 con 0x7f52c406bf50 2023-12-08T08:20:30.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7f52c37fe640 1 --2- 172.21.15.88:0/859076703 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f52b0066570 0x7f52b0068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7fcfbbfff640 1 -- 172.21.15.88:0/2703985854 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4005cf0 con 0x7fcfd40c5520 2023-12-08T08:20:30.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7fcfbbfff640 1 -- 172.21.15.88:0/2703985854 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc4005e50 con 0x7fcfd40c5520 2023-12-08T08:20:30.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7fcfbbfff640 1 -- 172.21.15.88:0/2703985854 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc40072f0 con 0x7fcfd40c5520 2023-12-08T08:20:30.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.638+0000 7f2d9d432640 1 -- 172.21.15.88:0/4147064943 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d98071f30 con 0x7f2d9806bb40 2023-12-08T08:20:30.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.642+0000 7fcfd99f8640 1 -- 172.21.15.88:0/2703985854 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfcc009a70 con 0x7fcfd40c5520 2023-12-08T08:20:30.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.642+0000 7fcfd99f8640 1 -- 172.21.15.88:0/2703985854 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd41581e0 con 0x7fcfd40c5520 2023-12-08T08:20:30.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.642+0000 7f52c0ff9640 1 -- 172.21.15.88:0/859076703 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f52b4051550 con 0x7f52c406bf50 2023-12-08T08:20:30.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.642+0000 7f2d7f7fe640 1 -- 172.21.15.88:0/4147064943 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2d8c0b3bc0 con 0x7f2d9806bb40 2023-12-08T08:20:30.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.642+0000 7fa0337fe640 1 -- 172.21.15.88:0/3204569493 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa0400b4040 con 0x7fa04c0c8000 2023-12-08T08:20:30.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.642+0000 7fa0337fe640 1 --2- 172.21.15.88:0/3204569493 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa038066540 0x7fa038068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.646+0000 7f2d7f7fe640 1 --2- 172.21.15.88:0/4147064943 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2d840664f0 0x7f2d840689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.646+0000 7fcfb9ffb640 1 -- 172.21.15.88:0/2703985854 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd41516b0 con 0x7fcfd40c5520 2023-12-08T08:20:30.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.642+0000 7fa0337fe640 1 -- 172.21.15.88:0/3204569493 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa04011da90 con 0x7fa04c0c8000 2023-12-08T08:20:30.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.646+0000 7f2d7f7fe640 1 -- 172.21.15.88:0/4147064943 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d8c11eba0 con 0x7f2d9806bb40 2023-12-08T08:20:30.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.646+0000 7fa05159d640 1 -- 172.21.15.88:0/3204569493 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa04c1fa5b0 con 0x7fa04c0c8000 2023-12-08T08:20:30.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.646+0000 7f2d967fc640 1 --2- 172.21.15.88:0/4147064943 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2d840664f0 0x7f2d840689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.646+0000 7f52c37fe640 1 --2- 172.21.15.88:0/859076703 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f52b0066570 0x7f52b0068a30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f52b8006fd0 tx=0x7f52b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.646+0000 7f2d7f7fe640 1 -- 172.21.15.88:0/4147064943 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2d8c0ec1b0 con 0x7f2d9806bb40 2023-12-08T08:20:30.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.646+0000 7f2d967fc640 1 --2- 172.21.15.88:0/4147064943 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2d840664f0 0x7f2d840689b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2d90007fd0 tx=0x7f2d90007ee0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.650+0000 7fa04affd640 1 --2- 172.21.15.88:0/3204569493 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa038066540 0x7fa038068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.650+0000 7fcfbbfff640 1 -- 172.21.15.88:0/2703985854 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcfc4007450 con 0x7fcfd40c5520 2023-12-08T08:20:30.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.650+0000 7fa04affd640 1 --2- 172.21.15.88:0/3204569493 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa038066540 0x7fa038068a00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa03c001380 tx=0x7fa03c007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.650+0000 7fcfbbfff640 1 --2- 172.21.15.88:0/2703985854 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcfc00664a0 0x7fcfc0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.650+0000 7fcfbbfff640 1 -- 172.21.15.88:0/2703985854 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfc4083190 con 0x7fcfd40c5520 2023-12-08T08:20:30.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.650+0000 7fcfd27fc640 1 --2- 172.21.15.88:0/2703985854 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcfc00664a0 0x7fcfc0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.654+0000 7fa0337fe640 1 -- 172.21.15.88:0/3204569493 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa0400b2080 con 0x7fa04c0c8000 2023-12-08T08:20:30.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.654+0000 7fcfd27fc640 1 --2- 172.21.15.88:0/2703985854 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcfc00664a0 0x7fcfc0068960 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcfd40c96e0 tx=0x7fcfc8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.654+0000 7fcfbbfff640 1 -- 172.21.15.88:0/2703985854 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcfc40506b0 con 0x7fcfd40c5520 2023-12-08T08:20:30.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.702+0000 7f96287df640 1 -- 172.21.15.88:0/163082063 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9620067630 con 0x7f9620151ae0 2023-12-08T08:20:30.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.706+0000 7f9616ffd640 1 -- 172.21.15.88:0/163082063 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9618018070 con 0x7f9620151ae0 2023-12-08T08:20:30.709 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2023-12-08T08:20:30.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.706+0000 7f96287df640 1 -- 172.21.15.88:0/163082063 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9604066470 msgr2=0x7f9604068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.706+0000 7f96287df640 1 --2- 172.21.15.88:0/163082063 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9604066470 0x7f9604068930 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f961c000f70 tx=0x7f961c0079c0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.706+0000 7f96287df640 1 -- 172.21.15.88:0/163082063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9620151ae0 msgr2=0x7f96200c3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.710+0000 7f96287df640 1 --2- 172.21.15.88:0/163082063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9620151ae0 0x7f96200c3030 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f961800efc0 tx=0x7f961800c490 comp rx=0 tx=0).stop 2023-12-08T08:20:30.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.714+0000 7f96287df640 1 -- 172.21.15.88:0/163082063 shutdown_connections 2023-12-08T08:20:30.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.714+0000 7f96287df640 1 --2- 172.21.15.88:0/163082063 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9604066470 0x7f9604068930 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.714+0000 7f96287df640 1 --2- 172.21.15.88:0/163082063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9620151ae0 0x7f96200c3030 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.714+0000 7f96287df640 1 --2- 172.21.15.88:0/163082063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96200c8000 0x7f9620153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.714+0000 7f96287df640 1 --2- 172.21.15.88:0/163082063 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96200c5520 0x7f96201f4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.714+0000 7f96287df640 1 -- 172.21.15.88:0/163082063 >> 172.21.15.88:0/163082063 conn(0x7f96200ca000 msgr2=0x7f96200a99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:30.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.714+0000 7f96287df640 1 -- 172.21.15.88:0/163082063 shutdown_connections 2023-12-08T08:20:30.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.714+0000 7f96287df640 1 -- 172.21.15.88:0/163082063 wait complete. 2023-12-08T08:20:30.760 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.0 2023-12-08T08:20:30.760 DEBUG:teuthology.parallel:result is None 2023-12-08T08:20:30.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.802+0000 7f48f2074640 1 -- 172.21.15.88:0/1737300216 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f48ec0674b0 con 0x7f48ec14dac0 2023-12-08T08:20:30.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.802+0000 7f48e1ffb640 1 -- 172.21.15.88:0/1737300216 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f48e8088020 con 0x7f48ec14dac0 2023-12-08T08:20:30.807 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2023-12-08T08:20:30.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.806+0000 7f48f2074640 1 -- 172.21.15.88:0/1737300216 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f48d00664f0 msgr2=0x7f48d00689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.806+0000 7f48f2074640 1 --2- 172.21.15.88:0/1737300216 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f48d00664f0 0x7f48d00689b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f48e401cb20 tx=0x7f48e400e040 comp rx=0 tx=0).stop 2023-12-08T08:20:30.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.806+0000 7f48f2074640 1 -- 172.21.15.88:0/1737300216 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48ec14dac0 msgr2=0x7f48ec156220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.806+0000 7f48f2074640 1 --2- 172.21.15.88:0/1737300216 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48ec14dac0 0x7f48ec156220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f48e800c7f0 tx=0x7f48e800ccb0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.806+0000 7f48f2074640 1 -- 172.21.15.88:0/1737300216 shutdown_connections 2023-12-08T08:20:30.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.806+0000 7f48f2074640 1 --2- 172.21.15.88:0/1737300216 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f48d00664f0 0x7f48d00689b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.806+0000 7f48f2074640 1 --2- 172.21.15.88:0/1737300216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48ec152260 0x7f48ec0a9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.806+0000 7f48f2074640 1 --2- 172.21.15.88:0/1737300216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48ec1518c0 0x7f48ec1ec310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.806+0000 7f48f2074640 1 --2- 172.21.15.88:0/1737300216 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48ec14dac0 0x7f48ec156220 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.806+0000 7f48f2074640 1 -- 172.21.15.88:0/1737300216 >> 172.21.15.88:0/1737300216 conn(0x7f48ec06a5b0 msgr2=0x7f48ec072390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:30.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.806+0000 7f48f2074640 1 -- 172.21.15.88:0/1737300216 shutdown_connections 2023-12-08T08:20:30.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.806+0000 7f48f2074640 1 -- 172.21.15.88:0/1737300216 wait complete. 2023-12-08T08:20:30.830 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.2 2023-12-08T08:20:30.830 DEBUG:teuthology.parallel:result is None 2023-12-08T08:20:30.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.894+0000 7f2d9d432640 1 -- 172.21.15.88:0/4147064943 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2d980674b0 con 0x7f2d9806bb40 2023-12-08T08:20:30.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.894+0000 7f2d7f7fe640 1 -- 172.21.15.88:0/4147064943 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2d8c0af020 con 0x7f2d9806bb40 2023-12-08T08:20:30.900 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2023-12-08T08:20:30.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.898+0000 7f2d9d432640 1 -- 172.21.15.88:0/4147064943 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2d840664f0 msgr2=0x7f2d840689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.898+0000 7f2d9d432640 1 --2- 172.21.15.88:0/4147064943 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2d840664f0 0x7f2d840689b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2d90007fd0 tx=0x7f2d90007ee0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.898+0000 7f2d9d432640 1 -- 172.21.15.88:0/4147064943 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d9806bb40 msgr2=0x7f2d980713e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.898+0000 7f2d9d432640 1 --2- 172.21.15.88:0/4147064943 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d9806bb40 0x7f2d980713e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c00ba80 tx=0x7f2d8c01da00 comp rx=0 tx=0).stop 2023-12-08T08:20:30.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.898+0000 7f2d9d432640 1 -- 172.21.15.88:0/4147064943 shutdown_connections 2023-12-08T08:20:30.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.898+0000 7f2d9d432640 1 --2- 172.21.15.88:0/4147064943 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2d840664f0 0x7f2d840689b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.898+0000 7f2d9d432640 1 --2- 172.21.15.88:0/4147064943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d9814daa0 0x7f2d98072230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.898+0000 7f2d9d432640 1 --2- 172.21.15.88:0/4147064943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d980a5050 0x7f2d980aa190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.898+0000 7f2d9d432640 1 --2- 172.21.15.88:0/4147064943 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2d9806bb40 0x7f2d980713e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.898+0000 7f2d9d432640 1 -- 172.21.15.88:0/4147064943 >> 172.21.15.88:0/4147064943 conn(0x7f2d980a7520 msgr2=0x7f2d980a7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:30.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.898+0000 7f2d9d432640 1 -- 172.21.15.88:0/4147064943 shutdown_connections 2023-12-08T08:20:30.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.898+0000 7f2d9d432640 1 -- 172.21.15.88:0/4147064943 wait complete. 2023-12-08T08:20:30.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.902+0000 7fcfb9ffb640 1 -- 172.21.15.88:0/2703985854 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fcfd4151ec0 con 0x7fcfd40c5520 2023-12-08T08:20:30.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.902+0000 7fcfbbfff640 1 -- 172.21.15.88:0/2703985854 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcfd4151ec0 con 0x7fcfd40c5520 2023-12-08T08:20:30.905 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2023-12-08T08:20:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.902+0000 7fcfb9ffb640 1 -- 172.21.15.88:0/2703985854 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcfc00664a0 msgr2=0x7fcfc0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.902+0000 7fcfb9ffb640 1 --2- 172.21.15.88:0/2703985854 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcfc00664a0 0x7fcfc0068960 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcfd40c96e0 tx=0x7fcfc8008040 comp rx=0 tx=0).stop 2023-12-08T08:20:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.902+0000 7fcfb9ffb640 1 -- 172.21.15.88:0/2703985854 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfd40c5520 msgr2=0x7fcfd41f14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.902+0000 7fcfb9ffb640 1 --2- 172.21.15.88:0/2703985854 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfd40c5520 0x7fcfd41f14e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400c500 tx=0x7fcfc400c9c0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.902+0000 7fcfb9ffb640 1 -- 172.21.15.88:0/2703985854 shutdown_connections 2023-12-08T08:20:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.902+0000 7fcfb9ffb640 1 --2- 172.21.15.88:0/2703985854 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcfc00664a0 0x7fcfc0068960 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.902+0000 7fcfb9ffb640 1 --2- 172.21.15.88:0/2703985854 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcfd4151ae0 0x7fcfd41418a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.902+0000 7fcfb9ffb640 1 --2- 172.21.15.88:0/2703985854 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfd40c8000 0x7fcfd41541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.902+0000 7fcfb9ffb640 1 --2- 172.21.15.88:0/2703985854 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfd40c5520 0x7fcfd41f14e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.902+0000 7fcfb9ffb640 1 -- 172.21.15.88:0/2703985854 >> 172.21.15.88:0/2703985854 conn(0x7fcfd40ca000 msgr2=0x7fcfd415e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:30.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.902+0000 7fcfb9ffb640 1 -- 172.21.15.88:0/2703985854 shutdown_connections 2023-12-08T08:20:30.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.902+0000 7fcfb9ffb640 1 -- 172.21.15.88:0/2703985854 wait complete. 2023-12-08T08:20:30.936 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.3 2023-12-08T08:20:30.936 DEBUG:teuthology.parallel:result is None 2023-12-08T08:20:30.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.4 2023-12-08T08:20:30.937 DEBUG:teuthology.parallel:result is None 2023-12-08T08:20:30.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.946+0000 7f73a759e640 1 -- 172.21.15.88:0/2509733474 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f73a0005370 con 0x7f73a00dbcb0 2023-12-08T08:20:30.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.946+0000 7f7396ffd640 1 -- 172.21.15.88:0/2509733474 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f739c053df0 con 0x7f73a00dbcb0 2023-12-08T08:20:30.951 INFO:teuthology.orchestra.run.smithi088.stdout:55834574857 2023-12-08T08:20:30.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.950+0000 7f73a759e640 1 -- 172.21.15.88:0/2509733474 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7388066540 msgr2=0x7f7388068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.950+0000 7f73a759e640 1 --2- 172.21.15.88:0/2509733474 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7388066540 0x7f7388068a00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f73a000c000 tx=0x7f73a80685c0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.950+0000 7f73a759e640 1 -- 172.21.15.88:0/2509733474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73a00dbcb0 msgr2=0x7f73a004add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.950+0000 7f73a759e640 1 --2- 172.21.15.88:0/2509733474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73a00dbcb0 0x7f73a004add0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f739c00c390 tx=0x7f739c00c850 comp rx=0 tx=0).stop 2023-12-08T08:20:30.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.950+0000 7f73a759e640 1 -- 172.21.15.88:0/2509733474 shutdown_connections 2023-12-08T08:20:30.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.950+0000 7f73a759e640 1 --2- 172.21.15.88:0/2509733474 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7388066540 0x7f7388068a00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.950+0000 7f73a759e640 1 --2- 172.21.15.88:0/2509733474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73a00dbcb0 0x7f73a004add0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.950+0000 7f73a759e640 1 --2- 172.21.15.88:0/2509733474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a000b090 0x7f73a004a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.950+0000 7f73a759e640 1 --2- 172.21.15.88:0/2509733474 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73a00073c0 0x7f73a00d5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.950+0000 7f73a759e640 1 -- 172.21.15.88:0/2509733474 >> 172.21.15.88:0/2509733474 conn(0x7f73a0048230 msgr2=0x7f73a00decf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:30.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.950+0000 7f73a759e640 1 -- 172.21.15.88:0/2509733474 shutdown_connections 2023-12-08T08:20:30.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.950+0000 7f73a759e640 1 -- 172.21.15.88:0/2509733474 wait complete. 2023-12-08T08:20:30.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.970+0000 7f52ca93e640 1 -- 172.21.15.88:0/859076703 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f52c41456e0 con 0x7f52c406bf50 2023-12-08T08:20:30.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.970+0000 7f52c0ff9640 1 -- 172.21.15.88:0/859076703 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f52b4054b70 con 0x7f52c406bf50 2023-12-08T08:20:30.973 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2023-12-08T08:20:30.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.970+0000 7fb3307c1640 1 -- 172.21.15.88:0/1576763577 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb328148300 con 0x7fb3280a5370 2023-12-08T08:20:30.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.970+0000 7fb31effd640 1 -- 172.21.15.88:0/1576763577 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb328148300 con 0x7fb3280a5370 2023-12-08T08:20:30.974 INFO:teuthology.orchestra.run.smithi088.stdout:55834574856 2023-12-08T08:20:30.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.970+0000 7f52ca93e640 1 -- 172.21.15.88:0/859076703 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f52b0066570 msgr2=0x7f52b0068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.970+0000 7f52ca93e640 1 --2- 172.21.15.88:0/859076703 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f52b0066570 0x7f52b0068a30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f52b8006fd0 tx=0x7f52b8008040 comp rx=0 tx=0).stop 2023-12-08T08:20:30.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.970+0000 7f52ca93e640 1 -- 172.21.15.88:0/859076703 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52c406bf50 msgr2=0x7f52c4143b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.970+0000 7f52ca93e640 1 --2- 172.21.15.88:0/859076703 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52c406bf50 0x7f52c4143b10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f52b400e8e0 tx=0x7f52b400eda0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.970+0000 7f52ca93e640 1 -- 172.21.15.88:0/859076703 shutdown_connections 2023-12-08T08:20:30.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.970+0000 7f52ca93e640 1 --2- 172.21.15.88:0/859076703 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f52b0066570 0x7f52b0068a30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.970+0000 7f52ca93e640 1 --2- 172.21.15.88:0/859076703 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52c40c5f60 0x7f52c40a6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.970+0000 7f52ca93e640 1 --2- 172.21.15.88:0/859076703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52c406dfa0 0x7f52c40a67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.970+0000 7f52ca93e640 1 --2- 172.21.15.88:0/859076703 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52c406bf50 0x7f52c4143b10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.970+0000 7f52ca93e640 1 -- 172.21.15.88:0/859076703 >> 172.21.15.88:0/859076703 conn(0x7f52c406b220 msgr2=0x7f52c41459d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:30.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.970+0000 7f52ca93e640 1 -- 172.21.15.88:0/859076703 shutdown_connections 2023-12-08T08:20:30.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.970+0000 7f52ca93e640 1 -- 172.21.15.88:0/859076703 wait complete. 2023-12-08T08:20:30.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.974+0000 7fb3307c1640 1 -- 172.21.15.88:0/1576763577 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb30c066540 msgr2=0x7fb30c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.974+0000 7fb3307c1640 1 --2- 172.21.15.88:0/1576763577 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb30c066540 0x7fb30c068a00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb3180ad000 tx=0x7fb3180a6000 comp rx=0 tx=0).stop 2023-12-08T08:20:30.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.974+0000 7fb3307c1640 1 -- 172.21.15.88:0/1576763577 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3280a5370 msgr2=0x7fb328070c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.974+0000 7fb3307c1640 1 --2- 172.21.15.88:0/1576763577 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3280a5370 0x7fb328070c20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb32000cb40 tx=0x7fb32000a060 comp rx=0 tx=0).stop 2023-12-08T08:20:30.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.974+0000 7fb3307c1640 1 -- 172.21.15.88:0/1576763577 shutdown_connections 2023-12-08T08:20:30.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.974+0000 7fb3307c1640 1 --2- 172.21.15.88:0/1576763577 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb30c066540 0x7fb30c068a00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.974+0000 7fb3307c1640 1 --2- 172.21.15.88:0/1576763577 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb3280a5370 0x7fb328070c20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.974+0000 7fb3307c1640 1 --2- 172.21.15.88:0/1576763577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3280a4f90 0x7fb328142f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.974+0000 7fb3307c1640 1 --2- 172.21.15.88:0/1576763577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb328072810 0x7fb3281429d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.974+0000 7fb3307c1640 1 -- 172.21.15.88:0/1576763577 >> 172.21.15.88:0/1576763577 conn(0x7fb32806b220 msgr2=0x7fb3280a5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:30.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.974+0000 7fb3307c1640 1 -- 172.21.15.88:0/1576763577 shutdown_connections 2023-12-08T08:20:30.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.974+0000 7fb3307c1640 1 -- 172.21.15.88:0/1576763577 wait complete. 2023-12-08T08:20:30.982 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.1 2023-12-08T08:20:30.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.978+0000 7fa05159d640 1 -- 172.21.15.88:0/3204569493 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa04c067630 con 0x7fa04c0c8000 2023-12-08T08:20:30.982 DEBUG:teuthology.parallel:result is None 2023-12-08T08:20:30.983 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2023-12-08T08:20:30.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.978+0000 7fa0337fe640 1 -- 172.21.15.88:0/3204569493 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa0400bb030 con 0x7fa04c0c8000 2023-12-08T08:20:30.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.982+0000 7fa05159d640 1 -- 172.21.15.88:0/3204569493 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa038066540 msgr2=0x7fa038068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.982+0000 7fa05159d640 1 --2- 172.21.15.88:0/3204569493 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa038066540 0x7fa038068a00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa03c001380 tx=0x7fa03c007d40 comp rx=0 tx=0).stop 2023-12-08T08:20:30.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.982+0000 7fa05159d640 1 -- 172.21.15.88:0/3204569493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa04c0c8000 msgr2=0x7fa04c0c2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.982+0000 7fa05159d640 1 --2- 172.21.15.88:0/3204569493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa04c0c8000 0x7fa04c0c2310 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa040019f90 tx=0x7fa040019100 comp rx=0 tx=0).stop 2023-12-08T08:20:30.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.982+0000 7fa05159d640 1 -- 172.21.15.88:0/3204569493 shutdown_connections 2023-12-08T08:20:30.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.982+0000 7fa05159d640 1 --2- 172.21.15.88:0/3204569493 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa038066540 0x7fa038068a00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.982+0000 7fa05159d640 1 --2- 172.21.15.88:0/3204569493 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa04c151ae0 0x7fa04c150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.982+0000 7fa05159d640 1 --2- 172.21.15.88:0/3204569493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa04c0c8000 0x7fa04c0c2310 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.982+0000 7fa05159d640 1 --2- 172.21.15.88:0/3204569493 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa04c0c5520 0x7fa04c0c1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.982+0000 7fa05159d640 1 -- 172.21.15.88:0/3204569493 >> 172.21.15.88:0/3204569493 conn(0x7fa04c0ca000 msgr2=0x7fa04c15f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:30.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.982+0000 7fa05159d640 1 -- 172.21.15.88:0/3204569493 shutdown_connections 2023-12-08T08:20:30.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:30.982+0000 7fa05159d640 1 -- 172.21.15.88:0/3204569493 wait complete. 2023-12-08T08:20:31.009 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.7 2023-12-08T08:20:31.009 DEBUG:teuthology.parallel:result is None 2023-12-08T08:20:31.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.6 2023-12-08T08:20:31.010 DEBUG:teuthology.parallel:result is None 2023-12-08T08:20:31.011 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.5 2023-12-08T08:20:31.011 DEBUG:teuthology.parallel:result is None 2023-12-08T08:20:31.011 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-08T08:20:31.011 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:20:31.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.185+0000 7f418aff5640 1 Processor -- start 2023-12-08T08:20:31.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.185+0000 7f418aff5640 1 -- start start 2023-12-08T08:20:31.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.189+0000 7f418aff5640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f41840bf310 0x7f4184154e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.189+0000 7f418aff5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4184157cf0 con 0x7f41840bee90 2023-12-08T08:20:31.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.189+0000 7f418aff5640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4184157fd0 con 0x7f418414b2a0 2023-12-08T08:20:31.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.189+0000 7f418aff5640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418406c3a0 con 0x7f41840bf310 2023-12-08T08:20:31.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.189+0000 7f417bfff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f41840bee90 0x7f4184154740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34452/0 (socket says 172.21.15.88:34452) 2023-12-08T08:20:31.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.189+0000 7f417bfff640 1 -- 172.21.15.88:0/306679271 learned_addr learned my addr 172.21.15.88:0/306679271 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:31.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.189+0000 7f4189592640 1 --2- 172.21.15.88:0/306679271 >> v2:172.21.15.148:3300/0 conn(0x7f41840bf310 0x7f4184154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.189+0000 7f417b7fe640 1 -- 172.21.15.88:0/306679271 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1687509449 0 0) 0x7f4184157cf0 con 0x7f41840bee90 2023-12-08T08:20:31.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.189+0000 7f417b7fe640 1 -- 172.21.15.88:0/306679271 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f416c003530 con 0x7f41840bee90 2023-12-08T08:20:31.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.189+0000 7f4189592640 1 -- 172.21.15.88:0/306679271 >> v1:172.21.15.148:6789/0 conn(0x7f418414b2a0 legacy=0x7f41840a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.189+0000 7f4189592640 1 -- 172.21.15.88:0/306679271 >> v1:172.21.15.88:6789/0 conn(0x7f41840bee90 legacy=0x7f4184154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.189+0000 7f4189592640 1 -- 172.21.15.88:0/306679271 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41841582b0 con 0x7f41840bf310 2023-12-08T08:20:31.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.193+0000 7f4189592640 1 --2- 172.21.15.88:0/306679271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41840bf310 0x7f4184154e50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f417c009d90 tx=0x7f417c01c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d82b04dcffefed1b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:31.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.193+0000 7f417b7fe640 1 -- 172.21.15.88:0/306679271 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c0a6700 con 0x7f41840bf310 2023-12-08T08:20:31.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.193+0000 7f417b7fe640 1 -- 172.21.15.88:0/306679271 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417c0a6860 con 0x7f41840bf310 2023-12-08T08:20:31.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.193+0000 7f417b7fe640 1 -- 172.21.15.88:0/306679271 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c0a6bd0 con 0x7f41840bf310 2023-12-08T08:20:31.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.193+0000 7f418aff5640 1 -- 172.21.15.88:0/306679271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41840bf310 msgr2=0x7f4184154e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.193+0000 7f418aff5640 1 --2- 172.21.15.88:0/306679271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41840bf310 0x7f4184154e50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f417c009d90 tx=0x7f417c01c830 comp rx=0 tx=0).stop 2023-12-08T08:20:31.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.193+0000 7f418aff5640 1 -- 172.21.15.88:0/306679271 shutdown_connections 2023-12-08T08:20:31.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.193+0000 7f418aff5640 1 --2- 172.21.15.88:0/306679271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41840bf310 0x7f4184154e50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.193+0000 7f418aff5640 1 -- 172.21.15.88:0/306679271 >> 172.21.15.88:0/306679271 conn(0x7f41840a7810 msgr2=0x7f41840a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:31.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.193+0000 7f418aff5640 1 -- 172.21.15.88:0/306679271 shutdown_connections 2023-12-08T08:20:31.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.193+0000 7f418aff5640 1 -- 172.21.15.88:0/306679271 wait complete. 2023-12-08T08:20:31.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.193+0000 7f418aff5640 1 Processor -- start 2023-12-08T08:20:31.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.193+0000 7f418aff5640 1 -- start start 2023-12-08T08:20:31.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.197+0000 7f418aff5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41840bee90 0x7f41841437c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.197+0000 7f418aff5640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41840bf310 0x7f4184143d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.197+0000 7f418aff5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f418414b2a0 0x7f41841ed2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.197+0000 7f418aff5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41840a9590 con 0x7f41840bee90 2023-12-08T08:20:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.197+0000 7f418aff5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41840a8b10 con 0x7f418414b2a0 2023-12-08T08:20:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.197+0000 7f418aff5640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41841ece60 con 0x7f41840bf310 2023-12-08T08:20:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.197+0000 7f4188d91640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41840bee90 0x7f41841437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.197+0000 7f4188d91640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41840bee90 0x7f41841437c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41236/0 (socket says 172.21.15.88:41236) 2023-12-08T08:20:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.197+0000 7f4188d91640 1 -- 172.21.15.88:0/3380235921 learned_addr learned my addr 172.21.15.88:0/3380235921 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.197+0000 7f4189592640 1 --2- 172.21.15.88:0/3380235921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f418414b2a0 0x7f41841ed2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.197+0000 7f4188d91640 1 -- 172.21.15.88:0/3380235921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41840bf310 msgr2=0x7f4184143d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.197+0000 7f417bfff640 1 --2- 172.21.15.88:0/3380235921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41840bf310 0x7f4184143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.197+0000 7f4188d91640 1 --2- 172.21.15.88:0/3380235921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41840bf310 0x7f4184143d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.197+0000 7f4188d91640 1 -- 172.21.15.88:0/3380235921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f418414b2a0 msgr2=0x7f41841ed2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.197+0000 7f4188d91640 1 --2- 172.21.15.88:0/3380235921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f418414b2a0 0x7f41841ed2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.197+0000 7f4188d91640 1 -- 172.21.15.88:0/3380235921 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c009a70 con 0x7f41840bee90 2023-12-08T08:20:31.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.197+0000 7f4189592640 1 --2- 172.21.15.88:0/3380235921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f418414b2a0 0x7f41841ed2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:31.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.197+0000 7f417bfff640 1 --2- 172.21.15.88:0/3380235921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41840bf310 0x7f4184143d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:31.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.197+0000 7f4188d91640 1 --2- 172.21.15.88:0/3380235921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41840bee90 0x7f41841437c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f418000c420 tx=0x7f418000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:31.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.197+0000 7f41797fa640 1 -- 172.21.15.88:0/3380235921 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41800052d0 con 0x7f41840bee90 2023-12-08T08:20:31.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.197+0000 7f41797fa640 1 -- 172.21.15.88:0/3380235921 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4180005430 con 0x7f41840bee90 2023-12-08T08:20:31.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.197+0000 7f418aff5640 1 -- 172.21.15.88:0/3380235921 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4184070fa0 con 0x7f41840bee90 2023-12-08T08:20:31.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.197+0000 7f41797fa640 1 -- 172.21.15.88:0/3380235921 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4180007260 con 0x7f41840bee90 2023-12-08T08:20:31.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.197+0000 7f418aff5640 1 -- 172.21.15.88:0/3380235921 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4184157810 con 0x7f41840bee90 2023-12-08T08:20:31.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.197+0000 7f418aff5640 1 -- 172.21.15.88:0/3380235921 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4184067630 con 0x7f41840bee90 2023-12-08T08:20:31.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.197+0000 7f41797fa640 1 -- 172.21.15.88:0/3380235921 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f41800073c0 con 0x7f41840bee90 2023-12-08T08:20:31.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.201+0000 7f41797fa640 1 --2- 172.21.15.88:0/3380235921 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4170066470 0x7f4170068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.201+0000 7f41797fa640 1 -- 172.21.15.88:0/3380235921 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41800832a0 con 0x7f41840bee90 2023-12-08T08:20:31.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.201+0000 7f417bfff640 1 --2- 172.21.15.88:0/3380235921 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4170066470 0x7f4170068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.201+0000 7f417bfff640 1 --2- 172.21.15.88:0/3380235921 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4170066470 0x7f4170068930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f41840aa3a0 tx=0x7f4174009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:31.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.205+0000 7f41797fa640 1 -- 172.21.15.88:0/3380235921 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4180050710 con 0x7f41840bee90 2023-12-08T08:20:31.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.349+0000 7f418aff5640 1 -- 172.21.15.88:0/3380235921 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f41840a55d0 con 0x7f4170066470 2023-12-08T08:20:31.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.357+0000 7f41797fa640 1 -- 172.21.15.88:0/3380235921 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264679 (secure 0 0 0) 0x7f4174001c90 con 0x7f4170066470 2023-12-08T08:20:31.366 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:31.367 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:20:31.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.361+0000 7f418aff5640 1 -- 172.21.15.88:0/3380235921 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4170066470 msgr2=0x7f4170068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.361+0000 7f418aff5640 1 --2- 172.21.15.88:0/3380235921 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4170066470 0x7f4170068930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f41840aa3a0 tx=0x7f4174009040 comp rx=0 tx=0).stop 2023-12-08T08:20:31.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.361+0000 7f418aff5640 1 -- 172.21.15.88:0/3380235921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41840bee90 msgr2=0x7f41841437c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.361+0000 7f418aff5640 1 --2- 172.21.15.88:0/3380235921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41840bee90 0x7f41841437c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f418000c420 tx=0x7f418000c8e0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.361+0000 7f418aff5640 1 -- 172.21.15.88:0/3380235921 shutdown_connections 2023-12-08T08:20:31.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.361+0000 7f418aff5640 1 --2- 172.21.15.88:0/3380235921 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4170066470 0x7f4170068930 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.361+0000 7f418aff5640 1 --2- 172.21.15.88:0/3380235921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f418414b2a0 0x7f41841ed2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.361+0000 7f418aff5640 1 --2- 172.21.15.88:0/3380235921 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f41840bf310 0x7f4184143d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.361+0000 7f418aff5640 1 --2- 172.21.15.88:0/3380235921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41840bee90 0x7f41841437c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.361+0000 7f418aff5640 1 -- 172.21.15.88:0/3380235921 >> 172.21.15.88:0/3380235921 conn(0x7f41840a7810 msgr2=0x7f418414a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:31.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.361+0000 7f418aff5640 1 -- 172.21.15.88:0/3380235921 shutdown_connections 2023-12-08T08:20:31.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.361+0000 7f418aff5640 1 -- 172.21.15.88:0/3380235921 wait complete. 2023-12-08T08:20:31.385 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-12-08T08:20:30.748453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":217988,"kb_used_data":1792,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756732,"statfs":{"total":773094113280,"available":772870893568,"internally_reserved":0,"allocated":1835008,"data_stored":1752836,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.006928"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957451+0000","last_change":"2023-12-08T08:20:20.526014+0000","last_active":"2023-12-08T08:20:21.957451+0000","last_peered":"2023-12-08T08:20:21.957451+0000","last_clean":"2023-12-08T08:20:21.957451+0000","last_became_active":"2023-12-08T08:20:20.525310+0000","last_became_peered":"2023-12-08T08:20:20.525310+0000","last_unstale":"2023-12-08T08:20:21.957451+0000","last_undegraded":"2023-12-08T08:20:21.957451+0000","last_fullsized":"2023-12-08T08:20:21.957451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:04.925519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503721+0000","last_change":"2023-12-08T08:20:20.515314+0000","last_active":"2023-12-08T08:20:21.503721+0000","last_peered":"2023-12-08T08:20:21.503721+0000","last_clean":"2023-12-08T08:20:21.503721+0000","last_became_active":"2023-12-08T08:20:20.512640+0000","last_became_peered":"2023-12-08T08:20:20.512640+0000","last_unstale":"2023-12-08T08:20:21.503721+0000","last_undegraded":"2023-12-08T08:20:21.503721+0000","last_fullsized":"2023-12-08T08:20:21.503721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:58.484542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713375+0000","last_change":"2023-12-08T08:20:20.506916+0000","last_active":"2023-12-08T08:20:21.713375+0000","last_peered":"2023-12-08T08:20:21.713375+0000","last_clean":"2023-12-08T08:20:21.713375+0000","last_became_active":"2023-12-08T08:20:20.506640+0000","last_became_peered":"2023-12-08T08:20:20.506640+0000","last_unstale":"2023-12-08T08:20:21.713375+0000","last_undegraded":"2023-12-08T08:20:21.713375+0000","last_fullsized":"2023-12-08T08:20:21.713375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:35:49.495548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214804+0000","last_change":"2023-12-08T08:20:20.526830+0000","last_active":"2023-12-08T08:20:22.214804+0000","last_peered":"2023-12-08T08:20:22.214804+0000","last_clean":"2023-12-08T08:20:22.214804+0000","last_became_active":"2023-12-08T08:20:20.522810+0000","last_became_peered":"2023-12-08T08:20:20.522810+0000","last_unstale":"2023-12-08T08:20:22.214804+0000","last_undegraded":"2023-12-08T08:20:22.214804+0000","last_fullsized":"2023-12-08T08:20:22.214804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:12:06.866332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957064+0000","last_change":"2023-12-08T08:20:20.515029+0000","last_active":"2023-12-08T08:20:21.957064+0000","last_peered":"2023-12-08T08:20:21.957064+0000","last_clean":"2023-12-08T08:20:21.957064+0000","last_became_active":"2023-12-08T08:20:20.514648+0000","last_became_peered":"2023-12-08T08:20:20.514648+0000","last_unstale":"2023-12-08T08:20:21.957064+0000","last_undegraded":"2023-12-08T08:20:21.957064+0000","last_fullsized":"2023-12-08T08:20:21.957064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:35:44.144209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214602+0000","last_change":"2023-12-08T08:20:20.519487+0000","last_active":"2023-12-08T08:20:22.214602+0000","last_peered":"2023-12-08T08:20:22.214602+0000","last_clean":"2023-12-08T08:20:22.214602+0000","last_became_active":"2023-12-08T08:20:20.518543+0000","last_became_peered":"2023-12-08T08:20:20.518543+0000","last_unstale":"2023-12-08T08:20:22.214602+0000","last_undegraded":"2023-12-08T08:20:22.214602+0000","last_fullsized":"2023-12-08T08:20:22.214602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:58.484542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.956995+0000","last_change":"2023-12-08T08:20:20.522151+0000","last_active":"2023-12-08T08:20:21.956995+0000","last_peered":"2023-12-08T08:20:21.956995+0000","last_clean":"2023-12-08T08:20:21.956995+0000","last_became_active":"2023-12-08T08:20:20.521736+0000","last_became_peered":"2023-12-08T08:20:20.521736+0000","last_unstale":"2023-12-08T08:20:21.956995+0000","last_undegraded":"2023-12-08T08:20:21.956995+0000","last_fullsized":"2023-12-08T08:20:21.956995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:12:06.866332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213278+0000","last_change":"2023-12-08T08:20:20.529673+0000","last_active":"2023-12-08T08:20:22.213278+0000","last_peered":"2023-12-08T08:20:22.213278+0000","last_clean":"2023-12-08T08:20:22.213278+0000","last_became_active":"2023-12-08T08:20:20.529379+0000","last_became_peered":"2023-12-08T08:20:20.529379+0000","last_unstale":"2023-12-08T08:20:22.213278+0000","last_undegraded":"2023-12-08T08:20:22.213278+0000","last_fullsized":"2023-12-08T08:20:22.213278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:35:49.495548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957552+0000","last_change":"2023-12-08T08:20:20.525718+0000","last_active":"2023-12-08T08:20:21.957552+0000","last_peered":"2023-12-08T08:20:21.957552+0000","last_clean":"2023-12-08T08:20:21.957552+0000","last_became_active":"2023-12-08T08:20:20.524881+0000","last_became_peered":"2023-12-08T08:20:20.524881+0000","last_unstale":"2023-12-08T08:20:21.957552+0000","last_undegraded":"2023-12-08T08:20:21.957552+0000","last_fullsized":"2023-12-08T08:20:21.957552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:18:00.048146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672553+0000","last_change":"2023-12-08T08:20:20.527390+0000","last_active":"2023-12-08T08:20:21.672553+0000","last_peered":"2023-12-08T08:20:21.672553+0000","last_clean":"2023-12-08T08:20:21.672553+0000","last_became_active":"2023-12-08T08:20:20.527081+0000","last_became_peered":"2023-12-08T08:20:20.527081+0000","last_unstale":"2023-12-08T08:20:21.672553+0000","last_undegraded":"2023-12-08T08:20:21.672553+0000","last_fullsized":"2023-12-08T08:20:21.672553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:58.484542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672274+0000","last_change":"2023-12-08T08:20:20.529477+0000","last_active":"2023-12-08T08:20:21.672274+0000","last_peered":"2023-12-08T08:20:21.672274+0000","last_clean":"2023-12-08T08:20:21.672274+0000","last_became_active":"2023-12-08T08:20:20.529203+0000","last_became_peered":"2023-12-08T08:20:20.529203+0000","last_unstale":"2023-12-08T08:20:21.672274+0000","last_undegraded":"2023-12-08T08:20:21.672274+0000","last_fullsized":"2023-12-08T08:20:21.672274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:55.605759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.510398+0000","last_change":"2023-12-08T08:20:20.513949+0000","last_active":"2023-12-08T08:20:21.510398+0000","last_peered":"2023-12-08T08:20:21.510398+0000","last_clean":"2023-12-08T08:20:21.510398+0000","last_became_active":"2023-12-08T08:20:20.509753+0000","last_became_peered":"2023-12-08T08:20:20.509753+0000","last_unstale":"2023-12-08T08:20:21.510398+0000","last_undegraded":"2023-12-08T08:20:21.510398+0000","last_fullsized":"2023-12-08T08:20:21.510398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:14:24.713628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213771+0000","last_change":"2023-12-08T08:20:20.528560+0000","last_active":"2023-12-08T08:20:22.213771+0000","last_peered":"2023-12-08T08:20:22.213771+0000","last_clean":"2023-12-08T08:20:22.213771+0000","last_became_active":"2023-12-08T08:20:20.528307+0000","last_became_peered":"2023-12-08T08:20:20.528307+0000","last_unstale":"2023-12-08T08:20:22.213771+0000","last_undegraded":"2023-12-08T08:20:22.213771+0000","last_fullsized":"2023-12-08T08:20:22.213771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:58.484542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713275+0000","last_change":"2023-12-08T08:20:20.512007+0000","last_active":"2023-12-08T08:20:21.713275+0000","last_peered":"2023-12-08T08:20:21.713275+0000","last_clean":"2023-12-08T08:20:21.713275+0000","last_became_active":"2023-12-08T08:20:20.511687+0000","last_became_peered":"2023-12-08T08:20:20.511687+0000","last_unstale":"2023-12-08T08:20:21.713275+0000","last_undegraded":"2023-12-08T08:20:21.713275+0000","last_fullsized":"2023-12-08T08:20:21.713275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:07:36.889410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503433+0000","last_change":"2023-12-08T08:20:20.515089+0000","last_active":"2023-12-08T08:20:21.503433+0000","last_peered":"2023-12-08T08:20:21.503433+0000","last_clean":"2023-12-08T08:20:21.503433+0000","last_became_active":"2023-12-08T08:20:20.514657+0000","last_became_peered":"2023-12-08T08:20:20.514657+0000","last_unstale":"2023-12-08T08:20:21.503433+0000","last_undegraded":"2023-12-08T08:20:21.503433+0000","last_fullsized":"2023-12-08T08:20:21.503433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:55.605759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214490+0000","last_change":"2023-12-08T08:20:20.518410+0000","last_active":"2023-12-08T08:20:22.214490+0000","last_peered":"2023-12-08T08:20:22.214490+0000","last_clean":"2023-12-08T08:20:22.214490+0000","last_became_active":"2023-12-08T08:20:20.518144+0000","last_became_peered":"2023-12-08T08:20:20.518144+0000","last_unstale":"2023-12-08T08:20:22.214490+0000","last_undegraded":"2023-12-08T08:20:22.214490+0000","last_fullsized":"2023-12-08T08:20:22.214490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:16:30.037506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.215317+0000","last_change":"2023-12-08T08:20:20.524234+0000","last_active":"2023-12-08T08:20:22.215317+0000","last_peered":"2023-12-08T08:20:22.215317+0000","last_clean":"2023-12-08T08:20:22.215317+0000","last_became_active":"2023-12-08T08:20:20.523988+0000","last_became_peered":"2023-12-08T08:20:20.523988+0000","last_unstale":"2023-12-08T08:20:22.215317+0000","last_undegraded":"2023-12-08T08:20:22.215317+0000","last_fullsized":"2023-12-08T08:20:22.215317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:04.925519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213689+0000","last_change":"2023-12-08T08:20:20.509163+0000","last_active":"2023-12-08T08:20:22.213689+0000","last_peered":"2023-12-08T08:20:22.213689+0000","last_clean":"2023-12-08T08:20:22.213689+0000","last_became_active":"2023-12-08T08:20:20.508891+0000","last_became_peered":"2023-12-08T08:20:20.508891+0000","last_unstale":"2023-12-08T08:20:22.213689+0000","last_undegraded":"2023-12-08T08:20:22.213689+0000","last_fullsized":"2023-12-08T08:20:22.213689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:14:24.713628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957438+0000","last_change":"2023-12-08T08:20:20.523793+0000","last_active":"2023-12-08T08:20:21.957438+0000","last_peered":"2023-12-08T08:20:21.957438+0000","last_clean":"2023-12-08T08:20:21.957438+0000","last_became_active":"2023-12-08T08:20:20.523526+0000","last_became_peered":"2023-12-08T08:20:20.523526+0000","last_unstale":"2023-12-08T08:20:21.957438+0000","last_undegraded":"2023-12-08T08:20:21.957438+0000","last_fullsized":"2023-12-08T08:20:21.957438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:52:56.239687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672374+0000","last_change":"2023-12-08T08:20:20.515864+0000","last_active":"2023-12-08T08:20:21.672374+0000","last_peered":"2023-12-08T08:20:21.672374+0000","last_clean":"2023-12-08T08:20:21.672374+0000","last_became_active":"2023-12-08T08:20:20.515572+0000","last_became_peered":"2023-12-08T08:20:20.515572+0000","last_unstale":"2023-12-08T08:20:21.672374+0000","last_undegraded":"2023-12-08T08:20:21.672374+0000","last_fullsized":"2023-12-08T08:20:21.672374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:16:30.037506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713276+0000","last_change":"2023-12-08T08:20:20.514531+0000","last_active":"2023-12-08T08:20:21.713276+0000","last_peered":"2023-12-08T08:20:21.713276+0000","last_clean":"2023-12-08T08:20:21.713276+0000","last_became_active":"2023-12-08T08:20:20.514275+0000","last_became_peered":"2023-12-08T08:20:20.514275+0000","last_unstale":"2023-12-08T08:20:21.713276+0000","last_undegraded":"2023-12-08T08:20:21.713276+0000","last_fullsized":"2023-12-08T08:20:21.713276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:24:45.197087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214695+0000","last_change":"2023-12-08T08:20:20.523484+0000","last_active":"2023-12-08T08:20:22.214695+0000","last_peered":"2023-12-08T08:20:22.214695+0000","last_clean":"2023-12-08T08:20:22.214695+0000","last_became_active":"2023-12-08T08:20:20.523161+0000","last_became_peered":"2023-12-08T08:20:20.523161+0000","last_unstale":"2023-12-08T08:20:22.214695+0000","last_undegraded":"2023-12-08T08:20:22.214695+0000","last_fullsized":"2023-12-08T08:20:22.214695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:34:40.228006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213314+0000","last_change":"2023-12-08T08:20:20.530871+0000","last_active":"2023-12-08T08:20:22.213314+0000","last_peered":"2023-12-08T08:20:22.213314+0000","last_clean":"2023-12-08T08:20:22.213314+0000","last_became_active":"2023-12-08T08:20:20.530604+0000","last_became_peered":"2023-12-08T08:20:20.530604+0000","last_unstale":"2023-12-08T08:20:22.213314+0000","last_undegraded":"2023-12-08T08:20:22.213314+0000","last_fullsized":"2023-12-08T08:20:22.213314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:55.605759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214573+0000","last_change":"2023-12-08T08:20:20.522332+0000","last_active":"2023-12-08T08:20:22.214573+0000","last_peered":"2023-12-08T08:20:22.214573+0000","last_clean":"2023-12-08T08:20:22.214573+0000","last_became_active":"2023-12-08T08:20:20.522036+0000","last_became_peered":"2023-12-08T08:20:20.522036+0000","last_unstale":"2023-12-08T08:20:22.214573+0000","last_undegraded":"2023-12-08T08:20:22.214573+0000","last_fullsized":"2023-12-08T08:20:22.214573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:41:18.155537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213974+0000","last_change":"2023-12-08T08:20:20.528859+0000","last_active":"2023-12-08T08:20:22.213974+0000","last_peered":"2023-12-08T08:20:22.213974+0000","last_clean":"2023-12-08T08:20:22.213974+0000","last_became_active":"2023-12-08T08:20:20.528595+0000","last_became_peered":"2023-12-08T08:20:20.528595+0000","last_unstale":"2023-12-08T08:20:22.213974+0000","last_undegraded":"2023-12-08T08:20:22.213974+0000","last_fullsized":"2023-12-08T08:20:22.213974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:12:06.866332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672548+0000","last_change":"2023-12-08T08:20:20.519122+0000","last_active":"2023-12-08T08:20:21.672548+0000","last_peered":"2023-12-08T08:20:21.672548+0000","last_clean":"2023-12-08T08:20:21.672548+0000","last_became_active":"2023-12-08T08:20:20.518790+0000","last_became_peered":"2023-12-08T08:20:20.518790+0000","last_unstale":"2023-12-08T08:20:21.672548+0000","last_undegraded":"2023-12-08T08:20:21.672548+0000","last_fullsized":"2023-12-08T08:20:21.672548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:41:18.155537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503627+0000","last_change":"2023-12-08T08:20:20.511207+0000","last_active":"2023-12-08T08:20:21.503627+0000","last_peered":"2023-12-08T08:20:21.503627+0000","last_clean":"2023-12-08T08:20:21.503627+0000","last_became_active":"2023-12-08T08:20:20.509613+0000","last_became_peered":"2023-12-08T08:20:20.509613+0000","last_unstale":"2023-12-08T08:20:21.503627+0000","last_undegraded":"2023-12-08T08:20:21.503627+0000","last_fullsized":"2023-12-08T08:20:21.503627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:41:18.155537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213986+0000","last_change":"2023-12-08T08:20:20.529699+0000","last_active":"2023-12-08T08:20:22.213986+0000","last_peered":"2023-12-08T08:20:22.213986+0000","last_clean":"2023-12-08T08:20:22.213986+0000","last_became_active":"2023-12-08T08:20:20.528976+0000","last_became_peered":"2023-12-08T08:20:20.528976+0000","last_unstale":"2023-12-08T08:20:22.213986+0000","last_undegraded":"2023-12-08T08:20:22.213986+0000","last_fullsized":"2023-12-08T08:20:22.213986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:35:44.144209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713583+0000","last_change":"2023-12-08T08:20:20.513060+0000","last_active":"2023-12-08T08:20:21.713583+0000","last_peered":"2023-12-08T08:20:21.713583+0000","last_clean":"2023-12-08T08:20:21.713583+0000","last_became_active":"2023-12-08T08:20:20.512637+0000","last_became_peered":"2023-12-08T08:20:20.512637+0000","last_unstale":"2023-12-08T08:20:21.713583+0000","last_undegraded":"2023-12-08T08:20:21.713583+0000","last_fullsized":"2023-12-08T08:20:21.713583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:58.484542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214832+0000","last_change":"2023-12-08T08:20:20.521987+0000","last_active":"2023-12-08T08:20:22.214832+0000","last_peered":"2023-12-08T08:20:22.214832+0000","last_clean":"2023-12-08T08:20:22.214832+0000","last_became_active":"2023-12-08T08:20:20.521639+0000","last_became_peered":"2023-12-08T08:20:20.521639+0000","last_unstale":"2023-12-08T08:20:22.214832+0000","last_undegraded":"2023-12-08T08:20:22.214832+0000","last_fullsized":"2023-12-08T08:20:22.214832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:35:44.144209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213304+0000","last_change":"2023-12-08T08:20:20.518482+0000","last_active":"2023-12-08T08:20:22.213304+0000","last_peered":"2023-12-08T08:20:22.213304+0000","last_clean":"2023-12-08T08:20:22.213304+0000","last_became_active":"2023-12-08T08:20:20.518190+0000","last_became_peered":"2023-12-08T08:20:20.518190+0000","last_unstale":"2023-12-08T08:20:22.213304+0000","last_undegraded":"2023-12-08T08:20:22.213304+0000","last_fullsized":"2023-12-08T08:20:22.213304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:14:43.007025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672162+0000","last_change":"2023-12-08T08:20:20.515939+0000","last_active":"2023-12-08T08:20:21.672162+0000","last_peered":"2023-12-08T08:20:21.672162+0000","last_clean":"2023-12-08T08:20:21.672162+0000","last_became_active":"2023-12-08T08:20:20.515314+0000","last_became_peered":"2023-12-08T08:20:20.515314+0000","last_unstale":"2023-12-08T08:20:21.672162+0000","last_undegraded":"2023-12-08T08:20:21.672162+0000","last_fullsized":"2023-12-08T08:20:21.672162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:35:49.495548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.510090+0000","last_change":"2023-12-08T08:20:20.517465+0000","last_active":"2023-12-08T08:20:21.510090+0000","last_peered":"2023-12-08T08:20:21.510090+0000","last_clean":"2023-12-08T08:20:21.510090+0000","last_became_active":"2023-12-08T08:20:20.517151+0000","last_became_peered":"2023-12-08T08:20:20.517151+0000","last_unstale":"2023-12-08T08:20:21.510090+0000","last_undegraded":"2023-12-08T08:20:21.510090+0000","last_fullsized":"2023-12-08T08:20:21.510090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:17:32.867357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213861+0000","last_change":"2023-12-08T08:20:20.127114+0000","last_active":"2023-12-08T08:20:22.213861+0000","last_peered":"2023-12-08T08:20:22.213861+0000","last_clean":"2023-12-08T08:20:22.213861+0000","last_became_active":"2023-12-08T08:20:20.126718+0000","last_became_peered":"2023-12-08T08:20:20.126718+0000","last_unstale":"2023-12-08T08:20:22.213861+0000","last_undegraded":"2023-12-08T08:20:22.213861+0000","last_fullsized":"2023-12-08T08:20:22.213861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:06:20.375858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713403+0000","last_change":"2023-12-08T08:20:20.511756+0000","last_active":"2023-12-08T08:20:21.713403+0000","last_peered":"2023-12-08T08:20:21.713403+0000","last_clean":"2023-12-08T08:20:21.713403+0000","last_became_active":"2023-12-08T08:20:20.511411+0000","last_became_peered":"2023-12-08T08:20:20.511411+0000","last_unstale":"2023-12-08T08:20:21.713403+0000","last_undegraded":"2023-12-08T08:20:21.713403+0000","last_fullsized":"2023-12-08T08:20:21.713403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:55.605759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672137+0000","last_change":"2023-12-08T08:20:20.119404+0000","last_active":"2023-12-08T08:20:21.672137+0000","last_peered":"2023-12-08T08:20:21.672137+0000","last_clean":"2023-12-08T08:20:21.672137+0000","last_became_active":"2023-12-08T08:20:20.119117+0000","last_became_peered":"2023-12-08T08:20:20.119117+0000","last_unstale":"2023-12-08T08:20:21.672137+0000","last_undegraded":"2023-12-08T08:20:21.672137+0000","last_fullsized":"2023-12-08T08:20:21.672137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:06:20.375858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213309+0000","last_change":"2023-12-08T08:20:20.118455+0000","last_active":"2023-12-08T08:20:22.213309+0000","last_peered":"2023-12-08T08:20:22.213309+0000","last_clean":"2023-12-08T08:20:22.213309+0000","last_became_active":"2023-12-08T08:20:20.118187+0000","last_became_peered":"2023-12-08T08:20:20.118187+0000","last_unstale":"2023-12-08T08:20:22.213309+0000","last_undegraded":"2023-12-08T08:20:22.213309+0000","last_fullsized":"2023-12-08T08:20:22.213309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:50:44.025429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213363+0000","last_change":"2023-12-08T08:20:20.519950+0000","last_active":"2023-12-08T08:20:22.213363+0000","last_peered":"2023-12-08T08:20:22.213363+0000","last_clean":"2023-12-08T08:20:22.213363+0000","last_became_active":"2023-12-08T08:20:20.519682+0000","last_became_peered":"2023-12-08T08:20:20.519682+0000","last_unstale":"2023-12-08T08:20:22.213363+0000","last_undegraded":"2023-12-08T08:20:22.213363+0000","last_fullsized":"2023-12-08T08:20:22.213363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:22.960211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214641+0000","last_change":"2023-12-08T08:20:20.125917+0000","last_active":"2023-12-08T08:20:22.214641+0000","last_peered":"2023-12-08T08:20:22.214641+0000","last_clean":"2023-12-08T08:20:22.214641+0000","last_became_active":"2023-12-08T08:20:20.125471+0000","last_became_peered":"2023-12-08T08:20:20.125471+0000","last_unstale":"2023-12-08T08:20:22.214641+0000","last_undegraded":"2023-12-08T08:20:22.214641+0000","last_fullsized":"2023-12-08T08:20:22.214641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:07:35.883797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503438+0000","last_change":"2023-12-08T08:20:20.514082+0000","last_active":"2023-12-08T08:20:21.503438+0000","last_peered":"2023-12-08T08:20:21.503438+0000","last_clean":"2023-12-08T08:20:21.503438+0000","last_became_active":"2023-12-08T08:20:20.511617+0000","last_became_peered":"2023-12-08T08:20:20.511617+0000","last_unstale":"2023-12-08T08:20:21.503438+0000","last_undegraded":"2023-12-08T08:20:21.503438+0000","last_fullsized":"2023-12-08T08:20:21.503438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:35:49.495548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672445+0000","last_change":"2023-12-08T08:20:20.117986+0000","last_active":"2023-12-08T08:20:21.672445+0000","last_peered":"2023-12-08T08:20:21.672445+0000","last_clean":"2023-12-08T08:20:21.672445+0000","last_became_active":"2023-12-08T08:20:20.117643+0000","last_became_peered":"2023-12-08T08:20:20.117643+0000","last_unstale":"2023-12-08T08:20:21.672445+0000","last_undegraded":"2023-12-08T08:20:21.672445+0000","last_fullsized":"2023-12-08T08:20:21.672445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:51:02.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.215153+0000","last_change":"2023-12-08T08:20:20.526658+0000","last_active":"2023-12-08T08:20:22.215153+0000","last_peered":"2023-12-08T08:20:22.215153+0000","last_clean":"2023-12-08T08:20:22.215153+0000","last_became_active":"2023-12-08T08:20:20.525963+0000","last_became_peered":"2023-12-08T08:20:20.525963+0000","last_unstale":"2023-12-08T08:20:22.215153+0000","last_undegraded":"2023-12-08T08:20:22.215153+0000","last_fullsized":"2023-12-08T08:20:22.215153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:34:32.364346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.215087+0000","last_change":"2023-12-08T08:20:20.119060+0000","last_active":"2023-12-08T08:20:22.215087+0000","last_peered":"2023-12-08T08:20:22.215087+0000","last_clean":"2023-12-08T08:20:22.215087+0000","last_became_active":"2023-12-08T08:20:20.118701+0000","last_became_peered":"2023-12-08T08:20:20.118701+0000","last_unstale":"2023-12-08T08:20:22.215087+0000","last_undegraded":"2023-12-08T08:20:22.215087+0000","last_fullsized":"2023-12-08T08:20:22.215087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:21.954598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713519+0000","last_change":"2023-12-08T08:20:20.530125+0000","last_active":"2023-12-08T08:20:21.713519+0000","last_peered":"2023-12-08T08:20:21.713519+0000","last_clean":"2023-12-08T08:20:21.713519+0000","last_became_active":"2023-12-08T08:20:20.529601+0000","last_became_peered":"2023-12-08T08:20:20.529601+0000","last_unstale":"2023-12-08T08:20:21.713519+0000","last_undegraded":"2023-12-08T08:20:21.713519+0000","last_fullsized":"2023-12-08T08:20:21.713519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:16:30.037506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503623+0000","last_change":"2023-12-08T08:20:20.118338+0000","last_active":"2023-12-08T08:20:21.503623+0000","last_peered":"2023-12-08T08:20:21.503623+0000","last_clean":"2023-12-08T08:20:21.503623+0000","last_became_active":"2023-12-08T08:20:20.118032+0000","last_became_peered":"2023-12-08T08:20:20.118032+0000","last_unstale":"2023-12-08T08:20:21.503623+0000","last_undegraded":"2023-12-08T08:20:21.503623+0000","last_fullsized":"2023-12-08T08:20:21.503623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:14:41.931523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.510480+0000","last_change":"2023-12-08T08:20:20.521236+0000","last_active":"2023-12-08T08:20:21.510480+0000","last_peered":"2023-12-08T08:20:21.510480+0000","last_clean":"2023-12-08T08:20:21.510480+0000","last_became_active":"2023-12-08T08:20:20.520900+0000","last_became_peered":"2023-12-08T08:20:20.520900+0000","last_unstale":"2023-12-08T08:20:21.510480+0000","last_undegraded":"2023-12-08T08:20:21.510480+0000","last_fullsized":"2023-12-08T08:20:21.510480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:51:03.805815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672410+0000","last_change":"2023-12-08T08:20:20.126955+0000","last_active":"2023-12-08T08:20:21.672410+0000","last_peered":"2023-12-08T08:20:21.672410+0000","last_clean":"2023-12-08T08:20:21.672410+0000","last_became_active":"2023-12-08T08:20:20.126629+0000","last_became_peered":"2023-12-08T08:20:20.126629+0000","last_unstale":"2023-12-08T08:20:21.672410+0000","last_undegraded":"2023-12-08T08:20:21.672410+0000","last_fullsized":"2023-12-08T08:20:21.672410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:14:41.931523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957190+0000","last_change":"2023-12-08T08:20:20.518442+0000","last_active":"2023-12-08T08:20:21.957190+0000","last_peered":"2023-12-08T08:20:21.957190+0000","last_clean":"2023-12-08T08:20:21.957190+0000","last_became_active":"2023-12-08T08:20:20.518033+0000","last_became_peered":"2023-12-08T08:20:20.518033+0000","last_unstale":"2023-12-08T08:20:21.957190+0000","last_undegraded":"2023-12-08T08:20:21.957190+0000","last_fullsized":"2023-12-08T08:20:21.957190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:34:32.364346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713480+0000","last_change":"2023-12-08T08:20:20.110330+0000","last_active":"2023-12-08T08:20:21.713480+0000","last_peered":"2023-12-08T08:20:21.713480+0000","last_clean":"2023-12-08T08:20:21.713480+0000","last_became_active":"2023-12-08T08:20:20.109870+0000","last_became_peered":"2023-12-08T08:20:20.109870+0000","last_unstale":"2023-12-08T08:20:21.713480+0000","last_undegraded":"2023-12-08T08:20:21.713480+0000","last_fullsized":"2023-12-08T08:20:21.713480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:01:11.293463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713167+0000","last_change":"2023-12-08T08:20:20.514723+0000","last_active":"2023-12-08T08:20:21.713167+0000","last_peered":"2023-12-08T08:20:21.713167+0000","last_clean":"2023-12-08T08:20:21.713167+0000","last_became_active":"2023-12-08T08:20:20.514377+0000","last_became_peered":"2023-12-08T08:20:20.514377+0000","last_unstale":"2023-12-08T08:20:21.713167+0000","last_undegraded":"2023-12-08T08:20:21.713167+0000","last_fullsized":"2023-12-08T08:20:21.713167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:06:21.381472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214843+0000","last_change":"2023-12-08T08:20:20.129684+0000","last_active":"2023-12-08T08:20:22.214843+0000","last_peered":"2023-12-08T08:20:22.214843+0000","last_clean":"2023-12-08T08:20:22.214843+0000","last_became_active":"2023-12-08T08:20:20.129423+0000","last_became_peered":"2023-12-08T08:20:20.129423+0000","last_unstale":"2023-12-08T08:20:22.214843+0000","last_undegraded":"2023-12-08T08:20:22.214843+0000","last_fullsized":"2023-12-08T08:20:22.214843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:24:44.191473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957171+0000","last_change":"2023-12-08T08:20:20.533071+0000","last_active":"2023-12-08T08:20:21.957171+0000","last_peered":"2023-12-08T08:20:21.957171+0000","last_clean":"2023-12-08T08:20:21.957171+0000","last_became_active":"2023-12-08T08:20:20.532811+0000","last_became_peered":"2023-12-08T08:20:20.532811+0000","last_unstale":"2023-12-08T08:20:21.957171+0000","last_undegraded":"2023-12-08T08:20:21.957171+0000","last_fullsized":"2023-12-08T08:20:21.957171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:06.439860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672150+0000","last_change":"2023-12-08T08:20:20.113477+0000","last_active":"2023-12-08T08:20:21.672150+0000","last_peered":"2023-12-08T08:20:21.672150+0000","last_clean":"2023-12-08T08:20:21.672150+0000","last_became_active":"2023-12-08T08:20:20.113149+0000","last_became_peered":"2023-12-08T08:20:20.113149+0000","last_unstale":"2023-12-08T08:20:21.672150+0000","last_undegraded":"2023-12-08T08:20:21.672150+0000","last_fullsized":"2023-12-08T08:20:21.672150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:14:23.708015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672290+0000","last_change":"2023-12-08T08:20:20.519693+0000","last_active":"2023-12-08T08:20:21.672290+0000","last_peered":"2023-12-08T08:20:21.672290+0000","last_clean":"2023-12-08T08:20:21.672290+0000","last_became_active":"2023-12-08T08:20:20.519418+0000","last_became_peered":"2023-12-08T08:20:20.519418+0000","last_unstale":"2023-12-08T08:20:21.672290+0000","last_undegraded":"2023-12-08T08:20:21.672290+0000","last_fullsized":"2023-12-08T08:20:21.672290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:22.960211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213194+0000","last_change":"2023-12-08T08:20:20.106359+0000","last_active":"2023-12-08T08:20:22.213194+0000","last_peered":"2023-12-08T08:20:22.213194+0000","last_clean":"2023-12-08T08:20:22.213194+0000","last_became_active":"2023-12-08T08:20:20.106095+0000","last_became_peered":"2023-12-08T08:20:20.106095+0000","last_unstale":"2023-12-08T08:20:22.213194+0000","last_undegraded":"2023-12-08T08:20:22.213194+0000","last_fullsized":"2023-12-08T08:20:22.213194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:00:11.928203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957117+0000","last_change":"2023-12-08T08:20:20.528783+0000","last_active":"2023-12-08T08:20:21.957117+0000","last_peered":"2023-12-08T08:20:21.957117+0000","last_clean":"2023-12-08T08:20:21.957117+0000","last_became_active":"2023-12-08T08:20:20.528463+0000","last_became_peered":"2023-12-08T08:20:20.528463+0000","last_unstale":"2023-12-08T08:20:21.957117+0000","last_undegraded":"2023-12-08T08:20:21.957117+0000","last_fullsized":"2023-12-08T08:20:21.957117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:43:55.983858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.510372+0000","last_change":"2023-12-08T08:20:20.109998+0000","last_active":"2023-12-08T08:20:21.510372+0000","last_peered":"2023-12-08T08:20:21.510372+0000","last_clean":"2023-12-08T08:20:21.510372+0000","last_became_active":"2023-12-08T08:20:20.109580+0000","last_became_peered":"2023-12-08T08:20:20.109580+0000","last_unstale":"2023-12-08T08:20:21.510372+0000","last_undegraded":"2023-12-08T08:20:21.510372+0000","last_fullsized":"2023-12-08T08:20:21.510372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:17:10.702274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957486+0000","last_change":"2023-12-08T08:20:20.533736+0000","last_active":"2023-12-08T08:20:21.957486+0000","last_peered":"2023-12-08T08:20:21.957486+0000","last_clean":"2023-12-08T08:20:21.957486+0000","last_became_active":"2023-12-08T08:20:20.533508+0000","last_became_peered":"2023-12-08T08:20:20.533508+0000","last_unstale":"2023-12-08T08:20:21.957486+0000","last_undegraded":"2023-12-08T08:20:21.957486+0000","last_fullsized":"2023-12-08T08:20:21.957486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:22:44.822453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213618+0000","last_change":"2023-12-08T08:20:20.121251+0000","last_active":"2023-12-08T08:20:22.213618+0000","last_peered":"2023-12-08T08:20:22.213618+0000","last_clean":"2023-12-08T08:20:22.213618+0000","last_became_active":"2023-12-08T08:20:20.120767+0000","last_became_peered":"2023-12-08T08:20:20.120767+0000","last_unstale":"2023-12-08T08:20:22.213618+0000","last_undegraded":"2023-12-08T08:20:22.213618+0000","last_fullsized":"2023-12-08T08:20:22.213618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:17:31.861743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957582+0000","last_change":"2023-12-08T08:20:20.532439+0000","last_active":"2023-12-08T08:20:21.957582+0000","last_peered":"2023-12-08T08:20:21.957582+0000","last_clean":"2023-12-08T08:20:21.957582+0000","last_became_active":"2023-12-08T08:20:20.532120+0000","last_became_peered":"2023-12-08T08:20:20.532120+0000","last_unstale":"2023-12-08T08:20:21.957582+0000","last_undegraded":"2023-12-08T08:20:21.957582+0000","last_fullsized":"2023-12-08T08:20:21.957582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:54:51.364740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503714+0000","last_change":"2023-12-08T08:20:20.112322+0000","last_active":"2023-12-08T08:20:21.503714+0000","last_peered":"2023-12-08T08:20:21.503714+0000","last_clean":"2023-12-08T08:20:21.503714+0000","last_became_active":"2023-12-08T08:20:20.112023+0000","last_became_peered":"2023-12-08T08:20:20.112023+0000","last_unstale":"2023-12-08T08:20:21.503714+0000","last_undegraded":"2023-12-08T08:20:21.503714+0000","last_fullsized":"2023-12-08T08:20:21.503714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:50:44.025429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.215085+0000","last_change":"2023-12-08T08:20:20.524988+0000","last_active":"2023-12-08T08:20:22.215085+0000","last_peered":"2023-12-08T08:20:22.215085+0000","last_clean":"2023-12-08T08:20:22.215085+0000","last_became_active":"2023-12-08T08:20:20.522486+0000","last_became_peered":"2023-12-08T08:20:20.522486+0000","last_unstale":"2023-12-08T08:20:22.215085+0000","last_undegraded":"2023-12-08T08:20:22.215085+0000","last_fullsized":"2023-12-08T08:20:22.215085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:06.439860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213544+0000","last_change":"2023-12-08T08:20:20.112210+0000","last_active":"2023-12-08T08:20:22.213544+0000","last_peered":"2023-12-08T08:20:22.213544+0000","last_clean":"2023-12-08T08:20:22.213544+0000","last_became_active":"2023-12-08T08:20:20.111888+0000","last_became_peered":"2023-12-08T08:20:20.111888+0000","last_unstale":"2023-12-08T08:20:22.213544+0000","last_undegraded":"2023-12-08T08:20:22.213544+0000","last_fullsized":"2023-12-08T08:20:22.213544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:17:10.702274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957276+0000","last_change":"2023-12-08T08:20:20.530738+0000","last_active":"2023-12-08T08:20:21.957276+0000","last_peered":"2023-12-08T08:20:21.957276+0000","last_clean":"2023-12-08T08:20:21.957276+0000","last_became_active":"2023-12-08T08:20:20.530478+0000","last_became_peered":"2023-12-08T08:20:20.530478+0000","last_unstale":"2023-12-08T08:20:21.957276+0000","last_undegraded":"2023-12-08T08:20:21.957276+0000","last_fullsized":"2023-12-08T08:20:21.957276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:18.441827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-08T08:20:20.505097+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:20:20.505097+0000","last_peered":"2023-12-08T08:20:20.505097+0000","last_clean":"2023-12-08T08:20:20.505097+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:20:20.505097+0000","last_undegraded":"2023-12-08T08:20:20.505097+0000","last_fullsized":"2023-12-08T08:20:20.505097+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214696+0000","last_change":"2023-12-08T08:20:20.115839+0000","last_active":"2023-12-08T08:20:22.214696+0000","last_peered":"2023-12-08T08:20:22.214696+0000","last_clean":"2023-12-08T08:20:22.214696+0000","last_became_active":"2023-12-08T08:20:20.113312+0000","last_became_peered":"2023-12-08T08:20:20.113312+0000","last_unstale":"2023-12-08T08:20:22.214696+0000","last_undegraded":"2023-12-08T08:20:22.214696+0000","last_fullsized":"2023-12-08T08:20:22.214696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:35:48.489934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213600+0000","last_change":"2023-12-08T08:20:20.529095+0000","last_active":"2023-12-08T08:20:22.213600+0000","last_peered":"2023-12-08T08:20:22.213600+0000","last_clean":"2023-12-08T08:20:22.213600+0000","last_became_active":"2023-12-08T08:20:20.528833+0000","last_became_peered":"2023-12-08T08:20:20.528833+0000","last_unstale":"2023-12-08T08:20:22.213600+0000","last_undegraded":"2023-12-08T08:20:22.213600+0000","last_fullsized":"2023-12-08T08:20:22.213600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:41:18.155537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.956800+0000","last_change":"2023-12-08T08:20:20.127208+0000","last_active":"2023-12-08T08:20:21.956800+0000","last_peered":"2023-12-08T08:20:21.956800+0000","last_clean":"2023-12-08T08:20:21.956800+0000","last_became_active":"2023-12-08T08:20:20.126756+0000","last_became_peered":"2023-12-08T08:20:20.126756+0000","last_unstale":"2023-12-08T08:20:21.956800+0000","last_undegraded":"2023-12-08T08:20:21.956800+0000","last_fullsized":"2023-12-08T08:20:21.956800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:17:31.861743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713208+0000","last_change":"2023-12-08T08:20:20.505416+0000","last_active":"2023-12-08T08:20:21.713208+0000","last_peered":"2023-12-08T08:20:21.713208+0000","last_clean":"2023-12-08T08:20:21.713208+0000","last_became_active":"2023-12-08T08:20:20.505234+0000","last_became_peered":"2023-12-08T08:20:20.505234+0000","last_unstale":"2023-12-08T08:20:21.713208+0000","last_undegraded":"2023-12-08T08:20:21.713208+0000","last_fullsized":"2023-12-08T08:20:21.713208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:50:45.031043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213398+0000","last_change":"2023-12-08T08:20:20.124516+0000","last_active":"2023-12-08T08:20:22.213398+0000","last_peered":"2023-12-08T08:20:22.213398+0000","last_clean":"2023-12-08T08:20:22.213398+0000","last_became_active":"2023-12-08T08:20:20.119912+0000","last_became_peered":"2023-12-08T08:20:20.119912+0000","last_unstale":"2023-12-08T08:20:22.213398+0000","last_undegraded":"2023-12-08T08:20:22.213398+0000","last_fullsized":"2023-12-08T08:20:22.213398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:01:11.293463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503488+0000","last_change":"2023-12-08T08:20:20.514055+0000","last_active":"2023-12-08T08:20:21.503488+0000","last_peered":"2023-12-08T08:20:21.503488+0000","last_clean":"2023-12-08T08:20:21.503488+0000","last_became_active":"2023-12-08T08:20:20.511185+0000","last_became_peered":"2023-12-08T08:20:20.511185+0000","last_unstale":"2023-12-08T08:20:21.503488+0000","last_undegraded":"2023-12-08T08:20:21.503488+0000","last_fullsized":"2023-12-08T08:20:21.503488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:22.960211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214950+0000","last_change":"2023-12-08T08:20:20.129124+0000","last_active":"2023-12-08T08:20:22.214950+0000","last_peered":"2023-12-08T08:20:22.214950+0000","last_clean":"2023-12-08T08:20:22.214950+0000","last_became_active":"2023-12-08T08:20:20.128851+0000","last_became_peered":"2023-12-08T08:20:20.128851+0000","last_unstale":"2023-12-08T08:20:22.214950+0000","last_undegraded":"2023-12-08T08:20:22.214950+0000","last_fullsized":"2023-12-08T08:20:22.214950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:54.600146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.510286+0000","last_change":"2023-12-08T08:20:20.518546+0000","last_active":"2023-12-08T08:20:21.510286+0000","last_peered":"2023-12-08T08:20:21.510286+0000","last_clean":"2023-12-08T08:20:21.510286+0000","last_became_active":"2023-12-08T08:20:20.516272+0000","last_became_peered":"2023-12-08T08:20:20.516272+0000","last_unstale":"2023-12-08T08:20:21.510286+0000","last_undegraded":"2023-12-08T08:20:21.510286+0000","last_fullsized":"2023-12-08T08:20:21.510286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:14:43.007025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503676+0000","last_change":"2023-12-08T08:20:20.106320+0000","last_active":"2023-12-08T08:20:21.503676+0000","last_peered":"2023-12-08T08:20:21.503676+0000","last_clean":"2023-12-08T08:20:21.503676+0000","last_became_active":"2023-12-08T08:20:20.106039+0000","last_became_peered":"2023-12-08T08:20:20.106039+0000","last_unstale":"2023-12-08T08:20:21.503676+0000","last_undegraded":"2023-12-08T08:20:21.503676+0000","last_fullsized":"2023-12-08T08:20:21.503676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:51:02.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.215173+0000","last_change":"2023-12-08T08:20:20.520730+0000","last_active":"2023-12-08T08:20:22.215173+0000","last_peered":"2023-12-08T08:20:22.215173+0000","last_clean":"2023-12-08T08:20:22.215173+0000","last_became_active":"2023-12-08T08:20:20.520084+0000","last_became_peered":"2023-12-08T08:20:20.520084+0000","last_unstale":"2023-12-08T08:20:22.215173+0000","last_undegraded":"2023-12-08T08:20:22.215173+0000","last_fullsized":"2023-12-08T08:20:22.215173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:18.441827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957458+0000","last_change":"2023-12-08T08:20:20.131234+0000","last_active":"2023-12-08T08:20:21.957458+0000","last_peered":"2023-12-08T08:20:21.957458+0000","last_clean":"2023-12-08T08:20:21.957458+0000","last_became_active":"2023-12-08T08:20:20.130858+0000","last_became_peered":"2023-12-08T08:20:20.130858+0000","last_unstale":"2023-12-08T08:20:21.957458+0000","last_undegraded":"2023-12-08T08:20:21.957458+0000","last_fullsized":"2023-12-08T08:20:21.957458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:41:17.149923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503584+0000","last_change":"2023-12-08T08:20:20.513590+0000","last_active":"2023-12-08T08:20:21.503584+0000","last_peered":"2023-12-08T08:20:21.503584+0000","last_clean":"2023-12-08T08:20:21.503584+0000","last_became_active":"2023-12-08T08:20:20.513254+0000","last_became_peered":"2023-12-08T08:20:20.513254+0000","last_unstale":"2023-12-08T08:20:21.503584+0000","last_undegraded":"2023-12-08T08:20:21.503584+0000","last_fullsized":"2023-12-08T08:20:21.503584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:16:30.037506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.788858+0000","last_change":"2023-12-08T08:20:20.119102+0000","last_active":"2023-12-08T08:20:22.788858+0000","last_peered":"2023-12-08T08:20:22.788858+0000","last_clean":"2023-12-08T08:20:22.788858+0000","last_became_active":"2023-12-08T08:20:20.118810+0000","last_became_peered":"2023-12-08T08:20:20.118810+0000","last_unstale":"2023-12-08T08:20:22.788858+0000","last_undegraded":"2023-12-08T08:20:22.788858+0000","last_fullsized":"2023-12-08T08:20:22.788858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:07:35.883797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214019+0000","last_change":"2023-12-08T08:20:20.517408+0000","last_active":"2023-12-08T08:20:22.214019+0000","last_peered":"2023-12-08T08:20:22.214019+0000","last_clean":"2023-12-08T08:20:22.214019+0000","last_became_active":"2023-12-08T08:20:20.517128+0000","last_became_peered":"2023-12-08T08:20:20.517128+0000","last_unstale":"2023-12-08T08:20:22.214019+0000","last_undegraded":"2023-12-08T08:20:22.214019+0000","last_fullsized":"2023-12-08T08:20:22.214019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:43:55.983858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672543+0000","last_change":"2023-12-08T08:20:20.123921+0000","last_active":"2023-12-08T08:20:21.672543+0000","last_peered":"2023-12-08T08:20:21.672543+0000","last_clean":"2023-12-08T08:20:21.672543+0000","last_became_active":"2023-12-08T08:20:20.123647+0000","last_became_peered":"2023-12-08T08:20:20.123647+0000","last_unstale":"2023-12-08T08:20:21.672543+0000","last_undegraded":"2023-12-08T08:20:21.672543+0000","last_fullsized":"2023-12-08T08:20:21.672543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:50:44.025429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713522+0000","last_change":"2023-12-08T08:20:20.512961+0000","last_active":"2023-12-08T08:20:21.713522+0000","last_peered":"2023-12-08T08:20:21.713522+0000","last_clean":"2023-12-08T08:20:21.713522+0000","last_became_active":"2023-12-08T08:20:20.512658+0000","last_became_peered":"2023-12-08T08:20:20.512658+0000","last_unstale":"2023-12-08T08:20:21.713522+0000","last_undegraded":"2023-12-08T08:20:21.713522+0000","last_fullsized":"2023-12-08T08:20:21.713522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:41:18.155537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.956795+0000","last_change":"2023-12-08T08:20:20.127034+0000","last_active":"2023-12-08T08:20:21.956795+0000","last_peered":"2023-12-08T08:20:21.956795+0000","last_clean":"2023-12-08T08:20:21.956795+0000","last_became_active":"2023-12-08T08:20:20.126738+0000","last_became_peered":"2023-12-08T08:20:20.126738+0000","last_unstale":"2023-12-08T08:20:21.956795+0000","last_undegraded":"2023-12-08T08:20:21.956795+0000","last_fullsized":"2023-12-08T08:20:21.956795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:01:11.293463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.510200+0000","last_change":"2023-12-08T08:20:20.508042+0000","last_active":"2023-12-08T08:20:21.510200+0000","last_peered":"2023-12-08T08:20:21.510200+0000","last_clean":"2023-12-08T08:20:21.510200+0000","last_became_active":"2023-12-08T08:20:20.507604+0000","last_became_peered":"2023-12-08T08:20:20.507604+0000","last_unstale":"2023-12-08T08:20:21.510200+0000","last_undegraded":"2023-12-08T08:20:21.510200+0000","last_fullsized":"2023-12-08T08:20:21.510200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:50:19.617575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503521+0000","last_change":"2023-12-08T08:20:20.114773+0000","last_active":"2023-12-08T08:20:21.503521+0000","last_peered":"2023-12-08T08:20:21.503521+0000","last_clean":"2023-12-08T08:20:21.503521+0000","last_became_active":"2023-12-08T08:20:20.114031+0000","last_became_peered":"2023-12-08T08:20:20.114031+0000","last_unstale":"2023-12-08T08:20:21.503521+0000","last_undegraded":"2023-12-08T08:20:21.503521+0000","last_fullsized":"2023-12-08T08:20:21.503521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:14:23.708015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213446+0000","last_change":"2023-12-08T08:20:20.517325+0000","last_active":"2023-12-08T08:20:22.213446+0000","last_peered":"2023-12-08T08:20:22.213446+0000","last_clean":"2023-12-08T08:20:22.213446+0000","last_became_active":"2023-12-08T08:20:20.517052+0000","last_became_peered":"2023-12-08T08:20:20.517052+0000","last_unstale":"2023-12-08T08:20:22.213446+0000","last_undegraded":"2023-12-08T08:20:22.213446+0000","last_fullsized":"2023-12-08T08:20:22.213446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:16:30.037506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503677+0000","last_change":"2023-12-08T08:20:20.125369+0000","last_active":"2023-12-08T08:20:21.503677+0000","last_peered":"2023-12-08T08:20:21.503677+0000","last_clean":"2023-12-08T08:20:21.503677+0000","last_became_active":"2023-12-08T08:20:20.124307+0000","last_became_peered":"2023-12-08T08:20:20.124307+0000","last_unstale":"2023-12-08T08:20:21.503677+0000","last_undegraded":"2023-12-08T08:20:21.503677+0000","last_fullsized":"2023-12-08T08:20:21.503677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:06:20.375858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213848+0000","last_change":"2023-12-08T08:20:20.517511+0000","last_active":"2023-12-08T08:20:22.213848+0000","last_peered":"2023-12-08T08:20:22.213848+0000","last_clean":"2023-12-08T08:20:22.213848+0000","last_became_active":"2023-12-08T08:20:20.517230+0000","last_became_peered":"2023-12-08T08:20:20.517230+0000","last_unstale":"2023-12-08T08:20:22.213848+0000","last_undegraded":"2023-12-08T08:20:22.213848+0000","last_fullsized":"2023-12-08T08:20:22.213848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:34:40.228006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957287+0000","last_change":"2023-12-08T08:20:20.131143+0000","last_active":"2023-12-08T08:20:21.957287+0000","last_peered":"2023-12-08T08:20:21.957287+0000","last_clean":"2023-12-08T08:20:21.957287+0000","last_became_active":"2023-12-08T08:20:20.130764+0000","last_became_peered":"2023-12-08T08:20:20.130764+0000","last_unstale":"2023-12-08T08:20:21.957287+0000","last_undegraded":"2023-12-08T08:20:21.957287+0000","last_fullsized":"2023-12-08T08:20:21.957287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:50:44.025429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672139+0000","last_change":"2023-12-08T08:20:20.512488+0000","last_active":"2023-12-08T08:20:21.672139+0000","last_peered":"2023-12-08T08:20:21.672139+0000","last_clean":"2023-12-08T08:20:21.672139+0000","last_became_active":"2023-12-08T08:20:20.512025+0000","last_became_peered":"2023-12-08T08:20:20.512025+0000","last_unstale":"2023-12-08T08:20:21.672139+0000","last_undegraded":"2023-12-08T08:20:21.672139+0000","last_fullsized":"2023-12-08T08:20:21.672139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:24:45.197087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.215175+0000","last_change":"2023-12-08T08:20:20.520916+0000","last_active":"2023-12-08T08:20:22.215175+0000","last_peered":"2023-12-08T08:20:22.215175+0000","last_clean":"2023-12-08T08:20:22.215175+0000","last_became_active":"2023-12-08T08:20:20.520425+0000","last_became_peered":"2023-12-08T08:20:20.520425+0000","last_unstale":"2023-12-08T08:20:22.215175+0000","last_undegraded":"2023-12-08T08:20:22.215175+0000","last_fullsized":"2023-12-08T08:20:22.215175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:52:56.239687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957134+0000","last_change":"2023-12-08T08:20:20.131174+0000","last_active":"2023-12-08T08:20:21.957134+0000","last_peered":"2023-12-08T08:20:21.957134+0000","last_clean":"2023-12-08T08:20:21.957134+0000","last_became_active":"2023-12-08T08:20:20.130872+0000","last_became_peered":"2023-12-08T08:20:20.130872+0000","last_unstale":"2023-12-08T08:20:21.957134+0000","last_undegraded":"2023-12-08T08:20:21.957134+0000","last_fullsized":"2023-12-08T08:20:21.957134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:51:02.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214974+0000","last_change":"2023-12-08T08:20:20.521452+0000","last_active":"2023-12-08T08:20:22.214974+0000","last_peered":"2023-12-08T08:20:22.214974+0000","last_clean":"2023-12-08T08:20:22.214974+0000","last_became_active":"2023-12-08T08:20:20.521159+0000","last_became_peered":"2023-12-08T08:20:20.521159+0000","last_unstale":"2023-12-08T08:20:22.214974+0000","last_undegraded":"2023-12-08T08:20:22.214974+0000","last_fullsized":"2023-12-08T08:20:22.214974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:43:55.983858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957295+0000","last_change":"2023-12-08T08:20:20.133530+0000","last_active":"2023-12-08T08:20:21.957295+0000","last_peered":"2023-12-08T08:20:21.957295+0000","last_clean":"2023-12-08T08:20:21.957295+0000","last_became_active":"2023-12-08T08:20:20.133275+0000","last_became_peered":"2023-12-08T08:20:20.133275+0000","last_unstale":"2023-12-08T08:20:21.957295+0000","last_undegraded":"2023-12-08T08:20:21.957295+0000","last_fullsized":"2023-12-08T08:20:21.957295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:21.954598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713403+0000","last_change":"2023-12-08T08:20:20.529914+0000","last_active":"2023-12-08T08:20:21.713403+0000","last_peered":"2023-12-08T08:20:21.713403+0000","last_clean":"2023-12-08T08:20:21.713403+0000","last_became_active":"2023-12-08T08:20:20.529197+0000","last_became_peered":"2023-12-08T08:20:20.529197+0000","last_unstale":"2023-12-08T08:20:21.713403+0000","last_undegraded":"2023-12-08T08:20:21.713403+0000","last_fullsized":"2023-12-08T08:20:21.713403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:22.960211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214115+0000","last_change":"2023-12-08T08:20:20.122629+0000","last_active":"2023-12-08T08:20:22.214115+0000","last_peered":"2023-12-08T08:20:22.214115+0000","last_clean":"2023-12-08T08:20:22.214115+0000","last_became_active":"2023-12-08T08:20:20.122354+0000","last_became_peered":"2023-12-08T08:20:20.122354+0000","last_unstale":"2023-12-08T08:20:22.214115+0000","last_undegraded":"2023-12-08T08:20:22.214115+0000","last_fullsized":"2023-12-08T08:20:22.214115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:07:35.883797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214035+0000","last_change":"2023-12-08T08:20:20.524585+0000","last_active":"2023-12-08T08:20:22.214035+0000","last_peered":"2023-12-08T08:20:22.214035+0000","last_clean":"2023-12-08T08:20:22.214035+0000","last_became_active":"2023-12-08T08:20:20.524328+0000","last_became_peered":"2023-12-08T08:20:20.524328+0000","last_unstale":"2023-12-08T08:20:22.214035+0000","last_undegraded":"2023-12-08T08:20:22.214035+0000","last_fullsized":"2023-12-08T08:20:22.214035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:06.439860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713606+0000","last_change":"2023-12-08T08:20:20.123711+0000","last_active":"2023-12-08T08:20:21.713606+0000","last_peered":"2023-12-08T08:20:21.713606+0000","last_clean":"2023-12-08T08:20:21.713606+0000","last_became_active":"2023-12-08T08:20:20.123409+0000","last_became_peered":"2023-12-08T08:20:20.123409+0000","last_unstale":"2023-12-08T08:20:21.713606+0000","last_undegraded":"2023-12-08T08:20:21.713606+0000","last_fullsized":"2023-12-08T08:20:21.713606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:14:23.708015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":661860,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":661916,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.863}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.7290000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6550000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.514}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8380000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4590000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:20:31.389 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:20:31.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.561+0000 7f57c6081640 1 Processor -- start 2023-12-08T08:20:31.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.561+0000 7f57c6081640 1 -- start start 2023-12-08T08:20:31.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.561+0000 7f57c6081640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57c00c65f0 0x7f57c00c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.561+0000 7f57c6081640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f57c00c8200 0x7f57c00c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.561+0000 7f57c6081640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f57c00c9040 0x7f57c01579c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.561+0000 7f57c6081640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c0151f20 con 0x7f57c00c9040 2023-12-08T08:20:31.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.561+0000 7f57c6081640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c0154450 con 0x7f57c00c8200 2023-12-08T08:20:31.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.561+0000 7f57c6081640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c0154710 con 0x7f57c00c65f0 2023-12-08T08:20:31.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.561+0000 7f57c5880640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f57c00c9040 0x7f57c01579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.561+0000 7f57c5880640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f57c00c9040 0x7f57c01579c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41252/0 (socket says 172.21.15.88:41252) 2023-12-08T08:20:31.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.561+0000 7f57c5880640 1 -- 172.21.15.88:0/185166721 learned_addr learned my addr 172.21.15.88:0/185166721 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:31.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.561+0000 7f57c507f640 1 --2- 172.21.15.88:0/185166721 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57c00c65f0 0x7f57c00c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.561+0000 7f57c487e640 1 --2- 172.21.15.88:0/185166721 >> v2:172.21.15.148:3300/0 conn(0x7f57c00c8200 0x7f57c00c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.561+0000 7f57c5880640 1 -- 172.21.15.88:0/185166721 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57c00c65f0 msgr2=0x7f57c00c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:31.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.561+0000 7f57c5880640 1 --2- 172.21.15.88:0/185166721 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57c00c65f0 0x7f57c00c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.561+0000 7f57c5880640 1 -- 172.21.15.88:0/185166721 >> v2:172.21.15.148:3300/0 conn(0x7f57c00c8200 msgr2=0x7f57c00c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:31.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.561+0000 7f57c5880640 1 --2- 172.21.15.88:0/185166721 >> v2:172.21.15.148:3300/0 conn(0x7f57c00c8200 0x7f57c00c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.561+0000 7f57c5880640 1 -- 172.21.15.88:0/185166721 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c01549f0 con 0x7f57c00c9040 2023-12-08T08:20:31.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.565+0000 7f57c5880640 1 --2- 172.21.15.88:0/185166721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57c00c9040 0x7f57c01579c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f57c008b0b0 tx=0x7f57b801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d044d7cdee5831ab server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:31.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.565+0000 7f57b7fff640 1 -- 172.21.15.88:0/185166721 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b80a5790 con 0x7f57c00c9040 2023-12-08T08:20:31.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.565+0000 7f57b7fff640 1 -- 172.21.15.88:0/185166721 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b80a58f0 con 0x7f57c00c9040 2023-12-08T08:20:31.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.565+0000 7f57b7fff640 1 -- 172.21.15.88:0/185166721 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b80a5c80 con 0x7f57c00c9040 2023-12-08T08:20:31.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.565+0000 7f57c6081640 1 -- 172.21.15.88:0/185166721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57c00c9040 msgr2=0x7f57c01579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.565+0000 7f57c6081640 1 --2- 172.21.15.88:0/185166721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57c00c9040 0x7f57c01579c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f57c008b0b0 tx=0x7f57b801c910 comp rx=0 tx=0).stop 2023-12-08T08:20:31.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.565+0000 7f57c6081640 1 -- 172.21.15.88:0/185166721 shutdown_connections 2023-12-08T08:20:31.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.565+0000 7f57c6081640 1 --2- 172.21.15.88:0/185166721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57c00c9040 0x7f57c01579c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.565+0000 7f57c6081640 1 --2- 172.21.15.88:0/185166721 >> v2:172.21.15.148:3300/0 conn(0x7f57c00c8200 0x7f57c00c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.565+0000 7f57c6081640 1 --2- 172.21.15.88:0/185166721 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57c00c65f0 0x7f57c00c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.565+0000 7f57c6081640 1 -- 172.21.15.88:0/185166721 >> 172.21.15.88:0/185166721 conn(0x7f57c00ab730 msgr2=0x7f57c00abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:31.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.565+0000 7f57c6081640 1 -- 172.21.15.88:0/185166721 shutdown_connections 2023-12-08T08:20:31.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.565+0000 7f57c6081640 1 -- 172.21.15.88:0/185166721 wait complete. 2023-12-08T08:20:31.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.569+0000 7f57c6081640 1 Processor -- start 2023-12-08T08:20:31.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.569+0000 7f57c6081640 1 -- start start 2023-12-08T08:20:31.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.569+0000 7f57c6081640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57c00c65f0 0x7f57c01ed160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.569+0000 7f57c6081640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57c00c8200 0x7f57c0142930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.569+0000 7f57c6081640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57c00c9040 0x7f57c0150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.569+0000 7f57c6081640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c01ee120 con 0x7f57c00c65f0 2023-12-08T08:20:31.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.569+0000 7f57c6081640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c0155b60 con 0x7f57c00c9040 2023-12-08T08:20:31.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.569+0000 7f57c6081640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c0155e40 con 0x7f57c00c8200 2023-12-08T08:20:31.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.569+0000 7f57c507f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57c00c65f0 0x7f57c01ed160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.569+0000 7f57c507f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57c00c65f0 0x7f57c01ed160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41256/0 (socket says 172.21.15.88:41256) 2023-12-08T08:20:31.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.569+0000 7f57c507f640 1 -- 172.21.15.88:0/221139738 learned_addr learned my addr 172.21.15.88:0/221139738 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:31.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.569+0000 7f57c487e640 1 --2- 172.21.15.88:0/221139738 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57c00c8200 0x7f57c0142930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.569+0000 7f57c5880640 1 --2- 172.21.15.88:0/221139738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57c00c9040 0x7f57c0150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.569+0000 7f57c507f640 1 -- 172.21.15.88:0/221139738 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57c00c8200 msgr2=0x7f57c0142930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.569+0000 7f57c507f640 1 --2- 172.21.15.88:0/221139738 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57c00c8200 0x7f57c0142930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.569+0000 7f57c507f640 1 -- 172.21.15.88:0/221139738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57c00c9040 msgr2=0x7f57c0150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.569+0000 7f57c507f640 1 --2- 172.21.15.88:0/221139738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57c00c9040 0x7f57c0150570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.569+0000 7f57c507f640 1 -- 172.21.15.88:0/221139738 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b8009b30 con 0x7f57c00c65f0 2023-12-08T08:20:31.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.569+0000 7f57c487e640 1 --2- 172.21.15.88:0/221139738 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57c00c8200 0x7f57c0142930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:31.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.569+0000 7f57c507f640 1 --2- 172.21.15.88:0/221139738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57c00c65f0 0x7f57c01ed160 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f57bc00d800 tx=0x7f57bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:31.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.569+0000 7f57b5ffb640 1 -- 172.21.15.88:0/221139738 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc0096a0 con 0x7f57c00c65f0 2023-12-08T08:20:31.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.569+0000 7f57b5ffb640 1 -- 172.21.15.88:0/221139738 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57bc009800 con 0x7f57c00c65f0 2023-12-08T08:20:31.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.569+0000 7f57b5ffb640 1 -- 172.21.15.88:0/221139738 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc009990 con 0x7f57c00c65f0 2023-12-08T08:20:31.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.569+0000 7f57c6081640 1 -- 172.21.15.88:0/221139738 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c0156120 con 0x7f57c00c65f0 2023-12-08T08:20:31.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.569+0000 7f57c6081640 1 -- 172.21.15.88:0/221139738 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c00af9c0 con 0x7f57c00c65f0 2023-12-08T08:20:31.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.573+0000 7f57c6081640 1 -- 172.21.15.88:0/221139738 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c00c5210 con 0x7f57c00c65f0 2023-12-08T08:20:31.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.573+0000 7f57b5ffb640 1 -- 172.21.15.88:0/221139738 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f57bc009af0 con 0x7f57c00c65f0 2023-12-08T08:20:31.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.573+0000 7f57b5ffb640 1 --2- 172.21.15.88:0/221139738 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f57a4066470 0x7f57a4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.573+0000 7f57b5ffb640 1 -- 172.21.15.88:0/221139738 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57bc0842f0 con 0x7f57c00c65f0 2023-12-08T08:20:31.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.573+0000 7f57c487e640 1 --2- 172.21.15.88:0/221139738 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f57a4066470 0x7f57a4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.573+0000 7f57c487e640 1 --2- 172.21.15.88:0/221139738 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f57a4066470 0x7f57a4068930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f57c00c09b0 tx=0x7f57b0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:31.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.577+0000 7f57b5ffb640 1 -- 172.21.15.88:0/221139738 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f57bc051760 con 0x7f57c00c65f0 2023-12-08T08:20:31.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.721+0000 7f57c6081640 1 -- 172.21.15.88:0/221139738 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f57c014bd70 con 0x7f57a4066470 2023-12-08T08:20:31.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.729+0000 7f57b5ffb640 1 -- 172.21.15.88:0/221139738 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264679 (secure 0 0 0) 0x7f57c014bd70 con 0x7f57a4066470 2023-12-08T08:20:31.737 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:31.739 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:20:31.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.733+0000 7f57c6081640 1 -- 172.21.15.88:0/221139738 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f57a4066470 msgr2=0x7f57a4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.733+0000 7f57c6081640 1 --2- 172.21.15.88:0/221139738 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f57a4066470 0x7f57a4068930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f57c00c09b0 tx=0x7f57b0008040 comp rx=0 tx=0).stop 2023-12-08T08:20:31.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.733+0000 7f57c6081640 1 -- 172.21.15.88:0/221139738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57c00c65f0 msgr2=0x7f57c01ed160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.733+0000 7f57c6081640 1 --2- 172.21.15.88:0/221139738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57c00c65f0 0x7f57c01ed160 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f57bc00d800 tx=0x7f57bc00dcc0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.733+0000 7f57c6081640 1 -- 172.21.15.88:0/221139738 shutdown_connections 2023-12-08T08:20:31.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.733+0000 7f57c6081640 1 --2- 172.21.15.88:0/221139738 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f57a4066470 0x7f57a4068930 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.733+0000 7f57c6081640 1 --2- 172.21.15.88:0/221139738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57c00c9040 0x7f57c0150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.733+0000 7f57c6081640 1 --2- 172.21.15.88:0/221139738 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57c00c8200 0x7f57c0142930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.733+0000 7f57c6081640 1 --2- 172.21.15.88:0/221139738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57c00c65f0 0x7f57c01ed160 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.733+0000 7f57c6081640 1 -- 172.21.15.88:0/221139738 >> 172.21.15.88:0/221139738 conn(0x7f57c00ab730 msgr2=0x7f57c00a9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:31.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.733+0000 7f57c6081640 1 -- 172.21.15.88:0/221139738 shutdown_connections 2023-12-08T08:20:31.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.733+0000 7f57c6081640 1 -- 172.21.15.88:0/221139738 wait complete. 2023-12-08T08:20:31.758 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-12-08T08:20:30.748453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":217988,"kb_used_data":1792,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756732,"statfs":{"total":773094113280,"available":772870893568,"internally_reserved":0,"allocated":1835008,"data_stored":1752836,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.006928"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957451+0000","last_change":"2023-12-08T08:20:20.526014+0000","last_active":"2023-12-08T08:20:21.957451+0000","last_peered":"2023-12-08T08:20:21.957451+0000","last_clean":"2023-12-08T08:20:21.957451+0000","last_became_active":"2023-12-08T08:20:20.525310+0000","last_became_peered":"2023-12-08T08:20:20.525310+0000","last_unstale":"2023-12-08T08:20:21.957451+0000","last_undegraded":"2023-12-08T08:20:21.957451+0000","last_fullsized":"2023-12-08T08:20:21.957451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:04.925519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503721+0000","last_change":"2023-12-08T08:20:20.515314+0000","last_active":"2023-12-08T08:20:21.503721+0000","last_peered":"2023-12-08T08:20:21.503721+0000","last_clean":"2023-12-08T08:20:21.503721+0000","last_became_active":"2023-12-08T08:20:20.512640+0000","last_became_peered":"2023-12-08T08:20:20.512640+0000","last_unstale":"2023-12-08T08:20:21.503721+0000","last_undegraded":"2023-12-08T08:20:21.503721+0000","last_fullsized":"2023-12-08T08:20:21.503721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:58.484542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713375+0000","last_change":"2023-12-08T08:20:20.506916+0000","last_active":"2023-12-08T08:20:21.713375+0000","last_peered":"2023-12-08T08:20:21.713375+0000","last_clean":"2023-12-08T08:20:21.713375+0000","last_became_active":"2023-12-08T08:20:20.506640+0000","last_became_peered":"2023-12-08T08:20:20.506640+0000","last_unstale":"2023-12-08T08:20:21.713375+0000","last_undegraded":"2023-12-08T08:20:21.713375+0000","last_fullsized":"2023-12-08T08:20:21.713375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:35:49.495548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214804+0000","last_change":"2023-12-08T08:20:20.526830+0000","last_active":"2023-12-08T08:20:22.214804+0000","last_peered":"2023-12-08T08:20:22.214804+0000","last_clean":"2023-12-08T08:20:22.214804+0000","last_became_active":"2023-12-08T08:20:20.522810+0000","last_became_peered":"2023-12-08T08:20:20.522810+0000","last_unstale":"2023-12-08T08:20:22.214804+0000","last_undegraded":"2023-12-08T08:20:22.214804+0000","last_fullsized":"2023-12-08T08:20:22.214804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:12:06.866332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957064+0000","last_change":"2023-12-08T08:20:20.515029+0000","last_active":"2023-12-08T08:20:21.957064+0000","last_peered":"2023-12-08T08:20:21.957064+0000","last_clean":"2023-12-08T08:20:21.957064+0000","last_became_active":"2023-12-08T08:20:20.514648+0000","last_became_peered":"2023-12-08T08:20:20.514648+0000","last_unstale":"2023-12-08T08:20:21.957064+0000","last_undegraded":"2023-12-08T08:20:21.957064+0000","last_fullsized":"2023-12-08T08:20:21.957064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:35:44.144209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214602+0000","last_change":"2023-12-08T08:20:20.519487+0000","last_active":"2023-12-08T08:20:22.214602+0000","last_peered":"2023-12-08T08:20:22.214602+0000","last_clean":"2023-12-08T08:20:22.214602+0000","last_became_active":"2023-12-08T08:20:20.518543+0000","last_became_peered":"2023-12-08T08:20:20.518543+0000","last_unstale":"2023-12-08T08:20:22.214602+0000","last_undegraded":"2023-12-08T08:20:22.214602+0000","last_fullsized":"2023-12-08T08:20:22.214602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:58.484542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.956995+0000","last_change":"2023-12-08T08:20:20.522151+0000","last_active":"2023-12-08T08:20:21.956995+0000","last_peered":"2023-12-08T08:20:21.956995+0000","last_clean":"2023-12-08T08:20:21.956995+0000","last_became_active":"2023-12-08T08:20:20.521736+0000","last_became_peered":"2023-12-08T08:20:20.521736+0000","last_unstale":"2023-12-08T08:20:21.956995+0000","last_undegraded":"2023-12-08T08:20:21.956995+0000","last_fullsized":"2023-12-08T08:20:21.956995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:12:06.866332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213278+0000","last_change":"2023-12-08T08:20:20.529673+0000","last_active":"2023-12-08T08:20:22.213278+0000","last_peered":"2023-12-08T08:20:22.213278+0000","last_clean":"2023-12-08T08:20:22.213278+0000","last_became_active":"2023-12-08T08:20:20.529379+0000","last_became_peered":"2023-12-08T08:20:20.529379+0000","last_unstale":"2023-12-08T08:20:22.213278+0000","last_undegraded":"2023-12-08T08:20:22.213278+0000","last_fullsized":"2023-12-08T08:20:22.213278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:35:49.495548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957552+0000","last_change":"2023-12-08T08:20:20.525718+0000","last_active":"2023-12-08T08:20:21.957552+0000","last_peered":"2023-12-08T08:20:21.957552+0000","last_clean":"2023-12-08T08:20:21.957552+0000","last_became_active":"2023-12-08T08:20:20.524881+0000","last_became_peered":"2023-12-08T08:20:20.524881+0000","last_unstale":"2023-12-08T08:20:21.957552+0000","last_undegraded":"2023-12-08T08:20:21.957552+0000","last_fullsized":"2023-12-08T08:20:21.957552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:18:00.048146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672553+0000","last_change":"2023-12-08T08:20:20.527390+0000","last_active":"2023-12-08T08:20:21.672553+0000","last_peered":"2023-12-08T08:20:21.672553+0000","last_clean":"2023-12-08T08:20:21.672553+0000","last_became_active":"2023-12-08T08:20:20.527081+0000","last_became_peered":"2023-12-08T08:20:20.527081+0000","last_unstale":"2023-12-08T08:20:21.672553+0000","last_undegraded":"2023-12-08T08:20:21.672553+0000","last_fullsized":"2023-12-08T08:20:21.672553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:58.484542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672274+0000","last_change":"2023-12-08T08:20:20.529477+0000","last_active":"2023-12-08T08:20:21.672274+0000","last_peered":"2023-12-08T08:20:21.672274+0000","last_clean":"2023-12-08T08:20:21.672274+0000","last_became_active":"2023-12-08T08:20:20.529203+0000","last_became_peered":"2023-12-08T08:20:20.529203+0000","last_unstale":"2023-12-08T08:20:21.672274+0000","last_undegraded":"2023-12-08T08:20:21.672274+0000","last_fullsized":"2023-12-08T08:20:21.672274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:55.605759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.510398+0000","last_change":"2023-12-08T08:20:20.513949+0000","last_active":"2023-12-08T08:20:21.510398+0000","last_peered":"2023-12-08T08:20:21.510398+0000","last_clean":"2023-12-08T08:20:21.510398+0000","last_became_active":"2023-12-08T08:20:20.509753+0000","last_became_peered":"2023-12-08T08:20:20.509753+0000","last_unstale":"2023-12-08T08:20:21.510398+0000","last_undegraded":"2023-12-08T08:20:21.510398+0000","last_fullsized":"2023-12-08T08:20:21.510398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:14:24.713628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213771+0000","last_change":"2023-12-08T08:20:20.528560+0000","last_active":"2023-12-08T08:20:22.213771+0000","last_peered":"2023-12-08T08:20:22.213771+0000","last_clean":"2023-12-08T08:20:22.213771+0000","last_became_active":"2023-12-08T08:20:20.528307+0000","last_became_peered":"2023-12-08T08:20:20.528307+0000","last_unstale":"2023-12-08T08:20:22.213771+0000","last_undegraded":"2023-12-08T08:20:22.213771+0000","last_fullsized":"2023-12-08T08:20:22.213771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:58.484542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713275+0000","last_change":"2023-12-08T08:20:20.512007+0000","last_active":"2023-12-08T08:20:21.713275+0000","last_peered":"2023-12-08T08:20:21.713275+0000","last_clean":"2023-12-08T08:20:21.713275+0000","last_became_active":"2023-12-08T08:20:20.511687+0000","last_became_peered":"2023-12-08T08:20:20.511687+0000","last_unstale":"2023-12-08T08:20:21.713275+0000","last_undegraded":"2023-12-08T08:20:21.713275+0000","last_fullsized":"2023-12-08T08:20:21.713275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:07:36.889410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503433+0000","last_change":"2023-12-08T08:20:20.515089+0000","last_active":"2023-12-08T08:20:21.503433+0000","last_peered":"2023-12-08T08:20:21.503433+0000","last_clean":"2023-12-08T08:20:21.503433+0000","last_became_active":"2023-12-08T08:20:20.514657+0000","last_became_peered":"2023-12-08T08:20:20.514657+0000","last_unstale":"2023-12-08T08:20:21.503433+0000","last_undegraded":"2023-12-08T08:20:21.503433+0000","last_fullsized":"2023-12-08T08:20:21.503433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:55.605759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214490+0000","last_change":"2023-12-08T08:20:20.518410+0000","last_active":"2023-12-08T08:20:22.214490+0000","last_peered":"2023-12-08T08:20:22.214490+0000","last_clean":"2023-12-08T08:20:22.214490+0000","last_became_active":"2023-12-08T08:20:20.518144+0000","last_became_peered":"2023-12-08T08:20:20.518144+0000","last_unstale":"2023-12-08T08:20:22.214490+0000","last_undegraded":"2023-12-08T08:20:22.214490+0000","last_fullsized":"2023-12-08T08:20:22.214490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:16:30.037506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.215317+0000","last_change":"2023-12-08T08:20:20.524234+0000","last_active":"2023-12-08T08:20:22.215317+0000","last_peered":"2023-12-08T08:20:22.215317+0000","last_clean":"2023-12-08T08:20:22.215317+0000","last_became_active":"2023-12-08T08:20:20.523988+0000","last_became_peered":"2023-12-08T08:20:20.523988+0000","last_unstale":"2023-12-08T08:20:22.215317+0000","last_undegraded":"2023-12-08T08:20:22.215317+0000","last_fullsized":"2023-12-08T08:20:22.215317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:04.925519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213689+0000","last_change":"2023-12-08T08:20:20.509163+0000","last_active":"2023-12-08T08:20:22.213689+0000","last_peered":"2023-12-08T08:20:22.213689+0000","last_clean":"2023-12-08T08:20:22.213689+0000","last_became_active":"2023-12-08T08:20:20.508891+0000","last_became_peered":"2023-12-08T08:20:20.508891+0000","last_unstale":"2023-12-08T08:20:22.213689+0000","last_undegraded":"2023-12-08T08:20:22.213689+0000","last_fullsized":"2023-12-08T08:20:22.213689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:14:24.713628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957438+0000","last_change":"2023-12-08T08:20:20.523793+0000","last_active":"2023-12-08T08:20:21.957438+0000","last_peered":"2023-12-08T08:20:21.957438+0000","last_clean":"2023-12-08T08:20:21.957438+0000","last_became_active":"2023-12-08T08:20:20.523526+0000","last_became_peered":"2023-12-08T08:20:20.523526+0000","last_unstale":"2023-12-08T08:20:21.957438+0000","last_undegraded":"2023-12-08T08:20:21.957438+0000","last_fullsized":"2023-12-08T08:20:21.957438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:52:56.239687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672374+0000","last_change":"2023-12-08T08:20:20.515864+0000","last_active":"2023-12-08T08:20:21.672374+0000","last_peered":"2023-12-08T08:20:21.672374+0000","last_clean":"2023-12-08T08:20:21.672374+0000","last_became_active":"2023-12-08T08:20:20.515572+0000","last_became_peered":"2023-12-08T08:20:20.515572+0000","last_unstale":"2023-12-08T08:20:21.672374+0000","last_undegraded":"2023-12-08T08:20:21.672374+0000","last_fullsized":"2023-12-08T08:20:21.672374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:16:30.037506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713276+0000","last_change":"2023-12-08T08:20:20.514531+0000","last_active":"2023-12-08T08:20:21.713276+0000","last_peered":"2023-12-08T08:20:21.713276+0000","last_clean":"2023-12-08T08:20:21.713276+0000","last_became_active":"2023-12-08T08:20:20.514275+0000","last_became_peered":"2023-12-08T08:20:20.514275+0000","last_unstale":"2023-12-08T08:20:21.713276+0000","last_undegraded":"2023-12-08T08:20:21.713276+0000","last_fullsized":"2023-12-08T08:20:21.713276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:24:45.197087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214695+0000","last_change":"2023-12-08T08:20:20.523484+0000","last_active":"2023-12-08T08:20:22.214695+0000","last_peered":"2023-12-08T08:20:22.214695+0000","last_clean":"2023-12-08T08:20:22.214695+0000","last_became_active":"2023-12-08T08:20:20.523161+0000","last_became_peered":"2023-12-08T08:20:20.523161+0000","last_unstale":"2023-12-08T08:20:22.214695+0000","last_undegraded":"2023-12-08T08:20:22.214695+0000","last_fullsized":"2023-12-08T08:20:22.214695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:34:40.228006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213314+0000","last_change":"2023-12-08T08:20:20.530871+0000","last_active":"2023-12-08T08:20:22.213314+0000","last_peered":"2023-12-08T08:20:22.213314+0000","last_clean":"2023-12-08T08:20:22.213314+0000","last_became_active":"2023-12-08T08:20:20.530604+0000","last_became_peered":"2023-12-08T08:20:20.530604+0000","last_unstale":"2023-12-08T08:20:22.213314+0000","last_undegraded":"2023-12-08T08:20:22.213314+0000","last_fullsized":"2023-12-08T08:20:22.213314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:55.605759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214573+0000","last_change":"2023-12-08T08:20:20.522332+0000","last_active":"2023-12-08T08:20:22.214573+0000","last_peered":"2023-12-08T08:20:22.214573+0000","last_clean":"2023-12-08T08:20:22.214573+0000","last_became_active":"2023-12-08T08:20:20.522036+0000","last_became_peered":"2023-12-08T08:20:20.522036+0000","last_unstale":"2023-12-08T08:20:22.214573+0000","last_undegraded":"2023-12-08T08:20:22.214573+0000","last_fullsized":"2023-12-08T08:20:22.214573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:41:18.155537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213974+0000","last_change":"2023-12-08T08:20:20.528859+0000","last_active":"2023-12-08T08:20:22.213974+0000","last_peered":"2023-12-08T08:20:22.213974+0000","last_clean":"2023-12-08T08:20:22.213974+0000","last_became_active":"2023-12-08T08:20:20.528595+0000","last_became_peered":"2023-12-08T08:20:20.528595+0000","last_unstale":"2023-12-08T08:20:22.213974+0000","last_undegraded":"2023-12-08T08:20:22.213974+0000","last_fullsized":"2023-12-08T08:20:22.213974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:12:06.866332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672548+0000","last_change":"2023-12-08T08:20:20.519122+0000","last_active":"2023-12-08T08:20:21.672548+0000","last_peered":"2023-12-08T08:20:21.672548+0000","last_clean":"2023-12-08T08:20:21.672548+0000","last_became_active":"2023-12-08T08:20:20.518790+0000","last_became_peered":"2023-12-08T08:20:20.518790+0000","last_unstale":"2023-12-08T08:20:21.672548+0000","last_undegraded":"2023-12-08T08:20:21.672548+0000","last_fullsized":"2023-12-08T08:20:21.672548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:41:18.155537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503627+0000","last_change":"2023-12-08T08:20:20.511207+0000","last_active":"2023-12-08T08:20:21.503627+0000","last_peered":"2023-12-08T08:20:21.503627+0000","last_clean":"2023-12-08T08:20:21.503627+0000","last_became_active":"2023-12-08T08:20:20.509613+0000","last_became_peered":"2023-12-08T08:20:20.509613+0000","last_unstale":"2023-12-08T08:20:21.503627+0000","last_undegraded":"2023-12-08T08:20:21.503627+0000","last_fullsized":"2023-12-08T08:20:21.503627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:41:18.155537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213986+0000","last_change":"2023-12-08T08:20:20.529699+0000","last_active":"2023-12-08T08:20:22.213986+0000","last_peered":"2023-12-08T08:20:22.213986+0000","last_clean":"2023-12-08T08:20:22.213986+0000","last_became_active":"2023-12-08T08:20:20.528976+0000","last_became_peered":"2023-12-08T08:20:20.528976+0000","last_unstale":"2023-12-08T08:20:22.213986+0000","last_undegraded":"2023-12-08T08:20:22.213986+0000","last_fullsized":"2023-12-08T08:20:22.213986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:35:44.144209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713583+0000","last_change":"2023-12-08T08:20:20.513060+0000","last_active":"2023-12-08T08:20:21.713583+0000","last_peered":"2023-12-08T08:20:21.713583+0000","last_clean":"2023-12-08T08:20:21.713583+0000","last_became_active":"2023-12-08T08:20:20.512637+0000","last_became_peered":"2023-12-08T08:20:20.512637+0000","last_unstale":"2023-12-08T08:20:21.713583+0000","last_undegraded":"2023-12-08T08:20:21.713583+0000","last_fullsized":"2023-12-08T08:20:21.713583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:58.484542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214832+0000","last_change":"2023-12-08T08:20:20.521987+0000","last_active":"2023-12-08T08:20:22.214832+0000","last_peered":"2023-12-08T08:20:22.214832+0000","last_clean":"2023-12-08T08:20:22.214832+0000","last_became_active":"2023-12-08T08:20:20.521639+0000","last_became_peered":"2023-12-08T08:20:20.521639+0000","last_unstale":"2023-12-08T08:20:22.214832+0000","last_undegraded":"2023-12-08T08:20:22.214832+0000","last_fullsized":"2023-12-08T08:20:22.214832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:35:44.144209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213304+0000","last_change":"2023-12-08T08:20:20.518482+0000","last_active":"2023-12-08T08:20:22.213304+0000","last_peered":"2023-12-08T08:20:22.213304+0000","last_clean":"2023-12-08T08:20:22.213304+0000","last_became_active":"2023-12-08T08:20:20.518190+0000","last_became_peered":"2023-12-08T08:20:20.518190+0000","last_unstale":"2023-12-08T08:20:22.213304+0000","last_undegraded":"2023-12-08T08:20:22.213304+0000","last_fullsized":"2023-12-08T08:20:22.213304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:14:43.007025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672162+0000","last_change":"2023-12-08T08:20:20.515939+0000","last_active":"2023-12-08T08:20:21.672162+0000","last_peered":"2023-12-08T08:20:21.672162+0000","last_clean":"2023-12-08T08:20:21.672162+0000","last_became_active":"2023-12-08T08:20:20.515314+0000","last_became_peered":"2023-12-08T08:20:20.515314+0000","last_unstale":"2023-12-08T08:20:21.672162+0000","last_undegraded":"2023-12-08T08:20:21.672162+0000","last_fullsized":"2023-12-08T08:20:21.672162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:35:49.495548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.510090+0000","last_change":"2023-12-08T08:20:20.517465+0000","last_active":"2023-12-08T08:20:21.510090+0000","last_peered":"2023-12-08T08:20:21.510090+0000","last_clean":"2023-12-08T08:20:21.510090+0000","last_became_active":"2023-12-08T08:20:20.517151+0000","last_became_peered":"2023-12-08T08:20:20.517151+0000","last_unstale":"2023-12-08T08:20:21.510090+0000","last_undegraded":"2023-12-08T08:20:21.510090+0000","last_fullsized":"2023-12-08T08:20:21.510090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:17:32.867357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213861+0000","last_change":"2023-12-08T08:20:20.127114+0000","last_active":"2023-12-08T08:20:22.213861+0000","last_peered":"2023-12-08T08:20:22.213861+0000","last_clean":"2023-12-08T08:20:22.213861+0000","last_became_active":"2023-12-08T08:20:20.126718+0000","last_became_peered":"2023-12-08T08:20:20.126718+0000","last_unstale":"2023-12-08T08:20:22.213861+0000","last_undegraded":"2023-12-08T08:20:22.213861+0000","last_fullsized":"2023-12-08T08:20:22.213861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:06:20.375858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713403+0000","last_change":"2023-12-08T08:20:20.511756+0000","last_active":"2023-12-08T08:20:21.713403+0000","last_peered":"2023-12-08T08:20:21.713403+0000","last_clean":"2023-12-08T08:20:21.713403+0000","last_became_active":"2023-12-08T08:20:20.511411+0000","last_became_peered":"2023-12-08T08:20:20.511411+0000","last_unstale":"2023-12-08T08:20:21.713403+0000","last_undegraded":"2023-12-08T08:20:21.713403+0000","last_fullsized":"2023-12-08T08:20:21.713403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:55.605759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672137+0000","last_change":"2023-12-08T08:20:20.119404+0000","last_active":"2023-12-08T08:20:21.672137+0000","last_peered":"2023-12-08T08:20:21.672137+0000","last_clean":"2023-12-08T08:20:21.672137+0000","last_became_active":"2023-12-08T08:20:20.119117+0000","last_became_peered":"2023-12-08T08:20:20.119117+0000","last_unstale":"2023-12-08T08:20:21.672137+0000","last_undegraded":"2023-12-08T08:20:21.672137+0000","last_fullsized":"2023-12-08T08:20:21.672137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:06:20.375858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213309+0000","last_change":"2023-12-08T08:20:20.118455+0000","last_active":"2023-12-08T08:20:22.213309+0000","last_peered":"2023-12-08T08:20:22.213309+0000","last_clean":"2023-12-08T08:20:22.213309+0000","last_became_active":"2023-12-08T08:20:20.118187+0000","last_became_peered":"2023-12-08T08:20:20.118187+0000","last_unstale":"2023-12-08T08:20:22.213309+0000","last_undegraded":"2023-12-08T08:20:22.213309+0000","last_fullsized":"2023-12-08T08:20:22.213309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:50:44.025429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213363+0000","last_change":"2023-12-08T08:20:20.519950+0000","last_active":"2023-12-08T08:20:22.213363+0000","last_peered":"2023-12-08T08:20:22.213363+0000","last_clean":"2023-12-08T08:20:22.213363+0000","last_became_active":"2023-12-08T08:20:20.519682+0000","last_became_peered":"2023-12-08T08:20:20.519682+0000","last_unstale":"2023-12-08T08:20:22.213363+0000","last_undegraded":"2023-12-08T08:20:22.213363+0000","last_fullsized":"2023-12-08T08:20:22.213363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:22.960211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214641+0000","last_change":"2023-12-08T08:20:20.125917+0000","last_active":"2023-12-08T08:20:22.214641+0000","last_peered":"2023-12-08T08:20:22.214641+0000","last_clean":"2023-12-08T08:20:22.214641+0000","last_became_active":"2023-12-08T08:20:20.125471+0000","last_became_peered":"2023-12-08T08:20:20.125471+0000","last_unstale":"2023-12-08T08:20:22.214641+0000","last_undegraded":"2023-12-08T08:20:22.214641+0000","last_fullsized":"2023-12-08T08:20:22.214641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:07:35.883797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503438+0000","last_change":"2023-12-08T08:20:20.514082+0000","last_active":"2023-12-08T08:20:21.503438+0000","last_peered":"2023-12-08T08:20:21.503438+0000","last_clean":"2023-12-08T08:20:21.503438+0000","last_became_active":"2023-12-08T08:20:20.511617+0000","last_became_peered":"2023-12-08T08:20:20.511617+0000","last_unstale":"2023-12-08T08:20:21.503438+0000","last_undegraded":"2023-12-08T08:20:21.503438+0000","last_fullsized":"2023-12-08T08:20:21.503438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:35:49.495548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672445+0000","last_change":"2023-12-08T08:20:20.117986+0000","last_active":"2023-12-08T08:20:21.672445+0000","last_peered":"2023-12-08T08:20:21.672445+0000","last_clean":"2023-12-08T08:20:21.672445+0000","last_became_active":"2023-12-08T08:20:20.117643+0000","last_became_peered":"2023-12-08T08:20:20.117643+0000","last_unstale":"2023-12-08T08:20:21.672445+0000","last_undegraded":"2023-12-08T08:20:21.672445+0000","last_fullsized":"2023-12-08T08:20:21.672445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:51:02.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.215153+0000","last_change":"2023-12-08T08:20:20.526658+0000","last_active":"2023-12-08T08:20:22.215153+0000","last_peered":"2023-12-08T08:20:22.215153+0000","last_clean":"2023-12-08T08:20:22.215153+0000","last_became_active":"2023-12-08T08:20:20.525963+0000","last_became_peered":"2023-12-08T08:20:20.525963+0000","last_unstale":"2023-12-08T08:20:22.215153+0000","last_undegraded":"2023-12-08T08:20:22.215153+0000","last_fullsized":"2023-12-08T08:20:22.215153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:34:32.364346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.215087+0000","last_change":"2023-12-08T08:20:20.119060+0000","last_active":"2023-12-08T08:20:22.215087+0000","last_peered":"2023-12-08T08:20:22.215087+0000","last_clean":"2023-12-08T08:20:22.215087+0000","last_became_active":"2023-12-08T08:20:20.118701+0000","last_became_peered":"2023-12-08T08:20:20.118701+0000","last_unstale":"2023-12-08T08:20:22.215087+0000","last_undegraded":"2023-12-08T08:20:22.215087+0000","last_fullsized":"2023-12-08T08:20:22.215087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:21.954598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713519+0000","last_change":"2023-12-08T08:20:20.530125+0000","last_active":"2023-12-08T08:20:21.713519+0000","last_peered":"2023-12-08T08:20:21.713519+0000","last_clean":"2023-12-08T08:20:21.713519+0000","last_became_active":"2023-12-08T08:20:20.529601+0000","last_became_peered":"2023-12-08T08:20:20.529601+0000","last_unstale":"2023-12-08T08:20:21.713519+0000","last_undegraded":"2023-12-08T08:20:21.713519+0000","last_fullsized":"2023-12-08T08:20:21.713519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:16:30.037506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503623+0000","last_change":"2023-12-08T08:20:20.118338+0000","last_active":"2023-12-08T08:20:21.503623+0000","last_peered":"2023-12-08T08:20:21.503623+0000","last_clean":"2023-12-08T08:20:21.503623+0000","last_became_active":"2023-12-08T08:20:20.118032+0000","last_became_peered":"2023-12-08T08:20:20.118032+0000","last_unstale":"2023-12-08T08:20:21.503623+0000","last_undegraded":"2023-12-08T08:20:21.503623+0000","last_fullsized":"2023-12-08T08:20:21.503623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:14:41.931523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.510480+0000","last_change":"2023-12-08T08:20:20.521236+0000","last_active":"2023-12-08T08:20:21.510480+0000","last_peered":"2023-12-08T08:20:21.510480+0000","last_clean":"2023-12-08T08:20:21.510480+0000","last_became_active":"2023-12-08T08:20:20.520900+0000","last_became_peered":"2023-12-08T08:20:20.520900+0000","last_unstale":"2023-12-08T08:20:21.510480+0000","last_undegraded":"2023-12-08T08:20:21.510480+0000","last_fullsized":"2023-12-08T08:20:21.510480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:51:03.805815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672410+0000","last_change":"2023-12-08T08:20:20.126955+0000","last_active":"2023-12-08T08:20:21.672410+0000","last_peered":"2023-12-08T08:20:21.672410+0000","last_clean":"2023-12-08T08:20:21.672410+0000","last_became_active":"2023-12-08T08:20:20.126629+0000","last_became_peered":"2023-12-08T08:20:20.126629+0000","last_unstale":"2023-12-08T08:20:21.672410+0000","last_undegraded":"2023-12-08T08:20:21.672410+0000","last_fullsized":"2023-12-08T08:20:21.672410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:14:41.931523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957190+0000","last_change":"2023-12-08T08:20:20.518442+0000","last_active":"2023-12-08T08:20:21.957190+0000","last_peered":"2023-12-08T08:20:21.957190+0000","last_clean":"2023-12-08T08:20:21.957190+0000","last_became_active":"2023-12-08T08:20:20.518033+0000","last_became_peered":"2023-12-08T08:20:20.518033+0000","last_unstale":"2023-12-08T08:20:21.957190+0000","last_undegraded":"2023-12-08T08:20:21.957190+0000","last_fullsized":"2023-12-08T08:20:21.957190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:34:32.364346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713480+0000","last_change":"2023-12-08T08:20:20.110330+0000","last_active":"2023-12-08T08:20:21.713480+0000","last_peered":"2023-12-08T08:20:21.713480+0000","last_clean":"2023-12-08T08:20:21.713480+0000","last_became_active":"2023-12-08T08:20:20.109870+0000","last_became_peered":"2023-12-08T08:20:20.109870+0000","last_unstale":"2023-12-08T08:20:21.713480+0000","last_undegraded":"2023-12-08T08:20:21.713480+0000","last_fullsized":"2023-12-08T08:20:21.713480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:01:11.293463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713167+0000","last_change":"2023-12-08T08:20:20.514723+0000","last_active":"2023-12-08T08:20:21.713167+0000","last_peered":"2023-12-08T08:20:21.713167+0000","last_clean":"2023-12-08T08:20:21.713167+0000","last_became_active":"2023-12-08T08:20:20.514377+0000","last_became_peered":"2023-12-08T08:20:20.514377+0000","last_unstale":"2023-12-08T08:20:21.713167+0000","last_undegraded":"2023-12-08T08:20:21.713167+0000","last_fullsized":"2023-12-08T08:20:21.713167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:06:21.381472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214843+0000","last_change":"2023-12-08T08:20:20.129684+0000","last_active":"2023-12-08T08:20:22.214843+0000","last_peered":"2023-12-08T08:20:22.214843+0000","last_clean":"2023-12-08T08:20:22.214843+0000","last_became_active":"2023-12-08T08:20:20.129423+0000","last_became_peered":"2023-12-08T08:20:20.129423+0000","last_unstale":"2023-12-08T08:20:22.214843+0000","last_undegraded":"2023-12-08T08:20:22.214843+0000","last_fullsized":"2023-12-08T08:20:22.214843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:24:44.191473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957171+0000","last_change":"2023-12-08T08:20:20.533071+0000","last_active":"2023-12-08T08:20:21.957171+0000","last_peered":"2023-12-08T08:20:21.957171+0000","last_clean":"2023-12-08T08:20:21.957171+0000","last_became_active":"2023-12-08T08:20:20.532811+0000","last_became_peered":"2023-12-08T08:20:20.532811+0000","last_unstale":"2023-12-08T08:20:21.957171+0000","last_undegraded":"2023-12-08T08:20:21.957171+0000","last_fullsized":"2023-12-08T08:20:21.957171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:06.439860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672150+0000","last_change":"2023-12-08T08:20:20.113477+0000","last_active":"2023-12-08T08:20:21.672150+0000","last_peered":"2023-12-08T08:20:21.672150+0000","last_clean":"2023-12-08T08:20:21.672150+0000","last_became_active":"2023-12-08T08:20:20.113149+0000","last_became_peered":"2023-12-08T08:20:20.113149+0000","last_unstale":"2023-12-08T08:20:21.672150+0000","last_undegraded":"2023-12-08T08:20:21.672150+0000","last_fullsized":"2023-12-08T08:20:21.672150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:14:23.708015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672290+0000","last_change":"2023-12-08T08:20:20.519693+0000","last_active":"2023-12-08T08:20:21.672290+0000","last_peered":"2023-12-08T08:20:21.672290+0000","last_clean":"2023-12-08T08:20:21.672290+0000","last_became_active":"2023-12-08T08:20:20.519418+0000","last_became_peered":"2023-12-08T08:20:20.519418+0000","last_unstale":"2023-12-08T08:20:21.672290+0000","last_undegraded":"2023-12-08T08:20:21.672290+0000","last_fullsized":"2023-12-08T08:20:21.672290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:22.960211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213194+0000","last_change":"2023-12-08T08:20:20.106359+0000","last_active":"2023-12-08T08:20:22.213194+0000","last_peered":"2023-12-08T08:20:22.213194+0000","last_clean":"2023-12-08T08:20:22.213194+0000","last_became_active":"2023-12-08T08:20:20.106095+0000","last_became_peered":"2023-12-08T08:20:20.106095+0000","last_unstale":"2023-12-08T08:20:22.213194+0000","last_undegraded":"2023-12-08T08:20:22.213194+0000","last_fullsized":"2023-12-08T08:20:22.213194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:00:11.928203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957117+0000","last_change":"2023-12-08T08:20:20.528783+0000","last_active":"2023-12-08T08:20:21.957117+0000","last_peered":"2023-12-08T08:20:21.957117+0000","last_clean":"2023-12-08T08:20:21.957117+0000","last_became_active":"2023-12-08T08:20:20.528463+0000","last_became_peered":"2023-12-08T08:20:20.528463+0000","last_unstale":"2023-12-08T08:20:21.957117+0000","last_undegraded":"2023-12-08T08:20:21.957117+0000","last_fullsized":"2023-12-08T08:20:21.957117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:43:55.983858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.510372+0000","last_change":"2023-12-08T08:20:20.109998+0000","last_active":"2023-12-08T08:20:21.510372+0000","last_peered":"2023-12-08T08:20:21.510372+0000","last_clean":"2023-12-08T08:20:21.510372+0000","last_became_active":"2023-12-08T08:20:20.109580+0000","last_became_peered":"2023-12-08T08:20:20.109580+0000","last_unstale":"2023-12-08T08:20:21.510372+0000","last_undegraded":"2023-12-08T08:20:21.510372+0000","last_fullsized":"2023-12-08T08:20:21.510372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:17:10.702274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957486+0000","last_change":"2023-12-08T08:20:20.533736+0000","last_active":"2023-12-08T08:20:21.957486+0000","last_peered":"2023-12-08T08:20:21.957486+0000","last_clean":"2023-12-08T08:20:21.957486+0000","last_became_active":"2023-12-08T08:20:20.533508+0000","last_became_peered":"2023-12-08T08:20:20.533508+0000","last_unstale":"2023-12-08T08:20:21.957486+0000","last_undegraded":"2023-12-08T08:20:21.957486+0000","last_fullsized":"2023-12-08T08:20:21.957486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:22:44.822453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213618+0000","last_change":"2023-12-08T08:20:20.121251+0000","last_active":"2023-12-08T08:20:22.213618+0000","last_peered":"2023-12-08T08:20:22.213618+0000","last_clean":"2023-12-08T08:20:22.213618+0000","last_became_active":"2023-12-08T08:20:20.120767+0000","last_became_peered":"2023-12-08T08:20:20.120767+0000","last_unstale":"2023-12-08T08:20:22.213618+0000","last_undegraded":"2023-12-08T08:20:22.213618+0000","last_fullsized":"2023-12-08T08:20:22.213618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:17:31.861743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957582+0000","last_change":"2023-12-08T08:20:20.532439+0000","last_active":"2023-12-08T08:20:21.957582+0000","last_peered":"2023-12-08T08:20:21.957582+0000","last_clean":"2023-12-08T08:20:21.957582+0000","last_became_active":"2023-12-08T08:20:20.532120+0000","last_became_peered":"2023-12-08T08:20:20.532120+0000","last_unstale":"2023-12-08T08:20:21.957582+0000","last_undegraded":"2023-12-08T08:20:21.957582+0000","last_fullsized":"2023-12-08T08:20:21.957582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:54:51.364740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503714+0000","last_change":"2023-12-08T08:20:20.112322+0000","last_active":"2023-12-08T08:20:21.503714+0000","last_peered":"2023-12-08T08:20:21.503714+0000","last_clean":"2023-12-08T08:20:21.503714+0000","last_became_active":"2023-12-08T08:20:20.112023+0000","last_became_peered":"2023-12-08T08:20:20.112023+0000","last_unstale":"2023-12-08T08:20:21.503714+0000","last_undegraded":"2023-12-08T08:20:21.503714+0000","last_fullsized":"2023-12-08T08:20:21.503714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:50:44.025429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.215085+0000","last_change":"2023-12-08T08:20:20.524988+0000","last_active":"2023-12-08T08:20:22.215085+0000","last_peered":"2023-12-08T08:20:22.215085+0000","last_clean":"2023-12-08T08:20:22.215085+0000","last_became_active":"2023-12-08T08:20:20.522486+0000","last_became_peered":"2023-12-08T08:20:20.522486+0000","last_unstale":"2023-12-08T08:20:22.215085+0000","last_undegraded":"2023-12-08T08:20:22.215085+0000","last_fullsized":"2023-12-08T08:20:22.215085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:06.439860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213544+0000","last_change":"2023-12-08T08:20:20.112210+0000","last_active":"2023-12-08T08:20:22.213544+0000","last_peered":"2023-12-08T08:20:22.213544+0000","last_clean":"2023-12-08T08:20:22.213544+0000","last_became_active":"2023-12-08T08:20:20.111888+0000","last_became_peered":"2023-12-08T08:20:20.111888+0000","last_unstale":"2023-12-08T08:20:22.213544+0000","last_undegraded":"2023-12-08T08:20:22.213544+0000","last_fullsized":"2023-12-08T08:20:22.213544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:17:10.702274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957276+0000","last_change":"2023-12-08T08:20:20.530738+0000","last_active":"2023-12-08T08:20:21.957276+0000","last_peered":"2023-12-08T08:20:21.957276+0000","last_clean":"2023-12-08T08:20:21.957276+0000","last_became_active":"2023-12-08T08:20:20.530478+0000","last_became_peered":"2023-12-08T08:20:20.530478+0000","last_unstale":"2023-12-08T08:20:21.957276+0000","last_undegraded":"2023-12-08T08:20:21.957276+0000","last_fullsized":"2023-12-08T08:20:21.957276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:18.441827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-08T08:20:20.505097+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:20:20.505097+0000","last_peered":"2023-12-08T08:20:20.505097+0000","last_clean":"2023-12-08T08:20:20.505097+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:20:20.505097+0000","last_undegraded":"2023-12-08T08:20:20.505097+0000","last_fullsized":"2023-12-08T08:20:20.505097+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214696+0000","last_change":"2023-12-08T08:20:20.115839+0000","last_active":"2023-12-08T08:20:22.214696+0000","last_peered":"2023-12-08T08:20:22.214696+0000","last_clean":"2023-12-08T08:20:22.214696+0000","last_became_active":"2023-12-08T08:20:20.113312+0000","last_became_peered":"2023-12-08T08:20:20.113312+0000","last_unstale":"2023-12-08T08:20:22.214696+0000","last_undegraded":"2023-12-08T08:20:22.214696+0000","last_fullsized":"2023-12-08T08:20:22.214696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:35:48.489934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213600+0000","last_change":"2023-12-08T08:20:20.529095+0000","last_active":"2023-12-08T08:20:22.213600+0000","last_peered":"2023-12-08T08:20:22.213600+0000","last_clean":"2023-12-08T08:20:22.213600+0000","last_became_active":"2023-12-08T08:20:20.528833+0000","last_became_peered":"2023-12-08T08:20:20.528833+0000","last_unstale":"2023-12-08T08:20:22.213600+0000","last_undegraded":"2023-12-08T08:20:22.213600+0000","last_fullsized":"2023-12-08T08:20:22.213600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:41:18.155537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.956800+0000","last_change":"2023-12-08T08:20:20.127208+0000","last_active":"2023-12-08T08:20:21.956800+0000","last_peered":"2023-12-08T08:20:21.956800+0000","last_clean":"2023-12-08T08:20:21.956800+0000","last_became_active":"2023-12-08T08:20:20.126756+0000","last_became_peered":"2023-12-08T08:20:20.126756+0000","last_unstale":"2023-12-08T08:20:21.956800+0000","last_undegraded":"2023-12-08T08:20:21.956800+0000","last_fullsized":"2023-12-08T08:20:21.956800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:17:31.861743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713208+0000","last_change":"2023-12-08T08:20:20.505416+0000","last_active":"2023-12-08T08:20:21.713208+0000","last_peered":"2023-12-08T08:20:21.713208+0000","last_clean":"2023-12-08T08:20:21.713208+0000","last_became_active":"2023-12-08T08:20:20.505234+0000","last_became_peered":"2023-12-08T08:20:20.505234+0000","last_unstale":"2023-12-08T08:20:21.713208+0000","last_undegraded":"2023-12-08T08:20:21.713208+0000","last_fullsized":"2023-12-08T08:20:21.713208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:50:45.031043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213398+0000","last_change":"2023-12-08T08:20:20.124516+0000","last_active":"2023-12-08T08:20:22.213398+0000","last_peered":"2023-12-08T08:20:22.213398+0000","last_clean":"2023-12-08T08:20:22.213398+0000","last_became_active":"2023-12-08T08:20:20.119912+0000","last_became_peered":"2023-12-08T08:20:20.119912+0000","last_unstale":"2023-12-08T08:20:22.213398+0000","last_undegraded":"2023-12-08T08:20:22.213398+0000","last_fullsized":"2023-12-08T08:20:22.213398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:01:11.293463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503488+0000","last_change":"2023-12-08T08:20:20.514055+0000","last_active":"2023-12-08T08:20:21.503488+0000","last_peered":"2023-12-08T08:20:21.503488+0000","last_clean":"2023-12-08T08:20:21.503488+0000","last_became_active":"2023-12-08T08:20:20.511185+0000","last_became_peered":"2023-12-08T08:20:20.511185+0000","last_unstale":"2023-12-08T08:20:21.503488+0000","last_undegraded":"2023-12-08T08:20:21.503488+0000","last_fullsized":"2023-12-08T08:20:21.503488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:22.960211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214950+0000","last_change":"2023-12-08T08:20:20.129124+0000","last_active":"2023-12-08T08:20:22.214950+0000","last_peered":"2023-12-08T08:20:22.214950+0000","last_clean":"2023-12-08T08:20:22.214950+0000","last_became_active":"2023-12-08T08:20:20.128851+0000","last_became_peered":"2023-12-08T08:20:20.128851+0000","last_unstale":"2023-12-08T08:20:22.214950+0000","last_undegraded":"2023-12-08T08:20:22.214950+0000","last_fullsized":"2023-12-08T08:20:22.214950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:54.600146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.510286+0000","last_change":"2023-12-08T08:20:20.518546+0000","last_active":"2023-12-08T08:20:21.510286+0000","last_peered":"2023-12-08T08:20:21.510286+0000","last_clean":"2023-12-08T08:20:21.510286+0000","last_became_active":"2023-12-08T08:20:20.516272+0000","last_became_peered":"2023-12-08T08:20:20.516272+0000","last_unstale":"2023-12-08T08:20:21.510286+0000","last_undegraded":"2023-12-08T08:20:21.510286+0000","last_fullsized":"2023-12-08T08:20:21.510286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:14:43.007025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503676+0000","last_change":"2023-12-08T08:20:20.106320+0000","last_active":"2023-12-08T08:20:21.503676+0000","last_peered":"2023-12-08T08:20:21.503676+0000","last_clean":"2023-12-08T08:20:21.503676+0000","last_became_active":"2023-12-08T08:20:20.106039+0000","last_became_peered":"2023-12-08T08:20:20.106039+0000","last_unstale":"2023-12-08T08:20:21.503676+0000","last_undegraded":"2023-12-08T08:20:21.503676+0000","last_fullsized":"2023-12-08T08:20:21.503676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:51:02.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.215173+0000","last_change":"2023-12-08T08:20:20.520730+0000","last_active":"2023-12-08T08:20:22.215173+0000","last_peered":"2023-12-08T08:20:22.215173+0000","last_clean":"2023-12-08T08:20:22.215173+0000","last_became_active":"2023-12-08T08:20:20.520084+0000","last_became_peered":"2023-12-08T08:20:20.520084+0000","last_unstale":"2023-12-08T08:20:22.215173+0000","last_undegraded":"2023-12-08T08:20:22.215173+0000","last_fullsized":"2023-12-08T08:20:22.215173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:18.441827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957458+0000","last_change":"2023-12-08T08:20:20.131234+0000","last_active":"2023-12-08T08:20:21.957458+0000","last_peered":"2023-12-08T08:20:21.957458+0000","last_clean":"2023-12-08T08:20:21.957458+0000","last_became_active":"2023-12-08T08:20:20.130858+0000","last_became_peered":"2023-12-08T08:20:20.130858+0000","last_unstale":"2023-12-08T08:20:21.957458+0000","last_undegraded":"2023-12-08T08:20:21.957458+0000","last_fullsized":"2023-12-08T08:20:21.957458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:41:17.149923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503584+0000","last_change":"2023-12-08T08:20:20.513590+0000","last_active":"2023-12-08T08:20:21.503584+0000","last_peered":"2023-12-08T08:20:21.503584+0000","last_clean":"2023-12-08T08:20:21.503584+0000","last_became_active":"2023-12-08T08:20:20.513254+0000","last_became_peered":"2023-12-08T08:20:20.513254+0000","last_unstale":"2023-12-08T08:20:21.503584+0000","last_undegraded":"2023-12-08T08:20:21.503584+0000","last_fullsized":"2023-12-08T08:20:21.503584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:16:30.037506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.788858+0000","last_change":"2023-12-08T08:20:20.119102+0000","last_active":"2023-12-08T08:20:22.788858+0000","last_peered":"2023-12-08T08:20:22.788858+0000","last_clean":"2023-12-08T08:20:22.788858+0000","last_became_active":"2023-12-08T08:20:20.118810+0000","last_became_peered":"2023-12-08T08:20:20.118810+0000","last_unstale":"2023-12-08T08:20:22.788858+0000","last_undegraded":"2023-12-08T08:20:22.788858+0000","last_fullsized":"2023-12-08T08:20:22.788858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:07:35.883797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214019+0000","last_change":"2023-12-08T08:20:20.517408+0000","last_active":"2023-12-08T08:20:22.214019+0000","last_peered":"2023-12-08T08:20:22.214019+0000","last_clean":"2023-12-08T08:20:22.214019+0000","last_became_active":"2023-12-08T08:20:20.517128+0000","last_became_peered":"2023-12-08T08:20:20.517128+0000","last_unstale":"2023-12-08T08:20:22.214019+0000","last_undegraded":"2023-12-08T08:20:22.214019+0000","last_fullsized":"2023-12-08T08:20:22.214019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:43:55.983858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672543+0000","last_change":"2023-12-08T08:20:20.123921+0000","last_active":"2023-12-08T08:20:21.672543+0000","last_peered":"2023-12-08T08:20:21.672543+0000","last_clean":"2023-12-08T08:20:21.672543+0000","last_became_active":"2023-12-08T08:20:20.123647+0000","last_became_peered":"2023-12-08T08:20:20.123647+0000","last_unstale":"2023-12-08T08:20:21.672543+0000","last_undegraded":"2023-12-08T08:20:21.672543+0000","last_fullsized":"2023-12-08T08:20:21.672543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:50:44.025429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713522+0000","last_change":"2023-12-08T08:20:20.512961+0000","last_active":"2023-12-08T08:20:21.713522+0000","last_peered":"2023-12-08T08:20:21.713522+0000","last_clean":"2023-12-08T08:20:21.713522+0000","last_became_active":"2023-12-08T08:20:20.512658+0000","last_became_peered":"2023-12-08T08:20:20.512658+0000","last_unstale":"2023-12-08T08:20:21.713522+0000","last_undegraded":"2023-12-08T08:20:21.713522+0000","last_fullsized":"2023-12-08T08:20:21.713522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:41:18.155537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.956795+0000","last_change":"2023-12-08T08:20:20.127034+0000","last_active":"2023-12-08T08:20:21.956795+0000","last_peered":"2023-12-08T08:20:21.956795+0000","last_clean":"2023-12-08T08:20:21.956795+0000","last_became_active":"2023-12-08T08:20:20.126738+0000","last_became_peered":"2023-12-08T08:20:20.126738+0000","last_unstale":"2023-12-08T08:20:21.956795+0000","last_undegraded":"2023-12-08T08:20:21.956795+0000","last_fullsized":"2023-12-08T08:20:21.956795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:01:11.293463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.510200+0000","last_change":"2023-12-08T08:20:20.508042+0000","last_active":"2023-12-08T08:20:21.510200+0000","last_peered":"2023-12-08T08:20:21.510200+0000","last_clean":"2023-12-08T08:20:21.510200+0000","last_became_active":"2023-12-08T08:20:20.507604+0000","last_became_peered":"2023-12-08T08:20:20.507604+0000","last_unstale":"2023-12-08T08:20:21.510200+0000","last_undegraded":"2023-12-08T08:20:21.510200+0000","last_fullsized":"2023-12-08T08:20:21.510200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:50:19.617575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503521+0000","last_change":"2023-12-08T08:20:20.114773+0000","last_active":"2023-12-08T08:20:21.503521+0000","last_peered":"2023-12-08T08:20:21.503521+0000","last_clean":"2023-12-08T08:20:21.503521+0000","last_became_active":"2023-12-08T08:20:20.114031+0000","last_became_peered":"2023-12-08T08:20:20.114031+0000","last_unstale":"2023-12-08T08:20:21.503521+0000","last_undegraded":"2023-12-08T08:20:21.503521+0000","last_fullsized":"2023-12-08T08:20:21.503521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:14:23.708015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213446+0000","last_change":"2023-12-08T08:20:20.517325+0000","last_active":"2023-12-08T08:20:22.213446+0000","last_peered":"2023-12-08T08:20:22.213446+0000","last_clean":"2023-12-08T08:20:22.213446+0000","last_became_active":"2023-12-08T08:20:20.517052+0000","last_became_peered":"2023-12-08T08:20:20.517052+0000","last_unstale":"2023-12-08T08:20:22.213446+0000","last_undegraded":"2023-12-08T08:20:22.213446+0000","last_fullsized":"2023-12-08T08:20:22.213446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:16:30.037506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.503677+0000","last_change":"2023-12-08T08:20:20.125369+0000","last_active":"2023-12-08T08:20:21.503677+0000","last_peered":"2023-12-08T08:20:21.503677+0000","last_clean":"2023-12-08T08:20:21.503677+0000","last_became_active":"2023-12-08T08:20:20.124307+0000","last_became_peered":"2023-12-08T08:20:20.124307+0000","last_unstale":"2023-12-08T08:20:21.503677+0000","last_undegraded":"2023-12-08T08:20:21.503677+0000","last_fullsized":"2023-12-08T08:20:21.503677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:06:20.375858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.213848+0000","last_change":"2023-12-08T08:20:20.517511+0000","last_active":"2023-12-08T08:20:22.213848+0000","last_peered":"2023-12-08T08:20:22.213848+0000","last_clean":"2023-12-08T08:20:22.213848+0000","last_became_active":"2023-12-08T08:20:20.517230+0000","last_became_peered":"2023-12-08T08:20:20.517230+0000","last_unstale":"2023-12-08T08:20:22.213848+0000","last_undegraded":"2023-12-08T08:20:22.213848+0000","last_fullsized":"2023-12-08T08:20:22.213848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:34:40.228006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957287+0000","last_change":"2023-12-08T08:20:20.131143+0000","last_active":"2023-12-08T08:20:21.957287+0000","last_peered":"2023-12-08T08:20:21.957287+0000","last_clean":"2023-12-08T08:20:21.957287+0000","last_became_active":"2023-12-08T08:20:20.130764+0000","last_became_peered":"2023-12-08T08:20:20.130764+0000","last_unstale":"2023-12-08T08:20:21.957287+0000","last_undegraded":"2023-12-08T08:20:21.957287+0000","last_fullsized":"2023-12-08T08:20:21.957287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:50:44.025429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.672139+0000","last_change":"2023-12-08T08:20:20.512488+0000","last_active":"2023-12-08T08:20:21.672139+0000","last_peered":"2023-12-08T08:20:21.672139+0000","last_clean":"2023-12-08T08:20:21.672139+0000","last_became_active":"2023-12-08T08:20:20.512025+0000","last_became_peered":"2023-12-08T08:20:20.512025+0000","last_unstale":"2023-12-08T08:20:21.672139+0000","last_undegraded":"2023-12-08T08:20:21.672139+0000","last_fullsized":"2023-12-08T08:20:21.672139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:24:45.197087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.215175+0000","last_change":"2023-12-08T08:20:20.520916+0000","last_active":"2023-12-08T08:20:22.215175+0000","last_peered":"2023-12-08T08:20:22.215175+0000","last_clean":"2023-12-08T08:20:22.215175+0000","last_became_active":"2023-12-08T08:20:20.520425+0000","last_became_peered":"2023-12-08T08:20:20.520425+0000","last_unstale":"2023-12-08T08:20:22.215175+0000","last_undegraded":"2023-12-08T08:20:22.215175+0000","last_fullsized":"2023-12-08T08:20:22.215175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:52:56.239687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957134+0000","last_change":"2023-12-08T08:20:20.131174+0000","last_active":"2023-12-08T08:20:21.957134+0000","last_peered":"2023-12-08T08:20:21.957134+0000","last_clean":"2023-12-08T08:20:21.957134+0000","last_became_active":"2023-12-08T08:20:20.130872+0000","last_became_peered":"2023-12-08T08:20:20.130872+0000","last_unstale":"2023-12-08T08:20:21.957134+0000","last_undegraded":"2023-12-08T08:20:21.957134+0000","last_fullsized":"2023-12-08T08:20:21.957134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:51:02.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214974+0000","last_change":"2023-12-08T08:20:20.521452+0000","last_active":"2023-12-08T08:20:22.214974+0000","last_peered":"2023-12-08T08:20:22.214974+0000","last_clean":"2023-12-08T08:20:22.214974+0000","last_became_active":"2023-12-08T08:20:20.521159+0000","last_became_peered":"2023-12-08T08:20:20.521159+0000","last_unstale":"2023-12-08T08:20:22.214974+0000","last_undegraded":"2023-12-08T08:20:22.214974+0000","last_fullsized":"2023-12-08T08:20:22.214974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:43:55.983858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.957295+0000","last_change":"2023-12-08T08:20:20.133530+0000","last_active":"2023-12-08T08:20:21.957295+0000","last_peered":"2023-12-08T08:20:21.957295+0000","last_clean":"2023-12-08T08:20:21.957295+0000","last_became_active":"2023-12-08T08:20:20.133275+0000","last_became_peered":"2023-12-08T08:20:20.133275+0000","last_unstale":"2023-12-08T08:20:21.957295+0000","last_undegraded":"2023-12-08T08:20:21.957295+0000","last_fullsized":"2023-12-08T08:20:21.957295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:21.954598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713403+0000","last_change":"2023-12-08T08:20:20.529914+0000","last_active":"2023-12-08T08:20:21.713403+0000","last_peered":"2023-12-08T08:20:21.713403+0000","last_clean":"2023-12-08T08:20:21.713403+0000","last_became_active":"2023-12-08T08:20:20.529197+0000","last_became_peered":"2023-12-08T08:20:20.529197+0000","last_unstale":"2023-12-08T08:20:21.713403+0000","last_undegraded":"2023-12-08T08:20:21.713403+0000","last_fullsized":"2023-12-08T08:20:21.713403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:22.960211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214115+0000","last_change":"2023-12-08T08:20:20.122629+0000","last_active":"2023-12-08T08:20:22.214115+0000","last_peered":"2023-12-08T08:20:22.214115+0000","last_clean":"2023-12-08T08:20:22.214115+0000","last_became_active":"2023-12-08T08:20:20.122354+0000","last_became_peered":"2023-12-08T08:20:20.122354+0000","last_unstale":"2023-12-08T08:20:22.214115+0000","last_undegraded":"2023-12-08T08:20:22.214115+0000","last_fullsized":"2023-12-08T08:20:22.214115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:07:35.883797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:22.214035+0000","last_change":"2023-12-08T08:20:20.524585+0000","last_active":"2023-12-08T08:20:22.214035+0000","last_peered":"2023-12-08T08:20:22.214035+0000","last_clean":"2023-12-08T08:20:22.214035+0000","last_became_active":"2023-12-08T08:20:20.524328+0000","last_became_peered":"2023-12-08T08:20:20.524328+0000","last_unstale":"2023-12-08T08:20:22.214035+0000","last_undegraded":"2023-12-08T08:20:22.214035+0000","last_fullsized":"2023-12-08T08:20:22.214035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:20.085627+0000","last_clean_scrub_stamp":"2023-12-08T08:20:20.085627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:06.439860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.713606+0000","last_change":"2023-12-08T08:20:20.123711+0000","last_active":"2023-12-08T08:20:21.713606+0000","last_peered":"2023-12-08T08:20:21.713606+0000","last_clean":"2023-12-08T08:20:21.713606+0000","last_became_active":"2023-12-08T08:20:20.123409+0000","last_became_peered":"2023-12-08T08:20:20.123409+0000","last_unstale":"2023-12-08T08:20:21.713606+0000","last_undegraded":"2023-12-08T08:20:21.713606+0000","last_fullsized":"2023-12-08T08:20:21.713606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:19.080013+0000","last_clean_scrub_stamp":"2023-12-08T08:20:19.080013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:14:23.708015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":661860,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":661916,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.863}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.7290000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6550000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.514}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8380000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4590000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:20:31.762 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-08T08:20:31.762 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-08T08:20:31.762 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-08T08:20:31.762 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-08T08:20:31.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.941+0000 7ffa59b72640 1 Processor -- start 2023-12-08T08:20:31.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.941+0000 7ffa59b72640 1 -- start start 2023-12-08T08:20:31.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.941+0000 7ffa59b72640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffa54154f20 0x7ffa5406b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.941+0000 7ffa59b72640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ffa5406bf30 0x7ffa5415ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.941+0000 7ffa59b72640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa540c4890 con 0x7ffa540af4c0 2023-12-08T08:20:31.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.941+0000 7ffa59b72640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa541553d0 con 0x7ffa54154f20 2023-12-08T08:20:31.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.941+0000 7ffa59b72640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa5406c340 con 0x7ffa5406bf30 2023-12-08T08:20:31.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.941+0000 7ffa52ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffa54154f20 0x7ffa5406b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.941+0000 7ffa537fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ffa540af4c0 0x7ffa540c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34462/0 (socket says 172.21.15.88:34462) 2023-12-08T08:20:31.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.941+0000 7ffa52ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffa54154f20 0x7ffa5406b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41266/0 (socket says 172.21.15.88:41266) 2023-12-08T08:20:31.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.941+0000 7ffa537fe640 1 -- 172.21.15.88:0/15651236 learned_addr learned my addr 172.21.15.88:0/15651236 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:31.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.941+0000 7ffa53fff640 1 --2- 172.21.15.88:0/15651236 >> v2:172.21.15.148:3300/0 conn(0x7ffa5406bf30 0x7ffa5415ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.941+0000 7ffa52ffd640 1 -- 172.21.15.88:0/15651236 >> v2:172.21.15.148:3300/0 conn(0x7ffa5406bf30 msgr2=0x7ffa5415ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:31.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.941+0000 7ffa52ffd640 1 --2- 172.21.15.88:0/15651236 >> v2:172.21.15.148:3300/0 conn(0x7ffa5406bf30 0x7ffa5415ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.941+0000 7ffa52ffd640 1 -- 172.21.15.88:0/15651236 >> v1:172.21.15.88:6789/0 conn(0x7ffa540af4c0 legacy=0x7ffa540c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.941+0000 7ffa52ffd640 1 -- 172.21.15.88:0/15651236 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa540af8a0 con 0x7ffa54154f20 2023-12-08T08:20:31.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.945+0000 7ffa52ffd640 1 --2- 172.21.15.88:0/15651236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa54154f20 0x7ffa5406b9f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffa540c9d90 tx=0x7ffa4801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fafe28501c1cac5d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:31.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.945+0000 7ffa527fc640 1 -- 172.21.15.88:0/15651236 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa480ac600 con 0x7ffa54154f20 2023-12-08T08:20:31.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.945+0000 7ffa527fc640 1 -- 172.21.15.88:0/15651236 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa480a8050 con 0x7ffa54154f20 2023-12-08T08:20:31.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.945+0000 7ffa527fc640 1 -- 172.21.15.88:0/15651236 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa480ac980 con 0x7ffa54154f20 2023-12-08T08:20:31.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.945+0000 7ffa59b72640 1 -- 172.21.15.88:0/15651236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa54154f20 msgr2=0x7ffa5406b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.945+0000 7ffa59b72640 1 --2- 172.21.15.88:0/15651236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa54154f20 0x7ffa5406b9f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffa540c9d90 tx=0x7ffa4801c3a0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.945+0000 7ffa59b72640 1 -- 172.21.15.88:0/15651236 shutdown_connections 2023-12-08T08:20:31.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.945+0000 7ffa59b72640 1 --2- 172.21.15.88:0/15651236 >> v2:172.21.15.148:3300/0 conn(0x7ffa5406bf30 0x7ffa5415ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.945+0000 7ffa59b72640 1 --2- 172.21.15.88:0/15651236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa54154f20 0x7ffa5406b9f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.945+0000 7ffa59b72640 1 -- 172.21.15.88:0/15651236 >> 172.21.15.88:0/15651236 conn(0x7ffa540ab9d0 msgr2=0x7ffa540abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:31.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.945+0000 7ffa59b72640 1 -- 172.21.15.88:0/15651236 shutdown_connections 2023-12-08T08:20:31.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.945+0000 7ffa59b72640 1 -- 172.21.15.88:0/15651236 wait complete. 2023-12-08T08:20:31.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.945+0000 7ffa59b72640 1 Processor -- start 2023-12-08T08:20:31.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.949+0000 7ffa59b72640 1 -- start start 2023-12-08T08:20:31.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.949+0000 7ffa59b72640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa5406bf30 0x7ffa541ed750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.949+0000 7ffa59b72640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa540af4c0 0x7ffa541f0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.949+0000 7ffa59b72640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffa54154f20 0x7ffa54155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.949+0000 7ffa59b72640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5414be20 con 0x7ffa540af4c0 2023-12-08T08:20:31.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.949+0000 7ffa59b72640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa541f1070 con 0x7ffa5406bf30 2023-12-08T08:20:31.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.949+0000 7ffa59b72640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5414b280 con 0x7ffa54154f20 2023-12-08T08:20:31.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.949+0000 7ffa52ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa540af4c0 0x7ffa541f0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.949+0000 7ffa52ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa540af4c0 0x7ffa541f0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41274/0 (socket says 172.21.15.88:41274) 2023-12-08T08:20:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.949+0000 7ffa52ffd640 1 -- 172.21.15.88:0/1475103461 learned_addr learned my addr 172.21.15.88:0/1475103461 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.949+0000 7ffa537fe640 1 --2- 172.21.15.88:0/1475103461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa5406bf30 0x7ffa541ed750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.949+0000 7ffa53fff640 1 --2- 172.21.15.88:0/1475103461 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffa54154f20 0x7ffa54155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.949+0000 7ffa52ffd640 1 -- 172.21.15.88:0/1475103461 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffa54154f20 msgr2=0x7ffa54155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.949+0000 7ffa52ffd640 1 --2- 172.21.15.88:0/1475103461 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffa54154f20 0x7ffa54155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.949+0000 7ffa52ffd640 1 -- 172.21.15.88:0/1475103461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa5406bf30 msgr2=0x7ffa541ed750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.949+0000 7ffa52ffd640 1 --2- 172.21.15.88:0/1475103461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa5406bf30 0x7ffa541ed750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.949+0000 7ffa52ffd640 1 -- 172.21.15.88:0/1475103461 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa48009420 con 0x7ffa540af4c0 2023-12-08T08:20:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.949+0000 7ffa537fe640 1 --2- 172.21.15.88:0/1475103461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa5406bf30 0x7ffa541ed750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.949+0000 7ffa53fff640 1 --2- 172.21.15.88:0/1475103461 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffa54154f20 0x7ffa54155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.949+0000 7ffa52ffd640 1 --2- 172.21.15.88:0/1475103461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa540af4c0 0x7ffa541f0b30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffa48018fb0 tx=0x7ffa4801abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.949+0000 7ffa3bfff640 1 -- 172.21.15.88:0/1475103461 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa480b7650 con 0x7ffa540af4c0 2023-12-08T08:20:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.949+0000 7ffa3bfff640 1 -- 172.21.15.88:0/1475103461 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa480b77b0 con 0x7ffa540af4c0 2023-12-08T08:20:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.949+0000 7ffa3bfff640 1 -- 172.21.15.88:0/1475103461 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa480b7b20 con 0x7ffa540af4c0 2023-12-08T08:20:31.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.949+0000 7ffa59b72640 1 -- 172.21.15.88:0/1475103461 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5414b560 con 0x7ffa540af4c0 2023-12-08T08:20:31.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.949+0000 7ffa59b72640 1 -- 172.21.15.88:0/1475103461 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa541ed230 con 0x7ffa540af4c0 2023-12-08T08:20:31.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.949+0000 7ffa59b72640 1 -- 172.21.15.88:0/1475103461 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa54067630 con 0x7ffa540af4c0 2023-12-08T08:20:31.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.953+0000 7ffa3bfff640 1 -- 172.21.15.88:0/1475103461 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffa480b3070 con 0x7ffa540af4c0 2023-12-08T08:20:31.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.953+0000 7ffa3bfff640 1 --2- 172.21.15.88:0/1475103461 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffa40066470 0x7ffa40068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.953+0000 7ffa3bfff640 1 -- 172.21.15.88:0/1475103461 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa4811e2a0 con 0x7ffa540af4c0 2023-12-08T08:20:31.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.953+0000 7ffa537fe640 1 --2- 172.21.15.88:0/1475103461 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffa40066470 0x7ffa40068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.953+0000 7ffa537fe640 1 --2- 172.21.15.88:0/1475103461 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffa40066470 0x7ffa40068930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffa44005890 tx=0x7ffa44009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:31.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:31.957+0000 7ffa3bfff640 1 -- 172.21.15.88:0/1475103461 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffa480eb8d0 con 0x7ffa540af4c0 2023-12-08T08:20:32.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.141+0000 7ffa59b72640 1 -- 172.21.15.88:0/1475103461 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ffa5406c7a0 con 0x7ffa540af4c0 2023-12-08T08:20:32.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.145+0000 7ffa3bfff640 1 -- 172.21.15.88:0/1475103461 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7ffa480eeef0 con 0x7ffa540af4c0 2023-12-08T08:20:32.149 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:32.149 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-08T08:20:32.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.145+0000 7ffa59b72640 1 -- 172.21.15.88:0/1475103461 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffa40066470 msgr2=0x7ffa40068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:32.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.145+0000 7ffa59b72640 1 --2- 172.21.15.88:0/1475103461 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffa40066470 0x7ffa40068930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffa44005890 tx=0x7ffa44009040 comp rx=0 tx=0).stop 2023-12-08T08:20:32.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.145+0000 7ffa59b72640 1 -- 172.21.15.88:0/1475103461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa540af4c0 msgr2=0x7ffa541f0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:32.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.145+0000 7ffa59b72640 1 --2- 172.21.15.88:0/1475103461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa540af4c0 0x7ffa541f0b30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffa48018fb0 tx=0x7ffa4801abe0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.145+0000 7ffa59b72640 1 -- 172.21.15.88:0/1475103461 shutdown_connections 2023-12-08T08:20:32.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.145+0000 7ffa59b72640 1 --2- 172.21.15.88:0/1475103461 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffa40066470 0x7ffa40068930 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.145+0000 7ffa59b72640 1 --2- 172.21.15.88:0/1475103461 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffa54154f20 0x7ffa54155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.145+0000 7ffa59b72640 1 --2- 172.21.15.88:0/1475103461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa540af4c0 0x7ffa541f0b30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.145+0000 7ffa59b72640 1 --2- 172.21.15.88:0/1475103461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa5406bf30 0x7ffa541ed750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.145+0000 7ffa59b72640 1 -- 172.21.15.88:0/1475103461 >> 172.21.15.88:0/1475103461 conn(0x7ffa540ab9d0 msgr2=0x7ffa54153c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:32.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.145+0000 7ffa59b72640 1 -- 172.21.15.88:0/1475103461 shutdown_connections 2023-12-08T08:20:32.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.145+0000 7ffa59b72640 1 -- 172.21.15.88:0/1475103461 wait complete. 2023-12-08T08:20:32.170 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-08T08:20:32.171 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:32.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.301+0000 7f7b79b48640 1 Processor -- start 2023-12-08T08:20:32.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.301+0000 7f7b79b48640 1 -- start start 2023-12-08T08:20:32.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.305+0000 7f7b79b48640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7b74151b40 0x7f7b740c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:32.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.305+0000 7f7b79b48640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7b740c9f80 0x7f7b740ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:32.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.305+0000 7f7b79b48640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b741584b0 con 0x7f7b74157910 2023-12-08T08:20:32.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.305+0000 7f7b79b48640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b74154320 con 0x7f7b740c9f80 2023-12-08T08:20:32.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.305+0000 7f7b79b48640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b741552f0 con 0x7f7b74151b40 2023-12-08T08:20:32.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.305+0000 7f7b73fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7b740c9f80 0x7f7b740ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:32.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.305+0000 7f7b79347640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7b74157910 0x7f7b74157da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34476/0 (socket says 172.21.15.88:34476) 2023-12-08T08:20:32.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.305+0000 7f7b79347640 1 -- 172.21.15.88:0/3365763785 learned_addr learned my addr 172.21.15.88:0/3365763785 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:32.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.305+0000 7f7b78b46640 1 --2- 172.21.15.88:0/3365763785 >> v2:172.21.15.148:3300/0 conn(0x7f7b74151b40 0x7f7b740c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:32.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.305+0000 7f7b73fff640 1 -- 172.21.15.88:0/3365763785 >> v2:172.21.15.148:3300/0 conn(0x7f7b74151b40 msgr2=0x7f7b740c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:32.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.305+0000 7f7b73fff640 1 --2- 172.21.15.88:0/3365763785 >> v2:172.21.15.148:3300/0 conn(0x7f7b74151b40 0x7f7b740c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.305+0000 7f7b73fff640 1 -- 172.21.15.88:0/3365763785 >> v1:172.21.15.88:6789/0 conn(0x7f7b74157910 legacy=0x7f7b74157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:32.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.305+0000 7f7b73fff640 1 -- 172.21.15.88:0/3365763785 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b74154530 con 0x7f7b740c9f80 2023-12-08T08:20:32.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.305+0000 7f7b737fe640 1 -- 172.21.15.88:0/3365763785 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684698443 0 0) 0x7f7b741584b0 con 0x7f7b74157910 2023-12-08T08:20:32.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.309+0000 7f7b73fff640 1 --2- 172.21.15.88:0/3365763785 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b740c9f80 0x7f7b740ca410 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7b74067230 tx=0x7f7b6001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b32bf22b4af49e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:32.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.309+0000 7f7b737fe640 1 -- 172.21.15.88:0/3365763785 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b600ab600 con 0x7f7b740c9f80 2023-12-08T08:20:32.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.309+0000 7f7b737fe640 1 -- 172.21.15.88:0/3365763785 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b600a7050 con 0x7f7b740c9f80 2023-12-08T08:20:32.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.309+0000 7f7b737fe640 1 -- 172.21.15.88:0/3365763785 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b600ab980 con 0x7f7b740c9f80 2023-12-08T08:20:32.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.309+0000 7f7b79b48640 1 -- 172.21.15.88:0/3365763785 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b740c9f80 msgr2=0x7f7b740ca410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:32.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.309+0000 7f7b79b48640 1 --2- 172.21.15.88:0/3365763785 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b740c9f80 0x7f7b740ca410 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7b74067230 tx=0x7f7b6001c3d0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.309+0000 7f7b79b48640 1 -- 172.21.15.88:0/3365763785 shutdown_connections 2023-12-08T08:20:32.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.309+0000 7f7b79b48640 1 --2- 172.21.15.88:0/3365763785 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b740c9f80 0x7f7b740ca410 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.309+0000 7f7b79b48640 1 --2- 172.21.15.88:0/3365763785 >> v2:172.21.15.148:3300/0 conn(0x7f7b74151b40 0x7f7b740c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.309+0000 7f7b79b48640 1 -- 172.21.15.88:0/3365763785 >> 172.21.15.88:0/3365763785 conn(0x7f7b74066470 msgr2=0x7f7b74066880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:32.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.309+0000 7f7b79b48640 1 -- 172.21.15.88:0/3365763785 shutdown_connections 2023-12-08T08:20:32.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.309+0000 7f7b79b48640 1 -- 172.21.15.88:0/3365763785 wait complete. 2023-12-08T08:20:32.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.309+0000 7f7b79b48640 1 Processor -- start 2023-12-08T08:20:32.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.309+0000 7f7b79b48640 1 -- start start 2023-12-08T08:20:32.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.309+0000 7f7b79b48640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b740c9f80 0x7f7b741ed550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:32.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.309+0000 7f7b79b48640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b74151b40 0x7f7b7414f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:32.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.309+0000 7f7b79b48640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b74157910 0x7f7b74153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:32.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.309+0000 7f7b79b48640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b74145070 con 0x7f7b740c9f80 2023-12-08T08:20:32.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.309+0000 7f7b79b48640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b74145470 con 0x7f7b74157910 2023-12-08T08:20:32.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.309+0000 7f7b79b48640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7414f710 con 0x7f7b74151b40 2023-12-08T08:20:32.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.313+0000 7f7b78b46640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b740c9f80 0x7f7b741ed550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:32.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.313+0000 7f7b78b46640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b740c9f80 0x7f7b741ed550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41302/0 (socket says 172.21.15.88:41302) 2023-12-08T08:20:32.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.313+0000 7f7b78b46640 1 -- 172.21.15.88:0/1901899577 learned_addr learned my addr 172.21.15.88:0/1901899577 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:32.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.313+0000 7f7b73fff640 1 --2- 172.21.15.88:0/1901899577 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b74151b40 0x7f7b7414f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:32.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.313+0000 7f7b78b46640 1 -- 172.21.15.88:0/1901899577 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b74151b40 msgr2=0x7f7b7414f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:32.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.313+0000 7f7b78b46640 1 --2- 172.21.15.88:0/1901899577 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b74151b40 0x7f7b7414f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.313+0000 7f7b79347640 1 --2- 172.21.15.88:0/1901899577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b74157910 0x7f7b74153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:32.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.313+0000 7f7b78b46640 1 -- 172.21.15.88:0/1901899577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b74157910 msgr2=0x7f7b74153990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:32.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.313+0000 7f7b78b46640 1 --2- 172.21.15.88:0/1901899577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b74157910 0x7f7b74153990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.313+0000 7f7b78b46640 1 -- 172.21.15.88:0/1901899577 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b60009420 con 0x7f7b740c9f80 2023-12-08T08:20:32.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.313+0000 7f7b73fff640 1 --2- 172.21.15.88:0/1901899577 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b74151b40 0x7f7b7414f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:32.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.313+0000 7f7b79347640 1 --2- 172.21.15.88:0/1901899577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b74157910 0x7f7b74153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:32.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.313+0000 7f7b78b46640 1 --2- 172.21.15.88:0/1901899577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b740c9f80 0x7f7b741ed550 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7b6800e930 tx=0x7f7b6800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:32.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.313+0000 7f7b717fa640 1 -- 172.21.15.88:0/1901899577 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b68009690 con 0x7f7b740c9f80 2023-12-08T08:20:32.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.313+0000 7f7b717fa640 1 -- 172.21.15.88:0/1901899577 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6800ca00 con 0x7f7b740c9f80 2023-12-08T08:20:32.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.313+0000 7f7b79b48640 1 -- 172.21.15.88:0/1901899577 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b74151040 con 0x7f7b740c9f80 2023-12-08T08:20:32.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.313+0000 7f7b717fa640 1 -- 172.21.15.88:0/1901899577 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6800cd70 con 0x7f7b740c9f80 2023-12-08T08:20:32.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.313+0000 7f7b79b48640 1 -- 172.21.15.88:0/1901899577 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b74151320 con 0x7f7b740c9f80 2023-12-08T08:20:32.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.313+0000 7f7b79b48640 1 -- 172.21.15.88:0/1901899577 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b741452e0 con 0x7f7b740c9f80 2023-12-08T08:20:32.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.313+0000 7f7b717fa640 1 -- 172.21.15.88:0/1901899577 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7b68013470 con 0x7f7b740c9f80 2023-12-08T08:20:32.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.317+0000 7f7b717fa640 1 --2- 172.21.15.88:0/1901899577 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7b58066470 0x7f7b58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:32.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.317+0000 7f7b717fa640 1 -- 172.21.15.88:0/1901899577 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b68084040 con 0x7f7b740c9f80 2023-12-08T08:20:32.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.317+0000 7f7b73fff640 1 --2- 172.21.15.88:0/1901899577 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7b58066470 0x7f7b58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:32.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.317+0000 7f7b73fff640 1 --2- 172.21.15.88:0/1901899577 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7b58066470 0x7f7b58068930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7b600ad000 tx=0x7f7b60008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:32.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.321+0000 7f7b717fa640 1 -- 172.21.15.88:0/1901899577 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7b68051610 con 0x7f7b740c9f80 2023-12-08T08:20:32.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.469+0000 7f7b79b48640 1 -- 172.21.15.88:0/1901899577 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b74067bc0 con 0x7f7b740c9f80 2023-12-08T08:20:32.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.473+0000 7f7b717fa640 1 -- 172.21.15.88:0/1901899577 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7f7b68054c30 con 0x7f7b740c9f80 2023-12-08T08:20:32.477 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:32.477 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:20:21.492555+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:18.675917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:19.511013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:32.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.473+0000 7f7b79b48640 1 -- 172.21.15.88:0/1901899577 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7b58066470 msgr2=0x7f7b58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:32.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.473+0000 7f7b79b48640 1 --2- 172.21.15.88:0/1901899577 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7b58066470 0x7f7b58068930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7b600ad000 tx=0x7f7b60008040 comp rx=0 tx=0).stop 2023-12-08T08:20:32.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.473+0000 7f7b79b48640 1 -- 172.21.15.88:0/1901899577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b740c9f80 msgr2=0x7f7b741ed550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:32.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.473+0000 7f7b79b48640 1 --2- 172.21.15.88:0/1901899577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b740c9f80 0x7f7b741ed550 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7b6800e930 tx=0x7f7b6800edf0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.473+0000 7f7b79b48640 1 -- 172.21.15.88:0/1901899577 shutdown_connections 2023-12-08T08:20:32.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.473+0000 7f7b79b48640 1 --2- 172.21.15.88:0/1901899577 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7b58066470 0x7f7b58068930 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.473+0000 7f7b79b48640 1 --2- 172.21.15.88:0/1901899577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b74157910 0x7f7b74153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.473+0000 7f7b79b48640 1 --2- 172.21.15.88:0/1901899577 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b74151b40 0x7f7b7414f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.473+0000 7f7b79b48640 1 --2- 172.21.15.88:0/1901899577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b740c9f80 0x7f7b741ed550 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.473+0000 7f7b79b48640 1 -- 172.21.15.88:0/1901899577 >> 172.21.15.88:0/1901899577 conn(0x7f7b74066470 msgr2=0x7f7b740ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:32.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.473+0000 7f7b79b48640 1 -- 172.21.15.88:0/1901899577 shutdown_connections 2023-12-08T08:20:32.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.473+0000 7f7b79b48640 1 -- 172.21.15.88:0/1901899577 wait complete. 2023-12-08T08:20:32.498 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:20:18.675917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:20:19.511013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:20:32.498 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:20:32.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.633+0000 7f9a9658d640 1 Processor -- start 2023-12-08T08:20:32.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.633+0000 7f9a9658d640 1 -- start start 2023-12-08T08:20:32.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.633+0000 7f9a9658d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9a900bf2d0 0x7f9a90151970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:32.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.633+0000 7f9a9658d640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9a900c6030 0x7f9a90151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:32.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.633+0000 7f9a9658d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a90158780 con 0x7f9a900c98f0 2023-12-08T08:20:32.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.633+0000 7f9a9658d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a900c0300 con 0x7f9a900bf2d0 2023-12-08T08:20:32.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.633+0000 7f9a9658d640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a90157b70 con 0x7f9a900c6030 2023-12-08T08:20:32.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.633+0000 7f9a8ffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9a900bf2d0 0x7f9a90151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:32.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.633+0000 7f9a94b2a640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9a900c98f0 0x7f9a900c7cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34492/0 (socket says 172.21.15.88:34492) 2023-12-08T08:20:32.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.633+0000 7f9a94b2a640 1 -- 172.21.15.88:0/1347397861 learned_addr learned my addr 172.21.15.88:0/1347397861 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:32.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.637+0000 7f9a8f7fe640 1 --2- 172.21.15.88:0/1347397861 >> v2:172.21.15.148:3300/0 conn(0x7f9a900c6030 0x7f9a90151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:32.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.637+0000 7f9a8ffff640 1 -- 172.21.15.88:0/1347397861 >> v2:172.21.15.148:3300/0 conn(0x7f9a900c6030 msgr2=0x7f9a90151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:32.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.637+0000 7f9a8ffff640 1 --2- 172.21.15.88:0/1347397861 >> v2:172.21.15.148:3300/0 conn(0x7f9a900c6030 0x7f9a90151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.637+0000 7f9a8ffff640 1 -- 172.21.15.88:0/1347397861 >> v1:172.21.15.88:6789/0 conn(0x7f9a900c98f0 legacy=0x7f9a900c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:32.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.637+0000 7f9a8ffff640 1 -- 172.21.15.88:0/1347397861 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a90157e50 con 0x7f9a900bf2d0 2023-12-08T08:20:32.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.637+0000 7f9a8effd640 1 -- 172.21.15.88:0/1347397861 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 253985807 0 0) 0x7f9a90158780 con 0x7f9a900c98f0 2023-12-08T08:20:32.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.637+0000 7f9a8f7fe640 1 --2- 172.21.15.88:0/1347397861 >> v2:172.21.15.148:3300/0 conn(0x7f9a900c6030 0x7f9a90151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:32.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.637+0000 7f9a8ffff640 1 --2- 172.21.15.88:0/1347397861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a900bf2d0 0x7f9a90151970 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9a9006cea0 tx=0x7f9a8001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6632cd1f89e3992 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:32.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.637+0000 7f9a8effd640 1 -- 172.21.15.88:0/1347397861 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a800a7070 con 0x7f9a900bf2d0 2023-12-08T08:20:32.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.637+0000 7f9a8effd640 1 -- 172.21.15.88:0/1347397861 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a800ab430 con 0x7f9a900bf2d0 2023-12-08T08:20:32.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.637+0000 7f9a8effd640 1 -- 172.21.15.88:0/1347397861 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a800ab7c0 con 0x7f9a900bf2d0 2023-12-08T08:20:32.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.637+0000 7f9a9658d640 1 -- 172.21.15.88:0/1347397861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a900bf2d0 msgr2=0x7f9a90151970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:32.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.637+0000 7f9a9658d640 1 --2- 172.21.15.88:0/1347397861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a900bf2d0 0x7f9a90151970 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9a9006cea0 tx=0x7f9a8001c430 comp rx=0 tx=0).stop 2023-12-08T08:20:32.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.637+0000 7f9a9658d640 1 -- 172.21.15.88:0/1347397861 shutdown_connections 2023-12-08T08:20:32.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.637+0000 7f9a9658d640 1 --2- 172.21.15.88:0/1347397861 >> v2:172.21.15.148:3300/0 conn(0x7f9a900c6030 0x7f9a90151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.637+0000 7f9a9658d640 1 --2- 172.21.15.88:0/1347397861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a900bf2d0 0x7f9a90151970 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.637+0000 7f9a9658d640 1 -- 172.21.15.88:0/1347397861 >> 172.21.15.88:0/1347397861 conn(0x7f9a900c9dc0 msgr2=0x7f9a900ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:32.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.641+0000 7f9a9658d640 1 -- 172.21.15.88:0/1347397861 shutdown_connections 2023-12-08T08:20:32.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.641+0000 7f9a9658d640 1 -- 172.21.15.88:0/1347397861 wait complete. 2023-12-08T08:20:32.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.641+0000 7f9a9658d640 1 Processor -- start 2023-12-08T08:20:32.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.641+0000 7f9a9658d640 1 -- start start 2023-12-08T08:20:32.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.641+0000 7f9a9658d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a900bf2d0 0x7f9a900aa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:32.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.641+0000 7f9a9658d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a900c6030 0x7f9a9006b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:32.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.641+0000 7f9a9658d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a900c98f0 0x7f9a9006bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:32.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.641+0000 7f9a9658d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a901f0af0 con 0x7f9a900c98f0 2023-12-08T08:20:32.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.641+0000 7f9a9658d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9006c580 con 0x7f9a900c6030 2023-12-08T08:20:32.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.641+0000 7f9a9658d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9006c860 con 0x7f9a900bf2d0 2023-12-08T08:20:32.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.641+0000 7f9a94b2a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a900c98f0 0x7f9a9006bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:32.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.641+0000 7f9a94b2a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a900c98f0 0x7f9a9006bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41318/0 (socket says 172.21.15.88:41318) 2023-12-08T08:20:32.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.641+0000 7f9a94b2a640 1 -- 172.21.15.88:0/183299974 learned_addr learned my addr 172.21.15.88:0/183299974 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:32.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.641+0000 7f9a8ffff640 1 --2- 172.21.15.88:0/183299974 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a900bf2d0 0x7f9a900aa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:32.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.641+0000 7f9a8f7fe640 1 --2- 172.21.15.88:0/183299974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a900c6030 0x7f9a9006b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:32.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.641+0000 7f9a94b2a640 1 -- 172.21.15.88:0/183299974 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a900bf2d0 msgr2=0x7f9a900aa2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:32.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.641+0000 7f9a94b2a640 1 --2- 172.21.15.88:0/183299974 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a900bf2d0 0x7f9a900aa2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.641+0000 7f9a94b2a640 1 -- 172.21.15.88:0/183299974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a900c6030 msgr2=0x7f9a9006b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:32.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.641+0000 7f9a94b2a640 1 --2- 172.21.15.88:0/183299974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a900c6030 0x7f9a9006b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.641+0000 7f9a94b2a640 1 -- 172.21.15.88:0/183299974 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a80009420 con 0x7f9a900c98f0 2023-12-08T08:20:32.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.641+0000 7f9a94b2a640 1 --2- 172.21.15.88:0/183299974 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a900c98f0 0x7f9a9006bf00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9a88001570 tx=0x7f9a8800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:32.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.641+0000 7f9a8cff9640 1 -- 172.21.15.88:0/183299974 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8800a640 con 0x7f9a900c98f0 2023-12-08T08:20:32.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.641+0000 7f9a8cff9640 1 -- 172.21.15.88:0/183299974 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8800a7c0 con 0x7f9a900c98f0 2023-12-08T08:20:32.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.641+0000 7f9a8cff9640 1 -- 172.21.15.88:0/183299974 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8800ab70 con 0x7f9a900c98f0 2023-12-08T08:20:32.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.641+0000 7f9a9658d640 1 -- 172.21.15.88:0/183299974 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a900aa830 con 0x7f9a900c98f0 2023-12-08T08:20:32.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.645+0000 7f9a9658d640 1 -- 172.21.15.88:0/183299974 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a900aafd0 con 0x7f9a900c98f0 2023-12-08T08:20:32.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.645+0000 7f9a9658d640 1 -- 172.21.15.88:0/183299974 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a9006cd80 con 0x7f9a900c98f0 2023-12-08T08:20:32.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.645+0000 7f9a8cff9640 1 -- 172.21.15.88:0/183299974 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9a8800acd0 con 0x7f9a900c98f0 2023-12-08T08:20:32.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.645+0000 7f9a8cff9640 1 --2- 172.21.15.88:0/183299974 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9a7c066470 0x7f9a7c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:32.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.645+0000 7f9a8cff9640 1 -- 172.21.15.88:0/183299974 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a88083460 con 0x7f9a900c98f0 2023-12-08T08:20:32.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.645+0000 7f9a8ffff640 1 --2- 172.21.15.88:0/183299974 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9a7c066470 0x7f9a7c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:32.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.645+0000 7f9a8ffff640 1 --2- 172.21.15.88:0/183299974 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9a7c066470 0x7f9a7c068930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9a800af000 tx=0x7f9a800a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:32.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.649+0000 7f9a8cff9640 1 -- 172.21.15.88:0/183299974 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9a880508d0 con 0x7f9a900c98f0 2023-12-08T08:20:32.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.805+0000 7f9a9658d640 1 -- 172.21.15.88:0/183299974 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a90067630 con 0x7f9a900c98f0 2023-12-08T08:20:32.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.805+0000 7f9a8cff9640 1 -- 172.21.15.88:0/183299974 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9a880180a0 con 0x7f9a900c98f0 2023-12-08T08:20:32.810 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:20:32.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.805+0000 7f9a9658d640 1 -- 172.21.15.88:0/183299974 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9a7c066470 msgr2=0x7f9a7c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:32.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.805+0000 7f9a9658d640 1 --2- 172.21.15.88:0/183299974 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9a7c066470 0x7f9a7c068930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9a800af000 tx=0x7f9a800a7000 comp rx=0 tx=0).stop 2023-12-08T08:20:32.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.805+0000 7f9a9658d640 1 -- 172.21.15.88:0/183299974 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a900c98f0 msgr2=0x7f9a9006bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:32.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.805+0000 7f9a9658d640 1 --2- 172.21.15.88:0/183299974 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a900c98f0 0x7f9a9006bf00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9a88001570 tx=0x7f9a8800cca0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.805+0000 7f9a9658d640 1 -- 172.21.15.88:0/183299974 shutdown_connections 2023-12-08T08:20:32.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.805+0000 7f9a9658d640 1 --2- 172.21.15.88:0/183299974 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9a7c066470 0x7f9a7c068930 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.805+0000 7f9a9658d640 1 --2- 172.21.15.88:0/183299974 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a900c98f0 0x7f9a9006bf00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.805+0000 7f9a9658d640 1 --2- 172.21.15.88:0/183299974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a900c6030 0x7f9a9006b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.805+0000 7f9a9658d640 1 --2- 172.21.15.88:0/183299974 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a900bf2d0 0x7f9a900aa2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.805+0000 7f9a9658d640 1 -- 172.21.15.88:0/183299974 >> 172.21.15.88:0/183299974 conn(0x7f9a900c9dc0 msgr2=0x7f9a90157350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:32.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.805+0000 7f9a9658d640 1 -- 172.21.15.88:0/183299974 shutdown_connections 2023-12-08T08:20:32.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.805+0000 7f9a9658d640 1 -- 172.21.15.88:0/183299974 wait complete. 2023-12-08T08:20:32.831 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:20:32.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.965+0000 7f7c4abe7640 1 Processor -- start 2023-12-08T08:20:32.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.965+0000 7f7c4abe7640 1 -- start start 2023-12-08T08:20:32.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.965+0000 7f7c4abe7640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c44157a90 0x7f7c44154c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:32.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.965+0000 7f7c4abe7640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7c441551c0 0x7f7c4406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:32.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.965+0000 7f7c4abe7640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c441547f0 con 0x7f7c44151a20 2023-12-08T08:20:32.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.965+0000 7f7c4abe7640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c440c2720 con 0x7f7c441551c0 2023-12-08T08:20:32.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.965+0000 7f7c4abe7640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c441544a0 con 0x7f7c44157a90 2023-12-08T08:20:32.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.969+0000 7f7c49184640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7c441551c0 0x7f7c4406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:32.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.969+0000 7f7c49184640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7c441551c0 0x7f7c4406b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41324/0 (socket says 172.21.15.88:41324) 2023-12-08T08:20:32.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.969+0000 7f7c49184640 1 -- 172.21.15.88:0/3243331503 learned_addr learned my addr 172.21.15.88:0/3243331503 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:32.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.969+0000 7f7c48983640 1 --1- 172.21.15.88:0/3243331503 >> v1:172.21.15.88:6789/0 conn(0x7f7c44151a20 0x7f7c4406e890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34500/0 (socket says 172.21.15.88:34500) 2023-12-08T08:20:32.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.969+0000 7f7c43fff640 1 --2- 172.21.15.88:0/3243331503 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c44157a90 0x7f7c44154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:32.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.969+0000 7f7c49184640 1 -- 172.21.15.88:0/3243331503 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c44157a90 msgr2=0x7f7c44154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:32.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.969+0000 7f7c49184640 1 --2- 172.21.15.88:0/3243331503 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c44157a90 0x7f7c44154c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.969+0000 7f7c49184640 1 -- 172.21.15.88:0/3243331503 >> v1:172.21.15.88:6789/0 conn(0x7f7c44151a20 legacy=0x7f7c4406e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:32.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.969+0000 7f7c49184640 1 -- 172.21.15.88:0/3243331503 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c440c1810 con 0x7f7c441551c0 2023-12-08T08:20:32.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.969+0000 7f7c437fe640 1 -- 172.21.15.88:0/3243331503 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 540781137 0 0) 0x7f7c441547f0 con 0x7f7c44151a20 2023-12-08T08:20:32.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.969+0000 7f7c43fff640 1 --2- 172.21.15.88:0/3243331503 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c44157a90 0x7f7c44154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:32.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.969+0000 7f7c49184640 1 --2- 172.21.15.88:0/3243331503 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c441551c0 0x7f7c4406b5c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009e80 tx=0x7f7c3c01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d7fbcbee483b2b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:32.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.969+0000 7f7c437fe640 1 -- 172.21.15.88:0/3243331503 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0a5790 con 0x7f7c441551c0 2023-12-08T08:20:32.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.969+0000 7f7c437fe640 1 -- 172.21.15.88:0/3243331503 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3c0a58f0 con 0x7f7c441551c0 2023-12-08T08:20:32.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.969+0000 7f7c437fe640 1 -- 172.21.15.88:0/3243331503 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0a5c80 con 0x7f7c441551c0 2023-12-08T08:20:32.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.973+0000 7f7c4abe7640 1 -- 172.21.15.88:0/3243331503 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c441551c0 msgr2=0x7f7c4406b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:32.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.973+0000 7f7c4abe7640 1 --2- 172.21.15.88:0/3243331503 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c441551c0 0x7f7c4406b5c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009e80 tx=0x7f7c3c01c8d0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.973+0000 7f7c4abe7640 1 -- 172.21.15.88:0/3243331503 shutdown_connections 2023-12-08T08:20:32.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.973+0000 7f7c4abe7640 1 --2- 172.21.15.88:0/3243331503 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c441551c0 0x7f7c4406b5c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.973+0000 7f7c4abe7640 1 --2- 172.21.15.88:0/3243331503 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c44157a90 0x7f7c44154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.973+0000 7f7c4abe7640 1 -- 172.21.15.88:0/3243331503 >> 172.21.15.88:0/3243331503 conn(0x7f7c440c2e20 msgr2=0x7f7c440c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:32.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.973+0000 7f7c4abe7640 1 -- 172.21.15.88:0/3243331503 shutdown_connections 2023-12-08T08:20:32.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.973+0000 7f7c4abe7640 1 -- 172.21.15.88:0/3243331503 wait complete. 2023-12-08T08:20:32.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.973+0000 7f7c4abe7640 1 Processor -- start 2023-12-08T08:20:32.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.973+0000 7f7c4abe7640 1 -- start start 2023-12-08T08:20:32.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.973+0000 7f7c4abe7640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c44151a20 0x7f7c44142a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:32.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.973+0000 7f7c4abe7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c44157a90 0x7f7c44157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:32.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.973+0000 7f7c4abe7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c44155e10 0x7f7c441562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:32.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.973+0000 7f7c4abe7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4414fae0 con 0x7f7c44155e10 2023-12-08T08:20:32.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.973+0000 7f7c4abe7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c44150df0 con 0x7f7c44157a90 2023-12-08T08:20:32.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.973+0000 7f7c4abe7640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c44150270 con 0x7f7c44151a20 2023-12-08T08:20:32.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.973+0000 7f7c49184640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c44155e10 0x7f7c441562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:32.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.973+0000 7f7c49184640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c44155e10 0x7f7c441562a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41326/0 (socket says 172.21.15.88:41326) 2023-12-08T08:20:32.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.973+0000 7f7c49184640 1 -- 172.21.15.88:0/2716081051 learned_addr learned my addr 172.21.15.88:0/2716081051 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:32.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.973+0000 7f7c48983640 1 --2- 172.21.15.88:0/2716081051 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c44151a20 0x7f7c44142a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:32.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.973+0000 7f7c43fff640 1 --2- 172.21.15.88:0/2716081051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c44157a90 0x7f7c44157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:32.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.977+0000 7f7c49184640 1 -- 172.21.15.88:0/2716081051 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c44151a20 msgr2=0x7f7c44142a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:32.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.977+0000 7f7c49184640 1 --2- 172.21.15.88:0/2716081051 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c44151a20 0x7f7c44142a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.977+0000 7f7c49184640 1 -- 172.21.15.88:0/2716081051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c44157a90 msgr2=0x7f7c44157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:32.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.977+0000 7f7c49184640 1 --2- 172.21.15.88:0/2716081051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c44157a90 0x7f7c44157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.977+0000 7f7c49184640 1 -- 172.21.15.88:0/2716081051 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c009b30 con 0x7f7c44155e10 2023-12-08T08:20:32.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.977+0000 7f7c48983640 1 --2- 172.21.15.88:0/2716081051 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c44151a20 0x7f7c44142a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:32.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.977+0000 7f7c49184640 1 --2- 172.21.15.88:0/2716081051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c44155e10 0x7f7c441562a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c01a500 tx=0x7f7c3c019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:32.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.977+0000 7f7c417fa640 1 -- 172.21.15.88:0/2716081051 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0b8670 con 0x7f7c44155e10 2023-12-08T08:20:32.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.977+0000 7f7c417fa640 1 -- 172.21.15.88:0/2716081051 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3c0b87f0 con 0x7f7c44155e10 2023-12-08T08:20:32.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.977+0000 7f7c4abe7640 1 -- 172.21.15.88:0/2716081051 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c44150550 con 0x7f7c44155e10 2023-12-08T08:20:32.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.977+0000 7f7c417fa640 1 -- 172.21.15.88:0/2716081051 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0b8ba0 con 0x7f7c44155e10 2023-12-08T08:20:32.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.977+0000 7f7c4abe7640 1 -- 172.21.15.88:0/2716081051 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c44150b10 con 0x7f7c44155e10 2023-12-08T08:20:32.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.977+0000 7f7c4abe7640 1 -- 172.21.15.88:0/2716081051 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c44066660 con 0x7f7c44155e10 2023-12-08T08:20:32.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.977+0000 7f7c417fa640 1 -- 172.21.15.88:0/2716081051 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7c3c0b8d00 con 0x7f7c44155e10 2023-12-08T08:20:32.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.977+0000 7f7c417fa640 1 --2- 172.21.15.88:0/2716081051 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7c28066470 0x7f7c28068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:32.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.981+0000 7f7c417fa640 1 -- 172.21.15.88:0/2716081051 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c3c11f400 con 0x7f7c44155e10 2023-12-08T08:20:32.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.981+0000 7f7c48983640 1 --2- 172.21.15.88:0/2716081051 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7c28066470 0x7f7c28068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:32.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.981+0000 7f7c48983640 1 --2- 172.21.15.88:0/2716081051 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7c28066470 0x7f7c28068930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7c38000f70 tx=0x7f7c38007cb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:32.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:32.981+0000 7f7c417fa640 1 -- 172.21.15.88:0/2716081051 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7c3c0ec7f0 con 0x7f7c44155e10 2023-12-08T08:20:33.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.133+0000 7f7c4abe7640 1 -- 172.21.15.88:0/2716081051 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c44155b30 con 0x7f7c44155e10 2023-12-08T08:20:33.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.133+0000 7f7c417fa640 1 -- 172.21.15.88:0/2716081051 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7c44155b30 con 0x7f7c44155e10 2023-12-08T08:20:33.140 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:20:33.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.137+0000 7f7c4abe7640 1 -- 172.21.15.88:0/2716081051 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7c28066470 msgr2=0x7f7c28068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:33.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.137+0000 7f7c4abe7640 1 --2- 172.21.15.88:0/2716081051 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7c28066470 0x7f7c28068930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7c38000f70 tx=0x7f7c38007cb0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.137+0000 7f7c4abe7640 1 -- 172.21.15.88:0/2716081051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c44155e10 msgr2=0x7f7c441562a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:33.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.137+0000 7f7c4abe7640 1 --2- 172.21.15.88:0/2716081051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c44155e10 0x7f7c441562a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c01a500 tx=0x7f7c3c019670 comp rx=0 tx=0).stop 2023-12-08T08:20:33.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.137+0000 7f7c4abe7640 1 -- 172.21.15.88:0/2716081051 shutdown_connections 2023-12-08T08:20:33.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.137+0000 7f7c4abe7640 1 --2- 172.21.15.88:0/2716081051 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7c28066470 0x7f7c28068930 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.137+0000 7f7c4abe7640 1 --2- 172.21.15.88:0/2716081051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c44155e10 0x7f7c441562a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.137+0000 7f7c4abe7640 1 --2- 172.21.15.88:0/2716081051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c44157a90 0x7f7c44157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.137+0000 7f7c4abe7640 1 --2- 172.21.15.88:0/2716081051 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7c44151a20 0x7f7c44142a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.137+0000 7f7c4abe7640 1 -- 172.21.15.88:0/2716081051 >> 172.21.15.88:0/2716081051 conn(0x7f7c440c2e20 msgr2=0x7f7c4406d830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:33.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.137+0000 7f7c4abe7640 1 -- 172.21.15.88:0/2716081051 shutdown_connections 2023-12-08T08:20:33.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.137+0000 7f7c4abe7640 1 -- 172.21.15.88:0/2716081051 wait complete. 2023-12-08T08:20:33.161 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:20:33.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.297+0000 7f7dcad8d640 1 Processor -- start 2023-12-08T08:20:33.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.297+0000 7f7dcad8d640 1 -- start start 2023-12-08T08:20:33.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.297+0000 7f7dcad8d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7dc40c5f60 0x7f7dc40c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.297+0000 7f7dcad8d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7dc40c4870 0x7f7dc40c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.297+0000 7f7dcad8d640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc40c6a10 con 0x7f7dc4155310 2023-12-08T08:20:33.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.297+0000 7f7dcad8d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc40c2740 con 0x7f7dc40c5f60 2023-12-08T08:20:33.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.297+0000 7f7dcad8d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc406bc80 con 0x7f7dc40c4870 2023-12-08T08:20:33.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.297+0000 7f7dbbfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7dc40c5f60 0x7f7dc40c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.297+0000 7f7dbbfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7dc40c5f60 0x7f7dc40c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41328/0 (socket says 172.21.15.88:41328) 2023-12-08T08:20:33.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.297+0000 7f7dbbfff640 1 -- 172.21.15.88:0/2482365644 learned_addr learned my addr 172.21.15.88:0/2482365644 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:33.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.301+0000 7f7dc932a640 1 --2- 172.21.15.88:0/2482365644 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7dc40c4870 0x7f7dc40c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.301+0000 7f7dbbfff640 1 -- 172.21.15.88:0/2482365644 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7dc40c4870 msgr2=0x7f7dc40c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:33.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.301+0000 7f7dbbfff640 1 --2- 172.21.15.88:0/2482365644 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7dc40c4870 0x7f7dc40c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.301+0000 7f7dbbfff640 1 -- 172.21.15.88:0/2482365644 >> v1:172.21.15.148:6789/0 conn(0x7f7dc4155310 legacy=0x7f7dc4158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:33.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.301+0000 7f7dbbfff640 1 -- 172.21.15.88:0/2482365644 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc40c2f80 con 0x7f7dc40c5f60 2023-12-08T08:20:33.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.301+0000 7f7dbbfff640 1 --2- 172.21.15.88:0/2482365644 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7dc40c5f60 0x7f7dc40c4330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7db4009870 tx=0x7f7db401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d597c0c365852e98 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:33.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.301+0000 7f7dbb7fe640 1 -- 172.21.15.88:0/2482365644 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db40ab620 con 0x7f7dc40c5f60 2023-12-08T08:20:33.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.301+0000 7f7dbb7fe640 1 -- 172.21.15.88:0/2482365644 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db40ab780 con 0x7f7dc40c5f60 2023-12-08T08:20:33.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.301+0000 7f7dbb7fe640 1 -- 172.21.15.88:0/2482365644 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db40abb10 con 0x7f7dc40c5f60 2023-12-08T08:20:33.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.305+0000 7f7dcad8d640 1 -- 172.21.15.88:0/2482365644 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7dc40c5f60 msgr2=0x7f7dc40c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:33.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.305+0000 7f7dcad8d640 1 --2- 172.21.15.88:0/2482365644 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7dc40c5f60 0x7f7dc40c4330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7db4009870 tx=0x7f7db401c510 comp rx=0 tx=0).stop 2023-12-08T08:20:33.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.305+0000 7f7dcad8d640 1 -- 172.21.15.88:0/2482365644 shutdown_connections 2023-12-08T08:20:33.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.305+0000 7f7dcad8d640 1 --2- 172.21.15.88:0/2482365644 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7dc40c4870 0x7f7dc40c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.305+0000 7f7dcad8d640 1 --2- 172.21.15.88:0/2482365644 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7dc40c5f60 0x7f7dc40c4330 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.305+0000 7f7dcad8d640 1 -- 172.21.15.88:0/2482365644 >> 172.21.15.88:0/2482365644 conn(0x7f7dc40a9830 msgr2=0x7f7dc40a9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:33.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.305+0000 7f7dcad8d640 1 -- 172.21.15.88:0/2482365644 shutdown_connections 2023-12-08T08:20:33.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.305+0000 7f7dcad8d640 1 -- 172.21.15.88:0/2482365644 wait complete. 2023-12-08T08:20:33.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.305+0000 7f7dcad8d640 1 Processor -- start 2023-12-08T08:20:33.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.305+0000 7f7dcad8d640 1 -- start start 2023-12-08T08:20:33.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.305+0000 7f7dcad8d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7dc40c4870 0x7f7dc41f0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.305+0000 7f7dcad8d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7dc40c5f60 0x7f7dc406f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.305+0000 7f7dcad8d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7dc4155310 0x7f7dc4149c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.305+0000 7f7dcad8d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc414f0a0 con 0x7f7dc4155310 2023-12-08T08:20:33.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.305+0000 7f7dcad8d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc4158a80 con 0x7f7dc40c5f60 2023-12-08T08:20:33.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.305+0000 7f7dcad8d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc4157f60 con 0x7f7dc40c4870 2023-12-08T08:20:33.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.305+0000 7f7dc932a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7dc4155310 0x7f7dc4149c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.305+0000 7f7dc932a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7dc4155310 0x7f7dc4149c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41332/0 (socket says 172.21.15.88:41332) 2023-12-08T08:20:33.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.305+0000 7f7dc932a640 1 -- 172.21.15.88:0/1946524964 learned_addr learned my addr 172.21.15.88:0/1946524964 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:33.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.305+0000 7f7dbbfff640 1 --2- 172.21.15.88:0/1946524964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7dc40c5f60 0x7f7dc406f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.305+0000 7f7dc8b29640 1 --2- 172.21.15.88:0/1946524964 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7dc40c4870 0x7f7dc41f0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.305+0000 7f7dc932a640 1 -- 172.21.15.88:0/1946524964 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7dc40c4870 msgr2=0x7f7dc41f0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:33.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.305+0000 7f7dc932a640 1 --2- 172.21.15.88:0/1946524964 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7dc40c4870 0x7f7dc41f0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.305+0000 7f7dc932a640 1 -- 172.21.15.88:0/1946524964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7dc40c5f60 msgr2=0x7f7dc406f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:33.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.305+0000 7f7dc932a640 1 --2- 172.21.15.88:0/1946524964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7dc40c5f60 0x7f7dc406f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.305+0000 7f7dc932a640 1 -- 172.21.15.88:0/1946524964 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db40094d0 con 0x7f7dc4155310 2023-12-08T08:20:33.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.305+0000 7f7dc932a640 1 --2- 172.21.15.88:0/1946524964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7dc4155310 0x7f7dc4149c40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc009d30 tx=0x7f7dbc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:33.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.309+0000 7f7db97fa640 1 -- 172.21.15.88:0/1946524964 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc009ba0 con 0x7f7dc4155310 2023-12-08T08:20:33.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.309+0000 7f7db97fa640 1 -- 172.21.15.88:0/1946524964 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dbc00f040 con 0x7f7dc4155310 2023-12-08T08:20:33.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.309+0000 7f7db97fa640 1 -- 172.21.15.88:0/1946524964 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc0146c0 con 0x7f7dc4155310 2023-12-08T08:20:33.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.309+0000 7f7dcad8d640 1 -- 172.21.15.88:0/1946524964 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc41587a0 con 0x7f7dc4155310 2023-12-08T08:20:33.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.309+0000 7f7dcad8d640 1 -- 172.21.15.88:0/1946524964 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc4157bf0 con 0x7f7dc4155310 2023-12-08T08:20:33.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.309+0000 7f7dcad8d640 1 -- 172.21.15.88:0/1946524964 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc4157770 con 0x7f7dc4155310 2023-12-08T08:20:33.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.309+0000 7f7db97fa640 1 -- 172.21.15.88:0/1946524964 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7dbc014820 con 0x7f7dc4155310 2023-12-08T08:20:33.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.309+0000 7f7db97fa640 1 --2- 172.21.15.88:0/1946524964 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7db0066470 0x7f7db0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.309+0000 7f7db97fa640 1 -- 172.21.15.88:0/1946524964 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7dbc084bd0 con 0x7f7dc4155310 2023-12-08T08:20:33.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.309+0000 7f7dc8b29640 1 --2- 172.21.15.88:0/1946524964 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7db0066470 0x7f7db0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.309+0000 7f7dc8b29640 1 --2- 172.21.15.88:0/1946524964 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7db0066470 0x7f7db0068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0007fd0 tx=0x7f7dc0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:33.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.313+0000 7f7db97fa640 1 -- 172.21.15.88:0/1946524964 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7dc4157770 con 0x7f7dc4155310 2023-12-08T08:20:33.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.461+0000 7f7dcad8d640 1 -- 172.21.15.88:0/1946524964 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7dc414ce00 con 0x7f7dc4155310 2023-12-08T08:20:33.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.465+0000 7f7db97fa640 1 -- 172.21.15.88:0/1946524964 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7dbc018020 con 0x7f7dc4155310 2023-12-08T08:20:33.469 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:20:33.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.465+0000 7f7dcad8d640 1 -- 172.21.15.88:0/1946524964 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7db0066470 msgr2=0x7f7db0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:33.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.465+0000 7f7dcad8d640 1 --2- 172.21.15.88:0/1946524964 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7db0066470 0x7f7db0068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0007fd0 tx=0x7f7dc0009040 comp rx=0 tx=0).stop 2023-12-08T08:20:33.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.465+0000 7f7dcad8d640 1 -- 172.21.15.88:0/1946524964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7dc4155310 msgr2=0x7f7dc4149c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:33.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.465+0000 7f7dcad8d640 1 --2- 172.21.15.88:0/1946524964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7dc4155310 0x7f7dc4149c40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc009d30 tx=0x7f7dbc00c490 comp rx=0 tx=0).stop 2023-12-08T08:20:33.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.465+0000 7f7dcad8d640 1 -- 172.21.15.88:0/1946524964 shutdown_connections 2023-12-08T08:20:33.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.465+0000 7f7dcad8d640 1 --2- 172.21.15.88:0/1946524964 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7db0066470 0x7f7db0068930 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.465+0000 7f7dcad8d640 1 --2- 172.21.15.88:0/1946524964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7dc4155310 0x7f7dc4149c40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.465+0000 7f7dcad8d640 1 --2- 172.21.15.88:0/1946524964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7dc40c5f60 0x7f7dc406f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.465+0000 7f7dcad8d640 1 --2- 172.21.15.88:0/1946524964 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7dc40c4870 0x7f7dc41f0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.465+0000 7f7dcad8d640 1 -- 172.21.15.88:0/1946524964 >> 172.21.15.88:0/1946524964 conn(0x7f7dc40a9830 msgr2=0x7f7dc406e290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:33.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.465+0000 7f7dcad8d640 1 -- 172.21.15.88:0/1946524964 shutdown_connections 2023-12-08T08:20:33.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.465+0000 7f7dcad8d640 1 -- 172.21.15.88:0/1946524964 wait complete. 2023-12-08T08:20:33.490 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:20:33.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.621+0000 7f5cb8d80640 1 Processor -- start 2023-12-08T08:20:33.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.621+0000 7f5cb8d80640 1 -- start start 2023-12-08T08:20:33.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cb8d80640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5cb40c0f30 0x7f5cb4072580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cb8d80640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cb40c0460 0x7f5cb4155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cb8d80640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb40c1a50 con 0x7f5cb40c3960 2023-12-08T08:20:33.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cb8d80640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb40c3de0 con 0x7f5cb40c0f30 2023-12-08T08:20:33.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cb8d80640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb4159990 con 0x7f5cb40c0460 2023-12-08T08:20:33.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cabfff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5cb40c3960 0x7f5cb4159280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34514/0 (socket says 172.21.15.88:34514) 2023-12-08T08:20:33.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cabfff640 1 -- 172.21.15.88:0/24111316 learned_addr learned my addr 172.21.15.88:0/24111316 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:33.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cb2d9d640 1 --2- 172.21.15.88:0/24111316 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cb40c0460 0x7f5cb4155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cb259c640 1 --2- 172.21.15.88:0/24111316 >> v2:172.21.15.148:3300/0 conn(0x7f5cb40c0f30 0x7f5cb4072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cb1d9b640 1 -- 172.21.15.88:0/24111316 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797670531 0 0) 0x7f5cb40c1a50 con 0x7f5cb40c3960 2023-12-08T08:20:33.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cb1d9b640 1 -- 172.21.15.88:0/24111316 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ca0003530 con 0x7f5cb40c3960 2023-12-08T08:20:33.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cb1d9b640 1 -- 172.21.15.88:0/24111316 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3592518151 0 0) 0x7f5ca0003530 con 0x7f5cb40c3960 2023-12-08T08:20:33.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cb1d9b640 1 -- 172.21.15.88:0/24111316 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cb40c0460 msgr2=0x7f5cb4155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cb1d9b640 1 --2- 172.21.15.88:0/24111316 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cb40c0460 0x7f5cb4155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cb1d9b640 1 -- 172.21.15.88:0/24111316 >> v2:172.21.15.148:3300/0 conn(0x7f5cb40c0f30 msgr2=0x7f5cb4072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cb1d9b640 1 --2- 172.21.15.88:0/24111316 >> v2:172.21.15.148:3300/0 conn(0x7f5cb40c0f30 0x7f5cb4072580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cb1d9b640 1 -- 172.21.15.88:0/24111316 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb40c08d0 con 0x7f5cb40c3960 2023-12-08T08:20:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cb1d9b640 1 -- 172.21.15.88:0/24111316 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f5c9c001680 con 0x7f5cb40c3960 2023-12-08T08:20:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cb1d9b640 1 -- 172.21.15.88:0/24111316 >> v1:172.21.15.88:6789/0 conn(0x7f5cb40c3960 legacy=0x7f5cb4159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cb1d9b640 1 --2- 172.21.15.88:0/24111316 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ca0003980 0x7f5ca0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cb1d9b640 1 --2- 172.21.15.88:0/24111316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ca00047d0 0x7f5ca0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cb1d9b640 1 --2- 172.21.15.88:0/24111316 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ca0005190 0x7f5ca000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cb1d9b640 1 -- 172.21.15.88:0/24111316 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb40c3de0 con 0x7f5ca00047d0 2023-12-08T08:20:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cb1d9b640 1 -- 172.21.15.88:0/24111316 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb4159990 con 0x7f5ca0003980 2023-12-08T08:20:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cb1d9b640 1 -- 172.21.15.88:0/24111316 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca000bf00 con 0x7f5ca0005190 2023-12-08T08:20:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cb2d9d640 1 --2- 172.21.15.88:0/24111316 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5cb40c0460 0x7f5cb4155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cabfff640 1 --2- 172.21.15.88:0/24111316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ca00047d0 0x7f5ca0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cb259c640 1 --2- 172.21.15.88:0/24111316 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ca0003980 0x7f5ca0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cb2d9d640 1 --2- 172.21.15.88:0/24111316 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ca0005190 0x7f5ca000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cabfff640 1 -- 172.21.15.88:0/24111316 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ca0005190 msgr2=0x7f5ca000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:33.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cabfff640 1 --2- 172.21.15.88:0/24111316 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ca0005190 0x7f5ca000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cabfff640 1 -- 172.21.15.88:0/24111316 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ca0003980 msgr2=0x7f5ca0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:33.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cabfff640 1 --2- 172.21.15.88:0/24111316 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ca0003980 0x7f5ca0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.625+0000 7f5cabfff640 1 -- 172.21.15.88:0/24111316 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca0003530 con 0x7f5ca00047d0 2023-12-08T08:20:33.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.629+0000 7f5cabfff640 1 --2- 172.21.15.88:0/24111316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ca00047d0 0x7f5ca0004c50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c00c240 tx=0x7f5c9c01cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295c6cdf406e432f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:33.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.629+0000 7f5cb1d9b640 1 -- 172.21.15.88:0/24111316 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c0a5940 con 0x7f5ca00047d0 2023-12-08T08:20:33.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.629+0000 7f5cb1d9b640 1 -- 172.21.15.88:0/24111316 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c0a5aa0 con 0x7f5ca00047d0 2023-12-08T08:20:33.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.629+0000 7f5cb1d9b640 1 -- 172.21.15.88:0/24111316 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c0a5e70 con 0x7f5ca00047d0 2023-12-08T08:20:33.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.629+0000 7f5cb8d80640 1 -- 172.21.15.88:0/24111316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ca00047d0 msgr2=0x7f5ca0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:33.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.629+0000 7f5cb8d80640 1 --2- 172.21.15.88:0/24111316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ca00047d0 0x7f5ca0004c50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c00c240 tx=0x7f5c9c01cc00 comp rx=0 tx=0).stop 2023-12-08T08:20:33.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.629+0000 7f5cb2d9d640 1 -- 172.21.15.88:0/24111316 reap_dead start 2023-12-08T08:20:33.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.629+0000 7f5cb8d80640 1 -- 172.21.15.88:0/24111316 shutdown_connections 2023-12-08T08:20:33.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.629+0000 7f5cb8d80640 1 -- 172.21.15.88:0/24111316 >> 172.21.15.88:0/24111316 conn(0x7f5cb40a7810 msgr2=0x7f5cb40a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:33.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.629+0000 7f5cb8d80640 1 -- 172.21.15.88:0/24111316 shutdown_connections 2023-12-08T08:20:33.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.629+0000 7f5cb8d80640 1 -- 172.21.15.88:0/24111316 wait complete. 2023-12-08T08:20:33.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.633+0000 7f5cb8d80640 1 Processor -- start 2023-12-08T08:20:33.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.633+0000 7f5cb8d80640 1 -- start start 2023-12-08T08:20:33.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.633+0000 7f5cb8d80640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ca00047d0 0x7f5cb41530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.633+0000 7f5cb8d80640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5cb40710d0 0x7f5cb414bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.633+0000 7f5cb8d80640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cb4071550 0x7f5cb414c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.633+0000 7f5cb8d80640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb414c780 con 0x7f5cb40710d0 2023-12-08T08:20:33.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.633+0000 7f5cb8d80640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb40709c0 con 0x7f5cb4071550 2023-12-08T08:20:33.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.633+0000 7f5cb8d80640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb4070c40 con 0x7f5ca00047d0 2023-12-08T08:20:33.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.633+0000 7f5cabfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5cb40710d0 0x7f5cb414bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.633+0000 7f5cabfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5cb40710d0 0x7f5cb414bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41342/0 (socket says 172.21.15.88:41342) 2023-12-08T08:20:33.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.633+0000 7f5cabfff640 1 -- 172.21.15.88:0/2445281734 learned_addr learned my addr 172.21.15.88:0/2445281734 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:33.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.633+0000 7f5cb259c640 1 --2- 172.21.15.88:0/2445281734 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ca00047d0 0x7f5cb41530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.633+0000 7f5cb2d9d640 1 --2- 172.21.15.88:0/2445281734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cb4071550 0x7f5cb414c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.633+0000 7f5cabfff640 1 -- 172.21.15.88:0/2445281734 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ca00047d0 msgr2=0x7f5cb41530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:33.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.633+0000 7f5cabfff640 1 --2- 172.21.15.88:0/2445281734 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ca00047d0 0x7f5cb41530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.633+0000 7f5cabfff640 1 -- 172.21.15.88:0/2445281734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cb4071550 msgr2=0x7f5cb414c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:33.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.633+0000 7f5cabfff640 1 --2- 172.21.15.88:0/2445281734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cb4071550 0x7f5cb414c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.633+0000 7f5cabfff640 1 -- 172.21.15.88:0/2445281734 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb40a8b10 con 0x7f5cb40710d0 2023-12-08T08:20:33.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.633+0000 7f5cabfff640 1 --2- 172.21.15.88:0/2445281734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5cb40710d0 0x7f5cb414bd00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c00c240 tx=0x7f5ca0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:33.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.633+0000 7f5caaffd640 1 -- 172.21.15.88:0/2445281734 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c0049f0 con 0x7f5cb40710d0 2023-12-08T08:20:33.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.633+0000 7f5caaffd640 1 -- 172.21.15.88:0/2445281734 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c0b3070 con 0x7f5cb40710d0 2023-12-08T08:20:33.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.633+0000 7f5cb8d80640 1 -- 172.21.15.88:0/2445281734 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb40a8df0 con 0x7f5cb40710d0 2023-12-08T08:20:33.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.633+0000 7f5caaffd640 1 -- 172.21.15.88:0/2445281734 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c004d70 con 0x7f5cb40710d0 2023-12-08T08:20:33.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.633+0000 7f5cb8d80640 1 -- 172.21.15.88:0/2445281734 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb4072820 con 0x7f5cb40710d0 2023-12-08T08:20:33.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.637+0000 7f5cb8d80640 1 -- 172.21.15.88:0/2445281734 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb40a9310 con 0x7f5cb40710d0 2023-12-08T08:20:33.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.637+0000 7f5caaffd640 1 -- 172.21.15.88:0/2445281734 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5c9c0ba480 con 0x7f5cb40710d0 2023-12-08T08:20:33.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.637+0000 7f5caaffd640 1 --2- 172.21.15.88:0/2445281734 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5c940664a0 0x7f5c94068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.637+0000 7f5caaffd640 1 -- 172.21.15.88:0/2445281734 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c9c0b5070 con 0x7f5cb40710d0 2023-12-08T08:20:33.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.637+0000 7f5cb259c640 1 --2- 172.21.15.88:0/2445281734 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5c940664a0 0x7f5c94068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.637+0000 7f5cb259c640 1 --2- 172.21.15.88:0/2445281734 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5c940664a0 0x7f5c94068960 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5ca4009b60 tx=0x7f5ca4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:33.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.641+0000 7f5caaffd640 1 -- 172.21.15.88:0/2445281734 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5cb40a9310 con 0x7f5cb40710d0 2023-12-08T08:20:33.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.821+0000 7f5cb8d80640 1 -- 172.21.15.88:0/2445281734 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5cb40a9310 con 0x7f5cb40710d0 2023-12-08T08:20:33.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.825+0000 7f5caaffd640 1 -- 172.21.15.88:0/2445281734 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4910 (secure 0 0 0) 0x7f5cb40a9310 con 0x7f5cb40710d0 2023-12-08T08:20:33.829 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:33.829 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/1946795737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":1946795737},{"type":"v1","addr":"172.21.15.88:6837","nonce":1946795737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/140150927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":140150927},{"type":"v1","addr":"172.21.15.148:6834","nonce":140150927}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2399327235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2399327235},{"type":"v1","addr":"172.21.15.148:6835","nonce":2399327235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:20:20.479364+0000","modified":"2023-12-08T08:20:23.493737+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/3793971563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":3793971563},{"type":"v1","addr":"172.21.15.88:6835","nonce":3793971563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T08:20:33.829 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 8 2023-12-08T08:20:33.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.825+0000 7f5cb8d80640 1 -- 172.21.15.88:0/2445281734 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5c940664a0 msgr2=0x7f5c94068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:33.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.825+0000 7f5cb8d80640 1 --2- 172.21.15.88:0/2445281734 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5c940664a0 0x7f5c94068960 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5ca4009b60 tx=0x7f5ca4009190 comp rx=0 tx=0).stop 2023-12-08T08:20:33.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.825+0000 7f5cb8d80640 1 -- 172.21.15.88:0/2445281734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5cb40710d0 msgr2=0x7f5cb414bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:33.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.825+0000 7f5cb8d80640 1 --2- 172.21.15.88:0/2445281734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5cb40710d0 0x7f5cb414bd00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c00c240 tx=0x7f5ca0005800 comp rx=0 tx=0).stop 2023-12-08T08:20:33.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.825+0000 7f5cb8d80640 1 -- 172.21.15.88:0/2445281734 shutdown_connections 2023-12-08T08:20:33.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.825+0000 7f5cb8d80640 1 --2- 172.21.15.88:0/2445281734 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5c940664a0 0x7f5c94068960 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.825+0000 7f5cb8d80640 1 --2- 172.21.15.88:0/2445281734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cb4071550 0x7f5cb414c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.825+0000 7f5cb8d80640 1 --2- 172.21.15.88:0/2445281734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5cb40710d0 0x7f5cb414bd00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.825+0000 7f5cb8d80640 1 --2- 172.21.15.88:0/2445281734 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ca00047d0 0x7f5cb41530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.825+0000 7f5cb8d80640 1 -- 172.21.15.88:0/2445281734 >> 172.21.15.88:0/2445281734 conn(0x7f5cb40a7810 msgr2=0x7f5cb4159280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:33.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.825+0000 7f5cb8d80640 1 -- 172.21.15.88:0/2445281734 shutdown_connections 2023-12-08T08:20:33.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.825+0000 7f5cb8d80640 1 -- 172.21.15.88:0/2445281734 wait complete. 2023-12-08T08:20:33.850 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:33.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.981+0000 7f8077bf8640 1 Processor -- start 2023-12-08T08:20:33.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.981+0000 7f8077bf8640 1 -- start start 2023-12-08T08:20:33.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.981+0000 7f8077bf8640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f80700c0f30 0x7f8070072580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.981+0000 7f8077bf8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f80700c0460 0x7f8070155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.981+0000 7f8077bf8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80700c1a50 con 0x7f80700c3960 2023-12-08T08:20:33.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.981+0000 7f8077bf8640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80700c3de0 con 0x7f80700c0460 2023-12-08T08:20:33.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.981+0000 7f8077bf8640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8070159990 con 0x7f80700c0f30 2023-12-08T08:20:33.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.981+0000 7f8076195640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f80700c0460 0x7f8070155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.981+0000 7f8076195640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f80700c0460 0x7f8070155ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41352/0 (socket says 172.21.15.88:41352) 2023-12-08T08:20:33.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.981+0000 7f8075193640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f80700c3960 0x7f8070159280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34518/0 (socket says 172.21.15.88:34518) 2023-12-08T08:20:33.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.981+0000 7f8076195640 1 -- 172.21.15.88:0/1055510605 learned_addr learned my addr 172.21.15.88:0/1055510605 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:33.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.981+0000 7f8075994640 1 --2- 172.21.15.88:0/1055510605 >> v2:172.21.15.148:3300/0 conn(0x7f80700c0f30 0x7f8070072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.985+0000 7f8076195640 1 -- 172.21.15.88:0/1055510605 >> v2:172.21.15.148:3300/0 conn(0x7f80700c0f30 msgr2=0x7f8070072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:33.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.985+0000 7f8076195640 1 --2- 172.21.15.88:0/1055510605 >> v2:172.21.15.148:3300/0 conn(0x7f80700c0f30 0x7f8070072580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.985+0000 7f8076195640 1 -- 172.21.15.88:0/1055510605 >> v1:172.21.15.88:6789/0 conn(0x7f80700c3960 legacy=0x7f8070159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:33.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.985+0000 7f8076195640 1 -- 172.21.15.88:0/1055510605 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80700c0890 con 0x7f80700c0460 2023-12-08T08:20:33.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.985+0000 7f8074992640 1 -- 172.21.15.88:0/1055510605 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408634023 0 0) 0x7f80700c1a50 con 0x7f80700c3960 2023-12-08T08:20:33.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.985+0000 7f8076195640 1 --2- 172.21.15.88:0/1055510605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80700c0460 0x7f8070155ed0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f807006b520 tx=0x7f806801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae01b8422dcbc8c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.985+0000 7f8074992640 1 -- 172.21.15.88:0/1055510605 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80680a5800 con 0x7f80700c0460 2023-12-08T08:20:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.985+0000 7f8074992640 1 -- 172.21.15.88:0/1055510605 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80680a5960 con 0x7f80700c0460 2023-12-08T08:20:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.985+0000 7f8074992640 1 -- 172.21.15.88:0/1055510605 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80680a5cf0 con 0x7f80700c0460 2023-12-08T08:20:33.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.985+0000 7f8077bf8640 1 -- 172.21.15.88:0/1055510605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80700c0460 msgr2=0x7f8070155ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:33.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.985+0000 7f8077bf8640 1 --2- 172.21.15.88:0/1055510605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80700c0460 0x7f8070155ed0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f807006b520 tx=0x7f806801c940 comp rx=0 tx=0).stop 2023-12-08T08:20:33.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.985+0000 7f8077bf8640 1 -- 172.21.15.88:0/1055510605 shutdown_connections 2023-12-08T08:20:33.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.985+0000 7f8077bf8640 1 --2- 172.21.15.88:0/1055510605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80700c0460 0x7f8070155ed0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.985+0000 7f8077bf8640 1 --2- 172.21.15.88:0/1055510605 >> v2:172.21.15.148:3300/0 conn(0x7f80700c0f30 0x7f8070072580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.985+0000 7f8077bf8640 1 -- 172.21.15.88:0/1055510605 >> 172.21.15.88:0/1055510605 conn(0x7f80700a7810 msgr2=0x7f80700a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:33.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.989+0000 7f8077bf8640 1 -- 172.21.15.88:0/1055510605 shutdown_connections 2023-12-08T08:20:33.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.989+0000 7f8077bf8640 1 -- 172.21.15.88:0/1055510605 wait complete. 2023-12-08T08:20:33.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.989+0000 7f8077bf8640 1 Processor -- start 2023-12-08T08:20:33.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.989+0000 7f8077bf8640 1 -- start start 2023-12-08T08:20:33.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.989+0000 7f8077bf8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80700c0460 0x7f8070150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.989+0000 7f8077bf8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80700c0f30 0x7f807014d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.989+0000 7f8077bf8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80700c3960 0x7f80701f4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.989+0000 7f8077bf8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80701f59a0 con 0x7f80700c0460 2023-12-08T08:20:33.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.989+0000 7f8077bf8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80701f56c0 con 0x7f80700c0f30 2023-12-08T08:20:33.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.989+0000 7f8077bf8640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f807014e400 con 0x7f80700c3960 2023-12-08T08:20:33.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.989+0000 7f8075994640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80700c0460 0x7f8070150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.989+0000 7f8075994640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80700c0460 0x7f8070150860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41362/0 (socket says 172.21.15.88:41362) 2023-12-08T08:20:33.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.989+0000 7f8075994640 1 -- 172.21.15.88:0/33702895 learned_addr learned my addr 172.21.15.88:0/33702895 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:33.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.989+0000 7f8075994640 1 -- 172.21.15.88:0/33702895 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80700c3960 msgr2=0x7f80701f4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:33.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.989+0000 7f8075994640 1 --2- 172.21.15.88:0/33702895 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80700c3960 0x7f80701f4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.989+0000 7f8075994640 1 -- 172.21.15.88:0/33702895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80700c0f30 msgr2=0x7f807014d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:33.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.989+0000 7f8075994640 1 --2- 172.21.15.88:0/33702895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80700c0f30 0x7f807014d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.989+0000 7f8075994640 1 -- 172.21.15.88:0/33702895 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8068009b30 con 0x7f80700c0460 2023-12-08T08:20:33.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.989+0000 7f8075994640 1 --2- 172.21.15.88:0/33702895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80700c0460 0x7f8070150860 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f806c00e870 tx=0x7f806c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.989+0000 7f80667fc640 1 -- 172.21.15.88:0/33702895 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c00eec0 con 0x7f80700c0460 2023-12-08T08:20:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.989+0000 7f80667fc640 1 -- 172.21.15.88:0/33702895 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806c00c940 con 0x7f80700c0460 2023-12-08T08:20:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.989+0000 7f80667fc640 1 -- 172.21.15.88:0/33702895 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c00ccb0 con 0x7f80700c0460 2023-12-08T08:20:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.989+0000 7f8077bf8640 1 -- 172.21.15.88:0/33702895 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f807014e6e0 con 0x7f80700c0460 2023-12-08T08:20:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.989+0000 7f8077bf8640 1 -- 172.21.15.88:0/33702895 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f807014dd30 con 0x7f80700c0460 2023-12-08T08:20:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.993+0000 7f8077bf8640 1 -- 172.21.15.88:0/33702895 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8070067630 con 0x7f80700c0460 2023-12-08T08:20:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.993+0000 7f80667fc640 1 -- 172.21.15.88:0/33702895 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f806c013470 con 0x7f80700c0460 2023-12-08T08:20:33.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.993+0000 7f80667fc640 1 --2- 172.21.15.88:0/33702895 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8054066470 0x7f8054068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.993+0000 7f80667fc640 1 -- 172.21.15.88:0/33702895 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f806c084320 con 0x7f80700c0460 2023-12-08T08:20:33.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.993+0000 7f8075193640 1 --2- 172.21.15.88:0/33702895 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8054066470 0x7f8054068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.993+0000 7f8075193640 1 --2- 172.21.15.88:0/33702895 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8054066470 0x7f8054068930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f80600011f0 tx=0x7f8060007930 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:34.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:33.997+0000 7f80667fc640 1 -- 172.21.15.88:0/33702895 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f806c051790 con 0x7f80700c0460 2023-12-08T08:20:34.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.149+0000 7f8077bf8640 1 -- 172.21.15.88:0/33702895 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f807014e870 con 0x7f80700c0460 2023-12-08T08:20:34.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.149+0000 7f80667fc640 1 -- 172.21.15.88:0/33702895 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7f806c054db0 con 0x7f80700c0460 2023-12-08T08:20:34.155 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:34.155 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:20:21.492555+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:18.675917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:19.511013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.153+0000 7f8077bf8640 1 -- 172.21.15.88:0/33702895 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8054066470 msgr2=0x7f8054068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.153+0000 7f8077bf8640 1 --2- 172.21.15.88:0/33702895 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8054066470 0x7f8054068930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f80600011f0 tx=0x7f8060007930 comp rx=0 tx=0).stop 2023-12-08T08:20:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.153+0000 7f8077bf8640 1 -- 172.21.15.88:0/33702895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80700c0460 msgr2=0x7f8070150860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.153+0000 7f8077bf8640 1 --2- 172.21.15.88:0/33702895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80700c0460 0x7f8070150860 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f806c00e870 tx=0x7f806c00ec70 comp rx=0 tx=0).stop 2023-12-08T08:20:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.153+0000 7f8077bf8640 1 -- 172.21.15.88:0/33702895 shutdown_connections 2023-12-08T08:20:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.153+0000 7f8077bf8640 1 --2- 172.21.15.88:0/33702895 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8054066470 0x7f8054068930 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.153+0000 7f8077bf8640 1 --2- 172.21.15.88:0/33702895 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80700c3960 0x7f80701f4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.153+0000 7f8077bf8640 1 --2- 172.21.15.88:0/33702895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80700c0f30 0x7f807014d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.153+0000 7f8077bf8640 1 --2- 172.21.15.88:0/33702895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80700c0460 0x7f8070150860 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.153+0000 7f8077bf8640 1 -- 172.21.15.88:0/33702895 >> 172.21.15.88:0/33702895 conn(0x7f80700a7810 msgr2=0x7f8070152230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:34.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.153+0000 7f8077bf8640 1 -- 172.21.15.88:0/33702895 shutdown_connections 2023-12-08T08:20:34.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.153+0000 7f8077bf8640 1 -- 172.21.15.88:0/33702895 wait complete. 2023-12-08T08:20:34.176 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:20:18.675917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:20:19.511013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:20:34.177 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:20:34.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.309+0000 7fe67f59e640 1 Processor -- start 2023-12-08T08:20:34.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.309+0000 7fe67f59e640 1 -- start start 2023-12-08T08:20:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.313+0000 7fe67f59e640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe6801519f0 0x7fe6800ca310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.313+0000 7fe67f59e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6800c7b00 0x7fe680154380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.313+0000 7fe67f59e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe6801585f0 0x7fe68006b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.313+0000 7fe67f59e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6800c5310 con 0x7fe6801585f0 2023-12-08T08:20:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.313+0000 7fe67f59e640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6800c85d0 con 0x7fe6801519f0 2023-12-08T08:20:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.313+0000 7fe67f59e640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe680158160 con 0x7fe6800c7b00 2023-12-08T08:20:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.313+0000 7fe67ed9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe6801585f0 0x7fe68006b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.313+0000 7fe67ed9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe6801585f0 0x7fe68006b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41376/0 (socket says 172.21.15.88:41376) 2023-12-08T08:20:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.313+0000 7fe67ed9d640 1 -- 172.21.15.88:0/998598411 learned_addr learned my addr 172.21.15.88:0/998598411 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.313+0000 7fe67e59c640 1 --2- 172.21.15.88:0/998598411 >> v2:172.21.15.148:3300/0 conn(0x7fe6801519f0 0x7fe6800ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.313+0000 7fe67dd9b640 1 --2- 172.21.15.88:0/998598411 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6800c7b00 0x7fe680154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.313+0000 7fe67ed9d640 1 -- 172.21.15.88:0/998598411 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6800c7b00 msgr2=0x7fe680154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:34.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.313+0000 7fe67ed9d640 1 --2- 172.21.15.88:0/998598411 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6800c7b00 0x7fe680154380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.313+0000 7fe67ed9d640 1 -- 172.21.15.88:0/998598411 >> v2:172.21.15.148:3300/0 conn(0x7fe6801519f0 msgr2=0x7fe6800ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:34.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.313+0000 7fe67ed9d640 1 --2- 172.21.15.88:0/998598411 >> v2:172.21.15.148:3300/0 conn(0x7fe6801519f0 0x7fe6800ca310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.313+0000 7fe67ed9d640 1 -- 172.21.15.88:0/998598411 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe680151dd0 con 0x7fe6801585f0 2023-12-08T08:20:34.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.317+0000 7fe67ed9d640 1 --2- 172.21.15.88:0/998598411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6801585f0 0x7fe68006b940 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe6800c6560 tx=0x7fe67801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692503d755abd53e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:34.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.317+0000 7fe67d59a640 1 -- 172.21.15.88:0/998598411 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6780a57a0 con 0x7fe6801585f0 2023-12-08T08:20:34.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.317+0000 7fe67d59a640 1 -- 172.21.15.88:0/998598411 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6780a5900 con 0x7fe6801585f0 2023-12-08T08:20:34.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.317+0000 7fe67d59a640 1 -- 172.21.15.88:0/998598411 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6780a5c90 con 0x7fe6801585f0 2023-12-08T08:20:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.317+0000 7fe67f59e640 1 -- 172.21.15.88:0/998598411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6801585f0 msgr2=0x7fe68006b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.317+0000 7fe67f59e640 1 --2- 172.21.15.88:0/998598411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6801585f0 0x7fe68006b940 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe6800c6560 tx=0x7fe67801c920 comp rx=0 tx=0).stop 2023-12-08T08:20:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.317+0000 7fe67f59e640 1 -- 172.21.15.88:0/998598411 shutdown_connections 2023-12-08T08:20:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.317+0000 7fe67f59e640 1 --2- 172.21.15.88:0/998598411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6801585f0 0x7fe68006b940 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.317+0000 7fe67f59e640 1 --2- 172.21.15.88:0/998598411 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6800c7b00 0x7fe680154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.317+0000 7fe67f59e640 1 --2- 172.21.15.88:0/998598411 >> v2:172.21.15.148:3300/0 conn(0x7fe6801519f0 0x7fe6800ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.317+0000 7fe67f59e640 1 -- 172.21.15.88:0/998598411 >> 172.21.15.88:0/998598411 conn(0x7fe6800abd90 msgr2=0x7fe6800c9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.317+0000 7fe67f59e640 1 -- 172.21.15.88:0/998598411 shutdown_connections 2023-12-08T08:20:34.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.317+0000 7fe67f59e640 1 -- 172.21.15.88:0/998598411 wait complete. 2023-12-08T08:20:34.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.317+0000 7fe67f59e640 1 Processor -- start 2023-12-08T08:20:34.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.317+0000 7fe67f59e640 1 -- start start 2023-12-08T08:20:34.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.321+0000 7fe67f59e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6800c7b00 0x7fe680156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.321+0000 7fe67f59e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6801519f0 0x7fe68014ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.321+0000 7fe67f59e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6801585f0 0x7fe68014b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.321+0000 7fe67f59e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6800bd8d0 con 0x7fe6800c7b00 2023-12-08T08:20:34.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.321+0000 7fe67f59e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6800c02b0 con 0x7fe6801519f0 2023-12-08T08:20:34.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.321+0000 7fe67f59e640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6801531c0 con 0x7fe6801585f0 2023-12-08T08:20:34.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.321+0000 7fe67e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6800c7b00 0x7fe680156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.321+0000 7fe67e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6800c7b00 0x7fe680156b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41378/0 (socket says 172.21.15.88:41378) 2023-12-08T08:20:34.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.321+0000 7fe67e59c640 1 -- 172.21.15.88:0/3384203527 learned_addr learned my addr 172.21.15.88:0/3384203527 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:34.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.321+0000 7fe67dd9b640 1 --2- 172.21.15.88:0/3384203527 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6801519f0 0x7fe68014ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.321+0000 7fe67ed9d640 1 --2- 172.21.15.88:0/3384203527 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6801585f0 0x7fe68014b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.321+0000 7fe67e59c640 1 -- 172.21.15.88:0/3384203527 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6801585f0 msgr2=0x7fe68014b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.321+0000 7fe67e59c640 1 --2- 172.21.15.88:0/3384203527 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6801585f0 0x7fe68014b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.321+0000 7fe67e59c640 1 -- 172.21.15.88:0/3384203527 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6801519f0 msgr2=0x7fe68014ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.321+0000 7fe67e59c640 1 --2- 172.21.15.88:0/3384203527 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6801519f0 0x7fe68014ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.321+0000 7fe67e59c640 1 -- 172.21.15.88:0/3384203527 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe678009b30 con 0x7fe6800c7b00 2023-12-08T08:20:34.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.321+0000 7fe67e59c640 1 --2- 172.21.15.88:0/3384203527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6800c7b00 0x7fe680156b50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe67000d800 tx=0x7fe67000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:34.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.321+0000 7fe66effd640 1 -- 172.21.15.88:0/3384203527 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67000b6c0 con 0x7fe6800c7b00 2023-12-08T08:20:34.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.321+0000 7fe66effd640 1 -- 172.21.15.88:0/3384203527 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67000b820 con 0x7fe6800c7b00 2023-12-08T08:20:34.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.321+0000 7fe66effd640 1 -- 172.21.15.88:0/3384203527 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67000bb90 con 0x7fe6800c7b00 2023-12-08T08:20:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.321+0000 7fe67f59e640 1 -- 172.21.15.88:0/3384203527 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6801536c0 con 0x7fe6800c7b00 2023-12-08T08:20:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.321+0000 7fe67f59e640 1 -- 172.21.15.88:0/3384203527 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe680153c80 con 0x7fe6800c7b00 2023-12-08T08:20:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.321+0000 7fe67f59e640 1 -- 172.21.15.88:0/3384203527 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe680072960 con 0x7fe6800c7b00 2023-12-08T08:20:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.321+0000 7fe66effd640 1 -- 172.21.15.88:0/3384203527 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe67000bcf0 con 0x7fe6800c7b00 2023-12-08T08:20:34.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.325+0000 7fe66effd640 1 --2- 172.21.15.88:0/3384203527 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe6600664a0 0x7fe660068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.325+0000 7fe66effd640 1 -- 172.21.15.88:0/3384203527 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe670084270 con 0x7fe6800c7b00 2023-12-08T08:20:34.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.325+0000 7fe67dd9b640 1 --2- 172.21.15.88:0/3384203527 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe6600664a0 0x7fe660068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.325+0000 7fe67dd9b640 1 --2- 172.21.15.88:0/3384203527 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe6600664a0 0x7fe660068960 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe6800c3d40 tx=0x7fe674008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:34.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.329+0000 7fe66effd640 1 -- 172.21.15.88:0/3384203527 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe670051790 con 0x7fe6800c7b00 2023-12-08T08:20:34.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.481+0000 7fe67f59e640 1 -- 172.21.15.88:0/3384203527 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe680067bc0 con 0x7fe6800c7b00 2023-12-08T08:20:34.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.481+0000 7fe66effd640 1 -- 172.21.15.88:0/3384203527 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe670054db0 con 0x7fe6800c7b00 2023-12-08T08:20:34.485 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:20:34.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.481+0000 7fe67f59e640 1 -- 172.21.15.88:0/3384203527 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe6600664a0 msgr2=0x7fe660068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.481+0000 7fe67f59e640 1 --2- 172.21.15.88:0/3384203527 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe6600664a0 0x7fe660068960 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe6800c3d40 tx=0x7fe674008040 comp rx=0 tx=0).stop 2023-12-08T08:20:34.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.481+0000 7fe67f59e640 1 -- 172.21.15.88:0/3384203527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6800c7b00 msgr2=0x7fe680156b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.481+0000 7fe67f59e640 1 --2- 172.21.15.88:0/3384203527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6800c7b00 0x7fe680156b50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe67000d800 tx=0x7fe67000dcc0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.481+0000 7fe67f59e640 1 -- 172.21.15.88:0/3384203527 shutdown_connections 2023-12-08T08:20:34.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.481+0000 7fe67f59e640 1 --2- 172.21.15.88:0/3384203527 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe6600664a0 0x7fe660068960 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.481+0000 7fe67f59e640 1 --2- 172.21.15.88:0/3384203527 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6801585f0 0x7fe68014b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.481+0000 7fe67f59e640 1 --2- 172.21.15.88:0/3384203527 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6801519f0 0x7fe68014ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.481+0000 7fe67f59e640 1 --2- 172.21.15.88:0/3384203527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6800c7b00 0x7fe680156b50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.481+0000 7fe67f59e640 1 -- 172.21.15.88:0/3384203527 >> 172.21.15.88:0/3384203527 conn(0x7fe6800abd90 msgr2=0x7fe68014f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:34.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.481+0000 7fe67f59e640 1 -- 172.21.15.88:0/3384203527 shutdown_connections 2023-12-08T08:20:34.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.481+0000 7fe67f59e640 1 -- 172.21.15.88:0/3384203527 wait complete. 2023-12-08T08:20:34.506 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:20:34.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.641+0000 7fba12bdf640 1 Processor -- start 2023-12-08T08:20:34.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.641+0000 7fba12bdf640 1 -- start start 2023-12-08T08:20:34.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.645+0000 7fba12bdf640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fba0c0c5300 0x7fba0c0a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.645+0000 7fba12bdf640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fba0c1548c0 0x7fba0c154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.645+0000 7fba12bdf640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba0c0a4e20 con 0x7fba0c14b1e0 2023-12-08T08:20:34.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.645+0000 7fba12bdf640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba0c0a50e0 con 0x7fba0c0c5300 2023-12-08T08:20:34.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.645+0000 7fba12bdf640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c0c0f00 con 0x7fba0c1548c0 2023-12-08T08:20:34.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.645+0000 7fba1097b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fba0c14b1e0 0x7fba0c0c1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34522/0 (socket says 172.21.15.88:34522) 2023-12-08T08:20:34.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.645+0000 7fba1097b640 1 -- 172.21.15.88:0/4048064353 learned_addr learned my addr 172.21.15.88:0/4048064353 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:34.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.645+0000 7fba0bfff640 1 --2- 172.21.15.88:0/4048064353 >> v2:172.21.15.148:3300/0 conn(0x7fba0c0c5300 0x7fba0c0a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.645+0000 7fba1117c640 1 --2- 172.21.15.88:0/4048064353 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fba0c1548c0 0x7fba0c154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.645+0000 7fba0b7fe640 1 -- 172.21.15.88:0/4048064353 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718300917 0 0) 0x7fba0c0a4e20 con 0x7fba0c14b1e0 2023-12-08T08:20:34.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.645+0000 7fba0b7fe640 1 -- 172.21.15.88:0/4048064353 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9fc003530 con 0x7fba0c14b1e0 2023-12-08T08:20:34.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.645+0000 7fba0b7fe640 1 -- 172.21.15.88:0/4048064353 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3504915881 0 0) 0x7fb9fc003530 con 0x7fba0c14b1e0 2023-12-08T08:20:34.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.645+0000 7fba0bfff640 1 -- 172.21.15.88:0/4048064353 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fba0c1548c0 msgr2=0x7fba0c154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:34.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.645+0000 7fba0bfff640 1 --2- 172.21.15.88:0/4048064353 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fba0c1548c0 0x7fba0c154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.645+0000 7fba0bfff640 1 -- 172.21.15.88:0/4048064353 >> v1:172.21.15.88:6789/0 conn(0x7fba0c14b1e0 legacy=0x7fba0c0c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.645+0000 7fba0bfff640 1 -- 172.21.15.88:0/4048064353 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0c0c11e0 con 0x7fba0c0c5300 2023-12-08T08:20:34.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.645+0000 7fba1117c640 1 --2- 172.21.15.88:0/4048064353 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fba0c1548c0 0x7fba0c154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:34.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.649+0000 7fba0bfff640 1 --2- 172.21.15.88:0/4048064353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba0c0c5300 0x7fba0c0a9c30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80097c0 tx=0x7fb9f801c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2502ec47b1c18c6e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:34.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.649+0000 7fba0b7fe640 1 -- 172.21.15.88:0/4048064353 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba000016a0 con 0x7fba0c0c5300 2023-12-08T08:20:34.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.649+0000 7fba0b7fe640 1 -- 172.21.15.88:0/4048064353 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f80a7050 con 0x7fba0c0c5300 2023-12-08T08:20:34.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.649+0000 7fba0b7fe640 1 -- 172.21.15.88:0/4048064353 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f80ab620 con 0x7fba0c0c5300 2023-12-08T08:20:34.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.649+0000 7fba12bdf640 1 -- 172.21.15.88:0/4048064353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba0c0c5300 msgr2=0x7fba0c0a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.649+0000 7fba12bdf640 1 --2- 172.21.15.88:0/4048064353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba0c0c5300 0x7fba0c0a9c30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80097c0 tx=0x7fb9f801c3a0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.649+0000 7fba12bdf640 1 -- 172.21.15.88:0/4048064353 shutdown_connections 2023-12-08T08:20:34.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.649+0000 7fba12bdf640 1 --2- 172.21.15.88:0/4048064353 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fba0c1548c0 0x7fba0c154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.649+0000 7fba12bdf640 1 --2- 172.21.15.88:0/4048064353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba0c0c5300 0x7fba0c0a9c30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.649+0000 7fba12bdf640 1 -- 172.21.15.88:0/4048064353 >> 172.21.15.88:0/4048064353 conn(0x7fba0c0c59f0 msgr2=0x7fba0c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:34.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.649+0000 7fba12bdf640 1 -- 172.21.15.88:0/4048064353 shutdown_connections 2023-12-08T08:20:34.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.649+0000 7fba12bdf640 1 -- 172.21.15.88:0/4048064353 wait complete. 2023-12-08T08:20:34.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.649+0000 7fba12bdf640 1 Processor -- start 2023-12-08T08:20:34.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.649+0000 7fba12bdf640 1 -- start start 2023-12-08T08:20:34.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.653+0000 7fba12bdf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba0c0c5300 0x7fba0c146050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.653+0000 7fba12bdf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba0c14b1e0 0x7fba0c1ed010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.653+0000 7fba12bdf640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fba0c1548c0 0x7fba0c1ed550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.653+0000 7fba12bdf640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c1ecb80 con 0x7fba0c0c5300 2023-12-08T08:20:34.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.653+0000 7fba12bdf640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c0a6770 con 0x7fba0c14b1e0 2023-12-08T08:20:34.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.653+0000 7fba12bdf640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c0a53c0 con 0x7fba0c1548c0 2023-12-08T08:20:34.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.653+0000 7fba1097b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba0c0c5300 0x7fba0c146050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.653+0000 7fba1097b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba0c0c5300 0x7fba0c146050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41380/0 (socket says 172.21.15.88:41380) 2023-12-08T08:20:34.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.653+0000 7fba1097b640 1 -- 172.21.15.88:0/1486858478 learned_addr learned my addr 172.21.15.88:0/1486858478 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:34.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.653+0000 7fba1117c640 1 --2- 172.21.15.88:0/1486858478 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fba0c1548c0 0x7fba0c1ed550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.653+0000 7fba0bfff640 1 --2- 172.21.15.88:0/1486858478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba0c14b1e0 0x7fba0c1ed010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.653+0000 7fba1097b640 1 -- 172.21.15.88:0/1486858478 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fba0c1548c0 msgr2=0x7fba0c1ed550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.653+0000 7fba1097b640 1 --2- 172.21.15.88:0/1486858478 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fba0c1548c0 0x7fba0c1ed550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.653+0000 7fba1097b640 1 -- 172.21.15.88:0/1486858478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba0c14b1e0 msgr2=0x7fba0c1ed010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.653+0000 7fba1097b640 1 --2- 172.21.15.88:0/1486858478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba0c14b1e0 0x7fba0c1ed010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.653+0000 7fba1097b640 1 -- 172.21.15.88:0/1486858478 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba04009a70 con 0x7fba0c0c5300 2023-12-08T08:20:34.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.653+0000 7fba1097b640 1 --2- 172.21.15.88:0/1486858478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba0c0c5300 0x7fba0c146050 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fba0000c730 tx=0x7fba0000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:34.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.653+0000 7fba097fa640 1 -- 172.21.15.88:0/1486858478 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba000072d0 con 0x7fba0c0c5300 2023-12-08T08:20:34.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.653+0000 7fba097fa640 1 -- 172.21.15.88:0/1486858478 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba00007450 con 0x7fba0c0c5300 2023-12-08T08:20:34.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.653+0000 7fba097fa640 1 -- 172.21.15.88:0/1486858478 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba000047f0 con 0x7fba0c0c5300 2023-12-08T08:20:34.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.653+0000 7fba12bdf640 1 -- 172.21.15.88:0/1486858478 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f8009420 con 0x7fba0c0c5300 2023-12-08T08:20:34.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.653+0000 7fba12bdf640 1 -- 172.21.15.88:0/1486858478 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0c0c6100 con 0x7fba0c0c5300 2023-12-08T08:20:34.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.653+0000 7fba12bdf640 1 -- 172.21.15.88:0/1486858478 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba0c067630 con 0x7fba0c0c5300 2023-12-08T08:20:34.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.653+0000 7fba097fa640 1 -- 172.21.15.88:0/1486858478 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fba00004b60 con 0x7fba0c0c5300 2023-12-08T08:20:34.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.657+0000 7fba097fa640 1 --2- 172.21.15.88:0/1486858478 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb9f0066470 0x7fb9f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.657+0000 7fba097fa640 1 -- 172.21.15.88:0/1486858478 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba00083460 con 0x7fba0c0c5300 2023-12-08T08:20:34.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.657+0000 7fba0bfff640 1 --2- 172.21.15.88:0/1486858478 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb9f0066470 0x7fb9f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.657+0000 7fba0bfff640 1 --2- 172.21.15.88:0/1486858478 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb9f0066470 0x7fb9f0068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80ad000 tx=0x7fb9f80a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:34.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.661+0000 7fba097fa640 1 -- 172.21.15.88:0/1486858478 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fba000508d0 con 0x7fba0c0c5300 2023-12-08T08:20:34.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.813+0000 7fba12bdf640 1 -- 172.21.15.88:0/1486858478 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fba0c0722f0 con 0x7fba0c0c5300 2023-12-08T08:20:34.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.813+0000 7fba097fa640 1 -- 172.21.15.88:0/1486858478 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fba00053ef0 con 0x7fba0c0c5300 2023-12-08T08:20:34.818 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:20:34.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.813+0000 7fba12bdf640 1 -- 172.21.15.88:0/1486858478 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb9f0066470 msgr2=0x7fb9f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.813+0000 7fba12bdf640 1 --2- 172.21.15.88:0/1486858478 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb9f0066470 0x7fb9f0068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80ad000 tx=0x7fb9f80a6000 comp rx=0 tx=0).stop 2023-12-08T08:20:34.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.813+0000 7fba12bdf640 1 -- 172.21.15.88:0/1486858478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba0c0c5300 msgr2=0x7fba0c146050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.813+0000 7fba12bdf640 1 --2- 172.21.15.88:0/1486858478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba0c0c5300 0x7fba0c146050 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fba0000c730 tx=0x7fba0000cbf0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.813+0000 7fba12bdf640 1 -- 172.21.15.88:0/1486858478 shutdown_connections 2023-12-08T08:20:34.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.813+0000 7fba12bdf640 1 --2- 172.21.15.88:0/1486858478 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb9f0066470 0x7fb9f0068930 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.813+0000 7fba12bdf640 1 --2- 172.21.15.88:0/1486858478 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fba0c1548c0 0x7fba0c1ed550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.813+0000 7fba12bdf640 1 --2- 172.21.15.88:0/1486858478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba0c14b1e0 0x7fba0c1ed010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.813+0000 7fba12bdf640 1 --2- 172.21.15.88:0/1486858478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba0c0c5300 0x7fba0c146050 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.813+0000 7fba12bdf640 1 -- 172.21.15.88:0/1486858478 >> 172.21.15.88:0/1486858478 conn(0x7fba0c0c59f0 msgr2=0x7fba0c153c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:34.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.813+0000 7fba12bdf640 1 -- 172.21.15.88:0/1486858478 shutdown_connections 2023-12-08T08:20:34.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.813+0000 7fba12bdf640 1 -- 172.21.15.88:0/1486858478 wait complete. 2023-12-08T08:20:34.839 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:20:34.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.973+0000 7f62f9c79640 1 Processor -- start 2023-12-08T08:20:34.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.973+0000 7f62f9c79640 1 -- start start 2023-12-08T08:20:34.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.973+0000 7f62f9c79640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f62f41516a0 0x7f62f40c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.973+0000 7f62f9c79640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f62f40c46c0 0x7f62f406bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.973+0000 7f62f9c79640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f4151b20 con 0x7f62f414e2a0 2023-12-08T08:20:34.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.973+0000 7f62f9c79640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f4151210 con 0x7f62f40c46c0 2023-12-08T08:20:34.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.973+0000 7f62f9c79640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f414e680 con 0x7f62f41516a0 2023-12-08T08:20:34.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.977+0000 7f62f37fe640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f62f414e2a0 0x7f62f40a9460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:57728/0 (socket says 172.21.15.88:57728) 2023-12-08T08:20:34.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.977+0000 7f62f37fe640 1 -- 172.21.15.88:0/1471705439 learned_addr learned my addr 172.21.15.88:0/1471705439 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:34.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.977+0000 7f62f3fff640 1 --2- 172.21.15.88:0/1471705439 >> v2:172.21.15.148:3300/0 conn(0x7f62f40c46c0 0x7f62f406bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.977+0000 7f62f2ffd640 1 --2- 172.21.15.88:0/1471705439 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f62f41516a0 0x7f62f40c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.977+0000 7f62f27fc640 1 -- 172.21.15.88:0/1471705439 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 537900279 0 0) 0x7f62e4001120 con 0x7f62f414e2a0 2023-12-08T08:20:34.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.977+0000 7f62f27fc640 1 -- 172.21.15.88:0/1471705439 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62dc003450 con 0x7f62f414e2a0 2023-12-08T08:20:34.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.977+0000 7f62f3fff640 1 -- 172.21.15.88:0/1471705439 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f62f41516a0 msgr2=0x7f62f40c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:34.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.977+0000 7f62f3fff640 1 --2- 172.21.15.88:0/1471705439 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f62f41516a0 0x7f62f40c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.977+0000 7f62f3fff640 1 -- 172.21.15.88:0/1471705439 >> v1:172.21.15.148:6789/0 conn(0x7f62f414e2a0 legacy=0x7f62f40a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.977+0000 7f62f3fff640 1 -- 172.21.15.88:0/1471705439 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f40a9b70 con 0x7f62f40c46c0 2023-12-08T08:20:34.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.977+0000 7f62f2ffd640 1 --2- 172.21.15.88:0/1471705439 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f62f41516a0 0x7f62f40c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:34.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.977+0000 7f62f3fff640 1 --2- 172.21.15.88:0/1471705439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62f40c46c0 0x7f62f406bc80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009d90 tx=0x7f62ec01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0c4959d1165487b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:34.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.977+0000 7f62f27fc640 1 -- 172.21.15.88:0/1471705439 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec0a5790 con 0x7f62f40c46c0 2023-12-08T08:20:34.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.977+0000 7f62f27fc640 1 -- 172.21.15.88:0/1471705439 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ec0a58f0 con 0x7f62f40c46c0 2023-12-08T08:20:34.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.977+0000 7f62f27fc640 1 -- 172.21.15.88:0/1471705439 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec0a5c80 con 0x7f62f40c46c0 2023-12-08T08:20:34.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.981+0000 7f62f9c79640 1 -- 172.21.15.88:0/1471705439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62f40c46c0 msgr2=0x7f62f406bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.981+0000 7f62f9c79640 1 --2- 172.21.15.88:0/1471705439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62f40c46c0 0x7f62f406bc80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009d90 tx=0x7f62ec01c950 comp rx=0 tx=0).stop 2023-12-08T08:20:34.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.981+0000 7f62f9c79640 1 -- 172.21.15.88:0/1471705439 shutdown_connections 2023-12-08T08:20:34.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.981+0000 7f62f9c79640 1 --2- 172.21.15.88:0/1471705439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62f40c46c0 0x7f62f406bc80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.981+0000 7f62f9c79640 1 --2- 172.21.15.88:0/1471705439 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f62f41516a0 0x7f62f40c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.981+0000 7f62f9c79640 1 -- 172.21.15.88:0/1471705439 >> 172.21.15.88:0/1471705439 conn(0x7f62f40c59f0 msgr2=0x7f62f40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:34.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.981+0000 7f62f9c79640 1 -- 172.21.15.88:0/1471705439 shutdown_connections 2023-12-08T08:20:34.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.981+0000 7f62f9c79640 1 -- 172.21.15.88:0/1471705439 wait complete. 2023-12-08T08:20:34.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.981+0000 7f62f9c79640 1 Processor -- start 2023-12-08T08:20:34.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.981+0000 7f62f9c79640 1 -- start start 2023-12-08T08:20:34.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.981+0000 7f62f9c79640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62f40c46c0 0x7f62f41f0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.981+0000 7f62f9c79640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62f414e2a0 0x7f62f4146fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.981+0000 7f62f9c79640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f62f41516a0 0x7f62f4147510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.981+0000 7f62f9c79640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f4152ab0 con 0x7f62f40c46c0 2023-12-08T08:20:34.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.981+0000 7f62f9c79640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f41f0f00 con 0x7f62f414e2a0 2023-12-08T08:20:34.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.981+0000 7f62f9c79640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f41f11e0 con 0x7f62f41516a0 2023-12-08T08:20:34.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.981+0000 7f62f37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62f40c46c0 0x7f62f41f0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.981+0000 7f62f37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62f40c46c0 0x7f62f41f0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41388/0 (socket says 172.21.15.88:41388) 2023-12-08T08:20:34.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.981+0000 7f62f37fe640 1 -- 172.21.15.88:0/2314338810 learned_addr learned my addr 172.21.15.88:0/2314338810 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:34.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.981+0000 7f62f2ffd640 1 --2- 172.21.15.88:0/2314338810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62f414e2a0 0x7f62f4146fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.981+0000 7f62f3fff640 1 --2- 172.21.15.88:0/2314338810 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f62f41516a0 0x7f62f4147510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.985+0000 7f62f37fe640 1 -- 172.21.15.88:0/2314338810 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f62f41516a0 msgr2=0x7f62f4147510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.985+0000 7f62f37fe640 1 --2- 172.21.15.88:0/2314338810 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f62f41516a0 0x7f62f4147510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.985+0000 7f62f37fe640 1 -- 172.21.15.88:0/2314338810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62f414e2a0 msgr2=0x7f62f4146fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.985+0000 7f62f37fe640 1 --2- 172.21.15.88:0/2314338810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62f414e2a0 0x7f62f4146fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.985+0000 7f62f37fe640 1 -- 172.21.15.88:0/2314338810 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e8009420 con 0x7f62f40c46c0 2023-12-08T08:20:34.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.985+0000 7f62f37fe640 1 --2- 172.21.15.88:0/2314338810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62f40c46c0 0x7f62f41f0560 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f62e400c4d0 tx=0x7f62e400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:34.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.985+0000 7f62dbfff640 1 -- 172.21.15.88:0/2314338810 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e4005cf0 con 0x7f62f40c46c0 2023-12-08T08:20:34.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.985+0000 7f62dbfff640 1 -- 172.21.15.88:0/2314338810 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e4005e50 con 0x7f62f40c46c0 2023-12-08T08:20:34.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.985+0000 7f62dbfff640 1 -- 172.21.15.88:0/2314338810 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e4007290 con 0x7f62f40c46c0 2023-12-08T08:20:34.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.985+0000 7f62f9c79640 1 -- 172.21.15.88:0/2314338810 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62ec009a70 con 0x7f62f40c46c0 2023-12-08T08:20:34.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.985+0000 7f62f9c79640 1 -- 172.21.15.88:0/2314338810 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f406ff20 con 0x7f62f40c46c0 2023-12-08T08:20:34.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.985+0000 7f62f9c79640 1 -- 172.21.15.88:0/2314338810 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f4070140 con 0x7f62f40c46c0 2023-12-08T08:20:34.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.985+0000 7f62dbfff640 1 -- 172.21.15.88:0/2314338810 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f62e40073f0 con 0x7f62f40c46c0 2023-12-08T08:20:34.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.985+0000 7f62dbfff640 1 --2- 172.21.15.88:0/2314338810 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f62e0066470 0x7f62e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.985+0000 7f62dbfff640 1 -- 172.21.15.88:0/2314338810 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62e40833a0 con 0x7f62f40c46c0 2023-12-08T08:20:34.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.985+0000 7f62f2ffd640 1 --2- 172.21.15.88:0/2314338810 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f62e0066470 0x7f62e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.989+0000 7f62f2ffd640 1 --2- 172.21.15.88:0/2314338810 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f62e0066470 0x7f62e0068930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f62f40a6dd0 tx=0x7f62e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:34.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:34.989+0000 7f62dbfff640 1 -- 172.21.15.88:0/2314338810 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f62e4050780 con 0x7f62f40c46c0 2023-12-08T08:20:35.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.141+0000 7f62f9c79640 1 -- 172.21.15.88:0/2314338810 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f62f4151b20 con 0x7f62f40c46c0 2023-12-08T08:20:35.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.141+0000 7f62dbfff640 1 -- 172.21.15.88:0/2314338810 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f62f4151b20 con 0x7f62f40c46c0 2023-12-08T08:20:35.148 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:20:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.145+0000 7f62f9c79640 1 -- 172.21.15.88:0/2314338810 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f62e0066470 msgr2=0x7f62e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.145+0000 7f62f9c79640 1 --2- 172.21.15.88:0/2314338810 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f62e0066470 0x7f62e0068930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f62f40a6dd0 tx=0x7f62e8008040 comp rx=0 tx=0).stop 2023-12-08T08:20:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.145+0000 7f62f9c79640 1 -- 172.21.15.88:0/2314338810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62f40c46c0 msgr2=0x7f62f41f0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.145+0000 7f62f9c79640 1 --2- 172.21.15.88:0/2314338810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62f40c46c0 0x7f62f41f0560 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f62e400c4d0 tx=0x7f62e400c990 comp rx=0 tx=0).stop 2023-12-08T08:20:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.145+0000 7f62f9c79640 1 -- 172.21.15.88:0/2314338810 shutdown_connections 2023-12-08T08:20:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.145+0000 7f62f9c79640 1 --2- 172.21.15.88:0/2314338810 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f62e0066470 0x7f62e0068930 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.145+0000 7f62f9c79640 1 --2- 172.21.15.88:0/2314338810 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f62f41516a0 0x7f62f4147510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.145+0000 7f62f9c79640 1 --2- 172.21.15.88:0/2314338810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62f414e2a0 0x7f62f4146fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.145+0000 7f62f9c79640 1 --2- 172.21.15.88:0/2314338810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62f40c46c0 0x7f62f41f0560 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.145+0000 7f62f9c79640 1 -- 172.21.15.88:0/2314338810 >> 172.21.15.88:0/2314338810 conn(0x7f62f40c59f0 msgr2=0x7f62f406c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.145+0000 7f62f9c79640 1 -- 172.21.15.88:0/2314338810 shutdown_connections 2023-12-08T08:20:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.145+0000 7f62f9c79640 1 -- 172.21.15.88:0/2314338810 wait complete. 2023-12-08T08:20:35.170 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:20:35.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.301+0000 7fe5cf06b640 1 Processor -- start 2023-12-08T08:20:35.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.301+0000 7fe5cf06b640 1 -- start start 2023-12-08T08:20:35.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.301+0000 7fe5cf06b640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5c806c100 0x7fe5c815fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.301+0000 7fe5cf06b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c80c4890 con 0x7fe5c80af4c0 2023-12-08T08:20:35.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.301+0000 7fe5cf06b640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c81553d0 con 0x7fe5c8154f20 2023-12-08T08:20:35.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.301+0000 7fe5cf06b640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c80af8a0 con 0x7fe5c806c100 2023-12-08T08:20:35.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.301+0000 7fe5cce07640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe5c80af4c0 0x7fe5c80c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34538/0 (socket says 172.21.15.88:34538) 2023-12-08T08:20:35.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.301+0000 7fe5cce07640 1 -- 172.21.15.88:0/2097415043 learned_addr learned my addr 172.21.15.88:0/2097415043 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:35.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.301+0000 7fe5cd608640 1 --2- 172.21.15.88:0/2097415043 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5c806c100 0x7fe5c815fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.301+0000 7fe5bf7fe640 1 -- 172.21.15.88:0/2097415043 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198977873 0 0) 0x7fe5c80c4890 con 0x7fe5c80af4c0 2023-12-08T08:20:35.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.301+0000 7fe5bf7fe640 1 -- 172.21.15.88:0/2097415043 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5b0003530 con 0x7fe5c80af4c0 2023-12-08T08:20:35.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.301+0000 7fe5bf7fe640 1 -- 172.21.15.88:0/2097415043 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3044938741 0 0) 0x7fe5c81553d0 con 0x7fe5c8154f20 2023-12-08T08:20:35.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.301+0000 7fe5bf7fe640 1 -- 172.21.15.88:0/2097415043 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5c80c4890 con 0x7fe5c8154f20 2023-12-08T08:20:35.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.301+0000 7fe5bf7fe640 1 -- 172.21.15.88:0/2097415043 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2939619311 0 0) 0x7fe5b0003530 con 0x7fe5c80af4c0 2023-12-08T08:20:35.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.301+0000 7fe5bf7fe640 1 -- 172.21.15.88:0/2097415043 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5c806c100 msgr2=0x7fe5c815fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:35.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.301+0000 7fe5bf7fe640 1 --2- 172.21.15.88:0/2097415043 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5c806c100 0x7fe5c815fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.301+0000 7fe5bf7fe640 1 -- 172.21.15.88:0/2097415043 >> v1:172.21.15.148:6789/0 conn(0x7fe5c8154f20 legacy=0x7fe5c806b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.301+0000 7fe5bf7fe640 1 -- 172.21.15.88:0/2097415043 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c80c4b30 con 0x7fe5c80af4c0 2023-12-08T08:20:35.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.301+0000 7fe5bf7fe640 1 -- 172.21.15.88:0/2097415043 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7fe5c4001680 con 0x7fe5c80af4c0 2023-12-08T08:20:35.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.301+0000 7fe5bf7fe640 1 -- 172.21.15.88:0/2097415043 >> v1:172.21.15.88:6789/0 conn(0x7fe5c80af4c0 legacy=0x7fe5c80c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.301+0000 7fe5bf7fe640 1 --2- 172.21.15.88:0/2097415043 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5c806c100 0x7fe5b0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.301+0000 7fe5bf7fe640 1 --2- 172.21.15.88:0/2097415043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5b00040f0 0x7fe5b00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.301+0000 7fe5bf7fe640 1 --2- 172.21.15.88:0/2097415043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b0004d10 0x7fe5b0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.301+0000 7fe5bf7fe640 1 -- 172.21.15.88:0/2097415043 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c80af8a0 con 0x7fe5b0004d10 2023-12-08T08:20:35.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.301+0000 7fe5bf7fe640 1 -- 172.21.15.88:0/2097415043 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b000bb50 con 0x7fe5b00040f0 2023-12-08T08:20:35.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.301+0000 7fe5bf7fe640 1 -- 172.21.15.88:0/2097415043 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b000bd10 con 0x7fe5c806c100 2023-12-08T08:20:35.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.305+0000 7fe5cd608640 1 --2- 172.21.15.88:0/2097415043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b0004d10 0x7fe5b0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.305+0000 7fe5cce07640 1 --2- 172.21.15.88:0/2097415043 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5c806c100 0x7fe5b0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.305+0000 7fe5bffff640 1 --2- 172.21.15.88:0/2097415043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5b00040f0 0x7fe5b00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.305+0000 7fe5cd608640 1 -- 172.21.15.88:0/2097415043 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5c806c100 msgr2=0x7fe5b0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:35.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.305+0000 7fe5cd608640 1 --2- 172.21.15.88:0/2097415043 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5c806c100 0x7fe5b0003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.305+0000 7fe5cd608640 1 -- 172.21.15.88:0/2097415043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5b00040f0 msgr2=0x7fe5b00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:35.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.305+0000 7fe5cd608640 1 --2- 172.21.15.88:0/2097415043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5b00040f0 0x7fe5b00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.305+0000 7fe5cd608640 1 -- 172.21.15.88:0/2097415043 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b0003530 con 0x7fe5b0004d10 2023-12-08T08:20:35.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.305+0000 7fe5bffff640 1 --2- 172.21.15.88:0/2097415043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5b00040f0 0x7fe5b00047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:35.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.305+0000 7fe5cd608640 1 --2- 172.21.15.88:0/2097415043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b0004d10 0x7fe5b0005190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0009f90 tx=0x7fe5c001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e5beff192972b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:35.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.305+0000 7fe5bf7fe640 1 -- 172.21.15.88:0/2097415043 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c00a5c30 con 0x7fe5b0004d10 2023-12-08T08:20:35.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.305+0000 7fe5bf7fe640 1 -- 172.21.15.88:0/2097415043 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c000f040 con 0x7fe5b0004d10 2023-12-08T08:20:35.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.305+0000 7fe5bf7fe640 1 -- 172.21.15.88:0/2097415043 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c00ad440 con 0x7fe5b0004d10 2023-12-08T08:20:35.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5cf06b640 1 -- 172.21.15.88:0/2097415043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b0004d10 msgr2=0x7fe5b0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5cf06b640 1 --2- 172.21.15.88:0/2097415043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b0004d10 0x7fe5b0005190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0009f90 tx=0x7fe5c001cc20 comp rx=0 tx=0).stop 2023-12-08T08:20:35.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5cd608640 1 -- 172.21.15.88:0/2097415043 reap_dead start 2023-12-08T08:20:35.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5cf06b640 1 -- 172.21.15.88:0/2097415043 shutdown_connections 2023-12-08T08:20:35.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5cf06b640 1 -- 172.21.15.88:0/2097415043 >> 172.21.15.88:0/2097415043 conn(0x7fe5c80ab9d0 msgr2=0x7fe5c80abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:35.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5cf06b640 1 -- 172.21.15.88:0/2097415043 shutdown_connections 2023-12-08T08:20:35.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5cf06b640 1 -- 172.21.15.88:0/2097415043 wait complete. 2023-12-08T08:20:35.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5cf06b640 1 Processor -- start 2023-12-08T08:20:35.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5cf06b640 1 -- start start 2023-12-08T08:20:35.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5cf06b640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5b0004d10 0x7fe5c81ea1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5cf06b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c80c1a70 0x7fe5c8152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5cf06b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5c81532c0 0x7fe5c81eccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5cf06b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c81ea720 con 0x7fe5c80c1a70 2023-12-08T08:20:35.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5cf06b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c80c3680 con 0x7fe5c81532c0 2023-12-08T08:20:35.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5cf06b640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c8154580 con 0x7fe5b0004d10 2023-12-08T08:20:35.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5bffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c80c1a70 0x7fe5c8152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5bffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c80c1a70 0x7fe5c8152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41408/0 (socket says 172.21.15.88:41408) 2023-12-08T08:20:35.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5bffff640 1 -- 172.21.15.88:0/3836847299 learned_addr learned my addr 172.21.15.88:0/3836847299 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:35.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5cce07640 1 --2- 172.21.15.88:0/3836847299 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5b0004d10 0x7fe5c81ea1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5cd608640 1 --2- 172.21.15.88:0/3836847299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5c81532c0 0x7fe5c81eccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5bffff640 1 -- 172.21.15.88:0/3836847299 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5b0004d10 msgr2=0x7fe5c81ea1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5bffff640 1 --2- 172.21.15.88:0/3836847299 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5b0004d10 0x7fe5c81ea1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5bffff640 1 -- 172.21.15.88:0/3836847299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5c81532c0 msgr2=0x7fe5c81eccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5bffff640 1 --2- 172.21.15.88:0/3836847299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5c81532c0 0x7fe5c81eccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5bffff640 1 -- 172.21.15.88:0/3836847299 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c8153f70 con 0x7fe5c80c1a70 2023-12-08T08:20:35.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5cce07640 1 --2- 172.21.15.88:0/3836847299 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5b0004d10 0x7fe5c81ea1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:35.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5bffff640 1 --2- 172.21.15.88:0/3836847299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c80c1a70 0x7fe5c8152d80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8011f00 tx=0x7fe5b800f540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:35.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.309+0000 7fe5bd7fa640 1 -- 172.21.15.88:0/3836847299 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8015610 con 0x7fe5c80c1a70 2023-12-08T08:20:35.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.313+0000 7fe5bd7fa640 1 -- 172.21.15.88:0/3836847299 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b8015770 con 0x7fe5c80c1a70 2023-12-08T08:20:35.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.313+0000 7fe5bd7fa640 1 -- 172.21.15.88:0/3836847299 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8015ae0 con 0x7fe5c80c1a70 2023-12-08T08:20:35.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.313+0000 7fe5cf06b640 1 -- 172.21.15.88:0/3836847299 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c80c38b0 con 0x7fe5c80c1a70 2023-12-08T08:20:35.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.313+0000 7fe5cf06b640 1 -- 172.21.15.88:0/3836847299 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c8154210 con 0x7fe5c80c1a70 2023-12-08T08:20:35.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.313+0000 7fe5cf06b640 1 -- 172.21.15.88:0/3836847299 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c8152aa0 con 0x7fe5c80c1a70 2023-12-08T08:20:35.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.313+0000 7fe5bd7fa640 1 -- 172.21.15.88:0/3836847299 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe5b8015c40 con 0x7fe5c80c1a70 2023-12-08T08:20:35.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.313+0000 7fe5bd7fa640 1 --2- 172.21.15.88:0/3836847299 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe5b40664a0 0x7fe5b4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.313+0000 7fe5bd7fa640 1 -- 172.21.15.88:0/3836847299 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5b80878d0 con 0x7fe5c80c1a70 2023-12-08T08:20:35.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.313+0000 7fe5cce07640 1 --2- 172.21.15.88:0/3836847299 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe5b40664a0 0x7fe5b4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.317+0000 7fe5cce07640 1 --2- 172.21.15.88:0/3836847299 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe5b40664a0 0x7fe5b4068960 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4007b90 tx=0x7fe5c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:35.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.317+0000 7fe5bd7fa640 1 -- 172.21.15.88:0/3836847299 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe5c8152aa0 con 0x7fe5c80c1a70 2023-12-08T08:20:35.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.497+0000 7fe5cf06b640 1 -- 172.21.15.88:0/3836847299 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5c8152aa0 con 0x7fe5c80c1a70 2023-12-08T08:20:35.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.497+0000 7fe5bd7fa640 1 -- 172.21.15.88:0/3836847299 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4910 (secure 0 0 0) 0x7fe5c8152aa0 con 0x7fe5c80c1a70 2023-12-08T08:20:35.504 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:35.504 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/1946795737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":1946795737},{"type":"v1","addr":"172.21.15.88:6837","nonce":1946795737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/140150927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":140150927},{"type":"v1","addr":"172.21.15.148:6834","nonce":140150927}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2399327235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2399327235},{"type":"v1","addr":"172.21.15.148:6835","nonce":2399327235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:20:20.479364+0000","modified":"2023-12-08T08:20:23.493737+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/3793971563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":3793971563},{"type":"v1","addr":"172.21.15.88:6835","nonce":3793971563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T08:20:35.504 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 8 2023-12-08T08:20:35.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.501+0000 7fe5cf06b640 1 -- 172.21.15.88:0/3836847299 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe5b40664a0 msgr2=0x7fe5b4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.501+0000 7fe5cf06b640 1 --2- 172.21.15.88:0/3836847299 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe5b40664a0 0x7fe5b4068960 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4007b90 tx=0x7fe5c4009040 comp rx=0 tx=0).stop 2023-12-08T08:20:35.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.501+0000 7fe5cf06b640 1 -- 172.21.15.88:0/3836847299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c80c1a70 msgr2=0x7fe5c8152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.501+0000 7fe5cf06b640 1 --2- 172.21.15.88:0/3836847299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c80c1a70 0x7fe5c8152d80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8011f00 tx=0x7fe5b800f540 comp rx=0 tx=0).stop 2023-12-08T08:20:35.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.501+0000 7fe5cf06b640 1 -- 172.21.15.88:0/3836847299 shutdown_connections 2023-12-08T08:20:35.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.501+0000 7fe5cf06b640 1 --2- 172.21.15.88:0/3836847299 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe5b40664a0 0x7fe5b4068960 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.501+0000 7fe5cf06b640 1 --2- 172.21.15.88:0/3836847299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5c81532c0 0x7fe5c81eccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.501+0000 7fe5cf06b640 1 --2- 172.21.15.88:0/3836847299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5c80c1a70 0x7fe5c8152d80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.501+0000 7fe5cf06b640 1 --2- 172.21.15.88:0/3836847299 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5b0004d10 0x7fe5c81ea1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.501+0000 7fe5cf06b640 1 -- 172.21.15.88:0/3836847299 >> 172.21.15.88:0/3836847299 conn(0x7fe5c80ab9d0 msgr2=0x7fe5c80733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:35.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.501+0000 7fe5cf06b640 1 -- 172.21.15.88:0/3836847299 shutdown_connections 2023-12-08T08:20:35.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.501+0000 7fe5cf06b640 1 -- 172.21.15.88:0/3836847299 wait complete. 2023-12-08T08:20:35.526 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:35.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.657+0000 7f65754e3640 1 Processor -- start 2023-12-08T08:20:35.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.657+0000 7f65754e3640 1 -- start start 2023-12-08T08:20:35.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.661+0000 7f65754e3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6570154f20 0x7f657006b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.661+0000 7f65754e3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f657006bf30 0x7f657015ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.661+0000 7f65754e3640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f657006c380 con 0x7f65700af4c0 2023-12-08T08:20:35.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.661+0000 7f65754e3640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65700c4890 con 0x7f657006bf30 2023-12-08T08:20:35.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.661+0000 7f65754e3640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65701553a0 con 0x7f6570154f20 2023-12-08T08:20:35.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.661+0000 7f656f7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f657006bf30 0x7f657015ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.661+0000 7f656f7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f657006bf30 0x7f657015ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41414/0 (socket says 172.21.15.88:41414) 2023-12-08T08:20:35.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.661+0000 7f656f7fe640 1 -- 172.21.15.88:0/3116149256 learned_addr learned my addr 172.21.15.88:0/3116149256 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:35.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.661+0000 7f65667fc640 1 --2- 172.21.15.88:0/3116149256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6570154f20 0x7f657006b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.661+0000 7f656f7fe640 1 -- 172.21.15.88:0/3116149256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6570154f20 msgr2=0x7f657006b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:35.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.661+0000 7f656f7fe640 1 --2- 172.21.15.88:0/3116149256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6570154f20 0x7f657006b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.661+0000 7f656f7fe640 1 -- 172.21.15.88:0/3116149256 >> v1:172.21.15.148:6789/0 conn(0x7f65700af4c0 legacy=0x7f65700c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.661+0000 7f656f7fe640 1 -- 172.21.15.88:0/3116149256 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65700af8a0 con 0x7f657006bf30 2023-12-08T08:20:35.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.661+0000 7f656f7fe640 1 --2- 172.21.15.88:0/3116149256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f657006bf30 0x7f657015ee20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6568009870 tx=0x7f656801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95312362c5524832 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:35.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.665+0000 7f656e7fc640 1 -- 172.21.15.88:0/3116149256 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65680ab680 con 0x7f657006bf30 2023-12-08T08:20:35.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.665+0000 7f656e7fc640 1 -- 172.21.15.88:0/3116149256 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65680ab7e0 con 0x7f657006bf30 2023-12-08T08:20:35.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.665+0000 7f656e7fc640 1 -- 172.21.15.88:0/3116149256 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65680abb70 con 0x7f657006bf30 2023-12-08T08:20:35.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.665+0000 7f65754e3640 1 -- 172.21.15.88:0/3116149256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f657006bf30 msgr2=0x7f657015ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.665+0000 7f65754e3640 1 --2- 172.21.15.88:0/3116149256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f657006bf30 0x7f657015ee20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6568009870 tx=0x7f656801c480 comp rx=0 tx=0).stop 2023-12-08T08:20:35.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.665+0000 7f65754e3640 1 -- 172.21.15.88:0/3116149256 shutdown_connections 2023-12-08T08:20:35.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.665+0000 7f65754e3640 1 --2- 172.21.15.88:0/3116149256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f657006bf30 0x7f657015ee20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.665+0000 7f65754e3640 1 --2- 172.21.15.88:0/3116149256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6570154f20 0x7f657006b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.665+0000 7f65754e3640 1 -- 172.21.15.88:0/3116149256 >> 172.21.15.88:0/3116149256 conn(0x7f65700ab9d0 msgr2=0x7f65700abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:35.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.665+0000 7f65754e3640 1 -- 172.21.15.88:0/3116149256 shutdown_connections 2023-12-08T08:20:35.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.665+0000 7f65754e3640 1 -- 172.21.15.88:0/3116149256 wait complete. 2023-12-08T08:20:35.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.665+0000 7f65754e3640 1 Processor -- start 2023-12-08T08:20:35.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.665+0000 7f65754e3640 1 -- start start 2023-12-08T08:20:35.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.665+0000 7f65754e3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f657006bf30 0x7f657014fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.665+0000 7f65754e3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65700af4c0 0x7f65700c00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.665+0000 7f65754e3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6570154f20 0x7f65700c05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.665+0000 7f65754e3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65700c0b20 con 0x7f65700af4c0 2023-12-08T08:20:35.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.665+0000 7f65754e3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65701523b0 con 0x7f6570154f20 2023-12-08T08:20:35.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.665+0000 7f65754e3640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65701f08c0 con 0x7f657006bf30 2023-12-08T08:20:35.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.669+0000 7f65667fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65700af4c0 0x7f65700c00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.669+0000 7f65667fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65700af4c0 0x7f65700c00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41416/0 (socket says 172.21.15.88:41416) 2023-12-08T08:20:35.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.669+0000 7f65667fc640 1 -- 172.21.15.88:0/3265096875 learned_addr learned my addr 172.21.15.88:0/3265096875 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:35.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.669+0000 7f656effd640 1 --2- 172.21.15.88:0/3265096875 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f657006bf30 0x7f657014fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.669+0000 7f656f7fe640 1 --2- 172.21.15.88:0/3265096875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6570154f20 0x7f65700c05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.669+0000 7f65667fc640 1 -- 172.21.15.88:0/3265096875 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f657006bf30 msgr2=0x7f657014fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.669+0000 7f65667fc640 1 --2- 172.21.15.88:0/3265096875 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f657006bf30 0x7f657014fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.669+0000 7f65667fc640 1 -- 172.21.15.88:0/3265096875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6570154f20 msgr2=0x7f65700c05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.669+0000 7f65667fc640 1 --2- 172.21.15.88:0/3265096875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6570154f20 0x7f65700c05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.669+0000 7f65667fc640 1 -- 172.21.15.88:0/3265096875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65680094d0 con 0x7f65700af4c0 2023-12-08T08:20:35.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.669+0000 7f65667fc640 1 --2- 172.21.15.88:0/3265096875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65700af4c0 0x7f65700c00a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f655800efc0 tx=0x7f655800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:35.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.669+0000 7f6567fff640 1 -- 172.21.15.88:0/3265096875 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6558014480 con 0x7f65700af4c0 2023-12-08T08:20:35.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.669+0000 7f6567fff640 1 -- 172.21.15.88:0/3265096875 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655800f040 con 0x7f65700af4c0 2023-12-08T08:20:35.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.669+0000 7f6567fff640 1 -- 172.21.15.88:0/3265096875 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6558014800 con 0x7f65700af4c0 2023-12-08T08:20:35.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.669+0000 7f65754e3640 1 -- 172.21.15.88:0/3265096875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6570152650 con 0x7f65700af4c0 2023-12-08T08:20:35.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.669+0000 7f65754e3640 1 -- 172.21.15.88:0/3265096875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65701f0ba0 con 0x7f65700af4c0 2023-12-08T08:20:35.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.669+0000 7f65754e3640 1 -- 172.21.15.88:0/3265096875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6570067630 con 0x7f65700af4c0 2023-12-08T08:20:35.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.669+0000 7f6567fff640 1 -- 172.21.15.88:0/3265096875 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6558014960 con 0x7f65700af4c0 2023-12-08T08:20:35.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.673+0000 7f6567fff640 1 --2- 172.21.15.88:0/3265096875 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6550066470 0x7f6550068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.673+0000 7f6567fff640 1 -- 172.21.15.88:0/3265096875 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65580848c0 con 0x7f65700af4c0 2023-12-08T08:20:35.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.673+0000 7f656effd640 1 --2- 172.21.15.88:0/3265096875 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6550066470 0x7f6550068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.673+0000 7f656effd640 1 --2- 172.21.15.88:0/3265096875 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6550066470 0x7f6550068930 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f657015f0e0 tx=0x7f6560009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:35.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.677+0000 7f6567fff640 1 -- 172.21.15.88:0/3265096875 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6558051df0 con 0x7f65700af4c0 2023-12-08T08:20:35.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.829+0000 7f65754e3640 1 -- 172.21.15.88:0/3265096875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f657006c7a0 con 0x7f65700af4c0 2023-12-08T08:20:35.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.829+0000 7f6567fff640 1 -- 172.21.15.88:0/3265096875 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7f6558055410 con 0x7f65700af4c0 2023-12-08T08:20:35.836 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:35.836 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:20:21.492555+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:18.675917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:19.511013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:35.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.833+0000 7f65754e3640 1 -- 172.21.15.88:0/3265096875 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6550066470 msgr2=0x7f6550068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.833+0000 7f65754e3640 1 --2- 172.21.15.88:0/3265096875 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6550066470 0x7f6550068930 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f657015f0e0 tx=0x7f6560009040 comp rx=0 tx=0).stop 2023-12-08T08:20:35.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.833+0000 7f65754e3640 1 -- 172.21.15.88:0/3265096875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65700af4c0 msgr2=0x7f65700c00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.833+0000 7f65754e3640 1 --2- 172.21.15.88:0/3265096875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65700af4c0 0x7f65700c00a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f655800efc0 tx=0x7f655800c490 comp rx=0 tx=0).stop 2023-12-08T08:20:35.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.833+0000 7f65754e3640 1 -- 172.21.15.88:0/3265096875 shutdown_connections 2023-12-08T08:20:35.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.833+0000 7f65754e3640 1 --2- 172.21.15.88:0/3265096875 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6550066470 0x7f6550068930 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.833+0000 7f65754e3640 1 --2- 172.21.15.88:0/3265096875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6570154f20 0x7f65700c05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.833+0000 7f65754e3640 1 --2- 172.21.15.88:0/3265096875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65700af4c0 0x7f65700c00a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.833+0000 7f65754e3640 1 --2- 172.21.15.88:0/3265096875 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f657006bf30 0x7f657014fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.833+0000 7f65754e3640 1 -- 172.21.15.88:0/3265096875 >> 172.21.15.88:0/3265096875 conn(0x7f65700ab9d0 msgr2=0x7f65700c8050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:35.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.833+0000 7f65754e3640 1 -- 172.21.15.88:0/3265096875 shutdown_connections 2023-12-08T08:20:35.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.833+0000 7f65754e3640 1 -- 172.21.15.88:0/3265096875 wait complete. 2023-12-08T08:20:35.858 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:20:35.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.989+0000 7fe1eee17640 1 Processor -- start 2023-12-08T08:20:35.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.989+0000 7fe1eee17640 1 -- start start 2023-12-08T08:20:35.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.989+0000 7fe1eee17640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1e806d2b0 0x7fe1e806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.989+0000 7fe1eee17640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe1e80c3b80 0x7fe1e80c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.989+0000 7fe1eee17640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e806bb80 con 0x7fe1e806c020 2023-12-08T08:20:35.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.989+0000 7fe1eee17640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e80c5840 con 0x7fe1e80c3b80 2023-12-08T08:20:35.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.989+0000 7fe1eee17640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e81515c0 con 0x7fe1e806d2b0 2023-12-08T08:20:35.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.989+0000 7fe1dffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe1e80c3b80 0x7fe1e80c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.989+0000 7fe1dffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe1e80c3b80 0x7fe1e80c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41418/0 (socket says 172.21.15.88:41418) 2023-12-08T08:20:35.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.989+0000 7fe1dffff640 1 -- 172.21.15.88:0/2445565984 learned_addr learned my addr 172.21.15.88:0/2445565984 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:35.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.989+0000 7fe1ecbb3640 1 --2- 172.21.15.88:0/2445565984 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1e806d2b0 0x7fe1e806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.989+0000 7fe1dffff640 1 -- 172.21.15.88:0/2445565984 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1e806d2b0 msgr2=0x7fe1e806d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:35.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.989+0000 7fe1dffff640 1 --2- 172.21.15.88:0/2445565984 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1e806d2b0 0x7fe1e806d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.989+0000 7fe1dffff640 1 -- 172.21.15.88:0/2445565984 >> v1:172.21.15.148:6789/0 conn(0x7fe1e806c020 legacy=0x7fe1e806c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:35.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.989+0000 7fe1dffff640 1 -- 172.21.15.88:0/2445565984 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e81518a0 con 0x7fe1e80c3b80 2023-12-08T08:20:35.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.993+0000 7fe1dffff640 1 --2- 172.21.15.88:0/2445565984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1e80c3b80 0x7fe1e80c5300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009870 tx=0x7fe1d801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91ca3e9aa2c330 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:35.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.993+0000 7fe1df7fe640 1 -- 172.21.15.88:0/2445565984 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d80aa670 con 0x7fe1e80c3b80 2023-12-08T08:20:35.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.993+0000 7fe1df7fe640 1 -- 172.21.15.88:0/2445565984 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d80aa7d0 con 0x7fe1e80c3b80 2023-12-08T08:20:35.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.993+0000 7fe1df7fe640 1 -- 172.21.15.88:0/2445565984 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d80aab60 con 0x7fe1e80c3b80 2023-12-08T08:20:36.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.993+0000 7fe1eee17640 1 -- 172.21.15.88:0/2445565984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1e80c3b80 msgr2=0x7fe1e80c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.993+0000 7fe1eee17640 1 --2- 172.21.15.88:0/2445565984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1e80c3b80 0x7fe1e80c5300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009870 tx=0x7fe1d801c510 comp rx=0 tx=0).stop 2023-12-08T08:20:36.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.993+0000 7fe1eee17640 1 -- 172.21.15.88:0/2445565984 shutdown_connections 2023-12-08T08:20:36.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.993+0000 7fe1eee17640 1 --2- 172.21.15.88:0/2445565984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1e80c3b80 0x7fe1e80c5300 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.993+0000 7fe1eee17640 1 --2- 172.21.15.88:0/2445565984 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1e806d2b0 0x7fe1e806d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.993+0000 7fe1eee17640 1 -- 172.21.15.88:0/2445565984 >> 172.21.15.88:0/2445565984 conn(0x7fe1e80a7810 msgr2=0x7fe1e80a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:36.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.993+0000 7fe1eee17640 1 -- 172.21.15.88:0/2445565984 shutdown_connections 2023-12-08T08:20:36.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.993+0000 7fe1eee17640 1 -- 172.21.15.88:0/2445565984 wait complete. 2023-12-08T08:20:36.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.997+0000 7fe1eee17640 1 Processor -- start 2023-12-08T08:20:36.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.997+0000 7fe1eee17640 1 -- start start 2023-12-08T08:20:36.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.997+0000 7fe1eee17640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1e806c020 0x7fe1e814bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.997+0000 7fe1eee17640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1e806d2b0 0x7fe1e814c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.997+0000 7fe1eee17640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1e80c3b80 0x7fe1e80a8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.997+0000 7fe1eee17640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e8156dc0 con 0x7fe1e80c3b80 2023-12-08T08:20:36.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.997+0000 7fe1eee17640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e81f0c10 con 0x7fe1e806d2b0 2023-12-08T08:20:36.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.997+0000 7fe1eee17640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e814f3c0 con 0x7fe1e806c020 2023-12-08T08:20:36.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.997+0000 7fe1ed3b4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1e80c3b80 0x7fe1e80a8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.997+0000 7fe1ecbb3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1e806c020 0x7fe1e814bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.997+0000 7fe1ecbb3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1e806c020 0x7fe1e814bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:60266/0 (socket says 172.21.15.88:60266) 2023-12-08T08:20:36.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.997+0000 7fe1ed3b4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1e80c3b80 0x7fe1e80a8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41432/0 (socket says 172.21.15.88:41432) 2023-12-08T08:20:36.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.997+0000 7fe1ecbb3640 1 -- 172.21.15.88:0/1575136861 learned_addr learned my addr 172.21.15.88:0/1575136861 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:36.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.997+0000 7fe1dffff640 1 --2- 172.21.15.88:0/1575136861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1e806d2b0 0x7fe1e814c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.997+0000 7fe1ed3b4640 1 -- 172.21.15.88:0/1575136861 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1e806c020 msgr2=0x7fe1e814bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.997+0000 7fe1ed3b4640 1 --2- 172.21.15.88:0/1575136861 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1e806c020 0x7fe1e814bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.997+0000 7fe1ed3b4640 1 -- 172.21.15.88:0/1575136861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1e806d2b0 msgr2=0x7fe1e814c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.997+0000 7fe1ed3b4640 1 --2- 172.21.15.88:0/1575136861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1e806d2b0 0x7fe1e814c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.997+0000 7fe1ed3b4640 1 -- 172.21.15.88:0/1575136861 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d80094d0 con 0x7fe1e80c3b80 2023-12-08T08:20:36.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.997+0000 7fe1ecbb3640 1 --2- 172.21.15.88:0/1575136861 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1e806c020 0x7fe1e814bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:36.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.997+0000 7fe1ed3b4640 1 --2- 172.21.15.88:0/1575136861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1e80c3b80 0x7fe1e80a8ed0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000c700 tx=0x7fe1e000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:36.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.997+0000 7fe1dd7fa640 1 -- 172.21.15.88:0/1575136861 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0003b80 con 0x7fe1e80c3b80 2023-12-08T08:20:36.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.997+0000 7fe1dd7fa640 1 -- 172.21.15.88:0/1575136861 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e0003ce0 con 0x7fe1e80c3b80 2023-12-08T08:20:36.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.997+0000 7fe1dd7fa640 1 -- 172.21.15.88:0/1575136861 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0005310 con 0x7fe1e80c3b80 2023-12-08T08:20:36.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.997+0000 7fe1eee17640 1 -- 172.21.15.88:0/1575136861 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e814ef80 con 0x7fe1e80c3b80 2023-12-08T08:20:36.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:35.997+0000 7fe1eee17640 1 -- 172.21.15.88:0/1575136861 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e814f980 con 0x7fe1e80c3b80 2023-12-08T08:20:36.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.001+0000 7fe1eee17640 1 -- 172.21.15.88:0/1575136861 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e814fb70 con 0x7fe1e80c3b80 2023-12-08T08:20:36.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.001+0000 7fe1dd7fa640 1 -- 172.21.15.88:0/1575136861 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe1e0005470 con 0x7fe1e80c3b80 2023-12-08T08:20:36.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.001+0000 7fe1dd7fa640 1 --2- 172.21.15.88:0/1575136861 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe1d4066470 0x7fe1d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.001+0000 7fe1dd7fa640 1 -- 172.21.15.88:0/1575136861 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1e0083a10 con 0x7fe1e80c3b80 2023-12-08T08:20:36.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.001+0000 7fe1ecbb3640 1 --2- 172.21.15.88:0/1575136861 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe1d4066470 0x7fe1d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.001+0000 7fe1ecbb3640 1 --2- 172.21.15.88:0/1575136861 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe1d4066470 0x7fe1d4068930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4007f00 tx=0x7fe1e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:36.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.005+0000 7fe1dd7fa640 1 -- 172.21.15.88:0/1575136861 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe1e0050f30 con 0x7fe1e80c3b80 2023-12-08T08:20:36.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.189+0000 7fe1eee17640 1 -- 172.21.15.88:0/1575136861 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1e8067630 con 0x7fe1e80c3b80 2023-12-08T08:20:36.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.189+0000 7fe1dd7fa640 1 -- 172.21.15.88:0/1575136861 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4910 (secure 0 0 0) 0x7fe1e0054550 con 0x7fe1e80c3b80 2023-12-08T08:20:36.195 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:36.195 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/1946795737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":1946795737},{"type":"v1","addr":"172.21.15.88:6837","nonce":1946795737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/140150927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":140150927},{"type":"v1","addr":"172.21.15.148:6834","nonce":140150927}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2399327235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2399327235},{"type":"v1","addr":"172.21.15.148:6835","nonce":2399327235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:20:20.479364+0000","modified":"2023-12-08T08:20:23.493737+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/3793971563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":3793971563},{"type":"v1","addr":"172.21.15.88:6835","nonce":3793971563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T08:20:36.195 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 8 2023-12-08T08:20:36.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.189+0000 7fe1eee17640 1 -- 172.21.15.88:0/1575136861 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe1d4066470 msgr2=0x7fe1d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.189+0000 7fe1eee17640 1 --2- 172.21.15.88:0/1575136861 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe1d4066470 0x7fe1d4068930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4007f00 tx=0x7fe1e4008040 comp rx=0 tx=0).stop 2023-12-08T08:20:36.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.189+0000 7fe1eee17640 1 -- 172.21.15.88:0/1575136861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1e80c3b80 msgr2=0x7fe1e80a8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.189+0000 7fe1eee17640 1 --2- 172.21.15.88:0/1575136861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1e80c3b80 0x7fe1e80a8ed0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000c700 tx=0x7fe1e000cbc0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.189+0000 7fe1eee17640 1 -- 172.21.15.88:0/1575136861 shutdown_connections 2023-12-08T08:20:36.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.189+0000 7fe1eee17640 1 --2- 172.21.15.88:0/1575136861 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe1d4066470 0x7fe1d4068930 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.189+0000 7fe1eee17640 1 --2- 172.21.15.88:0/1575136861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1e80c3b80 0x7fe1e80a8ed0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.189+0000 7fe1eee17640 1 --2- 172.21.15.88:0/1575136861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1e806d2b0 0x7fe1e814c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.189+0000 7fe1eee17640 1 --2- 172.21.15.88:0/1575136861 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe1e806c020 0x7fe1e814bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.189+0000 7fe1eee17640 1 -- 172.21.15.88:0/1575136861 >> 172.21.15.88:0/1575136861 conn(0x7fe1e80a7810 msgr2=0x7fe1e806d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:36.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.193+0000 7fe1eee17640 1 -- 172.21.15.88:0/1575136861 shutdown_connections 2023-12-08T08:20:36.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.193+0000 7fe1eee17640 1 -- 172.21.15.88:0/1575136861 wait complete. 2023-12-08T08:20:36.619 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-08T08:20:20.479364+0000', 'modified': '2023-12-08T08:20:23.493737+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4287}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4287': {'gid': 4287, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.88:6835/3793971563', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6834', 'nonce': 3793971563}, {'type': 'v1', 'addr': '172.21.15.88:6835', 'nonce': 3793971563}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-08T08:20:36.619 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-08T08:20:36.619 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-08T08:20:36.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.753+0000 7fc23ac68640 1 Processor -- start 2023-12-08T08:20:36.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.753+0000 7fc23ac68640 1 -- start start 2023-12-08T08:20:36.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.753+0000 7fc23ac68640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc234152d30 0x7fc23415cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.753+0000 7fc23ac68640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc2340c3930 0x7fc23406d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.753+0000 7fc23ac68640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc23415c710 con 0x7fc2340c3d90 2023-12-08T08:20:36.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.753+0000 7fc23ac68640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc23406c360 con 0x7fc2340c3930 2023-12-08T08:20:36.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.753+0000 7fc23ac68640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2340aa820 con 0x7fc234152d30 2023-12-08T08:20:36.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.753+0000 7fc233fff640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc2340c3930 0x7fc23406d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.753+0000 7fc238a04640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc234152d30 0x7fc23415cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.753+0000 7fc239205640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc2340c3d90 0x7fc2340a9af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:57774/0 (socket says 172.21.15.88:57774) 2023-12-08T08:20:36.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.753+0000 7fc239205640 1 -- 172.21.15.88:0/4210701954 learned_addr learned my addr 172.21.15.88:0/4210701954 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:36.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.757+0000 7fc233fff640 1 -- 172.21.15.88:0/4210701954 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc234152d30 msgr2=0x7fc23415cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:36.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.757+0000 7fc233fff640 1 --2- 172.21.15.88:0/4210701954 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc234152d30 0x7fc23415cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.757+0000 7fc233fff640 1 -- 172.21.15.88:0/4210701954 >> v1:172.21.15.148:6789/0 conn(0x7fc2340c3d90 legacy=0x7fc2340a9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.757+0000 7fc233fff640 1 -- 172.21.15.88:0/4210701954 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23415c0c0 con 0x7fc2340c3930 2023-12-08T08:20:36.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.757+0000 7fc238a04640 1 --2- 172.21.15.88:0/4210701954 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc234152d30 0x7fc23415cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:36.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.757+0000 7fc233fff640 1 --2- 172.21.15.88:0/4210701954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2340c3930 0x7fc23406d160 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc2200097c0 tx=0x7fc22001c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40c89734df5cdbb9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:36.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.757+0000 7fc2337fe640 1 -- 172.21.15.88:0/4210701954 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2200ab600 con 0x7fc2340c3930 2023-12-08T08:20:36.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.757+0000 7fc2337fe640 1 -- 172.21.15.88:0/4210701954 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2200a7050 con 0x7fc2340c3930 2023-12-08T08:20:36.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.757+0000 7fc2337fe640 1 -- 172.21.15.88:0/4210701954 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2200ab980 con 0x7fc2340c3930 2023-12-08T08:20:36.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.761+0000 7fc23ac68640 1 -- 172.21.15.88:0/4210701954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2340c3930 msgr2=0x7fc23406d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.761+0000 7fc23ac68640 1 --2- 172.21.15.88:0/4210701954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2340c3930 0x7fc23406d160 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc2200097c0 tx=0x7fc22001c310 comp rx=0 tx=0).stop 2023-12-08T08:20:36.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.761+0000 7fc23ac68640 1 -- 172.21.15.88:0/4210701954 shutdown_connections 2023-12-08T08:20:36.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.761+0000 7fc23ac68640 1 --2- 172.21.15.88:0/4210701954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2340c3930 0x7fc23406d160 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.761+0000 7fc23ac68640 1 --2- 172.21.15.88:0/4210701954 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc234152d30 0x7fc23415cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.761+0000 7fc23ac68640 1 -- 172.21.15.88:0/4210701954 >> 172.21.15.88:0/4210701954 conn(0x7fc23406b220 msgr2=0x7fc2340a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:36.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.761+0000 7fc23ac68640 1 -- 172.21.15.88:0/4210701954 shutdown_connections 2023-12-08T08:20:36.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.761+0000 7fc23ac68640 1 -- 172.21.15.88:0/4210701954 wait complete. 2023-12-08T08:20:36.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.761+0000 7fc23ac68640 1 Processor -- start 2023-12-08T08:20:36.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.761+0000 7fc23ac68640 1 -- start start 2023-12-08T08:20:36.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.761+0000 7fc23ac68640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc2340c3930 0x7fc2340a9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.761+0000 7fc23ac68640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2340c3d90 0x7fc234151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.761+0000 7fc23ac68640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc234152d30 0x7fc234152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.761+0000 7fc23ac68640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2341527d0 con 0x7fc2340c3d90 2023-12-08T08:20:36.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.761+0000 7fc23ac68640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc234072b30 con 0x7fc234152d30 2023-12-08T08:20:36.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.761+0000 7fc23ac68640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2341ee790 con 0x7fc2340c3930 2023-12-08T08:20:36.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.761+0000 7fc233fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2340c3d90 0x7fc234151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.761+0000 7fc233fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2340c3d90 0x7fc234151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41442/0 (socket says 172.21.15.88:41442) 2023-12-08T08:20:36.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.761+0000 7fc233fff640 1 -- 172.21.15.88:0/1137609759 learned_addr learned my addr 172.21.15.88:0/1137609759 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:36.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.761+0000 7fc238a04640 1 --2- 172.21.15.88:0/1137609759 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc2340c3930 0x7fc2340a9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.761+0000 7fc239205640 1 --2- 172.21.15.88:0/1137609759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc234152d30 0x7fc234152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.761+0000 7fc233fff640 1 -- 172.21.15.88:0/1137609759 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc2340c3930 msgr2=0x7fc2340a9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.761+0000 7fc233fff640 1 --2- 172.21.15.88:0/1137609759 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc2340c3930 0x7fc2340a9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.761+0000 7fc233fff640 1 -- 172.21.15.88:0/1137609759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc234152d30 msgr2=0x7fc234152290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.761+0000 7fc233fff640 1 --2- 172.21.15.88:0/1137609759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc234152d30 0x7fc234152290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.761+0000 7fc233fff640 1 -- 172.21.15.88:0/1137609759 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc228009420 con 0x7fc2340c3d90 2023-12-08T08:20:36.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.765+0000 7fc233fff640 1 --2- 172.21.15.88:0/1137609759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2340c3d90 0x7fc234151d50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc22001a9c0 tx=0x7fc2200190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:36.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.765+0000 7fc2317fa640 1 -- 172.21.15.88:0/1137609759 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2200b4820 con 0x7fc2340c3d90 2023-12-08T08:20:36.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.765+0000 7fc2317fa640 1 -- 172.21.15.88:0/1137609759 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2200b4980 con 0x7fc2340c3d90 2023-12-08T08:20:36.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.765+0000 7fc2317fa640 1 -- 172.21.15.88:0/1137609759 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2200b4d30 con 0x7fc2340c3d90 2023-12-08T08:20:36.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.765+0000 7fc23ac68640 1 -- 172.21.15.88:0/1137609759 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc220009420 con 0x7fc2340c3d90 2023-12-08T08:20:36.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.765+0000 7fc23ac68640 1 -- 172.21.15.88:0/1137609759 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc234155a00 con 0x7fc2340c3d90 2023-12-08T08:20:36.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.765+0000 7fc2317fa640 1 -- 172.21.15.88:0/1137609759 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc2200b2040 con 0x7fc2340c3d90 2023-12-08T08:20:36.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.765+0000 7fc2317fa640 1 --2- 172.21.15.88:0/1137609759 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc218066470 0x7fc218068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.765+0000 7fc2317fa640 1 -- 172.21.15.88:0/1137609759 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc22011e390 con 0x7fc2340c3d90 2023-12-08T08:20:36.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.765+0000 7fc238a04640 1 --2- 172.21.15.88:0/1137609759 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc218066470 0x7fc218068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.765+0000 7fc23dfc5000 1 Processor -- start 2023-12-08T08:20:36.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc23dfc5000 1 -- start start 2023-12-08T08:20:36.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc238a04640 1 --2- 172.21.15.88:0/1137609759 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc218066470 0x7fc218068930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc228009c50 tx=0x7fc228009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:36.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc23dfc5000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564523f9b2e0 0x564523f9b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc23dfc5000 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564523f9bc00 0x564523f9bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc23dfc5000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9c520 0x564523fe5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc23dfc5000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x564523e08130 con 0x564523f9c520 2023-12-08T08:20:36.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc23dfc5000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x564523df59a0 con 0x564523f9b2e0 2023-12-08T08:20:36.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc23dfc5000 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x564523df2ed0 con 0x564523f9bc00 2023-12-08T08:20:36.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc239205640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9c520 0x564523fe5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc239205640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9c520 0x564523fe5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41444/0 (socket says 172.21.15.88:41444) 2023-12-08T08:20:36.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc239205640 1 -- 172.21.15.88:0/1423737455 learned_addr learned my addr 172.21.15.88:0/1423737455 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:36.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc238a04640 1 --2- 172.21.15.88:0/1423737455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564523f9b2e0 0x564523f9b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc233fff640 1 --2- 172.21.15.88:0/1423737455 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564523f9bc00 0x564523f9bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc239205640 1 -- 172.21.15.88:0/1423737455 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564523f9bc00 msgr2=0x564523f9bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:36.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc239205640 1 --2- 172.21.15.88:0/1423737455 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564523f9bc00 0x564523f9bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc239205640 1 -- 172.21.15.88:0/1423737455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564523f9b2e0 msgr2=0x564523f9b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:36.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc239205640 1 --2- 172.21.15.88:0/1423737455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564523f9b2e0 0x564523f9b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc239205640 1 -- 172.21.15.88:0/1423737455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564523ae6890 con 0x564523f9c520 2023-12-08T08:20:36.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc239205640 1 --2- 172.21.15.88:0/1423737455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9c520 0x564523fe5a30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00cad0 tx=0x7fc22c00c1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f37499ef0b8c24 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:36.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc21e7fc640 1 -- 172.21.15.88:0/1423737455 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c0099c0 con 0x564523f9c520 2023-12-08T08:20:36.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc21e7fc640 1 -- 172.21.15.88:0/1423737455 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22c009b20 con 0x564523f9c520 2023-12-08T08:20:36.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc21e7fc640 1 -- 172.21.15.88:0/1423737455 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c015610 con 0x564523f9c520 2023-12-08T08:20:36.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc23dfc5000 1 -- 172.21.15.88:0/1423737455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9c520 msgr2=0x564523fe5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc23dfc5000 1 --2- 172.21.15.88:0/1423737455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9c520 0x564523fe5a30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00cad0 tx=0x7fc22c00c1c0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc23dfc5000 1 -- 172.21.15.88:0/1423737455 shutdown_connections 2023-12-08T08:20:36.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc23dfc5000 1 --2- 172.21.15.88:0/1423737455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9c520 0x564523fe5a30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc23dfc5000 1 --2- 172.21.15.88:0/1423737455 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564523f9bc00 0x564523f9bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc23dfc5000 1 --2- 172.21.15.88:0/1423737455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564523f9b2e0 0x564523f9b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc23dfc5000 1 -- 172.21.15.88:0/1423737455 >> 172.21.15.88:0/1423737455 conn(0x564523fa4190 msgr2=0x564523fdb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:36.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc23dfc5000 1 -- 172.21.15.88:0/1423737455 shutdown_connections 2023-12-08T08:20:36.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc23dfc5000 1 -- 172.21.15.88:0/1423737455 wait complete. 2023-12-08T08:20:36.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc23dfc5000 1 -- start start 2023-12-08T08:20:36.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.769+0000 7fc23dfc5000 1 Processor -- start 2023-12-08T08:20:36.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc23dfc5000 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564523f9b2e0 0x564523fd8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc23dfc5000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564523f9bc00 0x564523fa1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc23dfc5000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9c520 0x564523fa2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc23dfc5000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x564523dee7c0 con 0x564523f9c520 2023-12-08T08:20:36.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc23dfc5000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x564523da6bf0 con 0x564523f9bc00 2023-12-08T08:20:36.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc23dfc5000 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x564523daca90 con 0x564523f9b2e0 2023-12-08T08:20:36.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc23dfc5000 10 client.0 _ll_register_callbacks cb 0x564523f893c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T08:20:36.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc239205640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9c520 0x564523fa2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc239205640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9c520 0x564523fa2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41460/0 (socket says 172.21.15.88:41460) 2023-12-08T08:20:36.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc239205640 1 -- 172.21.15.88:0/3973614418 learned_addr learned my addr 172.21.15.88:0/3973614418 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:36.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc238a04640 1 --2- 172.21.15.88:0/3973614418 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564523f9b2e0 0x564523fd8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc233fff640 1 --2- 172.21.15.88:0/3973614418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564523f9bc00 0x564523fa1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc239205640 1 -- 172.21.15.88:0/3973614418 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564523f9b2e0 msgr2=0x564523fd8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:36.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc239205640 1 --2- 172.21.15.88:0/3973614418 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564523f9b2e0 0x564523fd8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc239205640 1 -- 172.21.15.88:0/3973614418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564523f9bc00 msgr2=0x564523fa1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:36.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc239205640 1 --2- 172.21.15.88:0/3973614418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564523f9bc00 0x564523fa1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc239205640 1 -- 172.21.15.88:0/3973614418 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc22c00c7c0 con 0x564523f9c520 2023-12-08T08:20:36.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc239205640 1 --2- 172.21.15.88:0/3973614418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9c520 0x564523fa2040 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0094e0 tx=0x7fc22c005b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bcd5bd5bf5b7c71 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:36.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc2137fe640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-12-08T08:20:36.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc2137fe640 1 -- 172.21.15.88:0/3973614418 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c015db0 con 0x564523f9c520 2023-12-08T08:20:36.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc2137fe640 1 -- 172.21.15.88:0/3973614418 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc22c02a470 con 0x564523f9c520 2023-12-08T08:20:36.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc23dfc5000 1 -- 172.21.15.88:0/3973614418 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564523db0470 con 0x564523f9c520 2023-12-08T08:20:36.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc2137fe640 1 -- 172.21.15.88:0/3973614418 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc22c02a670 con 0x564523f9c520 2023-12-08T08:20:36.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc23dfc5000 10 client.4701 fetch_fsmap learned FSMap version 8 2023-12-08T08:20:36.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc23dfc5000 1 -- 172.21.15.88:0/3973614418 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x564523daf190 con 0x564523f9c520 2023-12-08T08:20:36.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc2137fe640 1 -- 172.21.15.88:0/3973614418 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564523db0470 con 0x564523f9c520 2023-12-08T08:20:36.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc2137fe640 1 -- 172.21.15.88:0/3973614418 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc22c014070 con 0x564523f9c520 2023-12-08T08:20:36.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc23dfc5000 10 client.4701 fetch_fsmap finished waiting for FSMap version 8 2023-12-08T08:20:36.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc23dfc5000 10 client.4701 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-08T08:20:36.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc23dfc5000 20 client.4701 populate_metadata read hostname 'smithi088' 2023-12-08T08:20:36.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc23dfc5000 1 --2- 172.21.15.88:0/3973614418 >> [v2:172.21.15.88:6834/3793971563,v1:172.21.15.88:6835/3793971563] conn(0x564523fa2a50 0x564523fa2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc23dfc5000 4 client.4701 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-08T08:20:36.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc23dfc5000 1 -- 172.21.15.88:0/3973614418 --> [v2:172.21.15.88:6834/3793971563,v1:172.21.15.88:6835/3793971563] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564523db3b50 con 0x564523fa2a50 2023-12-08T08:20:36.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc238a04640 1 --2- 172.21.15.88:0/3973614418 >> [v2:172.21.15.88:6834/3793971563,v1:172.21.15.88:6835/3793971563] conn(0x564523fa2a50 0x564523fa2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc2137fe640 10 client.4701 ms_handle_connect on v2:172.21.15.88:6834/3793971563 2023-12-08T08:20:36.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.773+0000 7fc238a04640 1 --2- 172.21.15.88:0/3973614418 >> [v2:172.21.15.88:6834/3793971563,v1:172.21.15.88:6835/3793971563] conn(0x564523fa2a50 0x564523fa2e30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a534f7b1dc136cc server_cookie=782b94a189a95eb1 in_seq=0 out_seq=0 2023-12-08T08:20:36.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.777+0000 7fc2137fe640 1 -- 172.21.15.88:0/3973614418 <== mds.0 v2:172.21.15.88:6834/3793971563 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x564523db3b50 con 0x564523fa2a50 2023-12-08T08:20:36.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.777+0000 7fc2137fe640 10 client.4701 handle_command_reply: tid=0 2023-12-08T08:20:36.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.777+0000 7fc23dfc5000 1 client.4701 shutdown 2023-12-08T08:20:36.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.777+0000 7fc23dfc5000 1 -- 172.21.15.88:0/3973614418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9c520 msgr2=0x564523fa2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.777+0000 7fc23dfc5000 1 --2- 172.21.15.88:0/3973614418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9c520 0x564523fa2040 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0094e0 tx=0x7fc22c005b80 comp rx=0 tx=0).stop 2023-12-08T08:20:36.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.777+0000 7fc23dfc5000 1 -- 172.21.15.88:0/3973614418 shutdown_connections 2023-12-08T08:20:36.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.777+0000 7fc23dfc5000 1 --2- 172.21.15.88:0/3973614418 >> [v2:172.21.15.88:6834/3793971563,v1:172.21.15.88:6835/3793971563] conn(0x564523fa2a50 0x564523fa2e30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.777+0000 7fc23dfc5000 1 --2- 172.21.15.88:0/3973614418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9c520 0x564523fa2040 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.777+0000 7fc23dfc5000 1 --2- 172.21.15.88:0/3973614418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564523f9bc00 0x564523fa1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.777+0000 7fc23dfc5000 1 --2- 172.21.15.88:0/3973614418 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564523f9b2e0 0x564523fd8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.777+0000 7fc2137fe640 0 client.4701 ms_handle_reset on v2:172.21.15.88:6834/3793971563 2023-12-08T08:20:36.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.777+0000 7fc23dfc5000 1 -- 172.21.15.88:0/3973614418 >> 172.21.15.88:0/3973614418 conn(0x564523fa4190 msgr2=0x564523f9a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:36.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.777+0000 7fc23dfc5000 1 -- 172.21.15.88:0/3973614418 shutdown_connections 2023-12-08T08:20:36.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.777+0000 7fc23dfc5000 1 -- 172.21.15.88:0/3973614418 wait complete. 2023-12-08T08:20:36.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.777+0000 7fc23dfc5000 20 client.4701 trim_cache size 0 max 16384 2023-12-08T08:20:36.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc23dfc5000 1 Processor -- start 2023-12-08T08:20:36.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc23dfc5000 1 -- start start 2023-12-08T08:20:36.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc23dfc5000 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564523f9b2e0 0x564523ff6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc23dfc5000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9bc00 0x564523fa18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc23dfc5000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564523f9c520 0x564523fa1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc23dfc5000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x564523aa7940 con 0x564523f9bc00 2023-12-08T08:20:36.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc23dfc5000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x564523ae71b0 con 0x564523f9c520 2023-12-08T08:20:36.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc23dfc5000 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x564523dece40 con 0x564523f9b2e0 2023-12-08T08:20:36.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc233fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9bc00 0x564523fa18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc233fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9bc00 0x564523fa18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41462/0 (socket says 172.21.15.88:41462) 2023-12-08T08:20:36.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc233fff640 1 -- 172.21.15.88:0/3225594069 learned_addr learned my addr 172.21.15.88:0/3225594069 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:36.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc233fff640 1 -- 172.21.15.88:0/3225594069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564523f9b2e0 msgr2=0x564523ff6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:36.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc233fff640 1 --2- 172.21.15.88:0/3225594069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564523f9b2e0 0x564523ff6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc233fff640 1 -- 172.21.15.88:0/3225594069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564523f9c520 msgr2=0x564523fa1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:36.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc233fff640 1 --2- 172.21.15.88:0/3225594069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564523f9c520 0x564523fa1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc233fff640 1 -- 172.21.15.88:0/3225594069 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564523d95490 con 0x564523f9bc00 2023-12-08T08:20:36.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc233fff640 1 --2- 172.21.15.88:0/3225594069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9bc00 0x564523fa18b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc2200eba70 tx=0x7fc2200eef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731749e92f8f56a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:36.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc21effd640 1 -- 172.21.15.88:0/3225594069 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2200f77c0 con 0x564523f9bc00 2023-12-08T08:20:36.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc21effd640 1 -- 172.21.15.88:0/3225594069 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2200b4e90 con 0x564523f9bc00 2023-12-08T08:20:36.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc21effd640 1 -- 172.21.15.88:0/3225594069 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22011e0b0 con 0x564523f9bc00 2023-12-08T08:20:36.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc23dfc5000 1 -- 172.21.15.88:0/3225594069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9bc00 msgr2=0x564523fa18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc23dfc5000 1 --2- 172.21.15.88:0/3225594069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9bc00 0x564523fa18b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc2200eba70 tx=0x7fc2200eef90 comp rx=0 tx=0).stop 2023-12-08T08:20:36.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc23dfc5000 1 -- 172.21.15.88:0/3225594069 shutdown_connections 2023-12-08T08:20:36.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc23dfc5000 1 --2- 172.21.15.88:0/3225594069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564523f9c520 0x564523fa1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc23dfc5000 1 --2- 172.21.15.88:0/3225594069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9bc00 0x564523fa18b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc23dfc5000 1 --2- 172.21.15.88:0/3225594069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564523f9b2e0 0x564523ff6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc23dfc5000 1 -- 172.21.15.88:0/3225594069 >> 172.21.15.88:0/3225594069 conn(0x564523fa4190 msgr2=0x564523fa2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:36.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc23dfc5000 1 -- 172.21.15.88:0/3225594069 shutdown_connections 2023-12-08T08:20:36.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc23dfc5000 1 -- 172.21.15.88:0/3225594069 wait complete. 2023-12-08T08:20:36.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc23dfc5000 1 -- start start 2023-12-08T08:20:36.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.793+0000 7fc23dfc5000 1 Processor -- start 2023-12-08T08:20:36.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564523f9b2e0 0x564523ff23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564523f9bc00 0x564523ff2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9c520 0x564523ff2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x564523e30140 con 0x564523f9c520 2023-12-08T08:20:36.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x564523da3760 con 0x564523f9b2e0 2023-12-08T08:20:36.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x564523e75fa0 con 0x564523f9bc00 2023-12-08T08:20:36.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 10 client.0 _ll_register_callbacks cb 0x564523f69bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T08:20:36.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc239205640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9c520 0x564523ff2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc239205640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9c520 0x564523ff2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41466/0 (socket says 172.21.15.88:41466) 2023-12-08T08:20:36.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc239205640 1 -- 172.21.15.88:0/2670398722 learned_addr learned my addr 172.21.15.88:0/2670398722 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:36.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc238a04640 1 --2- 172.21.15.88:0/2670398722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564523f9b2e0 0x564523ff23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc233fff640 1 --2- 172.21.15.88:0/2670398722 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564523f9bc00 0x564523ff2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc239205640 1 -- 172.21.15.88:0/2670398722 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564523f9bc00 msgr2=0x564523ff2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:36.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc239205640 1 --2- 172.21.15.88:0/2670398722 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564523f9bc00 0x564523ff2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc239205640 1 -- 172.21.15.88:0/2670398722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564523f9b2e0 msgr2=0x564523ff23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:36.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc239205640 1 --2- 172.21.15.88:0/2670398722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564523f9b2e0 0x564523ff23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc239205640 1 -- 172.21.15.88:0/2670398722 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc234155a00 con 0x564523f9c520 2023-12-08T08:20:36.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc238a04640 1 --2- 172.21.15.88:0/2670398722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564523f9b2e0 0x564523ff23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:36.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc233fff640 1 --2- 172.21.15.88:0/2670398722 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564523f9bc00 0x564523ff2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:36.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc239205640 1 --2- 172.21.15.88:0/2670398722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9c520 0x564523ff2e40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc22c02ad20 tx=0x7fc22c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c19883d2818e296b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:36.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc2137fe640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-12-08T08:20:36.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc2137fe640 1 -- 172.21.15.88:0/2670398722 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c00c4e0 con 0x564523f9c520 2023-12-08T08:20:36.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc2137fe640 1 -- 172.21.15.88:0/2670398722 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc22c02a820 con 0x564523f9c520 2023-12-08T08:20:36.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 1 -- 172.21.15.88:0/2670398722 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564523ded110 con 0x564523f9c520 2023-12-08T08:20:36.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc2137fe640 1 -- 172.21.15.88:0/2670398722 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc22c00c640 con 0x564523f9c520 2023-12-08T08:20:36.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 10 client.4707 fetch_fsmap learned FSMap version 8 2023-12-08T08:20:36.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 1 -- 172.21.15.88:0/2670398722 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x564523ae6cc0 con 0x564523f9c520 2023-12-08T08:20:36.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc2137fe640 1 -- 172.21.15.88:0/2670398722 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564523ded110 con 0x564523f9c520 2023-12-08T08:20:36.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc2137fe640 1 -- 172.21.15.88:0/2670398722 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc22c014040 con 0x564523f9c520 2023-12-08T08:20:36.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 10 client.4707 fetch_fsmap finished waiting for FSMap version 8 2023-12-08T08:20:36.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 10 client.4707 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-08T08:20:36.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 20 client.4707 populate_metadata read hostname 'smithi088' 2023-12-08T08:20:36.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 1 --2- 172.21.15.88:0/2670398722 >> [v2:172.21.15.88:6834/3793971563,v1:172.21.15.88:6835/3793971563] conn(0x564523ff37a0 0x564524048b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 4 client.4707 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-08T08:20:36.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 1 -- 172.21.15.88:0/2670398722 --> [v2:172.21.15.88:6834/3793971563,v1:172.21.15.88:6835/3793971563] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564523e1c9a0 con 0x564523ff37a0 2023-12-08T08:20:36.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc238a04640 1 --2- 172.21.15.88:0/2670398722 >> [v2:172.21.15.88:6834/3793971563,v1:172.21.15.88:6835/3793971563] conn(0x564523ff37a0 0x564524048b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc238a04640 1 --2- 172.21.15.88:0/2670398722 >> [v2:172.21.15.88:6834/3793971563,v1:172.21.15.88:6835/3793971563] conn(0x564523ff37a0 0x564524048b40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=231b26580a78c4bf server_cookie=40d84f126efe5a50 in_seq=0 out_seq=0 2023-12-08T08:20:36.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc2137fe640 10 client.4707 ms_handle_connect on v2:172.21.15.88:6834/3793971563 2023-12-08T08:20:36.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc2137fe640 1 -- 172.21.15.88:0/2670398722 <== mds.0 v2:172.21.15.88:6834/3793971563 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x564523e1c9a0 con 0x564523ff37a0 2023-12-08T08:20:36.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc2137fe640 10 client.4707 handle_command_reply: tid=0 2023-12-08T08:20:36.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 1 client.4707 shutdown 2023-12-08T08:20:36.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 1 -- 172.21.15.88:0/2670398722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9c520 msgr2=0x564523ff2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 1 --2- 172.21.15.88:0/2670398722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9c520 0x564523ff2e40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc22c02ad20 tx=0x7fc22c001260 comp rx=0 tx=0).stop 2023-12-08T08:20:36.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 1 -- 172.21.15.88:0/2670398722 shutdown_connections 2023-12-08T08:20:36.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 1 --2- 172.21.15.88:0/2670398722 >> [v2:172.21.15.88:6834/3793971563,v1:172.21.15.88:6835/3793971563] conn(0x564523ff37a0 0x564524048b40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 1 --2- 172.21.15.88:0/2670398722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564523f9c520 0x564523ff2e40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 1 --2- 172.21.15.88:0/2670398722 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x564523f9bc00 0x564523ff2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc2137fe640 0 client.4707 ms_handle_reset on v2:172.21.15.88:6834/3793971563 2023-12-08T08:20:36.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 1 --2- 172.21.15.88:0/2670398722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564523f9b2e0 0x564523ff23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 1 -- 172.21.15.88:0/2670398722 >> 172.21.15.88:0/2670398722 conn(0x564523fa4190 msgr2=0x564523f99a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:36.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 1 -- 172.21.15.88:0/2670398722 shutdown_connections 2023-12-08T08:20:36.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 1 -- 172.21.15.88:0/2670398722 wait complete. 2023-12-08T08:20:36.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.797+0000 7fc23dfc5000 20 client.4707 trim_cache size 0 max 16384 2023-12-08T08:20:36.809 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-08T08:20:36.809 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_fsid": "681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3", 2023-12-08T08:20:36.809 INFO:teuthology.orchestra.run.smithi088.stdout: "whoami": 0, 2023-12-08T08:20:36.809 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4287, 2023-12-08T08:20:36.809 INFO:teuthology.orchestra.run.smithi088.stdout: "want_state": "up:active", 2023-12-08T08:20:36.809 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "up:active", 2023-12-08T08:20:36.809 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs", 2023-12-08T08:20:36.809 INFO:teuthology.orchestra.run.smithi088.stdout: "rank_uptime": 15.692340482000001, 2023-12-08T08:20:36.809 INFO:teuthology.orchestra.run.smithi088.stdout: "mdsmap_epoch": 8, 2023-12-08T08:20:36.809 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch": 20, 2023-12-08T08:20:36.809 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch_barrier": 20, 2023-12-08T08:20:36.810 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 22.750936437 2023-12-08T08:20:36.810 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-08T08:20:36.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.801+0000 7fc23ac68640 1 -- 172.21.15.88:0/1137609759 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc218066470 msgr2=0x7fc218068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.801+0000 7fc23ac68640 1 --2- 172.21.15.88:0/1137609759 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc218066470 0x7fc218068930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc228009c50 tx=0x7fc228009190 comp rx=0 tx=0).stop 2023-12-08T08:20:36.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.801+0000 7fc23ac68640 1 -- 172.21.15.88:0/1137609759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2340c3d90 msgr2=0x7fc234151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.801+0000 7fc23ac68640 1 --2- 172.21.15.88:0/1137609759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2340c3d90 0x7fc234151d50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc22001a9c0 tx=0x7fc2200190b0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.801+0000 7fc23ac68640 1 -- 172.21.15.88:0/1137609759 shutdown_connections 2023-12-08T08:20:36.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.801+0000 7fc23ac68640 1 --2- 172.21.15.88:0/1137609759 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc218066470 0x7fc218068930 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.801+0000 7fc23ac68640 1 --2- 172.21.15.88:0/1137609759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc234152d30 0x7fc234152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.801+0000 7fc23ac68640 1 --2- 172.21.15.88:0/1137609759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2340c3d90 0x7fc234151d50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.801+0000 7fc23ac68640 1 --2- 172.21.15.88:0/1137609759 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc2340c3930 0x7fc2340a9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.801+0000 7fc23ac68640 1 -- 172.21.15.88:0/1137609759 >> 172.21.15.88:0/1137609759 conn(0x7fc23406b220 msgr2=0x7fc2340c0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:36.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.801+0000 7fc23ac68640 1 -- 172.21.15.88:0/1137609759 shutdown_connections 2023-12-08T08:20:36.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:36.801+0000 7fc23ac68640 1 -- 172.21.15.88:0/1137609759 wait complete. 2023-12-08T08:20:36.824 INFO:teuthology.run_tasks:Running task kclient... 2023-12-08T08:20:36.847 INFO:tasks.kclient:Mounting kernel clients... 2023-12-08T08:20:36.848 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-12-08T08:20:36.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:36.848 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-12-08T08:20:36.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:36.858 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2023-12-08T08:20:36.923 INFO:teuthology.orchestra.run.smithi088.stderr:Cannot find device "ceph-brx" 2023-12-08T08:20:36.925 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:20:36.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:36.925 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-12-08T08:20:36.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:36.936 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link delete ceph-brx 2023-12-08T08:20:37.001 INFO:teuthology.orchestra.run.smithi148.stderr:Cannot find device "ceph-brx" 2023-12-08T08:20:37.003 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:20:37.003 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-12-08T08:20:37.004 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-08T08:20:37.004 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T08:20:37.004 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:20:37.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.137+0000 7f9b5926b640 1 Processor -- start 2023-12-08T08:20:37.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.137+0000 7f9b5926b640 1 -- start start 2023-12-08T08:20:37.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.137+0000 7f9b5926b640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9b540af4c0 0x7f9b54154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:37.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.137+0000 7f9b5926b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9b5406c100 0x7f9b540c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:37.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.137+0000 7f9b5926b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b540c4890 con 0x7f9b540c67d0 2023-12-08T08:20:37.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.137+0000 7f9b5926b640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b54155460 con 0x7f9b5406c100 2023-12-08T08:20:37.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.137+0000 7f9b5926b640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b540af8a0 con 0x7f9b540af4c0 2023-12-08T08:20:37.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.137+0000 7f9b537fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9b5406c100 0x7f9b540c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:37.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.137+0000 7f9b4a7fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9b540c67d0 0x7f9b5406b9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34554/0 (socket says 172.21.15.88:34554) 2023-12-08T08:20:37.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.137+0000 7f9b4a7fc640 1 -- 172.21.15.88:0/86887266 learned_addr learned my addr 172.21.15.88:0/86887266 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:37.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.137+0000 7f9b537fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9b5406c100 0x7f9b540c6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41482/0 (socket says 172.21.15.88:41482) 2023-12-08T08:20:37.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.137+0000 7f9b52ffd640 1 --2- 172.21.15.88:0/86887266 >> v2:172.21.15.148:3300/0 conn(0x7f9b540af4c0 0x7f9b54154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:37.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.137+0000 7f9b537fe640 1 -- 172.21.15.88:0/86887266 >> v2:172.21.15.148:3300/0 conn(0x7f9b540af4c0 msgr2=0x7f9b54154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:37.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.137+0000 7f9b537fe640 1 --2- 172.21.15.88:0/86887266 >> v2:172.21.15.148:3300/0 conn(0x7f9b540af4c0 0x7f9b54154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.137+0000 7f9b537fe640 1 -- 172.21.15.88:0/86887266 >> v1:172.21.15.88:6789/0 conn(0x7f9b540c67d0 legacy=0x7f9b5406b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:37.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.137+0000 7f9b537fe640 1 -- 172.21.15.88:0/86887266 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b540c4b30 con 0x7f9b5406c100 2023-12-08T08:20:37.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.137+0000 7f9b527fc640 1 -- 172.21.15.88:0/86887266 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1023776413 0 0) 0x7f9b540c4890 con 0x7f9b540c67d0 2023-12-08T08:20:37.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.141+0000 7f9b537fe640 1 --2- 172.21.15.88:0/86887266 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b5406c100 0x7f9b540c6c80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9b540a9790 tx=0x7f9b4c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccebc700e3006bfa server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:37.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.141+0000 7f9b527fc640 1 -- 172.21.15.88:0/86887266 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c0ac600 con 0x7f9b5406c100 2023-12-08T08:20:37.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.141+0000 7f9b527fc640 1 -- 172.21.15.88:0/86887266 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c0a8050 con 0x7f9b5406c100 2023-12-08T08:20:37.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.141+0000 7f9b527fc640 1 -- 172.21.15.88:0/86887266 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c0ac980 con 0x7f9b5406c100 2023-12-08T08:20:37.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.141+0000 7f9b5926b640 1 -- 172.21.15.88:0/86887266 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b5406c100 msgr2=0x7f9b540c6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:37.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.141+0000 7f9b5926b640 1 --2- 172.21.15.88:0/86887266 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b5406c100 0x7f9b540c6c80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9b540a9790 tx=0x7f9b4c01c3a0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.141+0000 7f9b5926b640 1 -- 172.21.15.88:0/86887266 shutdown_connections 2023-12-08T08:20:37.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.141+0000 7f9b5926b640 1 --2- 172.21.15.88:0/86887266 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b5406c100 0x7f9b540c6c80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.141+0000 7f9b5926b640 1 --2- 172.21.15.88:0/86887266 >> v2:172.21.15.148:3300/0 conn(0x7f9b540af4c0 0x7f9b54154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.141+0000 7f9b5926b640 1 -- 172.21.15.88:0/86887266 >> 172.21.15.88:0/86887266 conn(0x7f9b540ab9d0 msgr2=0x7f9b540abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:37.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.141+0000 7f9b5926b640 1 -- 172.21.15.88:0/86887266 shutdown_connections 2023-12-08T08:20:37.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.141+0000 7f9b5926b640 1 -- 172.21.15.88:0/86887266 wait complete. 2023-12-08T08:20:37.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.145+0000 7f9b5926b640 1 Processor -- start 2023-12-08T08:20:37.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.145+0000 7f9b5926b640 1 -- start start 2023-12-08T08:20:37.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.145+0000 7f9b5926b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b5406c100 0x7f9b540c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:37.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.145+0000 7f9b5926b640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b540af4c0 0x7f9b5414f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:37.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.145+0000 7f9b5926b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b540c67d0 0x7f9b541f0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:37.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.145+0000 7f9b5926b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b541eff00 con 0x7f9b540c67d0 2023-12-08T08:20:37.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.145+0000 7f9b5926b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b54154e90 con 0x7f9b5406c100 2023-12-08T08:20:37.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.145+0000 7f9b5926b640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b54155130 con 0x7f9b540af4c0 2023-12-08T08:20:37.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.145+0000 7f9b537fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b540c67d0 0x7f9b541f0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:37.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.145+0000 7f9b537fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b540c67d0 0x7f9b541f0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41488/0 (socket says 172.21.15.88:41488) 2023-12-08T08:20:37.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.145+0000 7f9b537fe640 1 -- 172.21.15.88:0/186710014 learned_addr learned my addr 172.21.15.88:0/186710014 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:37.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.145+0000 7f9b52ffd640 1 --2- 172.21.15.88:0/186710014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b5406c100 0x7f9b540c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:37.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.145+0000 7f9b4a7fc640 1 --2- 172.21.15.88:0/186710014 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b540af4c0 0x7f9b5414f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:37.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.145+0000 7f9b537fe640 1 -- 172.21.15.88:0/186710014 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b540af4c0 msgr2=0x7f9b5414f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:37.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.145+0000 7f9b537fe640 1 --2- 172.21.15.88:0/186710014 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b540af4c0 0x7f9b5414f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.145+0000 7f9b537fe640 1 -- 172.21.15.88:0/186710014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b5406c100 msgr2=0x7f9b540c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:37.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.145+0000 7f9b537fe640 1 --2- 172.21.15.88:0/186710014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b5406c100 0x7f9b540c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.145+0000 7f9b537fe640 1 -- 172.21.15.88:0/186710014 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4c009420 con 0x7f9b540c67d0 2023-12-08T08:20:37.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.145+0000 7f9b537fe640 1 --2- 172.21.15.88:0/186710014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b540c67d0 0x7f9b541f0390 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c019fd0 tx=0x7f9b4c01abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:37.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.145+0000 7f9b4bfff640 1 -- 172.21.15.88:0/186710014 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c0b7450 con 0x7f9b540c67d0 2023-12-08T08:20:37.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.145+0000 7f9b4bfff640 1 -- 172.21.15.88:0/186710014 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c0b75b0 con 0x7f9b540c67d0 2023-12-08T08:20:37.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.145+0000 7f9b5926b640 1 -- 172.21.15.88:0/186710014 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b541ef8b0 con 0x7f9b540c67d0 2023-12-08T08:20:37.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.145+0000 7f9b4bfff640 1 -- 172.21.15.88:0/186710014 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c0b7960 con 0x7f9b540c67d0 2023-12-08T08:20:37.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.145+0000 7f9b5926b640 1 -- 172.21.15.88:0/186710014 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b541585e0 con 0x7f9b540c67d0 2023-12-08T08:20:37.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.145+0000 7f9b5926b640 1 -- 172.21.15.88:0/186710014 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b541f0070 con 0x7f9b540c67d0 2023-12-08T08:20:37.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.149+0000 7f9b4bfff640 1 -- 172.21.15.88:0/186710014 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9b4c0b3070 con 0x7f9b540c67d0 2023-12-08T08:20:37.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.149+0000 7f9b4bfff640 1 --2- 172.21.15.88:0/186710014 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9b34066470 0x7f9b34068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:37.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.149+0000 7f9b4bfff640 1 -- 172.21.15.88:0/186710014 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b4c11e0f0 con 0x7f9b540c67d0 2023-12-08T08:20:37.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.149+0000 7f9b52ffd640 1 --2- 172.21.15.88:0/186710014 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9b34066470 0x7f9b34068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:37.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.149+0000 7f9b52ffd640 1 --2- 172.21.15.88:0/186710014 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9b34066470 0x7f9b34068930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9b54154d80 tx=0x7f9b44009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:37.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.153+0000 7f9b4bfff640 1 -- 172.21.15.88:0/186710014 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9b4c0eb560 con 0x7f9b540c67d0 2023-12-08T08:20:37.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.333+0000 7f9b5926b640 1 -- 172.21.15.88:0/186710014 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9b54067630 con 0x7f9b540c67d0 2023-12-08T08:20:37.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.333+0000 7f9b4bfff640 1 -- 172.21.15.88:0/186710014 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9b4c0eeb80 con 0x7f9b540c67d0 2023-12-08T08:20:37.342 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:20:37.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.337+0000 7f9b5926b640 1 -- 172.21.15.88:0/186710014 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9b34066470 msgr2=0x7f9b34068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:37.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.337+0000 7f9b5926b640 1 --2- 172.21.15.88:0/186710014 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9b34066470 0x7f9b34068930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9b54154d80 tx=0x7f9b44009190 comp rx=0 tx=0).stop 2023-12-08T08:20:37.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.337+0000 7f9b5926b640 1 -- 172.21.15.88:0/186710014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b540c67d0 msgr2=0x7f9b541f0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:37.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.337+0000 7f9b5926b640 1 --2- 172.21.15.88:0/186710014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b540c67d0 0x7f9b541f0390 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c019fd0 tx=0x7f9b4c01abe0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.337+0000 7f9b5926b640 1 -- 172.21.15.88:0/186710014 shutdown_connections 2023-12-08T08:20:37.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.337+0000 7f9b5926b640 1 --2- 172.21.15.88:0/186710014 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9b34066470 0x7f9b34068930 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.337+0000 7f9b5926b640 1 --2- 172.21.15.88:0/186710014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b540c67d0 0x7f9b541f0390 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.337+0000 7f9b5926b640 1 --2- 172.21.15.88:0/186710014 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9b540af4c0 0x7f9b5414f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.337+0000 7f9b5926b640 1 --2- 172.21.15.88:0/186710014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b5406c100 0x7f9b540c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.337+0000 7f9b5926b640 1 -- 172.21.15.88:0/186710014 >> 172.21.15.88:0/186710014 conn(0x7f9b540ab9d0 msgr2=0x7f9b5406b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:37.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.337+0000 7f9b5926b640 1 -- 172.21.15.88:0/186710014 shutdown_connections 2023-12-08T08:20:37.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:37.337+0000 7f9b5926b640 1 -- 172.21.15.88:0/186710014 wait complete. 2023-12-08T08:20:37.361 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-08T08:20:37.361 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:20:37.361 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2023-12-08T08:20:37.361 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-08T08:20:37.361 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T08:20:37.362 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-08T08:20:37.362 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-08T08:20:37.362 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:20:37.362 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:20:37.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:37.362 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2023-12-08T08:20:37.372 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:20:37.372 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:20:37.372 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:20:37.372 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:37.372 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-12-08T08:20:37.372 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:37.373 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:20:37.373 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:20:37.373 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2023-12-08T08:20:37.373 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:20:37.373 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:20:37.373 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2023-12-08T08:20:37.373 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:20:37.373 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2023-12-08T08:20:37.373 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:20:37.373 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2023-12-08T08:20:37.373 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-08T08:20:37.373 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42421sec preferred_lft 42421sec 2023-12-08T08:20:37.374 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2023-12-08T08:20:37.374 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:37.374 INFO:teuthology.orchestra.run.smithi088.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-08T08:20:37.374 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 02:42:cd:51:97:e3 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:20:37.374 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-08T08:20:37.374 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:37.374 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-08T08:20:37.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:37.375 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-12-08T08:20:37.375 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-12-08T08:20:37.375 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add name ceph-brx type bridge 2023-12-08T08:20:37.375 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr flush dev ceph-brx 2023-12-08T08:20:37.375 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set ceph-brx up 2023-12-08T08:20:37.375 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-08T08:20:37.375 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-12-08T08:20:37.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:37.490 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:20:37.509 INFO:teuthology.orchestra.run.smithi088.stdout:1 2023-12-08T08:20:37.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:37.511 DEBUG:teuthology.orchestra.run.smithi088:> route 2023-12-08T08:20:37.580 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2023-12-08T08:20:37.580 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:20:37.580 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-08T08:20:37.580 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-08T08:20:37.580 INFO:teuthology.orchestra.run.smithi088.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-08T08:20:37.580 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-08T08:20:37.580 INFO:teuthology.orchestra.run.smithi088.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:20:37.580 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:20:37.580 INFO:teuthology.orchestra.run.smithi088.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:20:37.581 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:20:37.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:37.581 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-12-08T08:20:37.581 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-12-08T08:20:37.581 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-08T08:20:37.581 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-08T08:20:37.581 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-08T08:20:37.581 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-12-08T08:20:37.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:37.671 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-12-08T08:20:37.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:37.681 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list-id 2023-12-08T08:20:37.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:37.738 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-12-08T08:20:37.738 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-12-08T08:20:37.738 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:20:37.738 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-08T08:20:37.738 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-12-08T08:20:37.821 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-08T08:20:37.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:37.822 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-12-08T08:20:37.822 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-12-08T08:20:37.822 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-08T08:20:37.822 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-08T08:20:37.822 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-08T08:20:37.822 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-08T08:20:37.822 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-08T08:20:37.822 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-12-08T08:20:37.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:37.999 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-12-08T08:20:37.999 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-12-08T08:20:37.999 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2023-12-08T08:20:37.999 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set dev brx.0 master ceph-brx 2023-12-08T08:20:37.999 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-12-08T08:20:38.040 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:20:38.040 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-08T08:20:38.089 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:20:38.089 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:20:38.089 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:20:38.140 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-08T08:20:38.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:38.140 DEBUG:teuthology.orchestra.run.smithi088:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:20:38.239 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:20:38.239 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:20:38.352 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:20:38.352 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:20:38.352 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-12-08T08:20:38.352 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: trying mount with new device syntax: 0@681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3.cephfs=/ 2023-12-08T08:20:38.352 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.88:3300/172.21.15.148:3300/172.21.15.148:3301" will pass to kernel 2023-12-08T08:20:38.356 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T08:20:38.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:38.356 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:20:38.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:38.377 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:20:38.446 INFO:teuthology.orchestra.run.smithi088.stdout:client4719 2023-12-08T08:20:38.446 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:20:38.446 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:20:38.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:38.497 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:20:38.558 INFO:teuthology.orchestra.run.smithi088.stdout:client4719 2023-12-08T08:20:38.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:38.558 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:20:38.622 INFO:teuthology.orchestra.run.smithi088.stdout:client4719 2023-12-08T08:20:38.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:38.622 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3.client4719/status') 2023-12-08T08:20:38.689 INFO:teuthology.orchestra.run.smithi088.stdout:instance: client.4719 (3)192.168.0.1:0/2863373824 2023-12-08T08:20:38.689 INFO:teuthology.orchestra.run.smithi088.stdout:blocklisted: false 2023-12-08T08:20:38.689 INFO:teuthology.orchestra.run.smithi088.stderr:0+1 records in 2023-12-08T08:20:38.689 INFO:teuthology.orchestra.run.smithi088.stderr:0+1 records out 2023-12-08T08:20:38.689 INFO:teuthology.orchestra.run.smithi088.stderr:69 bytes copied, 6.4917e-05 s, 1.1 MB/s 2023-12-08T08:20:38.691 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-12-08T08:20:38.691 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-08T08:20:38.691 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-08T08:20:38.692 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:20:38.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.865+0000 7f086912a640 1 Processor -- start 2023-12-08T08:20:38.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.865+0000 7f086912a640 1 -- start start 2023-12-08T08:20:38.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.865+0000 7f086912a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f086406d2b0 0x7f086406d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:38.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.865+0000 7f086912a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08640c5300 0x7f086406c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:38.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.865+0000 7f086912a640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086406bb80 con 0x7f08640c3b80 2023-12-08T08:20:38.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.865+0000 7f086912a640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086406cc70 con 0x7f086406d2b0 2023-12-08T08:20:38.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.865+0000 7f086912a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08640c5790 con 0x7f08640c5300 2023-12-08T08:20:38.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.869+0000 7f0862d9d640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f086406d2b0 0x7f086406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:38.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.869+0000 7f086359e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08640c5300 0x7f086406c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:38.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.869+0000 7f086259c640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f08640c3b80 0x7f086406c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:57784/0 (socket says 172.21.15.88:57784) 2023-12-08T08:20:38.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.869+0000 7f0862d9d640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f086406d2b0 0x7f086406d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:55892/0 (socket says 172.21.15.88:55892) 2023-12-08T08:20:38.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.869+0000 7f086259c640 1 -- 172.21.15.88:0/1701875999 learned_addr learned my addr 172.21.15.88:0/1701875999 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:38.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.869+0000 7f0862d9d640 1 -- 172.21.15.88:0/1701875999 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08640c5300 msgr2=0x7f086406c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:38.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.869+0000 7f0862d9d640 1 --2- 172.21.15.88:0/1701875999 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08640c5300 0x7f086406c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:38.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.869+0000 7f0862d9d640 1 -- 172.21.15.88:0/1701875999 >> v1:172.21.15.148:6789/0 conn(0x7f08640c3b80 legacy=0x7f086406c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:38.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.869+0000 7f0862d9d640 1 -- 172.21.15.88:0/1701875999 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08641515c0 con 0x7f086406d2b0 2023-12-08T08:20:38.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.869+0000 7f0861d9b640 1 -- 172.21.15.88:0/1701875999 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3067357881 0 0) 0x7f086406bb80 con 0x7f08640c3b80 2023-12-08T08:20:38.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.869+0000 7f0862d9d640 1 --2- 172.21.15.88:0/1701875999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f086406d2b0 0x7f086406d690 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f08540097c0 tx=0x7f085401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea9ca4b7f99587fa server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:38.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.873+0000 7f0861d9b640 1 -- 172.21.15.88:0/1701875999 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08540ad660 con 0x7f086406d2b0 2023-12-08T08:20:38.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.873+0000 7f0861d9b640 1 -- 172.21.15.88:0/1701875999 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08540ad7c0 con 0x7f086406d2b0 2023-12-08T08:20:38.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.873+0000 7f0861d9b640 1 -- 172.21.15.88:0/1701875999 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08540adb50 con 0x7f086406d2b0 2023-12-08T08:20:38.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.873+0000 7f086912a640 1 -- 172.21.15.88:0/1701875999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f086406d2b0 msgr2=0x7f086406d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:38.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.873+0000 7f086912a640 1 --2- 172.21.15.88:0/1701875999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f086406d2b0 0x7f086406d690 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f08540097c0 tx=0x7f085401c450 comp rx=0 tx=0).stop 2023-12-08T08:20:38.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.873+0000 7f086912a640 1 -- 172.21.15.88:0/1701875999 shutdown_connections 2023-12-08T08:20:38.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.873+0000 7f086912a640 1 --2- 172.21.15.88:0/1701875999 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08640c5300 0x7f086406c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:38.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.873+0000 7f086912a640 1 --2- 172.21.15.88:0/1701875999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f086406d2b0 0x7f086406d690 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:38.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.873+0000 7f086912a640 1 -- 172.21.15.88:0/1701875999 >> 172.21.15.88:0/1701875999 conn(0x7f08640a7810 msgr2=0x7f08640a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:38.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.873+0000 7f086912a640 1 -- 172.21.15.88:0/1701875999 shutdown_connections 2023-12-08T08:20:38.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.873+0000 7f086912a640 1 -- 172.21.15.88:0/1701875999 wait complete. 2023-12-08T08:20:38.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.873+0000 7f086912a640 1 Processor -- start 2023-12-08T08:20:38.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.873+0000 7f086912a640 1 -- start start 2023-12-08T08:20:38.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.873+0000 7f086912a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f086406d2b0 0x7f086414b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:38.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.873+0000 7f086912a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08640c3b80 0x7f08640bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:38.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.873+0000 7f086912a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08640c5300 0x7f08640a8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:38.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.873+0000 7f086912a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08640a87d0 con 0x7f08640c5300 2023-12-08T08:20:38.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.873+0000 7f086912a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08640a9c30 con 0x7f08640c3b80 2023-12-08T08:20:38.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.873+0000 7f086912a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08641edba0 con 0x7f086406d2b0 2023-12-08T08:20:38.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.877+0000 7f0862d9d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f086406d2b0 0x7f086414b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:38.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.877+0000 7f086259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08640c3b80 0x7f08640bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:38.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.877+0000 7f0862d9d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f086406d2b0 0x7f086414b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:60344/0 (socket says 172.21.15.88:60344) 2023-12-08T08:20:38.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.877+0000 7f086359e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08640c5300 0x7f08640a8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:38.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.877+0000 7f0862d9d640 1 -- 172.21.15.88:0/3599043025 learned_addr learned my addr 172.21.15.88:0/3599043025 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:38.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.877+0000 7f086359e640 1 -- 172.21.15.88:0/3599043025 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f086406d2b0 msgr2=0x7f086414b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:38.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.877+0000 7f086359e640 1 --2- 172.21.15.88:0/3599043025 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f086406d2b0 0x7f086414b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:38.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.877+0000 7f086359e640 1 -- 172.21.15.88:0/3599043025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08640c3b80 msgr2=0x7f08640bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:38.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.877+0000 7f086359e640 1 --2- 172.21.15.88:0/3599043025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08640c3b80 0x7f08640bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:38.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.877+0000 7f086359e640 1 -- 172.21.15.88:0/3599043025 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0854009420 con 0x7f08640c5300 2023-12-08T08:20:38.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.877+0000 7f0862d9d640 1 --2- 172.21.15.88:0/3599043025 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f086406d2b0 0x7f086414b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:38.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.877+0000 7f086259c640 1 --2- 172.21.15.88:0/3599043025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08640c3b80 0x7f08640bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:38.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.877+0000 7f086359e640 1 --2- 172.21.15.88:0/3599043025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08640c5300 0x7f08640a8c60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f085c00eb80 tx=0x7f085c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:38.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.877+0000 7f084b7fe640 1 -- 172.21.15.88:0/3599043025 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c00cd20 con 0x7f08640c5300 2023-12-08T08:20:38.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.877+0000 7f084b7fe640 1 -- 172.21.15.88:0/3599043025 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085c00f040 con 0x7f08640c5300 2023-12-08T08:20:38.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.877+0000 7f086912a640 1 -- 172.21.15.88:0/3599043025 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086414ef80 con 0x7f08640c5300 2023-12-08T08:20:38.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.877+0000 7f084b7fe640 1 -- 172.21.15.88:0/3599043025 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c00cea0 con 0x7f08640c5300 2023-12-08T08:20:38.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.877+0000 7f086912a640 1 -- 172.21.15.88:0/3599043025 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08641ee160 con 0x7f08640c5300 2023-12-08T08:20:38.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.877+0000 7f086912a640 1 -- 172.21.15.88:0/3599043025 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08640a8980 con 0x7f08640c5300 2023-12-08T08:20:38.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.877+0000 7f084b7fe640 1 -- 172.21.15.88:0/3599043025 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f085c0146c0 con 0x7f08640c5300 2023-12-08T08:20:38.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.877+0000 7f084b7fe640 1 --2- 172.21.15.88:0/3599043025 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0850066470 0x7f0850068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:38.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.881+0000 7f084b7fe640 1 -- 172.21.15.88:0/3599043025 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f085c0849c0 con 0x7f08640c5300 2023-12-08T08:20:38.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.881+0000 7f0862d9d640 1 --2- 172.21.15.88:0/3599043025 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0850066470 0x7f0850068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:38.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.881+0000 7f0862d9d640 1 --2- 172.21.15.88:0/3599043025 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0850066470 0x7f0850068930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f085401c490 tx=0x7f08540a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:38.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:38.881+0000 7f084b7fe640 1 -- 172.21.15.88:0/3599043025 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f08640a8980 con 0x7f08640c5300 2023-12-08T08:20:39.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:39.065+0000 7f086912a640 1 -- 172.21.15.88:0/3599043025 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f08640a8980 con 0x7f08640c5300 2023-12-08T08:20:39.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:39.065+0000 7f084b7fe640 1 -- 172.21.15.88:0/3599043025 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f08640a8980 con 0x7f08640c5300 2023-12-08T08:20:39.072 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:20:39.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:39.069+0000 7f086912a640 1 -- 172.21.15.88:0/3599043025 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0850066470 msgr2=0x7f0850068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:39.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:39.069+0000 7f086912a640 1 --2- 172.21.15.88:0/3599043025 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0850066470 0x7f0850068930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f085401c490 tx=0x7f08540a7000 comp rx=0 tx=0).stop 2023-12-08T08:20:39.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:39.069+0000 7f086912a640 1 -- 172.21.15.88:0/3599043025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08640c5300 msgr2=0x7f08640a8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:39.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:39.069+0000 7f086912a640 1 --2- 172.21.15.88:0/3599043025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08640c5300 0x7f08640a8c60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f085c00eb80 tx=0x7f085c00c490 comp rx=0 tx=0).stop 2023-12-08T08:20:39.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:39.069+0000 7f086912a640 1 -- 172.21.15.88:0/3599043025 shutdown_connections 2023-12-08T08:20:39.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:39.069+0000 7f086912a640 1 --2- 172.21.15.88:0/3599043025 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0850066470 0x7f0850068930 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:39.069+0000 7f086912a640 1 --2- 172.21.15.88:0/3599043025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08640c5300 0x7f08640a8c60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:39.069+0000 7f086912a640 1 --2- 172.21.15.88:0/3599043025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08640c3b80 0x7f08640bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:39.069+0000 7f086912a640 1 --2- 172.21.15.88:0/3599043025 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f086406d2b0 0x7f086414b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:39.069+0000 7f086912a640 1 -- 172.21.15.88:0/3599043025 >> 172.21.15.88:0/3599043025 conn(0x7f08640a7810 msgr2=0x7f08640c1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:39.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:39.069+0000 7f086912a640 1 -- 172.21.15.88:0/3599043025 shutdown_connections 2023-12-08T08:20:39.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:39.069+0000 7f086912a640 1 -- 172.21.15.88:0/3599043025 wait complete. 2023-12-08T08:20:39.092 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-08T08:20:39.093 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:20:39.093 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-12-08T08:20:39.093 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-08T08:20:39.093 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-08T08:20:39.093 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-08T08:20:39.093 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-08T08:20:39.093 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:20:39.093 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:20:39.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:39.094 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-12-08T08:20:39.104 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:20:39.104 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:20:39.104 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:20:39.104 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:39.104 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-12-08T08:20:39.104 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:39.105 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:20:39.105 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:20:39.105 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-12-08T08:20:39.105 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:20:39.105 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:20:39.105 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-12-08T08:20:39.105 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:20:39.105 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:20:39.105 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:20:39.105 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:20:39.105 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-08T08:20:39.105 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42400sec preferred_lft 42400sec 2023-12-08T08:20:39.105 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-12-08T08:20:39.105 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:39.106 INFO:teuthology.orchestra.run.smithi148.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-08T08:20:39.106 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 02:42:93:b7:1f:fa brd ff:ff:ff:ff:ff:ff 2023-12-08T08:20:39.106 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-08T08:20:39.106 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:39.107 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-08T08:20:39.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:39.107 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-12-08T08:20:39.107 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-12-08T08:20:39.107 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link add name ceph-brx type bridge 2023-12-08T08:20:39.107 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip addr flush dev ceph-brx 2023-12-08T08:20:39.107 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set ceph-brx up 2023-12-08T08:20:39.107 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-08T08:20:39.107 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-12-08T08:20:39.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:39.230 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:20:39.250 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-12-08T08:20:39.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:39.252 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-12-08T08:20:39.329 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-12-08T08:20:39.329 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:20:39.329 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-08T08:20:39.329 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-08T08:20:39.329 INFO:teuthology.orchestra.run.smithi148.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-08T08:20:39.329 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-08T08:20:39.329 INFO:teuthology.orchestra.run.smithi148.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:20:39.329 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:20:39.329 INFO:teuthology.orchestra.run.smithi148.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:20:39.329 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:20:39.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:39.330 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-12-08T08:20:39.330 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-12-08T08:20:39.330 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-08T08:20:39.330 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-08T08:20:39.330 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-08T08:20:39.330 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-12-08T08:20:39.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:39.421 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-12-08T08:20:39.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:39.431 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list-id 2023-12-08T08:20:39.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:39.486 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-12-08T08:20:39.486 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-12-08T08:20:39.487 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:20:39.487 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-08T08:20:39.487 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-12-08T08:20:39.575 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-08T08:20:39.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:39.575 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-12-08T08:20:39.575 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-12-08T08:20:39.576 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-08T08:20:39.576 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-08T08:20:39.576 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-08T08:20:39.576 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-08T08:20:39.576 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-08T08:20:39.576 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-12-08T08:20:39.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:39.737 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-12-08T08:20:39.738 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-12-08T08:20:39.738 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-12-08T08:20:39.738 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set dev brx.0 master ceph-brx 2023-12-08T08:20:39.738 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-12-08T08:20:39.778 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:20:39.779 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-08T08:20:39.830 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:20:39.830 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:20:39.830 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:20:39.885 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-08T08:20:39.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:39.885 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:20:39.991 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:20:39.991 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:20:40.090 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:20:40.090 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:20:40.090 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-12-08T08:20:40.090 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with new device syntax: 1@681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3.cephfs=/ 2023-12-08T08:20:40.091 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.88:3300/172.21.15.148:3300/172.21.15.148:3301" will pass to kernel 2023-12-08T08:20:40.094 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T08:20:40.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:40.094 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:20:40.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:40.115 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:20:40.180 INFO:teuthology.orchestra.run.smithi148.stdout:client4681 2023-12-08T08:20:40.180 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:20:40.180 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:20:40.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:40.230 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:20:40.284 INFO:teuthology.orchestra.run.smithi148.stdout:client4681 2023-12-08T08:20:40.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:40.285 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:20:40.336 INFO:teuthology.orchestra.run.smithi148.stdout:client4681 2023-12-08T08:20:40.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:40.337 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3.client4681/status') 2023-12-08T08:20:40.397 INFO:teuthology.orchestra.run.smithi148.stdout:instance: client.4681 (3)192.168.0.1:0/2121869984 2023-12-08T08:20:40.398 INFO:teuthology.orchestra.run.smithi148.stdout:blocklisted: false 2023-12-08T08:20:40.398 INFO:teuthology.orchestra.run.smithi148.stderr:0+1 records in 2023-12-08T08:20:40.398 INFO:teuthology.orchestra.run.smithi148.stderr:0+1 records out 2023-12-08T08:20:40.398 INFO:teuthology.orchestra.run.smithi148.stderr:69 bytes copied, 5.1854e-05 s, 1.3 MB/s 2023-12-08T08:20:40.400 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-08T08:20:40.420 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:40.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.561+0000 7fd04cd0e640 1 Processor -- start 2023-12-08T08:20:40.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.561+0000 7fd04cd0e640 1 -- start start 2023-12-08T08:20:40.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.565+0000 7fd04cd0e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd04806d2b0 0x7fd04806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.565+0000 7fd04cd0e640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd0480c3b80 0x7fd0480c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.565+0000 7fd04cd0e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd04806c020 0x7fd04806c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.565+0000 7fd04cd0e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0480c5840 con 0x7fd04806c020 2023-12-08T08:20:40.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.565+0000 7fd04cd0e640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd04806bb80 con 0x7fd0480c3b80 2023-12-08T08:20:40.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.565+0000 7fd04cd0e640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0481515c0 con 0x7fd04806d2b0 2023-12-08T08:20:40.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.565+0000 7fd046d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd04806c020 0x7fd04806c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.565+0000 7fd046d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd04806c020 0x7fd04806c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60210/0 (socket says 172.21.15.88:60210) 2023-12-08T08:20:40.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.565+0000 7fd046d9d640 1 -- 172.21.15.88:0/686983762 learned_addr learned my addr 172.21.15.88:0/686983762 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:40.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.565+0000 7fd03dd9b640 1 --2- 172.21.15.88:0/686983762 >> v2:172.21.15.148:3300/0 conn(0x7fd0480c3b80 0x7fd0480c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.565+0000 7fd04659c640 1 --2- 172.21.15.88:0/686983762 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd04806d2b0 0x7fd04806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.565+0000 7fd046d9d640 1 -- 172.21.15.88:0/686983762 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd04806d2b0 msgr2=0x7fd04806d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:40.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.565+0000 7fd046d9d640 1 --2- 172.21.15.88:0/686983762 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd04806d2b0 0x7fd04806d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.565+0000 7fd046d9d640 1 -- 172.21.15.88:0/686983762 >> v2:172.21.15.148:3300/0 conn(0x7fd0480c3b80 msgr2=0x7fd0480c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:40.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.565+0000 7fd046d9d640 1 --2- 172.21.15.88:0/686983762 >> v2:172.21.15.148:3300/0 conn(0x7fd0480c3b80 0x7fd0480c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.565+0000 7fd046d9d640 1 -- 172.21.15.88:0/686983762 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0481518a0 con 0x7fd04806c020 2023-12-08T08:20:40.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.569+0000 7fd046d9d640 1 --2- 172.21.15.88:0/686983762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd04806c020 0x7fd04806c4b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd0480c59c0 tx=0x7fd04001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f56a658e62bd1490 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:40.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.569+0000 7fd045d9b640 1 -- 172.21.15.88:0/686983762 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0400a5730 con 0x7fd04806c020 2023-12-08T08:20:40.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.569+0000 7fd045d9b640 1 -- 172.21.15.88:0/686983762 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0400a5890 con 0x7fd04806c020 2023-12-08T08:20:40.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.569+0000 7fd045d9b640 1 -- 172.21.15.88:0/686983762 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0400a5c20 con 0x7fd04806c020 2023-12-08T08:20:40.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.569+0000 7fd04cd0e640 1 -- 172.21.15.88:0/686983762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd04806c020 msgr2=0x7fd04806c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:40.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.569+0000 7fd04cd0e640 1 --2- 172.21.15.88:0/686983762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd04806c020 0x7fd04806c4b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd0480c59c0 tx=0x7fd04001c9a0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.569+0000 7fd04cd0e640 1 -- 172.21.15.88:0/686983762 shutdown_connections 2023-12-08T08:20:40.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.569+0000 7fd04cd0e640 1 --2- 172.21.15.88:0/686983762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd04806c020 0x7fd04806c4b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.569+0000 7fd04cd0e640 1 --2- 172.21.15.88:0/686983762 >> v2:172.21.15.148:3300/0 conn(0x7fd0480c3b80 0x7fd0480c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.569+0000 7fd04cd0e640 1 --2- 172.21.15.88:0/686983762 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd04806d2b0 0x7fd04806d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.569+0000 7fd04cd0e640 1 -- 172.21.15.88:0/686983762 >> 172.21.15.88:0/686983762 conn(0x7fd0480a7810 msgr2=0x7fd0480a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:40.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.569+0000 7fd04cd0e640 1 -- 172.21.15.88:0/686983762 shutdown_connections 2023-12-08T08:20:40.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.569+0000 7fd04cd0e640 1 -- 172.21.15.88:0/686983762 wait complete. 2023-12-08T08:20:40.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.569+0000 7fd04cd0e640 1 Processor -- start 2023-12-08T08:20:40.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.569+0000 7fd04cd0e640 1 -- start start 2023-12-08T08:20:40.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.573+0000 7fd04cd0e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd04806c020 0x7fd04815a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.573+0000 7fd04cd0e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd04806d2b0 0x7fd0481ed000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.573+0000 7fd04cd0e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0480c3b80 0x7fd0481ed540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.573+0000 7fd04cd0e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0480ab360 con 0x7fd04806c020 2023-12-08T08:20:40.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.573+0000 7fd04cd0e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0481f0e10 con 0x7fd0480c3b80 2023-12-08T08:20:40.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.573+0000 7fd04cd0e640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0481f10f0 con 0x7fd04806d2b0 2023-12-08T08:20:40.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.573+0000 7fd04659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd04806c020 0x7fd04815a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.573+0000 7fd04659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd04806c020 0x7fd04815a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60226/0 (socket says 172.21.15.88:60226) 2023-12-08T08:20:40.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.573+0000 7fd04659c640 1 -- 172.21.15.88:0/585646297 learned_addr learned my addr 172.21.15.88:0/585646297 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:40.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.573+0000 7fd03dd9b640 1 --2- 172.21.15.88:0/585646297 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd04806d2b0 0x7fd0481ed000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.573+0000 7fd046d9d640 1 --2- 172.21.15.88:0/585646297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0480c3b80 0x7fd0481ed540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.573+0000 7fd04659c640 1 -- 172.21.15.88:0/585646297 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd04806d2b0 msgr2=0x7fd0481ed000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:40.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.573+0000 7fd04659c640 1 --2- 172.21.15.88:0/585646297 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd04806d2b0 0x7fd0481ed000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.573+0000 7fd04659c640 1 -- 172.21.15.88:0/585646297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0480c3b80 msgr2=0x7fd0481ed540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:40.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.573+0000 7fd04659c640 1 --2- 172.21.15.88:0/585646297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0480c3b80 0x7fd0481ed540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.573+0000 7fd04659c640 1 -- 172.21.15.88:0/585646297 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd040009b30 con 0x7fd04806c020 2023-12-08T08:20:40.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.573+0000 7fd04659c640 1 --2- 172.21.15.88:0/585646297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd04806c020 0x7fd04815a370 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd03000e930 tx=0x7fd03000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:40.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.573+0000 7fd03f7fe640 1 -- 172.21.15.88:0/585646297 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd030009690 con 0x7fd04806c020 2023-12-08T08:20:40.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.573+0000 7fd03f7fe640 1 -- 172.21.15.88:0/585646297 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03000ca00 con 0x7fd04806c020 2023-12-08T08:20:40.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.573+0000 7fd04cd0e640 1 -- 172.21.15.88:0/585646297 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd04814ef80 con 0x7fd04806c020 2023-12-08T08:20:40.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.573+0000 7fd03f7fe640 1 -- 172.21.15.88:0/585646297 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03000cd70 con 0x7fd04806c020 2023-12-08T08:20:40.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.573+0000 7fd04cd0e640 1 -- 172.21.15.88:0/585646297 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd048150540 con 0x7fd04806c020 2023-12-08T08:20:40.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.573+0000 7fd04cd0e640 1 -- 172.21.15.88:0/585646297 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd048150700 con 0x7fd04806c020 2023-12-08T08:20:40.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.573+0000 7fd03f7fe640 1 -- 172.21.15.88:0/585646297 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd030013470 con 0x7fd04806c020 2023-12-08T08:20:40.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.577+0000 7fd03f7fe640 1 --2- 172.21.15.88:0/585646297 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd028066470 0x7fd028068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.577+0000 7fd03f7fe640 1 -- 172.21.15.88:0/585646297 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd030083ff0 con 0x7fd04806c020 2023-12-08T08:20:40.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.577+0000 7fd03dd9b640 1 --2- 172.21.15.88:0/585646297 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd028066470 0x7fd028068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.577+0000 7fd03dd9b640 1 --2- 172.21.15.88:0/585646297 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd028066470 0x7fd028068930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd048072be0 tx=0x7fd038009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:40.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.581+0000 7fd03f7fe640 1 -- 172.21.15.88:0/585646297 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd0300b5280 con 0x7fd04806c020 2023-12-08T08:20:40.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.729+0000 7fd04cd0e640 1 -- 172.21.15.88:0/585646297 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd048067630 con 0x7fd04806c020 2023-12-08T08:20:40.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.733+0000 7fd03f7fe640 1 -- 172.21.15.88:0/585646297 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7fd030017090 con 0x7fd04806c020 2023-12-08T08:20:40.738 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:40.738 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:20:21.492555+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:18.675917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:19.511013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:40.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.733+0000 7fd04cd0e640 1 -- 172.21.15.88:0/585646297 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd028066470 msgr2=0x7fd028068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:40.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.733+0000 7fd04cd0e640 1 --2- 172.21.15.88:0/585646297 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd028066470 0x7fd028068930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd048072be0 tx=0x7fd038009190 comp rx=0 tx=0).stop 2023-12-08T08:20:40.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.733+0000 7fd04cd0e640 1 -- 172.21.15.88:0/585646297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd04806c020 msgr2=0x7fd04815a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:40.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.733+0000 7fd04cd0e640 1 --2- 172.21.15.88:0/585646297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd04806c020 0x7fd04815a370 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd03000e930 tx=0x7fd03000edf0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.733+0000 7fd04cd0e640 1 -- 172.21.15.88:0/585646297 shutdown_connections 2023-12-08T08:20:40.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.733+0000 7fd04cd0e640 1 --2- 172.21.15.88:0/585646297 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd028066470 0x7fd028068930 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.733+0000 7fd04cd0e640 1 --2- 172.21.15.88:0/585646297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0480c3b80 0x7fd0481ed540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.733+0000 7fd04cd0e640 1 --2- 172.21.15.88:0/585646297 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd04806d2b0 0x7fd0481ed000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.733+0000 7fd04cd0e640 1 --2- 172.21.15.88:0/585646297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd04806c020 0x7fd04815a370 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.733+0000 7fd04cd0e640 1 -- 172.21.15.88:0/585646297 >> 172.21.15.88:0/585646297 conn(0x7fd0480a7810 msgr2=0x7fd0480a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:40.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.733+0000 7fd04cd0e640 1 -- 172.21.15.88:0/585646297 shutdown_connections 2023-12-08T08:20:40.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.733+0000 7fd04cd0e640 1 -- 172.21.15.88:0/585646297 wait complete. 2023-12-08T08:20:40.759 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:20:18.675917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:20:19.511013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:20:40.759 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:20:40.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.893+0000 7ff497868640 1 Processor -- start 2023-12-08T08:20:40.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.893+0000 7ff497868640 1 -- start start 2023-12-08T08:20:40.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.897+0000 7ff497868640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff4900c0e10 0x7ff4900c0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.897+0000 7ff497868640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff49015bf70 0x7ff49015c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.897+0000 7ff497868640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49006bce0 con 0x7ff490156200 2023-12-08T08:20:40.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.897+0000 7ff497868640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff49006d8d0 con 0x7ff4900c0e10 2023-12-08T08:20:40.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.897+0000 7ff497868640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4900c2270 con 0x7ff49015bf70 2023-12-08T08:20:40.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.897+0000 7ff495604640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff490156200 0x7ff4900c1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36498/0 (socket says 172.21.15.88:36498) 2023-12-08T08:20:40.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.897+0000 7ff495604640 1 -- 172.21.15.88:0/3642548016 learned_addr learned my addr 172.21.15.88:0/3642548016 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:40.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.897+0000 7ff494e03640 1 --2- 172.21.15.88:0/3642548016 >> v2:172.21.15.88:3300/0 conn(0x7ff4900c0e10 0x7ff4900c0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.897+0000 7ff495e05640 1 --2- 172.21.15.88:0/3642548016 >> v2:172.21.15.148:3300/0 conn(0x7ff49015bf70 0x7ff49015c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.897+0000 7ff494e03640 1 -- 172.21.15.88:0/3642548016 >> v2:172.21.15.148:3300/0 conn(0x7ff49015bf70 msgr2=0x7ff49015c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:40.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.897+0000 7ff494e03640 1 --2- 172.21.15.88:0/3642548016 >> v2:172.21.15.148:3300/0 conn(0x7ff49015bf70 0x7ff49015c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.897+0000 7ff494e03640 1 -- 172.21.15.88:0/3642548016 >> v1:172.21.15.88:6789/0 conn(0x7ff490156200 legacy=0x7ff4900c1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:40.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.897+0000 7ff494e03640 1 -- 172.21.15.88:0/3642548016 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49015cc60 con 0x7ff4900c0e10 2023-12-08T08:20:40.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.897+0000 7ff495e05640 1 --2- 172.21.15.88:0/3642548016 >> v2:172.21.15.148:3300/0 conn(0x7ff49015bf70 0x7ff49015c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:40.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.897+0000 7ff487fff640 1 -- 172.21.15.88:0/3642548016 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095052676 0 0) 0x7ff49006bce0 con 0x7ff490156200 2023-12-08T08:20:40.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.897+0000 7ff494e03640 1 --2- 172.21.15.88:0/3642548016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4900c0e10 0x7ff4900c0370 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff4900c6ad0 tx=0x7ff48001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47c533f4a8c552e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:40.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.901+0000 7ff487fff640 1 -- 172.21.15.88:0/3642548016 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4800ab600 con 0x7ff4900c0e10 2023-12-08T08:20:40.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.901+0000 7ff487fff640 1 -- 172.21.15.88:0/3642548016 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4800a7050 con 0x7ff4900c0e10 2023-12-08T08:20:40.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.901+0000 7ff487fff640 1 -- 172.21.15.88:0/3642548016 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4800ab980 con 0x7ff4900c0e10 2023-12-08T08:20:40.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.901+0000 7ff497868640 1 -- 172.21.15.88:0/3642548016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4900c0e10 msgr2=0x7ff4900c0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:40.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.901+0000 7ff497868640 1 --2- 172.21.15.88:0/3642548016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4900c0e10 0x7ff4900c0370 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff4900c6ad0 tx=0x7ff48001c310 comp rx=0 tx=0).stop 2023-12-08T08:20:40.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.901+0000 7ff497868640 1 -- 172.21.15.88:0/3642548016 shutdown_connections 2023-12-08T08:20:40.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.901+0000 7ff497868640 1 --2- 172.21.15.88:0/3642548016 >> v2:172.21.15.148:3300/0 conn(0x7ff49015bf70 0x7ff49015c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.901+0000 7ff497868640 1 --2- 172.21.15.88:0/3642548016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4900c0e10 0x7ff4900c0370 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.901+0000 7ff497868640 1 -- 172.21.15.88:0/3642548016 >> 172.21.15.88:0/3642548016 conn(0x7ff4900c59f0 msgr2=0x7ff4900c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:40.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.901+0000 7ff497868640 1 -- 172.21.15.88:0/3642548016 shutdown_connections 2023-12-08T08:20:40.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.901+0000 7ff497868640 1 -- 172.21.15.88:0/3642548016 wait complete. 2023-12-08T08:20:40.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.901+0000 7ff497868640 1 Processor -- start 2023-12-08T08:20:40.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.901+0000 7ff497868640 1 -- start start 2023-12-08T08:20:40.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.901+0000 7ff497868640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4900c0e10 0x7ff4900aa950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.901+0000 7ff497868640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff490156200 0x7ff49014ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.901+0000 7ff497868640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff49015bf70 0x7ff4901f4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.901+0000 7ff497868640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4900a9220 con 0x7ff4900c0e10 2023-12-08T08:20:40.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.901+0000 7ff497868640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4900abac0 con 0x7ff490156200 2023-12-08T08:20:40.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.901+0000 7ff497868640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4900aa4c0 con 0x7ff49015bf70 2023-12-08T08:20:40.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.901+0000 7ff495604640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4900c0e10 0x7ff4900aa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.901+0000 7ff495604640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4900c0e10 0x7ff4900aa950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60250/0 (socket says 172.21.15.88:60250) 2023-12-08T08:20:40.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.901+0000 7ff495604640 1 -- 172.21.15.88:0/2091097347 learned_addr learned my addr 172.21.15.88:0/2091097347 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:40.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.905+0000 7ff495e05640 1 --2- 172.21.15.88:0/2091097347 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff49015bf70 0x7ff4901f4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.905+0000 7ff494e03640 1 --2- 172.21.15.88:0/2091097347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff490156200 0x7ff49014ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.905+0000 7ff495604640 1 -- 172.21.15.88:0/2091097347 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff49015bf70 msgr2=0x7ff4901f4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:40.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.905+0000 7ff495604640 1 --2- 172.21.15.88:0/2091097347 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff49015bf70 0x7ff4901f4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.905+0000 7ff495604640 1 -- 172.21.15.88:0/2091097347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff490156200 msgr2=0x7ff49014ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:40.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.905+0000 7ff495604640 1 --2- 172.21.15.88:0/2091097347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff490156200 0x7ff49014ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.905+0000 7ff495604640 1 -- 172.21.15.88:0/2091097347 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff488009a70 con 0x7ff4900c0e10 2023-12-08T08:20:40.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.905+0000 7ff495e05640 1 --2- 172.21.15.88:0/2091097347 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff49015bf70 0x7ff4901f4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:40.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.905+0000 7ff494e03640 1 --2- 172.21.15.88:0/2091097347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff490156200 0x7ff49014ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:40.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.905+0000 7ff495604640 1 --2- 172.21.15.88:0/2091097347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4900c0e10 0x7ff4900aa950 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00c480 tx=0x7ff48c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:40.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.905+0000 7ff485ffb640 1 -- 172.21.15.88:0/2091097347 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c0074e0 con 0x7ff4900c0e10 2023-12-08T08:20:40.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.905+0000 7ff485ffb640 1 -- 172.21.15.88:0/2091097347 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48c007660 con 0x7ff4900c0e10 2023-12-08T08:20:40.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.905+0000 7ff497868640 1 -- 172.21.15.88:0/2091097347 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff480009420 con 0x7ff4900c0e10 2023-12-08T08:20:40.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.905+0000 7ff485ffb640 1 -- 172.21.15.88:0/2091097347 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c004a30 con 0x7ff4900c0e10 2023-12-08T08:20:40.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.905+0000 7ff497868640 1 -- 172.21.15.88:0/2091097347 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4900aa150 con 0x7ff4900c0e10 2023-12-08T08:20:40.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.905+0000 7ff497868640 1 -- 172.21.15.88:0/2091097347 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff490067630 con 0x7ff4900c0e10 2023-12-08T08:20:40.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.905+0000 7ff485ffb640 1 -- 172.21.15.88:0/2091097347 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff48c004b90 con 0x7ff4900c0e10 2023-12-08T08:20:40.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.905+0000 7ff485ffb640 1 --2- 172.21.15.88:0/2091097347 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff474066470 0x7ff474068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.905+0000 7ff485ffb640 1 -- 172.21.15.88:0/2091097347 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff48c0833d0 con 0x7ff4900c0e10 2023-12-08T08:20:40.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.905+0000 7ff494e03640 1 --2- 172.21.15.88:0/2091097347 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff474066470 0x7ff474068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.909+0000 7ff494e03640 1 --2- 172.21.15.88:0/2091097347 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff474066470 0x7ff474068930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff4800ad000 tx=0x7ff480008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:40.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:40.909+0000 7ff485ffb640 1 -- 172.21.15.88:0/2091097347 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff48c0542d0 con 0x7ff4900c0e10 2023-12-08T08:20:41.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.061+0000 7ff497868640 1 -- 172.21.15.88:0/2091097347 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff4900abcc0 con 0x7ff4900c0e10 2023-12-08T08:20:41.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.061+0000 7ff485ffb640 1 -- 172.21.15.88:0/2091097347 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff48c018020 con 0x7ff4900c0e10 2023-12-08T08:20:41.068 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:20:41.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.065+0000 7ff497868640 1 -- 172.21.15.88:0/2091097347 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff474066470 msgr2=0x7ff474068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.065+0000 7ff497868640 1 --2- 172.21.15.88:0/2091097347 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff474066470 0x7ff474068930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff4800ad000 tx=0x7ff480008040 comp rx=0 tx=0).stop 2023-12-08T08:20:41.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.065+0000 7ff497868640 1 -- 172.21.15.88:0/2091097347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4900c0e10 msgr2=0x7ff4900aa950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.065+0000 7ff497868640 1 --2- 172.21.15.88:0/2091097347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4900c0e10 0x7ff4900aa950 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00c480 tx=0x7ff48c00c940 comp rx=0 tx=0).stop 2023-12-08T08:20:41.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.065+0000 7ff497868640 1 -- 172.21.15.88:0/2091097347 shutdown_connections 2023-12-08T08:20:41.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.065+0000 7ff497868640 1 --2- 172.21.15.88:0/2091097347 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff474066470 0x7ff474068930 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.065+0000 7ff497868640 1 --2- 172.21.15.88:0/2091097347 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff49015bf70 0x7ff4901f4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.065+0000 7ff497868640 1 --2- 172.21.15.88:0/2091097347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff490156200 0x7ff49014ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.065+0000 7ff497868640 1 --2- 172.21.15.88:0/2091097347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4900c0e10 0x7ff4900aa950 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.065+0000 7ff497868640 1 -- 172.21.15.88:0/2091097347 >> 172.21.15.88:0/2091097347 conn(0x7ff4900c59f0 msgr2=0x7ff490159b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:41.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.065+0000 7ff497868640 1 -- 172.21.15.88:0/2091097347 shutdown_connections 2023-12-08T08:20:41.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.065+0000 7ff497868640 1 -- 172.21.15.88:0/2091097347 wait complete. 2023-12-08T08:20:41.089 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:20:41.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.225+0000 7fbbf585a640 1 Processor -- start 2023-12-08T08:20:41.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.225+0000 7fbbf585a640 1 -- start start 2023-12-08T08:20:41.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.225+0000 7fbbf585a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbbf00c6030 0x7fbbf00c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.225+0000 7fbbf585a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbbf00c98f0 0x7fbbf00c8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.225+0000 7fbbf585a640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf0158780 con 0x7fbbf00bf2d0 2023-12-08T08:20:41.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.225+0000 7fbbf585a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf00c0300 con 0x7fbbf00c6030 2023-12-08T08:20:41.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.225+0000 7fbbf585a640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf0157b70 con 0x7fbbf00c98f0 2023-12-08T08:20:41.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.225+0000 7fbbee7fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbbf00c6030 0x7fbbf00c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.225+0000 7fbbee7fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbbf00c6030 0x7fbbf00c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60264/0 (socket says 172.21.15.88:60264) 2023-12-08T08:20:41.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.225+0000 7fbbee7fc640 1 -- 172.21.15.88:0/3743609800 learned_addr learned my addr 172.21.15.88:0/3743609800 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:41.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.225+0000 7fbbef7fe640 1 --2- 172.21.15.88:0/3743609800 >> v2:172.21.15.148:3300/0 conn(0x7fbbf00c98f0 0x7fbbf00c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.225+0000 7fbbee7fc640 1 -- 172.21.15.88:0/3743609800 >> v2:172.21.15.148:3300/0 conn(0x7fbbf00c98f0 msgr2=0x7fbbf00c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:41.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.225+0000 7fbbee7fc640 1 --2- 172.21.15.88:0/3743609800 >> v2:172.21.15.148:3300/0 conn(0x7fbbf00c98f0 0x7fbbf00c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.225+0000 7fbbee7fc640 1 -- 172.21.15.88:0/3743609800 >> v1:172.21.15.148:6789/0 conn(0x7fbbf00bf2d0 legacy=0x7fbbf0151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:41.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.225+0000 7fbbee7fc640 1 -- 172.21.15.88:0/3743609800 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf0157e50 con 0x7fbbf00c6030 2023-12-08T08:20:41.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.229+0000 7fbbee7fc640 1 --2- 172.21.15.88:0/3743609800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbf00c6030 0x7fbbf00c7cc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbbf00a9720 tx=0x7fbbe401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=747f3fa14a59c8ed server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:41.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.229+0000 7fbbedffb640 1 -- 172.21.15.88:0/3743609800 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe40aa430 con 0x7fbbf00c6030 2023-12-08T08:20:41.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.229+0000 7fbbedffb640 1 -- 172.21.15.88:0/3743609800 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe40aa590 con 0x7fbbf00c6030 2023-12-08T08:20:41.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.229+0000 7fbbedffb640 1 -- 172.21.15.88:0/3743609800 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe40aa920 con 0x7fbbf00c6030 2023-12-08T08:20:41.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.229+0000 7fbbf585a640 1 -- 172.21.15.88:0/3743609800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbf00c6030 msgr2=0x7fbbf00c7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.229+0000 7fbbf585a640 1 --2- 172.21.15.88:0/3743609800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbf00c6030 0x7fbbf00c7cc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbbf00a9720 tx=0x7fbbe401c4d0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.229+0000 7fbbf585a640 1 -- 172.21.15.88:0/3743609800 shutdown_connections 2023-12-08T08:20:41.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.229+0000 7fbbf585a640 1 --2- 172.21.15.88:0/3743609800 >> v2:172.21.15.148:3300/0 conn(0x7fbbf00c98f0 0x7fbbf00c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.229+0000 7fbbf585a640 1 --2- 172.21.15.88:0/3743609800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbf00c6030 0x7fbbf00c7cc0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.229+0000 7fbbf585a640 1 -- 172.21.15.88:0/3743609800 >> 172.21.15.88:0/3743609800 conn(0x7fbbf00c9dc0 msgr2=0x7fbbf00ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:41.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.229+0000 7fbbf585a640 1 -- 172.21.15.88:0/3743609800 shutdown_connections 2023-12-08T08:20:41.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.229+0000 7fbbf585a640 1 -- 172.21.15.88:0/3743609800 wait complete. 2023-12-08T08:20:41.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.229+0000 7fbbf585a640 1 Processor -- start 2023-12-08T08:20:41.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.233+0000 7fbbf585a640 1 -- start start 2023-12-08T08:20:41.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.233+0000 7fbbf585a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbf00bf2d0 0x7fbbf01446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.233+0000 7fbbf585a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbbf00c6030 0x7fbbf0154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.233+0000 7fbbf585a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbbf00c98f0 0x7fbbf01550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.233+0000 7fbbf585a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf00adf20 con 0x7fbbf00bf2d0 2023-12-08T08:20:41.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.233+0000 7fbbf585a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf0145270 con 0x7fbbf00c98f0 2023-12-08T08:20:41.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.233+0000 7fbbf585a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf0146d70 con 0x7fbbf00c6030 2023-12-08T08:20:41.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.233+0000 7fbbeeffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbf00bf2d0 0x7fbbf01446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.233+0000 7fbbeeffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbf00bf2d0 0x7fbbf01446c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60274/0 (socket says 172.21.15.88:60274) 2023-12-08T08:20:41.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.233+0000 7fbbeeffd640 1 -- 172.21.15.88:0/3366936473 learned_addr learned my addr 172.21.15.88:0/3366936473 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:41.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.233+0000 7fbbee7fc640 1 --2- 172.21.15.88:0/3366936473 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbbf00c6030 0x7fbbf0154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.233+0000 7fbbef7fe640 1 --2- 172.21.15.88:0/3366936473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbbf00c98f0 0x7fbbf01550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.233+0000 7fbbeeffd640 1 -- 172.21.15.88:0/3366936473 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbbf00c6030 msgr2=0x7fbbf0154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.233+0000 7fbbeeffd640 1 --2- 172.21.15.88:0/3366936473 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbbf00c6030 0x7fbbf0154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.233+0000 7fbbeeffd640 1 -- 172.21.15.88:0/3366936473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbbf00c98f0 msgr2=0x7fbbf01550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.233+0000 7fbbeeffd640 1 --2- 172.21.15.88:0/3366936473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbbf00c98f0 0x7fbbf01550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.233+0000 7fbbeeffd640 1 -- 172.21.15.88:0/3366936473 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe40094d0 con 0x7fbbf00bf2d0 2023-12-08T08:20:41.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.233+0000 7fbbef7fe640 1 --2- 172.21.15.88:0/3366936473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbbf00c98f0 0x7fbbf01550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:41.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.233+0000 7fbbeeffd640 1 --2- 172.21.15.88:0/3366936473 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbf00bf2d0 0x7fbbf01446c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000c500 tx=0x7fbbe000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:41.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.233+0000 7fbbd7fff640 1 -- 172.21.15.88:0/3366936473 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0005220 con 0x7fbbf00bf2d0 2023-12-08T08:20:41.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.233+0000 7fbbd7fff640 1 -- 172.21.15.88:0/3366936473 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe0005380 con 0x7fbbf00bf2d0 2023-12-08T08:20:41.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.233+0000 7fbbf585a640 1 -- 172.21.15.88:0/3366936473 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf01439a0 con 0x7fbbf00bf2d0 2023-12-08T08:20:41.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.233+0000 7fbbd7fff640 1 -- 172.21.15.88:0/3366936473 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0007270 con 0x7fbbf00bf2d0 2023-12-08T08:20:41.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.233+0000 7fbbf585a640 1 -- 172.21.15.88:0/3366936473 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf00accf0 con 0x7fbbf00bf2d0 2023-12-08T08:20:41.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.233+0000 7fbbf585a640 1 -- 172.21.15.88:0/3366936473 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf0067630 con 0x7fbbf00bf2d0 2023-12-08T08:20:41.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.237+0000 7fbbd7fff640 1 -- 172.21.15.88:0/3366936473 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbbe00073d0 con 0x7fbbf00bf2d0 2023-12-08T08:20:41.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.237+0000 7fbbd7fff640 1 --2- 172.21.15.88:0/3366936473 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbbdc066470 0x7fbbdc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.237+0000 7fbbd7fff640 1 -- 172.21.15.88:0/3366936473 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbe0083700 con 0x7fbbf00bf2d0 2023-12-08T08:20:41.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.237+0000 7fbbee7fc640 1 --2- 172.21.15.88:0/3366936473 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbbdc066470 0x7fbbdc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.237+0000 7fbbee7fc640 1 --2- 172.21.15.88:0/3366936473 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbbdc066470 0x7fbbdc068930 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40ae000 tx=0x7fbbe40b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:41.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.241+0000 7fbbd7fff640 1 -- 172.21.15.88:0/3366936473 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbbe0050b70 con 0x7fbbf00bf2d0 2023-12-08T08:20:41.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.389+0000 7fbbf585a640 1 -- 172.21.15.88:0/3366936473 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbbf006b630 con 0x7fbbf00bf2d0 2023-12-08T08:20:41.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.389+0000 7fbbd7fff640 1 -- 172.21.15.88:0/3366936473 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbbe0054190 con 0x7fbbf00bf2d0 2023-12-08T08:20:41.395 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:20:41.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.389+0000 7fbbf585a640 1 -- 172.21.15.88:0/3366936473 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbbdc066470 msgr2=0x7fbbdc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.389+0000 7fbbf585a640 1 --2- 172.21.15.88:0/3366936473 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbbdc066470 0x7fbbdc068930 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40ae000 tx=0x7fbbe40b5040 comp rx=0 tx=0).stop 2023-12-08T08:20:41.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.389+0000 7fbbf585a640 1 -- 172.21.15.88:0/3366936473 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbf00bf2d0 msgr2=0x7fbbf01446c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.389+0000 7fbbf585a640 1 --2- 172.21.15.88:0/3366936473 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbf00bf2d0 0x7fbbf01446c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000c500 tx=0x7fbbe000c9c0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.389+0000 7fbbf585a640 1 -- 172.21.15.88:0/3366936473 shutdown_connections 2023-12-08T08:20:41.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.389+0000 7fbbf585a640 1 --2- 172.21.15.88:0/3366936473 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbbdc066470 0x7fbbdc068930 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.389+0000 7fbbf585a640 1 --2- 172.21.15.88:0/3366936473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbbf00c98f0 0x7fbbf01550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.389+0000 7fbbf585a640 1 --2- 172.21.15.88:0/3366936473 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbbf00c6030 0x7fbbf0154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.389+0000 7fbbf585a640 1 --2- 172.21.15.88:0/3366936473 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbf00bf2d0 0x7fbbf01446c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.389+0000 7fbbf585a640 1 -- 172.21.15.88:0/3366936473 >> 172.21.15.88:0/3366936473 conn(0x7fbbf00c9dc0 msgr2=0x7fbbf00ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:41.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.393+0000 7fbbf585a640 1 -- 172.21.15.88:0/3366936473 shutdown_connections 2023-12-08T08:20:41.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.393+0000 7fbbf585a640 1 -- 172.21.15.88:0/3366936473 wait complete. 2023-12-08T08:20:41.416 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:20:41.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.553+0000 7f4275afe640 1 Processor -- start 2023-12-08T08:20:41.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.553+0000 7f4275afe640 1 -- start start 2023-12-08T08:20:41.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.553+0000 7f4275afe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f42700c1ca0 0x7f4270072200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.553+0000 7f4275afe640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f42700bfdb0 0x7f42700c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.553+0000 7f4275afe640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4270154ce0 con 0x7f4270155170 2023-12-08T08:20:41.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.553+0000 7f4275afe640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42700c0520 con 0x7f42700c1ca0 2023-12-08T08:20:41.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.553+0000 7f4275afe640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4270154480 con 0x7f42700bfdb0 2023-12-08T08:20:41.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.553+0000 7f426f7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f42700c1ca0 0x7f4270072200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.553+0000 7f426f7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f42700c1ca0 0x7f4270072200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60288/0 (socket says 172.21.15.88:60288) 2023-12-08T08:20:41.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.553+0000 7f426f7fe640 1 -- 172.21.15.88:0/657759280 learned_addr learned my addr 172.21.15.88:0/657759280 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:41.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.553+0000 7f426f7fe640 1 -- 172.21.15.88:0/657759280 >> v2:172.21.15.148:3300/0 conn(0x7f42700bfdb0 msgr2=0x7f42700c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:41.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.553+0000 7f426f7fe640 1 --2- 172.21.15.88:0/657759280 >> v2:172.21.15.148:3300/0 conn(0x7f42700bfdb0 0x7f42700c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.553+0000 7f426f7fe640 1 -- 172.21.15.88:0/657759280 >> v1:172.21.15.148:6789/0 conn(0x7f4270155170 legacy=0x7f42700c0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:41.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.553+0000 7f426f7fe640 1 -- 172.21.15.88:0/657759280 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42700c0240 con 0x7f42700c1ca0 2023-12-08T08:20:41.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.557+0000 7f426f7fe640 1 --2- 172.21.15.88:0/657759280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42700c1ca0 0x7f4270072200 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4270070be0 tx=0x7f426001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26561474a15a31cc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:41.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.557+0000 7f426effd640 1 -- 172.21.15.88:0/657759280 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42600ac410 con 0x7f42700c1ca0 2023-12-08T08:20:41.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.557+0000 7f426effd640 1 -- 172.21.15.88:0/657759280 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42600ac570 con 0x7f42700c1ca0 2023-12-08T08:20:41.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.557+0000 7f426effd640 1 -- 172.21.15.88:0/657759280 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42600ac900 con 0x7f42700c1ca0 2023-12-08T08:20:41.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.557+0000 7f4275afe640 1 -- 172.21.15.88:0/657759280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42700c1ca0 msgr2=0x7f4270072200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.557+0000 7f4275afe640 1 --2- 172.21.15.88:0/657759280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42700c1ca0 0x7f4270072200 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4270070be0 tx=0x7f426001c4c0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.557+0000 7f4275afe640 1 -- 172.21.15.88:0/657759280 shutdown_connections 2023-12-08T08:20:41.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.557+0000 7f4275afe640 1 --2- 172.21.15.88:0/657759280 >> v2:172.21.15.148:3300/0 conn(0x7f42700bfdb0 0x7f42700c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.557+0000 7f4275afe640 1 --2- 172.21.15.88:0/657759280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42700c1ca0 0x7f4270072200 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.557+0000 7f4275afe640 1 -- 172.21.15.88:0/657759280 >> 172.21.15.88:0/657759280 conn(0x7f427006d2a0 msgr2=0x7f427006d680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:41.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.557+0000 7f4275afe640 1 -- 172.21.15.88:0/657759280 shutdown_connections 2023-12-08T08:20:41.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.557+0000 7f4275afe640 1 -- 172.21.15.88:0/657759280 wait complete. 2023-12-08T08:20:41.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.561+0000 7f4275afe640 1 Processor -- start 2023-12-08T08:20:41.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.561+0000 7f4275afe640 1 -- start start 2023-12-08T08:20:41.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.561+0000 7f4275afe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42700c1ca0 0x7f42701f0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.561+0000 7f4275afe640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4270155170 0x7f42701f0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.561+0000 7f4275afe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4270156280 0x7f4270156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.561+0000 7f4275afe640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42701455c0 con 0x7f42700c1ca0 2023-12-08T08:20:41.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.561+0000 7f4275afe640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42701f13a0 con 0x7f4270156280 2023-12-08T08:20:41.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.561+0000 7f4275afe640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42701f15d0 con 0x7f4270155170 2023-12-08T08:20:41.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.561+0000 7f426f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42700c1ca0 0x7f42701f0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.561+0000 7f426f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42700c1ca0 0x7f42701f0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60300/0 (socket says 172.21.15.88:60300) 2023-12-08T08:20:41.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.561+0000 7f426f7fe640 1 -- 172.21.15.88:0/343909030 learned_addr learned my addr 172.21.15.88:0/343909030 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:41.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.561+0000 7f4267fff640 1 --2- 172.21.15.88:0/343909030 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4270155170 0x7f42701f0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.561+0000 7f426ffff640 1 --2- 172.21.15.88:0/343909030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4270156280 0x7f4270156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.561+0000 7f426f7fe640 1 -- 172.21.15.88:0/343909030 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4270155170 msgr2=0x7f42701f0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.561+0000 7f426f7fe640 1 --2- 172.21.15.88:0/343909030 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4270155170 0x7f42701f0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.561+0000 7f426f7fe640 1 -- 172.21.15.88:0/343909030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4270156280 msgr2=0x7f4270156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.561+0000 7f426f7fe640 1 --2- 172.21.15.88:0/343909030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4270156280 0x7f4270156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.561+0000 7f426f7fe640 1 -- 172.21.15.88:0/343909030 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42600094d0 con 0x7f42700c1ca0 2023-12-08T08:20:41.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.561+0000 7f426f7fe640 1 --2- 172.21.15.88:0/343909030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42700c1ca0 0x7f42701f0920 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f426001ab70 tx=0x7f4260019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:41.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.561+0000 7f426cff9640 1 -- 172.21.15.88:0/343909030 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42600acea0 con 0x7f42700c1ca0 2023-12-08T08:20:41.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.561+0000 7f426cff9640 1 -- 172.21.15.88:0/343909030 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42600b5650 con 0x7f42700c1ca0 2023-12-08T08:20:41.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.561+0000 7f426cff9640 1 -- 172.21.15.88:0/343909030 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42600ac410 con 0x7f42700c1ca0 2023-12-08T08:20:41.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.561+0000 7f4275afe640 1 -- 172.21.15.88:0/343909030 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42701577d0 con 0x7f42700c1ca0 2023-12-08T08:20:41.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.561+0000 7f4275afe640 1 -- 172.21.15.88:0/343909030 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4270157ab0 con 0x7f42700c1ca0 2023-12-08T08:20:41.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.565+0000 7f4275afe640 1 -- 172.21.15.88:0/343909030 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4270067630 con 0x7f42700c1ca0 2023-12-08T08:20:41.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.565+0000 7f426cff9640 1 -- 172.21.15.88:0/343909030 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f42600b3070 con 0x7f42700c1ca0 2023-12-08T08:20:41.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.565+0000 7f426cff9640 1 --2- 172.21.15.88:0/343909030 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f42500664a0 0x7f4250068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.565+0000 7f426cff9640 1 -- 172.21.15.88:0/343909030 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f426011dd50 con 0x7f42700c1ca0 2023-12-08T08:20:41.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.565+0000 7f4267fff640 1 --2- 172.21.15.88:0/343909030 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f42500664a0 0x7f4250068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.565+0000 7f4267fff640 1 --2- 172.21.15.88:0/343909030 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f42500664a0 0x7f4250068960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f427014b3b0 tx=0x7f4258009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:41.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.569+0000 7f426cff9640 1 -- 172.21.15.88:0/343909030 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f42600eb270 con 0x7f42700c1ca0 2023-12-08T08:20:41.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.717+0000 7f4275afe640 1 -- 172.21.15.88:0/343909030 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f42700c0b90 con 0x7f42700c1ca0 2023-12-08T08:20:41.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.717+0000 7f426cff9640 1 -- 172.21.15.88:0/343909030 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f42600ee890 con 0x7f42700c1ca0 2023-12-08T08:20:41.724 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:20:41.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.721+0000 7f4275afe640 1 -- 172.21.15.88:0/343909030 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f42500664a0 msgr2=0x7f4250068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.721+0000 7f4275afe640 1 --2- 172.21.15.88:0/343909030 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f42500664a0 0x7f4250068960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f427014b3b0 tx=0x7f4258009110 comp rx=0 tx=0).stop 2023-12-08T08:20:41.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.721+0000 7f4275afe640 1 -- 172.21.15.88:0/343909030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42700c1ca0 msgr2=0x7f42701f0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.721+0000 7f4275afe640 1 --2- 172.21.15.88:0/343909030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42700c1ca0 0x7f42701f0920 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f426001ab70 tx=0x7f4260019260 comp rx=0 tx=0).stop 2023-12-08T08:20:41.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.721+0000 7f4275afe640 1 -- 172.21.15.88:0/343909030 shutdown_connections 2023-12-08T08:20:41.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.721+0000 7f4275afe640 1 --2- 172.21.15.88:0/343909030 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f42500664a0 0x7f4250068960 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.721+0000 7f4275afe640 1 --2- 172.21.15.88:0/343909030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4270156280 0x7f4270156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.721+0000 7f4275afe640 1 --2- 172.21.15.88:0/343909030 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4270155170 0x7f42701f0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.721+0000 7f4275afe640 1 --2- 172.21.15.88:0/343909030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42700c1ca0 0x7f42701f0920 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.721+0000 7f4275afe640 1 -- 172.21.15.88:0/343909030 >> 172.21.15.88:0/343909030 conn(0x7f427006d2a0 msgr2=0x7f42700c21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:41.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.721+0000 7f4275afe640 1 -- 172.21.15.88:0/343909030 shutdown_connections 2023-12-08T08:20:41.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.721+0000 7f4275afe640 1 -- 172.21.15.88:0/343909030 wait complete. 2023-12-08T08:20:41.746 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:41.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.877+0000 7f51f8879640 1 Processor -- start 2023-12-08T08:20:41.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.877+0000 7f51f8879640 1 -- start start 2023-12-08T08:20:41.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.881+0000 7f51f8879640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51f406d2b0 0x7f51f406d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.881+0000 7f51f8879640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f51f40c3b80 0x7f51f40c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.881+0000 7f51f8879640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f51f406c020 0x7f51f406c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.881+0000 7f51f8879640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f40c5840 con 0x7f51f406c020 2023-12-08T08:20:41.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.881+0000 7f51f8879640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f406bb80 con 0x7f51f40c3b80 2023-12-08T08:20:41.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.881+0000 7f51f8879640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f41515c0 con 0x7f51f406d2b0 2023-12-08T08:20:41.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.881+0000 7f51f2d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f51f406c020 0x7f51f406c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.881+0000 7f51f2d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f51f406c020 0x7f51f406c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60308/0 (socket says 172.21.15.88:60308) 2023-12-08T08:20:41.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.881+0000 7f51f2d9d640 1 -- 172.21.15.88:0/3802924850 learned_addr learned my addr 172.21.15.88:0/3802924850 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:41.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.881+0000 7f51e9d9b640 1 --2- 172.21.15.88:0/3802924850 >> v2:172.21.15.148:3300/0 conn(0x7f51f40c3b80 0x7f51f40c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.881+0000 7f51f259c640 1 --2- 172.21.15.88:0/3802924850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51f406d2b0 0x7f51f406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.881+0000 7f51f2d9d640 1 -- 172.21.15.88:0/3802924850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51f406d2b0 msgr2=0x7f51f406d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:41.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.881+0000 7f51f2d9d640 1 --2- 172.21.15.88:0/3802924850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51f406d2b0 0x7f51f406d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.881+0000 7f51f2d9d640 1 -- 172.21.15.88:0/3802924850 >> v2:172.21.15.148:3300/0 conn(0x7f51f40c3b80 msgr2=0x7f51f40c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:41.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.881+0000 7f51f2d9d640 1 --2- 172.21.15.88:0/3802924850 >> v2:172.21.15.148:3300/0 conn(0x7f51f40c3b80 0x7f51f40c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.881+0000 7f51f2d9d640 1 -- 172.21.15.88:0/3802924850 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f41518a0 con 0x7f51f406c020 2023-12-08T08:20:41.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.885+0000 7f51f2d9d640 1 --2- 172.21.15.88:0/3802924850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51f406c020 0x7f51f406c4b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f51f40c59c0 tx=0x7f51ec01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb90d2baf3b5fc5a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:41.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.885+0000 7f51f1d9b640 1 -- 172.21.15.88:0/3802924850 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec0a5730 con 0x7f51f406c020 2023-12-08T08:20:41.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.885+0000 7f51f1d9b640 1 -- 172.21.15.88:0/3802924850 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec0a5890 con 0x7f51f406c020 2023-12-08T08:20:41.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.885+0000 7f51f1d9b640 1 -- 172.21.15.88:0/3802924850 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec0a5c20 con 0x7f51f406c020 2023-12-08T08:20:41.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.885+0000 7f51f8879640 1 -- 172.21.15.88:0/3802924850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51f406c020 msgr2=0x7f51f406c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.885+0000 7f51f8879640 1 --2- 172.21.15.88:0/3802924850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51f406c020 0x7f51f406c4b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f51f40c59c0 tx=0x7f51ec01c9a0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.885+0000 7f51f8879640 1 -- 172.21.15.88:0/3802924850 shutdown_connections 2023-12-08T08:20:41.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.885+0000 7f51f8879640 1 --2- 172.21.15.88:0/3802924850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51f406c020 0x7f51f406c4b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.885+0000 7f51f8879640 1 --2- 172.21.15.88:0/3802924850 >> v2:172.21.15.148:3300/0 conn(0x7f51f40c3b80 0x7f51f40c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.885+0000 7f51f8879640 1 --2- 172.21.15.88:0/3802924850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51f406d2b0 0x7f51f406d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.885+0000 7f51f8879640 1 -- 172.21.15.88:0/3802924850 >> 172.21.15.88:0/3802924850 conn(0x7f51f40a7810 msgr2=0x7f51f40a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:41.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.885+0000 7f51f8879640 1 -- 172.21.15.88:0/3802924850 shutdown_connections 2023-12-08T08:20:41.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.885+0000 7f51f8879640 1 -- 172.21.15.88:0/3802924850 wait complete. 2023-12-08T08:20:41.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.885+0000 7f51f8879640 1 Processor -- start 2023-12-08T08:20:41.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.885+0000 7f51f8879640 1 -- start start 2023-12-08T08:20:41.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.889+0000 7f51f8879640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51f406c020 0x7f51f4144e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.889+0000 7f51f8879640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51f406d2b0 0x7f51f414d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.889+0000 7f51f8879640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51f40c3b80 0x7f51f41ec990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.889+0000 7f51f8879640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f41ec500 con 0x7f51f406c020 2023-12-08T08:20:41.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.889+0000 7f51f8879640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f41ebf20 con 0x7f51f406d2b0 2023-12-08T08:20:41.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.889+0000 7f51f8879640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f4150fd0 con 0x7f51f40c3b80 2023-12-08T08:20:41.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.889+0000 7f51f259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51f406c020 0x7f51f4144e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.889+0000 7f51f259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51f406c020 0x7f51f4144e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60322/0 (socket says 172.21.15.88:60322) 2023-12-08T08:20:41.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.889+0000 7f51f259c640 1 -- 172.21.15.88:0/1171081081 learned_addr learned my addr 172.21.15.88:0/1171081081 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:41.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.889+0000 7f51e9d9b640 1 --2- 172.21.15.88:0/1171081081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51f406d2b0 0x7f51f414d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.889+0000 7f51f2d9d640 1 --2- 172.21.15.88:0/1171081081 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51f40c3b80 0x7f51f41ec990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.889+0000 7f51f259c640 1 -- 172.21.15.88:0/1171081081 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51f40c3b80 msgr2=0x7f51f41ec990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.889+0000 7f51f259c640 1 --2- 172.21.15.88:0/1171081081 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51f40c3b80 0x7f51f41ec990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.889+0000 7f51f259c640 1 -- 172.21.15.88:0/1171081081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51f406d2b0 msgr2=0x7f51f414d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.889+0000 7f51f259c640 1 --2- 172.21.15.88:0/1171081081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51f406d2b0 0x7f51f414d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.889+0000 7f51f259c640 1 -- 172.21.15.88:0/1171081081 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec009b30 con 0x7f51f406c020 2023-12-08T08:20:41.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.889+0000 7f51f259c640 1 --2- 172.21.15.88:0/1171081081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51f406c020 0x7f51f4144e40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f51e400d800 tx=0x7f51e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:41.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.889+0000 7f51eb7fe640 1 -- 172.21.15.88:0/1171081081 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e400b6c0 con 0x7f51f406c020 2023-12-08T08:20:41.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.889+0000 7f51eb7fe640 1 -- 172.21.15.88:0/1171081081 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e400b820 con 0x7f51f406c020 2023-12-08T08:20:41.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.889+0000 7f51f8879640 1 -- 172.21.15.88:0/1171081081 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f414ef80 con 0x7f51f406c020 2023-12-08T08:20:41.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.889+0000 7f51eb7fe640 1 -- 172.21.15.88:0/1171081081 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e400bb90 con 0x7f51f406c020 2023-12-08T08:20:41.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.889+0000 7f51f8879640 1 -- 172.21.15.88:0/1171081081 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f4151270 con 0x7f51f406c020 2023-12-08T08:20:41.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.889+0000 7f51f8879640 1 -- 172.21.15.88:0/1171081081 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f4067630 con 0x7f51f406c020 2023-12-08T08:20:41.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.889+0000 7f51eb7fe640 1 -- 172.21.15.88:0/1171081081 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f51e400bcf0 con 0x7f51f406c020 2023-12-08T08:20:41.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.893+0000 7f51eb7fe640 1 --2- 172.21.15.88:0/1171081081 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f51d4066470 0x7f51d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.893+0000 7f51eb7fe640 1 -- 172.21.15.88:0/1171081081 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51e4084290 con 0x7f51f406c020 2023-12-08T08:20:41.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.893+0000 7f51e9d9b640 1 --2- 172.21.15.88:0/1171081081 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f51d4066470 0x7f51d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.893+0000 7f51e9d9b640 1 --2- 172.21.15.88:0/1171081081 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f51d4066470 0x7f51d4068930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f51f40bfdf0 tx=0x7f51dc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:41.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:41.897+0000 7f51eb7fe640 1 -- 172.21.15.88:0/1171081081 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f51e40517b0 con 0x7f51f406c020 2023-12-08T08:20:42.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.049+0000 7f51f8879640 1 -- 172.21.15.88:0/1171081081 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51f406bd70 con 0x7f51f406c020 2023-12-08T08:20:42.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.053+0000 7f51eb7fe640 1 -- 172.21.15.88:0/1171081081 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7f51e4054dd0 con 0x7f51f406c020 2023-12-08T08:20:42.057 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:42.057 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:20:21.492555+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:18.675917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:19.511013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:42.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.053+0000 7f51f8879640 1 -- 172.21.15.88:0/1171081081 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f51d4066470 msgr2=0x7f51d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.053+0000 7f51f8879640 1 --2- 172.21.15.88:0/1171081081 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f51d4066470 0x7f51d4068930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f51f40bfdf0 tx=0x7f51dc009190 comp rx=0 tx=0).stop 2023-12-08T08:20:42.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.053+0000 7f51f8879640 1 -- 172.21.15.88:0/1171081081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51f406c020 msgr2=0x7f51f4144e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.053+0000 7f51f8879640 1 --2- 172.21.15.88:0/1171081081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51f406c020 0x7f51f4144e40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f51e400d800 tx=0x7f51e400dcc0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.053+0000 7f51f8879640 1 -- 172.21.15.88:0/1171081081 shutdown_connections 2023-12-08T08:20:42.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.053+0000 7f51f8879640 1 --2- 172.21.15.88:0/1171081081 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f51d4066470 0x7f51d4068930 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.053+0000 7f51f8879640 1 --2- 172.21.15.88:0/1171081081 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51f40c3b80 0x7f51f41ec990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.053+0000 7f51f8879640 1 --2- 172.21.15.88:0/1171081081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51f406d2b0 0x7f51f414d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.053+0000 7f51f8879640 1 --2- 172.21.15.88:0/1171081081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51f406c020 0x7f51f4144e40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.053+0000 7f51f8879640 1 -- 172.21.15.88:0/1171081081 >> 172.21.15.88:0/1171081081 conn(0x7f51f40a7810 msgr2=0x7f51f40a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:42.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.053+0000 7f51f8879640 1 -- 172.21.15.88:0/1171081081 shutdown_connections 2023-12-08T08:20:42.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.053+0000 7f51f8879640 1 -- 172.21.15.88:0/1171081081 wait complete. 2023-12-08T08:20:42.078 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:20:18.675917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:20:19.511013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:20:42.079 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:20:42.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.213+0000 7f06e8301640 1 Processor -- start 2023-12-08T08:20:42.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.213+0000 7f06e8301640 1 -- start start 2023-12-08T08:20:42.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.213+0000 7f06e8301640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06e0151db0 0x7f06e00a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:42.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.213+0000 7f06e8301640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f06e00c4a20 0x7f06e00c14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:42.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.213+0000 7f06e8301640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e00a65d0 con 0x7f06e00c19e0 2023-12-08T08:20:42.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.213+0000 7f06e8301640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e0154570 con 0x7f06e00c4a20 2023-12-08T08:20:42.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.213+0000 7f06e8301640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e0155520 con 0x7f06e0151db0 2023-12-08T08:20:42.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.213+0000 7f06e689e640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f06e00c19e0 0x7f06e0157b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36502/0 (socket says 172.21.15.88:36502) 2023-12-08T08:20:42.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.213+0000 7f06e689e640 1 -- 172.21.15.88:0/1191051468 learned_addr learned my addr 172.21.15.88:0/1191051468 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:42.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.213+0000 7f06e589c640 1 --2- 172.21.15.88:0/1191051468 >> v2:172.21.15.148:3300/0 conn(0x7f06e00c4a20 0x7f06e00c14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:42.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.213+0000 7f06e609d640 1 --2- 172.21.15.88:0/1191051468 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06e0151db0 0x7f06e00a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:42.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.213+0000 7f06e509b640 1 -- 172.21.15.88:0/1191051468 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 689770856 0 0) 0x7f06e00a65d0 con 0x7f06e00c19e0 2023-12-08T08:20:42.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.213+0000 7f06e509b640 1 -- 172.21.15.88:0/1191051468 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06cc003530 con 0x7f06e00c19e0 2023-12-08T08:20:42.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.213+0000 7f06e589c640 1 -- 172.21.15.88:0/1191051468 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06e0151db0 msgr2=0x7f06e00a5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:42.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.213+0000 7f06e589c640 1 --2- 172.21.15.88:0/1191051468 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06e0151db0 0x7f06e00a5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.213+0000 7f06e589c640 1 -- 172.21.15.88:0/1191051468 >> v1:172.21.15.88:6789/0 conn(0x7f06e00c19e0 legacy=0x7f06e0157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.213+0000 7f06e589c640 1 -- 172.21.15.88:0/1191051468 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e0154780 con 0x7f06e00c4a20 2023-12-08T08:20:42.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.217+0000 7f06e589c640 1 --2- 172.21.15.88:0/1191051468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06e00c4a20 0x7f06e00c14a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f06d00097c0 tx=0x7f06d001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8aa30030fc397aea server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:42.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.217+0000 7f06e509b640 1 -- 172.21.15.88:0/1191051468 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d00ab600 con 0x7f06e00c4a20 2023-12-08T08:20:42.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.217+0000 7f06e509b640 1 -- 172.21.15.88:0/1191051468 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d00a7050 con 0x7f06e00c4a20 2023-12-08T08:20:42.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.217+0000 7f06e509b640 1 -- 172.21.15.88:0/1191051468 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d00ab980 con 0x7f06e00c4a20 2023-12-08T08:20:42.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.217+0000 7f06e8301640 1 -- 172.21.15.88:0/1191051468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06e00c4a20 msgr2=0x7f06e00c14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.217+0000 7f06e8301640 1 --2- 172.21.15.88:0/1191051468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06e00c4a20 0x7f06e00c14a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f06d00097c0 tx=0x7f06d001c3f0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.217+0000 7f06e8301640 1 -- 172.21.15.88:0/1191051468 shutdown_connections 2023-12-08T08:20:42.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.217+0000 7f06e8301640 1 --2- 172.21.15.88:0/1191051468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06e00c4a20 0x7f06e00c14a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.217+0000 7f06e8301640 1 --2- 172.21.15.88:0/1191051468 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06e0151db0 0x7f06e00a5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.217+0000 7f06e8301640 1 -- 172.21.15.88:0/1191051468 >> 172.21.15.88:0/1191051468 conn(0x7f06e00c6b20 msgr2=0x7f06e00c6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:42.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.217+0000 7f06e8301640 1 -- 172.21.15.88:0/1191051468 shutdown_connections 2023-12-08T08:20:42.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.217+0000 7f06e8301640 1 -- 172.21.15.88:0/1191051468 wait complete. 2023-12-08T08:20:42.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.221+0000 7f06e8301640 1 Processor -- start 2023-12-08T08:20:42.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.221+0000 7f06e8301640 1 -- start start 2023-12-08T08:20:42.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.221+0000 7f06e8301640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06e00c19e0 0x7f06e00ab120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:42.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.221+0000 7f06e8301640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06e00c4a20 0x7f06e01f0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:42.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.221+0000 7f06e8301640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06e0151db0 0x7f06e006e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:42.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.221+0000 7f06e8301640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e00a9cc0 con 0x7f06e00c4a20 2023-12-08T08:20:42.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.221+0000 7f06e8301640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e01ed540 con 0x7f06e0151db0 2023-12-08T08:20:42.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.221+0000 7f06e8301640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e00ac180 con 0x7f06e00c19e0 2023-12-08T08:20:42.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.221+0000 7f06e589c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06e00c4a20 0x7f06e01f0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:42.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.221+0000 7f06e589c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06e00c4a20 0x7f06e01f0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60328/0 (socket says 172.21.15.88:60328) 2023-12-08T08:20:42.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.221+0000 7f06e589c640 1 -- 172.21.15.88:0/1445157899 learned_addr learned my addr 172.21.15.88:0/1445157899 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:42.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.221+0000 7f06e689e640 1 --2- 172.21.15.88:0/1445157899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06e0151db0 0x7f06e006e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:42.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.221+0000 7f06e609d640 1 --2- 172.21.15.88:0/1445157899 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06e00c19e0 0x7f06e00ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:42.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.221+0000 7f06e589c640 1 -- 172.21.15.88:0/1445157899 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06e00c19e0 msgr2=0x7f06e00ab120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.221+0000 7f06e589c640 1 --2- 172.21.15.88:0/1445157899 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06e00c19e0 0x7f06e00ab120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.221+0000 7f06e589c640 1 -- 172.21.15.88:0/1445157899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06e0151db0 msgr2=0x7f06e006e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.221+0000 7f06e589c640 1 --2- 172.21.15.88:0/1445157899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06e0151db0 0x7f06e006e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.221+0000 7f06e589c640 1 -- 172.21.15.88:0/1445157899 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d0009420 con 0x7f06e00c4a20 2023-12-08T08:20:42.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.221+0000 7f06e689e640 1 --2- 172.21.15.88:0/1445157899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06e0151db0 0x7f06e006e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:42.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.221+0000 7f06e609d640 1 --2- 172.21.15.88:0/1445157899 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06e00c19e0 0x7f06e00ab120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:42.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.221+0000 7f06e589c640 1 --2- 172.21.15.88:0/1445157899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06e00c4a20 0x7f06e01f0920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f06d00ae040 tx=0x7f06d0019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:42.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.221+0000 7f06d6ffd640 1 -- 172.21.15.88:0/1445157899 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d00b4430 con 0x7f06e00c4a20 2023-12-08T08:20:42.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.221+0000 7f06d6ffd640 1 -- 172.21.15.88:0/1445157899 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d00b45b0 con 0x7f06e00c4a20 2023-12-08T08:20:42.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.221+0000 7f06d6ffd640 1 -- 172.21.15.88:0/1445157899 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d00b4960 con 0x7f06e00c4a20 2023-12-08T08:20:42.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.221+0000 7f06e8301640 1 -- 172.21.15.88:0/1445157899 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e01f0490 con 0x7f06e00c4a20 2023-12-08T08:20:42.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.221+0000 7f06e8301640 1 -- 172.21.15.88:0/1445157899 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e00ab660 con 0x7f06e00c4a20 2023-12-08T08:20:42.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.225+0000 7f06e8301640 1 -- 172.21.15.88:0/1445157899 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e01f0620 con 0x7f06e00c4a20 2023-12-08T08:20:42.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.225+0000 7f06d6ffd640 1 -- 172.21.15.88:0/1445157899 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f06d00b2040 con 0x7f06e00c4a20 2023-12-08T08:20:42.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.225+0000 7f06d6ffd640 1 --2- 172.21.15.88:0/1445157899 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f06c40664a0 0x7f06c4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:42.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.225+0000 7f06d6ffd640 1 -- 172.21.15.88:0/1445157899 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06d011dd20 con 0x7f06e00c4a20 2023-12-08T08:20:42.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.225+0000 7f06e609d640 1 --2- 172.21.15.88:0/1445157899 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f06c40664a0 0x7f06c4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:42.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.225+0000 7f06e609d640 1 --2- 172.21.15.88:0/1445157899 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f06c40664a0 0x7f06c4068960 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009a40 tx=0x7f06dc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:42.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.229+0000 7f06d6ffd640 1 -- 172.21.15.88:0/1445157899 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f06d00eb190 con 0x7f06e00c4a20 2023-12-08T08:20:42.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.381+0000 7f06e8301640 1 -- 172.21.15.88:0/1445157899 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f06e0067630 con 0x7f06e00c4a20 2023-12-08T08:20:42.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.381+0000 7f06d6ffd640 1 -- 172.21.15.88:0/1445157899 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f06d00ee7b0 con 0x7f06e00c4a20 2023-12-08T08:20:42.386 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:20:42.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.381+0000 7f06e8301640 1 -- 172.21.15.88:0/1445157899 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f06c40664a0 msgr2=0x7f06c4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.381+0000 7f06e8301640 1 --2- 172.21.15.88:0/1445157899 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f06c40664a0 0x7f06c4068960 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009a40 tx=0x7f06dc008040 comp rx=0 tx=0).stop 2023-12-08T08:20:42.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.381+0000 7f06e8301640 1 -- 172.21.15.88:0/1445157899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06e00c4a20 msgr2=0x7f06e01f0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.381+0000 7f06e8301640 1 --2- 172.21.15.88:0/1445157899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06e00c4a20 0x7f06e01f0920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f06d00ae040 tx=0x7f06d0019190 comp rx=0 tx=0).stop 2023-12-08T08:20:42.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.381+0000 7f06e8301640 1 -- 172.21.15.88:0/1445157899 shutdown_connections 2023-12-08T08:20:42.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.381+0000 7f06e8301640 1 --2- 172.21.15.88:0/1445157899 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f06c40664a0 0x7f06c4068960 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.381+0000 7f06e8301640 1 --2- 172.21.15.88:0/1445157899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06e0151db0 0x7f06e006e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.381+0000 7f06e8301640 1 --2- 172.21.15.88:0/1445157899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06e00c4a20 0x7f06e01f0920 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.381+0000 7f06e8301640 1 --2- 172.21.15.88:0/1445157899 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06e00c19e0 0x7f06e00ab120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.381+0000 7f06e8301640 1 -- 172.21.15.88:0/1445157899 >> 172.21.15.88:0/1445157899 conn(0x7f06e00c6b20 msgr2=0x7f06e0151070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:42.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.381+0000 7f06e8301640 1 -- 172.21.15.88:0/1445157899 shutdown_connections 2023-12-08T08:20:42.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.381+0000 7f06e8301640 1 -- 172.21.15.88:0/1445157899 wait complete. 2023-12-08T08:20:42.406 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:20:42.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.541+0000 7f4d0f72a640 1 Processor -- start 2023-12-08T08:20:42.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.541+0000 7f4d0f72a640 1 -- start start 2023-12-08T08:20:42.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.541+0000 7f4d0f72a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4d0814fc30 0x7f4d080c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:42.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.541+0000 7f4d0f72a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d08152910 con 0x7f4d0806d840 2023-12-08T08:20:42.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.545+0000 7f4d0f72a640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d08152bf0 con 0x7f4d0814f850 2023-12-08T08:20:42.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.545+0000 7f4d0f72a640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d080c2240 con 0x7f4d0814fc30 2023-12-08T08:20:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.545+0000 7f4d0dcc7640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4d0806d840 0x7f4d080c4210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36514/0 (socket says 172.21.15.88:36514) 2023-12-08T08:20:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.545+0000 7f4d0dcc7640 1 -- 172.21.15.88:0/3869327832 learned_addr learned my addr 172.21.15.88:0/3869327832 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.545+0000 7f4d0ccc5640 1 --2- 172.21.15.88:0/3869327832 >> v2:172.21.15.148:3300/0 conn(0x7f4d0814fc30 0x7f4d080c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.545+0000 7f4cfffff640 1 -- 172.21.15.88:0/3869327832 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522954431 0 0) 0x7f4d08152910 con 0x7f4d0806d840 2023-12-08T08:20:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.545+0000 7f4cfffff640 1 -- 172.21.15.88:0/3869327832 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cf4003530 con 0x7f4d0806d840 2023-12-08T08:20:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.545+0000 7f4cfffff640 1 -- 172.21.15.88:0/3869327832 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3921488245 0 0) 0x7f4d08152bf0 con 0x7f4d0814f850 2023-12-08T08:20:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.545+0000 7f4cfffff640 1 -- 172.21.15.88:0/3869327832 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d08152910 con 0x7f4d0814f850 2023-12-08T08:20:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.545+0000 7f4d0ccc5640 1 -- 172.21.15.88:0/3869327832 >> v1:172.21.15.148:6789/0 conn(0x7f4d0814f850 legacy=0x7f4d080aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.545+0000 7f4d0ccc5640 1 -- 172.21.15.88:0/3869327832 >> v1:172.21.15.88:6789/0 conn(0x7f4d0806d840 legacy=0x7f4d080c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.545+0000 7f4d0ccc5640 1 -- 172.21.15.88:0/3869327832 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d08152ed0 con 0x7f4d0814fc30 2023-12-08T08:20:42.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.545+0000 7f4d0ccc5640 1 --2- 172.21.15.88:0/3869327832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d0814fc30 0x7f4d080c3cd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4cf80097c0 tx=0x7f4cf801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6915d69a8d60db2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:42.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.549+0000 7f4cfffff640 1 -- 172.21.15.88:0/3869327832 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf80a6040 con 0x7f4d0814fc30 2023-12-08T08:20:42.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.549+0000 7f4cfffff640 1 -- 172.21.15.88:0/3869327832 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf80aa600 con 0x7f4d0814fc30 2023-12-08T08:20:42.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.549+0000 7f4cfffff640 1 -- 172.21.15.88:0/3869327832 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf80aa990 con 0x7f4d0814fc30 2023-12-08T08:20:42.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.549+0000 7f4d0f72a640 1 -- 172.21.15.88:0/3869327832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d0814fc30 msgr2=0x7f4d080c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.549+0000 7f4d0f72a640 1 --2- 172.21.15.88:0/3869327832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d0814fc30 0x7f4d080c3cd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4cf80097c0 tx=0x7f4cf801c480 comp rx=0 tx=0).stop 2023-12-08T08:20:42.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.549+0000 7f4d0f72a640 1 -- 172.21.15.88:0/3869327832 shutdown_connections 2023-12-08T08:20:42.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.549+0000 7f4d0f72a640 1 --2- 172.21.15.88:0/3869327832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d0814fc30 0x7f4d080c3cd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.549+0000 7f4d0f72a640 1 -- 172.21.15.88:0/3869327832 >> 172.21.15.88:0/3869327832 conn(0x7f4d080c59f0 msgr2=0x7f4d080c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:42.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.549+0000 7f4d0f72a640 1 -- 172.21.15.88:0/3869327832 shutdown_connections 2023-12-08T08:20:42.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.549+0000 7f4d0f72a640 1 -- 172.21.15.88:0/3869327832 wait complete. 2023-12-08T08:20:42.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.549+0000 7f4d0f72a640 1 Processor -- start 2023-12-08T08:20:42.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.549+0000 7f4d0f72a640 1 -- start start 2023-12-08T08:20:42.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.549+0000 7f4d0f72a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d0806d840 0x7f4d0814cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:42.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.549+0000 7f4d0f72a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d0814f850 0x7f4d080a9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:42.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.549+0000 7f4d0f72a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d0814fc30 0x7f4d0806fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:42.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.549+0000 7f4d0f72a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0814be20 con 0x7f4d0814f850 2023-12-08T08:20:42.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.549+0000 7f4d0f72a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0814c9a0 con 0x7f4d0806d840 2023-12-08T08:20:42.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.549+0000 7f4d0f72a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0814d300 con 0x7f4d0814fc30 2023-12-08T08:20:42.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.549+0000 7f4d0ccc5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d0814f850 0x7f4d080a9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:42.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.549+0000 7f4d0ccc5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d0814f850 0x7f4d080a9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60334/0 (socket says 172.21.15.88:60334) 2023-12-08T08:20:42.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.549+0000 7f4d0ccc5640 1 -- 172.21.15.88:0/3080608512 learned_addr learned my addr 172.21.15.88:0/3080608512 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:42.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.549+0000 7f4d0d4c6640 1 --2- 172.21.15.88:0/3080608512 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d0806d840 0x7f4d0814cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:42.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.549+0000 7f4d0dcc7640 1 --2- 172.21.15.88:0/3080608512 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d0814fc30 0x7f4d0806fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:42.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.553+0000 7f4d0ccc5640 1 -- 172.21.15.88:0/3080608512 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d0814fc30 msgr2=0x7f4d0806fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.553+0000 7f4d0ccc5640 1 --2- 172.21.15.88:0/3080608512 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d0814fc30 0x7f4d0806fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.553+0000 7f4d0ccc5640 1 -- 172.21.15.88:0/3080608512 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d0806d840 msgr2=0x7f4d0814cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.553+0000 7f4d0ccc5640 1 --2- 172.21.15.88:0/3080608512 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d0806d840 0x7f4d0814cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.553+0000 7f4d0ccc5640 1 -- 172.21.15.88:0/3080608512 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf8009420 con 0x7f4d0814f850 2023-12-08T08:20:42.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.553+0000 7f4d0d4c6640 1 --2- 172.21.15.88:0/3080608512 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d0806d840 0x7f4d0814cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:42.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.553+0000 7f4d0ccc5640 1 --2- 172.21.15.88:0/3080608512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d0814f850 0x7f4d080a9d90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8019090 tx=0x7f4cf801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:42.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.553+0000 7f4cfdffb640 1 -- 172.21.15.88:0/3080608512 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8006e20 con 0x7f4d0814f850 2023-12-08T08:20:42.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.553+0000 7f4cfdffb640 1 -- 172.21.15.88:0/3080608512 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf80a6030 con 0x7f4d0814f850 2023-12-08T08:20:42.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.553+0000 7f4d0f72a640 1 -- 172.21.15.88:0/3080608512 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d080aa7e0 con 0x7f4d0814f850 2023-12-08T08:20:42.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.553+0000 7f4cfdffb640 1 -- 172.21.15.88:0/3080608512 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf80b3840 con 0x7f4d0814f850 2023-12-08T08:20:42.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.553+0000 7f4d0f72a640 1 -- 172.21.15.88:0/3080608512 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0814c2e0 con 0x7f4d0814f850 2023-12-08T08:20:42.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.553+0000 7f4d0f72a640 1 -- 172.21.15.88:0/3080608512 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d08067630 con 0x7f4d0814f850 2023-12-08T08:20:42.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.553+0000 7f4cfdffb640 1 -- 172.21.15.88:0/3080608512 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4cf80b39a0 con 0x7f4d0814f850 2023-12-08T08:20:42.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.553+0000 7f4cfdffb640 1 --2- 172.21.15.88:0/3080608512 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4cec066470 0x7f4cec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:42.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.553+0000 7f4cfdffb640 1 -- 172.21.15.88:0/3080608512 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4cf811dc10 con 0x7f4d0814f850 2023-12-08T08:20:42.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.553+0000 7f4d0d4c6640 1 --2- 172.21.15.88:0/3080608512 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4cec066470 0x7f4cec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:42.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.557+0000 7f4d0d4c6640 1 --2- 172.21.15.88:0/3080608512 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4cec066470 0x7f4cec068930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4d040011f0 tx=0x7f4d04009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:42.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.557+0000 7f4cfdffb640 1 -- 172.21.15.88:0/3080608512 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4cf80eaff0 con 0x7f4d0814f850 2023-12-08T08:20:42.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.705+0000 7f4d0f72a640 1 -- 172.21.15.88:0/3080608512 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4d080a4a90 con 0x7f4d0814f850 2023-12-08T08:20:42.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.709+0000 7f4cfdffb640 1 -- 172.21.15.88:0/3080608512 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4cf80ee610 con 0x7f4d0814f850 2023-12-08T08:20:42.713 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:20:42.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.709+0000 7f4d0f72a640 1 -- 172.21.15.88:0/3080608512 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4cec066470 msgr2=0x7f4cec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.709+0000 7f4d0f72a640 1 --2- 172.21.15.88:0/3080608512 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4cec066470 0x7f4cec068930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4d040011f0 tx=0x7f4d04009040 comp rx=0 tx=0).stop 2023-12-08T08:20:42.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.709+0000 7f4d0f72a640 1 -- 172.21.15.88:0/3080608512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d0814f850 msgr2=0x7f4d080a9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.709+0000 7f4d0f72a640 1 --2- 172.21.15.88:0/3080608512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d0814f850 0x7f4d080a9d90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8019090 tx=0x7f4cf801acc0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.709+0000 7f4d0f72a640 1 -- 172.21.15.88:0/3080608512 shutdown_connections 2023-12-08T08:20:42.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.709+0000 7f4d0f72a640 1 --2- 172.21.15.88:0/3080608512 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4cec066470 0x7f4cec068930 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.709+0000 7f4d0f72a640 1 --2- 172.21.15.88:0/3080608512 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d0814fc30 0x7f4d0806fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.709+0000 7f4d0f72a640 1 --2- 172.21.15.88:0/3080608512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d0814f850 0x7f4d080a9d90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.709+0000 7f4d0f72a640 1 --2- 172.21.15.88:0/3080608512 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d0806d840 0x7f4d0814cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.709+0000 7f4d0f72a640 1 -- 172.21.15.88:0/3080608512 >> 172.21.15.88:0/3080608512 conn(0x7f4d080c59f0 msgr2=0x7f4d08151000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:42.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.709+0000 7f4d0f72a640 1 -- 172.21.15.88:0/3080608512 shutdown_connections 2023-12-08T08:20:42.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.709+0000 7f4d0f72a640 1 -- 172.21.15.88:0/3080608512 wait complete. 2023-12-08T08:20:42.734 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:20:42.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.869+0000 7fcc5b59e640 1 Processor -- start 2023-12-08T08:20:42.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.869+0000 7fcc5b59e640 1 -- start start 2023-12-08T08:20:42.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc5b59e640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcc5c0c7640 0x7fcc5c0a7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:42.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc5b59e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc5c0c3180 con 0x7fcc5c06fba0 2023-12-08T08:20:42.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc5b59e640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc5c0c69e0 con 0x7fcc5c0c47c0 2023-12-08T08:20:42.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc5b59e640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc5c0c2bc0 con 0x7fcc5c0c7640 2023-12-08T08:20:42.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc5ad9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcc5c06fba0 0x7fcc5c156f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36526/0 (socket says 172.21.15.88:36526) 2023-12-08T08:20:42.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc5ad9d640 1 -- 172.21.15.88:0/3651863553 learned_addr learned my addr 172.21.15.88:0/3651863553 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:42.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc59d9b640 1 -- 172.21.15.88:0/3651863553 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1136691280 0 0) 0x7fcc54001120 con 0x7fcc5c06fba0 2023-12-08T08:20:42.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc59d9b640 1 -- 172.21.15.88:0/3651863553 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc48003530 con 0x7fcc5c06fba0 2023-12-08T08:20:42.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc51d9b640 1 --2- 172.21.15.88:0/3651863553 >> v2:172.21.15.148:3300/0 conn(0x7fcc5c0c7640 0x7fcc5c0a7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:42.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc59d9b640 1 -- 172.21.15.88:0/3651863553 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3820902255 0 0) 0x7fcc48003530 con 0x7fcc5c06fba0 2023-12-08T08:20:42.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc59d9b640 1 -- 172.21.15.88:0/3651863553 >> v2:172.21.15.148:3300/0 conn(0x7fcc5c0c7640 msgr2=0x7fcc5c0a7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:42.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc59d9b640 1 --2- 172.21.15.88:0/3651863553 >> v2:172.21.15.148:3300/0 conn(0x7fcc5c0c7640 0x7fcc5c0a7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc59d9b640 1 -- 172.21.15.88:0/3651863553 >> v1:172.21.15.148:6789/0 conn(0x7fcc5c0c47c0 legacy=0x7fcc5c0c0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc59d9b640 1 -- 172.21.15.88:0/3651863553 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c0c2ea0 con 0x7fcc5c06fba0 2023-12-08T08:20:42.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc59d9b640 1 -- 172.21.15.88:0/3651863553 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7fcc54001810 con 0x7fcc5c06fba0 2023-12-08T08:20:42.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc59d9b640 1 -- 172.21.15.88:0/3651863553 >> v1:172.21.15.88:6789/0 conn(0x7fcc5c06fba0 legacy=0x7fcc5c156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc59d9b640 1 --2- 172.21.15.88:0/3651863553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc480039b0 0x7fcc48003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:42.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc59d9b640 1 --2- 172.21.15.88:0/3651863553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc480047d0 0x7fcc48004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:42.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc59d9b640 1 --2- 172.21.15.88:0/3651863553 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc480051e0 0x7fcc4800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:42.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc59d9b640 1 -- 172.21.15.88:0/3651863553 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c0c2bc0 con 0x7fcc480047d0 2023-12-08T08:20:42.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc59d9b640 1 -- 172.21.15.88:0/3651863553 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4800c110 con 0x7fcc480039b0 2023-12-08T08:20:42.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc59d9b640 1 -- 172.21.15.88:0/3651863553 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4800c2d0 con 0x7fcc480051e0 2023-12-08T08:20:42.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc51d9b640 1 --2- 172.21.15.88:0/3651863553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc480047d0 0x7fcc48004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:42.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc5a59c640 1 --2- 172.21.15.88:0/3651863553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc480039b0 0x7fcc48003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:42.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc5ad9d640 1 --2- 172.21.15.88:0/3651863553 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc480051e0 0x7fcc4800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:42.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc51d9b640 1 -- 172.21.15.88:0/3651863553 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc480051e0 msgr2=0x7fcc4800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:42.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc51d9b640 1 --2- 172.21.15.88:0/3651863553 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc480051e0 0x7fcc4800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc51d9b640 1 -- 172.21.15.88:0/3651863553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc480039b0 msgr2=0x7fcc48003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:42.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc51d9b640 1 --2- 172.21.15.88:0/3651863553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc480039b0 0x7fcc48003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc51d9b640 1 -- 172.21.15.88:0/3651863553 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc48003530 con 0x7fcc480047d0 2023-12-08T08:20:42.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.873+0000 7fcc5ad9d640 1 -- 172.21.15.88:0/3651863553 reap_dead start 2023-12-08T08:20:42.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.877+0000 7fcc51d9b640 1 --2- 172.21.15.88:0/3651863553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc480047d0 0x7fcc48004c50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcc44007330 tx=0x7fcc4401ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ca2fb576de6444 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:42.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.877+0000 7fcc59d9b640 1 -- 172.21.15.88:0/3651863553 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc440a5d00 con 0x7fcc480047d0 2023-12-08T08:20:42.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.877+0000 7fcc59d9b640 1 -- 172.21.15.88:0/3651863553 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc440a5e60 con 0x7fcc480047d0 2023-12-08T08:20:42.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.877+0000 7fcc59d9b640 1 -- 172.21.15.88:0/3651863553 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc440ad660 con 0x7fcc480047d0 2023-12-08T08:20:42.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.877+0000 7fcc5b59e640 1 -- 172.21.15.88:0/3651863553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc480047d0 msgr2=0x7fcc48004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.877+0000 7fcc5b59e640 1 --2- 172.21.15.88:0/3651863553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc480047d0 0x7fcc48004c50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcc44007330 tx=0x7fcc4401ce00 comp rx=0 tx=0).stop 2023-12-08T08:20:42.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.877+0000 7fcc5b59e640 1 -- 172.21.15.88:0/3651863553 shutdown_connections 2023-12-08T08:20:42.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.877+0000 7fcc5b59e640 1 --2- 172.21.15.88:0/3651863553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc480047d0 0x7fcc48004c50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.877+0000 7fcc5b59e640 1 -- 172.21.15.88:0/3651863553 >> 172.21.15.88:0/3651863553 conn(0x7fcc5c0c7af0 msgr2=0x7fcc5c0c7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:42.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.877+0000 7fcc5b59e640 1 -- 172.21.15.88:0/3651863553 shutdown_connections 2023-12-08T08:20:42.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.877+0000 7fcc5b59e640 1 -- 172.21.15.88:0/3651863553 wait complete. 2023-12-08T08:20:42.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.877+0000 7fcc5b59e640 1 Processor -- start 2023-12-08T08:20:42.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.877+0000 7fcc5b59e640 1 -- start start 2023-12-08T08:20:42.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.881+0000 7fcc5b59e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc480047d0 0x7fcc5c156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:42.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.881+0000 7fcc5b59e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc5c09e0f0 0x7fcc5c149aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:42.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.881+0000 7fcc5b59e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc5c1541a0 0x7fcc5c149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:42.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.881+0000 7fcc5b59e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c09d5c0 con 0x7fcc5c09e0f0 2023-12-08T08:20:42.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.881+0000 7fcc5b59e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c1ee530 con 0x7fcc480047d0 2023-12-08T08:20:42.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.881+0000 7fcc5b59e640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c14a520 con 0x7fcc5c1541a0 2023-12-08T08:20:42.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.881+0000 7fcc51d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc5c09e0f0 0x7fcc5c149aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:42.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.881+0000 7fcc51d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc5c09e0f0 0x7fcc5c149aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60356/0 (socket says 172.21.15.88:60356) 2023-12-08T08:20:42.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.881+0000 7fcc51d9b640 1 -- 172.21.15.88:0/1046208183 learned_addr learned my addr 172.21.15.88:0/1046208183 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:42.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.881+0000 7fcc5a59c640 1 --2- 172.21.15.88:0/1046208183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc480047d0 0x7fcc5c156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:42.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.881+0000 7fcc5ad9d640 1 --2- 172.21.15.88:0/1046208183 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc5c1541a0 0x7fcc5c149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:42.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.881+0000 7fcc51d9b640 1 -- 172.21.15.88:0/1046208183 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc5c1541a0 msgr2=0x7fcc5c149fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.881+0000 7fcc51d9b640 1 --2- 172.21.15.88:0/1046208183 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc5c1541a0 0x7fcc5c149fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.881+0000 7fcc51d9b640 1 -- 172.21.15.88:0/1046208183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc480047d0 msgr2=0x7fcc5c156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.881+0000 7fcc51d9b640 1 --2- 172.21.15.88:0/1046208183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc480047d0 0x7fcc5c156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.881+0000 7fcc51d9b640 1 -- 172.21.15.88:0/1046208183 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c1ed640 con 0x7fcc5c09e0f0 2023-12-08T08:20:42.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.881+0000 7fcc51d9b640 1 --2- 172.21.15.88:0/1046208183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc5c09e0f0 0x7fcc5c149aa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcc44000f90 tx=0x7fcc44019ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:42.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.881+0000 7fcc537fe640 1 -- 172.21.15.88:0/1046208183 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc440bc070 con 0x7fcc5c09e0f0 2023-12-08T08:20:42.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.881+0000 7fcc537fe640 1 -- 172.21.15.88:0/1046208183 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc440b8470 con 0x7fcc5c09e0f0 2023-12-08T08:20:42.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.881+0000 7fcc537fe640 1 -- 172.21.15.88:0/1046208183 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc440b8840 con 0x7fcc5c09e0f0 2023-12-08T08:20:42.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.881+0000 7fcc5b59e640 1 -- 172.21.15.88:0/1046208183 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc5c1ed920 con 0x7fcc5c09e0f0 2023-12-08T08:20:42.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.881+0000 7fcc5b59e640 1 -- 172.21.15.88:0/1046208183 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc5c1edee0 con 0x7fcc5c09e0f0 2023-12-08T08:20:42.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.881+0000 7fcc5b59e640 1 -- 172.21.15.88:0/1046208183 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc5c0674b0 con 0x7fcc5c09e0f0 2023-12-08T08:20:42.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.881+0000 7fcc537fe640 1 -- 172.21.15.88:0/1046208183 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcc440add50 con 0x7fcc5c09e0f0 2023-12-08T08:20:42.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.885+0000 7fcc537fe640 1 --2- 172.21.15.88:0/1046208183 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcc3c0664a0 0x7fcc3c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:42.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.885+0000 7fcc537fe640 1 -- 172.21.15.88:0/1046208183 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc4411e6b0 con 0x7fcc5c09e0f0 2023-12-08T08:20:42.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.885+0000 7fcc5a59c640 1 --2- 172.21.15.88:0/1046208183 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcc3c0664a0 0x7fcc3c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:42.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.885+0000 7fcc5a59c640 1 --2- 172.21.15.88:0/1046208183 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcc3c0664a0 0x7fcc3c068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c067b60 tx=0x7fcc4c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:42.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:42.889+0000 7fcc537fe640 1 -- 172.21.15.88:0/1046208183 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcc440eba90 con 0x7fcc5c09e0f0 2023-12-08T08:20:43.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.037+0000 7fcc5b59e640 1 -- 172.21.15.88:0/1046208183 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcc5c1ea0d0 con 0x7fcc5c09e0f0 2023-12-08T08:20:43.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.037+0000 7fcc537fe640 1 -- 172.21.15.88:0/1046208183 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcc440ef0b0 con 0x7fcc5c09e0f0 2023-12-08T08:20:43.043 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:20:43.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.037+0000 7fcc5b59e640 1 -- 172.21.15.88:0/1046208183 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcc3c0664a0 msgr2=0x7fcc3c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:43.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.037+0000 7fcc5b59e640 1 --2- 172.21.15.88:0/1046208183 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcc3c0664a0 0x7fcc3c068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c067b60 tx=0x7fcc4c009040 comp rx=0 tx=0).stop 2023-12-08T08:20:43.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.037+0000 7fcc5b59e640 1 -- 172.21.15.88:0/1046208183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc5c09e0f0 msgr2=0x7fcc5c149aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:43.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.037+0000 7fcc5b59e640 1 --2- 172.21.15.88:0/1046208183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc5c09e0f0 0x7fcc5c149aa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcc44000f90 tx=0x7fcc44019ba0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.037+0000 7fcc5b59e640 1 -- 172.21.15.88:0/1046208183 shutdown_connections 2023-12-08T08:20:43.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.037+0000 7fcc5b59e640 1 --2- 172.21.15.88:0/1046208183 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcc3c0664a0 0x7fcc3c068960 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.037+0000 7fcc5b59e640 1 --2- 172.21.15.88:0/1046208183 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc5c1541a0 0x7fcc5c149fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.037+0000 7fcc5b59e640 1 --2- 172.21.15.88:0/1046208183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc5c09e0f0 0x7fcc5c149aa0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.037+0000 7fcc5b59e640 1 --2- 172.21.15.88:0/1046208183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc480047d0 0x7fcc5c156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.037+0000 7fcc5b59e640 1 -- 172.21.15.88:0/1046208183 >> 172.21.15.88:0/1046208183 conn(0x7fcc5c0c7af0 msgr2=0x7fcc5c06ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:43.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.037+0000 7fcc5b59e640 1 -- 172.21.15.88:0/1046208183 shutdown_connections 2023-12-08T08:20:43.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.037+0000 7fcc5b59e640 1 -- 172.21.15.88:0/1046208183 wait complete. 2023-12-08T08:20:43.065 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:43.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.197+0000 7f8f681aa640 1 Processor -- start 2023-12-08T08:20:43.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.197+0000 7f8f681aa640 1 -- start start 2023-12-08T08:20:43.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.197+0000 7f8f681aa640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8f6014fd10 0x7f8f600a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:43.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.197+0000 7f8f681aa640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f600a5300 0x7f8f60071e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:43.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.197+0000 7f8f681aa640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f600c5710 con 0x7f8f60072370 2023-12-08T08:20:43.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.197+0000 7f8f681aa640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f6006c5e0 con 0x7f8f6014fd10 2023-12-08T08:20:43.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.197+0000 7f8f681aa640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f60155c80 con 0x7f8f600a5300 2023-12-08T08:20:43.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.197+0000 7f8f65f46640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8f6014fd10 0x7f8f600a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:43.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.197+0000 7f8f65745640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f600a5300 0x7f8f60071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:43.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.197+0000 7f8f66747640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f8f60072370 0x7f8f60156110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:44702/0 (socket says 172.21.15.88:44702) 2023-12-08T08:20:43.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.197+0000 7f8f66747640 1 -- 172.21.15.88:0/3355556341 learned_addr learned my addr 172.21.15.88:0/3355556341 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:43.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.201+0000 7f8f64f44640 1 -- 172.21.15.88:0/3355556341 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2193330945 0 0) 0x7f8f600c5710 con 0x7f8f60072370 2023-12-08T08:20:43.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.201+0000 7f8f65745640 1 -- 172.21.15.88:0/3355556341 >> v2:172.21.15.148:3300/0 conn(0x7f8f6014fd10 msgr2=0x7f8f600a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:43.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.201+0000 7f8f65745640 1 --2- 172.21.15.88:0/3355556341 >> v2:172.21.15.148:3300/0 conn(0x7f8f6014fd10 0x7f8f600a4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.201+0000 7f8f65745640 1 -- 172.21.15.88:0/3355556341 >> v1:172.21.15.148:6789/0 conn(0x7f8f60072370 legacy=0x7f8f60156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:43.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.201+0000 7f8f65745640 1 -- 172.21.15.88:0/3355556341 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f600c4e70 con 0x7f8f600a5300 2023-12-08T08:20:43.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.201+0000 7f8f65f46640 1 --2- 172.21.15.88:0/3355556341 >> v2:172.21.15.148:3300/0 conn(0x7f8f6014fd10 0x7f8f600a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:43.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.201+0000 7f8f65745640 1 --2- 172.21.15.88:0/3355556341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f600a5300 0x7f8f60071e30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8f500097c0 tx=0x7f8f5001c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81f46b1623758734 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:43.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.201+0000 7f8f64f44640 1 -- 172.21.15.88:0/3355556341 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f500ab600 con 0x7f8f600a5300 2023-12-08T08:20:43.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.201+0000 7f8f64f44640 1 -- 172.21.15.88:0/3355556341 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f500a7050 con 0x7f8f600a5300 2023-12-08T08:20:43.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.201+0000 7f8f64f44640 1 -- 172.21.15.88:0/3355556341 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f500ab980 con 0x7f8f600a5300 2023-12-08T08:20:43.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.201+0000 7f8f681aa640 1 -- 172.21.15.88:0/3355556341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f600a5300 msgr2=0x7f8f60071e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:43.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.201+0000 7f8f681aa640 1 --2- 172.21.15.88:0/3355556341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f600a5300 0x7f8f60071e30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8f500097c0 tx=0x7f8f5001c330 comp rx=0 tx=0).stop 2023-12-08T08:20:43.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.201+0000 7f8f681aa640 1 -- 172.21.15.88:0/3355556341 shutdown_connections 2023-12-08T08:20:43.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.201+0000 7f8f681aa640 1 --2- 172.21.15.88:0/3355556341 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f600a5300 0x7f8f60071e30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.201+0000 7f8f681aa640 1 --2- 172.21.15.88:0/3355556341 >> v2:172.21.15.148:3300/0 conn(0x7f8f6014fd10 0x7f8f600a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.201+0000 7f8f681aa640 1 -- 172.21.15.88:0/3355556341 >> 172.21.15.88:0/3355556341 conn(0x7f8f600a7810 msgr2=0x7f8f600a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:43.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f681aa640 1 -- 172.21.15.88:0/3355556341 shutdown_connections 2023-12-08T08:20:43.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f681aa640 1 -- 172.21.15.88:0/3355556341 wait complete. 2023-12-08T08:20:43.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f681aa640 1 Processor -- start 2023-12-08T08:20:43.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f681aa640 1 -- start start 2023-12-08T08:20:43.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f681aa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f60072370 0x7f8f6015c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:43.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f681aa640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f600a5300 0x7f8f601ec960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:43.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f681aa640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f6014fd10 0x7f8f601ecea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:43.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f681aa640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f60151000 con 0x7f8f60072370 2023-12-08T08:20:43.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f681aa640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f60150a40 con 0x7f8f600a5300 2023-12-08T08:20:43.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f681aa640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f600aaeb0 con 0x7f8f6014fd10 2023-12-08T08:20:43.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f65f46640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f60072370 0x7f8f6015c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:43.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f65f46640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f60072370 0x7f8f6015c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60370/0 (socket says 172.21.15.88:60370) 2023-12-08T08:20:43.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f65f46640 1 -- 172.21.15.88:0/300753382 learned_addr learned my addr 172.21.15.88:0/300753382 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:43.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f65745640 1 --2- 172.21.15.88:0/300753382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f600a5300 0x7f8f601ec960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:43.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f66747640 1 --2- 172.21.15.88:0/300753382 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f6014fd10 0x7f8f601ecea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:43.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f65f46640 1 -- 172.21.15.88:0/300753382 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f6014fd10 msgr2=0x7f8f601ecea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:43.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f65f46640 1 --2- 172.21.15.88:0/300753382 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f6014fd10 0x7f8f601ecea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f65f46640 1 -- 172.21.15.88:0/300753382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f600a5300 msgr2=0x7f8f601ec960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:43.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f65f46640 1 --2- 172.21.15.88:0/300753382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f600a5300 0x7f8f601ec960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f65f46640 1 -- 172.21.15.88:0/300753382 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c009420 con 0x7f8f60072370 2023-12-08T08:20:43.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f65745640 1 --2- 172.21.15.88:0/300753382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f600a5300 0x7f8f601ec960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:43.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f66747640 1 --2- 172.21.15.88:0/300753382 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f6014fd10 0x7f8f601ecea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:43.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f65f46640 1 --2- 172.21.15.88:0/300753382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f60072370 0x7f8f6015c370 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c00e980 tx=0x7f8f5c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:43.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f567fc640 1 -- 172.21.15.88:0/300753382 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c00c9a0 con 0x7f8f60072370 2023-12-08T08:20:43.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f567fc640 1 -- 172.21.15.88:0/300753382 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5c00cb00 con 0x7f8f60072370 2023-12-08T08:20:43.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f681aa640 1 -- 172.21.15.88:0/300753382 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f50009420 con 0x7f8f60072370 2023-12-08T08:20:43.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f567fc640 1 -- 172.21.15.88:0/300753382 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c00ce90 con 0x7f8f60072370 2023-12-08T08:20:43.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.205+0000 7f8f681aa640 1 -- 172.21.15.88:0/300753382 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f601f0af0 con 0x7f8f60072370 2023-12-08T08:20:43.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.209+0000 7f8f681aa640 1 -- 172.21.15.88:0/300753382 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f60067630 con 0x7f8f60072370 2023-12-08T08:20:43.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.209+0000 7f8f567fc640 1 -- 172.21.15.88:0/300753382 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8f5c013470 con 0x7f8f60072370 2023-12-08T08:20:43.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.209+0000 7f8f567fc640 1 --2- 172.21.15.88:0/300753382 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8f44066470 0x7f8f44068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:43.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.209+0000 7f8f567fc640 1 -- 172.21.15.88:0/300753382 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f5c0844d0 con 0x7f8f60072370 2023-12-08T08:20:43.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.209+0000 7f8f65745640 1 --2- 172.21.15.88:0/300753382 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8f44066470 0x7f8f44068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:43.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.209+0000 7f8f65745640 1 --2- 172.21.15.88:0/300753382 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8f44066470 0x7f8f44068930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8f500ad000 tx=0x7f8f50008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:43.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.213+0000 7f8f567fc640 1 -- 172.21.15.88:0/300753382 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8f5c0518b0 con 0x7f8f60072370 2023-12-08T08:20:43.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.365+0000 7f8f681aa640 1 -- 172.21.15.88:0/300753382 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f600c4b20 con 0x7f8f60072370 2023-12-08T08:20:43.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.365+0000 7f8f567fc640 1 -- 172.21.15.88:0/300753382 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7f8f5c054ed0 con 0x7f8f60072370 2023-12-08T08:20:43.371 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:43.371 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:20:21.492555+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:18.675917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:19.511013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:43.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.369+0000 7f8f681aa640 1 -- 172.21.15.88:0/300753382 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8f44066470 msgr2=0x7f8f44068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:43.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.369+0000 7f8f681aa640 1 --2- 172.21.15.88:0/300753382 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8f44066470 0x7f8f44068930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8f500ad000 tx=0x7f8f50008040 comp rx=0 tx=0).stop 2023-12-08T08:20:43.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.369+0000 7f8f681aa640 1 -- 172.21.15.88:0/300753382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f60072370 msgr2=0x7f8f6015c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:43.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.369+0000 7f8f681aa640 1 --2- 172.21.15.88:0/300753382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f60072370 0x7f8f6015c370 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c00e980 tx=0x7f8f5c00ee40 comp rx=0 tx=0).stop 2023-12-08T08:20:43.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.369+0000 7f8f681aa640 1 -- 172.21.15.88:0/300753382 shutdown_connections 2023-12-08T08:20:43.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.369+0000 7f8f681aa640 1 --2- 172.21.15.88:0/300753382 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8f44066470 0x7f8f44068930 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.369+0000 7f8f681aa640 1 --2- 172.21.15.88:0/300753382 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8f6014fd10 0x7f8f601ecea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.369+0000 7f8f681aa640 1 --2- 172.21.15.88:0/300753382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f600a5300 0x7f8f601ec960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.369+0000 7f8f681aa640 1 --2- 172.21.15.88:0/300753382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f60072370 0x7f8f6015c370 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.369+0000 7f8f681aa640 1 -- 172.21.15.88:0/300753382 >> 172.21.15.88:0/300753382 conn(0x7f8f600a7810 msgr2=0x7f8f60070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:43.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.369+0000 7f8f681aa640 1 -- 172.21.15.88:0/300753382 shutdown_connections 2023-12-08T08:20:43.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.369+0000 7f8f681aa640 1 -- 172.21.15.88:0/300753382 wait complete. 2023-12-08T08:20:43.393 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:20:18.675917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:20:19.511013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:20:43.393 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:20:43.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.529+0000 7ff2c390e640 1 Processor -- start 2023-12-08T08:20:43.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.529+0000 7ff2c390e640 1 -- start start 2023-12-08T08:20:43.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.529+0000 7ff2c390e640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff2bc0bf2d0 0x7ff2bc151970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:43.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.529+0000 7ff2c390e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff2bc0c98f0 0x7ff2bc151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:43.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.529+0000 7ff2c390e640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2bc158780 con 0x7ff2bc0c6030 2023-12-08T08:20:43.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.529+0000 7ff2c390e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2bc0c0300 con 0x7ff2bc0c98f0 2023-12-08T08:20:43.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.529+0000 7ff2c390e640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2bc157b70 con 0x7ff2bc0bf2d0 2023-12-08T08:20:43.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.529+0000 7ff2c1eab640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff2bc0c98f0 0x7ff2bc151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:43.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.529+0000 7ff2c1eab640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff2bc0c98f0 0x7ff2bc151eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60382/0 (socket says 172.21.15.88:60382) 2023-12-08T08:20:43.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.529+0000 7ff2c1eab640 1 -- 172.21.15.88:0/2911377769 learned_addr learned my addr 172.21.15.88:0/2911377769 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:43.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.529+0000 7ff2c16aa640 1 --2- 172.21.15.88:0/2911377769 >> v2:172.21.15.148:3300/0 conn(0x7ff2bc0bf2d0 0x7ff2bc151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:43.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.529+0000 7ff2c1eab640 1 -- 172.21.15.88:0/2911377769 >> v2:172.21.15.148:3300/0 conn(0x7ff2bc0bf2d0 msgr2=0x7ff2bc151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:43.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.529+0000 7ff2c1eab640 1 --2- 172.21.15.88:0/2911377769 >> v2:172.21.15.148:3300/0 conn(0x7ff2bc0bf2d0 0x7ff2bc151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.529+0000 7ff2c1eab640 1 -- 172.21.15.88:0/2911377769 >> v1:172.21.15.148:6789/0 conn(0x7ff2bc0c6030 legacy=0x7ff2bc0c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:43.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.529+0000 7ff2c1eab640 1 -- 172.21.15.88:0/2911377769 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2bc157e50 con 0x7ff2bc0c98f0 2023-12-08T08:20:43.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.533+0000 7ff2c1eab640 1 --2- 172.21.15.88:0/2911377769 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2bc0c98f0 0x7ff2bc151eb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc08afd0 tx=0x7ff2b401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c32c44c813df10 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:43.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.533+0000 7ff2b3fff640 1 -- 172.21.15.88:0/2911377769 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b40a5860 con 0x7ff2bc0c98f0 2023-12-08T08:20:43.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.533+0000 7ff2b3fff640 1 -- 172.21.15.88:0/2911377769 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b40a59c0 con 0x7ff2bc0c98f0 2023-12-08T08:20:43.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.533+0000 7ff2b3fff640 1 -- 172.21.15.88:0/2911377769 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b40a5d50 con 0x7ff2bc0c98f0 2023-12-08T08:20:43.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.533+0000 7ff2c390e640 1 -- 172.21.15.88:0/2911377769 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2bc0c98f0 msgr2=0x7ff2bc151eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:43.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.533+0000 7ff2c390e640 1 --2- 172.21.15.88:0/2911377769 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2bc0c98f0 0x7ff2bc151eb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc08afd0 tx=0x7ff2b401c9a0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.533+0000 7ff2c390e640 1 -- 172.21.15.88:0/2911377769 shutdown_connections 2023-12-08T08:20:43.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.533+0000 7ff2c390e640 1 --2- 172.21.15.88:0/2911377769 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2bc0c98f0 0x7ff2bc151eb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.533+0000 7ff2c390e640 1 --2- 172.21.15.88:0/2911377769 >> v2:172.21.15.148:3300/0 conn(0x7ff2bc0bf2d0 0x7ff2bc151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.533+0000 7ff2c390e640 1 -- 172.21.15.88:0/2911377769 >> 172.21.15.88:0/2911377769 conn(0x7ff2bc0c9dc0 msgr2=0x7ff2bc0ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:43.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.533+0000 7ff2c390e640 1 -- 172.21.15.88:0/2911377769 shutdown_connections 2023-12-08T08:20:43.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.533+0000 7ff2c390e640 1 -- 172.21.15.88:0/2911377769 wait complete. 2023-12-08T08:20:43.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.537+0000 7ff2c390e640 1 Processor -- start 2023-12-08T08:20:43.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.537+0000 7ff2c390e640 1 -- start start 2023-12-08T08:20:43.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.537+0000 7ff2c390e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2bc0bf2d0 0x7ff2bc1519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:43.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.537+0000 7ff2c390e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2bc0c6030 0x7ff2bc1ee0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:43.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.537+0000 7ff2c390e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2bc0c98f0 0x7ff2bc1ee620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:43.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.537+0000 7ff2c390e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc06c2c0 con 0x7ff2bc0bf2d0 2023-12-08T08:20:43.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.537+0000 7ff2c390e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc1eeb60 con 0x7ff2bc0c6030 2023-12-08T08:20:43.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.537+0000 7ff2c390e640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc06c750 con 0x7ff2bc0c98f0 2023-12-08T08:20:43.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.537+0000 7ff2c16aa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2bc0bf2d0 0x7ff2bc1519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:43.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.537+0000 7ff2c16aa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2bc0bf2d0 0x7ff2bc1519a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60390/0 (socket says 172.21.15.88:60390) 2023-12-08T08:20:43.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.537+0000 7ff2c16aa640 1 -- 172.21.15.88:0/2430649658 learned_addr learned my addr 172.21.15.88:0/2430649658 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:43.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.537+0000 7ff2c0ea9640 1 --2- 172.21.15.88:0/2430649658 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2bc0c6030 0x7ff2bc1ee0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:43.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.537+0000 7ff2c1eab640 1 --2- 172.21.15.88:0/2430649658 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2bc0c98f0 0x7ff2bc1ee620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:43.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.537+0000 7ff2c16aa640 1 -- 172.21.15.88:0/2430649658 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2bc0c98f0 msgr2=0x7ff2bc1ee620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:43.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.537+0000 7ff2c16aa640 1 --2- 172.21.15.88:0/2430649658 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2bc0c98f0 0x7ff2bc1ee620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.537+0000 7ff2c16aa640 1 -- 172.21.15.88:0/2430649658 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2bc0c6030 msgr2=0x7ff2bc1ee0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:43.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.537+0000 7ff2c16aa640 1 --2- 172.21.15.88:0/2430649658 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2bc0c6030 0x7ff2bc1ee0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.537+0000 7ff2c16aa640 1 -- 172.21.15.88:0/2430649658 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b4009b30 con 0x7ff2bc0bf2d0 2023-12-08T08:20:43.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.537+0000 7ff2c0ea9640 1 --2- 172.21.15.88:0/2430649658 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2bc0c6030 0x7ff2bc1ee0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:43.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.537+0000 7ff2c16aa640 1 --2- 172.21.15.88:0/2430649658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2bc0bf2d0 0x7ff2bc1519a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff2b800e930 tx=0x7ff2b800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:43.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.537+0000 7ff2b1ffb640 1 -- 172.21.15.88:0/2430649658 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8009690 con 0x7ff2bc0bf2d0 2023-12-08T08:20:43.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.537+0000 7ff2b1ffb640 1 -- 172.21.15.88:0/2430649658 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b800ca00 con 0x7ff2bc0bf2d0 2023-12-08T08:20:43.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.537+0000 7ff2b1ffb640 1 -- 172.21.15.88:0/2430649658 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b800cd70 con 0x7ff2bc0bf2d0 2023-12-08T08:20:43.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.537+0000 7ff2c390e640 1 -- 172.21.15.88:0/2430649658 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2bc06b990 con 0x7ff2bc0bf2d0 2023-12-08T08:20:43.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.537+0000 7ff2c390e640 1 -- 172.21.15.88:0/2430649658 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2bc06bf50 con 0x7ff2bc0bf2d0 2023-12-08T08:20:43.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.541+0000 7ff2c390e640 1 -- 172.21.15.88:0/2430649658 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2bc067630 con 0x7ff2bc0bf2d0 2023-12-08T08:20:43.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.541+0000 7ff2b1ffb640 1 -- 172.21.15.88:0/2430649658 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff2b8013470 con 0x7ff2bc0bf2d0 2023-12-08T08:20:43.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.541+0000 7ff2b1ffb640 1 --2- 172.21.15.88:0/2430649658 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff2a00664a0 0x7ff2a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:43.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.541+0000 7ff2b1ffb640 1 -- 172.21.15.88:0/2430649658 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2b8084390 con 0x7ff2bc0bf2d0 2023-12-08T08:20:43.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.541+0000 7ff2c0ea9640 1 --2- 172.21.15.88:0/2430649658 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff2a00664a0 0x7ff2a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:43.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.541+0000 7ff2c0ea9640 1 --2- 172.21.15.88:0/2430649658 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff2a00664a0 0x7ff2a0068960 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc1521e0 tx=0x7ff2ac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:43.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.545+0000 7ff2b1ffb640 1 -- 172.21.15.88:0/2430649658 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff2b8051970 con 0x7ff2bc0bf2d0 2023-12-08T08:20:43.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.697+0000 7ff2c390e640 1 -- 172.21.15.88:0/2430649658 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff2bc155cf0 con 0x7ff2bc0bf2d0 2023-12-08T08:20:43.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.697+0000 7ff2b1ffb640 1 -- 172.21.15.88:0/2430649658 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff2b8054f90 con 0x7ff2bc0bf2d0 2023-12-08T08:20:43.703 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:20:43.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.697+0000 7ff2c390e640 1 -- 172.21.15.88:0/2430649658 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff2a00664a0 msgr2=0x7ff2a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:43.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.697+0000 7ff2c390e640 1 --2- 172.21.15.88:0/2430649658 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff2a00664a0 0x7ff2a0068960 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc1521e0 tx=0x7ff2ac009040 comp rx=0 tx=0).stop 2023-12-08T08:20:43.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.697+0000 7ff2c390e640 1 -- 172.21.15.88:0/2430649658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2bc0bf2d0 msgr2=0x7ff2bc1519a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:43.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.697+0000 7ff2c390e640 1 --2- 172.21.15.88:0/2430649658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2bc0bf2d0 0x7ff2bc1519a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff2b800e930 tx=0x7ff2b800edf0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.701+0000 7ff2c390e640 1 -- 172.21.15.88:0/2430649658 shutdown_connections 2023-12-08T08:20:43.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.701+0000 7ff2c390e640 1 --2- 172.21.15.88:0/2430649658 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff2a00664a0 0x7ff2a0068960 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.701+0000 7ff2c390e640 1 --2- 172.21.15.88:0/2430649658 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff2bc0c98f0 0x7ff2bc1ee620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.701+0000 7ff2c390e640 1 --2- 172.21.15.88:0/2430649658 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2bc0c6030 0x7ff2bc1ee0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.701+0000 7ff2c390e640 1 --2- 172.21.15.88:0/2430649658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2bc0bf2d0 0x7ff2bc1519a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.701+0000 7ff2c390e640 1 -- 172.21.15.88:0/2430649658 >> 172.21.15.88:0/2430649658 conn(0x7ff2bc0c9dc0 msgr2=0x7ff2bc0aa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:43.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.701+0000 7ff2c390e640 1 -- 172.21.15.88:0/2430649658 shutdown_connections 2023-12-08T08:20:43.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.701+0000 7ff2c390e640 1 -- 172.21.15.88:0/2430649658 wait complete. 2023-12-08T08:20:43.724 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:20:43.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.857+0000 7fa8e509c640 1 Processor -- start 2023-12-08T08:20:43.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.857+0000 7fa8e509c640 1 -- start start 2023-12-08T08:20:43.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.861+0000 7fa8e509c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa8e00c5300 0x7fa8e00a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:43.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.861+0000 7fa8e509c640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa8e01548c0 0x7fa8e0154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.861+0000 7fa8e509c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e00a4e20 con 0x7fa8e014b1e0 2023-12-08T08:20:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.861+0000 7fa8e509c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e00a50e0 con 0x7fa8e00c5300 2023-12-08T08:20:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.861+0000 7fa8e509c640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e00c0f00 con 0x7fa8e01548c0 2023-12-08T08:20:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.861+0000 7fa8ded9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa8e014b1e0 0x7fa8e00c1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36534/0 (socket says 172.21.15.88:36534) 2023-12-08T08:20:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.861+0000 7fa8ded9d640 1 -- 172.21.15.88:0/411523863 learned_addr learned my addr 172.21.15.88:0/411523863 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.861+0000 7fa8de59c640 1 --2- 172.21.15.88:0/411523863 >> v2:172.21.15.88:3300/0 conn(0x7fa8e00c5300 0x7fa8e00a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.861+0000 7fa8df59e640 1 --2- 172.21.15.88:0/411523863 >> v2:172.21.15.148:3300/0 conn(0x7fa8e01548c0 0x7fa8e0154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.861+0000 7fa8ddd9b640 1 -- 172.21.15.88:0/411523863 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3418683419 0 0) 0x7fa8e00a4e20 con 0x7fa8e014b1e0 2023-12-08T08:20:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.861+0000 7fa8ddd9b640 1 -- 172.21.15.88:0/411523863 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8c8003530 con 0x7fa8e014b1e0 2023-12-08T08:20:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.861+0000 7fa8de59c640 1 -- 172.21.15.88:0/411523863 >> v2:172.21.15.148:3300/0 conn(0x7fa8e01548c0 msgr2=0x7fa8e0154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.861+0000 7fa8de59c640 1 --2- 172.21.15.88:0/411523863 >> v2:172.21.15.148:3300/0 conn(0x7fa8e01548c0 0x7fa8e0154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.861+0000 7fa8de59c640 1 -- 172.21.15.88:0/411523863 >> v1:172.21.15.88:6789/0 conn(0x7fa8e014b1e0 legacy=0x7fa8e00c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.861+0000 7fa8de59c640 1 -- 172.21.15.88:0/411523863 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e00c11e0 con 0x7fa8e00c5300 2023-12-08T08:20:43.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.865+0000 7fa8de59c640 1 --2- 172.21.15.88:0/411523863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e00c5300 0x7fa8e00a9c30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa8e00c5850 tx=0x7fa8d401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30dbbe5711ec3f90 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:43.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.865+0000 7fa8ddd9b640 1 -- 172.21.15.88:0/411523863 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d40ab600 con 0x7fa8e00c5300 2023-12-08T08:20:43.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.865+0000 7fa8ddd9b640 1 -- 172.21.15.88:0/411523863 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d40a7050 con 0x7fa8e00c5300 2023-12-08T08:20:43.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.865+0000 7fa8ddd9b640 1 -- 172.21.15.88:0/411523863 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d40ab980 con 0x7fa8e00c5300 2023-12-08T08:20:43.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.865+0000 7fa8e509c640 1 -- 172.21.15.88:0/411523863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e00c5300 msgr2=0x7fa8e00a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:43.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.865+0000 7fa8e509c640 1 --2- 172.21.15.88:0/411523863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e00c5300 0x7fa8e00a9c30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa8e00c5850 tx=0x7fa8d401c460 comp rx=0 tx=0).stop 2023-12-08T08:20:43.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.865+0000 7fa8e509c640 1 -- 172.21.15.88:0/411523863 shutdown_connections 2023-12-08T08:20:43.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.865+0000 7fa8e509c640 1 --2- 172.21.15.88:0/411523863 >> v2:172.21.15.148:3300/0 conn(0x7fa8e01548c0 0x7fa8e0154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.865+0000 7fa8e509c640 1 --2- 172.21.15.88:0/411523863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e00c5300 0x7fa8e00a9c30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.865+0000 7fa8e509c640 1 -- 172.21.15.88:0/411523863 >> 172.21.15.88:0/411523863 conn(0x7fa8e00c59f0 msgr2=0x7fa8e00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:43.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.865+0000 7fa8e509c640 1 -- 172.21.15.88:0/411523863 shutdown_connections 2023-12-08T08:20:43.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.865+0000 7fa8e509c640 1 -- 172.21.15.88:0/411523863 wait complete. 2023-12-08T08:20:43.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.865+0000 7fa8e509c640 1 Processor -- start 2023-12-08T08:20:43.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.865+0000 7fa8e509c640 1 -- start start 2023-12-08T08:20:43.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.869+0000 7fa8e509c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8e00c5300 0x7fa8e00c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:43.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.869+0000 7fa8e509c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e014b1e0 0x7fa8e0143c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:43.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.869+0000 7fa8e509c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8e01548c0 0x7fa8e0151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:43.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.869+0000 7fa8e509c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e00a66e0 con 0x7fa8e014b1e0 2023-12-08T08:20:43.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.869+0000 7fa8e509c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e00bf1f0 con 0x7fa8e00c5300 2023-12-08T08:20:43.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.869+0000 7fa8e509c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e00bf4d0 con 0x7fa8e01548c0 2023-12-08T08:20:43.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.869+0000 7fa8de59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e014b1e0 0x7fa8e0143c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:43.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.869+0000 7fa8de59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e014b1e0 0x7fa8e0143c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60422/0 (socket says 172.21.15.88:60422) 2023-12-08T08:20:43.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.869+0000 7fa8de59c640 1 -- 172.21.15.88:0/908580108 learned_addr learned my addr 172.21.15.88:0/908580108 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:43.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.869+0000 7fa8df59e640 1 --2- 172.21.15.88:0/908580108 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8e01548c0 0x7fa8e0151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:43.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.869+0000 7fa8ded9d640 1 --2- 172.21.15.88:0/908580108 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8e00c5300 0x7fa8e00c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:43.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.869+0000 7fa8de59c640 1 -- 172.21.15.88:0/908580108 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8e01548c0 msgr2=0x7fa8e0151390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:43.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.869+0000 7fa8de59c640 1 --2- 172.21.15.88:0/908580108 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8e01548c0 0x7fa8e0151390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.869+0000 7fa8de59c640 1 -- 172.21.15.88:0/908580108 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8e00c5300 msgr2=0x7fa8e00c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:43.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.869+0000 7fa8de59c640 1 --2- 172.21.15.88:0/908580108 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8e00c5300 0x7fa8e00c62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:43.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.869+0000 7fa8de59c640 1 -- 172.21.15.88:0/908580108 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d4009420 con 0x7fa8e014b1e0 2023-12-08T08:20:43.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.869+0000 7fa8de59c640 1 --2- 172.21.15.88:0/908580108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e014b1e0 0x7fa8e0143c40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa8d40ae040 tx=0x7fa8d4019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:43.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.869+0000 7fa8c77fe640 1 -- 172.21.15.88:0/908580108 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d40abe70 con 0x7fa8e014b1e0 2023-12-08T08:20:43.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.869+0000 7fa8c77fe640 1 -- 172.21.15.88:0/908580108 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d40b4430 con 0x7fa8e014b1e0 2023-12-08T08:20:43.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.869+0000 7fa8e509c640 1 -- 172.21.15.88:0/908580108 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e00bf7b0 con 0x7fa8e014b1e0 2023-12-08T08:20:43.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.869+0000 7fa8c77fe640 1 -- 172.21.15.88:0/908580108 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d40b4800 con 0x7fa8e014b1e0 2023-12-08T08:20:43.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.869+0000 7fa8e509c640 1 -- 172.21.15.88:0/908580108 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e01ee480 con 0x7fa8e014b1e0 2023-12-08T08:20:43.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.869+0000 7fa8e509c640 1 -- 172.21.15.88:0/908580108 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e01536b0 con 0x7fa8e014b1e0 2023-12-08T08:20:43.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.869+0000 7fa8c77fe640 1 -- 172.21.15.88:0/908580108 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa8d40b2040 con 0x7fa8e014b1e0 2023-12-08T08:20:43.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.873+0000 7fa8c77fe640 1 --2- 172.21.15.88:0/908580108 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa8cc066470 0x7fa8cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:43.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.873+0000 7fa8c77fe640 1 -- 172.21.15.88:0/908580108 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8d411dd80 con 0x7fa8e014b1e0 2023-12-08T08:20:43.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.873+0000 7fa8ded9d640 1 --2- 172.21.15.88:0/908580108 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa8cc066470 0x7fa8cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:43.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.873+0000 7fa8ded9d640 1 --2- 172.21.15.88:0/908580108 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa8cc066470 0x7fa8cc068930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00011f0 tx=0x7fa8d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:43.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:43.877+0000 7fa8c77fe640 1 -- 172.21.15.88:0/908580108 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa8d40eb160 con 0x7fa8e014b1e0 2023-12-08T08:20:44.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.025+0000 7fa8e509c640 1 -- 172.21.15.88:0/908580108 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa8e01ee670 con 0x7fa8e014b1e0 2023-12-08T08:20:44.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.025+0000 7fa8c77fe640 1 -- 172.21.15.88:0/908580108 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa8d40ee780 con 0x7fa8e014b1e0 2023-12-08T08:20:44.031 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:20:44.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.029+0000 7fa8e509c640 1 -- 172.21.15.88:0/908580108 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa8cc066470 msgr2=0x7fa8cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:44.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.029+0000 7fa8e509c640 1 --2- 172.21.15.88:0/908580108 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa8cc066470 0x7fa8cc068930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00011f0 tx=0x7fa8d0009040 comp rx=0 tx=0).stop 2023-12-08T08:20:44.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.029+0000 7fa8e509c640 1 -- 172.21.15.88:0/908580108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e014b1e0 msgr2=0x7fa8e0143c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:44.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.029+0000 7fa8e509c640 1 --2- 172.21.15.88:0/908580108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e014b1e0 0x7fa8e0143c40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa8d40ae040 tx=0x7fa8d4019200 comp rx=0 tx=0).stop 2023-12-08T08:20:44.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.029+0000 7fa8e509c640 1 -- 172.21.15.88:0/908580108 shutdown_connections 2023-12-08T08:20:44.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.029+0000 7fa8e509c640 1 --2- 172.21.15.88:0/908580108 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa8cc066470 0x7fa8cc068930 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:44.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.029+0000 7fa8e509c640 1 --2- 172.21.15.88:0/908580108 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8e01548c0 0x7fa8e0151390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:44.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.029+0000 7fa8e509c640 1 --2- 172.21.15.88:0/908580108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e014b1e0 0x7fa8e0143c40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:44.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.029+0000 7fa8e509c640 1 --2- 172.21.15.88:0/908580108 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8e00c5300 0x7fa8e00c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:44.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.029+0000 7fa8e509c640 1 -- 172.21.15.88:0/908580108 >> 172.21.15.88:0/908580108 conn(0x7fa8e00c59f0 msgr2=0x7fa8e0145da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:44.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.029+0000 7fa8e509c640 1 -- 172.21.15.88:0/908580108 shutdown_connections 2023-12-08T08:20:44.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.029+0000 7fa8e509c640 1 -- 172.21.15.88:0/908580108 wait complete. 2023-12-08T08:20:44.052 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:20:44.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.189+0000 7f1383c9c640 1 Processor -- start 2023-12-08T08:20:44.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.189+0000 7f1383c9c640 1 -- start start 2023-12-08T08:20:44.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.189+0000 7f1383c9c640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f137c156200 0x7f137c0c0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:44.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.189+0000 7f1383c9c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f137c15bf70 0x7f137c15c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:44.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.189+0000 7f1383c9c640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f137c06bce0 con 0x7f137c0c0e10 2023-12-08T08:20:44.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.189+0000 7f1383c9c640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f137c06d8d0 con 0x7f137c156200 2023-12-08T08:20:44.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.189+0000 7f1383c9c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137c0c2270 con 0x7f137c15bf70 2023-12-08T08:20:44.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.189+0000 7f1382239640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f137c15bf70 0x7f137c15c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:44.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.193+0000 7f1381a38640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f137c156200 0x7f137c0c0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:44.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.193+0000 7f1381237640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f137c0c0e10 0x7f137c0c1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:44730/0 (socket says 172.21.15.88:44730) 2023-12-08T08:20:44.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.193+0000 7f1382239640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f137c15bf70 0x7f137c15c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:49752/0 (socket says 172.21.15.88:49752) 2023-12-08T08:20:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.193+0000 7f1381237640 1 -- 172.21.15.88:0/3243964931 learned_addr learned my addr 172.21.15.88:0/3243964931 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.193+0000 7f1381a38640 1 -- 172.21.15.88:0/3243964931 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f137c15bf70 msgr2=0x7f137c15c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.193+0000 7f1381a38640 1 --2- 172.21.15.88:0/3243964931 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f137c15bf70 0x7f137c15c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.193+0000 7f1381a38640 1 -- 172.21.15.88:0/3243964931 >> v1:172.21.15.148:6789/0 conn(0x7f137c0c0e10 legacy=0x7f137c0c1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.193+0000 7f1381a38640 1 -- 172.21.15.88:0/3243964931 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137c15cc60 con 0x7f137c156200 2023-12-08T08:20:44.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.193+0000 7f1381a38640 1 --2- 172.21.15.88:0/3243964931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f137c156200 0x7f137c0c0370 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f13780097c0 tx=0x7f137801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1408c914499d991 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:44.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.193+0000 7f1380a36640 1 -- 172.21.15.88:0/3243964931 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13780ab600 con 0x7f137c156200 2023-12-08T08:20:44.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.193+0000 7f1380a36640 1 -- 172.21.15.88:0/3243964931 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13780a7050 con 0x7f137c156200 2023-12-08T08:20:44.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.193+0000 7f1380a36640 1 -- 172.21.15.88:0/3243964931 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13780ab980 con 0x7f137c156200 2023-12-08T08:20:44.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.197+0000 7f1383c9c640 1 -- 172.21.15.88:0/3243964931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f137c156200 msgr2=0x7f137c0c0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:44.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.197+0000 7f1383c9c640 1 --2- 172.21.15.88:0/3243964931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f137c156200 0x7f137c0c0370 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f13780097c0 tx=0x7f137801c330 comp rx=0 tx=0).stop 2023-12-08T08:20:44.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.197+0000 7f1383c9c640 1 -- 172.21.15.88:0/3243964931 shutdown_connections 2023-12-08T08:20:44.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.197+0000 7f1383c9c640 1 --2- 172.21.15.88:0/3243964931 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f137c15bf70 0x7f137c15c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:44.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.197+0000 7f1383c9c640 1 --2- 172.21.15.88:0/3243964931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f137c156200 0x7f137c0c0370 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:44.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.197+0000 7f1383c9c640 1 -- 172.21.15.88:0/3243964931 >> 172.21.15.88:0/3243964931 conn(0x7f137c0c59f0 msgr2=0x7f137c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:44.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.197+0000 7f1383c9c640 1 -- 172.21.15.88:0/3243964931 shutdown_connections 2023-12-08T08:20:44.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.197+0000 7f1383c9c640 1 -- 172.21.15.88:0/3243964931 wait complete. 2023-12-08T08:20:44.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.197+0000 7f1383c9c640 1 Processor -- start 2023-12-08T08:20:44.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.197+0000 7f1383c9c640 1 -- start start 2023-12-08T08:20:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.197+0000 7f1383c9c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f137c0c0e10 0x7f137c0aa900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.197+0000 7f1383c9c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f137c156200 0x7f137c158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.197+0000 7f1383c9c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f137c15bf70 0x7f137c158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.197+0000 7f1383c9c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137c072240 con 0x7f137c156200 2023-12-08T08:20:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.197+0000 7f1383c9c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137c1f1220 con 0x7f137c15bf70 2023-12-08T08:20:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.197+0000 7f1383c9c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137c1f52c0 con 0x7f137c0c0e10 2023-12-08T08:20:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.197+0000 7f1381237640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f137c156200 0x7f137c158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.197+0000 7f1381a38640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f137c0c0e10 0x7f137c0aa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.197+0000 7f1381237640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f137c156200 0x7f137c158760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60438/0 (socket says 172.21.15.88:60438) 2023-12-08T08:20:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.197+0000 7f1381237640 1 -- 172.21.15.88:0/1740277515 learned_addr learned my addr 172.21.15.88:0/1740277515 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:44.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.197+0000 7f1382239640 1 --2- 172.21.15.88:0/1740277515 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f137c15bf70 0x7f137c158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:44.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.201+0000 7f1381a38640 1 -- 172.21.15.88:0/1740277515 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f137c15bf70 msgr2=0x7f137c158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:44.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.201+0000 7f1381a38640 1 --2- 172.21.15.88:0/1740277515 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f137c15bf70 0x7f137c158ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:44.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.201+0000 7f1381a38640 1 -- 172.21.15.88:0/1740277515 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f137c156200 msgr2=0x7f137c158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:44.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.201+0000 7f1381a38640 1 --2- 172.21.15.88:0/1740277515 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f137c156200 0x7f137c158760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:44.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.201+0000 7f1381a38640 1 -- 172.21.15.88:0/1740277515 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1378009420 con 0x7f137c0c0e10 2023-12-08T08:20:44.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.201+0000 7f1381237640 1 --2- 172.21.15.88:0/1740277515 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f137c156200 0x7f137c158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:44.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.201+0000 7f1381a38640 1 --2- 172.21.15.88:0/1740277515 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f137c0c0e10 0x7f137c0aa900 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f13780ab000 tx=0x7f137801ab70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:44.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.201+0000 7f13727fc640 1 -- 172.21.15.88:0/1740277515 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13780b7650 con 0x7f137c0c0e10 2023-12-08T08:20:44.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.201+0000 7f13727fc640 1 -- 172.21.15.88:0/1740277515 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13780b77f0 con 0x7f137c0c0e10 2023-12-08T08:20:44.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.201+0000 7f1383c9c640 1 -- 172.21.15.88:0/1740277515 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f137c1591e0 con 0x7f137c0c0e10 2023-12-08T08:20:44.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.201+0000 7f13727fc640 1 -- 172.21.15.88:0/1740277515 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13780b7ba0 con 0x7f137c0c0e10 2023-12-08T08:20:44.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.201+0000 7f1383c9c640 1 -- 172.21.15.88:0/1740277515 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f137c1f47e0 con 0x7f137c0c0e10 2023-12-08T08:20:44.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.201+0000 7f1383c9c640 1 -- 172.21.15.88:0/1740277515 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f137c067630 con 0x7f137c0c0e10 2023-12-08T08:20:44.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.201+0000 7f13727fc640 1 -- 172.21.15.88:0/1740277515 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f13780b7d00 con 0x7f137c0c0e10 2023-12-08T08:20:44.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.201+0000 7f13727fc640 1 --2- 172.21.15.88:0/1740277515 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1360066470 0x7f1360068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:44.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.201+0000 7f13727fc640 1 -- 172.21.15.88:0/1740277515 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f137811e880 con 0x7f137c0c0e10 2023-12-08T08:20:44.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.201+0000 7f1381237640 1 --2- 172.21.15.88:0/1740277515 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1360066470 0x7f1360068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:44.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.205+0000 7f1381237640 1 --2- 172.21.15.88:0/1740277515 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1360066470 0x7f1360068930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f137c159a30 tx=0x7f136c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:44.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.205+0000 7f13727fc640 1 -- 172.21.15.88:0/1740277515 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f13780ec040 con 0x7f137c0c0e10 2023-12-08T08:20:44.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.357+0000 7f1383c9c640 1 -- 172.21.15.88:0/1740277515 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f137c15bb30 con 0x7f137c0c0e10 2023-12-08T08:20:44.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.357+0000 7f13727fc640 1 -- 172.21.15.88:0/1740277515 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f13780ef660 con 0x7f137c0c0e10 2023-12-08T08:20:44.362 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:20:44.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.357+0000 7f1383c9c640 1 -- 172.21.15.88:0/1740277515 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1360066470 msgr2=0x7f1360068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:44.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.357+0000 7f1383c9c640 1 --2- 172.21.15.88:0/1740277515 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1360066470 0x7f1360068930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f137c159a30 tx=0x7f136c009040 comp rx=0 tx=0).stop 2023-12-08T08:20:44.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.357+0000 7f1383c9c640 1 -- 172.21.15.88:0/1740277515 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f137c0c0e10 msgr2=0x7f137c0aa900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:44.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.357+0000 7f1383c9c640 1 --2- 172.21.15.88:0/1740277515 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f137c0c0e10 0x7f137c0aa900 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f13780ab000 tx=0x7f137801ab70 comp rx=0 tx=0).stop 2023-12-08T08:20:44.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.357+0000 7f1383c9c640 1 -- 172.21.15.88:0/1740277515 shutdown_connections 2023-12-08T08:20:44.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.357+0000 7f1383c9c640 1 --2- 172.21.15.88:0/1740277515 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1360066470 0x7f1360068930 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:44.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.357+0000 7f1383c9c640 1 --2- 172.21.15.88:0/1740277515 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f137c15bf70 0x7f137c158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:44.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.357+0000 7f1383c9c640 1 --2- 172.21.15.88:0/1740277515 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f137c156200 0x7f137c158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:44.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.357+0000 7f1383c9c640 1 --2- 172.21.15.88:0/1740277515 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f137c0c0e10 0x7f137c0aa900 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:44.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.357+0000 7f1383c9c640 1 -- 172.21.15.88:0/1740277515 >> 172.21.15.88:0/1740277515 conn(0x7f137c0c59f0 msgr2=0x7f137c159a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:44.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.357+0000 7f1383c9c640 1 -- 172.21.15.88:0/1740277515 shutdown_connections 2023-12-08T08:20:44.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.357+0000 7f1383c9c640 1 -- 172.21.15.88:0/1740277515 wait complete. 2023-12-08T08:20:44.383 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:44.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.517+0000 7ffa62d93640 1 Processor -- start 2023-12-08T08:20:44.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.517+0000 7ffa62d93640 1 -- start start 2023-12-08T08:20:44.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.517+0000 7ffa62d93640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffa5c151b40 0x7ffa5c0c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:44.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.517+0000 7ffa62d93640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ffa5c0c9f80 0x7ffa5c0ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:44.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.517+0000 7ffa62d93640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5c1584b0 con 0x7ffa5c157910 2023-12-08T08:20:44.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.517+0000 7ffa62d93640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa5c154320 con 0x7ffa5c151b40 2023-12-08T08:20:44.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.517+0000 7ffa62d93640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa5c1552f0 con 0x7ffa5c0c9f80 2023-12-08T08:20:44.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.517+0000 7ffa61d91640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffa5c151b40 0x7ffa5c0c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:44.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.517+0000 7ffa61d91640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffa5c151b40 0x7ffa5c0c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60444/0 (socket says 172.21.15.88:60444) 2023-12-08T08:20:44.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.517+0000 7ffa61d91640 1 -- 172.21.15.88:0/2611106460 learned_addr learned my addr 172.21.15.88:0/2611106460 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:44.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.517+0000 7ffa62592640 1 --1- 172.21.15.88:0/2611106460 >> v1:172.21.15.88:6789/0 conn(0x7ffa5c157910 0x7ffa5c157da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36546/0 (socket says 172.21.15.88:36546) 2023-12-08T08:20:44.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.517+0000 7ffa61590640 1 --2- 172.21.15.88:0/2611106460 >> v2:172.21.15.148:3300/0 conn(0x7ffa5c0c9f80 0x7ffa5c0ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:44.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.517+0000 7ffa61d91640 1 -- 172.21.15.88:0/2611106460 >> v2:172.21.15.148:3300/0 conn(0x7ffa5c0c9f80 msgr2=0x7ffa5c0ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:44.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.517+0000 7ffa61d91640 1 --2- 172.21.15.88:0/2611106460 >> v2:172.21.15.148:3300/0 conn(0x7ffa5c0c9f80 0x7ffa5c0ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:44.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.517+0000 7ffa61d91640 1 -- 172.21.15.88:0/2611106460 >> v1:172.21.15.88:6789/0 conn(0x7ffa5c157910 legacy=0x7ffa5c157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:44.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.517+0000 7ffa61d91640 1 -- 172.21.15.88:0/2611106460 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c154530 con 0x7ffa5c151b40 2023-12-08T08:20:44.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.517+0000 7ffa60d8f640 1 -- 172.21.15.88:0/2611106460 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1049481063 0 0) 0x7ffa5c1584b0 con 0x7ffa5c157910 2023-12-08T08:20:44.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.521+0000 7ffa61d91640 1 --2- 172.21.15.88:0/2611106460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa5c151b40 0x7ffa5c0c7fd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c0c3ee0 tx=0x7ffa5801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee82f9b5f7c0f75 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:44.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.521+0000 7ffa60d8f640 1 -- 172.21.15.88:0/2611106460 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa580ad680 con 0x7ffa5c151b40 2023-12-08T08:20:44.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.521+0000 7ffa60d8f640 1 -- 172.21.15.88:0/2611106460 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa580ad7e0 con 0x7ffa5c151b40 2023-12-08T08:20:44.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.521+0000 7ffa60d8f640 1 -- 172.21.15.88:0/2611106460 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa580adb70 con 0x7ffa5c151b40 2023-12-08T08:20:44.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.521+0000 7ffa62d93640 1 -- 172.21.15.88:0/2611106460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa5c151b40 msgr2=0x7ffa5c0c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:44.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.521+0000 7ffa62d93640 1 --2- 172.21.15.88:0/2611106460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa5c151b40 0x7ffa5c0c7fd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c0c3ee0 tx=0x7ffa5801c470 comp rx=0 tx=0).stop 2023-12-08T08:20:44.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.521+0000 7ffa62d93640 1 -- 172.21.15.88:0/2611106460 shutdown_connections 2023-12-08T08:20:44.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.521+0000 7ffa62d93640 1 --2- 172.21.15.88:0/2611106460 >> v2:172.21.15.148:3300/0 conn(0x7ffa5c0c9f80 0x7ffa5c0ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:44.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.521+0000 7ffa62d93640 1 --2- 172.21.15.88:0/2611106460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa5c151b40 0x7ffa5c0c7fd0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:44.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.521+0000 7ffa62d93640 1 -- 172.21.15.88:0/2611106460 >> 172.21.15.88:0/2611106460 conn(0x7ffa5c066470 msgr2=0x7ffa5c066880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:44.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.521+0000 7ffa62d93640 1 -- 172.21.15.88:0/2611106460 shutdown_connections 2023-12-08T08:20:44.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.521+0000 7ffa62d93640 1 -- 172.21.15.88:0/2611106460 wait complete. 2023-12-08T08:20:44.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.525+0000 7ffa62d93640 1 Processor -- start 2023-12-08T08:20:44.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.525+0000 7ffa62d93640 1 -- start start 2023-12-08T08:20:44.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.525+0000 7ffa62d93640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffa5c0c9f80 0x7ffa5c1ed610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:44.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.525+0000 7ffa62d93640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa5c151b40 0x7ffa5c14db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:44.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.525+0000 7ffa62d93640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa5c157910 0x7ffa5c148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:44.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.525+0000 7ffa62d93640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c1577d0 con 0x7ffa5c157910 2023-12-08T08:20:44.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.525+0000 7ffa62d93640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c1edb50 con 0x7ffa5c151b40 2023-12-08T08:20:44.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.525+0000 7ffa62d93640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c14bcf0 con 0x7ffa5c0c9f80 2023-12-08T08:20:44.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.525+0000 7ffa62592640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa5c157910 0x7ffa5c148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:44.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.525+0000 7ffa62592640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa5c157910 0x7ffa5c148cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60454/0 (socket says 172.21.15.88:60454) 2023-12-08T08:20:44.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.525+0000 7ffa62592640 1 -- 172.21.15.88:0/1561256430 learned_addr learned my addr 172.21.15.88:0/1561256430 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:44.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.525+0000 7ffa61590640 1 --2- 172.21.15.88:0/1561256430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa5c151b40 0x7ffa5c14db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:44.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.525+0000 7ffa61d91640 1 --2- 172.21.15.88:0/1561256430 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffa5c0c9f80 0x7ffa5c1ed610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:44.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.525+0000 7ffa62592640 1 -- 172.21.15.88:0/1561256430 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffa5c0c9f80 msgr2=0x7ffa5c1ed610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:44.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.525+0000 7ffa62592640 1 --2- 172.21.15.88:0/1561256430 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffa5c0c9f80 0x7ffa5c1ed610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:44.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.525+0000 7ffa62592640 1 -- 172.21.15.88:0/1561256430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa5c151b40 msgr2=0x7ffa5c14db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:44.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.525+0000 7ffa62592640 1 --2- 172.21.15.88:0/1561256430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa5c151b40 0x7ffa5c14db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:44.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.525+0000 7ffa62592640 1 -- 172.21.15.88:0/1561256430 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa580094d0 con 0x7ffa5c157910 2023-12-08T08:20:44.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.525+0000 7ffa62592640 1 --2- 172.21.15.88:0/1561256430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa5c157910 0x7ffa5c148cc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400c780 tx=0x7ffa5400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:44.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.525+0000 7ffa527fc640 1 -- 172.21.15.88:0/1561256430 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5400ce90 con 0x7ffa5c157910 2023-12-08T08:20:44.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.525+0000 7ffa527fc640 1 -- 172.21.15.88:0/1561256430 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5400a640 con 0x7ffa5c157910 2023-12-08T08:20:44.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.525+0000 7ffa62d93640 1 -- 172.21.15.88:0/1561256430 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5c1565b0 con 0x7ffa5c157910 2023-12-08T08:20:44.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.525+0000 7ffa527fc640 1 -- 172.21.15.88:0/1561256430 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5400a9d0 con 0x7ffa5c157910 2023-12-08T08:20:44.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.525+0000 7ffa62d93640 1 -- 172.21.15.88:0/1561256430 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa5c156b70 con 0x7ffa5c157910 2023-12-08T08:20:44.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.525+0000 7ffa62d93640 1 -- 172.21.15.88:0/1561256430 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa5c0c4da0 con 0x7ffa5c157910 2023-12-08T08:20:44.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.529+0000 7ffa527fc640 1 -- 172.21.15.88:0/1561256430 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffa5400ab30 con 0x7ffa5c157910 2023-12-08T08:20:44.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.529+0000 7ffa527fc640 1 --2- 172.21.15.88:0/1561256430 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffa400664a0 0x7ffa40068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:44.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.529+0000 7ffa527fc640 1 -- 172.21.15.88:0/1561256430 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa540830f0 con 0x7ffa5c157910 2023-12-08T08:20:44.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.529+0000 7ffa61d91640 1 --2- 172.21.15.88:0/1561256430 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffa400664a0 0x7ffa40068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:44.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.529+0000 7ffa61d91640 1 --2- 172.21.15.88:0/1561256430 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffa400664a0 0x7ffa40068960 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ffa580af000 tx=0x7ffa580a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:44.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.533+0000 7ffa527fc640 1 -- 172.21.15.88:0/1561256430 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffa540506b0 con 0x7ffa5c157910 2023-12-08T08:20:44.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.685+0000 7ffa62d93640 1 -- 172.21.15.88:0/1561256430 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa5c067bc0 con 0x7ffa5c157910 2023-12-08T08:20:44.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.685+0000 7ffa527fc640 1 -- 172.21.15.88:0/1561256430 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7ffa54053cd0 con 0x7ffa5c157910 2023-12-08T08:20:44.691 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:44.691 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:20:21.492555+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:18.675917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:19.511013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:44.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.689+0000 7ffa62d93640 1 -- 172.21.15.88:0/1561256430 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffa400664a0 msgr2=0x7ffa40068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:44.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.689+0000 7ffa62d93640 1 --2- 172.21.15.88:0/1561256430 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffa400664a0 0x7ffa40068960 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ffa580af000 tx=0x7ffa580a7000 comp rx=0 tx=0).stop 2023-12-08T08:20:44.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.689+0000 7ffa62d93640 1 -- 172.21.15.88:0/1561256430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa5c157910 msgr2=0x7ffa5c148cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:44.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.689+0000 7ffa62d93640 1 --2- 172.21.15.88:0/1561256430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa5c157910 0x7ffa5c148cc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400c780 tx=0x7ffa5400cc40 comp rx=0 tx=0).stop 2023-12-08T08:20:44.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.689+0000 7ffa62d93640 1 -- 172.21.15.88:0/1561256430 shutdown_connections 2023-12-08T08:20:44.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.689+0000 7ffa62d93640 1 --2- 172.21.15.88:0/1561256430 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffa400664a0 0x7ffa40068960 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:44.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.689+0000 7ffa62d93640 1 --2- 172.21.15.88:0/1561256430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa5c157910 0x7ffa5c148cc0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:44.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.689+0000 7ffa62d93640 1 --2- 172.21.15.88:0/1561256430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa5c151b40 0x7ffa5c14db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:44.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.689+0000 7ffa62d93640 1 --2- 172.21.15.88:0/1561256430 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffa5c0c9f80 0x7ffa5c1ed610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:44.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.689+0000 7ffa62d93640 1 -- 172.21.15.88:0/1561256430 >> 172.21.15.88:0/1561256430 conn(0x7ffa5c066470 msgr2=0x7ffa5c14e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:44.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.689+0000 7ffa62d93640 1 -- 172.21.15.88:0/1561256430 shutdown_connections 2023-12-08T08:20:44.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.689+0000 7ffa62d93640 1 -- 172.21.15.88:0/1561256430 wait complete. 2023-12-08T08:20:44.712 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:20:18.675917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:20:19.511013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:20:44.712 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:20:44.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.849+0000 7f9e82e09640 1 Processor -- start 2023-12-08T08:20:44.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.849+0000 7f9e82e09640 1 -- start start 2023-12-08T08:20:44.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.849+0000 7f9e82e09640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e7c14fc30 0x7f9e7c0c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:44.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.849+0000 7f9e82e09640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9e7c06d840 0x7f9e7c0c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:44.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.849+0000 7f9e82e09640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e7c152910 con 0x7f9e7c14f850 2023-12-08T08:20:44.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.849+0000 7f9e82e09640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e7c0c2240 con 0x7f9e7c06d840 2023-12-08T08:20:44.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.849+0000 7f9e82e09640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c152bf0 con 0x7f9e7c14fc30 2023-12-08T08:20:44.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.849+0000 7f9e73fff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e7c14fc30 0x7f9e7c0c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:44.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.849+0000 7f9e813a6640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9e7c06d840 0x7f9e7c0c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:44.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.849+0000 7f9e73fff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e7c14fc30 0x7f9e7c0c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:49778/0 (socket says 172.21.15.88:49778) 2023-12-08T08:20:44.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.849+0000 7f9e73fff640 1 -- 172.21.15.88:0/1783677684 learned_addr learned my addr 172.21.15.88:0/1783677684 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:44.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.849+0000 7f9e813a6640 1 -- 172.21.15.88:0/1783677684 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e7c14fc30 msgr2=0x7f9e7c0c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:44.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.849+0000 7f9e813a6640 1 --2- 172.21.15.88:0/1783677684 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e7c14fc30 0x7f9e7c0c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:44.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.849+0000 7f9e813a6640 1 -- 172.21.15.88:0/1783677684 >> v1:172.21.15.148:6789/0 conn(0x7f9e7c14f850 legacy=0x7f9e7c0aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:44.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.849+0000 7f9e813a6640 1 -- 172.21.15.88:0/1783677684 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7c152ed0 con 0x7f9e7c06d840 2023-12-08T08:20:44.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.853+0000 7f9e813a6640 1 --2- 172.21.15.88:0/1783677684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e7c06d840 0x7f9e7c0c4210 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009d90 tx=0x7f9e7401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d4d7b7b7e973a17 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:44.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.853+0000 7f9e737fe640 1 -- 172.21.15.88:0/1783677684 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e740a5940 con 0x7f9e7c06d840 2023-12-08T08:20:44.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.853+0000 7f9e737fe640 1 -- 172.21.15.88:0/1783677684 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e740a5aa0 con 0x7f9e7c06d840 2023-12-08T08:20:44.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.853+0000 7f9e737fe640 1 -- 172.21.15.88:0/1783677684 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e740a5e30 con 0x7f9e7c06d840 2023-12-08T08:20:44.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.853+0000 7f9e82e09640 1 -- 172.21.15.88:0/1783677684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e7c06d840 msgr2=0x7f9e7c0c4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:44.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.853+0000 7f9e82e09640 1 --2- 172.21.15.88:0/1783677684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e7c06d840 0x7f9e7c0c4210 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009d90 tx=0x7f9e7401c950 comp rx=0 tx=0).stop 2023-12-08T08:20:44.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.853+0000 7f9e82e09640 1 -- 172.21.15.88:0/1783677684 shutdown_connections 2023-12-08T08:20:44.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.853+0000 7f9e82e09640 1 --2- 172.21.15.88:0/1783677684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e7c06d840 0x7f9e7c0c4210 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:44.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.853+0000 7f9e82e09640 1 --2- 172.21.15.88:0/1783677684 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e7c14fc30 0x7f9e7c0c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:44.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.853+0000 7f9e82e09640 1 -- 172.21.15.88:0/1783677684 >> 172.21.15.88:0/1783677684 conn(0x7f9e7c0c59f0 msgr2=0x7f9e7c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:44.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.853+0000 7f9e82e09640 1 -- 172.21.15.88:0/1783677684 shutdown_connections 2023-12-08T08:20:44.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.853+0000 7f9e82e09640 1 -- 172.21.15.88:0/1783677684 wait complete. 2023-12-08T08:20:44.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.857+0000 7f9e82e09640 1 Processor -- start 2023-12-08T08:20:44.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.857+0000 7f9e82e09640 1 -- start start 2023-12-08T08:20:44.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.857+0000 7f9e82e09640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e7c06d840 0x7f9e7c14af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:44.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.857+0000 7f9e82e09640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e7c14f850 0x7f9e7c0c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:44.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.857+0000 7f9e82e09640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e7c14fc30 0x7f9e7c14ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:44.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.857+0000 7f9e82e09640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c14b450 con 0x7f9e7c14fc30 2023-12-08T08:20:44.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.857+0000 7f9e82e09640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c14ac30 con 0x7f9e7c06d840 2023-12-08T08:20:44.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.857+0000 7f9e82e09640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c1ee4c0 con 0x7f9e7c14f850 2023-12-08T08:20:44.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.857+0000 7f9e813a6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e7c14fc30 0x7f9e7c14ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:44.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.857+0000 7f9e813a6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e7c14fc30 0x7f9e7c14ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60462/0 (socket says 172.21.15.88:60462) 2023-12-08T08:20:44.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.857+0000 7f9e813a6640 1 -- 172.21.15.88:0/3815715162 learned_addr learned my addr 172.21.15.88:0/3815715162 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:44.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.857+0000 7f9e80ba5640 1 --2- 172.21.15.88:0/3815715162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e7c06d840 0x7f9e7c14af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:44.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.857+0000 7f9e73fff640 1 --2- 172.21.15.88:0/3815715162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e7c14f850 0x7f9e7c0c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:44.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.857+0000 7f9e813a6640 1 -- 172.21.15.88:0/3815715162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e7c14f850 msgr2=0x7f9e7c0c3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:44.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.857+0000 7f9e813a6640 1 --2- 172.21.15.88:0/3815715162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e7c14f850 0x7f9e7c0c3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:44.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.857+0000 7f9e813a6640 1 -- 172.21.15.88:0/3815715162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e7c06d840 msgr2=0x7f9e7c14af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:44.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.857+0000 7f9e813a6640 1 --2- 172.21.15.88:0/3815715162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e7c06d840 0x7f9e7c14af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:44.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.857+0000 7f9e813a6640 1 -- 172.21.15.88:0/3815715162 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e74009a70 con 0x7f9e7c14fc30 2023-12-08T08:20:44.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.857+0000 7f9e73fff640 1 --2- 172.21.15.88:0/3815715162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e7c14f850 0x7f9e7c0c3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:44.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.857+0000 7f9e813a6640 1 --2- 172.21.15.88:0/3815715162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e7c14fc30 0x7f9e7c14ba40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9e740b0040 tx=0x7f9e740196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:44.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.857+0000 7f9e717fa640 1 -- 172.21.15.88:0/3815715162 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e740add90 con 0x7f9e7c14fc30 2023-12-08T08:20:44.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.857+0000 7f9e717fa640 1 -- 172.21.15.88:0/3815715162 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e74009450 con 0x7f9e7c14fc30 2023-12-08T08:20:44.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.857+0000 7f9e717fa640 1 -- 172.21.15.88:0/3815715162 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e740b9690 con 0x7f9e7c14fc30 2023-12-08T08:20:44.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.857+0000 7f9e82e09640 1 -- 172.21.15.88:0/3815715162 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e7c14dcc0 con 0x7f9e7c14fc30 2023-12-08T08:20:44.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.857+0000 7f9e82e09640 1 -- 172.21.15.88:0/3815715162 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e7c0c4470 con 0x7f9e7c14fc30 2023-12-08T08:20:44.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.861+0000 7f9e82e09640 1 -- 172.21.15.88:0/3815715162 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e7c067630 con 0x7f9e7c14fc30 2023-12-08T08:20:44.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.861+0000 7f9e717fa640 1 -- 172.21.15.88:0/3815715162 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9e740b97f0 con 0x7f9e7c14fc30 2023-12-08T08:20:44.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.861+0000 7f9e717fa640 1 --2- 172.21.15.88:0/3815715162 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9e680664a0 0x7f9e68068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:44.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.861+0000 7f9e717fa640 1 -- 172.21.15.88:0/3815715162 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e7411ff90 con 0x7f9e7c14fc30 2023-12-08T08:20:44.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.861+0000 7f9e80ba5640 1 --2- 172.21.15.88:0/3815715162 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9e680664a0 0x7f9e68068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:44.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.861+0000 7f9e80ba5640 1 --2- 172.21.15.88:0/3815715162 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9e680664a0 0x7f9e68068960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9e78007fd0 tx=0x7f9e78009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:44.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:44.865+0000 7f9e717fa640 1 -- 172.21.15.88:0/3815715162 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9e740ed370 con 0x7f9e7c14fc30 2023-12-08T08:20:45.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.013+0000 7f9e82e09640 1 -- 172.21.15.88:0/3815715162 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9e7c0a4a90 con 0x7f9e7c14fc30 2023-12-08T08:20:45.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.017+0000 7f9e717fa640 1 -- 172.21.15.88:0/3815715162 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9e740f0990 con 0x7f9e7c14fc30 2023-12-08T08:20:45.021 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:20:45.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.017+0000 7f9e82e09640 1 -- 172.21.15.88:0/3815715162 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9e680664a0 msgr2=0x7f9e68068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:45.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.017+0000 7f9e82e09640 1 --2- 172.21.15.88:0/3815715162 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9e680664a0 0x7f9e68068960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9e78007fd0 tx=0x7f9e78009040 comp rx=0 tx=0).stop 2023-12-08T08:20:45.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.017+0000 7f9e82e09640 1 -- 172.21.15.88:0/3815715162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e7c14fc30 msgr2=0x7f9e7c14ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:45.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.017+0000 7f9e82e09640 1 --2- 172.21.15.88:0/3815715162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e7c14fc30 0x7f9e7c14ba40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9e740b0040 tx=0x7f9e740196f0 comp rx=0 tx=0).stop 2023-12-08T08:20:45.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.017+0000 7f9e82e09640 1 -- 172.21.15.88:0/3815715162 shutdown_connections 2023-12-08T08:20:45.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.017+0000 7f9e82e09640 1 --2- 172.21.15.88:0/3815715162 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9e680664a0 0x7f9e68068960 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:45.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.017+0000 7f9e82e09640 1 --2- 172.21.15.88:0/3815715162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e7c14fc30 0x7f9e7c14ba40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:45.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.017+0000 7f9e82e09640 1 --2- 172.21.15.88:0/3815715162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e7c14f850 0x7f9e7c0c3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:45.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.017+0000 7f9e82e09640 1 --2- 172.21.15.88:0/3815715162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e7c06d840 0x7f9e7c14af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:45.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.017+0000 7f9e82e09640 1 -- 172.21.15.88:0/3815715162 >> 172.21.15.88:0/3815715162 conn(0x7f9e7c0c59f0 msgr2=0x7f9e7c06cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:45.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.017+0000 7f9e82e09640 1 -- 172.21.15.88:0/3815715162 shutdown_connections 2023-12-08T08:20:45.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.017+0000 7f9e82e09640 1 -- 172.21.15.88:0/3815715162 wait complete. 2023-12-08T08:20:45.042 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:20:45.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.177+0000 7f50a6d72640 1 Processor -- start 2023-12-08T08:20:45.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.177+0000 7f50a6d72640 1 -- start start 2023-12-08T08:20:45.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.177+0000 7f50a6d72640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f50a00bed60 0x7f50a00bf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:45.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.177+0000 7f50a6d72640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a0157b80 con 0x7f50a00a4f30 2023-12-08T08:20:45.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.177+0000 7f50a6d72640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a006d6c0 con 0x7f50a00c4b20 2023-12-08T08:20:45.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.177+0000 7f50a6d72640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a006d960 con 0x7f50a00bed60 2023-12-08T08:20:45.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.177+0000 7f50a4b0e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f50a00bed60 0x7f50a00bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:45.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.177+0000 7f509ffff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f50a00a4f30 0x7f50a0154590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36562/0 (socket says 172.21.15.88:36562) 2023-12-08T08:20:45.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.177+0000 7f509ffff640 1 -- 172.21.15.88:0/2813905892 learned_addr learned my addr 172.21.15.88:0/2813905892 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:45.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.181+0000 7f50a4b0e640 1 -- 172.21.15.88:0/2813905892 >> v1:172.21.15.148:6789/0 conn(0x7f50a00c4b20 legacy=0x7f50a015ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:45.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.181+0000 7f50a4b0e640 1 -- 172.21.15.88:0/2813905892 >> v1:172.21.15.88:6789/0 conn(0x7f50a00a4f30 legacy=0x7f50a0154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:45.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.181+0000 7f50a4b0e640 1 -- 172.21.15.88:0/2813905892 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a0157dd0 con 0x7f50a00bed60 2023-12-08T08:20:45.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.181+0000 7f509f7fe640 1 -- 172.21.15.88:0/2813905892 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1456694975 0 0) 0x7f50a0157b80 con 0x7f50a00a4f30 2023-12-08T08:20:45.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.181+0000 7f50a4b0e640 1 --2- 172.21.15.88:0/2813905892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50a00bed60 0x7f50a00bf140 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f50940097c0 tx=0x7f509401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35cebdc659086d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:45.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.181+0000 7f509f7fe640 1 -- 172.21.15.88:0/2813905892 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50940ab600 con 0x7f50a00bed60 2023-12-08T08:20:45.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.181+0000 7f509f7fe640 1 -- 172.21.15.88:0/2813905892 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50940a7050 con 0x7f50a00bed60 2023-12-08T08:20:45.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.181+0000 7f509f7fe640 1 -- 172.21.15.88:0/2813905892 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50940ab980 con 0x7f50a00bed60 2023-12-08T08:20:45.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.185+0000 7f50a6d72640 1 -- 172.21.15.88:0/2813905892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50a00bed60 msgr2=0x7f50a00bf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:45.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.185+0000 7f50a6d72640 1 --2- 172.21.15.88:0/2813905892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50a00bed60 0x7f50a00bf140 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f50940097c0 tx=0x7f509401c3b0 comp rx=0 tx=0).stop 2023-12-08T08:20:45.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.185+0000 7f50a6d72640 1 -- 172.21.15.88:0/2813905892 shutdown_connections 2023-12-08T08:20:45.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.185+0000 7f50a6d72640 1 --2- 172.21.15.88:0/2813905892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50a00bed60 0x7f50a00bf140 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:45.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.185+0000 7f50a6d72640 1 -- 172.21.15.88:0/2813905892 >> 172.21.15.88:0/2813905892 conn(0x7f50a00c59f0 msgr2=0x7f50a00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:45.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.185+0000 7f50a6d72640 1 -- 172.21.15.88:0/2813905892 shutdown_connections 2023-12-08T08:20:45.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.185+0000 7f50a6d72640 1 -- 172.21.15.88:0/2813905892 wait complete. 2023-12-08T08:20:45.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.185+0000 7f50a6d72640 1 Processor -- start 2023-12-08T08:20:45.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.185+0000 7f50a6d72640 1 -- start start 2023-12-08T08:20:45.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.185+0000 7f50a6d72640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50a00a4f30 0x7f50a0071460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:45.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.185+0000 7f50a6d72640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50a00bed60 0x7f50a01f0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:45.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.185+0000 7f50a6d72640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f50a00c4b20 0x7f50a01561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:45.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.185+0000 7f50a6d72640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a01ed580 con 0x7f50a00bed60 2023-12-08T08:20:45.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.185+0000 7f50a6d72640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a00bf5f0 con 0x7f50a00a4f30 2023-12-08T08:20:45.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.185+0000 7f50a6d72640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a01f11f0 con 0x7f50a00c4b20 2023-12-08T08:20:45.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.185+0000 7f509ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50a00bed60 0x7f50a01f0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:45.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.185+0000 7f509ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50a00bed60 0x7f50a01f0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60480/0 (socket says 172.21.15.88:60480) 2023-12-08T08:20:45.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.185+0000 7f509ffff640 1 -- 172.21.15.88:0/3521769529 learned_addr learned my addr 172.21.15.88:0/3521769529 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:45.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.185+0000 7f50a4b0e640 1 --2- 172.21.15.88:0/3521769529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50a00a4f30 0x7f50a0071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:45.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.185+0000 7f50a530f640 1 --2- 172.21.15.88:0/3521769529 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f50a00c4b20 0x7f50a01561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:45.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.185+0000 7f509ffff640 1 -- 172.21.15.88:0/3521769529 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f50a00c4b20 msgr2=0x7f50a01561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:45.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.185+0000 7f509ffff640 1 --2- 172.21.15.88:0/3521769529 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f50a00c4b20 0x7f50a01561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:45.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.185+0000 7f509ffff640 1 -- 172.21.15.88:0/3521769529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50a00a4f30 msgr2=0x7f50a0071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:45.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.185+0000 7f509ffff640 1 --2- 172.21.15.88:0/3521769529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50a00a4f30 0x7f50a0071460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:45.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.185+0000 7f509ffff640 1 -- 172.21.15.88:0/3521769529 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5094009420 con 0x7f50a00bed60 2023-12-08T08:20:45.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.185+0000 7f50a530f640 1 --2- 172.21.15.88:0/3521769529 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f50a00c4b20 0x7f50a01561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:45.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.189+0000 7f509ffff640 1 --2- 172.21.15.88:0/3521769529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50a00bed60 0x7f50a01f0af0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f508c00c450 tx=0x7f508c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:45.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.189+0000 7f509d7fa640 1 -- 172.21.15.88:0/3521769529 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c0074e0 con 0x7f50a00bed60 2023-12-08T08:20:45.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.189+0000 7f509d7fa640 1 -- 172.21.15.88:0/3521769529 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508c007640 con 0x7f50a00bed60 2023-12-08T08:20:45.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.189+0000 7f509d7fa640 1 -- 172.21.15.88:0/3521769529 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c0049f0 con 0x7f50a00bed60 2023-12-08T08:20:45.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.189+0000 7f50a6d72640 1 -- 172.21.15.88:0/3521769529 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a01f14d0 con 0x7f50a00bed60 2023-12-08T08:20:45.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.189+0000 7f50a6d72640 1 -- 172.21.15.88:0/3521769529 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a01ed790 con 0x7f50a00bed60 2023-12-08T08:20:45.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.189+0000 7f50a6d72640 1 -- 172.21.15.88:0/3521769529 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a01f19f0 con 0x7f50a00bed60 2023-12-08T08:20:45.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.189+0000 7f509d7fa640 1 -- 172.21.15.88:0/3521769529 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f508c004b50 con 0x7f50a00bed60 2023-12-08T08:20:45.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.189+0000 7f509d7fa640 1 --2- 172.21.15.88:0/3521769529 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5084066470 0x7f5084068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:45.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.189+0000 7f509d7fa640 1 -- 172.21.15.88:0/3521769529 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f508c0830c0 con 0x7f50a00bed60 2023-12-08T08:20:45.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.189+0000 7f50a4b0e640 1 --2- 172.21.15.88:0/3521769529 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5084066470 0x7f5084068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:45.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.193+0000 7f50a4b0e640 1 --2- 172.21.15.88:0/3521769529 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5084066470 0x7f5084068930 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f50940ad000 tx=0x7f50940a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:45.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.193+0000 7f509d7fa640 1 -- 172.21.15.88:0/3521769529 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f50a01f19f0 con 0x7f50a00bed60 2023-12-08T08:20:45.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.345+0000 7f50a6d72640 1 -- 172.21.15.88:0/3521769529 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f50a01f19f0 con 0x7f50a00bed60 2023-12-08T08:20:45.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.345+0000 7f509d7fa640 1 -- 172.21.15.88:0/3521769529 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f50a01f19f0 con 0x7f50a00bed60 2023-12-08T08:20:45.350 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:20:45.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.345+0000 7f50a6d72640 1 -- 172.21.15.88:0/3521769529 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5084066470 msgr2=0x7f5084068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:45.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.345+0000 7f50a6d72640 1 --2- 172.21.15.88:0/3521769529 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5084066470 0x7f5084068930 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f50940ad000 tx=0x7f50940a6000 comp rx=0 tx=0).stop 2023-12-08T08:20:45.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.345+0000 7f50a6d72640 1 -- 172.21.15.88:0/3521769529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50a00bed60 msgr2=0x7f50a01f0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:45.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.345+0000 7f50a6d72640 1 --2- 172.21.15.88:0/3521769529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50a00bed60 0x7f50a01f0af0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f508c00c450 tx=0x7f508c00c910 comp rx=0 tx=0).stop 2023-12-08T08:20:45.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.345+0000 7f50a6d72640 1 -- 172.21.15.88:0/3521769529 shutdown_connections 2023-12-08T08:20:45.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.345+0000 7f50a6d72640 1 --2- 172.21.15.88:0/3521769529 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5084066470 0x7f5084068930 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:45.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.345+0000 7f50a6d72640 1 --2- 172.21.15.88:0/3521769529 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f50a00c4b20 0x7f50a01561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:45.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.345+0000 7f50a6d72640 1 --2- 172.21.15.88:0/3521769529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50a00bed60 0x7f50a01f0af0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:45.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.345+0000 7f50a6d72640 1 --2- 172.21.15.88:0/3521769529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50a00a4f30 0x7f50a0071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:45.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.345+0000 7f50a6d72640 1 -- 172.21.15.88:0/3521769529 >> 172.21.15.88:0/3521769529 conn(0x7f50a00c59f0 msgr2=0x7f50a0154410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:45.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.345+0000 7f50a6d72640 1 -- 172.21.15.88:0/3521769529 shutdown_connections 2023-12-08T08:20:45.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.345+0000 7f50a6d72640 1 -- 172.21.15.88:0/3521769529 wait complete. 2023-12-08T08:20:45.370 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:20:45.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.505+0000 7f9c89780640 1 Processor -- start 2023-12-08T08:20:45.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.505+0000 7f9c89780640 1 -- start start 2023-12-08T08:20:45.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.505+0000 7f9c89780640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c84154e70 0x7f9c840c5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:45.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.505+0000 7f9c89780640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c840c4230 con 0x7f9c840c3e50 2023-12-08T08:20:45.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.505+0000 7f9c89780640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c840c0bf0 con 0x7f9c840c58a0 2023-12-08T08:20:45.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.505+0000 7f9c89780640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c840c0ed0 con 0x7f9c84154e70 2023-12-08T08:20:45.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.505+0000 7f9c82ffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9c840c3e50 0x7f9c8406a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36572/0 (socket says 172.21.15.88:36572) 2023-12-08T08:20:45.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.505+0000 7f9c82ffd640 1 -- 172.21.15.88:0/3595116356 learned_addr learned my addr 172.21.15.88:0/3595116356 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:45.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.505+0000 7f9c827fc640 1 --2- 172.21.15.88:0/3595116356 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c84154e70 0x7f9c840c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:45.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.505+0000 7f9c81ffb640 1 -- 172.21.15.88:0/3595116356 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2595934791 0 0) 0x7f9c840c4230 con 0x7f9c840c3e50 2023-12-08T08:20:45.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.505+0000 7f9c81ffb640 1 -- 172.21.15.88:0/3595116356 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c6c003530 con 0x7f9c840c3e50 2023-12-08T08:20:45.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.505+0000 7f9c81ffb640 1 -- 172.21.15.88:0/3595116356 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364921025 0 0) 0x7f9c840c0bf0 con 0x7f9c840c58a0 2023-12-08T08:20:45.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.505+0000 7f9c81ffb640 1 -- 172.21.15.88:0/3595116356 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c840c4230 con 0x7f9c840c58a0 2023-12-08T08:20:45.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.505+0000 7f9c827fc640 1 -- 172.21.15.88:0/3595116356 >> v1:172.21.15.148:6789/0 conn(0x7f9c840c58a0 legacy=0x7f9c8415ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:45.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.505+0000 7f9c827fc640 1 -- 172.21.15.88:0/3595116356 >> v1:172.21.15.88:6789/0 conn(0x7f9c840c3e50 legacy=0x7f9c8406a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:45.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.505+0000 7f9c827fc640 1 -- 172.21.15.88:0/3595116356 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c840c4880 con 0x7f9c84154e70 2023-12-08T08:20:45.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.509+0000 7f9c827fc640 1 --2- 172.21.15.88:0/3595116356 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c84154e70 0x7f9c840c5360 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9c780097f0 tx=0x7f9c7801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5327c3bf62e0885 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:45.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.509+0000 7f9c81ffb640 1 -- 172.21.15.88:0/3595116356 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c780ac640 con 0x7f9c84154e70 2023-12-08T08:20:45.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.509+0000 7f9c81ffb640 1 -- 172.21.15.88:0/3595116356 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c780ac7a0 con 0x7f9c84154e70 2023-12-08T08:20:45.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.509+0000 7f9c81ffb640 1 -- 172.21.15.88:0/3595116356 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c780acb30 con 0x7f9c84154e70 2023-12-08T08:20:45.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.509+0000 7f9c89780640 1 -- 172.21.15.88:0/3595116356 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c84154e70 msgr2=0x7f9c840c5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:45.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.509+0000 7f9c89780640 1 --2- 172.21.15.88:0/3595116356 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c84154e70 0x7f9c840c5360 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9c780097f0 tx=0x7f9c7801c400 comp rx=0 tx=0).stop 2023-12-08T08:20:45.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.509+0000 7f9c89780640 1 -- 172.21.15.88:0/3595116356 shutdown_connections 2023-12-08T08:20:45.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.509+0000 7f9c89780640 1 --2- 172.21.15.88:0/3595116356 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c84154e70 0x7f9c840c5360 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:45.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.509+0000 7f9c89780640 1 -- 172.21.15.88:0/3595116356 >> 172.21.15.88:0/3595116356 conn(0x7f9c8406b6c0 msgr2=0x7f9c8406bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:45.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.509+0000 7f9c89780640 1 -- 172.21.15.88:0/3595116356 shutdown_connections 2023-12-08T08:20:45.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.509+0000 7f9c89780640 1 -- 172.21.15.88:0/3595116356 wait complete. 2023-12-08T08:20:45.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.513+0000 7f9c89780640 1 Processor -- start 2023-12-08T08:20:45.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.513+0000 7f9c89780640 1 -- start start 2023-12-08T08:20:45.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.513+0000 7f9c89780640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c840c3e50 0x7f9c84150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:45.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.513+0000 7f9c89780640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c840c58a0 0x7f9c841ec9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:45.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.513+0000 7f9c89780640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c84154e70 0x7f9c841f07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:45.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.513+0000 7f9c89780640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8414b240 con 0x7f9c840c58a0 2023-12-08T08:20:45.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.513+0000 7f9c89780640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c84150a60 con 0x7f9c84154e70 2023-12-08T08:20:45.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.513+0000 7f9c89780640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c841ecee0 con 0x7f9c840c3e50 2023-12-08T08:20:45.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.513+0000 7f9c827fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c840c58a0 0x7f9c841ec9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:45.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.513+0000 7f9c827fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c840c58a0 0x7f9c841ec9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60490/0 (socket says 172.21.15.88:60490) 2023-12-08T08:20:45.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.513+0000 7f9c827fc640 1 -- 172.21.15.88:0/2132028502 learned_addr learned my addr 172.21.15.88:0/2132028502 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:45.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.513+0000 7f9c82ffd640 1 --2- 172.21.15.88:0/2132028502 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c840c3e50 0x7f9c84150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:45.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.513+0000 7f9c837fe640 1 --2- 172.21.15.88:0/2132028502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c84154e70 0x7f9c841f07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:45.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.513+0000 7f9c827fc640 1 -- 172.21.15.88:0/2132028502 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c840c3e50 msgr2=0x7f9c84150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:45.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.513+0000 7f9c827fc640 1 --2- 172.21.15.88:0/2132028502 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c840c3e50 0x7f9c84150520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:45.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.513+0000 7f9c827fc640 1 -- 172.21.15.88:0/2132028502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c84154e70 msgr2=0x7f9c841f07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:45.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.513+0000 7f9c827fc640 1 --2- 172.21.15.88:0/2132028502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c84154e70 0x7f9c841f07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:45.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.513+0000 7f9c827fc640 1 -- 172.21.15.88:0/2132028502 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c78009420 con 0x7f9c840c58a0 2023-12-08T08:20:45.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.513+0000 7f9c837fe640 1 --2- 172.21.15.88:0/2132028502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c84154e70 0x7f9c841f07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:45.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.513+0000 7f9c827fc640 1 --2- 172.21.15.88:0/2132028502 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c840c58a0 0x7f9c841ec9a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9c780097f0 tx=0x7f9c780191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:45.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.513+0000 7f9c6b7fe640 1 -- 172.21.15.88:0/2132028502 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c780b5600 con 0x7f9c840c58a0 2023-12-08T08:20:45.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.513+0000 7f9c6b7fe640 1 -- 172.21.15.88:0/2132028502 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c780b5780 con 0x7f9c840c58a0 2023-12-08T08:20:45.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.513+0000 7f9c6b7fe640 1 -- 172.21.15.88:0/2132028502 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c780b5b30 con 0x7f9c840c58a0 2023-12-08T08:20:45.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.513+0000 7f9c89780640 1 -- 172.21.15.88:0/2132028502 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8414f550 con 0x7f9c840c58a0 2023-12-08T08:20:45.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.513+0000 7f9c89780640 1 -- 172.21.15.88:0/2132028502 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c841f0290 con 0x7f9c840c58a0 2023-12-08T08:20:45.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.517+0000 7f9c697fa640 1 -- 172.21.15.88:0/2132028502 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c84154560 con 0x7f9c840c58a0 2023-12-08T08:20:45.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.521+0000 7f9c6b7fe640 1 -- 172.21.15.88:0/2132028502 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9c780b3040 con 0x7f9c840c58a0 2023-12-08T08:20:45.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.521+0000 7f9c6b7fe640 1 --2- 172.21.15.88:0/2132028502 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9c700664a0 0x7f9c70068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:45.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.521+0000 7f9c6b7fe640 1 -- 172.21.15.88:0/2132028502 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c7811e2b0 con 0x7f9c840c58a0 2023-12-08T08:20:45.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.521+0000 7f9c82ffd640 1 --2- 172.21.15.88:0/2132028502 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9c700664a0 0x7f9c70068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:45.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.521+0000 7f9c82ffd640 1 --2- 172.21.15.88:0/2132028502 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9c700664a0 0x7f9c70068960 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9c74007fd0 tx=0x7f9c74007d80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:45.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.525+0000 7f9c6b7fe640 1 -- 172.21.15.88:0/2132028502 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9c780eb8a0 con 0x7f9c840c58a0 2023-12-08T08:20:45.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.681+0000 7f9c697fa640 1 -- 172.21.15.88:0/2132028502 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9c840674b0 con 0x7f9c840c58a0 2023-12-08T08:20:45.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.681+0000 7f9c6b7fe640 1 -- 172.21.15.88:0/2132028502 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9c780eeec0 con 0x7f9c840c58a0 2023-12-08T08:20:45.689 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:20:45.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.685+0000 7f9c697fa640 1 -- 172.21.15.88:0/2132028502 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9c700664a0 msgr2=0x7f9c70068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:45.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.685+0000 7f9c697fa640 1 --2- 172.21.15.88:0/2132028502 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9c700664a0 0x7f9c70068960 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9c74007fd0 tx=0x7f9c74007d80 comp rx=0 tx=0).stop 2023-12-08T08:20:45.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.685+0000 7f9c697fa640 1 -- 172.21.15.88:0/2132028502 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c840c58a0 msgr2=0x7f9c841ec9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:45.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.685+0000 7f9c697fa640 1 --2- 172.21.15.88:0/2132028502 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c840c58a0 0x7f9c841ec9a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9c780097f0 tx=0x7f9c780191a0 comp rx=0 tx=0).stop 2023-12-08T08:20:45.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.685+0000 7f9c697fa640 1 -- 172.21.15.88:0/2132028502 shutdown_connections 2023-12-08T08:20:45.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.685+0000 7f9c697fa640 1 --2- 172.21.15.88:0/2132028502 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9c700664a0 0x7f9c70068960 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:45.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.685+0000 7f9c697fa640 1 --2- 172.21.15.88:0/2132028502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c84154e70 0x7f9c841f07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:45.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.685+0000 7f9c697fa640 1 --2- 172.21.15.88:0/2132028502 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c840c58a0 0x7f9c841ec9a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:45.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.685+0000 7f9c697fa640 1 --2- 172.21.15.88:0/2132028502 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9c840c3e50 0x7f9c84150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:45.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.685+0000 7f9c697fa640 1 -- 172.21.15.88:0/2132028502 >> 172.21.15.88:0/2132028502 conn(0x7f9c8406b6c0 msgr2=0x7f9c8406baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:45.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.685+0000 7f9c697fa640 1 -- 172.21.15.88:0/2132028502 shutdown_connections 2023-12-08T08:20:45.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.685+0000 7f9c697fa640 1 -- 172.21.15.88:0/2132028502 wait complete. 2023-12-08T08:20:45.719 INFO:tasks.cephfs_test_runner:Starting test: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-12-08T08:20:45.720 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:45.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.853+0000 7f3272417640 1 Processor -- start 2023-12-08T08:20:45.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.853+0000 7f3272417640 1 -- start start 2023-12-08T08:20:45.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.853+0000 7f3272417640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f326c0bf310 0x7f326c154e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:45.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.853+0000 7f3272417640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f326c157cf0 con 0x7f326c0bee90 2023-12-08T08:20:45.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.853+0000 7f3272417640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f326c157fd0 con 0x7f326c14b2a0 2023-12-08T08:20:45.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.853+0000 7f3272417640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f326c06c3a0 con 0x7f326c0bf310 2023-12-08T08:20:45.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.853+0000 7f326b7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f326c0bee90 0x7f326c154740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36576/0 (socket says 172.21.15.88:36576) 2023-12-08T08:20:45.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.853+0000 7f326b7fe640 1 -- 172.21.15.88:0/193335612 learned_addr learned my addr 172.21.15.88:0/193335612 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:45.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.853+0000 7f32709b4640 1 --2- 172.21.15.88:0/193335612 >> v2:172.21.15.148:3300/0 conn(0x7f326c0bf310 0x7f326c154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:45.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.853+0000 7f326affd640 1 -- 172.21.15.88:0/193335612 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902667091 0 0) 0x7f326c157cf0 con 0x7f326c0bee90 2023-12-08T08:20:45.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.853+0000 7f326affd640 1 -- 172.21.15.88:0/193335612 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3254003530 con 0x7f326c0bee90 2023-12-08T08:20:45.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.853+0000 7f326affd640 1 -- 172.21.15.88:0/193335612 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 306114348 0 0) 0x7f326c157fd0 con 0x7f326c14b2a0 2023-12-08T08:20:45.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.853+0000 7f326affd640 1 -- 172.21.15.88:0/193335612 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f326c157cf0 con 0x7f326c14b2a0 2023-12-08T08:20:45.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.853+0000 7f32709b4640 1 -- 172.21.15.88:0/193335612 >> v1:172.21.15.148:6789/0 conn(0x7f326c14b2a0 legacy=0x7f326c0a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:45.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.853+0000 7f32709b4640 1 -- 172.21.15.88:0/193335612 >> v1:172.21.15.88:6789/0 conn(0x7f326c0bee90 legacy=0x7f326c154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:45.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.853+0000 7f32709b4640 1 -- 172.21.15.88:0/193335612 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326c1582b0 con 0x7f326c0bf310 2023-12-08T08:20:45.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.857+0000 7f32709b4640 1 --2- 172.21.15.88:0/193335612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f326c0bf310 0x7f326c154e50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3264009d90 tx=0x7f326401c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bae18d4770a45bf server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:45.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.857+0000 7f326affd640 1 -- 172.21.15.88:0/193335612 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32640a6700 con 0x7f326c0bf310 2023-12-08T08:20:45.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.857+0000 7f326affd640 1 -- 172.21.15.88:0/193335612 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32640a6860 con 0x7f326c0bf310 2023-12-08T08:20:45.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.857+0000 7f326affd640 1 -- 172.21.15.88:0/193335612 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32640a6bf0 con 0x7f326c0bf310 2023-12-08T08:20:45.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.857+0000 7f3272417640 1 -- 172.21.15.88:0/193335612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f326c0bf310 msgr2=0x7f326c154e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:45.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.857+0000 7f3272417640 1 --2- 172.21.15.88:0/193335612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f326c0bf310 0x7f326c154e50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3264009d90 tx=0x7f326401c830 comp rx=0 tx=0).stop 2023-12-08T08:20:45.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.857+0000 7f3272417640 1 -- 172.21.15.88:0/193335612 shutdown_connections 2023-12-08T08:20:45.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.857+0000 7f3272417640 1 --2- 172.21.15.88:0/193335612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f326c0bf310 0x7f326c154e50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:45.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.857+0000 7f3272417640 1 -- 172.21.15.88:0/193335612 >> 172.21.15.88:0/193335612 conn(0x7f326c0a7810 msgr2=0x7f326c0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:45.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.857+0000 7f3272417640 1 -- 172.21.15.88:0/193335612 shutdown_connections 2023-12-08T08:20:45.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.857+0000 7f3272417640 1 -- 172.21.15.88:0/193335612 wait complete. 2023-12-08T08:20:45.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.861+0000 7f3272417640 1 Processor -- start 2023-12-08T08:20:45.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.861+0000 7f3272417640 1 -- start start 2023-12-08T08:20:45.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.861+0000 7f3272417640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f326c0bee90 0x7f326c1536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:45.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.861+0000 7f3272417640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f326c0bf310 0x7f326c143b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:45.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.861+0000 7f3272417640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f326c14b2a0 0x7f326c144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:45.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.861+0000 7f3272417640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326c0aba50 con 0x7f326c0bf310 2023-12-08T08:20:45.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.861+0000 7f3272417640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326c1f0a60 con 0x7f326c0bee90 2023-12-08T08:20:45.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.861+0000 7f3272417640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f326c1551b0 con 0x7f326c14b2a0 2023-12-08T08:20:45.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.861+0000 7f326b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f326c0bf310 0x7f326c143b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:45.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.861+0000 7f326b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f326c0bf310 0x7f326c143b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60494/0 (socket says 172.21.15.88:60494) 2023-12-08T08:20:45.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.861+0000 7f326b7fe640 1 -- 172.21.15.88:0/1507592818 learned_addr learned my addr 172.21.15.88:0/1507592818 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:45.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.861+0000 7f326bfff640 1 --2- 172.21.15.88:0/1507592818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f326c0bee90 0x7f326c1536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:45.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.861+0000 7f32709b4640 1 --2- 172.21.15.88:0/1507592818 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f326c14b2a0 0x7f326c144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:45.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.861+0000 7f326b7fe640 1 -- 172.21.15.88:0/1507592818 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f326c14b2a0 msgr2=0x7f326c144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:45.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.861+0000 7f326b7fe640 1 --2- 172.21.15.88:0/1507592818 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f326c14b2a0 0x7f326c144050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:45.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.861+0000 7f326b7fe640 1 -- 172.21.15.88:0/1507592818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f326c0bee90 msgr2=0x7f326c1536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:45.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.861+0000 7f326b7fe640 1 --2- 172.21.15.88:0/1507592818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f326c0bee90 0x7f326c1536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:45.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.861+0000 7f326b7fe640 1 -- 172.21.15.88:0/1507592818 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3264009a70 con 0x7f326c0bf310 2023-12-08T08:20:45.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.861+0000 7f326bfff640 1 --2- 172.21.15.88:0/1507592818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f326c0bee90 0x7f326c1536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:45.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.861+0000 7f32709b4640 1 --2- 172.21.15.88:0/1507592818 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f326c14b2a0 0x7f326c144050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:45.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.861+0000 7f326b7fe640 1 --2- 172.21.15.88:0/1507592818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f326c0bf310 0x7f326c143b10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f326000c500 tx=0x7f326000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:45.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.861+0000 7f3268ff9640 1 -- 172.21.15.88:0/1507592818 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3260005cf0 con 0x7f326c0bf310 2023-12-08T08:20:45.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.861+0000 7f3268ff9640 1 -- 172.21.15.88:0/1507592818 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3260005e50 con 0x7f326c0bf310 2023-12-08T08:20:45.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.861+0000 7f3268ff9640 1 -- 172.21.15.88:0/1507592818 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3260007310 con 0x7f326c0bf310 2023-12-08T08:20:45.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.861+0000 7f3272417640 1 -- 172.21.15.88:0/1507592818 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f326c0ab4b0 con 0x7f326c0bf310 2023-12-08T08:20:45.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.861+0000 7f3272417640 1 -- 172.21.15.88:0/1507592818 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f326c0a4f50 con 0x7f326c0bf310 2023-12-08T08:20:45.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.861+0000 7f3272417640 1 -- 172.21.15.88:0/1507592818 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f326c067630 con 0x7f326c0bf310 2023-12-08T08:20:45.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.865+0000 7f3268ff9640 1 -- 172.21.15.88:0/1507592818 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3260007470 con 0x7f326c0bf310 2023-12-08T08:20:45.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.865+0000 7f3268ff9640 1 --2- 172.21.15.88:0/1507592818 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3258066470 0x7f3258068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:45.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.865+0000 7f3268ff9640 1 -- 172.21.15.88:0/1507592818 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32600834d0 con 0x7f326c0bf310 2023-12-08T08:20:45.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.865+0000 7f326bfff640 1 --2- 172.21.15.88:0/1507592818 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3258066470 0x7f3258068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:45.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.865+0000 7f326bfff640 1 --2- 172.21.15.88:0/1507592818 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3258066470 0x7f3258068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f325c0011f0 tx=0x7f325c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:45.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:45.869+0000 7f3268ff9640 1 -- 172.21.15.88:0/1507592818 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3260050940 con 0x7f326c0bf310 2023-12-08T08:20:46.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.021+0000 7f3272417640 1 -- 172.21.15.88:0/1507592818 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f326c0c0010 con 0x7f326c0bf310 2023-12-08T08:20:46.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.021+0000 7f3268ff9640 1 -- 172.21.15.88:0/1507592818 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7f3260053f60 con 0x7f326c0bf310 2023-12-08T08:20:46.028 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:46.028 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:20:21.492555+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:18.675917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:19.511013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:46.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.025+0000 7f3272417640 1 -- 172.21.15.88:0/1507592818 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3258066470 msgr2=0x7f3258068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:46.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.025+0000 7f3272417640 1 --2- 172.21.15.88:0/1507592818 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3258066470 0x7f3258068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f325c0011f0 tx=0x7f325c009040 comp rx=0 tx=0).stop 2023-12-08T08:20:46.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.025+0000 7f3272417640 1 -- 172.21.15.88:0/1507592818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f326c0bf310 msgr2=0x7f326c143b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:46.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.025+0000 7f3272417640 1 --2- 172.21.15.88:0/1507592818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f326c0bf310 0x7f326c143b10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f326000c500 tx=0x7f326000c9c0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.025+0000 7f3272417640 1 -- 172.21.15.88:0/1507592818 shutdown_connections 2023-12-08T08:20:46.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.025+0000 7f3272417640 1 --2- 172.21.15.88:0/1507592818 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3258066470 0x7f3258068930 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.025+0000 7f3272417640 1 --2- 172.21.15.88:0/1507592818 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f326c14b2a0 0x7f326c144050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.025+0000 7f3272417640 1 --2- 172.21.15.88:0/1507592818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f326c0bf310 0x7f326c143b10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.025+0000 7f3272417640 1 --2- 172.21.15.88:0/1507592818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f326c0bee90 0x7f326c1536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.025+0000 7f3272417640 1 -- 172.21.15.88:0/1507592818 >> 172.21.15.88:0/1507592818 conn(0x7f326c0a7810 msgr2=0x7f326c147e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:46.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.025+0000 7f3272417640 1 -- 172.21.15.88:0/1507592818 shutdown_connections 2023-12-08T08:20:46.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.025+0000 7f3272417640 1 -- 172.21.15.88:0/1507592818 wait complete. 2023-12-08T08:20:46.049 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:20:18.675917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:20:19.511013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:20:46.050 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:20:46.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.185+0000 7f0451757640 1 Processor -- start 2023-12-08T08:20:46.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.185+0000 7f0451757640 1 -- start start 2023-12-08T08:20:46.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.185+0000 7f0451757640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f044c0c6030 0x7f044c0c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:46.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.185+0000 7f0451757640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f044c0c98f0 0x7f044c0c8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:46.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.185+0000 7f0451757640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f044c158780 con 0x7f044c0bf2d0 2023-12-08T08:20:46.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.185+0000 7f0451757640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f044c0c0300 con 0x7f044c0c98f0 2023-12-08T08:20:46.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.185+0000 7f0451757640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044c157b70 con 0x7f044c0c6030 2023-12-08T08:20:46.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.185+0000 7f044b7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f044c0c98f0 0x7f044c0c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:46.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.185+0000 7f044b7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f044c0c98f0 0x7f044c0c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60500/0 (socket says 172.21.15.88:60500) 2023-12-08T08:20:46.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.185+0000 7f044b7fe640 1 -- 172.21.15.88:0/228472277 learned_addr learned my addr 172.21.15.88:0/228472277 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:46.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.185+0000 7f044a7fc640 1 --2- 172.21.15.88:0/228472277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f044c0c6030 0x7f044c0c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:46.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.185+0000 7f044b7fe640 1 -- 172.21.15.88:0/228472277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f044c0c6030 msgr2=0x7f044c0c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:46.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.185+0000 7f044b7fe640 1 --2- 172.21.15.88:0/228472277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f044c0c6030 0x7f044c0c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.185+0000 7f044b7fe640 1 -- 172.21.15.88:0/228472277 >> v1:172.21.15.148:6789/0 conn(0x7f044c0bf2d0 legacy=0x7f044c151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:46.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.185+0000 7f044b7fe640 1 -- 172.21.15.88:0/228472277 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044c157e50 con 0x7f044c0c98f0 2023-12-08T08:20:46.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.189+0000 7f044b7fe640 1 --2- 172.21.15.88:0/228472277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c0c98f0 0x7f044c0c8200 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0444009e50 tx=0x7f044401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24cf338eab477bbf server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:46.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.189+0000 7f0449ffb640 1 -- 172.21.15.88:0/228472277 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04440a58a0 con 0x7f044c0c98f0 2023-12-08T08:20:46.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.189+0000 7f0449ffb640 1 -- 172.21.15.88:0/228472277 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04440a5a00 con 0x7f044c0c98f0 2023-12-08T08:20:46.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.189+0000 7f0449ffb640 1 -- 172.21.15.88:0/228472277 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04440a5d90 con 0x7f044c0c98f0 2023-12-08T08:20:46.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.189+0000 7f0451757640 1 -- 172.21.15.88:0/228472277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c0c98f0 msgr2=0x7f044c0c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:46.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.189+0000 7f0451757640 1 --2- 172.21.15.88:0/228472277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c0c98f0 0x7f044c0c8200 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0444009e50 tx=0x7f044401c9e0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.189+0000 7f0451757640 1 -- 172.21.15.88:0/228472277 shutdown_connections 2023-12-08T08:20:46.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.189+0000 7f0451757640 1 --2- 172.21.15.88:0/228472277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c0c98f0 0x7f044c0c8200 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.189+0000 7f0451757640 1 --2- 172.21.15.88:0/228472277 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f044c0c6030 0x7f044c0c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.189+0000 7f0451757640 1 -- 172.21.15.88:0/228472277 >> 172.21.15.88:0/228472277 conn(0x7f044c0c9dc0 msgr2=0x7f044c0ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:46.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.189+0000 7f0451757640 1 -- 172.21.15.88:0/228472277 shutdown_connections 2023-12-08T08:20:46.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.189+0000 7f0451757640 1 -- 172.21.15.88:0/228472277 wait complete. 2023-12-08T08:20:46.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.193+0000 7f0451757640 1 Processor -- start 2023-12-08T08:20:46.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.193+0000 7f0451757640 1 -- start start 2023-12-08T08:20:46.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.193+0000 7f0451757640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f044c0bf2d0 0x7f044c0ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:46.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.193+0000 7f0451757640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f044c0c6030 0x7f044c148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:46.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.193+0000 7f0451757640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c0c98f0 0x7f044c1f09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:46.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.193+0000 7f0451757640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044c1f0f20 con 0x7f044c0c98f0 2023-12-08T08:20:46.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.193+0000 7f0451757640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044c148a10 con 0x7f044c0c6030 2023-12-08T08:20:46.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.193+0000 7f0451757640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044c0ace20 con 0x7f044c0bf2d0 2023-12-08T08:20:46.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.193+0000 7f044b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c0c98f0 0x7f044c1f09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:46.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.193+0000 7f044b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c0c98f0 0x7f044c1f09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60512/0 (socket says 172.21.15.88:60512) 2023-12-08T08:20:46.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.193+0000 7f044b7fe640 1 -- 172.21.15.88:0/3596541158 learned_addr learned my addr 172.21.15.88:0/3596541158 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:46.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.193+0000 7f044affd640 1 --2- 172.21.15.88:0/3596541158 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f044c0bf2d0 0x7f044c0ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:46.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.193+0000 7f044a7fc640 1 --2- 172.21.15.88:0/3596541158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f044c0c6030 0x7f044c148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:46.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.193+0000 7f044b7fe640 1 -- 172.21.15.88:0/3596541158 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f044c0bf2d0 msgr2=0x7f044c0ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:46.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.193+0000 7f044b7fe640 1 --2- 172.21.15.88:0/3596541158 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f044c0bf2d0 0x7f044c0ad8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.193+0000 7f044b7fe640 1 -- 172.21.15.88:0/3596541158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f044c0c6030 msgr2=0x7f044c148140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:46.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.193+0000 7f044b7fe640 1 --2- 172.21.15.88:0/3596541158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f044c0c6030 0x7f044c148140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.193+0000 7f044b7fe640 1 -- 172.21.15.88:0/3596541158 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0444009b30 con 0x7f044c0c98f0 2023-12-08T08:20:46.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.193+0000 7f044a7fc640 1 --2- 172.21.15.88:0/3596541158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f044c0c6030 0x7f044c148140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:46.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.193+0000 7f044b7fe640 1 --2- 172.21.15.88:0/3596541158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c0c98f0 0x7f044c1f09e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f04440af040 tx=0x7f0444019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:46.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.193+0000 7f04337fe640 1 -- 172.21.15.88:0/3596541158 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04440b8670 con 0x7f044c0c98f0 2023-12-08T08:20:46.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.193+0000 7f04337fe640 1 -- 172.21.15.88:0/3596541158 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04440b87d0 con 0x7f044c0c98f0 2023-12-08T08:20:46.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.193+0000 7f0451757640 1 -- 172.21.15.88:0/3596541158 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f044c148730 con 0x7f044c0c98f0 2023-12-08T08:20:46.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.193+0000 7f04337fe640 1 -- 172.21.15.88:0/3596541158 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04440b8b80 con 0x7f044c0c98f0 2023-12-08T08:20:46.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.193+0000 7f0451757640 1 -- 172.21.15.88:0/3596541158 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f044c0ad3a0 con 0x7f044c0c98f0 2023-12-08T08:20:46.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.193+0000 7f0451757640 1 -- 172.21.15.88:0/3596541158 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f044c0ad590 con 0x7f044c0c98f0 2023-12-08T08:20:46.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.197+0000 7f04337fe640 1 -- 172.21.15.88:0/3596541158 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f04440b8ce0 con 0x7f044c0c98f0 2023-12-08T08:20:46.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.197+0000 7f04337fe640 1 --2- 172.21.15.88:0/3596541158 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0438066470 0x7f0438068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:46.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.197+0000 7f04337fe640 1 -- 172.21.15.88:0/3596541158 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f044411f3c0 con 0x7f044c0c98f0 2023-12-08T08:20:46.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.197+0000 7f044affd640 1 --2- 172.21.15.88:0/3596541158 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0438066470 0x7f0438068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:46.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.197+0000 7f044affd640 1 --2- 172.21.15.88:0/3596541158 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0438066470 0x7f0438068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f043c007fd0 tx=0x7f043c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:46.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.201+0000 7f04337fe640 1 -- 172.21.15.88:0/3596541158 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f04440ec9f0 con 0x7f044c0c98f0 2023-12-08T08:20:46.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.349+0000 7f0451757640 1 -- 172.21.15.88:0/3596541158 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f044c067630 con 0x7f044c0c98f0 2023-12-08T08:20:46.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.349+0000 7f04337fe640 1 -- 172.21.15.88:0/3596541158 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f04440f0010 con 0x7f044c0c98f0 2023-12-08T08:20:46.355 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:20:46.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.353+0000 7f0451757640 1 -- 172.21.15.88:0/3596541158 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0438066470 msgr2=0x7f0438068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:46.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.353+0000 7f0451757640 1 --2- 172.21.15.88:0/3596541158 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0438066470 0x7f0438068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f043c007fd0 tx=0x7f043c009040 comp rx=0 tx=0).stop 2023-12-08T08:20:46.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.353+0000 7f0451757640 1 -- 172.21.15.88:0/3596541158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c0c98f0 msgr2=0x7f044c1f09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:46.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.353+0000 7f0451757640 1 --2- 172.21.15.88:0/3596541158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c0c98f0 0x7f044c1f09e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f04440af040 tx=0x7f0444019780 comp rx=0 tx=0).stop 2023-12-08T08:20:46.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.353+0000 7f0451757640 1 -- 172.21.15.88:0/3596541158 shutdown_connections 2023-12-08T08:20:46.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.353+0000 7f0451757640 1 --2- 172.21.15.88:0/3596541158 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0438066470 0x7f0438068930 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.353+0000 7f0451757640 1 --2- 172.21.15.88:0/3596541158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c0c98f0 0x7f044c1f09e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.353+0000 7f0451757640 1 --2- 172.21.15.88:0/3596541158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f044c0c6030 0x7f044c148140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.353+0000 7f0451757640 1 --2- 172.21.15.88:0/3596541158 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f044c0bf2d0 0x7f044c0ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.353+0000 7f0451757640 1 -- 172.21.15.88:0/3596541158 >> 172.21.15.88:0/3596541158 conn(0x7f044c0c9dc0 msgr2=0x7f044c151740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:46.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.353+0000 7f0451757640 1 -- 172.21.15.88:0/3596541158 shutdown_connections 2023-12-08T08:20:46.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.353+0000 7f0451757640 1 -- 172.21.15.88:0/3596541158 wait complete. 2023-12-08T08:20:46.376 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:20:46.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.509+0000 7f64fdd2a640 1 Processor -- start 2023-12-08T08:20:46.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.509+0000 7f64fdd2a640 1 -- start start 2023-12-08T08:20:46.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.513+0000 7f64fdd2a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64f80c5300 0x7f64f80a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:46.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.513+0000 7f64fdd2a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f64f81548c0 0x7f64f8154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:46.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.513+0000 7f64fdd2a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f80a4e20 con 0x7f64f814b1e0 2023-12-08T08:20:46.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.513+0000 7f64fdd2a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f80a50e0 con 0x7f64f81548c0 2023-12-08T08:20:46.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.513+0000 7f64fdd2a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f80c0f00 con 0x7f64f80c5300 2023-12-08T08:20:46.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.513+0000 7f64f7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f64f81548c0 0x7f64f8154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:46.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.513+0000 7f64f7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f64f81548c0 0x7f64f8154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60524/0 (socket says 172.21.15.88:60524) 2023-12-08T08:20:46.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.513+0000 7f64f7fff640 1 -- 172.21.15.88:0/1762627609 learned_addr learned my addr 172.21.15.88:0/1762627609 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:46.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.513+0000 7f64effff640 1 --2- 172.21.15.88:0/1762627609 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64f80c5300 0x7f64f80a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:46.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.513+0000 7f64f7fff640 1 -- 172.21.15.88:0/1762627609 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64f80c5300 msgr2=0x7f64f80a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:46.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.513+0000 7f64f7fff640 1 --2- 172.21.15.88:0/1762627609 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64f80c5300 0x7f64f80a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.513+0000 7f64f7fff640 1 -- 172.21.15.88:0/1762627609 >> v1:172.21.15.88:6789/0 conn(0x7f64f814b1e0 legacy=0x7f64f80c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:46.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.513+0000 7f64f7fff640 1 -- 172.21.15.88:0/1762627609 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f80c11e0 con 0x7f64f81548c0 2023-12-08T08:20:46.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.513+0000 7f64f6ffd640 1 -- 172.21.15.88:0/1762627609 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2283724693 0 0) 0x7f64f80a4e20 con 0x7f64f814b1e0 2023-12-08T08:20:46.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.517+0000 7f64f7fff640 1 --2- 172.21.15.88:0/1762627609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64f81548c0 0x7f64f8154d50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f64f000d150 tx=0x7f64f001ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f18ce41deb791494 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:46.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.517+0000 7f64f6ffd640 1 -- 172.21.15.88:0/1762627609 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f81558b0 con 0x7f64f81548c0 2023-12-08T08:20:46.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.517+0000 7f64f6ffd640 1 -- 172.21.15.88:0/1762627609 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f000b2d0 con 0x7f64f81548c0 2023-12-08T08:20:46.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.517+0000 7f64f6ffd640 1 -- 172.21.15.88:0/1762627609 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f00a7b10 con 0x7f64f81548c0 2023-12-08T08:20:46.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.517+0000 7f64fdd2a640 1 -- 172.21.15.88:0/1762627609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64f81548c0 msgr2=0x7f64f8154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:46.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.517+0000 7f64fdd2a640 1 --2- 172.21.15.88:0/1762627609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64f81548c0 0x7f64f8154d50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f64f000d150 tx=0x7f64f001ec10 comp rx=0 tx=0).stop 2023-12-08T08:20:46.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.517+0000 7f64fdd2a640 1 -- 172.21.15.88:0/1762627609 shutdown_connections 2023-12-08T08:20:46.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.517+0000 7f64fdd2a640 1 --2- 172.21.15.88:0/1762627609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64f81548c0 0x7f64f8154d50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.517+0000 7f64fdd2a640 1 --2- 172.21.15.88:0/1762627609 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64f80c5300 0x7f64f80a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.517+0000 7f64fdd2a640 1 -- 172.21.15.88:0/1762627609 >> 172.21.15.88:0/1762627609 conn(0x7f64f80c59f0 msgr2=0x7f64f80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:46.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.517+0000 7f64fdd2a640 1 -- 172.21.15.88:0/1762627609 shutdown_connections 2023-12-08T08:20:46.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.517+0000 7f64fdd2a640 1 -- 172.21.15.88:0/1762627609 wait complete. 2023-12-08T08:20:46.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.517+0000 7f64fdd2a640 1 Processor -- start 2023-12-08T08:20:46.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.517+0000 7f64fdd2a640 1 -- start start 2023-12-08T08:20:46.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.517+0000 7f64fdd2a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64f80c5300 0x7f64f8147bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:46.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.517+0000 7f64fdd2a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64f814b1e0 0x7f64f81ebd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:46.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.517+0000 7f64fdd2a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64f81548c0 0x7f64f81ec280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:46.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.517+0000 7f64fdd2a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f81502b0 con 0x7f64f81548c0 2023-12-08T08:20:46.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.517+0000 7f64fdd2a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f8150660 con 0x7f64f814b1e0 2023-12-08T08:20:46.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.517+0000 7f64fdd2a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f814beb0 con 0x7f64f80c5300 2023-12-08T08:20:46.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.517+0000 7f64f7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64f81548c0 0x7f64f81ec280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:46.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.517+0000 7f64f7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64f81548c0 0x7f64f81ec280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60526/0 (socket says 172.21.15.88:60526) 2023-12-08T08:20:46.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.517+0000 7f64f7fff640 1 -- 172.21.15.88:0/3977682660 learned_addr learned my addr 172.21.15.88:0/3977682660 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:46.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.521+0000 7f64f77fe640 1 --2- 172.21.15.88:0/3977682660 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64f80c5300 0x7f64f8147bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:46.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.521+0000 7f64effff640 1 --2- 172.21.15.88:0/3977682660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64f814b1e0 0x7f64f81ebd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:46.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.521+0000 7f64f7fff640 1 -- 172.21.15.88:0/3977682660 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64f80c5300 msgr2=0x7f64f8147bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:46.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.521+0000 7f64f7fff640 1 --2- 172.21.15.88:0/3977682660 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64f80c5300 0x7f64f8147bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.521+0000 7f64f7fff640 1 -- 172.21.15.88:0/3977682660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64f814b1e0 msgr2=0x7f64f81ebd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:46.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.521+0000 7f64f7fff640 1 --2- 172.21.15.88:0/3977682660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64f814b1e0 0x7f64f81ebd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.521+0000 7f64f7fff640 1 -- 172.21.15.88:0/3977682660 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f000bd40 con 0x7f64f81548c0 2023-12-08T08:20:46.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.521+0000 7f64f7fff640 1 --2- 172.21.15.88:0/3977682660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64f81548c0 0x7f64f81ec280 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f64f000d150 tx=0x7f64f001b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:46.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.521+0000 7f64f4ff9640 1 -- 172.21.15.88:0/3977682660 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f000b440 con 0x7f64f81548c0 2023-12-08T08:20:46.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.521+0000 7f64f4ff9640 1 -- 172.21.15.88:0/3977682660 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f0009810 con 0x7f64f81548c0 2023-12-08T08:20:46.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.521+0000 7f64f4ff9640 1 -- 172.21.15.88:0/3977682660 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f0009bc0 con 0x7f64f81548c0 2023-12-08T08:20:46.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.521+0000 7f64fdd2a640 1 -- 172.21.15.88:0/3977682660 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f81ec8d0 con 0x7f64f81548c0 2023-12-08T08:20:46.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.521+0000 7f64fdd2a640 1 -- 172.21.15.88:0/3977682660 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f814c450 con 0x7f64f81548c0 2023-12-08T08:20:46.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.521+0000 7f64fdd2a640 1 -- 172.21.15.88:0/3977682660 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f814c640 con 0x7f64f81548c0 2023-12-08T08:20:46.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.521+0000 7f64f4ff9640 1 -- 172.21.15.88:0/3977682660 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f64f0009d20 con 0x7f64f81548c0 2023-12-08T08:20:46.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.521+0000 7f64f4ff9640 1 --2- 172.21.15.88:0/3977682660 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f64d8066470 0x7f64d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:46.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.521+0000 7f64f4ff9640 1 -- 172.21.15.88:0/3977682660 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64f01215a0 con 0x7f64f81548c0 2023-12-08T08:20:46.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.525+0000 7f64f77fe640 1 --2- 172.21.15.88:0/3977682660 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f64d8066470 0x7f64d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:46.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.525+0000 7f64f77fe640 1 --2- 172.21.15.88:0/3977682660 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f64d8066470 0x7f64d8068930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f64e8000f70 tx=0x7f64e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:46.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.525+0000 7f64f4ff9640 1 -- 172.21.15.88:0/3977682660 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f64f00eeb30 con 0x7f64f81548c0 2023-12-08T08:20:46.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.677+0000 7f64fdd2a640 1 -- 172.21.15.88:0/3977682660 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f64f8067630 con 0x7f64f81548c0 2023-12-08T08:20:46.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.677+0000 7f64f4ff9640 1 -- 172.21.15.88:0/3977682660 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f64f00f2150 con 0x7f64f81548c0 2023-12-08T08:20:46.683 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:20:46.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.677+0000 7f64fdd2a640 1 -- 172.21.15.88:0/3977682660 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f64d8066470 msgr2=0x7f64d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:46.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.677+0000 7f64fdd2a640 1 --2- 172.21.15.88:0/3977682660 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f64d8066470 0x7f64d8068930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f64e8000f70 tx=0x7f64e8009040 comp rx=0 tx=0).stop 2023-12-08T08:20:46.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.677+0000 7f64fdd2a640 1 -- 172.21.15.88:0/3977682660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64f81548c0 msgr2=0x7f64f81ec280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:46.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.677+0000 7f64fdd2a640 1 --2- 172.21.15.88:0/3977682660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64f81548c0 0x7f64f81ec280 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f64f000d150 tx=0x7f64f001b9b0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.677+0000 7f64fdd2a640 1 -- 172.21.15.88:0/3977682660 shutdown_connections 2023-12-08T08:20:46.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.677+0000 7f64fdd2a640 1 --2- 172.21.15.88:0/3977682660 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f64d8066470 0x7f64d8068930 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.677+0000 7f64fdd2a640 1 --2- 172.21.15.88:0/3977682660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64f81548c0 0x7f64f81ec280 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.677+0000 7f64fdd2a640 1 --2- 172.21.15.88:0/3977682660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64f814b1e0 0x7f64f81ebd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.677+0000 7f64fdd2a640 1 --2- 172.21.15.88:0/3977682660 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64f80c5300 0x7f64f8147bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.677+0000 7f64fdd2a640 1 -- 172.21.15.88:0/3977682660 >> 172.21.15.88:0/3977682660 conn(0x7f64f80c59f0 msgr2=0x7f64f8149300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:46.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.677+0000 7f64fdd2a640 1 -- 172.21.15.88:0/3977682660 shutdown_connections 2023-12-08T08:20:46.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.677+0000 7f64fdd2a640 1 -- 172.21.15.88:0/3977682660 wait complete. 2023-12-08T08:20:46.703 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:20:46.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.837+0000 7f692d468640 1 Processor -- start 2023-12-08T08:20:46.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.837+0000 7f692d468640 1 -- start start 2023-12-08T08:20:46.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.841+0000 7f692d468640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69280c1540 0x7f69280c1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:46.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.841+0000 7f692d468640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f69281510b0 0x7f69280c36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:46.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.841+0000 7f692d468640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69280c0170 con 0x7f69280c3c10 2023-12-08T08:20:46.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.841+0000 7f692d468640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69280a9720 con 0x7f69281510b0 2023-12-08T08:20:46.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.841+0000 7f692d468640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692806de60 con 0x7f69280c1540 2023-12-08T08:20:46.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.841+0000 7f6926ffd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69280c1540 0x7f69280c1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:46.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.841+0000 7f6926ffd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69280c1540 0x7f69280c1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:49898/0 (socket says 172.21.15.88:49898) 2023-12-08T08:20:46.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.841+0000 7f6926ffd640 1 -- 172.21.15.88:0/877594593 learned_addr learned my addr 172.21.15.88:0/877594593 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:46.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.841+0000 7f69277fe640 1 --1- 172.21.15.88:0/877594593 >> v1:172.21.15.148:6789/0 conn(0x7f69280c3c10 0x7f69280aabe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:44792/0 (socket says 172.21.15.88:44792) 2023-12-08T08:20:46.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.841+0000 7f691e7fc640 1 --2- 172.21.15.88:0/877594593 >> v2:172.21.15.148:3300/0 conn(0x7f69281510b0 0x7f69280c36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:46.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.841+0000 7f6926ffd640 1 -- 172.21.15.88:0/877594593 >> v2:172.21.15.148:3300/0 conn(0x7f69281510b0 msgr2=0x7f69280c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:46.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.841+0000 7f6926ffd640 1 --2- 172.21.15.88:0/877594593 >> v2:172.21.15.148:3300/0 conn(0x7f69281510b0 0x7f69280c36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.841+0000 7f6926ffd640 1 -- 172.21.15.88:0/877594593 >> v1:172.21.15.148:6789/0 conn(0x7f69280c3c10 legacy=0x7f69280aabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:46.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.841+0000 7f6926ffd640 1 -- 172.21.15.88:0/877594593 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69280c03c0 con 0x7f69280c1540 2023-12-08T08:20:46.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.845+0000 7f6926ffd640 1 --2- 172.21.15.88:0/877594593 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69280c1540 0x7f69280c1920 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6918009870 tx=0x7f691801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bbf714dfc5415d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:46.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.845+0000 7f69267fc640 1 -- 172.21.15.88:0/877594593 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69180ad640 con 0x7f69280c1540 2023-12-08T08:20:46.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.845+0000 7f69267fc640 1 -- 172.21.15.88:0/877594593 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69180ad7a0 con 0x7f69280c1540 2023-12-08T08:20:46.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.845+0000 7f69267fc640 1 -- 172.21.15.88:0/877594593 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69180adb30 con 0x7f69280c1540 2023-12-08T08:20:46.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.845+0000 7f692d468640 1 -- 172.21.15.88:0/877594593 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69280c1540 msgr2=0x7f69280c1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:46.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.845+0000 7f692d468640 1 --2- 172.21.15.88:0/877594593 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69280c1540 0x7f69280c1920 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6918009870 tx=0x7f691801c480 comp rx=0 tx=0).stop 2023-12-08T08:20:46.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.845+0000 7f692d468640 1 -- 172.21.15.88:0/877594593 shutdown_connections 2023-12-08T08:20:46.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.845+0000 7f692d468640 1 --2- 172.21.15.88:0/877594593 >> v2:172.21.15.148:3300/0 conn(0x7f69281510b0 0x7f69280c36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.845+0000 7f692d468640 1 --2- 172.21.15.88:0/877594593 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69280c1540 0x7f69280c1920 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.845+0000 7f692d468640 1 -- 172.21.15.88:0/877594593 >> 172.21.15.88:0/877594593 conn(0x7f69280a7520 msgr2=0x7f69280a7930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:46.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.845+0000 7f692d468640 1 -- 172.21.15.88:0/877594593 shutdown_connections 2023-12-08T08:20:46.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.845+0000 7f692d468640 1 -- 172.21.15.88:0/877594593 wait complete. 2023-12-08T08:20:46.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.845+0000 7f692d468640 1 Processor -- start 2023-12-08T08:20:46.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.845+0000 7f692d468640 1 -- start start 2023-12-08T08:20:46.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.849+0000 7f692d468640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69280c1540 0x7f6928072650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:46.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.849+0000 7f692d468640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69280c3c10 0x7f6928152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:46.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.849+0000 7f692d468640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69281510b0 0x7f69281f0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:46.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.849+0000 7f692d468640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692814e6c0 con 0x7f69280c3c10 2023-12-08T08:20:46.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.849+0000 7f692d468640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6928070c10 con 0x7f69281510b0 2023-12-08T08:20:46.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.849+0000 7f692d468640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692814b9f0 con 0x7f69280c1540 2023-12-08T08:20:46.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.849+0000 7f6926ffd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69280c1540 0x7f6928072650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:46.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.849+0000 7f6926ffd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69280c1540 0x7f6928072650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:49902/0 (socket says 172.21.15.88:49902) 2023-12-08T08:20:46.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.849+0000 7f6926ffd640 1 -- 172.21.15.88:0/3483024230 learned_addr learned my addr 172.21.15.88:0/3483024230 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:46.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.849+0000 7f691e7fc640 1 --2- 172.21.15.88:0/3483024230 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69280c3c10 0x7f6928152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:46.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.849+0000 7f69277fe640 1 --2- 172.21.15.88:0/3483024230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69281510b0 0x7f69281f0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:46.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.849+0000 7f6926ffd640 1 -- 172.21.15.88:0/3483024230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69281510b0 msgr2=0x7f69281f0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:46.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.849+0000 7f6926ffd640 1 --2- 172.21.15.88:0/3483024230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69281510b0 0x7f69281f0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.849+0000 7f6926ffd640 1 -- 172.21.15.88:0/3483024230 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69280c3c10 msgr2=0x7f6928152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:46.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.849+0000 7f6926ffd640 1 --2- 172.21.15.88:0/3483024230 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69280c3c10 0x7f6928152e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:46.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.849+0000 7f6926ffd640 1 -- 172.21.15.88:0/3483024230 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69180094d0 con 0x7f69280c1540 2023-12-08T08:20:46.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.849+0000 7f69277fe640 1 --2- 172.21.15.88:0/3483024230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69281510b0 0x7f69281f0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:46.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.849+0000 7f6926ffd640 1 --2- 172.21.15.88:0/3483024230 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69280c1540 0x7f6928072650 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f69180b0040 tx=0x7f6918019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:46.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.849+0000 7f691ffff640 1 -- 172.21.15.88:0/3483024230 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69180b8670 con 0x7f69280c1540 2023-12-08T08:20:46.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.849+0000 7f691ffff640 1 -- 172.21.15.88:0/3483024230 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69180a6040 con 0x7f69280c1540 2023-12-08T08:20:46.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.849+0000 7f691ffff640 1 -- 172.21.15.88:0/3483024230 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69180b89d0 con 0x7f69280c1540 2023-12-08T08:20:46.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.849+0000 7f692d468640 1 -- 172.21.15.88:0/3483024230 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69281f1670 con 0x7f69280c1540 2023-12-08T08:20:46.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.849+0000 7f692d468640 1 -- 172.21.15.88:0/3483024230 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692814bf90 con 0x7f69280c1540 2023-12-08T08:20:46.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.849+0000 7f692d468640 1 -- 172.21.15.88:0/3483024230 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69280674b0 con 0x7f69280c1540 2023-12-08T08:20:46.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.853+0000 7f691ffff640 1 -- 172.21.15.88:0/3483024230 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f69180b4070 con 0x7f69280c1540 2023-12-08T08:20:46.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.853+0000 7f691ffff640 1 --2- 172.21.15.88:0/3483024230 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f69080664a0 0x7f6908068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:46.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.853+0000 7f691ffff640 1 -- 172.21.15.88:0/3483024230 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f691811f200 con 0x7f69280c1540 2023-12-08T08:20:46.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.853+0000 7f691e7fc640 1 --2- 172.21.15.88:0/3483024230 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f69080664a0 0x7f6908068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:46.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.853+0000 7f691e7fc640 1 --2- 172.21.15.88:0/3483024230 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f69080664a0 0x7f6908068960 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f69281ee440 tx=0x7f6910009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:46.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:46.857+0000 7f691ffff640 1 -- 172.21.15.88:0/3483024230 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f69180ec6f0 con 0x7f69280c1540 2023-12-08T08:20:47.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.005+0000 7f692d468640 1 -- 172.21.15.88:0/3483024230 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f69280a87f0 con 0x7f69280c1540 2023-12-08T08:20:47.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.005+0000 7f691ffff640 1 -- 172.21.15.88:0/3483024230 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f69180b2020 con 0x7f69280c1540 2023-12-08T08:20:47.011 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:20:47.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.005+0000 7f692d468640 1 -- 172.21.15.88:0/3483024230 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f69080664a0 msgr2=0x7f6908068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:47.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.005+0000 7f692d468640 1 --2- 172.21.15.88:0/3483024230 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f69080664a0 0x7f6908068960 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f69281ee440 tx=0x7f6910009190 comp rx=0 tx=0).stop 2023-12-08T08:20:47.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.005+0000 7f692d468640 1 -- 172.21.15.88:0/3483024230 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69280c1540 msgr2=0x7f6928072650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:47.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.005+0000 7f692d468640 1 --2- 172.21.15.88:0/3483024230 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69280c1540 0x7f6928072650 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f69180b0040 tx=0x7f6918019220 comp rx=0 tx=0).stop 2023-12-08T08:20:47.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.005+0000 7f692d468640 1 -- 172.21.15.88:0/3483024230 shutdown_connections 2023-12-08T08:20:47.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.005+0000 7f692d468640 1 --2- 172.21.15.88:0/3483024230 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f69080664a0 0x7f6908068960 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:47.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.005+0000 7f692d468640 1 --2- 172.21.15.88:0/3483024230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69281510b0 0x7f69281f0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:47.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.005+0000 7f692d468640 1 --2- 172.21.15.88:0/3483024230 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69280c3c10 0x7f6928152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:47.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.005+0000 7f692d468640 1 --2- 172.21.15.88:0/3483024230 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f69280c1540 0x7f6928072650 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:47.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.005+0000 7f692d468640 1 -- 172.21.15.88:0/3483024230 >> 172.21.15.88:0/3483024230 conn(0x7f69280a7520 msgr2=0x7f69280aa5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:47.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.005+0000 7f692d468640 1 -- 172.21.15.88:0/3483024230 shutdown_connections 2023-12-08T08:20:47.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.005+0000 7f692d468640 1 -- 172.21.15.88:0/3483024230 wait complete. 2023-12-08T08:20:47.031 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-12-08T08:20:47.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.165+0000 7f5ae558d640 1 Processor -- start 2023-12-08T08:20:47.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.165+0000 7f5ae558d640 1 -- start start 2023-12-08T08:20:47.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.165+0000 7f5ae558d640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5ae00af4c0 0x7f5ae0154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:47.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.165+0000 7f5ae558d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5ae006c100 0x7f5ae00c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:47.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.165+0000 7f5ae558d640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae00c4890 con 0x7f5ae00c67d0 2023-12-08T08:20:47.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.165+0000 7f5ae558d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae0155460 con 0x7f5ae006c100 2023-12-08T08:20:47.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.165+0000 7f5ae558d640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae00af8a0 con 0x7f5ae00af4c0 2023-12-08T08:20:47.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.165+0000 7f5adf7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5ae006c100 0x7f5ae00c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:47.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.165+0000 7f5adf7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5ae006c100 0x7f5ae00c6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60542/0 (socket says 172.21.15.88:60542) 2023-12-08T08:20:47.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.165+0000 7f5adf7fe640 1 -- 172.21.15.88:0/2950303629 learned_addr learned my addr 172.21.15.88:0/2950303629 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:47.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.165+0000 7f5adeffd640 1 --2- 172.21.15.88:0/2950303629 >> v2:172.21.15.148:3300/0 conn(0x7f5ae00af4c0 0x7f5ae0154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:47.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.165+0000 7f5adf7fe640 1 -- 172.21.15.88:0/2950303629 >> v2:172.21.15.148:3300/0 conn(0x7f5ae00af4c0 msgr2=0x7f5ae0154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:47.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.165+0000 7f5adf7fe640 1 --2- 172.21.15.88:0/2950303629 >> v2:172.21.15.148:3300/0 conn(0x7f5ae00af4c0 0x7f5ae0154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:47.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.165+0000 7f5adf7fe640 1 -- 172.21.15.88:0/2950303629 >> v1:172.21.15.148:6789/0 conn(0x7f5ae00c67d0 legacy=0x7f5ae006b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:47.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.165+0000 7f5adf7fe640 1 -- 172.21.15.88:0/2950303629 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae00c4b30 con 0x7f5ae006c100 2023-12-08T08:20:47.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.169+0000 7f5adf7fe640 1 --2- 172.21.15.88:0/2950303629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ae006c100 0x7f5ae00c6c80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5ae00a9790 tx=0x7f5ad801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f500b844308e60b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:47.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.169+0000 7f5ade7fc640 1 -- 172.21.15.88:0/2950303629 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad80a57d0 con 0x7f5ae006c100 2023-12-08T08:20:47.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.169+0000 7f5ade7fc640 1 -- 172.21.15.88:0/2950303629 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad80a5930 con 0x7f5ae006c100 2023-12-08T08:20:47.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.169+0000 7f5ade7fc640 1 -- 172.21.15.88:0/2950303629 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad80a5cc0 con 0x7f5ae006c100 2023-12-08T08:20:47.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.169+0000 7f5ae558d640 1 -- 172.21.15.88:0/2950303629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ae006c100 msgr2=0x7f5ae00c6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:47.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.169+0000 7f5ae558d640 1 --2- 172.21.15.88:0/2950303629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ae006c100 0x7f5ae00c6c80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5ae00a9790 tx=0x7f5ad801c910 comp rx=0 tx=0).stop 2023-12-08T08:20:47.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.169+0000 7f5ae558d640 1 -- 172.21.15.88:0/2950303629 shutdown_connections 2023-12-08T08:20:47.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.169+0000 7f5ae558d640 1 --2- 172.21.15.88:0/2950303629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ae006c100 0x7f5ae00c6c80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:47.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.169+0000 7f5ae558d640 1 --2- 172.21.15.88:0/2950303629 >> v2:172.21.15.148:3300/0 conn(0x7f5ae00af4c0 0x7f5ae0154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:47.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.169+0000 7f5ae558d640 1 -- 172.21.15.88:0/2950303629 >> 172.21.15.88:0/2950303629 conn(0x7f5ae00ab9d0 msgr2=0x7f5ae00abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:47.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.169+0000 7f5ae558d640 1 -- 172.21.15.88:0/2950303629 shutdown_connections 2023-12-08T08:20:47.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.169+0000 7f5ae558d640 1 -- 172.21.15.88:0/2950303629 wait complete. 2023-12-08T08:20:47.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.173+0000 7f5ae558d640 1 Processor -- start 2023-12-08T08:20:47.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.173+0000 7f5ae558d640 1 -- start start 2023-12-08T08:20:47.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.173+0000 7f5ae558d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ae006c100 0x7f5ae0151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:47.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.173+0000 7f5ae558d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ae00af4c0 0x7f5ae014df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:47.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.173+0000 7f5ae558d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ae00c67d0 0x7f5ae014e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:47.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.173+0000 7f5ae558d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae01ecfd0 con 0x7f5ae006c100 2023-12-08T08:20:47.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.173+0000 7f5ae558d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae00caaf0 con 0x7f5ae00c67d0 2023-12-08T08:20:47.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.173+0000 7f5ae558d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae01ec910 con 0x7f5ae00af4c0 2023-12-08T08:20:47.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.173+0000 7f5adeffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ae006c100 0x7f5ae0151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:47.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.173+0000 7f5adeffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ae006c100 0x7f5ae0151270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60544/0 (socket says 172.21.15.88:60544) 2023-12-08T08:20:47.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.173+0000 7f5adeffd640 1 -- 172.21.15.88:0/2620051940 learned_addr learned my addr 172.21.15.88:0/2620051940 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:47.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.173+0000 7f5adf7fe640 1 --2- 172.21.15.88:0/2620051940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ae00c67d0 0x7f5ae014e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:47.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.173+0000 7f5ad67fc640 1 --2- 172.21.15.88:0/2620051940 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ae00af4c0 0x7f5ae014df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:47.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.173+0000 7f5adeffd640 1 -- 172.21.15.88:0/2620051940 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ae00af4c0 msgr2=0x7f5ae014df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:47.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.173+0000 7f5adeffd640 1 --2- 172.21.15.88:0/2620051940 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ae00af4c0 0x7f5ae014df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:47.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.173+0000 7f5adeffd640 1 -- 172.21.15.88:0/2620051940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ae00c67d0 msgr2=0x7f5ae014e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:47.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.173+0000 7f5adeffd640 1 --2- 172.21.15.88:0/2620051940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ae00c67d0 0x7f5ae014e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:47.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.173+0000 7f5adeffd640 1 -- 172.21.15.88:0/2620051940 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad8009b30 con 0x7f5ae006c100 2023-12-08T08:20:47.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.173+0000 7f5adeffd640 1 --2- 172.21.15.88:0/2620051940 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ae006c100 0x7f5ae0151270 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000e870 tx=0x7f5ad000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:47.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.173+0000 7f5ad7fff640 1 -- 172.21.15.88:0/2620051940 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0009510 con 0x7f5ae006c100 2023-12-08T08:20:47.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.173+0000 7f5ad7fff640 1 -- 172.21.15.88:0/2620051940 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad000eec0 con 0x7f5ae006c100 2023-12-08T08:20:47.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.173+0000 7f5ae558d640 1 -- 172.21.15.88:0/2620051940 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae01ecbf0 con 0x7f5ae006c100 2023-12-08T08:20:47.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.173+0000 7f5ad7fff640 1 -- 172.21.15.88:0/2620051940 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad000cb40 con 0x7f5ae006c100 2023-12-08T08:20:47.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.173+0000 7f5ae558d640 1 -- 172.21.15.88:0/2620051940 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae01ec5c0 con 0x7f5ae006c100 2023-12-08T08:20:47.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.177+0000 7f5ae558d640 1 -- 172.21.15.88:0/2620051940 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae0067630 con 0x7f5ae006c100 2023-12-08T08:20:47.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.177+0000 7f5ad7fff640 1 -- 172.21.15.88:0/2620051940 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5ad000cca0 con 0x7f5ae006c100 2023-12-08T08:20:47.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.177+0000 7f5ad7fff640 1 --2- 172.21.15.88:0/2620051940 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5ac0066470 0x7f5ac0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:47.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.177+0000 7f5ad7fff640 1 -- 172.21.15.88:0/2620051940 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ad0083f10 con 0x7f5ae006c100 2023-12-08T08:20:47.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.177+0000 7f5ad67fc640 1 --2- 172.21.15.88:0/2620051940 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5ac0066470 0x7f5ac0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:47.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.177+0000 7f5ad67fc640 1 --2- 172.21.15.88:0/2620051940 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5ac0066470 0x7f5ac0068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5ae00c0cf0 tx=0x7f5ac8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:47.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.181+0000 7f5ad7fff640 1 -- 172.21.15.88:0/2620051940 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5ad0051430 con 0x7f5ae006c100 2023-12-08T08:20:47.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.381+0000 7f5ae558d640 1 -- 172.21.15.88:0/2620051940 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f5ae006c7a0 con 0x7f5ae006c100 2023-12-08T08:20:47.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.533+0000 7f5ad7fff640 1 -- 172.21.15.88:0/2620051940 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v49) v1 ==== 162+0+0 (secure 0 0 0) 0x7f5ad0054a50 con 0x7f5ae006c100 2023-12-08T08:20:47.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.533+0000 7f5ae558d640 1 -- 172.21.15.88:0/2620051940 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5ac0066470 msgr2=0x7f5ac0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:47.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.533+0000 7f5ae558d640 1 --2- 172.21.15.88:0/2620051940 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5ac0066470 0x7f5ac0068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5ae00c0cf0 tx=0x7f5ac8009040 comp rx=0 tx=0).stop 2023-12-08T08:20:47.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.533+0000 7f5ae558d640 1 -- 172.21.15.88:0/2620051940 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ae006c100 msgr2=0x7f5ae0151270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:47.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.533+0000 7f5ae558d640 1 --2- 172.21.15.88:0/2620051940 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ae006c100 0x7f5ae0151270 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000e870 tx=0x7f5ad000ec70 comp rx=0 tx=0).stop 2023-12-08T08:20:47.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.533+0000 7f5ae558d640 1 -- 172.21.15.88:0/2620051940 shutdown_connections 2023-12-08T08:20:47.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.533+0000 7f5ae558d640 1 --2- 172.21.15.88:0/2620051940 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5ac0066470 0x7f5ac0068930 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:47.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.533+0000 7f5ae558d640 1 --2- 172.21.15.88:0/2620051940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ae00c67d0 0x7f5ae014e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:47.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.533+0000 7f5ae558d640 1 --2- 172.21.15.88:0/2620051940 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ae00af4c0 0x7f5ae014df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:47.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.533+0000 7f5ae558d640 1 --2- 172.21.15.88:0/2620051940 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ae006c100 0x7f5ae0151270 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:47.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.533+0000 7f5ae558d640 1 -- 172.21.15.88:0/2620051940 >> 172.21.15.88:0/2620051940 conn(0x7f5ae00ab9d0 msgr2=0x7f5ae00acb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:47.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.533+0000 7f5ae558d640 1 -- 172.21.15.88:0/2620051940 shutdown_connections 2023-12-08T08:20:47.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.533+0000 7f5ae558d640 1 -- 172.21.15.88:0/2620051940 wait complete. 2023-12-08T08:20:47.559 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-08T08:20:47.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.693+0000 7f1454a32640 1 Processor -- start 2023-12-08T08:20:47.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.693+0000 7f1454a32640 1 -- start start 2023-12-08T08:20:47.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.693+0000 7f1454a32640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1450158760 0x7f145015fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:47.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.693+0000 7f1454a32640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14500c67a0 con 0x7f1450154f20 2023-12-08T08:20:47.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.693+0000 7f1454a32640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14500c69f0 con 0x7f14500af550 2023-12-08T08:20:47.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.693+0000 7f1454a32640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14501553d0 con 0x7f1450158760 2023-12-08T08:20:47.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.693+0000 7f1445d9b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1450154f20 0x7f1450158050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36600/0 (socket says 172.21.15.88:36600) 2023-12-08T08:20:47.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.693+0000 7f1445d9b640 1 -- 172.21.15.88:0/16390418 learned_addr learned my addr 172.21.15.88:0/16390418 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:47.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.693+0000 7f144ed9d640 1 --2- 172.21.15.88:0/16390418 >> v2:172.21.15.148:3300/0 conn(0x7f1450158760 0x7f145015fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:47.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.693+0000 7f144dd9b640 1 -- 172.21.15.88:0/16390418 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000867593 0 0) 0x7f14500c67a0 con 0x7f1450154f20 2023-12-08T08:20:47.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.693+0000 7f144dd9b640 1 -- 172.21.15.88:0/16390418 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f143c003530 con 0x7f1450154f20 2023-12-08T08:20:47.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.693+0000 7f144dd9b640 1 -- 172.21.15.88:0/16390418 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 548878718 0 0) 0x7f143c003530 con 0x7f1450154f20 2023-12-08T08:20:47.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.693+0000 7f144dd9b640 1 -- 172.21.15.88:0/16390418 >> v2:172.21.15.148:3300/0 conn(0x7f1450158760 msgr2=0x7f145015fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:47.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.693+0000 7f144dd9b640 1 --2- 172.21.15.88:0/16390418 >> v2:172.21.15.148:3300/0 conn(0x7f1450158760 0x7f145015fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:47.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.693+0000 7f144dd9b640 1 -- 172.21.15.88:0/16390418 >> v1:172.21.15.148:6789/0 conn(0x7f14500af550 legacy=0x7f14500c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:47.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.693+0000 7f144dd9b640 1 -- 172.21.15.88:0/16390418 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14500c6cd0 con 0x7f1450154f20 2023-12-08T08:20:47.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.693+0000 7f144dd9b640 1 -- 172.21.15.88:0/16390418 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f1438001680 con 0x7f1450154f20 2023-12-08T08:20:47.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.693+0000 7f144dd9b640 1 -- 172.21.15.88:0/16390418 >> v1:172.21.15.88:6789/0 conn(0x7f1450154f20 legacy=0x7f1450158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:47.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.693+0000 7f144dd9b640 1 --2- 172.21.15.88:0/16390418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f143c003980 0x7f143c003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:47.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.693+0000 7f144dd9b640 1 --2- 172.21.15.88:0/16390418 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f143c0047d0 0x7f143c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:47.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.693+0000 7f144dd9b640 1 --2- 172.21.15.88:0/16390418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f143c005190 0x7f143c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:47.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.693+0000 7f144dd9b640 1 -- 172.21.15.88:0/16390418 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14501553d0 con 0x7f143c005190 2023-12-08T08:20:47.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.693+0000 7f144dd9b640 1 -- 172.21.15.88:0/16390418 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143c00c0e0 con 0x7f143c003980 2023-12-08T08:20:47.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.693+0000 7f144dd9b640 1 -- 172.21.15.88:0/16390418 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f143c00c2a0 con 0x7f143c0047d0 2023-12-08T08:20:47.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.693+0000 7f144ed9d640 1 --2- 172.21.15.88:0/16390418 >> v2:172.21.15.148:3300/0 conn(0x7f1450158760 0x7f145015fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:47.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.697+0000 7f144ed9d640 1 --2- 172.21.15.88:0/16390418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f143c005190 0x7f143c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:47.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.697+0000 7f144e59c640 1 --2- 172.21.15.88:0/16390418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f143c003980 0x7f143c003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:47.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.697+0000 7f1445d9b640 1 --2- 172.21.15.88:0/16390418 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f143c0047d0 0x7f143c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:47.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.697+0000 7f144ed9d640 1 -- 172.21.15.88:0/16390418 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f143c0047d0 msgr2=0x7f143c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:47.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.697+0000 7f144ed9d640 1 --2- 172.21.15.88:0/16390418 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f143c0047d0 0x7f143c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:47.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.697+0000 7f144ed9d640 1 -- 172.21.15.88:0/16390418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f143c003980 msgr2=0x7f143c003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:47.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.697+0000 7f144ed9d640 1 --2- 172.21.15.88:0/16390418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f143c003980 0x7f143c003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:47.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.697+0000 7f144ed9d640 1 -- 172.21.15.88:0/16390418 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143c003530 con 0x7f143c005190 2023-12-08T08:20:47.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.697+0000 7f144ed9d640 1 -- 172.21.15.88:0/16390418 reap_dead start 2023-12-08T08:20:47.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.697+0000 7f144ed9d640 1 --2- 172.21.15.88:0/16390418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f143c005190 0x7f143c00b990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f144800e350 tx=0x7f144801ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d9d642519bf89f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:47.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.697+0000 7f144dd9b640 1 -- 172.21.15.88:0/16390418 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14480a5e50 con 0x7f143c005190 2023-12-08T08:20:47.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.697+0000 7f144dd9b640 1 -- 172.21.15.88:0/16390418 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144800f040 con 0x7f143c005190 2023-12-08T08:20:47.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.697+0000 7f144dd9b640 1 -- 172.21.15.88:0/16390418 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1448003bc0 con 0x7f143c005190 2023-12-08T08:20:47.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.701+0000 7f1454a32640 1 -- 172.21.15.88:0/16390418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f143c005190 msgr2=0x7f143c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:47.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.701+0000 7f1454a32640 1 --2- 172.21.15.88:0/16390418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f143c005190 0x7f143c00b990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f144800e350 tx=0x7f144801ce40 comp rx=0 tx=0).stop 2023-12-08T08:20:47.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.701+0000 7f1454a32640 1 -- 172.21.15.88:0/16390418 shutdown_connections 2023-12-08T08:20:47.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.701+0000 7f1454a32640 1 --2- 172.21.15.88:0/16390418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f143c005190 0x7f143c00b990 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:47.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.701+0000 7f1454a32640 1 -- 172.21.15.88:0/16390418 >> 172.21.15.88:0/16390418 conn(0x7f14500668d0 msgr2=0x7f14500ab980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:47.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.701+0000 7f1454a32640 1 -- 172.21.15.88:0/16390418 shutdown_connections 2023-12-08T08:20:47.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.701+0000 7f1454a32640 1 -- 172.21.15.88:0/16390418 wait complete. 2023-12-08T08:20:47.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.701+0000 7f1454a32640 1 Processor -- start 2023-12-08T08:20:47.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.701+0000 7f1454a32640 1 -- start start 2023-12-08T08:20:47.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.701+0000 7f1454a32640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f143c005190 0x7f14500c10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:47.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.701+0000 7f1454a32640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14500aca30 0x7f1450148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:47.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.701+0000 7f1454a32640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14500aceb0 0x7f14500c2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:47.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.701+0000 7f1454a32640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14500c2290 con 0x7f14500aca30 2023-12-08T08:20:47.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.701+0000 7f1454a32640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145014d140 con 0x7f143c005190 2023-12-08T08:20:47.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.701+0000 7f1454a32640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14500aebc0 con 0x7f14500aceb0 2023-12-08T08:20:47.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.701+0000 7f1445d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14500aca30 0x7f1450148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:47.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.701+0000 7f1445d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14500aca30 0x7f1450148d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60572/0 (socket says 172.21.15.88:60572) 2023-12-08T08:20:47.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.701+0000 7f1445d9b640 1 -- 172.21.15.88:0/1063706130 learned_addr learned my addr 172.21.15.88:0/1063706130 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:47.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.701+0000 7f144e59c640 1 --2- 172.21.15.88:0/1063706130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f143c005190 0x7f14500c10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:47.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.701+0000 7f144ed9d640 1 --2- 172.21.15.88:0/1063706130 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14500aceb0 0x7f14500c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:47.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.701+0000 7f1445d9b640 1 -- 172.21.15.88:0/1063706130 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14500aceb0 msgr2=0x7f14500c2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:47.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.701+0000 7f1445d9b640 1 --2- 172.21.15.88:0/1063706130 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14500aceb0 0x7f14500c2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:47.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.701+0000 7f1445d9b640 1 -- 172.21.15.88:0/1063706130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f143c005190 msgr2=0x7f14500c10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:47.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.701+0000 7f1445d9b640 1 --2- 172.21.15.88:0/1063706130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f143c005190 0x7f14500c10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:47.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.701+0000 7f1445d9b640 1 -- 172.21.15.88:0/1063706130 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14500ae8e0 con 0x7f14500aca30 2023-12-08T08:20:47.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.705+0000 7f1445d9b640 1 --2- 172.21.15.88:0/1063706130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14500aca30 0x7f1450148d70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1438007290 tx=0x7f1438007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:47.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.705+0000 7f14477fe640 1 -- 172.21.15.88:0/1063706130 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1438001660 con 0x7f14500aca30 2023-12-08T08:20:47.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.705+0000 7f14477fe640 1 -- 172.21.15.88:0/1063706130 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143800f8c0 con 0x7f14500aca30 2023-12-08T08:20:47.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.705+0000 7f14477fe640 1 -- 172.21.15.88:0/1063706130 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143800fc50 con 0x7f14500aca30 2023-12-08T08:20:47.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.705+0000 7f1454a32640 1 -- 172.21.15.88:0/1063706130 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14501eda60 con 0x7f14500aca30 2023-12-08T08:20:47.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.705+0000 7f1454a32640 1 -- 172.21.15.88:0/1063706130 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1450155640 con 0x7f14500aca30 2023-12-08T08:20:47.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.705+0000 7f1454a32640 1 -- 172.21.15.88:0/1063706130 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1450067630 con 0x7f14500aca30 2023-12-08T08:20:47.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.705+0000 7f14477fe640 1 -- 172.21.15.88:0/1063706130 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f143801d460 con 0x7f14500aca30 2023-12-08T08:20:47.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.705+0000 7f14477fe640 1 --2- 172.21.15.88:0/1063706130 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f14300664a0 0x7f1430068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:47.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.705+0000 7f14477fe640 1 -- 172.21.15.88:0/1063706130 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1438083d60 con 0x7f14500aca30 2023-12-08T08:20:47.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.705+0000 7f144e59c640 1 --2- 172.21.15.88:0/1063706130 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f14300664a0 0x7f1430068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:47.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.709+0000 7f144e59c640 1 --2- 172.21.15.88:0/1063706130 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f14300664a0 0x7f1430068960 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1440007fd0 tx=0x7f14400013f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:47.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.709+0000 7f14477fe640 1 -- 172.21.15.88:0/1063706130 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1438051280 con 0x7f14500aca30 2023-12-08T08:20:47.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.861+0000 7f1454a32640 1 -- 172.21.15.88:0/1063706130 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f145006c630 con 0x7f14500aca30 2023-12-08T08:20:47.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.865+0000 7f14477fe640 1 -- 172.21.15.88:0/1063706130 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f14380548a0 con 0x7f14500aca30 2023-12-08T08:20:47.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.869+0000 7f1454a32640 1 -- 172.21.15.88:0/1063706130 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f14300664a0 msgr2=0x7f1430068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:47.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.869+0000 7f1454a32640 1 --2- 172.21.15.88:0/1063706130 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f14300664a0 0x7f1430068960 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1440007fd0 tx=0x7f14400013f0 comp rx=0 tx=0).stop 2023-12-08T08:20:47.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.869+0000 7f1454a32640 1 -- 172.21.15.88:0/1063706130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14500aca30 msgr2=0x7f1450148d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:47.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.869+0000 7f1454a32640 1 --2- 172.21.15.88:0/1063706130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14500aca30 0x7f1450148d70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1438007290 tx=0x7f1438007750 comp rx=0 tx=0).stop 2023-12-08T08:20:47.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.869+0000 7f1454a32640 1 -- 172.21.15.88:0/1063706130 shutdown_connections 2023-12-08T08:20:47.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.869+0000 7f1454a32640 1 --2- 172.21.15.88:0/1063706130 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f14300664a0 0x7f1430068960 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:47.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.869+0000 7f1454a32640 1 --2- 172.21.15.88:0/1063706130 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14500aceb0 0x7f14500c2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:47.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.869+0000 7f1454a32640 1 --2- 172.21.15.88:0/1063706130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14500aca30 0x7f1450148d70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:47.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.869+0000 7f1454a32640 1 --2- 172.21.15.88:0/1063706130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f143c005190 0x7f14500c10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:47.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.869+0000 7f1454a32640 1 -- 172.21.15.88:0/1063706130 >> 172.21.15.88:0/1063706130 conn(0x7f14500668d0 msgr2=0x7f1450154510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:47.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.869+0000 7f1454a32640 1 -- 172.21.15.88:0/1063706130 shutdown_connections 2023-12-08T08:20:47.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:47.869+0000 7f1454a32640 1 -- 172.21.15.88:0/1063706130 wait complete. 2023-12-08T08:20:47.894 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-08T08:20:47.894 DEBUG:teuthology.orchestra.run.smithi088:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:20:48.006 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:20:48.080 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-08T08:20:48.080 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:20:48.081 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:20:48.089 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:20:48.090 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:20:48.145 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:20:48.145 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:20:48.201 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:48.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.377+0000 7f9bbe58d640 1 Processor -- start 2023-12-08T08:20:48.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.377+0000 7f9bbe58d640 1 -- start start 2023-12-08T08:20:48.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bbe58d640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9bb80bfce0 0x7f9bb814e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:48.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bbe58d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9bb806ccc0 0x7f9bb80c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:48.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bbe58d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb8151690 con 0x7f9bb806bef0 2023-12-08T08:20:48.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bbe58d640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb814e930 con 0x7f9bb80bfce0 2023-12-08T08:20:48.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bbe58d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb8151bc0 con 0x7f9bb806ccc0 2023-12-08T08:20:48.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb7fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9bb806bef0 0x7f9bb806c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36602/0 (socket says 172.21.15.88:36602) 2023-12-08T08:20:48.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb7fff640 1 -- 172.21.15.88:0/2871503470 learned_addr learned my addr 172.21.15.88:0/2871503470 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:48.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bbcb2a640 1 --2- 172.21.15.88:0/2871503470 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9bb806ccc0 0x7f9bb80c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:48.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb77fe640 1 --2- 172.21.15.88:0/2871503470 >> v2:172.21.15.148:3300/0 conn(0x7f9bb80bfce0 0x7f9bb814e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:48.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb6ffd640 1 -- 172.21.15.88:0/2871503470 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1932536390 0 0) 0x7f9bb8151690 con 0x7f9bb806bef0 2023-12-08T08:20:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb6ffd640 1 -- 172.21.15.88:0/2871503470 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ba0003530 con 0x7f9bb806bef0 2023-12-08T08:20:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb6ffd640 1 -- 172.21.15.88:0/2871503470 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 734782180 0 0) 0x7f9ba0003530 con 0x7f9bb806bef0 2023-12-08T08:20:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb6ffd640 1 -- 172.21.15.88:0/2871503470 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9bb806ccc0 msgr2=0x7f9bb80c3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb6ffd640 1 --2- 172.21.15.88:0/2871503470 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9bb806ccc0 0x7f9bb80c3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb6ffd640 1 -- 172.21.15.88:0/2871503470 >> v2:172.21.15.148:3300/0 conn(0x7f9bb80bfce0 msgr2=0x7f9bb814e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb6ffd640 1 --2- 172.21.15.88:0/2871503470 >> v2:172.21.15.148:3300/0 conn(0x7f9bb80bfce0 0x7f9bb814e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb6ffd640 1 -- 172.21.15.88:0/2871503470 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb81518e0 con 0x7f9bb806bef0 2023-12-08T08:20:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb6ffd640 1 -- 172.21.15.88:0/2871503470 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f9ba8001680 con 0x7f9bb806bef0 2023-12-08T08:20:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb77fe640 1 --2- 172.21.15.88:0/2871503470 >> v2:172.21.15.148:3300/0 conn(0x7f9bb80bfce0 0x7f9bb814e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb6ffd640 1 -- 172.21.15.88:0/2871503470 >> v1:172.21.15.88:6789/0 conn(0x7f9bb806bef0 legacy=0x7f9bb806c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb6ffd640 1 --2- 172.21.15.88:0/2871503470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ba0003980 0x7f9ba0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb6ffd640 1 --2- 172.21.15.88:0/2871503470 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9bb806ccc0 0x7f9ba00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb6ffd640 1 --2- 172.21.15.88:0/2871503470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ba0004d10 0x7f9ba0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:48.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb6ffd640 1 -- 172.21.15.88:0/2871503470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb8151bc0 con 0x7f9ba0003980 2023-12-08T08:20:48.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb6ffd640 1 -- 172.21.15.88:0/2871503470 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba000b990 con 0x7f9ba0004d10 2023-12-08T08:20:48.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb6ffd640 1 -- 172.21.15.88:0/2871503470 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba000bad0 con 0x7f9bb806ccc0 2023-12-08T08:20:48.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb7fff640 1 --2- 172.21.15.88:0/2871503470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ba0003980 0x7f9ba0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:48.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bbcb2a640 1 --2- 172.21.15.88:0/2871503470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ba0004d10 0x7f9ba0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:48.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb77fe640 1 --2- 172.21.15.88:0/2871503470 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9bb806ccc0 0x7f9ba00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:48.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb7fff640 1 -- 172.21.15.88:0/2871503470 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9bb806ccc0 msgr2=0x7f9ba00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:48.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb7fff640 1 --2- 172.21.15.88:0/2871503470 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9bb806ccc0 0x7f9ba00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb7fff640 1 -- 172.21.15.88:0/2871503470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ba0004d10 msgr2=0x7f9ba0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:48.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb7fff640 1 --2- 172.21.15.88:0/2871503470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ba0004d10 0x7f9ba0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb7fff640 1 -- 172.21.15.88:0/2871503470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba0003530 con 0x7f9ba0003980 2023-12-08T08:20:48.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bbcb2a640 1 --2- 172.21.15.88:0/2871503470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ba0004d10 0x7f9ba0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:48.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.381+0000 7f9bb77fe640 1 --2- 172.21.15.88:0/2871503470 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9bb806ccc0 0x7f9ba00047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:48.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.385+0000 7f9bb7fff640 1 --2- 172.21.15.88:0/2871503470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ba0003980 0x7f9ba0003da0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800c290 tx=0x7f9ba801cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f1195b1facec47 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:48.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.385+0000 7f9bb6ffd640 1 -- 172.21.15.88:0/2871503470 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba80058e0 con 0x7f9ba0003980 2023-12-08T08:20:48.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.385+0000 7f9bb6ffd640 1 -- 172.21.15.88:0/2871503470 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba8005a60 con 0x7f9ba0003980 2023-12-08T08:20:48.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.385+0000 7f9bb6ffd640 1 -- 172.21.15.88:0/2871503470 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8005e10 con 0x7f9ba0003980 2023-12-08T08:20:48.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.385+0000 7f9bbe58d640 1 -- 172.21.15.88:0/2871503470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ba0003980 msgr2=0x7f9ba0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:48.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.385+0000 7f9bbe58d640 1 --2- 172.21.15.88:0/2871503470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ba0003980 0x7f9ba0003da0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800c290 tx=0x7f9ba801cce0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.385+0000 7f9bbcb2a640 1 -- 172.21.15.88:0/2871503470 reap_dead start 2023-12-08T08:20:48.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.385+0000 7f9bbe58d640 1 -- 172.21.15.88:0/2871503470 shutdown_connections 2023-12-08T08:20:48.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.385+0000 7f9bbe58d640 1 -- 172.21.15.88:0/2871503470 >> 172.21.15.88:0/2871503470 conn(0x7f9bb80a7810 msgr2=0x7f9bb80a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:48.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.385+0000 7f9bbe58d640 1 -- 172.21.15.88:0/2871503470 shutdown_connections 2023-12-08T08:20:48.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.385+0000 7f9bbe58d640 1 -- 172.21.15.88:0/2871503470 wait complete. 2023-12-08T08:20:48.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.389+0000 7f9bbe58d640 1 Processor -- start 2023-12-08T08:20:48.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.389+0000 7f9bbe58d640 1 -- start start 2023-12-08T08:20:48.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.389+0000 7f9bbe58d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ba0003980 0x7f9bb81e9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:48.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.389+0000 7f9bbe58d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9bb80a8f40 0x7f9bb8149c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:48.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.389+0000 7f9bbe58d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9bb81ec480 0x7f9bb8158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:48.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.389+0000 7f9bbe58d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb81e9760 con 0x7f9ba0003980 2023-12-08T08:20:48.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.389+0000 7f9bbe58d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb81ebd10 con 0x7f9bb81ec480 2023-12-08T08:20:48.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.389+0000 7f9bbe58d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb8072040 con 0x7f9bb80a8f40 2023-12-08T08:20:48.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.389+0000 7f9bb7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ba0003980 0x7f9bb81e9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:48.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.389+0000 7f9bb7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ba0003980 0x7f9bb81e9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60582/0 (socket says 172.21.15.88:60582) 2023-12-08T08:20:48.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.389+0000 7f9bb7fff640 1 -- 172.21.15.88:0/1312294286 learned_addr learned my addr 172.21.15.88:0/1312294286 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:48.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.389+0000 7f9bb7fff640 1 -- 172.21.15.88:0/1312294286 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9bb80a8f40 msgr2=0x7f9bb8149c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:48.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.389+0000 7f9bb7fff640 1 --2- 172.21.15.88:0/1312294286 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9bb80a8f40 0x7f9bb8149c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.389+0000 7f9bb7fff640 1 -- 172.21.15.88:0/1312294286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9bb81ec480 msgr2=0x7f9bb8158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:48.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.389+0000 7f9bb7fff640 1 --2- 172.21.15.88:0/1312294286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9bb81ec480 0x7f9bb8158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.389+0000 7f9bb7fff640 1 -- 172.21.15.88:0/1312294286 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb8072320 con 0x7f9ba0003980 2023-12-08T08:20:48.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.389+0000 7f9bb7fff640 1 --2- 172.21.15.88:0/1312294286 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ba0003980 0x7f9bb81e9220 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9ba80ab040 tx=0x7f9ba0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:48.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.389+0000 7f9bb4ff9640 1 -- 172.21.15.88:0/1312294286 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8001780 con 0x7f9ba0003980 2023-12-08T08:20:48.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.389+0000 7f9bb4ff9640 1 -- 172.21.15.88:0/1312294286 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba80047f0 con 0x7f9ba0003980 2023-12-08T08:20:48.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.389+0000 7f9bbe58d640 1 -- 172.21.15.88:0/1312294286 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb8072600 con 0x7f9ba0003980 2023-12-08T08:20:48.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.389+0000 7f9bb4ff9640 1 -- 172.21.15.88:0/1312294286 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8004ba0 con 0x7f9ba0003980 2023-12-08T08:20:48.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.389+0000 7f9bbe58d640 1 -- 172.21.15.88:0/1312294286 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb814a1d0 con 0x7f9ba0003980 2023-12-08T08:20:48.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.389+0000 7f9bbe58d640 1 -- 172.21.15.88:0/1312294286 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb80679d0 con 0x7f9ba0003980 2023-12-08T08:20:48.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.393+0000 7f9bb4ff9640 1 -- 172.21.15.88:0/1312294286 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9ba8004d00 con 0x7f9ba0003980 2023-12-08T08:20:48.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.393+0000 7f9bb4ff9640 1 --2- 172.21.15.88:0/1312294286 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9ba40664a0 0x7f9ba4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:48.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.393+0000 7f9bb4ff9640 1 -- 172.21.15.88:0/1312294286 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ba811d6e0 con 0x7f9ba0003980 2023-12-08T08:20:48.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.393+0000 7f9bb77fe640 1 --2- 172.21.15.88:0/1312294286 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9ba40664a0 0x7f9ba4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:48.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.393+0000 7f9bb77fe640 1 --2- 172.21.15.88:0/1312294286 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9ba40664a0 0x7f9ba4068960 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9bb806dee0 tx=0x7f9bac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:48.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.397+0000 7f9bb4ff9640 1 -- 172.21.15.88:0/1312294286 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9ba80eab50 con 0x7f9ba0003980 2023-12-08T08:20:48.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.549+0000 7f9bbe58d640 1 -- 172.21.15.88:0/1312294286 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9bb8067630 con 0x7f9ba0003980 2023-12-08T08:20:48.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.549+0000 7f9bb4ff9640 1 -- 172.21.15.88:0/1312294286 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7f9ba80ee170 con 0x7f9ba0003980 2023-12-08T08:20:48.556 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:48.556 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:20:21.492555+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:18.675917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:19.511013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:48.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.553+0000 7f9bbe58d640 1 -- 172.21.15.88:0/1312294286 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9ba40664a0 msgr2=0x7f9ba4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:48.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.553+0000 7f9bbe58d640 1 --2- 172.21.15.88:0/1312294286 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9ba40664a0 0x7f9ba4068960 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9bb806dee0 tx=0x7f9bac008040 comp rx=0 tx=0).stop 2023-12-08T08:20:48.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.553+0000 7f9bbe58d640 1 -- 172.21.15.88:0/1312294286 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ba0003980 msgr2=0x7f9bb81e9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:48.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.553+0000 7f9bbe58d640 1 --2- 172.21.15.88:0/1312294286 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ba0003980 0x7f9bb81e9220 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9ba80ab040 tx=0x7f9ba0005800 comp rx=0 tx=0).stop 2023-12-08T08:20:48.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.553+0000 7f9bbe58d640 1 -- 172.21.15.88:0/1312294286 shutdown_connections 2023-12-08T08:20:48.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.553+0000 7f9bbe58d640 1 --2- 172.21.15.88:0/1312294286 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9ba40664a0 0x7f9ba4068960 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.553+0000 7f9bbe58d640 1 --2- 172.21.15.88:0/1312294286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9bb81ec480 0x7f9bb8158ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.553+0000 7f9bbe58d640 1 --2- 172.21.15.88:0/1312294286 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9bb80a8f40 0x7f9bb8149c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.553+0000 7f9bbe58d640 1 --2- 172.21.15.88:0/1312294286 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ba0003980 0x7f9bb81e9220 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.553+0000 7f9bbe58d640 1 -- 172.21.15.88:0/1312294286 >> 172.21.15.88:0/1312294286 conn(0x7f9bb80a7810 msgr2=0x7f9bb8073450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:48.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.553+0000 7f9bbe58d640 1 -- 172.21.15.88:0/1312294286 shutdown_connections 2023-12-08T08:20:48.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.553+0000 7f9bbe58d640 1 -- 172.21.15.88:0/1312294286 wait complete. 2023-12-08T08:20:48.577 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:20:18.675917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:20:19.511013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:20:48.578 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:20:48.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.713+0000 7f73a59f8640 1 Processor -- start 2023-12-08T08:20:48.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.713+0000 7f73a59f8640 1 -- start start 2023-12-08T08:20:48.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.713+0000 7f73a59f8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73a00bf2d0 0x7f73a0151970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:48.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.713+0000 7f73a59f8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f73a00c98f0 0x7f73a0151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:48.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.713+0000 7f73a59f8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a0158780 con 0x7f73a00c6030 2023-12-08T08:20:48.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.713+0000 7f73a59f8640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a00c0300 con 0x7f73a00c98f0 2023-12-08T08:20:48.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.713+0000 7f73a59f8640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a0157b70 con 0x7f73a00bf2d0 2023-12-08T08:20:48.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.713+0000 7f73967fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f73a00c6030 0x7f73a00c7cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36604/0 (socket says 172.21.15.88:36604) 2023-12-08T08:20:48.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.713+0000 7f73967fc640 1 -- 172.21.15.88:0/4036004650 learned_addr learned my addr 172.21.15.88:0/4036004650 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:48.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.713+0000 7f739f7fe640 1 --2- 172.21.15.88:0/4036004650 >> v2:172.21.15.88:3300/0 conn(0x7f73a00c98f0 0x7f73a0151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:48.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.713+0000 7f739effd640 1 --2- 172.21.15.88:0/4036004650 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73a00bf2d0 0x7f73a0151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:48.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.713+0000 7f739e7fc640 1 -- 172.21.15.88:0/4036004650 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3494607487 0 0) 0x7f73a0158780 con 0x7f73a00c6030 2023-12-08T08:20:48.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.713+0000 7f739e7fc640 1 -- 172.21.15.88:0/4036004650 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f738c003530 con 0x7f73a00c6030 2023-12-08T08:20:48.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.713+0000 7f739f7fe640 1 -- 172.21.15.88:0/4036004650 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73a00bf2d0 msgr2=0x7f73a0151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:48.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.713+0000 7f739f7fe640 1 --2- 172.21.15.88:0/4036004650 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73a00bf2d0 0x7f73a0151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.713+0000 7f739f7fe640 1 -- 172.21.15.88:0/4036004650 >> v1:172.21.15.88:6789/0 conn(0x7f73a00c6030 legacy=0x7f73a00c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:48.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.713+0000 7f739f7fe640 1 -- 172.21.15.88:0/4036004650 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a0157e50 con 0x7f73a00c98f0 2023-12-08T08:20:48.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.717+0000 7f739f7fe640 1 --2- 172.21.15.88:0/4036004650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a00c98f0 0x7f73a0151eb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7398009d90 tx=0x7f739801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2888631f836d69 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:48.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.717+0000 7f739e7fc640 1 -- 172.21.15.88:0/4036004650 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73980a59e0 con 0x7f73a00c98f0 2023-12-08T08:20:48.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.717+0000 7f739e7fc640 1 -- 172.21.15.88:0/4036004650 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73980a5b40 con 0x7f73a00c98f0 2023-12-08T08:20:48.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.717+0000 7f739e7fc640 1 -- 172.21.15.88:0/4036004650 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73980ad440 con 0x7f73a00c98f0 2023-12-08T08:20:48.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.717+0000 7f73a59f8640 1 -- 172.21.15.88:0/4036004650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a00c98f0 msgr2=0x7f73a0151eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:48.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.717+0000 7f73a59f8640 1 --2- 172.21.15.88:0/4036004650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a00c98f0 0x7f73a0151eb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7398009d90 tx=0x7f739801c920 comp rx=0 tx=0).stop 2023-12-08T08:20:48.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.717+0000 7f73a59f8640 1 -- 172.21.15.88:0/4036004650 shutdown_connections 2023-12-08T08:20:48.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.717+0000 7f73a59f8640 1 --2- 172.21.15.88:0/4036004650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a00c98f0 0x7f73a0151eb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.717+0000 7f73a59f8640 1 --2- 172.21.15.88:0/4036004650 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73a00bf2d0 0x7f73a0151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.717+0000 7f73a59f8640 1 -- 172.21.15.88:0/4036004650 >> 172.21.15.88:0/4036004650 conn(0x7f73a00c9dc0 msgr2=0x7f73a00ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:48.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.717+0000 7f73a59f8640 1 -- 172.21.15.88:0/4036004650 shutdown_connections 2023-12-08T08:20:48.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.717+0000 7f73a59f8640 1 -- 172.21.15.88:0/4036004650 wait complete. 2023-12-08T08:20:48.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.721+0000 7f73a59f8640 1 Processor -- start 2023-12-08T08:20:48.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.721+0000 7f73a59f8640 1 -- start start 2023-12-08T08:20:48.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.721+0000 7f73a59f8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73a00bf2d0 0x7f73a0144b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:48.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.721+0000 7f73a59f8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73a00c6030 0x7f73a013f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:48.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.721+0000 7f73a59f8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a00c98f0 0x7f73a013f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:48.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.721+0000 7f73a59f8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a013fe10 con 0x7f73a00c98f0 2023-12-08T08:20:48.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.721+0000 7f73a59f8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a0148d30 con 0x7f73a00bf2d0 2023-12-08T08:20:48.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.721+0000 7f73a59f8640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a0148fa0 con 0x7f73a00c6030 2023-12-08T08:20:48.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.721+0000 7f739f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a00c98f0 0x7f73a013f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:48.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.721+0000 7f739f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a00c98f0 0x7f73a013f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60596/0 (socket says 172.21.15.88:60596) 2023-12-08T08:20:48.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.721+0000 7f739f7fe640 1 -- 172.21.15.88:0/364990816 learned_addr learned my addr 172.21.15.88:0/364990816 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:48.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.721+0000 7f739effd640 1 --2- 172.21.15.88:0/364990816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73a00bf2d0 0x7f73a0144b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:48.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.721+0000 7f73967fc640 1 --2- 172.21.15.88:0/364990816 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73a00c6030 0x7f73a013f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:48.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.721+0000 7f739f7fe640 1 -- 172.21.15.88:0/364990816 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73a00c6030 msgr2=0x7f73a013f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:48.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.721+0000 7f739f7fe640 1 --2- 172.21.15.88:0/364990816 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73a00c6030 0x7f73a013f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.721+0000 7f739f7fe640 1 -- 172.21.15.88:0/364990816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73a00bf2d0 msgr2=0x7f73a0144b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:48.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.721+0000 7f739f7fe640 1 --2- 172.21.15.88:0/364990816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73a00bf2d0 0x7f73a0144b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.721+0000 7f739f7fe640 1 -- 172.21.15.88:0/364990816 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7398009a70 con 0x7f73a00c98f0 2023-12-08T08:20:48.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.721+0000 7f739f7fe640 1 --2- 172.21.15.88:0/364990816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a00c98f0 0x7f73a013f8d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7398009d90 tx=0x7f73980196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:48.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.721+0000 7f739cff9640 1 -- 172.21.15.88:0/364990816 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73980add90 con 0x7f73a00c98f0 2023-12-08T08:20:48.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.721+0000 7f739cff9640 1 -- 172.21.15.88:0/364990816 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7398009450 con 0x7f73a00c98f0 2023-12-08T08:20:48.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.721+0000 7f73a59f8640 1 -- 172.21.15.88:0/364990816 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a0149280 con 0x7f73a00c98f0 2023-12-08T08:20:48.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.721+0000 7f739cff9640 1 -- 172.21.15.88:0/364990816 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73980b7650 con 0x7f73a00c98f0 2023-12-08T08:20:48.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.721+0000 7f73a59f8640 1 -- 172.21.15.88:0/364990816 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a01f0f20 con 0x7f73a00c98f0 2023-12-08T08:20:48.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.725+0000 7f73a59f8640 1 -- 172.21.15.88:0/364990816 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a0067630 con 0x7f73a00c98f0 2023-12-08T08:20:48.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.725+0000 7f739cff9640 1 -- 172.21.15.88:0/364990816 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f73980b4050 con 0x7f73a00c98f0 2023-12-08T08:20:48.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.725+0000 7f739cff9640 1 --2- 172.21.15.88:0/364990816 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7380066470 0x7f7380068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:48.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.725+0000 7f739cff9640 1 -- 172.21.15.88:0/364990816 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f739811ef30 con 0x7f73a00c98f0 2023-12-08T08:20:48.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.725+0000 7f739effd640 1 --2- 172.21.15.88:0/364990816 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7380066470 0x7f7380068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:48.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.725+0000 7f739effd640 1 --2- 172.21.15.88:0/364990816 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7380066470 0x7f7380068930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7390007a60 tx=0x7f7390008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:48.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.729+0000 7f739cff9640 1 -- 172.21.15.88:0/364990816 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f73980ec3c0 con 0x7f73a00c98f0 2023-12-08T08:20:48.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.881+0000 7f73a59f8640 1 -- 172.21.15.88:0/364990816 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f73a01486c0 con 0x7f73a00c98f0 2023-12-08T08:20:48.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.881+0000 7f739cff9640 1 -- 172.21.15.88:0/364990816 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f73980b20a0 con 0x7f73a00c98f0 2023-12-08T08:20:48.885 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:20:48.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.881+0000 7f73a59f8640 1 -- 172.21.15.88:0/364990816 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7380066470 msgr2=0x7f7380068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:48.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.881+0000 7f73a59f8640 1 --2- 172.21.15.88:0/364990816 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7380066470 0x7f7380068930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7390007a60 tx=0x7f7390008040 comp rx=0 tx=0).stop 2023-12-08T08:20:48.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.881+0000 7f73a59f8640 1 -- 172.21.15.88:0/364990816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a00c98f0 msgr2=0x7f73a013f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:48.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.881+0000 7f73a59f8640 1 --2- 172.21.15.88:0/364990816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a00c98f0 0x7f73a013f8d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7398009d90 tx=0x7f73980196c0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.881+0000 7f73a59f8640 1 -- 172.21.15.88:0/364990816 shutdown_connections 2023-12-08T08:20:48.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.881+0000 7f73a59f8640 1 --2- 172.21.15.88:0/364990816 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7380066470 0x7f7380068930 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.881+0000 7f73a59f8640 1 --2- 172.21.15.88:0/364990816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73a00c98f0 0x7f73a013f8d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.881+0000 7f73a59f8640 1 --2- 172.21.15.88:0/364990816 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73a00c6030 0x7f73a013f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.881+0000 7f73a59f8640 1 --2- 172.21.15.88:0/364990816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73a00bf2d0 0x7f73a0144b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.881+0000 7f73a59f8640 1 -- 172.21.15.88:0/364990816 >> 172.21.15.88:0/364990816 conn(0x7f73a00c9dc0 msgr2=0x7f73a00ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:48.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.881+0000 7f73a59f8640 1 -- 172.21.15.88:0/364990816 shutdown_connections 2023-12-08T08:20:48.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:48.881+0000 7f73a59f8640 1 -- 172.21.15.88:0/364990816 wait complete. 2023-12-08T08:20:48.907 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:20:49.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.041+0000 7f2552f01640 1 Processor -- start 2023-12-08T08:20:49.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.041+0000 7f2552f01640 1 -- start start 2023-12-08T08:20:49.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.041+0000 7f2552f01640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f254c0af550 0x7f254c154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:49.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.041+0000 7f2552f01640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f254c158760 0x7f254c0c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:49.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.041+0000 7f2552f01640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f254c0c67a0 con 0x7f254c0c4710 2023-12-08T08:20:49.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.041+0000 7f2552f01640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f254c0af930 con 0x7f254c0af550 2023-12-08T08:20:49.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.041+0000 7f2552f01640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f254c0c69f0 con 0x7f254c158760 2023-12-08T08:20:49.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.041+0000 7f2550c9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f254c0af550 0x7f254c154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:49.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.041+0000 7f2550c9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f254c0af550 0x7f254c154f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60610/0 (socket says 172.21.15.88:60610) 2023-12-08T08:20:49.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.041+0000 7f2550c9d640 1 -- 172.21.15.88:0/3735131039 learned_addr learned my addr 172.21.15.88:0/3735131039 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:49.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.041+0000 7f255149e640 1 --2- 172.21.15.88:0/3735131039 >> v2:172.21.15.148:3300/0 conn(0x7f254c158760 0x7f254c0c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:49.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.041+0000 7f2550c9d640 1 -- 172.21.15.88:0/3735131039 >> v2:172.21.15.148:3300/0 conn(0x7f254c158760 msgr2=0x7f254c0c4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:49.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.041+0000 7f2550c9d640 1 --2- 172.21.15.88:0/3735131039 >> v2:172.21.15.148:3300/0 conn(0x7f254c158760 0x7f254c0c4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.041+0000 7f2550c9d640 1 -- 172.21.15.88:0/3735131039 >> v1:172.21.15.148:6789/0 conn(0x7f254c0c4710 legacy=0x7f254c158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:49.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.041+0000 7f2550c9d640 1 -- 172.21.15.88:0/3735131039 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c0c6cd0 con 0x7f254c0af550 2023-12-08T08:20:49.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.045+0000 7f2550c9d640 1 --2- 172.21.15.88:0/3735131039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f254c0af550 0x7f254c154f20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f254c0aca00 tx=0x7f253c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44699869cf8557c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:49.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.045+0000 7f254b7fe640 1 -- 172.21.15.88:0/3735131039 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253c0ab600 con 0x7f254c0af550 2023-12-08T08:20:49.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.045+0000 7f254b7fe640 1 -- 172.21.15.88:0/3735131039 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253c0a7050 con 0x7f254c0af550 2023-12-08T08:20:49.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.045+0000 7f254b7fe640 1 -- 172.21.15.88:0/3735131039 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253c0ab980 con 0x7f254c0af550 2023-12-08T08:20:49.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.045+0000 7f2552f01640 1 -- 172.21.15.88:0/3735131039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f254c0af550 msgr2=0x7f254c154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:49.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.045+0000 7f2552f01640 1 --2- 172.21.15.88:0/3735131039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f254c0af550 0x7f254c154f20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f254c0aca00 tx=0x7f253c01c3a0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.045+0000 7f2552f01640 1 -- 172.21.15.88:0/3735131039 shutdown_connections 2023-12-08T08:20:49.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.045+0000 7f2552f01640 1 --2- 172.21.15.88:0/3735131039 >> v2:172.21.15.148:3300/0 conn(0x7f254c158760 0x7f254c0c4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.045+0000 7f2552f01640 1 --2- 172.21.15.88:0/3735131039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f254c0af550 0x7f254c154f20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.045+0000 7f2552f01640 1 -- 172.21.15.88:0/3735131039 >> 172.21.15.88:0/3735131039 conn(0x7f254c0668d0 msgr2=0x7f254c0ab980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:49.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.045+0000 7f2552f01640 1 -- 172.21.15.88:0/3735131039 shutdown_connections 2023-12-08T08:20:49.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.045+0000 7f2552f01640 1 -- 172.21.15.88:0/3735131039 wait complete. 2023-12-08T08:20:49.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.049+0000 7f2552f01640 1 Processor -- start 2023-12-08T08:20:49.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.049+0000 7f2552f01640 1 -- start start 2023-12-08T08:20:49.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.049+0000 7f2552f01640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f254c0af550 0x7f254c0ad380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:49.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.049+0000 7f2552f01640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f254c0c4710 0x7f254c149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:49.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.049+0000 7f2552f01640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f254c158760 0x7f254c150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:49.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.049+0000 7f2552f01640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254c0aec30 con 0x7f254c0c4710 2023-12-08T08:20:49.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.049+0000 7f2552f01640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254c0ad8c0 con 0x7f254c0af550 2023-12-08T08:20:49.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.049+0000 7f2552f01640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f254c0aa710 con 0x7f254c158760 2023-12-08T08:20:49.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.049+0000 7f254bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f254c0c4710 0x7f254c149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:49.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.049+0000 7f254bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f254c0c4710 0x7f254c149b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60614/0 (socket says 172.21.15.88:60614) 2023-12-08T08:20:49.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.049+0000 7f254bfff640 1 -- 172.21.15.88:0/1306123180 learned_addr learned my addr 172.21.15.88:0/1306123180 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:49.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.049+0000 7f2550c9d640 1 --2- 172.21.15.88:0/1306123180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f254c0af550 0x7f254c0ad380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:49.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.049+0000 7f255149e640 1 --2- 172.21.15.88:0/1306123180 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f254c158760 0x7f254c150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:49.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.049+0000 7f254bfff640 1 -- 172.21.15.88:0/1306123180 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f254c158760 msgr2=0x7f254c150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:49.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.049+0000 7f254bfff640 1 --2- 172.21.15.88:0/1306123180 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f254c158760 0x7f254c150d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.049+0000 7f254bfff640 1 -- 172.21.15.88:0/1306123180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f254c0af550 msgr2=0x7f254c0ad380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:49.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.049+0000 7f254bfff640 1 --2- 172.21.15.88:0/1306123180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f254c0af550 0x7f254c0ad380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.049+0000 7f254bfff640 1 -- 172.21.15.88:0/1306123180 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c0094d0 con 0x7f254c0c4710 2023-12-08T08:20:49.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.049+0000 7f2550c9d640 1 --2- 172.21.15.88:0/1306123180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f254c0af550 0x7f254c0ad380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:49.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.049+0000 7f254bfff640 1 --2- 172.21.15.88:0/1306123180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f254c0c4710 0x7f254c149b50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f253400c450 tx=0x7f253400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:49.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.049+0000 7f25497fa640 1 -- 172.21.15.88:0/1306123180 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2534012830 con 0x7f254c0c4710 2023-12-08T08:20:49.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.049+0000 7f25497fa640 1 -- 172.21.15.88:0/1306123180 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25340129b0 con 0x7f254c0c4710 2023-12-08T08:20:49.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.049+0000 7f25497fa640 1 -- 172.21.15.88:0/1306123180 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2534012d60 con 0x7f254c0c4710 2023-12-08T08:20:49.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.049+0000 7f2552f01640 1 -- 172.21.15.88:0/1306123180 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f254c0adaf0 con 0x7f254c0c4710 2023-12-08T08:20:49.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.049+0000 7f2552f01640 1 -- 172.21.15.88:0/1306123180 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f254c0aac60 con 0x7f254c0c4710 2023-12-08T08:20:49.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.053+0000 7f2552f01640 1 -- 172.21.15.88:0/1306123180 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f254c067630 con 0x7f254c0c4710 2023-12-08T08:20:49.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.053+0000 7f25497fa640 1 -- 172.21.15.88:0/1306123180 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f253401c460 con 0x7f254c0c4710 2023-12-08T08:20:49.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.053+0000 7f25497fa640 1 --2- 172.21.15.88:0/1306123180 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f252c066470 0x7f252c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:49.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.053+0000 7f25497fa640 1 -- 172.21.15.88:0/1306123180 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2534083cd0 con 0x7f254c0c4710 2023-12-08T08:20:49.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.053+0000 7f2550c9d640 1 --2- 172.21.15.88:0/1306123180 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f252c066470 0x7f252c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:49.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.053+0000 7f2550c9d640 1 --2- 172.21.15.88:0/1306123180 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f252c066470 0x7f252c068930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f253c0ad000 tx=0x7f253c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:49.063 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:20:49.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.057+0000 7f25497fa640 1 -- 172.21.15.88:0/1306123180 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2534051160 con 0x7f254c0c4710 2023-12-08T08:20:49.066 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:20:49.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.209+0000 7f2552f01640 1 -- 172.21.15.88:0/1306123180 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f254c06c630 con 0x7f254c0c4710 2023-12-08T08:20:49.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.209+0000 7f25497fa640 1 -- 172.21.15.88:0/1306123180 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2534054780 con 0x7f254c0c4710 2023-12-08T08:20:49.216 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:20:49.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.213+0000 7f2552f01640 1 -- 172.21.15.88:0/1306123180 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f252c066470 msgr2=0x7f252c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:49.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.213+0000 7f2552f01640 1 --2- 172.21.15.88:0/1306123180 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f252c066470 0x7f252c068930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f253c0ad000 tx=0x7f253c008040 comp rx=0 tx=0).stop 2023-12-08T08:20:49.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.213+0000 7f2552f01640 1 -- 172.21.15.88:0/1306123180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f254c0c4710 msgr2=0x7f254c149b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:49.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.213+0000 7f2552f01640 1 --2- 172.21.15.88:0/1306123180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f254c0c4710 0x7f254c149b50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f253400c450 tx=0x7f253400c910 comp rx=0 tx=0).stop 2023-12-08T08:20:49.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.213+0000 7f2552f01640 1 -- 172.21.15.88:0/1306123180 shutdown_connections 2023-12-08T08:20:49.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.213+0000 7f2552f01640 1 --2- 172.21.15.88:0/1306123180 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f252c066470 0x7f252c068930 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.213+0000 7f2552f01640 1 --2- 172.21.15.88:0/1306123180 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f254c158760 0x7f254c150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.213+0000 7f2552f01640 1 --2- 172.21.15.88:0/1306123180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f254c0c4710 0x7f254c149b50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.213+0000 7f2552f01640 1 --2- 172.21.15.88:0/1306123180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f254c0af550 0x7f254c0ad380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.213+0000 7f2552f01640 1 -- 172.21.15.88:0/1306123180 >> 172.21.15.88:0/1306123180 conn(0x7f254c0668d0 msgr2=0x7f254c1544d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:49.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.213+0000 7f2552f01640 1 -- 172.21.15.88:0/1306123180 shutdown_connections 2023-12-08T08:20:49.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.213+0000 7f2552f01640 1 -- 172.21.15.88:0/1306123180 wait complete. 2023-12-08T08:20:49.237 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:20:49.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.373+0000 7fafde3f5640 1 Processor -- start 2023-12-08T08:20:49.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.373+0000 7fafde3f5640 1 -- start start 2023-12-08T08:20:49.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.373+0000 7fafde3f5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fafd814f850 0x7fafd80aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:49.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.373+0000 7fafde3f5640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafd814fc30 0x7fafd80c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:49.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.373+0000 7fafde3f5640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fafd806d840 0x7fafd80c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:49.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.373+0000 7fafde3f5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd80c2240 con 0x7fafd814f850 2023-12-08T08:20:49.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.373+0000 7fafde3f5640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd8152910 con 0x7fafd806d840 2023-12-08T08:20:49.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.373+0000 7fafde3f5640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd8152bf0 con 0x7fafd814fc30 2023-12-08T08:20:49.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.373+0000 7fafd7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fafd814f850 0x7fafd80aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:49.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.373+0000 7fafd7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fafd814f850 0x7fafd80aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60618/0 (socket says 172.21.15.88:60618) 2023-12-08T08:20:49.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.373+0000 7fafd7fff640 1 -- 172.21.15.88:0/4189882292 learned_addr learned my addr 172.21.15.88:0/4189882292 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:49.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.373+0000 7fafdc992640 1 --2- 172.21.15.88:0/4189882292 >> v2:172.21.15.148:3300/0 conn(0x7fafd806d840 0x7fafd80c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:49.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.373+0000 7fafcffff640 1 --2- 172.21.15.88:0/4189882292 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafd814fc30 0x7fafd80c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:49.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.373+0000 7fafd7fff640 1 -- 172.21.15.88:0/4189882292 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafd814fc30 msgr2=0x7fafd80c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:49.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.373+0000 7fafd7fff640 1 --2- 172.21.15.88:0/4189882292 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafd814fc30 0x7fafd80c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.373+0000 7fafd7fff640 1 -- 172.21.15.88:0/4189882292 >> v2:172.21.15.148:3300/0 conn(0x7fafd806d840 msgr2=0x7fafd80c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:49.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.373+0000 7fafd7fff640 1 --2- 172.21.15.88:0/4189882292 >> v2:172.21.15.148:3300/0 conn(0x7fafd806d840 0x7fafd80c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.373+0000 7fafd7fff640 1 -- 172.21.15.88:0/4189882292 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd8152ed0 con 0x7fafd814f850 2023-12-08T08:20:49.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.373+0000 7fafdc992640 1 --2- 172.21.15.88:0/4189882292 >> v2:172.21.15.148:3300/0 conn(0x7fafd806d840 0x7fafd80c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:49.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.377+0000 7fafd7fff640 1 --2- 172.21.15.88:0/4189882292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafd814f850 0x7fafd80aacf0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fafd806e1a0 tx=0x7fafc801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ad47932db7340b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:49.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.377+0000 7fafd77fe640 1 -- 172.21.15.88:0/4189882292 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc80aa640 con 0x7fafd814f850 2023-12-08T08:20:49.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.377+0000 7fafd77fe640 1 -- 172.21.15.88:0/4189882292 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc80aa7a0 con 0x7fafd814f850 2023-12-08T08:20:49.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.377+0000 7fafd77fe640 1 -- 172.21.15.88:0/4189882292 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc80aab30 con 0x7fafd814f850 2023-12-08T08:20:49.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.377+0000 7fafde3f5640 1 -- 172.21.15.88:0/4189882292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafd814f850 msgr2=0x7fafd80aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:49.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.377+0000 7fafde3f5640 1 --2- 172.21.15.88:0/4189882292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafd814f850 0x7fafd80aacf0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fafd806e1a0 tx=0x7fafc801c500 comp rx=0 tx=0).stop 2023-12-08T08:20:49.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.377+0000 7fafde3f5640 1 -- 172.21.15.88:0/4189882292 shutdown_connections 2023-12-08T08:20:49.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.377+0000 7fafde3f5640 1 --2- 172.21.15.88:0/4189882292 >> v2:172.21.15.148:3300/0 conn(0x7fafd806d840 0x7fafd80c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.377+0000 7fafde3f5640 1 --2- 172.21.15.88:0/4189882292 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafd814fc30 0x7fafd80c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.377+0000 7fafde3f5640 1 --2- 172.21.15.88:0/4189882292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafd814f850 0x7fafd80aacf0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.377+0000 7fafde3f5640 1 -- 172.21.15.88:0/4189882292 >> 172.21.15.88:0/4189882292 conn(0x7fafd80c59f0 msgr2=0x7fafd80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:49.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.377+0000 7fafde3f5640 1 -- 172.21.15.88:0/4189882292 shutdown_connections 2023-12-08T08:20:49.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.377+0000 7fafde3f5640 1 -- 172.21.15.88:0/4189882292 wait complete. 2023-12-08T08:20:49.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.381+0000 7fafde3f5640 1 Processor -- start 2023-12-08T08:20:49.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.381+0000 7fafde3f5640 1 -- start start 2023-12-08T08:20:49.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.381+0000 7fafde3f5640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafd806d840 0x7fafd81f1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:49.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.381+0000 7fafde3f5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafd814f850 0x7fafd815b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:49.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.381+0000 7fafde3f5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafd814fc30 0x7fafd81edae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:49.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.381+0000 7fafde3f5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd81ed3d0 con 0x7fafd814fc30 2023-12-08T08:20:49.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.381+0000 7fafde3f5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd81f1890 con 0x7fafd814f850 2023-12-08T08:20:49.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.381+0000 7fafde3f5640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd80a6970 con 0x7fafd806d840 2023-12-08T08:20:49.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.381+0000 7fafdc992640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafd814fc30 0x7fafd81edae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:49.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.381+0000 7fafdc992640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafd814fc30 0x7fafd81edae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60620/0 (socket says 172.21.15.88:60620) 2023-12-08T08:20:49.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.381+0000 7fafdc992640 1 -- 172.21.15.88:0/2541553353 learned_addr learned my addr 172.21.15.88:0/2541553353 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:49.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.381+0000 7fafcffff640 1 --2- 172.21.15.88:0/2541553353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafd814f850 0x7fafd815b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:49.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.381+0000 7fafd7fff640 1 --2- 172.21.15.88:0/2541553353 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafd806d840 0x7fafd81f1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:49.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.381+0000 7fafdc992640 1 -- 172.21.15.88:0/2541553353 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafd806d840 msgr2=0x7fafd81f1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:49.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.381+0000 7fafdc992640 1 --2- 172.21.15.88:0/2541553353 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafd806d840 0x7fafd81f1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.381+0000 7fafdc992640 1 -- 172.21.15.88:0/2541553353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafd814f850 msgr2=0x7fafd815b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:49.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.381+0000 7fafdc992640 1 --2- 172.21.15.88:0/2541553353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafd814f850 0x7fafd815b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.381+0000 7fafdc992640 1 -- 172.21.15.88:0/2541553353 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc80094d0 con 0x7fafd814fc30 2023-12-08T08:20:49.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.381+0000 7fafdc992640 1 --2- 172.21.15.88:0/2541553353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafd814fc30 0x7fafd81edae0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fafd0007e20 tx=0x7fafd000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:49.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.381+0000 7fafd57fa640 1 -- 172.21.15.88:0/2541553353 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd0015400 con 0x7fafd814fc30 2023-12-08T08:20:49.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.381+0000 7fafd57fa640 1 -- 172.21.15.88:0/2541553353 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd000f040 con 0x7fafd814fc30 2023-12-08T08:20:49.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.381+0000 7fafde3f5640 1 -- 172.21.15.88:0/2541553353 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd80a6c50 con 0x7fafd814fc30 2023-12-08T08:20:49.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.381+0000 7fafd57fa640 1 -- 172.21.15.88:0/2541553353 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd00157a0 con 0x7fafd814fc30 2023-12-08T08:20:49.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.381+0000 7fafde3f5640 1 -- 172.21.15.88:0/2541553353 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd80a7210 con 0x7fafd814fc30 2023-12-08T08:20:49.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.385+0000 7fafde3f5640 1 -- 172.21.15.88:0/2541553353 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd8067630 con 0x7fafd814fc30 2023-12-08T08:20:49.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.385+0000 7fafd57fa640 1 -- 172.21.15.88:0/2541553353 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fafd001e3b0 con 0x7fafd814fc30 2023-12-08T08:20:49.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.385+0000 7fafd57fa640 1 --2- 172.21.15.88:0/2541553353 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fafb8066470 0x7fafb8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:49.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.385+0000 7fafd57fa640 1 -- 172.21.15.88:0/2541553353 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fafd0084060 con 0x7fafd814fc30 2023-12-08T08:20:49.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.385+0000 7fafd7fff640 1 --2- 172.21.15.88:0/2541553353 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fafb8066470 0x7fafb8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:49.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.385+0000 7fafd7fff640 1 --2- 172.21.15.88:0/2541553353 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fafb8066470 0x7fafb8068930 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fafc80ae000 tx=0x7fafc80b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:49.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.389+0000 7fafd57fa640 1 -- 172.21.15.88:0/2541553353 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fafd0051590 con 0x7fafd814fc30 2023-12-08T08:20:49.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.541+0000 7fafde3f5640 1 -- 172.21.15.88:0/2541553353 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fafd80a4a90 con 0x7fafd814fc30 2023-12-08T08:20:49.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.541+0000 7fafd57fa640 1 -- 172.21.15.88:0/2541553353 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fafd001a020 con 0x7fafd814fc30 2023-12-08T08:20:49.548 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:20:49.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.545+0000 7fafde3f5640 1 -- 172.21.15.88:0/2541553353 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fafb8066470 msgr2=0x7fafb8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:49.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.545+0000 7fafde3f5640 1 --2- 172.21.15.88:0/2541553353 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fafb8066470 0x7fafb8068930 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fafc80ae000 tx=0x7fafc80b5040 comp rx=0 tx=0).stop 2023-12-08T08:20:49.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.545+0000 7fafde3f5640 1 -- 172.21.15.88:0/2541553353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafd814fc30 msgr2=0x7fafd81edae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:49.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.545+0000 7fafde3f5640 1 --2- 172.21.15.88:0/2541553353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafd814fc30 0x7fafd81edae0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fafd0007e20 tx=0x7fafd000d4a0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.545+0000 7fafde3f5640 1 -- 172.21.15.88:0/2541553353 shutdown_connections 2023-12-08T08:20:49.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.545+0000 7fafde3f5640 1 --2- 172.21.15.88:0/2541553353 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fafb8066470 0x7fafb8068930 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.545+0000 7fafde3f5640 1 --2- 172.21.15.88:0/2541553353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafd814fc30 0x7fafd81edae0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.545+0000 7fafde3f5640 1 --2- 172.21.15.88:0/2541553353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafd814f850 0x7fafd815b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.545+0000 7fafde3f5640 1 --2- 172.21.15.88:0/2541553353 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fafd806d840 0x7fafd81f1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.545+0000 7fafde3f5640 1 -- 172.21.15.88:0/2541553353 >> 172.21.15.88:0/2541553353 conn(0x7fafd80c59f0 msgr2=0x7fafd8150ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:49.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.545+0000 7fafde3f5640 1 -- 172.21.15.88:0/2541553353 shutdown_connections 2023-12-08T08:20:49.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.545+0000 7fafde3f5640 1 -- 172.21.15.88:0/2541553353 wait complete. 2023-12-08T08:20:49.569 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:20:49.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.701+0000 7fcf4c294640 1 Processor -- start 2023-12-08T08:20:49.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.701+0000 7fcf4c294640 1 -- start start 2023-12-08T08:20:49.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.701+0000 7fcf4c294640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcf44072810 0x7fcf440c0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:49.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.701+0000 7fcf4c294640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf441524b0 con 0x7fcf440a5370 2023-12-08T08:20:49.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.701+0000 7fcf4c294640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf440c62f0 con 0x7fcf440a4f90 2023-12-08T08:20:49.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.701+0000 7fcf4c294640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf440c60d0 con 0x7fcf44072810 2023-12-08T08:20:49.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4982f640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcf440a5370 0x7fcf4414f870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36614/0 (socket says 172.21.15.88:36614) 2023-12-08T08:20:49.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4982f640 1 -- 172.21.15.88:0/286751899 learned_addr learned my addr 172.21.15.88:0/286751899 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:49.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4a831640 1 --2- 172.21.15.88:0/286751899 >> v2:172.21.15.148:3300/0 conn(0x7fcf44072810 0x7fcf440c0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:49.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4902e640 1 -- 172.21.15.88:0/286751899 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830500952 0 0) 0x7fcf441524b0 con 0x7fcf440a5370 2023-12-08T08:20:49.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4902e640 1 -- 172.21.15.88:0/286751899 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf30003530 con 0x7fcf440a5370 2023-12-08T08:20:49.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4902e640 1 -- 172.21.15.88:0/286751899 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2576981223 0 0) 0x7fcf30003530 con 0x7fcf440a5370 2023-12-08T08:20:49.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4902e640 1 -- 172.21.15.88:0/286751899 >> v2:172.21.15.148:3300/0 conn(0x7fcf44072810 msgr2=0x7fcf440c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:49.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4902e640 1 --2- 172.21.15.88:0/286751899 >> v2:172.21.15.148:3300/0 conn(0x7fcf44072810 0x7fcf440c0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4902e640 1 -- 172.21.15.88:0/286751899 >> v1:172.21.15.148:6789/0 conn(0x7fcf440a4f90 legacy=0x7fcf440c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:49.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4902e640 1 -- 172.21.15.88:0/286751899 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf44152770 con 0x7fcf440a5370 2023-12-08T08:20:49.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4902e640 1 -- 172.21.15.88:0/286751899 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7fcf34001680 con 0x7fcf440a5370 2023-12-08T08:20:49.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4902e640 1 -- 172.21.15.88:0/286751899 >> v1:172.21.15.88:6789/0 conn(0x7fcf440a5370 legacy=0x7fcf4414f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:49.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4902e640 1 --2- 172.21.15.88:0/286751899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf30003980 0x7fcf30003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:49.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4902e640 1 --2- 172.21.15.88:0/286751899 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf300047d0 0x7fcf30004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:49.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4902e640 1 --2- 172.21.15.88:0/286751899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf30005190 0x7fcf3000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:49.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4902e640 1 -- 172.21.15.88:0/286751899 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf440c60d0 con 0x7fcf30005190 2023-12-08T08:20:49.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4902e640 1 -- 172.21.15.88:0/286751899 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3000c0c0 con 0x7fcf30003980 2023-12-08T08:20:49.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4902e640 1 -- 172.21.15.88:0/286751899 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3000c280 con 0x7fcf300047d0 2023-12-08T08:20:49.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4a831640 1 --2- 172.21.15.88:0/286751899 >> v2:172.21.15.148:3300/0 conn(0x7fcf44072810 0x7fcf440c0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:49.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4a030640 1 --2- 172.21.15.88:0/286751899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf30003980 0x7fcf30003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:49.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4982f640 1 --2- 172.21.15.88:0/286751899 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf300047d0 0x7fcf30004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:49.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4a831640 1 --2- 172.21.15.88:0/286751899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf30005190 0x7fcf3000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:49.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4a030640 1 -- 172.21.15.88:0/286751899 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf300047d0 msgr2=0x7fcf30004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:49.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4a030640 1 --2- 172.21.15.88:0/286751899 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf300047d0 0x7fcf30004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4a030640 1 -- 172.21.15.88:0/286751899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf30005190 msgr2=0x7fcf3000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:49.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4a030640 1 --2- 172.21.15.88:0/286751899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf30005190 0x7fcf3000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4a030640 1 -- 172.21.15.88:0/286751899 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf30003530 con 0x7fcf30003980 2023-12-08T08:20:49.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4a831640 1 --2- 172.21.15.88:0/286751899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf30005190 0x7fcf3000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:49.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.705+0000 7fcf4a831640 1 -- 172.21.15.88:0/286751899 reap_dead start 2023-12-08T08:20:49.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.709+0000 7fcf4a030640 1 --2- 172.21.15.88:0/286751899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf30003980 0x7fcf30003d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcf40001860 tx=0x7fcf4001ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=951f7f0b39200055 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:49.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.709+0000 7fcf4902e640 1 -- 172.21.15.88:0/286751899 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf400a8870 con 0x7fcf30003980 2023-12-08T08:20:49.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.709+0000 7fcf4902e640 1 -- 172.21.15.88:0/286751899 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf400a89d0 con 0x7fcf30003980 2023-12-08T08:20:49.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.709+0000 7fcf4902e640 1 -- 172.21.15.88:0/286751899 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf400a8dc0 con 0x7fcf30003980 2023-12-08T08:20:49.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.709+0000 7fcf4c294640 1 -- 172.21.15.88:0/286751899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf30003980 msgr2=0x7fcf30003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:49.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.709+0000 7fcf4c294640 1 --2- 172.21.15.88:0/286751899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf30003980 0x7fcf30003d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcf40001860 tx=0x7fcf4001ec50 comp rx=0 tx=0).stop 2023-12-08T08:20:49.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.709+0000 7fcf4c294640 1 -- 172.21.15.88:0/286751899 shutdown_connections 2023-12-08T08:20:49.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.709+0000 7fcf4c294640 1 --2- 172.21.15.88:0/286751899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf30003980 0x7fcf30003d80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.709+0000 7fcf4c294640 1 -- 172.21.15.88:0/286751899 >> 172.21.15.88:0/286751899 conn(0x7fcf4406b220 msgr2=0x7fcf440a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:49.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.709+0000 7fcf4c294640 1 -- 172.21.15.88:0/286751899 shutdown_connections 2023-12-08T08:20:49.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.709+0000 7fcf4c294640 1 -- 172.21.15.88:0/286751899 wait complete. 2023-12-08T08:20:49.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.709+0000 7fcf4c294640 1 Processor -- start 2023-12-08T08:20:49.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.709+0000 7fcf4c294640 1 -- start start 2023-12-08T08:20:49.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.713+0000 7fcf4c294640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf30003980 0x7fcf440a8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:49.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.713+0000 7fcf4c294640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf440a9760 0x7fcf4414bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:49.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.713+0000 7fcf4c294640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf4414c440 0x7fcf44155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:49.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.713+0000 7fcf4c294640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf44155370 con 0x7fcf30003980 2023-12-08T08:20:49.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.713+0000 7fcf4c294640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4414c8c0 con 0x7fcf4414c440 2023-12-08T08:20:49.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.713+0000 7fcf4c294640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf440a9e50 con 0x7fcf440a9760 2023-12-08T08:20:49.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.713+0000 7fcf4a030640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf30003980 0x7fcf440a8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:49.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.713+0000 7fcf4a030640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf30003980 0x7fcf440a8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60642/0 (socket says 172.21.15.88:60642) 2023-12-08T08:20:49.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.713+0000 7fcf4a030640 1 -- 172.21.15.88:0/1722296938 learned_addr learned my addr 172.21.15.88:0/1722296938 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:49.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.713+0000 7fcf4a030640 1 -- 172.21.15.88:0/1722296938 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf440a9760 msgr2=0x7fcf4414bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:49.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.713+0000 7fcf4a030640 1 --2- 172.21.15.88:0/1722296938 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf440a9760 0x7fcf4414bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.713+0000 7fcf4a030640 1 -- 172.21.15.88:0/1722296938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf4414c440 msgr2=0x7fcf44155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:49.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.713+0000 7fcf4a030640 1 --2- 172.21.15.88:0/1722296938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf4414c440 0x7fcf44155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.713+0000 7fcf4a030640 1 -- 172.21.15.88:0/1722296938 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf441533d0 con 0x7fcf30003980 2023-12-08T08:20:49.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.713+0000 7fcf4a030640 1 --2- 172.21.15.88:0/1722296938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf30003980 0x7fcf440a8e40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcf400b3040 tx=0x7fcf30005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:49.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.713+0000 7fcf3affd640 1 -- 172.21.15.88:0/1722296938 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf400069e0 con 0x7fcf30003980 2023-12-08T08:20:49.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.713+0000 7fcf3affd640 1 -- 172.21.15.88:0/1722296938 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf40006b40 con 0x7fcf30003980 2023-12-08T08:20:49.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.713+0000 7fcf3affd640 1 -- 172.21.15.88:0/1722296938 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf400a87f0 con 0x7fcf30003980 2023-12-08T08:20:49.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.713+0000 7fcf4c294640 1 -- 172.21.15.88:0/1722296938 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf440aa130 con 0x7fcf30003980 2023-12-08T08:20:49.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.713+0000 7fcf4c294640 1 -- 172.21.15.88:0/1722296938 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf44154000 con 0x7fcf30003980 2023-12-08T08:20:49.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.713+0000 7fcf4c294640 1 -- 172.21.15.88:0/1722296938 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf44067630 con 0x7fcf30003980 2023-12-08T08:20:49.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.713+0000 7fcf3affd640 1 -- 172.21.15.88:0/1722296938 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcf400b7040 con 0x7fcf30003980 2023-12-08T08:20:49.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.717+0000 7fcf3affd640 1 --2- 172.21.15.88:0/1722296938 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcf280664a0 0x7fcf28068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:49.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.717+0000 7fcf3affd640 1 -- 172.21.15.88:0/1722296938 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf401210f0 con 0x7fcf30003980 2023-12-08T08:20:49.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.717+0000 7fcf4982f640 1 --2- 172.21.15.88:0/1722296938 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcf280664a0 0x7fcf28068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:49.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.717+0000 7fcf4982f640 1 --2- 172.21.15.88:0/1722296938 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcf280664a0 0x7fcf28068960 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcf34001bf0 tx=0x7fcf34001b00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:49.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.721+0000 7fcf3affd640 1 -- 172.21.15.88:0/1722296938 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcf400ee5f0 con 0x7fcf30003980 2023-12-08T08:20:49.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.881+0000 7fcf4c294640 1 -- 172.21.15.88:0/1722296938 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcf4406c6a0 con 0x7fcf30003980 2023-12-08T08:20:49.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.881+0000 7fcf3affd640 1 -- 172.21.15.88:0/1722296938 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcf400f1c10 con 0x7fcf30003980 2023-12-08T08:20:49.887 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-12-08T08:20:49.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.881+0000 7fcf4c294640 1 -- 172.21.15.88:0/1722296938 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcf280664a0 msgr2=0x7fcf28068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:49.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.881+0000 7fcf4c294640 1 --2- 172.21.15.88:0/1722296938 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcf280664a0 0x7fcf28068960 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcf34001bf0 tx=0x7fcf34001b00 comp rx=0 tx=0).stop 2023-12-08T08:20:49.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.881+0000 7fcf4c294640 1 -- 172.21.15.88:0/1722296938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf30003980 msgr2=0x7fcf440a8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:49.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.881+0000 7fcf4c294640 1 --2- 172.21.15.88:0/1722296938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf30003980 0x7fcf440a8e40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcf400b3040 tx=0x7fcf30005800 comp rx=0 tx=0).stop 2023-12-08T08:20:49.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.881+0000 7fcf4c294640 1 -- 172.21.15.88:0/1722296938 shutdown_connections 2023-12-08T08:20:49.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.881+0000 7fcf4c294640 1 --2- 172.21.15.88:0/1722296938 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcf280664a0 0x7fcf28068960 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.881+0000 7fcf4c294640 1 --2- 172.21.15.88:0/1722296938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf4414c440 0x7fcf44155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.881+0000 7fcf4c294640 1 --2- 172.21.15.88:0/1722296938 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf440a9760 0x7fcf4414bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.881+0000 7fcf4c294640 1 --2- 172.21.15.88:0/1722296938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf30003980 0x7fcf440a8e40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:49.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.885+0000 7fcf4c294640 1 -- 172.21.15.88:0/1722296938 >> 172.21.15.88:0/1722296938 conn(0x7fcf4406b220 msgr2=0x7fcf440a77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:49.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.885+0000 7fcf4c294640 1 -- 172.21.15.88:0/1722296938 shutdown_connections 2023-12-08T08:20:49.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:49.885+0000 7fcf4c294640 1 -- 172.21.15.88:0/1722296938 wait complete. 2023-12-08T08:20:49.908 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-08T08:20:49.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:49.908 DEBUG:teuthology.orchestra.run.smithi088:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-12-08T08:20:49.937 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2023-12-08T08:20:49.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:49.937 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-08T08:20:49.998 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:20:49.998 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:20:50.008 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:20:50.009 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:20:50.059 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:20:50.059 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:20:50.111 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:50.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.245+0000 7f9a3765a640 1 Processor -- start 2023-12-08T08:20:50.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.245+0000 7f9a3765a640 1 -- start start 2023-12-08T08:20:50.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.245+0000 7f9a3765a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9a30071e30 0x7f9a300722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.245+0000 7f9a3765a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9a30156110 0x7f9a30156580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.245+0000 7f9a3765a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a300c5710 con 0x7f9a3014fd10 2023-12-08T08:20:50.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.245+0000 7f9a3765a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a3006c5e0 con 0x7f9a30071e30 2023-12-08T08:20:50.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.245+0000 7f9a3765a640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a30155c80 con 0x7f9a30156110 2023-12-08T08:20:50.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.245+0000 7f9a34bf5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9a30071e30 0x7f9a300722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.245+0000 7f9a353f6640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9a3014fd10 0x7f9a300a4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40404/0 (socket says 172.21.15.88:40404) 2023-12-08T08:20:50.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.245+0000 7f9a353f6640 1 -- 172.21.15.88:0/48783834 learned_addr learned my addr 172.21.15.88:0/48783834 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:50.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.245+0000 7f9a35bf7640 1 --2- 172.21.15.88:0/48783834 >> v2:172.21.15.148:3300/0 conn(0x7f9a30156110 0x7f9a30156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.245+0000 7f9a34bf5640 1 -- 172.21.15.88:0/48783834 >> v2:172.21.15.148:3300/0 conn(0x7f9a30156110 msgr2=0x7f9a30156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:50.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.249+0000 7f9a34bf5640 1 --2- 172.21.15.88:0/48783834 >> v2:172.21.15.148:3300/0 conn(0x7f9a30156110 0x7f9a30156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.249+0000 7f9a34bf5640 1 -- 172.21.15.88:0/48783834 >> v1:172.21.15.88:6789/0 conn(0x7f9a3014fd10 legacy=0x7f9a300a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:50.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.249+0000 7f9a34bf5640 1 -- 172.21.15.88:0/48783834 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a300c4e70 con 0x7f9a30071e30 2023-12-08T08:20:50.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.249+0000 7f9a27fff640 1 -- 172.21.15.88:0/48783834 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 20502288 0 0) 0x7f9a300c5710 con 0x7f9a3014fd10 2023-12-08T08:20:50.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.249+0000 7f9a34bf5640 1 --2- 172.21.15.88:0/48783834 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a30071e30 0x7f9a300722c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9a300a86e0 tx=0x7f9a2001c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2a0bc2d42df4ec server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:50.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.249+0000 7f9a27fff640 1 -- 172.21.15.88:0/48783834 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a200ab600 con 0x7f9a30071e30 2023-12-08T08:20:50.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.249+0000 7f9a27fff640 1 -- 172.21.15.88:0/48783834 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a200a7050 con 0x7f9a30071e30 2023-12-08T08:20:50.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.249+0000 7f9a27fff640 1 -- 172.21.15.88:0/48783834 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a200ab980 con 0x7f9a30071e30 2023-12-08T08:20:50.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.249+0000 7f9a3765a640 1 -- 172.21.15.88:0/48783834 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a30071e30 msgr2=0x7f9a300722c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:50.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.249+0000 7f9a3765a640 1 --2- 172.21.15.88:0/48783834 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a30071e30 0x7f9a300722c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9a300a86e0 tx=0x7f9a2001c340 comp rx=0 tx=0).stop 2023-12-08T08:20:50.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.249+0000 7f9a3765a640 1 -- 172.21.15.88:0/48783834 shutdown_connections 2023-12-08T08:20:50.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.249+0000 7f9a3765a640 1 --2- 172.21.15.88:0/48783834 >> v2:172.21.15.148:3300/0 conn(0x7f9a30156110 0x7f9a30156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.249+0000 7f9a3765a640 1 --2- 172.21.15.88:0/48783834 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a30071e30 0x7f9a300722c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.249+0000 7f9a3765a640 1 -- 172.21.15.88:0/48783834 >> 172.21.15.88:0/48783834 conn(0x7f9a300a7810 msgr2=0x7f9a300a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:50.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.253+0000 7f9a3765a640 1 -- 172.21.15.88:0/48783834 shutdown_connections 2023-12-08T08:20:50.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.253+0000 7f9a3765a640 1 -- 172.21.15.88:0/48783834 wait complete. 2023-12-08T08:20:50.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.253+0000 7f9a3765a640 1 Processor -- start 2023-12-08T08:20:50.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.253+0000 7f9a3765a640 1 -- start start 2023-12-08T08:20:50.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.253+0000 7f9a3765a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a30071e30 0x7f9a300bee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.253+0000 7f9a3765a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a3014fd10 0x7f9a300aa550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.253+0000 7f9a3765a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a30156110 0x7f9a300aaa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.253+0000 7f9a3765a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a300a9490 con 0x7f9a30071e30 2023-12-08T08:20:50.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.253+0000 7f9a3765a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3014a1f0 con 0x7f9a30156110 2023-12-08T08:20:50.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.253+0000 7f9a3765a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a300aafd0 con 0x7f9a3014fd10 2023-12-08T08:20:50.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.253+0000 7f9a353f6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a30071e30 0x7f9a300bee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.253+0000 7f9a353f6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a30071e30 0x7f9a300bee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57154/0 (socket says 172.21.15.88:57154) 2023-12-08T08:20:50.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.253+0000 7f9a353f6640 1 -- 172.21.15.88:0/2257919715 learned_addr learned my addr 172.21.15.88:0/2257919715 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:50.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.253+0000 7f9a35bf7640 1 --2- 172.21.15.88:0/2257919715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a30156110 0x7f9a300aaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.253+0000 7f9a34bf5640 1 --2- 172.21.15.88:0/2257919715 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a3014fd10 0x7f9a300aa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.253+0000 7f9a353f6640 1 -- 172.21.15.88:0/2257919715 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a3014fd10 msgr2=0x7f9a300aa550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:50.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.253+0000 7f9a353f6640 1 --2- 172.21.15.88:0/2257919715 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a3014fd10 0x7f9a300aa550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.253+0000 7f9a353f6640 1 -- 172.21.15.88:0/2257919715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a30156110 msgr2=0x7f9a300aaa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:50.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.253+0000 7f9a353f6640 1 --2- 172.21.15.88:0/2257919715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a30156110 0x7f9a300aaa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.253+0000 7f9a353f6640 1 -- 172.21.15.88:0/2257919715 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a20009420 con 0x7f9a30071e30 2023-12-08T08:20:50.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.253+0000 7f9a34bf5640 1 --2- 172.21.15.88:0/2257919715 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a3014fd10 0x7f9a300aa550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:50.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.253+0000 7f9a353f6640 1 --2- 172.21.15.88:0/2257919715 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a30071e30 0x7f9a300bee90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c0011f0 tx=0x7f9a2c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:50.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.253+0000 7f9a25ffb640 1 -- 172.21.15.88:0/2257919715 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c0074e0 con 0x7f9a30071e30 2023-12-08T08:20:50.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.253+0000 7f9a25ffb640 1 -- 172.21.15.88:0/2257919715 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c007640 con 0x7f9a30071e30 2023-12-08T08:20:50.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.253+0000 7f9a3765a640 1 -- 172.21.15.88:0/2257919715 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a300ab480 con 0x7f9a30071e30 2023-12-08T08:20:50.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.253+0000 7f9a25ffb640 1 -- 172.21.15.88:0/2257919715 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c004a10 con 0x7f9a30071e30 2023-12-08T08:20:50.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.257+0000 7f9a3765a640 1 -- 172.21.15.88:0/2257919715 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a300a89a0 con 0x7f9a30071e30 2023-12-08T08:20:50.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.257+0000 7f9a3765a640 1 -- 172.21.15.88:0/2257919715 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a300679d0 con 0x7f9a30071e30 2023-12-08T08:20:50.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.257+0000 7f9a25ffb640 1 -- 172.21.15.88:0/2257919715 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9a2c004b70 con 0x7f9a30071e30 2023-12-08T08:20:50.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.257+0000 7f9a25ffb640 1 --2- 172.21.15.88:0/2257919715 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9a14066470 0x7f9a14068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.257+0000 7f9a25ffb640 1 -- 172.21.15.88:0/2257919715 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a2c0833e0 con 0x7f9a30071e30 2023-12-08T08:20:50.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.257+0000 7f9a34bf5640 1 --2- 172.21.15.88:0/2257919715 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9a14066470 0x7f9a14068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.257+0000 7f9a34bf5640 1 --2- 172.21.15.88:0/2257919715 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9a14066470 0x7f9a14068930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9a3006b5a0 tx=0x7f9a20008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:50.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.261+0000 7f9a25ffb640 1 -- 172.21.15.88:0/2257919715 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9a2c050850 con 0x7f9a30071e30 2023-12-08T08:20:50.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.413+0000 7f9a3765a640 1 -- 172.21.15.88:0/2257919715 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a300a54a0 con 0x7f9a30071e30 2023-12-08T08:20:50.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.417+0000 7f9a25ffb640 1 -- 172.21.15.88:0/2257919715 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7f9a2c053e70 con 0x7f9a30071e30 2023-12-08T08:20:50.422 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:50.422 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:20:21.492555+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:18.675917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:19.511013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:50.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.417+0000 7f9a3765a640 1 -- 172.21.15.88:0/2257919715 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9a14066470 msgr2=0x7f9a14068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:50.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.417+0000 7f9a3765a640 1 --2- 172.21.15.88:0/2257919715 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9a14066470 0x7f9a14068930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9a3006b5a0 tx=0x7f9a20008040 comp rx=0 tx=0).stop 2023-12-08T08:20:50.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.417+0000 7f9a3765a640 1 -- 172.21.15.88:0/2257919715 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a30071e30 msgr2=0x7f9a300bee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:50.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.417+0000 7f9a3765a640 1 --2- 172.21.15.88:0/2257919715 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a30071e30 0x7f9a300bee90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c0011f0 tx=0x7f9a2c00c9b0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.417+0000 7f9a3765a640 1 -- 172.21.15.88:0/2257919715 shutdown_connections 2023-12-08T08:20:50.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.417+0000 7f9a3765a640 1 --2- 172.21.15.88:0/2257919715 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9a14066470 0x7f9a14068930 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.417+0000 7f9a3765a640 1 --2- 172.21.15.88:0/2257919715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a30156110 0x7f9a300aaa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.417+0000 7f9a3765a640 1 --2- 172.21.15.88:0/2257919715 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9a3014fd10 0x7f9a300aa550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.417+0000 7f9a3765a640 1 --2- 172.21.15.88:0/2257919715 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a30071e30 0x7f9a300bee90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.417+0000 7f9a3765a640 1 -- 172.21.15.88:0/2257919715 >> 172.21.15.88:0/2257919715 conn(0x7f9a300a7810 msgr2=0x7f9a300a59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:50.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.417+0000 7f9a3765a640 1 -- 172.21.15.88:0/2257919715 shutdown_connections 2023-12-08T08:20:50.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.417+0000 7f9a3765a640 1 -- 172.21.15.88:0/2257919715 wait complete. 2023-12-08T08:20:50.443 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:20:18.675917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:20:19.511013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:20:50.443 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:20:50.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.581+0000 7fbbea294640 1 Processor -- start 2023-12-08T08:20:50.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.581+0000 7fbbea294640 1 -- start start 2023-12-08T08:20:50.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.581+0000 7fbbea294640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbbe414b1e0 0x7fbbe40c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.581+0000 7fbbea294640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe40a4e20 con 0x7fbbe40c5300 2023-12-08T08:20:50.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.581+0000 7fbbea294640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe40a50e0 con 0x7fbbe41548c0 2023-12-08T08:20:50.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.581+0000 7fbbea294640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe40c0f00 con 0x7fbbe414b1e0 2023-12-08T08:20:50.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.581+0000 7fbbe3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbbe414b1e0 0x7fbbe40c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.581+0000 7fbbe37fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbbe40c5300 0x7fbbe40a9c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40408/0 (socket says 172.21.15.88:40408) 2023-12-08T08:20:50.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.581+0000 7fbbe37fe640 1 -- 172.21.15.88:0/1248338943 learned_addr learned my addr 172.21.15.88:0/1248338943 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:50.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.581+0000 7fbbe3fff640 1 --2- 172.21.15.88:0/1248338943 >> v2:172.21.15.88:3300/0 conn(0x7fbbe414b1e0 0x7fbbe40c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57166/0 (socket says 172.21.15.88:57166) 2023-12-08T08:20:50.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.581+0000 7fbbe3fff640 1 -- 172.21.15.88:0/1248338943 >> v1:172.21.15.148:6789/0 conn(0x7fbbe41548c0 legacy=0x7fbbe4154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:50.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.581+0000 7fbbe2ffd640 1 -- 172.21.15.88:0/1248338943 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1788858267 0 0) 0x7fbbe40a4e20 con 0x7fbbe40c5300 2023-12-08T08:20:50.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.581+0000 7fbbe3fff640 1 -- 172.21.15.88:0/1248338943 >> v1:172.21.15.88:6789/0 conn(0x7fbbe40c5300 legacy=0x7fbbe40a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:50.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.581+0000 7fbbe3fff640 1 -- 172.21.15.88:0/1248338943 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe40c11e0 con 0x7fbbe414b1e0 2023-12-08T08:20:50.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.585+0000 7fbbe3fff640 1 --2- 172.21.15.88:0/1248338943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbe414b1e0 0x7fbbe40c1700 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbbd40097c0 tx=0x7fbbd401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5594954845589ed7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:50.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.585+0000 7fbbe2ffd640 1 -- 172.21.15.88:0/1248338943 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd40ab600 con 0x7fbbe414b1e0 2023-12-08T08:20:50.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.585+0000 7fbbe2ffd640 1 -- 172.21.15.88:0/1248338943 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd40a7050 con 0x7fbbe414b1e0 2023-12-08T08:20:50.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.585+0000 7fbbe2ffd640 1 -- 172.21.15.88:0/1248338943 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd40ab980 con 0x7fbbe414b1e0 2023-12-08T08:20:50.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.585+0000 7fbbea294640 1 -- 172.21.15.88:0/1248338943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbe414b1e0 msgr2=0x7fbbe40c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:50.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.585+0000 7fbbea294640 1 --2- 172.21.15.88:0/1248338943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbe414b1e0 0x7fbbe40c1700 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbbd40097c0 tx=0x7fbbd401c440 comp rx=0 tx=0).stop 2023-12-08T08:20:50.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.585+0000 7fbbea294640 1 -- 172.21.15.88:0/1248338943 shutdown_connections 2023-12-08T08:20:50.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.585+0000 7fbbea294640 1 --2- 172.21.15.88:0/1248338943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbe414b1e0 0x7fbbe40c1700 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.585+0000 7fbbea294640 1 -- 172.21.15.88:0/1248338943 >> 172.21.15.88:0/1248338943 conn(0x7fbbe40c59f0 msgr2=0x7fbbe40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:50.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.585+0000 7fbbea294640 1 -- 172.21.15.88:0/1248338943 shutdown_connections 2023-12-08T08:20:50.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.585+0000 7fbbea294640 1 -- 172.21.15.88:0/1248338943 wait complete. 2023-12-08T08:20:50.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.589+0000 7fbbea294640 1 Processor -- start 2023-12-08T08:20:50.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.589+0000 7fbbea294640 1 -- start start 2023-12-08T08:20:50.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.589+0000 7fbbea294640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbe40c5300 0x7fbbe40a6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.589+0000 7fbbea294640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbbe414b1e0 0x7fbbe40bf420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.589+0000 7fbbea294640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbbe41548c0 0x7fbbe406b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.589+0000 7fbbea294640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe40a6600 con 0x7fbbe40c5300 2023-12-08T08:20:50.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.589+0000 7fbbea294640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe41f0aa0 con 0x7fbbe414b1e0 2023-12-08T08:20:50.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.589+0000 7fbbea294640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe41f07c0 con 0x7fbbe41548c0 2023-12-08T08:20:50.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.589+0000 7fbbe3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbe40c5300 0x7fbbe40a6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.589+0000 7fbbe3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbe40c5300 0x7fbbe40a6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57178/0 (socket says 172.21.15.88:57178) 2023-12-08T08:20:50.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.589+0000 7fbbe3fff640 1 -- 172.21.15.88:0/2974142543 learned_addr learned my addr 172.21.15.88:0/2974142543 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:50.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.589+0000 7fbbe37fe640 1 --2- 172.21.15.88:0/2974142543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbbe414b1e0 0x7fbbe40bf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.589+0000 7fbbe8831640 1 --2- 172.21.15.88:0/2974142543 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbbe41548c0 0x7fbbe406b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.589+0000 7fbbe3fff640 1 -- 172.21.15.88:0/2974142543 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbbe41548c0 msgr2=0x7fbbe406b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:50.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.589+0000 7fbbe3fff640 1 --2- 172.21.15.88:0/2974142543 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbbe41548c0 0x7fbbe406b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.589+0000 7fbbe3fff640 1 -- 172.21.15.88:0/2974142543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbbe414b1e0 msgr2=0x7fbbe40bf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:50.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.589+0000 7fbbe3fff640 1 --2- 172.21.15.88:0/2974142543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbbe414b1e0 0x7fbbe40bf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.589+0000 7fbbe3fff640 1 -- 172.21.15.88:0/2974142543 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd4009420 con 0x7fbbe40c5300 2023-12-08T08:20:50.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.589+0000 7fbbe3fff640 1 --2- 172.21.15.88:0/2974142543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbe40c5300 0x7fbbe40a6a20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbbd401a070 tx=0x7fbbd401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:50.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.589+0000 7fbbe0ff9640 1 -- 172.21.15.88:0/2974142543 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4004230 con 0x7fbbe40c5300 2023-12-08T08:20:50.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.589+0000 7fbbe0ff9640 1 -- 172.21.15.88:0/2974142543 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd4004390 con 0x7fbbe40c5300 2023-12-08T08:20:50.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.589+0000 7fbbea294640 1 -- 172.21.15.88:0/2974142543 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe40a5c60 con 0x7fbbe40c5300 2023-12-08T08:20:50.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.589+0000 7fbbe0ff9640 1 -- 172.21.15.88:0/2974142543 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4003820 con 0x7fbbe40c5300 2023-12-08T08:20:50.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.589+0000 7fbbea294640 1 -- 172.21.15.88:0/2974142543 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe40a6220 con 0x7fbbe40c5300 2023-12-08T08:20:50.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.589+0000 7fbbea294640 1 -- 172.21.15.88:0/2974142543 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe4067630 con 0x7fbbe40c5300 2023-12-08T08:20:50.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.593+0000 7fbbe0ff9640 1 -- 172.21.15.88:0/2974142543 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbbd4003980 con 0x7fbbe40c5300 2023-12-08T08:20:50.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.593+0000 7fbbe0ff9640 1 --2- 172.21.15.88:0/2974142543 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbbd0066470 0x7fbbd0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.593+0000 7fbbe0ff9640 1 -- 172.21.15.88:0/2974142543 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbd411ec10 con 0x7fbbe40c5300 2023-12-08T08:20:50.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.593+0000 7fbbe37fe640 1 --2- 172.21.15.88:0/2974142543 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbbd0066470 0x7fbbd0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.593+0000 7fbbe37fe640 1 --2- 172.21.15.88:0/2974142543 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbbd0066470 0x7fbbd0068930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40bfdd0 tx=0x7fbbd8007b60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:50.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.597+0000 7fbbe0ff9640 1 -- 172.21.15.88:0/2974142543 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbbd40ec180 con 0x7fbbe40c5300 2023-12-08T08:20:50.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.749+0000 7fbbea294640 1 -- 172.21.15.88:0/2974142543 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbbe40a6870 con 0x7fbbe40c5300 2023-12-08T08:20:50.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.749+0000 7fbbe0ff9640 1 -- 172.21.15.88:0/2974142543 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbbd40c4020 con 0x7fbbe40c5300 2023-12-08T08:20:50.754 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:20:50.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.749+0000 7fbbea294640 1 -- 172.21.15.88:0/2974142543 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbbd0066470 msgr2=0x7fbbd0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:50.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.749+0000 7fbbea294640 1 --2- 172.21.15.88:0/2974142543 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbbd0066470 0x7fbbd0068930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40bfdd0 tx=0x7fbbd8007b60 comp rx=0 tx=0).stop 2023-12-08T08:20:50.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.749+0000 7fbbea294640 1 -- 172.21.15.88:0/2974142543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbe40c5300 msgr2=0x7fbbe40a6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:50.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.749+0000 7fbbea294640 1 --2- 172.21.15.88:0/2974142543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbe40c5300 0x7fbbe40a6a20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbbd401a070 tx=0x7fbbd401ac80 comp rx=0 tx=0).stop 2023-12-08T08:20:50.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.749+0000 7fbbea294640 1 -- 172.21.15.88:0/2974142543 shutdown_connections 2023-12-08T08:20:50.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.749+0000 7fbbea294640 1 --2- 172.21.15.88:0/2974142543 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbbd0066470 0x7fbbd0068930 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.749+0000 7fbbea294640 1 --2- 172.21.15.88:0/2974142543 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbbe41548c0 0x7fbbe406b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.749+0000 7fbbea294640 1 --2- 172.21.15.88:0/2974142543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbbe414b1e0 0x7fbbe40bf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.749+0000 7fbbea294640 1 --2- 172.21.15.88:0/2974142543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbe40c5300 0x7fbbe40a6a20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.749+0000 7fbbea294640 1 -- 172.21.15.88:0/2974142543 >> 172.21.15.88:0/2974142543 conn(0x7fbbe40c59f0 msgr2=0x7fbbe41495b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:50.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.749+0000 7fbbea294640 1 -- 172.21.15.88:0/2974142543 shutdown_connections 2023-12-08T08:20:50.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.749+0000 7fbbea294640 1 -- 172.21.15.88:0/2974142543 wait complete. 2023-12-08T08:20:50.775 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:20:50.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.909+0000 7fb1cf92a640 1 Processor -- start 2023-12-08T08:20:50.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.909+0000 7fb1cf92a640 1 -- start start 2023-12-08T08:20:50.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.909+0000 7fb1cf92a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb1c814f850 0x7fb1c80aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.909+0000 7fb1cf92a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb1c814fc30 0x7fb1c80c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.909+0000 7fb1cf92a640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c8152910 con 0x7fb1c806d840 2023-12-08T08:20:50.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.909+0000 7fb1cf92a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c80c2240 con 0x7fb1c814fc30 2023-12-08T08:20:50.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.909+0000 7fb1cf92a640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c8152bf0 con 0x7fb1c814f850 2023-12-08T08:20:50.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.909+0000 7fb1ccec5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb1c814fc30 0x7fb1c80c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.909+0000 7fb1ccec5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb1c814fc30 0x7fb1c80c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57190/0 (socket says 172.21.15.88:57190) 2023-12-08T08:20:50.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.909+0000 7fb1ccec5640 1 -- 172.21.15.88:0/878819620 learned_addr learned my addr 172.21.15.88:0/878819620 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:50.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.909+0000 7fb1cd6c6640 1 --2- 172.21.15.88:0/878819620 >> v2:172.21.15.148:3300/0 conn(0x7fb1c814f850 0x7fb1c80aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.913+0000 7fb1ccec5640 1 -- 172.21.15.88:0/878819620 >> v2:172.21.15.148:3300/0 conn(0x7fb1c814f850 msgr2=0x7fb1c80aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:50.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.913+0000 7fb1ccec5640 1 --2- 172.21.15.88:0/878819620 >> v2:172.21.15.148:3300/0 conn(0x7fb1c814f850 0x7fb1c80aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.913+0000 7fb1ccec5640 1 -- 172.21.15.88:0/878819620 >> v1:172.21.15.148:6789/0 conn(0x7fb1c806d840 legacy=0x7fb1c80c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:50.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.913+0000 7fb1ccec5640 1 -- 172.21.15.88:0/878819620 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c8152ed0 con 0x7fb1c814fc30 2023-12-08T08:20:50.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.913+0000 7fb1ccec5640 1 --2- 172.21.15.88:0/878819620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1c814fc30 0x7fb1c80c3cd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8066f50 tx=0x7fb1b801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39cd6ec655125778 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:50.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.913+0000 7fb1bffff640 1 -- 172.21.15.88:0/878819620 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b80aa680 con 0x7fb1c814fc30 2023-12-08T08:20:50.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.913+0000 7fb1bffff640 1 -- 172.21.15.88:0/878819620 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b80aa7e0 con 0x7fb1c814fc30 2023-12-08T08:20:50.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.913+0000 7fb1bffff640 1 -- 172.21.15.88:0/878819620 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b80aab70 con 0x7fb1c814fc30 2023-12-08T08:20:50.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.913+0000 7fb1cf92a640 1 -- 172.21.15.88:0/878819620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1c814fc30 msgr2=0x7fb1c80c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:50.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.913+0000 7fb1cf92a640 1 --2- 172.21.15.88:0/878819620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1c814fc30 0x7fb1c80c3cd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8066f50 tx=0x7fb1b801c500 comp rx=0 tx=0).stop 2023-12-08T08:20:50.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.913+0000 7fb1cf92a640 1 -- 172.21.15.88:0/878819620 shutdown_connections 2023-12-08T08:20:50.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.913+0000 7fb1cf92a640 1 --2- 172.21.15.88:0/878819620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1c814fc30 0x7fb1c80c3cd0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.913+0000 7fb1cf92a640 1 --2- 172.21.15.88:0/878819620 >> v2:172.21.15.148:3300/0 conn(0x7fb1c814f850 0x7fb1c80aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.917+0000 7fb1cf92a640 1 -- 172.21.15.88:0/878819620 >> 172.21.15.88:0/878819620 conn(0x7fb1c80c59f0 msgr2=0x7fb1c80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:50.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.917+0000 7fb1cf92a640 1 -- 172.21.15.88:0/878819620 shutdown_connections 2023-12-08T08:20:50.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.917+0000 7fb1cf92a640 1 -- 172.21.15.88:0/878819620 wait complete. 2023-12-08T08:20:50.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.917+0000 7fb1cf92a640 1 Processor -- start 2023-12-08T08:20:50.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.917+0000 7fb1cf92a640 1 -- start start 2023-12-08T08:20:50.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.917+0000 7fb1cf92a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1c806d840 0x7fb1c8155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.917+0000 7fb1cf92a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1c814f850 0x7fb1c815aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.917+0000 7fb1cf92a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1c814fc30 0x7fb1c815af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.917+0000 7fb1cf92a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c80a5850 con 0x7fb1c806d840 2023-12-08T08:20:50.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.917+0000 7fb1cf92a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c815b4d0 con 0x7fb1c814f850 2023-12-08T08:20:50.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.917+0000 7fb1cf92a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c81eeb40 con 0x7fb1c814fc30 2023-12-08T08:20:50.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.917+0000 7fb1cd6c6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1c806d840 0x7fb1c8155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.917+0000 7fb1cd6c6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1c806d840 0x7fb1c8155cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57196/0 (socket says 172.21.15.88:57196) 2023-12-08T08:20:50.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.917+0000 7fb1cd6c6640 1 -- 172.21.15.88:0/1690792977 learned_addr learned my addr 172.21.15.88:0/1690792977 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:50.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.917+0000 7fb1ccec5640 1 --2- 172.21.15.88:0/1690792977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1c814f850 0x7fb1c815aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.917+0000 7fb1cdec7640 1 --2- 172.21.15.88:0/1690792977 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1c814fc30 0x7fb1c815af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.917+0000 7fb1cd6c6640 1 -- 172.21.15.88:0/1690792977 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1c814fc30 msgr2=0x7fb1c815af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:50.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.917+0000 7fb1cd6c6640 1 --2- 172.21.15.88:0/1690792977 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1c814fc30 0x7fb1c815af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.917+0000 7fb1cd6c6640 1 -- 172.21.15.88:0/1690792977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1c814f850 msgr2=0x7fb1c815aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:50.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.917+0000 7fb1cd6c6640 1 --2- 172.21.15.88:0/1690792977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1c814f850 0x7fb1c815aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.917+0000 7fb1cd6c6640 1 -- 172.21.15.88:0/1690792977 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b80094d0 con 0x7fb1c806d840 2023-12-08T08:20:50.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.917+0000 7fb1cdec7640 1 --2- 172.21.15.88:0/1690792977 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1c814fc30 0x7fb1c815af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:50.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.917+0000 7fb1cd6c6640 1 --2- 172.21.15.88:0/1690792977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1c806d840 0x7fb1c8155cc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb1c400d800 tx=0x7fb1c400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:50.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.917+0000 7fb1bdffb640 1 -- 172.21.15.88:0/1690792977 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c400b6c0 con 0x7fb1c806d840 2023-12-08T08:20:50.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.917+0000 7fb1bdffb640 1 -- 172.21.15.88:0/1690792977 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c400b820 con 0x7fb1c806d840 2023-12-08T08:20:50.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.917+0000 7fb1cf92a640 1 -- 172.21.15.88:0/1690792977 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c81eee20 con 0x7fb1c806d840 2023-12-08T08:20:50.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.917+0000 7fb1bdffb640 1 -- 172.21.15.88:0/1690792977 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c400bb90 con 0x7fb1c806d840 2023-12-08T08:20:50.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.921+0000 7fb1cf92a640 1 -- 172.21.15.88:0/1690792977 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c81ef3e0 con 0x7fb1c806d840 2023-12-08T08:20:50.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.921+0000 7fb1cf92a640 1 -- 172.21.15.88:0/1690792977 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c81ec840 con 0x7fb1c806d840 2023-12-08T08:20:50.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.921+0000 7fb1bdffb640 1 -- 172.21.15.88:0/1690792977 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb1c400bcf0 con 0x7fb1c806d840 2023-12-08T08:20:50.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.921+0000 7fb1bdffb640 1 --2- 172.21.15.88:0/1690792977 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb1ac0664a0 0x7fb1ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.921+0000 7fb1bdffb640 1 -- 172.21.15.88:0/1690792977 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1c4084270 con 0x7fb1c806d840 2023-12-08T08:20:50.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.921+0000 7fb1ccec5640 1 --2- 172.21.15.88:0/1690792977 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb1ac0664a0 0x7fb1ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.921+0000 7fb1ccec5640 1 --2- 172.21.15.88:0/1690792977 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb1ac0664a0 0x7fb1ac068960 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80ae000 tx=0x7fb1b80b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:50.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:50.925+0000 7fb1bdffb640 1 -- 172.21.15.88:0/1690792977 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb1c4051780 con 0x7fb1c806d840 2023-12-08T08:20:51.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.073+0000 7fb1cf92a640 1 -- 172.21.15.88:0/1690792977 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb1c8067630 con 0x7fb1c806d840 2023-12-08T08:20:51.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.073+0000 7fb1bdffb640 1 -- 172.21.15.88:0/1690792977 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb1c4054da0 con 0x7fb1c806d840 2023-12-08T08:20:51.082 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:20:51.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.077+0000 7fb1cf92a640 1 -- 172.21.15.88:0/1690792977 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb1ac0664a0 msgr2=0x7fb1ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.077+0000 7fb1cf92a640 1 --2- 172.21.15.88:0/1690792977 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb1ac0664a0 0x7fb1ac068960 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80ae000 tx=0x7fb1b80b5040 comp rx=0 tx=0).stop 2023-12-08T08:20:51.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.077+0000 7fb1cf92a640 1 -- 172.21.15.88:0/1690792977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1c806d840 msgr2=0x7fb1c8155cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.077+0000 7fb1cf92a640 1 --2- 172.21.15.88:0/1690792977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1c806d840 0x7fb1c8155cc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb1c400d800 tx=0x7fb1c400dcc0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.077+0000 7fb1cf92a640 1 -- 172.21.15.88:0/1690792977 shutdown_connections 2023-12-08T08:20:51.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.077+0000 7fb1cf92a640 1 --2- 172.21.15.88:0/1690792977 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb1ac0664a0 0x7fb1ac068960 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.077+0000 7fb1cf92a640 1 --2- 172.21.15.88:0/1690792977 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1c814fc30 0x7fb1c815af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.077+0000 7fb1cf92a640 1 --2- 172.21.15.88:0/1690792977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1c814f850 0x7fb1c815aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.077+0000 7fb1cf92a640 1 --2- 172.21.15.88:0/1690792977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1c806d840 0x7fb1c8155cc0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.077+0000 7fb1cf92a640 1 -- 172.21.15.88:0/1690792977 >> 172.21.15.88:0/1690792977 conn(0x7fb1c80c59f0 msgr2=0x7fb1c814eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:51.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.077+0000 7fb1cf92a640 1 -- 172.21.15.88:0/1690792977 shutdown_connections 2023-12-08T08:20:51.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.077+0000 7fb1cf92a640 1 -- 172.21.15.88:0/1690792977 wait complete. 2023-12-08T08:20:51.102 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:20:51.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.237+0000 7fb4405c1640 1 Processor -- start 2023-12-08T08:20:51.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.237+0000 7fb4405c1640 1 -- start start 2023-12-08T08:20:51.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.237+0000 7fb4405c1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb438151a20 0x7fb438157a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.237+0000 7fb4405c1640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4381547f0 con 0x7fb43806b5c0 2023-12-08T08:20:51.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.237+0000 7fb4405c1640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4381544a0 con 0x7fb43806e890 2023-12-08T08:20:51.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.237+0000 7fb4405c1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4380c2720 con 0x7fb438151a20 2023-12-08T08:20:51.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.237+0000 7fb43eb5e640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb43806b5c0 0x7fb43815ee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40418/0 (socket says 172.21.15.88:40418) 2023-12-08T08:20:51.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.237+0000 7fb43eb5e640 1 -- 172.21.15.88:0/580116298 learned_addr learned my addr 172.21.15.88:0/580116298 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:51.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.237+0000 7fb43e35d640 1 --2- 172.21.15.88:0/580116298 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb438151a20 0x7fb438157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.237+0000 7fb43d35b640 1 -- 172.21.15.88:0/580116298 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 15970248 0 0) 0x7fb4381547f0 con 0x7fb43806b5c0 2023-12-08T08:20:51.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.237+0000 7fb43d35b640 1 -- 172.21.15.88:0/580116298 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb424003530 con 0x7fb43806b5c0 2023-12-08T08:20:51.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.237+0000 7fb43d35b640 1 -- 172.21.15.88:0/580116298 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830237300 0 0) 0x7fb4381544a0 con 0x7fb43806e890 2023-12-08T08:20:51.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.237+0000 7fb43d35b640 1 -- 172.21.15.88:0/580116298 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4381547f0 con 0x7fb43806e890 2023-12-08T08:20:51.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.237+0000 7fb43e35d640 1 -- 172.21.15.88:0/580116298 >> v1:172.21.15.148:6789/0 conn(0x7fb43806e890 legacy=0x7fb438154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.237+0000 7fb43e35d640 1 -- 172.21.15.88:0/580116298 >> v1:172.21.15.88:6789/0 conn(0x7fb43806b5c0 legacy=0x7fb43815ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.237+0000 7fb43e35d640 1 -- 172.21.15.88:0/580116298 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb438155390 con 0x7fb438151a20 2023-12-08T08:20:51.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.241+0000 7fb43e35d640 1 --2- 172.21.15.88:0/580116298 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb438151a20 0x7fb438157a90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb4340097f0 tx=0x7fb43401c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6a95fb7d8f349af server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:51.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.241+0000 7fb43d35b640 1 -- 172.21.15.88:0/580116298 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4340ab600 con 0x7fb438151a20 2023-12-08T08:20:51.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.241+0000 7fb43d35b640 1 -- 172.21.15.88:0/580116298 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4340a7050 con 0x7fb438151a20 2023-12-08T08:20:51.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.241+0000 7fb43d35b640 1 -- 172.21.15.88:0/580116298 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4340ab980 con 0x7fb438151a20 2023-12-08T08:20:51.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.241+0000 7fb4405c1640 1 -- 172.21.15.88:0/580116298 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb438151a20 msgr2=0x7fb438157a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.241+0000 7fb4405c1640 1 --2- 172.21.15.88:0/580116298 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb438151a20 0x7fb438157a90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb4340097f0 tx=0x7fb43401c370 comp rx=0 tx=0).stop 2023-12-08T08:20:51.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.241+0000 7fb4405c1640 1 -- 172.21.15.88:0/580116298 shutdown_connections 2023-12-08T08:20:51.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.241+0000 7fb4405c1640 1 --2- 172.21.15.88:0/580116298 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb438151a20 0x7fb438157a90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.241+0000 7fb4405c1640 1 -- 172.21.15.88:0/580116298 >> 172.21.15.88:0/580116298 conn(0x7fb4380c2e20 msgr2=0x7fb4380c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:51.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.241+0000 7fb4405c1640 1 -- 172.21.15.88:0/580116298 shutdown_connections 2023-12-08T08:20:51.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.241+0000 7fb4405c1640 1 -- 172.21.15.88:0/580116298 wait complete. 2023-12-08T08:20:51.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.245+0000 7fb4405c1640 1 Processor -- start 2023-12-08T08:20:51.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.245+0000 7fb4405c1640 1 -- start start 2023-12-08T08:20:51.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.245+0000 7fb4405c1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb43806b5c0 0x7fb438157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.245+0000 7fb4405c1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb43806e890 0x7fb438155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.245+0000 7fb4405c1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb438151a20 0x7fb4381582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.245+0000 7fb4405c1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb438151650 con 0x7fb43806b5c0 2023-12-08T08:20:51.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.245+0000 7fb4405c1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4381ed2b0 con 0x7fb438151a20 2023-12-08T08:20:51.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.245+0000 7fb4405c1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4381f12c0 con 0x7fb43806e890 2023-12-08T08:20:51.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.245+0000 7fb43e35d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb43806b5c0 0x7fb438157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.245+0000 7fb43e35d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb43806b5c0 0x7fb438157610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57210/0 (socket says 172.21.15.88:57210) 2023-12-08T08:20:51.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.245+0000 7fb43e35d640 1 -- 172.21.15.88:0/1513603796 learned_addr learned my addr 172.21.15.88:0/1513603796 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:51.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.245+0000 7fb43db5c640 1 --2- 172.21.15.88:0/1513603796 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb43806e890 0x7fb438155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.245+0000 7fb43eb5e640 1 --2- 172.21.15.88:0/1513603796 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb438151a20 0x7fb4381582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.245+0000 7fb43e35d640 1 -- 172.21.15.88:0/1513603796 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb43806e890 msgr2=0x7fb438155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.245+0000 7fb43e35d640 1 --2- 172.21.15.88:0/1513603796 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb43806e890 0x7fb438155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.245+0000 7fb43e35d640 1 -- 172.21.15.88:0/1513603796 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb438151a20 msgr2=0x7fb4381582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.245+0000 7fb43e35d640 1 --2- 172.21.15.88:0/1513603796 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb438151a20 0x7fb4381582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.245+0000 7fb43e35d640 1 -- 172.21.15.88:0/1513603796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb434009420 con 0x7fb43806b5c0 2023-12-08T08:20:51.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.245+0000 7fb43db5c640 1 --2- 172.21.15.88:0/1513603796 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb43806e890 0x7fb438155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:51.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.245+0000 7fb43e35d640 1 --2- 172.21.15.88:0/1513603796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb43806b5c0 0x7fb438157610 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb434018f80 tx=0x7fb43401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:51.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.245+0000 7fb42effd640 1 -- 172.21.15.88:0/1513603796 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4340b7450 con 0x7fb43806b5c0 2023-12-08T08:20:51.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.245+0000 7fb42effd640 1 -- 172.21.15.88:0/1513603796 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4340b75d0 con 0x7fb43806b5c0 2023-12-08T08:20:51.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.245+0000 7fb42effd640 1 -- 172.21.15.88:0/1513603796 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4340b7980 con 0x7fb43806b5c0 2023-12-08T08:20:51.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.245+0000 7fb4405c1640 1 -- 172.21.15.88:0/1513603796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4381ed550 con 0x7fb43806b5c0 2023-12-08T08:20:51.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.245+0000 7fb4405c1640 1 -- 172.21.15.88:0/1513603796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb438158820 con 0x7fb43806b5c0 2023-12-08T08:20:51.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.249+0000 7fb4405c1640 1 -- 172.21.15.88:0/1513603796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb438066660 con 0x7fb43806b5c0 2023-12-08T08:20:51.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.249+0000 7fb42effd640 1 -- 172.21.15.88:0/1513603796 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb4340b7ae0 con 0x7fb43806b5c0 2023-12-08T08:20:51.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.249+0000 7fb42effd640 1 --2- 172.21.15.88:0/1513603796 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb41c066470 0x7fb41c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.249+0000 7fb42effd640 1 -- 172.21.15.88:0/1513603796 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb43411e710 con 0x7fb43806b5c0 2023-12-08T08:20:51.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.249+0000 7fb43db5c640 1 --2- 172.21.15.88:0/1513603796 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb41c066470 0x7fb41c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.249+0000 7fb43db5c640 1 --2- 172.21.15.88:0/1513603796 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb41c066470 0x7fb41c068930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb438153300 tx=0x7fb428009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:51.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.253+0000 7fb42effd640 1 -- 172.21.15.88:0/1513603796 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb4340ebc20 con 0x7fb43806b5c0 2023-12-08T08:20:51.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.401+0000 7fb4405c1640 1 -- 172.21.15.88:0/1513603796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb438067630 con 0x7fb43806b5c0 2023-12-08T08:20:51.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.401+0000 7fb42effd640 1 -- 172.21.15.88:0/1513603796 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb4340ef240 con 0x7fb43806b5c0 2023-12-08T08:20:51.408 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:20:51.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.405+0000 7fb4405c1640 1 -- 172.21.15.88:0/1513603796 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb41c066470 msgr2=0x7fb41c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.405+0000 7fb4405c1640 1 --2- 172.21.15.88:0/1513603796 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb41c066470 0x7fb41c068930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb438153300 tx=0x7fb428009040 comp rx=0 tx=0).stop 2023-12-08T08:20:51.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.405+0000 7fb4405c1640 1 -- 172.21.15.88:0/1513603796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb43806b5c0 msgr2=0x7fb438157610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.405+0000 7fb4405c1640 1 --2- 172.21.15.88:0/1513603796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb43806b5c0 0x7fb438157610 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb434018f80 tx=0x7fb43401abb0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.405+0000 7fb4405c1640 1 -- 172.21.15.88:0/1513603796 shutdown_connections 2023-12-08T08:20:51.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.405+0000 7fb4405c1640 1 --2- 172.21.15.88:0/1513603796 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb41c066470 0x7fb41c068930 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.405+0000 7fb4405c1640 1 --2- 172.21.15.88:0/1513603796 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb438151a20 0x7fb4381582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.405+0000 7fb4405c1640 1 --2- 172.21.15.88:0/1513603796 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb43806e890 0x7fb438155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.405+0000 7fb4405c1640 1 --2- 172.21.15.88:0/1513603796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb43806b5c0 0x7fb438157610 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.405+0000 7fb4405c1640 1 -- 172.21.15.88:0/1513603796 >> 172.21.15.88:0/1513603796 conn(0x7fb4380c2e20 msgr2=0x7fb4380c3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:51.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.405+0000 7fb4405c1640 1 -- 172.21.15.88:0/1513603796 shutdown_connections 2023-12-08T08:20:51.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.405+0000 7fb4405c1640 1 -- 172.21.15.88:0/1513603796 wait complete. 2023-12-08T08:20:51.429 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:20:51.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.561+0000 7f91d2809640 1 Processor -- start 2023-12-08T08:20:51.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.561+0000 7f91d2809640 1 -- start start 2023-12-08T08:20:51.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.565+0000 7f91d2809640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f91cc0c47b0 0x7f91cc0c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.565+0000 7f91d2809640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91cc155950 0x7f91cc1582f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.565+0000 7f91d2809640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91cc0c6840 con 0x7f91cc0bd550 2023-12-08T08:20:51.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.565+0000 7f91d2809640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91cc155da0 con 0x7f91cc0c47b0 2023-12-08T08:20:51.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.565+0000 7f91d2809640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc0af870 con 0x7f91cc155950 2023-12-08T08:20:51.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.565+0000 7f91cb7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f91cc0bd550 0x7f91cc154ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40432/0 (socket says 172.21.15.88:40432) 2023-12-08T08:20:51.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.565+0000 7f91cb7fe640 1 -- 172.21.15.88:0/1415633385 learned_addr learned my addr 172.21.15.88:0/1415633385 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:51.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.565+0000 7f91d0da6640 1 --2- 172.21.15.88:0/1415633385 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91cc155950 0x7f91cc1582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.565+0000 7f91cbfff640 1 --2- 172.21.15.88:0/1415633385 >> v2:172.21.15.148:3300/0 conn(0x7f91cc0c47b0 0x7f91cc0c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.565+0000 7f91caffd640 1 -- 172.21.15.88:0/1415633385 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300175246 0 0) 0x7f91cc0c6840 con 0x7f91cc0bd550 2023-12-08T08:20:51.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.565+0000 7f91caffd640 1 -- 172.21.15.88:0/1415633385 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91b4003530 con 0x7f91cc0bd550 2023-12-08T08:20:51.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.565+0000 7f91d0da6640 1 -- 172.21.15.88:0/1415633385 >> v2:172.21.15.148:3300/0 conn(0x7f91cc0c47b0 msgr2=0x7f91cc0c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:51.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.565+0000 7f91d0da6640 1 --2- 172.21.15.88:0/1415633385 >> v2:172.21.15.148:3300/0 conn(0x7f91cc0c47b0 0x7f91cc0c4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.565+0000 7f91d0da6640 1 -- 172.21.15.88:0/1415633385 >> v1:172.21.15.88:6789/0 conn(0x7f91cc0bd550 legacy=0x7f91cc154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.565+0000 7f91caffd640 1 -- 172.21.15.88:0/1415633385 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2229524032 0 0) 0x7f91b4003530 con 0x7f91cc0bd550 2023-12-08T08:20:51.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.565+0000 7f91d0da6640 1 -- 172.21.15.88:0/1415633385 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91cc0c6a70 con 0x7f91cc155950 2023-12-08T08:20:51.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.569+0000 7f91d0da6640 1 --2- 172.21.15.88:0/1415633385 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91cc155950 0x7f91cc1582f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f91c4009d90 tx=0x7f91c401c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7dc8f76c32ecb4f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:51.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.569+0000 7f91caffd640 1 -- 172.21.15.88:0/1415633385 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c0001680 con 0x7f91cc155950 2023-12-08T08:20:51.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.569+0000 7f91caffd640 1 -- 172.21.15.88:0/1415633385 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c40a64e0 con 0x7f91cc155950 2023-12-08T08:20:51.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.569+0000 7f91caffd640 1 -- 172.21.15.88:0/1415633385 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c40a6850 con 0x7f91cc155950 2023-12-08T08:20:51.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.569+0000 7f91d2809640 1 -- 172.21.15.88:0/1415633385 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91cc155950 msgr2=0x7f91cc1582f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.569+0000 7f91d2809640 1 --2- 172.21.15.88:0/1415633385 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91cc155950 0x7f91cc1582f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f91c4009d90 tx=0x7f91c401c7e0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.569+0000 7f91d2809640 1 -- 172.21.15.88:0/1415633385 shutdown_connections 2023-12-08T08:20:51.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.569+0000 7f91d2809640 1 --2- 172.21.15.88:0/1415633385 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91cc155950 0x7f91cc1582f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.569+0000 7f91d2809640 1 --2- 172.21.15.88:0/1415633385 >> v2:172.21.15.148:3300/0 conn(0x7f91cc0c47b0 0x7f91cc0c4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.569+0000 7f91d2809640 1 -- 172.21.15.88:0/1415633385 >> 172.21.15.88:0/1415633385 conn(0x7f91cc0aba00 msgr2=0x7f91cc0abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:51.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.569+0000 7f91d2809640 1 -- 172.21.15.88:0/1415633385 shutdown_connections 2023-12-08T08:20:51.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.569+0000 7f91d2809640 1 -- 172.21.15.88:0/1415633385 wait complete. 2023-12-08T08:20:51.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.569+0000 7f91d2809640 1 Processor -- start 2023-12-08T08:20:51.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.569+0000 7f91d2809640 1 -- start start 2023-12-08T08:20:51.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.569+0000 7f91d2809640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91cc0bd550 0x7f91cc0c3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.573+0000 7f91d2809640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91cc0c47b0 0x7f91cc0bebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.573+0000 7f91d2809640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91cc155950 0x7f91cc0c0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.573+0000 7f91d2809640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc0c0770 con 0x7f91cc0c47b0 2023-12-08T08:20:51.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.573+0000 7f91d2809640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc0c0c80 con 0x7f91cc0bd550 2023-12-08T08:20:51.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.573+0000 7f91d2809640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc0c09a0 con 0x7f91cc155950 2023-12-08T08:20:51.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.573+0000 7f91cb7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91cc0c47b0 0x7f91cc0bebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.573+0000 7f91cb7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91cc0c47b0 0x7f91cc0bebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57218/0 (socket says 172.21.15.88:57218) 2023-12-08T08:20:51.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.573+0000 7f91cb7fe640 1 -- 172.21.15.88:0/3016132210 learned_addr learned my addr 172.21.15.88:0/3016132210 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:51.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.573+0000 7f91cbfff640 1 --2- 172.21.15.88:0/3016132210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91cc0bd550 0x7f91cc0c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.573+0000 7f91d0da6640 1 --2- 172.21.15.88:0/3016132210 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91cc155950 0x7f91cc0c0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.573+0000 7f91cb7fe640 1 -- 172.21.15.88:0/3016132210 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91cc155950 msgr2=0x7f91cc0c0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.573+0000 7f91cb7fe640 1 --2- 172.21.15.88:0/3016132210 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91cc155950 0x7f91cc0c0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.573+0000 7f91cb7fe640 1 -- 172.21.15.88:0/3016132210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91cc0bd550 msgr2=0x7f91cc0c3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.573+0000 7f91cb7fe640 1 --2- 172.21.15.88:0/3016132210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91cc0bd550 0x7f91cc0c3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.573+0000 7f91cb7fe640 1 -- 172.21.15.88:0/3016132210 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c4009a70 con 0x7f91cc0c47b0 2023-12-08T08:20:51.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.573+0000 7f91d0da6640 1 --2- 172.21.15.88:0/3016132210 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91cc155950 0x7f91cc0c0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:51.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.573+0000 7f91cb7fe640 1 --2- 172.21.15.88:0/3016132210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91cc0c47b0 0x7f91cc0bebd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f91c00011f0 tx=0x7f91c000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:51.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.573+0000 7f91c8ff9640 1 -- 172.21.15.88:0/3016132210 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c0005ae0 con 0x7f91cc0c47b0 2023-12-08T08:20:51.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.573+0000 7f91c8ff9640 1 -- 172.21.15.88:0/3016132210 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c0005c40 con 0x7f91cc0c47b0 2023-12-08T08:20:51.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.573+0000 7f91d2809640 1 -- 172.21.15.88:0/3016132210 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91cc0c3b40 con 0x7f91cc0c47b0 2023-12-08T08:20:51.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.573+0000 7f91c8ff9640 1 -- 172.21.15.88:0/3016132210 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c0007070 con 0x7f91cc0c47b0 2023-12-08T08:20:51.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.573+0000 7f91d2809640 1 -- 172.21.15.88:0/3016132210 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91cc0c3e20 con 0x7f91cc0c47b0 2023-12-08T08:20:51.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.573+0000 7f91d2809640 1 -- 172.21.15.88:0/3016132210 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91cc067630 con 0x7f91cc0c47b0 2023-12-08T08:20:51.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.573+0000 7f91c8ff9640 1 -- 172.21.15.88:0/3016132210 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f91c00071d0 con 0x7f91cc0c47b0 2023-12-08T08:20:51.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.577+0000 7f91c8ff9640 1 --2- 172.21.15.88:0/3016132210 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f91b8066470 0x7f91b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.577+0000 7f91c8ff9640 1 -- 172.21.15.88:0/3016132210 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91c0083ab0 con 0x7f91cc0c47b0 2023-12-08T08:20:51.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.577+0000 7f91cbfff640 1 --2- 172.21.15.88:0/3016132210 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f91b8066470 0x7f91b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.577+0000 7f91cbfff640 1 --2- 172.21.15.88:0/3016132210 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f91b8066470 0x7f91b8068930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f91cc15d810 tx=0x7f91bc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:51.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.577+0000 7f91c8ff9640 1 -- 172.21.15.88:0/3016132210 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f91c0050f20 con 0x7f91cc0c47b0 2023-12-08T08:20:51.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.737+0000 7f91d2809640 1 -- 172.21.15.88:0/3016132210 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f91cc0c2f40 con 0x7f91cc0c47b0 2023-12-08T08:20:51.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.737+0000 7f91c8ff9640 1 -- 172.21.15.88:0/3016132210 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f91c0054540 con 0x7f91cc0c47b0 2023-12-08T08:20:51.745 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-12-08T08:20:51.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.741+0000 7f91d2809640 1 -- 172.21.15.88:0/3016132210 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f91b8066470 msgr2=0x7f91b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.741+0000 7f91d2809640 1 --2- 172.21.15.88:0/3016132210 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f91b8066470 0x7f91b8068930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f91cc15d810 tx=0x7f91bc009190 comp rx=0 tx=0).stop 2023-12-08T08:20:51.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.741+0000 7f91d2809640 1 -- 172.21.15.88:0/3016132210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91cc0c47b0 msgr2=0x7f91cc0bebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.741+0000 7f91d2809640 1 --2- 172.21.15.88:0/3016132210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91cc0c47b0 0x7f91cc0bebd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f91c00011f0 tx=0x7f91c000cbe0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.741+0000 7f91d2809640 1 -- 172.21.15.88:0/3016132210 shutdown_connections 2023-12-08T08:20:51.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.741+0000 7f91d2809640 1 --2- 172.21.15.88:0/3016132210 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f91b8066470 0x7f91b8068930 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.741+0000 7f91d2809640 1 --2- 172.21.15.88:0/3016132210 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f91cc155950 0x7f91cc0c0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.741+0000 7f91d2809640 1 --2- 172.21.15.88:0/3016132210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91cc0c47b0 0x7f91cc0bebd0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.741+0000 7f91d2809640 1 --2- 172.21.15.88:0/3016132210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91cc0bd550 0x7f91cc0c3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.741+0000 7f91d2809640 1 -- 172.21.15.88:0/3016132210 >> 172.21.15.88:0/3016132210 conn(0x7f91cc0aba00 msgr2=0x7f91cc0c80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:51.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.741+0000 7f91d2809640 1 -- 172.21.15.88:0/3016132210 shutdown_connections 2023-12-08T08:20:51.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.741+0000 7f91d2809640 1 -- 172.21.15.88:0/3016132210 wait complete. 2023-12-08T08:20:51.766 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-08T08:20:51.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:51.767 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-12-08T08:20:51.808 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-12-08T08:20:51.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:51.809 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-08T08:20:51.867 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-12-08T08:20:51.868 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:20:52.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.997+0000 7fbe4032a640 1 Processor -- start 2023-12-08T08:20:52.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:51.997+0000 7fbe4032a640 1 -- start start 2023-12-08T08:20:52.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe4032a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbe3814e3f0 0x7fbe380bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe4032a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe38151690 con 0x7fbe3806bef0 2023-12-08T08:20:52.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe4032a640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe38151bc0 con 0x7fbe3806c5b0 2023-12-08T08:20:52.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe4032a640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe381518e0 con 0x7fbe3814e3f0 2023-12-08T08:20:52.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3d8c5640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbe3806bef0 0x7fbe380c41f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40448/0 (socket says 172.21.15.88:40448) 2023-12-08T08:20:52.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3d8c5640 1 -- 172.21.15.88:0/679689557 learned_addr learned my addr 172.21.15.88:0/679689557 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:52.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3e0c6640 1 --2- 172.21.15.88:0/679689557 >> v2:172.21.15.148:3300/0 conn(0x7fbe3814e3f0 0x7fbe380bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3d0c4640 1 -- 172.21.15.88:0/679689557 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2082721653 0 0) 0x7fbe38151690 con 0x7fbe3806bef0 2023-12-08T08:20:52.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3d0c4640 1 -- 172.21.15.88:0/679689557 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe24003530 con 0x7fbe3806bef0 2023-12-08T08:20:52.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3d0c4640 1 -- 172.21.15.88:0/679689557 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143268973 0 0) 0x7fbe38151bc0 con 0x7fbe3806c5b0 2023-12-08T08:20:52.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3d0c4640 1 -- 172.21.15.88:0/679689557 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe38151690 con 0x7fbe3806c5b0 2023-12-08T08:20:52.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3d0c4640 1 -- 172.21.15.88:0/679689557 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2375058483 0 0) 0x7fbe24003530 con 0x7fbe3806bef0 2023-12-08T08:20:52.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3d0c4640 1 -- 172.21.15.88:0/679689557 >> v2:172.21.15.148:3300/0 conn(0x7fbe3814e3f0 msgr2=0x7fbe380bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:52.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3d0c4640 1 --2- 172.21.15.88:0/679689557 >> v2:172.21.15.148:3300/0 conn(0x7fbe3814e3f0 0x7fbe380bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3d0c4640 1 -- 172.21.15.88:0/679689557 >> v1:172.21.15.148:6789/0 conn(0x7fbe3806c5b0 legacy=0x7fbe3806ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3d0c4640 1 -- 172.21.15.88:0/679689557 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe380c1de0 con 0x7fbe3806bef0 2023-12-08T08:20:52.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3d0c4640 1 -- 172.21.15.88:0/679689557 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7fbe28001680 con 0x7fbe3806bef0 2023-12-08T08:20:52.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3d0c4640 1 -- 172.21.15.88:0/679689557 >> v1:172.21.15.88:6789/0 conn(0x7fbe3806bef0 legacy=0x7fbe380c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3d0c4640 1 --2- 172.21.15.88:0/679689557 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe24003b60 0x7fbe24003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3d0c4640 1 --2- 172.21.15.88:0/679689557 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe240047d0 0x7fbe24004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3d0c4640 1 --2- 172.21.15.88:0/679689557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe240051e0 0x7fbe2400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3d0c4640 1 -- 172.21.15.88:0/679689557 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe381518e0 con 0x7fbe240047d0 2023-12-08T08:20:52.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3d0c4640 1 -- 172.21.15.88:0/679689557 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2400e320 con 0x7fbe240051e0 2023-12-08T08:20:52.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3d0c4640 1 -- 172.21.15.88:0/679689557 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2400e4e0 con 0x7fbe24003b60 2023-12-08T08:20:52.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3d8c5640 1 --2- 172.21.15.88:0/679689557 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe240047d0 0x7fbe24004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3e0c6640 1 --2- 172.21.15.88:0/679689557 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe24003b60 0x7fbe24003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3e8c7640 1 --2- 172.21.15.88:0/679689557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe240051e0 0x7fbe2400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3d8c5640 1 -- 172.21.15.88:0/679689557 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe24003b60 msgr2=0x7fbe24003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:52.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3d8c5640 1 --2- 172.21.15.88:0/679689557 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe24003b60 0x7fbe24003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3d8c5640 1 -- 172.21.15.88:0/679689557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe240051e0 msgr2=0x7fbe2400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:52.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3d8c5640 1 --2- 172.21.15.88:0/679689557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe240051e0 0x7fbe2400dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3e8c7640 1 -- 172.21.15.88:0/679689557 reap_dead start 2023-12-08T08:20:52.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.001+0000 7fbe3d8c5640 1 -- 172.21.15.88:0/679689557 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe24003530 con 0x7fbe240047d0 2023-12-08T08:20:52.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.005+0000 7fbe3d8c5640 1 --2- 172.21.15.88:0/679689557 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe240047d0 0x7fbe24004c50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbe28007fb0 tx=0x7fbe2801cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8684b0f348e9d4c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:52.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.005+0000 7fbe3d0c4640 1 -- 172.21.15.88:0/679689557 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe28005ae0 con 0x7fbe240047d0 2023-12-08T08:20:52.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.005+0000 7fbe3d0c4640 1 -- 172.21.15.88:0/679689557 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe28005c40 con 0x7fbe240047d0 2023-12-08T08:20:52.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.005+0000 7fbe3d0c4640 1 -- 172.21.15.88:0/679689557 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe280072b0 con 0x7fbe240047d0 2023-12-08T08:20:52.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.005+0000 7fbe4032a640 1 -- 172.21.15.88:0/679689557 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe240047d0 msgr2=0x7fbe24004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.005+0000 7fbe4032a640 1 --2- 172.21.15.88:0/679689557 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe240047d0 0x7fbe24004c50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbe28007fb0 tx=0x7fbe2801cad0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.005+0000 7fbe4032a640 1 -- 172.21.15.88:0/679689557 shutdown_connections 2023-12-08T08:20:52.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.005+0000 7fbe4032a640 1 --2- 172.21.15.88:0/679689557 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe240047d0 0x7fbe24004c50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.005+0000 7fbe4032a640 1 -- 172.21.15.88:0/679689557 >> 172.21.15.88:0/679689557 conn(0x7fbe380a7810 msgr2=0x7fbe380a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:52.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.005+0000 7fbe4032a640 1 -- 172.21.15.88:0/679689557 shutdown_connections 2023-12-08T08:20:52.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.005+0000 7fbe4032a640 1 -- 172.21.15.88:0/679689557 wait complete. 2023-12-08T08:20:52.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.009+0000 7fbe4032a640 1 Processor -- start 2023-12-08T08:20:52.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.009+0000 7fbe4032a640 1 -- start start 2023-12-08T08:20:52.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.009+0000 7fbe4032a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe240047d0 0x7fbe3814cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.009+0000 7fbe4032a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe38071a20 0x7fbe38071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.009+0000 7fbe4032a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe38070dd0 0x7fbe38071250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.009+0000 7fbe4032a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe38151dd0 con 0x7fbe38070dd0 2023-12-08T08:20:52.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.009+0000 7fbe4032a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe38070880 con 0x7fbe38071a20 2023-12-08T08:20:52.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.009+0000 7fbe4032a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe38150740 con 0x7fbe240047d0 2023-12-08T08:20:52.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.009+0000 7fbe3e8c7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe38070dd0 0x7fbe38071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.009+0000 7fbe3e8c7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe38070dd0 0x7fbe38071250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57240/0 (socket says 172.21.15.88:57240) 2023-12-08T08:20:52.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.009+0000 7fbe3e8c7640 1 -- 172.21.15.88:0/377855050 learned_addr learned my addr 172.21.15.88:0/377855050 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:52.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.009+0000 7fbe3e0c6640 1 --2- 172.21.15.88:0/377855050 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe240047d0 0x7fbe3814cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.009+0000 7fbe3d8c5640 1 --2- 172.21.15.88:0/377855050 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe38071a20 0x7fbe38071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.009+0000 7fbe3e8c7640 1 -- 172.21.15.88:0/377855050 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe240047d0 msgr2=0x7fbe3814cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.009+0000 7fbe3e8c7640 1 --2- 172.21.15.88:0/377855050 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe240047d0 0x7fbe3814cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.009+0000 7fbe3e8c7640 1 -- 172.21.15.88:0/377855050 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe38071a20 msgr2=0x7fbe38071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.009+0000 7fbe3e8c7640 1 --2- 172.21.15.88:0/377855050 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe38071a20 0x7fbe38071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.009+0000 7fbe3e8c7640 1 -- 172.21.15.88:0/377855050 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3814f8e0 con 0x7fbe38070dd0 2023-12-08T08:20:52.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.009+0000 7fbe3e0c6640 1 --2- 172.21.15.88:0/377855050 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe240047d0 0x7fbe3814cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:52.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.009+0000 7fbe3d8c5640 1 --2- 172.21.15.88:0/377855050 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe38071a20 0x7fbe38071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:52.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.009+0000 7fbe3e8c7640 1 --2- 172.21.15.88:0/377855050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe38070dd0 0x7fbe38071250 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbe380c1930 tx=0x7fbe3000fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:52.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.009+0000 7fbe2effd640 1 -- 172.21.15.88:0/377855050 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30006d70 con 0x7fbe38070dd0 2023-12-08T08:20:52.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.009+0000 7fbe2effd640 1 -- 172.21.15.88:0/377855050 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe30003980 con 0x7fbe38070dd0 2023-12-08T08:20:52.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.009+0000 7fbe2effd640 1 -- 172.21.15.88:0/377855050 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30003d30 con 0x7fbe38070dd0 2023-12-08T08:20:52.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.009+0000 7fbe4032a640 1 -- 172.21.15.88:0/377855050 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe3814fbc0 con 0x7fbe38070dd0 2023-12-08T08:20:52.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.009+0000 7fbe4032a640 1 -- 172.21.15.88:0/377855050 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe38150180 con 0x7fbe38070dd0 2023-12-08T08:20:52.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.009+0000 7fbe4032a640 1 -- 172.21.15.88:0/377855050 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe38067630 con 0x7fbe38070dd0 2023-12-08T08:20:52.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.013+0000 7fbe2effd640 1 -- 172.21.15.88:0/377855050 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbe300050d0 con 0x7fbe38070dd0 2023-12-08T08:20:52.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.013+0000 7fbe2effd640 1 --2- 172.21.15.88:0/377855050 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbe1c0664a0 0x7fbe1c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.013+0000 7fbe2effd640 1 -- 172.21.15.88:0/377855050 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe300830a0 con 0x7fbe38070dd0 2023-12-08T08:20:52.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.013+0000 7fbe3e0c6640 1 --2- 172.21.15.88:0/377855050 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbe1c0664a0 0x7fbe1c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.013+0000 7fbe3e0c6640 1 --2- 172.21.15.88:0/377855050 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbe1c0664a0 0x7fbe1c068960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbe38072610 tx=0x7fbe34008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:52.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.017+0000 7fbe2effd640 1 -- 172.21.15.88:0/377855050 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbe30050480 con 0x7fbe38070dd0 2023-12-08T08:20:52.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.201+0000 7fbe4032a640 1 -- 172.21.15.88:0/377855050 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe380c5370 con 0x7fbe38070dd0 2023-12-08T08:20:52.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.201+0000 7fbe2effd640 1 -- 172.21.15.88:0/377855050 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4910 (secure 0 0 0) 0x7fbe30053aa0 con 0x7fbe38070dd0 2023-12-08T08:20:52.206 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:52.207 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/1946795737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":1946795737},{"type":"v1","addr":"172.21.15.88:6837","nonce":1946795737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/140150927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":140150927},{"type":"v1","addr":"172.21.15.148:6834","nonce":140150927}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2399327235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2399327235},{"type":"v1","addr":"172.21.15.148:6835","nonce":2399327235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:20:20.479364+0000","modified":"2023-12-08T08:20:23.493737+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/3793971563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":3793971563},{"type":"v1","addr":"172.21.15.88:6835","nonce":3793971563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T08:20:52.207 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 8 2023-12-08T08:20:52.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.201+0000 7fbe4032a640 1 -- 172.21.15.88:0/377855050 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbe1c0664a0 msgr2=0x7fbe1c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.201+0000 7fbe4032a640 1 --2- 172.21.15.88:0/377855050 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbe1c0664a0 0x7fbe1c068960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbe38072610 tx=0x7fbe34008040 comp rx=0 tx=0).stop 2023-12-08T08:20:52.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.201+0000 7fbe4032a640 1 -- 172.21.15.88:0/377855050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe38070dd0 msgr2=0x7fbe38071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.201+0000 7fbe4032a640 1 --2- 172.21.15.88:0/377855050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe38070dd0 0x7fbe38071250 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbe380c1930 tx=0x7fbe3000fd40 comp rx=0 tx=0).stop 2023-12-08T08:20:52.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.201+0000 7fbe4032a640 1 -- 172.21.15.88:0/377855050 shutdown_connections 2023-12-08T08:20:52.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.201+0000 7fbe4032a640 1 --2- 172.21.15.88:0/377855050 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbe1c0664a0 0x7fbe1c068960 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.201+0000 7fbe4032a640 1 --2- 172.21.15.88:0/377855050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe38070dd0 0x7fbe38071250 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.201+0000 7fbe4032a640 1 --2- 172.21.15.88:0/377855050 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe38071a20 0x7fbe38071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.201+0000 7fbe4032a640 1 --2- 172.21.15.88:0/377855050 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe240047d0 0x7fbe3814cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.201+0000 7fbe4032a640 1 -- 172.21.15.88:0/377855050 >> 172.21.15.88:0/377855050 conn(0x7fbe380a7810 msgr2=0x7fbe3814b600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:52.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.201+0000 7fbe4032a640 1 -- 172.21.15.88:0/377855050 shutdown_connections 2023-12-08T08:20:52.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.201+0000 7fbe4032a640 1 -- 172.21.15.88:0/377855050 wait complete. 2023-12-08T08:20:52.227 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:52.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.357+0000 7fb49258d640 1 Processor -- start 2023-12-08T08:20:52.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.361+0000 7fb49258d640 1 -- start start 2023-12-08T08:20:52.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.361+0000 7fb49258d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb48c0af4c0 0x7fb48c154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.361+0000 7fb49258d640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb48c0c67d0 0x7fb48c0c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.361+0000 7fb49258d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb48c0c4890 con 0x7fb48c06b9f0 2023-12-08T08:20:52.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.361+0000 7fb49258d640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb48c155460 con 0x7fb48c0c67d0 2023-12-08T08:20:52.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.361+0000 7fb49258d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c0af8a0 con 0x7fb48c0af4c0 2023-12-08T08:20:52.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.361+0000 7fb490b2a640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb48c06b9f0 0x7fb48c157a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40458/0 (socket says 172.21.15.88:40458) 2023-12-08T08:20:52.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.361+0000 7fb490b2a640 1 -- 172.21.15.88:0/3202016810 learned_addr learned my addr 172.21.15.88:0/3202016810 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:52.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.361+0000 7fb48b7fe640 1 --2- 172.21.15.88:0/3202016810 >> v2:172.21.15.148:3300/0 conn(0x7fb48c0c67d0 0x7fb48c0c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.361+0000 7fb48bfff640 1 --2- 172.21.15.88:0/3202016810 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb48c0af4c0 0x7fb48c154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.361+0000 7fb48affd640 1 -- 172.21.15.88:0/3202016810 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4029736821 0 0) 0x7fb48c0c4890 con 0x7fb48c06b9f0 2023-12-08T08:20:52.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.361+0000 7fb48affd640 1 -- 172.21.15.88:0/3202016810 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb474003530 con 0x7fb48c06b9f0 2023-12-08T08:20:52.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.361+0000 7fb48b7fe640 1 -- 172.21.15.88:0/3202016810 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb48c0af4c0 msgr2=0x7fb48c154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:52.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.361+0000 7fb48b7fe640 1 --2- 172.21.15.88:0/3202016810 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb48c0af4c0 0x7fb48c154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.361+0000 7fb48b7fe640 1 -- 172.21.15.88:0/3202016810 >> v1:172.21.15.88:6789/0 conn(0x7fb48c06b9f0 legacy=0x7fb48c157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.361+0000 7fb48b7fe640 1 -- 172.21.15.88:0/3202016810 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48c0c4b30 con 0x7fb48c0c67d0 2023-12-08T08:20:52.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.365+0000 7fb48b7fe640 1 --2- 172.21.15.88:0/3202016810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb48c0c67d0 0x7fb48c0c6c50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb4800097c0 tx=0x7fb48001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ea6f049c937b47c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:52.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.365+0000 7fb48affd640 1 -- 172.21.15.88:0/3202016810 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4800ac620 con 0x7fb48c0c67d0 2023-12-08T08:20:52.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.365+0000 7fb48affd640 1 -- 172.21.15.88:0/3202016810 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4800ac780 con 0x7fb48c0c67d0 2023-12-08T08:20:52.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.365+0000 7fb48affd640 1 -- 172.21.15.88:0/3202016810 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4800acb10 con 0x7fb48c0c67d0 2023-12-08T08:20:52.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.365+0000 7fb49258d640 1 -- 172.21.15.88:0/3202016810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb48c0c67d0 msgr2=0x7fb48c0c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.365+0000 7fb49258d640 1 --2- 172.21.15.88:0/3202016810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb48c0c67d0 0x7fb48c0c6c50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb4800097c0 tx=0x7fb48001c3c0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.365+0000 7fb49258d640 1 -- 172.21.15.88:0/3202016810 shutdown_connections 2023-12-08T08:20:52.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.365+0000 7fb49258d640 1 --2- 172.21.15.88:0/3202016810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb48c0c67d0 0x7fb48c0c6c50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.365+0000 7fb49258d640 1 --2- 172.21.15.88:0/3202016810 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb48c0af4c0 0x7fb48c154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.365+0000 7fb49258d640 1 -- 172.21.15.88:0/3202016810 >> 172.21.15.88:0/3202016810 conn(0x7fb48c0ab9d0 msgr2=0x7fb48c0abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:52.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.365+0000 7fb49258d640 1 -- 172.21.15.88:0/3202016810 shutdown_connections 2023-12-08T08:20:52.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.365+0000 7fb49258d640 1 -- 172.21.15.88:0/3202016810 wait complete. 2023-12-08T08:20:52.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.365+0000 7fb49258d640 1 Processor -- start 2023-12-08T08:20:52.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.369+0000 7fb49258d640 1 -- start start 2023-12-08T08:20:52.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.369+0000 7fb49258d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb48c06b9f0 0x7fb48c0adea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.369+0000 7fb49258d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb48c0af4c0 0x7fb48c152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.369+0000 7fb49258d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb48c0c67d0 0x7fb48c152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.369+0000 7fb49258d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c150c30 con 0x7fb48c0af4c0 2023-12-08T08:20:52.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.369+0000 7fb49258d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c1f0790 con 0x7fb48c0c67d0 2023-12-08T08:20:52.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.369+0000 7fb49258d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c151270 con 0x7fb48c06b9f0 2023-12-08T08:20:52.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.369+0000 7fb48b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb48c0af4c0 0x7fb48c152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.369+0000 7fb48b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb48c0af4c0 0x7fb48c152310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57256/0 (socket says 172.21.15.88:57256) 2023-12-08T08:20:52.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.369+0000 7fb48b7fe640 1 -- 172.21.15.88:0/1751247118 learned_addr learned my addr 172.21.15.88:0/1751247118 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:52.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.369+0000 7fb490b2a640 1 --2- 172.21.15.88:0/1751247118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb48c0c67d0 0x7fb48c152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.369+0000 7fb48bfff640 1 --2- 172.21.15.88:0/1751247118 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb48c06b9f0 0x7fb48c0adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.369+0000 7fb48b7fe640 1 -- 172.21.15.88:0/1751247118 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb48c06b9f0 msgr2=0x7fb48c0adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.369+0000 7fb48b7fe640 1 --2- 172.21.15.88:0/1751247118 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb48c06b9f0 0x7fb48c0adea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.369+0000 7fb48b7fe640 1 -- 172.21.15.88:0/1751247118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb48c0c67d0 msgr2=0x7fb48c152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.369+0000 7fb48b7fe640 1 --2- 172.21.15.88:0/1751247118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb48c0c67d0 0x7fb48c152850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.369+0000 7fb48b7fe640 1 -- 172.21.15.88:0/1751247118 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb480009420 con 0x7fb48c0af4c0 2023-12-08T08:20:52.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.369+0000 7fb490b2a640 1 --2- 172.21.15.88:0/1751247118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb48c0c67d0 0x7fb48c152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:52.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.369+0000 7fb48b7fe640 1 --2- 172.21.15.88:0/1751247118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb48c0af4c0 0x7fb48c152310 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb48001aa70 tx=0x7fb480019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:52.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.369+0000 7fb488ff9640 1 -- 172.21.15.88:0/1751247118 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4800ac620 con 0x7fb48c0af4c0 2023-12-08T08:20:52.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.369+0000 7fb488ff9640 1 -- 172.21.15.88:0/1751247118 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4800b5400 con 0x7fb48c0af4c0 2023-12-08T08:20:52.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.369+0000 7fb488ff9640 1 -- 172.21.15.88:0/1751247118 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4800b57d0 con 0x7fb48c0af4c0 2023-12-08T08:20:52.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.369+0000 7fb49258d640 1 -- 172.21.15.88:0/1751247118 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb48c1efe60 con 0x7fb48c0af4c0 2023-12-08T08:20:52.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.369+0000 7fb49258d640 1 -- 172.21.15.88:0/1751247118 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb48c1f0420 con 0x7fb48c0af4c0 2023-12-08T08:20:52.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.369+0000 7fb49258d640 1 -- 172.21.15.88:0/1751247118 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb48c1f0900 con 0x7fb48c0af4c0 2023-12-08T08:20:52.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.373+0000 7fb488ff9640 1 -- 172.21.15.88:0/1751247118 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb4800b3040 con 0x7fb48c0af4c0 2023-12-08T08:20:52.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.373+0000 7fb488ff9640 1 --2- 172.21.15.88:0/1751247118 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb478066470 0x7fb478068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.373+0000 7fb488ff9640 1 -- 172.21.15.88:0/1751247118 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb48011de20 con 0x7fb48c0af4c0 2023-12-08T08:20:52.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.373+0000 7fb48bfff640 1 --2- 172.21.15.88:0/1751247118 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb478066470 0x7fb478068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.373+0000 7fb48bfff640 1 --2- 172.21.15.88:0/1751247118 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb478066470 0x7fb478068930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb47c009af0 tx=0x7fb47c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:52.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.377+0000 7fb488ff9640 1 -- 172.21.15.88:0/1751247118 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb4800eb3b0 con 0x7fb48c0af4c0 2023-12-08T08:20:52.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.529+0000 7fb49258d640 1 -- 172.21.15.88:0/1751247118 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb48c067630 con 0x7fb48c0af4c0 2023-12-08T08:20:52.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.533+0000 7fb488ff9640 1 -- 172.21.15.88:0/1751247118 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7fb4800ee9d0 con 0x7fb48c0af4c0 2023-12-08T08:20:52.538 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:52.538 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:20:21.492555+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:18.675917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:19.511013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:52.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.533+0000 7fb49258d640 1 -- 172.21.15.88:0/1751247118 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb478066470 msgr2=0x7fb478068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.533+0000 7fb49258d640 1 --2- 172.21.15.88:0/1751247118 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb478066470 0x7fb478068930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb47c009af0 tx=0x7fb47c008040 comp rx=0 tx=0).stop 2023-12-08T08:20:52.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.533+0000 7fb49258d640 1 -- 172.21.15.88:0/1751247118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb48c0af4c0 msgr2=0x7fb48c152310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.533+0000 7fb49258d640 1 --2- 172.21.15.88:0/1751247118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb48c0af4c0 0x7fb48c152310 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb48001aa70 tx=0x7fb480019160 comp rx=0 tx=0).stop 2023-12-08T08:20:52.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.533+0000 7fb49258d640 1 -- 172.21.15.88:0/1751247118 shutdown_connections 2023-12-08T08:20:52.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.533+0000 7fb49258d640 1 --2- 172.21.15.88:0/1751247118 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb478066470 0x7fb478068930 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.533+0000 7fb49258d640 1 --2- 172.21.15.88:0/1751247118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb48c0c67d0 0x7fb48c152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.533+0000 7fb49258d640 1 --2- 172.21.15.88:0/1751247118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb48c0af4c0 0x7fb48c152310 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.533+0000 7fb49258d640 1 --2- 172.21.15.88:0/1751247118 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb48c06b9f0 0x7fb48c0adea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.533+0000 7fb49258d640 1 -- 172.21.15.88:0/1751247118 >> 172.21.15.88:0/1751247118 conn(0x7fb48c0ab9d0 msgr2=0x7fb48c157a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:52.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.533+0000 7fb49258d640 1 -- 172.21.15.88:0/1751247118 shutdown_connections 2023-12-08T08:20:52.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.533+0000 7fb49258d640 1 -- 172.21.15.88:0/1751247118 wait complete. 2023-12-08T08:20:52.560 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:20:18.675917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:20:19.511013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:20:52.560 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:20:52.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.693+0000 7f8020ff8640 1 Processor -- start 2023-12-08T08:20:52.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.693+0000 7f8020ff8640 1 -- start start 2023-12-08T08:20:52.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.697+0000 7f8020ff8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f801c151a90 0x7f801c06c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.697+0000 7f8020ff8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f801c0c66b0 0x7f801c0c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.697+0000 7f8020ff8640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f801c151e70 con 0x7f801c0c9580 2023-12-08T08:20:52.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.697+0000 7f8020ff8640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f801c0c5790 con 0x7f801c151a90 2023-12-08T08:20:52.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.697+0000 7f8020ff8640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801c0c4e00 con 0x7f801c0c66b0 2023-12-08T08:20:52.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.697+0000 7f801b7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f801c151a90 0x7f801c06c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.697+0000 7f801b7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f801c151a90 0x7f801c06c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57260/0 (socket says 172.21.15.88:57260) 2023-12-08T08:20:52.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.697+0000 7f801b7fe640 1 -- 172.21.15.88:0/1753621858 learned_addr learned my addr 172.21.15.88:0/1753621858 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:52.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.697+0000 7f801bfff640 1 --2- 172.21.15.88:0/1753621858 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f801c0c66b0 0x7f801c0c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.697+0000 7f801b7fe640 1 -- 172.21.15.88:0/1753621858 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f801c0c66b0 msgr2=0x7f801c0c6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:52.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.697+0000 7f801b7fe640 1 --2- 172.21.15.88:0/1753621858 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f801c0c66b0 0x7f801c0c6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.697+0000 7f801b7fe640 1 -- 172.21.15.88:0/1753621858 >> v1:172.21.15.148:6789/0 conn(0x7f801c0c9580 legacy=0x7f801c0c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.697+0000 7f801b7fe640 1 -- 172.21.15.88:0/1753621858 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801c0c8aa0 con 0x7f801c151a90 2023-12-08T08:20:52.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.697+0000 7f801b7fe640 1 --2- 172.21.15.88:0/1753621858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801c151a90 0x7f801c06c760 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f800c009870 tx=0x7f800c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e2b29c22ef3121 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:52.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.701+0000 7f801a7fc640 1 -- 172.21.15.88:0/1753621858 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c0ab680 con 0x7f801c151a90 2023-12-08T08:20:52.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.701+0000 7f801a7fc640 1 -- 172.21.15.88:0/1753621858 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800c0ab7e0 con 0x7f801c151a90 2023-12-08T08:20:52.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.701+0000 7f801a7fc640 1 -- 172.21.15.88:0/1753621858 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c0abb70 con 0x7f801c151a90 2023-12-08T08:20:52.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.701+0000 7f8020ff8640 1 -- 172.21.15.88:0/1753621858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801c151a90 msgr2=0x7f801c06c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.701+0000 7f8020ff8640 1 --2- 172.21.15.88:0/1753621858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801c151a90 0x7f801c06c760 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f800c009870 tx=0x7f800c01c480 comp rx=0 tx=0).stop 2023-12-08T08:20:52.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.701+0000 7f8020ff8640 1 -- 172.21.15.88:0/1753621858 shutdown_connections 2023-12-08T08:20:52.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.701+0000 7f8020ff8640 1 --2- 172.21.15.88:0/1753621858 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f801c0c66b0 0x7f801c0c6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.701+0000 7f8020ff8640 1 --2- 172.21.15.88:0/1753621858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801c151a90 0x7f801c06c760 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.701+0000 7f8020ff8640 1 -- 172.21.15.88:0/1753621858 >> 172.21.15.88:0/1753621858 conn(0x7f801c0ab9e0 msgr2=0x7f801c0abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:52.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.701+0000 7f8020ff8640 1 -- 172.21.15.88:0/1753621858 shutdown_connections 2023-12-08T08:20:52.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.701+0000 7f8020ff8640 1 -- 172.21.15.88:0/1753621858 wait complete. 2023-12-08T08:20:52.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.701+0000 7f8020ff8640 1 Processor -- start 2023-12-08T08:20:52.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.701+0000 7f8020ff8640 1 -- start start 2023-12-08T08:20:52.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.701+0000 7f8020ff8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f801c0c66b0 0x7f801c0c11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.701+0000 7f8020ff8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801c0c9580 0x7f801c0c16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.701+0000 7f8020ff8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f801c151a90 0x7f801c155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.701+0000 7f8020ff8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c1559f0 con 0x7f801c0c9580 2023-12-08T08:20:52.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.701+0000 7f8020ff8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c1578c0 con 0x7f801c151a90 2023-12-08T08:20:52.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.701+0000 7f8020ff8640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801c14c750 con 0x7f801c0c66b0 2023-12-08T08:20:52.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.701+0000 7f801affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801c0c9580 0x7f801c0c16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.701+0000 7f801b7fe640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f801c0c66b0 0x7f801c0c11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.701+0000 7f801b7fe640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f801c0c66b0 0x7f801c0c11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:43206/0 (socket says 172.21.15.88:43206) 2023-12-08T08:20:52.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.701+0000 7f801bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f801c151a90 0x7f801c155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.701+0000 7f801b7fe640 1 -- 172.21.15.88:0/1049498611 learned_addr learned my addr 172.21.15.88:0/1049498611 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:52.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.701+0000 7f801affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801c0c9580 0x7f801c0c16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57264/0 (socket says 172.21.15.88:57264) 2023-12-08T08:20:52.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.705+0000 7f801affd640 1 -- 172.21.15.88:0/1049498611 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f801c0c66b0 msgr2=0x7f801c0c11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.705+0000 7f801affd640 1 --2- 172.21.15.88:0/1049498611 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f801c0c66b0 0x7f801c0c11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.705+0000 7f801affd640 1 -- 172.21.15.88:0/1049498611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f801c151a90 msgr2=0x7f801c155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.705+0000 7f801affd640 1 --2- 172.21.15.88:0/1049498611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f801c151a90 0x7f801c155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.705+0000 7f801affd640 1 -- 172.21.15.88:0/1049498611 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800c0094d0 con 0x7f801c0c9580 2023-12-08T08:20:52.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.705+0000 7f801b7fe640 1 --2- 172.21.15.88:0/1049498611 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f801c0c66b0 0x7f801c0c11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:52.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.705+0000 7f801affd640 1 --2- 172.21.15.88:0/1049498611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801c0c9580 0x7f801c0c16e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8010000f70 tx=0x7f801000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:52.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.705+0000 7f8003fff640 1 -- 172.21.15.88:0/1049498611 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80100052d0 con 0x7f801c0c9580 2023-12-08T08:20:52.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.705+0000 7f8003fff640 1 -- 172.21.15.88:0/1049498611 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8010005430 con 0x7f801c0c9580 2023-12-08T08:20:52.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.705+0000 7f8003fff640 1 -- 172.21.15.88:0/1049498611 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8010003840 con 0x7f801c0c9580 2023-12-08T08:20:52.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.705+0000 7f8020ff8640 1 -- 172.21.15.88:0/1049498611 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f801c14beb0 con 0x7f801c0c9580 2023-12-08T08:20:52.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.705+0000 7f8020ff8640 1 -- 172.21.15.88:0/1049498611 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f801c14c470 con 0x7f801c0c9580 2023-12-08T08:20:52.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.705+0000 7f8020ff8640 1 -- 172.21.15.88:0/1049498611 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f801c156b40 con 0x7f801c0c9580 2023-12-08T08:20:52.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.705+0000 7f8003fff640 1 -- 172.21.15.88:0/1049498611 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f80100039a0 con 0x7f801c0c9580 2023-12-08T08:20:52.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.705+0000 7f8003fff640 1 --2- 172.21.15.88:0/1049498611 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8008066470 0x7f8008068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.705+0000 7f8003fff640 1 -- 172.21.15.88:0/1049498611 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8010083210 con 0x7f801c0c9580 2023-12-08T08:20:52.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.705+0000 7f801b7fe640 1 --2- 172.21.15.88:0/1049498611 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8008066470 0x7f8008068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.709+0000 7f801b7fe640 1 --2- 172.21.15.88:0/1049498611 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8008066470 0x7f8008068930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f800c009870 tx=0x7f800c0b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:52.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.709+0000 7f8003fff640 1 -- 172.21.15.88:0/1049498611 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f80100507d0 con 0x7f801c0c9580 2023-12-08T08:20:52.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.865+0000 7f8020ff8640 1 -- 172.21.15.88:0/1049498611 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f801c0674b0 con 0x7f801c0c9580 2023-12-08T08:20:52.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.865+0000 7f8003fff640 1 -- 172.21.15.88:0/1049498611 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8010053df0 con 0x7f801c0c9580 2023-12-08T08:20:52.871 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:20:52.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.865+0000 7f8020ff8640 1 -- 172.21.15.88:0/1049498611 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8008066470 msgr2=0x7f8008068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.865+0000 7f8020ff8640 1 --2- 172.21.15.88:0/1049498611 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8008066470 0x7f8008068930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f800c009870 tx=0x7f800c0b6040 comp rx=0 tx=0).stop 2023-12-08T08:20:52.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.865+0000 7f8020ff8640 1 -- 172.21.15.88:0/1049498611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801c0c9580 msgr2=0x7f801c0c16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.865+0000 7f8020ff8640 1 --2- 172.21.15.88:0/1049498611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801c0c9580 0x7f801c0c16e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8010000f70 tx=0x7f801000c820 comp rx=0 tx=0).stop 2023-12-08T08:20:52.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.865+0000 7f8020ff8640 1 -- 172.21.15.88:0/1049498611 shutdown_connections 2023-12-08T08:20:52.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.865+0000 7f8020ff8640 1 --2- 172.21.15.88:0/1049498611 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8008066470 0x7f8008068930 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.865+0000 7f8020ff8640 1 --2- 172.21.15.88:0/1049498611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f801c151a90 0x7f801c155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.865+0000 7f8020ff8640 1 --2- 172.21.15.88:0/1049498611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801c0c9580 0x7f801c0c16e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.865+0000 7f8020ff8640 1 --2- 172.21.15.88:0/1049498611 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f801c0c66b0 0x7f801c0c11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.865+0000 7f8020ff8640 1 -- 172.21.15.88:0/1049498611 >> 172.21.15.88:0/1049498611 conn(0x7f801c0ab9e0 msgr2=0x7f801c0c4520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:52.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.865+0000 7f8020ff8640 1 -- 172.21.15.88:0/1049498611 shutdown_connections 2023-12-08T08:20:52.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:52.865+0000 7f8020ff8640 1 -- 172.21.15.88:0/1049498611 wait complete. 2023-12-08T08:20:52.891 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:20:53.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.025+0000 7f610ca17640 1 Processor -- start 2023-12-08T08:20:53.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.025+0000 7f610ca17640 1 -- start start 2023-12-08T08:20:53.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.025+0000 7f610ca17640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f610814e2a0 0x7f61081516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.025+0000 7f610ca17640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6108151210 con 0x7f61080a9460 2023-12-08T08:20:53.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.025+0000 7f610ca17640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610814e680 con 0x7f61080a9910 2023-12-08T08:20:53.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.025+0000 7f610ca17640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6108150be0 con 0x7f610814e2a0 2023-12-08T08:20:53.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f60fdd9b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f61080a9460 0x7f61080c4180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40462/0 (socket says 172.21.15.88:40462) 2023-12-08T08:20:53.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f60fdd9b640 1 -- 172.21.15.88:0/2172945677 learned_addr learned my addr 172.21.15.88:0/2172945677 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:53.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f6105d9b640 1 -- 172.21.15.88:0/2172945677 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722169886 0 0) 0x7f6108151210 con 0x7f61080a9460 2023-12-08T08:20:53.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f610659c640 1 --2- 172.21.15.88:0/2172945677 >> v2:172.21.15.148:3300/0 conn(0x7f610814e2a0 0x7f61081516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f6105d9b640 1 -- 172.21.15.88:0/2172945677 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60f4003450 con 0x7f61080a9460 2023-12-08T08:20:53.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f6105d9b640 1 -- 172.21.15.88:0/2172945677 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1293444766 0 0) 0x7f60f4003450 con 0x7f61080a9460 2023-12-08T08:20:53.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f6105d9b640 1 -- 172.21.15.88:0/2172945677 >> v2:172.21.15.148:3300/0 conn(0x7f610814e2a0 msgr2=0x7f61081516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:53.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f6105d9b640 1 --2- 172.21.15.88:0/2172945677 >> v2:172.21.15.148:3300/0 conn(0x7f610814e2a0 0x7f61081516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f6105d9b640 1 -- 172.21.15.88:0/2172945677 >> v1:172.21.15.148:6789/0 conn(0x7f61080a9910 legacy=0x7f610806bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f6105d9b640 1 -- 172.21.15.88:0/2172945677 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61080c53c0 con 0x7f61080a9460 2023-12-08T08:20:53.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f6105d9b640 1 -- 172.21.15.88:0/2172945677 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f60f0001680 con 0x7f61080a9460 2023-12-08T08:20:53.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f6105d9b640 1 -- 172.21.15.88:0/2172945677 >> v1:172.21.15.88:6789/0 conn(0x7f61080a9460 legacy=0x7f61080c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f6105d9b640 1 --2- 172.21.15.88:0/2172945677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60f4003a70 0x7f60f4003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f6105d9b640 1 --2- 172.21.15.88:0/2172945677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60f4006650 0x7f60f4008a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f6105d9b640 1 --2- 172.21.15.88:0/2172945677 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60f4009280 0x7f60f400b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f6105d9b640 1 -- 172.21.15.88:0/2172945677 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6108150be0 con 0x7f60f4006650 2023-12-08T08:20:53.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f6105d9b640 1 -- 172.21.15.88:0/2172945677 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f400c020 con 0x7f60f4003a70 2023-12-08T08:20:53.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f6105d9b640 1 -- 172.21.15.88:0/2172945677 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f400c1e0 con 0x7f60f4009280 2023-12-08T08:20:53.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f610659c640 1 --2- 172.21.15.88:0/2172945677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60f4003a70 0x7f60f4003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f60fdd9b640 1 --2- 172.21.15.88:0/2172945677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60f4006650 0x7f60f4008a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f6106d9d640 1 --2- 172.21.15.88:0/2172945677 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60f4009280 0x7f60f400b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f60fdd9b640 1 -- 172.21.15.88:0/2172945677 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60f4009280 msgr2=0x7f60f400b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:53.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f60fdd9b640 1 --2- 172.21.15.88:0/2172945677 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60f4009280 0x7f60f400b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f60fdd9b640 1 -- 172.21.15.88:0/2172945677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60f4003a70 msgr2=0x7f60f4003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:53.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f60fdd9b640 1 --2- 172.21.15.88:0/2172945677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60f4003a70 0x7f60f4003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f60fdd9b640 1 -- 172.21.15.88:0/2172945677 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f4003450 con 0x7f60f4006650 2023-12-08T08:20:53.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f610659c640 1 --2- 172.21.15.88:0/2172945677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60f4003a70 0x7f60f4003e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:53.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.029+0000 7f6106d9d640 1 -- 172.21.15.88:0/2172945677 reap_dead start 2023-12-08T08:20:53.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.033+0000 7f60fdd9b640 1 --2- 172.21.15.88:0/2172945677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60f4006650 0x7f60f4008a80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f60f000c1c0 tx=0x7f60f001f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5393d40f4e40974f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:53.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.033+0000 7f6105d9b640 1 -- 172.21.15.88:0/2172945677 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f0005ae0 con 0x7f60f4006650 2023-12-08T08:20:53.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.033+0000 7f6105d9b640 1 -- 172.21.15.88:0/2172945677 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f00ab070 con 0x7f60f4006650 2023-12-08T08:20:53.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.033+0000 7f6105d9b640 1 -- 172.21.15.88:0/2172945677 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f0007070 con 0x7f60f4006650 2023-12-08T08:20:53.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.033+0000 7f610ca17640 1 -- 172.21.15.88:0/2172945677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60f4006650 msgr2=0x7f60f4008a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.033+0000 7f610ca17640 1 --2- 172.21.15.88:0/2172945677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60f4006650 0x7f60f4008a80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f60f000c1c0 tx=0x7f60f001f350 comp rx=0 tx=0).stop 2023-12-08T08:20:53.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.033+0000 7f610ca17640 1 -- 172.21.15.88:0/2172945677 shutdown_connections 2023-12-08T08:20:53.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.033+0000 7f610ca17640 1 --2- 172.21.15.88:0/2172945677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60f4006650 0x7f60f4008a80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.033+0000 7f610ca17640 1 -- 172.21.15.88:0/2172945677 >> 172.21.15.88:0/2172945677 conn(0x7f61080c59f0 msgr2=0x7f61080c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:53.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.033+0000 7f610ca17640 1 -- 172.21.15.88:0/2172945677 shutdown_connections 2023-12-08T08:20:53.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.033+0000 7f610ca17640 1 -- 172.21.15.88:0/2172945677 wait complete. 2023-12-08T08:20:53.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.033+0000 7f610ca17640 1 Processor -- start 2023-12-08T08:20:53.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.033+0000 7f610ca17640 1 -- start start 2023-12-08T08:20:53.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.037+0000 7f610ca17640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60f4006650 0x7f610814bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.037+0000 7f610ca17640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f610814c1a0 0x7f6108146410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.037+0000 7f610ca17640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6108146950 0x7f6108149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.037+0000 7f610ca17640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6108072690 con 0x7f6108146950 2023-12-08T08:20:53.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.037+0000 7f610ca17640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6108147d00 con 0x7f610814c1a0 2023-12-08T08:20:53.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.037+0000 7f610ca17640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610806fd50 con 0x7f60f4006650 2023-12-08T08:20:53.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.037+0000 7f6106d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6108146950 0x7f6108149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.037+0000 7f610659c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60f4006650 0x7f610814bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.037+0000 7f6106d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6108146950 0x7f6108149990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57282/0 (socket says 172.21.15.88:57282) 2023-12-08T08:20:53.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.037+0000 7f6106d9d640 1 -- 172.21.15.88:0/102670703 learned_addr learned my addr 172.21.15.88:0/102670703 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:53.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.037+0000 7f60fdd9b640 1 --2- 172.21.15.88:0/102670703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f610814c1a0 0x7f6108146410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.037+0000 7f6106d9d640 1 -- 172.21.15.88:0/102670703 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60f4006650 msgr2=0x7f610814bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.037+0000 7f6106d9d640 1 --2- 172.21.15.88:0/102670703 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60f4006650 0x7f610814bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.037+0000 7f6106d9d640 1 -- 172.21.15.88:0/102670703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f610814c1a0 msgr2=0x7f6108146410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.037+0000 7f6106d9d640 1 --2- 172.21.15.88:0/102670703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f610814c1a0 0x7f6108146410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.037+0000 7f6106d9d640 1 -- 172.21.15.88:0/102670703 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61080728e0 con 0x7f6108146950 2023-12-08T08:20:53.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.037+0000 7f6106d9d640 1 --2- 172.21.15.88:0/102670703 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6108146950 0x7f6108149990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6108074310 tx=0x7f610000f910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:53.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.037+0000 7f60ff7fe640 1 -- 172.21.15.88:0/102670703 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61000052e0 con 0x7f6108146950 2023-12-08T08:20:53.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.037+0000 7f60ff7fe640 1 -- 172.21.15.88:0/102670703 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6100005440 con 0x7f6108146950 2023-12-08T08:20:53.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.037+0000 7f610ca17640 1 -- 172.21.15.88:0/102670703 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6108147f50 con 0x7f6108146950 2023-12-08T08:20:53.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.037+0000 7f60ff7fe640 1 -- 172.21.15.88:0/102670703 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100003840 con 0x7f6108146950 2023-12-08T08:20:53.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.037+0000 7f610ca17640 1 -- 172.21.15.88:0/102670703 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f610814db90 con 0x7f6108146950 2023-12-08T08:20:53.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.037+0000 7f610ca17640 1 -- 172.21.15.88:0/102670703 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6108072a70 con 0x7f6108146950 2023-12-08T08:20:53.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.037+0000 7f60ff7fe640 1 -- 172.21.15.88:0/102670703 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f61000039a0 con 0x7f6108146950 2023-12-08T08:20:53.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.041+0000 7f60ff7fe640 1 --2- 172.21.15.88:0/102670703 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f60e80664a0 0x7f60e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.041+0000 7f60ff7fe640 1 -- 172.21.15.88:0/102670703 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6100083a30 con 0x7f6108146950 2023-12-08T08:20:53.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.041+0000 7f610659c640 1 --2- 172.21.15.88:0/102670703 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f60e80664a0 0x7f60e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.041+0000 7f610659c640 1 --2- 172.21.15.88:0/102670703 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f60e80664a0 0x7f60e8068960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f61080693e0 tx=0x7f60f800d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:53.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.045+0000 7f60ff7fe640 1 -- 172.21.15.88:0/102670703 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6100050ea0 con 0x7f6108146950 2023-12-08T08:20:53.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.197+0000 7f610ca17640 1 -- 172.21.15.88:0/102670703 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6108067630 con 0x7f6108146950 2023-12-08T08:20:53.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.197+0000 7f60ff7fe640 1 -- 172.21.15.88:0/102670703 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f61000544c0 con 0x7f6108146950 2023-12-08T08:20:53.203 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:20:53.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.197+0000 7f610ca17640 1 -- 172.21.15.88:0/102670703 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f60e80664a0 msgr2=0x7f60e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.197+0000 7f610ca17640 1 --2- 172.21.15.88:0/102670703 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f60e80664a0 0x7f60e8068960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f61080693e0 tx=0x7f60f800d040 comp rx=0 tx=0).stop 2023-12-08T08:20:53.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.197+0000 7f610ca17640 1 -- 172.21.15.88:0/102670703 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6108146950 msgr2=0x7f6108149990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.197+0000 7f610ca17640 1 --2- 172.21.15.88:0/102670703 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6108146950 0x7f6108149990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6108074310 tx=0x7f610000f910 comp rx=0 tx=0).stop 2023-12-08T08:20:53.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.197+0000 7f610ca17640 1 -- 172.21.15.88:0/102670703 shutdown_connections 2023-12-08T08:20:53.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.197+0000 7f610ca17640 1 --2- 172.21.15.88:0/102670703 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f60e80664a0 0x7f60e8068960 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.197+0000 7f610ca17640 1 --2- 172.21.15.88:0/102670703 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6108146950 0x7f6108149990 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.197+0000 7f610ca17640 1 --2- 172.21.15.88:0/102670703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f610814c1a0 0x7f6108146410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.197+0000 7f610ca17640 1 --2- 172.21.15.88:0/102670703 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f60f4006650 0x7f610814bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.197+0000 7f610ca17640 1 -- 172.21.15.88:0/102670703 >> 172.21.15.88:0/102670703 conn(0x7f61080c59f0 msgr2=0x7f61080aab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:53.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.197+0000 7f610ca17640 1 -- 172.21.15.88:0/102670703 shutdown_connections 2023-12-08T08:20:53.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.197+0000 7f610ca17640 1 -- 172.21.15.88:0/102670703 wait complete. 2023-12-08T08:20:53.223 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:20:53.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.357+0000 7f4d11980640 1 Processor -- start 2023-12-08T08:20:53.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.357+0000 7f4d11980640 1 -- start start 2023-12-08T08:20:53.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.357+0000 7f4d11980640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4d0c0c5f60 0x7f4d0c0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.357+0000 7f4d11980640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d0c0c4870 0x7f4d0c0c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.357+0000 7f4d11980640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d0c0c6a10 con 0x7f4d0c155310 2023-12-08T08:20:53.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.357+0000 7f4d11980640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d0c0c2740 con 0x7f4d0c0c5f60 2023-12-08T08:20:53.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.357+0000 7f4d11980640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c06bc80 con 0x7f4d0c0c4870 2023-12-08T08:20:53.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.357+0000 7f4d0affd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4d0c155310 0x7f4d0c158590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40472/0 (socket says 172.21.15.88:40472) 2023-12-08T08:20:53.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.357+0000 7f4d0affd640 1 -- 172.21.15.88:0/257214475 learned_addr learned my addr 172.21.15.88:0/257214475 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:53.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d027fc640 1 --2- 172.21.15.88:0/257214475 >> v2:172.21.15.148:3300/0 conn(0x7f4d0c0c5f60 0x7f4d0c0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d0b7fe640 1 --2- 172.21.15.88:0/257214475 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d0c0c4870 0x7f4d0c0c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d0a7fc640 1 -- 172.21.15.88:0/257214475 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242916407 0 0) 0x7f4d0c0c6a10 con 0x7f4d0c155310 2023-12-08T08:20:53.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d0a7fc640 1 -- 172.21.15.88:0/257214475 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cf8003530 con 0x7f4d0c155310 2023-12-08T08:20:53.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d0a7fc640 1 -- 172.21.15.88:0/257214475 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3078185338 0 0) 0x7f4cf8003530 con 0x7f4d0c155310 2023-12-08T08:20:53.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d0a7fc640 1 -- 172.21.15.88:0/257214475 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d0c0c4870 msgr2=0x7f4d0c0c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:53.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d0a7fc640 1 --2- 172.21.15.88:0/257214475 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d0c0c4870 0x7f4d0c0c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d0a7fc640 1 -- 172.21.15.88:0/257214475 >> v2:172.21.15.148:3300/0 conn(0x7f4d0c0c5f60 msgr2=0x7f4d0c0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:53.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d0a7fc640 1 --2- 172.21.15.88:0/257214475 >> v2:172.21.15.148:3300/0 conn(0x7f4d0c0c5f60 0x7f4d0c0c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d0a7fc640 1 -- 172.21.15.88:0/257214475 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c0c2f80 con 0x7f4d0c155310 2023-12-08T08:20:53.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d0a7fc640 1 -- 172.21.15.88:0/257214475 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f4cfc001680 con 0x7f4d0c155310 2023-12-08T08:20:53.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d0a7fc640 1 -- 172.21.15.88:0/257214475 >> v1:172.21.15.88:6789/0 conn(0x7f4d0c155310 legacy=0x7f4d0c158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d0a7fc640 1 --2- 172.21.15.88:0/257214475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4cf8003980 0x7f4cf8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d0a7fc640 1 --2- 172.21.15.88:0/257214475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cf80047d0 0x7f4cf8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d0a7fc640 1 --2- 172.21.15.88:0/257214475 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d0c0c4870 0x7f4cf8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d0a7fc640 1 -- 172.21.15.88:0/257214475 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c0c2740 con 0x7f4cf80047d0 2023-12-08T08:20:53.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d0a7fc640 1 -- 172.21.15.88:0/257214475 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c06bc80 con 0x7f4cf8003980 2023-12-08T08:20:53.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d0a7fc640 1 -- 172.21.15.88:0/257214475 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf800b990 con 0x7f4d0c0c4870 2023-12-08T08:20:53.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d027fc640 1 --2- 172.21.15.88:0/257214475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cf80047d0 0x7f4cf8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d0b7fe640 1 --2- 172.21.15.88:0/257214475 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d0c0c4870 0x7f4cf8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d0affd640 1 --2- 172.21.15.88:0/257214475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4cf8003980 0x7f4cf8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d027fc640 1 -- 172.21.15.88:0/257214475 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d0c0c4870 msgr2=0x7f4cf8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:53.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d027fc640 1 --2- 172.21.15.88:0/257214475 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d0c0c4870 0x7f4cf8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d027fc640 1 -- 172.21.15.88:0/257214475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4cf8003980 msgr2=0x7f4cf8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:53.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d027fc640 1 --2- 172.21.15.88:0/257214475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4cf8003980 0x7f4cf8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d027fc640 1 -- 172.21.15.88:0/257214475 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf8003530 con 0x7f4cf80047d0 2023-12-08T08:20:53.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d0b7fe640 1 --2- 172.21.15.88:0/257214475 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d0c0c4870 0x7f4cf8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:53.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.361+0000 7f4d0affd640 1 --2- 172.21.15.88:0/257214475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4cf8003980 0x7f4cf8003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:53.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.365+0000 7f4d027fc640 1 --2- 172.21.15.88:0/257214475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cf80047d0 0x7f4cf8004c50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4009ab0 tx=0x7f4cf401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c560dcf7a2e311 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:53.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.365+0000 7f4d0a7fc640 1 -- 172.21.15.88:0/257214475 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf40a6480 con 0x7f4cf80047d0 2023-12-08T08:20:53.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.365+0000 7f4d0a7fc640 1 -- 172.21.15.88:0/257214475 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf40a65e0 con 0x7f4cf80047d0 2023-12-08T08:20:53.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.365+0000 7f4d0a7fc640 1 -- 172.21.15.88:0/257214475 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf40a6990 con 0x7f4cf80047d0 2023-12-08T08:20:53.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.365+0000 7f4d11980640 1 -- 172.21.15.88:0/257214475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cf80047d0 msgr2=0x7f4cf8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.365+0000 7f4d11980640 1 --2- 172.21.15.88:0/257214475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cf80047d0 0x7f4cf8004c50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4009ab0 tx=0x7f4cf401ca70 comp rx=0 tx=0).stop 2023-12-08T08:20:53.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.365+0000 7f4d0b7fe640 1 -- 172.21.15.88:0/257214475 reap_dead start 2023-12-08T08:20:53.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.365+0000 7f4d11980640 1 -- 172.21.15.88:0/257214475 shutdown_connections 2023-12-08T08:20:53.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.365+0000 7f4d11980640 1 -- 172.21.15.88:0/257214475 >> 172.21.15.88:0/257214475 conn(0x7f4d0c0a9830 msgr2=0x7f4d0c0a9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:53.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.365+0000 7f4d11980640 1 -- 172.21.15.88:0/257214475 shutdown_connections 2023-12-08T08:20:53.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.365+0000 7f4d11980640 1 -- 172.21.15.88:0/257214475 wait complete. 2023-12-08T08:20:53.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.365+0000 7f4d11980640 1 Processor -- start 2023-12-08T08:20:53.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.365+0000 7f4d11980640 1 -- start start 2023-12-08T08:20:53.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.365+0000 7f4d11980640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cf80047d0 0x7f4d0c0abd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.365+0000 7f4d11980640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d0c0ad330 0x7f4d0c1ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.365+0000 7f4d11980640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d0c1eaf70 0x7f4d0c14fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.365+0000 7f4d11980640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c0ab960 con 0x7f4cf80047d0 2023-12-08T08:20:53.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.365+0000 7f4d11980640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c0ab330 con 0x7f4d0c1eaf70 2023-12-08T08:20:53.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.365+0000 7f4d11980640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c1edb20 con 0x7f4d0c0ad330 2023-12-08T08:20:53.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.369+0000 7f4d0affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cf80047d0 0x7f4d0c0abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.369+0000 7f4d0affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cf80047d0 0x7f4d0c0abd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57296/0 (socket says 172.21.15.88:57296) 2023-12-08T08:20:53.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.369+0000 7f4d0affd640 1 -- 172.21.15.88:0/3649751760 learned_addr learned my addr 172.21.15.88:0/3649751760 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:53.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.369+0000 7f4d0b7fe640 1 --2- 172.21.15.88:0/3649751760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d0c1eaf70 0x7f4d0c14fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.369+0000 7f4d027fc640 1 --2- 172.21.15.88:0/3649751760 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d0c0ad330 0x7f4d0c1ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.369+0000 7f4d0affd640 1 -- 172.21.15.88:0/3649751760 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d0c0ad330 msgr2=0x7f4d0c1ed2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.369+0000 7f4d0affd640 1 --2- 172.21.15.88:0/3649751760 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d0c0ad330 0x7f4d0c1ed2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.369+0000 7f4d0affd640 1 -- 172.21.15.88:0/3649751760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d0c1eaf70 msgr2=0x7f4d0c14fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.369+0000 7f4d0affd640 1 --2- 172.21.15.88:0/3649751760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d0c1eaf70 0x7f4d0c14fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.369+0000 7f4d0affd640 1 -- 172.21.15.88:0/3649751760 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c1eddc0 con 0x7f4cf80047d0 2023-12-08T08:20:53.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.369+0000 7f4d027fc640 1 --2- 172.21.15.88:0/3649751760 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d0c0ad330 0x7f4d0c1ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:53.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.369+0000 7f4d0affd640 1 --2- 172.21.15.88:0/3649751760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cf80047d0 0x7f4d0c0abd80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc011810 tx=0x7f4cfc011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:53.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.369+0000 7f4d08ff9640 1 -- 172.21.15.88:0/3649751760 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc00fb60 con 0x7f4cf80047d0 2023-12-08T08:20:53.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.369+0000 7f4d08ff9640 1 -- 172.21.15.88:0/3649751760 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cfc00fcc0 con 0x7f4cf80047d0 2023-12-08T08:20:53.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.369+0000 7f4d11980640 1 -- 172.21.15.88:0/3649751760 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d0c0ab580 con 0x7f4cf80047d0 2023-12-08T08:20:53.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.369+0000 7f4d08ff9640 1 -- 172.21.15.88:0/3649751760 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc015610 con 0x7f4cf80047d0 2023-12-08T08:20:53.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.369+0000 7f4d11980640 1 -- 172.21.15.88:0/3649751760 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0c0ac6c0 con 0x7f4cf80047d0 2023-12-08T08:20:53.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.369+0000 7f4d11980640 1 -- 172.21.15.88:0/3649751760 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0c067630 con 0x7f4cf80047d0 2023-12-08T08:20:53.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.369+0000 7f4d08ff9640 1 -- 172.21.15.88:0/3649751760 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4cfc015770 con 0x7f4cf80047d0 2023-12-08T08:20:53.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.369+0000 7f4d08ff9640 1 --2- 172.21.15.88:0/3649751760 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4cec0664a0 0x7f4cec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.369+0000 7f4d08ff9640 1 -- 172.21.15.88:0/3649751760 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4cfc086fe0 con 0x7f4cf80047d0 2023-12-08T08:20:53.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.373+0000 7f4d027fc640 1 --2- 172.21.15.88:0/3649751760 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4cec0664a0 0x7f4cec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.373+0000 7f4d027fc640 1 --2- 172.21.15.88:0/3649751760 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4cec0664a0 0x7f4cec068960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40ad000 tx=0x7f4cf40b2040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:53.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.373+0000 7f4d08ff9640 1 -- 172.21.15.88:0/3649751760 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4cfc054490 con 0x7f4cf80047d0 2023-12-08T08:20:53.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.525+0000 7f4d11980640 1 -- 172.21.15.88:0/3649751760 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4d0c0c5d40 con 0x7f4cf80047d0 2023-12-08T08:20:53.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.525+0000 7f4d08ff9640 1 -- 172.21.15.88:0/3649751760 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4cfc057ab0 con 0x7f4cf80047d0 2023-12-08T08:20:53.530 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:20:53.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.525+0000 7f4d11980640 1 -- 172.21.15.88:0/3649751760 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4cec0664a0 msgr2=0x7f4cec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.525+0000 7f4d11980640 1 --2- 172.21.15.88:0/3649751760 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4cec0664a0 0x7f4cec068960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40ad000 tx=0x7f4cf40b2040 comp rx=0 tx=0).stop 2023-12-08T08:20:53.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.525+0000 7f4d11980640 1 -- 172.21.15.88:0/3649751760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cf80047d0 msgr2=0x7f4d0c0abd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.525+0000 7f4d11980640 1 --2- 172.21.15.88:0/3649751760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cf80047d0 0x7f4d0c0abd80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc011810 tx=0x7f4cfc011cd0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.525+0000 7f4d11980640 1 -- 172.21.15.88:0/3649751760 shutdown_connections 2023-12-08T08:20:53.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.525+0000 7f4d11980640 1 --2- 172.21.15.88:0/3649751760 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4cec0664a0 0x7f4cec068960 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.525+0000 7f4d11980640 1 --2- 172.21.15.88:0/3649751760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d0c1eaf70 0x7f4d0c14fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.525+0000 7f4d11980640 1 --2- 172.21.15.88:0/3649751760 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4d0c0ad330 0x7f4d0c1ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.525+0000 7f4d11980640 1 --2- 172.21.15.88:0/3649751760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cf80047d0 0x7f4d0c0abd80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.525+0000 7f4d11980640 1 -- 172.21.15.88:0/3649751760 >> 172.21.15.88:0/3649751760 conn(0x7f4d0c0a9830 msgr2=0x7f4d0c06cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:53.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.525+0000 7f4d11980640 1 -- 172.21.15.88:0/3649751760 shutdown_connections 2023-12-08T08:20:53.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.525+0000 7f4d11980640 1 -- 172.21.15.88:0/3649751760 wait complete. 2023-12-08T08:20:53.551 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:20:53.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.685+0000 7f6f40817640 1 Processor -- start 2023-12-08T08:20:53.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.685+0000 7f6f40817640 1 -- start start 2023-12-08T08:20:53.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.685+0000 7f6f40817640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6f3c14fd10 0x7f6f3c0a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.685+0000 7f6f40817640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6f3c156110 0x7f6f3c156580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.685+0000 7f6f40817640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f3c0c5710 con 0x7f6f3c0a5300 2023-12-08T08:20:53.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.685+0000 7f6f40817640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f3c06c5e0 con 0x7f6f3c14fd10 2023-12-08T08:20:53.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.685+0000 7f6f40817640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f3c155c80 con 0x7f6f3c156110 2023-12-08T08:20:53.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.685+0000 7f6f3a59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6f3c14fd10 0x7f6f3c0a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.685+0000 7f6f3a59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6f3c14fd10 0x7f6f3c0a4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57306/0 (socket says 172.21.15.88:57306) 2023-12-08T08:20:53.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.685+0000 7f6f3a59c640 1 -- 172.21.15.88:0/1197425630 learned_addr learned my addr 172.21.15.88:0/1197425630 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:53.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.685+0000 7f6f3ad9d640 1 --2- 172.21.15.88:0/1197425630 >> v2:172.21.15.148:3300/0 conn(0x7f6f3c156110 0x7f6f3c156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.685+0000 7f6f3a59c640 1 -- 172.21.15.88:0/1197425630 >> v2:172.21.15.148:3300/0 conn(0x7f6f3c156110 msgr2=0x7f6f3c156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:53.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.685+0000 7f6f3a59c640 1 --2- 172.21.15.88:0/1197425630 >> v2:172.21.15.148:3300/0 conn(0x7f6f3c156110 0x7f6f3c156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.685+0000 7f6f3a59c640 1 -- 172.21.15.88:0/1197425630 >> v1:172.21.15.148:6789/0 conn(0x7f6f3c0a5300 legacy=0x7f6f3c071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:53.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.685+0000 7f6f3a59c640 1 -- 172.21.15.88:0/1197425630 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3c0c4e70 con 0x7f6f3c14fd10 2023-12-08T08:20:53.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.685+0000 7f6f3ad9d640 1 --2- 172.21.15.88:0/1197425630 >> v2:172.21.15.148:3300/0 conn(0x7f6f3c156110 0x7f6f3c156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:53.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.689+0000 7f6f3a59c640 1 --2- 172.21.15.88:0/1197425630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f3c14fd10 0x7f6f3c0a4dc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c06e790 tx=0x7f6f2c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc86daf8810c4a7f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:53.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.689+0000 7f6f39d9b640 1 -- 172.21.15.88:0/1197425630 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c0ac600 con 0x7f6f3c14fd10 2023-12-08T08:20:53.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.689+0000 7f6f39d9b640 1 -- 172.21.15.88:0/1197425630 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2c0a8050 con 0x7f6f3c14fd10 2023-12-08T08:20:53.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.689+0000 7f6f39d9b640 1 -- 172.21.15.88:0/1197425630 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c0ac980 con 0x7f6f3c14fd10 2023-12-08T08:20:53.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.689+0000 7f6f40817640 1 -- 172.21.15.88:0/1197425630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f3c14fd10 msgr2=0x7f6f3c0a4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.689+0000 7f6f40817640 1 --2- 172.21.15.88:0/1197425630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f3c14fd10 0x7f6f3c0a4dc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c06e790 tx=0x7f6f2c01c3a0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.689+0000 7f6f40817640 1 -- 172.21.15.88:0/1197425630 shutdown_connections 2023-12-08T08:20:53.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.689+0000 7f6f40817640 1 --2- 172.21.15.88:0/1197425630 >> v2:172.21.15.148:3300/0 conn(0x7f6f3c156110 0x7f6f3c156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.689+0000 7f6f40817640 1 --2- 172.21.15.88:0/1197425630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f3c14fd10 0x7f6f3c0a4dc0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.689+0000 7f6f40817640 1 -- 172.21.15.88:0/1197425630 >> 172.21.15.88:0/1197425630 conn(0x7f6f3c0a7810 msgr2=0x7f6f3c0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:53.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.689+0000 7f6f40817640 1 -- 172.21.15.88:0/1197425630 shutdown_connections 2023-12-08T08:20:53.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.689+0000 7f6f40817640 1 -- 172.21.15.88:0/1197425630 wait complete. 2023-12-08T08:20:53.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.693+0000 7f6f40817640 1 Processor -- start 2023-12-08T08:20:53.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.693+0000 7f6f40817640 1 -- start start 2023-12-08T08:20:53.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.693+0000 7f6f40817640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f3c0a5300 0x7f6f3c0ab460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.693+0000 7f6f40817640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f3c14fd10 0x7f6f3c15c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.693+0000 7f6f40817640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f3c156110 0x7f6f3c070a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.693+0000 7f6f40817640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c1ec8d0 con 0x7f6f3c0a5300 2023-12-08T08:20:53.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.693+0000 7f6f40817640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c1ed0f0 con 0x7f6f3c156110 2023-12-08T08:20:53.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.693+0000 7f6f40817640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c1ecac0 con 0x7f6f3c14fd10 2023-12-08T08:20:53.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.693+0000 7f6f3a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f3c0a5300 0x7f6f3c0ab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.693+0000 7f6f3a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f3c0a5300 0x7f6f3c0ab460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57318/0 (socket says 172.21.15.88:57318) 2023-12-08T08:20:53.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.693+0000 7f6f3a59c640 1 -- 172.21.15.88:0/3637675562 learned_addr learned my addr 172.21.15.88:0/3637675562 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:53.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.693+0000 7f6f31d9b640 1 --2- 172.21.15.88:0/3637675562 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f3c14fd10 0x7f6f3c15c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.693+0000 7f6f3a59c640 1 -- 172.21.15.88:0/3637675562 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f3c14fd10 msgr2=0x7f6f3c15c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.693+0000 7f6f3ad9d640 1 --2- 172.21.15.88:0/3637675562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f3c156110 0x7f6f3c070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.693+0000 7f6f3a59c640 1 --2- 172.21.15.88:0/3637675562 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f3c14fd10 0x7f6f3c15c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.693+0000 7f6f3a59c640 1 -- 172.21.15.88:0/3637675562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f3c156110 msgr2=0x7f6f3c070a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.693+0000 7f6f3a59c640 1 --2- 172.21.15.88:0/3637675562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f3c156110 0x7f6f3c070a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.693+0000 7f6f3a59c640 1 -- 172.21.15.88:0/3637675562 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2c0094d0 con 0x7f6f3c0a5300 2023-12-08T08:20:53.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.693+0000 7f6f31d9b640 1 --2- 172.21.15.88:0/3637675562 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f3c14fd10 0x7f6f3c15c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:53.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.693+0000 7f6f3ad9d640 1 --2- 172.21.15.88:0/3637675562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f3c156110 0x7f6f3c070a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:53.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.693+0000 7f6f3a59c640 1 --2- 172.21.15.88:0/3637675562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f3c0a5300 0x7f6f3c0ab460 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c019fd0 tx=0x7f6f2c01abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:53.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.693+0000 7f6f337fe640 1 -- 172.21.15.88:0/3637675562 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c0b7620 con 0x7f6f3c0a5300 2023-12-08T08:20:53.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.693+0000 7f6f337fe640 1 -- 172.21.15.88:0/3637675562 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2c0b7780 con 0x7f6f3c0a5300 2023-12-08T08:20:53.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.693+0000 7f6f337fe640 1 -- 172.21.15.88:0/3637675562 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c0b7af0 con 0x7f6f3c0a5300 2023-12-08T08:20:53.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.693+0000 7f6f40817640 1 -- 172.21.15.88:0/3637675562 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f3c1f0b30 con 0x7f6f3c0a5300 2023-12-08T08:20:53.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.693+0000 7f6f40817640 1 -- 172.21.15.88:0/3637675562 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3c15cb70 con 0x7f6f3c0a5300 2023-12-08T08:20:53.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.697+0000 7f6f40817640 1 -- 172.21.15.88:0/3637675562 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3c067630 con 0x7f6f3c0a5300 2023-12-08T08:20:53.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.697+0000 7f6f337fe640 1 -- 172.21.15.88:0/3637675562 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6f2c0b3040 con 0x7f6f3c0a5300 2023-12-08T08:20:53.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.697+0000 7f6f337fe640 1 --2- 172.21.15.88:0/3637675562 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6f1c066470 0x7f6f1c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.697+0000 7f6f337fe640 1 -- 172.21.15.88:0/3637675562 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f2c11e2e0 con 0x7f6f3c0a5300 2023-12-08T08:20:53.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.697+0000 7f6f31d9b640 1 --2- 172.21.15.88:0/3637675562 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6f1c066470 0x7f6f1c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.697+0000 7f6f31d9b640 1 --2- 172.21.15.88:0/3637675562 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6f1c066470 0x7f6f1c068930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c0a5220 tx=0x7f6f24009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:53.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.701+0000 7f6f337fe640 1 -- 172.21.15.88:0/3637675562 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6f2c0eb880 con 0x7f6f3c0a5300 2023-12-08T08:20:53.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.881+0000 7f6f40817640 1 -- 172.21.15.88:0/3637675562 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f3c0c4b20 con 0x7f6f3c0a5300 2023-12-08T08:20:53.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.881+0000 7f6f337fe640 1 -- 172.21.15.88:0/3637675562 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4910 (secure 0 0 0) 0x7f6f2c0eeea0 con 0x7f6f3c0a5300 2023-12-08T08:20:53.887 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:53.887 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/1946795737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":1946795737},{"type":"v1","addr":"172.21.15.88:6837","nonce":1946795737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/140150927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":140150927},{"type":"v1","addr":"172.21.15.148:6834","nonce":140150927}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2399327235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2399327235},{"type":"v1","addr":"172.21.15.148:6835","nonce":2399327235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:20:20.479364+0000","modified":"2023-12-08T08:20:23.493737+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/3793971563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":3793971563},{"type":"v1","addr":"172.21.15.88:6835","nonce":3793971563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T08:20:53.887 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 8 2023-12-08T08:20:53.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.881+0000 7f6f40817640 1 -- 172.21.15.88:0/3637675562 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6f1c066470 msgr2=0x7f6f1c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.881+0000 7f6f40817640 1 --2- 172.21.15.88:0/3637675562 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6f1c066470 0x7f6f1c068930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c0a5220 tx=0x7f6f24009040 comp rx=0 tx=0).stop 2023-12-08T08:20:53.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.881+0000 7f6f40817640 1 -- 172.21.15.88:0/3637675562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f3c0a5300 msgr2=0x7f6f3c0ab460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.881+0000 7f6f40817640 1 --2- 172.21.15.88:0/3637675562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f3c0a5300 0x7f6f3c0ab460 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c019fd0 tx=0x7f6f2c01abe0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.881+0000 7f6f40817640 1 -- 172.21.15.88:0/3637675562 shutdown_connections 2023-12-08T08:20:53.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.881+0000 7f6f40817640 1 --2- 172.21.15.88:0/3637675562 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6f1c066470 0x7f6f1c068930 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.881+0000 7f6f40817640 1 --2- 172.21.15.88:0/3637675562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f3c156110 0x7f6f3c070a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.881+0000 7f6f40817640 1 --2- 172.21.15.88:0/3637675562 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6f3c14fd10 0x7f6f3c15c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.881+0000 7f6f40817640 1 --2- 172.21.15.88:0/3637675562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f3c0a5300 0x7f6f3c0ab460 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.881+0000 7f6f40817640 1 -- 172.21.15.88:0/3637675562 >> 172.21.15.88:0/3637675562 conn(0x7f6f3c0a7810 msgr2=0x7f6f3c0c1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:53.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.881+0000 7f6f40817640 1 -- 172.21.15.88:0/3637675562 shutdown_connections 2023-12-08T08:20:53.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:53.881+0000 7f6f40817640 1 -- 172.21.15.88:0/3637675562 wait complete. 2023-12-08T08:20:53.908 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:54.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f45303640 1 Processor -- start 2023-12-08T08:20:54.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f45303640 1 -- start start 2023-12-08T08:20:54.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f45303640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f400c65f0 0x7f1f400c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f45303640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1f400c9210 0x7f1f4015ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f45303640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f40151f20 con 0x7f1f400c8200 2023-12-08T08:20:54.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f45303640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f40154450 con 0x7f1f400c9210 2023-12-08T08:20:54.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f45303640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f40154710 con 0x7f1f400c65f0 2023-12-08T08:20:54.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f3f7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1f400c8200 0x7f1f400c8b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40488/0 (socket says 172.21.15.88:40488) 2023-12-08T08:20:54.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f3f7fe640 1 -- 172.21.15.88:0/1251476604 learned_addr learned my addr 172.21.15.88:0/1251476604 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:54.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f3ffff640 1 --2- 172.21.15.88:0/1251476604 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f400c65f0 0x7f1f400c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f3effd640 1 -- 172.21.15.88:0/1251476604 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 327317052 0 0) 0x7f1f40151f20 con 0x7f1f400c8200 2023-12-08T08:20:54.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f3effd640 1 -- 172.21.15.88:0/1251476604 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f28003530 con 0x7f1f400c8200 2023-12-08T08:20:54.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f44b02640 1 --2- 172.21.15.88:0/1251476604 >> v2:172.21.15.148:3300/0 conn(0x7f1f400c9210 0x7f1f4015ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f3effd640 1 -- 172.21.15.88:0/1251476604 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1369978720 0 0) 0x7f1f28003530 con 0x7f1f400c8200 2023-12-08T08:20:54.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f3effd640 1 -- 172.21.15.88:0/1251476604 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f400c65f0 msgr2=0x7f1f400c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:54.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f3effd640 1 --2- 172.21.15.88:0/1251476604 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f400c65f0 0x7f1f400c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f3effd640 1 -- 172.21.15.88:0/1251476604 >> v2:172.21.15.148:3300/0 conn(0x7f1f400c9210 msgr2=0x7f1f4015ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:54.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f3effd640 1 --2- 172.21.15.88:0/1251476604 >> v2:172.21.15.148:3300/0 conn(0x7f1f400c9210 0x7f1f4015ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f3effd640 1 -- 172.21.15.88:0/1251476604 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f401549f0 con 0x7f1f400c8200 2023-12-08T08:20:54.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f3effd640 1 -- 172.21.15.88:0/1251476604 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f1f34001680 con 0x7f1f400c8200 2023-12-08T08:20:54.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f3effd640 1 -- 172.21.15.88:0/1251476604 >> v1:172.21.15.88:6789/0 conn(0x7f1f400c8200 legacy=0x7f1f400c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f3effd640 1 --2- 172.21.15.88:0/1251476604 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f400c65f0 0x7f1f28003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f3effd640 1 --2- 172.21.15.88:0/1251476604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f28003f00 0x7f1f280047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f3effd640 1 --2- 172.21.15.88:0/1251476604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f28004d10 0x7f1f28005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f3effd640 1 -- 172.21.15.88:0/1251476604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f40154450 con 0x7f1f28004d10 2023-12-08T08:20:54.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f3effd640 1 -- 172.21.15.88:0/1251476604 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f40154710 con 0x7f1f28003f00 2023-12-08T08:20:54.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f3effd640 1 -- 172.21.15.88:0/1251476604 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2800b9e0 con 0x7f1f400c65f0 2023-12-08T08:20:54.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f44b02640 1 --2- 172.21.15.88:0/1251476604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f28004d10 0x7f1f28005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f3f7fe640 1 --2- 172.21.15.88:0/1251476604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f28003f00 0x7f1f280047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f3ffff640 1 --2- 172.21.15.88:0/1251476604 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f400c65f0 0x7f1f28003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f44b02640 1 -- 172.21.15.88:0/1251476604 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f400c65f0 msgr2=0x7f1f28003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:54.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f44b02640 1 --2- 172.21.15.88:0/1251476604 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f400c65f0 0x7f1f28003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f44b02640 1 -- 172.21.15.88:0/1251476604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f28003f00 msgr2=0x7f1f280047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:54.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f44b02640 1 --2- 172.21.15.88:0/1251476604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f28003f00 0x7f1f280047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.041+0000 7f1f44b02640 1 -- 172.21.15.88:0/1251476604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f28003530 con 0x7f1f28004d10 2023-12-08T08:20:54.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.045+0000 7f1f44b02640 1 --2- 172.21.15.88:0/1251476604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f28004d10 0x7f1f28005190 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1f3800e170 tx=0x7f1f3801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79fce30eab4c14b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:54.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.045+0000 7f1f3effd640 1 -- 172.21.15.88:0/1251476604 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f380a5c90 con 0x7f1f28004d10 2023-12-08T08:20:54.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.045+0000 7f1f3effd640 1 -- 172.21.15.88:0/1251476604 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3800f040 con 0x7f1f28004d10 2023-12-08T08:20:54.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.045+0000 7f1f3effd640 1 -- 172.21.15.88:0/1251476604 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f380ad440 con 0x7f1f28004d10 2023-12-08T08:20:54.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.045+0000 7f1f45303640 1 -- 172.21.15.88:0/1251476604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f28004d10 msgr2=0x7f1f28005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.045+0000 7f1f45303640 1 --2- 172.21.15.88:0/1251476604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f28004d10 0x7f1f28005190 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1f3800e170 tx=0x7f1f3801cc80 comp rx=0 tx=0).stop 2023-12-08T08:20:54.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.045+0000 7f1f44b02640 1 -- 172.21.15.88:0/1251476604 reap_dead start 2023-12-08T08:20:54.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.045+0000 7f1f45303640 1 -- 172.21.15.88:0/1251476604 shutdown_connections 2023-12-08T08:20:54.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.045+0000 7f1f45303640 1 -- 172.21.15.88:0/1251476604 >> 172.21.15.88:0/1251476604 conn(0x7f1f400ab730 msgr2=0x7f1f400abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:54.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.045+0000 7f1f45303640 1 -- 172.21.15.88:0/1251476604 shutdown_connections 2023-12-08T08:20:54.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.045+0000 7f1f45303640 1 -- 172.21.15.88:0/1251476604 wait complete. 2023-12-08T08:20:54.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.049+0000 7f1f45303640 1 Processor -- start 2023-12-08T08:20:54.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.049+0000 7f1f45303640 1 -- start start 2023-12-08T08:20:54.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.049+0000 7f1f45303640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f28004d10 0x7f1f40157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.049+0000 7f1f45303640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f4014acf0 0x7f1f401ea000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.049+0000 7f1f45303640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f401557c0 0x7f1f40155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.049+0000 7f1f45303640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f40158860 con 0x7f1f4014acf0 2023-12-08T08:20:54.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.049+0000 7f1f45303640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f40157ac0 con 0x7f1f401557c0 2023-12-08T08:20:54.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.049+0000 7f1f45303640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f401582d0 con 0x7f1f28004d10 2023-12-08T08:20:54.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.049+0000 7f1f3f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f4014acf0 0x7f1f401ea000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.049+0000 7f1f3f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f4014acf0 0x7f1f401ea000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57342/0 (socket says 172.21.15.88:57342) 2023-12-08T08:20:54.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.049+0000 7f1f3f7fe640 1 -- 172.21.15.88:0/16180700 learned_addr learned my addr 172.21.15.88:0/16180700 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:54.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.049+0000 7f1f3ffff640 1 --2- 172.21.15.88:0/16180700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f28004d10 0x7f1f40157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.049+0000 7f1f44b02640 1 --2- 172.21.15.88:0/16180700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f401557c0 0x7f1f40155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.049+0000 7f1f3f7fe640 1 -- 172.21.15.88:0/16180700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f28004d10 msgr2=0x7f1f40157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.049+0000 7f1f3f7fe640 1 --2- 172.21.15.88:0/16180700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f28004d10 0x7f1f40157580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.049+0000 7f1f3f7fe640 1 -- 172.21.15.88:0/16180700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f401557c0 msgr2=0x7f1f40155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.049+0000 7f1f3f7fe640 1 --2- 172.21.15.88:0/16180700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f401557c0 0x7f1f40155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.049+0000 7f1f3f7fe640 1 -- 172.21.15.88:0/16180700 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f401e9840 con 0x7f1f4014acf0 2023-12-08T08:20:54.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.049+0000 7f1f3f7fe640 1 --2- 172.21.15.88:0/16180700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f4014acf0 0x7f1f401ea000 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1f34012540 tx=0x7f1f34012a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:54.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.049+0000 7f1f3cff9640 1 -- 172.21.15.88:0/16180700 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f34014810 con 0x7f1f4014acf0 2023-12-08T08:20:54.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.049+0000 7f1f3cff9640 1 -- 172.21.15.88:0/16180700 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f34014970 con 0x7f1f4014acf0 2023-12-08T08:20:54.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.049+0000 7f1f3cff9640 1 -- 172.21.15.88:0/16180700 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f34014d00 con 0x7f1f4014acf0 2023-12-08T08:20:54.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.049+0000 7f1f45303640 1 -- 172.21.15.88:0/16180700 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f40157d10 con 0x7f1f4014acf0 2023-12-08T08:20:54.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.049+0000 7f1f45303640 1 -- 172.21.15.88:0/16180700 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f401e9ae0 con 0x7f1f4014acf0 2023-12-08T08:20:54.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.053+0000 7f1f45303640 1 -- 172.21.15.88:0/16180700 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f401e96a0 con 0x7f1f4014acf0 2023-12-08T08:20:54.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.053+0000 7f1f3cff9640 1 -- 172.21.15.88:0/16180700 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1f340153e0 con 0x7f1f4014acf0 2023-12-08T08:20:54.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.053+0000 7f1f3cff9640 1 --2- 172.21.15.88:0/16180700 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1f2c0664a0 0x7f1f2c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.053+0000 7f1f3cff9640 1 -- 172.21.15.88:0/16180700 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f34086730 con 0x7f1f4014acf0 2023-12-08T08:20:54.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.053+0000 7f1f3ffff640 1 --2- 172.21.15.88:0/16180700 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1f2c0664a0 0x7f1f2c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.053+0000 7f1f3ffff640 1 --2- 172.21.15.88:0/16180700 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1f2c0664a0 0x7f1f2c068960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1f30009b20 tx=0x7f1f30008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:54.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.057+0000 7f1f3cff9640 1 -- 172.21.15.88:0/16180700 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1f401e96a0 con 0x7f1f4014acf0 2023-12-08T08:20:54.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.209+0000 7f1f45303640 1 -- 172.21.15.88:0/16180700 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f401e96a0 con 0x7f1f4014acf0 2023-12-08T08:20:54.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.213+0000 7f1f3cff9640 1 -- 172.21.15.88:0/16180700 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7f1f401e96a0 con 0x7f1f4014acf0 2023-12-08T08:20:54.218 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:54.218 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:20:21.492555+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:18.675917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:19.511013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:54.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.213+0000 7f1f45303640 1 -- 172.21.15.88:0/16180700 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1f2c0664a0 msgr2=0x7f1f2c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.213+0000 7f1f45303640 1 --2- 172.21.15.88:0/16180700 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1f2c0664a0 0x7f1f2c068960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1f30009b20 tx=0x7f1f30008040 comp rx=0 tx=0).stop 2023-12-08T08:20:54.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.213+0000 7f1f45303640 1 -- 172.21.15.88:0/16180700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f4014acf0 msgr2=0x7f1f401ea000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.213+0000 7f1f45303640 1 --2- 172.21.15.88:0/16180700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f4014acf0 0x7f1f401ea000 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1f34012540 tx=0x7f1f34012a00 comp rx=0 tx=0).stop 2023-12-08T08:20:54.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.213+0000 7f1f45303640 1 -- 172.21.15.88:0/16180700 shutdown_connections 2023-12-08T08:20:54.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.213+0000 7f1f45303640 1 --2- 172.21.15.88:0/16180700 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1f2c0664a0 0x7f1f2c068960 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.213+0000 7f1f45303640 1 --2- 172.21.15.88:0/16180700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f401557c0 0x7f1f40155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.213+0000 7f1f45303640 1 --2- 172.21.15.88:0/16180700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f4014acf0 0x7f1f401ea000 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.213+0000 7f1f45303640 1 --2- 172.21.15.88:0/16180700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f28004d10 0x7f1f40157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.213+0000 7f1f45303640 1 -- 172.21.15.88:0/16180700 >> 172.21.15.88:0/16180700 conn(0x7f1f400ab730 msgr2=0x7f1f400abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:54.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.213+0000 7f1f45303640 1 -- 172.21.15.88:0/16180700 shutdown_connections 2023-12-08T08:20:54.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.213+0000 7f1f45303640 1 -- 172.21.15.88:0/16180700 wait complete. 2023-12-08T08:20:54.239 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-08T08:20:54.239 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:20:54.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.369+0000 7f507a2d6640 1 Processor -- start 2023-12-08T08:20:54.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.369+0000 7f507a2d6640 1 -- start start 2023-12-08T08:20:54.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.369+0000 7f507a2d6640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f50740c0f30 0x7f5074072580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.369+0000 7f507a2d6640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50740c1a50 con 0x7f50740c3960 2023-12-08T08:20:54.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.369+0000 7f507a2d6640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50740c08f0 con 0x7f50740c0460 2023-12-08T08:20:54.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.369+0000 7f507a2d6640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50740c3de0 con 0x7f50740c0f30 2023-12-08T08:20:54.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.369+0000 7f50737fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f50740c3960 0x7f5074159280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40494/0 (socket says 172.21.15.88:40494) 2023-12-08T08:20:54.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.369+0000 7f50737fe640 1 -- 172.21.15.88:0/217099508 learned_addr learned my addr 172.21.15.88:0/217099508 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:54.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.369+0000 7f5073fff640 1 --2- 172.21.15.88:0/217099508 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f50740c0f30 0x7f5074072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.373+0000 7f5072ffd640 1 -- 172.21.15.88:0/217099508 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339683947 0 0) 0x7f50740c1a50 con 0x7f50740c3960 2023-12-08T08:20:54.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.373+0000 7f5072ffd640 1 -- 172.21.15.88:0/217099508 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f505c003530 con 0x7f50740c3960 2023-12-08T08:20:54.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.373+0000 7f5072ffd640 1 -- 172.21.15.88:0/217099508 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137509622 0 0) 0x7f50740c08f0 con 0x7f50740c0460 2023-12-08T08:20:54.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.373+0000 7f5072ffd640 1 -- 172.21.15.88:0/217099508 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50740c1a50 con 0x7f50740c0460 2023-12-08T08:20:54.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.373+0000 7f5073fff640 1 -- 172.21.15.88:0/217099508 >> v1:172.21.15.148:6789/0 conn(0x7f50740c0460 legacy=0x7f5074155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.373+0000 7f5073fff640 1 -- 172.21.15.88:0/217099508 >> v1:172.21.15.88:6789/0 conn(0x7f50740c3960 legacy=0x7f5074159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.373+0000 7f5073fff640 1 -- 172.21.15.88:0/217099508 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5074159990 con 0x7f50740c0f30 2023-12-08T08:20:54.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.373+0000 7f5073fff640 1 --2- 172.21.15.88:0/217099508 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f50740c0f30 0x7f5074072580 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f50640097f0 tx=0x7f506401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b839d263d762c711 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:54.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.373+0000 7f5072ffd640 1 -- 172.21.15.88:0/217099508 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50640a7070 con 0x7f50740c0f30 2023-12-08T08:20:54.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.373+0000 7f5072ffd640 1 -- 172.21.15.88:0/217099508 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50640ab430 con 0x7f50740c0f30 2023-12-08T08:20:54.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.373+0000 7f5072ffd640 1 -- 172.21.15.88:0/217099508 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50640ab7a0 con 0x7f50740c0f30 2023-12-08T08:20:54.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.377+0000 7f507a2d6640 1 -- 172.21.15.88:0/217099508 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f50740c0f30 msgr2=0x7f5074072580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.377+0000 7f507a2d6640 1 --2- 172.21.15.88:0/217099508 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f50740c0f30 0x7f5074072580 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f50640097f0 tx=0x7f506401c430 comp rx=0 tx=0).stop 2023-12-08T08:20:54.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.377+0000 7f507a2d6640 1 -- 172.21.15.88:0/217099508 shutdown_connections 2023-12-08T08:20:54.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.377+0000 7f507a2d6640 1 --2- 172.21.15.88:0/217099508 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f50740c0f30 0x7f5074072580 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.377+0000 7f507a2d6640 1 -- 172.21.15.88:0/217099508 >> 172.21.15.88:0/217099508 conn(0x7f50740a7810 msgr2=0x7f50740a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:54.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.377+0000 7f507a2d6640 1 -- 172.21.15.88:0/217099508 shutdown_connections 2023-12-08T08:20:54.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.377+0000 7f507a2d6640 1 -- 172.21.15.88:0/217099508 wait complete. 2023-12-08T08:20:54.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.377+0000 7f507a2d6640 1 Processor -- start 2023-12-08T08:20:54.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.377+0000 7f507a2d6640 1 -- start start 2023-12-08T08:20:54.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.377+0000 7f507a2d6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50740c0460 0x7f50741f14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.377+0000 7f507a2d6640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f50740c0f30 0x7f5074153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.377+0000 7f507a2d6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50740c3960 0x7f5074147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.377+0000 7f507a2d6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5074070a40 con 0x7f50740c3960 2023-12-08T08:20:54.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.377+0000 7f507a2d6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50741f1a10 con 0x7f50740c0460 2023-12-08T08:20:54.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.377+0000 7f507a2d6640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5074070ce0 con 0x7f50740c0f30 2023-12-08T08:20:54.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.377+0000 7f5078873640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50740c3960 0x7f5074147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.377+0000 7f5078873640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50740c3960 0x7f5074147be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57344/0 (socket says 172.21.15.88:57344) 2023-12-08T08:20:54.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.377+0000 7f5078873640 1 -- 172.21.15.88:0/1911851649 learned_addr learned my addr 172.21.15.88:0/1911851649 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:54.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.377+0000 7f5073fff640 1 --2- 172.21.15.88:0/1911851649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50740c0460 0x7f50741f14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.377+0000 7f50737fe640 1 --2- 172.21.15.88:0/1911851649 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f50740c0f30 0x7f5074153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.381+0000 7f5078873640 1 -- 172.21.15.88:0/1911851649 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f50740c0f30 msgr2=0x7f5074153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.381+0000 7f5078873640 1 --2- 172.21.15.88:0/1911851649 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f50740c0f30 0x7f5074153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.381+0000 7f5078873640 1 -- 172.21.15.88:0/1911851649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50740c0460 msgr2=0x7f50741f14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.381+0000 7f5078873640 1 --2- 172.21.15.88:0/1911851649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50740c0460 0x7f50741f14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.381+0000 7f5078873640 1 -- 172.21.15.88:0/1911851649 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5064009420 con 0x7f50740c3960 2023-12-08T08:20:54.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.381+0000 7f5078873640 1 --2- 172.21.15.88:0/1911851649 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50740c3960 0x7f5074147be0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f506c00c730 tx=0x7f506c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:54.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.381+0000 7f5070ff9640 1 -- 172.21.15.88:0/1911851649 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c003b80 con 0x7f50740c3960 2023-12-08T08:20:54.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.381+0000 7f5070ff9640 1 -- 172.21.15.88:0/1911851649 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506c003ce0 con 0x7f50740c3960 2023-12-08T08:20:54.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.381+0000 7f507a2d6640 1 -- 172.21.15.88:0/1911851649 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5074156760 con 0x7f50740c3960 2023-12-08T08:20:54.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.381+0000 7f5070ff9640 1 -- 172.21.15.88:0/1911851649 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c005310 con 0x7f50740c3960 2023-12-08T08:20:54.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.381+0000 7f507a2d6640 1 -- 172.21.15.88:0/1911851649 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5074153140 con 0x7f50740c3960 2023-12-08T08:20:54.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.381+0000 7f507a2d6640 1 -- 172.21.15.88:0/1911851649 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5074070e50 con 0x7f50740c3960 2023-12-08T08:20:54.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.381+0000 7f5070ff9640 1 -- 172.21.15.88:0/1911851649 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f506c005680 con 0x7f50740c3960 2023-12-08T08:20:54.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.381+0000 7f5070ff9640 1 --2- 172.21.15.88:0/1911851649 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f50600664a0 0x7f5060068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.381+0000 7f5070ff9640 1 -- 172.21.15.88:0/1911851649 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f506c083c70 con 0x7f50740c3960 2023-12-08T08:20:54.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.381+0000 7f5073fff640 1 --2- 172.21.15.88:0/1911851649 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f50600664a0 0x7f5060068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.385+0000 7f5073fff640 1 --2- 172.21.15.88:0/1911851649 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f50600664a0 0x7f5060068960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f50640af000 tx=0x7f50640a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:54.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.385+0000 7f5070ff9640 1 -- 172.21.15.88:0/1911851649 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f506c051180 con 0x7f50740c3960 2023-12-08T08:20:54.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.565+0000 7f507a2d6640 1 -- 172.21.15.88:0/1911851649 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5074067630 con 0x7f50740c3960 2023-12-08T08:20:54.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.565+0000 7f5070ff9640 1 -- 172.21.15.88:0/1911851649 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4910 (secure 0 0 0) 0x7f506c0547a0 con 0x7f50740c3960 2023-12-08T08:20:54.573 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:54.573 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/1946795737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":1946795737},{"type":"v1","addr":"172.21.15.88:6837","nonce":1946795737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/140150927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":140150927},{"type":"v1","addr":"172.21.15.148:6834","nonce":140150927}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2399327235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2399327235},{"type":"v1","addr":"172.21.15.148:6835","nonce":2399327235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:20:20.479364+0000","modified":"2023-12-08T08:20:23.493737+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/3793971563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":3793971563},{"type":"v1","addr":"172.21.15.88:6835","nonce":3793971563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T08:20:54.573 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 8 2023-12-08T08:20:54.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.569+0000 7f507a2d6640 1 -- 172.21.15.88:0/1911851649 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f50600664a0 msgr2=0x7f5060068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.569+0000 7f507a2d6640 1 --2- 172.21.15.88:0/1911851649 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f50600664a0 0x7f5060068960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f50640af000 tx=0x7f50640a7000 comp rx=0 tx=0).stop 2023-12-08T08:20:54.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.569+0000 7f507a2d6640 1 -- 172.21.15.88:0/1911851649 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50740c3960 msgr2=0x7f5074147be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.569+0000 7f507a2d6640 1 --2- 172.21.15.88:0/1911851649 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50740c3960 0x7f5074147be0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f506c00c730 tx=0x7f506c00cbf0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.569+0000 7f507a2d6640 1 -- 172.21.15.88:0/1911851649 shutdown_connections 2023-12-08T08:20:54.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.569+0000 7f507a2d6640 1 --2- 172.21.15.88:0/1911851649 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f50600664a0 0x7f5060068960 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.569+0000 7f507a2d6640 1 --2- 172.21.15.88:0/1911851649 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50740c3960 0x7f5074147be0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.569+0000 7f507a2d6640 1 --2- 172.21.15.88:0/1911851649 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f50740c0f30 0x7f5074153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.569+0000 7f507a2d6640 1 --2- 172.21.15.88:0/1911851649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50740c0460 0x7f50741f14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.569+0000 7f507a2d6640 1 -- 172.21.15.88:0/1911851649 >> 172.21.15.88:0/1911851649 conn(0x7f50740a7810 msgr2=0x7f50740a5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:54.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.569+0000 7f507a2d6640 1 -- 172.21.15.88:0/1911851649 shutdown_connections 2023-12-08T08:20:54.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.569+0000 7f507a2d6640 1 -- 172.21.15.88:0/1911851649 wait complete. 2023-12-08T08:20:54.593 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:20:54.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.725+0000 7f36367df640 1 Processor -- start 2023-12-08T08:20:54.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.725+0000 7f36367df640 1 -- start start 2023-12-08T08:20:54.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.725+0000 7f36367df640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f36300c3b80 0x7f363006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.725+0000 7f36367df640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f36300c5300 0x7f363006c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.725+0000 7f36367df640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f363006bb80 con 0x7f363006d2b0 2023-12-08T08:20:54.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.725+0000 7f36367df640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f363006cc70 con 0x7f36300c5300 2023-12-08T08:20:54.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.725+0000 7f36367df640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36300c5790 con 0x7f36300c3b80 2023-12-08T08:20:54.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.725+0000 7f3634d7c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f36300c5300 0x7f363006c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.725+0000 7f3634d7c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f36300c5300 0x7f363006c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57356/0 (socket says 172.21.15.88:57356) 2023-12-08T08:20:54.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.725+0000 7f3634d7c640 1 -- 172.21.15.88:0/3533885882 learned_addr learned my addr 172.21.15.88:0/3533885882 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:54.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.725+0000 7f362f7fe640 1 --2- 172.21.15.88:0/3533885882 >> v2:172.21.15.148:3300/0 conn(0x7f36300c3b80 0x7f363006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.725+0000 7f3634d7c640 1 -- 172.21.15.88:0/3533885882 >> v2:172.21.15.148:3300/0 conn(0x7f36300c3b80 msgr2=0x7f363006d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:54.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.725+0000 7f3634d7c640 1 --2- 172.21.15.88:0/3533885882 >> v2:172.21.15.148:3300/0 conn(0x7f36300c3b80 0x7f363006d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.725+0000 7f3634d7c640 1 -- 172.21.15.88:0/3533885882 >> v1:172.21.15.148:6789/0 conn(0x7f363006d2b0 legacy=0x7f363006c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:54.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.725+0000 7f3634d7c640 1 -- 172.21.15.88:0/3533885882 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36301515c0 con 0x7f36300c5300 2023-12-08T08:20:54.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.729+0000 7f3634d7c640 1 --2- 172.21.15.88:0/3533885882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36300c5300 0x7f363006c730 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f363006b5a0 tx=0x7f362801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10252d3530e18288 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:54.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.729+0000 7f362effd640 1 -- 172.21.15.88:0/3533885882 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36280a5730 con 0x7f36300c5300 2023-12-08T08:20:54.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.729+0000 7f362effd640 1 -- 172.21.15.88:0/3533885882 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36280a5890 con 0x7f36300c5300 2023-12-08T08:20:54.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.729+0000 7f362effd640 1 -- 172.21.15.88:0/3533885882 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36280a5c20 con 0x7f36300c5300 2023-12-08T08:20:54.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.729+0000 7f36367df640 1 -- 172.21.15.88:0/3533885882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36300c5300 msgr2=0x7f363006c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.729+0000 7f36367df640 1 --2- 172.21.15.88:0/3533885882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36300c5300 0x7f363006c730 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f363006b5a0 tx=0x7f362801c960 comp rx=0 tx=0).stop 2023-12-08T08:20:54.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.729+0000 7f36367df640 1 -- 172.21.15.88:0/3533885882 shutdown_connections 2023-12-08T08:20:54.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.729+0000 7f36367df640 1 --2- 172.21.15.88:0/3533885882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36300c5300 0x7f363006c730 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.729+0000 7f36367df640 1 --2- 172.21.15.88:0/3533885882 >> v2:172.21.15.148:3300/0 conn(0x7f36300c3b80 0x7f363006d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.729+0000 7f36367df640 1 -- 172.21.15.88:0/3533885882 >> 172.21.15.88:0/3533885882 conn(0x7f36300a7810 msgr2=0x7f36300a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:54.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.729+0000 7f36367df640 1 -- 172.21.15.88:0/3533885882 shutdown_connections 2023-12-08T08:20:54.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.729+0000 7f36367df640 1 -- 172.21.15.88:0/3533885882 wait complete. 2023-12-08T08:20:54.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.733+0000 7f36367df640 1 Processor -- start 2023-12-08T08:20:54.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.733+0000 7f36367df640 1 -- start start 2023-12-08T08:20:54.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.733+0000 7f36367df640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f363006d2b0 0x7f36300a87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.733+0000 7f36367df640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36300c3b80 0x7f363014e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.733+0000 7f36367df640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36300c5300 0x7f36301ed400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.733+0000 7f36367df640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36300ab840 con 0x7f36300c3b80 2023-12-08T08:20:54.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.733+0000 7f36367df640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36300ab280 con 0x7f36300c5300 2023-12-08T08:20:54.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.733+0000 7f36367df640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36300ab560 con 0x7f363006d2b0 2023-12-08T08:20:54.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.733+0000 7f362f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36300c3b80 0x7f363014e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.733+0000 7f362f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36300c3b80 0x7f363014e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57360/0 (socket says 172.21.15.88:57360) 2023-12-08T08:20:54.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.733+0000 7f362f7fe640 1 -- 172.21.15.88:0/2962247584 learned_addr learned my addr 172.21.15.88:0/2962247584 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:54.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.733+0000 7f362ffff640 1 --2- 172.21.15.88:0/2962247584 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f363006d2b0 0x7f36300a87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.733+0000 7f3634d7c640 1 --2- 172.21.15.88:0/2962247584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36300c5300 0x7f36301ed400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.733+0000 7f362f7fe640 1 -- 172.21.15.88:0/2962247584 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f363006d2b0 msgr2=0x7f36300a87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.733+0000 7f362f7fe640 1 --2- 172.21.15.88:0/2962247584 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f363006d2b0 0x7f36300a87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.733+0000 7f362f7fe640 1 -- 172.21.15.88:0/2962247584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36300c5300 msgr2=0x7f36301ed400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.733+0000 7f362f7fe640 1 --2- 172.21.15.88:0/2962247584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36300c5300 0x7f36301ed400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.733+0000 7f362f7fe640 1 -- 172.21.15.88:0/2962247584 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3628009b30 con 0x7f36300c3b80 2023-12-08T08:20:54.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.733+0000 7f362f7fe640 1 --2- 172.21.15.88:0/2962247584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36300c3b80 0x7f363014e0b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f362400d800 tx=0x7f362400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:54.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.733+0000 7f362cff9640 1 -- 172.21.15.88:0/2962247584 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362400b6c0 con 0x7f36300c3b80 2023-12-08T08:20:54.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.733+0000 7f362cff9640 1 -- 172.21.15.88:0/2962247584 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362400b820 con 0x7f36300c3b80 2023-12-08T08:20:54.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.733+0000 7f362cff9640 1 -- 172.21.15.88:0/2962247584 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362400bb90 con 0x7f36300c3b80 2023-12-08T08:20:54.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.733+0000 7f36367df640 1 -- 172.21.15.88:0/2962247584 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f363014ef80 con 0x7f36300c3b80 2023-12-08T08:20:54.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.733+0000 7f36367df640 1 -- 172.21.15.88:0/2962247584 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36301ecee0 con 0x7f36300c3b80 2023-12-08T08:20:54.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.737+0000 7f36367df640 1 -- 172.21.15.88:0/2962247584 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36300a82f0 con 0x7f36300c3b80 2023-12-08T08:20:54.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.737+0000 7f362cff9640 1 -- 172.21.15.88:0/2962247584 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f362400bcf0 con 0x7f36300c3b80 2023-12-08T08:20:54.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.737+0000 7f362cff9640 1 --2- 172.21.15.88:0/2962247584 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f361c066470 0x7f361c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.737+0000 7f362cff9640 1 -- 172.21.15.88:0/2962247584 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3624084320 con 0x7f36300c3b80 2023-12-08T08:20:54.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.737+0000 7f362ffff640 1 --2- 172.21.15.88:0/2962247584 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f361c066470 0x7f361c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.737+0000 7f362ffff640 1 --2- 172.21.15.88:0/2962247584 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f361c066470 0x7f361c068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3620007fd0 tx=0x7f3620007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:54.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.741+0000 7f362cff9640 1 -- 172.21.15.88:0/2962247584 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f36240517b0 con 0x7f36300c3b80 2023-12-08T08:20:54.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.925+0000 7f36367df640 1 -- 172.21.15.88:0/2962247584 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36301ed0a0 con 0x7f36300c3b80 2023-12-08T08:20:54.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.925+0000 7f362cff9640 1 -- 172.21.15.88:0/2962247584 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4910 (secure 0 0 0) 0x7f3624054dd0 con 0x7f36300c3b80 2023-12-08T08:20:54.930 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:54.930 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/1946795737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":1946795737},{"type":"v1","addr":"172.21.15.88:6837","nonce":1946795737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/140150927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":140150927},{"type":"v1","addr":"172.21.15.148:6834","nonce":140150927}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2399327235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2399327235},{"type":"v1","addr":"172.21.15.148:6835","nonce":2399327235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:20:20.479364+0000","modified":"2023-12-08T08:20:23.493737+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/3793971563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":3793971563},{"type":"v1","addr":"172.21.15.88:6835","nonce":3793971563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T08:20:54.930 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 8 2023-12-08T08:20:54.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.925+0000 7f36367df640 1 -- 172.21.15.88:0/2962247584 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f361c066470 msgr2=0x7f361c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.925+0000 7f36367df640 1 --2- 172.21.15.88:0/2962247584 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f361c066470 0x7f361c068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3620007fd0 tx=0x7f3620007e40 comp rx=0 tx=0).stop 2023-12-08T08:20:54.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.925+0000 7f36367df640 1 -- 172.21.15.88:0/2962247584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36300c3b80 msgr2=0x7f363014e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.925+0000 7f36367df640 1 --2- 172.21.15.88:0/2962247584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36300c3b80 0x7f363014e0b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f362400d800 tx=0x7f362400dcc0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.925+0000 7f36367df640 1 -- 172.21.15.88:0/2962247584 shutdown_connections 2023-12-08T08:20:54.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.925+0000 7f36367df640 1 --2- 172.21.15.88:0/2962247584 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f361c066470 0x7f361c068930 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.925+0000 7f36367df640 1 --2- 172.21.15.88:0/2962247584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36300c5300 0x7f36301ed400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.925+0000 7f36367df640 1 --2- 172.21.15.88:0/2962247584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36300c3b80 0x7f363014e0b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.925+0000 7f36367df640 1 --2- 172.21.15.88:0/2962247584 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f363006d2b0 0x7f36300a87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.925+0000 7f36367df640 1 -- 172.21.15.88:0/2962247584 >> 172.21.15.88:0/2962247584 conn(0x7f36300a7810 msgr2=0x7f3630154b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:54.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.925+0000 7f36367df640 1 -- 172.21.15.88:0/2962247584 shutdown_connections 2023-12-08T08:20:54.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:54.925+0000 7f36367df640 1 -- 172.21.15.88:0/2962247584 wait complete. 2023-12-08T08:20:54.951 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:55.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.081+0000 7f0d9b180640 1 Processor -- start 2023-12-08T08:20:55.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.081+0000 7f0d9b180640 1 -- start start 2023-12-08T08:20:55.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.081+0000 7f0d9b180640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d9406d2b0 0x7f0d9406d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.081+0000 7f0d9b180640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d9406bb80 con 0x7f0d940c5300 2023-12-08T08:20:55.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.081+0000 7f0d9b180640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d940c5790 con 0x7f0d940c3b80 2023-12-08T08:20:55.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.081+0000 7f0d9b180640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d941515c0 con 0x7f0d9406d2b0 2023-12-08T08:20:55.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.085+0000 7f0d9971d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0d940c5300 0x7f0d9406c730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40508/0 (socket says 172.21.15.88:40508) 2023-12-08T08:20:55.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.085+0000 7f0d9971d640 1 -- 172.21.15.88:0/790572966 learned_addr learned my addr 172.21.15.88:0/790572966 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:55.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.085+0000 7f0d98f1c640 1 --2- 172.21.15.88:0/790572966 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d9406d2b0 0x7f0d9406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.085+0000 7f0d8b7fe640 1 -- 172.21.15.88:0/790572966 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207644956 0 0) 0x7f0d9406bb80 con 0x7f0d940c5300 2023-12-08T08:20:55.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.085+0000 7f0d8b7fe640 1 -- 172.21.15.88:0/790572966 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d7c003530 con 0x7f0d940c5300 2023-12-08T08:20:55.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.085+0000 7f0d8b7fe640 1 -- 172.21.15.88:0/790572966 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721084471 0 0) 0x7f0d940c5790 con 0x7f0d940c3b80 2023-12-08T08:20:55.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.085+0000 7f0d8b7fe640 1 -- 172.21.15.88:0/790572966 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d9406bb80 con 0x7f0d940c3b80 2023-12-08T08:20:55.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.085+0000 7f0d98f1c640 1 -- 172.21.15.88:0/790572966 >> v1:172.21.15.148:6789/0 conn(0x7f0d940c3b80 legacy=0x7f0d9406c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.085+0000 7f0d98f1c640 1 -- 172.21.15.88:0/790572966 >> v1:172.21.15.88:6789/0 conn(0x7f0d940c5300 legacy=0x7f0d9406c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.085+0000 7f0d98f1c640 1 -- 172.21.15.88:0/790572966 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d941518a0 con 0x7f0d9406d2b0 2023-12-08T08:20:55.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.085+0000 7f0d98f1c640 1 --2- 172.21.15.88:0/790572966 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d9406d2b0 0x7f0d9406d690 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0d900097f0 tx=0x7f0d9001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2cac3ca30d05f19 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:55.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.089+0000 7f0d8b7fe640 1 -- 172.21.15.88:0/790572966 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d900ac600 con 0x7f0d9406d2b0 2023-12-08T08:20:55.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.089+0000 7f0d8b7fe640 1 -- 172.21.15.88:0/790572966 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d900a8050 con 0x7f0d9406d2b0 2023-12-08T08:20:55.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.089+0000 7f0d8b7fe640 1 -- 172.21.15.88:0/790572966 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d900ac980 con 0x7f0d9406d2b0 2023-12-08T08:20:55.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.089+0000 7f0d9b180640 1 -- 172.21.15.88:0/790572966 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d9406d2b0 msgr2=0x7f0d9406d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.089+0000 7f0d9b180640 1 --2- 172.21.15.88:0/790572966 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d9406d2b0 0x7f0d9406d690 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0d900097f0 tx=0x7f0d9001c490 comp rx=0 tx=0).stop 2023-12-08T08:20:55.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.089+0000 7f0d9b180640 1 -- 172.21.15.88:0/790572966 shutdown_connections 2023-12-08T08:20:55.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.089+0000 7f0d9b180640 1 --2- 172.21.15.88:0/790572966 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d9406d2b0 0x7f0d9406d690 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.089+0000 7f0d9b180640 1 -- 172.21.15.88:0/790572966 >> 172.21.15.88:0/790572966 conn(0x7f0d940a7810 msgr2=0x7f0d940a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:55.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.089+0000 7f0d9b180640 1 -- 172.21.15.88:0/790572966 shutdown_connections 2023-12-08T08:20:55.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.089+0000 7f0d9b180640 1 -- 172.21.15.88:0/790572966 wait complete. 2023-12-08T08:20:55.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.089+0000 7f0d9b180640 1 Processor -- start 2023-12-08T08:20:55.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.089+0000 7f0d9b180640 1 -- start start 2023-12-08T08:20:55.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.089+0000 7f0d9b180640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d9406d2b0 0x7f0d941f0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.089+0000 7f0d9b180640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d940c3b80 0x7f0d940bf380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.089+0000 7f0d9b180640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d940c5300 0x7f0d940aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.089+0000 7f0d9b180640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d941512a0 con 0x7f0d9406d2b0 2023-12-08T08:20:55.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.089+0000 7f0d9b180640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d941f11e0 con 0x7f0d940c5300 2023-12-08T08:20:55.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.089+0000 7f0d9b180640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d94150a00 con 0x7f0d940c3b80 2023-12-08T08:20:55.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.089+0000 7f0d98f1c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d9406d2b0 0x7f0d941f0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.089+0000 7f0d98f1c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d9406d2b0 0x7f0d941f0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57362/0 (socket says 172.21.15.88:57362) 2023-12-08T08:20:55.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.089+0000 7f0d98f1c640 1 -- 172.21.15.88:0/2393668036 learned_addr learned my addr 172.21.15.88:0/2393668036 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:55.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.093+0000 7f0d9971d640 1 --2- 172.21.15.88:0/2393668036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d940c5300 0x7f0d940aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.093+0000 7f0d8bfff640 1 --2- 172.21.15.88:0/2393668036 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d940c3b80 0x7f0d940bf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.093+0000 7f0d98f1c640 1 -- 172.21.15.88:0/2393668036 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d940c3b80 msgr2=0x7f0d940bf380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.093+0000 7f0d98f1c640 1 --2- 172.21.15.88:0/2393668036 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d940c3b80 0x7f0d940bf380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.093+0000 7f0d98f1c640 1 -- 172.21.15.88:0/2393668036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d940c5300 msgr2=0x7f0d940aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.093+0000 7f0d98f1c640 1 --2- 172.21.15.88:0/2393668036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d940c5300 0x7f0d940aae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.093+0000 7f0d98f1c640 1 -- 172.21.15.88:0/2393668036 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d90009420 con 0x7f0d9406d2b0 2023-12-08T08:20:55.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.093+0000 7f0d98f1c640 1 --2- 172.21.15.88:0/2393668036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d9406d2b0 0x7f0d941f0ca0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0d900097f0 tx=0x7f0d9001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:55.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.093+0000 7f0d897fa640 1 -- 172.21.15.88:0/2393668036 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d900b7420 con 0x7f0d9406d2b0 2023-12-08T08:20:55.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.093+0000 7f0d897fa640 1 -- 172.21.15.88:0/2393668036 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d900b75a0 con 0x7f0d9406d2b0 2023-12-08T08:20:55.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.093+0000 7f0d9b180640 1 -- 172.21.15.88:0/2393668036 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d9414ef80 con 0x7f0d9406d2b0 2023-12-08T08:20:55.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.093+0000 7f0d897fa640 1 -- 172.21.15.88:0/2393668036 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d900b7950 con 0x7f0d9406d2b0 2023-12-08T08:20:55.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.093+0000 7f0d9b180640 1 -- 172.21.15.88:0/2393668036 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d94150fc0 con 0x7f0d9406d2b0 2023-12-08T08:20:55.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.093+0000 7f0d9b180640 1 -- 172.21.15.88:0/2393668036 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d94067630 con 0x7f0d9406d2b0 2023-12-08T08:20:55.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.093+0000 7f0d897fa640 1 -- 172.21.15.88:0/2393668036 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0d900b3040 con 0x7f0d9406d2b0 2023-12-08T08:20:55.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.093+0000 7f0d897fa640 1 --2- 172.21.15.88:0/2393668036 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0d80066470 0x7f0d80068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.093+0000 7f0d897fa640 1 -- 172.21.15.88:0/2393668036 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d9011e210 con 0x7f0d9406d2b0 2023-12-08T08:20:55.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.093+0000 7f0d8bfff640 1 --2- 172.21.15.88:0/2393668036 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0d80066470 0x7f0d80068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.097+0000 7f0d8bfff640 1 --2- 172.21.15.88:0/2393668036 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0d80066470 0x7f0d80068930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0d94150910 tx=0x7f0d84009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:55.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.097+0000 7f0d897fa640 1 -- 172.21.15.88:0/2393668036 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0d900eb680 con 0x7f0d9406d2b0 2023-12-08T08:20:55.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.249+0000 7f0d9b180640 1 -- 172.21.15.88:0/2393668036 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d94067bc0 con 0x7f0d9406d2b0 2023-12-08T08:20:55.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.249+0000 7f0d897fa640 1 -- 172.21.15.88:0/2393668036 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16481 (secure 0 0 0) 0x7f0d900eeca0 con 0x7f0d9406d2b0 2023-12-08T08:20:55.256 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:20:55.256 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:20:21.492555+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:18.675917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:19.511013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:55.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.253+0000 7f0d9b180640 1 -- 172.21.15.88:0/2393668036 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0d80066470 msgr2=0x7f0d80068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.253+0000 7f0d9b180640 1 --2- 172.21.15.88:0/2393668036 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0d80066470 0x7f0d80068930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0d94150910 tx=0x7f0d84009040 comp rx=0 tx=0).stop 2023-12-08T08:20:55.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.253+0000 7f0d9b180640 1 -- 172.21.15.88:0/2393668036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d9406d2b0 msgr2=0x7f0d941f0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.253+0000 7f0d9b180640 1 --2- 172.21.15.88:0/2393668036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d9406d2b0 0x7f0d941f0ca0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0d900097f0 tx=0x7f0d9001acd0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.253+0000 7f0d9b180640 1 -- 172.21.15.88:0/2393668036 shutdown_connections 2023-12-08T08:20:55.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.253+0000 7f0d9b180640 1 --2- 172.21.15.88:0/2393668036 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0d80066470 0x7f0d80068930 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.253+0000 7f0d9b180640 1 --2- 172.21.15.88:0/2393668036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0d940c5300 0x7f0d940aae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.253+0000 7f0d9b180640 1 --2- 172.21.15.88:0/2393668036 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0d940c3b80 0x7f0d940bf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.253+0000 7f0d9b180640 1 --2- 172.21.15.88:0/2393668036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d9406d2b0 0x7f0d941f0ca0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.253+0000 7f0d9b180640 1 -- 172.21.15.88:0/2393668036 >> 172.21.15.88:0/2393668036 conn(0x7f0d940a7810 msgr2=0x7f0d940c0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:55.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.253+0000 7f0d9b180640 1 -- 172.21.15.88:0/2393668036 shutdown_connections 2023-12-08T08:20:55.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.253+0000 7f0d9b180640 1 -- 172.21.15.88:0/2393668036 wait complete. 2023-12-08T08:20:55.277 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-08T08:20:55.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.409+0000 7ffbc3d1d640 1 Processor -- start 2023-12-08T08:20:55.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.409+0000 7ffbc3d1d640 1 -- start start 2023-12-08T08:20:55.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.409+0000 7ffbc3d1d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffbbc070090 0x7ffbbc0c2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.409+0000 7ffbc3d1d640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ffbbc072310 0x7ffbbc0bfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.409+0000 7ffbc3d1d640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbbc0c6ab0 con 0x7ffbbc14e550 2023-12-08T08:20:55.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.409+0000 7ffbc3d1d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbbc14e930 con 0x7ffbbc070090 2023-12-08T08:20:55.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.409+0000 7ffbc3d1d640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbbc0ac150 con 0x7ffbbc072310 2023-12-08T08:20:55.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.413+0000 7ffbc12b8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffbbc070090 0x7ffbbc0c2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.413+0000 7ffbc12b8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffbbc070090 0x7ffbbc0c2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57378/0 (socket says 172.21.15.88:57378) 2023-12-08T08:20:55.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.413+0000 7ffbc12b8640 1 -- 172.21.15.88:0/405115114 learned_addr learned my addr 172.21.15.88:0/405115114 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:55.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.413+0000 7ffbc22ba640 1 --2- 172.21.15.88:0/405115114 >> v2:172.21.15.148:3300/0 conn(0x7ffbbc072310 0x7ffbbc0bfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.413+0000 7ffbc12b8640 1 -- 172.21.15.88:0/405115114 >> v2:172.21.15.148:3300/0 conn(0x7ffbbc072310 msgr2=0x7ffbbc0bfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:55.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.413+0000 7ffbc12b8640 1 --2- 172.21.15.88:0/405115114 >> v2:172.21.15.148:3300/0 conn(0x7ffbbc072310 0x7ffbbc0bfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.413+0000 7ffbc12b8640 1 -- 172.21.15.88:0/405115114 >> v1:172.21.15.148:6789/0 conn(0x7ffbbc14e550 legacy=0x7ffbbc154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.413+0000 7ffbc12b8640 1 -- 172.21.15.88:0/405115114 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbbc0c64f0 con 0x7ffbbc070090 2023-12-08T08:20:55.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.413+0000 7ffbc12b8640 1 --2- 172.21.15.88:0/405115114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbbc070090 0x7ffbbc0c2260 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc072780 tx=0x7ffbac01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e01b2456ab975cc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:55.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.413+0000 7ffbc0ab7640 1 -- 172.21.15.88:0/405115114 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac0ad660 con 0x7ffbbc070090 2023-12-08T08:20:55.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.413+0000 7ffbc0ab7640 1 -- 172.21.15.88:0/405115114 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbac0ad7c0 con 0x7ffbbc070090 2023-12-08T08:20:55.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.413+0000 7ffbc0ab7640 1 -- 172.21.15.88:0/405115114 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac0adb50 con 0x7ffbbc070090 2023-12-08T08:20:55.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbc3d1d640 1 -- 172.21.15.88:0/405115114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbbc070090 msgr2=0x7ffbbc0c2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbc3d1d640 1 --2- 172.21.15.88:0/405115114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbbc070090 0x7ffbbc0c2260 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc072780 tx=0x7ffbac01c470 comp rx=0 tx=0).stop 2023-12-08T08:20:55.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbc3d1d640 1 -- 172.21.15.88:0/405115114 shutdown_connections 2023-12-08T08:20:55.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbc3d1d640 1 --2- 172.21.15.88:0/405115114 >> v2:172.21.15.148:3300/0 conn(0x7ffbbc072310 0x7ffbbc0bfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbc3d1d640 1 --2- 172.21.15.88:0/405115114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbbc070090 0x7ffbbc0c2260 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbc3d1d640 1 -- 172.21.15.88:0/405115114 >> 172.21.15.88:0/405115114 conn(0x7ffbbc06d2e0 msgr2=0x7ffbbc06d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:55.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbc3d1d640 1 -- 172.21.15.88:0/405115114 shutdown_connections 2023-12-08T08:20:55.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbc3d1d640 1 -- 172.21.15.88:0/405115114 wait complete. 2023-12-08T08:20:55.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbc3d1d640 1 Processor -- start 2023-12-08T08:20:55.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbc3d1d640 1 -- start start 2023-12-08T08:20:55.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbc3d1d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbbc070090 0x7ffbbc152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbc3d1d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbbc072310 0x7ffbbc13f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbc3d1d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbbc14e550 0x7ffbbc149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbc3d1d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc13f190 con 0x7ffbbc072310 2023-12-08T08:20:55.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbc3d1d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc13e510 con 0x7ffbbc070090 2023-12-08T08:20:55.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbc3d1d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc13e7f0 con 0x7ffbbc14e550 2023-12-08T08:20:55.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbc12b8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbbc072310 0x7ffbbc13f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbc12b8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbbc072310 0x7ffbbc13f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57394/0 (socket says 172.21.15.88:57394) 2023-12-08T08:20:55.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbc12b8640 1 -- 172.21.15.88:0/1945551013 learned_addr learned my addr 172.21.15.88:0/1945551013 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:55.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbc1ab9640 1 --2- 172.21.15.88:0/1945551013 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbbc070090 0x7ffbbc152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbc22ba640 1 --2- 172.21.15.88:0/1945551013 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbbc14e550 0x7ffbbc149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbc12b8640 1 -- 172.21.15.88:0/1945551013 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbbc14e550 msgr2=0x7ffbbc149e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbc12b8640 1 --2- 172.21.15.88:0/1945551013 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbbc14e550 0x7ffbbc149e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbc12b8640 1 -- 172.21.15.88:0/1945551013 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbbc070090 msgr2=0x7ffbbc152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbc12b8640 1 --2- 172.21.15.88:0/1945551013 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbbc070090 0x7ffbbc152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbc12b8640 1 -- 172.21.15.88:0/1945551013 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbac0094d0 con 0x7ffbbc072310 2023-12-08T08:20:55.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbc12b8640 1 --2- 172.21.15.88:0/1945551013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbbc072310 0x7ffbbc13f5b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ffbac019080 tx=0x7ffbac019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:55.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.417+0000 7ffbb27fc640 1 -- 172.21.15.88:0/1945551013 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac0b6640 con 0x7ffbbc072310 2023-12-08T08:20:55.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.421+0000 7ffbb27fc640 1 -- 172.21.15.88:0/1945551013 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbac0b67a0 con 0x7ffbbc072310 2023-12-08T08:20:55.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.421+0000 7ffbb27fc640 1 -- 172.21.15.88:0/1945551013 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac0b6b30 con 0x7ffbbc072310 2023-12-08T08:20:55.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.421+0000 7ffbc3d1d640 1 -- 172.21.15.88:0/1945551013 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbbc13ead0 con 0x7ffbbc072310 2023-12-08T08:20:55.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.421+0000 7ffbc3d1d640 1 -- 172.21.15.88:0/1945551013 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbbc140240 con 0x7ffbbc072310 2023-12-08T08:20:55.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.421+0000 7ffbc3d1d640 1 -- 172.21.15.88:0/1945551013 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbbc070ed0 con 0x7ffbbc072310 2023-12-08T08:20:55.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.421+0000 7ffbb27fc640 1 -- 172.21.15.88:0/1945551013 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffbac0b4070 con 0x7ffbbc072310 2023-12-08T08:20:55.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.421+0000 7ffbb27fc640 1 --2- 172.21.15.88:0/1945551013 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffba0066470 0x7ffba0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.421+0000 7ffbb27fc640 1 -- 172.21.15.88:0/1945551013 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffbac11df10 con 0x7ffbbc072310 2023-12-08T08:20:55.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.421+0000 7ffbc1ab9640 1 --2- 172.21.15.88:0/1945551013 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffba0066470 0x7ffba0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.421+0000 7ffbc1ab9640 1 --2- 172.21.15.88:0/1945551013 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffba0066470 0x7ffba0068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8007fd0 tx=0x7ffbb8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:55.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.425+0000 7ffbb27fc640 1 -- 172.21.15.88:0/1945551013 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffbac0eb420 con 0x7ffbbc072310 2023-12-08T08:20:55.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.609+0000 7ffbc3d1d640 1 -- 172.21.15.88:0/1945551013 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ffbbc067630 con 0x7ffbbc072310 2023-12-08T08:20:55.615 INFO:tasks.ceph.mon.a.smithi088.stderr:2023-12-08T08:20:55.609+0000 7f9f56907640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-08T08:20:55.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.613+0000 7ffbb27fc640 1 -- 172.21.15.88:0/1945551013 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7ffbac0eea40 con 0x7ffbbc072310 2023-12-08T08:20:55.618 INFO:teuthology.orchestra.run.smithi088.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-08T08:20:55.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.613+0000 7ffbc3d1d640 1 -- 172.21.15.88:0/1945551013 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffba0066470 msgr2=0x7ffba0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.613+0000 7ffbc3d1d640 1 --2- 172.21.15.88:0/1945551013 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffba0066470 0x7ffba0068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8007fd0 tx=0x7ffbb8009040 comp rx=0 tx=0).stop 2023-12-08T08:20:55.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.613+0000 7ffbc3d1d640 1 -- 172.21.15.88:0/1945551013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbbc072310 msgr2=0x7ffbbc13f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.613+0000 7ffbc3d1d640 1 --2- 172.21.15.88:0/1945551013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbbc072310 0x7ffbbc13f5b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ffbac019080 tx=0x7ffbac019210 comp rx=0 tx=0).stop 2023-12-08T08:20:55.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.617+0000 7ffbc3d1d640 1 -- 172.21.15.88:0/1945551013 shutdown_connections 2023-12-08T08:20:55.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.617+0000 7ffbc3d1d640 1 --2- 172.21.15.88:0/1945551013 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffba0066470 0x7ffba0068930 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.617+0000 7ffbc3d1d640 1 --2- 172.21.15.88:0/1945551013 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbbc14e550 0x7ffbbc149e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.617+0000 7ffbc3d1d640 1 --2- 172.21.15.88:0/1945551013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbbc072310 0x7ffbbc13f5b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.617+0000 7ffbc3d1d640 1 --2- 172.21.15.88:0/1945551013 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbbc070090 0x7ffbbc152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.617+0000 7ffbc3d1d640 1 -- 172.21.15.88:0/1945551013 >> 172.21.15.88:0/1945551013 conn(0x7ffbbc06d2e0 msgr2=0x7ffbbc06bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:55.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.617+0000 7ffbc3d1d640 1 -- 172.21.15.88:0/1945551013 shutdown_connections 2023-12-08T08:20:55.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.617+0000 7ffbc3d1d640 1 -- 172.21.15.88:0/1945551013 wait complete. 2023-12-08T08:20:55.635 INFO:tasks.ceph.mds.a.smithi088.stderr: -5405> 2023-12-08T08:20:24.062+0000 7f10a1c0a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:20:55.649 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-08T08:20:55.691 INFO:tasks.ceph.mds.a.smithi088.stdout:starting mds.a at 2023-12-08T08:20:55.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.785+0000 7f2970a68640 1 Processor -- start 2023-12-08T08:20:55.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.789+0000 7f2970a68640 1 -- start start 2023-12-08T08:20:55.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.789+0000 7f2970a68640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f296c14fc30 0x7f296c0c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.789+0000 7f2970a68640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f296c06d840 0x7f296c0c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.789+0000 7f2970a68640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f296c152910 con 0x7f296c14f850 2023-12-08T08:20:55.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.789+0000 7f2970a68640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f296c0c2240 con 0x7f296c14fc30 2023-12-08T08:20:55.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.789+0000 7f2970a68640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f296c152bf0 con 0x7f296c06d840 2023-12-08T08:20:55.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.789+0000 7f2961d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f296c14fc30 0x7f296c0c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.789+0000 7f2961d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f296c14fc30 0x7f296c0c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57412/0 (socket says 172.21.15.88:57412) 2023-12-08T08:20:55.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.789+0000 7f2961d9b640 1 -- 172.21.15.88:0/2526846576 learned_addr learned my addr 172.21.15.88:0/2526846576 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:55.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.789+0000 7f296ad9d640 1 --2- 172.21.15.88:0/2526846576 >> v2:172.21.15.148:3300/0 conn(0x7f296c06d840 0x7f296c0c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.789+0000 7f2961d9b640 1 -- 172.21.15.88:0/2526846576 >> v2:172.21.15.148:3300/0 conn(0x7f296c06d840 msgr2=0x7f296c0c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:55.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.789+0000 7f2961d9b640 1 --2- 172.21.15.88:0/2526846576 >> v2:172.21.15.148:3300/0 conn(0x7f296c06d840 0x7f296c0c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.789+0000 7f2961d9b640 1 -- 172.21.15.88:0/2526846576 >> v1:172.21.15.148:6789/0 conn(0x7f296c14f850 legacy=0x7f296c0aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:55.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.789+0000 7f2961d9b640 1 -- 172.21.15.88:0/2526846576 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296c152ed0 con 0x7f296c14fc30 2023-12-08T08:20:55.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.793+0000 7f2961d9b640 1 --2- 172.21.15.88:0/2526846576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f296c14fc30 0x7f296c0c3cd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f296c0c2440 tx=0x7f295401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974b465640c2ff3d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:55.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.793+0000 7f2969d9b640 1 -- 172.21.15.88:0/2526846576 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29540ab5f0 con 0x7f296c14fc30 2023-12-08T08:20:55.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.793+0000 7f2969d9b640 1 -- 172.21.15.88:0/2526846576 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29540ab750 con 0x7f296c14fc30 2023-12-08T08:20:55.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.793+0000 7f2969d9b640 1 -- 172.21.15.88:0/2526846576 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29540abae0 con 0x7f296c14fc30 2023-12-08T08:20:55.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.793+0000 7f2970a68640 1 -- 172.21.15.88:0/2526846576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f296c14fc30 msgr2=0x7f296c0c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.793+0000 7f2970a68640 1 --2- 172.21.15.88:0/2526846576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f296c14fc30 0x7f296c0c3cd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f296c0c2440 tx=0x7f295401c4c0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.793+0000 7f2970a68640 1 -- 172.21.15.88:0/2526846576 shutdown_connections 2023-12-08T08:20:55.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.793+0000 7f2970a68640 1 --2- 172.21.15.88:0/2526846576 >> v2:172.21.15.148:3300/0 conn(0x7f296c06d840 0x7f296c0c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.793+0000 7f2970a68640 1 --2- 172.21.15.88:0/2526846576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f296c14fc30 0x7f296c0c3cd0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.793+0000 7f2970a68640 1 -- 172.21.15.88:0/2526846576 >> 172.21.15.88:0/2526846576 conn(0x7f296c0c59f0 msgr2=0x7f296c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:55.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.793+0000 7f2970a68640 1 -- 172.21.15.88:0/2526846576 shutdown_connections 2023-12-08T08:20:55.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.793+0000 7f2970a68640 1 -- 172.21.15.88:0/2526846576 wait complete. 2023-12-08T08:20:55.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.793+0000 7f2970a68640 1 Processor -- start 2023-12-08T08:20:55.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.793+0000 7f2970a68640 1 -- start start 2023-12-08T08:20:55.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.797+0000 7f2970a68640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f296c06d840 0x7f296c14a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.797+0000 7f2970a68640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f296c14f850 0x7f296c0a5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.797+0000 7f2970a68640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f296c14fc30 0x7f296c0a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.797+0000 7f2970a68640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296c06fcc0 con 0x7f296c06d840 2023-12-08T08:20:55.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.797+0000 7f2970a68640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296c1ee500 con 0x7f296c14f850 2023-12-08T08:20:55.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.797+0000 7f2970a68640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296c067fa0 con 0x7f296c14fc30 2023-12-08T08:20:55.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.797+0000 7f296a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f296c06d840 0x7f296c14a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.797+0000 7f296a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f296c06d840 0x7f296c14a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57420/0 (socket says 172.21.15.88:57420) 2023-12-08T08:20:55.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.797+0000 7f296a59c640 1 -- 172.21.15.88:0/1947035938 learned_addr learned my addr 172.21.15.88:0/1947035938 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:55.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.797+0000 7f2961d9b640 1 --2- 172.21.15.88:0/1947035938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f296c14f850 0x7f296c0a5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.797+0000 7f296ad9d640 1 --2- 172.21.15.88:0/1947035938 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f296c14fc30 0x7f296c0a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.797+0000 7f296a59c640 1 -- 172.21.15.88:0/1947035938 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f296c14fc30 msgr2=0x7f296c0a5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.797+0000 7f296a59c640 1 --2- 172.21.15.88:0/1947035938 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f296c14fc30 0x7f296c0a5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.797+0000 7f296a59c640 1 -- 172.21.15.88:0/1947035938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f296c14f850 msgr2=0x7f296c0a5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.797+0000 7f296a59c640 1 --2- 172.21.15.88:0/1947035938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f296c14f850 0x7f296c0a5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.797+0000 7f296a59c640 1 -- 172.21.15.88:0/1947035938 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29540094d0 con 0x7f296c06d840 2023-12-08T08:20:55.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.797+0000 7f2961d9b640 1 --2- 172.21.15.88:0/1947035938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f296c14f850 0x7f296c0a5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:55.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.797+0000 7f296ad9d640 1 --2- 172.21.15.88:0/1947035938 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f296c14fc30 0x7f296c0a5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:55.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.797+0000 7f296a59c640 1 --2- 172.21.15.88:0/1947035938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f296c06d840 0x7f296c14a050 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f295c00c7c0 tx=0x7f295c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:55.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.797+0000 7f29637fe640 1 -- 172.21.15.88:0/1947035938 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c00aa50 con 0x7f296c06d840 2023-12-08T08:20:55.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.797+0000 7f29637fe640 1 -- 172.21.15.88:0/1947035938 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295c00abb0 con 0x7f296c06d840 2023-12-08T08:20:55.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.797+0000 7f2970a68640 1 -- 172.21.15.88:0/1947035938 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f296c1edbd0 con 0x7f296c06d840 2023-12-08T08:20:55.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.797+0000 7f29637fe640 1 -- 172.21.15.88:0/1947035938 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c012420 con 0x7f296c06d840 2023-12-08T08:20:55.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.797+0000 7f2970a68640 1 -- 172.21.15.88:0/1947035938 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296c1ee190 con 0x7f296c06d840 2023-12-08T08:20:55.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.797+0000 7f2970a68640 1 -- 172.21.15.88:0/1947035938 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f296c067630 con 0x7f296c06d840 2023-12-08T08:20:55.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.797+0000 7f29637fe640 1 -- 172.21.15.88:0/1947035938 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f295c012580 con 0x7f296c06d840 2023-12-08T08:20:55.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.801+0000 7f29637fe640 1 --2- 172.21.15.88:0/1947035938 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f294c066470 0x7f294c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.801+0000 7f29637fe640 1 -- 172.21.15.88:0/1947035938 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f295c084140 con 0x7f296c06d840 2023-12-08T08:20:55.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.801+0000 7f2961d9b640 1 --2- 172.21.15.88:0/1947035938 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f294c066470 0x7f294c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.801+0000 7f2961d9b640 1 --2- 172.21.15.88:0/1947035938 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f294c066470 0x7f294c068930 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f29540af000 tx=0x7f2954008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:55.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.805+0000 7f29637fe640 1 -- 172.21.15.88:0/1947035938 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f295c051550 con 0x7f296c06d840 2023-12-08T08:20:55.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:55.989+0000 7f2970a68640 1 -- 172.21.15.88:0/1947035938 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f296c1ee350 con 0x7f296c06d840 2023-12-08T08:20:56.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.613+0000 7f29637fe640 1 -- 172.21.15.88:0/1947035938 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f295c054b70 con 0x7f296c06d840 2023-12-08T08:20:56.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.617+0000 7f2970a68640 1 -- 172.21.15.88:0/1947035938 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f294c066470 msgr2=0x7f294c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:56.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.617+0000 7f2970a68640 1 --2- 172.21.15.88:0/1947035938 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f294c066470 0x7f294c068930 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f29540af000 tx=0x7f2954008040 comp rx=0 tx=0).stop 2023-12-08T08:20:56.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.617+0000 7f2970a68640 1 -- 172.21.15.88:0/1947035938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f296c06d840 msgr2=0x7f296c14a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:56.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.617+0000 7f2970a68640 1 --2- 172.21.15.88:0/1947035938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f296c06d840 0x7f296c14a050 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f295c00c7c0 tx=0x7f295c00cc80 comp rx=0 tx=0).stop 2023-12-08T08:20:56.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.617+0000 7f2970a68640 1 -- 172.21.15.88:0/1947035938 shutdown_connections 2023-12-08T08:20:56.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.617+0000 7f2970a68640 1 --2- 172.21.15.88:0/1947035938 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f294c066470 0x7f294c068930 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.617+0000 7f2970a68640 1 --2- 172.21.15.88:0/1947035938 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f296c14fc30 0x7f296c0a5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.617+0000 7f2970a68640 1 --2- 172.21.15.88:0/1947035938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f296c14f850 0x7f296c0a5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.617+0000 7f2970a68640 1 --2- 172.21.15.88:0/1947035938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f296c06d840 0x7f296c14a050 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.617+0000 7f2970a68640 1 -- 172.21.15.88:0/1947035938 >> 172.21.15.88:0/1947035938 conn(0x7f296c0c59f0 msgr2=0x7f296c0c3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:56.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.617+0000 7f2970a68640 1 -- 172.21.15.88:0/1947035938 shutdown_connections 2023-12-08T08:20:56.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.617+0000 7f2970a68640 1 -- 172.21.15.88:0/1947035938 wait complete. 2023-12-08T08:20:56.644 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-08T08:20:56.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.825+0000 7f2940d57640 1 Processor -- start 2023-12-08T08:20:56.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.825+0000 7f2940d57640 1 -- start start 2023-12-08T08:20:56.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.825+0000 7f2940d57640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f293c14f850 0x7f293c0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:56.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.825+0000 7f2940d57640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f293c14fc30 0x7f293c0c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:56.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.825+0000 7f2940d57640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f293c152910 con 0x7f293c06d840 2023-12-08T08:20:56.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.825+0000 7f2940d57640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f293c0c2240 con 0x7f293c14fc30 2023-12-08T08:20:56.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.825+0000 7f2940d57640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f293c152bf0 con 0x7f293c14f850 2023-12-08T08:20:56.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.829+0000 7f2933fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f293c14fc30 0x7f293c0c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:56.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.829+0000 7f2933fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f293c14fc30 0x7f293c0c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57430/0 (socket says 172.21.15.88:57430) 2023-12-08T08:20:56.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.829+0000 7f293ad9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f293c06d840 0x7f293c0c4210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40516/0 (socket says 172.21.15.88:40516) 2023-12-08T08:20:56.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.829+0000 7f2933fff640 1 -- 172.21.15.88:0/3080919380 learned_addr learned my addr 172.21.15.88:0/3080919380 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:56.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.829+0000 7f293a59c640 1 --2- 172.21.15.88:0/3080919380 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f293c14f850 0x7f293c0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:56.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.829+0000 7f2933fff640 1 -- 172.21.15.88:0/3080919380 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f293c14f850 msgr2=0x7f293c0aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:56.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.829+0000 7f2933fff640 1 --2- 172.21.15.88:0/3080919380 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f293c14f850 0x7f293c0aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.829+0000 7f2933fff640 1 -- 172.21.15.88:0/3080919380 >> v1:172.21.15.88:6789/0 conn(0x7f293c06d840 legacy=0x7f293c0c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:56.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.829+0000 7f2933fff640 1 -- 172.21.15.88:0/3080919380 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293c152ed0 con 0x7f293c14fc30 2023-12-08T08:20:56.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.829+0000 7f2939d9b640 1 -- 172.21.15.88:0/3080919380 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579893762 0 0) 0x7f293c152910 con 0x7f293c06d840 2023-12-08T08:20:56.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.829+0000 7f293a59c640 1 --2- 172.21.15.88:0/3080919380 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f293c14f850 0x7f293c0aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:56.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.829+0000 7f2933fff640 1 --2- 172.21.15.88:0/3080919380 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f293c14fc30 0x7f293c0c3cd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2924009870 tx=0x7f292401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571b9393ca7ec4bb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:56.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.829+0000 7f2939d9b640 1 -- 172.21.15.88:0/3080919380 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29240a9620 con 0x7f293c14fc30 2023-12-08T08:20:56.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.829+0000 7f2939d9b640 1 -- 172.21.15.88:0/3080919380 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29240a9780 con 0x7f293c14fc30 2023-12-08T08:20:56.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.829+0000 7f2939d9b640 1 -- 172.21.15.88:0/3080919380 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29240a9b10 con 0x7f293c14fc30 2023-12-08T08:20:56.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f2940d57640 1 -- 172.21.15.88:0/3080919380 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f293c14fc30 msgr2=0x7f293c0c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:56.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f2940d57640 1 --2- 172.21.15.88:0/3080919380 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f293c14fc30 0x7f293c0c3cd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2924009870 tx=0x7f292401c540 comp rx=0 tx=0).stop 2023-12-08T08:20:56.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f2940d57640 1 -- 172.21.15.88:0/3080919380 shutdown_connections 2023-12-08T08:20:56.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f2940d57640 1 --2- 172.21.15.88:0/3080919380 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f293c14fc30 0x7f293c0c3cd0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f2940d57640 1 --2- 172.21.15.88:0/3080919380 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f293c14f850 0x7f293c0aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f2940d57640 1 -- 172.21.15.88:0/3080919380 >> 172.21.15.88:0/3080919380 conn(0x7f293c0c59f0 msgr2=0x7f293c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:56.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f2940d57640 1 -- 172.21.15.88:0/3080919380 shutdown_connections 2023-12-08T08:20:56.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f2940d57640 1 -- 172.21.15.88:0/3080919380 wait complete. 2023-12-08T08:20:56.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f2940d57640 1 Processor -- start 2023-12-08T08:20:56.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f2940d57640 1 -- start start 2023-12-08T08:20:56.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f2940d57640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f293c06d840 0x7f293c154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:56.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f2940d57640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f293c14f850 0x7f293c1eb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:56.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f2940d57640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f293c14fc30 0x7f293c0a60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:56.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f2940d57640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293c157020 con 0x7f293c14fc30 2023-12-08T08:20:56.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f2940d57640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293c1ebd50 con 0x7f293c14f850 2023-12-08T08:20:56.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f2940d57640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f293c1ee3e0 con 0x7f293c06d840 2023-12-08T08:20:56.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f293ad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f293c14fc30 0x7f293c0a60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:56.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f293ad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f293c14fc30 0x7f293c0a60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57440/0 (socket says 172.21.15.88:57440) 2023-12-08T08:20:56.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f293ad9d640 1 -- 172.21.15.88:0/3099926179 learned_addr learned my addr 172.21.15.88:0/3099926179 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:56.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f293a59c640 1 --2- 172.21.15.88:0/3099926179 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f293c06d840 0x7f293c154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:56.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f2933fff640 1 --2- 172.21.15.88:0/3099926179 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f293c14f850 0x7f293c1eb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:56.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f293ad9d640 1 -- 172.21.15.88:0/3099926179 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f293c06d840 msgr2=0x7f293c154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:56.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f293ad9d640 1 --2- 172.21.15.88:0/3099926179 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f293c06d840 0x7f293c154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f293ad9d640 1 -- 172.21.15.88:0/3099926179 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f293c14f850 msgr2=0x7f293c1eb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:56.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f293ad9d640 1 --2- 172.21.15.88:0/3099926179 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f293c14f850 0x7f293c1eb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f293ad9d640 1 -- 172.21.15.88:0/3099926179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29240094d0 con 0x7f293c14fc30 2023-12-08T08:20:56.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f293a59c640 1 --2- 172.21.15.88:0/3099926179 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f293c06d840 0x7f293c154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:56.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.833+0000 7f2933fff640 1 --2- 172.21.15.88:0/3099926179 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f293c14f850 0x7f293c1eb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:56.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.837+0000 7f293ad9d640 1 --2- 172.21.15.88:0/3099926179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f293c14fc30 0x7f293c0a60e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2934001570 tx=0x7f293400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:56.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.837+0000 7f2932ffd640 1 -- 172.21.15.88:0/3099926179 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293400a640 con 0x7f293c14fc30 2023-12-08T08:20:56.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.837+0000 7f2932ffd640 1 -- 172.21.15.88:0/3099926179 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293400a7a0 con 0x7f293c14fc30 2023-12-08T08:20:56.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.837+0000 7f2932ffd640 1 -- 172.21.15.88:0/3099926179 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293400ab90 con 0x7f293c14fc30 2023-12-08T08:20:56.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.837+0000 7f2940d57640 1 -- 172.21.15.88:0/3099926179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f293c0723b0 con 0x7f293c14fc30 2023-12-08T08:20:56.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.837+0000 7f2940d57640 1 -- 172.21.15.88:0/3099926179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f293c1ee680 con 0x7f293c14fc30 2023-12-08T08:20:56.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.837+0000 7f2940d57640 1 -- 172.21.15.88:0/3099926179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f293c1ee870 con 0x7f293c14fc30 2023-12-08T08:20:56.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.837+0000 7f2932ffd640 1 -- 172.21.15.88:0/3099926179 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f293400acf0 con 0x7f293c14fc30 2023-12-08T08:20:56.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.837+0000 7f2932ffd640 1 --2- 172.21.15.88:0/3099926179 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f291c0664a0 0x7f291c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:56.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.837+0000 7f2932ffd640 1 -- 172.21.15.88:0/3099926179 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f29340833a0 con 0x7f293c14fc30 2023-12-08T08:20:56.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.837+0000 7f293a59c640 1 --2- 172.21.15.88:0/3099926179 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f291c0664a0 0x7f291c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:56.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.837+0000 7f293a59c640 1 --2- 172.21.15.88:0/3099926179 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f291c0664a0 0x7f291c068960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f292c009970 tx=0x7f292c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:56.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.841+0000 7f2932ffd640 1 -- 172.21.15.88:0/3099926179 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2934050850 con 0x7f293c14fc30 2023-12-08T08:20:56.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:56.993+0000 7f2940d57640 1 -- 172.21.15.88:0/3099926179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f293c067630 con 0x7f293c14fc30 2023-12-08T08:20:57.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.621+0000 7f2932ffd640 1 -- 172.21.15.88:0/3099926179 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7f29340180d0 con 0x7f293c14fc30 2023-12-08T08:20:57.626 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' removed 2023-12-08T08:20:57.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.621+0000 7f2940d57640 1 -- 172.21.15.88:0/3099926179 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f291c0664a0 msgr2=0x7f291c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:57.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.621+0000 7f2940d57640 1 --2- 172.21.15.88:0/3099926179 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f291c0664a0 0x7f291c068960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f292c009970 tx=0x7f292c008040 comp rx=0 tx=0).stop 2023-12-08T08:20:57.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.621+0000 7f2940d57640 1 -- 172.21.15.88:0/3099926179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f293c14fc30 msgr2=0x7f293c0a60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:57.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.621+0000 7f2940d57640 1 --2- 172.21.15.88:0/3099926179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f293c14fc30 0x7f293c0a60e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2934001570 tx=0x7f293400cc70 comp rx=0 tx=0).stop 2023-12-08T08:20:57.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.621+0000 7f2940d57640 1 -- 172.21.15.88:0/3099926179 shutdown_connections 2023-12-08T08:20:57.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.621+0000 7f2940d57640 1 --2- 172.21.15.88:0/3099926179 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f291c0664a0 0x7f291c068960 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:57.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.621+0000 7f2940d57640 1 --2- 172.21.15.88:0/3099926179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f293c14fc30 0x7f293c0a60e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:57.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.621+0000 7f2940d57640 1 --2- 172.21.15.88:0/3099926179 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f293c14f850 0x7f293c1eb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:57.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.621+0000 7f2940d57640 1 --2- 172.21.15.88:0/3099926179 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f293c06d840 0x7f293c154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:57.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.621+0000 7f2940d57640 1 -- 172.21.15.88:0/3099926179 >> 172.21.15.88:0/3099926179 conn(0x7f293c0c59f0 msgr2=0x7f293c0a5610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:57.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.625+0000 7f2940d57640 1 -- 172.21.15.88:0/3099926179 shutdown_connections 2023-12-08T08:20:57.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.625+0000 7f2940d57640 1 -- 172.21.15.88:0/3099926179 wait complete. 2023-12-08T08:20:57.652 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-08T08:20:57.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.797+0000 7f8005301640 1 Processor -- start 2023-12-08T08:20:57.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.797+0000 7f8005301640 1 -- start start 2023-12-08T08:20:57.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.797+0000 7f8005301640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80000af4d0 0x7f80000c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:57.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.797+0000 7f8005301640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8000154f00 0x7f800006be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:57.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.797+0000 7f8005301640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80000c8450 con 0x7f80000c6d80 2023-12-08T08:20:57.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.797+0000 7f8005301640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80000af8b0 con 0x7f8000154f00 2023-12-08T08:20:57.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.797+0000 7f8005301640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8000155470 con 0x7f80000af4d0 2023-12-08T08:20:57.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.797+0000 7f7ff7fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f80000c6d80 0x7f800006b710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40530/0 (socket says 172.21.15.88:40530) 2023-12-08T08:20:57.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.797+0000 7f7ff7fff640 1 -- 172.21.15.88:0/1054300894 learned_addr learned my addr 172.21.15.88:0/1054300894 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:57.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.797+0000 7f7fff7fe640 1 --2- 172.21.15.88:0/1054300894 >> v2:172.21.15.148:3300/0 conn(0x7f8000154f00 0x7f800006be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:57.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.797+0000 7f7ffeffd640 1 --2- 172.21.15.88:0/1054300894 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80000af4d0 0x7f80000c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:57.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.801+0000 7f7ffe7fc640 1 -- 172.21.15.88:0/1054300894 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2273060211 0 0) 0x7f80000c8450 con 0x7f80000c6d80 2023-12-08T08:20:57.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.801+0000 7f7ffe7fc640 1 -- 172.21.15.88:0/1054300894 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fec003530 con 0x7f80000c6d80 2023-12-08T08:20:57.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.801+0000 7f7ffeffd640 1 -- 172.21.15.88:0/1054300894 >> v2:172.21.15.148:3300/0 conn(0x7f8000154f00 msgr2=0x7f800006be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:57.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.801+0000 7f7ffeffd640 1 --2- 172.21.15.88:0/1054300894 >> v2:172.21.15.148:3300/0 conn(0x7f8000154f00 0x7f800006be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:57.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.801+0000 7f7ffeffd640 1 -- 172.21.15.88:0/1054300894 >> v1:172.21.15.88:6789/0 conn(0x7f80000c6d80 legacy=0x7f800006b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:57.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.801+0000 7f7ffeffd640 1 -- 172.21.15.88:0/1054300894 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80000c48c0 con 0x7f80000af4d0 2023-12-08T08:20:57.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.801+0000 7f7ffeffd640 1 --2- 172.21.15.88:0/1054300894 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80000af4d0 0x7f80000c6840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7ff00097c0 tx=0x7f7ff001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9ac3b9fce4ee7e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:57.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.801+0000 7f7ffe7fc640 1 -- 172.21.15.88:0/1054300894 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff00ab600 con 0x7f80000af4d0 2023-12-08T08:20:57.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.801+0000 7f7ffe7fc640 1 -- 172.21.15.88:0/1054300894 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff00a7050 con 0x7f80000af4d0 2023-12-08T08:20:57.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.801+0000 7f7ffe7fc640 1 -- 172.21.15.88:0/1054300894 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff00ab980 con 0x7f80000af4d0 2023-12-08T08:20:57.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.805+0000 7f8005301640 1 -- 172.21.15.88:0/1054300894 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80000af4d0 msgr2=0x7f80000c6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:57.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.805+0000 7f8005301640 1 --2- 172.21.15.88:0/1054300894 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80000af4d0 0x7f80000c6840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7ff00097c0 tx=0x7f7ff001c3f0 comp rx=0 tx=0).stop 2023-12-08T08:20:57.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.805+0000 7f8005301640 1 -- 172.21.15.88:0/1054300894 shutdown_connections 2023-12-08T08:20:57.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.805+0000 7f8005301640 1 --2- 172.21.15.88:0/1054300894 >> v2:172.21.15.148:3300/0 conn(0x7f8000154f00 0x7f800006be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:57.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.805+0000 7f8005301640 1 --2- 172.21.15.88:0/1054300894 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80000af4d0 0x7f80000c6840 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:57.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.805+0000 7f8005301640 1 -- 172.21.15.88:0/1054300894 >> 172.21.15.88:0/1054300894 conn(0x7f80000aba00 msgr2=0x7f80000abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:57.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.805+0000 7f8005301640 1 -- 172.21.15.88:0/1054300894 shutdown_connections 2023-12-08T08:20:57.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.805+0000 7f8005301640 1 -- 172.21.15.88:0/1054300894 wait complete. 2023-12-08T08:20:57.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.805+0000 7f8005301640 1 Processor -- start 2023-12-08T08:20:57.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.805+0000 7f8005301640 1 -- start start 2023-12-08T08:20:57.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.805+0000 7f8005301640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80000af4d0 0x7f8000156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:57.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.805+0000 7f8005301640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80000c6d80 0x7f80001556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:57.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.805+0000 7f8005301640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8000154f00 0x7f8000155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:57.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.805+0000 7f8005301640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80000c9e20 con 0x7f80000af4d0 2023-12-08T08:20:57.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.805+0000 7f8005301640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80000c3b10 con 0x7f8000154f00 2023-12-08T08:20:57.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.805+0000 7f8005301640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80000c3df0 con 0x7f80000c6d80 2023-12-08T08:20:57.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.805+0000 7f7ffeffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80000af4d0 0x7f8000156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:57.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.805+0000 7f7ffeffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80000af4d0 0x7f8000156a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57454/0 (socket says 172.21.15.88:57454) 2023-12-08T08:20:57.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.805+0000 7f7ffeffd640 1 -- 172.21.15.88:0/408388975 learned_addr learned my addr 172.21.15.88:0/408388975 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:57.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.805+0000 7f7fff7fe640 1 --2- 172.21.15.88:0/408388975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8000154f00 0x7f8000155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:57.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.805+0000 7f7ff7fff640 1 --2- 172.21.15.88:0/408388975 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80000c6d80 0x7f80001556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:57.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.805+0000 7f7ffeffd640 1 -- 172.21.15.88:0/408388975 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80000c6d80 msgr2=0x7f80001556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:57.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.805+0000 7f7ffeffd640 1 --2- 172.21.15.88:0/408388975 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80000c6d80 0x7f80001556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:57.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.805+0000 7f7ffeffd640 1 -- 172.21.15.88:0/408388975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8000154f00 msgr2=0x7f8000155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:57.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.805+0000 7f7ffeffd640 1 --2- 172.21.15.88:0/408388975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8000154f00 0x7f8000155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:57.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.805+0000 7f7ffeffd640 1 -- 172.21.15.88:0/408388975 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff0009420 con 0x7f80000af4d0 2023-12-08T08:20:57.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.805+0000 7f7ffeffd640 1 --2- 172.21.15.88:0/408388975 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80000af4d0 0x7f8000156a70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7ff001a020 tx=0x7f7ff001ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:57.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.809+0000 7f7ff77fe640 1 -- 172.21.15.88:0/408388975 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff00abea0 con 0x7f80000af4d0 2023-12-08T08:20:57.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.809+0000 7f7ff77fe640 1 -- 172.21.15.88:0/408388975 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff00b7450 con 0x7f80000af4d0 2023-12-08T08:20:57.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.809+0000 7f7ff77fe640 1 -- 172.21.15.88:0/408388975 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff00b77e0 con 0x7f80000af4d0 2023-12-08T08:20:57.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.809+0000 7f8005301640 1 -- 172.21.15.88:0/408388975 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80000c9ab0 con 0x7f80000af4d0 2023-12-08T08:20:57.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.809+0000 7f8005301640 1 -- 172.21.15.88:0/408388975 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80000c9780 con 0x7f80000af4d0 2023-12-08T08:20:57.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.809+0000 7f8005301640 1 -- 172.21.15.88:0/408388975 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8000067630 con 0x7f80000af4d0 2023-12-08T08:20:57.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.809+0000 7f7ff77fe640 1 -- 172.21.15.88:0/408388975 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7ff00b7940 con 0x7f80000af4d0 2023-12-08T08:20:57.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.809+0000 7f7ff77fe640 1 --2- 172.21.15.88:0/408388975 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7fe0066470 0x7f7fe0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:57.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.809+0000 7f7ff77fe640 1 -- 172.21.15.88:0/408388975 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f7ff011e240 con 0x7f80000af4d0 2023-12-08T08:20:57.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.809+0000 7f7ff7fff640 1 --2- 172.21.15.88:0/408388975 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7fe0066470 0x7f7fe0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:57.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.809+0000 7f7ff7fff640 1 --2- 172.21.15.88:0/408388975 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7fe0066470 0x7f7fe0068930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f80000c0880 tx=0x7f7fe8007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:57.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.813+0000 7f7ff77fe640 1 -- 172.21.15.88:0/408388975 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7ff00eb8d0 con 0x7f80000af4d0 2023-12-08T08:20:57.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:57.961+0000 7f8005301640 1 -- 172.21.15.88:0/408388975 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f800006c880 con 0x7f80000af4d0 2023-12-08T08:20:58.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.633+0000 7f7ff77fe640 1 -- 172.21.15.88:0/408388975 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7ff00eeef0 con 0x7f80000af4d0 2023-12-08T08:20:58.638 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' removed 2023-12-08T08:20:58.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.637+0000 7f8005301640 1 -- 172.21.15.88:0/408388975 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7fe0066470 msgr2=0x7f7fe0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:58.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.637+0000 7f8005301640 1 --2- 172.21.15.88:0/408388975 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7fe0066470 0x7f7fe0068930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f80000c0880 tx=0x7f7fe8007d40 comp rx=0 tx=0).stop 2023-12-08T08:20:58.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.637+0000 7f8005301640 1 -- 172.21.15.88:0/408388975 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80000af4d0 msgr2=0x7f8000156a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:58.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.637+0000 7f8005301640 1 --2- 172.21.15.88:0/408388975 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80000af4d0 0x7f8000156a70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7ff001a020 tx=0x7f7ff001ac30 comp rx=0 tx=0).stop 2023-12-08T08:20:58.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.637+0000 7f8005301640 1 -- 172.21.15.88:0/408388975 shutdown_connections 2023-12-08T08:20:58.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.637+0000 7f8005301640 1 --2- 172.21.15.88:0/408388975 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7fe0066470 0x7f7fe0068930 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:58.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.637+0000 7f8005301640 1 --2- 172.21.15.88:0/408388975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8000154f00 0x7f8000155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:58.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.637+0000 7f8005301640 1 --2- 172.21.15.88:0/408388975 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80000c6d80 0x7f80001556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:58.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.637+0000 7f8005301640 1 --2- 172.21.15.88:0/408388975 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80000af4d0 0x7f8000156a70 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:58.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.637+0000 7f8005301640 1 -- 172.21.15.88:0/408388975 >> 172.21.15.88:0/408388975 conn(0x7f80000aba00 msgr2=0x7f8000151440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:58.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.637+0000 7f8005301640 1 -- 172.21.15.88:0/408388975 shutdown_connections 2023-12-08T08:20:58.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.637+0000 7f8005301640 1 -- 172.21.15.88:0/408388975 wait complete. 2023-12-08T08:20:58.677 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-08T08:20:58.677 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-08T08:20:58.677 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-08T08:20:58.677 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:58.677 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-08T08:20:58.678 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-08T08:20:58.678 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-08T08:20:58.678 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:58.678 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-08T08:20:58.678 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-08T08:20:58.678 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-08T08:20:58.678 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:58.679 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-08T08:20:58.679 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-08T08:20:58.679 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-08T08:20:58.679 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:58.702 INFO:tasks.ceph.mds.c:Stopped 2023-12-08T08:20:58.702 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-08T08:20:58.711 INFO:tasks.ceph.mds.b:Stopped 2023-12-08T08:20:58.711 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-08T08:20:58.714 INFO:tasks.ceph.mds.d:Stopped 2023-12-08T08:20:58.714 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-08T08:20:58.719 INFO:tasks.ceph.mds.a:Stopped 2023-12-08T08:20:58.719 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-08T08:20:58.760 INFO:tasks.ceph.mds.b:Started 2023-12-08T08:20:58.760 DEBUG:teuthology.parallel:result is None 2023-12-08T08:20:58.763 INFO:tasks.ceph.mds.d:Started 2023-12-08T08:20:58.763 DEBUG:teuthology.parallel:result is None 2023-12-08T08:20:58.767 INFO:tasks.ceph.mds.c:Started 2023-12-08T08:20:58.767 DEBUG:teuthology.parallel:result is None 2023-12-08T08:20:58.770 INFO:tasks.ceph.mds.a:Started 2023-12-08T08:20:58.770 DEBUG:teuthology.parallel:result is None 2023-12-08T08:20:58.770 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-08T08:20:58.846 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-12-08T08:20:58.847 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-12-08T08:20:58.848 INFO:tasks.ceph.mds.b.smithi148.stderr:2023-12-08T08:20:58.844+0000 7fe7532b8640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-12-08T08:20:58.857 INFO:tasks.ceph.mds.c.smithi088.stdout:starting mds.c at 2023-12-08T08:20:58.857 INFO:tasks.ceph.mds.a.smithi088.stdout:starting mds.a at 2023-12-08T08:20:58.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.909+0000 7f24310e3640 1 Processor -- start 2023-12-08T08:20:58.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.909+0000 7f24310e3640 1 -- start start 2023-12-08T08:20:58.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.913+0000 7f24310e3640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f242c14e520 0x7f242c0c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:58.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.913+0000 7f24310e3640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f242c0c51b0 con 0x7f242c0a6f70 2023-12-08T08:20:58.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.913+0000 7f24310e3640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f242c14e900 con 0x7f242c155170 2023-12-08T08:20:58.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.913+0000 7f24310e3640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f242c0c4ed0 con 0x7f242c14e520 2023-12-08T08:20:58.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.913+0000 7f242b59e640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f242c0a6f70 0x7f242c0c1090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40554/0 (socket says 172.21.15.88:40554) 2023-12-08T08:20:58.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.913+0000 7f242b59e640 1 -- 172.21.15.88:0/2068981532 learned_addr learned my addr 172.21.15.88:0/2068981532 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:20:58.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.913+0000 7f242ad9d640 1 --2- 172.21.15.88:0/2068981532 >> v2:172.21.15.148:3300/0 conn(0x7f242c14e520 0x7f242c0c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:58.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.913+0000 7f242a59c640 1 -- 172.21.15.88:0/2068981532 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923086339 0 0) 0x7f242c0c51b0 con 0x7f242c0a6f70 2023-12-08T08:20:58.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.913+0000 7f242a59c640 1 -- 172.21.15.88:0/2068981532 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2418003530 con 0x7f242c0a6f70 2023-12-08T08:20:58.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.913+0000 7f242a59c640 1 -- 172.21.15.88:0/2068981532 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 869547754 0 0) 0x7f242c14e900 con 0x7f242c155170 2023-12-08T08:20:58.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.913+0000 7f242a59c640 1 -- 172.21.15.88:0/2068981532 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f242c0c51b0 con 0x7f242c155170 2023-12-08T08:20:58.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.913+0000 7f242ad9d640 1 -- 172.21.15.88:0/2068981532 >> v1:172.21.15.148:6789/0 conn(0x7f242c155170 legacy=0x7f242c0c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:58.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.913+0000 7f242ad9d640 1 -- 172.21.15.88:0/2068981532 >> v1:172.21.15.88:6789/0 conn(0x7f242c0a6f70 legacy=0x7f242c0c1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:58.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.913+0000 7f242ad9d640 1 -- 172.21.15.88:0/2068981532 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242c154690 con 0x7f242c14e520 2023-12-08T08:20:58.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.917+0000 7f242ad9d640 1 --2- 172.21.15.88:0/2068981532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f242c14e520 0x7f242c0c5d80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f241c0097c0 tx=0x7f241c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a80ad4481dc8023 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:58.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.917+0000 7f242a59c640 1 -- 172.21.15.88:0/2068981532 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c0ad660 con 0x7f242c14e520 2023-12-08T08:20:58.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.917+0000 7f242a59c640 1 -- 172.21.15.88:0/2068981532 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241c0ad7c0 con 0x7f242c14e520 2023-12-08T08:20:58.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.917+0000 7f242a59c640 1 -- 172.21.15.88:0/2068981532 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c0adb50 con 0x7f242c14e520 2023-12-08T08:20:58.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.917+0000 7f24310e3640 1 -- 172.21.15.88:0/2068981532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f242c14e520 msgr2=0x7f242c0c5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:58.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.917+0000 7f24310e3640 1 --2- 172.21.15.88:0/2068981532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f242c14e520 0x7f242c0c5d80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f241c0097c0 tx=0x7f241c01c450 comp rx=0 tx=0).stop 2023-12-08T08:20:58.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.917+0000 7f24310e3640 1 -- 172.21.15.88:0/2068981532 shutdown_connections 2023-12-08T08:20:58.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.917+0000 7f24310e3640 1 --2- 172.21.15.88:0/2068981532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f242c14e520 0x7f242c0c5d80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:58.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.917+0000 7f24310e3640 1 -- 172.21.15.88:0/2068981532 >> 172.21.15.88:0/2068981532 conn(0x7f242c0c7c60 msgr2=0x7f242c0c8070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:58.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.917+0000 7f24310e3640 1 -- 172.21.15.88:0/2068981532 shutdown_connections 2023-12-08T08:20:58.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.917+0000 7f24310e3640 1 -- 172.21.15.88:0/2068981532 wait complete. 2023-12-08T08:20:58.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.917+0000 7f24310e3640 1 Processor -- start 2023-12-08T08:20:58.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.917+0000 7f24310e3640 1 -- start start 2023-12-08T08:20:58.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.921+0000 7f24310e3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f242c0a6f70 0x7f242c144e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:58.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.921+0000 7f24310e3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f242c14e520 0x7f242c13f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:58.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.921+0000 7f24310e3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f242c155170 0x7f242c0a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:58.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.921+0000 7f24310e3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242c1527b0 con 0x7f242c14e520 2023-12-08T08:20:58.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.921+0000 7f24310e3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242c146660 con 0x7f242c0a6f70 2023-12-08T08:20:58.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.921+0000 7f24310e3640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242c06fa10 con 0x7f242c155170 2023-12-08T08:20:58.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.921+0000 7f2423fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f242c14e520 0x7f242c13f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:58.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.921+0000 7f2423fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f242c14e520 0x7f242c13f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57488/0 (socket says 172.21.15.88:57488) 2023-12-08T08:20:58.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.921+0000 7f2423fff640 1 -- 172.21.15.88:0/1794474890 learned_addr learned my addr 172.21.15.88:0/1794474890 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:58.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.921+0000 7f242ad9d640 1 --2- 172.21.15.88:0/1794474890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f242c0a6f70 0x7f242c144e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:58.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.921+0000 7f242b59e640 1 --2- 172.21.15.88:0/1794474890 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f242c155170 0x7f242c0a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:58.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.921+0000 7f2423fff640 1 -- 172.21.15.88:0/1794474890 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f242c155170 msgr2=0x7f242c0a5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:58.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.921+0000 7f2423fff640 1 --2- 172.21.15.88:0/1794474890 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f242c155170 0x7f242c0a5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:58.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.921+0000 7f2423fff640 1 -- 172.21.15.88:0/1794474890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f242c0a6f70 msgr2=0x7f242c144e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:58.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.921+0000 7f2423fff640 1 --2- 172.21.15.88:0/1794474890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f242c0a6f70 0x7f242c144e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:58.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.921+0000 7f2423fff640 1 -- 172.21.15.88:0/1794474890 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241c009420 con 0x7f242c14e520 2023-12-08T08:20:58.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.921+0000 7f242ad9d640 1 --2- 172.21.15.88:0/1794474890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f242c0a6f70 0x7f242c144e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:58.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.921+0000 7f2423fff640 1 --2- 172.21.15.88:0/1794474890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f242c14e520 0x7f242c13f700 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f241400c500 tx=0x7f241400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:58.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.921+0000 7f24237fe640 1 -- 172.21.15.88:0/1794474890 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24140052d0 con 0x7f242c14e520 2023-12-08T08:20:58.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.921+0000 7f24237fe640 1 -- 172.21.15.88:0/1794474890 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2414005430 con 0x7f242c14e520 2023-12-08T08:20:58.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.921+0000 7f24310e3640 1 -- 172.21.15.88:0/1794474890 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f242c146920 con 0x7f242c14e520 2023-12-08T08:20:58.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.921+0000 7f24237fe640 1 -- 172.21.15.88:0/1794474890 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2414003820 con 0x7f242c14e520 2023-12-08T08:20:58.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.921+0000 7f24310e3640 1 -- 172.21.15.88:0/1794474890 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f242c13fc40 con 0x7f242c14e520 2023-12-08T08:20:58.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.921+0000 7f24310e3640 1 -- 172.21.15.88:0/1794474890 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f242c0c4670 con 0x7f242c14e520 2023-12-08T08:20:58.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.925+0000 7f24237fe640 1 -- 172.21.15.88:0/1794474890 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2414003980 con 0x7f242c14e520 2023-12-08T08:20:58.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.925+0000 7f24237fe640 1 --2- 172.21.15.88:0/1794474890 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f240c066470 0x7f240c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:58.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.925+0000 7f24237fe640 1 -- 172.21.15.88:0/1794474890 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2414083190 con 0x7f242c14e520 2023-12-08T08:20:58.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.925+0000 7f242ad9d640 1 --2- 172.21.15.88:0/1794474890 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f240c066470 0x7f240c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:58.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.925+0000 7f242ad9d640 1 --2- 172.21.15.88:0/1794474890 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f240c066470 0x7f240c068930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f241c0af000 tx=0x7f241c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:58.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:58.929+0000 7f24237fe640 1 -- 172.21.15.88:0/1794474890 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2414054390 con 0x7f242c14e520 2023-12-08T08:20:59.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.089+0000 7f24310e3640 1 -- 172.21.15.88:0/1794474890 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f242c067630 con 0x7f242c14e520 2023-12-08T08:20:59.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.645+0000 7f24237fe640 1 -- 172.21.15.88:0/1794474890 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2414053f20 con 0x7f242c14e520 2023-12-08T08:20:59.649 INFO:teuthology.orchestra.run.smithi088.stderr: removed all blocklist entries 2023-12-08T08:20:59.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.645+0000 7f24310e3640 1 -- 172.21.15.88:0/1794474890 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f240c066470 msgr2=0x7f240c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:59.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.645+0000 7f24310e3640 1 --2- 172.21.15.88:0/1794474890 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f240c066470 0x7f240c068930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f241c0af000 tx=0x7f241c0a7000 comp rx=0 tx=0).stop 2023-12-08T08:20:59.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.645+0000 7f24310e3640 1 -- 172.21.15.88:0/1794474890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f242c14e520 msgr2=0x7f242c13f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.645+0000 7f24310e3640 1 --2- 172.21.15.88:0/1794474890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f242c14e520 0x7f242c13f700 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f241400c500 tx=0x7f241400c9c0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.645+0000 7f24310e3640 1 -- 172.21.15.88:0/1794474890 shutdown_connections 2023-12-08T08:20:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.645+0000 7f24310e3640 1 --2- 172.21.15.88:0/1794474890 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f240c066470 0x7f240c068930 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.645+0000 7f24310e3640 1 --2- 172.21.15.88:0/1794474890 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f242c155170 0x7f242c0a5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.645+0000 7f24310e3640 1 --2- 172.21.15.88:0/1794474890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f242c14e520 0x7f242c13f700 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.645+0000 7f24310e3640 1 --2- 172.21.15.88:0/1794474890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f242c0a6f70 0x7f242c144e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.645+0000 7f24310e3640 1 -- 172.21.15.88:0/1794474890 >> 172.21.15.88:0/1794474890 conn(0x7f242c0c7c60 msgr2=0x7f242c143af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:59.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.645+0000 7f24310e3640 1 -- 172.21.15.88:0/1794474890 shutdown_connections 2023-12-08T08:20:59.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.645+0000 7f24310e3640 1 -- 172.21.15.88:0/1794474890 wait complete. 2023-12-08T08:20:59.676 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-08T08:20:59.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.809+0000 7fdd0d09f640 1 Processor -- start 2023-12-08T08:20:59.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.809+0000 7fdd0d09f640 1 -- start start 2023-12-08T08:20:59.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.809+0000 7fdd0d09f640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdd08151b40 0x7fdd080c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:59.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.809+0000 7fdd0d09f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdd080c9f80 0x7fdd080ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:59.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.809+0000 7fdd0d09f640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd081584b0 con 0x7fdd08157910 2023-12-08T08:20:59.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.809+0000 7fdd0d09f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd08154320 con 0x7fdd080c9f80 2023-12-08T08:20:59.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.809+0000 7fdd0d09f640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd081552f0 con 0x7fdd08151b40 2023-12-08T08:20:59.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.809+0000 7fdd077fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdd080c9f80 0x7fdd080ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:59.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.809+0000 7fdd077fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdd080c9f80 0x7fdd080ca410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57498/0 (socket says 172.21.15.88:57498) 2023-12-08T08:20:59.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.809+0000 7fdd077fe640 1 -- 172.21.15.88:0/2596623785 learned_addr learned my addr 172.21.15.88:0/2596623785 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:59.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.809+0000 7fdd07fff640 1 --2- 172.21.15.88:0/2596623785 >> v2:172.21.15.148:3300/0 conn(0x7fdd08151b40 0x7fdd080c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:59.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.809+0000 7fdd077fe640 1 -- 172.21.15.88:0/2596623785 >> v2:172.21.15.148:3300/0 conn(0x7fdd08151b40 msgr2=0x7fdd080c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:59.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.809+0000 7fdd077fe640 1 --2- 172.21.15.88:0/2596623785 >> v2:172.21.15.148:3300/0 conn(0x7fdd08151b40 0x7fdd080c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.809+0000 7fdd077fe640 1 -- 172.21.15.88:0/2596623785 >> v1:172.21.15.148:6789/0 conn(0x7fdd08157910 legacy=0x7fdd08157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:59.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.809+0000 7fdd077fe640 1 -- 172.21.15.88:0/2596623785 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd08154530 con 0x7fdd080c9f80 2023-12-08T08:20:59.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.813+0000 7fdd077fe640 1 --2- 172.21.15.88:0/2596623785 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd080c9f80 0x7fdd080ca410 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdd08067230 tx=0x7fdcfc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa74c17c84c55f86 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:59.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.813+0000 7fdd06ffd640 1 -- 172.21.15.88:0/2596623785 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc0ad680 con 0x7fdd080c9f80 2023-12-08T08:20:59.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.813+0000 7fdd06ffd640 1 -- 172.21.15.88:0/2596623785 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcfc0ad7e0 con 0x7fdd080c9f80 2023-12-08T08:20:59.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.813+0000 7fdd06ffd640 1 -- 172.21.15.88:0/2596623785 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc0adb70 con 0x7fdd080c9f80 2023-12-08T08:20:59.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.813+0000 7fdd0d09f640 1 -- 172.21.15.88:0/2596623785 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd080c9f80 msgr2=0x7fdd080ca410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:59.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.813+0000 7fdd0d09f640 1 --2- 172.21.15.88:0/2596623785 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd080c9f80 0x7fdd080ca410 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdd08067230 tx=0x7fdcfc01c470 comp rx=0 tx=0).stop 2023-12-08T08:20:59.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.813+0000 7fdd0d09f640 1 -- 172.21.15.88:0/2596623785 shutdown_connections 2023-12-08T08:20:59.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.813+0000 7fdd0d09f640 1 --2- 172.21.15.88:0/2596623785 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd080c9f80 0x7fdd080ca410 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.813+0000 7fdd0d09f640 1 --2- 172.21.15.88:0/2596623785 >> v2:172.21.15.148:3300/0 conn(0x7fdd08151b40 0x7fdd080c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.813+0000 7fdd0d09f640 1 -- 172.21.15.88:0/2596623785 >> 172.21.15.88:0/2596623785 conn(0x7fdd08066470 msgr2=0x7fdd08066880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:59.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.813+0000 7fdd0d09f640 1 -- 172.21.15.88:0/2596623785 shutdown_connections 2023-12-08T08:20:59.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.813+0000 7fdd0d09f640 1 -- 172.21.15.88:0/2596623785 wait complete. 2023-12-08T08:20:59.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.813+0000 7fdd0d09f640 1 Processor -- start 2023-12-08T08:20:59.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.817+0000 7fdd0d09f640 1 -- start start 2023-12-08T08:20:59.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.817+0000 7fdd0d09f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd080c9f80 0x7fdd081497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:59.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.817+0000 7fdd0d09f640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd08151b40 0x7fdd081f01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:59.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.817+0000 7fdd0d09f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd08157910 0x7fdd08147f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:59.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.817+0000 7fdd0d09f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd081f0ea0 con 0x7fdd08157910 2023-12-08T08:20:59.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.817+0000 7fdd0d09f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd08148e10 con 0x7fdd080c9f80 2023-12-08T08:20:59.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.817+0000 7fdd0d09f640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd081490f0 con 0x7fdd08151b40 2023-12-08T08:20:59.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.817+0000 7fdd0c89e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd08157910 0x7fdd08147f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:59.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.817+0000 7fdd0c89e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd08157910 0x7fdd08147f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57510/0 (socket says 172.21.15.88:57510) 2023-12-08T08:20:59.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.817+0000 7fdd0c89e640 1 -- 172.21.15.88:0/751902437 learned_addr learned my addr 172.21.15.88:0/751902437 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:20:59.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.817+0000 7fdd07fff640 1 --2- 172.21.15.88:0/751902437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd080c9f80 0x7fdd081497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:59.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.817+0000 7fdd077fe640 1 --2- 172.21.15.88:0/751902437 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd08151b40 0x7fdd081f01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:59.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.817+0000 7fdd0c89e640 1 -- 172.21.15.88:0/751902437 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd08151b40 msgr2=0x7fdd081f01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:59.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.817+0000 7fdd0c89e640 1 --2- 172.21.15.88:0/751902437 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd08151b40 0x7fdd081f01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.817+0000 7fdd0c89e640 1 -- 172.21.15.88:0/751902437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd080c9f80 msgr2=0x7fdd081497d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:59.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.817+0000 7fdd0c89e640 1 --2- 172.21.15.88:0/751902437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd080c9f80 0x7fdd081497d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.817+0000 7fdd0c89e640 1 -- 172.21.15.88:0/751902437 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc0094d0 con 0x7fdd08157910 2023-12-08T08:20:59.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.817+0000 7fdd07fff640 1 --2- 172.21.15.88:0/751902437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd080c9f80 0x7fdd081497d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:59.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.817+0000 7fdd0c89e640 1 --2- 172.21.15.88:0/751902437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd08157910 0x7fdd08147f50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000c730 tx=0x7fdd0000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:59.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.817+0000 7fdd04ff9640 1 -- 172.21.15.88:0/751902437 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd00003b80 con 0x7fdd08157910 2023-12-08T08:20:59.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.817+0000 7fdd04ff9640 1 -- 172.21.15.88:0/751902437 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd00003ce0 con 0x7fdd08157910 2023-12-08T08:20:59.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.817+0000 7fdd0d09f640 1 -- 172.21.15.88:0/751902437 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd081f0bc0 con 0x7fdd08157910 2023-12-08T08:20:59.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.817+0000 7fdd04ff9640 1 -- 172.21.15.88:0/751902437 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0000aa30 con 0x7fdd08157910 2023-12-08T08:20:59.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.817+0000 7fdd0d09f640 1 -- 172.21.15.88:0/751902437 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd08155920 con 0x7fdd08157910 2023-12-08T08:20:59.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.817+0000 7fdd0d09f640 1 -- 172.21.15.88:0/751902437 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd081492b0 con 0x7fdd08157910 2023-12-08T08:20:59.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.821+0000 7fdd04ff9640 1 -- 172.21.15.88:0/751902437 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdd0000ab90 con 0x7fdd08157910 2023-12-08T08:20:59.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.821+0000 7fdd04ff9640 1 --2- 172.21.15.88:0/751902437 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdcf4066470 0x7fdcf4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:59.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.821+0000 7fdd04ff9640 1 -- 172.21.15.88:0/751902437 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdd000837b0 con 0x7fdd08157910 2023-12-08T08:20:59.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.821+0000 7fdd07fff640 1 --2- 172.21.15.88:0/751902437 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdcf4066470 0x7fdcf4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:59.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.821+0000 7fdd07fff640 1 --2- 172.21.15.88:0/751902437 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdcf4066470 0x7fdcf4068930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009f50 tx=0x7fdcf8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:59.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:20:59.825+0000 7fdd04ff9640 1 -- 172.21.15.88:0/751902437 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdd00051020 con 0x7fdd08157910 2023-12-08T08:21:00.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.021+0000 7fdd0d09f640 1 -- 172.21.15.88:0/751902437 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fdd08067bc0 con 0x7fdd08157910 2023-12-08T08:21:00.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.025+0000 7fdd04ff9640 1 -- 172.21.15.88:0/751902437 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6065 (secure 0 0 0) 0x7fdd00054640 con 0x7fdd08157910 2023-12-08T08:21:00.030 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:00.030 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-08T08:21:00.030 INFO:teuthology.orchestra.run.smithi088.stdout: "auth_dump": [ 2023-12-08T08:21:00.030 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:00.030 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mds.a", 2023-12-08T08:21:00.030 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCJ0XJloTK6HRAAu8n+gz+R9g+apHf4wBCxeQ==", 2023-12-08T08:21:00.030 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:00.030 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-12-08T08:21:00.031 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2023-12-08T08:21:00.031 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2023-12-08T08:21:00.031 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:00.031 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:00.031 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:00.031 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:00.031 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mds.b", 2023-12-08T08:21:00.031 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCJ0XJlrbnLKRAAO9XhdXDMFK67UwNQyAt2gg==", 2023-12-08T08:21:00.031 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:00.031 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-12-08T08:21:00.031 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2023-12-08T08:21:00.031 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2023-12-08T08:21:00.032 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:00.032 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:00.032 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:00.032 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:00.032 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mds.c", 2023-12-08T08:21:00.032 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCJ0XJlDhLZJBAACSOMzN+IeMzMVLNekOe7dw==", 2023-12-08T08:21:00.032 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:00.032 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-12-08T08:21:00.032 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2023-12-08T08:21:00.032 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2023-12-08T08:21:00.032 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:00.033 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:00.033 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:00.033 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:00.033 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mds.d", 2023-12-08T08:21:00.033 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCJ0XJlWdgsMRAAuaC4T6rzN3zYLCszue26tw==", 2023-12-08T08:21:00.033 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:00.033 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-12-08T08:21:00.034 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2023-12-08T08:21:00.034 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2023-12-08T08:21:00.034 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:00.034 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:00.034 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:00.035 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:00.035 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.0", 2023-12-08T08:21:00.035 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCM0XJlWUyMOxAA6Q7lleuO31iXvAYMe7LWNw==", 2023-12-08T08:21:00.035 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:00.035 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-12-08T08:21:00.035 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-12-08T08:21:00.035 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:00.036 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:00.036 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:00.036 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:00.036 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.1", 2023-12-08T08:21:00.036 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCQ0XJlc0EeBxAA+a5ftRhbAX9Re+hWg9dLsQ==", 2023-12-08T08:21:00.036 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:00.036 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-12-08T08:21:00.037 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-12-08T08:21:00.037 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:00.037 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:00.037 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:00.037 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:00.037 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.2", 2023-12-08T08:21:00.037 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCT0XJlZAYzDRAAXGdagNNhMTiFIzHDaKgFQg==", 2023-12-08T08:21:00.038 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:00.038 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-12-08T08:21:00.038 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-12-08T08:21:00.038 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:00.038 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:00.038 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:00.039 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:00.039 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.3", 2023-12-08T08:21:00.039 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCW0XJlGa+gExAA/BQ9Po66U86hYML+eMjuUQ==", 2023-12-08T08:21:00.039 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:00.039 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-12-08T08:21:00.039 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-12-08T08:21:00.039 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:00.039 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:00.039 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:00.039 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:00.039 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.4", 2023-12-08T08:21:00.040 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCc0XJlvrSlHxAAEabqt1NzUyyON8/eGwqo1Q==", 2023-12-08T08:21:00.040 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:00.040 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-12-08T08:21:00.040 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-12-08T08:21:00.040 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:00.040 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:00.040 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:00.040 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:00.040 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.5", 2023-12-08T08:21:00.040 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCf0XJl0W+8JRAA8Twf/r3v6rJWcXMfLT0LCA==", 2023-12-08T08:21:00.040 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:00.041 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-12-08T08:21:00.041 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-12-08T08:21:00.041 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:00.041 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:00.041 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:00.041 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:00.041 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.6", 2023-12-08T08:21:00.041 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCi0XJljGjUKxAAOgrH0WvuIwuzZsgOki/fsA==", 2023-12-08T08:21:00.041 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:00.041 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-12-08T08:21:00.041 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-12-08T08:21:00.041 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:00.041 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:00.042 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:00.042 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:00.042 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.7", 2023-12-08T08:21:00.042 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCl0XJl5NI2MhAA2zOJ9DGnD4JtXTfmVjgkmw==", 2023-12-08T08:21:00.042 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:00.042 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-12-08T08:21:00.042 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-12-08T08:21:00.042 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:00.042 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:00.042 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:00.042 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:00.043 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.0", 2023-12-08T08:21:00.043 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCJ0XJlCC1UNRAARGaNCoJFAvsCcXsQY6BjFg==", 2023-12-08T08:21:00.043 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:00.043 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-12-08T08:21:00.043 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow r", 2023-12-08T08:21:00.043 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow rw", 2023-12-08T08:21:00.043 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow rwx" 2023-12-08T08:21:00.043 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:00.043 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:00.043 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:00.043 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.1", 2023-12-08T08:21:00.043 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCJ0XJld2rjOBAAUnEIBuqXHktNpqFW/Ikf7g==", 2023-12-08T08:21:00.043 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:00.043 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-12-08T08:21:00.044 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow r", 2023-12-08T08:21:00.044 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow rw", 2023-12-08T08:21:00.044 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow rwx" 2023-12-08T08:21:00.044 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:00.044 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:00.044 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:00.044 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.admin", 2023-12-08T08:21:00.044 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCJ0XJl5zt3ARAACqokMwcpmbL/boyr7vMJvw==", 2023-12-08T08:21:00.044 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:00.044 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow *", 2023-12-08T08:21:00.044 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2023-12-08T08:21:00.044 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2023-12-08T08:21:00.044 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:00.044 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:00.044 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:00.045 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:00.045 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-mds", 2023-12-08T08:21:00.045 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCr0XJlh2mdKxAAsRg9N8C8QrghIRArTqXDXQ==", 2023-12-08T08:21:00.045 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:00.045 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-mds" 2023-12-08T08:21:00.045 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:00.045 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:00.045 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:00.045 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-mgr", 2023-12-08T08:21:00.045 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCr0XJlfXOdKxAAbNxIk9ml4KLjuRT+2Pz2vA==", 2023-12-08T08:21:00.045 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:00.045 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-08T08:21:00.045 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:00.045 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:00.045 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:00.046 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-osd", 2023-12-08T08:21:00.046 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCr0XJlEHydKxAAOwAwu/NOXYaf5/VRV6WSKg==", 2023-12-08T08:21:00.046 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:00.046 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-osd" 2023-12-08T08:21:00.046 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:00.046 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:00.046 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:00.046 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-rbd", 2023-12-08T08:21:00.046 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCr0XJlYoSdKxAAFN6L1mtBthRDW7Y56xQGfg==", 2023-12-08T08:21:00.046 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:00.046 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-08T08:21:00.046 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:00.046 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:00.046 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:00.047 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-08T08:21:00.047 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCr0XJlQI2dKxAAxbINUgIG6WsA9Cjai/Gdiw==", 2023-12-08T08:21:00.047 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:00.047 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-08T08:21:00.047 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:00.047 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:00.047 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:00.047 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-rgw", 2023-12-08T08:21:00.047 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCr0XJlHpadKxAArNMCKN6QlpO+qi+/PNqkzA==", 2023-12-08T08:21:00.048 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:00.048 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-08T08:21:00.048 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:00.048 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:00.048 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:00.048 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mgr.x", 2023-12-08T08:21:00.048 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCJ0XJl4fEwGRAA7AYI8JM8WALXPX5s5d4ybg==", 2023-12-08T08:21:00.049 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:00.049 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow *", 2023-12-08T08:21:00.049 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile mgr", 2023-12-08T08:21:00.049 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:00.049 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:00.049 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:00.049 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:00.049 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mgr.y", 2023-12-08T08:21:00.049 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCJ0XJlIJRaFRAALL9eP2riyJXD1ZixzxpiWw==", 2023-12-08T08:21:00.049 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:00.049 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow *", 2023-12-08T08:21:00.049 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile mgr", 2023-12-08T08:21:00.049 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:00.050 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:00.050 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:00.050 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-12-08T08:21:00.050 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-08T08:21:00.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.025+0000 7fdd0d09f640 1 -- 172.21.15.88:0/751902437 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdcf4066470 msgr2=0x7fdcf4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:00.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.025+0000 7fdd0d09f640 1 --2- 172.21.15.88:0/751902437 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdcf4066470 0x7fdcf4068930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009f50 tx=0x7fdcf8009190 comp rx=0 tx=0).stop 2023-12-08T08:21:00.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.025+0000 7fdd0d09f640 1 -- 172.21.15.88:0/751902437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd08157910 msgr2=0x7fdd08147f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:00.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.025+0000 7fdd0d09f640 1 --2- 172.21.15.88:0/751902437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd08157910 0x7fdd08147f50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000c730 tx=0x7fdd0000cbf0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.025+0000 7fdd0d09f640 1 -- 172.21.15.88:0/751902437 shutdown_connections 2023-12-08T08:21:00.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.025+0000 7fdd0d09f640 1 --2- 172.21.15.88:0/751902437 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdcf4066470 0x7fdcf4068930 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.025+0000 7fdd0d09f640 1 --2- 172.21.15.88:0/751902437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd08157910 0x7fdd08147f50 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.025+0000 7fdd0d09f640 1 --2- 172.21.15.88:0/751902437 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdd08151b40 0x7fdd081f01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.025+0000 7fdd0d09f640 1 --2- 172.21.15.88:0/751902437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd080c9f80 0x7fdd081497d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.025+0000 7fdd0d09f640 1 -- 172.21.15.88:0/751902437 >> 172.21.15.88:0/751902437 conn(0x7fdd08066470 msgr2=0x7fdd08066850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:00.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.025+0000 7fdd0d09f640 1 -- 172.21.15.88:0/751902437 shutdown_connections 2023-12-08T08:21:00.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.025+0000 7fdd0d09f640 1 -- 172.21.15.88:0/751902437 wait complete. 2023-12-08T08:21:00.053 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-08T08:21:00.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.185+0000 7f27e9901640 1 Processor -- start 2023-12-08T08:21:00.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.185+0000 7f27e9901640 1 -- start start 2023-12-08T08:21:00.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.185+0000 7f27e9901640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27e406bc70 0x7f27e40a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:00.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.189+0000 7f27e9901640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f27e40c66b0 0x7f27e414de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:00.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.189+0000 7f27e9901640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e40a4cc0 con 0x7f27e414e380 2023-12-08T08:21:00.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.189+0000 7f27e9901640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e40c23d0 con 0x7f27e40c66b0 2023-12-08T08:21:00.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.189+0000 7f27e9901640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e40c1b70 con 0x7f27e406bc70 2023-12-08T08:21:00.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.189+0000 7f27da7fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f27e40c66b0 0x7f27e414de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:00.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.189+0000 7f27e37fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f27e414e380 0x7f27e4150f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:56090/0 (socket says 172.21.15.88:56090) 2023-12-08T08:21:00.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.189+0000 7f27e37fe640 1 -- 172.21.15.88:0/560859394 learned_addr learned my addr 172.21.15.88:0/560859394 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:00.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.189+0000 7f27e2ffd640 1 --2- 172.21.15.88:0/560859394 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27e406bc70 0x7f27e40a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:00.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.189+0000 7f27da7fc640 1 -- 172.21.15.88:0/560859394 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27e406bc70 msgr2=0x7f27e40a4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:00.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.189+0000 7f27da7fc640 1 --2- 172.21.15.88:0/560859394 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27e406bc70 0x7f27e40a4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.189+0000 7f27da7fc640 1 -- 172.21.15.88:0/560859394 >> v1:172.21.15.88:6789/0 conn(0x7f27e414e380 legacy=0x7f27e4150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:00.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.189+0000 7f27da7fc640 1 -- 172.21.15.88:0/560859394 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e40c1d80 con 0x7f27e40c66b0 2023-12-08T08:21:00.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.189+0000 7f27e27fc640 1 -- 172.21.15.88:0/560859394 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307857047 0 0) 0x7f27e40a4cc0 con 0x7f27e414e380 2023-12-08T08:21:00.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.189+0000 7f27da7fc640 1 --2- 172.21.15.88:0/560859394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27e40c66b0 0x7f27e414de40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f27cc009dc0 tx=0x7f27cc01c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a6e3ad96bfca8e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:00.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.193+0000 7f27e27fc640 1 -- 172.21.15.88:0/560859394 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc0a6710 con 0x7f27e40c66b0 2023-12-08T08:21:00.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.193+0000 7f27e27fc640 1 -- 172.21.15.88:0/560859394 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27cc0a6870 con 0x7f27e40c66b0 2023-12-08T08:21:00.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.193+0000 7f27e27fc640 1 -- 172.21.15.88:0/560859394 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc0a6c00 con 0x7f27e40c66b0 2023-12-08T08:21:00.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.193+0000 7f27e9901640 1 -- 172.21.15.88:0/560859394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27e40c66b0 msgr2=0x7f27e414de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:00.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.193+0000 7f27e9901640 1 --2- 172.21.15.88:0/560859394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27e40c66b0 0x7f27e414de40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f27cc009dc0 tx=0x7f27cc01c810 comp rx=0 tx=0).stop 2023-12-08T08:21:00.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.193+0000 7f27e9901640 1 -- 172.21.15.88:0/560859394 shutdown_connections 2023-12-08T08:21:00.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.193+0000 7f27e9901640 1 --2- 172.21.15.88:0/560859394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27e40c66b0 0x7f27e414de40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.193+0000 7f27e9901640 1 --2- 172.21.15.88:0/560859394 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27e406bc70 0x7f27e40a4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.193+0000 7f27e9901640 1 -- 172.21.15.88:0/560859394 >> 172.21.15.88:0/560859394 conn(0x7f27e406b220 msgr2=0x7f27e40a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:00.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.193+0000 7f27e9901640 1 -- 172.21.15.88:0/560859394 shutdown_connections 2023-12-08T08:21:00.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.193+0000 7f27e9901640 1 -- 172.21.15.88:0/560859394 wait complete. 2023-12-08T08:21:00.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.193+0000 7f27e9901640 1 Processor -- start 2023-12-08T08:21:00.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.193+0000 7f27e9901640 1 -- start start 2023-12-08T08:21:00.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.193+0000 7f27e9901640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27e406bc70 0x7f27e4144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:00.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.193+0000 7f27e9901640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e40c66b0 0x7f27e41f0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:00.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.193+0000 7f27e9901640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27e414e380 0x7f27e414ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:00.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.193+0000 7f27e9901640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e4145150 con 0x7f27e406bc70 2023-12-08T08:21:00.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.193+0000 7f27e9901640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e41ecdc0 con 0x7f27e40c66b0 2023-12-08T08:21:00.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.193+0000 7f27e9901640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e4144e70 con 0x7f27e414e380 2023-12-08T08:21:00.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.193+0000 7f27e2ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27e406bc70 0x7f27e4144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:00.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.193+0000 7f27e2ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27e406bc70 0x7f27e4144770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51976/0 (socket says 172.21.15.88:51976) 2023-12-08T08:21:00.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.193+0000 7f27e2ffd640 1 -- 172.21.15.88:0/3335960941 learned_addr learned my addr 172.21.15.88:0/3335960941 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:00.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.193+0000 7f27da7fc640 1 --2- 172.21.15.88:0/3335960941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e40c66b0 0x7f27e41f0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:00.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.193+0000 7f27e37fe640 1 --2- 172.21.15.88:0/3335960941 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27e414e380 0x7f27e414ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:00.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.197+0000 7f27e2ffd640 1 -- 172.21.15.88:0/3335960941 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27e414e380 msgr2=0x7f27e414ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:00.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.197+0000 7f27e2ffd640 1 --2- 172.21.15.88:0/3335960941 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27e414e380 0x7f27e414ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.197+0000 7f27e2ffd640 1 -- 172.21.15.88:0/3335960941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e40c66b0 msgr2=0x7f27e41f0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:00.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.197+0000 7f27e2ffd640 1 --2- 172.21.15.88:0/3335960941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e40c66b0 0x7f27e41f0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.197+0000 7f27e2ffd640 1 -- 172.21.15.88:0/3335960941 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27cc009a70 con 0x7f27e406bc70 2023-12-08T08:21:00.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.197+0000 7f27e37fe640 1 --2- 172.21.15.88:0/3335960941 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27e414e380 0x7f27e414ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:00.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.197+0000 7f27da7fc640 1 --2- 172.21.15.88:0/3335960941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e40c66b0 0x7f27e41f0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:00.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.197+0000 7f27e2ffd640 1 --2- 172.21.15.88:0/3335960941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27e406bc70 0x7f27e4144770 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f27d400e930 tx=0x7f27d400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:00.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.197+0000 7f27e0ff9640 1 -- 172.21.15.88:0/3335960941 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d4009690 con 0x7f27e406bc70 2023-12-08T08:21:00.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.197+0000 7f27e0ff9640 1 -- 172.21.15.88:0/3335960941 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d400ca00 con 0x7f27e406bc70 2023-12-08T08:21:00.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.197+0000 7f27e9901640 1 -- 172.21.15.88:0/3335960941 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e41ed060 con 0x7f27e406bc70 2023-12-08T08:21:00.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.197+0000 7f27e0ff9640 1 -- 172.21.15.88:0/3335960941 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d400cd70 con 0x7f27e406bc70 2023-12-08T08:21:00.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.197+0000 7f27e9901640 1 -- 172.21.15.88:0/3335960941 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e41504a0 con 0x7f27e406bc70 2023-12-08T08:21:00.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.197+0000 7f27e9901640 1 -- 172.21.15.88:0/3335960941 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e41ecc20 con 0x7f27e406bc70 2023-12-08T08:21:00.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.197+0000 7f27e0ff9640 1 -- 172.21.15.88:0/3335960941 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f27d4013470 con 0x7f27e406bc70 2023-12-08T08:21:00.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.197+0000 7f27e0ff9640 1 --2- 172.21.15.88:0/3335960941 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f27c4066470 0x7f27c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:00.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.197+0000 7f27e0ff9640 1 -- 172.21.15.88:0/3335960941 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f27d4083eb0 con 0x7f27e406bc70 2023-12-08T08:21:00.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.197+0000 7f27da7fc640 1 --2- 172.21.15.88:0/3335960941 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f27c4066470 0x7f27c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:00.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.201+0000 7f27da7fc640 1 --2- 172.21.15.88:0/3335960941 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f27c4066470 0x7f27c4068930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0af000 tx=0x7f27cc0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:00.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.201+0000 7f27e0ff9640 1 -- 172.21.15.88:0/3335960941 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f27e41ecc20 con 0x7f27e406bc70 2023-12-08T08:21:00.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.405+0000 7f27e9901640 1 -- 172.21.15.88:0/3335960941 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f27e41ecc20 con 0x7f27e406bc70 2023-12-08T08:21:00.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.409+0000 7f27e0ff9640 1 -- 172.21.15.88:0/3335960941 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f27e41ecc20 con 0x7f27e406bc70 2023-12-08T08:21:00.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.409+0000 7f27e9901640 1 -- 172.21.15.88:0/3335960941 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f27c4066470 msgr2=0x7f27c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:00.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.409+0000 7f27e9901640 1 --2- 172.21.15.88:0/3335960941 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f27c4066470 0x7f27c4068930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0af000 tx=0x7f27cc0a7000 comp rx=0 tx=0).stop 2023-12-08T08:21:00.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.409+0000 7f27e9901640 1 -- 172.21.15.88:0/3335960941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27e406bc70 msgr2=0x7f27e4144770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:00.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.409+0000 7f27e9901640 1 --2- 172.21.15.88:0/3335960941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27e406bc70 0x7f27e4144770 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f27d400e930 tx=0x7f27d400edf0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.409+0000 7f27e9901640 1 -- 172.21.15.88:0/3335960941 shutdown_connections 2023-12-08T08:21:00.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.409+0000 7f27e9901640 1 --2- 172.21.15.88:0/3335960941 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f27c4066470 0x7f27c4068930 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.409+0000 7f27e9901640 1 --2- 172.21.15.88:0/3335960941 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f27e414e380 0x7f27e414ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.409+0000 7f27e9901640 1 --2- 172.21.15.88:0/3335960941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e40c66b0 0x7f27e41f0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.409+0000 7f27e9901640 1 --2- 172.21.15.88:0/3335960941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27e406bc70 0x7f27e4144770 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.409+0000 7f27e9901640 1 -- 172.21.15.88:0/3335960941 >> 172.21.15.88:0/3335960941 conn(0x7f27e406b220 msgr2=0x7f27e41490f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:00.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.409+0000 7f27e9901640 1 -- 172.21.15.88:0/3335960941 shutdown_connections 2023-12-08T08:21:00.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.409+0000 7f27e9901640 1 -- 172.21.15.88:0/3335960941 wait complete. 2023-12-08T08:21:00.437 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-08T08:21:00.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.573+0000 7fe5e571c640 1 Processor -- start 2023-12-08T08:21:00.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.573+0000 7fe5e571c640 1 -- start start 2023-12-08T08:21:00.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.573+0000 7fe5e571c640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe5e00c47b0 0x7fe5e00c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:00.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.573+0000 7fe5e571c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e00c6840 con 0x7fe5e00bd550 2023-12-08T08:21:00.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.573+0000 7fe5e571c640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e0158a00 con 0x7fe5e0155950 2023-12-08T08:21:00.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.573+0000 7fe5e571c640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e00af870 con 0x7fe5e00c47b0 2023-12-08T08:21:00.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.573+0000 7fe5d67fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe5e00bd550 0x7fe5e0154ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:56106/0 (socket says 172.21.15.88:56106) 2023-12-08T08:21:00.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.573+0000 7fe5d67fc640 1 -- 172.21.15.88:0/3125129707 learned_addr learned my addr 172.21.15.88:0/3125129707 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:00.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.573+0000 7fe5deffd640 1 --2- 172.21.15.88:0/3125129707 >> v2:172.21.15.148:3300/0 conn(0x7fe5e00c47b0 0x7fe5e00c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:00.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.573+0000 7fe5de7fc640 1 -- 172.21.15.88:0/3125129707 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063582048 0 0) 0x7fe5e00c6840 con 0x7fe5e00bd550 2023-12-08T08:21:00.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.573+0000 7fe5de7fc640 1 -- 172.21.15.88:0/3125129707 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5cc003530 con 0x7fe5e00bd550 2023-12-08T08:21:00.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.573+0000 7fe5de7fc640 1 -- 172.21.15.88:0/3125129707 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3952707191 0 0) 0x7fe5d80014a0 con 0x7fe5e0155950 2023-12-08T08:21:00.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.573+0000 7fe5de7fc640 1 -- 172.21.15.88:0/3125129707 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5e00c6840 con 0x7fe5e0155950 2023-12-08T08:21:00.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.573+0000 7fe5deffd640 1 -- 172.21.15.88:0/3125129707 >> v1:172.21.15.148:6789/0 conn(0x7fe5e0155950 legacy=0x7fe5e01582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:00.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.573+0000 7fe5deffd640 1 -- 172.21.15.88:0/3125129707 >> v1:172.21.15.88:6789/0 conn(0x7fe5e00bd550 legacy=0x7fe5e0154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:00.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.573+0000 7fe5deffd640 1 -- 172.21.15.88:0/3125129707 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e00c6a70 con 0x7fe5e00c47b0 2023-12-08T08:21:00.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.577+0000 7fe5deffd640 1 --2- 172.21.15.88:0/3125129707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5e00c47b0 0x7fe5e00c4b90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00097c0 tx=0x7fe5d001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ce819385ffff59b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:00.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.577+0000 7fe5de7fc640 1 -- 172.21.15.88:0/3125129707 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d00ab600 con 0x7fe5e00c47b0 2023-12-08T08:21:00.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.577+0000 7fe5de7fc640 1 -- 172.21.15.88:0/3125129707 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d00a7050 con 0x7fe5e00c47b0 2023-12-08T08:21:00.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.577+0000 7fe5de7fc640 1 -- 172.21.15.88:0/3125129707 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d00ab980 con 0x7fe5e00c47b0 2023-12-08T08:21:00.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.577+0000 7fe5e571c640 1 -- 172.21.15.88:0/3125129707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5e00c47b0 msgr2=0x7fe5e00c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:00.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.577+0000 7fe5e571c640 1 --2- 172.21.15.88:0/3125129707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5e00c47b0 0x7fe5e00c4b90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00097c0 tx=0x7fe5d001c3f0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.577+0000 7fe5e571c640 1 -- 172.21.15.88:0/3125129707 shutdown_connections 2023-12-08T08:21:00.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.577+0000 7fe5e571c640 1 --2- 172.21.15.88:0/3125129707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5e00c47b0 0x7fe5e00c4b90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.577+0000 7fe5e571c640 1 -- 172.21.15.88:0/3125129707 >> 172.21.15.88:0/3125129707 conn(0x7fe5e00aba00 msgr2=0x7fe5e00abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:00.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.577+0000 7fe5e571c640 1 -- 172.21.15.88:0/3125129707 shutdown_connections 2023-12-08T08:21:00.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.577+0000 7fe5e571c640 1 -- 172.21.15.88:0/3125129707 wait complete. 2023-12-08T08:21:00.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.581+0000 7fe5e571c640 1 Processor -- start 2023-12-08T08:21:00.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.581+0000 7fe5e571c640 1 -- start start 2023-12-08T08:21:00.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.581+0000 7fe5e571c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5e00bd550 0x7fe5e00c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:00.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.581+0000 7fe5e571c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5e00c47b0 0x7fe5e0148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:00.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.581+0000 7fe5e571c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5e0155950 0x7fe5e00c2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:00.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.581+0000 7fe5e571c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e00c8cd0 con 0x7fe5e0155950 2023-12-08T08:21:00.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.581+0000 7fe5e571c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e00acdb0 con 0x7fe5e00bd550 2023-12-08T08:21:00.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.581+0000 7fe5e571c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e00acad0 con 0x7fe5e00c47b0 2023-12-08T08:21:00.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.581+0000 7fe5df7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5e0155950 0x7fe5e00c2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:00.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.581+0000 7fe5df7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5e0155950 0x7fe5e00c2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51992/0 (socket says 172.21.15.88:51992) 2023-12-08T08:21:00.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.581+0000 7fe5df7fe640 1 -- 172.21.15.88:0/4063444557 learned_addr learned my addr 172.21.15.88:0/4063444557 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:00.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.581+0000 7fe5d67fc640 1 --2- 172.21.15.88:0/4063444557 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5e00c47b0 0x7fe5e0148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:00.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.581+0000 7fe5deffd640 1 --2- 172.21.15.88:0/4063444557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5e00bd550 0x7fe5e00c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:00.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.581+0000 7fe5df7fe640 1 -- 172.21.15.88:0/4063444557 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5e00c47b0 msgr2=0x7fe5e0148230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:00.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.581+0000 7fe5df7fe640 1 --2- 172.21.15.88:0/4063444557 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5e00c47b0 0x7fe5e0148230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.581+0000 7fe5df7fe640 1 -- 172.21.15.88:0/4063444557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5e00bd550 msgr2=0x7fe5e00c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:00.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.581+0000 7fe5df7fe640 1 --2- 172.21.15.88:0/4063444557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5e00bd550 0x7fe5e00c2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.581+0000 7fe5df7fe640 1 -- 172.21.15.88:0/4063444557 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d0009420 con 0x7fe5e0155950 2023-12-08T08:21:00.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.581+0000 7fe5deffd640 1 --2- 172.21.15.88:0/4063444557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5e00bd550 0x7fe5e00c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:21:00.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.581+0000 7fe5df7fe640 1 --2- 172.21.15.88:0/4063444557 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5e0155950 0x7fe5e00c2f60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe5d800c700 tx=0x7fe5d800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:00.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.581+0000 7fe5d7fff640 1 -- 172.21.15.88:0/4063444557 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8003b80 con 0x7fe5e0155950 2023-12-08T08:21:00.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.581+0000 7fe5d7fff640 1 -- 172.21.15.88:0/4063444557 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d8003ce0 con 0x7fe5e0155950 2023-12-08T08:21:00.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.581+0000 7fe5e571c640 1 -- 172.21.15.88:0/4063444557 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e00ade80 con 0x7fe5e0155950 2023-12-08T08:21:00.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.581+0000 7fe5d7fff640 1 -- 172.21.15.88:0/4063444557 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d800aa90 con 0x7fe5e0155950 2023-12-08T08:21:00.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.581+0000 7fe5e571c640 1 -- 172.21.15.88:0/4063444557 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e00ae440 con 0x7fe5e0155950 2023-12-08T08:21:00.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.585+0000 7fe5e571c640 1 -- 172.21.15.88:0/4063444557 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5e00ae660 con 0x7fe5e0155950 2023-12-08T08:21:00.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.585+0000 7fe5d7fff640 1 -- 172.21.15.88:0/4063444557 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe5d800abf0 con 0x7fe5e0155950 2023-12-08T08:21:00.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.585+0000 7fe5d7fff640 1 --2- 172.21.15.88:0/4063444557 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe5c0066470 0x7fe5c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:00.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.585+0000 7fe5d7fff640 1 -- 172.21.15.88:0/4063444557 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe5d8083720 con 0x7fe5e0155950 2023-12-08T08:21:00.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.585+0000 7fe5deffd640 1 --2- 172.21.15.88:0/4063444557 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe5c0066470 0x7fe5c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:00.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.585+0000 7fe5deffd640 1 --2- 172.21.15.88:0/4063444557 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe5c0066470 0x7fe5c0068930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00ad000 tx=0x7fe5d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:00.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.589+0000 7fe5d7fff640 1 -- 172.21.15.88:0/4063444557 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe5d8050f90 con 0x7fe5e0155950 2023-12-08T08:21:00.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.797+0000 7fe5e571c640 1 -- 172.21.15.88:0/4063444557 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fe5e0158a00 con 0x7fe5e0155950 2023-12-08T08:21:00.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.801+0000 7fe5d7fff640 1 -- 172.21.15.88:0/4063444557 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe5e0158a00 con 0x7fe5e0155950 2023-12-08T08:21:00.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.801+0000 7fe5e571c640 1 -- 172.21.15.88:0/4063444557 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe5c0066470 msgr2=0x7fe5c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:00.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.801+0000 7fe5e571c640 1 --2- 172.21.15.88:0/4063444557 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe5c0066470 0x7fe5c0068930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00ad000 tx=0x7fe5d0008040 comp rx=0 tx=0).stop 2023-12-08T08:21:00.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.801+0000 7fe5e571c640 1 -- 172.21.15.88:0/4063444557 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5e0155950 msgr2=0x7fe5e00c2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:00.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.801+0000 7fe5e571c640 1 --2- 172.21.15.88:0/4063444557 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5e0155950 0x7fe5e00c2f60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe5d800c700 tx=0x7fe5d800cbc0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.801+0000 7fe5e571c640 1 -- 172.21.15.88:0/4063444557 shutdown_connections 2023-12-08T08:21:00.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.801+0000 7fe5e571c640 1 --2- 172.21.15.88:0/4063444557 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe5c0066470 0x7fe5c0068930 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.801+0000 7fe5e571c640 1 --2- 172.21.15.88:0/4063444557 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5e0155950 0x7fe5e00c2f60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.801+0000 7fe5e571c640 1 --2- 172.21.15.88:0/4063444557 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe5e00c47b0 0x7fe5e0148230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.801+0000 7fe5e571c640 1 --2- 172.21.15.88:0/4063444557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5e00bd550 0x7fe5e00c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.801+0000 7fe5e571c640 1 -- 172.21.15.88:0/4063444557 >> 172.21.15.88:0/4063444557 conn(0x7fe5e00aba00 msgr2=0x7fe5e00abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:00.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.801+0000 7fe5e571c640 1 -- 172.21.15.88:0/4063444557 shutdown_connections 2023-12-08T08:21:00.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.801+0000 7fe5e571c640 1 -- 172.21.15.88:0/4063444557 wait complete. 2023-12-08T08:21:00.827 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-08T08:21:00.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.961+0000 7fc54eee4640 1 Processor -- start 2023-12-08T08:21:00.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.961+0000 7fc54eee4640 1 -- start start 2023-12-08T08:21:00.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.961+0000 7fc54eee4640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc548154390 0x7fc5480c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:00.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.961+0000 7fc54eee4640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5480a93d0 con 0x7fc5480c4f80 2023-12-08T08:21:00.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.961+0000 7fc54eee4640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5480a9640 con 0x7fc5480c2110 2023-12-08T08:21:00.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.961+0000 7fc54eee4640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5480aa1c0 con 0x7fc548154390 2023-12-08T08:21:00.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.961+0000 7fc54d481640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc5480c4f80 0x7fc54815bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:56120/0 (socket says 172.21.15.88:56120) 2023-12-08T08:21:00.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.961+0000 7fc54d481640 1 -- 172.21.15.88:0/1620577658 learned_addr learned my addr 172.21.15.88:0/1620577658 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:00.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.961+0000 7fc54cc80640 1 --2- 172.21.15.88:0/1620577658 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc548154390 0x7fc5480c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:00.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.961+0000 7fc53f7fe640 1 -- 172.21.15.88:0/1620577658 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 260024745 0 0) 0x7fc5480a93d0 con 0x7fc5480c4f80 2023-12-08T08:21:00.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.961+0000 7fc53f7fe640 1 -- 172.21.15.88:0/1620577658 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc530003530 con 0x7fc5480c4f80 2023-12-08T08:21:00.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.961+0000 7fc53f7fe640 1 -- 172.21.15.88:0/1620577658 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3861717876 0 0) 0x7fc5480a9640 con 0x7fc5480c2110 2023-12-08T08:21:00.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.961+0000 7fc53f7fe640 1 -- 172.21.15.88:0/1620577658 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5480a93d0 con 0x7fc5480c2110 2023-12-08T08:21:00.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.961+0000 7fc54cc80640 1 -- 172.21.15.88:0/1620577658 >> v1:172.21.15.148:6789/0 conn(0x7fc5480c2110 legacy=0x7fc5480c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:00.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.961+0000 7fc54cc80640 1 -- 172.21.15.88:0/1620577658 >> v1:172.21.15.88:6789/0 conn(0x7fc5480c4f80 legacy=0x7fc54815bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:00.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.961+0000 7fc54cc80640 1 -- 172.21.15.88:0/1620577658 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5480a9920 con 0x7fc548154390 2023-12-08T08:21:00.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.965+0000 7fc54cc80640 1 --2- 172.21.15.88:0/1620577658 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc548154390 0x7fc5480c4a40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc5440097f0 tx=0x7fc54401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c4981574a6f8876 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:00.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.965+0000 7fc53f7fe640 1 -- 172.21.15.88:0/1620577658 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5440ac630 con 0x7fc548154390 2023-12-08T08:21:00.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.965+0000 7fc53f7fe640 1 -- 172.21.15.88:0/1620577658 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5440ac790 con 0x7fc548154390 2023-12-08T08:21:00.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.965+0000 7fc53f7fe640 1 -- 172.21.15.88:0/1620577658 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5440acb20 con 0x7fc548154390 2023-12-08T08:21:00.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.965+0000 7fc54eee4640 1 -- 172.21.15.88:0/1620577658 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc548154390 msgr2=0x7fc5480c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:00.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.965+0000 7fc54eee4640 1 --2- 172.21.15.88:0/1620577658 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc548154390 0x7fc5480c4a40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc5440097f0 tx=0x7fc54401c4c0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.965+0000 7fc54eee4640 1 -- 172.21.15.88:0/1620577658 shutdown_connections 2023-12-08T08:21:00.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.965+0000 7fc54eee4640 1 --2- 172.21.15.88:0/1620577658 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc548154390 0x7fc5480c4a40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.965+0000 7fc54eee4640 1 -- 172.21.15.88:0/1620577658 >> 172.21.15.88:0/1620577658 conn(0x7fc54806b220 msgr2=0x7fc5480a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:00.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.965+0000 7fc54eee4640 1 -- 172.21.15.88:0/1620577658 shutdown_connections 2023-12-08T08:21:00.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.965+0000 7fc54eee4640 1 -- 172.21.15.88:0/1620577658 wait complete. 2023-12-08T08:21:00.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.965+0000 7fc54eee4640 1 Processor -- start 2023-12-08T08:21:00.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.969+0000 7fc54eee4640 1 -- start start 2023-12-08T08:21:00.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.969+0000 7fc54eee4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5480c2110 0x7fc54814f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:00.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.969+0000 7fc54eee4640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc5480c4f80 0x7fc54814e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:00.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.969+0000 7fc54eee4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc548154390 0x7fc54814e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:00.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.969+0000 7fc54eee4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc548072760 con 0x7fc5480c2110 2023-12-08T08:21:00.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.969+0000 7fc54eee4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc548072a40 con 0x7fc548154390 2023-12-08T08:21:00.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.969+0000 7fc54eee4640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54814fff0 con 0x7fc5480c4f80 2023-12-08T08:21:00.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.969+0000 7fc54cc80640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5480c2110 0x7fc54814f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:00.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.969+0000 7fc54cc80640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5480c2110 0x7fc54814f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52006/0 (socket says 172.21.15.88:52006) 2023-12-08T08:21:00.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.969+0000 7fc54cc80640 1 -- 172.21.15.88:0/318571482 learned_addr learned my addr 172.21.15.88:0/318571482 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:00.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.969+0000 7fc53ffff640 1 --2- 172.21.15.88:0/318571482 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc5480c4f80 0x7fc54814e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:00.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.969+0000 7fc54d481640 1 --2- 172.21.15.88:0/318571482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc548154390 0x7fc54814e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:00.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.969+0000 7fc54cc80640 1 -- 172.21.15.88:0/318571482 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc5480c4f80 msgr2=0x7fc54814e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:00.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.969+0000 7fc54cc80640 1 --2- 172.21.15.88:0/318571482 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc5480c4f80 0x7fc54814e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.969+0000 7fc54cc80640 1 -- 172.21.15.88:0/318571482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc548154390 msgr2=0x7fc54814e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:00.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.969+0000 7fc54cc80640 1 --2- 172.21.15.88:0/318571482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc548154390 0x7fc54814e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.969+0000 7fc54cc80640 1 -- 172.21.15.88:0/318571482 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc544009420 con 0x7fc5480c2110 2023-12-08T08:21:00.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.969+0000 7fc54cc80640 1 --2- 172.21.15.88:0/318571482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5480c2110 0x7fc54814f5e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc5440190d0 tx=0x7fc544019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:00.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.969+0000 7fc53d7fa640 1 -- 172.21.15.88:0/318571482 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5440b7680 con 0x7fc5480c2110 2023-12-08T08:21:00.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.969+0000 7fc53d7fa640 1 -- 172.21.15.88:0/318571482 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5440b77e0 con 0x7fc5480c2110 2023-12-08T08:21:00.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.969+0000 7fc53d7fa640 1 -- 172.21.15.88:0/318571482 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5440b7b90 con 0x7fc5480c2110 2023-12-08T08:21:00.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.969+0000 7fc54eee4640 1 -- 172.21.15.88:0/318571482 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5481502d0 con 0x7fc5480c2110 2023-12-08T08:21:00.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.969+0000 7fc54eee4640 1 -- 172.21.15.88:0/318571482 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5480a78e0 con 0x7fc5480c2110 2023-12-08T08:21:00.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.969+0000 7fc54eee4640 1 -- 172.21.15.88:0/318571482 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5480679d0 con 0x7fc5480c2110 2023-12-08T08:21:00.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.973+0000 7fc53d7fa640 1 -- 172.21.15.88:0/318571482 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc5440b3040 con 0x7fc5480c2110 2023-12-08T08:21:00.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.973+0000 7fc53d7fa640 1 --2- 172.21.15.88:0/318571482 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc534066470 0x7fc534068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:00.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.973+0000 7fc53d7fa640 1 -- 172.21.15.88:0/318571482 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc54411e170 con 0x7fc5480c2110 2023-12-08T08:21:00.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.973+0000 7fc53ffff640 1 --2- 172.21.15.88:0/318571482 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc534066470 0x7fc534068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:00.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.973+0000 7fc53ffff640 1 --2- 172.21.15.88:0/318571482 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc534066470 0x7fc534068930 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc5481f1f00 tx=0x7fc538009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:00.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:00.977+0000 7fc53d7fa640 1 -- 172.21.15.88:0/318571482 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc5440eba60 con 0x7fc5480c2110 2023-12-08T08:21:01.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.177+0000 7fc54eee4640 1 -- 172.21.15.88:0/318571482 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fc548067630 con 0x7fc5480c2110 2023-12-08T08:21:01.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.181+0000 7fc53d7fa640 1 -- 172.21.15.88:0/318571482 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc544006e20 con 0x7fc5480c2110 2023-12-08T08:21:01.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.185+0000 7fc54eee4640 1 -- 172.21.15.88:0/318571482 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc534066470 msgr2=0x7fc534068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.185+0000 7fc54eee4640 1 --2- 172.21.15.88:0/318571482 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc534066470 0x7fc534068930 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc5481f1f00 tx=0x7fc538009040 comp rx=0 tx=0).stop 2023-12-08T08:21:01.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.185+0000 7fc54eee4640 1 -- 172.21.15.88:0/318571482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5480c2110 msgr2=0x7fc54814f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.185+0000 7fc54eee4640 1 --2- 172.21.15.88:0/318571482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5480c2110 0x7fc54814f5e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc5440190d0 tx=0x7fc544019260 comp rx=0 tx=0).stop 2023-12-08T08:21:01.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.185+0000 7fc54eee4640 1 -- 172.21.15.88:0/318571482 shutdown_connections 2023-12-08T08:21:01.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.185+0000 7fc54eee4640 1 --2- 172.21.15.88:0/318571482 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc534066470 0x7fc534068930 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.185+0000 7fc54eee4640 1 --2- 172.21.15.88:0/318571482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc548154390 0x7fc54814e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.185+0000 7fc54eee4640 1 --2- 172.21.15.88:0/318571482 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc5480c4f80 0x7fc54814e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.185+0000 7fc54eee4640 1 --2- 172.21.15.88:0/318571482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5480c2110 0x7fc54814f5e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.185+0000 7fc54eee4640 1 -- 172.21.15.88:0/318571482 >> 172.21.15.88:0/318571482 conn(0x7fc54806b220 msgr2=0x7fc548151a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:01.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.185+0000 7fc54eee4640 1 -- 172.21.15.88:0/318571482 shutdown_connections 2023-12-08T08:21:01.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.185+0000 7fc54eee4640 1 -- 172.21.15.88:0/318571482 wait complete. 2023-12-08T08:21:01.210 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-08T08:21:01.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.341+0000 7f6a815c1640 1 Processor -- start 2023-12-08T08:21:01.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.341+0000 7f6a815c1640 1 -- start start 2023-12-08T08:21:01.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.345+0000 7f6a815c1640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6a7c0c2110 0x7f6a7c0c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.345+0000 7f6a815c1640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7c0a93d0 con 0x7f6a7c0c0c80 2023-12-08T08:21:01.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.345+0000 7f6a815c1640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7c0a9640 con 0x7f6a7c154390 2023-12-08T08:21:01.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.345+0000 7f6a815c1640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a7c0aa1c0 con 0x7f6a7c0c2110 2023-12-08T08:21:01.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.345+0000 7f6a7b7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6a7c0c0c80 0x7f6a7c0c61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:56134/0 (socket says 172.21.15.88:56134) 2023-12-08T08:21:01.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.345+0000 7f6a7b7fe640 1 -- 172.21.15.88:0/1516009212 learned_addr learned my addr 172.21.15.88:0/1516009212 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:01.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.345+0000 7f6a727fc640 1 --2- 172.21.15.88:0/1516009212 >> v2:172.21.15.148:3300/0 conn(0x7f6a7c0c2110 0x7f6a7c0c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.345+0000 7f6a7a7fc640 1 -- 172.21.15.88:0/1516009212 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1673891019 0 0) 0x7f6a7c0a93d0 con 0x7f6a7c0c0c80 2023-12-08T08:21:01.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.345+0000 7f6a7a7fc640 1 -- 172.21.15.88:0/1516009212 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a68003530 con 0x7f6a7c0c0c80 2023-12-08T08:21:01.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.345+0000 7f6a7a7fc640 1 -- 172.21.15.88:0/1516009212 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730273348 0 0) 0x7f6a7c0a9640 con 0x7f6a7c154390 2023-12-08T08:21:01.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.345+0000 7f6a7a7fc640 1 -- 172.21.15.88:0/1516009212 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a7c0a93d0 con 0x7f6a7c154390 2023-12-08T08:21:01.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.345+0000 7f6a727fc640 1 -- 172.21.15.88:0/1516009212 >> v1:172.21.15.148:6789/0 conn(0x7f6a7c154390 legacy=0x7f6a7c0c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.345+0000 7f6a727fc640 1 -- 172.21.15.88:0/1516009212 >> v1:172.21.15.88:6789/0 conn(0x7f6a7c0c0c80 legacy=0x7f6a7c0c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.345+0000 7f6a727fc640 1 -- 172.21.15.88:0/1516009212 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7c0a9920 con 0x7f6a7c0c2110 2023-12-08T08:21:01.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.349+0000 7f6a727fc640 1 --2- 172.21.15.88:0/1516009212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a7c0c2110 0x7f6a7c0c5ca0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009d90 tx=0x7f6a6401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81101317086c9994 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:01.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.349+0000 7f6a7a7fc640 1 -- 172.21.15.88:0/1516009212 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a640a5920 con 0x7f6a7c0c2110 2023-12-08T08:21:01.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.349+0000 7f6a7a7fc640 1 -- 172.21.15.88:0/1516009212 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a640a5a80 con 0x7f6a7c0c2110 2023-12-08T08:21:01.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.349+0000 7f6a7a7fc640 1 -- 172.21.15.88:0/1516009212 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a640a5e10 con 0x7f6a7c0c2110 2023-12-08T08:21:01.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.349+0000 7f6a815c1640 1 -- 172.21.15.88:0/1516009212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a7c0c2110 msgr2=0x7f6a7c0c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.349+0000 7f6a815c1640 1 --2- 172.21.15.88:0/1516009212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a7c0c2110 0x7f6a7c0c5ca0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009d90 tx=0x7f6a6401c950 comp rx=0 tx=0).stop 2023-12-08T08:21:01.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.349+0000 7f6a815c1640 1 -- 172.21.15.88:0/1516009212 shutdown_connections 2023-12-08T08:21:01.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.349+0000 7f6a815c1640 1 --2- 172.21.15.88:0/1516009212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a7c0c2110 0x7f6a7c0c5ca0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.349+0000 7f6a815c1640 1 -- 172.21.15.88:0/1516009212 >> 172.21.15.88:0/1516009212 conn(0x7f6a7c06b220 msgr2=0x7f6a7c0a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:01.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.349+0000 7f6a815c1640 1 -- 172.21.15.88:0/1516009212 shutdown_connections 2023-12-08T08:21:01.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.349+0000 7f6a815c1640 1 -- 172.21.15.88:0/1516009212 wait complete. 2023-12-08T08:21:01.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.349+0000 7f6a815c1640 1 Processor -- start 2023-12-08T08:21:01.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.349+0000 7f6a815c1640 1 -- start start 2023-12-08T08:21:01.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.353+0000 7f6a815c1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a7c0c0c80 0x7f6a7c15bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.353+0000 7f6a815c1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7c0c2110 0x7f6a7c1ed750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.353+0000 7f6a815c1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a7c154390 0x7f6a7c0c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.353+0000 7f6a815c1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c14dda0 con 0x7f6a7c0c2110 2023-12-08T08:21:01.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.353+0000 7f6a815c1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c1edc90 con 0x7f6a7c0c0c80 2023-12-08T08:21:01.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.353+0000 7f6a815c1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c0a57d0 con 0x7f6a7c154390 2023-12-08T08:21:01.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.353+0000 7f6a727fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7c0c2110 0x7f6a7c1ed750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.353+0000 7f6a727fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7c0c2110 0x7f6a7c1ed750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52020/0 (socket says 172.21.15.88:52020) 2023-12-08T08:21:01.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.353+0000 7f6a727fc640 1 -- 172.21.15.88:0/1706521898 learned_addr learned my addr 172.21.15.88:0/1706521898 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:01.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.353+0000 7f6a7affd640 1 --2- 172.21.15.88:0/1706521898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a7c0c0c80 0x7f6a7c15bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.353+0000 7f6a7b7fe640 1 --2- 172.21.15.88:0/1706521898 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a7c154390 0x7f6a7c0c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.353+0000 7f6a727fc640 1 -- 172.21.15.88:0/1706521898 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a7c154390 msgr2=0x7f6a7c0c5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.353+0000 7f6a727fc640 1 --2- 172.21.15.88:0/1706521898 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a7c154390 0x7f6a7c0c5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.353+0000 7f6a727fc640 1 -- 172.21.15.88:0/1706521898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a7c0c0c80 msgr2=0x7f6a7c15bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.353+0000 7f6a727fc640 1 --2- 172.21.15.88:0/1706521898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a7c0c0c80 0x7f6a7c15bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.353+0000 7f6a727fc640 1 -- 172.21.15.88:0/1706521898 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a64009a70 con 0x7f6a7c0c2110 2023-12-08T08:21:01.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.353+0000 7f6a727fc640 1 --2- 172.21.15.88:0/1706521898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7c0c2110 0x7f6a7c1ed750 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6a640b0040 tx=0x7f6a640196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:01.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.353+0000 7f6a73fff640 1 -- 172.21.15.88:0/1706521898 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a640add60 con 0x7f6a7c0c2110 2023-12-08T08:21:01.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.353+0000 7f6a73fff640 1 -- 172.21.15.88:0/1706521898 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a64009450 con 0x7f6a7c0c2110 2023-12-08T08:21:01.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.353+0000 7f6a815c1640 1 -- 172.21.15.88:0/1706521898 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7c15c3b0 con 0x7f6a7c0c2110 2023-12-08T08:21:01.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.353+0000 7f6a73fff640 1 -- 172.21.15.88:0/1706521898 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a640b9690 con 0x7f6a7c0c2110 2023-12-08T08:21:01.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.353+0000 7f6a815c1640 1 -- 172.21.15.88:0/1706521898 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7c0a5d20 con 0x7f6a7c0c2110 2023-12-08T08:21:01.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.353+0000 7f6a815c1640 1 -- 172.21.15.88:0/1706521898 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a7c0a5f10 con 0x7f6a7c0c2110 2023-12-08T08:21:01.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.353+0000 7f6a73fff640 1 -- 172.21.15.88:0/1706521898 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6a640b97f0 con 0x7f6a7c0c2110 2023-12-08T08:21:01.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.357+0000 7f6a73fff640 1 --2- 172.21.15.88:0/1706521898 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6a5c066470 0x7f6a5c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.357+0000 7f6a73fff640 1 -- 172.21.15.88:0/1706521898 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6a6411eff0 con 0x7f6a7c0c2110 2023-12-08T08:21:01.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.357+0000 7f6a7affd640 1 --2- 172.21.15.88:0/1706521898 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6a5c066470 0x7f6a5c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.357+0000 7f6a7affd640 1 --2- 172.21.15.88:0/1706521898 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6a5c066470 0x7f6a5c068930 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0011f0 tx=0x7f6a6c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:01.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.361+0000 7f6a73fff640 1 -- 172.21.15.88:0/1706521898 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6a640ec880 con 0x7f6a7c0c2110 2023-12-08T08:21:01.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.561+0000 7f6a815c1640 1 -- 172.21.15.88:0/1706521898 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f6a7c067630 con 0x7f6a7c0c2110 2023-12-08T08:21:01.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.565+0000 7f6a73fff640 1 -- 172.21.15.88:0/1706521898 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6a640efea0 con 0x7f6a7c0c2110 2023-12-08T08:21:01.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.565+0000 7f6a815c1640 1 -- 172.21.15.88:0/1706521898 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6a5c066470 msgr2=0x7f6a5c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.565+0000 7f6a815c1640 1 --2- 172.21.15.88:0/1706521898 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6a5c066470 0x7f6a5c068930 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0011f0 tx=0x7f6a6c009040 comp rx=0 tx=0).stop 2023-12-08T08:21:01.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.565+0000 7f6a815c1640 1 -- 172.21.15.88:0/1706521898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7c0c2110 msgr2=0x7f6a7c1ed750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.565+0000 7f6a815c1640 1 --2- 172.21.15.88:0/1706521898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7c0c2110 0x7f6a7c1ed750 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6a640b0040 tx=0x7f6a640196f0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.565+0000 7f6a815c1640 1 -- 172.21.15.88:0/1706521898 shutdown_connections 2023-12-08T08:21:01.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.565+0000 7f6a815c1640 1 --2- 172.21.15.88:0/1706521898 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6a5c066470 0x7f6a5c068930 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.565+0000 7f6a815c1640 1 --2- 172.21.15.88:0/1706521898 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a7c154390 0x7f6a7c0c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.565+0000 7f6a815c1640 1 --2- 172.21.15.88:0/1706521898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7c0c2110 0x7f6a7c1ed750 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.565+0000 7f6a815c1640 1 --2- 172.21.15.88:0/1706521898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a7c0c0c80 0x7f6a7c15bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.565+0000 7f6a815c1640 1 -- 172.21.15.88:0/1706521898 >> 172.21.15.88:0/1706521898 conn(0x7f6a7c06b220 msgr2=0x7f6a7c0c4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:01.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.565+0000 7f6a815c1640 1 -- 172.21.15.88:0/1706521898 shutdown_connections 2023-12-08T08:21:01.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.565+0000 7f6a815c1640 1 -- 172.21.15.88:0/1706521898 wait complete. 2023-12-08T08:21:01.591 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-08T08:21:01.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.725+0000 7f925f217640 1 Processor -- start 2023-12-08T08:21:01.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.725+0000 7f925f217640 1 -- start start 2023-12-08T08:21:01.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.725+0000 7f925f217640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f92580c47b0 0x7f92580c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.725+0000 7f925f217640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f92580bd550 0x7f9258155950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.725+0000 7f925f217640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9258154ee0 0x7f92581582f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.725+0000 7f925f217640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92580c6840 con 0x7f92580bd550 2023-12-08T08:21:01.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.725+0000 7f925f217640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92580af870 con 0x7f92580c47b0 2023-12-08T08:21:01.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.725+0000 7f925f217640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92580c6a70 con 0x7f9258154ee0 2023-12-08T08:21:01.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.725+0000 7f924ffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f92580bd550 0x7f9258155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.725+0000 7f924ffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f92580bd550 0x7f9258155950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52026/0 (socket says 172.21.15.88:52026) 2023-12-08T08:21:01.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.725+0000 7f924ffff640 1 -- 172.21.15.88:0/173313141 learned_addr learned my addr 172.21.15.88:0/173313141 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:01.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.725+0000 7f925d7b4640 1 --2- 172.21.15.88:0/173313141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9258154ee0 0x7f92581582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.725+0000 7f925cfb3640 1 --2- 172.21.15.88:0/173313141 >> v2:172.21.15.148:3300/0 conn(0x7f92580c47b0 0x7f92580c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.725+0000 7f924ffff640 1 -- 172.21.15.88:0/173313141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9258154ee0 msgr2=0x7f92581582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:01.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.725+0000 7f924ffff640 1 --2- 172.21.15.88:0/173313141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9258154ee0 0x7f92581582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.725+0000 7f924ffff640 1 -- 172.21.15.88:0/173313141 >> v2:172.21.15.148:3300/0 conn(0x7f92580c47b0 msgr2=0x7f92580c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:01.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.725+0000 7f924ffff640 1 --2- 172.21.15.88:0/173313141 >> v2:172.21.15.148:3300/0 conn(0x7f92580c47b0 0x7f92580c4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.725+0000 7f924ffff640 1 -- 172.21.15.88:0/173313141 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92580c6d50 con 0x7f92580bd550 2023-12-08T08:21:01.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.725+0000 7f925d7b4640 1 --2- 172.21.15.88:0/173313141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9258154ee0 0x7f92581582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:01.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.725+0000 7f925cfb3640 1 --2- 172.21.15.88:0/173313141 >> v2:172.21.15.148:3300/0 conn(0x7f92580c47b0 0x7f92580c4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:01.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.729+0000 7f924ffff640 1 --2- 172.21.15.88:0/173313141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92580bd550 0x7f9258155950 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f92580c7980 tx=0x7f924801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7ad5cfccef74c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:01.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.729+0000 7f924f7fe640 1 -- 172.21.15.88:0/173313141 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92480ab600 con 0x7f92580bd550 2023-12-08T08:21:01.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.729+0000 7f924f7fe640 1 -- 172.21.15.88:0/173313141 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92480a7050 con 0x7f92580bd550 2023-12-08T08:21:01.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.729+0000 7f924f7fe640 1 -- 172.21.15.88:0/173313141 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92480ab980 con 0x7f92580bd550 2023-12-08T08:21:01.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.729+0000 7f925f217640 1 -- 172.21.15.88:0/173313141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92580bd550 msgr2=0x7f9258155950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.729+0000 7f925f217640 1 --2- 172.21.15.88:0/173313141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92580bd550 0x7f9258155950 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f92580c7980 tx=0x7f924801c470 comp rx=0 tx=0).stop 2023-12-08T08:21:01.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.729+0000 7f925f217640 1 -- 172.21.15.88:0/173313141 shutdown_connections 2023-12-08T08:21:01.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.729+0000 7f925f217640 1 --2- 172.21.15.88:0/173313141 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9258154ee0 0x7f92581582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.729+0000 7f925f217640 1 --2- 172.21.15.88:0/173313141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92580bd550 0x7f9258155950 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.729+0000 7f925f217640 1 --2- 172.21.15.88:0/173313141 >> v2:172.21.15.148:3300/0 conn(0x7f92580c47b0 0x7f92580c4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.729+0000 7f925f217640 1 -- 172.21.15.88:0/173313141 >> 172.21.15.88:0/173313141 conn(0x7f92580aba00 msgr2=0x7f92580abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:01.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.729+0000 7f925f217640 1 -- 172.21.15.88:0/173313141 shutdown_connections 2023-12-08T08:21:01.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.729+0000 7f925f217640 1 -- 172.21.15.88:0/173313141 wait complete. 2023-12-08T08:21:01.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.733+0000 7f925f217640 1 Processor -- start 2023-12-08T08:21:01.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.733+0000 7f925f217640 1 -- start start 2023-12-08T08:21:01.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.733+0000 7f925f217640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92580bd550 0x7f925814eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.733+0000 7f925f217640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92580c47b0 0x7f92581f1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.733+0000 7f925f217640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9258154ee0 0x7f9258150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.733+0000 7f925f217640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92580c0ca0 con 0x7f92580c47b0 2023-12-08T08:21:01.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.733+0000 7f925f217640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925814f3e0 con 0x7f9258154ee0 2023-12-08T08:21:01.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.733+0000 7f925f217640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92580bf260 con 0x7f92580bd550 2023-12-08T08:21:01.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.733+0000 7f924ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92580c47b0 0x7f92581f1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.733+0000 7f924ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92580c47b0 0x7f92581f1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52028/0 (socket says 172.21.15.88:52028) 2023-12-08T08:21:01.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.733+0000 7f924ffff640 1 -- 172.21.15.88:0/2507109246 learned_addr learned my addr 172.21.15.88:0/2507109246 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:01.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.733+0000 7f925d7b4640 1 --2- 172.21.15.88:0/2507109246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9258154ee0 0x7f9258150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.733+0000 7f925cfb3640 1 --2- 172.21.15.88:0/2507109246 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92580bd550 0x7f925814eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.733+0000 7f924ffff640 1 -- 172.21.15.88:0/2507109246 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92580bd550 msgr2=0x7f925814eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.733+0000 7f924ffff640 1 --2- 172.21.15.88:0/2507109246 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92580bd550 0x7f925814eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.733+0000 7f924ffff640 1 -- 172.21.15.88:0/2507109246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9258154ee0 msgr2=0x7f9258150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.733+0000 7f924ffff640 1 --2- 172.21.15.88:0/2507109246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9258154ee0 0x7f9258150e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.733+0000 7f924ffff640 1 -- 172.21.15.88:0/2507109246 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92480094d0 con 0x7f92580c47b0 2023-12-08T08:21:01.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.733+0000 7f924ffff640 1 --2- 172.21.15.88:0/2507109246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92580c47b0 0x7f92581f1160 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f924801cd10 tx=0x7f9248019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:01.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.733+0000 7f924d7fa640 1 -- 172.21.15.88:0/2507109246 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92480b4420 con 0x7f92580c47b0 2023-12-08T08:21:01.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.733+0000 7f924d7fa640 1 -- 172.21.15.88:0/2507109246 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92480b4580 con 0x7f92580c47b0 2023-12-08T08:21:01.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.733+0000 7f925f217640 1 -- 172.21.15.88:0/2507109246 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9258155470 con 0x7f92580c47b0 2023-12-08T08:21:01.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.733+0000 7f924d7fa640 1 -- 172.21.15.88:0/2507109246 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92480b4910 con 0x7f92580c47b0 2023-12-08T08:21:01.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.733+0000 7f925f217640 1 -- 172.21.15.88:0/2507109246 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92580c2880 con 0x7f92580c47b0 2023-12-08T08:21:01.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.737+0000 7f925f217640 1 -- 172.21.15.88:0/2507109246 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9258067630 con 0x7f92580c47b0 2023-12-08T08:21:01.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.737+0000 7f924d7fa640 1 -- 172.21.15.88:0/2507109246 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f92480b2070 con 0x7f92580c47b0 2023-12-08T08:21:01.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.737+0000 7f924d7fa640 1 --2- 172.21.15.88:0/2507109246 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9244066470 0x7f9244068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.737+0000 7f924d7fa640 1 -- 172.21.15.88:0/2507109246 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f924811cd70 con 0x7f92580c47b0 2023-12-08T08:21:01.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.737+0000 7f925cfb3640 1 --2- 172.21.15.88:0/2507109246 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9244066470 0x7f9244068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.737+0000 7f925cfb3640 1 --2- 172.21.15.88:0/2507109246 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9244066470 0x7f9244068930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f92540045f0 tx=0x7f9254008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:01.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.741+0000 7f924d7fa640 1 -- 172.21.15.88:0/2507109246 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f92480ea670 con 0x7f92580c47b0 2023-12-08T08:21:01.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.945+0000 7f925f217640 1 -- 172.21.15.88:0/2507109246 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f92580c3fb0 con 0x7f92580c47b0 2023-12-08T08:21:01.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.945+0000 7f924d7fa640 1 -- 172.21.15.88:0/2507109246 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f92480edc90 con 0x7f92580c47b0 2023-12-08T08:21:01.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.949+0000 7f925f217640 1 -- 172.21.15.88:0/2507109246 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9244066470 msgr2=0x7f9244068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.949+0000 7f925f217640 1 --2- 172.21.15.88:0/2507109246 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9244066470 0x7f9244068930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f92540045f0 tx=0x7f9254008040 comp rx=0 tx=0).stop 2023-12-08T08:21:01.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.949+0000 7f925f217640 1 -- 172.21.15.88:0/2507109246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92580c47b0 msgr2=0x7f92581f1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.949+0000 7f925f217640 1 --2- 172.21.15.88:0/2507109246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92580c47b0 0x7f92581f1160 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f924801cd10 tx=0x7f9248019210 comp rx=0 tx=0).stop 2023-12-08T08:21:01.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.949+0000 7f925f217640 1 -- 172.21.15.88:0/2507109246 shutdown_connections 2023-12-08T08:21:01.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.949+0000 7f925f217640 1 --2- 172.21.15.88:0/2507109246 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9244066470 0x7f9244068930 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.949+0000 7f925f217640 1 --2- 172.21.15.88:0/2507109246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9258154ee0 0x7f9258150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.949+0000 7f925f217640 1 --2- 172.21.15.88:0/2507109246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92580c47b0 0x7f92581f1160 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.949+0000 7f925f217640 1 --2- 172.21.15.88:0/2507109246 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92580bd550 0x7f925814eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.949+0000 7f925f217640 1 -- 172.21.15.88:0/2507109246 >> 172.21.15.88:0/2507109246 conn(0x7f92580aba00 msgr2=0x7f92580abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:01.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.949+0000 7f925f217640 1 -- 172.21.15.88:0/2507109246 shutdown_connections 2023-12-08T08:21:01.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:01.949+0000 7f925f217640 1 -- 172.21.15.88:0/2507109246 wait complete. 2023-12-08T08:21:01.974 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-08T08:21:02.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.105+0000 7f8aa5cea640 1 Processor -- start 2023-12-08T08:21:02.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.105+0000 7f8aa5cea640 1 -- start start 2023-12-08T08:21:02.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.109+0000 7f8aa5cea640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8aa0154390 0x7f8aa00c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:02.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.109+0000 7f8aa5cea640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8aa00c2110 0x7f8aa00c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:02.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.109+0000 7f8aa5cea640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8aa00c4f80 0x7f8aa00c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:02.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.109+0000 7f8aa5cea640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa00aa1c0 con 0x7f8aa00c2110 2023-12-08T08:21:02.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.109+0000 7f8aa5cea640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa0154770 con 0x7f8aa0154390 2023-12-08T08:21:02.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.109+0000 7f8aa5cea640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa00a93d0 con 0x7f8aa00c4f80 2023-12-08T08:21:02.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.109+0000 7f8a9effd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8aa00c2110 0x7f8aa00c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:02.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.109+0000 7f8a9effd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8aa00c2110 0x7f8aa00c5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52034/0 (socket says 172.21.15.88:52034) 2023-12-08T08:21:02.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.109+0000 7f8a9effd640 1 -- 172.21.15.88:0/3647370993 learned_addr learned my addr 172.21.15.88:0/3647370993 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:02.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.109+0000 7f8a9ffff640 1 --2- 172.21.15.88:0/3647370993 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8aa00c4f80 0x7f8aa00c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:02.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.109+0000 7f8a9f7fe640 1 --2- 172.21.15.88:0/3647370993 >> v2:172.21.15.148:3300/0 conn(0x7f8aa0154390 0x7f8aa00c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:02.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.109+0000 7f8a9effd640 1 -- 172.21.15.88:0/3647370993 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8aa00c4f80 msgr2=0x7f8aa00c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:02.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.109+0000 7f8a9effd640 1 --2- 172.21.15.88:0/3647370993 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8aa00c4f80 0x7f8aa00c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.109+0000 7f8a9effd640 1 -- 172.21.15.88:0/3647370993 >> v2:172.21.15.148:3300/0 conn(0x7f8aa0154390 msgr2=0x7f8aa00c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:02.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.109+0000 7f8a9effd640 1 --2- 172.21.15.88:0/3647370993 >> v2:172.21.15.148:3300/0 conn(0x7f8aa0154390 0x7f8aa00c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.109+0000 7f8a9effd640 1 -- 172.21.15.88:0/3647370993 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa00a9640 con 0x7f8aa00c2110 2023-12-08T08:21:02.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.109+0000 7f8a9ffff640 1 --2- 172.21.15.88:0/3647370993 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8aa00c4f80 0x7f8aa00c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:02.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.109+0000 7f8a9f7fe640 1 --2- 172.21.15.88:0/3647370993 >> v2:172.21.15.148:3300/0 conn(0x7f8aa0154390 0x7f8aa00c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:02.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.113+0000 7f8a9effd640 1 --2- 172.21.15.88:0/3647370993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8aa00c2110 0x7f8aa00c5ca0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00a83b0 tx=0x7f8a9401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e24e2fb76d2ee4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:02.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.113+0000 7f8a9e7fc640 1 -- 172.21.15.88:0/3647370993 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a940aa620 con 0x7f8aa00c2110 2023-12-08T08:21:02.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.113+0000 7f8a9e7fc640 1 -- 172.21.15.88:0/3647370993 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a940aa780 con 0x7f8aa00c2110 2023-12-08T08:21:02.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.113+0000 7f8a9e7fc640 1 -- 172.21.15.88:0/3647370993 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a940aab10 con 0x7f8aa00c2110 2023-12-08T08:21:02.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.113+0000 7f8aa5cea640 1 -- 172.21.15.88:0/3647370993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8aa00c2110 msgr2=0x7f8aa00c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:02.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.113+0000 7f8aa5cea640 1 --2- 172.21.15.88:0/3647370993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8aa00c2110 0x7f8aa00c5ca0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00a83b0 tx=0x7f8a9401c500 comp rx=0 tx=0).stop 2023-12-08T08:21:02.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.113+0000 7f8aa5cea640 1 -- 172.21.15.88:0/3647370993 shutdown_connections 2023-12-08T08:21:02.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.113+0000 7f8aa5cea640 1 --2- 172.21.15.88:0/3647370993 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8aa00c4f80 0x7f8aa00c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.113+0000 7f8aa5cea640 1 --2- 172.21.15.88:0/3647370993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8aa00c2110 0x7f8aa00c5ca0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.113+0000 7f8aa5cea640 1 --2- 172.21.15.88:0/3647370993 >> v2:172.21.15.148:3300/0 conn(0x7f8aa0154390 0x7f8aa00c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.113+0000 7f8aa5cea640 1 -- 172.21.15.88:0/3647370993 >> 172.21.15.88:0/3647370993 conn(0x7f8aa006b220 msgr2=0x7f8aa00a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:02.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.113+0000 7f8aa5cea640 1 -- 172.21.15.88:0/3647370993 shutdown_connections 2023-12-08T08:21:02.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.113+0000 7f8aa5cea640 1 -- 172.21.15.88:0/3647370993 wait complete. 2023-12-08T08:21:02.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.113+0000 7f8aa5cea640 1 Processor -- start 2023-12-08T08:21:02.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.113+0000 7f8aa5cea640 1 -- start start 2023-12-08T08:21:02.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.117+0000 7f8aa5cea640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8aa00c2110 0x7f8aa01f05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:02.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.117+0000 7f8aa5cea640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8aa00c4f80 0x7f8aa01ed970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:02.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.117+0000 7f8aa5cea640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8aa0154390 0x7f8aa00c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:02.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.117+0000 7f8aa5cea640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa0071d80 con 0x7f8aa00c2110 2023-12-08T08:21:02.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.117+0000 7f8aa5cea640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa0072550 con 0x7f8aa0154390 2023-12-08T08:21:02.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.117+0000 7f8aa5cea640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa01f0ae0 con 0x7f8aa00c4f80 2023-12-08T08:21:02.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.117+0000 7f8a9f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8aa00c2110 0x7f8aa01f05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:02.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.117+0000 7f8a9f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8aa00c2110 0x7f8aa01f05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52040/0 (socket says 172.21.15.88:52040) 2023-12-08T08:21:02.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.117+0000 7f8a9f7fe640 1 -- 172.21.15.88:0/4074744555 learned_addr learned my addr 172.21.15.88:0/4074744555 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:02.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.117+0000 7f8a9effd640 1 --2- 172.21.15.88:0/4074744555 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8aa00c4f80 0x7f8aa01ed970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:02.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.117+0000 7f8a9ffff640 1 --2- 172.21.15.88:0/4074744555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8aa0154390 0x7f8aa00c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:02.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.117+0000 7f8a9f7fe640 1 -- 172.21.15.88:0/4074744555 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8aa00c4f80 msgr2=0x7f8aa01ed970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:02.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.117+0000 7f8a9f7fe640 1 --2- 172.21.15.88:0/4074744555 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8aa00c4f80 0x7f8aa01ed970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.117+0000 7f8a9f7fe640 1 -- 172.21.15.88:0/4074744555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8aa0154390 msgr2=0x7f8aa00c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:02.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.117+0000 7f8a9f7fe640 1 --2- 172.21.15.88:0/4074744555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8aa0154390 0x7f8aa00c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.117+0000 7f8a9f7fe640 1 -- 172.21.15.88:0/4074744555 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a940094d0 con 0x7f8aa00c2110 2023-12-08T08:21:02.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.117+0000 7f8a9f7fe640 1 --2- 172.21.15.88:0/4074744555 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8aa00c2110 0x7f8aa01f05a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8a9000c7f0 tx=0x7f8a9000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:02.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.117+0000 7f8a87fff640 1 -- 172.21.15.88:0/4074744555 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a90007820 con 0x7f8aa00c2110 2023-12-08T08:21:02.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.117+0000 7f8a87fff640 1 -- 172.21.15.88:0/4074744555 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a90007980 con 0x7f8aa00c2110 2023-12-08T08:21:02.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.117+0000 7f8aa5cea640 1 -- 172.21.15.88:0/4074744555 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa014e680 con 0x7f8aa00c2110 2023-12-08T08:21:02.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.117+0000 7f8a87fff640 1 -- 172.21.15.88:0/4074744555 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a90007d30 con 0x7f8aa00c2110 2023-12-08T08:21:02.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.117+0000 7f8aa5cea640 1 -- 172.21.15.88:0/4074744555 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa01ed190 con 0x7f8aa00c2110 2023-12-08T08:21:02.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.117+0000 7f8aa5cea640 1 -- 172.21.15.88:0/4074744555 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa0067630 con 0x7f8aa00c2110 2023-12-08T08:21:02.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.117+0000 7f8a87fff640 1 -- 172.21.15.88:0/4074744555 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8a900113f0 con 0x7f8aa00c2110 2023-12-08T08:21:02.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.121+0000 7f8a87fff640 1 --2- 172.21.15.88:0/4074744555 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8a8c066470 0x7f8a8c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:02.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.121+0000 7f8a87fff640 1 -- 172.21.15.88:0/4074744555 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8a90083db0 con 0x7f8aa00c2110 2023-12-08T08:21:02.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.121+0000 7f8a9effd640 1 --2- 172.21.15.88:0/4074744555 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8a8c066470 0x7f8a8c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:02.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.121+0000 7f8a9effd640 1 --2- 172.21.15.88:0/4074744555 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8a8c066470 0x7f8a8c068930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8a940ae000 tx=0x7f8a940b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:02.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.125+0000 7f8a87fff640 1 -- 172.21.15.88:0/4074744555 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8a90088070 con 0x7f8aa00c2110 2023-12-08T08:21:02.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.325+0000 7f8aa5cea640 1 -- 172.21.15.88:0/4074744555 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f8aa01ecff0 con 0x7f8aa00c2110 2023-12-08T08:21:02.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.329+0000 7f8a87fff640 1 -- 172.21.15.88:0/4074744555 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8aa01ecff0 con 0x7f8aa00c2110 2023-12-08T08:21:02.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.329+0000 7f8aa5cea640 1 -- 172.21.15.88:0/4074744555 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8a8c066470 msgr2=0x7f8a8c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:02.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.329+0000 7f8aa5cea640 1 --2- 172.21.15.88:0/4074744555 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8a8c066470 0x7f8a8c068930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8a940ae000 tx=0x7f8a940b5040 comp rx=0 tx=0).stop 2023-12-08T08:21:02.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.329+0000 7f8aa5cea640 1 -- 172.21.15.88:0/4074744555 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8aa00c2110 msgr2=0x7f8aa01f05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:02.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.329+0000 7f8aa5cea640 1 --2- 172.21.15.88:0/4074744555 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8aa00c2110 0x7f8aa01f05a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8a9000c7f0 tx=0x7f8a9000ccb0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.333+0000 7f8aa5cea640 1 -- 172.21.15.88:0/4074744555 shutdown_connections 2023-12-08T08:21:02.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.333+0000 7f8aa5cea640 1 --2- 172.21.15.88:0/4074744555 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8a8c066470 0x7f8a8c068930 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.333+0000 7f8aa5cea640 1 --2- 172.21.15.88:0/4074744555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8aa0154390 0x7f8aa00c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.333+0000 7f8aa5cea640 1 --2- 172.21.15.88:0/4074744555 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8aa00c4f80 0x7f8aa01ed970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.333+0000 7f8aa5cea640 1 --2- 172.21.15.88:0/4074744555 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8aa00c2110 0x7f8aa01f05a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.333+0000 7f8aa5cea640 1 -- 172.21.15.88:0/4074744555 >> 172.21.15.88:0/4074744555 conn(0x7f8aa006b220 msgr2=0x7f8aa00a76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:02.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.333+0000 7f8aa5cea640 1 -- 172.21.15.88:0/4074744555 shutdown_connections 2023-12-08T08:21:02.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.333+0000 7f8aa5cea640 1 -- 172.21.15.88:0/4074744555 wait complete. 2023-12-08T08:21:02.356 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:21:02.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.489+0000 7f7a17d55640 1 Processor -- start 2023-12-08T08:21:02.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.489+0000 7f7a17d55640 1 -- start start 2023-12-08T08:21:02.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.489+0000 7f7a17d55640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7a100722c0 0x7f7a1015de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:02.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.489+0000 7f7a17d55640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a100c5710 con 0x7f7a1014fd10 2023-12-08T08:21:02.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.489+0000 7f7a17d55640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a10155c80 con 0x7f7a10071e30 2023-12-08T08:21:02.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.489+0000 7f7a17d55640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a1006c5e0 con 0x7f7a100722c0 2023-12-08T08:21:02.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.489+0000 7f7a15af1640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7a1014fd10 0x7f7a100a4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:56148/0 (socket says 172.21.15.88:56148) 2023-12-08T08:21:02.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.489+0000 7f7a15af1640 1 -- 172.21.15.88:0/664162104 learned_addr learned my addr 172.21.15.88:0/664162104 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:02.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.489+0000 7f7a162f2640 1 --2- 172.21.15.88:0/664162104 >> v2:172.21.15.88:3300/0 conn(0x7f7a100722c0 0x7f7a1015de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:02.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.489+0000 7f7a14aef640 1 -- 172.21.15.88:0/664162104 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247748946 0 0) 0x7f7a100c5710 con 0x7f7a1014fd10 2023-12-08T08:21:02.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.489+0000 7f7a14aef640 1 -- 172.21.15.88:0/664162104 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79fc003530 con 0x7f7a1014fd10 2023-12-08T08:21:02.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.489+0000 7f7a162f2640 1 -- 172.21.15.88:0/664162104 >> v1:172.21.15.148:6789/0 conn(0x7f7a10071e30 legacy=0x7f7a10156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:02.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.489+0000 7f7a162f2640 1 -- 172.21.15.88:0/664162104 >> v1:172.21.15.88:6789/0 conn(0x7f7a1014fd10 legacy=0x7f7a100a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:02.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.489+0000 7f7a162f2640 1 -- 172.21.15.88:0/664162104 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a100c4e70 con 0x7f7a100722c0 2023-12-08T08:21:02.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.493+0000 7f7a162f2640 1 --2- 172.21.15.88:0/664162104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a100722c0 0x7f7a1015de60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7a08009d90 tx=0x7f7a0801c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d574f6508dddd036 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:02.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.493+0000 7f7a14aef640 1 -- 172.21.15.88:0/664162104 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a080a57a0 con 0x7f7a100722c0 2023-12-08T08:21:02.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.493+0000 7f7a14aef640 1 -- 172.21.15.88:0/664162104 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a080a5900 con 0x7f7a100722c0 2023-12-08T08:21:02.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.493+0000 7f7a14aef640 1 -- 172.21.15.88:0/664162104 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a080a5c90 con 0x7f7a100722c0 2023-12-08T08:21:02.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.493+0000 7f7a17d55640 1 -- 172.21.15.88:0/664162104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a100722c0 msgr2=0x7f7a1015de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:02.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.493+0000 7f7a17d55640 1 --2- 172.21.15.88:0/664162104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a100722c0 0x7f7a1015de60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7a08009d90 tx=0x7f7a0801c7f0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.493+0000 7f7a17d55640 1 -- 172.21.15.88:0/664162104 shutdown_connections 2023-12-08T08:21:02.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.493+0000 7f7a17d55640 1 --2- 172.21.15.88:0/664162104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a100722c0 0x7f7a1015de60 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.493+0000 7f7a17d55640 1 -- 172.21.15.88:0/664162104 >> 172.21.15.88:0/664162104 conn(0x7f7a100a7810 msgr2=0x7f7a100a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:02.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.493+0000 7f7a17d55640 1 -- 172.21.15.88:0/664162104 shutdown_connections 2023-12-08T08:21:02.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.493+0000 7f7a17d55640 1 -- 172.21.15.88:0/664162104 wait complete. 2023-12-08T08:21:02.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.497+0000 7f7a17d55640 1 Processor -- start 2023-12-08T08:21:02.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.497+0000 7f7a17d55640 1 -- start start 2023-12-08T08:21:02.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.497+0000 7f7a17d55640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a10071e30 0x7f7a100a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:02.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.497+0000 7f7a17d55640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a100722c0 0x7f7a100c1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:02.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.497+0000 7f7a17d55640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a1014fd10 0x7f7a10146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:02.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.497+0000 7f7a17d55640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a100a75b0 con 0x7f7a10071e30 2023-12-08T08:21:02.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.497+0000 7f7a17d55640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a100c1280 con 0x7f7a100722c0 2023-12-08T08:21:02.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.497+0000 7f7a17d55640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a100a72d0 con 0x7f7a1014fd10 2023-12-08T08:21:02.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.497+0000 7f7a15af1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a10071e30 0x7f7a100a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:02.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.497+0000 7f7a15af1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a10071e30 0x7f7a100a5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52062/0 (socket says 172.21.15.88:52062) 2023-12-08T08:21:02.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.497+0000 7f7a15af1640 1 -- 172.21.15.88:0/593563097 learned_addr learned my addr 172.21.15.88:0/593563097 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:02.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.497+0000 7f7a152f0640 1 --2- 172.21.15.88:0/593563097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a100722c0 0x7f7a100c1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:02.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.497+0000 7f7a162f2640 1 --2- 172.21.15.88:0/593563097 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a1014fd10 0x7f7a10146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:02.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.497+0000 7f7a15af1640 1 -- 172.21.15.88:0/593563097 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a1014fd10 msgr2=0x7f7a10146cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:02.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.497+0000 7f7a15af1640 1 --2- 172.21.15.88:0/593563097 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a1014fd10 0x7f7a10146cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.497+0000 7f7a15af1640 1 -- 172.21.15.88:0/593563097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a100722c0 msgr2=0x7f7a100c1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:02.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.497+0000 7f7a15af1640 1 --2- 172.21.15.88:0/593563097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a100722c0 0x7f7a100c1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.497+0000 7f7a15af1640 1 -- 172.21.15.88:0/593563097 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a08009a70 con 0x7f7a10071e30 2023-12-08T08:21:02.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.497+0000 7f7a15af1640 1 --2- 172.21.15.88:0/593563097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a10071e30 0x7f7a100a5e40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c00c420 tx=0x7f7a0c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:02.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.497+0000 7f7a067fc640 1 -- 172.21.15.88:0/593563097 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c005cf0 con 0x7f7a10071e30 2023-12-08T08:21:02.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.497+0000 7f7a067fc640 1 -- 172.21.15.88:0/593563097 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0c005e50 con 0x7f7a10071e30 2023-12-08T08:21:02.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.497+0000 7f7a067fc640 1 -- 172.21.15.88:0/593563097 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c0072d0 con 0x7f7a10071e30 2023-12-08T08:21:02.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.497+0000 7f7a17d55640 1 -- 172.21.15.88:0/593563097 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a100a6720 con 0x7f7a10071e30 2023-12-08T08:21:02.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.497+0000 7f7a17d55640 1 -- 172.21.15.88:0/593563097 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a100a58f0 con 0x7f7a10071e30 2023-12-08T08:21:02.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.501+0000 7f7a17d55640 1 -- 172.21.15.88:0/593563097 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a101485a0 con 0x7f7a10071e30 2023-12-08T08:21:02.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.501+0000 7f7a067fc640 1 -- 172.21.15.88:0/593563097 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7a0c007430 con 0x7f7a10071e30 2023-12-08T08:21:02.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.501+0000 7f7a067fc640 1 --2- 172.21.15.88:0/593563097 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f79f4066470 0x7f79f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:02.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.501+0000 7f7a067fc640 1 -- 172.21.15.88:0/593563097 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7a0c082fd0 con 0x7f7a10071e30 2023-12-08T08:21:02.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.501+0000 7f7a152f0640 1 --2- 172.21.15.88:0/593563097 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f79f4066470 0x7f79f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:02.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.501+0000 7f7a152f0640 1 --2- 172.21.15.88:0/593563097 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f79f4066470 0x7f79f4068930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7a100c42b0 tx=0x7f7a00007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:02.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.505+0000 7f7a067fc640 1 -- 172.21.15.88:0/593563097 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7a0c050840 con 0x7f7a10071e30 2023-12-08T08:21:02.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.657+0000 7f7a17d55640 1 -- 172.21.15.88:0/593563097 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a100c0d70 con 0x7f7a10071e30 2023-12-08T08:21:02.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.657+0000 7f7a067fc640 1 -- 172.21.15.88:0/593563097 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+12833 (secure 0 0 0) 0x7f7a100c0d70 con 0x7f7a10071e30 2023-12-08T08:21:02.663 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:02.663 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:20:59.656418+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:21:02.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.657+0000 7f7a17d55640 1 -- 172.21.15.88:0/593563097 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f79f4066470 msgr2=0x7f79f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:02.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.657+0000 7f7a17d55640 1 --2- 172.21.15.88:0/593563097 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f79f4066470 0x7f79f4068930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7a100c42b0 tx=0x7f7a00007e40 comp rx=0 tx=0).stop 2023-12-08T08:21:02.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.657+0000 7f7a17d55640 1 -- 172.21.15.88:0/593563097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a10071e30 msgr2=0x7f7a100a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:02.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.657+0000 7f7a17d55640 1 --2- 172.21.15.88:0/593563097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a10071e30 0x7f7a100a5e40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c00c420 tx=0x7f7a0c00c8e0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.657+0000 7f7a17d55640 1 -- 172.21.15.88:0/593563097 shutdown_connections 2023-12-08T08:21:02.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.657+0000 7f7a17d55640 1 --2- 172.21.15.88:0/593563097 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f79f4066470 0x7f79f4068930 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.657+0000 7f7a17d55640 1 --2- 172.21.15.88:0/593563097 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a1014fd10 0x7f7a10146cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.657+0000 7f7a17d55640 1 --2- 172.21.15.88:0/593563097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a100722c0 0x7f7a100c1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.657+0000 7f7a17d55640 1 --2- 172.21.15.88:0/593563097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a10071e30 0x7f7a100a5e40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.657+0000 7f7a17d55640 1 -- 172.21.15.88:0/593563097 >> 172.21.15.88:0/593563097 conn(0x7f7a100a7810 msgr2=0x7f7a10153900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:02.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.657+0000 7f7a17d55640 1 -- 172.21.15.88:0/593563097 shutdown_connections 2023-12-08T08:21:02.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.657+0000 7f7a17d55640 1 -- 172.21.15.88:0/593563097 wait complete. 2023-12-08T08:21:02.684 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:21:02.684 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:21:02.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.817+0000 7faa18101640 1 Processor -- start 2023-12-08T08:21:02.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.817+0000 7faa18101640 1 -- start start 2023-12-08T08:21:02.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.821+0000 7faa18101640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faa1014b1e0 0x7faa100c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:02.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.821+0000 7faa18101640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa100a4e20 con 0x7faa101548c0 2023-12-08T08:21:02.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.821+0000 7faa18101640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa100a50e0 con 0x7faa100c5300 2023-12-08T08:21:02.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.821+0000 7faa18101640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa100c0f00 con 0x7faa1014b1e0 2023-12-08T08:21:02.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.821+0000 7faa1669e640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7faa101548c0 0x7faa10154d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:56156/0 (socket says 172.21.15.88:56156) 2023-12-08T08:21:02.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.821+0000 7faa1669e640 1 -- 172.21.15.88:0/4164725984 learned_addr learned my addr 172.21.15.88:0/4164725984 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:02.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.821+0000 7faa15e9d640 1 --2- 172.21.15.88:0/4164725984 >> v2:172.21.15.148:3300/0 conn(0x7faa1014b1e0 0x7faa100c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:02.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.821+0000 7faa14e9b640 1 -- 172.21.15.88:0/4164725984 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1212277676 0 0) 0x7faa100a4e20 con 0x7faa101548c0 2023-12-08T08:21:02.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.821+0000 7faa14e9b640 1 -- 172.21.15.88:0/4164725984 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9fc005740 con 0x7faa101548c0 2023-12-08T08:21:02.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.821+0000 7faa15e9d640 1 -- 172.21.15.88:0/4164725984 >> v1:172.21.15.148:6789/0 conn(0x7faa100c5300 legacy=0x7faa100a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:02.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.821+0000 7faa15e9d640 1 -- 172.21.15.88:0/4164725984 >> v1:172.21.15.88:6789/0 conn(0x7faa101548c0 legacy=0x7faa10154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:02.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.821+0000 7faa15e9d640 1 -- 172.21.15.88:0/4164725984 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa100c11e0 con 0x7faa1014b1e0 2023-12-08T08:21:02.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.825+0000 7faa15e9d640 1 --2- 172.21.15.88:0/4164725984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa1014b1e0 0x7faa100c1700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0097c0 tx=0x7faa0c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69af4a0f3f92c9fc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:02.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.825+0000 7faa14e9b640 1 -- 172.21.15.88:0/4164725984 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c0ab600 con 0x7faa1014b1e0 2023-12-08T08:21:02.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.825+0000 7faa14e9b640 1 -- 172.21.15.88:0/4164725984 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0c0a7050 con 0x7faa1014b1e0 2023-12-08T08:21:02.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.825+0000 7faa14e9b640 1 -- 172.21.15.88:0/4164725984 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c0ab980 con 0x7faa1014b1e0 2023-12-08T08:21:02.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.825+0000 7faa18101640 1 -- 172.21.15.88:0/4164725984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa1014b1e0 msgr2=0x7faa100c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:02.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.825+0000 7faa18101640 1 --2- 172.21.15.88:0/4164725984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa1014b1e0 0x7faa100c1700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0097c0 tx=0x7faa0c01c480 comp rx=0 tx=0).stop 2023-12-08T08:21:02.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.825+0000 7faa18101640 1 -- 172.21.15.88:0/4164725984 shutdown_connections 2023-12-08T08:21:02.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.825+0000 7faa18101640 1 --2- 172.21.15.88:0/4164725984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa1014b1e0 0x7faa100c1700 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.825+0000 7faa18101640 1 -- 172.21.15.88:0/4164725984 >> 172.21.15.88:0/4164725984 conn(0x7faa100c59f0 msgr2=0x7faa100c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:02.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.825+0000 7faa18101640 1 -- 172.21.15.88:0/4164725984 shutdown_connections 2023-12-08T08:21:02.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.825+0000 7faa18101640 1 -- 172.21.15.88:0/4164725984 wait complete. 2023-12-08T08:21:02.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.825+0000 7faa18101640 1 Processor -- start 2023-12-08T08:21:02.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.825+0000 7faa18101640 1 -- start start 2023-12-08T08:21:02.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.829+0000 7faa18101640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa100c5300 0x7faa1006cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:02.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.829+0000 7faa18101640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa1014b1e0 0x7faa101f1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:02.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.829+0000 7faa18101640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa101548c0 0x7faa1013f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:02.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.829+0000 7faa18101640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa101f0bd0 con 0x7faa1014b1e0 2023-12-08T08:21:02.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.829+0000 7faa18101640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1014a940 con 0x7faa101548c0 2023-12-08T08:21:02.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.829+0000 7faa18101640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1006d5b0 con 0x7faa100c5300 2023-12-08T08:21:02.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.829+0000 7faa1569c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa1014b1e0 0x7faa101f1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:02.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.829+0000 7faa1569c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa1014b1e0 0x7faa101f1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52070/0 (socket says 172.21.15.88:52070) 2023-12-08T08:21:02.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.829+0000 7faa1569c640 1 -- 172.21.15.88:0/4090229737 learned_addr learned my addr 172.21.15.88:0/4090229737 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:02.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.829+0000 7faa1669e640 1 --2- 172.21.15.88:0/4090229737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa101548c0 0x7faa1013f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:02.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.829+0000 7faa15e9d640 1 --2- 172.21.15.88:0/4090229737 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa100c5300 0x7faa1006cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:02.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.829+0000 7faa1569c640 1 -- 172.21.15.88:0/4090229737 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa100c5300 msgr2=0x7faa1006cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:02.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.829+0000 7faa1569c640 1 --2- 172.21.15.88:0/4090229737 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa100c5300 0x7faa1006cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.829+0000 7faa1569c640 1 -- 172.21.15.88:0/4090229737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa101548c0 msgr2=0x7faa1013f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:02.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.829+0000 7faa1569c640 1 --2- 172.21.15.88:0/4090229737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa101548c0 0x7faa1013f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.829+0000 7faa1569c640 1 -- 172.21.15.88:0/4090229737 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c009420 con 0x7faa1014b1e0 2023-12-08T08:21:02.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.829+0000 7faa1569c640 1 --2- 172.21.15.88:0/4090229737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa1014b1e0 0x7faa101f1640 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7faa0000c390 tx=0x7faa0000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:02.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.829+0000 7faa067fc640 1 -- 172.21.15.88:0/4090229737 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa000052d0 con 0x7faa1014b1e0 2023-12-08T08:21:02.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.829+0000 7faa067fc640 1 -- 172.21.15.88:0/4090229737 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa00005430 con 0x7faa1014b1e0 2023-12-08T08:21:02.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.829+0000 7faa067fc640 1 -- 172.21.15.88:0/4090229737 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa00003820 con 0x7faa1014b1e0 2023-12-08T08:21:02.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.829+0000 7faa18101640 1 -- 172.21.15.88:0/4090229737 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa101f0e40 con 0x7faa1014b1e0 2023-12-08T08:21:02.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.829+0000 7faa18101640 1 -- 172.21.15.88:0/4090229737 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1013f7b0 con 0x7faa1014b1e0 2023-12-08T08:21:02.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.829+0000 7faa18101640 1 -- 172.21.15.88:0/4090229737 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa10067630 con 0x7faa1014b1e0 2023-12-08T08:21:02.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.829+0000 7faa067fc640 1 -- 172.21.15.88:0/4090229737 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faa00003980 con 0x7faa1014b1e0 2023-12-08T08:21:02.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.833+0000 7faa067fc640 1 --2- 172.21.15.88:0/4090229737 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa9f4066470 0x7fa9f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:02.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.833+0000 7faa067fc640 1 -- 172.21.15.88:0/4090229737 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faa00082fe0 con 0x7faa1014b1e0 2023-12-08T08:21:02.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.833+0000 7faa15e9d640 1 --2- 172.21.15.88:0/4090229737 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa9f4066470 0x7fa9f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:02.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.833+0000 7faa15e9d640 1 --2- 172.21.15.88:0/4090229737 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa9f4066470 0x7fa9f4068930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0ad000 tx=0x7faa0c0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:02.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.837+0000 7faa067fc640 1 -- 172.21.15.88:0/4090229737 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faa00050870 con 0x7faa1014b1e0 2023-12-08T08:21:02.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.985+0000 7faa18101640 1 -- 172.21.15.88:0/4090229737 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faa101524a0 con 0x7faa1014b1e0 2023-12-08T08:21:02.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.985+0000 7faa067fc640 1 -- 172.21.15.88:0/4090229737 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7faa000170a0 con 0x7faa1014b1e0 2023-12-08T08:21:02.991 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:21:02.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.985+0000 7faa18101640 1 -- 172.21.15.88:0/4090229737 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa9f4066470 msgr2=0x7fa9f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:02.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.985+0000 7faa18101640 1 --2- 172.21.15.88:0/4090229737 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa9f4066470 0x7fa9f4068930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0ad000 tx=0x7faa0c0a6000 comp rx=0 tx=0).stop 2023-12-08T08:21:02.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.985+0000 7faa18101640 1 -- 172.21.15.88:0/4090229737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa1014b1e0 msgr2=0x7faa101f1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:02.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.985+0000 7faa18101640 1 --2- 172.21.15.88:0/4090229737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa1014b1e0 0x7faa101f1640 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7faa0000c390 tx=0x7faa0000c850 comp rx=0 tx=0).stop 2023-12-08T08:21:02.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.985+0000 7faa18101640 1 -- 172.21.15.88:0/4090229737 shutdown_connections 2023-12-08T08:21:02.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.985+0000 7faa18101640 1 --2- 172.21.15.88:0/4090229737 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa9f4066470 0x7fa9f4068930 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.985+0000 7faa18101640 1 --2- 172.21.15.88:0/4090229737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa101548c0 0x7faa1013f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.985+0000 7faa18101640 1 --2- 172.21.15.88:0/4090229737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa1014b1e0 0x7faa101f1640 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.985+0000 7faa18101640 1 --2- 172.21.15.88:0/4090229737 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa100c5300 0x7faa1006cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.985+0000 7faa18101640 1 -- 172.21.15.88:0/4090229737 >> 172.21.15.88:0/4090229737 conn(0x7faa100c59f0 msgr2=0x7faa10141310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:02.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.985+0000 7faa18101640 1 -- 172.21.15.88:0/4090229737 shutdown_connections 2023-12-08T08:21:02.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:02.985+0000 7faa18101640 1 -- 172.21.15.88:0/4090229737 wait complete. 2023-12-08T08:21:03.012 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-08T08:21:03.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.141+0000 7f1ef6bf5640 1 Processor -- start 2023-12-08T08:21:03.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.145+0000 7f1ef6bf5640 1 -- start start 2023-12-08T08:21:03.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.145+0000 7f1ef6bf5640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1ef00c3b80 0x7f1ef006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.145+0000 7f1ef6bf5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef006bb80 con 0x7f1ef006d2b0 2023-12-08T08:21:03.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.145+0000 7f1ef6bf5640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef00c5790 con 0x7f1ef00c5300 2023-12-08T08:21:03.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.145+0000 7f1ef6bf5640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ef01515c0 con 0x7f1ef00c3b80 2023-12-08T08:21:03.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.145+0000 7f1ef4991640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1ef006d2b0 0x7f1ef006c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:56162/0 (socket says 172.21.15.88:56162) 2023-12-08T08:21:03.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.145+0000 7f1ef4991640 1 -- 172.21.15.88:0/3338326244 learned_addr learned my addr 172.21.15.88:0/3338326244 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:03.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.145+0000 7f1ee7fff640 1 --2- 172.21.15.88:0/3338326244 >> v2:172.21.15.148:3300/0 conn(0x7f1ef00c3b80 0x7f1ef006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.145+0000 7f1ee77fe640 1 -- 172.21.15.88:0/3338326244 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3369616577 0 0) 0x7f1ef006bb80 con 0x7f1ef006d2b0 2023-12-08T08:21:03.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.145+0000 7f1ee77fe640 1 -- 172.21.15.88:0/3338326244 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ed8003530 con 0x7f1ef006d2b0 2023-12-08T08:21:03.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.145+0000 7f1ee77fe640 1 -- 172.21.15.88:0/3338326244 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 356355961 0 0) 0x7f1ed8003530 con 0x7f1ef006d2b0 2023-12-08T08:21:03.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.145+0000 7f1ee7fff640 1 -- 172.21.15.88:0/3338326244 >> v1:172.21.15.148:6789/0 conn(0x7f1ef00c5300 legacy=0x7f1ef006c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.145+0000 7f1ee7fff640 1 -- 172.21.15.88:0/3338326244 >> v1:172.21.15.88:6789/0 conn(0x7f1ef006d2b0 legacy=0x7f1ef006c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.145+0000 7f1ee7fff640 1 -- 172.21.15.88:0/3338326244 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef01518a0 con 0x7f1ef00c3b80 2023-12-08T08:21:03.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.149+0000 7f1ee7fff640 1 --2- 172.21.15.88:0/3338326244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ef00c3b80 0x7f1ef006d690 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00097c0 tx=0x7f1ee001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4e181148e3f83be server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:03.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.149+0000 7f1ee77fe640 1 -- 172.21.15.88:0/3338326244 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eec001680 con 0x7f1ef00c3b80 2023-12-08T08:21:03.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.149+0000 7f1ee77fe640 1 -- 172.21.15.88:0/3338326244 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee00a7050 con 0x7f1ef00c3b80 2023-12-08T08:21:03.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.149+0000 7f1ee77fe640 1 -- 172.21.15.88:0/3338326244 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee00ab620 con 0x7f1ef00c3b80 2023-12-08T08:21:03.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.149+0000 7f1ef6bf5640 1 -- 172.21.15.88:0/3338326244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ef00c3b80 msgr2=0x7f1ef006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.149+0000 7f1ef6bf5640 1 --2- 172.21.15.88:0/3338326244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ef00c3b80 0x7f1ef006d690 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00097c0 tx=0x7f1ee001c370 comp rx=0 tx=0).stop 2023-12-08T08:21:03.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.149+0000 7f1ef6bf5640 1 -- 172.21.15.88:0/3338326244 shutdown_connections 2023-12-08T08:21:03.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.149+0000 7f1ef6bf5640 1 --2- 172.21.15.88:0/3338326244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ef00c3b80 0x7f1ef006d690 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.149+0000 7f1ef6bf5640 1 -- 172.21.15.88:0/3338326244 >> 172.21.15.88:0/3338326244 conn(0x7f1ef00a7810 msgr2=0x7f1ef00a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:03.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.149+0000 7f1ef6bf5640 1 -- 172.21.15.88:0/3338326244 shutdown_connections 2023-12-08T08:21:03.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.149+0000 7f1ef6bf5640 1 -- 172.21.15.88:0/3338326244 wait complete. 2023-12-08T08:21:03.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.149+0000 7f1ef6bf5640 1 Processor -- start 2023-12-08T08:21:03.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.153+0000 7f1ef6bf5640 1 -- start start 2023-12-08T08:21:03.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.153+0000 7f1ef6bf5640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ef006d2b0 0x7f1ef0071e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.153+0000 7f1ef6bf5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ef00c3b80 0x7f1ef015b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.153+0000 7f1ef6bf5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ef00c5300 0x7f1ef014aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.153+0000 7f1ef6bf5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef01f0b40 con 0x7f1ef00c3b80 2023-12-08T08:21:03.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.153+0000 7f1ef6bf5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef015bc30 con 0x7f1ef00c5300 2023-12-08T08:21:03.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.153+0000 7f1ef6bf5640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef01f0fd0 con 0x7f1ef006d2b0 2023-12-08T08:21:03.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.153+0000 7f1ee7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ef00c3b80 0x7f1ef015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.153+0000 7f1ee7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ef00c3b80 0x7f1ef015b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52078/0 (socket says 172.21.15.88:52078) 2023-12-08T08:21:03.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.153+0000 7f1ee7fff640 1 -- 172.21.15.88:0/1457163147 learned_addr learned my addr 172.21.15.88:0/1457163147 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:03.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.153+0000 7f1ef4991640 1 --2- 172.21.15.88:0/1457163147 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ef006d2b0 0x7f1ef0071e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.153+0000 7f1ef5192640 1 --2- 172.21.15.88:0/1457163147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ef00c5300 0x7f1ef014aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.153+0000 7f1ee7fff640 1 -- 172.21.15.88:0/1457163147 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ef006d2b0 msgr2=0x7f1ef0071e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.153+0000 7f1ee7fff640 1 --2- 172.21.15.88:0/1457163147 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ef006d2b0 0x7f1ef0071e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.153+0000 7f1ee7fff640 1 -- 172.21.15.88:0/1457163147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ef00c5300 msgr2=0x7f1ef014aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.153+0000 7f1ee7fff640 1 --2- 172.21.15.88:0/1457163147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ef00c5300 0x7f1ef014aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.153+0000 7f1ee7fff640 1 -- 172.21.15.88:0/1457163147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee0009420 con 0x7f1ef00c3b80 2023-12-08T08:21:03.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.153+0000 7f1ee7fff640 1 --2- 172.21.15.88:0/1457163147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ef00c3b80 0x7f1ef015b200 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00097c0 tx=0x7f1ee001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:03.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.153+0000 7f1ee57fa640 1 -- 172.21.15.88:0/1457163147 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee00abd00 con 0x7f1ef00c3b80 2023-12-08T08:21:03.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.153+0000 7f1ee57fa640 1 -- 172.21.15.88:0/1457163147 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee00abe60 con 0x7f1ef00c3b80 2023-12-08T08:21:03.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.153+0000 7f1ef6bf5640 1 -- 172.21.15.88:0/1457163147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef014ef80 con 0x7f1ef00c3b80 2023-12-08T08:21:03.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.153+0000 7f1ee57fa640 1 -- 172.21.15.88:0/1457163147 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0004260 con 0x7f1ef00c3b80 2023-12-08T08:21:03.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.153+0000 7f1ef6bf5640 1 -- 172.21.15.88:0/1457163147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef01f04f0 con 0x7f1ef00c3b80 2023-12-08T08:21:03.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.153+0000 7f1ef6bf5640 1 -- 172.21.15.88:0/1457163147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef0067630 con 0x7f1ef00c3b80 2023-12-08T08:21:03.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.157+0000 7f1ee57fa640 1 -- 172.21.15.88:0/1457163147 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1ee00043c0 con 0x7f1ef00c3b80 2023-12-08T08:21:03.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.157+0000 7f1ee57fa640 1 --2- 172.21.15.88:0/1457163147 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1edc066470 0x7f1edc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.157+0000 7f1ee57fa640 1 -- 172.21.15.88:0/1457163147 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1ee011e060 con 0x7f1ef00c3b80 2023-12-08T08:21:03.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.157+0000 7f1ef4991640 1 --2- 172.21.15.88:0/1457163147 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1edc066470 0x7f1edc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.157+0000 7f1ef4991640 1 --2- 172.21.15.88:0/1457163147 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1edc066470 0x7f1edc068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1eec000f70 tx=0x7f1eec001d70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:03.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.161+0000 7f1ee57fa640 1 -- 172.21.15.88:0/1457163147 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1ee00eba90 con 0x7f1ef00c3b80 2023-12-08T08:21:03.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.313+0000 7f1ef6bf5640 1 -- 172.21.15.88:0/1457163147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1ef006d020 con 0x7f1ef00c3b80 2023-12-08T08:21:03.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.313+0000 7f1ee57fa640 1 -- 172.21.15.88:0/1457163147 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1ee00ef0b0 con 0x7f1ef00c3b80 2023-12-08T08:21:03.318 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:03.319 INFO:teuthology.orchestra.run.smithi088.stdout:[ 2023-12-08T08:21:03.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:03.319 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 1, 2023-12-08T08:21:03.319 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": ".mgr" 2023-12-08T08:21:03.319 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:03.319 INFO:teuthology.orchestra.run.smithi088.stdout:] 2023-12-08T08:21:03.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.313+0000 7f1ef6bf5640 1 -- 172.21.15.88:0/1457163147 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1edc066470 msgr2=0x7f1edc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.313+0000 7f1ef6bf5640 1 --2- 172.21.15.88:0/1457163147 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1edc066470 0x7f1edc068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1eec000f70 tx=0x7f1eec001d70 comp rx=0 tx=0).stop 2023-12-08T08:21:03.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.313+0000 7f1ef6bf5640 1 -- 172.21.15.88:0/1457163147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ef00c3b80 msgr2=0x7f1ef015b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.313+0000 7f1ef6bf5640 1 --2- 172.21.15.88:0/1457163147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ef00c3b80 0x7f1ef015b200 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00097c0 tx=0x7f1ee001abb0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.313+0000 7f1ef6bf5640 1 -- 172.21.15.88:0/1457163147 shutdown_connections 2023-12-08T08:21:03.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.313+0000 7f1ef6bf5640 1 --2- 172.21.15.88:0/1457163147 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1edc066470 0x7f1edc068930 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.313+0000 7f1ef6bf5640 1 --2- 172.21.15.88:0/1457163147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ef00c5300 0x7f1ef014aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.313+0000 7f1ef6bf5640 1 --2- 172.21.15.88:0/1457163147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ef00c3b80 0x7f1ef015b200 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.313+0000 7f1ef6bf5640 1 --2- 172.21.15.88:0/1457163147 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ef006d2b0 0x7f1ef0071e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.313+0000 7f1ef6bf5640 1 -- 172.21.15.88:0/1457163147 >> 172.21.15.88:0/1457163147 conn(0x7f1ef00a7810 msgr2=0x7f1ef00a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:03.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.313+0000 7f1ef6bf5640 1 -- 172.21.15.88:0/1457163147 shutdown_connections 2023-12-08T08:21:03.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.313+0000 7f1ef6bf5640 1 -- 172.21.15.88:0/1457163147 wait complete. 2023-12-08T08:21:03.340 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-08T08:21:03.340 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-08T08:21:03.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.473+0000 7f7cf759e640 1 Processor -- start 2023-12-08T08:21:03.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf759e640 1 -- start start 2023-12-08T08:21:03.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf759e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cf80bd250 0x7f7cf8158060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf759e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf814e780 con 0x7f7cf80c7ac0 2023-12-08T08:21:03.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf759e640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf8154ce0 con 0x7f7cf814e3a0 2023-12-08T08:21:03.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf759e640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf80c4c80 con 0x7f7cf80bd250 2023-12-08T08:21:03.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf5d9b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7cf80c7ac0 0x7f7cf8157950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:56166/0 (socket says 172.21.15.88:56166) 2023-12-08T08:21:03.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf5d9b640 1 -- 172.21.15.88:0/1218027768 learned_addr learned my addr 172.21.15.88:0/1218027768 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:03.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf6d9d640 1 --2- 172.21.15.88:0/1218027768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cf80bd250 0x7f7cf8158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf559a640 1 -- 172.21.15.88:0/1218027768 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896895107 0 0) 0x7f7cec001120 con 0x7f7cf80c7ac0 2023-12-08T08:21:03.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf559a640 1 -- 172.21.15.88:0/1218027768 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ce0003530 con 0x7f7cf80c7ac0 2023-12-08T08:21:03.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf559a640 1 -- 172.21.15.88:0/1218027768 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108578219 0 0) 0x7f7cf8154ce0 con 0x7f7cf814e3a0 2023-12-08T08:21:03.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf559a640 1 -- 172.21.15.88:0/1218027768 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cec001120 con 0x7f7cf814e3a0 2023-12-08T08:21:03.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf559a640 1 -- 172.21.15.88:0/1218027768 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 314153339 0 0) 0x7f7ce0003530 con 0x7f7cf80c7ac0 2023-12-08T08:21:03.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf559a640 1 -- 172.21.15.88:0/1218027768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cf80bd250 msgr2=0x7f7cf8158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:03.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf559a640 1 --2- 172.21.15.88:0/1218027768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cf80bd250 0x7f7cf8158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf559a640 1 -- 172.21.15.88:0/1218027768 >> v1:172.21.15.148:6789/0 conn(0x7f7cf814e3a0 legacy=0x7f7cf80c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf559a640 1 -- 172.21.15.88:0/1218027768 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf8155210 con 0x7f7cf80c7ac0 2023-12-08T08:21:03.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf559a640 1 -- 172.21.15.88:0/1218027768 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f7cec001810 con 0x7f7cf80c7ac0 2023-12-08T08:21:03.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf559a640 1 -- 172.21.15.88:0/1218027768 >> v1:172.21.15.88:6789/0 conn(0x7f7cf80c7ac0 legacy=0x7f7cf8157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf559a640 1 --2- 172.21.15.88:0/1218027768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cf80bd250 0x7f7ce0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf559a640 1 --2- 172.21.15.88:0/1218027768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ce00040a0 0x7f7ce00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf559a640 1 --2- 172.21.15.88:0/1218027768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ce0004d10 0x7f7ce0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf559a640 1 -- 172.21.15.88:0/1218027768 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf80c4c80 con 0x7f7ce00040a0 2023-12-08T08:21:03.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf559a640 1 -- 172.21.15.88:0/1218027768 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce000bba0 con 0x7f7ce0004d10 2023-12-08T08:21:03.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf559a640 1 -- 172.21.15.88:0/1218027768 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce000bd60 con 0x7f7cf80bd250 2023-12-08T08:21:03.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf5d9b640 1 --2- 172.21.15.88:0/1218027768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ce00040a0 0x7f7ce00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf6d9d640 1 --2- 172.21.15.88:0/1218027768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ce0004d10 0x7f7ce0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf659c640 1 --2- 172.21.15.88:0/1218027768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cf80bd250 0x7f7ce0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf5d9b640 1 -- 172.21.15.88:0/1218027768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cf80bd250 msgr2=0x7f7ce0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:03.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf5d9b640 1 --2- 172.21.15.88:0/1218027768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cf80bd250 0x7f7ce0003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf5d9b640 1 -- 172.21.15.88:0/1218027768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ce0004d10 msgr2=0x7f7ce0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:03.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf5d9b640 1 --2- 172.21.15.88:0/1218027768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ce0004d10 0x7f7ce0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.477+0000 7f7cf5d9b640 1 -- 172.21.15.88:0/1218027768 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce0003530 con 0x7f7ce00040a0 2023-12-08T08:21:03.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.481+0000 7f7cf5d9b640 1 --2- 172.21.15.88:0/1218027768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ce00040a0 0x7f7ce00047d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7cf80c7f20 tx=0x7f7cec01cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c330db446c7bf71 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:03.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.481+0000 7f7cf559a640 1 -- 172.21.15.88:0/1218027768 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec0058e0 con 0x7f7ce00040a0 2023-12-08T08:21:03.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.481+0000 7f7cf559a640 1 -- 172.21.15.88:0/1218027768 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cec005a60 con 0x7f7ce00040a0 2023-12-08T08:21:03.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.481+0000 7f7cf559a640 1 -- 172.21.15.88:0/1218027768 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec005e50 con 0x7f7ce00040a0 2023-12-08T08:21:03.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.481+0000 7f7cf759e640 1 -- 172.21.15.88:0/1218027768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ce00040a0 msgr2=0x7f7ce00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.481+0000 7f7cf759e640 1 --2- 172.21.15.88:0/1218027768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ce00040a0 0x7f7ce00047d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7cf80c7f20 tx=0x7f7cec01cb60 comp rx=0 tx=0).stop 2023-12-08T08:21:03.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.481+0000 7f7cf6d9d640 1 -- 172.21.15.88:0/1218027768 reap_dead start 2023-12-08T08:21:03.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.481+0000 7f7cf759e640 1 -- 172.21.15.88:0/1218027768 shutdown_connections 2023-12-08T08:21:03.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.481+0000 7f7cf759e640 1 -- 172.21.15.88:0/1218027768 >> 172.21.15.88:0/1218027768 conn(0x7f7cf8066d20 msgr2=0x7f7cf80ab750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:03.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.481+0000 7f7cf759e640 1 -- 172.21.15.88:0/1218027768 shutdown_connections 2023-12-08T08:21:03.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.481+0000 7f7cf759e640 1 -- 172.21.15.88:0/1218027768 wait complete. 2023-12-08T08:21:03.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.485+0000 7f7cf759e640 1 Processor -- start 2023-12-08T08:21:03.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.485+0000 7f7cf759e640 1 -- start start 2023-12-08T08:21:03.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.485+0000 7f7cf759e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ce00040a0 0x7f7cf80aec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.485+0000 7f7cf759e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cf80c0c90 0x7f7cf80bedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.485+0000 7f7cf759e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cf80c3d20 0x7f7cf814aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.485+0000 7f7cf759e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf80c1450 con 0x7f7cf80c0c90 2023-12-08T08:21:03.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.485+0000 7f7cf759e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf80bfdf0 con 0x7f7ce00040a0 2023-12-08T08:21:03.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.485+0000 7f7cf759e640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf80c00d0 con 0x7f7cf80c3d20 2023-12-08T08:21:03.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.485+0000 7f7cf5d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cf80c0c90 0x7f7cf80bedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.485+0000 7f7cf5d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cf80c0c90 0x7f7cf80bedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52086/0 (socket says 172.21.15.88:52086) 2023-12-08T08:21:03.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.485+0000 7f7cf5d9b640 1 -- 172.21.15.88:0/3549786375 learned_addr learned my addr 172.21.15.88:0/3549786375 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:03.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.485+0000 7f7cf5d9b640 1 -- 172.21.15.88:0/3549786375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cf80c3d20 msgr2=0x7f7cf814aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.485+0000 7f7cf5d9b640 1 --2- 172.21.15.88:0/3549786375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cf80c3d20 0x7f7cf814aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.485+0000 7f7cf5d9b640 1 -- 172.21.15.88:0/3549786375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ce00040a0 msgr2=0x7f7cf80aec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.485+0000 7f7cf5d9b640 1 --2- 172.21.15.88:0/3549786375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ce00040a0 0x7f7cf80aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.485+0000 7f7cf5d9b640 1 -- 172.21.15.88:0/3549786375 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf80c3520 con 0x7f7cf80c0c90 2023-12-08T08:21:03.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.485+0000 7f7cf5d9b640 1 --2- 172.21.15.88:0/3549786375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cf80c0c90 0x7f7cf80bedd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7cec007040 tx=0x7f7ce0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:03.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.485+0000 7f7ce6ffd640 1 -- 172.21.15.88:0/3549786375 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec004e50 con 0x7f7cf80c0c90 2023-12-08T08:21:03.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.485+0000 7f7ce6ffd640 1 -- 172.21.15.88:0/3549786375 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cec005e30 con 0x7f7cf80c0c90 2023-12-08T08:21:03.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.485+0000 7f7cf759e640 1 -- 172.21.15.88:0/3549786375 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf80c3800 con 0x7f7cf80c0c90 2023-12-08T08:21:03.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.485+0000 7f7ce6ffd640 1 -- 172.21.15.88:0/3549786375 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec0a5730 con 0x7f7cf80c0c90 2023-12-08T08:21:03.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.485+0000 7f7cf759e640 1 -- 172.21.15.88:0/3549786375 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf80c10b0 con 0x7f7cf80c0c90 2023-12-08T08:21:03.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.485+0000 7f7cf759e640 1 -- 172.21.15.88:0/3549786375 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf80c3990 con 0x7f7cf80c0c90 2023-12-08T08:21:03.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.489+0000 7f7ce6ffd640 1 -- 172.21.15.88:0/3549786375 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7cec0a5890 con 0x7f7cf80c0c90 2023-12-08T08:21:03.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.489+0000 7f7ce6ffd640 1 --2- 172.21.15.88:0/3549786375 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7cd8066470 0x7f7cd8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.489+0000 7f7ce6ffd640 1 -- 172.21.15.88:0/3549786375 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7cec11d580 con 0x7f7cf80c0c90 2023-12-08T08:21:03.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.489+0000 7f7cf659c640 1 --2- 172.21.15.88:0/3549786375 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7cd8066470 0x7f7cd8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.489+0000 7f7cf659c640 1 --2- 172.21.15.88:0/3549786375 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7cd8066470 0x7f7cd8068930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7ce80010f0 tx=0x7f7ce8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:03.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.493+0000 7f7ce6ffd640 1 -- 172.21.15.88:0/3549786375 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7cec0ead40 con 0x7f7cf80c0c90 2023-12-08T08:21:03.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.641+0000 7f7cf759e640 1 -- 172.21.15.88:0/3549786375 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7cf814e780 con 0x7f7cf80c0c90 2023-12-08T08:21:03.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.737+0000 7f7ce6ffd640 1 -- 172.21.15.88:0/3549786375 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7cf814e780 con 0x7f7cf80c0c90 2023-12-08T08:21:03.745 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' created 2023-12-08T08:21:03.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.741+0000 7f7cf759e640 1 -- 172.21.15.88:0/3549786375 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7cd8066470 msgr2=0x7f7cd8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.741+0000 7f7cf759e640 1 --2- 172.21.15.88:0/3549786375 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7cd8066470 0x7f7cd8068930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7ce80010f0 tx=0x7f7ce8009040 comp rx=0 tx=0).stop 2023-12-08T08:21:03.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.741+0000 7f7cf759e640 1 -- 172.21.15.88:0/3549786375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cf80c0c90 msgr2=0x7f7cf80bedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.741+0000 7f7cf759e640 1 --2- 172.21.15.88:0/3549786375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cf80c0c90 0x7f7cf80bedd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7cec007040 tx=0x7f7ce0005800 comp rx=0 tx=0).stop 2023-12-08T08:21:03.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.741+0000 7f7cf759e640 1 -- 172.21.15.88:0/3549786375 shutdown_connections 2023-12-08T08:21:03.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.741+0000 7f7cf759e640 1 --2- 172.21.15.88:0/3549786375 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7cd8066470 0x7f7cd8068930 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.741+0000 7f7cf759e640 1 --2- 172.21.15.88:0/3549786375 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7cf80c3d20 0x7f7cf814aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.741+0000 7f7cf759e640 1 --2- 172.21.15.88:0/3549786375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cf80c0c90 0x7f7cf80bedd0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.741+0000 7f7cf759e640 1 --2- 172.21.15.88:0/3549786375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ce00040a0 0x7f7cf80aec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.741+0000 7f7cf759e640 1 -- 172.21.15.88:0/3549786375 >> 172.21.15.88:0/3549786375 conn(0x7f7cf8066d20 msgr2=0x7f7cf814ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:03.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.741+0000 7f7cf759e640 1 -- 172.21.15.88:0/3549786375 shutdown_connections 2023-12-08T08:21:03.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.741+0000 7f7cf759e640 1 -- 172.21.15.88:0/3549786375 wait complete. 2023-12-08T08:21:03.772 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-08T08:21:03.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.908+0000 7f9d6fd2a640 1 Processor -- start 2023-12-08T08:21:03.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.908+0000 7f9d6fd2a640 1 -- start start 2023-12-08T08:21:03.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6fd2a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9d6806b5c0 0x7f9d6806ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6fd2a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d681547f0 con 0x7f9d68151a20 2023-12-08T08:21:03.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6fd2a640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d681544a0 con 0x7f9d68157a90 2023-12-08T08:21:03.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6fd2a640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d680c2720 con 0x7f9d6806b5c0 2023-12-08T08:21:03.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6dac6640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9d68151a20 0x7f9d6806e890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:56174/0 (socket says 172.21.15.88:56174) 2023-12-08T08:21:03.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6dac6640 1 -- 172.21.15.88:0/119510640 learned_addr learned my addr 172.21.15.88:0/119510640 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:03.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6e2c7640 1 --2- 172.21.15.88:0/119510640 >> v2:172.21.15.148:3300/0 conn(0x7f9d6806b5c0 0x7f9d6806ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6cac4640 1 -- 172.21.15.88:0/119510640 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 909161969 0 0) 0x7f9d681547f0 con 0x7f9d68151a20 2023-12-08T08:21:03.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6cac4640 1 -- 172.21.15.88:0/119510640 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d54003530 con 0x7f9d68151a20 2023-12-08T08:21:03.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6cac4640 1 -- 172.21.15.88:0/119510640 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 683277749 0 0) 0x7f9d54003530 con 0x7f9d68151a20 2023-12-08T08:21:03.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6cac4640 1 -- 172.21.15.88:0/119510640 >> v2:172.21.15.148:3300/0 conn(0x7f9d6806b5c0 msgr2=0x7f9d6806ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:03.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6cac4640 1 --2- 172.21.15.88:0/119510640 >> v2:172.21.15.148:3300/0 conn(0x7f9d6806b5c0 0x7f9d6806ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6cac4640 1 -- 172.21.15.88:0/119510640 >> v1:172.21.15.148:6789/0 conn(0x7f9d68157a90 legacy=0x7f9d68154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6cac4640 1 -- 172.21.15.88:0/119510640 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d68155390 con 0x7f9d68151a20 2023-12-08T08:21:03.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6cac4640 1 -- 172.21.15.88:0/119510640 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f9d64001680 con 0x7f9d68151a20 2023-12-08T08:21:03.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6cac4640 1 -- 172.21.15.88:0/119510640 >> v1:172.21.15.88:6789/0 conn(0x7f9d68151a20 legacy=0x7f9d6806e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6cac4640 1 --2- 172.21.15.88:0/119510640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d54003980 0x7f9d54003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6cac4640 1 --2- 172.21.15.88:0/119510640 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d540047d0 0x7f9d54004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6cac4640 1 --2- 172.21.15.88:0/119510640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d540052b0 0x7f9d5400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6cac4640 1 -- 172.21.15.88:0/119510640 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d680c2720 con 0x7f9d540052b0 2023-12-08T08:21:03.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6cac4640 1 -- 172.21.15.88:0/119510640 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5400c180 con 0x7f9d54003980 2023-12-08T08:21:03.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6cac4640 1 -- 172.21.15.88:0/119510640 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5400c340 con 0x7f9d540047d0 2023-12-08T08:21:03.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6e2c7640 1 --2- 172.21.15.88:0/119510640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d540052b0 0x7f9d5400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6dac6640 1 --2- 172.21.15.88:0/119510640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d54003980 0x7f9d54003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6d2c5640 1 --2- 172.21.15.88:0/119510640 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d540047d0 0x7f9d54004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6e2c7640 1 -- 172.21.15.88:0/119510640 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d540047d0 msgr2=0x7f9d54004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:03.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6e2c7640 1 --2- 172.21.15.88:0/119510640 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d540047d0 0x7f9d54004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6e2c7640 1 -- 172.21.15.88:0/119510640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d54003980 msgr2=0x7f9d54003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:03.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6e2c7640 1 --2- 172.21.15.88:0/119510640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d54003980 0x7f9d54003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.912+0000 7f9d6e2c7640 1 -- 172.21.15.88:0/119510640 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d54003530 con 0x7f9d540052b0 2023-12-08T08:21:03.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.916+0000 7f9d6e2c7640 1 -- 172.21.15.88:0/119510640 reap_dead start 2023-12-08T08:21:03.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.916+0000 7f9d6e2c7640 1 --2- 172.21.15.88:0/119510640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d540052b0 0x7f9d5400b990 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9d60009f90 tx=0x7f9d6001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30f75546b8590e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:03.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.916+0000 7f9d6cac4640 1 -- 172.21.15.88:0/119510640 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d600a5c50 con 0x7f9d540052b0 2023-12-08T08:21:03.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.916+0000 7f9d6cac4640 1 -- 172.21.15.88:0/119510640 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6000f040 con 0x7f9d540052b0 2023-12-08T08:21:03.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.916+0000 7f9d6cac4640 1 -- 172.21.15.88:0/119510640 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d600039a0 con 0x7f9d540052b0 2023-12-08T08:21:03.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.916+0000 7f9d6fd2a640 1 -- 172.21.15.88:0/119510640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d540052b0 msgr2=0x7f9d5400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.916+0000 7f9d6fd2a640 1 --2- 172.21.15.88:0/119510640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d540052b0 0x7f9d5400b990 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9d60009f90 tx=0x7f9d6001cc60 comp rx=0 tx=0).stop 2023-12-08T08:21:03.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.916+0000 7f9d6fd2a640 1 -- 172.21.15.88:0/119510640 shutdown_connections 2023-12-08T08:21:03.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.916+0000 7f9d6fd2a640 1 --2- 172.21.15.88:0/119510640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d540052b0 0x7f9d5400b990 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.916+0000 7f9d6fd2a640 1 -- 172.21.15.88:0/119510640 >> 172.21.15.88:0/119510640 conn(0x7f9d680c2e20 msgr2=0x7f9d680c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:03.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.916+0000 7f9d6fd2a640 1 -- 172.21.15.88:0/119510640 shutdown_connections 2023-12-08T08:21:03.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.916+0000 7f9d6fd2a640 1 -- 172.21.15.88:0/119510640 wait complete. 2023-12-08T08:21:03.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.916+0000 7f9d6fd2a640 1 Processor -- start 2023-12-08T08:21:03.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.920+0000 7f9d6fd2a640 1 -- start start 2023-12-08T08:21:03.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.920+0000 7f9d6fd2a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d540052b0 0x7f9d680c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.920+0000 7f9d6fd2a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d681f00f0 0x7f9d68153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.920+0000 7f9d6fd2a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d68143d60 0x7f9d681441e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.920+0000 7f9d6fd2a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d680c4760 con 0x7f9d540052b0 2023-12-08T08:21:03.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.920+0000 7f9d6fd2a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d680c4a40 con 0x7f9d68143d60 2023-12-08T08:21:03.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.920+0000 7f9d6fd2a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d680c4d20 con 0x7f9d681f00f0 2023-12-08T08:21:03.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.920+0000 7f9d6dac6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d540052b0 0x7f9d680c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.920+0000 7f9d6dac6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d540052b0 0x7f9d680c3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52096/0 (socket says 172.21.15.88:52096) 2023-12-08T08:21:03.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.920+0000 7f9d6dac6640 1 -- 172.21.15.88:0/1809226474 learned_addr learned my addr 172.21.15.88:0/1809226474 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:03.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.920+0000 7f9d6d2c5640 1 --2- 172.21.15.88:0/1809226474 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d681f00f0 0x7f9d68153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.920+0000 7f9d6dac6640 1 -- 172.21.15.88:0/1809226474 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d681f00f0 msgr2=0x7f9d68153710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.920+0000 7f9d6dac6640 1 --2- 172.21.15.88:0/1809226474 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d681f00f0 0x7f9d68153710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.920+0000 7f9d6e2c7640 1 --2- 172.21.15.88:0/1809226474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d68143d60 0x7f9d681441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.920+0000 7f9d6dac6640 1 -- 172.21.15.88:0/1809226474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d68143d60 msgr2=0x7f9d681441e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.920+0000 7f9d6dac6640 1 --2- 172.21.15.88:0/1809226474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d68143d60 0x7f9d681441e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.920+0000 7f9d6dac6640 1 -- 172.21.15.88:0/1809226474 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d680c5000 con 0x7f9d540052b0 2023-12-08T08:21:03.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.920+0000 7f9d6d2c5640 1 --2- 172.21.15.88:0/1809226474 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d681f00f0 0x7f9d68153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:03.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.920+0000 7f9d6e2c7640 1 --2- 172.21.15.88:0/1809226474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d68143d60 0x7f9d681441e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:03.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.920+0000 7f9d6dac6640 1 --2- 172.21.15.88:0/1809226474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d540052b0 0x7f9d680c3f10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9d640072c0 tx=0x7f9d64007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:03.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.920+0000 7f9d5e7fc640 1 -- 172.21.15.88:0/1809226474 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d640015f0 con 0x7f9d540052b0 2023-12-08T08:21:03.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.920+0000 7f9d5e7fc640 1 -- 172.21.15.88:0/1809226474 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6400f940 con 0x7f9d540052b0 2023-12-08T08:21:03.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.920+0000 7f9d5e7fc640 1 -- 172.21.15.88:0/1809226474 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6400fcf0 con 0x7f9d540052b0 2023-12-08T08:21:03.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.920+0000 7f9d6fd2a640 1 -- 172.21.15.88:0/1809226474 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d680c52e0 con 0x7f9d540052b0 2023-12-08T08:21:03.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.920+0000 7f9d6fd2a640 1 -- 172.21.15.88:0/1809226474 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d680c4450 con 0x7f9d540052b0 2023-12-08T08:21:03.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.920+0000 7f9d6fd2a640 1 -- 172.21.15.88:0/1809226474 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d68066660 con 0x7f9d540052b0 2023-12-08T08:21:03.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.924+0000 7f9d5e7fc640 1 -- 172.21.15.88:0/1809226474 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9d6401d460 con 0x7f9d540052b0 2023-12-08T08:21:03.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.924+0000 7f9d5e7fc640 1 --2- 172.21.15.88:0/1809226474 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9d4c0664a0 0x7f9d4c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.924+0000 7f9d5e7fc640 1 -- 172.21.15.88:0/1809226474 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f9d640847d0 con 0x7f9d540052b0 2023-12-08T08:21:03.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.924+0000 7f9d6d2c5640 1 --2- 172.21.15.88:0/1809226474 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9d4c0664a0 0x7f9d4c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.924+0000 7f9d6d2c5640 1 --2- 172.21.15.88:0/1809226474 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9d4c0664a0 0x7f9d4c068960 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9d58000c10 tx=0x7f9d58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:03.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:03.928+0000 7f9d5e7fc640 1 -- 172.21.15.88:0/1809226474 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9d64051ea0 con 0x7f9d540052b0 2023-12-08T08:21:04.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.076+0000 7f9d6fd2a640 1 -- 172.21.15.88:0/1809226474 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9d680c5520 con 0x7f9d540052b0 2023-12-08T08:21:04.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.740+0000 7f9d5e7fc640 1 -- 172.21.15.88:0/1809226474 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9d680c5520 con 0x7f9d540052b0 2023-12-08T08:21:04.748 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' created 2023-12-08T08:21:04.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.744+0000 7f9d6fd2a640 1 -- 172.21.15.88:0/1809226474 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9d4c0664a0 msgr2=0x7f9d4c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.744+0000 7f9d6fd2a640 1 --2- 172.21.15.88:0/1809226474 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9d4c0664a0 0x7f9d4c068960 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9d58000c10 tx=0x7f9d58009040 comp rx=0 tx=0).stop 2023-12-08T08:21:04.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.744+0000 7f9d6fd2a640 1 -- 172.21.15.88:0/1809226474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d540052b0 msgr2=0x7f9d680c3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.744+0000 7f9d6fd2a640 1 --2- 172.21.15.88:0/1809226474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d540052b0 0x7f9d680c3f10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9d640072c0 tx=0x7f9d64007780 comp rx=0 tx=0).stop 2023-12-08T08:21:04.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.744+0000 7f9d6fd2a640 1 -- 172.21.15.88:0/1809226474 shutdown_connections 2023-12-08T08:21:04.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.744+0000 7f9d6fd2a640 1 --2- 172.21.15.88:0/1809226474 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9d4c0664a0 0x7f9d4c068960 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.744+0000 7f9d6fd2a640 1 --2- 172.21.15.88:0/1809226474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d68143d60 0x7f9d681441e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.744+0000 7f9d6fd2a640 1 --2- 172.21.15.88:0/1809226474 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d681f00f0 0x7f9d68153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.744+0000 7f9d6fd2a640 1 --2- 172.21.15.88:0/1809226474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d540052b0 0x7f9d680c3f10 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.744+0000 7f9d6fd2a640 1 -- 172.21.15.88:0/1809226474 >> 172.21.15.88:0/1809226474 conn(0x7f9d680c2e20 msgr2=0x7f9d6806da60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:04.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.744+0000 7f9d6fd2a640 1 -- 172.21.15.88:0/1809226474 shutdown_connections 2023-12-08T08:21:04.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.744+0000 7f9d6fd2a640 1 -- 172.21.15.88:0/1809226474 wait complete. 2023-12-08T08:21:04.790 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-08T08:21:04.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.924+0000 7f9181879640 1 Processor -- start 2023-12-08T08:21:04.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.924+0000 7f9181879640 1 -- start start 2023-12-08T08:21:04.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.928+0000 7f9181879640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f917c14e010 0x7f917c0c0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.928+0000 7f9181879640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f917c150c70 0x7f917c1510e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.928+0000 7f9181879640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917c0c5570 con 0x7f917c06db40 2023-12-08T08:21:04.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.928+0000 7f9181879640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917c06e100 con 0x7f917c150c70 2023-12-08T08:21:04.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.928+0000 7f9181879640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917c14e3f0 con 0x7f917c14e010 2023-12-08T08:21:04.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.928+0000 7f917b7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f917c150c70 0x7f917c1510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.928+0000 7f9173fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f917c06db40 0x7f917c06c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:56178/0 (socket says 172.21.15.88:56178) 2023-12-08T08:21:04.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.928+0000 7f9173fff640 1 -- 172.21.15.88:0/2997035583 learned_addr learned my addr 172.21.15.88:0/2997035583 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:04.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.928+0000 7f917affd640 1 --2- 172.21.15.88:0/2997035583 >> v2:172.21.15.148:3300/0 conn(0x7f917c14e010 0x7f917c0c0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.928+0000 7f917b7fe640 1 -- 172.21.15.88:0/2997035583 >> v2:172.21.15.148:3300/0 conn(0x7f917c14e010 msgr2=0x7f917c0c0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:04.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.928+0000 7f917b7fe640 1 --2- 172.21.15.88:0/2997035583 >> v2:172.21.15.148:3300/0 conn(0x7f917c14e010 0x7f917c0c0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.928+0000 7f917b7fe640 1 -- 172.21.15.88:0/2997035583 >> v1:172.21.15.88:6789/0 conn(0x7f917c06db40 legacy=0x7f917c06c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.928+0000 7f917b7fe640 1 -- 172.21.15.88:0/2997035583 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917c0c4c40 con 0x7f917c150c70 2023-12-08T08:21:04.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.928+0000 7f917affd640 1 --2- 172.21.15.88:0/2997035583 >> v2:172.21.15.148:3300/0 conn(0x7f917c14e010 0x7f917c0c0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:04.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.928+0000 7f917b7fe640 1 --2- 172.21.15.88:0/2997035583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f917c150c70 0x7f917c1510e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f917c0c0040 tx=0x7f917401c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b61ff60f00299557 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:04.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.932+0000 7f917a7fc640 1 -- 172.21.15.88:0/2997035583 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91740a5800 con 0x7f917c150c70 2023-12-08T08:21:04.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.932+0000 7f917a7fc640 1 -- 172.21.15.88:0/2997035583 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91740a5960 con 0x7f917c150c70 2023-12-08T08:21:04.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.932+0000 7f917a7fc640 1 -- 172.21.15.88:0/2997035583 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91740a5cf0 con 0x7f917c150c70 2023-12-08T08:21:04.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.932+0000 7f9181879640 1 -- 172.21.15.88:0/2997035583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f917c150c70 msgr2=0x7f917c1510e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.932+0000 7f9181879640 1 --2- 172.21.15.88:0/2997035583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f917c150c70 0x7f917c1510e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f917c0c0040 tx=0x7f917401c7c0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.932+0000 7f9181879640 1 -- 172.21.15.88:0/2997035583 shutdown_connections 2023-12-08T08:21:04.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.932+0000 7f9181879640 1 --2- 172.21.15.88:0/2997035583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f917c150c70 0x7f917c1510e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.932+0000 7f9181879640 1 --2- 172.21.15.88:0/2997035583 >> v2:172.21.15.148:3300/0 conn(0x7f917c14e010 0x7f917c0c0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.932+0000 7f9181879640 1 -- 172.21.15.88:0/2997035583 >> 172.21.15.88:0/2997035583 conn(0x7f917c0a7520 msgr2=0x7f917c0a7930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:04.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.932+0000 7f9181879640 1 -- 172.21.15.88:0/2997035583 shutdown_connections 2023-12-08T08:21:04.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.932+0000 7f9181879640 1 -- 172.21.15.88:0/2997035583 wait complete. 2023-12-08T08:21:04.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.932+0000 7f9181879640 1 Processor -- start 2023-12-08T08:21:04.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.932+0000 7f9181879640 1 -- start start 2023-12-08T08:21:04.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.932+0000 7f9181879640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f917c06db40 0x7f917c072250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.932+0000 7f9181879640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f917c14e010 0x7f917c0a6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.932+0000 7f9181879640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f917c150c70 0x7f917c13b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.932+0000 7f9181879640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c071dc0 con 0x7f917c14e010 2023-12-08T08:21:04.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.932+0000 7f9181879640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c14e960 con 0x7f917c06db40 2023-12-08T08:21:04.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.932+0000 7f9181879640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917c14ec40 con 0x7f917c150c70 2023-12-08T08:21:04.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.932+0000 7f9173fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f917c14e010 0x7f917c0a6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.932+0000 7f9173fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f917c14e010 0x7f917c0a6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52106/0 (socket says 172.21.15.88:52106) 2023-12-08T08:21:04.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.932+0000 7f9173fff640 1 -- 172.21.15.88:0/1742647770 learned_addr learned my addr 172.21.15.88:0/1742647770 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:04.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.932+0000 7f917affd640 1 --2- 172.21.15.88:0/1742647770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f917c06db40 0x7f917c072250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.932+0000 7f917b7fe640 1 --2- 172.21.15.88:0/1742647770 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f917c150c70 0x7f917c13b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.936+0000 7f9173fff640 1 -- 172.21.15.88:0/1742647770 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f917c150c70 msgr2=0x7f917c13b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.936+0000 7f9173fff640 1 --2- 172.21.15.88:0/1742647770 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f917c150c70 0x7f917c13b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.936+0000 7f9173fff640 1 -- 172.21.15.88:0/1742647770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f917c06db40 msgr2=0x7f917c072250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.936+0000 7f9173fff640 1 --2- 172.21.15.88:0/1742647770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f917c06db40 0x7f917c072250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.936+0000 7f9173fff640 1 -- 172.21.15.88:0/1742647770 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9174009a70 con 0x7f917c14e010 2023-12-08T08:21:04.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.936+0000 7f917b7fe640 1 --2- 172.21.15.88:0/1742647770 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f917c150c70 0x7f917c13b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:04.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.936+0000 7f9173fff640 1 --2- 172.21.15.88:0/1742647770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f917c14e010 0x7f917c0a6a40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f916400c500 tx=0x7f916400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:04.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.936+0000 7f9178ff9640 1 -- 172.21.15.88:0/1742647770 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9164005cf0 con 0x7f917c14e010 2023-12-08T08:21:04.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.936+0000 7f9178ff9640 1 -- 172.21.15.88:0/1742647770 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9164005e50 con 0x7f917c14e010 2023-12-08T08:21:04.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.936+0000 7f9181879640 1 -- 172.21.15.88:0/1742647770 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f917c14ef20 con 0x7f917c14e010 2023-12-08T08:21:04.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.936+0000 7f9178ff9640 1 -- 172.21.15.88:0/1742647770 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91640072f0 con 0x7f917c14e010 2023-12-08T08:21:04.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.936+0000 7f9181879640 1 -- 172.21.15.88:0/1742647770 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f917c13c590 con 0x7f917c14e010 2023-12-08T08:21:04.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.936+0000 7f9181879640 1 -- 172.21.15.88:0/1742647770 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f917c071f70 con 0x7f917c14e010 2023-12-08T08:21:04.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.936+0000 7f9178ff9640 1 -- 172.21.15.88:0/1742647770 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9164007450 con 0x7f917c14e010 2023-12-08T08:21:04.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.940+0000 7f9178ff9640 1 --2- 172.21.15.88:0/1742647770 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f915c066470 0x7f915c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.940+0000 7f9178ff9640 1 -- 172.21.15.88:0/1742647770 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f91640832c0 con 0x7f917c14e010 2023-12-08T08:21:04.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.940+0000 7f917affd640 1 --2- 172.21.15.88:0/1742647770 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f915c066470 0x7f915c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.940+0000 7f917affd640 1 --2- 172.21.15.88:0/1742647770 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f915c066470 0x7f915c068930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f916c00ab60 tx=0x7f916c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:04.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:04.944+0000 7f9178ff9640 1 -- 172.21.15.88:0/1742647770 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9164050840 con 0x7f917c14e010 2023-12-08T08:21:05.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.124+0000 7f9181879640 1 -- 172.21.15.88:0/1742647770 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f917c0674b0 con 0x7f917c14e010 2023-12-08T08:21:05.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.756+0000 7f9178ff9640 1 -- 172.21.15.88:0/1742647770 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9164053e60 con 0x7f917c14e010 2023-12-08T08:21:05.765 INFO:teuthology.orchestra.run.smithi088.stderr:new fs with metadata pool 4 and data pool 5 2023-12-08T08:21:05.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.760+0000 7f9181879640 1 -- 172.21.15.88:0/1742647770 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f915c066470 msgr2=0x7f915c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.760+0000 7f9181879640 1 --2- 172.21.15.88:0/1742647770 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f915c066470 0x7f915c068930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f916c00ab60 tx=0x7f916c008040 comp rx=0 tx=0).stop 2023-12-08T08:21:05.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.760+0000 7f9181879640 1 -- 172.21.15.88:0/1742647770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f917c14e010 msgr2=0x7f917c0a6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.760+0000 7f9181879640 1 --2- 172.21.15.88:0/1742647770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f917c14e010 0x7f917c0a6a40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f916400c500 tx=0x7f916400c9c0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.760+0000 7f9181879640 1 -- 172.21.15.88:0/1742647770 shutdown_connections 2023-12-08T08:21:05.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.760+0000 7f9181879640 1 --2- 172.21.15.88:0/1742647770 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f915c066470 0x7f915c068930 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.760+0000 7f9181879640 1 --2- 172.21.15.88:0/1742647770 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f917c150c70 0x7f917c13b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.760+0000 7f9181879640 1 --2- 172.21.15.88:0/1742647770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f917c14e010 0x7f917c0a6a40 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.760+0000 7f9181879640 1 --2- 172.21.15.88:0/1742647770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f917c06db40 0x7f917c072250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.760+0000 7f9181879640 1 -- 172.21.15.88:0/1742647770 >> 172.21.15.88:0/1742647770 conn(0x7f917c0a7520 msgr2=0x7f917c06a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:05.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.760+0000 7f9181879640 1 -- 172.21.15.88:0/1742647770 shutdown_connections 2023-12-08T08:21:05.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.760+0000 7f9181879640 1 -- 172.21.15.88:0/1742647770 wait complete. 2023-12-08T08:21:05.797 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:21:05.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.928+0000 7f78317a1640 1 Processor -- start 2023-12-08T08:21:05.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.928+0000 7f78317a1640 1 -- start start 2023-12-08T08:21:05.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.928+0000 7f78317a1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f782c0af4c0 0x7f782c154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.928+0000 7f78317a1640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782c0c4890 con 0x7f782c0c67d0 2023-12-08T08:21:05.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.928+0000 7f78317a1640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782c0af8a0 con 0x7f782c06c100 2023-12-08T08:21:05.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.928+0000 7f78317a1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782c155460 con 0x7f782c0af4c0 2023-12-08T08:21:05.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.928+0000 7f78227fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f782c0c67d0 0x7f782c06b9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:56186/0 (socket says 172.21.15.88:56186) 2023-12-08T08:21:05.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.928+0000 7f78227fc640 1 -- 172.21.15.88:0/2222107865 learned_addr learned my addr 172.21.15.88:0/2222107865 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:05.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.928+0000 7f782affd640 1 --2- 172.21.15.88:0/2222107865 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f782c0af4c0 0x7f782c154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.928+0000 7f782a7fc640 1 -- 172.21.15.88:0/2222107865 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1136378164 0 0) 0x7f782c0c4890 con 0x7f782c0c67d0 2023-12-08T08:21:05.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.928+0000 7f782a7fc640 1 -- 172.21.15.88:0/2222107865 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7818003530 con 0x7f782c0c67d0 2023-12-08T08:21:05.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.928+0000 7f782a7fc640 1 -- 172.21.15.88:0/2222107865 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 491367460 0 0) 0x7f7818003530 con 0x7f782c0c67d0 2023-12-08T08:21:05.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.928+0000 7f782a7fc640 1 -- 172.21.15.88:0/2222107865 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f782c0af4c0 msgr2=0x7f782c154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:05.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.928+0000 7f782a7fc640 1 --2- 172.21.15.88:0/2222107865 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f782c0af4c0 0x7f782c154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.928+0000 7f782a7fc640 1 -- 172.21.15.88:0/2222107865 >> v1:172.21.15.148:6789/0 conn(0x7f782c06c100 legacy=0x7f782c15ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.928+0000 7f782a7fc640 1 -- 172.21.15.88:0/2222107865 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782c0c4b30 con 0x7f782c0c67d0 2023-12-08T08:21:05.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.928+0000 7f782a7fc640 1 -- 172.21.15.88:0/2222107865 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f7814001a00 con 0x7f782c0c67d0 2023-12-08T08:21:05.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.928+0000 7f782a7fc640 1 -- 172.21.15.88:0/2222107865 >> v1:172.21.15.88:6789/0 conn(0x7f782c0c67d0 legacy=0x7f782c06b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.928+0000 7f782a7fc640 1 --2- 172.21.15.88:0/2222107865 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f782c0af4c0 0x7f78180039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.928+0000 7f782a7fc640 1 --2- 172.21.15.88:0/2222107865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7818003f30 0x7f78180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.928+0000 7f782a7fc640 1 --2- 172.21.15.88:0/2222107865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7818004d10 0x7f7818005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.928+0000 7f782a7fc640 1 -- 172.21.15.88:0/2222107865 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c155460 con 0x7f7818003f30 2023-12-08T08:21:05.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.928+0000 7f782a7fc640 1 -- 172.21.15.88:0/2222107865 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781800bb20 con 0x7f7818004d10 2023-12-08T08:21:05.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.928+0000 7f782a7fc640 1 -- 172.21.15.88:0/2222107865 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781800bce0 con 0x7f782c0af4c0 2023-12-08T08:21:05.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.928+0000 7f78227fc640 1 --2- 172.21.15.88:0/2222107865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7818003f30 0x7f78180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.928+0000 7f782affd640 1 --2- 172.21.15.88:0/2222107865 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f782c0af4c0 0x7f78180039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.932+0000 7f782b7fe640 1 --2- 172.21.15.88:0/2222107865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7818004d10 0x7f7818005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.932+0000 7f78227fc640 1 -- 172.21.15.88:0/2222107865 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f782c0af4c0 msgr2=0x7f78180039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:05.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.932+0000 7f78227fc640 1 --2- 172.21.15.88:0/2222107865 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f782c0af4c0 0x7f78180039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.932+0000 7f78227fc640 1 -- 172.21.15.88:0/2222107865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7818004d10 msgr2=0x7f7818005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:05.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.932+0000 7f78227fc640 1 --2- 172.21.15.88:0/2222107865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7818004d10 0x7f7818005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.932+0000 7f78227fc640 1 -- 172.21.15.88:0/2222107865 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7818003530 con 0x7f7818003f30 2023-12-08T08:21:05.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.932+0000 7f78227fc640 1 --2- 172.21.15.88:0/2222107865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7818003f30 0x7f78180047d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f781400a820 tx=0x7f781401d2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c0b326e3616b60 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:05.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.932+0000 7f782a7fc640 1 -- 172.21.15.88:0/2222107865 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78140072d0 con 0x7f7818003f30 2023-12-08T08:21:05.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.932+0000 7f782a7fc640 1 -- 172.21.15.88:0/2222107865 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78140a8070 con 0x7f7818003f30 2023-12-08T08:21:05.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.932+0000 7f782a7fc640 1 -- 172.21.15.88:0/2222107865 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78140076b0 con 0x7f7818003f30 2023-12-08T08:21:05.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.932+0000 7f78317a1640 1 -- 172.21.15.88:0/2222107865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7818003f30 msgr2=0x7f78180047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.932+0000 7f78317a1640 1 --2- 172.21.15.88:0/2222107865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7818003f30 0x7f78180047d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f781400a820 tx=0x7f781401d2f0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.932+0000 7f782b7fe640 1 -- 172.21.15.88:0/2222107865 reap_dead start 2023-12-08T08:21:05.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.932+0000 7f78317a1640 1 -- 172.21.15.88:0/2222107865 shutdown_connections 2023-12-08T08:21:05.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.932+0000 7f78317a1640 1 -- 172.21.15.88:0/2222107865 >> 172.21.15.88:0/2222107865 conn(0x7f782c0ab9d0 msgr2=0x7f782c0abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:05.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.936+0000 7f78317a1640 1 -- 172.21.15.88:0/2222107865 shutdown_connections 2023-12-08T08:21:05.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.936+0000 7f78317a1640 1 -- 172.21.15.88:0/2222107865 wait complete. 2023-12-08T08:21:05.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.936+0000 7f78317a1640 1 Processor -- start 2023-12-08T08:21:05.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.936+0000 7f78317a1640 1 -- start start 2023-12-08T08:21:05.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.936+0000 7f78317a1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7818003f30 0x7f782c146da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.936+0000 7f78317a1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f782c14a2d0 0x7f782c14a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.936+0000 7f78317a1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f782c147d60 0x7f782c1481e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.936+0000 7f78317a1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c14ece0 con 0x7f7818003f30 2023-12-08T08:21:05.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.936+0000 7f78317a1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c153960 con 0x7f782c14a2d0 2023-12-08T08:21:05.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.936+0000 7f78317a1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782c152dc0 con 0x7f782c147d60 2023-12-08T08:21:05.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.936+0000 7f782affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7818003f30 0x7f782c146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.936+0000 7f782affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7818003f30 0x7f782c146da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52120/0 (socket says 172.21.15.88:52120) 2023-12-08T08:21:05.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.936+0000 7f782affd640 1 -- 172.21.15.88:0/4286817907 learned_addr learned my addr 172.21.15.88:0/4286817907 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:05.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.936+0000 7f782affd640 1 -- 172.21.15.88:0/4286817907 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f782c147d60 msgr2=0x7f782c1481e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.936+0000 7f782affd640 1 --2- 172.21.15.88:0/4286817907 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f782c147d60 0x7f782c1481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.936+0000 7f782affd640 1 -- 172.21.15.88:0/4286817907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f782c14a2d0 msgr2=0x7f782c14a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.936+0000 7f782affd640 1 --2- 172.21.15.88:0/4286817907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f782c14a2d0 0x7f782c14a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.936+0000 7f782affd640 1 -- 172.21.15.88:0/4286817907 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782c1530a0 con 0x7f7818003f30 2023-12-08T08:21:05.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.936+0000 7f782affd640 1 --2- 172.21.15.88:0/4286817907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7818003f30 0x7f782c146da0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f781c0119d0 tx=0x7f781c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:05.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.936+0000 7f7823fff640 1 -- 172.21.15.88:0/4286817907 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c00fb50 con 0x7f7818003f30 2023-12-08T08:21:05.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.936+0000 7f7823fff640 1 -- 172.21.15.88:0/4286817907 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781c00fcb0 con 0x7f7818003f30 2023-12-08T08:21:05.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.936+0000 7f7823fff640 1 -- 172.21.15.88:0/4286817907 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c014440 con 0x7f7818003f30 2023-12-08T08:21:05.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.936+0000 7f78317a1640 1 -- 172.21.15.88:0/4286817907 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782c147840 con 0x7f7818003f30 2023-12-08T08:21:05.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.940+0000 7f78317a1640 1 -- 172.21.15.88:0/4286817907 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782c14c700 con 0x7f7818003f30 2023-12-08T08:21:05.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.940+0000 7f78317a1640 1 -- 172.21.15.88:0/4286817907 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f782c1532e0 con 0x7f7818003f30 2023-12-08T08:21:05.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.940+0000 7f7823fff640 1 -- 172.21.15.88:0/4286817907 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f781c0145a0 con 0x7f7818003f30 2023-12-08T08:21:05.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.940+0000 7f7823fff640 1 --2- 172.21.15.88:0/4286817907 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f780c0664a0 0x7f780c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.940+0000 7f7823fff640 1 -- 172.21.15.88:0/4286817907 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f781c0847f0 con 0x7f7818003f30 2023-12-08T08:21:05.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.940+0000 7f78227fc640 1 --2- 172.21.15.88:0/4286817907 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f780c0664a0 0x7f780c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.940+0000 7f78227fc640 1 --2- 172.21.15.88:0/4286817907 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f780c0664a0 0x7f780c068960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f781400a820 tx=0x7f782c0c64d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:05.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:05.944+0000 7f7823fff640 1 -- 172.21.15.88:0/4286817907 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f782c1532e0 con 0x7f7818003f30 2023-12-08T08:21:06.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.096+0000 7f78317a1640 1 -- 172.21.15.88:0/4286817907 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f782c1476a0 con 0x7f7818003f30 2023-12-08T08:21:06.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.096+0000 7f7823fff640 1 -- 172.21.15.88:0/4286817907 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16558 (secure 0 0 0) 0x7f782c1476a0 con 0x7f7818003f30 2023-12-08T08:21:06.103 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:06.104 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":30,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:21:05.130566+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:21:03.690721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-08T08:21:04.127786+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:21:06.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.100+0000 7f78317a1640 1 -- 172.21.15.88:0/4286817907 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f780c0664a0 msgr2=0x7f780c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.100+0000 7f78317a1640 1 --2- 172.21.15.88:0/4286817907 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f780c0664a0 0x7f780c068960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f781400a820 tx=0x7f782c0c64d0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.100+0000 7f78317a1640 1 -- 172.21.15.88:0/4286817907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7818003f30 msgr2=0x7f782c146da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.100+0000 7f78317a1640 1 --2- 172.21.15.88:0/4286817907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7818003f30 0x7f782c146da0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f781c0119d0 tx=0x7f781c011e90 comp rx=0 tx=0).stop 2023-12-08T08:21:06.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.100+0000 7f78317a1640 1 -- 172.21.15.88:0/4286817907 shutdown_connections 2023-12-08T08:21:06.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.100+0000 7f78317a1640 1 --2- 172.21.15.88:0/4286817907 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f780c0664a0 0x7f780c068960 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.100+0000 7f78317a1640 1 --2- 172.21.15.88:0/4286817907 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f782c147d60 0x7f782c1481e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.100+0000 7f78317a1640 1 --2- 172.21.15.88:0/4286817907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f782c14a2d0 0x7f782c14a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.100+0000 7f78317a1640 1 --2- 172.21.15.88:0/4286817907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7818003f30 0x7f782c146da0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.100+0000 7f78317a1640 1 -- 172.21.15.88:0/4286817907 >> 172.21.15.88:0/4286817907 conn(0x7f782c0ab9d0 msgr2=0x7f782c0ae610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:06.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.100+0000 7f78317a1640 1 -- 172.21.15.88:0/4286817907 shutdown_connections 2023-12-08T08:21:06.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.100+0000 7f78317a1640 1 -- 172.21.15.88:0/4286817907 wait complete. 2023-12-08T08:21:06.125 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:21:06.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.256+0000 7f2c749c1640 1 Processor -- start 2023-12-08T08:21:06.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.256+0000 7f2c749c1640 1 -- start start 2023-12-08T08:21:06.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.256+0000 7f2c749c1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c70154f20 0x7f2c7006b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.256+0000 7f2c749c1640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c7006c380 con 0x7f2c700af4c0 2023-12-08T08:21:06.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.256+0000 7f2c749c1640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c700c4890 con 0x7f2c7006bf30 2023-12-08T08:21:06.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.256+0000 7f2c749c1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c701553a0 con 0x7f2c70154f20 2023-12-08T08:21:06.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.256+0000 7f2c6e59c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2c700af4c0 0x7f2c700c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:56200/0 (socket says 172.21.15.88:56200) 2023-12-08T08:21:06.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.256+0000 7f2c6e59c640 1 -- 172.21.15.88:0/3289559547 learned_addr learned my addr 172.21.15.88:0/3289559547 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:06.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.256+0000 7f2c6dd9b640 1 -- 172.21.15.88:0/3289559547 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537809865 0 0) 0x7f2c7006c380 con 0x7f2c700af4c0 2023-12-08T08:21:06.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.256+0000 7f2c6dd9b640 1 -- 172.21.15.88:0/3289559547 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c5c003530 con 0x7f2c700af4c0 2023-12-08T08:21:06.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.256+0000 7f2c65d9b640 1 --2- 172.21.15.88:0/3289559547 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c70154f20 0x7f2c7006b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.256+0000 7f2c6dd9b640 1 -- 172.21.15.88:0/3289559547 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2866314732 0 0) 0x7f2c5c003530 con 0x7f2c700af4c0 2023-12-08T08:21:06.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.256+0000 7f2c6dd9b640 1 -- 172.21.15.88:0/3289559547 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c70154f20 msgr2=0x7f2c7006b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:06.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.256+0000 7f2c6dd9b640 1 --2- 172.21.15.88:0/3289559547 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c70154f20 0x7f2c7006b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.256+0000 7f2c6dd9b640 1 -- 172.21.15.88:0/3289559547 >> v1:172.21.15.148:6789/0 conn(0x7f2c7006bf30 legacy=0x7f2c7015ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.256+0000 7f2c6dd9b640 1 -- 172.21.15.88:0/3289559547 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c700af8a0 con 0x7f2c700af4c0 2023-12-08T08:21:06.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.256+0000 7f2c6dd9b640 1 -- 172.21.15.88:0/3289559547 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f2c60001680 con 0x7f2c700af4c0 2023-12-08T08:21:06.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.256+0000 7f2c6dd9b640 1 -- 172.21.15.88:0/3289559547 >> v1:172.21.15.88:6789/0 conn(0x7f2c700af4c0 legacy=0x7f2c700c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.256+0000 7f2c6dd9b640 1 --2- 172.21.15.88:0/3289559547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c5c0039b0 0x7f2c5c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.256+0000 7f2c6dd9b640 1 --2- 172.21.15.88:0/3289559547 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c5c0047d0 0x7f2c5c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.256+0000 7f2c6dd9b640 1 --2- 172.21.15.88:0/3289559547 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c70154f20 0x7f2c5c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.256+0000 7f2c6dd9b640 1 -- 172.21.15.88:0/3289559547 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c701553a0 con 0x7f2c5c0047d0 2023-12-08T08:21:06.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.256+0000 7f2c6dd9b640 1 -- 172.21.15.88:0/3289559547 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5c00baf0 con 0x7f2c5c0039b0 2023-12-08T08:21:06.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.256+0000 7f2c6dd9b640 1 -- 172.21.15.88:0/3289559547 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5c00bcb0 con 0x7f2c70154f20 2023-12-08T08:21:06.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.260+0000 7f2c65d9b640 1 --2- 172.21.15.88:0/3289559547 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c5c0047d0 0x7f2c5c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.260+0000 7f2c6e59c640 1 --2- 172.21.15.88:0/3289559547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c5c0039b0 0x7f2c5c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.260+0000 7f2c6ed9d640 1 --2- 172.21.15.88:0/3289559547 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c70154f20 0x7f2c5c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.260+0000 7f2c65d9b640 1 -- 172.21.15.88:0/3289559547 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c70154f20 msgr2=0x7f2c5c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:06.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.260+0000 7f2c65d9b640 1 --2- 172.21.15.88:0/3289559547 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c70154f20 0x7f2c5c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.260+0000 7f2c65d9b640 1 -- 172.21.15.88:0/3289559547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c5c0039b0 msgr2=0x7f2c5c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:06.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.260+0000 7f2c65d9b640 1 --2- 172.21.15.88:0/3289559547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c5c0039b0 0x7f2c5c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.260+0000 7f2c65d9b640 1 -- 172.21.15.88:0/3289559547 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5c003530 con 0x7f2c5c0047d0 2023-12-08T08:21:06.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.260+0000 7f2c65d9b640 1 --2- 172.21.15.88:0/3289559547 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c5c0047d0 0x7f2c5c004c50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2c58009fc0 tx=0x7f2c5801cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba8335550e76b7d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:06.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.260+0000 7f2c6dd9b640 1 -- 172.21.15.88:0/3289559547 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c580a5b30 con 0x7f2c5c0047d0 2023-12-08T08:21:06.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.260+0000 7f2c6dd9b640 1 -- 172.21.15.88:0/3289559547 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5800f040 con 0x7f2c5c0047d0 2023-12-08T08:21:06.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.260+0000 7f2c6dd9b640 1 -- 172.21.15.88:0/3289559547 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c580ad440 con 0x7f2c5c0047d0 2023-12-08T08:21:06.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.264+0000 7f2c749c1640 1 -- 172.21.15.88:0/3289559547 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c5c0047d0 msgr2=0x7f2c5c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.264+0000 7f2c749c1640 1 --2- 172.21.15.88:0/3289559547 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c5c0047d0 0x7f2c5c004c50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2c58009fc0 tx=0x7f2c5801cc30 comp rx=0 tx=0).stop 2023-12-08T08:21:06.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.264+0000 7f2c6ed9d640 1 -- 172.21.15.88:0/3289559547 reap_dead start 2023-12-08T08:21:06.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.264+0000 7f2c749c1640 1 -- 172.21.15.88:0/3289559547 shutdown_connections 2023-12-08T08:21:06.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.264+0000 7f2c749c1640 1 -- 172.21.15.88:0/3289559547 >> 172.21.15.88:0/3289559547 conn(0x7f2c700ab9d0 msgr2=0x7f2c700abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:06.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.264+0000 7f2c749c1640 1 -- 172.21.15.88:0/3289559547 shutdown_connections 2023-12-08T08:21:06.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.264+0000 7f2c749c1640 1 -- 172.21.15.88:0/3289559547 wait complete. 2023-12-08T08:21:06.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.264+0000 7f2c749c1640 1 Processor -- start 2023-12-08T08:21:06.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.264+0000 7f2c749c1640 1 -- start start 2023-12-08T08:21:06.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.264+0000 7f2c749c1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c5c0047d0 0x7f2c7014baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.264+0000 7f2c749c1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c700ad340 0x7f2c70149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.264+0000 7f2c749c1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c700ad7a0 0x7f2c70149a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.264+0000 7f2c749c1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c701f1690 con 0x7f2c5c0047d0 2023-12-08T08:21:06.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.264+0000 7f2c749c1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c701f0a10 con 0x7f2c700ad7a0 2023-12-08T08:21:06.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.264+0000 7f2c749c1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c701f0cf0 con 0x7f2c700ad340 2023-12-08T08:21:06.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.264+0000 7f2c6e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c5c0047d0 0x7f2c7014baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.264+0000 7f2c6e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c5c0047d0 0x7f2c7014baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52144/0 (socket says 172.21.15.88:52144) 2023-12-08T08:21:06.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.264+0000 7f2c6e59c640 1 -- 172.21.15.88:0/2786525875 learned_addr learned my addr 172.21.15.88:0/2786525875 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:06.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.264+0000 7f2c65d9b640 1 --2- 172.21.15.88:0/2786525875 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c700ad340 0x7f2c70149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.264+0000 7f2c6e59c640 1 -- 172.21.15.88:0/2786525875 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c700ad340 msgr2=0x7f2c70149530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.264+0000 7f2c6e59c640 1 --2- 172.21.15.88:0/2786525875 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c700ad340 0x7f2c70149530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.264+0000 7f2c6e59c640 1 -- 172.21.15.88:0/2786525875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c700ad7a0 msgr2=0x7f2c70149a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.264+0000 7f2c6e59c640 1 --2- 172.21.15.88:0/2786525875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c700ad7a0 0x7f2c70149a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.264+0000 7f2c6e59c640 1 -- 172.21.15.88:0/2786525875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c701f0fd0 con 0x7f2c5c0047d0 2023-12-08T08:21:06.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.268+0000 7f2c6e59c640 1 --2- 172.21.15.88:0/2786525875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c5c0047d0 0x7f2c7014baa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2c60007290 tx=0x7f2c60007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:06.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.268+0000 7f2c677fe640 1 -- 172.21.15.88:0/2786525875 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6000f840 con 0x7f2c5c0047d0 2023-12-08T08:21:06.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.268+0000 7f2c677fe640 1 -- 172.21.15.88:0/2786525875 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6000f9c0 con 0x7f2c5c0047d0 2023-12-08T08:21:06.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.268+0000 7f2c677fe640 1 -- 172.21.15.88:0/2786525875 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6000fd70 con 0x7f2c5c0047d0 2023-12-08T08:21:06.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.268+0000 7f2c749c1640 1 -- 172.21.15.88:0/2786525875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c701f12b0 con 0x7f2c5c0047d0 2023-12-08T08:21:06.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.268+0000 7f2c749c1640 1 -- 172.21.15.88:0/2786525875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7014ecb0 con 0x7f2c5c0047d0 2023-12-08T08:21:06.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.268+0000 7f2c749c1640 1 -- 172.21.15.88:0/2786525875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c701f17d0 con 0x7f2c5c0047d0 2023-12-08T08:21:06.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.268+0000 7f2c677fe640 1 -- 172.21.15.88:0/2786525875 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2c6001d460 con 0x7f2c5c0047d0 2023-12-08T08:21:06.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.268+0000 7f2c677fe640 1 --2- 172.21.15.88:0/2786525875 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2c500664a0 0x7f2c50068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.268+0000 7f2c677fe640 1 -- 172.21.15.88:0/2786525875 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c60084020 con 0x7f2c5c0047d0 2023-12-08T08:21:06.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.268+0000 7f2c65d9b640 1 --2- 172.21.15.88:0/2786525875 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2c500664a0 0x7f2c50068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.272+0000 7f2c65d9b640 1 --2- 172.21.15.88:0/2786525875 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2c500664a0 0x7f2c50068960 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2c580af000 tx=0x7f2c580a7040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:06.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.272+0000 7f2c677fe640 1 -- 172.21.15.88:0/2786525875 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2c60051530 con 0x7f2c5c0047d0 2023-12-08T08:21:06.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.424+0000 7f2c749c1640 1 -- 172.21.15.88:0/2786525875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c70067630 con 0x7f2c5c0047d0 2023-12-08T08:21:06.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.428+0000 7f2c677fe640 1 -- 172.21.15.88:0/2786525875 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16558 (secure 0 0 0) 0x7f2c60054b50 con 0x7f2c5c0047d0 2023-12-08T08:21:06.434 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:06.434 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":30,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:21:05.130566+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:21:03.690721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-08T08:21:04.127786+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:21:06.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.428+0000 7f2c749c1640 1 -- 172.21.15.88:0/2786525875 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2c500664a0 msgr2=0x7f2c50068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.428+0000 7f2c749c1640 1 --2- 172.21.15.88:0/2786525875 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2c500664a0 0x7f2c50068960 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2c580af000 tx=0x7f2c580a7040 comp rx=0 tx=0).stop 2023-12-08T08:21:06.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.428+0000 7f2c749c1640 1 -- 172.21.15.88:0/2786525875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c5c0047d0 msgr2=0x7f2c7014baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.428+0000 7f2c749c1640 1 --2- 172.21.15.88:0/2786525875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c5c0047d0 0x7f2c7014baa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2c60007290 tx=0x7f2c60007750 comp rx=0 tx=0).stop 2023-12-08T08:21:06.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.428+0000 7f2c749c1640 1 -- 172.21.15.88:0/2786525875 shutdown_connections 2023-12-08T08:21:06.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.428+0000 7f2c749c1640 1 --2- 172.21.15.88:0/2786525875 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2c500664a0 0x7f2c50068960 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.428+0000 7f2c749c1640 1 --2- 172.21.15.88:0/2786525875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c700ad7a0 0x7f2c70149a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.428+0000 7f2c749c1640 1 --2- 172.21.15.88:0/2786525875 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2c700ad340 0x7f2c70149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.428+0000 7f2c749c1640 1 --2- 172.21.15.88:0/2786525875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c5c0047d0 0x7f2c7014baa0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.428+0000 7f2c749c1640 1 -- 172.21.15.88:0/2786525875 >> 172.21.15.88:0/2786525875 conn(0x7f2c700ab9d0 msgr2=0x7f2c700733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:06.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.428+0000 7f2c749c1640 1 -- 172.21.15.88:0/2786525875 shutdown_connections 2023-12-08T08:21:06.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.428+0000 7f2c749c1640 1 -- 172.21.15.88:0/2786525875 wait complete. 2023-12-08T08:21:06.455 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-08T08:21:06.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4baa479640 1 Processor -- start 2023-12-08T08:21:06.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4baa479640 1 -- start start 2023-12-08T08:21:06.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4baa479640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ba414b1e0 0x7f4ba40c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4baa479640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4ba41548c0 0x7f4ba4154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4baa479640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba40a4e20 con 0x7f4ba40c5300 2023-12-08T08:21:06.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4baa479640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba40a50e0 con 0x7f4ba41548c0 2023-12-08T08:21:06.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4baa479640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba40c0f00 con 0x7f4ba414b1e0 2023-12-08T08:21:06.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba37fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4ba40c5300 0x7f4ba40a9c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:56212/0 (socket says 172.21.15.88:56212) 2023-12-08T08:21:06.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba37fe640 1 -- 172.21.15.88:0/291058054 learned_addr learned my addr 172.21.15.88:0/291058054 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:06.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba8a16640 1 --2- 172.21.15.88:0/291058054 >> v2:172.21.15.148:3300/0 conn(0x7f4ba41548c0 0x7f4ba4154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba3fff640 1 --2- 172.21.15.88:0/291058054 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ba414b1e0 0x7f4ba40c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba2ffd640 1 -- 172.21.15.88:0/291058054 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 5217862 0 0) 0x7f4ba40a4e20 con 0x7f4ba40c5300 2023-12-08T08:21:06.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba2ffd640 1 -- 172.21.15.88:0/291058054 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b8c005740 con 0x7f4ba40c5300 2023-12-08T08:21:06.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba2ffd640 1 -- 172.21.15.88:0/291058054 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1754671288 0 0) 0x7f4b8c005740 con 0x7f4ba40c5300 2023-12-08T08:21:06.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba2ffd640 1 -- 172.21.15.88:0/291058054 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ba414b1e0 msgr2=0x7f4ba40c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:06.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba2ffd640 1 --2- 172.21.15.88:0/291058054 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ba414b1e0 0x7f4ba40c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba2ffd640 1 -- 172.21.15.88:0/291058054 >> v2:172.21.15.148:3300/0 conn(0x7f4ba41548c0 msgr2=0x7f4ba4154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:06.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba2ffd640 1 --2- 172.21.15.88:0/291058054 >> v2:172.21.15.148:3300/0 conn(0x7f4ba41548c0 0x7f4ba4154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba2ffd640 1 -- 172.21.15.88:0/291058054 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba40c11e0 con 0x7f4ba40c5300 2023-12-08T08:21:06.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba2ffd640 1 -- 172.21.15.88:0/291058054 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f4b980016a0 con 0x7f4ba40c5300 2023-12-08T08:21:06.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba2ffd640 1 -- 172.21.15.88:0/291058054 >> v1:172.21.15.88:6789/0 conn(0x7f4ba40c5300 legacy=0x7f4ba40a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba2ffd640 1 --2- 172.21.15.88:0/291058054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b8c005b90 0x7f4b8c005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba2ffd640 1 --2- 172.21.15.88:0/291058054 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ba414b1e0 0x7f4b8c0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba2ffd640 1 --2- 172.21.15.88:0/291058054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b8c006f20 0x7f4b8c0073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba2ffd640 1 -- 172.21.15.88:0/291058054 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba40a50e0 con 0x7f4b8c006f20 2023-12-08T08:21:06.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba2ffd640 1 -- 172.21.15.88:0/291058054 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba40c0f00 con 0x7f4b8c005b90 2023-12-08T08:21:06.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba2ffd640 1 -- 172.21.15.88:0/291058054 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c00dba0 con 0x7f4ba414b1e0 2023-12-08T08:21:06.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba3fff640 1 --2- 172.21.15.88:0/291058054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b8c005b90 0x7f4b8c005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba8a16640 1 --2- 172.21.15.88:0/291058054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b8c006f20 0x7f4b8c0073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba37fe640 1 --2- 172.21.15.88:0/291058054 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ba414b1e0 0x7f4b8c0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba37fe640 1 -- 172.21.15.88:0/291058054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b8c005b90 msgr2=0x7f4b8c005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:06.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba37fe640 1 --2- 172.21.15.88:0/291058054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b8c005b90 0x7f4b8c005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba37fe640 1 -- 172.21.15.88:0/291058054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b8c006f20 msgr2=0x7f4b8c0073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:06.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba37fe640 1 --2- 172.21.15.88:0/291058054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b8c006f20 0x7f4b8c0073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba37fe640 1 -- 172.21.15.88:0/291058054 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8c005740 con 0x7f4ba414b1e0 2023-12-08T08:21:06.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.592+0000 7f4ba8a16640 1 --2- 172.21.15.88:0/291058054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b8c006f20 0x7f4b8c0073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:21:06.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.596+0000 7f4ba37fe640 1 --2- 172.21.15.88:0/291058054 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ba414b1e0 0x7f4b8c0069e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40c6a70 tx=0x7f4b9801cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a3278a4e654b1d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:06.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.596+0000 7f4ba2ffd640 1 -- 172.21.15.88:0/291058054 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b980a5900 con 0x7f4ba414b1e0 2023-12-08T08:21:06.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.596+0000 7f4ba2ffd640 1 -- 172.21.15.88:0/291058054 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b980a5a60 con 0x7f4ba414b1e0 2023-12-08T08:21:06.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.596+0000 7f4ba2ffd640 1 -- 172.21.15.88:0/291058054 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b980a5e10 con 0x7f4ba414b1e0 2023-12-08T08:21:06.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.596+0000 7f4baa479640 1 -- 172.21.15.88:0/291058054 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ba414b1e0 msgr2=0x7f4b8c0069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.596+0000 7f4baa479640 1 --2- 172.21.15.88:0/291058054 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ba414b1e0 0x7f4b8c0069e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40c6a70 tx=0x7f4b9801cc00 comp rx=0 tx=0).stop 2023-12-08T08:21:06.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.596+0000 7f4ba8a16640 1 -- 172.21.15.88:0/291058054 reap_dead start 2023-12-08T08:21:06.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.596+0000 7f4baa479640 1 -- 172.21.15.88:0/291058054 shutdown_connections 2023-12-08T08:21:06.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.596+0000 7f4baa479640 1 -- 172.21.15.88:0/291058054 >> 172.21.15.88:0/291058054 conn(0x7f4ba40c59f0 msgr2=0x7f4ba40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:06.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.596+0000 7f4baa479640 1 -- 172.21.15.88:0/291058054 shutdown_connections 2023-12-08T08:21:06.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.596+0000 7f4baa479640 1 -- 172.21.15.88:0/291058054 wait complete. 2023-12-08T08:21:06.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.600+0000 7f4baa479640 1 Processor -- start 2023-12-08T08:21:06.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.600+0000 7f4baa479640 1 -- start start 2023-12-08T08:21:06.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.600+0000 7f4baa479640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ba414b1e0 0x7f4ba4070230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.600+0000 7f4baa479640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ba414b950 0x7f4ba4147a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.600+0000 7f4baa479640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ba4147f40 0x7f4ba41e9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.600+0000 7f4baa479640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba41546c0 con 0x7f4ba414b950 2023-12-08T08:21:06.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.600+0000 7f4baa479640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba414db90 con 0x7f4ba414b1e0 2023-12-08T08:21:06.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.600+0000 7f4baa479640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba4072bd0 con 0x7f4ba4147f40 2023-12-08T08:21:06.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.600+0000 7f4ba37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ba414b950 0x7f4ba4147a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.600+0000 7f4ba37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ba414b950 0x7f4ba4147a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52158/0 (socket says 172.21.15.88:52158) 2023-12-08T08:21:06.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.600+0000 7f4ba37fe640 1 -- 172.21.15.88:0/1915776118 learned_addr learned my addr 172.21.15.88:0/1915776118 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:06.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.600+0000 7f4ba8a16640 1 --2- 172.21.15.88:0/1915776118 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ba4147f40 0x7f4ba41e9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.600+0000 7f4ba3fff640 1 --2- 172.21.15.88:0/1915776118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ba414b1e0 0x7f4ba4070230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.600+0000 7f4ba37fe640 1 -- 172.21.15.88:0/1915776118 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ba4147f40 msgr2=0x7f4ba41e9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.600+0000 7f4ba37fe640 1 --2- 172.21.15.88:0/1915776118 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ba4147f40 0x7f4ba41e9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.600+0000 7f4ba37fe640 1 -- 172.21.15.88:0/1915776118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ba414b1e0 msgr2=0x7f4ba4070230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.600+0000 7f4ba37fe640 1 --2- 172.21.15.88:0/1915776118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ba414b1e0 0x7f4ba4070230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.600+0000 7f4ba37fe640 1 -- 172.21.15.88:0/1915776118 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba4148910 con 0x7f4ba414b950 2023-12-08T08:21:06.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.600+0000 7f4ba37fe640 1 --2- 172.21.15.88:0/1915776118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ba414b950 0x7f4ba4147a00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4b9801ca30 tx=0x7f4b8c007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:06.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.600+0000 7f4ba0ff9640 1 -- 172.21.15.88:0/1915776118 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b98004c00 con 0x7f4ba414b950 2023-12-08T08:21:06.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.600+0000 7f4ba0ff9640 1 -- 172.21.15.88:0/1915776118 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b98004d80 con 0x7f4ba414b950 2023-12-08T08:21:06.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.600+0000 7f4ba0ff9640 1 -- 172.21.15.88:0/1915776118 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b98007310 con 0x7f4ba414b950 2023-12-08T08:21:06.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.600+0000 7f4baa479640 1 -- 172.21.15.88:0/1915776118 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba414d260 con 0x7f4ba414b950 2023-12-08T08:21:06.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.600+0000 7f4baa479640 1 -- 172.21.15.88:0/1915776118 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba414d820 con 0x7f4ba414b950 2023-12-08T08:21:06.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.604+0000 7f4baa479640 1 -- 172.21.15.88:0/1915776118 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba4067630 con 0x7f4ba414b950 2023-12-08T08:21:06.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.604+0000 7f4ba0ff9640 1 -- 172.21.15.88:0/1915776118 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4b980b5030 con 0x7f4ba414b950 2023-12-08T08:21:06.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.604+0000 7f4ba0ff9640 1 --2- 172.21.15.88:0/1915776118 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4b90066470 0x7f4b90068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.604+0000 7f4ba0ff9640 1 -- 172.21.15.88:0/1915776118 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b9811d760 con 0x7f4ba414b950 2023-12-08T08:21:06.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.604+0000 7f4ba3fff640 1 --2- 172.21.15.88:0/1915776118 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4b90066470 0x7f4b90068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.604+0000 7f4ba3fff640 1 --2- 172.21.15.88:0/1915776118 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4b90066470 0x7f4b90068930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4ba414e040 tx=0x7f4b94008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:06.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.608+0000 7f4ba0ff9640 1 -- 172.21.15.88:0/1915776118 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4b980eabd0 con 0x7f4ba414b950 2023-12-08T08:21:06.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:06.792+0000 7f4baa479640 1 -- 172.21.15.88:0/1915776118 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4ba414dcd0 con 0x7f4ba414b950 2023-12-08T08:21:07.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.772+0000 7f4ba0ff9640 1 -- 172.21.15.88:0/1915776118 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4b98001c80 con 0x7f4ba414b950 2023-12-08T08:21:07.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.776+0000 7f4baa479640 1 -- 172.21.15.88:0/1915776118 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4b90066470 msgr2=0x7f4b90068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:07.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.776+0000 7f4baa479640 1 --2- 172.21.15.88:0/1915776118 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4b90066470 0x7f4b90068930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4ba414e040 tx=0x7f4b94008040 comp rx=0 tx=0).stop 2023-12-08T08:21:07.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.776+0000 7f4baa479640 1 -- 172.21.15.88:0/1915776118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ba414b950 msgr2=0x7f4ba4147a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:07.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.776+0000 7f4baa479640 1 --2- 172.21.15.88:0/1915776118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ba414b950 0x7f4ba4147a00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4b9801ca30 tx=0x7f4b8c007a10 comp rx=0 tx=0).stop 2023-12-08T08:21:07.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.776+0000 7f4baa479640 1 -- 172.21.15.88:0/1915776118 shutdown_connections 2023-12-08T08:21:07.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.776+0000 7f4baa479640 1 --2- 172.21.15.88:0/1915776118 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4b90066470 0x7f4b90068930 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:07.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.776+0000 7f4baa479640 1 --2- 172.21.15.88:0/1915776118 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4ba4147f40 0x7f4ba41e9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:07.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.776+0000 7f4baa479640 1 --2- 172.21.15.88:0/1915776118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ba414b950 0x7f4ba4147a00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:07.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.776+0000 7f4baa479640 1 --2- 172.21.15.88:0/1915776118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ba414b1e0 0x7f4ba4070230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:07.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.776+0000 7f4baa479640 1 -- 172.21.15.88:0/1915776118 >> 172.21.15.88:0/1915776118 conn(0x7f4ba40c59f0 msgr2=0x7f4ba40bf560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:07.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.776+0000 7f4baa479640 1 -- 172.21.15.88:0/1915776118 shutdown_connections 2023-12-08T08:21:07.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.776+0000 7f4baa479640 1 -- 172.21.15.88:0/1915776118 wait complete. 2023-12-08T08:21:07.809 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-08T08:21:07.809 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-08T08:21:07.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.944+0000 7fc336dd1640 1 Processor -- start 2023-12-08T08:21:07.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.944+0000 7fc336dd1640 1 -- start start 2023-12-08T08:21:07.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.948+0000 7fc336dd1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3300c5300 0x7fc3300a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:07.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.948+0000 7fc336dd1640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc3301548c0 0x7fc330154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:07.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.948+0000 7fc336dd1640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3300a4e20 con 0x7fc33014b1e0 2023-12-08T08:21:07.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.948+0000 7fc336dd1640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3300a50e0 con 0x7fc3301548c0 2023-12-08T08:21:07.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.948+0000 7fc336dd1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300c0f00 con 0x7fc3300c5300 2023-12-08T08:21:07.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.948+0000 7fc334b6d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc33014b1e0 0x7fc3300c1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:56216/0 (socket says 172.21.15.88:56216) 2023-12-08T08:21:07.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.948+0000 7fc334b6d640 1 -- 172.21.15.88:0/482830321 learned_addr learned my addr 172.21.15.88:0/482830321 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:07.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.948+0000 7fc33536e640 1 --2- 172.21.15.88:0/482830321 >> v2:172.21.15.148:3300/0 conn(0x7fc3301548c0 0x7fc330154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:07.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.948+0000 7fc327fff640 1 --2- 172.21.15.88:0/482830321 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3300c5300 0x7fc3300a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:07.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.948+0000 7fc3277fe640 1 -- 172.21.15.88:0/482830321 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 640799385 0 0) 0x7fc3300a4e20 con 0x7fc33014b1e0 2023-12-08T08:21:07.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.948+0000 7fc3277fe640 1 -- 172.21.15.88:0/482830321 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc318003530 con 0x7fc33014b1e0 2023-12-08T08:21:07.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.948+0000 7fc33536e640 1 -- 172.21.15.88:0/482830321 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3300c5300 msgr2=0x7fc3300a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:07.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.948+0000 7fc33536e640 1 --2- 172.21.15.88:0/482830321 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3300c5300 0x7fc3300a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:07.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.948+0000 7fc33536e640 1 -- 172.21.15.88:0/482830321 >> v1:172.21.15.88:6789/0 conn(0x7fc33014b1e0 legacy=0x7fc3300c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:07.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.948+0000 7fc33536e640 1 -- 172.21.15.88:0/482830321 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3300c11e0 con 0x7fc3301548c0 2023-12-08T08:21:07.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.948+0000 7fc327fff640 1 --2- 172.21.15.88:0/482830321 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3300c5300 0x7fc3300a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:21:07.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.952+0000 7fc33536e640 1 --2- 172.21.15.88:0/482830321 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3301548c0 0x7fc330154d50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc328009d90 tx=0x7fc32801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4de77005f37127c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:07.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.952+0000 7fc3277fe640 1 -- 172.21.15.88:0/482830321 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3301558b0 con 0x7fc3301548c0 2023-12-08T08:21:07.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.952+0000 7fc3277fe640 1 -- 172.21.15.88:0/482830321 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3280a5920 con 0x7fc3301548c0 2023-12-08T08:21:07.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.952+0000 7fc3277fe640 1 -- 172.21.15.88:0/482830321 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3280a5cb0 con 0x7fc3301548c0 2023-12-08T08:21:07.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.952+0000 7fc336dd1640 1 -- 172.21.15.88:0/482830321 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3301548c0 msgr2=0x7fc330154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:07.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.952+0000 7fc336dd1640 1 --2- 172.21.15.88:0/482830321 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3301548c0 0x7fc330154d50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc328009d90 tx=0x7fc32801c950 comp rx=0 tx=0).stop 2023-12-08T08:21:07.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.952+0000 7fc336dd1640 1 -- 172.21.15.88:0/482830321 shutdown_connections 2023-12-08T08:21:07.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.952+0000 7fc336dd1640 1 --2- 172.21.15.88:0/482830321 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3301548c0 0x7fc330154d50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:07.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.952+0000 7fc336dd1640 1 --2- 172.21.15.88:0/482830321 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3300c5300 0x7fc3300a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:07.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.952+0000 7fc336dd1640 1 -- 172.21.15.88:0/482830321 >> 172.21.15.88:0/482830321 conn(0x7fc3300c59f0 msgr2=0x7fc3300c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:07.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.952+0000 7fc336dd1640 1 -- 172.21.15.88:0/482830321 shutdown_connections 2023-12-08T08:21:07.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.952+0000 7fc336dd1640 1 -- 172.21.15.88:0/482830321 wait complete. 2023-12-08T08:21:07.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.952+0000 7fc336dd1640 1 Processor -- start 2023-12-08T08:21:07.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.952+0000 7fc336dd1640 1 -- start start 2023-12-08T08:21:07.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.956+0000 7fc336dd1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3300c5300 0x7fc33013e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:07.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.956+0000 7fc336dd1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc33014b1e0 0x7fc33006cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:07.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.956+0000 7fc336dd1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3301548c0 0x7fc330070160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:07.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.956+0000 7fc336dd1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33013efe0 con 0x7fc33014b1e0 2023-12-08T08:21:07.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.956+0000 7fc336dd1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc330148b80 con 0x7fc3301548c0 2023-12-08T08:21:07.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.956+0000 7fc336dd1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc33013f230 con 0x7fc3300c5300 2023-12-08T08:21:07.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.956+0000 7fc327fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc33014b1e0 0x7fc33006cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:07.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.956+0000 7fc327fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc33014b1e0 0x7fc33006cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52164/0 (socket says 172.21.15.88:52164) 2023-12-08T08:21:07.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.956+0000 7fc327fff640 1 -- 172.21.15.88:0/1618184068 learned_addr learned my addr 172.21.15.88:0/1618184068 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:07.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.956+0000 7fc334b6d640 1 --2- 172.21.15.88:0/1618184068 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3300c5300 0x7fc33013e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:07.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.956+0000 7fc33536e640 1 --2- 172.21.15.88:0/1618184068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3301548c0 0x7fc330070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:07.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.956+0000 7fc327fff640 1 -- 172.21.15.88:0/1618184068 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3300c5300 msgr2=0x7fc33013e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:07.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.956+0000 7fc327fff640 1 --2- 172.21.15.88:0/1618184068 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3300c5300 0x7fc33013e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:07.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.956+0000 7fc327fff640 1 -- 172.21.15.88:0/1618184068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3301548c0 msgr2=0x7fc330070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:07.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.956+0000 7fc327fff640 1 --2- 172.21.15.88:0/1618184068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3301548c0 0x7fc330070160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:07.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.956+0000 7fc327fff640 1 -- 172.21.15.88:0/1618184068 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc320009420 con 0x7fc33014b1e0 2023-12-08T08:21:07.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.956+0000 7fc327fff640 1 --2- 172.21.15.88:0/1618184068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc33014b1e0 0x7fc33006cfc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc32000e9d0 tx=0x7fc32000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:07.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.956+0000 7fc3257fa640 1 -- 172.21.15.88:0/1618184068 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32000ca60 con 0x7fc33014b1e0 2023-12-08T08:21:07.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.956+0000 7fc3257fa640 1 -- 172.21.15.88:0/1618184068 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32000cbc0 con 0x7fc33014b1e0 2023-12-08T08:21:07.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.956+0000 7fc3257fa640 1 -- 172.21.15.88:0/1618184068 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc320013470 con 0x7fc33014b1e0 2023-12-08T08:21:07.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.956+0000 7fc336dd1640 1 -- 172.21.15.88:0/1618184068 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc328009a70 con 0x7fc33014b1e0 2023-12-08T08:21:07.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.956+0000 7fc336dd1640 1 -- 172.21.15.88:0/1618184068 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3301ed700 con 0x7fc33014b1e0 2023-12-08T08:21:07.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.956+0000 7fc336dd1640 1 -- 172.21.15.88:0/1618184068 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc330067630 con 0x7fc33014b1e0 2023-12-08T08:21:07.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.956+0000 7fc3257fa640 1 -- 172.21.15.88:0/1618184068 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc3200135d0 con 0x7fc33014b1e0 2023-12-08T08:21:07.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.960+0000 7fc3257fa640 1 --2- 172.21.15.88:0/1618184068 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc31c066470 0x7fc31c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:07.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.960+0000 7fc3257fa640 1 -- 172.21.15.88:0/1618184068 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc320083d80 con 0x7fc33014b1e0 2023-12-08T08:21:07.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.960+0000 7fc334b6d640 1 --2- 172.21.15.88:0/1618184068 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc31c066470 0x7fc31c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:07.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.960+0000 7fc334b6d640 1 --2- 172.21.15.88:0/1618184068 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc31c066470 0x7fc31c068930 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc32c005890 tx=0x7fc32c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:07.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:07.964+0000 7fc3257fa640 1 -- 172.21.15.88:0/1618184068 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc320051210 con 0x7fc33014b1e0 2023-12-08T08:21:08.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.144+0000 7fc336dd1640 1 -- 172.21.15.88:0/1618184068 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc3300c4e10 con 0x7fc33014b1e0 2023-12-08T08:21:08.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.788+0000 7fc3257fa640 1 -- 172.21.15.88:0/1618184068 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc320054830 con 0x7fc33014b1e0 2023-12-08T08:21:08.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.792+0000 7fc336dd1640 1 -- 172.21.15.88:0/1618184068 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc31c066470 msgr2=0x7fc31c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:08.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.792+0000 7fc336dd1640 1 --2- 172.21.15.88:0/1618184068 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc31c066470 0x7fc31c068930 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc32c005890 tx=0x7fc32c009040 comp rx=0 tx=0).stop 2023-12-08T08:21:08.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.792+0000 7fc336dd1640 1 -- 172.21.15.88:0/1618184068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc33014b1e0 msgr2=0x7fc33006cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:08.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.792+0000 7fc336dd1640 1 --2- 172.21.15.88:0/1618184068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc33014b1e0 0x7fc33006cfc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc32000e9d0 tx=0x7fc32000ee90 comp rx=0 tx=0).stop 2023-12-08T08:21:08.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.792+0000 7fc336dd1640 1 -- 172.21.15.88:0/1618184068 shutdown_connections 2023-12-08T08:21:08.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.792+0000 7fc336dd1640 1 --2- 172.21.15.88:0/1618184068 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc31c066470 0x7fc31c068930 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:08.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.792+0000 7fc336dd1640 1 --2- 172.21.15.88:0/1618184068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3301548c0 0x7fc330070160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:08.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.792+0000 7fc336dd1640 1 --2- 172.21.15.88:0/1618184068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc33014b1e0 0x7fc33006cfc0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:08.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.792+0000 7fc336dd1640 1 --2- 172.21.15.88:0/1618184068 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3300c5300 0x7fc33013e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:08.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.792+0000 7fc336dd1640 1 -- 172.21.15.88:0/1618184068 >> 172.21.15.88:0/1618184068 conn(0x7fc3300c59f0 msgr2=0x7fc330149310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:08.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.792+0000 7fc336dd1640 1 -- 172.21.15.88:0/1618184068 shutdown_connections 2023-12-08T08:21:08.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.792+0000 7fc336dd1640 1 -- 172.21.15.88:0/1618184068 wait complete. 2023-12-08T08:21:08.819 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-08T08:21:08.819 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:21:08.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.952+0000 7f706bda1640 1 Processor -- start 2023-12-08T08:21:08.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.952+0000 7f706bda1640 1 -- start start 2023-12-08T08:21:08.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.952+0000 7f706bda1640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f70640af4c0 0x7f7064154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:08.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.952+0000 7f706bda1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f70640c67d0 0x7f70640c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:08.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.952+0000 7f706bda1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f706406b9f0 0x7f706406be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:08.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.952+0000 7f706bda1640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7064155460 con 0x7f70640c67d0 2023-12-08T08:21:08.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.952+0000 7f706bda1640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f706406c380 con 0x7f70640af4c0 2023-12-08T08:21:08.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.952+0000 7f706bda1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70640c4890 con 0x7f706406b9f0 2023-12-08T08:21:08.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.952+0000 7f706933c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f70640c67d0 0x7f70640c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:08.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.952+0000 7f706933c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f70640c67d0 0x7f70640c6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52174/0 (socket says 172.21.15.88:52174) 2023-12-08T08:21:08.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.952+0000 7f706933c640 1 -- 172.21.15.88:0/3098842387 learned_addr learned my addr 172.21.15.88:0/3098842387 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:08.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.952+0000 7f7069b3d640 1 --2- 172.21.15.88:0/3098842387 >> v2:172.21.15.148:3300/0 conn(0x7f70640af4c0 0x7f7064154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:08.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.952+0000 7f706a33e640 1 --2- 172.21.15.88:0/3098842387 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f706406b9f0 0x7f706406be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:08.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.952+0000 7f706933c640 1 -- 172.21.15.88:0/3098842387 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f706406b9f0 msgr2=0x7f706406be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:08.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.952+0000 7f706933c640 1 --2- 172.21.15.88:0/3098842387 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f706406b9f0 0x7f706406be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:08.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.952+0000 7f706933c640 1 -- 172.21.15.88:0/3098842387 >> v2:172.21.15.148:3300/0 conn(0x7f70640af4c0 msgr2=0x7f7064154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:08.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.952+0000 7f706933c640 1 --2- 172.21.15.88:0/3098842387 >> v2:172.21.15.148:3300/0 conn(0x7f70640af4c0 0x7f7064154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:08.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.952+0000 7f706933c640 1 -- 172.21.15.88:0/3098842387 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70640af8a0 con 0x7f70640c67d0 2023-12-08T08:21:08.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.952+0000 7f7069b3d640 1 --2- 172.21.15.88:0/3098842387 >> v2:172.21.15.148:3300/0 conn(0x7f70640af4c0 0x7f7064154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:08.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.956+0000 7f706933c640 1 --2- 172.21.15.88:0/3098842387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70640c67d0 0x7f70640c6c80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f70640a9790 tx=0x7f705401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8dd599654d705e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:08.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.956+0000 7f7068b3b640 1 -- 172.21.15.88:0/3098842387 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70540ab600 con 0x7f70640c67d0 2023-12-08T08:21:08.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.956+0000 7f7068b3b640 1 -- 172.21.15.88:0/3098842387 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70540ab760 con 0x7f70640c67d0 2023-12-08T08:21:08.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.956+0000 7f7068b3b640 1 -- 172.21.15.88:0/3098842387 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70540abaf0 con 0x7f70640c67d0 2023-12-08T08:21:08.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.956+0000 7f706bda1640 1 -- 172.21.15.88:0/3098842387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70640c67d0 msgr2=0x7f70640c6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:08.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.956+0000 7f706bda1640 1 --2- 172.21.15.88:0/3098842387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70640c67d0 0x7f70640c6c80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f70640a9790 tx=0x7f705401c440 comp rx=0 tx=0).stop 2023-12-08T08:21:08.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.956+0000 7f706bda1640 1 -- 172.21.15.88:0/3098842387 shutdown_connections 2023-12-08T08:21:08.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.956+0000 7f706bda1640 1 --2- 172.21.15.88:0/3098842387 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f706406b9f0 0x7f706406be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:08.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.956+0000 7f706bda1640 1 --2- 172.21.15.88:0/3098842387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70640c67d0 0x7f70640c6c80 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:08.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.956+0000 7f706bda1640 1 --2- 172.21.15.88:0/3098842387 >> v2:172.21.15.148:3300/0 conn(0x7f70640af4c0 0x7f7064154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:08.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.956+0000 7f706bda1640 1 -- 172.21.15.88:0/3098842387 >> 172.21.15.88:0/3098842387 conn(0x7f70640ab9d0 msgr2=0x7f70640abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:08.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.956+0000 7f706bda1640 1 -- 172.21.15.88:0/3098842387 shutdown_connections 2023-12-08T08:21:08.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.956+0000 7f706bda1640 1 -- 172.21.15.88:0/3098842387 wait complete. 2023-12-08T08:21:08.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.960+0000 7f706bda1640 1 Processor -- start 2023-12-08T08:21:08.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.960+0000 7f706bda1640 1 -- start start 2023-12-08T08:21:08.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.960+0000 7f706bda1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f706406b9f0 0x7f70641f01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:08.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.960+0000 7f706bda1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70640af4c0 0x7f70640c2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:08.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.960+0000 7f706bda1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70640c67d0 0x7f70640be240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:08.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.960+0000 7f706bda1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706415df70 con 0x7f70640c67d0 2023-12-08T08:21:08.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.960+0000 7f706bda1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70640c2940 con 0x7f70640af4c0 2023-12-08T08:21:08.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.960+0000 7f706bda1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7064150f20 con 0x7f706406b9f0 2023-12-08T08:21:08.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.960+0000 7f706a33e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70640c67d0 0x7f70640be240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:08.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.960+0000 7f706a33e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70640c67d0 0x7f70640be240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52190/0 (socket says 172.21.15.88:52190) 2023-12-08T08:21:08.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.960+0000 7f706a33e640 1 -- 172.21.15.88:0/4281964027 learned_addr learned my addr 172.21.15.88:0/4281964027 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:08.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.960+0000 7f706933c640 1 --2- 172.21.15.88:0/4281964027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70640af4c0 0x7f70640c2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:08.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.960+0000 7f7069b3d640 1 --2- 172.21.15.88:0/4281964027 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f706406b9f0 0x7f70641f01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:08.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.960+0000 7f706a33e640 1 -- 172.21.15.88:0/4281964027 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f706406b9f0 msgr2=0x7f70641f01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:08.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.960+0000 7f706a33e640 1 --2- 172.21.15.88:0/4281964027 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f706406b9f0 0x7f70641f01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:08.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.960+0000 7f706a33e640 1 -- 172.21.15.88:0/4281964027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70640af4c0 msgr2=0x7f70640c2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:08.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.960+0000 7f706a33e640 1 --2- 172.21.15.88:0/4281964027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70640af4c0 0x7f70640c2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:08.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.960+0000 7f706a33e640 1 -- 172.21.15.88:0/4281964027 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70540094d0 con 0x7f70640c67d0 2023-12-08T08:21:08.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.960+0000 7f706a33e640 1 --2- 172.21.15.88:0/4281964027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70640c67d0 0x7f70640be240 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f705c00eed0 tx=0x7f705c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:08.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.960+0000 7f705a7fc640 1 -- 172.21.15.88:0/4281964027 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c010040 con 0x7f70640c67d0 2023-12-08T08:21:08.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.960+0000 7f705a7fc640 1 -- 172.21.15.88:0/4281964027 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705c00bd20 con 0x7f70640c67d0 2023-12-08T08:21:08.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.960+0000 7f705a7fc640 1 -- 172.21.15.88:0/4281964027 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c014640 con 0x7f70640c67d0 2023-12-08T08:21:08.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.960+0000 7f706bda1640 1 -- 172.21.15.88:0/4281964027 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7064154690 con 0x7f70640c67d0 2023-12-08T08:21:08.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.960+0000 7f706bda1640 1 -- 172.21.15.88:0/4281964027 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706415dc90 con 0x7f70640c67d0 2023-12-08T08:21:08.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.964+0000 7f706bda1640 1 -- 172.21.15.88:0/4281964027 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70641514b0 con 0x7f70640c67d0 2023-12-08T08:21:08.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.964+0000 7f705a7fc640 1 -- 172.21.15.88:0/4281964027 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f705c0147a0 con 0x7f70640c67d0 2023-12-08T08:21:08.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.964+0000 7f705a7fc640 1 --2- 172.21.15.88:0/4281964027 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7048066470 0x7f7048068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:08.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.964+0000 7f705a7fc640 1 -- 172.21.15.88:0/4281964027 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f705c0842e0 con 0x7f70640c67d0 2023-12-08T08:21:08.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.964+0000 7f7069b3d640 1 --2- 172.21.15.88:0/4281964027 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7048066470 0x7f7048068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:08.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.964+0000 7f7069b3d640 1 --2- 172.21.15.88:0/4281964027 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7048066470 0x7f7048068930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f70640aa870 tx=0x7f7060008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:08.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:08.968+0000 7f705a7fc640 1 -- 172.21.15.88:0/4281964027 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f705c0518a0 con 0x7f70640c67d0 2023-12-08T08:21:09.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.148+0000 7f706bda1640 1 -- 172.21.15.88:0/4281964027 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f706415dad0 con 0x7f70640c67d0 2023-12-08T08:21:09.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.148+0000 7f705a7fc640 1 -- 172.21.15.88:0/4281964027 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f705c054ec0 con 0x7f70640c67d0 2023-12-08T08:21:09.156 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:09.156 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4978,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3372523869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3372523869},{"type":"v1","addr":"172.21.15.148:6834","nonce":3372523869}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4085245492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":4085245492},{"type":"v1","addr":"172.21.15.148:6835","nonce":4085245492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5046,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/4274252181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":4274252181},{"type":"v1","addr":"172.21.15.88:6836","nonce":4274252181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:21:05.130882+0000","modified":"2023-12-08T08:21:08.148991+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5049},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5049":{"gid":5049,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/181654220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":181654220},{"type":"v1","addr":"172.21.15.88:6837","nonce":181654220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-08T08:21:09.156 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 17 2023-12-08T08:21:09.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.152+0000 7f706bda1640 1 -- 172.21.15.88:0/4281964027 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7048066470 msgr2=0x7f7048068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:09.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.152+0000 7f706bda1640 1 --2- 172.21.15.88:0/4281964027 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7048066470 0x7f7048068930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f70640aa870 tx=0x7f7060008040 comp rx=0 tx=0).stop 2023-12-08T08:21:09.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.152+0000 7f706bda1640 1 -- 172.21.15.88:0/4281964027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70640c67d0 msgr2=0x7f70640be240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:09.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.152+0000 7f706bda1640 1 --2- 172.21.15.88:0/4281964027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70640c67d0 0x7f70640be240 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f705c00eed0 tx=0x7f705c00b480 comp rx=0 tx=0).stop 2023-12-08T08:21:09.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.152+0000 7f706bda1640 1 -- 172.21.15.88:0/4281964027 shutdown_connections 2023-12-08T08:21:09.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.152+0000 7f706bda1640 1 --2- 172.21.15.88:0/4281964027 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7048066470 0x7f7048068930 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:09.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.152+0000 7f706bda1640 1 --2- 172.21.15.88:0/4281964027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70640c67d0 0x7f70640be240 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:09.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.152+0000 7f706bda1640 1 --2- 172.21.15.88:0/4281964027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70640af4c0 0x7f70640c2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:09.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.152+0000 7f706bda1640 1 --2- 172.21.15.88:0/4281964027 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f706406b9f0 0x7f70641f01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:09.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.152+0000 7f706bda1640 1 -- 172.21.15.88:0/4281964027 >> 172.21.15.88:0/4281964027 conn(0x7f70640ab9d0 msgr2=0x7f7064156a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:09.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.152+0000 7f706bda1640 1 -- 172.21.15.88:0/4281964027 shutdown_connections 2023-12-08T08:21:09.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.152+0000 7f706bda1640 1 -- 172.21.15.88:0/4281964027 wait complete. 2023-12-08T08:21:09.177 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:21:09.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.304+0000 7f9d0113e640 1 Processor -- start 2023-12-08T08:21:09.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.304+0000 7f9d0113e640 1 -- start start 2023-12-08T08:21:09.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9d0113e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cfc071e30 0x7f9cfc072290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:09.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9d0113e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0c5710 con 0x7f9cfc156110 2023-12-08T08:21:09.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9d0113e640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc155c80 con 0x7f9cfc14fd10 2023-12-08T08:21:09.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9d0113e640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc06c5e0 con 0x7f9cfc071e30 2023-12-08T08:21:09.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9cfb59e640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9cfc156110 0x7f9cfc15ce50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:56230/0 (socket says 172.21.15.88:56230) 2023-12-08T08:21:09.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9cfb59e640 1 -- 172.21.15.88:0/3872111915 learned_addr learned my addr 172.21.15.88:0/3872111915 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:09.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9cfa59c640 1 --2- 172.21.15.88:0/3872111915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cfc071e30 0x7f9cfc072290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:09.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9cf9d9b640 1 -- 172.21.15.88:0/3872111915 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4133459574 0 0) 0x7f9cfc0c5710 con 0x7f9cfc156110 2023-12-08T08:21:09.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9cf9d9b640 1 -- 172.21.15.88:0/3872111915 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ce4003530 con 0x7f9cfc156110 2023-12-08T08:21:09.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9cf9d9b640 1 -- 172.21.15.88:0/3872111915 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2466883546 0 0) 0x7f9ce4003530 con 0x7f9cfc156110 2023-12-08T08:21:09.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9cf9d9b640 1 -- 172.21.15.88:0/3872111915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cfc071e30 msgr2=0x7f9cfc072290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:09.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9cf9d9b640 1 --2- 172.21.15.88:0/3872111915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cfc071e30 0x7f9cfc072290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:09.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9cf9d9b640 1 -- 172.21.15.88:0/3872111915 >> v1:172.21.15.148:6789/0 conn(0x7f9cfc14fd10 legacy=0x7f9cfc0a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:09.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9cf9d9b640 1 -- 172.21.15.88:0/3872111915 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc0c4e70 con 0x7f9cfc156110 2023-12-08T08:21:09.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9cf9d9b640 1 -- 172.21.15.88:0/3872111915 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f9cf4001a00 con 0x7f9cfc156110 2023-12-08T08:21:09.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9cf9d9b640 1 -- 172.21.15.88:0/3872111915 >> v1:172.21.15.88:6789/0 conn(0x7f9cfc156110 legacy=0x7f9cfc15ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:09.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9cf9d9b640 1 --2- 172.21.15.88:0/3872111915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cfc071e30 0x7f9ce40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:09.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9cf9d9b640 1 --2- 172.21.15.88:0/3872111915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ce4003ef0 0x7f9ce40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:09.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9cf9d9b640 1 --2- 172.21.15.88:0/3872111915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ce4004d10 0x7f9ce4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:09.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9cf9d9b640 1 -- 172.21.15.88:0/3872111915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce400bb50 con 0x7f9ce4003ef0 2023-12-08T08:21:09.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9cf9d9b640 1 -- 172.21.15.88:0/3872111915 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce400bcc0 con 0x7f9ce4004d10 2023-12-08T08:21:09.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9cf9d9b640 1 -- 172.21.15.88:0/3872111915 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce400be80 con 0x7f9cfc071e30 2023-12-08T08:21:09.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9cfa59c640 1 --2- 172.21.15.88:0/3872111915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ce4003ef0 0x7f9ce40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:09.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9cfad9d640 1 --2- 172.21.15.88:0/3872111915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cfc071e30 0x7f9ce40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:09.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9cfb59e640 1 --2- 172.21.15.88:0/3872111915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ce4004d10 0x7f9ce4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:09.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9cfa59c640 1 -- 172.21.15.88:0/3872111915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cfc071e30 msgr2=0x7f9ce40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:09.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9cfa59c640 1 --2- 172.21.15.88:0/3872111915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cfc071e30 0x7f9ce40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:09.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9cfa59c640 1 -- 172.21.15.88:0/3872111915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ce4004d10 msgr2=0x7f9ce4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:09.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9cfa59c640 1 --2- 172.21.15.88:0/3872111915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ce4004d10 0x7f9ce4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:09.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.308+0000 7f9cfa59c640 1 -- 172.21.15.88:0/3872111915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce4003530 con 0x7f9ce4003ef0 2023-12-08T08:21:09.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.312+0000 7f9cfa59c640 1 --2- 172.21.15.88:0/3872111915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ce4003ef0 0x7f9ce40047d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0009ae0 tx=0x7f9cf001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a479dc66e704df07 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:09.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.312+0000 7f9cf9d9b640 1 -- 172.21.15.88:0/3872111915 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf00a5610 con 0x7f9ce4003ef0 2023-12-08T08:21:09.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.312+0000 7f9cf9d9b640 1 -- 172.21.15.88:0/3872111915 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf00a5770 con 0x7f9ce4003ef0 2023-12-08T08:21:09.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.312+0000 7f9cf9d9b640 1 -- 172.21.15.88:0/3872111915 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf00a5b20 con 0x7f9ce4003ef0 2023-12-08T08:21:09.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.312+0000 7f9d0113e640 1 -- 172.21.15.88:0/3872111915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ce4003ef0 msgr2=0x7f9ce40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:09.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.312+0000 7f9d0113e640 1 --2- 172.21.15.88:0/3872111915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ce4003ef0 0x7f9ce40047d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0009ae0 tx=0x7f9cf001ca20 comp rx=0 tx=0).stop 2023-12-08T08:21:09.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.312+0000 7f9cfb59e640 1 -- 172.21.15.88:0/3872111915 reap_dead start 2023-12-08T08:21:09.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.312+0000 7f9d0113e640 1 -- 172.21.15.88:0/3872111915 shutdown_connections 2023-12-08T08:21:09.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.312+0000 7f9d0113e640 1 -- 172.21.15.88:0/3872111915 >> 172.21.15.88:0/3872111915 conn(0x7f9cfc0a7810 msgr2=0x7f9cfc0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:09.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.312+0000 7f9d0113e640 1 -- 172.21.15.88:0/3872111915 shutdown_connections 2023-12-08T08:21:09.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.312+0000 7f9d0113e640 1 -- 172.21.15.88:0/3872111915 wait complete. 2023-12-08T08:21:09.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.316+0000 7f9d0113e640 1 Processor -- start 2023-12-08T08:21:09.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.316+0000 7f9d0113e640 1 -- start start 2023-12-08T08:21:09.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.316+0000 7f9d0113e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ce4003ef0 0x7f9cfc14a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:09.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.316+0000 7f9d0113e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cfc145e20 0x7f9cfc14d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:09.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.316+0000 7f9d0113e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cfc14df20 0x7f9cfc1ef7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:09.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.316+0000 7f9d0113e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc0a7500 con 0x7f9cfc14df20 2023-12-08T08:21:09.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.316+0000 7f9d0113e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc1ee230 con 0x7f9ce4003ef0 2023-12-08T08:21:09.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.316+0000 7f9d0113e640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc14f4a0 con 0x7f9cfc145e20 2023-12-08T08:21:09.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.316+0000 7f9cfb59e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cfc14df20 0x7f9cfc1ef7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:09.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.316+0000 7f9cfb59e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cfc14df20 0x7f9cfc1ef7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52210/0 (socket says 172.21.15.88:52210) 2023-12-08T08:21:09.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.316+0000 7f9cfb59e640 1 -- 172.21.15.88:0/3334502862 learned_addr learned my addr 172.21.15.88:0/3334502862 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:09.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.316+0000 7f9cfa59c640 1 --2- 172.21.15.88:0/3334502862 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cfc145e20 0x7f9cfc14d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:09.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.316+0000 7f9cfad9d640 1 --2- 172.21.15.88:0/3334502862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ce4003ef0 0x7f9cfc14a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:09.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.316+0000 7f9cfb59e640 1 -- 172.21.15.88:0/3334502862 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cfc145e20 msgr2=0x7f9cfc14d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:09.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.316+0000 7f9cfb59e640 1 --2- 172.21.15.88:0/3334502862 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cfc145e20 0x7f9cfc14d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:09.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.316+0000 7f9cfb59e640 1 -- 172.21.15.88:0/3334502862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ce4003ef0 msgr2=0x7f9cfc14a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:09.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.316+0000 7f9cfb59e640 1 --2- 172.21.15.88:0/3334502862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ce4003ef0 0x7f9cfc14a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:09.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.316+0000 7f9cfb59e640 1 -- 172.21.15.88:0/3334502862 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc0a7220 con 0x7f9cfc14df20 2023-12-08T08:21:09.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.316+0000 7f9cfad9d640 1 --2- 172.21.15.88:0/3334502862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ce4003ef0 0x7f9cfc14a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:09.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.316+0000 7f9cfb59e640 1 --2- 172.21.15.88:0/3334502862 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cfc14df20 0x7f9cfc1ef7a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4007660 tx=0x7f9cf4007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:09.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.316+0000 7f9ce37fe640 1 -- 172.21.15.88:0/3334502862 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf400e9e0 con 0x7f9cfc14df20 2023-12-08T08:21:09.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.316+0000 7f9ce37fe640 1 -- 172.21.15.88:0/3334502862 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf400eb60 con 0x7f9cfc14df20 2023-12-08T08:21:09.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.316+0000 7f9ce37fe640 1 -- 172.21.15.88:0/3334502862 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4014430 con 0x7f9cfc14df20 2023-12-08T08:21:09.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.316+0000 7f9d0113e640 1 -- 172.21.15.88:0/3334502862 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cfc0a6190 con 0x7f9cfc14df20 2023-12-08T08:21:09.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.316+0000 7f9d0113e640 1 -- 172.21.15.88:0/3334502862 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cfc1462a0 con 0x7f9cfc14df20 2023-12-08T08:21:09.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.316+0000 7f9d0113e640 1 -- 172.21.15.88:0/3334502862 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cfc067630 con 0x7f9cfc14df20 2023-12-08T08:21:09.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.320+0000 7f9ce37fe640 1 -- 172.21.15.88:0/3334502862 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9cf4014590 con 0x7f9cfc14df20 2023-12-08T08:21:09.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.320+0000 7f9ce37fe640 1 --2- 172.21.15.88:0/3334502862 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9ce8066470 0x7f9ce8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:09.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.320+0000 7f9ce37fe640 1 -- 172.21.15.88:0/3334502862 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9cf40839a0 con 0x7f9cfc14df20 2023-12-08T08:21:09.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.320+0000 7f9cfad9d640 1 --2- 172.21.15.88:0/3334502862 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9ce8066470 0x7f9ce8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:09.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.320+0000 7f9cfad9d640 1 --2- 172.21.15.88:0/3334502862 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9ce8066470 0x7f9ce8068930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9cec000c10 tx=0x7f9cec007c60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:09.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.324+0000 7f9ce37fe640 1 -- 172.21.15.88:0/3334502862 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9cf4050ec0 con 0x7f9cfc14df20 2023-12-08T08:21:09.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.472+0000 7f9d0113e640 1 -- 172.21.15.88:0/3334502862 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cfc1ee370 con 0x7f9cfc14df20 2023-12-08T08:21:09.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.476+0000 7f9ce37fe640 1 -- 172.21.15.88:0/3334502862 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f9cf40544e0 con 0x7f9cfc14df20 2023-12-08T08:21:09.482 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:09.482 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":31,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:21:06.508444+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:21:03.690721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-08T08:21:04.127786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:21:09.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.476+0000 7f9d0113e640 1 -- 172.21.15.88:0/3334502862 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9ce8066470 msgr2=0x7f9ce8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:09.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.476+0000 7f9d0113e640 1 --2- 172.21.15.88:0/3334502862 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9ce8066470 0x7f9ce8068930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9cec000c10 tx=0x7f9cec007c60 comp rx=0 tx=0).stop 2023-12-08T08:21:09.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.476+0000 7f9d0113e640 1 -- 172.21.15.88:0/3334502862 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cfc14df20 msgr2=0x7f9cfc1ef7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:09.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.476+0000 7f9d0113e640 1 --2- 172.21.15.88:0/3334502862 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cfc14df20 0x7f9cfc1ef7a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4007660 tx=0x7f9cf4007b20 comp rx=0 tx=0).stop 2023-12-08T08:21:09.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.476+0000 7f9d0113e640 1 -- 172.21.15.88:0/3334502862 shutdown_connections 2023-12-08T08:21:09.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.476+0000 7f9d0113e640 1 --2- 172.21.15.88:0/3334502862 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9ce8066470 0x7f9ce8068930 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:09.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.476+0000 7f9d0113e640 1 --2- 172.21.15.88:0/3334502862 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9cfc14df20 0x7f9cfc1ef7a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:09.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.476+0000 7f9d0113e640 1 --2- 172.21.15.88:0/3334502862 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9cfc145e20 0x7f9cfc14d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:09.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.476+0000 7f9d0113e640 1 --2- 172.21.15.88:0/3334502862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ce4003ef0 0x7f9cfc14a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:09.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.476+0000 7f9d0113e640 1 -- 172.21.15.88:0/3334502862 >> 172.21.15.88:0/3334502862 conn(0x7f9cfc0a7810 msgr2=0x7f9cfc0c0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:09.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.476+0000 7f9d0113e640 1 -- 172.21.15.88:0/3334502862 shutdown_connections 2023-12-08T08:21:09.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.476+0000 7f9d0113e640 1 -- 172.21.15.88:0/3334502862 wait complete. 2023-12-08T08:21:09.503 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-08T08:21:09.503 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:21:09.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.632+0000 7ff90330f640 1 Processor -- start 2023-12-08T08:21:09.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.632+0000 7ff90330f640 1 -- start start 2023-12-08T08:21:09.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.636+0000 7ff90330f640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8fc14fd10 0x7ff8fc0a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:09.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.636+0000 7ff90330f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff8fc0a5300 0x7ff8fc071e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:09.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.636+0000 7ff90330f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8fc0c5710 con 0x7ff8fc072370 2023-12-08T08:21:09.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.636+0000 7ff90330f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8fc06c5e0 con 0x7ff8fc0a5300 2023-12-08T08:21:09.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.636+0000 7ff90330f640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc155c80 con 0x7ff8fc14fd10 2023-12-08T08:21:09.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.636+0000 7ff9008aa640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff8fc0a5300 0x7ff8fc071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:09.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.636+0000 7ff9018ac640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff8fc072370 0x7ff8fc156110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:56234/0 (socket says 172.21.15.88:56234) 2023-12-08T08:21:09.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.636+0000 7ff9018ac640 1 -- 172.21.15.88:0/2166275463 learned_addr learned my addr 172.21.15.88:0/2166275463 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:09.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.636+0000 7ff9010ab640 1 --2- 172.21.15.88:0/2166275463 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8fc14fd10 0x7ff8fc0a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:09.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.636+0000 7ff9008aa640 1 -- 172.21.15.88:0/2166275463 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8fc14fd10 msgr2=0x7ff8fc0a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:09.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.636+0000 7ff9008aa640 1 --2- 172.21.15.88:0/2166275463 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8fc14fd10 0x7ff8fc0a4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:09.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.636+0000 7ff9008aa640 1 -- 172.21.15.88:0/2166275463 >> v1:172.21.15.88:6789/0 conn(0x7ff8fc072370 legacy=0x7ff8fc156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:09.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.636+0000 7ff9008aa640 1 -- 172.21.15.88:0/2166275463 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8fc0c4e70 con 0x7ff8fc0a5300 2023-12-08T08:21:09.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.640+0000 7ff9008aa640 1 --2- 172.21.15.88:0/2166275463 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8fc0a5300 0x7ff8fc071e30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0097c0 tx=0x7ff8ec01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11fda53a7edf0684 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:09.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.640+0000 7ff8f3fff640 1 -- 172.21.15.88:0/2166275463 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec0ab600 con 0x7ff8fc0a5300 2023-12-08T08:21:09.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.640+0000 7ff8f3fff640 1 -- 172.21.15.88:0/2166275463 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ec0a7050 con 0x7ff8fc0a5300 2023-12-08T08:21:09.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.640+0000 7ff8f3fff640 1 -- 172.21.15.88:0/2166275463 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec0ab980 con 0x7ff8fc0a5300 2023-12-08T08:21:09.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.640+0000 7ff90330f640 1 -- 172.21.15.88:0/2166275463 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8fc0a5300 msgr2=0x7ff8fc071e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:09.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.640+0000 7ff90330f640 1 --2- 172.21.15.88:0/2166275463 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8fc0a5300 0x7ff8fc071e30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0097c0 tx=0x7ff8ec01c330 comp rx=0 tx=0).stop 2023-12-08T08:21:09.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.640+0000 7ff90330f640 1 -- 172.21.15.88:0/2166275463 shutdown_connections 2023-12-08T08:21:09.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.640+0000 7ff90330f640 1 --2- 172.21.15.88:0/2166275463 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8fc0a5300 0x7ff8fc071e30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:09.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.640+0000 7ff90330f640 1 --2- 172.21.15.88:0/2166275463 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8fc14fd10 0x7ff8fc0a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:09.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.640+0000 7ff90330f640 1 -- 172.21.15.88:0/2166275463 >> 172.21.15.88:0/2166275463 conn(0x7ff8fc0a7810 msgr2=0x7ff8fc0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:09.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.640+0000 7ff90330f640 1 -- 172.21.15.88:0/2166275463 shutdown_connections 2023-12-08T08:21:09.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.640+0000 7ff90330f640 1 -- 172.21.15.88:0/2166275463 wait complete. 2023-12-08T08:21:09.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.640+0000 7ff90330f640 1 Processor -- start 2023-12-08T08:21:09.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.640+0000 7ff90330f640 1 -- start start 2023-12-08T08:21:09.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.640+0000 7ff90330f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8fc072370 0x7ff8fc1ede40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:09.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.640+0000 7ff90330f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8fc0a5300 0x7ff8fc0708d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:09.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.640+0000 7ff90330f640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8fc14fd10 0x7ff8fc1ed1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:09.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.640+0000 7ff90330f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc1efd70 con 0x7ff8fc0a5300 2023-12-08T08:21:09.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.640+0000 7ff90330f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc1ecd20 con 0x7ff8fc072370 2023-12-08T08:21:09.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.640+0000 7ff90330f640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc156e90 con 0x7ff8fc14fd10 2023-12-08T08:21:09.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.644+0000 7ff9008aa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8fc0a5300 0x7ff8fc0708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:09.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.644+0000 7ff9008aa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8fc0a5300 0x7ff8fc0708d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52230/0 (socket says 172.21.15.88:52230) 2023-12-08T08:21:09.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.644+0000 7ff9008aa640 1 -- 172.21.15.88:0/3446357513 learned_addr learned my addr 172.21.15.88:0/3446357513 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:09.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.644+0000 7ff9018ac640 1 --2- 172.21.15.88:0/3446357513 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8fc14fd10 0x7ff8fc1ed1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:09.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.644+0000 7ff9010ab640 1 --2- 172.21.15.88:0/3446357513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8fc072370 0x7ff8fc1ede40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:09.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.644+0000 7ff9008aa640 1 -- 172.21.15.88:0/3446357513 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8fc14fd10 msgr2=0x7ff8fc1ed1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:09.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.644+0000 7ff9008aa640 1 --2- 172.21.15.88:0/3446357513 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8fc14fd10 0x7ff8fc1ed1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:09.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.644+0000 7ff9008aa640 1 -- 172.21.15.88:0/3446357513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8fc072370 msgr2=0x7ff8fc1ede40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:09.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.644+0000 7ff9008aa640 1 --2- 172.21.15.88:0/3446357513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8fc072370 0x7ff8fc1ede40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:09.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.644+0000 7ff9008aa640 1 -- 172.21.15.88:0/3446357513 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ec009420 con 0x7ff8fc0a5300 2023-12-08T08:21:09.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.644+0000 7ff9008aa640 1 --2- 172.21.15.88:0/3446357513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8fc0a5300 0x7ff8fc0708d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0ae040 tx=0x7ff8ec01ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:09.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.644+0000 7ff8f1ffb640 1 -- 172.21.15.88:0/3446357513 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec0b7650 con 0x7ff8fc0a5300 2023-12-08T08:21:09.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.644+0000 7ff8f1ffb640 1 -- 172.21.15.88:0/3446357513 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ec0abe90 con 0x7ff8fc0a5300 2023-12-08T08:21:09.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.644+0000 7ff90330f640 1 -- 172.21.15.88:0/3446357513 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8fc1ec9d0 con 0x7ff8fc0a5300 2023-12-08T08:21:09.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.644+0000 7ff8f1ffb640 1 -- 172.21.15.88:0/3446357513 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec0b7a10 con 0x7ff8fc0a5300 2023-12-08T08:21:09.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.644+0000 7ff90330f640 1 -- 172.21.15.88:0/3446357513 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8fc154d00 con 0x7ff8fc0a5300 2023-12-08T08:21:09.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.644+0000 7ff90330f640 1 -- 172.21.15.88:0/3446357513 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8fc1eceb0 con 0x7ff8fc0a5300 2023-12-08T08:21:09.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.644+0000 7ff8f1ffb640 1 -- 172.21.15.88:0/3446357513 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff8ec0b7b70 con 0x7ff8fc0a5300 2023-12-08T08:21:09.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.644+0000 7ff8f1ffb640 1 --2- 172.21.15.88:0/3446357513 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff8e00664a0 0x7ff8e0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:09.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.648+0000 7ff8f1ffb640 1 -- 172.21.15.88:0/3446357513 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8ec11e4f0 con 0x7ff8fc0a5300 2023-12-08T08:21:09.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.648+0000 7ff9010ab640 1 --2- 172.21.15.88:0/3446357513 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff8e00664a0 0x7ff8e0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:09.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.648+0000 7ff9010ab640 1 --2- 172.21.15.88:0/3446357513 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff8e00664a0 0x7ff8e0068960 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800b930 tx=0x7ff8f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:09.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.648+0000 7ff8f1ffb640 1 -- 172.21.15.88:0/3446357513 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff8ec0eb960 con 0x7ff8fc0a5300 2023-12-08T08:21:09.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.796+0000 7ff90330f640 1 -- 172.21.15.88:0/3446357513 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff8fc156820 con 0x7ff8e00664a0 2023-12-08T08:21:09.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.804+0000 7ff8f1ffb640 1 -- 172.21.15.88:0/3446357513 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264806 (secure 0 0 0) 0x7ff8f800f860 con 0x7ff8e00664a0 2023-12-08T08:21:09.815 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:09.817 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:21:09.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.808+0000 7ff90330f640 1 -- 172.21.15.88:0/3446357513 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff8e00664a0 msgr2=0x7ff8e0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:09.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.808+0000 7ff90330f640 1 --2- 172.21.15.88:0/3446357513 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff8e00664a0 0x7ff8e0068960 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800b930 tx=0x7ff8f8008040 comp rx=0 tx=0).stop 2023-12-08T08:21:09.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.808+0000 7ff90330f640 1 -- 172.21.15.88:0/3446357513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8fc0a5300 msgr2=0x7ff8fc0708d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:09.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.808+0000 7ff90330f640 1 --2- 172.21.15.88:0/3446357513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8fc0a5300 0x7ff8fc0708d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0ae040 tx=0x7ff8ec01ab70 comp rx=0 tx=0).stop 2023-12-08T08:21:09.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.808+0000 7ff90330f640 1 -- 172.21.15.88:0/3446357513 shutdown_connections 2023-12-08T08:21:09.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.808+0000 7ff90330f640 1 --2- 172.21.15.88:0/3446357513 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff8e00664a0 0x7ff8e0068960 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:09.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.808+0000 7ff90330f640 1 --2- 172.21.15.88:0/3446357513 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8fc14fd10 0x7ff8fc1ed1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:09.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.808+0000 7ff90330f640 1 --2- 172.21.15.88:0/3446357513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8fc0a5300 0x7ff8fc0708d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:09.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.808+0000 7ff90330f640 1 --2- 172.21.15.88:0/3446357513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8fc072370 0x7ff8fc1ede40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:09.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.808+0000 7ff90330f640 1 -- 172.21.15.88:0/3446357513 >> 172.21.15.88:0/3446357513 conn(0x7ff8fc0a7810 msgr2=0x7ff8fc0a5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:09.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.808+0000 7ff90330f640 1 -- 172.21.15.88:0/3446357513 shutdown_connections 2023-12-08T08:21:09.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:09.808+0000 7ff90330f640 1 -- 172.21.15.88:0/3446357513 wait complete. 2023-12-08T08:21:09.835 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-12-08T08:21:08.757275+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":101,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219096,"kb_used_data":2912,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755624,"statfs":{"total":773094113280,"available":772869758976,"internally_reserved":0,"allocated":2981888,"data_stored":2258372,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.012608"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822861+0000","last_change":"2023-12-08T08:21:05.540661+0000","last_active":"2023-12-08T08:21:06.822861+0000","last_peered":"2023-12-08T08:21:06.822861+0000","last_clean":"2023-12-08T08:21:06.822861+0000","last_became_active":"2023-12-08T08:21:05.539125+0000","last_became_peered":"2023-12-08T08:21:05.539125+0000","last_unstale":"2023-12-08T08:21:06.822861+0000","last_undegraded":"2023-12-08T08:21:06.822861+0000","last_fullsized":"2023-12-08T08:21:06.822861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:58:23.887952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821904+0000","last_change":"2023-12-08T08:21:05.527659+0000","last_active":"2023-12-08T08:21:06.821904+0000","last_peered":"2023-12-08T08:21:06.821904+0000","last_clean":"2023-12-08T08:21:06.821904+0000","last_became_active":"2023-12-08T08:21:05.527361+0000","last_became_peered":"2023-12-08T08:21:05.527361+0000","last_unstale":"2023-12-08T08:21:06.821904+0000","last_undegraded":"2023-12-08T08:21:06.821904+0000","last_fullsized":"2023-12-08T08:21:06.821904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:49.782105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822316+0000","last_change":"2023-12-08T08:21:05.534658+0000","last_active":"2023-12-08T08:21:06.822316+0000","last_peered":"2023-12-08T08:21:06.822316+0000","last_clean":"2023-12-08T08:21:06.822316+0000","last_became_active":"2023-12-08T08:21:05.534383+0000","last_became_peered":"2023-12-08T08:21:05.534383+0000","last_unstale":"2023-12-08T08:21:06.822316+0000","last_undegraded":"2023-12-08T08:21:06.822316+0000","last_fullsized":"2023-12-08T08:21:06.822316+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.368162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820745+0000","last_change":"2023-12-08T08:21:05.528111+0000","last_active":"2023-12-08T08:21:06.820745+0000","last_peered":"2023-12-08T08:21:06.820745+0000","last_clean":"2023-12-08T08:21:06.820745+0000","last_became_active":"2023-12-08T08:21:05.527809+0000","last_became_peered":"2023-12-08T08:21:05.527809+0000","last_unstale":"2023-12-08T08:21:06.820745+0000","last_undegraded":"2023-12-08T08:21:06.820745+0000","last_fullsized":"2023-12-08T08:21:06.820745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:51.183842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820248+0000","last_change":"2023-12-08T08:21:05.532561+0000","last_active":"2023-12-08T08:21:06.820248+0000","last_peered":"2023-12-08T08:21:06.820248+0000","last_clean":"2023-12-08T08:21:06.820248+0000","last_became_active":"2023-12-08T08:21:05.532254+0000","last_became_peered":"2023-12-08T08:21:05.532254+0000","last_unstale":"2023-12-08T08:21:06.820248+0000","last_undegraded":"2023-12-08T08:21:06.820248+0000","last_fullsized":"2023-12-08T08:21:06.820248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:30:51.157799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820070+0000","last_change":"2023-12-08T08:21:05.543535+0000","last_active":"2023-12-08T08:21:06.820070+0000","last_peered":"2023-12-08T08:21:06.820070+0000","last_clean":"2023-12-08T08:21:06.820070+0000","last_became_active":"2023-12-08T08:21:05.543244+0000","last_became_peered":"2023-12-08T08:21:05.543244+0000","last_unstale":"2023-12-08T08:21:06.820070+0000","last_undegraded":"2023-12-08T08:21:06.820070+0000","last_fullsized":"2023-12-08T08:21:06.820070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:20:39.875619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822061+0000","last_change":"2023-12-08T08:21:05.534310+0000","last_active":"2023-12-08T08:21:06.822061+0000","last_peered":"2023-12-08T08:21:06.822061+0000","last_clean":"2023-12-08T08:21:06.822061+0000","last_became_active":"2023-12-08T08:21:05.534003+0000","last_became_peered":"2023-12-08T08:21:05.534003+0000","last_unstale":"2023-12-08T08:21:06.822061+0000","last_undegraded":"2023-12-08T08:21:06.822061+0000","last_fullsized":"2023-12-08T08:21:06.822061+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:49.782105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821469+0000","last_change":"2023-12-08T08:21:05.537523+0000","last_active":"2023-12-08T08:21:06.821469+0000","last_peered":"2023-12-08T08:21:06.821469+0000","last_clean":"2023-12-08T08:21:06.821469+0000","last_became_active":"2023-12-08T08:21:05.537263+0000","last_became_peered":"2023-12-08T08:21:05.537263+0000","last_unstale":"2023-12-08T08:21:06.821469+0000","last_undegraded":"2023-12-08T08:21:06.821469+0000","last_fullsized":"2023-12-08T08:21:06.821469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:08.596525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.516301+0000","last_change":"2023-12-08T08:21:05.525741+0000","last_active":"2023-12-08T08:21:06.516301+0000","last_peered":"2023-12-08T08:21:06.516301+0000","last_clean":"2023-12-08T08:21:06.516301+0000","last_became_active":"2023-12-08T08:21:05.525406+0000","last_became_peered":"2023-12-08T08:21:05.525406+0000","last_unstale":"2023-12-08T08:21:06.516301+0000","last_undegraded":"2023-12-08T08:21:06.516301+0000","last_fullsized":"2023-12-08T08:21:06.516301+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:08.596525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821305+0000","last_change":"2023-12-08T08:21:05.533444+0000","last_active":"2023-12-08T08:21:06.821305+0000","last_peered":"2023-12-08T08:21:06.821305+0000","last_clean":"2023-12-08T08:21:06.821305+0000","last_became_active":"2023-12-08T08:21:05.533146+0000","last_became_peered":"2023-12-08T08:21:05.533146+0000","last_unstale":"2023-12-08T08:21:06.821305+0000","last_undegraded":"2023-12-08T08:21:06.821305+0000","last_fullsized":"2023-12-08T08:21:06.821305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:14:18.284764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821785+0000","last_change":"2023-12-08T08:21:05.536252+0000","last_active":"2023-12-08T08:21:06.821785+0000","last_peered":"2023-12-08T08:21:06.821785+0000","last_clean":"2023-12-08T08:21:06.821785+0000","last_became_active":"2023-12-08T08:21:05.535964+0000","last_became_peered":"2023-12-08T08:21:05.535964+0000","last_unstale":"2023-12-08T08:21:06.821785+0000","last_undegraded":"2023-12-08T08:21:06.821785+0000","last_fullsized":"2023-12-08T08:21:06.821785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:30.973295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822212+0000","last_change":"2023-12-08T08:21:05.540446+0000","last_active":"2023-12-08T08:21:06.822212+0000","last_peered":"2023-12-08T08:21:06.822212+0000","last_clean":"2023-12-08T08:21:06.822212+0000","last_became_active":"2023-12-08T08:21:05.540024+0000","last_became_peered":"2023-12-08T08:21:05.540024+0000","last_unstale":"2023-12-08T08:21:06.822212+0000","last_undegraded":"2023-12-08T08:21:06.822212+0000","last_fullsized":"2023-12-08T08:21:06.822212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:59:00.606587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820269+0000","last_change":"2023-12-08T08:21:05.530318+0000","last_active":"2023-12-08T08:21:06.820269+0000","last_peered":"2023-12-08T08:21:06.820269+0000","last_clean":"2023-12-08T08:21:06.820269+0000","last_became_active":"2023-12-08T08:21:05.529990+0000","last_became_peered":"2023-12-08T08:21:05.529990+0000","last_unstale":"2023-12-08T08:21:06.820269+0000","last_undegraded":"2023-12-08T08:21:06.820269+0000","last_fullsized":"2023-12-08T08:21:06.820269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:54:39.738546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820200+0000","last_change":"2023-12-08T08:21:05.527949+0000","last_active":"2023-12-08T08:21:06.820200+0000","last_peered":"2023-12-08T08:21:06.820200+0000","last_clean":"2023-12-08T08:21:06.820200+0000","last_became_active":"2023-12-08T08:21:05.527215+0000","last_became_peered":"2023-12-08T08:21:05.527215+0000","last_unstale":"2023-12-08T08:21:06.820200+0000","last_undegraded":"2023-12-08T08:21:06.820200+0000","last_fullsized":"2023-12-08T08:21:06.820200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:25.239396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821789+0000","last_change":"2023-12-08T08:21:05.529395+0000","last_active":"2023-12-08T08:21:06.821789+0000","last_peered":"2023-12-08T08:21:06.821789+0000","last_clean":"2023-12-08T08:21:06.821789+0000","last_became_active":"2023-12-08T08:21:05.529089+0000","last_became_peered":"2023-12-08T08:21:05.529089+0000","last_unstale":"2023-12-08T08:21:06.821789+0000","last_undegraded":"2023-12-08T08:21:06.821789+0000","last_fullsized":"2023-12-08T08:21:06.821789+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:43.021591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821879+0000","last_change":"2023-12-08T08:21:05.535656+0000","last_active":"2023-12-08T08:21:06.821879+0000","last_peered":"2023-12-08T08:21:06.821879+0000","last_clean":"2023-12-08T08:21:06.821879+0000","last_became_active":"2023-12-08T08:21:05.535310+0000","last_became_peered":"2023-12-08T08:21:05.535310+0000","last_unstale":"2023-12-08T08:21:06.821879+0000","last_undegraded":"2023-12-08T08:21:06.821879+0000","last_fullsized":"2023-12-08T08:21:06.821879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:09:56.356105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822294+0000","last_change":"2023-12-08T08:21:05.532053+0000","last_active":"2023-12-08T08:21:06.822294+0000","last_peered":"2023-12-08T08:21:06.822294+0000","last_clean":"2023-12-08T08:21:06.822294+0000","last_became_active":"2023-12-08T08:21:05.531799+0000","last_became_peered":"2023-12-08T08:21:05.531799+0000","last_unstale":"2023-12-08T08:21:06.822294+0000","last_undegraded":"2023-12-08T08:21:06.822294+0000","last_fullsized":"2023-12-08T08:21:06.822294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:05.968004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821923+0000","last_change":"2023-12-08T08:21:05.530770+0000","last_active":"2023-12-08T08:21:06.821923+0000","last_peered":"2023-12-08T08:21:06.821923+0000","last_clean":"2023-12-08T08:21:06.821923+0000","last_became_active":"2023-12-08T08:21:05.530517+0000","last_became_peered":"2023-12-08T08:21:05.530517+0000","last_unstale":"2023-12-08T08:21:06.821923+0000","last_undegraded":"2023-12-08T08:21:06.821923+0000","last_fullsized":"2023-12-08T08:21:06.821923+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:05.968004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821636+0000","last_change":"2023-12-08T08:21:05.525566+0000","last_active":"2023-12-08T08:21:06.821636+0000","last_peered":"2023-12-08T08:21:06.821636+0000","last_clean":"2023-12-08T08:21:06.821636+0000","last_became_active":"2023-12-08T08:21:05.525251+0000","last_became_peered":"2023-12-08T08:21:05.525251+0000","last_unstale":"2023-12-08T08:21:06.821636+0000","last_undegraded":"2023-12-08T08:21:06.821636+0000","last_fullsized":"2023-12-08T08:21:06.821636+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:09:56.356105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821458+0000","last_change":"2023-12-08T08:21:05.538014+0000","last_active":"2023-12-08T08:21:06.821458+0000","last_peered":"2023-12-08T08:21:06.821458+0000","last_clean":"2023-12-08T08:21:06.821458+0000","last_became_active":"2023-12-08T08:21:05.537721+0000","last_became_peered":"2023-12-08T08:21:05.537721+0000","last_unstale":"2023-12-08T08:21:06.821458+0000","last_undegraded":"2023-12-08T08:21:06.821458+0000","last_fullsized":"2023-12-08T08:21:06.821458+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:30.813093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.515531+0000","last_change":"2023-12-08T08:21:05.523783+0000","last_active":"2023-12-08T08:21:06.515531+0000","last_peered":"2023-12-08T08:21:06.515531+0000","last_clean":"2023-12-08T08:21:06.515531+0000","last_became_active":"2023-12-08T08:21:05.523509+0000","last_became_peered":"2023-12-08T08:21:05.523509+0000","last_unstale":"2023-12-08T08:21:06.515531+0000","last_undegraded":"2023-12-08T08:21:06.515531+0000","last_fullsized":"2023-12-08T08:21:06.515531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:11.477913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.515696+0000","last_change":"2023-12-08T08:21:05.529673+0000","last_active":"2023-12-08T08:21:06.515696+0000","last_peered":"2023-12-08T08:21:06.515696+0000","last_clean":"2023-12-08T08:21:06.515696+0000","last_became_active":"2023-12-08T08:21:05.528239+0000","last_became_peered":"2023-12-08T08:21:05.528239+0000","last_unstale":"2023-12-08T08:21:06.515696+0000","last_undegraded":"2023-12-08T08:21:06.515696+0000","last_fullsized":"2023-12-08T08:21:06.515696+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:19.928543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.513502+0000","last_change":"2023-12-08T08:21:05.534953+0000","last_active":"2023-12-08T08:21:06.513502+0000","last_peered":"2023-12-08T08:21:06.513502+0000","last_clean":"2023-12-08T08:21:06.513502+0000","last_became_active":"2023-12-08T08:21:05.531291+0000","last_became_peered":"2023-12-08T08:21:05.531291+0000","last_unstale":"2023-12-08T08:21:06.513502+0000","last_undegraded":"2023-12-08T08:21:06.513502+0000","last_fullsized":"2023-12-08T08:21:06.513502+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:47.419331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821931+0000","last_change":"2023-12-08T08:21:05.535454+0000","last_active":"2023-12-08T08:21:06.821931+0000","last_peered":"2023-12-08T08:21:06.821931+0000","last_clean":"2023-12-08T08:21:06.821931+0000","last_became_active":"2023-12-08T08:21:05.535095+0000","last_became_peered":"2023-12-08T08:21:05.535095+0000","last_unstale":"2023-12-08T08:21:06.821931+0000","last_undegraded":"2023-12-08T08:21:06.821931+0000","last_fullsized":"2023-12-08T08:21:06.821931+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:50:53.654615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821180+0000","last_change":"2023-12-08T08:21:05.531201+0000","last_active":"2023-12-08T08:21:06.821180+0000","last_peered":"2023-12-08T08:21:06.821180+0000","last_clean":"2023-12-08T08:21:06.821180+0000","last_became_active":"2023-12-08T08:21:05.530935+0000","last_became_peered":"2023-12-08T08:21:05.530935+0000","last_unstale":"2023-12-08T08:21:06.821180+0000","last_undegraded":"2023-12-08T08:21:06.821180+0000","last_fullsized":"2023-12-08T08:21:06.821180+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:37.538055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822029+0000","last_change":"2023-12-08T08:21:05.532516+0000","last_active":"2023-12-08T08:21:06.822029+0000","last_peered":"2023-12-08T08:21:06.822029+0000","last_clean":"2023-12-08T08:21:06.822029+0000","last_became_active":"2023-12-08T08:21:05.531827+0000","last_became_peered":"2023-12-08T08:21:05.531827+0000","last_unstale":"2023-12-08T08:21:06.822029+0000","last_undegraded":"2023-12-08T08:21:06.822029+0000","last_fullsized":"2023-12-08T08:21:06.822029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:49:59.047557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821259+0000","last_change":"2023-12-08T08:21:05.538170+0000","last_active":"2023-12-08T08:21:06.821259+0000","last_peered":"2023-12-08T08:21:06.821259+0000","last_clean":"2023-12-08T08:21:06.821259+0000","last_became_active":"2023-12-08T08:21:05.537834+0000","last_became_peered":"2023-12-08T08:21:05.537834+0000","last_unstale":"2023-12-08T08:21:06.821259+0000","last_undegraded":"2023-12-08T08:21:06.821259+0000","last_fullsized":"2023-12-08T08:21:06.821259+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:23.756612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822339+0000","last_change":"2023-12-08T08:21:05.538326+0000","last_active":"2023-12-08T08:21:06.822339+0000","last_peered":"2023-12-08T08:21:06.822339+0000","last_clean":"2023-12-08T08:21:06.822339+0000","last_became_active":"2023-12-08T08:21:05.538042+0000","last_became_peered":"2023-12-08T08:21:05.538042+0000","last_unstale":"2023-12-08T08:21:06.822339+0000","last_undegraded":"2023-12-08T08:21:06.822339+0000","last_fullsized":"2023-12-08T08:21:06.822339+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:30.973295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.515717+0000","last_change":"2023-12-08T08:21:05.531803+0000","last_active":"2023-12-08T08:21:06.515717+0000","last_peered":"2023-12-08T08:21:06.515717+0000","last_clean":"2023-12-08T08:21:06.515717+0000","last_became_active":"2023-12-08T08:21:05.531470+0000","last_became_peered":"2023-12-08T08:21:05.531470+0000","last_unstale":"2023-12-08T08:21:06.515717+0000","last_undegraded":"2023-12-08T08:21:06.515717+0000","last_fullsized":"2023-12-08T08:21:06.515717+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:37.538055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821529+0000","last_change":"2023-12-08T08:21:05.530432+0000","last_active":"2023-12-08T08:21:06.821529+0000","last_peered":"2023-12-08T08:21:06.821529+0000","last_clean":"2023-12-08T08:21:06.821529+0000","last_became_active":"2023-12-08T08:21:05.530065+0000","last_became_peered":"2023-12-08T08:21:05.530065+0000","last_unstale":"2023-12-08T08:21:06.821529+0000","last_undegraded":"2023-12-08T08:21:06.821529+0000","last_fullsized":"2023-12-08T08:21:06.821529+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:43.021591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822464+0000","last_change":"2023-12-08T08:21:05.532086+0000","last_active":"2023-12-08T08:21:06.822464+0000","last_peered":"2023-12-08T08:21:06.822464+0000","last_clean":"2023-12-08T08:21:06.822464+0000","last_became_active":"2023-12-08T08:21:05.531583+0000","last_became_peered":"2023-12-08T08:21:05.531583+0000","last_unstale":"2023-12-08T08:21:06.822464+0000","last_undegraded":"2023-12-08T08:21:06.822464+0000","last_fullsized":"2023-12-08T08:21:06.822464+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:13.936073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821617+0000","last_change":"2023-12-08T08:21:05.539808+0000","last_active":"2023-12-08T08:21:06.821617+0000","last_peered":"2023-12-08T08:21:06.821617+0000","last_clean":"2023-12-08T08:21:06.821617+0000","last_became_active":"2023-12-08T08:21:05.539443+0000","last_became_peered":"2023-12-08T08:21:05.539443+0000","last_unstale":"2023-12-08T08:21:06.821617+0000","last_undegraded":"2023-12-08T08:21:06.821617+0000","last_fullsized":"2023-12-08T08:21:06.821617+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:20:39.875619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.513768+0000","last_change":"2023-12-08T08:21:05.532180+0000","last_active":"2023-12-08T08:21:06.513768+0000","last_peered":"2023-12-08T08:21:06.513768+0000","last_clean":"2023-12-08T08:21:06.513768+0000","last_became_active":"2023-12-08T08:21:05.529640+0000","last_became_peered":"2023-12-08T08:21:05.529640+0000","last_unstale":"2023-12-08T08:21:06.513768+0000","last_undegraded":"2023-12-08T08:21:06.513768+0000","last_fullsized":"2023-12-08T08:21:06.513768+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:11.477913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.823085+0000","last_change":"2023-12-08T08:21:04.777030+0000","last_active":"2023-12-08T08:21:06.823085+0000","last_peered":"2023-12-08T08:21:06.823085+0000","last_clean":"2023-12-08T08:21:06.823085+0000","last_became_active":"2023-12-08T08:21:04.775911+0000","last_became_peered":"2023-12-08T08:21:04.775911+0000","last_unstale":"2023-12-08T08:21:06.823085+0000","last_undegraded":"2023-12-08T08:21:06.823085+0000","last_fullsized":"2023-12-08T08:21:06.823085+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:29.810210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822992+0000","last_change":"2023-12-08T08:21:05.531374+0000","last_active":"2023-12-08T08:21:06.822992+0000","last_peered":"2023-12-08T08:21:06.822992+0000","last_clean":"2023-12-08T08:21:06.822992+0000","last_became_active":"2023-12-08T08:21:05.531104+0000","last_became_peered":"2023-12-08T08:21:05.531104+0000","last_unstale":"2023-12-08T08:21:06.822992+0000","last_undegraded":"2023-12-08T08:21:06.822992+0000","last_fullsized":"2023-12-08T08:21:06.822992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:04.403116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.513760+0000","last_change":"2023-12-08T08:21:04.780684+0000","last_active":"2023-12-08T08:21:06.513760+0000","last_peered":"2023-12-08T08:21:06.513760+0000","last_clean":"2023-12-08T08:21:06.513760+0000","last_became_active":"2023-12-08T08:21:04.780321+0000","last_became_peered":"2023-12-08T08:21:04.780321+0000","last_unstale":"2023-12-08T08:21:06.513760+0000","last_undegraded":"2023-12-08T08:21:06.513760+0000","last_fullsized":"2023-12-08T08:21:06.513760+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:13.006406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.515801+0000","last_change":"2023-12-08T08:21:05.532257+0000","last_active":"2023-12-08T08:21:06.515801+0000","last_peered":"2023-12-08T08:21:06.515801+0000","last_clean":"2023-12-08T08:21:06.515801+0000","last_became_active":"2023-12-08T08:21:05.531965+0000","last_became_peered":"2023-12-08T08:21:05.531965+0000","last_unstale":"2023-12-08T08:21:06.515801+0000","last_undegraded":"2023-12-08T08:21:06.515801+0000","last_fullsized":"2023-12-08T08:21:06.515801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:23.756612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821679+0000","last_change":"2023-12-08T08:21:04.778223+0000","last_active":"2023-12-08T08:21:06.821679+0000","last_peered":"2023-12-08T08:21:06.821679+0000","last_clean":"2023-12-08T08:21:06.821679+0000","last_became_active":"2023-12-08T08:21:04.777902+0000","last_became_peered":"2023-12-08T08:21:04.777902+0000","last_unstale":"2023-12-08T08:21:06.821679+0000","last_undegraded":"2023-12-08T08:21:06.821679+0000","last_fullsized":"2023-12-08T08:21:06.821679+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:07.593642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821325+0000","last_change":"2023-12-08T08:21:05.527749+0000","last_active":"2023-12-08T08:21:06.821325+0000","last_peered":"2023-12-08T08:21:06.821325+0000","last_clean":"2023-12-08T08:21:06.821325+0000","last_became_active":"2023-12-08T08:21:05.527397+0000","last_became_peered":"2023-12-08T08:21:05.527397+0000","last_unstale":"2023-12-08T08:21:06.821325+0000","last_undegraded":"2023-12-08T08:21:06.821325+0000","last_fullsized":"2023-12-08T08:21:06.821325+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:13.692096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821541+0000","last_change":"2023-12-08T08:21:04.773475+0000","last_active":"2023-12-08T08:21:06.821541+0000","last_peered":"2023-12-08T08:21:06.821541+0000","last_clean":"2023-12-08T08:21:06.821541+0000","last_became_active":"2023-12-08T08:21:04.773125+0000","last_became_peered":"2023-12-08T08:21:04.773125+0000","last_unstale":"2023-12-08T08:21:06.821541+0000","last_undegraded":"2023-12-08T08:21:06.821541+0000","last_fullsized":"2023-12-08T08:21:06.821541+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:00:34.107681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821564+0000","last_change":"2023-12-08T08:21:05.542808+0000","last_active":"2023-12-08T08:21:06.821564+0000","last_peered":"2023-12-08T08:21:06.821564+0000","last_clean":"2023-12-08T08:21:06.821564+0000","last_became_active":"2023-12-08T08:21:05.542495+0000","last_became_peered":"2023-12-08T08:21:05.542495+0000","last_unstale":"2023-12-08T08:21:06.821564+0000","last_undegraded":"2023-12-08T08:21:06.821564+0000","last_fullsized":"2023-12-08T08:21:06.821564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:50:53.654615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.515785+0000","last_change":"2023-12-08T08:21:04.784944+0000","last_active":"2023-12-08T08:21:06.515785+0000","last_peered":"2023-12-08T08:21:06.515785+0000","last_clean":"2023-12-08T08:21:06.515785+0000","last_became_active":"2023-12-08T08:21:04.784657+0000","last_became_peered":"2023-12-08T08:21:04.784657+0000","last_unstale":"2023-12-08T08:21:06.515785+0000","last_undegraded":"2023-12-08T08:21:06.515785+0000","last_fullsized":"2023-12-08T08:21:06.515785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:51:05.330323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821336+0000","last_change":"2023-12-08T08:21:05.537414+0000","last_active":"2023-12-08T08:21:06.821336+0000","last_peered":"2023-12-08T08:21:06.821336+0000","last_clean":"2023-12-08T08:21:06.821336+0000","last_became_active":"2023-12-08T08:21:05.537137+0000","last_became_peered":"2023-12-08T08:21:05.537137+0000","last_unstale":"2023-12-08T08:21:06.821336+0000","last_undegraded":"2023-12-08T08:21:06.821336+0000","last_fullsized":"2023-12-08T08:21:06.821336+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:08.596525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.515748+0000","last_change":"2023-12-08T08:21:04.783596+0000","last_active":"2023-12-08T08:21:06.515748+0000","last_peered":"2023-12-08T08:21:06.515748+0000","last_clean":"2023-12-08T08:21:06.515748+0000","last_became_active":"2023-12-08T08:21:04.783159+0000","last_became_peered":"2023-12-08T08:21:04.783159+0000","last_unstale":"2023-12-08T08:21:06.515748+0000","last_undegraded":"2023-12-08T08:21:06.515748+0000","last_fullsized":"2023-12-08T08:21:06.515748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:43.027429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.515966+0000","last_change":"2023-12-08T08:21:05.535708+0000","last_active":"2023-12-08T08:21:06.515966+0000","last_peered":"2023-12-08T08:21:06.515966+0000","last_clean":"2023-12-08T08:21:06.515966+0000","last_became_active":"2023-12-08T08:21:05.527959+0000","last_became_peered":"2023-12-08T08:21:05.527959+0000","last_unstale":"2023-12-08T08:21:06.515966+0000","last_undegraded":"2023-12-08T08:21:06.515966+0000","last_fullsized":"2023-12-08T08:21:06.515966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:14:18.284764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820625+0000","last_change":"2023-12-08T08:21:04.780723+0000","last_active":"2023-12-08T08:21:06.820625+0000","last_peered":"2023-12-08T08:21:06.820625+0000","last_clean":"2023-12-08T08:21:06.820625+0000","last_became_active":"2023-12-08T08:21:04.780436+0000","last_became_peered":"2023-12-08T08:21:04.780436+0000","last_unstale":"2023-12-08T08:21:06.820625+0000","last_undegraded":"2023-12-08T08:21:06.820625+0000","last_fullsized":"2023-12-08T08:21:06.820625+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:12.689213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820421+0000","last_change":"2023-12-08T08:21:05.536397+0000","last_active":"2023-12-08T08:21:06.820421+0000","last_peered":"2023-12-08T08:21:06.820421+0000","last_clean":"2023-12-08T08:21:06.820421+0000","last_became_active":"2023-12-08T08:21:05.536103+0000","last_became_peered":"2023-12-08T08:21:05.536103+0000","last_unstale":"2023-12-08T08:21:06.820421+0000","last_undegraded":"2023-12-08T08:21:06.820421+0000","last_fullsized":"2023-12-08T08:21:06.820421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:44.030312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.515912+0000","last_change":"2023-12-08T08:21:04.776553+0000","last_active":"2023-12-08T08:21:06.515912+0000","last_peered":"2023-12-08T08:21:06.515912+0000","last_clean":"2023-12-08T08:21:06.515912+0000","last_became_active":"2023-12-08T08:21:04.773755+0000","last_became_peered":"2023-12-08T08:21:04.773755+0000","last_unstale":"2023-12-08T08:21:06.515912+0000","last_undegraded":"2023-12-08T08:21:06.515912+0000","last_fullsized":"2023-12-08T08:21:06.515912+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:12.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822282+0000","last_change":"2023-12-08T08:21:05.533947+0000","last_active":"2023-12-08T08:21:06.822282+0000","last_peered":"2023-12-08T08:21:06.822282+0000","last_clean":"2023-12-08T08:21:06.822282+0000","last_became_active":"2023-12-08T08:21:05.533554+0000","last_became_peered":"2023-12-08T08:21:05.533554+0000","last_unstale":"2023-12-08T08:21:06.822282+0000","last_undegraded":"2023-12-08T08:21:06.822282+0000","last_fullsized":"2023-12-08T08:21:06.822282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:25.239396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821990+0000","last_change":"2023-12-08T08:21:04.782800+0000","last_active":"2023-12-08T08:21:06.821990+0000","last_peered":"2023-12-08T08:21:06.821990+0000","last_clean":"2023-12-08T08:21:06.821990+0000","last_became_active":"2023-12-08T08:21:04.782531+0000","last_became_peered":"2023-12-08T08:21:04.782531+0000","last_unstale":"2023-12-08T08:21:06.821990+0000","last_undegraded":"2023-12-08T08:21:06.821990+0000","last_fullsized":"2023-12-08T08:21:06.821990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:42.018708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821965+0000","last_change":"2023-12-08T08:21:05.532644+0000","last_active":"2023-12-08T08:21:06.821965+0000","last_peered":"2023-12-08T08:21:06.821965+0000","last_clean":"2023-12-08T08:21:06.821965+0000","last_became_active":"2023-12-08T08:21:05.530404+0000","last_became_peered":"2023-12-08T08:21:05.530404+0000","last_unstale":"2023-12-08T08:21:06.821965+0000","last_undegraded":"2023-12-08T08:21:06.821965+0000","last_fullsized":"2023-12-08T08:21:06.821965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:05:11.193024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.513905+0000","last_change":"2023-12-08T08:21:04.786064+0000","last_active":"2023-12-08T08:21:06.513905+0000","last_peered":"2023-12-08T08:21:06.513905+0000","last_clean":"2023-12-08T08:21:06.513905+0000","last_became_active":"2023-12-08T08:21:04.785859+0000","last_became_peered":"2023-12-08T08:21:04.785859+0000","last_unstale":"2023-12-08T08:21:06.513905+0000","last_undegraded":"2023-12-08T08:21:06.513905+0000","last_fullsized":"2023-12-08T08:21:06.513905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:12.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821392+0000","last_change":"2023-12-08T08:21:05.532372+0000","last_active":"2023-12-08T08:21:06.821392+0000","last_peered":"2023-12-08T08:21:06.821392+0000","last_clean":"2023-12-08T08:21:06.821392+0000","last_became_active":"2023-12-08T08:21:05.531767+0000","last_became_peered":"2023-12-08T08:21:05.531767+0000","last_unstale":"2023-12-08T08:21:06.821392+0000","last_undegraded":"2023-12-08T08:21:06.821392+0000","last_fullsized":"2023-12-08T08:21:06.821392+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:30.973295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822403+0000","last_change":"2023-12-08T08:21:04.782195+0000","last_active":"2023-12-08T08:21:06.822403+0000","last_peered":"2023-12-08T08:21:06.822403+0000","last_clean":"2023-12-08T08:21:06.822403+0000","last_became_active":"2023-12-08T08:21:04.781298+0000","last_became_peered":"2023-12-08T08:21:04.781298+0000","last_unstale":"2023-12-08T08:21:06.822403+0000","last_undegraded":"2023-12-08T08:21:06.822403+0000","last_fullsized":"2023-12-08T08:21:06.822403+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:12.689213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822176+0000","last_change":"2023-12-08T08:21:05.540670+0000","last_active":"2023-12-08T08:21:06.822176+0000","last_peered":"2023-12-08T08:21:06.822176+0000","last_clean":"2023-12-08T08:21:06.822176+0000","last_became_active":"2023-12-08T08:21:05.539546+0000","last_became_peered":"2023-12-08T08:21:05.539546+0000","last_unstale":"2023-12-08T08:21:06.822176+0000","last_undegraded":"2023-12-08T08:21:06.822176+0000","last_fullsized":"2023-12-08T08:21:06.822176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:20:39.875619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821529+0000","last_change":"2023-12-08T08:21:04.778814+0000","last_active":"2023-12-08T08:21:06.821529+0000","last_peered":"2023-12-08T08:21:06.821529+0000","last_clean":"2023-12-08T08:21:06.821529+0000","last_became_active":"2023-12-08T08:21:04.778501+0000","last_became_peered":"2023-12-08T08:21:04.778501+0000","last_unstale":"2023-12-08T08:21:06.821529+0000","last_undegraded":"2023-12-08T08:21:06.821529+0000","last_fullsized":"2023-12-08T08:21:06.821529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:50:52.651732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820851+0000","last_change":"2023-12-08T08:21:05.543017+0000","last_active":"2023-12-08T08:21:06.820851+0000","last_peered":"2023-12-08T08:21:06.820851+0000","last_clean":"2023-12-08T08:21:06.820851+0000","last_became_active":"2023-12-08T08:21:05.542729+0000","last_became_peered":"2023-12-08T08:21:05.542729+0000","last_unstale":"2023-12-08T08:21:06.820851+0000","last_undegraded":"2023-12-08T08:21:06.820851+0000","last_fullsized":"2023-12-08T08:21:06.820851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:19.928543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.515842+0000","last_change":"2023-12-08T08:21:04.773643+0000","last_active":"2023-12-08T08:21:06.515842+0000","last_peered":"2023-12-08T08:21:06.515842+0000","last_clean":"2023-12-08T08:21:06.515842+0000","last_became_active":"2023-12-08T08:21:04.773361+0000","last_became_peered":"2023-12-08T08:21:04.773361+0000","last_unstale":"2023-12-08T08:21:06.515842+0000","last_undegraded":"2023-12-08T08:21:06.515842+0000","last_fullsized":"2023-12-08T08:21:06.515842+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:08.017533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820409+0000","last_change":"2023-12-08T08:21:05.528470+0000","last_active":"2023-12-08T08:21:06.820409+0000","last_peered":"2023-12-08T08:21:06.820409+0000","last_clean":"2023-12-08T08:21:06.820409+0000","last_became_active":"2023-12-08T08:21:05.528125+0000","last_became_peered":"2023-12-08T08:21:05.528125+0000","last_unstale":"2023-12-08T08:21:06.820409+0000","last_undegraded":"2023-12-08T08:21:06.820409+0000","last_fullsized":"2023-12-08T08:21:06.820409+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.368162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820930+0000","last_change":"2023-12-08T08:21:04.778563+0000","last_active":"2023-12-08T08:21:06.820930+0000","last_peered":"2023-12-08T08:21:06.820930+0000","last_clean":"2023-12-08T08:21:06.820930+0000","last_became_active":"2023-12-08T08:21:04.778275+0000","last_became_peered":"2023-12-08T08:21:04.778275+0000","last_unstale":"2023-12-08T08:21:06.820930+0000","last_undegraded":"2023-12-08T08:21:06.820930+0000","last_fullsized":"2023-12-08T08:21:06.820930+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:45:05.142948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821733+0000","last_change":"2023-12-08T08:21:05.544369+0000","last_active":"2023-12-08T08:21:06.821733+0000","last_peered":"2023-12-08T08:21:06.821733+0000","last_clean":"2023-12-08T08:21:06.821733+0000","last_became_active":"2023-12-08T08:21:05.544090+0000","last_became_peered":"2023-12-08T08:21:05.544090+0000","last_unstale":"2023-12-08T08:21:06.821733+0000","last_undegraded":"2023-12-08T08:21:06.821733+0000","last_fullsized":"2023-12-08T08:21:06.821733+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:25.239396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820547+0000","last_change":"2023-12-08T08:21:04.781520+0000","last_active":"2023-12-08T08:21:06.820547+0000","last_peered":"2023-12-08T08:21:06.820547+0000","last_clean":"2023-12-08T08:21:06.820547+0000","last_became_active":"2023-12-08T08:21:04.781236+0000","last_became_peered":"2023-12-08T08:21:04.781236+0000","last_unstale":"2023-12-08T08:21:06.820547+0000","last_undegraded":"2023-12-08T08:21:06.820547+0000","last_fullsized":"2023-12-08T08:21:06.820547+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:14:17.281881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822632+0000","last_change":"2023-12-08T08:21:05.528065+0000","last_active":"2023-12-08T08:21:06.822632+0000","last_peered":"2023-12-08T08:21:06.822632+0000","last_clean":"2023-12-08T08:21:06.822632+0000","last_became_active":"2023-12-08T08:21:05.527792+0000","last_became_peered":"2023-12-08T08:21:05.527792+0000","last_unstale":"2023-12-08T08:21:06.822632+0000","last_undegraded":"2023-12-08T08:21:06.822632+0000","last_fullsized":"2023-12-08T08:21:06.822632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:51:06.333206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820320+0000","last_change":"2023-12-08T08:21:04.775742+0000","last_active":"2023-12-08T08:21:06.820320+0000","last_peered":"2023-12-08T08:21:06.820320+0000","last_clean":"2023-12-08T08:21:06.820320+0000","last_became_active":"2023-12-08T08:21:04.775482+0000","last_became_peered":"2023-12-08T08:21:04.775482+0000","last_unstale":"2023-12-08T08:21:06.820320+0000","last_undegraded":"2023-12-08T08:21:06.820320+0000","last_fullsized":"2023-12-08T08:21:06.820320+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:46.416448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.516161+0000","last_change":"2023-12-08T08:21:05.537706+0000","last_active":"2023-12-08T08:21:06.516161+0000","last_peered":"2023-12-08T08:21:06.516161+0000","last_clean":"2023-12-08T08:21:06.516161+0000","last_became_active":"2023-12-08T08:21:05.537282+0000","last_became_peered":"2023-12-08T08:21:05.537282+0000","last_unstale":"2023-12-08T08:21:06.516161+0000","last_undegraded":"2023-12-08T08:21:06.516161+0000","last_fullsized":"2023-12-08T08:21:06.516161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:13.692096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821235+0000","last_change":"2023-12-08T08:21:04.785414+0000","last_active":"2023-12-08T08:21:06.821235+0000","last_peered":"2023-12-08T08:21:06.821235+0000","last_clean":"2023-12-08T08:21:06.821235+0000","last_became_active":"2023-12-08T08:21:04.785198+0000","last_became_peered":"2023-12-08T08:21:04.785198+0000","last_unstale":"2023-12-08T08:21:06.821235+0000","last_undegraded":"2023-12-08T08:21:06.821235+0000","last_fullsized":"2023-12-08T08:21:06.821235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:03.400233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822545+0000","last_change":"2023-12-08T08:21:05.538159+0000","last_active":"2023-12-08T08:21:06.822545+0000","last_peered":"2023-12-08T08:21:06.822545+0000","last_clean":"2023-12-08T08:21:06.822545+0000","last_became_active":"2023-12-08T08:21:05.537601+0000","last_became_peered":"2023-12-08T08:21:05.537601+0000","last_unstale":"2023-12-08T08:21:06.822545+0000","last_undegraded":"2023-12-08T08:21:06.822545+0000","last_fullsized":"2023-12-08T08:21:06.822545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:09:56.356105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.516147+0000","last_change":"2023-12-08T08:21:04.776652+0000","last_active":"2023-12-08T08:21:06.516147+0000","last_peered":"2023-12-08T08:21:06.516147+0000","last_clean":"2023-12-08T08:21:06.516147+0000","last_became_active":"2023-12-08T08:21:04.776345+0000","last_became_peered":"2023-12-08T08:21:04.776345+0000","last_unstale":"2023-12-08T08:21:06.516147+0000","last_undegraded":"2023-12-08T08:21:06.516147+0000","last_fullsized":"2023-12-08T08:21:06.516147+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:46.416448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820848+0000","last_change":"2023-12-08T08:21:05.521567+0000","last_active":"2023-12-08T08:21:06.820848+0000","last_peered":"2023-12-08T08:21:06.820848+0000","last_clean":"2023-12-08T08:21:06.820848+0000","last_became_active":"2023-12-08T08:21:05.521289+0000","last_became_peered":"2023-12-08T08:21:05.521289+0000","last_unstale":"2023-12-08T08:21:06.820848+0000","last_undegraded":"2023-12-08T08:21:06.820848+0000","last_fullsized":"2023-12-08T08:21:06.820848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:11.477913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.516143+0000","last_change":"2023-12-08T08:21:04.770820+0000","last_active":"2023-12-08T08:21:06.516143+0000","last_peered":"2023-12-08T08:21:06.516143+0000","last_clean":"2023-12-08T08:21:06.516143+0000","last_became_active":"2023-12-08T08:21:04.767804+0000","last_became_peered":"2023-12-08T08:21:04.767804+0000","last_unstale":"2023-12-08T08:21:06.516143+0000","last_undegraded":"2023-12-08T08:21:06.516143+0000","last_fullsized":"2023-12-08T08:21:06.516143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:58:22.885070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820726+0000","last_change":"2023-12-08T08:21:05.534904+0000","last_active":"2023-12-08T08:21:06.820726+0000","last_peered":"2023-12-08T08:21:06.820726+0000","last_clean":"2023-12-08T08:21:06.820726+0000","last_became_active":"2023-12-08T08:21:05.534637+0000","last_became_peered":"2023-12-08T08:21:05.534637+0000","last_unstale":"2023-12-08T08:21:06.820726+0000","last_undegraded":"2023-12-08T08:21:06.820726+0000","last_fullsized":"2023-12-08T08:21:06.820726+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:40:41.034391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.515965+0000","last_change":"2023-12-08T08:21:04.775274+0000","last_active":"2023-12-08T08:21:06.515965+0000","last_peered":"2023-12-08T08:21:06.515965+0000","last_clean":"2023-12-08T08:21:06.515965+0000","last_became_active":"2023-12-08T08:21:04.774961+0000","last_became_peered":"2023-12-08T08:21:04.774961+0000","last_unstale":"2023-12-08T08:21:06.515965+0000","last_undegraded":"2023-12-08T08:21:06.515965+0000","last_fullsized":"2023-12-08T08:21:06.515965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:03.400233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820552+0000","last_change":"2023-12-08T08:21:05.542434+0000","last_active":"2023-12-08T08:21:06.820552+0000","last_peered":"2023-12-08T08:21:06.820552+0000","last_clean":"2023-12-08T08:21:06.820552+0000","last_became_active":"2023-12-08T08:21:05.542218+0000","last_became_peered":"2023-12-08T08:21:05.542218+0000","last_unstale":"2023-12-08T08:21:06.820552+0000","last_undegraded":"2023-12-08T08:21:06.820552+0000","last_fullsized":"2023-12-08T08:21:06.820552+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:16:19.580755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.513805+0000","last_change":"2023-12-08T08:21:04.768985+0000","last_active":"2023-12-08T08:21:06.513805+0000","last_peered":"2023-12-08T08:21:06.513805+0000","last_clean":"2023-12-08T08:21:06.513805+0000","last_became_active":"2023-12-08T08:21:04.768693+0000","last_became_peered":"2023-12-08T08:21:04.768693+0000","last_unstale":"2023-12-08T08:21:06.513805+0000","last_undegraded":"2023-12-08T08:21:06.513805+0000","last_fullsized":"2023-12-08T08:21:06.513805+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:29.810210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820595+0000","last_change":"2023-12-08T08:21:05.537164+0000","last_active":"2023-12-08T08:21:06.820595+0000","last_peered":"2023-12-08T08:21:06.820595+0000","last_clean":"2023-12-08T08:21:06.820595+0000","last_became_active":"2023-12-08T08:21:05.536915+0000","last_became_peered":"2023-12-08T08:21:05.536915+0000","last_unstale":"2023-12-08T08:21:06.820595+0000","last_undegraded":"2023-12-08T08:21:06.820595+0000","last_fullsized":"2023-12-08T08:21:06.820595+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:14.009289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822925+0000","last_change":"2023-12-08T08:21:04.776313+0000","last_active":"2023-12-08T08:21:06.822925+0000","last_peered":"2023-12-08T08:21:06.822925+0000","last_clean":"2023-12-08T08:21:06.822925+0000","last_became_active":"2023-12-08T08:21:04.775894+0000","last_became_peered":"2023-12-08T08:21:04.775894+0000","last_unstale":"2023-12-08T08:21:06.822925+0000","last_undegraded":"2023-12-08T08:21:06.822925+0000","last_fullsized":"2023-12-08T08:21:06.822925+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:13.006406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820046+0000","last_change":"2023-12-08T08:21:05.538591+0000","last_active":"2023-12-08T08:21:06.820046+0000","last_peered":"2023-12-08T08:21:06.820046+0000","last_clean":"2023-12-08T08:21:06.820046+0000","last_became_active":"2023-12-08T08:21:05.538303+0000","last_became_peered":"2023-12-08T08:21:05.538303+0000","last_unstale":"2023-12-08T08:21:06.820046+0000","last_undegraded":"2023-12-08T08:21:06.820046+0000","last_fullsized":"2023-12-08T08:21:06.820046+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:45:35.860546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.515462+0000","last_change":"2023-12-08T08:21:04.771979+0000","last_active":"2023-12-08T08:21:06.515462+0000","last_peered":"2023-12-08T08:21:06.515462+0000","last_clean":"2023-12-08T08:21:06.515462+0000","last_became_active":"2023-12-08T08:21:04.771656+0000","last_became_peered":"2023-12-08T08:21:04.771656+0000","last_unstale":"2023-12-08T08:21:06.515462+0000","last_undegraded":"2023-12-08T08:21:06.515462+0000","last_fullsized":"2023-12-08T08:21:06.515462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:46:43.523269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821761+0000","last_change":"2023-12-08T08:21:05.530364+0000","last_active":"2023-12-08T08:21:06.821761+0000","last_peered":"2023-12-08T08:21:06.821761+0000","last_clean":"2023-12-08T08:21:06.821761+0000","last_became_active":"2023-12-08T08:21:05.530046+0000","last_became_peered":"2023-12-08T08:21:05.530046+0000","last_unstale":"2023-12-08T08:21:06.821761+0000","last_undegraded":"2023-12-08T08:21:06.821761+0000","last_fullsized":"2023-12-08T08:21:06.821761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.368162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821149+0000","last_change":"2023-12-08T08:21:04.778519+0000","last_active":"2023-12-08T08:21:06.821149+0000","last_peered":"2023-12-08T08:21:06.821149+0000","last_clean":"2023-12-08T08:21:06.821149+0000","last_became_active":"2023-12-08T08:21:04.778208+0000","last_became_peered":"2023-12-08T08:21:04.778208+0000","last_unstale":"2023-12-08T08:21:06.821149+0000","last_undegraded":"2023-12-08T08:21:06.821149+0000","last_fullsized":"2023-12-08T08:21:06.821149+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:36.535172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821134+0000","last_change":"2023-12-08T08:21:05.540583+0000","last_active":"2023-12-08T08:21:06.821134+0000","last_peered":"2023-12-08T08:21:06.821134+0000","last_clean":"2023-12-08T08:21:06.821134+0000","last_became_active":"2023-12-08T08:21:05.540350+0000","last_became_peered":"2023-12-08T08:21:05.540350+0000","last_unstale":"2023-12-08T08:21:06.821134+0000","last_undegraded":"2023-12-08T08:21:06.821134+0000","last_fullsized":"2023-12-08T08:21:06.821134+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:46:44.526151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821282+0000","last_change":"2023-12-08T08:21:04.774731+0000","last_active":"2023-12-08T08:21:06.821282+0000","last_peered":"2023-12-08T08:21:06.821282+0000","last_clean":"2023-12-08T08:21:06.821282+0000","last_became_active":"2023-12-08T08:21:04.773894+0000","last_became_peered":"2023-12-08T08:21:04.773894+0000","last_unstale":"2023-12-08T08:21:06.821282+0000","last_undegraded":"2023-12-08T08:21:06.821282+0000","last_fullsized":"2023-12-08T08:21:06.821282+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:46.416448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822591+0000","last_change":"2023-12-08T08:21:05.537968+0000","last_active":"2023-12-08T08:21:06.822591+0000","last_peered":"2023-12-08T08:21:06.822591+0000","last_clean":"2023-12-08T08:21:06.822591+0000","last_became_active":"2023-12-08T08:21:05.537190+0000","last_became_peered":"2023-12-08T08:21:05.537190+0000","last_unstale":"2023-12-08T08:21:06.822591+0000","last_undegraded":"2023-12-08T08:21:06.822591+0000","last_fullsized":"2023-12-08T08:21:06.822591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:49.782105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.513859+0000","last_change":"2023-12-08T08:21:04.771189+0000","last_active":"2023-12-08T08:21:06.513859+0000","last_peered":"2023-12-08T08:21:06.513859+0000","last_clean":"2023-12-08T08:21:06.513859+0000","last_became_active":"2023-12-08T08:21:04.770913+0000","last_became_peered":"2023-12-08T08:21:04.770913+0000","last_unstale":"2023-12-08T08:21:06.513859+0000","last_undegraded":"2023-12-08T08:21:06.513859+0000","last_fullsized":"2023-12-08T08:21:06.513859+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:58:22.885070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.513704+0000","last_change":"2023-12-08T08:21:05.525845+0000","last_active":"2023-12-08T08:21:06.513704+0000","last_peered":"2023-12-08T08:21:06.513704+0000","last_clean":"2023-12-08T08:21:06.513704+0000","last_became_active":"2023-12-08T08:21:05.525546+0000","last_became_peered":"2023-12-08T08:21:05.525546+0000","last_unstale":"2023-12-08T08:21:06.513704+0000","last_undegraded":"2023-12-08T08:21:06.513704+0000","last_fullsized":"2023-12-08T08:21:06.513704+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:44.030312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820897+0000","last_change":"2023-12-08T08:21:04.769119+0000","last_active":"2023-12-08T08:21:06.820897+0000","last_peered":"2023-12-08T08:21:06.820897+0000","last_clean":"2023-12-08T08:21:06.820897+0000","last_became_active":"2023-12-08T08:21:04.768807+0000","last_became_peered":"2023-12-08T08:21:04.768807+0000","last_unstale":"2023-12-08T08:21:06.820897+0000","last_undegraded":"2023-12-08T08:21:06.820897+0000","last_fullsized":"2023-12-08T08:21:06.820897+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:29.810210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822834+0000","last_change":"2023-12-08T08:21:05.529399+0000","last_active":"2023-12-08T08:21:06.822834+0000","last_peered":"2023-12-08T08:21:06.822834+0000","last_clean":"2023-12-08T08:21:06.822834+0000","last_became_active":"2023-12-08T08:21:05.529054+0000","last_became_peered":"2023-12-08T08:21:05.529054+0000","last_unstale":"2023-12-08T08:21:06.822834+0000","last_undegraded":"2023-12-08T08:21:06.822834+0000","last_fullsized":"2023-12-08T08:21:06.822834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:09.020416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.513864+0000","last_change":"2023-12-08T08:21:04.764784+0000","last_active":"2023-12-08T08:21:06.513864+0000","last_peered":"2023-12-08T08:21:06.513864+0000","last_clean":"2023-12-08T08:21:06.513864+0000","last_became_active":"2023-12-08T08:21:04.764580+0000","last_became_peered":"2023-12-08T08:21:04.764580+0000","last_unstale":"2023-12-08T08:21:06.513864+0000","last_undegraded":"2023-12-08T08:21:06.513864+0000","last_fullsized":"2023-12-08T08:21:06.513864+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:51:05.330323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.513708+0000","last_change":"2023-12-08T08:21:05.528356+0000","last_active":"2023-12-08T08:21:06.513708+0000","last_peered":"2023-12-08T08:21:06.513708+0000","last_clean":"2023-12-08T08:21:06.513708+0000","last_became_active":"2023-12-08T08:21:05.528102+0000","last_became_peered":"2023-12-08T08:21:05.528102+0000","last_unstale":"2023-12-08T08:21:06.513708+0000","last_undegraded":"2023-12-08T08:21:06.513708+0000","last_fullsized":"2023-12-08T08:21:06.513708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:51.183842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821004+0000","last_change":"2023-12-08T08:21:04.776576+0000","last_active":"2023-12-08T08:21:06.821004+0000","last_peered":"2023-12-08T08:21:06.821004+0000","last_clean":"2023-12-08T08:21:06.821004+0000","last_became_active":"2023-12-08T08:21:04.773627+0000","last_became_peered":"2023-12-08T08:21:04.773627+0000","last_unstale":"2023-12-08T08:21:06.821004+0000","last_undegraded":"2023-12-08T08:21:06.821004+0000","last_fullsized":"2023-12-08T08:21:06.821004+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:12.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820138+0000","last_change":"2023-12-08T08:21:05.526701+0000","last_active":"2023-12-08T08:21:06.820138+0000","last_peered":"2023-12-08T08:21:06.820138+0000","last_clean":"2023-12-08T08:21:06.820138+0000","last_became_active":"2023-12-08T08:21:05.526275+0000","last_became_peered":"2023-12-08T08:21:05.526275+0000","last_unstale":"2023-12-08T08:21:06.820138+0000","last_undegraded":"2023-12-08T08:21:06.820138+0000","last_fullsized":"2023-12-08T08:21:06.820138+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:59:00.606587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.515589+0000","last_change":"2023-12-08T08:21:04.768138+0000","last_active":"2023-12-08T08:21:06.515589+0000","last_peered":"2023-12-08T08:21:06.515589+0000","last_clean":"2023-12-08T08:21:06.515589+0000","last_became_active":"2023-12-08T08:21:04.767873+0000","last_became_peered":"2023-12-08T08:21:04.767873+0000","last_unstale":"2023-12-08T08:21:06.515589+0000","last_undegraded":"2023-12-08T08:21:06.515589+0000","last_fullsized":"2023-12-08T08:21:06.515589+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:45:05.142948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.515470+0000","last_change":"2023-12-08T08:21:05.529530+0000","last_active":"2023-12-08T08:21:06.515470+0000","last_peered":"2023-12-08T08:21:06.515470+0000","last_clean":"2023-12-08T08:21:06.515470+0000","last_became_active":"2023-12-08T08:21:05.529080+0000","last_became_peered":"2023-12-08T08:21:05.529080+0000","last_unstale":"2023-12-08T08:21:06.515470+0000","last_undegraded":"2023-12-08T08:21:06.515470+0000","last_fullsized":"2023-12-08T08:21:06.515470+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:51.183842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820227+0000","last_change":"2023-12-08T08:21:04.781980+0000","last_active":"2023-12-08T08:21:06.820227+0000","last_peered":"2023-12-08T08:21:06.820227+0000","last_clean":"2023-12-08T08:21:06.820227+0000","last_became_active":"2023-12-08T08:21:04.781716+0000","last_became_peered":"2023-12-08T08:21:04.781716+0000","last_unstale":"2023-12-08T08:21:06.820227+0000","last_undegraded":"2023-12-08T08:21:06.820227+0000","last_fullsized":"2023-12-08T08:21:06.820227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:03.400233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821676+0000","last_change":"2023-12-08T08:21:05.536640+0000","last_active":"2023-12-08T08:21:06.821676+0000","last_peered":"2023-12-08T08:21:06.821676+0000","last_clean":"2023-12-08T08:21:06.821676+0000","last_became_active":"2023-12-08T08:21:05.536368+0000","last_became_peered":"2023-12-08T08:21:05.536368+0000","last_unstale":"2023-12-08T08:21:06.821676+0000","last_undegraded":"2023-12-08T08:21:06.821676+0000","last_fullsized":"2023-12-08T08:21:06.821676+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:59:00.606587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822676+0000","last_change":"2023-12-08T08:21:04.776417+0000","last_active":"2023-12-08T08:21:06.822676+0000","last_peered":"2023-12-08T08:21:06.822676+0000","last_clean":"2023-12-08T08:21:06.822676+0000","last_became_active":"2023-12-08T08:21:04.776117+0000","last_became_peered":"2023-12-08T08:21:04.776117+0000","last_unstale":"2023-12-08T08:21:06.822676+0000","last_undegraded":"2023-12-08T08:21:06.822676+0000","last_fullsized":"2023-12-08T08:21:06.822676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:45:05.142948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T08:21:05.522634+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:21:05.522634+0000","last_peered":"2023-12-08T08:21:05.522634+0000","last_clean":"2023-12-08T08:21:05.522634+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:21:05.522634+0000","last_undegraded":"2023-12-08T08:21:05.522634+0000","last_fullsized":"2023-12-08T08:21:05.522634+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":724560,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":134774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":134206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":135736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":134172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":135736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":724470,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:21:09.839 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:21:10.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.008+0000 7f4fc8279640 1 Processor -- start 2023-12-08T08:21:10.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.008+0000 7f4fc8279640 1 -- start start 2023-12-08T08:21:10.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.008+0000 7f4fc8279640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4fc006d2b0 0x7f4fc006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:10.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.008+0000 7f4fc8279640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4fc00c5300 0x7f4fc006c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:10.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.008+0000 7f4fc8279640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc006bb80 con 0x7f4fc00c3b80 2023-12-08T08:21:10.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.008+0000 7f4fc8279640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc006cc70 con 0x7f4fc006d2b0 2023-12-08T08:21:10.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.008+0000 7f4fc8279640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc00c5790 con 0x7f4fc00c5300 2023-12-08T08:21:10.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.008+0000 7f4fc5814640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4fc00c3b80 0x7f4fc006c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:56248/0 (socket says 172.21.15.88:56248) 2023-12-08T08:21:10.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.008+0000 7f4fc6015640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4fc006d2b0 0x7f4fc006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:10.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.008+0000 7f4fc5814640 1 -- 172.21.15.88:0/3239368829 learned_addr learned my addr 172.21.15.88:0/3239368829 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:10.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.008+0000 7f4fc6816640 1 --2- 172.21.15.88:0/3239368829 >> v2:172.21.15.148:3300/0 conn(0x7f4fc00c5300 0x7f4fc006c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:10.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.008+0000 7f4fc6015640 1 -- 172.21.15.88:0/3239368829 >> v2:172.21.15.148:3300/0 conn(0x7f4fc00c5300 msgr2=0x7f4fc006c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:10.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.008+0000 7f4fc6015640 1 --2- 172.21.15.88:0/3239368829 >> v2:172.21.15.148:3300/0 conn(0x7f4fc00c5300 0x7f4fc006c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.008+0000 7f4fc6015640 1 -- 172.21.15.88:0/3239368829 >> v1:172.21.15.88:6789/0 conn(0x7f4fc00c3b80 legacy=0x7f4fc006c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:10.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.008+0000 7f4fc6015640 1 -- 172.21.15.88:0/3239368829 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc01515c0 con 0x7f4fc006d2b0 2023-12-08T08:21:10.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.012+0000 7f4fc6015640 1 --2- 172.21.15.88:0/3239368829 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc006d2b0 0x7f4fc006d690 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4fc006e3c0 tx=0x7f4fbc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a344d4eb6afdd7f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:10.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.012+0000 7f4fc5013640 1 -- 172.21.15.88:0/3239368829 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc0ab600 con 0x7f4fc006d2b0 2023-12-08T08:21:10.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.012+0000 7f4fc5013640 1 -- 172.21.15.88:0/3239368829 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fbc0a7050 con 0x7f4fc006d2b0 2023-12-08T08:21:10.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.012+0000 7f4fc5013640 1 -- 172.21.15.88:0/3239368829 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc0ab980 con 0x7f4fc006d2b0 2023-12-08T08:21:10.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.012+0000 7f4fc8279640 1 -- 172.21.15.88:0/3239368829 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc006d2b0 msgr2=0x7f4fc006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:10.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.012+0000 7f4fc8279640 1 --2- 172.21.15.88:0/3239368829 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc006d2b0 0x7f4fc006d690 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4fc006e3c0 tx=0x7f4fbc01c430 comp rx=0 tx=0).stop 2023-12-08T08:21:10.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.012+0000 7f4fc8279640 1 -- 172.21.15.88:0/3239368829 shutdown_connections 2023-12-08T08:21:10.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.012+0000 7f4fc8279640 1 --2- 172.21.15.88:0/3239368829 >> v2:172.21.15.148:3300/0 conn(0x7f4fc00c5300 0x7f4fc006c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.012+0000 7f4fc8279640 1 --2- 172.21.15.88:0/3239368829 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc006d2b0 0x7f4fc006d690 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.012+0000 7f4fc8279640 1 -- 172.21.15.88:0/3239368829 >> 172.21.15.88:0/3239368829 conn(0x7f4fc00a7810 msgr2=0x7f4fc00a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:10.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.012+0000 7f4fc8279640 1 -- 172.21.15.88:0/3239368829 shutdown_connections 2023-12-08T08:21:10.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.012+0000 7f4fc8279640 1 -- 172.21.15.88:0/3239368829 wait complete. 2023-12-08T08:21:10.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.016+0000 7f4fc8279640 1 Processor -- start 2023-12-08T08:21:10.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.016+0000 7f4fc8279640 1 -- start start 2023-12-08T08:21:10.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.016+0000 7f4fc8279640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc006d2b0 0x7f4fc01ed8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:10.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.016+0000 7f4fc8279640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc00c3b80 0x7f4fc00ab3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:10.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.016+0000 7f4fc8279640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc00c5300 0x7f4fc00a9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:10.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.016+0000 7f4fc8279640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc014c040 con 0x7f4fc00c5300 2023-12-08T08:21:10.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.016+0000 7f4fc8279640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc00a8990 con 0x7f4fc00c3b80 2023-12-08T08:21:10.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.016+0000 7f4fc8279640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc00a8c70 con 0x7f4fc006d2b0 2023-12-08T08:21:10.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.016+0000 7f4fc6816640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc00c5300 0x7f4fc00a9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:10.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.016+0000 7f4fc6816640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc00c5300 0x7f4fc00a9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52250/0 (socket says 172.21.15.88:52250) 2023-12-08T08:21:10.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.016+0000 7f4fc6816640 1 -- 172.21.15.88:0/882642981 learned_addr learned my addr 172.21.15.88:0/882642981 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:10.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.016+0000 7f4fc5814640 1 --2- 172.21.15.88:0/882642981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc00c3b80 0x7f4fc00ab3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:10.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.016+0000 7f4fc6015640 1 --2- 172.21.15.88:0/882642981 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc006d2b0 0x7f4fc01ed8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:10.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.016+0000 7f4fc6816640 1 -- 172.21.15.88:0/882642981 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc006d2b0 msgr2=0x7f4fc01ed8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:10.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.016+0000 7f4fc6816640 1 --2- 172.21.15.88:0/882642981 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc006d2b0 0x7f4fc01ed8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.016+0000 7f4fc6816640 1 -- 172.21.15.88:0/882642981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc00c3b80 msgr2=0x7f4fc00ab3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:10.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.016+0000 7f4fc6816640 1 --2- 172.21.15.88:0/882642981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc00c3b80 0x7f4fc00ab3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.016+0000 7f4fc6816640 1 -- 172.21.15.88:0/882642981 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fbc009420 con 0x7f4fc00c5300 2023-12-08T08:21:10.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.016+0000 7f4fc5814640 1 --2- 172.21.15.88:0/882642981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc00c3b80 0x7f4fc00ab3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:10.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.016+0000 7f4fc6816640 1 --2- 172.21.15.88:0/882642981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc00c5300 0x7f4fc00a9820 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4fb800cc80 tx=0x7f4fb800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:10.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.016+0000 7f4fb6ffd640 1 -- 172.21.15.88:0/882642981 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb800ce30 con 0x7f4fc00c5300 2023-12-08T08:21:10.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.016+0000 7f4fb6ffd640 1 -- 172.21.15.88:0/882642981 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb80039a0 con 0x7f4fc00c5300 2023-12-08T08:21:10.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.016+0000 7f4fb6ffd640 1 -- 172.21.15.88:0/882642981 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8003d30 con 0x7f4fc00c5300 2023-12-08T08:21:10.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.016+0000 7f4fc8279640 1 -- 172.21.15.88:0/882642981 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc014ef80 con 0x7f4fc00c5300 2023-12-08T08:21:10.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.016+0000 7f4fc8279640 1 -- 172.21.15.88:0/882642981 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc00a9d60 con 0x7f4fc00c5300 2023-12-08T08:21:10.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.020+0000 7f4fc8279640 1 -- 172.21.15.88:0/882642981 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc0067630 con 0x7f4fc00c5300 2023-12-08T08:21:10.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.020+0000 7f4fb6ffd640 1 -- 172.21.15.88:0/882642981 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4fb8003e90 con 0x7f4fc00c5300 2023-12-08T08:21:10.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.020+0000 7f4fb6ffd640 1 --2- 172.21.15.88:0/882642981 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4fa4066470 0x7f4fa4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:10.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.020+0000 7f4fb6ffd640 1 -- 172.21.15.88:0/882642981 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4fb8084110 con 0x7f4fc00c5300 2023-12-08T08:21:10.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.020+0000 7f4fc6015640 1 --2- 172.21.15.88:0/882642981 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4fa4066470 0x7f4fa4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:10.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.020+0000 7f4fc6015640 1 --2- 172.21.15.88:0/882642981 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4fa4066470 0x7f4fa4068930 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4fc006b5a0 tx=0x7f4fbc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:10.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.024+0000 7f4fb6ffd640 1 -- 172.21.15.88:0/882642981 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4fb8051630 con 0x7f4fc00c5300 2023-12-08T08:21:10.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.168+0000 7f4fc8279640 1 -- 172.21.15.88:0/882642981 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4fc014ee00 con 0x7f4fa4066470 2023-12-08T08:21:10.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.176+0000 7f4fb6ffd640 1 -- 172.21.15.88:0/882642981 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264806 (secure 0 0 0) 0x7f4fbc0ab8a0 con 0x7f4fa4066470 2023-12-08T08:21:10.188 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:10.189 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:21:10.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.180+0000 7f4fc8279640 1 -- 172.21.15.88:0/882642981 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4fa4066470 msgr2=0x7f4fa4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:10.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.180+0000 7f4fc8279640 1 --2- 172.21.15.88:0/882642981 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4fa4066470 0x7f4fa4068930 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4fc006b5a0 tx=0x7f4fbc008040 comp rx=0 tx=0).stop 2023-12-08T08:21:10.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.180+0000 7f4fc8279640 1 -- 172.21.15.88:0/882642981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc00c5300 msgr2=0x7f4fc00a9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:10.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.180+0000 7f4fc8279640 1 --2- 172.21.15.88:0/882642981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc00c5300 0x7f4fc00a9820 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4fb800cc80 tx=0x7f4fb800a5c0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.180+0000 7f4fc8279640 1 -- 172.21.15.88:0/882642981 shutdown_connections 2023-12-08T08:21:10.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.180+0000 7f4fc8279640 1 --2- 172.21.15.88:0/882642981 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4fa4066470 0x7f4fa4068930 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.180+0000 7f4fc8279640 1 --2- 172.21.15.88:0/882642981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc00c5300 0x7f4fc00a9820 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.180+0000 7f4fc8279640 1 --2- 172.21.15.88:0/882642981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc00c3b80 0x7f4fc00ab3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.180+0000 7f4fc8279640 1 --2- 172.21.15.88:0/882642981 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4fc006d2b0 0x7f4fc01ed8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.180+0000 7f4fc8279640 1 -- 172.21.15.88:0/882642981 >> 172.21.15.88:0/882642981 conn(0x7f4fc00a7810 msgr2=0x7f4fc0071c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:10.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.180+0000 7f4fc8279640 1 -- 172.21.15.88:0/882642981 shutdown_connections 2023-12-08T08:21:10.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.180+0000 7f4fc8279640 1 -- 172.21.15.88:0/882642981 wait complete. 2023-12-08T08:21:10.206 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-12-08T08:21:08.757275+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":101,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219096,"kb_used_data":2912,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755624,"statfs":{"total":773094113280,"available":772869758976,"internally_reserved":0,"allocated":2981888,"data_stored":2258372,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.012608"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822861+0000","last_change":"2023-12-08T08:21:05.540661+0000","last_active":"2023-12-08T08:21:06.822861+0000","last_peered":"2023-12-08T08:21:06.822861+0000","last_clean":"2023-12-08T08:21:06.822861+0000","last_became_active":"2023-12-08T08:21:05.539125+0000","last_became_peered":"2023-12-08T08:21:05.539125+0000","last_unstale":"2023-12-08T08:21:06.822861+0000","last_undegraded":"2023-12-08T08:21:06.822861+0000","last_fullsized":"2023-12-08T08:21:06.822861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:58:23.887952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821904+0000","last_change":"2023-12-08T08:21:05.527659+0000","last_active":"2023-12-08T08:21:06.821904+0000","last_peered":"2023-12-08T08:21:06.821904+0000","last_clean":"2023-12-08T08:21:06.821904+0000","last_became_active":"2023-12-08T08:21:05.527361+0000","last_became_peered":"2023-12-08T08:21:05.527361+0000","last_unstale":"2023-12-08T08:21:06.821904+0000","last_undegraded":"2023-12-08T08:21:06.821904+0000","last_fullsized":"2023-12-08T08:21:06.821904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:49.782105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822316+0000","last_change":"2023-12-08T08:21:05.534658+0000","last_active":"2023-12-08T08:21:06.822316+0000","last_peered":"2023-12-08T08:21:06.822316+0000","last_clean":"2023-12-08T08:21:06.822316+0000","last_became_active":"2023-12-08T08:21:05.534383+0000","last_became_peered":"2023-12-08T08:21:05.534383+0000","last_unstale":"2023-12-08T08:21:06.822316+0000","last_undegraded":"2023-12-08T08:21:06.822316+0000","last_fullsized":"2023-12-08T08:21:06.822316+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.368162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820745+0000","last_change":"2023-12-08T08:21:05.528111+0000","last_active":"2023-12-08T08:21:06.820745+0000","last_peered":"2023-12-08T08:21:06.820745+0000","last_clean":"2023-12-08T08:21:06.820745+0000","last_became_active":"2023-12-08T08:21:05.527809+0000","last_became_peered":"2023-12-08T08:21:05.527809+0000","last_unstale":"2023-12-08T08:21:06.820745+0000","last_undegraded":"2023-12-08T08:21:06.820745+0000","last_fullsized":"2023-12-08T08:21:06.820745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:51.183842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820248+0000","last_change":"2023-12-08T08:21:05.532561+0000","last_active":"2023-12-08T08:21:06.820248+0000","last_peered":"2023-12-08T08:21:06.820248+0000","last_clean":"2023-12-08T08:21:06.820248+0000","last_became_active":"2023-12-08T08:21:05.532254+0000","last_became_peered":"2023-12-08T08:21:05.532254+0000","last_unstale":"2023-12-08T08:21:06.820248+0000","last_undegraded":"2023-12-08T08:21:06.820248+0000","last_fullsized":"2023-12-08T08:21:06.820248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:30:51.157799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820070+0000","last_change":"2023-12-08T08:21:05.543535+0000","last_active":"2023-12-08T08:21:06.820070+0000","last_peered":"2023-12-08T08:21:06.820070+0000","last_clean":"2023-12-08T08:21:06.820070+0000","last_became_active":"2023-12-08T08:21:05.543244+0000","last_became_peered":"2023-12-08T08:21:05.543244+0000","last_unstale":"2023-12-08T08:21:06.820070+0000","last_undegraded":"2023-12-08T08:21:06.820070+0000","last_fullsized":"2023-12-08T08:21:06.820070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:20:39.875619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822061+0000","last_change":"2023-12-08T08:21:05.534310+0000","last_active":"2023-12-08T08:21:06.822061+0000","last_peered":"2023-12-08T08:21:06.822061+0000","last_clean":"2023-12-08T08:21:06.822061+0000","last_became_active":"2023-12-08T08:21:05.534003+0000","last_became_peered":"2023-12-08T08:21:05.534003+0000","last_unstale":"2023-12-08T08:21:06.822061+0000","last_undegraded":"2023-12-08T08:21:06.822061+0000","last_fullsized":"2023-12-08T08:21:06.822061+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:49.782105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821469+0000","last_change":"2023-12-08T08:21:05.537523+0000","last_active":"2023-12-08T08:21:06.821469+0000","last_peered":"2023-12-08T08:21:06.821469+0000","last_clean":"2023-12-08T08:21:06.821469+0000","last_became_active":"2023-12-08T08:21:05.537263+0000","last_became_peered":"2023-12-08T08:21:05.537263+0000","last_unstale":"2023-12-08T08:21:06.821469+0000","last_undegraded":"2023-12-08T08:21:06.821469+0000","last_fullsized":"2023-12-08T08:21:06.821469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:08.596525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.516301+0000","last_change":"2023-12-08T08:21:05.525741+0000","last_active":"2023-12-08T08:21:06.516301+0000","last_peered":"2023-12-08T08:21:06.516301+0000","last_clean":"2023-12-08T08:21:06.516301+0000","last_became_active":"2023-12-08T08:21:05.525406+0000","last_became_peered":"2023-12-08T08:21:05.525406+0000","last_unstale":"2023-12-08T08:21:06.516301+0000","last_undegraded":"2023-12-08T08:21:06.516301+0000","last_fullsized":"2023-12-08T08:21:06.516301+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:08.596525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821305+0000","last_change":"2023-12-08T08:21:05.533444+0000","last_active":"2023-12-08T08:21:06.821305+0000","last_peered":"2023-12-08T08:21:06.821305+0000","last_clean":"2023-12-08T08:21:06.821305+0000","last_became_active":"2023-12-08T08:21:05.533146+0000","last_became_peered":"2023-12-08T08:21:05.533146+0000","last_unstale":"2023-12-08T08:21:06.821305+0000","last_undegraded":"2023-12-08T08:21:06.821305+0000","last_fullsized":"2023-12-08T08:21:06.821305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:14:18.284764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821785+0000","last_change":"2023-12-08T08:21:05.536252+0000","last_active":"2023-12-08T08:21:06.821785+0000","last_peered":"2023-12-08T08:21:06.821785+0000","last_clean":"2023-12-08T08:21:06.821785+0000","last_became_active":"2023-12-08T08:21:05.535964+0000","last_became_peered":"2023-12-08T08:21:05.535964+0000","last_unstale":"2023-12-08T08:21:06.821785+0000","last_undegraded":"2023-12-08T08:21:06.821785+0000","last_fullsized":"2023-12-08T08:21:06.821785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:30.973295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822212+0000","last_change":"2023-12-08T08:21:05.540446+0000","last_active":"2023-12-08T08:21:06.822212+0000","last_peered":"2023-12-08T08:21:06.822212+0000","last_clean":"2023-12-08T08:21:06.822212+0000","last_became_active":"2023-12-08T08:21:05.540024+0000","last_became_peered":"2023-12-08T08:21:05.540024+0000","last_unstale":"2023-12-08T08:21:06.822212+0000","last_undegraded":"2023-12-08T08:21:06.822212+0000","last_fullsized":"2023-12-08T08:21:06.822212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:59:00.606587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820269+0000","last_change":"2023-12-08T08:21:05.530318+0000","last_active":"2023-12-08T08:21:06.820269+0000","last_peered":"2023-12-08T08:21:06.820269+0000","last_clean":"2023-12-08T08:21:06.820269+0000","last_became_active":"2023-12-08T08:21:05.529990+0000","last_became_peered":"2023-12-08T08:21:05.529990+0000","last_unstale":"2023-12-08T08:21:06.820269+0000","last_undegraded":"2023-12-08T08:21:06.820269+0000","last_fullsized":"2023-12-08T08:21:06.820269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:54:39.738546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820200+0000","last_change":"2023-12-08T08:21:05.527949+0000","last_active":"2023-12-08T08:21:06.820200+0000","last_peered":"2023-12-08T08:21:06.820200+0000","last_clean":"2023-12-08T08:21:06.820200+0000","last_became_active":"2023-12-08T08:21:05.527215+0000","last_became_peered":"2023-12-08T08:21:05.527215+0000","last_unstale":"2023-12-08T08:21:06.820200+0000","last_undegraded":"2023-12-08T08:21:06.820200+0000","last_fullsized":"2023-12-08T08:21:06.820200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:25.239396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821789+0000","last_change":"2023-12-08T08:21:05.529395+0000","last_active":"2023-12-08T08:21:06.821789+0000","last_peered":"2023-12-08T08:21:06.821789+0000","last_clean":"2023-12-08T08:21:06.821789+0000","last_became_active":"2023-12-08T08:21:05.529089+0000","last_became_peered":"2023-12-08T08:21:05.529089+0000","last_unstale":"2023-12-08T08:21:06.821789+0000","last_undegraded":"2023-12-08T08:21:06.821789+0000","last_fullsized":"2023-12-08T08:21:06.821789+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:43.021591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821879+0000","last_change":"2023-12-08T08:21:05.535656+0000","last_active":"2023-12-08T08:21:06.821879+0000","last_peered":"2023-12-08T08:21:06.821879+0000","last_clean":"2023-12-08T08:21:06.821879+0000","last_became_active":"2023-12-08T08:21:05.535310+0000","last_became_peered":"2023-12-08T08:21:05.535310+0000","last_unstale":"2023-12-08T08:21:06.821879+0000","last_undegraded":"2023-12-08T08:21:06.821879+0000","last_fullsized":"2023-12-08T08:21:06.821879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:09:56.356105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822294+0000","last_change":"2023-12-08T08:21:05.532053+0000","last_active":"2023-12-08T08:21:06.822294+0000","last_peered":"2023-12-08T08:21:06.822294+0000","last_clean":"2023-12-08T08:21:06.822294+0000","last_became_active":"2023-12-08T08:21:05.531799+0000","last_became_peered":"2023-12-08T08:21:05.531799+0000","last_unstale":"2023-12-08T08:21:06.822294+0000","last_undegraded":"2023-12-08T08:21:06.822294+0000","last_fullsized":"2023-12-08T08:21:06.822294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:05.968004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821923+0000","last_change":"2023-12-08T08:21:05.530770+0000","last_active":"2023-12-08T08:21:06.821923+0000","last_peered":"2023-12-08T08:21:06.821923+0000","last_clean":"2023-12-08T08:21:06.821923+0000","last_became_active":"2023-12-08T08:21:05.530517+0000","last_became_peered":"2023-12-08T08:21:05.530517+0000","last_unstale":"2023-12-08T08:21:06.821923+0000","last_undegraded":"2023-12-08T08:21:06.821923+0000","last_fullsized":"2023-12-08T08:21:06.821923+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:05.968004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821636+0000","last_change":"2023-12-08T08:21:05.525566+0000","last_active":"2023-12-08T08:21:06.821636+0000","last_peered":"2023-12-08T08:21:06.821636+0000","last_clean":"2023-12-08T08:21:06.821636+0000","last_became_active":"2023-12-08T08:21:05.525251+0000","last_became_peered":"2023-12-08T08:21:05.525251+0000","last_unstale":"2023-12-08T08:21:06.821636+0000","last_undegraded":"2023-12-08T08:21:06.821636+0000","last_fullsized":"2023-12-08T08:21:06.821636+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:09:56.356105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821458+0000","last_change":"2023-12-08T08:21:05.538014+0000","last_active":"2023-12-08T08:21:06.821458+0000","last_peered":"2023-12-08T08:21:06.821458+0000","last_clean":"2023-12-08T08:21:06.821458+0000","last_became_active":"2023-12-08T08:21:05.537721+0000","last_became_peered":"2023-12-08T08:21:05.537721+0000","last_unstale":"2023-12-08T08:21:06.821458+0000","last_undegraded":"2023-12-08T08:21:06.821458+0000","last_fullsized":"2023-12-08T08:21:06.821458+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:30.813093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.515531+0000","last_change":"2023-12-08T08:21:05.523783+0000","last_active":"2023-12-08T08:21:06.515531+0000","last_peered":"2023-12-08T08:21:06.515531+0000","last_clean":"2023-12-08T08:21:06.515531+0000","last_became_active":"2023-12-08T08:21:05.523509+0000","last_became_peered":"2023-12-08T08:21:05.523509+0000","last_unstale":"2023-12-08T08:21:06.515531+0000","last_undegraded":"2023-12-08T08:21:06.515531+0000","last_fullsized":"2023-12-08T08:21:06.515531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:11.477913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.515696+0000","last_change":"2023-12-08T08:21:05.529673+0000","last_active":"2023-12-08T08:21:06.515696+0000","last_peered":"2023-12-08T08:21:06.515696+0000","last_clean":"2023-12-08T08:21:06.515696+0000","last_became_active":"2023-12-08T08:21:05.528239+0000","last_became_peered":"2023-12-08T08:21:05.528239+0000","last_unstale":"2023-12-08T08:21:06.515696+0000","last_undegraded":"2023-12-08T08:21:06.515696+0000","last_fullsized":"2023-12-08T08:21:06.515696+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:19.928543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.513502+0000","last_change":"2023-12-08T08:21:05.534953+0000","last_active":"2023-12-08T08:21:06.513502+0000","last_peered":"2023-12-08T08:21:06.513502+0000","last_clean":"2023-12-08T08:21:06.513502+0000","last_became_active":"2023-12-08T08:21:05.531291+0000","last_became_peered":"2023-12-08T08:21:05.531291+0000","last_unstale":"2023-12-08T08:21:06.513502+0000","last_undegraded":"2023-12-08T08:21:06.513502+0000","last_fullsized":"2023-12-08T08:21:06.513502+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:47.419331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821931+0000","last_change":"2023-12-08T08:21:05.535454+0000","last_active":"2023-12-08T08:21:06.821931+0000","last_peered":"2023-12-08T08:21:06.821931+0000","last_clean":"2023-12-08T08:21:06.821931+0000","last_became_active":"2023-12-08T08:21:05.535095+0000","last_became_peered":"2023-12-08T08:21:05.535095+0000","last_unstale":"2023-12-08T08:21:06.821931+0000","last_undegraded":"2023-12-08T08:21:06.821931+0000","last_fullsized":"2023-12-08T08:21:06.821931+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:50:53.654615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821180+0000","last_change":"2023-12-08T08:21:05.531201+0000","last_active":"2023-12-08T08:21:06.821180+0000","last_peered":"2023-12-08T08:21:06.821180+0000","last_clean":"2023-12-08T08:21:06.821180+0000","last_became_active":"2023-12-08T08:21:05.530935+0000","last_became_peered":"2023-12-08T08:21:05.530935+0000","last_unstale":"2023-12-08T08:21:06.821180+0000","last_undegraded":"2023-12-08T08:21:06.821180+0000","last_fullsized":"2023-12-08T08:21:06.821180+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:37.538055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822029+0000","last_change":"2023-12-08T08:21:05.532516+0000","last_active":"2023-12-08T08:21:06.822029+0000","last_peered":"2023-12-08T08:21:06.822029+0000","last_clean":"2023-12-08T08:21:06.822029+0000","last_became_active":"2023-12-08T08:21:05.531827+0000","last_became_peered":"2023-12-08T08:21:05.531827+0000","last_unstale":"2023-12-08T08:21:06.822029+0000","last_undegraded":"2023-12-08T08:21:06.822029+0000","last_fullsized":"2023-12-08T08:21:06.822029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:49:59.047557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821259+0000","last_change":"2023-12-08T08:21:05.538170+0000","last_active":"2023-12-08T08:21:06.821259+0000","last_peered":"2023-12-08T08:21:06.821259+0000","last_clean":"2023-12-08T08:21:06.821259+0000","last_became_active":"2023-12-08T08:21:05.537834+0000","last_became_peered":"2023-12-08T08:21:05.537834+0000","last_unstale":"2023-12-08T08:21:06.821259+0000","last_undegraded":"2023-12-08T08:21:06.821259+0000","last_fullsized":"2023-12-08T08:21:06.821259+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:23.756612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822339+0000","last_change":"2023-12-08T08:21:05.538326+0000","last_active":"2023-12-08T08:21:06.822339+0000","last_peered":"2023-12-08T08:21:06.822339+0000","last_clean":"2023-12-08T08:21:06.822339+0000","last_became_active":"2023-12-08T08:21:05.538042+0000","last_became_peered":"2023-12-08T08:21:05.538042+0000","last_unstale":"2023-12-08T08:21:06.822339+0000","last_undegraded":"2023-12-08T08:21:06.822339+0000","last_fullsized":"2023-12-08T08:21:06.822339+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:30.973295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.515717+0000","last_change":"2023-12-08T08:21:05.531803+0000","last_active":"2023-12-08T08:21:06.515717+0000","last_peered":"2023-12-08T08:21:06.515717+0000","last_clean":"2023-12-08T08:21:06.515717+0000","last_became_active":"2023-12-08T08:21:05.531470+0000","last_became_peered":"2023-12-08T08:21:05.531470+0000","last_unstale":"2023-12-08T08:21:06.515717+0000","last_undegraded":"2023-12-08T08:21:06.515717+0000","last_fullsized":"2023-12-08T08:21:06.515717+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:37.538055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821529+0000","last_change":"2023-12-08T08:21:05.530432+0000","last_active":"2023-12-08T08:21:06.821529+0000","last_peered":"2023-12-08T08:21:06.821529+0000","last_clean":"2023-12-08T08:21:06.821529+0000","last_became_active":"2023-12-08T08:21:05.530065+0000","last_became_peered":"2023-12-08T08:21:05.530065+0000","last_unstale":"2023-12-08T08:21:06.821529+0000","last_undegraded":"2023-12-08T08:21:06.821529+0000","last_fullsized":"2023-12-08T08:21:06.821529+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:43.021591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822464+0000","last_change":"2023-12-08T08:21:05.532086+0000","last_active":"2023-12-08T08:21:06.822464+0000","last_peered":"2023-12-08T08:21:06.822464+0000","last_clean":"2023-12-08T08:21:06.822464+0000","last_became_active":"2023-12-08T08:21:05.531583+0000","last_became_peered":"2023-12-08T08:21:05.531583+0000","last_unstale":"2023-12-08T08:21:06.822464+0000","last_undegraded":"2023-12-08T08:21:06.822464+0000","last_fullsized":"2023-12-08T08:21:06.822464+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:13.936073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821617+0000","last_change":"2023-12-08T08:21:05.539808+0000","last_active":"2023-12-08T08:21:06.821617+0000","last_peered":"2023-12-08T08:21:06.821617+0000","last_clean":"2023-12-08T08:21:06.821617+0000","last_became_active":"2023-12-08T08:21:05.539443+0000","last_became_peered":"2023-12-08T08:21:05.539443+0000","last_unstale":"2023-12-08T08:21:06.821617+0000","last_undegraded":"2023-12-08T08:21:06.821617+0000","last_fullsized":"2023-12-08T08:21:06.821617+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:20:39.875619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.513768+0000","last_change":"2023-12-08T08:21:05.532180+0000","last_active":"2023-12-08T08:21:06.513768+0000","last_peered":"2023-12-08T08:21:06.513768+0000","last_clean":"2023-12-08T08:21:06.513768+0000","last_became_active":"2023-12-08T08:21:05.529640+0000","last_became_peered":"2023-12-08T08:21:05.529640+0000","last_unstale":"2023-12-08T08:21:06.513768+0000","last_undegraded":"2023-12-08T08:21:06.513768+0000","last_fullsized":"2023-12-08T08:21:06.513768+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:11.477913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.823085+0000","last_change":"2023-12-08T08:21:04.777030+0000","last_active":"2023-12-08T08:21:06.823085+0000","last_peered":"2023-12-08T08:21:06.823085+0000","last_clean":"2023-12-08T08:21:06.823085+0000","last_became_active":"2023-12-08T08:21:04.775911+0000","last_became_peered":"2023-12-08T08:21:04.775911+0000","last_unstale":"2023-12-08T08:21:06.823085+0000","last_undegraded":"2023-12-08T08:21:06.823085+0000","last_fullsized":"2023-12-08T08:21:06.823085+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:29.810210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822992+0000","last_change":"2023-12-08T08:21:05.531374+0000","last_active":"2023-12-08T08:21:06.822992+0000","last_peered":"2023-12-08T08:21:06.822992+0000","last_clean":"2023-12-08T08:21:06.822992+0000","last_became_active":"2023-12-08T08:21:05.531104+0000","last_became_peered":"2023-12-08T08:21:05.531104+0000","last_unstale":"2023-12-08T08:21:06.822992+0000","last_undegraded":"2023-12-08T08:21:06.822992+0000","last_fullsized":"2023-12-08T08:21:06.822992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:04.403116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.513760+0000","last_change":"2023-12-08T08:21:04.780684+0000","last_active":"2023-12-08T08:21:06.513760+0000","last_peered":"2023-12-08T08:21:06.513760+0000","last_clean":"2023-12-08T08:21:06.513760+0000","last_became_active":"2023-12-08T08:21:04.780321+0000","last_became_peered":"2023-12-08T08:21:04.780321+0000","last_unstale":"2023-12-08T08:21:06.513760+0000","last_undegraded":"2023-12-08T08:21:06.513760+0000","last_fullsized":"2023-12-08T08:21:06.513760+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:13.006406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.515801+0000","last_change":"2023-12-08T08:21:05.532257+0000","last_active":"2023-12-08T08:21:06.515801+0000","last_peered":"2023-12-08T08:21:06.515801+0000","last_clean":"2023-12-08T08:21:06.515801+0000","last_became_active":"2023-12-08T08:21:05.531965+0000","last_became_peered":"2023-12-08T08:21:05.531965+0000","last_unstale":"2023-12-08T08:21:06.515801+0000","last_undegraded":"2023-12-08T08:21:06.515801+0000","last_fullsized":"2023-12-08T08:21:06.515801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:23.756612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821679+0000","last_change":"2023-12-08T08:21:04.778223+0000","last_active":"2023-12-08T08:21:06.821679+0000","last_peered":"2023-12-08T08:21:06.821679+0000","last_clean":"2023-12-08T08:21:06.821679+0000","last_became_active":"2023-12-08T08:21:04.777902+0000","last_became_peered":"2023-12-08T08:21:04.777902+0000","last_unstale":"2023-12-08T08:21:06.821679+0000","last_undegraded":"2023-12-08T08:21:06.821679+0000","last_fullsized":"2023-12-08T08:21:06.821679+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:07.593642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821325+0000","last_change":"2023-12-08T08:21:05.527749+0000","last_active":"2023-12-08T08:21:06.821325+0000","last_peered":"2023-12-08T08:21:06.821325+0000","last_clean":"2023-12-08T08:21:06.821325+0000","last_became_active":"2023-12-08T08:21:05.527397+0000","last_became_peered":"2023-12-08T08:21:05.527397+0000","last_unstale":"2023-12-08T08:21:06.821325+0000","last_undegraded":"2023-12-08T08:21:06.821325+0000","last_fullsized":"2023-12-08T08:21:06.821325+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:13.692096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821541+0000","last_change":"2023-12-08T08:21:04.773475+0000","last_active":"2023-12-08T08:21:06.821541+0000","last_peered":"2023-12-08T08:21:06.821541+0000","last_clean":"2023-12-08T08:21:06.821541+0000","last_became_active":"2023-12-08T08:21:04.773125+0000","last_became_peered":"2023-12-08T08:21:04.773125+0000","last_unstale":"2023-12-08T08:21:06.821541+0000","last_undegraded":"2023-12-08T08:21:06.821541+0000","last_fullsized":"2023-12-08T08:21:06.821541+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:00:34.107681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821564+0000","last_change":"2023-12-08T08:21:05.542808+0000","last_active":"2023-12-08T08:21:06.821564+0000","last_peered":"2023-12-08T08:21:06.821564+0000","last_clean":"2023-12-08T08:21:06.821564+0000","last_became_active":"2023-12-08T08:21:05.542495+0000","last_became_peered":"2023-12-08T08:21:05.542495+0000","last_unstale":"2023-12-08T08:21:06.821564+0000","last_undegraded":"2023-12-08T08:21:06.821564+0000","last_fullsized":"2023-12-08T08:21:06.821564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:50:53.654615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.515785+0000","last_change":"2023-12-08T08:21:04.784944+0000","last_active":"2023-12-08T08:21:06.515785+0000","last_peered":"2023-12-08T08:21:06.515785+0000","last_clean":"2023-12-08T08:21:06.515785+0000","last_became_active":"2023-12-08T08:21:04.784657+0000","last_became_peered":"2023-12-08T08:21:04.784657+0000","last_unstale":"2023-12-08T08:21:06.515785+0000","last_undegraded":"2023-12-08T08:21:06.515785+0000","last_fullsized":"2023-12-08T08:21:06.515785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:51:05.330323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821336+0000","last_change":"2023-12-08T08:21:05.537414+0000","last_active":"2023-12-08T08:21:06.821336+0000","last_peered":"2023-12-08T08:21:06.821336+0000","last_clean":"2023-12-08T08:21:06.821336+0000","last_became_active":"2023-12-08T08:21:05.537137+0000","last_became_peered":"2023-12-08T08:21:05.537137+0000","last_unstale":"2023-12-08T08:21:06.821336+0000","last_undegraded":"2023-12-08T08:21:06.821336+0000","last_fullsized":"2023-12-08T08:21:06.821336+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:08.596525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.515748+0000","last_change":"2023-12-08T08:21:04.783596+0000","last_active":"2023-12-08T08:21:06.515748+0000","last_peered":"2023-12-08T08:21:06.515748+0000","last_clean":"2023-12-08T08:21:06.515748+0000","last_became_active":"2023-12-08T08:21:04.783159+0000","last_became_peered":"2023-12-08T08:21:04.783159+0000","last_unstale":"2023-12-08T08:21:06.515748+0000","last_undegraded":"2023-12-08T08:21:06.515748+0000","last_fullsized":"2023-12-08T08:21:06.515748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:43.027429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.515966+0000","last_change":"2023-12-08T08:21:05.535708+0000","last_active":"2023-12-08T08:21:06.515966+0000","last_peered":"2023-12-08T08:21:06.515966+0000","last_clean":"2023-12-08T08:21:06.515966+0000","last_became_active":"2023-12-08T08:21:05.527959+0000","last_became_peered":"2023-12-08T08:21:05.527959+0000","last_unstale":"2023-12-08T08:21:06.515966+0000","last_undegraded":"2023-12-08T08:21:06.515966+0000","last_fullsized":"2023-12-08T08:21:06.515966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:14:18.284764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820625+0000","last_change":"2023-12-08T08:21:04.780723+0000","last_active":"2023-12-08T08:21:06.820625+0000","last_peered":"2023-12-08T08:21:06.820625+0000","last_clean":"2023-12-08T08:21:06.820625+0000","last_became_active":"2023-12-08T08:21:04.780436+0000","last_became_peered":"2023-12-08T08:21:04.780436+0000","last_unstale":"2023-12-08T08:21:06.820625+0000","last_undegraded":"2023-12-08T08:21:06.820625+0000","last_fullsized":"2023-12-08T08:21:06.820625+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:12.689213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820421+0000","last_change":"2023-12-08T08:21:05.536397+0000","last_active":"2023-12-08T08:21:06.820421+0000","last_peered":"2023-12-08T08:21:06.820421+0000","last_clean":"2023-12-08T08:21:06.820421+0000","last_became_active":"2023-12-08T08:21:05.536103+0000","last_became_peered":"2023-12-08T08:21:05.536103+0000","last_unstale":"2023-12-08T08:21:06.820421+0000","last_undegraded":"2023-12-08T08:21:06.820421+0000","last_fullsized":"2023-12-08T08:21:06.820421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:44.030312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.515912+0000","last_change":"2023-12-08T08:21:04.776553+0000","last_active":"2023-12-08T08:21:06.515912+0000","last_peered":"2023-12-08T08:21:06.515912+0000","last_clean":"2023-12-08T08:21:06.515912+0000","last_became_active":"2023-12-08T08:21:04.773755+0000","last_became_peered":"2023-12-08T08:21:04.773755+0000","last_unstale":"2023-12-08T08:21:06.515912+0000","last_undegraded":"2023-12-08T08:21:06.515912+0000","last_fullsized":"2023-12-08T08:21:06.515912+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:12.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822282+0000","last_change":"2023-12-08T08:21:05.533947+0000","last_active":"2023-12-08T08:21:06.822282+0000","last_peered":"2023-12-08T08:21:06.822282+0000","last_clean":"2023-12-08T08:21:06.822282+0000","last_became_active":"2023-12-08T08:21:05.533554+0000","last_became_peered":"2023-12-08T08:21:05.533554+0000","last_unstale":"2023-12-08T08:21:06.822282+0000","last_undegraded":"2023-12-08T08:21:06.822282+0000","last_fullsized":"2023-12-08T08:21:06.822282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:25.239396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821990+0000","last_change":"2023-12-08T08:21:04.782800+0000","last_active":"2023-12-08T08:21:06.821990+0000","last_peered":"2023-12-08T08:21:06.821990+0000","last_clean":"2023-12-08T08:21:06.821990+0000","last_became_active":"2023-12-08T08:21:04.782531+0000","last_became_peered":"2023-12-08T08:21:04.782531+0000","last_unstale":"2023-12-08T08:21:06.821990+0000","last_undegraded":"2023-12-08T08:21:06.821990+0000","last_fullsized":"2023-12-08T08:21:06.821990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:42.018708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821965+0000","last_change":"2023-12-08T08:21:05.532644+0000","last_active":"2023-12-08T08:21:06.821965+0000","last_peered":"2023-12-08T08:21:06.821965+0000","last_clean":"2023-12-08T08:21:06.821965+0000","last_became_active":"2023-12-08T08:21:05.530404+0000","last_became_peered":"2023-12-08T08:21:05.530404+0000","last_unstale":"2023-12-08T08:21:06.821965+0000","last_undegraded":"2023-12-08T08:21:06.821965+0000","last_fullsized":"2023-12-08T08:21:06.821965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:05:11.193024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.513905+0000","last_change":"2023-12-08T08:21:04.786064+0000","last_active":"2023-12-08T08:21:06.513905+0000","last_peered":"2023-12-08T08:21:06.513905+0000","last_clean":"2023-12-08T08:21:06.513905+0000","last_became_active":"2023-12-08T08:21:04.785859+0000","last_became_peered":"2023-12-08T08:21:04.785859+0000","last_unstale":"2023-12-08T08:21:06.513905+0000","last_undegraded":"2023-12-08T08:21:06.513905+0000","last_fullsized":"2023-12-08T08:21:06.513905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:12.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821392+0000","last_change":"2023-12-08T08:21:05.532372+0000","last_active":"2023-12-08T08:21:06.821392+0000","last_peered":"2023-12-08T08:21:06.821392+0000","last_clean":"2023-12-08T08:21:06.821392+0000","last_became_active":"2023-12-08T08:21:05.531767+0000","last_became_peered":"2023-12-08T08:21:05.531767+0000","last_unstale":"2023-12-08T08:21:06.821392+0000","last_undegraded":"2023-12-08T08:21:06.821392+0000","last_fullsized":"2023-12-08T08:21:06.821392+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:30.973295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822403+0000","last_change":"2023-12-08T08:21:04.782195+0000","last_active":"2023-12-08T08:21:06.822403+0000","last_peered":"2023-12-08T08:21:06.822403+0000","last_clean":"2023-12-08T08:21:06.822403+0000","last_became_active":"2023-12-08T08:21:04.781298+0000","last_became_peered":"2023-12-08T08:21:04.781298+0000","last_unstale":"2023-12-08T08:21:06.822403+0000","last_undegraded":"2023-12-08T08:21:06.822403+0000","last_fullsized":"2023-12-08T08:21:06.822403+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:12.689213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822176+0000","last_change":"2023-12-08T08:21:05.540670+0000","last_active":"2023-12-08T08:21:06.822176+0000","last_peered":"2023-12-08T08:21:06.822176+0000","last_clean":"2023-12-08T08:21:06.822176+0000","last_became_active":"2023-12-08T08:21:05.539546+0000","last_became_peered":"2023-12-08T08:21:05.539546+0000","last_unstale":"2023-12-08T08:21:06.822176+0000","last_undegraded":"2023-12-08T08:21:06.822176+0000","last_fullsized":"2023-12-08T08:21:06.822176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:20:39.875619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821529+0000","last_change":"2023-12-08T08:21:04.778814+0000","last_active":"2023-12-08T08:21:06.821529+0000","last_peered":"2023-12-08T08:21:06.821529+0000","last_clean":"2023-12-08T08:21:06.821529+0000","last_became_active":"2023-12-08T08:21:04.778501+0000","last_became_peered":"2023-12-08T08:21:04.778501+0000","last_unstale":"2023-12-08T08:21:06.821529+0000","last_undegraded":"2023-12-08T08:21:06.821529+0000","last_fullsized":"2023-12-08T08:21:06.821529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:50:52.651732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820851+0000","last_change":"2023-12-08T08:21:05.543017+0000","last_active":"2023-12-08T08:21:06.820851+0000","last_peered":"2023-12-08T08:21:06.820851+0000","last_clean":"2023-12-08T08:21:06.820851+0000","last_became_active":"2023-12-08T08:21:05.542729+0000","last_became_peered":"2023-12-08T08:21:05.542729+0000","last_unstale":"2023-12-08T08:21:06.820851+0000","last_undegraded":"2023-12-08T08:21:06.820851+0000","last_fullsized":"2023-12-08T08:21:06.820851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:19.928543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.515842+0000","last_change":"2023-12-08T08:21:04.773643+0000","last_active":"2023-12-08T08:21:06.515842+0000","last_peered":"2023-12-08T08:21:06.515842+0000","last_clean":"2023-12-08T08:21:06.515842+0000","last_became_active":"2023-12-08T08:21:04.773361+0000","last_became_peered":"2023-12-08T08:21:04.773361+0000","last_unstale":"2023-12-08T08:21:06.515842+0000","last_undegraded":"2023-12-08T08:21:06.515842+0000","last_fullsized":"2023-12-08T08:21:06.515842+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:08.017533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820409+0000","last_change":"2023-12-08T08:21:05.528470+0000","last_active":"2023-12-08T08:21:06.820409+0000","last_peered":"2023-12-08T08:21:06.820409+0000","last_clean":"2023-12-08T08:21:06.820409+0000","last_became_active":"2023-12-08T08:21:05.528125+0000","last_became_peered":"2023-12-08T08:21:05.528125+0000","last_unstale":"2023-12-08T08:21:06.820409+0000","last_undegraded":"2023-12-08T08:21:06.820409+0000","last_fullsized":"2023-12-08T08:21:06.820409+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.368162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820930+0000","last_change":"2023-12-08T08:21:04.778563+0000","last_active":"2023-12-08T08:21:06.820930+0000","last_peered":"2023-12-08T08:21:06.820930+0000","last_clean":"2023-12-08T08:21:06.820930+0000","last_became_active":"2023-12-08T08:21:04.778275+0000","last_became_peered":"2023-12-08T08:21:04.778275+0000","last_unstale":"2023-12-08T08:21:06.820930+0000","last_undegraded":"2023-12-08T08:21:06.820930+0000","last_fullsized":"2023-12-08T08:21:06.820930+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:45:05.142948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821733+0000","last_change":"2023-12-08T08:21:05.544369+0000","last_active":"2023-12-08T08:21:06.821733+0000","last_peered":"2023-12-08T08:21:06.821733+0000","last_clean":"2023-12-08T08:21:06.821733+0000","last_became_active":"2023-12-08T08:21:05.544090+0000","last_became_peered":"2023-12-08T08:21:05.544090+0000","last_unstale":"2023-12-08T08:21:06.821733+0000","last_undegraded":"2023-12-08T08:21:06.821733+0000","last_fullsized":"2023-12-08T08:21:06.821733+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:25.239396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820547+0000","last_change":"2023-12-08T08:21:04.781520+0000","last_active":"2023-12-08T08:21:06.820547+0000","last_peered":"2023-12-08T08:21:06.820547+0000","last_clean":"2023-12-08T08:21:06.820547+0000","last_became_active":"2023-12-08T08:21:04.781236+0000","last_became_peered":"2023-12-08T08:21:04.781236+0000","last_unstale":"2023-12-08T08:21:06.820547+0000","last_undegraded":"2023-12-08T08:21:06.820547+0000","last_fullsized":"2023-12-08T08:21:06.820547+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:14:17.281881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822632+0000","last_change":"2023-12-08T08:21:05.528065+0000","last_active":"2023-12-08T08:21:06.822632+0000","last_peered":"2023-12-08T08:21:06.822632+0000","last_clean":"2023-12-08T08:21:06.822632+0000","last_became_active":"2023-12-08T08:21:05.527792+0000","last_became_peered":"2023-12-08T08:21:05.527792+0000","last_unstale":"2023-12-08T08:21:06.822632+0000","last_undegraded":"2023-12-08T08:21:06.822632+0000","last_fullsized":"2023-12-08T08:21:06.822632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:51:06.333206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820320+0000","last_change":"2023-12-08T08:21:04.775742+0000","last_active":"2023-12-08T08:21:06.820320+0000","last_peered":"2023-12-08T08:21:06.820320+0000","last_clean":"2023-12-08T08:21:06.820320+0000","last_became_active":"2023-12-08T08:21:04.775482+0000","last_became_peered":"2023-12-08T08:21:04.775482+0000","last_unstale":"2023-12-08T08:21:06.820320+0000","last_undegraded":"2023-12-08T08:21:06.820320+0000","last_fullsized":"2023-12-08T08:21:06.820320+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:46.416448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.516161+0000","last_change":"2023-12-08T08:21:05.537706+0000","last_active":"2023-12-08T08:21:06.516161+0000","last_peered":"2023-12-08T08:21:06.516161+0000","last_clean":"2023-12-08T08:21:06.516161+0000","last_became_active":"2023-12-08T08:21:05.537282+0000","last_became_peered":"2023-12-08T08:21:05.537282+0000","last_unstale":"2023-12-08T08:21:06.516161+0000","last_undegraded":"2023-12-08T08:21:06.516161+0000","last_fullsized":"2023-12-08T08:21:06.516161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:13.692096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821235+0000","last_change":"2023-12-08T08:21:04.785414+0000","last_active":"2023-12-08T08:21:06.821235+0000","last_peered":"2023-12-08T08:21:06.821235+0000","last_clean":"2023-12-08T08:21:06.821235+0000","last_became_active":"2023-12-08T08:21:04.785198+0000","last_became_peered":"2023-12-08T08:21:04.785198+0000","last_unstale":"2023-12-08T08:21:06.821235+0000","last_undegraded":"2023-12-08T08:21:06.821235+0000","last_fullsized":"2023-12-08T08:21:06.821235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:03.400233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822545+0000","last_change":"2023-12-08T08:21:05.538159+0000","last_active":"2023-12-08T08:21:06.822545+0000","last_peered":"2023-12-08T08:21:06.822545+0000","last_clean":"2023-12-08T08:21:06.822545+0000","last_became_active":"2023-12-08T08:21:05.537601+0000","last_became_peered":"2023-12-08T08:21:05.537601+0000","last_unstale":"2023-12-08T08:21:06.822545+0000","last_undegraded":"2023-12-08T08:21:06.822545+0000","last_fullsized":"2023-12-08T08:21:06.822545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:09:56.356105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.516147+0000","last_change":"2023-12-08T08:21:04.776652+0000","last_active":"2023-12-08T08:21:06.516147+0000","last_peered":"2023-12-08T08:21:06.516147+0000","last_clean":"2023-12-08T08:21:06.516147+0000","last_became_active":"2023-12-08T08:21:04.776345+0000","last_became_peered":"2023-12-08T08:21:04.776345+0000","last_unstale":"2023-12-08T08:21:06.516147+0000","last_undegraded":"2023-12-08T08:21:06.516147+0000","last_fullsized":"2023-12-08T08:21:06.516147+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:46.416448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820848+0000","last_change":"2023-12-08T08:21:05.521567+0000","last_active":"2023-12-08T08:21:06.820848+0000","last_peered":"2023-12-08T08:21:06.820848+0000","last_clean":"2023-12-08T08:21:06.820848+0000","last_became_active":"2023-12-08T08:21:05.521289+0000","last_became_peered":"2023-12-08T08:21:05.521289+0000","last_unstale":"2023-12-08T08:21:06.820848+0000","last_undegraded":"2023-12-08T08:21:06.820848+0000","last_fullsized":"2023-12-08T08:21:06.820848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:11.477913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.516143+0000","last_change":"2023-12-08T08:21:04.770820+0000","last_active":"2023-12-08T08:21:06.516143+0000","last_peered":"2023-12-08T08:21:06.516143+0000","last_clean":"2023-12-08T08:21:06.516143+0000","last_became_active":"2023-12-08T08:21:04.767804+0000","last_became_peered":"2023-12-08T08:21:04.767804+0000","last_unstale":"2023-12-08T08:21:06.516143+0000","last_undegraded":"2023-12-08T08:21:06.516143+0000","last_fullsized":"2023-12-08T08:21:06.516143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:58:22.885070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820726+0000","last_change":"2023-12-08T08:21:05.534904+0000","last_active":"2023-12-08T08:21:06.820726+0000","last_peered":"2023-12-08T08:21:06.820726+0000","last_clean":"2023-12-08T08:21:06.820726+0000","last_became_active":"2023-12-08T08:21:05.534637+0000","last_became_peered":"2023-12-08T08:21:05.534637+0000","last_unstale":"2023-12-08T08:21:06.820726+0000","last_undegraded":"2023-12-08T08:21:06.820726+0000","last_fullsized":"2023-12-08T08:21:06.820726+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:40:41.034391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.515965+0000","last_change":"2023-12-08T08:21:04.775274+0000","last_active":"2023-12-08T08:21:06.515965+0000","last_peered":"2023-12-08T08:21:06.515965+0000","last_clean":"2023-12-08T08:21:06.515965+0000","last_became_active":"2023-12-08T08:21:04.774961+0000","last_became_peered":"2023-12-08T08:21:04.774961+0000","last_unstale":"2023-12-08T08:21:06.515965+0000","last_undegraded":"2023-12-08T08:21:06.515965+0000","last_fullsized":"2023-12-08T08:21:06.515965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:03.400233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820552+0000","last_change":"2023-12-08T08:21:05.542434+0000","last_active":"2023-12-08T08:21:06.820552+0000","last_peered":"2023-12-08T08:21:06.820552+0000","last_clean":"2023-12-08T08:21:06.820552+0000","last_became_active":"2023-12-08T08:21:05.542218+0000","last_became_peered":"2023-12-08T08:21:05.542218+0000","last_unstale":"2023-12-08T08:21:06.820552+0000","last_undegraded":"2023-12-08T08:21:06.820552+0000","last_fullsized":"2023-12-08T08:21:06.820552+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:16:19.580755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.513805+0000","last_change":"2023-12-08T08:21:04.768985+0000","last_active":"2023-12-08T08:21:06.513805+0000","last_peered":"2023-12-08T08:21:06.513805+0000","last_clean":"2023-12-08T08:21:06.513805+0000","last_became_active":"2023-12-08T08:21:04.768693+0000","last_became_peered":"2023-12-08T08:21:04.768693+0000","last_unstale":"2023-12-08T08:21:06.513805+0000","last_undegraded":"2023-12-08T08:21:06.513805+0000","last_fullsized":"2023-12-08T08:21:06.513805+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:29.810210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820595+0000","last_change":"2023-12-08T08:21:05.537164+0000","last_active":"2023-12-08T08:21:06.820595+0000","last_peered":"2023-12-08T08:21:06.820595+0000","last_clean":"2023-12-08T08:21:06.820595+0000","last_became_active":"2023-12-08T08:21:05.536915+0000","last_became_peered":"2023-12-08T08:21:05.536915+0000","last_unstale":"2023-12-08T08:21:06.820595+0000","last_undegraded":"2023-12-08T08:21:06.820595+0000","last_fullsized":"2023-12-08T08:21:06.820595+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:14.009289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822925+0000","last_change":"2023-12-08T08:21:04.776313+0000","last_active":"2023-12-08T08:21:06.822925+0000","last_peered":"2023-12-08T08:21:06.822925+0000","last_clean":"2023-12-08T08:21:06.822925+0000","last_became_active":"2023-12-08T08:21:04.775894+0000","last_became_peered":"2023-12-08T08:21:04.775894+0000","last_unstale":"2023-12-08T08:21:06.822925+0000","last_undegraded":"2023-12-08T08:21:06.822925+0000","last_fullsized":"2023-12-08T08:21:06.822925+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:13.006406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820046+0000","last_change":"2023-12-08T08:21:05.538591+0000","last_active":"2023-12-08T08:21:06.820046+0000","last_peered":"2023-12-08T08:21:06.820046+0000","last_clean":"2023-12-08T08:21:06.820046+0000","last_became_active":"2023-12-08T08:21:05.538303+0000","last_became_peered":"2023-12-08T08:21:05.538303+0000","last_unstale":"2023-12-08T08:21:06.820046+0000","last_undegraded":"2023-12-08T08:21:06.820046+0000","last_fullsized":"2023-12-08T08:21:06.820046+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:45:35.860546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.515462+0000","last_change":"2023-12-08T08:21:04.771979+0000","last_active":"2023-12-08T08:21:06.515462+0000","last_peered":"2023-12-08T08:21:06.515462+0000","last_clean":"2023-12-08T08:21:06.515462+0000","last_became_active":"2023-12-08T08:21:04.771656+0000","last_became_peered":"2023-12-08T08:21:04.771656+0000","last_unstale":"2023-12-08T08:21:06.515462+0000","last_undegraded":"2023-12-08T08:21:06.515462+0000","last_fullsized":"2023-12-08T08:21:06.515462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:46:43.523269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821761+0000","last_change":"2023-12-08T08:21:05.530364+0000","last_active":"2023-12-08T08:21:06.821761+0000","last_peered":"2023-12-08T08:21:06.821761+0000","last_clean":"2023-12-08T08:21:06.821761+0000","last_became_active":"2023-12-08T08:21:05.530046+0000","last_became_peered":"2023-12-08T08:21:05.530046+0000","last_unstale":"2023-12-08T08:21:06.821761+0000","last_undegraded":"2023-12-08T08:21:06.821761+0000","last_fullsized":"2023-12-08T08:21:06.821761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.368162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821149+0000","last_change":"2023-12-08T08:21:04.778519+0000","last_active":"2023-12-08T08:21:06.821149+0000","last_peered":"2023-12-08T08:21:06.821149+0000","last_clean":"2023-12-08T08:21:06.821149+0000","last_became_active":"2023-12-08T08:21:04.778208+0000","last_became_peered":"2023-12-08T08:21:04.778208+0000","last_unstale":"2023-12-08T08:21:06.821149+0000","last_undegraded":"2023-12-08T08:21:06.821149+0000","last_fullsized":"2023-12-08T08:21:06.821149+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:36.535172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821134+0000","last_change":"2023-12-08T08:21:05.540583+0000","last_active":"2023-12-08T08:21:06.821134+0000","last_peered":"2023-12-08T08:21:06.821134+0000","last_clean":"2023-12-08T08:21:06.821134+0000","last_became_active":"2023-12-08T08:21:05.540350+0000","last_became_peered":"2023-12-08T08:21:05.540350+0000","last_unstale":"2023-12-08T08:21:06.821134+0000","last_undegraded":"2023-12-08T08:21:06.821134+0000","last_fullsized":"2023-12-08T08:21:06.821134+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:46:44.526151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821282+0000","last_change":"2023-12-08T08:21:04.774731+0000","last_active":"2023-12-08T08:21:06.821282+0000","last_peered":"2023-12-08T08:21:06.821282+0000","last_clean":"2023-12-08T08:21:06.821282+0000","last_became_active":"2023-12-08T08:21:04.773894+0000","last_became_peered":"2023-12-08T08:21:04.773894+0000","last_unstale":"2023-12-08T08:21:06.821282+0000","last_undegraded":"2023-12-08T08:21:06.821282+0000","last_fullsized":"2023-12-08T08:21:06.821282+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:46.416448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822591+0000","last_change":"2023-12-08T08:21:05.537968+0000","last_active":"2023-12-08T08:21:06.822591+0000","last_peered":"2023-12-08T08:21:06.822591+0000","last_clean":"2023-12-08T08:21:06.822591+0000","last_became_active":"2023-12-08T08:21:05.537190+0000","last_became_peered":"2023-12-08T08:21:05.537190+0000","last_unstale":"2023-12-08T08:21:06.822591+0000","last_undegraded":"2023-12-08T08:21:06.822591+0000","last_fullsized":"2023-12-08T08:21:06.822591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:49.782105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.513859+0000","last_change":"2023-12-08T08:21:04.771189+0000","last_active":"2023-12-08T08:21:06.513859+0000","last_peered":"2023-12-08T08:21:06.513859+0000","last_clean":"2023-12-08T08:21:06.513859+0000","last_became_active":"2023-12-08T08:21:04.770913+0000","last_became_peered":"2023-12-08T08:21:04.770913+0000","last_unstale":"2023-12-08T08:21:06.513859+0000","last_undegraded":"2023-12-08T08:21:06.513859+0000","last_fullsized":"2023-12-08T08:21:06.513859+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:58:22.885070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.513704+0000","last_change":"2023-12-08T08:21:05.525845+0000","last_active":"2023-12-08T08:21:06.513704+0000","last_peered":"2023-12-08T08:21:06.513704+0000","last_clean":"2023-12-08T08:21:06.513704+0000","last_became_active":"2023-12-08T08:21:05.525546+0000","last_became_peered":"2023-12-08T08:21:05.525546+0000","last_unstale":"2023-12-08T08:21:06.513704+0000","last_undegraded":"2023-12-08T08:21:06.513704+0000","last_fullsized":"2023-12-08T08:21:06.513704+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:44.030312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820897+0000","last_change":"2023-12-08T08:21:04.769119+0000","last_active":"2023-12-08T08:21:06.820897+0000","last_peered":"2023-12-08T08:21:06.820897+0000","last_clean":"2023-12-08T08:21:06.820897+0000","last_became_active":"2023-12-08T08:21:04.768807+0000","last_became_peered":"2023-12-08T08:21:04.768807+0000","last_unstale":"2023-12-08T08:21:06.820897+0000","last_undegraded":"2023-12-08T08:21:06.820897+0000","last_fullsized":"2023-12-08T08:21:06.820897+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:29.810210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822834+0000","last_change":"2023-12-08T08:21:05.529399+0000","last_active":"2023-12-08T08:21:06.822834+0000","last_peered":"2023-12-08T08:21:06.822834+0000","last_clean":"2023-12-08T08:21:06.822834+0000","last_became_active":"2023-12-08T08:21:05.529054+0000","last_became_peered":"2023-12-08T08:21:05.529054+0000","last_unstale":"2023-12-08T08:21:06.822834+0000","last_undegraded":"2023-12-08T08:21:06.822834+0000","last_fullsized":"2023-12-08T08:21:06.822834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:09.020416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.513864+0000","last_change":"2023-12-08T08:21:04.764784+0000","last_active":"2023-12-08T08:21:06.513864+0000","last_peered":"2023-12-08T08:21:06.513864+0000","last_clean":"2023-12-08T08:21:06.513864+0000","last_became_active":"2023-12-08T08:21:04.764580+0000","last_became_peered":"2023-12-08T08:21:04.764580+0000","last_unstale":"2023-12-08T08:21:06.513864+0000","last_undegraded":"2023-12-08T08:21:06.513864+0000","last_fullsized":"2023-12-08T08:21:06.513864+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:51:05.330323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.513708+0000","last_change":"2023-12-08T08:21:05.528356+0000","last_active":"2023-12-08T08:21:06.513708+0000","last_peered":"2023-12-08T08:21:06.513708+0000","last_clean":"2023-12-08T08:21:06.513708+0000","last_became_active":"2023-12-08T08:21:05.528102+0000","last_became_peered":"2023-12-08T08:21:05.528102+0000","last_unstale":"2023-12-08T08:21:06.513708+0000","last_undegraded":"2023-12-08T08:21:06.513708+0000","last_fullsized":"2023-12-08T08:21:06.513708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:51.183842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821004+0000","last_change":"2023-12-08T08:21:04.776576+0000","last_active":"2023-12-08T08:21:06.821004+0000","last_peered":"2023-12-08T08:21:06.821004+0000","last_clean":"2023-12-08T08:21:06.821004+0000","last_became_active":"2023-12-08T08:21:04.773627+0000","last_became_peered":"2023-12-08T08:21:04.773627+0000","last_unstale":"2023-12-08T08:21:06.821004+0000","last_undegraded":"2023-12-08T08:21:06.821004+0000","last_fullsized":"2023-12-08T08:21:06.821004+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:12.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820138+0000","last_change":"2023-12-08T08:21:05.526701+0000","last_active":"2023-12-08T08:21:06.820138+0000","last_peered":"2023-12-08T08:21:06.820138+0000","last_clean":"2023-12-08T08:21:06.820138+0000","last_became_active":"2023-12-08T08:21:05.526275+0000","last_became_peered":"2023-12-08T08:21:05.526275+0000","last_unstale":"2023-12-08T08:21:06.820138+0000","last_undegraded":"2023-12-08T08:21:06.820138+0000","last_fullsized":"2023-12-08T08:21:06.820138+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:59:00.606587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.515589+0000","last_change":"2023-12-08T08:21:04.768138+0000","last_active":"2023-12-08T08:21:06.515589+0000","last_peered":"2023-12-08T08:21:06.515589+0000","last_clean":"2023-12-08T08:21:06.515589+0000","last_became_active":"2023-12-08T08:21:04.767873+0000","last_became_peered":"2023-12-08T08:21:04.767873+0000","last_unstale":"2023-12-08T08:21:06.515589+0000","last_undegraded":"2023-12-08T08:21:06.515589+0000","last_fullsized":"2023-12-08T08:21:06.515589+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:45:05.142948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.515470+0000","last_change":"2023-12-08T08:21:05.529530+0000","last_active":"2023-12-08T08:21:06.515470+0000","last_peered":"2023-12-08T08:21:06.515470+0000","last_clean":"2023-12-08T08:21:06.515470+0000","last_became_active":"2023-12-08T08:21:05.529080+0000","last_became_peered":"2023-12-08T08:21:05.529080+0000","last_unstale":"2023-12-08T08:21:06.515470+0000","last_undegraded":"2023-12-08T08:21:06.515470+0000","last_fullsized":"2023-12-08T08:21:06.515470+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:51.183842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.820227+0000","last_change":"2023-12-08T08:21:04.781980+0000","last_active":"2023-12-08T08:21:06.820227+0000","last_peered":"2023-12-08T08:21:06.820227+0000","last_clean":"2023-12-08T08:21:06.820227+0000","last_became_active":"2023-12-08T08:21:04.781716+0000","last_became_peered":"2023-12-08T08:21:04.781716+0000","last_unstale":"2023-12-08T08:21:06.820227+0000","last_undegraded":"2023-12-08T08:21:06.820227+0000","last_fullsized":"2023-12-08T08:21:06.820227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:03.400233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.821676+0000","last_change":"2023-12-08T08:21:05.536640+0000","last_active":"2023-12-08T08:21:06.821676+0000","last_peered":"2023-12-08T08:21:06.821676+0000","last_clean":"2023-12-08T08:21:06.821676+0000","last_became_active":"2023-12-08T08:21:05.536368+0000","last_became_peered":"2023-12-08T08:21:05.536368+0000","last_unstale":"2023-12-08T08:21:06.821676+0000","last_undegraded":"2023-12-08T08:21:06.821676+0000","last_fullsized":"2023-12-08T08:21:06.821676+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:59:00.606587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-08T08:21:06.822676+0000","last_change":"2023-12-08T08:21:04.776417+0000","last_active":"2023-12-08T08:21:06.822676+0000","last_peered":"2023-12-08T08:21:06.822676+0000","last_clean":"2023-12-08T08:21:06.822676+0000","last_became_active":"2023-12-08T08:21:04.776117+0000","last_became_peered":"2023-12-08T08:21:04.776117+0000","last_unstale":"2023-12-08T08:21:06.822676+0000","last_undegraded":"2023-12-08T08:21:06.822676+0000","last_fullsized":"2023-12-08T08:21:06.822676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:45:05.142948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-08T08:21:05.522634+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:21:05.522634+0000","last_peered":"2023-12-08T08:21:05.522634+0000","last_clean":"2023-12-08T08:21:05.522634+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:21:05.522634+0000","last_undegraded":"2023-12-08T08:21:05.522634+0000","last_fullsized":"2023-12-08T08:21:05.522634+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":724560,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":134774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":134206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":135736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":134172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":135736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":724470,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:21:10.210 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-08T08:21:10.211 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-08T08:21:10.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.384+0000 7f06ea38d640 1 Processor -- start 2023-12-08T08:21:10.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.384+0000 7f06ea38d640 1 -- start start 2023-12-08T08:21:10.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.384+0000 7f06ea38d640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f06e414b1e0 0x7f06e40c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:10.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.384+0000 7f06ea38d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f06e40c5300 0x7f06e40a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:10.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.384+0000 7f06ea38d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e40a4e20 con 0x7f06e4151280 2023-12-08T08:21:10.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.384+0000 7f06ea38d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e41558d0 con 0x7f06e40c5300 2023-12-08T08:21:10.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.384+0000 7f06ea38d640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e40a50e0 con 0x7f06e414b1e0 2023-12-08T08:21:10.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.388+0000 7f06e892a640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f06e4151280 0x7f06e41516f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57962/0 (socket says 172.21.15.88:57962) 2023-12-08T08:21:10.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.388+0000 7f06e37fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f06e40c5300 0x7f06e40a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:10.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.388+0000 7f06e892a640 1 -- 172.21.15.88:0/4097680347 learned_addr learned my addr 172.21.15.88:0/4097680347 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:10.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.388+0000 7f06e3fff640 1 --2- 172.21.15.88:0/4097680347 >> v2:172.21.15.148:3300/0 conn(0x7f06e414b1e0 0x7f06e40c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:10.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.388+0000 7f06e37fe640 1 -- 172.21.15.88:0/4097680347 >> v2:172.21.15.148:3300/0 conn(0x7f06e414b1e0 msgr2=0x7f06e40c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:10.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.388+0000 7f06e37fe640 1 --2- 172.21.15.88:0/4097680347 >> v2:172.21.15.148:3300/0 conn(0x7f06e414b1e0 0x7f06e40c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.388+0000 7f06e37fe640 1 -- 172.21.15.88:0/4097680347 >> v1:172.21.15.88:6789/0 conn(0x7f06e4151280 legacy=0x7f06e41516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:10.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.388+0000 7f06e37fe640 1 -- 172.21.15.88:0/4097680347 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e40c0f00 con 0x7f06e40c5300 2023-12-08T08:21:10.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.388+0000 7f06e2ffd640 1 -- 172.21.15.88:0/4097680347 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3692515217 0 0) 0x7f06e40a4e20 con 0x7f06e4151280 2023-12-08T08:21:10.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.388+0000 7f06e37fe640 1 --2- 172.21.15.88:0/4097680347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06e40c5300 0x7f06e40a9c30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f06e40c4150 tx=0x7f06d801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56556f42aca2d186 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:10.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.388+0000 7f06e2ffd640 1 -- 172.21.15.88:0/4097680347 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d80ab600 con 0x7f06e40c5300 2023-12-08T08:21:10.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.388+0000 7f06e2ffd640 1 -- 172.21.15.88:0/4097680347 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d80a7050 con 0x7f06e40c5300 2023-12-08T08:21:10.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.388+0000 7f06e2ffd640 1 -- 172.21.15.88:0/4097680347 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d80ab980 con 0x7f06e40c5300 2023-12-08T08:21:10.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.392+0000 7f06ea38d640 1 -- 172.21.15.88:0/4097680347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06e40c5300 msgr2=0x7f06e40a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:10.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.392+0000 7f06ea38d640 1 --2- 172.21.15.88:0/4097680347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06e40c5300 0x7f06e40a9c30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f06e40c4150 tx=0x7f06d801c460 comp rx=0 tx=0).stop 2023-12-08T08:21:10.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.392+0000 7f06ea38d640 1 -- 172.21.15.88:0/4097680347 shutdown_connections 2023-12-08T08:21:10.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.392+0000 7f06ea38d640 1 --2- 172.21.15.88:0/4097680347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06e40c5300 0x7f06e40a9c30 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.392+0000 7f06ea38d640 1 --2- 172.21.15.88:0/4097680347 >> v2:172.21.15.148:3300/0 conn(0x7f06e414b1e0 0x7f06e40c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.392+0000 7f06ea38d640 1 -- 172.21.15.88:0/4097680347 >> 172.21.15.88:0/4097680347 conn(0x7f06e40c59f0 msgr2=0x7f06e40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:10.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.392+0000 7f06ea38d640 1 -- 172.21.15.88:0/4097680347 shutdown_connections 2023-12-08T08:21:10.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.392+0000 7f06ea38d640 1 -- 172.21.15.88:0/4097680347 wait complete. 2023-12-08T08:21:10.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.392+0000 7f06ea38d640 1 Processor -- start 2023-12-08T08:21:10.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.392+0000 7f06ea38d640 1 -- start start 2023-12-08T08:21:10.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.392+0000 7f06ea38d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06e40c5300 0x7f06e40a6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:10.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.392+0000 7f06ea38d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06e414b1e0 0x7f06e40a5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:10.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.392+0000 7f06ea38d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06e4151280 0x7f06e406ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:10.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.392+0000 7f06ea38d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e40a74c0 con 0x7f06e414b1e0 2023-12-08T08:21:10.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.392+0000 7f06ea38d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e41ee700 con 0x7f06e4151280 2023-12-08T08:21:10.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.392+0000 7f06ea38d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e41ee0f0 con 0x7f06e40c5300 2023-12-08T08:21:10.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.392+0000 7f06e37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06e414b1e0 0x7f06e40a5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:10.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.392+0000 7f06e37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06e414b1e0 0x7f06e40a5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47332/0 (socket says 172.21.15.88:47332) 2023-12-08T08:21:10.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.392+0000 7f06e37fe640 1 -- 172.21.15.88:0/3345679244 learned_addr learned my addr 172.21.15.88:0/3345679244 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:10.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.392+0000 7f06e3fff640 1 --2- 172.21.15.88:0/3345679244 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06e40c5300 0x7f06e40a6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:10.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.392+0000 7f06e892a640 1 --2- 172.21.15.88:0/3345679244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06e4151280 0x7f06e406ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:10.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.392+0000 7f06e37fe640 1 -- 172.21.15.88:0/3345679244 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06e40c5300 msgr2=0x7f06e40a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:10.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.392+0000 7f06e37fe640 1 --2- 172.21.15.88:0/3345679244 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06e40c5300 0x7f06e40a6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.392+0000 7f06e37fe640 1 -- 172.21.15.88:0/3345679244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06e4151280 msgr2=0x7f06e406ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:10.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.392+0000 7f06e37fe640 1 --2- 172.21.15.88:0/3345679244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06e4151280 0x7f06e406ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.392+0000 7f06e37fe640 1 -- 172.21.15.88:0/3345679244 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d8009420 con 0x7f06e414b1e0 2023-12-08T08:21:10.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.392+0000 7f06e3fff640 1 --2- 172.21.15.88:0/3345679244 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06e40c5300 0x7f06e40a6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:10.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.396+0000 7f06e37fe640 1 --2- 172.21.15.88:0/3345679244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06e414b1e0 0x7f06e40a5da0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f06d80ae040 tx=0x7f06d8019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:10.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.396+0000 7f06e0ff9640 1 -- 172.21.15.88:0/3345679244 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d80b4410 con 0x7f06e414b1e0 2023-12-08T08:21:10.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.396+0000 7f06e0ff9640 1 -- 172.21.15.88:0/3345679244 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d80b4570 con 0x7f06e414b1e0 2023-12-08T08:21:10.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.396+0000 7f06e0ff9640 1 -- 172.21.15.88:0/3345679244 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d80b4900 con 0x7f06e414b1e0 2023-12-08T08:21:10.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.396+0000 7f06ea38d640 1 -- 172.21.15.88:0/3345679244 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e40a62e0 con 0x7f06e414b1e0 2023-12-08T08:21:10.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.396+0000 7f06ea38d640 1 -- 172.21.15.88:0/3345679244 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e41ee390 con 0x7f06e414b1e0 2023-12-08T08:21:10.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.396+0000 7f06ea38d640 1 -- 172.21.15.88:0/3345679244 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e40c3fc0 con 0x7f06e414b1e0 2023-12-08T08:21:10.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.396+0000 7f06e0ff9640 1 -- 172.21.15.88:0/3345679244 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f06d80b2040 con 0x7f06e414b1e0 2023-12-08T08:21:10.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.396+0000 7f06e0ff9640 1 --2- 172.21.15.88:0/3345679244 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f06d00664a0 0x7f06d0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:10.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.396+0000 7f06e0ff9640 1 -- 172.21.15.88:0/3345679244 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06d811ddc0 con 0x7f06e414b1e0 2023-12-08T08:21:10.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.396+0000 7f06e3fff640 1 --2- 172.21.15.88:0/3345679244 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f06d00664a0 0x7f06d0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:10.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.400+0000 7f06e3fff640 1 --2- 172.21.15.88:0/3345679244 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f06d00664a0 0x7f06d0068960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009bb0 tx=0x7f06d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:10.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.400+0000 7f06e0ff9640 1 -- 172.21.15.88:0/3345679244 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f06d80eb240 con 0x7f06e414b1e0 2023-12-08T08:21:10.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.604+0000 7f06ea38d640 1 -- 172.21.15.88:0/3345679244 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f06e41edf50 con 0x7f06e414b1e0 2023-12-08T08:21:10.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.604+0000 7f06e0ff9640 1 -- 172.21.15.88:0/3345679244 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f06d80b00b0 con 0x7f06e414b1e0 2023-12-08T08:21:10.612 INFO:teuthology.orchestra.run.smithi088.stdout:[client.0] 2023-12-08T08:21:10.612 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCJ0XJlCC1UNRAARGaNCoJFAvsCcXsQY6BjFg== 2023-12-08T08:21:10.612 INFO:teuthology.orchestra.run.smithi088.stdout: caps mds = "allow" 2023-12-08T08:21:10.612 INFO:teuthology.orchestra.run.smithi088.stdout: caps mon = "allow r" 2023-12-08T08:21:10.613 INFO:teuthology.orchestra.run.smithi088.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-08T08:21:10.613 INFO:teuthology.orchestra.run.smithi088.stderr:updated caps for client.0 2023-12-08T08:21:10.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.608+0000 7f06ea38d640 1 -- 172.21.15.88:0/3345679244 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f06d00664a0 msgr2=0x7f06d0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:10.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.608+0000 7f06ea38d640 1 --2- 172.21.15.88:0/3345679244 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f06d00664a0 0x7f06d0068960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009bb0 tx=0x7f06d4008040 comp rx=0 tx=0).stop 2023-12-08T08:21:10.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.608+0000 7f06ea38d640 1 -- 172.21.15.88:0/3345679244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06e414b1e0 msgr2=0x7f06e40a5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:10.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.608+0000 7f06ea38d640 1 --2- 172.21.15.88:0/3345679244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06e414b1e0 0x7f06e40a5da0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f06d80ae040 tx=0x7f06d8019200 comp rx=0 tx=0).stop 2023-12-08T08:21:10.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.608+0000 7f06ea38d640 1 -- 172.21.15.88:0/3345679244 shutdown_connections 2023-12-08T08:21:10.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.608+0000 7f06ea38d640 1 --2- 172.21.15.88:0/3345679244 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f06d00664a0 0x7f06d0068960 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.608+0000 7f06ea38d640 1 --2- 172.21.15.88:0/3345679244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06e4151280 0x7f06e406ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.608+0000 7f06ea38d640 1 --2- 172.21.15.88:0/3345679244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06e414b1e0 0x7f06e40a5da0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.608+0000 7f06ea38d640 1 --2- 172.21.15.88:0/3345679244 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f06e40c5300 0x7f06e40a6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.608+0000 7f06ea38d640 1 -- 172.21.15.88:0/3345679244 >> 172.21.15.88:0/3345679244 conn(0x7f06e40c59f0 msgr2=0x7f06e414f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:10.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.608+0000 7f06ea38d640 1 -- 172.21.15.88:0/3345679244 shutdown_connections 2023-12-08T08:21:10.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.608+0000 7f06ea38d640 1 -- 172.21.15.88:0/3345679244 wait complete. 2023-12-08T08:21:10.634 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:21:10.659 INFO:tasks.ceph.mds.a.smithi088.stderr:2023-12-08T08:21:10.652+0000 7f5e956e6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:21:10.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.764+0000 7f626ce74640 1 Processor -- start 2023-12-08T08:21:10.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.764+0000 7f626ce74640 1 -- start start 2023-12-08T08:21:10.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.768+0000 7f626ce74640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6268151b00 0x7f626806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:10.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.768+0000 7f626ce74640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f62680c8210 0x7f62680c4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:10.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.768+0000 7f626ce74640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6268155370 con 0x7f62680c4b40 2023-12-08T08:21:10.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.768+0000 7f626ce74640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f626806cae0 con 0x7f62680c8210 2023-12-08T08:21:10.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.768+0000 7f626ce74640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6268154550 con 0x7f6268151b00 2023-12-08T08:21:10.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.768+0000 7f6267fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f62680c4b40 0x7f62680c89e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57978/0 (socket says 172.21.15.88:57978) 2023-12-08T08:21:10.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.768+0000 7f6267fff640 1 -- 172.21.15.88:0/3058760465 learned_addr learned my addr 172.21.15.88:0/3058760465 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:10.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.768+0000 7f6266ffd640 1 --2- 172.21.15.88:0/3058760465 >> v2:172.21.15.148:3300/0 conn(0x7f62680c8210 0x7f62680c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:10.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.768+0000 7f62677fe640 1 --2- 172.21.15.88:0/3058760465 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6268151b00 0x7f626806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:10.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.768+0000 7f62667fc640 1 -- 172.21.15.88:0/3058760465 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3688538660 0 0) 0x7f6268155370 con 0x7f62680c4b40 2023-12-08T08:21:10.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.768+0000 7f62667fc640 1 -- 172.21.15.88:0/3058760465 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6250003530 con 0x7f62680c4b40 2023-12-08T08:21:10.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.768+0000 7f6266ffd640 1 -- 172.21.15.88:0/3058760465 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6268151b00 msgr2=0x7f626806c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:10.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.768+0000 7f6266ffd640 1 --2- 172.21.15.88:0/3058760465 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6268151b00 0x7f626806c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.768+0000 7f6266ffd640 1 -- 172.21.15.88:0/3058760465 >> v1:172.21.15.88:6789/0 conn(0x7f62680c4b40 legacy=0x7f62680c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:10.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.768+0000 7f6266ffd640 1 -- 172.21.15.88:0/3058760465 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6268154760 con 0x7f62680c8210 2023-12-08T08:21:10.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.768+0000 7f62677fe640 1 --2- 172.21.15.88:0/3058760465 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6268151b00 0x7f626806c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:21:10.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.772+0000 7f6266ffd640 1 --2- 172.21.15.88:0/3058760465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62680c8210 0x7f62680c4600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f625c0097c0 tx=0x7f625c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9a690d246440de9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:10.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.772+0000 7f62667fc640 1 -- 172.21.15.88:0/3058760465 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c0ab600 con 0x7f62680c8210 2023-12-08T08:21:10.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.772+0000 7f62667fc640 1 -- 172.21.15.88:0/3058760465 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625c0a7050 con 0x7f62680c8210 2023-12-08T08:21:10.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.772+0000 7f62667fc640 1 -- 172.21.15.88:0/3058760465 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c0ab980 con 0x7f62680c8210 2023-12-08T08:21:10.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.772+0000 7f626ce74640 1 -- 172.21.15.88:0/3058760465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62680c8210 msgr2=0x7f62680c4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:10.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.772+0000 7f626ce74640 1 --2- 172.21.15.88:0/3058760465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62680c8210 0x7f62680c4600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f625c0097c0 tx=0x7f625c01c3f0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.772+0000 7f626ce74640 1 -- 172.21.15.88:0/3058760465 shutdown_connections 2023-12-08T08:21:10.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.772+0000 7f626ce74640 1 --2- 172.21.15.88:0/3058760465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62680c8210 0x7f62680c4600 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.772+0000 7f626ce74640 1 --2- 172.21.15.88:0/3058760465 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6268151b00 0x7f626806c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.772+0000 7f626ce74640 1 -- 172.21.15.88:0/3058760465 >> 172.21.15.88:0/3058760465 conn(0x7f62680ab9c0 msgr2=0x7f62680abdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:10.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.772+0000 7f626ce74640 1 -- 172.21.15.88:0/3058760465 shutdown_connections 2023-12-08T08:21:10.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.772+0000 7f626ce74640 1 -- 172.21.15.88:0/3058760465 wait complete. 2023-12-08T08:21:10.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.772+0000 7f626ce74640 1 Processor -- start 2023-12-08T08:21:10.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.772+0000 7f626ce74640 1 -- start start 2023-12-08T08:21:10.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.776+0000 7f626ce74640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62680c4b40 0x7f62681ecaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:10.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.776+0000 7f626ce74640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f62680c8210 0x7f62680be830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:10.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.776+0000 7f626ce74640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6268151b00 0x7f62681ed480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:10.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.776+0000 7f626ce74640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62680bf2f0 con 0x7f62680c4b40 2023-12-08T08:21:10.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.776+0000 7f626ce74640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62681f02b0 con 0x7f6268151b00 2023-12-08T08:21:10.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.776+0000 7f626ce74640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62680bde10 con 0x7f62680c8210 2023-12-08T08:21:10.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.776+0000 7f62677fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62680c4b40 0x7f62681ecaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:10.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.776+0000 7f62677fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62680c4b40 0x7f62681ecaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47340/0 (socket says 172.21.15.88:47340) 2023-12-08T08:21:10.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.776+0000 7f62677fe640 1 -- 172.21.15.88:0/2925079134 learned_addr learned my addr 172.21.15.88:0/2925079134 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:10.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.776+0000 7f6266ffd640 1 --2- 172.21.15.88:0/2925079134 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f62680c8210 0x7f62680be830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:10.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.776+0000 7f6267fff640 1 --2- 172.21.15.88:0/2925079134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6268151b00 0x7f62681ed480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:10.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.776+0000 7f62677fe640 1 -- 172.21.15.88:0/2925079134 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f62680c8210 msgr2=0x7f62680be830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:10.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.776+0000 7f62677fe640 1 --2- 172.21.15.88:0/2925079134 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f62680c8210 0x7f62680be830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.776+0000 7f62677fe640 1 -- 172.21.15.88:0/2925079134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6268151b00 msgr2=0x7f62681ed480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:10.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.776+0000 7f62677fe640 1 --2- 172.21.15.88:0/2925079134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6268151b00 0x7f62681ed480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.776+0000 7f62677fe640 1 -- 172.21.15.88:0/2925079134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6258009420 con 0x7f62680c4b40 2023-12-08T08:21:10.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.776+0000 7f6267fff640 1 --2- 172.21.15.88:0/2925079134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6268151b00 0x7f62681ed480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:10.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.776+0000 7f62677fe640 1 --2- 172.21.15.88:0/2925079134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62680c4b40 0x7f62681ecaa0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f625800e9b0 tx=0x7f625800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:10.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.776+0000 7f624ffff640 1 -- 172.21.15.88:0/2925079134 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625800ca00 con 0x7f62680c4b40 2023-12-08T08:21:10.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.776+0000 7f624ffff640 1 -- 172.21.15.88:0/2925079134 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625800cb60 con 0x7f62680c4b40 2023-12-08T08:21:10.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.776+0000 7f624ffff640 1 -- 172.21.15.88:0/2925079134 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6258013470 con 0x7f62680c4b40 2023-12-08T08:21:10.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.776+0000 7f626ce74640 1 -- 172.21.15.88:0/2925079134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f625c009420 con 0x7f62680c4b40 2023-12-08T08:21:10.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.776+0000 7f626ce74640 1 -- 172.21.15.88:0/2925079134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62680bd850 con 0x7f62680c4b40 2023-12-08T08:21:10.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.776+0000 7f626ce74640 1 -- 172.21.15.88:0/2925079134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62681f0010 con 0x7f62680c4b40 2023-12-08T08:21:10.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.780+0000 7f624ffff640 1 -- 172.21.15.88:0/2925079134 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f62580135d0 con 0x7f62680c4b40 2023-12-08T08:21:10.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.780+0000 7f624ffff640 1 --2- 172.21.15.88:0/2925079134 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6254066470 0x7f6254068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:10.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.780+0000 7f624ffff640 1 -- 172.21.15.88:0/2925079134 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6258083ff0 con 0x7f62680c4b40 2023-12-08T08:21:10.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.780+0000 7f6266ffd640 1 --2- 172.21.15.88:0/2925079134 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6254066470 0x7f6254068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:10.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.780+0000 7f6266ffd640 1 --2- 172.21.15.88:0/2925079134 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6254066470 0x7f6254068930 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f625c0ad000 tx=0x7f625c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:10.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.784+0000 7f624ffff640 1 -- 172.21.15.88:0/2925079134 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f62681f0010 con 0x7f62680c4b40 2023-12-08T08:21:10.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.964+0000 7f626ce74640 1 -- 172.21.15.88:0/2925079134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62680674b0 con 0x7f62680c4b40 2023-12-08T08:21:10.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.964+0000 7f624ffff640 1 -- 172.21.15.88:0/2925079134 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f6258051570 con 0x7f62680c4b40 2023-12-08T08:21:10.971 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:10.971 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4978,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3372523869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3372523869},{"type":"v1","addr":"172.21.15.148:6834","nonce":3372523869}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4085245492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":4085245492},{"type":"v1","addr":"172.21.15.148:6835","nonce":4085245492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5046,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/4274252181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":4274252181},{"type":"v1","addr":"172.21.15.88:6836","nonce":4274252181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:21:05.130882+0000","modified":"2023-12-08T08:21:08.148991+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5049},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5049":{"gid":5049,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/181654220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":181654220},{"type":"v1","addr":"172.21.15.88:6837","nonce":181654220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-08T08:21:10.971 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 17 2023-12-08T08:21:10.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.964+0000 7f626ce74640 1 -- 172.21.15.88:0/2925079134 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6254066470 msgr2=0x7f6254068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:10.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.964+0000 7f626ce74640 1 --2- 172.21.15.88:0/2925079134 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6254066470 0x7f6254068930 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f625c0ad000 tx=0x7f625c008040 comp rx=0 tx=0).stop 2023-12-08T08:21:10.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.964+0000 7f626ce74640 1 -- 172.21.15.88:0/2925079134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62680c4b40 msgr2=0x7f62681ecaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:10.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.964+0000 7f626ce74640 1 --2- 172.21.15.88:0/2925079134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62680c4b40 0x7f62681ecaa0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f625800e9b0 tx=0x7f625800ee70 comp rx=0 tx=0).stop 2023-12-08T08:21:10.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.964+0000 7f626ce74640 1 -- 172.21.15.88:0/2925079134 shutdown_connections 2023-12-08T08:21:10.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.964+0000 7f626ce74640 1 --2- 172.21.15.88:0/2925079134 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6254066470 0x7f6254068930 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.964+0000 7f626ce74640 1 --2- 172.21.15.88:0/2925079134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6268151b00 0x7f62681ed480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.964+0000 7f626ce74640 1 --2- 172.21.15.88:0/2925079134 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f62680c8210 0x7f62680be830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.964+0000 7f626ce74640 1 --2- 172.21.15.88:0/2925079134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62680c4b40 0x7f62681ecaa0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:10.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.964+0000 7f626ce74640 1 -- 172.21.15.88:0/2925079134 >> 172.21.15.88:0/2925079134 conn(0x7f62680ab9c0 msgr2=0x7f6268150990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:10.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.964+0000 7f626ce74640 1 -- 172.21.15.88:0/2925079134 shutdown_connections 2023-12-08T08:21:10.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:10.964+0000 7f626ce74640 1 -- 172.21.15.88:0/2925079134 wait complete. 2023-12-08T08:21:11.394 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-08T08:21:05.130882+0000', 'modified': '2023-12-08T08:21:08.148991+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5049}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5049': {'gid': 5049, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.88:6837/181654220', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6835', 'nonce': 181654220}, {'type': 'v1', 'addr': '172.21.15.88:6837', 'nonce': 181654220}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-08T08:21:11.394 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-08T08:21:11.394 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-08T08:21:11.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.528+0000 7f9f47e68640 1 Processor -- start 2023-12-08T08:21:11.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.528+0000 7f9f47e68640 1 -- start start 2023-12-08T08:21:11.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.528+0000 7f9f47e68640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f40151a20 0x7f9f4006df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:11.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.532+0000 7f9f47e68640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9f40154410 0x7f9f4006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:11.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.532+0000 7f9f47e68640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9f4006bb00 0x7f9f401580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:11.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.532+0000 7f9f47e68640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f400c2640 con 0x7f9f4006bb00 2023-12-08T08:21:11.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.532+0000 7f9f47e68640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f400c2220 con 0x7f9f40154410 2023-12-08T08:21:11.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.532+0000 7f9f47e68640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f400c1980 con 0x7f9f40151a20 2023-12-08T08:21:11.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.532+0000 7f9f46405640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9f4006bb00 0x7f9f401580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:11.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.532+0000 7f9f46405640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9f4006bb00 0x7f9f401580c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47356/0 (socket says 172.21.15.88:47356) 2023-12-08T08:21:11.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.532+0000 7f9f45403640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9f40154410 0x7f9f4006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:11.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.532+0000 7f9f46405640 1 -- 172.21.15.88:0/265913171 learned_addr learned my addr 172.21.15.88:0/265913171 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:11.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.532+0000 7f9f45c04640 1 --2- 172.21.15.88:0/265913171 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f40151a20 0x7f9f4006df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:11.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.532+0000 7f9f46405640 1 -- 172.21.15.88:0/265913171 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f40151a20 msgr2=0x7f9f4006df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:11.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.532+0000 7f9f46405640 1 --2- 172.21.15.88:0/265913171 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f40151a20 0x7f9f4006df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.532+0000 7f9f46405640 1 -- 172.21.15.88:0/265913171 >> v2:172.21.15.148:3300/0 conn(0x7f9f40154410 msgr2=0x7f9f4006b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:11.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.532+0000 7f9f46405640 1 --2- 172.21.15.88:0/265913171 >> v2:172.21.15.148:3300/0 conn(0x7f9f40154410 0x7f9f4006b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.532+0000 7f9f46405640 1 -- 172.21.15.88:0/265913171 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f400c1c60 con 0x7f9f4006bb00 2023-12-08T08:21:11.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.532+0000 7f9f46405640 1 --2- 172.21.15.88:0/265913171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f4006bb00 0x7f9f401580c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9f4006d1a0 tx=0x7f9f3801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30bc55f3766d282d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:11.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.536+0000 7f9f44c02640 1 -- 172.21.15.88:0/265913171 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f380a55c0 con 0x7f9f4006bb00 2023-12-08T08:21:11.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.536+0000 7f9f44c02640 1 -- 172.21.15.88:0/265913171 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f380a5720 con 0x7f9f4006bb00 2023-12-08T08:21:11.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.536+0000 7f9f44c02640 1 -- 172.21.15.88:0/265913171 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f380a5ab0 con 0x7f9f4006bb00 2023-12-08T08:21:11.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.536+0000 7f9f47e68640 1 -- 172.21.15.88:0/265913171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f4006bb00 msgr2=0x7f9f401580c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:11.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.536+0000 7f9f47e68640 1 --2- 172.21.15.88:0/265913171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f4006bb00 0x7f9f401580c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9f4006d1a0 tx=0x7f9f3801c940 comp rx=0 tx=0).stop 2023-12-08T08:21:11.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.536+0000 7f9f47e68640 1 -- 172.21.15.88:0/265913171 shutdown_connections 2023-12-08T08:21:11.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.536+0000 7f9f47e68640 1 --2- 172.21.15.88:0/265913171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f4006bb00 0x7f9f401580c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.536+0000 7f9f47e68640 1 --2- 172.21.15.88:0/265913171 >> v2:172.21.15.148:3300/0 conn(0x7f9f40154410 0x7f9f4006b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.536+0000 7f9f47e68640 1 --2- 172.21.15.88:0/265913171 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f40151a20 0x7f9f4006df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.536+0000 7f9f47e68640 1 -- 172.21.15.88:0/265913171 >> 172.21.15.88:0/265913171 conn(0x7f9f400c2e20 msgr2=0x7f9f400c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:11.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.536+0000 7f9f47e68640 1 -- 172.21.15.88:0/265913171 shutdown_connections 2023-12-08T08:21:11.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.536+0000 7f9f47e68640 1 -- 172.21.15.88:0/265913171 wait complete. 2023-12-08T08:21:11.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.536+0000 7f9f47e68640 1 Processor -- start 2023-12-08T08:21:11.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.536+0000 7f9f47e68640 1 -- start start 2023-12-08T08:21:11.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.536+0000 7f9f47e68640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f4006bb00 0x7f9f401f09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:11.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.536+0000 7f9f47e68640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f40151a20 0x7f9f4014f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:11.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.536+0000 7f9f47e68640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f40154410 0x7f9f40149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:11.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.536+0000 7f9f47e68640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f401f0f00 con 0x7f9f40154410 2023-12-08T08:21:11.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.536+0000 7f9f47e68640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f401568a0 con 0x7f9f4006bb00 2023-12-08T08:21:11.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.536+0000 7f9f47e68640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f40156000 con 0x7f9f40151a20 2023-12-08T08:21:11.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.536+0000 7f9f46405640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f40154410 0x7f9f40149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:11.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.540+0000 7f9f46405640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f40154410 0x7f9f40149140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47362/0 (socket says 172.21.15.88:47362) 2023-12-08T08:21:11.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.540+0000 7f9f46405640 1 -- 172.21.15.88:0/944131048 learned_addr learned my addr 172.21.15.88:0/944131048 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:11.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.540+0000 7f9f45c04640 1 --2- 172.21.15.88:0/944131048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f4006bb00 0x7f9f401f09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:11.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.540+0000 7f9f45403640 1 --2- 172.21.15.88:0/944131048 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f40151a20 0x7f9f4014f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:11.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.540+0000 7f9f46405640 1 -- 172.21.15.88:0/944131048 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f40151a20 msgr2=0x7f9f4014f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:11.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.540+0000 7f9f46405640 1 --2- 172.21.15.88:0/944131048 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f40151a20 0x7f9f4014f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.540+0000 7f9f46405640 1 -- 172.21.15.88:0/944131048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f4006bb00 msgr2=0x7f9f401f09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:11.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.540+0000 7f9f46405640 1 --2- 172.21.15.88:0/944131048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f4006bb00 0x7f9f401f09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.540+0000 7f9f46405640 1 -- 172.21.15.88:0/944131048 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f38009b30 con 0x7f9f40154410 2023-12-08T08:21:11.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.540+0000 7f9f46405640 1 --2- 172.21.15.88:0/944131048 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f40154410 0x7f9f40149140 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9f380af040 tx=0x7f9f380196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:11.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.540+0000 7f9f367fc640 1 -- 172.21.15.88:0/944131048 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f380a55c0 con 0x7f9f40154410 2023-12-08T08:21:11.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.540+0000 7f9f367fc640 1 -- 172.21.15.88:0/944131048 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f380b8690 con 0x7f9f40154410 2023-12-08T08:21:11.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.540+0000 7f9f367fc640 1 -- 172.21.15.88:0/944131048 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f380b8a40 con 0x7f9f40154410 2023-12-08T08:21:11.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.540+0000 7f9f47e68640 1 -- 172.21.15.88:0/944131048 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f401562e0 con 0x7f9f40154410 2023-12-08T08:21:11.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.540+0000 7f9f47e68640 1 -- 172.21.15.88:0/944131048 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4014a500 con 0x7f9f40154410 2023-12-08T08:21:11.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.540+0000 7f9f367fc640 1 -- 172.21.15.88:0/944131048 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9f380b8ba0 con 0x7f9f40154410 2023-12-08T08:21:11.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f367fc640 1 --2- 172.21.15.88:0/944131048 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9f24066470 0x7f9f24068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:11.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f367fc640 1 -- 172.21.15.88:0/944131048 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f3811f080 con 0x7f9f40154410 2023-12-08T08:21:11.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f45c04640 1 --2- 172.21.15.88:0/944131048 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9f24066470 0x7f9f24068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:11.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f4b1c7000 1 Processor -- start 2023-12-08T08:21:11.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f4b1c7000 1 -- start start 2023-12-08T08:21:11.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f45c04640 1 --2- 172.21.15.88:0/944131048 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9f24066470 0x7f9f24068930 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009a40 tx=0x7f9f3c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:11.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f4b1c7000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790e2e0 0x561c0790e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:11.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f4b1c7000 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561c0790ec00 0x561c0790efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:11.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f4b1c7000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c0790f520 0x561c07958a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:11.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f4b1c7000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c0777b130 con 0x561c0790e2e0 2023-12-08T08:21:11.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f4b1c7000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c077689a0 con 0x561c0790f520 2023-12-08T08:21:11.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f4b1c7000 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c07765ed0 con 0x561c0790ec00 2023-12-08T08:21:11.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f45c04640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790e2e0 0x561c0790e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:11.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f45c04640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790e2e0 0x561c0790e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47378/0 (socket says 172.21.15.88:47378) 2023-12-08T08:21:11.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f45c04640 1 -- 172.21.15.88:0/2068954027 learned_addr learned my addr 172.21.15.88:0/2068954027 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:11.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f46405640 1 --2- 172.21.15.88:0/2068954027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c0790f520 0x561c07958a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:11.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f45403640 1 --2- 172.21.15.88:0/2068954027 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561c0790ec00 0x561c0790efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:11.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f45c04640 1 -- 172.21.15.88:0/2068954027 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561c0790ec00 msgr2=0x561c0790efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:11.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f45c04640 1 --2- 172.21.15.88:0/2068954027 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561c0790ec00 0x561c0790efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f45c04640 1 -- 172.21.15.88:0/2068954027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c0790f520 msgr2=0x561c07958a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:11.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f45c04640 1 --2- 172.21.15.88:0/2068954027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c0790f520 0x561c07958a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f45c04640 1 -- 172.21.15.88:0/2068954027 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c07459890 con 0x561c0790e2e0 2023-12-08T08:21:11.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f46405640 1 --2- 172.21.15.88:0/2068954027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c0790f520 0x561c07958a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:11.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f45c04640 1 --2- 172.21.15.88:0/2068954027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790e2e0 0x561c0790e6c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c011dc0 tx=0x7f9f3c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a1e11636fc0972 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:11.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f237fe640 1 -- 172.21.15.88:0/2068954027 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c01c040 con 0x561c0790e2e0 2023-12-08T08:21:11.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f237fe640 1 -- 172.21.15.88:0/2068954027 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3c003830 con 0x561c0790e2e0 2023-12-08T08:21:11.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f237fe640 1 -- 172.21.15.88:0/2068954027 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c003bc0 con 0x561c0790e2e0 2023-12-08T08:21:11.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f4b1c7000 1 -- 172.21.15.88:0/2068954027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790e2e0 msgr2=0x561c0790e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:11.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f4b1c7000 1 --2- 172.21.15.88:0/2068954027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790e2e0 0x561c0790e6c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c011dc0 tx=0x7f9f3c014000 comp rx=0 tx=0).stop 2023-12-08T08:21:11.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f4b1c7000 1 -- 172.21.15.88:0/2068954027 shutdown_connections 2023-12-08T08:21:11.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f4b1c7000 1 --2- 172.21.15.88:0/2068954027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c0790f520 0x561c07958a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f4b1c7000 1 --2- 172.21.15.88:0/2068954027 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561c0790ec00 0x561c0790efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f4b1c7000 1 --2- 172.21.15.88:0/2068954027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790e2e0 0x561c0790e6c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f4b1c7000 1 -- 172.21.15.88:0/2068954027 >> 172.21.15.88:0/2068954027 conn(0x561c07917190 msgr2=0x561c0794e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:11.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f4b1c7000 1 -- 172.21.15.88:0/2068954027 shutdown_connections 2023-12-08T08:21:11.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.544+0000 7f9f4b1c7000 1 -- 172.21.15.88:0/2068954027 wait complete. 2023-12-08T08:21:11.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f4b1c7000 1 -- start start 2023-12-08T08:21:11.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f4b1c7000 1 Processor -- start 2023-12-08T08:21:11.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f4b1c7000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c0790e2e0 0x561c0794b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:11.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f4b1c7000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790ec00 0x561c07914b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:11.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f4b1c7000 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561c0790f520 0x561c07915040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:11.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f4b1c7000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c077617c0 con 0x561c0790ec00 2023-12-08T08:21:11.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f4b1c7000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c07719bf0 con 0x561c0790e2e0 2023-12-08T08:21:11.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f4b1c7000 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c0771fa90 con 0x561c0790f520 2023-12-08T08:21:11.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f4b1c7000 10 client.0 _ll_register_callbacks cb 0x561c078fc3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T08:21:11.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f45403640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790ec00 0x561c07914b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:11.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f45403640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790ec00 0x561c07914b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47382/0 (socket says 172.21.15.88:47382) 2023-12-08T08:21:11.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f45403640 1 -- 172.21.15.88:0/3435054641 learned_addr learned my addr 172.21.15.88:0/3435054641 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:11.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f46405640 1 --2- 172.21.15.88:0/3435054641 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561c0790f520 0x561c07915040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:11.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f45c04640 1 --2- 172.21.15.88:0/3435054641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c0790e2e0 0x561c0794b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:11.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f45403640 1 -- 172.21.15.88:0/3435054641 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561c0790f520 msgr2=0x561c07915040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:11.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f45403640 1 --2- 172.21.15.88:0/3435054641 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561c0790f520 0x561c07915040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f45403640 1 -- 172.21.15.88:0/3435054641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c0790e2e0 msgr2=0x561c0794b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:11.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f45403640 1 --2- 172.21.15.88:0/3435054641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c0790e2e0 0x561c0794b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f45403640 1 -- 172.21.15.88:0/3435054641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f3c011aa0 con 0x561c0790ec00 2023-12-08T08:21:11.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f45403640 1 --2- 172.21.15.88:0/3435054641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790ec00 0x561c07914b00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9f30014600 tx=0x7f9f30014a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e3c98145f63b6f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:11.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f20ff9640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-12-08T08:21:11.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f20ff9640 1 -- 172.21.15.88:0/3435054641 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f30004240 con 0x561c0790ec00 2023-12-08T08:21:11.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f20ff9640 1 -- 172.21.15.88:0/3435054641 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f3001a070 con 0x561c0790ec00 2023-12-08T08:21:11.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f4b1c7000 1 -- 172.21.15.88:0/3435054641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c07723470 con 0x561c0790ec00 2023-12-08T08:21:11.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f20ff9640 1 -- 172.21.15.88:0/3435054641 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f300043a0 con 0x561c0790ec00 2023-12-08T08:21:11.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f4b1c7000 10 client.5223 fetch_fsmap learned FSMap version 17 2023-12-08T08:21:11.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f4b1c7000 1 -- 172.21.15.88:0/3435054641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x561c07722190 con 0x561c0790ec00 2023-12-08T08:21:11.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f20ff9640 1 -- 172.21.15.88:0/3435054641 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561c07723470 con 0x561c0790ec00 2023-12-08T08:21:11.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f20ff9640 1 -- 172.21.15.88:0/3435054641 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9f30011070 con 0x561c0790ec00 2023-12-08T08:21:11.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f4b1c7000 10 client.5223 fetch_fsmap finished waiting for FSMap version 17 2023-12-08T08:21:11.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f4b1c7000 10 client.5223 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-08T08:21:11.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f4b1c7000 20 client.5223 populate_metadata read hostname 'smithi088' 2023-12-08T08:21:11.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f4b1c7000 1 --2- 172.21.15.88:0/3435054641 >> [v2:172.21.15.88:6835/181654220,v1:172.21.15.88:6837/181654220] conn(0x561c07915a50 0x561c07915e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:11.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f4b1c7000 4 client.5223 mds_command: new command op to 5049 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-08T08:21:11.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f4b1c7000 1 -- 172.21.15.88:0/3435054641 --> [v2:172.21.15.88:6835/181654220,v1:172.21.15.88:6837/181654220] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561c07726b50 con 0x561c07915a50 2023-12-08T08:21:11.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.548+0000 7f9f45c04640 1 --2- 172.21.15.88:0/3435054641 >> [v2:172.21.15.88:6835/181654220,v1:172.21.15.88:6837/181654220] conn(0x561c07915a50 0x561c07915e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:11.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.552+0000 7f9f45c04640 1 --2- 172.21.15.88:0/3435054641 >> [v2:172.21.15.88:6835/181654220,v1:172.21.15.88:6837/181654220] conn(0x561c07915a50 0x561c07915e30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=503a659292dcacbd server_cookie=e37812253201e928 in_seq=0 out_seq=0 2023-12-08T08:21:11.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.552+0000 7f9f20ff9640 10 client.5223 ms_handle_connect on v2:172.21.15.88:6835/181654220 2023-12-08T08:21:11.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.552+0000 7f9f20ff9640 1 -- 172.21.15.88:0/3435054641 <== mds.0 v2:172.21.15.88:6835/181654220 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x561c07726b50 con 0x561c07915a50 2023-12-08T08:21:11.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.552+0000 7f9f20ff9640 10 client.5223 handle_command_reply: tid=0 2023-12-08T08:21:11.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.552+0000 7f9f4b1c7000 1 client.5223 shutdown 2023-12-08T08:21:11.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.552+0000 7f9f4b1c7000 1 -- 172.21.15.88:0/3435054641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790ec00 msgr2=0x561c07914b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:11.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.552+0000 7f9f4b1c7000 1 --2- 172.21.15.88:0/3435054641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790ec00 0x561c07914b00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9f30014600 tx=0x7f9f30014a00 comp rx=0 tx=0).stop 2023-12-08T08:21:11.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.552+0000 7f9f4b1c7000 1 -- 172.21.15.88:0/3435054641 shutdown_connections 2023-12-08T08:21:11.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.552+0000 7f9f4b1c7000 1 --2- 172.21.15.88:0/3435054641 >> [v2:172.21.15.88:6835/181654220,v1:172.21.15.88:6837/181654220] conn(0x561c07915a50 0x561c07915e30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.552+0000 7f9f4b1c7000 1 --2- 172.21.15.88:0/3435054641 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561c0790f520 0x561c07915040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.552+0000 7f9f4b1c7000 1 --2- 172.21.15.88:0/3435054641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790ec00 0x561c07914b00 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.552+0000 7f9f4b1c7000 1 --2- 172.21.15.88:0/3435054641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c0790e2e0 0x561c0794b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.552+0000 7f9f4b1c7000 1 -- 172.21.15.88:0/3435054641 >> 172.21.15.88:0/3435054641 conn(0x561c07917190 msgr2=0x561c0790d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:11.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.552+0000 7f9f20ff9640 0 client.5223 ms_handle_reset on v2:172.21.15.88:6835/181654220 2023-12-08T08:21:11.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.552+0000 7f9f4b1c7000 1 -- 172.21.15.88:0/3435054641 shutdown_connections 2023-12-08T08:21:11.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.552+0000 7f9f4b1c7000 1 -- 172.21.15.88:0/3435054641 wait complete. 2023-12-08T08:21:11.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.552+0000 7f9f4b1c7000 20 client.5223 trim_cache size 0 max 16384 2023-12-08T08:21:11.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.568+0000 7f9f4b1c7000 1 Processor -- start 2023-12-08T08:21:11.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.568+0000 7f9f4b1c7000 1 -- start start 2023-12-08T08:21:11.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.568+0000 7f9f4b1c7000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c0790e2e0 0x561c07969220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:11.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.568+0000 7f9f4b1c7000 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561c0790ec00 0x561c079148b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:11.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.568+0000 7f9f4b1c7000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790f520 0x561c07914df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:11.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.568+0000 7f9f4b1c7000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c0741a940 con 0x561c0790f520 2023-12-08T08:21:11.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.568+0000 7f9f4b1c7000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c07760650 con 0x561c0790e2e0 2023-12-08T08:21:11.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.568+0000 7f9f4b1c7000 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c0775d130 con 0x561c0790ec00 2023-12-08T08:21:11.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.568+0000 7f9f46405640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790f520 0x561c07914df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:11.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.568+0000 7f9f46405640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790f520 0x561c07914df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47384/0 (socket says 172.21.15.88:47384) 2023-12-08T08:21:11.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.568+0000 7f9f46405640 1 -- 172.21.15.88:0/534331068 learned_addr learned my addr 172.21.15.88:0/534331068 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:11.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.568+0000 7f9f46405640 1 -- 172.21.15.88:0/534331068 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561c0790ec00 msgr2=0x561c079148b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:11.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.568+0000 7f9f46405640 1 --2- 172.21.15.88:0/534331068 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561c0790ec00 0x561c079148b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.568+0000 7f9f46405640 1 -- 172.21.15.88:0/534331068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c0790e2e0 msgr2=0x561c07969220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:11.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.568+0000 7f9f46405640 1 --2- 172.21.15.88:0/534331068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c0790e2e0 0x561c07969220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.568+0000 7f9f46405640 1 -- 172.21.15.88:0/534331068 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c07708490 con 0x561c0790f520 2023-12-08T08:21:11.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.568+0000 7f9f46405640 1 --2- 172.21.15.88:0/534331068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790f520 0x561c07914df0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9f380eff90 tx=0x7f9f38009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b62d54a9db776d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:11.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.568+0000 7f9f23fff640 1 -- 172.21.15.88:0/534331068 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f380f4330 con 0x561c0790f520 2023-12-08T08:21:11.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.568+0000 7f9f23fff640 1 -- 172.21.15.88:0/534331068 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f380f84e0 con 0x561c0790f520 2023-12-08T08:21:11.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.568+0000 7f9f23fff640 1 -- 172.21.15.88:0/534331068 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f380ee3d0 con 0x561c0790f520 2023-12-08T08:21:11.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.568+0000 7f9f4b1c7000 1 -- 172.21.15.88:0/534331068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790f520 msgr2=0x561c07914df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:11.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.568+0000 7f9f4b1c7000 1 --2- 172.21.15.88:0/534331068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790f520 0x561c07914df0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9f380eff90 tx=0x7f9f38009040 comp rx=0 tx=0).stop 2023-12-08T08:21:11.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f4b1c7000 1 -- 172.21.15.88:0/534331068 shutdown_connections 2023-12-08T08:21:11.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f4b1c7000 1 --2- 172.21.15.88:0/534331068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790f520 0x561c07914df0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f4b1c7000 1 --2- 172.21.15.88:0/534331068 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561c0790ec00 0x561c079148b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f4b1c7000 1 --2- 172.21.15.88:0/534331068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c0790e2e0 0x561c07969220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f4b1c7000 1 -- 172.21.15.88:0/534331068 >> 172.21.15.88:0/534331068 conn(0x561c07917190 msgr2=0x561c07915e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:11.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f4b1c7000 1 -- 172.21.15.88:0/534331068 shutdown_connections 2023-12-08T08:21:11.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f4b1c7000 1 -- 172.21.15.88:0/534331068 wait complete. 2023-12-08T08:21:11.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f4b1c7000 1 -- start start 2023-12-08T08:21:11.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f4b1c7000 1 Processor -- start 2023-12-08T08:21:11.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f4b1c7000 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561c0790e2e0 0x561c079148f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:11.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f4b1c7000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790ec00 0x561c079651e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:11.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f4b1c7000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c0790f520 0x561c07965720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:11.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f4b1c7000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c076fc8a0 con 0x561c0790ec00 2023-12-08T08:21:11.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f4b1c7000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c0775efd0 con 0x561c0790f520 2023-12-08T08:21:11.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f4b1c7000 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c0745a1b0 con 0x561c0790e2e0 2023-12-08T08:21:11.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f4b1c7000 10 client.0 _ll_register_callbacks cb 0x561c078dcbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T08:21:11.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f45403640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790ec00 0x561c079651e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:11.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f45403640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790ec00 0x561c079651e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47390/0 (socket says 172.21.15.88:47390) 2023-12-08T08:21:11.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f45403640 1 -- 172.21.15.88:0/2612374560 learned_addr learned my addr 172.21.15.88:0/2612374560 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:11.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f45c04640 1 --2- 172.21.15.88:0/2612374560 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561c0790e2e0 0x561c079148f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:11.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f46405640 1 --2- 172.21.15.88:0/2612374560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c0790f520 0x561c07965720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:11.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f45403640 1 -- 172.21.15.88:0/2612374560 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561c0790e2e0 msgr2=0x561c079148f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:11.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f45403640 1 --2- 172.21.15.88:0/2612374560 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561c0790e2e0 0x561c079148f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f45403640 1 -- 172.21.15.88:0/2612374560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c0790f520 msgr2=0x561c07965720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:11.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f45403640 1 --2- 172.21.15.88:0/2612374560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c0790f520 0x561c07965720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f45403640 1 -- 172.21.15.88:0/2612374560 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4014a500 con 0x561c0790ec00 2023-12-08T08:21:11.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f45403640 1 --2- 172.21.15.88:0/2612374560 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790ec00 0x561c079651e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9f30014a40 tx=0x7f9f300046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c21cb0fecb25b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:11.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f20ff9640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-12-08T08:21:11.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f20ff9640 1 -- 172.21.15.88:0/2612374560 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f300143c0 con 0x561c0790ec00 2023-12-08T08:21:11.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f20ff9640 1 -- 172.21.15.88:0/2612374560 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f30009d90 con 0x561c0790ec00 2023-12-08T08:21:11.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f4b1c7000 1 -- 172.21.15.88:0/2612374560 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c07760110 con 0x561c0790ec00 2023-12-08T08:21:11.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f20ff9640 1 -- 172.21.15.88:0/2612374560 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f300164f0 con 0x561c0790ec00 2023-12-08T08:21:11.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f4b1c7000 10 client.5229 fetch_fsmap learned FSMap version 17 2023-12-08T08:21:11.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f4b1c7000 1 -- 172.21.15.88:0/2612374560 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x561c07459cc0 con 0x561c0790ec00 2023-12-08T08:21:11.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f20ff9640 1 -- 172.21.15.88:0/2612374560 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561c07760110 con 0x561c0790ec00 2023-12-08T08:21:11.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f20ff9640 1 -- 172.21.15.88:0/2612374560 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9f30034070 con 0x561c0790ec00 2023-12-08T08:21:11.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f4b1c7000 10 client.5229 fetch_fsmap finished waiting for FSMap version 17 2023-12-08T08:21:11.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f4b1c7000 10 client.5229 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-08T08:21:11.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f4b1c7000 20 client.5229 populate_metadata read hostname 'smithi088' 2023-12-08T08:21:11.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f4b1c7000 1 --2- 172.21.15.88:0/2612374560 >> [v2:172.21.15.88:6835/181654220,v1:172.21.15.88:6837/181654220] conn(0x561c07914e30 0x561c07965c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:11.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f4b1c7000 4 client.5229 mds_command: new command op to 5049 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-08T08:21:11.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.572+0000 7f9f4b1c7000 1 -- 172.21.15.88:0/2612374560 --> [v2:172.21.15.88:6835/181654220,v1:172.21.15.88:6837/181654220] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561c0778f9a0 con 0x561c07914e30 2023-12-08T08:21:11.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f45c04640 1 --2- 172.21.15.88:0/2612374560 >> [v2:172.21.15.88:6835/181654220,v1:172.21.15.88:6837/181654220] conn(0x561c07914e30 0x561c07965c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:11.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f45c04640 1 --2- 172.21.15.88:0/2612374560 >> [v2:172.21.15.88:6835/181654220,v1:172.21.15.88:6837/181654220] conn(0x561c07914e30 0x561c07965c60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6f6c3f889a1536 server_cookie=553dea79d2e3934d in_seq=0 out_seq=0 2023-12-08T08:21:11.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f20ff9640 10 client.5229 ms_handle_connect on v2:172.21.15.88:6835/181654220 2023-12-08T08:21:11.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f20ff9640 1 -- 172.21.15.88:0/2612374560 <== mds.0 v2:172.21.15.88:6835/181654220 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7f9f3c018160 con 0x561c07914e30 2023-12-08T08:21:11.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f20ff9640 10 client.5229 handle_command_reply: tid=0 2023-12-08T08:21:11.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f4b1c7000 1 client.5229 shutdown 2023-12-08T08:21:11.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f4b1c7000 1 -- 172.21.15.88:0/2612374560 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790ec00 msgr2=0x561c079651e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:11.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f4b1c7000 1 --2- 172.21.15.88:0/2612374560 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790ec00 0x561c079651e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9f30014a40 tx=0x7f9f300046d0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f4b1c7000 1 -- 172.21.15.88:0/2612374560 shutdown_connections 2023-12-08T08:21:11.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f4b1c7000 1 --2- 172.21.15.88:0/2612374560 >> [v2:172.21.15.88:6835/181654220,v1:172.21.15.88:6837/181654220] conn(0x561c07914e30 0x561c07965c60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f4b1c7000 1 --2- 172.21.15.88:0/2612374560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c0790f520 0x561c07965720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f4b1c7000 1 --2- 172.21.15.88:0/2612374560 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561c0790ec00 0x561c079651e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f4b1c7000 1 --2- 172.21.15.88:0/2612374560 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x561c0790e2e0 0x561c079148f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f20ff9640 0 client.5229 ms_handle_reset on v2:172.21.15.88:6835/181654220 2023-12-08T08:21:11.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f4b1c7000 1 -- 172.21.15.88:0/2612374560 >> 172.21.15.88:0/2612374560 conn(0x561c07917190 msgr2=0x561c0795f840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:11.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f4b1c7000 1 -- 172.21.15.88:0/2612374560 shutdown_connections 2023-12-08T08:21:11.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f4b1c7000 1 -- 172.21.15.88:0/2612374560 wait complete. 2023-12-08T08:21:11.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f4b1c7000 20 client.5229 trim_cache size 0 max 16384 2023-12-08T08:21:11.588 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-08T08:21:11.588 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_fsid": "681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3", 2023-12-08T08:21:11.588 INFO:teuthology.orchestra.run.smithi088.stdout: "whoami": 0, 2023-12-08T08:21:11.588 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 5049, 2023-12-08T08:21:11.588 INFO:teuthology.orchestra.run.smithi088.stdout: "want_state": "up:active", 2023-12-08T08:21:11.588 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "up:active", 2023-12-08T08:21:11.588 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs", 2023-12-08T08:21:11.588 INFO:teuthology.orchestra.run.smithi088.stdout: "rank_uptime": 5.8159900709999999, 2023-12-08T08:21:11.589 INFO:teuthology.orchestra.run.smithi088.stdout: "mdsmap_epoch": 17, 2023-12-08T08:21:11.589 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch": 31, 2023-12-08T08:21:11.589 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch_barrier": 31, 2023-12-08T08:21:11.589 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 12.719777065000001 2023-12-08T08:21:11.589 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-08T08:21:11.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f47e68640 1 -- 172.21.15.88:0/944131048 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9f24066470 msgr2=0x7f9f24068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:11.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f47e68640 1 --2- 172.21.15.88:0/944131048 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9f24066470 0x7f9f24068930 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009a40 tx=0x7f9f3c009190 comp rx=0 tx=0).stop 2023-12-08T08:21:11.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f47e68640 1 -- 172.21.15.88:0/944131048 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f40154410 msgr2=0x7f9f40149140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:11.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f47e68640 1 --2- 172.21.15.88:0/944131048 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f40154410 0x7f9f40149140 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9f380af040 tx=0x7f9f380196e0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f47e68640 1 -- 172.21.15.88:0/944131048 shutdown_connections 2023-12-08T08:21:11.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f47e68640 1 --2- 172.21.15.88:0/944131048 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9f24066470 0x7f9f24068930 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f47e68640 1 --2- 172.21.15.88:0/944131048 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f40154410 0x7f9f40149140 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f47e68640 1 --2- 172.21.15.88:0/944131048 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f40151a20 0x7f9f4014f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f47e68640 1 --2- 172.21.15.88:0/944131048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f4006bb00 0x7f9f401f09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f47e68640 1 -- 172.21.15.88:0/944131048 >> 172.21.15.88:0/944131048 conn(0x7f9f400c2e20 msgr2=0x7f9f4006e620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:11.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f47e68640 1 -- 172.21.15.88:0/944131048 shutdown_connections 2023-12-08T08:21:11.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.576+0000 7f9f47e68640 1 -- 172.21.15.88:0/944131048 wait complete. 2023-12-08T08:21:11.602 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:21:11.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.736+0000 7fb70d66b640 1 Processor -- start 2023-12-08T08:21:11.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.736+0000 7fb70d66b640 1 -- start start 2023-12-08T08:21:11.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.736+0000 7fb70d66b640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb708072850 0x7fb7080a6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:11.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.736+0000 7fb70d66b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb70806b060 con 0x7fb708154520 2023-12-08T08:21:11.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.736+0000 7fb70d66b640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb70806b300 con 0x7fb708151e80 2023-12-08T08:21:11.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.736+0000 7fb70d66b640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb708070d30 con 0x7fb708072850 2023-12-08T08:21:11.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.736+0000 7fb7077fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb708154520 0x7fb7081549d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57990/0 (socket says 172.21.15.88:57990) 2023-12-08T08:21:11.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.736+0000 7fb7077fe640 1 -- 172.21.15.88:0/3300710708 learned_addr learned my addr 172.21.15.88:0/3300710708 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:11.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.736+0000 7fb7067fc640 1 --2- 172.21.15.88:0/3300710708 >> v2:172.21.15.148:3300/0 conn(0x7fb708072850 0x7fb7080a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:11.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.736+0000 7fb705ffb640 1 -- 172.21.15.88:0/3300710708 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2909410467 0 0) 0x7fb70806b060 con 0x7fb708154520 2023-12-08T08:21:11.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.736+0000 7fb705ffb640 1 -- 172.21.15.88:0/3300710708 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6f0003530 con 0x7fb708154520 2023-12-08T08:21:11.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.736+0000 7fb705ffb640 1 -- 172.21.15.88:0/3300710708 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 336773382 0 0) 0x7fb70806b300 con 0x7fb708151e80 2023-12-08T08:21:11.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.736+0000 7fb705ffb640 1 -- 172.21.15.88:0/3300710708 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb70806b060 con 0x7fb708151e80 2023-12-08T08:21:11.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.736+0000 7fb705ffb640 1 -- 172.21.15.88:0/3300710708 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3746484042 0 0) 0x7fb6f0003530 con 0x7fb708154520 2023-12-08T08:21:11.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.736+0000 7fb7067fc640 1 -- 172.21.15.88:0/3300710708 >> v1:172.21.15.148:6789/0 conn(0x7fb708151e80 legacy=0x7fb7080c0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:11.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.736+0000 7fb7067fc640 1 -- 172.21.15.88:0/3300710708 >> v1:172.21.15.88:6789/0 conn(0x7fb708154520 legacy=0x7fb7081549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:11.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.736+0000 7fb7067fc640 1 -- 172.21.15.88:0/3300710708 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb708070f40 con 0x7fb708072850 2023-12-08T08:21:11.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.740+0000 7fb7067fc640 1 --2- 172.21.15.88:0/3300710708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb708072850 0x7fb7080a6370 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc0097c0 tx=0x7fb6fc01c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=510caf9beb88f0d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:11.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.740+0000 7fb705ffb640 1 -- 172.21.15.88:0/3300710708 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb700001a00 con 0x7fb708072850 2023-12-08T08:21:11.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.740+0000 7fb705ffb640 1 -- 172.21.15.88:0/3300710708 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6fc0a7050 con 0x7fb708072850 2023-12-08T08:21:11.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.740+0000 7fb705ffb640 1 -- 172.21.15.88:0/3300710708 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc0ab620 con 0x7fb708072850 2023-12-08T08:21:11.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.740+0000 7fb70d66b640 1 -- 172.21.15.88:0/3300710708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb708072850 msgr2=0x7fb7080a6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:11.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.740+0000 7fb70d66b640 1 --2- 172.21.15.88:0/3300710708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb708072850 0x7fb7080a6370 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc0097c0 tx=0x7fb6fc01c3a0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.740+0000 7fb70d66b640 1 -- 172.21.15.88:0/3300710708 shutdown_connections 2023-12-08T08:21:11.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.740+0000 7fb70d66b640 1 --2- 172.21.15.88:0/3300710708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb708072850 0x7fb7080a6370 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.740+0000 7fb70d66b640 1 -- 172.21.15.88:0/3300710708 >> 172.21.15.88:0/3300710708 conn(0x7fb7080a8990 msgr2=0x7fb7080a8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:11.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.740+0000 7fb70d66b640 1 -- 172.21.15.88:0/3300710708 shutdown_connections 2023-12-08T08:21:11.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.740+0000 7fb70d66b640 1 -- 172.21.15.88:0/3300710708 wait complete. 2023-12-08T08:21:11.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.744+0000 7fb70d66b640 1 Processor -- start 2023-12-08T08:21:11.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.744+0000 7fb70d66b640 1 -- start start 2023-12-08T08:21:11.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.744+0000 7fb70d66b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb708072850 0x7fb7081458b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:11.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.744+0000 7fb70d66b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb708151e80 0x7fb7080a7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:11.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.744+0000 7fb70d66b640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb708154520 0x7fb7081441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:11.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.744+0000 7fb70d66b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7080c2540 con 0x7fb708151e80 2023-12-08T08:21:11.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.744+0000 7fb70d66b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7080c3430 con 0x7fb708072850 2023-12-08T08:21:11.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.744+0000 7fb70d66b640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7080c18c0 con 0x7fb708154520 2023-12-08T08:21:11.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.744+0000 7fb7067fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb708151e80 0x7fb7080a7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:11.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.744+0000 7fb7067fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb708151e80 0x7fb7080a7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47402/0 (socket says 172.21.15.88:47402) 2023-12-08T08:21:11.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.744+0000 7fb7067fc640 1 -- 172.21.15.88:0/3606221401 learned_addr learned my addr 172.21.15.88:0/3606221401 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:11.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.744+0000 7fb706ffd640 1 --2- 172.21.15.88:0/3606221401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb708072850 0x7fb7081458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:11.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.744+0000 7fb7077fe640 1 --2- 172.21.15.88:0/3606221401 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb708154520 0x7fb7081441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:11.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.744+0000 7fb7067fc640 1 -- 172.21.15.88:0/3606221401 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb708154520 msgr2=0x7fb7081441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:11.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.744+0000 7fb7067fc640 1 --2- 172.21.15.88:0/3606221401 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb708154520 0x7fb7081441c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.744+0000 7fb7067fc640 1 -- 172.21.15.88:0/3606221401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb708072850 msgr2=0x7fb7081458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:11.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.744+0000 7fb7067fc640 1 --2- 172.21.15.88:0/3606221401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb708072850 0x7fb7081458b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.744+0000 7fb7067fc640 1 -- 172.21.15.88:0/3606221401 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6fc009420 con 0x7fb708151e80 2023-12-08T08:21:11.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.744+0000 7fb7067fc640 1 --2- 172.21.15.88:0/3606221401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb708151e80 0x7fb7080a7a10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc0097c0 tx=0x7fb6fc019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:11.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.744+0000 7fb6ef7fe640 1 -- 172.21.15.88:0/3606221401 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc004030 con 0x7fb708151e80 2023-12-08T08:21:11.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.744+0000 7fb6ef7fe640 1 -- 172.21.15.88:0/3606221401 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6fc004190 con 0x7fb708151e80 2023-12-08T08:21:11.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.744+0000 7fb6ef7fe640 1 -- 172.21.15.88:0/3606221401 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc004520 con 0x7fb708151e80 2023-12-08T08:21:11.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.744+0000 7fb70d66b640 1 -- 172.21.15.88:0/3606221401 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7080c1ba0 con 0x7fb708151e80 2023-12-08T08:21:11.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.744+0000 7fb70d66b640 1 -- 172.21.15.88:0/3606221401 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7080c2160 con 0x7fb708151e80 2023-12-08T08:21:11.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.748+0000 7fb70d66b640 1 -- 172.21.15.88:0/3606221401 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb708067630 con 0x7fb708151e80 2023-12-08T08:21:11.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.748+0000 7fb6ef7fe640 1 -- 172.21.15.88:0/3606221401 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb6fc0b2040 con 0x7fb708151e80 2023-12-08T08:21:11.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.748+0000 7fb6ef7fe640 1 --2- 172.21.15.88:0/3606221401 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb6f4066470 0x7fb6f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:11.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.748+0000 7fb6ef7fe640 1 -- 172.21.15.88:0/3606221401 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6fc11cfd0 con 0x7fb708151e80 2023-12-08T08:21:11.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.748+0000 7fb706ffd640 1 --2- 172.21.15.88:0/3606221401 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb6f4066470 0x7fb6f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:11.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.748+0000 7fb706ffd640 1 --2- 172.21.15.88:0/3606221401 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb6f4066470 0x7fb6f4068930 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80011f0 tx=0x7fb6f8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:11.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.752+0000 7fb6ef7fe640 1 -- 172.21.15.88:0/3606221401 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb6fc0ea460 con 0x7fb708151e80 2023-12-08T08:21:11.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.932+0000 7fb70d66b640 1 -- 172.21.15.88:0/3606221401 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb70806ef20 con 0x7fb708151e80 2023-12-08T08:21:11.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.932+0000 7fb6ef7fe640 1 -- 172.21.15.88:0/3606221401 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb6fc0eda80 con 0x7fb708151e80 2023-12-08T08:21:11.941 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:21:11.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.932+0000 7fb70d66b640 1 -- 172.21.15.88:0/3606221401 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb6f4066470 msgr2=0x7fb6f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:11.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.932+0000 7fb70d66b640 1 --2- 172.21.15.88:0/3606221401 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb6f4066470 0x7fb6f4068930 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80011f0 tx=0x7fb6f8009040 comp rx=0 tx=0).stop 2023-12-08T08:21:11.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.932+0000 7fb70d66b640 1 -- 172.21.15.88:0/3606221401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb708151e80 msgr2=0x7fb7080a7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:11.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.932+0000 7fb70d66b640 1 --2- 172.21.15.88:0/3606221401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb708151e80 0x7fb7080a7a10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc0097c0 tx=0x7fb6fc019140 comp rx=0 tx=0).stop 2023-12-08T08:21:11.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.932+0000 7fb70d66b640 1 -- 172.21.15.88:0/3606221401 shutdown_connections 2023-12-08T08:21:11.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.932+0000 7fb70d66b640 1 --2- 172.21.15.88:0/3606221401 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb6f4066470 0x7fb6f4068930 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.932+0000 7fb70d66b640 1 --2- 172.21.15.88:0/3606221401 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb708154520 0x7fb7081441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.932+0000 7fb70d66b640 1 --2- 172.21.15.88:0/3606221401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb708151e80 0x7fb7080a7a10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.932+0000 7fb70d66b640 1 --2- 172.21.15.88:0/3606221401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb708072850 0x7fb7081458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:11.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.932+0000 7fb70d66b640 1 -- 172.21.15.88:0/3606221401 >> 172.21.15.88:0/3606221401 conn(0x7fb7080a8990 msgr2=0x7fb708148d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:11.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.932+0000 7fb70d66b640 1 -- 172.21.15.88:0/3606221401 shutdown_connections 2023-12-08T08:21:11.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:11.932+0000 7fb70d66b640 1 -- 172.21.15.88:0/3606221401 wait complete. 2023-12-08T08:21:11.960 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-08T08:21:11.960 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:21:11.961 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2023-12-08T08:21:11.961 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-08T08:21:11.961 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T08:21:11.961 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-08T08:21:11.961 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-08T08:21:11.961 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:21:11.961 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:21:11.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:11.961 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2023-12-08T08:21:11.972 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:21:11.972 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:21:11.972 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:21:11.972 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:11.972 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-12-08T08:21:11.972 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:11.972 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:21:11.972 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:21:11.972 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2023-12-08T08:21:11.972 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:21:11.972 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:21:11.973 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2023-12-08T08:21:11.973 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:21:11.973 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2023-12-08T08:21:11.973 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:21:11.973 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2023-12-08T08:21:11.973 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-08T08:21:11.973 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42387sec preferred_lft 42387sec 2023-12-08T08:21:11.973 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2023-12-08T08:21:11.973 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:11.973 INFO:teuthology.orchestra.run.smithi088.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-08T08:21:11.973 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 02:42:cd:51:97:e3 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:21:11.973 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-08T08:21:11.973 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:11.973 INFO:teuthology.orchestra.run.smithi088.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:21:11.974 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-08T08:21:11.974 INFO:teuthology.orchestra.run.smithi088.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:21:11.974 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:11.974 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-08T08:21:11.974 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:11.974 INFO:teuthology.orchestra.run.smithi088.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:21:11.974 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:21:11.974 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-08T08:21:11.974 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:11.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:11.975 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:21:12.031 INFO:teuthology.orchestra.run.smithi088.stdout:1 2023-12-08T08:21:12.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:12.033 DEBUG:teuthology.orchestra.run.smithi088:> route 2023-12-08T08:21:12.087 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2023-12-08T08:21:12.087 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:21:12.087 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-08T08:21:12.087 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-08T08:21:12.088 INFO:teuthology.orchestra.run.smithi088.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-08T08:21:12.088 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-08T08:21:12.088 INFO:teuthology.orchestra.run.smithi088.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:21:12.088 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:21:12.088 INFO:teuthology.orchestra.run.smithi088.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:21:12.088 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:21:12.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:12.088 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-12-08T08:21:12.088 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-12-08T08:21:12.088 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-08T08:21:12.088 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-08T08:21:12.088 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-08T08:21:12.089 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-12-08T08:21:12.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:12.179 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-12-08T08:21:12.189 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-08T08:21:12.189 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:21:12.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:12.189 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2023-12-08T08:21:12.253 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:21:12.253 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-08T08:21:12.305 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:21:12.306 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:21:12.306 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:21:12.356 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-08T08:21:12.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:12.357 DEBUG:teuthology.orchestra.run.smithi088:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:21:12.447 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:21:12.447 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:21:12.459 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:21:12.459 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:21:12.460 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-12-08T08:21:12.460 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: trying mount with new device syntax: 0@681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3.cephfs=/ 2023-12-08T08:21:12.460 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.88:3300/172.21.15.148:3300/172.21.15.148:3301" will pass to kernel 2023-12-08T08:21:12.463 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T08:21:12.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:12.464 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:21:12.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:12.484 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:21:12.544 INFO:teuthology.orchestra.run.smithi088.stdout:client4850 2023-12-08T08:21:12.544 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:21:12.544 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:21:12.594 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:21:12.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.768+0000 7fb5d2f85640 1 Processor -- start 2023-12-08T08:21:12.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.768+0000 7fb5d2f85640 1 -- start start 2023-12-08T08:21:12.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.772+0000 7fb5d2f85640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5cc0c8200 0x7fb5cc0c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:12.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.772+0000 7fb5d2f85640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb5cc0c9210 0x7fb5cc15ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:12.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.772+0000 7fb5d2f85640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5cc151f20 con 0x7fb5cc0c65f0 2023-12-08T08:21:12.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.772+0000 7fb5d2f85640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5cc154450 con 0x7fb5cc0c9210 2023-12-08T08:21:12.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.772+0000 7fb5d2f85640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc154710 con 0x7fb5cc0c8200 2023-12-08T08:21:12.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.772+0000 7fb5d2784640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb5cc0c9210 0x7fb5cc15ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:12.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.772+0000 7fb5d2784640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb5cc0c9210 0x7fb5cc15ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47412/0 (socket says 172.21.15.88:47412) 2023-12-08T08:21:12.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.772+0000 7fb5d1782640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5cc0c8200 0x7fb5cc0c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:12.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.772+0000 7fb5d2784640 1 -- 172.21.15.88:0/2392709993 learned_addr learned my addr 172.21.15.88:0/2392709993 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:12.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.772+0000 7fb5d2784640 1 -- 172.21.15.88:0/2392709993 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5cc0c8200 msgr2=0x7fb5cc0c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:12.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.772+0000 7fb5d2784640 1 --2- 172.21.15.88:0/2392709993 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5cc0c8200 0x7fb5cc0c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:12.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.772+0000 7fb5d2784640 1 -- 172.21.15.88:0/2392709993 >> v1:172.21.15.148:6789/0 conn(0x7fb5cc0c65f0 legacy=0x7fb5cc0c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:12.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.772+0000 7fb5d2784640 1 -- 172.21.15.88:0/2392709993 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5cc1549f0 con 0x7fb5cc0c9210 2023-12-08T08:21:12.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.776+0000 7fb5d2784640 1 --2- 172.21.15.88:0/2392709993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5cc0c9210 0x7fb5cc15ecf0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4009e50 tx=0x7fb5c401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e69ae43feb96792e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:12.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.776+0000 7fb5d0f81640 1 -- 172.21.15.88:0/2392709993 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c40a5810 con 0x7fb5cc0c9210 2023-12-08T08:21:12.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.776+0000 7fb5d0f81640 1 -- 172.21.15.88:0/2392709993 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c40a5970 con 0x7fb5cc0c9210 2023-12-08T08:21:12.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.776+0000 7fb5d0f81640 1 -- 172.21.15.88:0/2392709993 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c40a5d00 con 0x7fb5cc0c9210 2023-12-08T08:21:12.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.776+0000 7fb5d2f85640 1 -- 172.21.15.88:0/2392709993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5cc0c9210 msgr2=0x7fb5cc15ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:12.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.776+0000 7fb5d2f85640 1 --2- 172.21.15.88:0/2392709993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5cc0c9210 0x7fb5cc15ecf0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4009e50 tx=0x7fb5c401c950 comp rx=0 tx=0).stop 2023-12-08T08:21:12.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.776+0000 7fb5d2f85640 1 -- 172.21.15.88:0/2392709993 shutdown_connections 2023-12-08T08:21:12.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.776+0000 7fb5d2f85640 1 --2- 172.21.15.88:0/2392709993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5cc0c9210 0x7fb5cc15ecf0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:12.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.776+0000 7fb5d2f85640 1 --2- 172.21.15.88:0/2392709993 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5cc0c8200 0x7fb5cc0c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:12.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.776+0000 7fb5d2f85640 1 -- 172.21.15.88:0/2392709993 >> 172.21.15.88:0/2392709993 conn(0x7fb5cc0ab730 msgr2=0x7fb5cc0abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:12.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.776+0000 7fb5d2f85640 1 -- 172.21.15.88:0/2392709993 shutdown_connections 2023-12-08T08:21:12.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.776+0000 7fb5d2f85640 1 -- 172.21.15.88:0/2392709993 wait complete. 2023-12-08T08:21:12.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.776+0000 7fb5d2f85640 1 Processor -- start 2023-12-08T08:21:12.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.776+0000 7fb5d2f85640 1 -- start start 2023-12-08T08:21:12.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.780+0000 7fb5d2f85640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5cc0c65f0 0x7fb5cc0c0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:12.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.780+0000 7fb5d2f85640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5cc0c8200 0x7fb5cc147fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:12.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.780+0000 7fb5d2f85640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5cc0c9210 0x7fb5cc14cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:12.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.780+0000 7fb5d2f85640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc14c1d0 con 0x7fb5cc0c65f0 2023-12-08T08:21:12.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.780+0000 7fb5d2f85640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc14e270 con 0x7fb5cc0c9210 2023-12-08T08:21:12.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.780+0000 7fb5d2f85640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc14e550 con 0x7fb5cc0c8200 2023-12-08T08:21:12.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.780+0000 7fb5d1f83640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5cc0c65f0 0x7fb5cc0c0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:12.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.780+0000 7fb5d1f83640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5cc0c65f0 0x7fb5cc0c0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47418/0 (socket says 172.21.15.88:47418) 2023-12-08T08:21:12.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.780+0000 7fb5d1f83640 1 -- 172.21.15.88:0/3487486562 learned_addr learned my addr 172.21.15.88:0/3487486562 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:12.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.780+0000 7fb5d1782640 1 --2- 172.21.15.88:0/3487486562 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5cc0c8200 0x7fb5cc147fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:12.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.780+0000 7fb5d2784640 1 --2- 172.21.15.88:0/3487486562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5cc0c9210 0x7fb5cc14cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:12.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.780+0000 7fb5d1f83640 1 -- 172.21.15.88:0/3487486562 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5cc0c8200 msgr2=0x7fb5cc147fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:12.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.780+0000 7fb5d1f83640 1 --2- 172.21.15.88:0/3487486562 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5cc0c8200 0x7fb5cc147fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:12.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.780+0000 7fb5d1f83640 1 -- 172.21.15.88:0/3487486562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5cc0c9210 msgr2=0x7fb5cc14cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:12.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.780+0000 7fb5d1f83640 1 --2- 172.21.15.88:0/3487486562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5cc0c9210 0x7fb5cc14cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:12.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.780+0000 7fb5d1f83640 1 -- 172.21.15.88:0/3487486562 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c4009b30 con 0x7fb5cc0c65f0 2023-12-08T08:21:12.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.780+0000 7fb5d1782640 1 --2- 172.21.15.88:0/3487486562 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5cc0c8200 0x7fb5cc147fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:12.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.780+0000 7fb5d2784640 1 --2- 172.21.15.88:0/3487486562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5cc0c9210 0x7fb5cc14cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:12.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.780+0000 7fb5d1f83640 1 --2- 172.21.15.88:0/3487486562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5cc0c65f0 0x7fb5cc0c0cb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb5c800c3c0 tx=0x7fb5c800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:12.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.780+0000 7fb5c27fc640 1 -- 172.21.15.88:0/3487486562 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c80052d0 con 0x7fb5cc0c65f0 2023-12-08T08:21:12.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.780+0000 7fb5c27fc640 1 -- 172.21.15.88:0/3487486562 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c8005430 con 0x7fb5cc0c65f0 2023-12-08T08:21:12.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.780+0000 7fb5d2f85640 1 -- 172.21.15.88:0/3487486562 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5cc14c420 con 0x7fb5cc0c65f0 2023-12-08T08:21:12.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.780+0000 7fb5c27fc640 1 -- 172.21.15.88:0/3487486562 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8003840 con 0x7fb5cc0c65f0 2023-12-08T08:21:12.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.780+0000 7fb5d2f85640 1 -- 172.21.15.88:0/3487486562 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5cc148500 con 0x7fb5cc0c65f0 2023-12-08T08:21:12.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.780+0000 7fb5d2f85640 1 -- 172.21.15.88:0/3487486562 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5cc0674b0 con 0x7fb5cc0c65f0 2023-12-08T08:21:12.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.784+0000 7fb5c27fc640 1 -- 172.21.15.88:0/3487486562 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb5c80039a0 con 0x7fb5cc0c65f0 2023-12-08T08:21:12.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.784+0000 7fb5c27fc640 1 --2- 172.21.15.88:0/3487486562 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb5b0066470 0x7fb5b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:12.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.784+0000 7fb5c27fc640 1 -- 172.21.15.88:0/3487486562 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5c8083410 con 0x7fb5cc0c65f0 2023-12-08T08:21:12.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.784+0000 7fb5d1782640 1 --2- 172.21.15.88:0/3487486562 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb5b0066470 0x7fb5b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:12.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.784+0000 7fb5d1782640 1 --2- 172.21.15.88:0/3487486562 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb5b0066470 0x7fb5b0068930 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc153df0 tx=0x7fb5bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:12.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.788+0000 7fb5c27fc640 1 -- 172.21.15.88:0/3487486562 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb5c8050880 con 0x7fb5cc0c65f0 2023-12-08T08:21:12.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.968+0000 7fb5d2f85640 1 -- 172.21.15.88:0/3487486562 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb5cc0c0730 con 0x7fb5cc0c65f0 2023-12-08T08:21:12.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.972+0000 7fb5c27fc640 1 -- 172.21.15.88:0/3487486562 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb5c8053ea0 con 0x7fb5cc0c65f0 2023-12-08T08:21:12.978 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:21:12.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.972+0000 7fb5d2f85640 1 -- 172.21.15.88:0/3487486562 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb5b0066470 msgr2=0x7fb5b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:12.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.972+0000 7fb5d2f85640 1 --2- 172.21.15.88:0/3487486562 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb5b0066470 0x7fb5b0068930 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc153df0 tx=0x7fb5bc008040 comp rx=0 tx=0).stop 2023-12-08T08:21:12.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.972+0000 7fb5d2f85640 1 -- 172.21.15.88:0/3487486562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5cc0c65f0 msgr2=0x7fb5cc0c0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:12.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.972+0000 7fb5d2f85640 1 --2- 172.21.15.88:0/3487486562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5cc0c65f0 0x7fb5cc0c0cb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb5c800c3c0 tx=0x7fb5c800c880 comp rx=0 tx=0).stop 2023-12-08T08:21:12.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.972+0000 7fb5d2f85640 1 -- 172.21.15.88:0/3487486562 shutdown_connections 2023-12-08T08:21:12.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.972+0000 7fb5d2f85640 1 --2- 172.21.15.88:0/3487486562 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb5b0066470 0x7fb5b0068930 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:12.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.972+0000 7fb5d2f85640 1 --2- 172.21.15.88:0/3487486562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5cc0c9210 0x7fb5cc14cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:12.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.972+0000 7fb5d2f85640 1 --2- 172.21.15.88:0/3487486562 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb5cc0c8200 0x7fb5cc147fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:12.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.972+0000 7fb5d2f85640 1 --2- 172.21.15.88:0/3487486562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5cc0c65f0 0x7fb5cc0c0cb0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:12.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.972+0000 7fb5d2f85640 1 -- 172.21.15.88:0/3487486562 >> 172.21.15.88:0/3487486562 conn(0x7fb5cc0ab730 msgr2=0x7fb5cc0c4460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:12.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.972+0000 7fb5d2f85640 1 -- 172.21.15.88:0/3487486562 shutdown_connections 2023-12-08T08:21:12.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:12.972+0000 7fb5d2f85640 1 -- 172.21.15.88:0/3487486562 wait complete. 2023-12-08T08:21:12.998 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-08T08:21:12.998 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:21:12.998 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-12-08T08:21:12.998 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-08T08:21:12.998 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-08T08:21:12.998 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-08T08:21:12.998 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-08T08:21:12.998 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:21:12.998 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:21:12.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:12.999 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-12-08T08:21:13.009 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:21:13.009 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:21:13.009 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:21:13.009 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:13.010 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-12-08T08:21:13.010 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:13.010 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:21:13.010 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:21:13.010 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-12-08T08:21:13.010 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:21:13.010 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:21:13.010 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-12-08T08:21:13.010 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:21:13.010 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:21:13.010 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:21:13.010 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:21:13.010 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-08T08:21:13.010 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42366sec preferred_lft 42366sec 2023-12-08T08:21:13.010 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-12-08T08:21:13.011 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:13.011 INFO:teuthology.orchestra.run.smithi148.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-08T08:21:13.011 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 02:42:93:b7:1f:fa brd ff:ff:ff:ff:ff:ff 2023-12-08T08:21:13.011 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-08T08:21:13.011 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:13.011 INFO:teuthology.orchestra.run.smithi148.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:21:13.011 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-08T08:21:13.011 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:21:13.011 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:13.011 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-08T08:21:13.011 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:13.011 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:21:13.011 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:21:13.011 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-08T08:21:13.012 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:13.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:13.012 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:21:13.074 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-12-08T08:21:13.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:13.076 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-12-08T08:21:13.129 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-12-08T08:21:13.129 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:21:13.129 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-08T08:21:13.129 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-08T08:21:13.130 INFO:teuthology.orchestra.run.smithi148.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-08T08:21:13.130 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-08T08:21:13.130 INFO:teuthology.orchestra.run.smithi148.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:21:13.130 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:21:13.130 INFO:teuthology.orchestra.run.smithi148.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:21:13.130 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:21:13.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:13.130 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-12-08T08:21:13.130 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-12-08T08:21:13.130 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-08T08:21:13.130 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-08T08:21:13.131 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-08T08:21:13.131 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-12-08T08:21:13.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:13.235 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-12-08T08:21:13.244 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-08T08:21:13.245 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:21:13.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:13.245 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-12-08T08:21:13.310 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:21:13.311 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-08T08:21:13.362 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:21:13.363 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:21:13.363 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:21:13.413 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-08T08:21:13.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:13.414 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:21:13.509 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:21:13.509 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:21:13.522 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:21:13.522 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:21:13.522 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-12-08T08:21:13.522 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with new device syntax: 1@681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3.cephfs=/ 2023-12-08T08:21:13.522 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.88:3300/172.21.15.148:3300/172.21.15.148:3301" will pass to kernel 2023-12-08T08:21:13.526 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T08:21:13.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:13.526 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:21:13.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:13.549 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:21:13.605 INFO:teuthology.orchestra.run.smithi148.stdout:client4859 2023-12-08T08:21:13.606 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:21:13.606 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:21:13.658 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-12-08T08:21:13.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.792+0000 7efc86c05640 1 Processor -- start 2023-12-08T08:21:13.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.792+0000 7efc86c05640 1 -- start start 2023-12-08T08:21:13.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.792+0000 7efc86c05640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efc800c40c0 0x7efc80155070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:13.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.792+0000 7efc86c05640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc80152170 con 0x7efc800a5200 2023-12-08T08:21:13.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.792+0000 7efc86c05640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc80158630 con 0x7efc80151d90 2023-12-08T08:21:13.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.792+0000 7efc86c05640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc80158b60 con 0x7efc800c40c0 2023-12-08T08:21:13.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.792+0000 7efc77fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7efc800a5200 0x7efc80154960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58000/0 (socket says 172.21.15.88:58000) 2023-12-08T08:21:13.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.792+0000 7efc77fff640 1 -- 172.21.15.88:0/345101605 learned_addr learned my addr 172.21.15.88:0/345101605 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:13.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.792+0000 7efc851a2640 1 --2- 172.21.15.88:0/345101605 >> v2:172.21.15.148:3300/0 conn(0x7efc800c40c0 0x7efc80155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:13.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.792+0000 7efc777fe640 1 -- 172.21.15.88:0/345101605 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3857787184 0 0) 0x7efc70001120 con 0x7efc800a5200 2023-12-08T08:21:13.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.792+0000 7efc777fe640 1 -- 172.21.15.88:0/345101605 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc68003530 con 0x7efc800a5200 2023-12-08T08:21:13.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.792+0000 7efc777fe640 1 -- 172.21.15.88:0/345101605 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4253656141 0 0) 0x7efc80158630 con 0x7efc80151d90 2023-12-08T08:21:13.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.792+0000 7efc777fe640 1 -- 172.21.15.88:0/345101605 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc70001120 con 0x7efc80151d90 2023-12-08T08:21:13.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.792+0000 7efc777fe640 1 -- 172.21.15.88:0/345101605 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3928432405 0 0) 0x7efc68003530 con 0x7efc800a5200 2023-12-08T08:21:13.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.792+0000 7efc777fe640 1 -- 172.21.15.88:0/345101605 >> v2:172.21.15.148:3300/0 conn(0x7efc800c40c0 msgr2=0x7efc80155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:13.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.792+0000 7efc777fe640 1 --2- 172.21.15.88:0/345101605 >> v2:172.21.15.148:3300/0 conn(0x7efc800c40c0 0x7efc80155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:13.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.792+0000 7efc777fe640 1 -- 172.21.15.88:0/345101605 >> v1:172.21.15.148:6789/0 conn(0x7efc80151d90 legacy=0x7efc800c4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:13.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.792+0000 7efc777fe640 1 -- 172.21.15.88:0/345101605 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc80158880 con 0x7efc800a5200 2023-12-08T08:21:13.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.792+0000 7efc777fe640 1 -- 172.21.15.88:0/345101605 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7efc70001810 con 0x7efc800a5200 2023-12-08T08:21:13.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.792+0000 7efc777fe640 1 -- 172.21.15.88:0/345101605 >> v1:172.21.15.88:6789/0 conn(0x7efc800a5200 legacy=0x7efc80154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:13.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.796+0000 7efc777fe640 1 --2- 172.21.15.88:0/345101605 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc68003b60 0x7efc68003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:13.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.796+0000 7efc777fe640 1 --2- 172.21.15.88:0/345101605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc680047d0 0x7efc68004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:13.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.796+0000 7efc777fe640 1 --2- 172.21.15.88:0/345101605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc68005250 0x7efc6800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:13.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.796+0000 7efc777fe640 1 -- 172.21.15.88:0/345101605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc80158b60 con 0x7efc680047d0 2023-12-08T08:21:13.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.796+0000 7efc777fe640 1 -- 172.21.15.88:0/345101605 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6800c190 con 0x7efc68005250 2023-12-08T08:21:13.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.796+0000 7efc777fe640 1 -- 172.21.15.88:0/345101605 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6800c350 con 0x7efc68003b60 2023-12-08T08:21:13.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.796+0000 7efc851a2640 1 --2- 172.21.15.88:0/345101605 >> v2:172.21.15.148:3300/0 conn(0x7efc800c40c0 0x7efc80155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:21:13.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.796+0000 7efc849a1640 1 --2- 172.21.15.88:0/345101605 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc68003b60 0x7efc68003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:13.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.796+0000 7efc77fff640 1 --2- 172.21.15.88:0/345101605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc680047d0 0x7efc68004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:13.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.796+0000 7efc851a2640 1 --2- 172.21.15.88:0/345101605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc68005250 0x7efc6800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:13.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.796+0000 7efc849a1640 1 -- 172.21.15.88:0/345101605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc68005250 msgr2=0x7efc6800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:13.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.796+0000 7efc849a1640 1 --2- 172.21.15.88:0/345101605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc68005250 0x7efc6800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:13.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.796+0000 7efc849a1640 1 -- 172.21.15.88:0/345101605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc680047d0 msgr2=0x7efc68004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:13.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.796+0000 7efc849a1640 1 --2- 172.21.15.88:0/345101605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc680047d0 0x7efc68004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:13.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.796+0000 7efc849a1640 1 -- 172.21.15.88:0/345101605 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc68003530 con 0x7efc68003b60 2023-12-08T08:21:13.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.796+0000 7efc851a2640 1 -- 172.21.15.88:0/345101605 reap_dead start 2023-12-08T08:21:13.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.796+0000 7efc77fff640 1 --2- 172.21.15.88:0/345101605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc680047d0 0x7efc68004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:21:13.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.796+0000 7efc849a1640 1 --2- 172.21.15.88:0/345101605 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc68003b60 0x7efc68003f60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efc7c0018d0 tx=0x7efc7c01c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67b6347437843828 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:13.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.796+0000 7efc777fe640 1 -- 172.21.15.88:0/345101605 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c0050d0 con 0x7efc68003b60 2023-12-08T08:21:13.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.796+0000 7efc777fe640 1 -- 172.21.15.88:0/345101605 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7c005250 con 0x7efc68003b60 2023-12-08T08:21:13.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.796+0000 7efc777fe640 1 -- 172.21.15.88:0/345101605 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c003600 con 0x7efc68003b60 2023-12-08T08:21:13.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.800+0000 7efc86c05640 1 -- 172.21.15.88:0/345101605 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc68003b60 msgr2=0x7efc68003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:13.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.800+0000 7efc86c05640 1 --2- 172.21.15.88:0/345101605 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc68003b60 0x7efc68003f60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efc7c0018d0 tx=0x7efc7c01c4f0 comp rx=0 tx=0).stop 2023-12-08T08:21:13.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.800+0000 7efc86c05640 1 -- 172.21.15.88:0/345101605 shutdown_connections 2023-12-08T08:21:13.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.800+0000 7efc86c05640 1 --2- 172.21.15.88:0/345101605 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc68003b60 0x7efc68003f60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:13.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.800+0000 7efc86c05640 1 -- 172.21.15.88:0/345101605 >> 172.21.15.88:0/345101605 conn(0x7efc8006b220 msgr2=0x7efc800a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:13.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.800+0000 7efc86c05640 1 -- 172.21.15.88:0/345101605 shutdown_connections 2023-12-08T08:21:13.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.800+0000 7efc86c05640 1 -- 172.21.15.88:0/345101605 wait complete. 2023-12-08T08:21:13.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.800+0000 7efc86c05640 1 Processor -- start 2023-12-08T08:21:13.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.800+0000 7efc86c05640 1 -- start start 2023-12-08T08:21:13.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.800+0000 7efc86c05640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc68003b60 0x7efc801ed230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:13.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.800+0000 7efc86c05640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc801496e0 0x7efc80156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:13.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.800+0000 7efc86c05640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc8006c130 0x7efc8006c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:13.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.800+0000 7efc86c05640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8006bd10 con 0x7efc68003b60 2023-12-08T08:21:13.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.800+0000 7efc86c05640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8006caf0 con 0x7efc8006c130 2023-12-08T08:21:13.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.800+0000 7efc86c05640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc801ed810 con 0x7efc801496e0 2023-12-08T08:21:13.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.800+0000 7efc849a1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc68003b60 0x7efc801ed230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:13.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.800+0000 7efc849a1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc68003b60 0x7efc801ed230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47428/0 (socket says 172.21.15.88:47428) 2023-12-08T08:21:13.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.800+0000 7efc849a1640 1 -- 172.21.15.88:0/1569482166 learned_addr learned my addr 172.21.15.88:0/1569482166 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:13.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.800+0000 7efc77fff640 1 --2- 172.21.15.88:0/1569482166 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc801496e0 0x7efc80156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:13.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.800+0000 7efc849a1640 1 -- 172.21.15.88:0/1569482166 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc801496e0 msgr2=0x7efc80156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:13.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.800+0000 7efc849a1640 1 --2- 172.21.15.88:0/1569482166 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc801496e0 0x7efc80156b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:13.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.800+0000 7efc849a1640 1 -- 172.21.15.88:0/1569482166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc8006c130 msgr2=0x7efc8006c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:13.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.800+0000 7efc849a1640 1 --2- 172.21.15.88:0/1569482166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc8006c130 0x7efc8006c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:13.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.800+0000 7efc849a1640 1 -- 172.21.15.88:0/1569482166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc801edaf0 con 0x7efc68003b60 2023-12-08T08:21:13.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.804+0000 7efc849a1640 1 --2- 172.21.15.88:0/1569482166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc68003b60 0x7efc801ed230 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7efc7c0ae040 tx=0x7efc68005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:13.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.804+0000 7efc757fa640 1 -- 172.21.15.88:0/1569482166 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c0050d0 con 0x7efc68003b60 2023-12-08T08:21:13.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.804+0000 7efc757fa640 1 -- 172.21.15.88:0/1569482166 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7c003c40 con 0x7efc68003b60 2023-12-08T08:21:13.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.804+0000 7efc86c05640 1 -- 172.21.15.88:0/1569482166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc801eddd0 con 0x7efc68003b60 2023-12-08T08:21:13.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.804+0000 7efc757fa640 1 -- 172.21.15.88:0/1569482166 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c0067e0 con 0x7efc68003b60 2023-12-08T08:21:13.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.804+0000 7efc86c05640 1 -- 172.21.15.88:0/1569482166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc801570c0 con 0x7efc68003b60 2023-12-08T08:21:13.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.804+0000 7efc86c05640 1 -- 172.21.15.88:0/1569482166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc8006bf80 con 0x7efc68003b60 2023-12-08T08:21:13.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.804+0000 7efc757fa640 1 -- 172.21.15.88:0/1569482166 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efc7c0b2040 con 0x7efc68003b60 2023-12-08T08:21:13.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.804+0000 7efc757fa640 1 --2- 172.21.15.88:0/1569482166 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efc6c066470 0x7efc6c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:13.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.804+0000 7efc757fa640 1 -- 172.21.15.88:0/1569482166 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc7c11d830 con 0x7efc68003b60 2023-12-08T08:21:13.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.804+0000 7efc77fff640 1 --2- 172.21.15.88:0/1569482166 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efc6c066470 0x7efc6c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:13.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.808+0000 7efc77fff640 1 --2- 172.21.15.88:0/1569482166 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efc6c066470 0x7efc6c068930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efc70000c10 tx=0x7efc70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:13.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:13.808+0000 7efc757fa640 1 -- 172.21.15.88:0/1569482166 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efc7c0eae70 con 0x7efc68003b60 2023-12-08T08:21:14.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.012+0000 7efc86c05640 1 -- 172.21.15.88:0/1569482166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7efc80067630 con 0x7efc68003b60 2023-12-08T08:21:14.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.012+0000 7efc757fa640 1 -- 172.21.15.88:0/1569482166 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v11) v1 ==== 84+0+0 (secure 0 0 0) 0x7efc7c0ee490 con 0x7efc68003b60 2023-12-08T08:21:14.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.012+0000 7efc86c05640 1 -- 172.21.15.88:0/1569482166 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efc6c066470 msgr2=0x7efc6c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:14.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.012+0000 7efc86c05640 1 --2- 172.21.15.88:0/1569482166 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efc6c066470 0x7efc6c068930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efc70000c10 tx=0x7efc70009040 comp rx=0 tx=0).stop 2023-12-08T08:21:14.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.012+0000 7efc86c05640 1 -- 172.21.15.88:0/1569482166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc68003b60 msgr2=0x7efc801ed230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:14.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.012+0000 7efc86c05640 1 --2- 172.21.15.88:0/1569482166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc68003b60 0x7efc801ed230 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7efc7c0ae040 tx=0x7efc68005800 comp rx=0 tx=0).stop 2023-12-08T08:21:14.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.012+0000 7efc86c05640 1 -- 172.21.15.88:0/1569482166 shutdown_connections 2023-12-08T08:21:14.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.012+0000 7efc86c05640 1 --2- 172.21.15.88:0/1569482166 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efc6c066470 0x7efc6c068930 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.012+0000 7efc86c05640 1 --2- 172.21.15.88:0/1569482166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc8006c130 0x7efc8006c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.012+0000 7efc86c05640 1 --2- 172.21.15.88:0/1569482166 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efc801496e0 0x7efc80156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.012+0000 7efc86c05640 1 --2- 172.21.15.88:0/1569482166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc68003b60 0x7efc801ed230 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.012+0000 7efc86c05640 1 -- 172.21.15.88:0/1569482166 >> 172.21.15.88:0/1569482166 conn(0x7efc8006b220 msgr2=0x7efc800c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:14.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.012+0000 7efc86c05640 1 -- 172.21.15.88:0/1569482166 shutdown_connections 2023-12-08T08:21:14.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.016+0000 7efc86c05640 1 -- 172.21.15.88:0/1569482166 wait complete. 2023-12-08T08:21:14.041 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:21:14.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.172+0000 7fefb6b0f640 1 Processor -- start 2023-12-08T08:21:14.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.172+0000 7fefb6b0f640 1 -- start start 2023-12-08T08:21:14.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.172+0000 7fefb6b0f640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fefb0154f20 0x7fefb006b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:14.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.172+0000 7fefb6b0f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fefb006bf30 0x7fefb015ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:14.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.172+0000 7fefb6b0f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb00c4890 con 0x7fefb00af4c0 2023-12-08T08:21:14.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.172+0000 7fefb6b0f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb01553d0 con 0x7fefb006bf30 2023-12-08T08:21:14.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.172+0000 7fefb6b0f640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb006c340 con 0x7fefb0154f20 2023-12-08T08:21:14.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.172+0000 7fefb48ab640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fefb00af4c0 0x7fefb00c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58006/0 (socket says 172.21.15.88:58006) 2023-12-08T08:21:14.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.172+0000 7fefb48ab640 1 -- 172.21.15.88:0/1725106937 learned_addr learned my addr 172.21.15.88:0/1725106937 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:14.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.172+0000 7fefb50ac640 1 --2- 172.21.15.88:0/1725106937 >> v2:172.21.15.88:3300/0 conn(0x7fefb006bf30 0x7fefb015ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:14.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.172+0000 7fefa7fff640 1 --2- 172.21.15.88:0/1725106937 >> v2:172.21.15.148:3300/0 conn(0x7fefb0154f20 0x7fefb006b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:14.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.172+0000 7fefa77fe640 1 -- 172.21.15.88:0/1725106937 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145390145 0 0) 0x7fefb00c4890 con 0x7fefb00af4c0 2023-12-08T08:21:14.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.172+0000 7fefa77fe640 1 -- 172.21.15.88:0/1725106937 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef98003530 con 0x7fefb00af4c0 2023-12-08T08:21:14.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.172+0000 7fefb50ac640 1 -- 172.21.15.88:0/1725106937 >> v2:172.21.15.148:3300/0 conn(0x7fefb0154f20 msgr2=0x7fefb006b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:14.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.172+0000 7fefb50ac640 1 --2- 172.21.15.88:0/1725106937 >> v2:172.21.15.148:3300/0 conn(0x7fefb0154f20 0x7fefb006b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.172+0000 7fefb50ac640 1 -- 172.21.15.88:0/1725106937 >> v1:172.21.15.88:6789/0 conn(0x7fefb00af4c0 legacy=0x7fefb00c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:14.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.172+0000 7fefb50ac640 1 -- 172.21.15.88:0/1725106937 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb00af8a0 con 0x7fefb006bf30 2023-12-08T08:21:14.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.176+0000 7fefb50ac640 1 --2- 172.21.15.88:0/1725106937 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fefb006bf30 0x7fefb015ee20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fefb00c7290 tx=0x7fefa801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acbf0d70331cf0c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:14.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.176+0000 7fefa77fe640 1 -- 172.21.15.88:0/1725106937 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa80a5910 con 0x7fefb006bf30 2023-12-08T08:21:14.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.176+0000 7fefa77fe640 1 -- 172.21.15.88:0/1725106937 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa80a5a70 con 0x7fefb006bf30 2023-12-08T08:21:14.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.176+0000 7fefa77fe640 1 -- 172.21.15.88:0/1725106937 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa80a5e00 con 0x7fefb006bf30 2023-12-08T08:21:14.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.176+0000 7fefb6b0f640 1 -- 172.21.15.88:0/1725106937 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fefb006bf30 msgr2=0x7fefb015ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:14.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.176+0000 7fefb6b0f640 1 --2- 172.21.15.88:0/1725106937 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fefb006bf30 0x7fefb015ee20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fefb00c7290 tx=0x7fefa801c850 comp rx=0 tx=0).stop 2023-12-08T08:21:14.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.176+0000 7fefb6b0f640 1 -- 172.21.15.88:0/1725106937 shutdown_connections 2023-12-08T08:21:14.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.176+0000 7fefb6b0f640 1 --2- 172.21.15.88:0/1725106937 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fefb006bf30 0x7fefb015ee20 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.176+0000 7fefb6b0f640 1 --2- 172.21.15.88:0/1725106937 >> v2:172.21.15.148:3300/0 conn(0x7fefb0154f20 0x7fefb006b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.176+0000 7fefb6b0f640 1 -- 172.21.15.88:0/1725106937 >> 172.21.15.88:0/1725106937 conn(0x7fefb00ab9d0 msgr2=0x7fefb00abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:14.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.176+0000 7fefb6b0f640 1 -- 172.21.15.88:0/1725106937 shutdown_connections 2023-12-08T08:21:14.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.176+0000 7fefb6b0f640 1 -- 172.21.15.88:0/1725106937 wait complete. 2023-12-08T08:21:14.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.180+0000 7fefb6b0f640 1 Processor -- start 2023-12-08T08:21:14.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.180+0000 7fefb6b0f640 1 -- start start 2023-12-08T08:21:14.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.180+0000 7fefb6b0f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fefb006bf30 0x7fefb00c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:14.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.180+0000 7fefb6b0f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefb00af4c0 0x7fefb0148df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:14.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.180+0000 7fefb6b0f640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefb0154f20 0x7fefb01ed3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:14.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.180+0000 7fefb6b0f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb01ecf50 con 0x7fefb006bf30 2023-12-08T08:21:14.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.180+0000 7fefb6b0f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb014d460 con 0x7fefb00af4c0 2023-12-08T08:21:14.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.180+0000 7fefb6b0f640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb00c3c90 con 0x7fefb0154f20 2023-12-08T08:21:14.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.180+0000 7fefb48ab640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fefb006bf30 0x7fefb00c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:14.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.180+0000 7fefb48ab640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fefb006bf30 0x7fefb00c7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47454/0 (socket says 172.21.15.88:47454) 2023-12-08T08:21:14.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.180+0000 7fefb48ab640 1 -- 172.21.15.88:0/900096208 learned_addr learned my addr 172.21.15.88:0/900096208 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:14.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.180+0000 7fefa7fff640 1 --2- 172.21.15.88:0/900096208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefb00af4c0 0x7fefb0148df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:14.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.180+0000 7fefb50ac640 1 --2- 172.21.15.88:0/900096208 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefb0154f20 0x7fefb01ed3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:14.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.180+0000 7fefb48ab640 1 -- 172.21.15.88:0/900096208 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefb0154f20 msgr2=0x7fefb01ed3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:14.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.180+0000 7fefb48ab640 1 --2- 172.21.15.88:0/900096208 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefb0154f20 0x7fefb01ed3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.180+0000 7fefb48ab640 1 -- 172.21.15.88:0/900096208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefb00af4c0 msgr2=0x7fefb0148df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:14.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.180+0000 7fefb48ab640 1 --2- 172.21.15.88:0/900096208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefb00af4c0 0x7fefb0148df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.180+0000 7fefb48ab640 1 -- 172.21.15.88:0/900096208 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa8009a70 con 0x7fefb006bf30 2023-12-08T08:21:14.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.180+0000 7fefa7fff640 1 --2- 172.21.15.88:0/900096208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefb00af4c0 0x7fefb0148df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:14.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.180+0000 7fefb48ab640 1 --2- 172.21.15.88:0/900096208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fefb006bf30 0x7fefb00c7bc0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fefac00c420 tx=0x7fefac00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:14.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.180+0000 7fefa57fa640 1 -- 172.21.15.88:0/900096208 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac005cf0 con 0x7fefb006bf30 2023-12-08T08:21:14.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.180+0000 7fefa57fa640 1 -- 172.21.15.88:0/900096208 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefac005e50 con 0x7fefb006bf30 2023-12-08T08:21:14.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.180+0000 7fefb6b0f640 1 -- 172.21.15.88:0/900096208 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb01ecc00 con 0x7fefb006bf30 2023-12-08T08:21:14.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.180+0000 7fefa57fa640 1 -- 172.21.15.88:0/900096208 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac0072d0 con 0x7fefb006bf30 2023-12-08T08:21:14.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.180+0000 7fefb6b0f640 1 -- 172.21.15.88:0/900096208 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb00ca0b0 con 0x7fefb006bf30 2023-12-08T08:21:14.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.184+0000 7fefb6b0f640 1 -- 172.21.15.88:0/900096208 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb00a9c90 con 0x7fefb006bf30 2023-12-08T08:21:14.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.184+0000 7fefa57fa640 1 -- 172.21.15.88:0/900096208 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fefac007430 con 0x7fefb006bf30 2023-12-08T08:21:14.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.184+0000 7fefa57fa640 1 --2- 172.21.15.88:0/900096208 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fef9c066470 0x7fef9c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:14.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.184+0000 7fefa57fa640 1 -- 172.21.15.88:0/900096208 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefac083430 con 0x7fefb006bf30 2023-12-08T08:21:14.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.184+0000 7fefa7fff640 1 --2- 172.21.15.88:0/900096208 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fef9c066470 0x7fef9c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:14.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.184+0000 7fefa7fff640 1 --2- 172.21.15.88:0/900096208 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fef9c066470 0x7fef9c068930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fefb00c3eb0 tx=0x7fefa0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:14.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.188+0000 7fefa57fa640 1 -- 172.21.15.88:0/900096208 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fefac0508c0 con 0x7fefb006bf30 2023-12-08T08:21:14.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.340+0000 7fefb6b0f640 1 -- 172.21.15.88:0/900096208 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fefb0067630 con 0x7fefb006bf30 2023-12-08T08:21:14.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.340+0000 7fefa57fa640 1 -- 172.21.15.88:0/900096208 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16545 (secure 0 0 0) 0x7fefac053ee0 con 0x7fefb006bf30 2023-12-08T08:21:14.349 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:14.349 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":31,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:21:06.508444+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:21:03.690721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-08T08:21:04.127786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:21:14.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.344+0000 7fefb6b0f640 1 -- 172.21.15.88:0/900096208 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fef9c066470 msgr2=0x7fef9c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:14.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.344+0000 7fefb6b0f640 1 --2- 172.21.15.88:0/900096208 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fef9c066470 0x7fef9c068930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fefb00c3eb0 tx=0x7fefa0008040 comp rx=0 tx=0).stop 2023-12-08T08:21:14.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.344+0000 7fefb6b0f640 1 -- 172.21.15.88:0/900096208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fefb006bf30 msgr2=0x7fefb00c7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:14.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.344+0000 7fefb6b0f640 1 --2- 172.21.15.88:0/900096208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fefb006bf30 0x7fefb00c7bc0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fefac00c420 tx=0x7fefac00c8e0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.344+0000 7fefb6b0f640 1 -- 172.21.15.88:0/900096208 shutdown_connections 2023-12-08T08:21:14.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.344+0000 7fefb6b0f640 1 --2- 172.21.15.88:0/900096208 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fef9c066470 0x7fef9c068930 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.344+0000 7fefb6b0f640 1 --2- 172.21.15.88:0/900096208 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fefb0154f20 0x7fefb01ed3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.344+0000 7fefb6b0f640 1 --2- 172.21.15.88:0/900096208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefb00af4c0 0x7fefb0148df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.344+0000 7fefb6b0f640 1 --2- 172.21.15.88:0/900096208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fefb006bf30 0x7fefb00c7bc0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.344+0000 7fefb6b0f640 1 -- 172.21.15.88:0/900096208 >> 172.21.15.88:0/900096208 conn(0x7fefb00ab9d0 msgr2=0x7fefb0149c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:14.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.344+0000 7fefb6b0f640 1 -- 172.21.15.88:0/900096208 shutdown_connections 2023-12-08T08:21:14.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.344+0000 7fefb6b0f640 1 -- 172.21.15.88:0/900096208 wait complete. 2023-12-08T08:21:14.370 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:21:03.690721+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:21:04.127786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:21:14.370 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:21:14.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.504+0000 7ff15c09c640 1 Processor -- start 2023-12-08T08:21:14.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.504+0000 7ff15c09c640 1 -- start start 2023-12-08T08:21:14.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.504+0000 7ff15c09c640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff154151a20 0x7ff154157a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:14.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.504+0000 7ff15c09c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff15406b5c0 0x7ff15406ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:14.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.504+0000 7ff15c09c640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1541547f0 con 0x7ff15406e890 2023-12-08T08:21:14.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.504+0000 7ff15c09c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1540c2720 con 0x7ff15406b5c0 2023-12-08T08:21:14.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.504+0000 7ff15c09c640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1541544a0 con 0x7ff154151a20 2023-12-08T08:21:14.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.504+0000 7ff15a639640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff15406b5c0 0x7ff15406ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:14.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.504+0000 7ff15a639640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff15406b5c0 0x7ff15406ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47470/0 (socket says 172.21.15.88:47470) 2023-12-08T08:21:14.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.504+0000 7ff15a639640 1 -- 172.21.15.88:0/367695457 learned_addr learned my addr 172.21.15.88:0/367695457 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:14.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.504+0000 7ff15a639640 1 -- 172.21.15.88:0/367695457 >> v2:172.21.15.148:3300/0 conn(0x7ff154151a20 msgr2=0x7ff154157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:14.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.504+0000 7ff159e38640 1 --2- 172.21.15.88:0/367695457 >> v2:172.21.15.148:3300/0 conn(0x7ff154151a20 0x7ff154157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:14.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.504+0000 7ff15a639640 1 --2- 172.21.15.88:0/367695457 >> v2:172.21.15.148:3300/0 conn(0x7ff154151a20 0x7ff154157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.504+0000 7ff15a639640 1 -- 172.21.15.88:0/367695457 >> v1:172.21.15.148:6789/0 conn(0x7ff15406e890 legacy=0x7ff154154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:14.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.504+0000 7ff15a639640 1 -- 172.21.15.88:0/367695457 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff154155390 con 0x7ff15406b5c0 2023-12-08T08:21:14.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.504+0000 7ff159e38640 1 --2- 172.21.15.88:0/367695457 >> v2:172.21.15.148:3300/0 conn(0x7ff154151a20 0x7ff154157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:14.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.508+0000 7ff15a639640 1 --2- 172.21.15.88:0/367695457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff15406b5c0 0x7ff15406ba30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff15406f820 tx=0x7ff14c01c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ad651ed6df7257 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:14.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.508+0000 7ff158e36640 1 -- 172.21.15.88:0/367695457 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c0a5700 con 0x7ff15406b5c0 2023-12-08T08:21:14.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.508+0000 7ff158e36640 1 -- 172.21.15.88:0/367695457 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c0a5860 con 0x7ff15406b5c0 2023-12-08T08:21:14.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.508+0000 7ff158e36640 1 -- 172.21.15.88:0/367695457 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c0a5bf0 con 0x7ff15406b5c0 2023-12-08T08:21:14.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.508+0000 7ff15c09c640 1 -- 172.21.15.88:0/367695457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff15406b5c0 msgr2=0x7ff15406ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:14.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.508+0000 7ff15c09c640 1 --2- 172.21.15.88:0/367695457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff15406b5c0 0x7ff15406ba30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff15406f820 tx=0x7ff14c01c840 comp rx=0 tx=0).stop 2023-12-08T08:21:14.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.508+0000 7ff15c09c640 1 -- 172.21.15.88:0/367695457 shutdown_connections 2023-12-08T08:21:14.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.508+0000 7ff15c09c640 1 --2- 172.21.15.88:0/367695457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff15406b5c0 0x7ff15406ba30 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.508+0000 7ff15c09c640 1 --2- 172.21.15.88:0/367695457 >> v2:172.21.15.148:3300/0 conn(0x7ff154151a20 0x7ff154157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.508+0000 7ff15c09c640 1 -- 172.21.15.88:0/367695457 >> 172.21.15.88:0/367695457 conn(0x7ff1540c2e20 msgr2=0x7ff1540c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:14.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.508+0000 7ff15c09c640 1 -- 172.21.15.88:0/367695457 shutdown_connections 2023-12-08T08:21:14.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.508+0000 7ff15c09c640 1 -- 172.21.15.88:0/367695457 wait complete. 2023-12-08T08:21:14.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.512+0000 7ff15c09c640 1 Processor -- start 2023-12-08T08:21:14.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.512+0000 7ff15c09c640 1 -- start start 2023-12-08T08:21:14.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.512+0000 7ff15c09c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff15406b5c0 0x7ff15414fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:14.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.512+0000 7ff15c09c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff15406e890 0x7ff1541f0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:14.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.512+0000 7ff15c09c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff154151a20 0x7ff154153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:14.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.512+0000 7ff15c09c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1541510b0 con 0x7ff154151a20 2023-12-08T08:21:14.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.512+0000 7ff15c09c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1541f0f50 con 0x7ff15406b5c0 2023-12-08T08:21:14.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.512+0000 7ff15c09c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1540c36e0 con 0x7ff15406e890 2023-12-08T08:21:14.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.512+0000 7ff15a639640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff154151a20 0x7ff154153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:14.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.512+0000 7ff15a639640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff154151a20 0x7ff154153b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47482/0 (socket says 172.21.15.88:47482) 2023-12-08T08:21:14.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.512+0000 7ff15a639640 1 -- 172.21.15.88:0/3174213574 learned_addr learned my addr 172.21.15.88:0/3174213574 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:14.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.512+0000 7ff159637640 1 --2- 172.21.15.88:0/3174213574 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff15406e890 0x7ff1541f0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:14.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.512+0000 7ff159e38640 1 --2- 172.21.15.88:0/3174213574 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff15406b5c0 0x7ff15414fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:14.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.512+0000 7ff15a639640 1 -- 172.21.15.88:0/3174213574 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff15406e890 msgr2=0x7ff1541f0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:14.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.512+0000 7ff15a639640 1 --2- 172.21.15.88:0/3174213574 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff15406e890 0x7ff1541f0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.512+0000 7ff15a639640 1 -- 172.21.15.88:0/3174213574 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff15406b5c0 msgr2=0x7ff15414fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:14.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.512+0000 7ff15a639640 1 --2- 172.21.15.88:0/3174213574 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff15406b5c0 0x7ff15414fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.512+0000 7ff15a639640 1 -- 172.21.15.88:0/3174213574 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c009b30 con 0x7ff154151a20 2023-12-08T08:21:14.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.512+0000 7ff15a639640 1 --2- 172.21.15.88:0/3174213574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff154151a20 0x7ff154153b90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0af040 tx=0x7ff14c0195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:14.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.512+0000 7ff14a7fc640 1 -- 172.21.15.88:0/3174213574 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c0b8670 con 0x7ff154151a20 2023-12-08T08:21:14.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.512+0000 7ff14a7fc640 1 -- 172.21.15.88:0/3174213574 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c0b87f0 con 0x7ff154151a20 2023-12-08T08:21:14.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.512+0000 7ff15c09c640 1 -- 172.21.15.88:0/3174213574 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1540a9c70 con 0x7ff154151a20 2023-12-08T08:21:14.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.512+0000 7ff14a7fc640 1 -- 172.21.15.88:0/3174213574 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c0b8ba0 con 0x7ff154151a20 2023-12-08T08:21:14.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.512+0000 7ff15c09c640 1 -- 172.21.15.88:0/3174213574 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1541ecba0 con 0x7ff154151a20 2023-12-08T08:21:14.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.512+0000 7ff15c09c640 1 -- 172.21.15.88:0/3174213574 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff154067630 con 0x7ff154151a20 2023-12-08T08:21:14.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.516+0000 7ff14a7fc640 1 -- 172.21.15.88:0/3174213574 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff14c0b8d00 con 0x7ff154151a20 2023-12-08T08:21:14.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.516+0000 7ff14a7fc640 1 --2- 172.21.15.88:0/3174213574 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff1380664a0 0x7ff138068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:14.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.516+0000 7ff14a7fc640 1 -- 172.21.15.88:0/3174213574 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff14c11f740 con 0x7ff154151a20 2023-12-08T08:21:14.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.516+0000 7ff159e38640 1 --2- 172.21.15.88:0/3174213574 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff1380664a0 0x7ff138068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:14.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.516+0000 7ff159e38640 1 --2- 172.21.15.88:0/3174213574 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff1380664a0 0x7ff138068960 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff15000a9a0 tx=0x7ff150008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:14.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.520+0000 7ff14a7fc640 1 -- 172.21.15.88:0/3174213574 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff14c0eccd0 con 0x7ff154151a20 2023-12-08T08:21:14.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.668+0000 7ff15c09c640 1 -- 172.21.15.88:0/3174213574 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff154152b70 con 0x7ff154151a20 2023-12-08T08:21:14.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.672+0000 7ff14a7fc640 1 -- 172.21.15.88:0/3174213574 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff14c0f02f0 con 0x7ff154151a20 2023-12-08T08:21:14.678 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:21:14.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.672+0000 7ff15c09c640 1 -- 172.21.15.88:0/3174213574 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff1380664a0 msgr2=0x7ff138068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:14.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.672+0000 7ff15c09c640 1 --2- 172.21.15.88:0/3174213574 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff1380664a0 0x7ff138068960 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff15000a9a0 tx=0x7ff150008040 comp rx=0 tx=0).stop 2023-12-08T08:21:14.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.672+0000 7ff15c09c640 1 -- 172.21.15.88:0/3174213574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff154151a20 msgr2=0x7ff154153b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:14.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.672+0000 7ff15c09c640 1 --2- 172.21.15.88:0/3174213574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff154151a20 0x7ff154153b90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0af040 tx=0x7ff14c0195e0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.672+0000 7ff15c09c640 1 -- 172.21.15.88:0/3174213574 shutdown_connections 2023-12-08T08:21:14.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.672+0000 7ff15c09c640 1 --2- 172.21.15.88:0/3174213574 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff1380664a0 0x7ff138068960 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.672+0000 7ff15c09c640 1 --2- 172.21.15.88:0/3174213574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff154151a20 0x7ff154153b90 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.672+0000 7ff15c09c640 1 --2- 172.21.15.88:0/3174213574 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff15406e890 0x7ff1541f0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.672+0000 7ff15c09c640 1 --2- 172.21.15.88:0/3174213574 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff15406b5c0 0x7ff15414fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.672+0000 7ff15c09c640 1 -- 172.21.15.88:0/3174213574 >> 172.21.15.88:0/3174213574 conn(0x7ff1540c2e20 msgr2=0x7ff154154c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:14.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.672+0000 7ff15c09c640 1 -- 172.21.15.88:0/3174213574 shutdown_connections 2023-12-08T08:21:14.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.672+0000 7ff15c09c640 1 -- 172.21.15.88:0/3174213574 wait complete. 2023-12-08T08:21:14.698 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:21:14.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.832+0000 7f53527b5640 1 Processor -- start 2023-12-08T08:21:14.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.832+0000 7f53527b5640 1 -- start start 2023-12-08T08:21:14.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f53527b5640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f534c06d990 0x7f534c0c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:14.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f53527b5640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f534c1520e0 0x7f534c0c4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:14.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f53527b5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f534c1525e0 con 0x7f534c14f8f0 2023-12-08T08:21:14.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f53527b5640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f534c1528c0 con 0x7f534c1520e0 2023-12-08T08:21:14.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f53527b5640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534c152ba0 con 0x7f534c06d990 2023-12-08T08:21:14.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f53517b3640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f534c14f8f0 0x7f534c0aac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58020/0 (socket says 172.21.15.88:58020) 2023-12-08T08:21:14.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f53517b3640 1 -- 172.21.15.88:0/2093079012 learned_addr learned my addr 172.21.15.88:0/2093079012 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:14.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f5350fb2640 1 --2- 172.21.15.88:0/2093079012 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f534c06d990 0x7f534c0c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:14.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f5351fb4640 1 --2- 172.21.15.88:0/2093079012 >> v2:172.21.15.148:3300/0 conn(0x7f534c1520e0 0x7f534c0c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:14.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f5343fff640 1 -- 172.21.15.88:0/2093079012 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369861049 0 0) 0x7f534c1525e0 con 0x7f534c14f8f0 2023-12-08T08:21:14.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f5343fff640 1 -- 172.21.15.88:0/2093079012 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5338003530 con 0x7f534c14f8f0 2023-12-08T08:21:14.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f5343fff640 1 -- 172.21.15.88:0/2093079012 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3969239922 0 0) 0x7f5338003530 con 0x7f534c14f8f0 2023-12-08T08:21:14.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f5343fff640 1 -- 172.21.15.88:0/2093079012 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f534c06d990 msgr2=0x7f534c0c3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:14.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f5343fff640 1 --2- 172.21.15.88:0/2093079012 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f534c06d990 0x7f534c0c3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f5343fff640 1 -- 172.21.15.88:0/2093079012 >> v2:172.21.15.148:3300/0 conn(0x7f534c1520e0 msgr2=0x7f534c0c4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:14.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f5343fff640 1 --2- 172.21.15.88:0/2093079012 >> v2:172.21.15.148:3300/0 conn(0x7f534c1520e0 0x7f534c0c4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f5343fff640 1 -- 172.21.15.88:0/2093079012 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c152e80 con 0x7f534c14f8f0 2023-12-08T08:21:14.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f5343fff640 1 -- 172.21.15.88:0/2093079012 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f5348001680 con 0x7f534c14f8f0 2023-12-08T08:21:14.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f5343fff640 1 -- 172.21.15.88:0/2093079012 >> v1:172.21.15.88:6789/0 conn(0x7f534c14f8f0 legacy=0x7f534c0aac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:14.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f5343fff640 1 --2- 172.21.15.88:0/2093079012 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f534c06d990 0x7f5338003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:14.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f5343fff640 1 --2- 172.21.15.88:0/2093079012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5338003f00 0x7f53380047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:14.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f5343fff640 1 --2- 172.21.15.88:0/2093079012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5338004d10 0x7f5338005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:14.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f5343fff640 1 -- 172.21.15.88:0/2093079012 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c1528c0 con 0x7f5338003f00 2023-12-08T08:21:14.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f5343fff640 1 -- 172.21.15.88:0/2093079012 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c152ba0 con 0x7f5338004d10 2023-12-08T08:21:14.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f5343fff640 1 -- 172.21.15.88:0/2093079012 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533800b9c0 con 0x7f534c06d990 2023-12-08T08:21:14.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f5350fb2640 1 --2- 172.21.15.88:0/2093079012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5338003f00 0x7f53380047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:14.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f53517b3640 1 --2- 172.21.15.88:0/2093079012 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f534c06d990 0x7f5338003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:14.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f5351fb4640 1 --2- 172.21.15.88:0/2093079012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5338004d10 0x7f5338005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:14.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f5350fb2640 1 -- 172.21.15.88:0/2093079012 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f534c06d990 msgr2=0x7f5338003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:14.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f5350fb2640 1 --2- 172.21.15.88:0/2093079012 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f534c06d990 0x7f5338003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f5350fb2640 1 -- 172.21.15.88:0/2093079012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5338004d10 msgr2=0x7f5338005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:14.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f5350fb2640 1 --2- 172.21.15.88:0/2093079012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5338004d10 0x7f5338005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.836+0000 7f5350fb2640 1 -- 172.21.15.88:0/2093079012 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5338003530 con 0x7f5338003f00 2023-12-08T08:21:14.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.840+0000 7f5350fb2640 1 --2- 172.21.15.88:0/2093079012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5338003f00 0x7f53380047d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f533c009ab0 tx=0x7f533c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d271bb3c07b33bb2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:14.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.840+0000 7f5343fff640 1 -- 172.21.15.88:0/2093079012 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c0a5620 con 0x7f5338003f00 2023-12-08T08:21:14.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.840+0000 7f5343fff640 1 -- 172.21.15.88:0/2093079012 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c0a5780 con 0x7f5338003f00 2023-12-08T08:21:14.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.840+0000 7f5343fff640 1 -- 172.21.15.88:0/2093079012 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c0a5b30 con 0x7f5338003f00 2023-12-08T08:21:14.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.840+0000 7f53527b5640 1 -- 172.21.15.88:0/2093079012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5338003f00 msgr2=0x7f53380047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:14.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.840+0000 7f53527b5640 1 --2- 172.21.15.88:0/2093079012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5338003f00 0x7f53380047d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f533c009ab0 tx=0x7f533c01ca30 comp rx=0 tx=0).stop 2023-12-08T08:21:14.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.840+0000 7f5351fb4640 1 -- 172.21.15.88:0/2093079012 reap_dead start 2023-12-08T08:21:14.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.840+0000 7f53527b5640 1 -- 172.21.15.88:0/2093079012 shutdown_connections 2023-12-08T08:21:14.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.840+0000 7f53527b5640 1 -- 172.21.15.88:0/2093079012 >> 172.21.15.88:0/2093079012 conn(0x7f534c0c2350 msgr2=0x7f534c0c2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:14.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.840+0000 7f53527b5640 1 -- 172.21.15.88:0/2093079012 shutdown_connections 2023-12-08T08:21:14.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.840+0000 7f53527b5640 1 -- 172.21.15.88:0/2093079012 wait complete. 2023-12-08T08:21:14.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.840+0000 7f53527b5640 1 Processor -- start 2023-12-08T08:21:14.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.840+0000 7f53527b5640 1 -- start start 2023-12-08T08:21:14.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.844+0000 7f53527b5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5338003f00 0x7f534c1db530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:14.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.844+0000 7f53527b5640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f534c155d90 0x7f534c1e05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:14.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.844+0000 7f53527b5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f534c14e5f0 0x7f534c1eaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:14.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.844+0000 7f53527b5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c1e0b30 con 0x7f5338003f00 2023-12-08T08:21:14.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.844+0000 7f53527b5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c1ea9b0 con 0x7f534c14e5f0 2023-12-08T08:21:14.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.844+0000 7f53527b5640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534c154fd0 con 0x7f534c155d90 2023-12-08T08:21:14.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.844+0000 7f53517b3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5338003f00 0x7f534c1db530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:14.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.844+0000 7f53517b3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5338003f00 0x7f534c1db530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47506/0 (socket says 172.21.15.88:47506) 2023-12-08T08:21:14.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.844+0000 7f53517b3640 1 -- 172.21.15.88:0/4097059469 learned_addr learned my addr 172.21.15.88:0/4097059469 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:14.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.844+0000 7f5351fb4640 1 --2- 172.21.15.88:0/4097059469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f534c14e5f0 0x7f534c1eaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:14.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.844+0000 7f5350fb2640 1 --2- 172.21.15.88:0/4097059469 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f534c155d90 0x7f534c1e05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:14.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.844+0000 7f53517b3640 1 -- 172.21.15.88:0/4097059469 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f534c155d90 msgr2=0x7f534c1e05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:14.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.844+0000 7f53517b3640 1 --2- 172.21.15.88:0/4097059469 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f534c155d90 0x7f534c1e05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.844+0000 7f53517b3640 1 -- 172.21.15.88:0/4097059469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f534c14e5f0 msgr2=0x7f534c1eaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:14.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.844+0000 7f53517b3640 1 --2- 172.21.15.88:0/4097059469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f534c14e5f0 0x7f534c1eaf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:14.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.844+0000 7f53517b3640 1 -- 172.21.15.88:0/4097059469 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c1552b0 con 0x7f5338003f00 2023-12-08T08:21:14.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.844+0000 7f53517b3640 1 --2- 172.21.15.88:0/4097059469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5338003f00 0x7f534c1db530 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5348007340 tx=0x7f5348007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:14.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.844+0000 7f5341ffb640 1 -- 172.21.15.88:0/4097059469 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534800f9c0 con 0x7f5338003f00 2023-12-08T08:21:14.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.844+0000 7f5341ffb640 1 -- 172.21.15.88:0/4097059469 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534800fb20 con 0x7f5338003f00 2023-12-08T08:21:14.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.844+0000 7f53527b5640 1 -- 172.21.15.88:0/4097059469 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534c155590 con 0x7f5338003f00 2023-12-08T08:21:14.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.844+0000 7f5341ffb640 1 -- 172.21.15.88:0/4097059469 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534800feb0 con 0x7f5338003f00 2023-12-08T08:21:14.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.844+0000 7f53527b5640 1 -- 172.21.15.88:0/4097059469 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534c1eb4b0 con 0x7f5338003f00 2023-12-08T08:21:14.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.844+0000 7f53527b5640 1 -- 172.21.15.88:0/4097059469 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f534c0674b0 con 0x7f5338003f00 2023-12-08T08:21:14.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.844+0000 7f5341ffb640 1 -- 172.21.15.88:0/4097059469 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f534801d460 con 0x7f5338003f00 2023-12-08T08:21:14.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.848+0000 7f5341ffb640 1 --2- 172.21.15.88:0/4097059469 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f53300664a0 0x7f5330068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:14.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.848+0000 7f5341ffb640 1 -- 172.21.15.88:0/4097059469 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5348083fe0 con 0x7f5338003f00 2023-12-08T08:21:14.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.848+0000 7f5350fb2640 1 --2- 172.21.15.88:0/4097059469 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f53300664a0 0x7f5330068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:14.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.848+0000 7f5350fb2640 1 --2- 172.21.15.88:0/4097059469 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f53300664a0 0x7f5330068960 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f533c0af000 tx=0x7f533c0046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:14.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:14.852+0000 7f5341ffb640 1 -- 172.21.15.88:0/4097059469 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5348051510 con 0x7f5338003f00 2023-12-08T08:21:15.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.000+0000 7f53527b5640 1 -- 172.21.15.88:0/4097059469 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f534c155a40 con 0x7f5338003f00 2023-12-08T08:21:15.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.000+0000 7f5341ffb640 1 -- 172.21.15.88:0/4097059469 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5348054b30 con 0x7f5338003f00 2023-12-08T08:21:15.009 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:21:15.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.004+0000 7f53527b5640 1 -- 172.21.15.88:0/4097059469 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f53300664a0 msgr2=0x7f5330068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:15.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.004+0000 7f53527b5640 1 --2- 172.21.15.88:0/4097059469 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f53300664a0 0x7f5330068960 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f533c0af000 tx=0x7f533c0046d0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.004+0000 7f53527b5640 1 -- 172.21.15.88:0/4097059469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5338003f00 msgr2=0x7f534c1db530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:15.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.004+0000 7f53527b5640 1 --2- 172.21.15.88:0/4097059469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5338003f00 0x7f534c1db530 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5348007340 tx=0x7f5348007800 comp rx=0 tx=0).stop 2023-12-08T08:21:15.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.004+0000 7f53527b5640 1 -- 172.21.15.88:0/4097059469 shutdown_connections 2023-12-08T08:21:15.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.004+0000 7f53527b5640 1 --2- 172.21.15.88:0/4097059469 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f53300664a0 0x7f5330068960 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.004+0000 7f53527b5640 1 --2- 172.21.15.88:0/4097059469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f534c14e5f0 0x7f534c1eaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.004+0000 7f53527b5640 1 --2- 172.21.15.88:0/4097059469 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f534c155d90 0x7f534c1e05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.004+0000 7f53527b5640 1 --2- 172.21.15.88:0/4097059469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5338003f00 0x7f534c1db530 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.004+0000 7f53527b5640 1 -- 172.21.15.88:0/4097059469 >> 172.21.15.88:0/4097059469 conn(0x7f534c0c2350 msgr2=0x7f534c0aa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:15.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.004+0000 7f53527b5640 1 -- 172.21.15.88:0/4097059469 shutdown_connections 2023-12-08T08:21:15.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.004+0000 7f53527b5640 1 -- 172.21.15.88:0/4097059469 wait complete. 2023-12-08T08:21:15.030 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:21:15.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f53a352a640 1 Processor -- start 2023-12-08T08:21:15.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f53a352a640 1 -- start start 2023-12-08T08:21:15.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f53a352a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f539c14b1e0 0x7f539c0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:15.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f53a352a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f539c0c5300 0x7f539c0a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:15.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f53a352a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f539c0a4e20 con 0x7f539c151280 2023-12-08T08:21:15.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f53a352a640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f539c1558d0 con 0x7f539c14b1e0 2023-12-08T08:21:15.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f53a352a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539c0a50e0 con 0x7f539c0c5300 2023-12-08T08:21:15.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f53a1ac7640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f539c151280 0x7f539c151710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58026/0 (socket says 172.21.15.88:58026) 2023-12-08T08:21:15.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f53a1ac7640 1 -- 172.21.15.88:0/3993631723 learned_addr learned my addr 172.21.15.88:0/3993631723 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:15.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f53a12c6640 1 --2- 172.21.15.88:0/3993631723 >> v2:172.21.15.148:3300/0 conn(0x7f539c14b1e0 0x7f539c0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:15.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f5393fff640 1 -- 172.21.15.88:0/3993631723 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1344750226 0 0) 0x7f539c0a4e20 con 0x7f539c151280 2023-12-08T08:21:15.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f5393fff640 1 -- 172.21.15.88:0/3993631723 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5388003530 con 0x7f539c151280 2023-12-08T08:21:15.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f53a0ac5640 1 --2- 172.21.15.88:0/3993631723 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f539c0c5300 0x7f539c0a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:15.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f5393fff640 1 -- 172.21.15.88:0/3993631723 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3153294081 0 0) 0x7f5388003530 con 0x7f539c151280 2023-12-08T08:21:15.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f5393fff640 1 -- 172.21.15.88:0/3993631723 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f539c0c5300 msgr2=0x7f539c0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:15.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f5393fff640 1 --2- 172.21.15.88:0/3993631723 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f539c0c5300 0x7f539c0a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f5393fff640 1 -- 172.21.15.88:0/3993631723 >> v2:172.21.15.148:3300/0 conn(0x7f539c14b1e0 msgr2=0x7f539c0c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:15.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f5393fff640 1 --2- 172.21.15.88:0/3993631723 >> v2:172.21.15.148:3300/0 conn(0x7f539c14b1e0 0x7f539c0c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f5393fff640 1 -- 172.21.15.88:0/3993631723 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539c0c0f00 con 0x7f539c151280 2023-12-08T08:21:15.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f5393fff640 1 -- 172.21.15.88:0/3993631723 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f5394001a20 con 0x7f539c151280 2023-12-08T08:21:15.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f5393fff640 1 -- 172.21.15.88:0/3993631723 >> v1:172.21.15.88:6789/0 conn(0x7f539c151280 legacy=0x7f539c151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:15.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f5393fff640 1 --2- 172.21.15.88:0/3993631723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5388003980 0x7f5388003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:15.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f5393fff640 1 --2- 172.21.15.88:0/3993631723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53880047d0 0x7f5388004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:15.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f5393fff640 1 --2- 172.21.15.88:0/3993631723 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f539c0c5300 0x7f5388005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:15.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f5393fff640 1 -- 172.21.15.88:0/3993631723 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539c1558d0 con 0x7f5388003980 2023-12-08T08:21:15.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f5393fff640 1 -- 172.21.15.88:0/3993631723 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539c0a50e0 con 0x7f53880047d0 2023-12-08T08:21:15.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f5393fff640 1 -- 172.21.15.88:0/3993631723 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538800fda0 con 0x7f539c0c5300 2023-12-08T08:21:15.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f53a12c6640 1 --2- 172.21.15.88:0/3993631723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5388003980 0x7f5388003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:15.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f53a0ac5640 1 --2- 172.21.15.88:0/3993631723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53880047d0 0x7f5388004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:15.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f53a1ac7640 1 --2- 172.21.15.88:0/3993631723 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f539c0c5300 0x7f5388005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:15.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f53a12c6640 1 -- 172.21.15.88:0/3993631723 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f539c0c5300 msgr2=0x7f5388005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:15.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f53a12c6640 1 --2- 172.21.15.88:0/3993631723 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f539c0c5300 0x7f5388005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f53a12c6640 1 -- 172.21.15.88:0/3993631723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53880047d0 msgr2=0x7f5388004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:15.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f53a12c6640 1 --2- 172.21.15.88:0/3993631723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53880047d0 0x7f5388004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.164+0000 7f53a12c6640 1 -- 172.21.15.88:0/3993631723 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5388003530 con 0x7f5388003980 2023-12-08T08:21:15.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.168+0000 7f53a12c6640 1 --2- 172.21.15.88:0/3993631723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5388003980 0x7f5388003da0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f539800bbf0 tx=0x7f539801ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e4be1d936830d1b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:15.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.168+0000 7f5393fff640 1 -- 172.21.15.88:0/3993631723 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53980a5ad0 con 0x7f5388003980 2023-12-08T08:21:15.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.168+0000 7f5393fff640 1 -- 172.21.15.88:0/3993631723 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53980a5c30 con 0x7f5388003980 2023-12-08T08:21:15.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.168+0000 7f5393fff640 1 -- 172.21.15.88:0/3993631723 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53980ad440 con 0x7f5388003980 2023-12-08T08:21:15.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.168+0000 7f53a352a640 1 -- 172.21.15.88:0/3993631723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5388003980 msgr2=0x7f5388003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:15.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.168+0000 7f53a352a640 1 --2- 172.21.15.88:0/3993631723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5388003980 0x7f5388003da0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f539800bbf0 tx=0x7f539801ce40 comp rx=0 tx=0).stop 2023-12-08T08:21:15.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.168+0000 7f53a1ac7640 1 -- 172.21.15.88:0/3993631723 reap_dead start 2023-12-08T08:21:15.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.168+0000 7f53a352a640 1 -- 172.21.15.88:0/3993631723 shutdown_connections 2023-12-08T08:21:15.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.168+0000 7f53a352a640 1 -- 172.21.15.88:0/3993631723 >> 172.21.15.88:0/3993631723 conn(0x7f539c0c59f0 msgr2=0x7f539c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:15.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.168+0000 7f53a352a640 1 -- 172.21.15.88:0/3993631723 shutdown_connections 2023-12-08T08:21:15.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.168+0000 7f53a352a640 1 -- 172.21.15.88:0/3993631723 wait complete. 2023-12-08T08:21:15.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.172+0000 7f53a352a640 1 Processor -- start 2023-12-08T08:21:15.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.172+0000 7f53a352a640 1 -- start start 2023-12-08T08:21:15.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.172+0000 7f53a352a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5388003980 0x7f539c1e00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:15.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.172+0000 7f53a352a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f539c13f400 0x7f539c13f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:15.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.172+0000 7f53a352a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f539c1e8ea0 0x7f539c1e9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:15.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.172+0000 7f53a352a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539c06cdc0 con 0x7f539c1e8ea0 2023-12-08T08:21:15.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.172+0000 7f53a352a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539c0a5f10 con 0x7f539c13f400 2023-12-08T08:21:15.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.172+0000 7f53a352a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539c140190 con 0x7f5388003980 2023-12-08T08:21:15.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.172+0000 7f53a1ac7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f539c1e8ea0 0x7f539c1e9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:15.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.172+0000 7f53a1ac7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f539c1e8ea0 0x7f539c1e9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47526/0 (socket says 172.21.15.88:47526) 2023-12-08T08:21:15.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.172+0000 7f53a1ac7640 1 -- 172.21.15.88:0/1114339407 learned_addr learned my addr 172.21.15.88:0/1114339407 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:15.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.172+0000 7f53a0ac5640 1 --2- 172.21.15.88:0/1114339407 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f539c13f400 0x7f539c13f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:15.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.172+0000 7f53a12c6640 1 --2- 172.21.15.88:0/1114339407 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5388003980 0x7f539c1e00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:15.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.172+0000 7f53a1ac7640 1 -- 172.21.15.88:0/1114339407 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5388003980 msgr2=0x7f539c1e00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:15.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.172+0000 7f53a1ac7640 1 --2- 172.21.15.88:0/1114339407 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5388003980 0x7f539c1e00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.172+0000 7f53a1ac7640 1 -- 172.21.15.88:0/1114339407 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f539c13f400 msgr2=0x7f539c13f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:15.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.172+0000 7f53a1ac7640 1 --2- 172.21.15.88:0/1114339407 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f539c13f400 0x7f539c13f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.172+0000 7f53a1ac7640 1 -- 172.21.15.88:0/1114339407 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539c06d010 con 0x7f539c1e8ea0 2023-12-08T08:21:15.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.172+0000 7f53a0ac5640 1 --2- 172.21.15.88:0/1114339407 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f539c13f400 0x7f539c13f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:15.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.172+0000 7f53a12c6640 1 --2- 172.21.15.88:0/1114339407 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5388003980 0x7f539c1e00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:15.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.172+0000 7f53a1ac7640 1 --2- 172.21.15.88:0/1114339407 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f539c1e8ea0 0x7f539c1e9330 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f539c0bfff0 tx=0x7f5394007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:15.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.172+0000 7f5391ffb640 1 -- 172.21.15.88:0/1114339407 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539400ad40 con 0x7f539c1e8ea0 2023-12-08T08:21:15.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.172+0000 7f5391ffb640 1 -- 172.21.15.88:0/1114339407 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53940133f0 con 0x7f539c1e8ea0 2023-12-08T08:21:15.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.172+0000 7f53a352a640 1 -- 172.21.15.88:0/1114339407 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f539c06d2f0 con 0x7f539c1e8ea0 2023-12-08T08:21:15.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.172+0000 7f5391ffb640 1 -- 172.21.15.88:0/1114339407 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53940137a0 con 0x7f539c1e8ea0 2023-12-08T08:21:15.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.172+0000 7f53a352a640 1 -- 172.21.15.88:0/1114339407 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f539c1e0600 con 0x7f539c1e8ea0 2023-12-08T08:21:15.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.176+0000 7f53a352a640 1 -- 172.21.15.88:0/1114339407 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f539c067630 con 0x7f539c1e8ea0 2023-12-08T08:21:15.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.176+0000 7f5391ffb640 1 -- 172.21.15.88:0/1114339407 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5394013900 con 0x7f539c1e8ea0 2023-12-08T08:21:15.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.176+0000 7f5391ffb640 1 --2- 172.21.15.88:0/1114339407 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5380066470 0x7f5380068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:15.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.176+0000 7f5391ffb640 1 -- 172.21.15.88:0/1114339407 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5394084940 con 0x7f539c1e8ea0 2023-12-08T08:21:15.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.176+0000 7f53a12c6640 1 --2- 172.21.15.88:0/1114339407 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5380066470 0x7f5380068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:15.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.176+0000 7f53a12c6640 1 --2- 172.21.15.88:0/1114339407 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5380066470 0x7f5380068930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f53980af000 tx=0x7f53980046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:15.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.180+0000 7f5391ffb640 1 -- 172.21.15.88:0/1114339407 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5394051db0 con 0x7f539c1e8ea0 2023-12-08T08:21:15.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.332+0000 7f53a352a640 1 -- 172.21.15.88:0/1114339407 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f539c073fd0 con 0x7f539c1e8ea0 2023-12-08T08:21:15.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.332+0000 7f5391ffb640 1 -- 172.21.15.88:0/1114339407 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5394017070 con 0x7f539c1e8ea0 2023-12-08T08:21:15.338 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:21:15.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.332+0000 7f53a352a640 1 -- 172.21.15.88:0/1114339407 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5380066470 msgr2=0x7f5380068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:15.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.332+0000 7f53a352a640 1 --2- 172.21.15.88:0/1114339407 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5380066470 0x7f5380068930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f53980af000 tx=0x7f53980046d0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.332+0000 7f53a352a640 1 -- 172.21.15.88:0/1114339407 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f539c1e8ea0 msgr2=0x7f539c1e9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:15.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.332+0000 7f53a352a640 1 --2- 172.21.15.88:0/1114339407 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f539c1e8ea0 0x7f539c1e9330 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f539c0bfff0 tx=0x7f5394007bd0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.332+0000 7f53a352a640 1 -- 172.21.15.88:0/1114339407 shutdown_connections 2023-12-08T08:21:15.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.332+0000 7f53a352a640 1 --2- 172.21.15.88:0/1114339407 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5380066470 0x7f5380068930 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.332+0000 7f53a352a640 1 --2- 172.21.15.88:0/1114339407 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f539c1e8ea0 0x7f539c1e9330 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.332+0000 7f53a352a640 1 --2- 172.21.15.88:0/1114339407 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f539c13f400 0x7f539c13f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.332+0000 7f53a352a640 1 --2- 172.21.15.88:0/1114339407 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5388003980 0x7f539c1e00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.332+0000 7f53a352a640 1 -- 172.21.15.88:0/1114339407 >> 172.21.15.88:0/1114339407 conn(0x7f539c0c59f0 msgr2=0x7f539c0733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:15.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.332+0000 7f53a352a640 1 -- 172.21.15.88:0/1114339407 shutdown_connections 2023-12-08T08:21:15.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.332+0000 7f53a352a640 1 -- 172.21.15.88:0/1114339407 wait complete. 2023-12-08T08:21:15.359 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-08T08:21:15.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.488+0000 7fad66ebb640 1 Processor -- start 2023-12-08T08:21:15.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.488+0000 7fad66ebb640 1 -- start start 2023-12-08T08:21:15.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.488+0000 7fad66ebb640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fad600bf310 0x7fad60154e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:15.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.488+0000 7fad66ebb640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad60157cf0 con 0x7fad6014b2a0 2023-12-08T08:21:15.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.488+0000 7fad66ebb640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad60157fd0 con 0x7fad600bee90 2023-12-08T08:21:15.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.488+0000 7fad66ebb640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad6006c3a0 con 0x7fad600bf310 2023-12-08T08:21:15.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.492+0000 7fad64c57640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fad6014b2a0 0x7fad600a4ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58038/0 (socket says 172.21.15.88:58038) 2023-12-08T08:21:15.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.492+0000 7fad64c57640 1 -- 172.21.15.88:0/2559766813 learned_addr learned my addr 172.21.15.88:0/2559766813 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:15.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.492+0000 7fad65458640 1 --2- 172.21.15.88:0/2559766813 >> v2:172.21.15.88:3300/0 conn(0x7fad600bf310 0x7fad60154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:15.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.492+0000 7fad577fe640 1 -- 172.21.15.88:0/2559766813 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 525857296 0 0) 0x7fad60157cf0 con 0x7fad6014b2a0 2023-12-08T08:21:15.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.492+0000 7fad577fe640 1 -- 172.21.15.88:0/2559766813 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad48003530 con 0x7fad6014b2a0 2023-12-08T08:21:15.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.492+0000 7fad65458640 1 -- 172.21.15.88:0/2559766813 >> v1:172.21.15.148:6789/0 conn(0x7fad600bee90 legacy=0x7fad60154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:15.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.492+0000 7fad577fe640 1 -- 172.21.15.88:0/2559766813 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3532054700 0 0) 0x7fad60157fd0 con 0x7fad600bee90 2023-12-08T08:21:15.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.492+0000 7fad65458640 1 -- 172.21.15.88:0/2559766813 >> v1:172.21.15.88:6789/0 conn(0x7fad6014b2a0 legacy=0x7fad600a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:15.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.492+0000 7fad65458640 1 -- 172.21.15.88:0/2559766813 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad601582b0 con 0x7fad600bf310 2023-12-08T08:21:15.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.492+0000 7fad65458640 1 --2- 172.21.15.88:0/2559766813 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad600bf310 0x7fad60154e50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fad58009d90 tx=0x7fad5801c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f768e0543145b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:15.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.492+0000 7fad577fe640 1 -- 172.21.15.88:0/2559766813 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad580a6700 con 0x7fad600bf310 2023-12-08T08:21:15.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.492+0000 7fad577fe640 1 -- 172.21.15.88:0/2559766813 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad580a6860 con 0x7fad600bf310 2023-12-08T08:21:15.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.492+0000 7fad577fe640 1 -- 172.21.15.88:0/2559766813 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad580a6bf0 con 0x7fad600bf310 2023-12-08T08:21:15.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.496+0000 7fad66ebb640 1 -- 172.21.15.88:0/2559766813 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad600bf310 msgr2=0x7fad60154e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:15.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.496+0000 7fad66ebb640 1 --2- 172.21.15.88:0/2559766813 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad600bf310 0x7fad60154e50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fad58009d90 tx=0x7fad5801c830 comp rx=0 tx=0).stop 2023-12-08T08:21:15.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.496+0000 7fad66ebb640 1 -- 172.21.15.88:0/2559766813 shutdown_connections 2023-12-08T08:21:15.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.496+0000 7fad66ebb640 1 --2- 172.21.15.88:0/2559766813 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad600bf310 0x7fad60154e50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.496+0000 7fad66ebb640 1 -- 172.21.15.88:0/2559766813 >> 172.21.15.88:0/2559766813 conn(0x7fad600a7810 msgr2=0x7fad600a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:15.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.496+0000 7fad66ebb640 1 -- 172.21.15.88:0/2559766813 shutdown_connections 2023-12-08T08:21:15.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.496+0000 7fad66ebb640 1 -- 172.21.15.88:0/2559766813 wait complete. 2023-12-08T08:21:15.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.496+0000 7fad66ebb640 1 Processor -- start 2023-12-08T08:21:15.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.496+0000 7fad66ebb640 1 -- start start 2023-12-08T08:21:15.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.496+0000 7fad66ebb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad600bee90 0x7fad6013d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:15.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.496+0000 7fad66ebb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad600bf310 0x7fad60156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:15.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.496+0000 7fad66ebb640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad6014b2a0 0x7fad601f0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:15.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.496+0000 7fad66ebb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad600abdc0 con 0x7fad600bf310 2023-12-08T08:21:15.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.496+0000 7fad66ebb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad60070510 con 0x7fad600bee90 2023-12-08T08:21:15.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.496+0000 7fad66ebb640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad601ecd50 con 0x7fad6014b2a0 2023-12-08T08:21:15.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.496+0000 7fad57fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad600bf310 0x7fad60156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:15.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.496+0000 7fad57fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad600bf310 0x7fad60156f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47554/0 (socket says 172.21.15.88:47554) 2023-12-08T08:21:15.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.496+0000 7fad57fff640 1 -- 172.21.15.88:0/459996157 learned_addr learned my addr 172.21.15.88:0/459996157 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:15.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.496+0000 7fad64c57640 1 --2- 172.21.15.88:0/459996157 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad600bee90 0x7fad6013d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:15.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.496+0000 7fad65458640 1 --2- 172.21.15.88:0/459996157 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad6014b2a0 0x7fad601f0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:15.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.496+0000 7fad57fff640 1 -- 172.21.15.88:0/459996157 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad6014b2a0 msgr2=0x7fad601f0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:15.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.496+0000 7fad57fff640 1 --2- 172.21.15.88:0/459996157 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad6014b2a0 0x7fad601f0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.496+0000 7fad57fff640 1 -- 172.21.15.88:0/459996157 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad600bee90 msgr2=0x7fad6013d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:15.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.496+0000 7fad57fff640 1 --2- 172.21.15.88:0/459996157 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad600bee90 0x7fad6013d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.496+0000 7fad57fff640 1 -- 172.21.15.88:0/459996157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad58009a70 con 0x7fad600bf310 2023-12-08T08:21:15.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.500+0000 7fad57fff640 1 --2- 172.21.15.88:0/459996157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad600bf310 0x7fad60156f80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fad50001ec0 tx=0x7fad5000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:15.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.500+0000 7fad557fa640 1 -- 172.21.15.88:0/459996157 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad500054e0 con 0x7fad600bf310 2023-12-08T08:21:15.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.500+0000 7fad557fa640 1 -- 172.21.15.88:0/459996157 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad50003600 con 0x7fad600bf310 2023-12-08T08:21:15.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.500+0000 7fad557fa640 1 -- 172.21.15.88:0/459996157 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad500039b0 con 0x7fad600bf310 2023-12-08T08:21:15.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.500+0000 7fad66ebb640 1 -- 172.21.15.88:0/459996157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad6006ff50 con 0x7fad600bf310 2023-12-08T08:21:15.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.500+0000 7fad66ebb640 1 -- 172.21.15.88:0/459996157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad601f0130 con 0x7fad600bf310 2023-12-08T08:21:15.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.500+0000 7fad66ebb640 1 -- 172.21.15.88:0/459996157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad601eff90 con 0x7fad600bf310 2023-12-08T08:21:15.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.500+0000 7fad557fa640 1 -- 172.21.15.88:0/459996157 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fad50003b10 con 0x7fad600bf310 2023-12-08T08:21:15.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.500+0000 7fad557fa640 1 --2- 172.21.15.88:0/459996157 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fad4c066470 0x7fad4c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:15.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.500+0000 7fad557fa640 1 -- 172.21.15.88:0/459996157 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad50083470 con 0x7fad600bf310 2023-12-08T08:21:15.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.500+0000 7fad64c57640 1 --2- 172.21.15.88:0/459996157 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fad4c066470 0x7fad4c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:15.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.504+0000 7fad64c57640 1 --2- 172.21.15.88:0/459996157 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fad4c066470 0x7fad4c068930 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fad5c007fd0 tx=0x7fad5c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:15.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.504+0000 7fad557fa640 1 -- 172.21.15.88:0/459996157 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fad601eff90 con 0x7fad600bf310 2023-12-08T08:21:15.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.656+0000 7fad66ebb640 1 -- 172.21.15.88:0/459996157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fad601eff90 con 0x7fad600bf310 2023-12-08T08:21:15.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.656+0000 7fad557fa640 1 -- 172.21.15.88:0/459996157 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+207 (secure 0 0 0) 0x7fad601eff90 con 0x7fad600bf310 2023-12-08T08:21:15.665 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:15.665 INFO:teuthology.orchestra.run.smithi088.stdout:[ 2023-12-08T08:21:15.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:15.666 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 1, 2023-12-08T08:21:15.666 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": ".mgr" 2023-12-08T08:21:15.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:15.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:15.666 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 4, 2023-12-08T08:21:15.666 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": "cephfs_metadata" 2023-12-08T08:21:15.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:15.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:15.666 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 5, 2023-12-08T08:21:15.666 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": "cephfs_data" 2023-12-08T08:21:15.666 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:15.666 INFO:teuthology.orchestra.run.smithi088.stdout:] 2023-12-08T08:21:15.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.660+0000 7fad66ebb640 1 -- 172.21.15.88:0/459996157 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fad4c066470 msgr2=0x7fad4c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:15.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.660+0000 7fad66ebb640 1 --2- 172.21.15.88:0/459996157 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fad4c066470 0x7fad4c068930 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fad5c007fd0 tx=0x7fad5c009040 comp rx=0 tx=0).stop 2023-12-08T08:21:15.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.660+0000 7fad66ebb640 1 -- 172.21.15.88:0/459996157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad600bf310 msgr2=0x7fad60156f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:15.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.660+0000 7fad66ebb640 1 --2- 172.21.15.88:0/459996157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad600bf310 0x7fad60156f80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fad50001ec0 tx=0x7fad5000c8e0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.660+0000 7fad66ebb640 1 -- 172.21.15.88:0/459996157 shutdown_connections 2023-12-08T08:21:15.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.660+0000 7fad66ebb640 1 --2- 172.21.15.88:0/459996157 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fad4c066470 0x7fad4c068930 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.660+0000 7fad66ebb640 1 --2- 172.21.15.88:0/459996157 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad6014b2a0 0x7fad601f0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.660+0000 7fad66ebb640 1 --2- 172.21.15.88:0/459996157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad600bf310 0x7fad60156f80 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.660+0000 7fad66ebb640 1 --2- 172.21.15.88:0/459996157 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad600bee90 0x7fad6013d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.660+0000 7fad66ebb640 1 -- 172.21.15.88:0/459996157 >> 172.21.15.88:0/459996157 conn(0x7fad600a7810 msgr2=0x7fad60149550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:15.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.660+0000 7fad66ebb640 1 -- 172.21.15.88:0/459996157 shutdown_connections 2023-12-08T08:21:15.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.660+0000 7fad66ebb640 1 -- 172.21.15.88:0/459996157 wait complete. 2023-12-08T08:21:15.686 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-12-08T08:21:15.686 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-12-08T08:21:15.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e73f57640 1 Processor -- start 2023-12-08T08:21:15.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e73f57640 1 -- start start 2023-12-08T08:21:15.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e73f57640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0e6c0c5300 0x7f0e6c0a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:15.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e73f57640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e6c0a4e20 con 0x7f0e6c14b1e0 2023-12-08T08:21:15.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e73f57640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e6c0a50e0 con 0x7f0e6c1548c0 2023-12-08T08:21:15.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e73f57640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e6c0c0f00 con 0x7f0e6c0c5300 2023-12-08T08:21:15.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e71cf3640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0e6c14b1e0 0x7f0e6c0c1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58040/0 (socket says 172.21.15.88:58040) 2023-12-08T08:21:15.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e71cf3640 1 -- 172.21.15.88:0/4016363068 learned_addr learned my addr 172.21.15.88:0/4016363068 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:15.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e714f2640 1 --2- 172.21.15.88:0/4016363068 >> v2:172.21.15.148:3300/0 conn(0x7f0e6c0c5300 0x7f0e6c0a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:15.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e70cf1640 1 -- 172.21.15.88:0/4016363068 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873474385 0 0) 0x7f0e6c0a4e20 con 0x7f0e6c14b1e0 2023-12-08T08:21:15.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e70cf1640 1 -- 172.21.15.88:0/4016363068 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e58003530 con 0x7f0e6c14b1e0 2023-12-08T08:21:15.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e70cf1640 1 -- 172.21.15.88:0/4016363068 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642909267 0 0) 0x7f0e6c0a50e0 con 0x7f0e6c1548c0 2023-12-08T08:21:15.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e70cf1640 1 -- 172.21.15.88:0/4016363068 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e6c0a4e20 con 0x7f0e6c1548c0 2023-12-08T08:21:15.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e70cf1640 1 -- 172.21.15.88:0/4016363068 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 986158895 0 0) 0x7f0e58003530 con 0x7f0e6c14b1e0 2023-12-08T08:21:15.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e70cf1640 1 -- 172.21.15.88:0/4016363068 >> v2:172.21.15.148:3300/0 conn(0x7f0e6c0c5300 msgr2=0x7f0e6c0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:15.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e70cf1640 1 --2- 172.21.15.88:0/4016363068 >> v2:172.21.15.148:3300/0 conn(0x7f0e6c0c5300 0x7f0e6c0a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e70cf1640 1 -- 172.21.15.88:0/4016363068 >> v1:172.21.15.148:6789/0 conn(0x7f0e6c1548c0 legacy=0x7f0e6c154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:15.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e70cf1640 1 -- 172.21.15.88:0/4016363068 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6c0c11e0 con 0x7f0e6c14b1e0 2023-12-08T08:21:15.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e70cf1640 1 -- 172.21.15.88:0/4016363068 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f0e68001680 con 0x7f0e6c14b1e0 2023-12-08T08:21:15.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e70cf1640 1 -- 172.21.15.88:0/4016363068 >> v1:172.21.15.88:6789/0 conn(0x7f0e6c14b1e0 legacy=0x7f0e6c0c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:15.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e70cf1640 1 --2- 172.21.15.88:0/4016363068 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e58003b10 0x7f0e58003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:15.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e70cf1640 1 --2- 172.21.15.88:0/4016363068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e580047d0 0x7f0e58004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:15.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e70cf1640 1 --2- 172.21.15.88:0/4016363068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e58005190 0x7f0e5800ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:15.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e70cf1640 1 -- 172.21.15.88:0/4016363068 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c0c0f00 con 0x7f0e58005190 2023-12-08T08:21:15.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e70cf1640 1 -- 172.21.15.88:0/4016363068 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580104e0 con 0x7f0e580047d0 2023-12-08T08:21:15.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e70cf1640 1 -- 172.21.15.88:0/4016363068 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e58010620 con 0x7f0e58003b10 2023-12-08T08:21:15.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e714f2640 1 --2- 172.21.15.88:0/4016363068 >> v2:172.21.15.148:3300/0 conn(0x7f0e6c0c5300 0x7f0e6c0a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:21:15.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e724f4640 1 --2- 172.21.15.88:0/4016363068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e58005190 0x7f0e5800ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:15.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e71cf3640 1 --2- 172.21.15.88:0/4016363068 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e58003b10 0x7f0e58003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:15.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e714f2640 1 --2- 172.21.15.88:0/4016363068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e580047d0 0x7f0e58004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:15.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e724f4640 1 -- 172.21.15.88:0/4016363068 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e58003b10 msgr2=0x7f0e58003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:15.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e724f4640 1 --2- 172.21.15.88:0/4016363068 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e58003b10 0x7f0e58003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e724f4640 1 -- 172.21.15.88:0/4016363068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e580047d0 msgr2=0x7f0e58004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:15.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e724f4640 1 --2- 172.21.15.88:0/4016363068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e580047d0 0x7f0e58004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.824+0000 7f0e724f4640 1 -- 172.21.15.88:0/4016363068 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e58003530 con 0x7f0e58005190 2023-12-08T08:21:15.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.828+0000 7f0e724f4640 1 -- 172.21.15.88:0/4016363068 reap_dead start 2023-12-08T08:21:15.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.828+0000 7f0e724f4640 1 --2- 172.21.15.88:0/4016363068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e58005190 0x7f0e5800ffa0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0e64001fd0 tx=0x7f0e6401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef97eb91ff7ef8c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:15.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.828+0000 7f0e70cf1640 1 -- 172.21.15.88:0/4016363068 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e64003b80 con 0x7f0e58005190 2023-12-08T08:21:15.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.828+0000 7f0e70cf1640 1 -- 172.21.15.88:0/4016363068 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e64003ce0 con 0x7f0e58005190 2023-12-08T08:21:15.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.828+0000 7f0e70cf1640 1 -- 172.21.15.88:0/4016363068 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e64005310 con 0x7f0e58005190 2023-12-08T08:21:15.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.828+0000 7f0e73f57640 1 -- 172.21.15.88:0/4016363068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e58005190 msgr2=0x7f0e5800ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:15.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.828+0000 7f0e73f57640 1 --2- 172.21.15.88:0/4016363068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e58005190 0x7f0e5800ffa0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0e64001fd0 tx=0x7f0e6401c8e0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.828+0000 7f0e73f57640 1 -- 172.21.15.88:0/4016363068 shutdown_connections 2023-12-08T08:21:15.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.828+0000 7f0e73f57640 1 --2- 172.21.15.88:0/4016363068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e58005190 0x7f0e5800ffa0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.828+0000 7f0e73f57640 1 -- 172.21.15.88:0/4016363068 >> 172.21.15.88:0/4016363068 conn(0x7f0e6c0c59f0 msgr2=0x7f0e6c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:15.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.828+0000 7f0e73f57640 1 -- 172.21.15.88:0/4016363068 shutdown_connections 2023-12-08T08:21:15.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.828+0000 7f0e73f57640 1 -- 172.21.15.88:0/4016363068 wait complete. 2023-12-08T08:21:15.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.832+0000 7f0e73f57640 1 Processor -- start 2023-12-08T08:21:15.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.832+0000 7f0e73f57640 1 -- start start 2023-12-08T08:21:15.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.832+0000 7f0e73f57640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e58005190 0x7f0e6c1e8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:15.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.832+0000 7f0e73f57640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e6c153cc0 0x7f0e6c1e5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:15.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.832+0000 7f0e73f57640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e6c1e57c0 0x7f0e6c1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:15.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.832+0000 7f0e73f57640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c1e9520 con 0x7f0e6c153cc0 2023-12-08T08:21:15.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.832+0000 7f0e73f57640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c06fed0 con 0x7f0e58005190 2023-12-08T08:21:15.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.832+0000 7f0e73f57640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c0a5690 con 0x7f0e6c1e57c0 2023-12-08T08:21:15.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.832+0000 7f0e714f2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e6c153cc0 0x7f0e6c1e5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:15.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.832+0000 7f0e714f2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e6c153cc0 0x7f0e6c1e5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47570/0 (socket says 172.21.15.88:47570) 2023-12-08T08:21:15.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.832+0000 7f0e714f2640 1 -- 172.21.15.88:0/3729564076 learned_addr learned my addr 172.21.15.88:0/3729564076 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:15.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.832+0000 7f0e724f4640 1 --2- 172.21.15.88:0/3729564076 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e6c1e57c0 0x7f0e6c1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:15.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.832+0000 7f0e71cf3640 1 --2- 172.21.15.88:0/3729564076 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e58005190 0x7f0e6c1e8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:15.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.832+0000 7f0e714f2640 1 -- 172.21.15.88:0/3729564076 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e6c1e57c0 msgr2=0x7f0e6c1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:15.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.832+0000 7f0e714f2640 1 --2- 172.21.15.88:0/3729564076 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e6c1e57c0 0x7f0e6c1447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.832+0000 7f0e714f2640 1 -- 172.21.15.88:0/3729564076 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e58005190 msgr2=0x7f0e6c1e8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:15.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.832+0000 7f0e714f2640 1 --2- 172.21.15.88:0/3729564076 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e58005190 0x7f0e6c1e8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:15.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.832+0000 7f0e714f2640 1 -- 172.21.15.88:0/3729564076 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6c06fb60 con 0x7f0e6c153cc0 2023-12-08T08:21:15.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.832+0000 7f0e71cf3640 1 --2- 172.21.15.88:0/3729564076 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e58005190 0x7f0e6c1e8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:15.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.832+0000 7f0e714f2640 1 --2- 172.21.15.88:0/3729564076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e6c153cc0 0x7f0e6c1e5280 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c0115f0 tx=0x7f0e5c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:15.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.832+0000 7f0e627fc640 1 -- 172.21.15.88:0/3729564076 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c00f8f0 con 0x7f0e6c153cc0 2023-12-08T08:21:15.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.832+0000 7f0e627fc640 1 -- 172.21.15.88:0/3729564076 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5c00fa50 con 0x7f0e6c153cc0 2023-12-08T08:21:15.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.832+0000 7f0e627fc640 1 -- 172.21.15.88:0/3729564076 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c00fde0 con 0x7f0e6c153cc0 2023-12-08T08:21:15.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.832+0000 7f0e73f57640 1 -- 172.21.15.88:0/3729564076 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e6c0a5970 con 0x7f0e6c153cc0 2023-12-08T08:21:15.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.832+0000 7f0e73f57640 1 -- 172.21.15.88:0/3729564076 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6c06d6a0 con 0x7f0e6c153cc0 2023-12-08T08:21:15.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.832+0000 7f0e73f57640 1 -- 172.21.15.88:0/3729564076 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e6c070360 con 0x7f0e6c153cc0 2023-12-08T08:21:15.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.836+0000 7f0e627fc640 1 -- 172.21.15.88:0/3729564076 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0e5c015460 con 0x7f0e6c153cc0 2023-12-08T08:21:15.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.836+0000 7f0e627fc640 1 --2- 172.21.15.88:0/3729564076 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0e50066470 0x7f0e50068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:15.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.836+0000 7f0e627fc640 1 -- 172.21.15.88:0/3729564076 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e5c084820 con 0x7f0e6c153cc0 2023-12-08T08:21:15.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.836+0000 7f0e71cf3640 1 --2- 172.21.15.88:0/3729564076 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0e50066470 0x7f0e50068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:15.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.836+0000 7f0e71cf3640 1 --2- 172.21.15.88:0/3729564076 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0e50066470 0x7f0e50068930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0e680017b0 tx=0x7f0e68001160 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:15.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.840+0000 7f0e627fc640 1 -- 172.21.15.88:0/3729564076 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0e6c070360 con 0x7f0e6c153cc0 2023-12-08T08:21:15.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:15.988+0000 7f0e73f57640 1 -- 172.21.15.88:0/3729564076 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0e6c070010 con 0x7f0e6c153cc0 2023-12-08T08:21:16.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.640+0000 7f0e627fc640 1 -- 172.21.15.88:0/3729564076 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v32) v1 ==== 140+0+0 (secure 0 0 0) 0x7f0e6c070010 con 0x7f0e6c153cc0 2023-12-08T08:21:16.642 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs2_metadata' created 2023-12-08T08:21:16.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.640+0000 7f0e73f57640 1 -- 172.21.15.88:0/3729564076 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0e50066470 msgr2=0x7f0e50068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:16.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.640+0000 7f0e73f57640 1 --2- 172.21.15.88:0/3729564076 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0e50066470 0x7f0e50068930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0e680017b0 tx=0x7f0e68001160 comp rx=0 tx=0).stop 2023-12-08T08:21:16.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.640+0000 7f0e73f57640 1 -- 172.21.15.88:0/3729564076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e6c153cc0 msgr2=0x7f0e6c1e5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:16.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.640+0000 7f0e73f57640 1 --2- 172.21.15.88:0/3729564076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e6c153cc0 0x7f0e6c1e5280 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c0115f0 tx=0x7f0e5c011ab0 comp rx=0 tx=0).stop 2023-12-08T08:21:16.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.640+0000 7f0e73f57640 1 -- 172.21.15.88:0/3729564076 shutdown_connections 2023-12-08T08:21:16.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.640+0000 7f0e73f57640 1 --2- 172.21.15.88:0/3729564076 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0e50066470 0x7f0e50068930 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:16.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.640+0000 7f0e73f57640 1 --2- 172.21.15.88:0/3729564076 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0e6c1e57c0 0x7f0e6c1447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:16.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.640+0000 7f0e73f57640 1 --2- 172.21.15.88:0/3729564076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e6c153cc0 0x7f0e6c1e5280 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:16.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.640+0000 7f0e73f57640 1 --2- 172.21.15.88:0/3729564076 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e58005190 0x7f0e6c1e8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:16.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.640+0000 7f0e73f57640 1 -- 172.21.15.88:0/3729564076 >> 172.21.15.88:0/3729564076 conn(0x7f0e6c0c59f0 msgr2=0x7f0e6c149b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:16.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.640+0000 7f0e73f57640 1 -- 172.21.15.88:0/3729564076 shutdown_connections 2023-12-08T08:21:16.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.640+0000 7f0e73f57640 1 -- 172.21.15.88:0/3729564076 wait complete. 2023-12-08T08:21:16.671 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-08T08:21:16.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.812+0000 7f8c8659d640 1 Processor -- start 2023-12-08T08:21:16.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.816+0000 7f8c8659d640 1 -- start start 2023-12-08T08:21:16.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.816+0000 7f8c8659d640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8c800c6030 0x7f8c800c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:16.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.816+0000 7f8c8659d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c800c98f0 0x7f8c800c8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:16.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.816+0000 7f8c8659d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c80158780 con 0x7f8c800bf2d0 2023-12-08T08:21:16.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.816+0000 7f8c8659d640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c800c0300 con 0x7f8c800c6030 2023-12-08T08:21:16.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.816+0000 7f8c8659d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c80157b70 con 0x7f8c800c98f0 2023-12-08T08:21:16.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.816+0000 7f8c7ffff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8c800bf2d0 0x7f8c80151970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58050/0 (socket says 172.21.15.88:58050) 2023-12-08T08:21:16.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.816+0000 7f8c7ffff640 1 -- 172.21.15.88:0/375176619 learned_addr learned my addr 172.21.15.88:0/375176619 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:16.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.816+0000 7f8c84b3a640 1 --2- 172.21.15.88:0/375176619 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c800c98f0 0x7f8c800c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:16.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.816+0000 7f8c7f7fe640 1 --2- 172.21.15.88:0/375176619 >> v2:172.21.15.148:3300/0 conn(0x7f8c800c6030 0x7f8c800c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:16.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.816+0000 7f8c7effd640 1 -- 172.21.15.88:0/375176619 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2615442270 0 0) 0x7f8c80158780 con 0x7f8c800bf2d0 2023-12-08T08:21:16.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.816+0000 7f8c7effd640 1 -- 172.21.15.88:0/375176619 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c68003530 con 0x7f8c800bf2d0 2023-12-08T08:21:16.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.816+0000 7f8c84b3a640 1 -- 172.21.15.88:0/375176619 >> v2:172.21.15.148:3300/0 conn(0x7f8c800c6030 msgr2=0x7f8c800c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:16.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.816+0000 7f8c84b3a640 1 --2- 172.21.15.88:0/375176619 >> v2:172.21.15.148:3300/0 conn(0x7f8c800c6030 0x7f8c800c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:16.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.816+0000 7f8c84b3a640 1 -- 172.21.15.88:0/375176619 >> v1:172.21.15.88:6789/0 conn(0x7f8c800bf2d0 legacy=0x7f8c80151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:16.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.816+0000 7f8c84b3a640 1 -- 172.21.15.88:0/375176619 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c80157e50 con 0x7f8c800c98f0 2023-12-08T08:21:16.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.820+0000 7f8c84b3a640 1 --2- 172.21.15.88:0/375176619 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c800c98f0 0x7f8c800c8200 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009d90 tx=0x7f8c7801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d220b2ed791aeb7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:16.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.820+0000 7f8c7effd640 1 -- 172.21.15.88:0/375176619 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c780a59e0 con 0x7f8c800c98f0 2023-12-08T08:21:16.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.820+0000 7f8c7effd640 1 -- 172.21.15.88:0/375176619 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c780a5b40 con 0x7f8c800c98f0 2023-12-08T08:21:16.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.820+0000 7f8c7effd640 1 -- 172.21.15.88:0/375176619 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c780ad440 con 0x7f8c800c98f0 2023-12-08T08:21:16.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.820+0000 7f8c8659d640 1 -- 172.21.15.88:0/375176619 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c800c98f0 msgr2=0x7f8c800c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:16.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.820+0000 7f8c8659d640 1 --2- 172.21.15.88:0/375176619 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c800c98f0 0x7f8c800c8200 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009d90 tx=0x7f8c7801c920 comp rx=0 tx=0).stop 2023-12-08T08:21:16.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.820+0000 7f8c8659d640 1 -- 172.21.15.88:0/375176619 shutdown_connections 2023-12-08T08:21:16.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.820+0000 7f8c8659d640 1 --2- 172.21.15.88:0/375176619 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c800c98f0 0x7f8c800c8200 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:16.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.820+0000 7f8c8659d640 1 --2- 172.21.15.88:0/375176619 >> v2:172.21.15.148:3300/0 conn(0x7f8c800c6030 0x7f8c800c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:16.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.820+0000 7f8c8659d640 1 -- 172.21.15.88:0/375176619 >> 172.21.15.88:0/375176619 conn(0x7f8c800c9dc0 msgr2=0x7f8c800ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:16.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.820+0000 7f8c8659d640 1 -- 172.21.15.88:0/375176619 shutdown_connections 2023-12-08T08:21:16.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.820+0000 7f8c8659d640 1 -- 172.21.15.88:0/375176619 wait complete. 2023-12-08T08:21:16.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.820+0000 7f8c8659d640 1 Processor -- start 2023-12-08T08:21:16.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.824+0000 7f8c8659d640 1 -- start start 2023-12-08T08:21:16.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.824+0000 7f8c8659d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c800bf2d0 0x7f8c80153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:16.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.824+0000 7f8c8659d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c800c6030 0x7f8c80152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:16.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.824+0000 7f8c8659d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c800c98f0 0x7f8c801ef8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:16.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.824+0000 7f8c8659d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c801553d0 con 0x7f8c800bf2d0 2023-12-08T08:21:16.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.824+0000 7f8c8659d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8006c1f0 con 0x7f8c800c6030 2023-12-08T08:21:16.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.824+0000 7f8c8659d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8006c440 con 0x7f8c800c98f0 2023-12-08T08:21:16.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.824+0000 7f8c7ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c800bf2d0 0x7f8c80153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:16.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.824+0000 7f8c7ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c800bf2d0 0x7f8c80153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47580/0 (socket says 172.21.15.88:47580) 2023-12-08T08:21:16.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.824+0000 7f8c7ffff640 1 -- 172.21.15.88:0/1076026135 learned_addr learned my addr 172.21.15.88:0/1076026135 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:16.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.824+0000 7f8c7f7fe640 1 --2- 172.21.15.88:0/1076026135 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c800c6030 0x7f8c80152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:16.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.824+0000 7f8c84b3a640 1 --2- 172.21.15.88:0/1076026135 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c800c98f0 0x7f8c801ef8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:16.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.824+0000 7f8c7ffff640 1 -- 172.21.15.88:0/1076026135 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c800c98f0 msgr2=0x7f8c801ef8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:16.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.824+0000 7f8c7ffff640 1 --2- 172.21.15.88:0/1076026135 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c800c98f0 0x7f8c801ef8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:16.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.824+0000 7f8c7ffff640 1 -- 172.21.15.88:0/1076026135 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c800c6030 msgr2=0x7f8c80152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:16.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.824+0000 7f8c7ffff640 1 --2- 172.21.15.88:0/1076026135 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c800c6030 0x7f8c80152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:16.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.824+0000 7f8c7ffff640 1 -- 172.21.15.88:0/1076026135 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c78009a70 con 0x7f8c800bf2d0 2023-12-08T08:21:16.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.824+0000 7f8c7ffff640 1 --2- 172.21.15.88:0/1076026135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c800bf2d0 0x7f8c80153be0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8c7000c500 tx=0x7f8c7000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:16.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.824+0000 7f8c7cff9640 1 -- 172.21.15.88:0/1076026135 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c70005cf0 con 0x7f8c800bf2d0 2023-12-08T08:21:16.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.824+0000 7f8c7cff9640 1 -- 172.21.15.88:0/1076026135 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c70005e50 con 0x7f8c800bf2d0 2023-12-08T08:21:16.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.824+0000 7f8c8659d640 1 -- 172.21.15.88:0/1076026135 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c8006c720 con 0x7f8c800bf2d0 2023-12-08T08:21:16.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.824+0000 7f8c7cff9640 1 -- 172.21.15.88:0/1076026135 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c700072f0 con 0x7f8c800bf2d0 2023-12-08T08:21:16.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.824+0000 7f8c8659d640 1 -- 172.21.15.88:0/1076026135 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c80152990 con 0x7f8c800bf2d0 2023-12-08T08:21:16.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.824+0000 7f8c8659d640 1 -- 172.21.15.88:0/1076026135 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c80067630 con 0x7f8c800bf2d0 2023-12-08T08:21:16.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.828+0000 7f8c7cff9640 1 -- 172.21.15.88:0/1076026135 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8c70007450 con 0x7f8c800bf2d0 2023-12-08T08:21:16.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.828+0000 7f8c7cff9640 1 --2- 172.21.15.88:0/1076026135 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8c6c066470 0x7f8c6c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:16.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.828+0000 7f8c7cff9640 1 -- 172.21.15.88:0/1076026135 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6080+0+0 (secure 0 0 0) 0x7f8c700834b0 con 0x7f8c800bf2d0 2023-12-08T08:21:16.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.828+0000 7f8c7f7fe640 1 --2- 172.21.15.88:0/1076026135 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8c6c066470 0x7f8c6c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:16.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.828+0000 7f8c7f7fe640 1 --2- 172.21.15.88:0/1076026135 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8c6c066470 0x7f8c6c068930 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8c80148d40 tx=0x7f8c74009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:16.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.832+0000 7f8c7cff9640 1 -- 172.21.15.88:0/1076026135 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8c70050900 con 0x7f8c800bf2d0 2023-12-08T08:21:16.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:16.984+0000 7f8c8659d640 1 -- 172.21.15.88:0/1076026135 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8c80073f70 con 0x7f8c800bf2d0 2023-12-08T08:21:17.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.648+0000 7f8c7cff9640 1 -- 172.21.15.88:0/1076026135 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v33) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8c70053f20 con 0x7f8c800bf2d0 2023-12-08T08:21:17.650 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs2_data' created 2023-12-08T08:21:17.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.648+0000 7f8c8659d640 1 -- 172.21.15.88:0/1076026135 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8c6c066470 msgr2=0x7f8c6c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:17.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.648+0000 7f8c8659d640 1 --2- 172.21.15.88:0/1076026135 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8c6c066470 0x7f8c6c068930 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8c80148d40 tx=0x7f8c74009190 comp rx=0 tx=0).stop 2023-12-08T08:21:17.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.648+0000 7f8c8659d640 1 -- 172.21.15.88:0/1076026135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c800bf2d0 msgr2=0x7f8c80153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:17.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.648+0000 7f8c8659d640 1 --2- 172.21.15.88:0/1076026135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c800bf2d0 0x7f8c80153be0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8c7000c500 tx=0x7f8c7000c9c0 comp rx=0 tx=0).stop 2023-12-08T08:21:17.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.648+0000 7f8c8659d640 1 -- 172.21.15.88:0/1076026135 shutdown_connections 2023-12-08T08:21:17.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.648+0000 7f8c8659d640 1 --2- 172.21.15.88:0/1076026135 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8c6c066470 0x7f8c6c068930 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:17.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.648+0000 7f8c8659d640 1 --2- 172.21.15.88:0/1076026135 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8c800c98f0 0x7f8c801ef8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:17.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.648+0000 7f8c8659d640 1 --2- 172.21.15.88:0/1076026135 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c800c6030 0x7f8c80152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:17.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.648+0000 7f8c8659d640 1 --2- 172.21.15.88:0/1076026135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c800bf2d0 0x7f8c80153be0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:17.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.648+0000 7f8c8659d640 1 -- 172.21.15.88:0/1076026135 >> 172.21.15.88:0/1076026135 conn(0x7f8c800c9dc0 msgr2=0x7f8c80150ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:17.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.648+0000 7f8c8659d640 1 -- 172.21.15.88:0/1076026135 shutdown_connections 2023-12-08T08:21:17.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.648+0000 7f8c8659d640 1 -- 172.21.15.88:0/1076026135 wait complete. 2023-12-08T08:21:17.688 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-12-08T08:21:17.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.828+0000 7f9e7226b640 1 Processor -- start 2023-12-08T08:21:17.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.828+0000 7f9e7226b640 1 -- start start 2023-12-08T08:21:17.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.828+0000 7f9e7226b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9e6c1516a0 0x7f9e6c0c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:17.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.828+0000 7f9e7226b640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e6c0c46c0 0x7f9e6c06bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:17.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.828+0000 7f9e7226b640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e6c151210 con 0x7f9e6c14e2a0 2023-12-08T08:21:17.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.828+0000 7f9e7226b640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6c151b50 con 0x7f9e6c1516a0 2023-12-08T08:21:17.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.828+0000 7f9e7226b640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c14e680 con 0x7f9e6c0c46c0 2023-12-08T08:21:17.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.828+0000 7f9e6b7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9e6c1516a0 0x7f9e6c0c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:17.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.828+0000 7f9e6b7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9e6c1516a0 0x7f9e6c0c4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47588/0 (socket says 172.21.15.88:47588) 2023-12-08T08:21:17.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.828+0000 7f9e6b7fe640 1 -- 172.21.15.88:0/1602341643 learned_addr learned my addr 172.21.15.88:0/1602341643 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:17.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.832+0000 7f9e6b7fe640 1 -- 172.21.15.88:0/1602341643 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e6c0c46c0 msgr2=0x7f9e6c06bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:17.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.832+0000 7f9e6b7fe640 1 --2- 172.21.15.88:0/1602341643 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e6c0c46c0 0x7f9e6c06bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:17.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.832+0000 7f9e6b7fe640 1 -- 172.21.15.88:0/1602341643 >> v1:172.21.15.148:6789/0 conn(0x7f9e6c14e2a0 legacy=0x7f9e6c0a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:17.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.832+0000 7f9e6b7fe640 1 -- 172.21.15.88:0/1602341643 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6c0a9b70 con 0x7f9e6c1516a0 2023-12-08T08:21:17.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.832+0000 7f9e6b7fe640 1 --2- 172.21.15.88:0/1602341643 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e6c1516a0 0x7f9e6c0c4180 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9e60009870 tx=0x7f9e6001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d83b9ba30285ed server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:17.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.832+0000 7f9e6affd640 1 -- 172.21.15.88:0/1602341643 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e600ab600 con 0x7f9e6c1516a0 2023-12-08T08:21:17.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.832+0000 7f9e6affd640 1 -- 172.21.15.88:0/1602341643 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e600a7050 con 0x7f9e6c1516a0 2023-12-08T08:21:17.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.832+0000 7f9e6affd640 1 -- 172.21.15.88:0/1602341643 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e600ab980 con 0x7f9e6c1516a0 2023-12-08T08:21:17.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.832+0000 7f9e7226b640 1 -- 172.21.15.88:0/1602341643 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e6c1516a0 msgr2=0x7f9e6c0c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:17.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.832+0000 7f9e7226b640 1 --2- 172.21.15.88:0/1602341643 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e6c1516a0 0x7f9e6c0c4180 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9e60009870 tx=0x7f9e6001c500 comp rx=0 tx=0).stop 2023-12-08T08:21:17.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.832+0000 7f9e7226b640 1 -- 172.21.15.88:0/1602341643 shutdown_connections 2023-12-08T08:21:17.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.832+0000 7f9e7226b640 1 --2- 172.21.15.88:0/1602341643 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e6c0c46c0 0x7f9e6c06bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:17.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.832+0000 7f9e7226b640 1 --2- 172.21.15.88:0/1602341643 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e6c1516a0 0x7f9e6c0c4180 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:17.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.832+0000 7f9e7226b640 1 -- 172.21.15.88:0/1602341643 >> 172.21.15.88:0/1602341643 conn(0x7f9e6c0c59f0 msgr2=0x7f9e6c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:17.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.832+0000 7f9e7226b640 1 -- 172.21.15.88:0/1602341643 shutdown_connections 2023-12-08T08:21:17.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.832+0000 7f9e7226b640 1 -- 172.21.15.88:0/1602341643 wait complete. 2023-12-08T08:21:17.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.836+0000 7f9e7226b640 1 Processor -- start 2023-12-08T08:21:17.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.836+0000 7f9e7226b640 1 -- start start 2023-12-08T08:21:17.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.836+0000 7f9e7226b640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e6c0c46c0 0x7f9e6c146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:17.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.836+0000 7f9e7226b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e6c14e2a0 0x7f9e6c071360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:17.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.836+0000 7f9e7226b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e6c1516a0 0x7f9e6c0718a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:17.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.836+0000 7f9e7226b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c143300 con 0x7f9e6c14e2a0 2023-12-08T08:21:17.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.836+0000 7f9e7226b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c070f80 con 0x7f9e6c1516a0 2023-12-08T08:21:17.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.836+0000 7f9e7226b640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c1eee60 con 0x7f9e6c0c46c0 2023-12-08T08:21:17.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.836+0000 7f9e6b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e6c14e2a0 0x7f9e6c071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:17.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.836+0000 7f9e6b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e6c14e2a0 0x7f9e6c071360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47598/0 (socket says 172.21.15.88:47598) 2023-12-08T08:21:17.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.836+0000 7f9e6b7fe640 1 -- 172.21.15.88:0/4110977914 learned_addr learned my addr 172.21.15.88:0/4110977914 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:17.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.836+0000 7f9e70808640 1 --2- 172.21.15.88:0/4110977914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e6c1516a0 0x7f9e6c0718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:17.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.836+0000 7f9e6bfff640 1 --2- 172.21.15.88:0/4110977914 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e6c0c46c0 0x7f9e6c146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:17.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.836+0000 7f9e6b7fe640 1 -- 172.21.15.88:0/4110977914 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e6c0c46c0 msgr2=0x7f9e6c146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:17.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.836+0000 7f9e6b7fe640 1 --2- 172.21.15.88:0/4110977914 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e6c0c46c0 0x7f9e6c146700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:17.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.836+0000 7f9e6b7fe640 1 -- 172.21.15.88:0/4110977914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e6c1516a0 msgr2=0x7f9e6c0718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:17.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.836+0000 7f9e6b7fe640 1 --2- 172.21.15.88:0/4110977914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e6c1516a0 0x7f9e6c0718a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:17.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.836+0000 7f9e6b7fe640 1 -- 172.21.15.88:0/4110977914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e600094d0 con 0x7f9e6c14e2a0 2023-12-08T08:21:17.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.836+0000 7f9e70808640 1 --2- 172.21.15.88:0/4110977914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e6c1516a0 0x7f9e6c0718a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:17.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.836+0000 7f9e6bfff640 1 --2- 172.21.15.88:0/4110977914 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e6c0c46c0 0x7f9e6c146700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:17.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.836+0000 7f9e6b7fe640 1 --2- 172.21.15.88:0/4110977914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e6c14e2a0 0x7f9e6c071360 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9e600ae040 tx=0x7f9e600192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:17.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.836+0000 7f9e68ff9640 1 -- 172.21.15.88:0/4110977914 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e600b7860 con 0x7f9e6c14e2a0 2023-12-08T08:21:17.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.836+0000 7f9e68ff9640 1 -- 172.21.15.88:0/4110977914 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e600b79e0 con 0x7f9e6c14e2a0 2023-12-08T08:21:17.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.836+0000 7f9e7226b640 1 -- 172.21.15.88:0/4110977914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e6c143020 con 0x7f9e6c14e2a0 2023-12-08T08:21:17.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.836+0000 7f9e68ff9640 1 -- 172.21.15.88:0/4110977914 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e600b7d90 con 0x7f9e6c14e2a0 2023-12-08T08:21:17.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.840+0000 7f9e7226b640 1 -- 172.21.15.88:0/4110977914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e6c1eeaf0 con 0x7f9e6c14e2a0 2023-12-08T08:21:17.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.840+0000 7f9e7226b640 1 -- 172.21.15.88:0/4110977914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e6c1eefd0 con 0x7f9e6c14e2a0 2023-12-08T08:21:17.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.840+0000 7f9e68ff9640 1 -- 172.21.15.88:0/4110977914 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9e600c9430 con 0x7f9e6c14e2a0 2023-12-08T08:21:17.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.844+0000 7f9e68ff9640 1 --2- 172.21.15.88:0/4110977914 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9e58066470 0x7f9e58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:17.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.844+0000 7f9e68ff9640 1 -- 172.21.15.88:0/4110977914 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f9e6011efe0 con 0x7f9e6c14e2a0 2023-12-08T08:21:17.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.844+0000 7f9e6bfff640 1 --2- 172.21.15.88:0/4110977914 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9e58066470 0x7f9e58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:17.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.844+0000 7f9e6bfff640 1 --2- 172.21.15.88:0/4110977914 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9e58066470 0x7f9e58068930 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c0016e0 tx=0x7f9e5c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:17.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:17.844+0000 7f9e68ff9640 1 -- 172.21.15.88:0/4110977914 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9e600ec240 con 0x7f9e6c14e2a0 2023-12-08T08:21:18.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.028+0000 7f9e7226b640 1 -- 172.21.15.88:0/4110977914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f9e6c15b450 con 0x7f9e6c14e2a0 2023-12-08T08:21:18.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.648+0000 7f9e68ff9640 1 -- 172.21.15.88:0/4110977914 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 6 and data pool 7 v18) v1 ==== 175+0+0 (secure 0 0 0) 0x7f9e600ef860 con 0x7f9e6c14e2a0 2023-12-08T08:21:18.652 INFO:teuthology.orchestra.run.smithi088.stderr:new fs with metadata pool 6 and data pool 7 2023-12-08T08:21:18.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.652+0000 7f9e7226b640 1 -- 172.21.15.88:0/4110977914 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9e58066470 msgr2=0x7f9e58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:18.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.652+0000 7f9e7226b640 1 --2- 172.21.15.88:0/4110977914 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9e58066470 0x7f9e58068930 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c0016e0 tx=0x7f9e5c009040 comp rx=0 tx=0).stop 2023-12-08T08:21:18.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.652+0000 7f9e7226b640 1 -- 172.21.15.88:0/4110977914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e6c14e2a0 msgr2=0x7f9e6c071360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:18.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.652+0000 7f9e7226b640 1 --2- 172.21.15.88:0/4110977914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e6c14e2a0 0x7f9e6c071360 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9e600ae040 tx=0x7f9e600192a0 comp rx=0 tx=0).stop 2023-12-08T08:21:18.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.652+0000 7f9e7226b640 1 -- 172.21.15.88:0/4110977914 shutdown_connections 2023-12-08T08:21:18.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.652+0000 7f9e7226b640 1 --2- 172.21.15.88:0/4110977914 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9e58066470 0x7f9e58068930 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:18.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.652+0000 7f9e7226b640 1 --2- 172.21.15.88:0/4110977914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e6c1516a0 0x7f9e6c0718a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:18.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.652+0000 7f9e7226b640 1 --2- 172.21.15.88:0/4110977914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e6c14e2a0 0x7f9e6c071360 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:18.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.652+0000 7f9e7226b640 1 --2- 172.21.15.88:0/4110977914 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e6c0c46c0 0x7f9e6c146700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:18.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.652+0000 7f9e7226b640 1 -- 172.21.15.88:0/4110977914 >> 172.21.15.88:0/4110977914 conn(0x7f9e6c0c59f0 msgr2=0x7f9e6c15b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:18.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.656+0000 7f9e7226b640 1 -- 172.21.15.88:0/4110977914 shutdown_connections 2023-12-08T08:21:18.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.656+0000 7f9e7226b640 1 -- 172.21.15.88:0/4110977914 wait complete. 2023-12-08T08:21:18.719 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:21:18.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.852+0000 7fb9e6dc1640 1 Processor -- start 2023-12-08T08:21:18.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.852+0000 7fb9e6dc1640 1 -- start start 2023-12-08T08:21:18.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.856+0000 7fb9e6dc1640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb9e006d2b0 0x7fb9e006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:18.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.856+0000 7fb9e6dc1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb9e00c5300 0x7fb9e006c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:18.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.856+0000 7fb9e6dc1640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e006bb80 con 0x7fb9e00c3b80 2023-12-08T08:21:18.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.856+0000 7fb9e6dc1640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e006cc70 con 0x7fb9e006d2b0 2023-12-08T08:21:18.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.856+0000 7fb9e6dc1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e00c5790 con 0x7fb9e00c5300 2023-12-08T08:21:18.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.856+0000 7fb9dffff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb9e00c3b80 0x7fb9e006c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58062/0 (socket says 172.21.15.88:58062) 2023-12-08T08:21:18.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.856+0000 7fb9dffff640 1 -- 172.21.15.88:0/4267835160 learned_addr learned my addr 172.21.15.88:0/4267835160 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:18.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.856+0000 7fb9e535e640 1 --2- 172.21.15.88:0/4267835160 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb9e00c5300 0x7fb9e006c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:18.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.856+0000 7fb9e4b5d640 1 --2- 172.21.15.88:0/4267835160 >> v2:172.21.15.148:3300/0 conn(0x7fb9e006d2b0 0x7fb9e006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:18.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.856+0000 7fb9df7fe640 1 -- 172.21.15.88:0/4267835160 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696587789 0 0) 0x7fb9e006bb80 con 0x7fb9e00c3b80 2023-12-08T08:21:18.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.856+0000 7fb9df7fe640 1 -- 172.21.15.88:0/4267835160 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9d0003530 con 0x7fb9e00c3b80 2023-12-08T08:21:18.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.856+0000 7fb9e4b5d640 1 -- 172.21.15.88:0/4267835160 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb9e00c5300 msgr2=0x7fb9e006c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:18.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.856+0000 7fb9e4b5d640 1 --2- 172.21.15.88:0/4267835160 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb9e00c5300 0x7fb9e006c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:18.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.856+0000 7fb9e4b5d640 1 -- 172.21.15.88:0/4267835160 >> v1:172.21.15.88:6789/0 conn(0x7fb9e00c3b80 legacy=0x7fb9e006c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:18.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.856+0000 7fb9df7fe640 1 -- 172.21.15.88:0/4267835160 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4001229293 0 0) 0x7fb9d0003530 con 0x7fb9e00c3b80 2023-12-08T08:21:18.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.856+0000 7fb9e4b5d640 1 -- 172.21.15.88:0/4267835160 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e01515c0 con 0x7fb9e006d2b0 2023-12-08T08:21:18.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.860+0000 7fb9e4b5d640 1 --2- 172.21.15.88:0/4267835160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9e006d2b0 0x7fb9e006d690 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40097c0 tx=0x7fb9d401c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d61bfa24351a682a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:18.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.860+0000 7fb9df7fe640 1 -- 172.21.15.88:0/4267835160 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc001680 con 0x7fb9e006d2b0 2023-12-08T08:21:18.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.860+0000 7fb9df7fe640 1 -- 172.21.15.88:0/4267835160 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d40a7050 con 0x7fb9e006d2b0 2023-12-08T08:21:18.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.860+0000 7fb9df7fe640 1 -- 172.21.15.88:0/4267835160 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d40ab620 con 0x7fb9e006d2b0 2023-12-08T08:21:18.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.860+0000 7fb9e6dc1640 1 -- 172.21.15.88:0/4267835160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9e006d2b0 msgr2=0x7fb9e006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:18.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.860+0000 7fb9e6dc1640 1 --2- 172.21.15.88:0/4267835160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9e006d2b0 0x7fb9e006d690 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40097c0 tx=0x7fb9d401c370 comp rx=0 tx=0).stop 2023-12-08T08:21:18.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.860+0000 7fb9e6dc1640 1 -- 172.21.15.88:0/4267835160 shutdown_connections 2023-12-08T08:21:18.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.860+0000 7fb9e6dc1640 1 --2- 172.21.15.88:0/4267835160 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb9e00c5300 0x7fb9e006c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:18.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.860+0000 7fb9e6dc1640 1 --2- 172.21.15.88:0/4267835160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9e006d2b0 0x7fb9e006d690 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:18.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.860+0000 7fb9e6dc1640 1 -- 172.21.15.88:0/4267835160 >> 172.21.15.88:0/4267835160 conn(0x7fb9e00a7810 msgr2=0x7fb9e00a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:18.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.860+0000 7fb9e6dc1640 1 -- 172.21.15.88:0/4267835160 shutdown_connections 2023-12-08T08:21:18.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.860+0000 7fb9e6dc1640 1 -- 172.21.15.88:0/4267835160 wait complete. 2023-12-08T08:21:18.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.860+0000 7fb9e6dc1640 1 Processor -- start 2023-12-08T08:21:18.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.860+0000 7fb9e6dc1640 1 -- start start 2023-12-08T08:21:18.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.864+0000 7fb9e6dc1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9e006d2b0 0x7fb9e01f0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:18.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.864+0000 7fb9e6dc1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb9e00c3b80 0x7fb9e014bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:18.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.864+0000 7fb9e6dc1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9e00c5300 0x7fb9e014c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:18.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.864+0000 7fb9e6dc1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e01f0e30 con 0x7fb9e00c5300 2023-12-08T08:21:18.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.864+0000 7fb9e6dc1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e014c6f0 con 0x7fb9e006d2b0 2023-12-08T08:21:18.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.864+0000 7fb9e6dc1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e014de00 con 0x7fb9e00c3b80 2023-12-08T08:21:18.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.864+0000 7fb9e535e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9e00c5300 0x7fb9e014c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:18.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.864+0000 7fb9dffff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb9e00c3b80 0x7fb9e014bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:18.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.864+0000 7fb9e535e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9e00c5300 0x7fb9e014c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47608/0 (socket says 172.21.15.88:47608) 2023-12-08T08:21:18.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.864+0000 7fb9e535e640 1 -- 172.21.15.88:0/1269244372 learned_addr learned my addr 172.21.15.88:0/1269244372 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:18.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.864+0000 7fb9e4b5d640 1 --2- 172.21.15.88:0/1269244372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9e006d2b0 0x7fb9e01f0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:18.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.864+0000 7fb9e535e640 1 -- 172.21.15.88:0/1269244372 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb9e00c3b80 msgr2=0x7fb9e014bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:18.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.864+0000 7fb9e535e640 1 --2- 172.21.15.88:0/1269244372 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb9e00c3b80 0x7fb9e014bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:18.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.864+0000 7fb9e535e640 1 -- 172.21.15.88:0/1269244372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9e006d2b0 msgr2=0x7fb9e01f0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:18.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.864+0000 7fb9e535e640 1 --2- 172.21.15.88:0/1269244372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9e006d2b0 0x7fb9e01f0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:18.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.864+0000 7fb9e535e640 1 -- 172.21.15.88:0/1269244372 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d4009420 con 0x7fb9e00c5300 2023-12-08T08:21:18.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.864+0000 7fb9e535e640 1 --2- 172.21.15.88:0/1269244372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9e00c5300 0x7fb9e014c1b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800ec10 tx=0x7fb9d800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:18.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.864+0000 7fb9dd7fa640 1 -- 172.21.15.88:0/1269244372 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d800cd20 con 0x7fb9e00c5300 2023-12-08T08:21:18.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.864+0000 7fb9dd7fa640 1 -- 172.21.15.88:0/1269244372 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d800f040 con 0x7fb9e00c5300 2023-12-08T08:21:18.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.864+0000 7fb9dd7fa640 1 -- 172.21.15.88:0/1269244372 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d80146c0 con 0x7fb9e00c5300 2023-12-08T08:21:18.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.864+0000 7fb9e6dc1640 1 -- 172.21.15.88:0/1269244372 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e014ef80 con 0x7fb9e00c5300 2023-12-08T08:21:18.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.864+0000 7fb9e6dc1640 1 -- 172.21.15.88:0/1269244372 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e014e070 con 0x7fb9e00c5300 2023-12-08T08:21:18.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.864+0000 7fb9e6dc1640 1 -- 172.21.15.88:0/1269244372 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e01f0fa0 con 0x7fb9e00c5300 2023-12-08T08:21:18.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.868+0000 7fb9dd7fa640 1 -- 172.21.15.88:0/1269244372 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb9d8014a30 con 0x7fb9e00c5300 2023-12-08T08:21:18.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.868+0000 7fb9dd7fa640 1 --2- 172.21.15.88:0/1269244372 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb9c4066470 0x7fb9c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:18.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.868+0000 7fb9dd7fa640 1 -- 172.21.15.88:0/1269244372 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb9d8085440 con 0x7fb9e00c5300 2023-12-08T08:21:18.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.868+0000 7fb9e4b5d640 1 --2- 172.21.15.88:0/1269244372 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb9c4066470 0x7fb9c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:18.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.868+0000 7fb9e4b5d640 1 --2- 172.21.15.88:0/1269244372 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb9c4066470 0x7fb9c4068930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40ad000 tx=0x7fb9d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:18.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:18.868+0000 7fb9dd7fa640 1 -- 172.21.15.88:0/1269244372 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb9d8052700 con 0x7fb9e00c5300 2023-12-08T08:21:19.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.020+0000 7fb9e6dc1640 1 -- 172.21.15.88:0/1269244372 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9e0067630 con 0x7fb9e00c5300 2023-12-08T08:21:19.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.020+0000 7fb9dd7fa640 1 -- 172.21.15.88:0/1269244372 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+20218 (secure 0 0 0) 0x7fb9d8018090 con 0x7fb9e00c5300 2023-12-08T08:21:19.025 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:19.025 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":34,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:21:18.028886+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:21:03.690721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-08T08:21:04.127786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:21:16.039054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:21:17.029894+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:21:19.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.024+0000 7fb9e6dc1640 1 -- 172.21.15.88:0/1269244372 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb9c4066470 msgr2=0x7fb9c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:19.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.024+0000 7fb9e6dc1640 1 --2- 172.21.15.88:0/1269244372 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb9c4066470 0x7fb9c4068930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40ad000 tx=0x7fb9d4008040 comp rx=0 tx=0).stop 2023-12-08T08:21:19.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.024+0000 7fb9e6dc1640 1 -- 172.21.15.88:0/1269244372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9e00c5300 msgr2=0x7fb9e014c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:19.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.024+0000 7fb9e6dc1640 1 --2- 172.21.15.88:0/1269244372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9e00c5300 0x7fb9e014c1b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800ec10 tx=0x7fb9d800c490 comp rx=0 tx=0).stop 2023-12-08T08:21:19.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.024+0000 7fb9e6dc1640 1 -- 172.21.15.88:0/1269244372 shutdown_connections 2023-12-08T08:21:19.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.024+0000 7fb9e6dc1640 1 --2- 172.21.15.88:0/1269244372 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb9c4066470 0x7fb9c4068930 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:19.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.024+0000 7fb9e6dc1640 1 --2- 172.21.15.88:0/1269244372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9e00c5300 0x7fb9e014c1b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:19.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.024+0000 7fb9e6dc1640 1 --2- 172.21.15.88:0/1269244372 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb9e00c3b80 0x7fb9e014bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:19.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.024+0000 7fb9e6dc1640 1 --2- 172.21.15.88:0/1269244372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9e006d2b0 0x7fb9e01f0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:19.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.024+0000 7fb9e6dc1640 1 -- 172.21.15.88:0/1269244372 >> 172.21.15.88:0/1269244372 conn(0x7fb9e00a7810 msgr2=0x7fb9e00c0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:19.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.024+0000 7fb9e6dc1640 1 -- 172.21.15.88:0/1269244372 shutdown_connections 2023-12-08T08:21:19.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.024+0000 7fb9e6dc1640 1 -- 172.21.15.88:0/1269244372 wait complete. 2023-12-08T08:21:19.046 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:21:19.127 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:21:19.132 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:21:19.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.180+0000 7fc31c89c640 1 Processor -- start 2023-12-08T08:21:19.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.180+0000 7fc31c89c640 1 -- start start 2023-12-08T08:21:19.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.184+0000 7fc31c89c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc31806d690 0x7fc3180c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:19.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.184+0000 7fc31c89c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31806db20 con 0x7fc31806d2b0 2023-12-08T08:21:19.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.184+0000 7fc31c89c640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31806bb80 con 0x7fc3180c3b80 2023-12-08T08:21:19.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.184+0000 7fc31c89c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3180c5840 con 0x7fc31806d690 2023-12-08T08:21:19.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.184+0000 7fc31659c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc31806d2b0 0x7fc31806c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58064/0 (socket says 172.21.15.88:58064) 2023-12-08T08:21:19.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.184+0000 7fc31659c640 1 -- 172.21.15.88:0/2508729335 learned_addr learned my addr 172.21.15.88:0/2508729335 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:19.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.184+0000 7fc316d9d640 1 --2- 172.21.15.88:0/2508729335 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc31806d690 0x7fc3180c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:19.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.184+0000 7fc315d9b640 1 -- 172.21.15.88:0/2508729335 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3517768910 0 0) 0x7fc308001120 con 0x7fc31806d2b0 2023-12-08T08:21:19.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.184+0000 7fc315d9b640 1 -- 172.21.15.88:0/2508729335 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc304003530 con 0x7fc31806d2b0 2023-12-08T08:21:19.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.184+0000 7fc315d9b640 1 -- 172.21.15.88:0/2508729335 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2613809031 0 0) 0x7fc31806bb80 con 0x7fc3180c3b80 2023-12-08T08:21:19.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.184+0000 7fc315d9b640 1 -- 172.21.15.88:0/2508729335 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc308001120 con 0x7fc3180c3b80 2023-12-08T08:21:19.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.184+0000 7fc316d9d640 1 -- 172.21.15.88:0/2508729335 >> v1:172.21.15.148:6789/0 conn(0x7fc3180c3b80 legacy=0x7fc31806c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:19.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.184+0000 7fc316d9d640 1 -- 172.21.15.88:0/2508729335 >> v1:172.21.15.88:6789/0 conn(0x7fc31806d2b0 legacy=0x7fc31806c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:19.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.184+0000 7fc315d9b640 1 -- 172.21.15.88:0/2508729335 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3702878539 0 0) 0x7fc304003530 con 0x7fc31806d2b0 2023-12-08T08:21:19.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.184+0000 7fc316d9d640 1 -- 172.21.15.88:0/2508729335 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3181515c0 con 0x7fc31806d690 2023-12-08T08:21:19.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.188+0000 7fc316d9d640 1 --2- 172.21.15.88:0/2508729335 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc31806d690 0x7fc3180c5300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc310009dc0 tx=0x7fc31001c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67db42dc38999a5e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:19.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.188+0000 7fc315d9b640 1 -- 172.21.15.88:0/2508729335 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3100a5910 con 0x7fc31806d690 2023-12-08T08:21:19.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.188+0000 7fc315d9b640 1 -- 172.21.15.88:0/2508729335 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3100a5a70 con 0x7fc31806d690 2023-12-08T08:21:19.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.188+0000 7fc315d9b640 1 -- 172.21.15.88:0/2508729335 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3100a5e00 con 0x7fc31806d690 2023-12-08T08:21:19.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.188+0000 7fc31c89c640 1 -- 172.21.15.88:0/2508729335 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc31806d690 msgr2=0x7fc3180c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:19.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.188+0000 7fc31c89c640 1 --2- 172.21.15.88:0/2508729335 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc31806d690 0x7fc3180c5300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc310009dc0 tx=0x7fc31001c940 comp rx=0 tx=0).stop 2023-12-08T08:21:19.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.188+0000 7fc31c89c640 1 -- 172.21.15.88:0/2508729335 shutdown_connections 2023-12-08T08:21:19.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.188+0000 7fc31c89c640 1 --2- 172.21.15.88:0/2508729335 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc31806d690 0x7fc3180c5300 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:19.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.188+0000 7fc31c89c640 1 -- 172.21.15.88:0/2508729335 >> 172.21.15.88:0/2508729335 conn(0x7fc3180a7810 msgr2=0x7fc3180a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:19.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.188+0000 7fc31c89c640 1 -- 172.21.15.88:0/2508729335 shutdown_connections 2023-12-08T08:21:19.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.188+0000 7fc31c89c640 1 -- 172.21.15.88:0/2508729335 wait complete. 2023-12-08T08:21:19.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.188+0000 7fc31c89c640 1 Processor -- start 2023-12-08T08:21:19.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.188+0000 7fc31c89c640 1 -- start start 2023-12-08T08:21:19.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.192+0000 7fc31c89c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc31806d2b0 0x7fc3181eb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:19.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.192+0000 7fc31c89c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc31806d690 0x7fc31815c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:19.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.192+0000 7fc31c89c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3180c3b80 0x7fc3180a96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:19.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.192+0000 7fc31c89c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3180c2c00 con 0x7fc3180c3b80 2023-12-08T08:21:19.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.192+0000 7fc31c89c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3181eb8f0 con 0x7fc31806d690 2023-12-08T08:21:19.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.192+0000 7fc31c89c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3180a8d40 con 0x7fc31806d2b0 2023-12-08T08:21:19.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.192+0000 7fc31659c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc31806d2b0 0x7fc3181eb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:19.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.192+0000 7fc316d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3180c3b80 0x7fc3180a96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:19.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.192+0000 7fc31659c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc31806d2b0 0x7fc3181eb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:41882/0 (socket says 172.21.15.88:41882) 2023-12-08T08:21:19.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.192+0000 7fc31659c640 1 -- 172.21.15.88:0/56296262 learned_addr learned my addr 172.21.15.88:0/56296262 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:19.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.192+0000 7fc30ffff640 1 --2- 172.21.15.88:0/56296262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc31806d690 0x7fc31815c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:19.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.192+0000 7fc31659c640 1 -- 172.21.15.88:0/56296262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc31806d690 msgr2=0x7fc31815c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:19.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.192+0000 7fc31659c640 1 --2- 172.21.15.88:0/56296262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc31806d690 0x7fc31815c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:19.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.192+0000 7fc31659c640 1 -- 172.21.15.88:0/56296262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3180c3b80 msgr2=0x7fc3180a96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:19.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.192+0000 7fc31659c640 1 --2- 172.21.15.88:0/56296262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3180c3b80 0x7fc3180a96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:19.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.192+0000 7fc31659c640 1 -- 172.21.15.88:0/56296262 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc310009a70 con 0x7fc31806d2b0 2023-12-08T08:21:19.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.192+0000 7fc316d9d640 1 --2- 172.21.15.88:0/56296262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3180c3b80 0x7fc3180a96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:21:19.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.192+0000 7fc31659c640 1 --2- 172.21.15.88:0/56296262 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc31806d2b0 0x7fc3181eb3b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc30800c7b0 tx=0x7fc30800cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:19.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.192+0000 7fc30effd640 1 -- 172.21.15.88:0/56296262 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc308005cf0 con 0x7fc31806d2b0 2023-12-08T08:21:19.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.192+0000 7fc30effd640 1 -- 172.21.15.88:0/56296262 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc308005e70 con 0x7fc31806d2b0 2023-12-08T08:21:19.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.192+0000 7fc31c89c640 1 -- 172.21.15.88:0/56296262 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31814ef80 con 0x7fc31806d2b0 2023-12-08T08:21:19.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.192+0000 7fc30effd640 1 -- 172.21.15.88:0/56296262 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc308007290 con 0x7fc31806d2b0 2023-12-08T08:21:19.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.192+0000 7fc31c89c640 1 -- 172.21.15.88:0/56296262 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3181ee300 con 0x7fc31806d2b0 2023-12-08T08:21:19.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.192+0000 7fc31c89c640 1 -- 172.21.15.88:0/56296262 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc318067630 con 0x7fc31806d2b0 2023-12-08T08:21:19.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.196+0000 7fc30effd640 1 -- 172.21.15.88:0/56296262 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc3080073f0 con 0x7fc31806d2b0 2023-12-08T08:21:19.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.196+0000 7fc30effd640 1 --2- 172.21.15.88:0/56296262 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc2f8066470 0x7fc2f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:19.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.196+0000 7fc30effd640 1 -- 172.21.15.88:0/56296262 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc308083820 con 0x7fc31806d2b0 2023-12-08T08:21:19.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.196+0000 7fc30ffff640 1 --2- 172.21.15.88:0/56296262 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc2f8066470 0x7fc2f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:19.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.196+0000 7fc30ffff640 1 --2- 172.21.15.88:0/56296262 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc2f8066470 0x7fc2f8068930 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc31815cb10 tx=0x7fc300009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:19.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.200+0000 7fc30effd640 1 -- 172.21.15.88:0/56296262 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc308050a60 con 0x7fc31806d2b0 2023-12-08T08:21:19.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.348+0000 7fc31c89c640 1 -- 172.21.15.88:0/56296262 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc31806db20 con 0x7fc31806d2b0 2023-12-08T08:21:19.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.352+0000 7fc30effd640 1 -- 172.21.15.88:0/56296262 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+20218 (secure 0 0 0) 0x7fc31806db20 con 0x7fc31806d2b0 2023-12-08T08:21:19.354 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:19.354 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":34,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:21:18.028886+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:21:03.690721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-08T08:21:04.127786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:21:16.039054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:21:17.029894+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:21:19.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.352+0000 7fc31c89c640 1 -- 172.21.15.88:0/56296262 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc2f8066470 msgr2=0x7fc2f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:19.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.352+0000 7fc31c89c640 1 --2- 172.21.15.88:0/56296262 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc2f8066470 0x7fc2f8068930 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc31815cb10 tx=0x7fc300009040 comp rx=0 tx=0).stop 2023-12-08T08:21:19.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.352+0000 7fc31c89c640 1 -- 172.21.15.88:0/56296262 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc31806d2b0 msgr2=0x7fc3181eb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:19.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.352+0000 7fc31c89c640 1 --2- 172.21.15.88:0/56296262 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc31806d2b0 0x7fc3181eb3b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc30800c7b0 tx=0x7fc30800cc70 comp rx=0 tx=0).stop 2023-12-08T08:21:19.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.352+0000 7fc31c89c640 1 -- 172.21.15.88:0/56296262 shutdown_connections 2023-12-08T08:21:19.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.352+0000 7fc31c89c640 1 --2- 172.21.15.88:0/56296262 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc2f8066470 0x7fc2f8068930 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:19.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.352+0000 7fc31c89c640 1 --2- 172.21.15.88:0/56296262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3180c3b80 0x7fc3180a96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:19.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.352+0000 7fc31c89c640 1 --2- 172.21.15.88:0/56296262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc31806d690 0x7fc31815c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:19.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.352+0000 7fc31c89c640 1 --2- 172.21.15.88:0/56296262 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc31806d2b0 0x7fc3181eb3b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:19.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.352+0000 7fc31c89c640 1 -- 172.21.15.88:0/56296262 >> 172.21.15.88:0/56296262 conn(0x7fc3180a7810 msgr2=0x7fc3180a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:19.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.352+0000 7fc31c89c640 1 -- 172.21.15.88:0/56296262 shutdown_connections 2023-12-08T08:21:19.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.352+0000 7fc31c89c640 1 -- 172.21.15.88:0/56296262 wait complete. 2023-12-08T08:21:19.375 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-12-08T08:21:19.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.552+0000 7fa70d557640 1 Processor -- start 2023-12-08T08:21:19.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.552+0000 7fa70d557640 1 -- start start 2023-12-08T08:21:19.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.556+0000 7fa70d557640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa708152e50 0x7fa7080a6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:19.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.556+0000 7fa70d557640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa708155790 0x7fa708155c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:19.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.556+0000 7fa70d557640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7080c2f60 con 0x7fa70814f8c0 2023-12-08T08:21:19.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.556+0000 7fa70d557640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7081521a0 con 0x7fa708152e50 2023-12-08T08:21:19.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.556+0000 7fa70d557640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa70814fca0 con 0x7fa708155790 2023-12-08T08:21:19.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.556+0000 7fa6fffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa708152e50 0x7fa7080a6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:19.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.556+0000 7fa6fffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa708152e50 0x7fa7080a6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47634/0 (socket says 172.21.15.88:47634) 2023-12-08T08:21:19.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.556+0000 7fa6fffff640 1 -- 172.21.15.88:0/32013880 learned_addr learned my addr 172.21.15.88:0/32013880 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:19.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.556+0000 7fa7077fe640 1 --2- 172.21.15.88:0/32013880 >> v2:172.21.15.148:3300/0 conn(0x7fa708155790 0x7fa708155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:19.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.556+0000 7fa6fffff640 1 -- 172.21.15.88:0/32013880 >> v2:172.21.15.148:3300/0 conn(0x7fa708155790 msgr2=0x7fa708155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:19.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.556+0000 7fa6fffff640 1 --2- 172.21.15.88:0/32013880 >> v2:172.21.15.148:3300/0 conn(0x7fa708155790 0x7fa708155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:19.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.556+0000 7fa6fffff640 1 -- 172.21.15.88:0/32013880 >> v1:172.21.15.148:6789/0 conn(0x7fa70814f8c0 legacy=0x7fa7080a9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:19.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.556+0000 7fa6fffff640 1 -- 172.21.15.88:0/32013880 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa708152390 con 0x7fa708152e50 2023-12-08T08:21:19.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.560+0000 7fa6fffff640 1 --2- 172.21.15.88:0/32013880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa708152e50 0x7fa7080a6cc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa70806f1e0 tx=0x7fa6f001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d160f85b25eff0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:19.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.560+0000 7fa7067fc640 1 -- 172.21.15.88:0/32013880 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f00ac630 con 0x7fa708152e50 2023-12-08T08:21:19.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.560+0000 7fa7067fc640 1 -- 172.21.15.88:0/32013880 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f00ac790 con 0x7fa708152e50 2023-12-08T08:21:19.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.560+0000 7fa7067fc640 1 -- 172.21.15.88:0/32013880 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f00acb20 con 0x7fa708152e50 2023-12-08T08:21:19.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.560+0000 7fa70d557640 1 -- 172.21.15.88:0/32013880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa708152e50 msgr2=0x7fa7080a6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:19.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.560+0000 7fa70d557640 1 --2- 172.21.15.88:0/32013880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa708152e50 0x7fa7080a6cc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa70806f1e0 tx=0x7fa6f001c4c0 comp rx=0 tx=0).stop 2023-12-08T08:21:19.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.560+0000 7fa70d557640 1 -- 172.21.15.88:0/32013880 shutdown_connections 2023-12-08T08:21:19.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.560+0000 7fa70d557640 1 --2- 172.21.15.88:0/32013880 >> v2:172.21.15.148:3300/0 conn(0x7fa708155790 0x7fa708155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:19.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.560+0000 7fa70d557640 1 --2- 172.21.15.88:0/32013880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa708152e50 0x7fa7080a6cc0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:19.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.560+0000 7fa70d557640 1 -- 172.21.15.88:0/32013880 >> 172.21.15.88:0/32013880 conn(0x7fa708071d80 msgr2=0x7fa708072190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:19.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.560+0000 7fa70d557640 1 -- 172.21.15.88:0/32013880 shutdown_connections 2023-12-08T08:21:19.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.560+0000 7fa70d557640 1 -- 172.21.15.88:0/32013880 wait complete. 2023-12-08T08:21:19.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.560+0000 7fa70d557640 1 Processor -- start 2023-12-08T08:21:19.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.560+0000 7fa70d557640 1 -- start start 2023-12-08T08:21:19.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.560+0000 7fa70d557640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa70814f8c0 0x7fa7081539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:19.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.560+0000 7fa70d557640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa708152e50 0x7fa708148df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:19.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.560+0000 7fa70d557640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa708155790 0x7fa708149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:19.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.560+0000 7fa70d557640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7080a8680 con 0x7fa708152e50 2023-12-08T08:21:19.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.560+0000 7fa70d557640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70806ce70 con 0x7fa708155790 2023-12-08T08:21:19.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.560+0000 7fa70d557640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70806cb90 con 0x7fa70814f8c0 2023-12-08T08:21:19.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.564+0000 7fa6fffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa708152e50 0x7fa708148df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:19.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.564+0000 7fa6fffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa708152e50 0x7fa708148df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47640/0 (socket says 172.21.15.88:47640) 2023-12-08T08:21:19.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.564+0000 7fa6fffff640 1 -- 172.21.15.88:0/3389762573 learned_addr learned my addr 172.21.15.88:0/3389762573 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:19.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.564+0000 7fa706ffd640 1 --2- 172.21.15.88:0/3389762573 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa70814f8c0 0x7fa7081539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:19.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.564+0000 7fa7077fe640 1 --2- 172.21.15.88:0/3389762573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa708155790 0x7fa708149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:19.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.564+0000 7fa6fffff640 1 -- 172.21.15.88:0/3389762573 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa70814f8c0 msgr2=0x7fa7081539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:19.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.564+0000 7fa6fffff640 1 --2- 172.21.15.88:0/3389762573 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa70814f8c0 0x7fa7081539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:19.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.564+0000 7fa6fffff640 1 -- 172.21.15.88:0/3389762573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa708155790 msgr2=0x7fa708149330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:19.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.564+0000 7fa6fffff640 1 --2- 172.21.15.88:0/3389762573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa708155790 0x7fa708149330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:19.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.564+0000 7fa6fffff640 1 -- 172.21.15.88:0/3389762573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f00094d0 con 0x7fa708152e50 2023-12-08T08:21:19.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.564+0000 7fa7077fe640 1 --2- 172.21.15.88:0/3389762573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa708155790 0x7fa708149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:19.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.564+0000 7fa6fffff640 1 --2- 172.21.15.88:0/3389762573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa708152e50 0x7fa708148df0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa6f00af040 tx=0x7fa6f0019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:19.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.564+0000 7fa6ff7fe640 1 -- 172.21.15.88:0/3389762573 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f00b7670 con 0x7fa708152e50 2023-12-08T08:21:19.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.564+0000 7fa6ff7fe640 1 -- 172.21.15.88:0/3389762573 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f00b77f0 con 0x7fa708152e50 2023-12-08T08:21:19.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.564+0000 7fa6ff7fe640 1 -- 172.21.15.88:0/3389762573 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f00b7ba0 con 0x7fa708152e50 2023-12-08T08:21:19.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.564+0000 7fa70d557640 1 -- 172.21.15.88:0/3389762573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa70814abd0 con 0x7fa708152e50 2023-12-08T08:21:19.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.564+0000 7fa70d557640 1 -- 172.21.15.88:0/3389762573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70814b190 con 0x7fa708152e50 2023-12-08T08:21:19.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.564+0000 7fa70d557640 1 -- 172.21.15.88:0/3389762573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7080674b0 con 0x7fa708152e50 2023-12-08T08:21:19.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.564+0000 7fa6ff7fe640 1 -- 172.21.15.88:0/3389762573 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa6f00b3070 con 0x7fa708152e50 2023-12-08T08:21:19.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.568+0000 7fa6ff7fe640 1 --2- 172.21.15.88:0/3389762573 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa6e8066470 0x7fa6e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:19.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.568+0000 7fa6ff7fe640 1 -- 172.21.15.88:0/3389762573 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa6f011e840 con 0x7fa708152e50 2023-12-08T08:21:19.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.568+0000 7fa706ffd640 1 --2- 172.21.15.88:0/3389762573 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa6e8066470 0x7fa6e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:19.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.568+0000 7fa706ffd640 1 --2- 172.21.15.88:0/3389762573 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa6e8066470 0x7fa6e8068930 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80098e0 tx=0x7fa6f8009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:19.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.572+0000 7fa6ff7fe640 1 -- 172.21.15.88:0/3389762573 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa6f00eb9e0 con 0x7fa708152e50 2023-12-08T08:21:19.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:19.756+0000 7fa70d557640 1 -- 172.21.15.88:0/3389762573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa70814b380 con 0x7fa708152e50 2023-12-08T08:21:20.660 INFO:tasks.ceph.mds.c.smithi088.stderr:2023-12-08T08:21:20.656+0000 7f74acf06640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:21:20.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.684+0000 7fa6ff7fe640 1 -- 172.21.15.88:0/3389762573 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v21) v1 ==== 119+0+0 (secure 0 0 0) 0x7fa6f00ef000 con 0x7fa708152e50 2023-12-08T08:21:20.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.688+0000 7fa70d557640 1 -- 172.21.15.88:0/3389762573 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa6e8066470 msgr2=0x7fa6e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:20.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.688+0000 7fa70d557640 1 --2- 172.21.15.88:0/3389762573 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa6e8066470 0x7fa6e8068930 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80098e0 tx=0x7fa6f8009060 comp rx=0 tx=0).stop 2023-12-08T08:21:20.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.688+0000 7fa70d557640 1 -- 172.21.15.88:0/3389762573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa708152e50 msgr2=0x7fa708148df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:20.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.688+0000 7fa70d557640 1 --2- 172.21.15.88:0/3389762573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa708152e50 0x7fa708148df0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa6f00af040 tx=0x7fa6f0019260 comp rx=0 tx=0).stop 2023-12-08T08:21:20.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.688+0000 7fa70d557640 1 -- 172.21.15.88:0/3389762573 shutdown_connections 2023-12-08T08:21:20.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.688+0000 7fa70d557640 1 --2- 172.21.15.88:0/3389762573 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa6e8066470 0x7fa6e8068930 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:20.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.688+0000 7fa70d557640 1 --2- 172.21.15.88:0/3389762573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa708155790 0x7fa708149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:20.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.688+0000 7fa70d557640 1 --2- 172.21.15.88:0/3389762573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa708152e50 0x7fa708148df0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:20.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.688+0000 7fa70d557640 1 --2- 172.21.15.88:0/3389762573 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa70814f8c0 0x7fa7081539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:20.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.688+0000 7fa70d557640 1 -- 172.21.15.88:0/3389762573 >> 172.21.15.88:0/3389762573 conn(0x7fa708071d80 msgr2=0x7fa708150210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:20.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.688+0000 7fa70d557640 1 -- 172.21.15.88:0/3389762573 shutdown_connections 2023-12-08T08:21:20.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.688+0000 7fa70d557640 1 -- 172.21.15.88:0/3389762573 wait complete. 2023-12-08T08:21:20.713 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-08T08:21:20.713 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-12-08T08:21:20.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.856+0000 7f23022bb640 1 Processor -- start 2023-12-08T08:21:20.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.856+0000 7f23022bb640 1 -- start start 2023-12-08T08:21:20.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.860+0000 7f23022bb640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f22fc14e8e0 0x7f22fc154f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:20.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.860+0000 7f23022bb640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22fc0c0250 0x7f22fc06c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:20.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.860+0000 7f23022bb640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22fc0a53c0 con 0x7f22fc06cbb0 2023-12-08T08:21:20.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.860+0000 7f23022bb640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22fc0a9140 con 0x7f22fc14e8e0 2023-12-08T08:21:20.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.860+0000 7f23022bb640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc14ecc0 con 0x7f22fc0c0250 2023-12-08T08:21:20.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.860+0000 7f2300ab8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22fc0c0250 0x7f22fc06c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:20.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.860+0000 7f23012b9640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f22fc14e8e0 0x7f22fc154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:20.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.860+0000 7f2301aba640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f22fc06cbb0 0x7f22fc06d140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:47518/0 (socket says 172.21.15.88:47518) 2023-12-08T08:21:20.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.860+0000 7f2301aba640 1 -- 172.21.15.88:0/3632113782 learned_addr learned my addr 172.21.15.88:0/3632113782 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:20.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.860+0000 7f22f3fff640 1 -- 172.21.15.88:0/3632113782 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984862588 0 0) 0x7f22fc0a53c0 con 0x7f22fc06cbb0 2023-12-08T08:21:20.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.860+0000 7f22f3fff640 1 -- 172.21.15.88:0/3632113782 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22e8003530 con 0x7f22fc06cbb0 2023-12-08T08:21:20.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.860+0000 7f23012b9640 1 -- 172.21.15.88:0/3632113782 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22fc0c0250 msgr2=0x7f22fc06c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:20.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.860+0000 7f23012b9640 1 --2- 172.21.15.88:0/3632113782 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22fc0c0250 0x7f22fc06c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:20.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.860+0000 7f23012b9640 1 -- 172.21.15.88:0/3632113782 >> v1:172.21.15.148:6789/0 conn(0x7f22fc06cbb0 legacy=0x7f22fc06d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:20.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.860+0000 7f23012b9640 1 -- 172.21.15.88:0/3632113782 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22fc0a4e20 con 0x7f22fc14e8e0 2023-12-08T08:21:20.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.860+0000 7f2300ab8640 1 --2- 172.21.15.88:0/3632113782 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22fc0c0250 0x7f22fc06c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:21:20.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.864+0000 7f23012b9640 1 --2- 172.21.15.88:0/3632113782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22fc14e8e0 0x7f22fc154f80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f22f80097c0 tx=0x7f22f801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd7956875c5d2936 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:20.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.864+0000 7f22f3fff640 1 -- 172.21.15.88:0/3632113782 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f80ab600 con 0x7f22fc14e8e0 2023-12-08T08:21:20.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.864+0000 7f22f3fff640 1 -- 172.21.15.88:0/3632113782 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f80a7050 con 0x7f22fc14e8e0 2023-12-08T08:21:20.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.864+0000 7f22f3fff640 1 -- 172.21.15.88:0/3632113782 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f80ab980 con 0x7f22fc14e8e0 2023-12-08T08:21:20.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.864+0000 7f23022bb640 1 -- 172.21.15.88:0/3632113782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22fc14e8e0 msgr2=0x7f22fc154f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:20.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.864+0000 7f23022bb640 1 --2- 172.21.15.88:0/3632113782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22fc14e8e0 0x7f22fc154f80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f22f80097c0 tx=0x7f22f801c330 comp rx=0 tx=0).stop 2023-12-08T08:21:20.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.864+0000 7f23022bb640 1 -- 172.21.15.88:0/3632113782 shutdown_connections 2023-12-08T08:21:20.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.864+0000 7f23022bb640 1 --2- 172.21.15.88:0/3632113782 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22fc0c0250 0x7f22fc06c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:20.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.864+0000 7f23022bb640 1 --2- 172.21.15.88:0/3632113782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22fc14e8e0 0x7f22fc154f80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:20.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.864+0000 7f23022bb640 1 -- 172.21.15.88:0/3632113782 >> 172.21.15.88:0/3632113782 conn(0x7f22fc0c2350 msgr2=0x7f22fc0c2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:20.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.864+0000 7f23022bb640 1 -- 172.21.15.88:0/3632113782 shutdown_connections 2023-12-08T08:21:20.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.864+0000 7f23022bb640 1 -- 172.21.15.88:0/3632113782 wait complete. 2023-12-08T08:21:20.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.864+0000 7f23022bb640 1 Processor -- start 2023-12-08T08:21:20.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.864+0000 7f23022bb640 1 -- start start 2023-12-08T08:21:20.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.868+0000 7f23022bb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22fc06cbb0 0x7f22fc0c4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:20.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.868+0000 7f23022bb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22fc0c0250 0x7f22fc1f0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:20.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.868+0000 7f23022bb640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22fc14e8e0 0x7f22fc150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:20.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.868+0000 7f23022bb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc1efe20 con 0x7f22fc06cbb0 2023-12-08T08:21:20.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.868+0000 7f23022bb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc14bec0 con 0x7f22fc0c0250 2023-12-08T08:21:20.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.868+0000 7f23022bb640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc14c060 con 0x7f22fc14e8e0 2023-12-08T08:21:20.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.868+0000 7f23012b9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22fc06cbb0 0x7f22fc0c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:20.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.868+0000 7f23012b9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22fc06cbb0 0x7f22fc0c4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33666/0 (socket says 172.21.15.88:33666) 2023-12-08T08:21:20.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.868+0000 7f23012b9640 1 -- 172.21.15.88:0/446447723 learned_addr learned my addr 172.21.15.88:0/446447723 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:20.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.868+0000 7f2300ab8640 1 --2- 172.21.15.88:0/446447723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22fc0c0250 0x7f22fc1f0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:20.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.868+0000 7f2301aba640 1 --2- 172.21.15.88:0/446447723 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22fc14e8e0 0x7f22fc150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:20.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.868+0000 7f23012b9640 1 -- 172.21.15.88:0/446447723 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22fc14e8e0 msgr2=0x7f22fc150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:20.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.868+0000 7f23012b9640 1 --2- 172.21.15.88:0/446447723 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22fc14e8e0 0x7f22fc150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:20.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.868+0000 7f23012b9640 1 -- 172.21.15.88:0/446447723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22fc0c0250 msgr2=0x7f22fc1f0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:20.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.868+0000 7f23012b9640 1 --2- 172.21.15.88:0/446447723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22fc0c0250 0x7f22fc1f0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:20.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.868+0000 7f23012b9640 1 -- 172.21.15.88:0/446447723 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec009420 con 0x7f22fc06cbb0 2023-12-08T08:21:20.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.868+0000 7f2300ab8640 1 --2- 172.21.15.88:0/446447723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22fc0c0250 0x7f22fc1f0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:20.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.868+0000 7f23012b9640 1 --2- 172.21.15.88:0/446447723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22fc06cbb0 0x7f22fc0c4240 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f22f8019f60 tx=0x7f22f801ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:20.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.868+0000 7f22f1ffb640 1 -- 172.21.15.88:0/446447723 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f80b7450 con 0x7f22fc06cbb0 2023-12-08T08:21:20.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.868+0000 7f22f1ffb640 1 -- 172.21.15.88:0/446447723 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f80b75d0 con 0x7f22fc06cbb0 2023-12-08T08:21:20.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.868+0000 7f23022bb640 1 -- 172.21.15.88:0/446447723 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f8009420 con 0x7f22fc06cbb0 2023-12-08T08:21:20.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.868+0000 7f22f1ffb640 1 -- 172.21.15.88:0/446447723 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f80b7980 con 0x7f22fc06cbb0 2023-12-08T08:21:20.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.868+0000 7f23022bb640 1 -- 172.21.15.88:0/446447723 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22fc14bbe0 con 0x7f22fc06cbb0 2023-12-08T08:21:20.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.868+0000 7f23022bb640 1 -- 172.21.15.88:0/446447723 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22fc0674b0 con 0x7f22fc06cbb0 2023-12-08T08:21:20.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.868+0000 7f22f1ffb640 1 -- 172.21.15.88:0/446447723 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f22f80b7ae0 con 0x7f22fc06cbb0 2023-12-08T08:21:20.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.872+0000 7f22f1ffb640 1 --2- 172.21.15.88:0/446447723 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f22e0066470 0x7f22e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:20.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.872+0000 7f22f1ffb640 1 -- 172.21.15.88:0/446447723 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f22f811e850 con 0x7f22fc06cbb0 2023-12-08T08:21:20.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.872+0000 7f2300ab8640 1 --2- 172.21.15.88:0/446447723 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f22e0066470 0x7f22e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:20.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.872+0000 7f2300ab8640 1 --2- 172.21.15.88:0/446447723 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f22e0066470 0x7f22e0068930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f22fc0a61f0 tx=0x7f22ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:20.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:20.876+0000 7f22f1ffb640 1 -- 172.21.15.88:0/446447723 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f22f80ebb20 con 0x7f22fc06cbb0 2023-12-08T08:21:21.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.052+0000 7f23022bb640 1 -- 172.21.15.88:0/446447723 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f22fc06d390 con 0x7f22fc06cbb0 2023-12-08T08:21:21.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.692+0000 7f22f1ffb640 1 -- 172.21.15.88:0/446447723 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7f22f80bb0c0 con 0x7f22fc06cbb0 2023-12-08T08:21:21.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.692+0000 7f23022bb640 1 -- 172.21.15.88:0/446447723 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f22e0066470 msgr2=0x7f22e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:21.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.692+0000 7f23022bb640 1 --2- 172.21.15.88:0/446447723 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f22e0066470 0x7f22e0068930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f22fc0a61f0 tx=0x7f22ec008040 comp rx=0 tx=0).stop 2023-12-08T08:21:21.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.692+0000 7f23022bb640 1 -- 172.21.15.88:0/446447723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22fc06cbb0 msgr2=0x7f22fc0c4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:21.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.692+0000 7f23022bb640 1 --2- 172.21.15.88:0/446447723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22fc06cbb0 0x7f22fc0c4240 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f22f8019f60 tx=0x7f22f801ab70 comp rx=0 tx=0).stop 2023-12-08T08:21:21.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.692+0000 7f23022bb640 1 -- 172.21.15.88:0/446447723 shutdown_connections 2023-12-08T08:21:21.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.692+0000 7f23022bb640 1 --2- 172.21.15.88:0/446447723 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f22e0066470 0x7f22e0068930 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:21.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.692+0000 7f23022bb640 1 --2- 172.21.15.88:0/446447723 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f22fc14e8e0 0x7f22fc150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:21.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.692+0000 7f23022bb640 1 --2- 172.21.15.88:0/446447723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22fc0c0250 0x7f22fc1f0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:21.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.692+0000 7f23022bb640 1 --2- 172.21.15.88:0/446447723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22fc06cbb0 0x7f22fc0c4240 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:21.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.692+0000 7f23022bb640 1 -- 172.21.15.88:0/446447723 >> 172.21.15.88:0/446447723 conn(0x7f22fc0c2350 msgr2=0x7f22fc152290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:21.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.692+0000 7f23022bb640 1 -- 172.21.15.88:0/446447723 shutdown_connections 2023-12-08T08:21:21.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.692+0000 7f23022bb640 1 -- 172.21.15.88:0/446447723 wait complete. 2023-12-08T08:21:21.717 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-12-08T08:21:21.717 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:21:21.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.852+0000 7f64035b8640 1 Processor -- start 2023-12-08T08:21:21.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.852+0000 7f64035b8640 1 -- start start 2023-12-08T08:21:21.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.852+0000 7f64035b8640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f63fc071e30 0x7f63fc0722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:21.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.852+0000 7f64035b8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63fc0c5710 con 0x7f63fc156110 2023-12-08T08:21:21.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.852+0000 7f64035b8640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63fc155c80 con 0x7f63fc14fd10 2023-12-08T08:21:21.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.852+0000 7f64035b8640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63fc06c5e0 con 0x7f63fc071e30 2023-12-08T08:21:21.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.852+0000 7f6401b55640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f63fc156110 0x7f63fc15ce50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46724/0 (socket says 172.21.15.88:46724) 2023-12-08T08:21:21.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.852+0000 7f6401b55640 1 -- 172.21.15.88:0/61382709 learned_addr learned my addr 172.21.15.88:0/61382709 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:21.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.852+0000 7f6400b53640 1 --2- 172.21.15.88:0/61382709 >> v2:172.21.15.148:3300/0 conn(0x7f63fc071e30 0x7f63fc0722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:21.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.852+0000 7f63f3fff640 1 -- 172.21.15.88:0/61382709 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3870742324 0 0) 0x7f63fc0c5710 con 0x7f63fc156110 2023-12-08T08:21:21.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.852+0000 7f63f3fff640 1 -- 172.21.15.88:0/61382709 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63e8003530 con 0x7f63fc156110 2023-12-08T08:21:21.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.856+0000 7f63f3fff640 1 -- 172.21.15.88:0/61382709 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3729669275 0 0) 0x7f63e8003530 con 0x7f63fc156110 2023-12-08T08:21:21.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.856+0000 7f6400b53640 1 -- 172.21.15.88:0/61382709 >> v1:172.21.15.148:6789/0 conn(0x7f63fc14fd10 legacy=0x7f63fc0a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:21.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.856+0000 7f6400b53640 1 -- 172.21.15.88:0/61382709 >> v1:172.21.15.88:6789/0 conn(0x7f63fc156110 legacy=0x7f63fc15ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:21.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.856+0000 7f6400b53640 1 -- 172.21.15.88:0/61382709 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63fc0c4e70 con 0x7f63fc071e30 2023-12-08T08:21:21.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.856+0000 7f6400b53640 1 --2- 172.21.15.88:0/61382709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63fc071e30 0x7f63fc0722c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0097c0 tx=0x7f63ec01be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=389e482a5caf5929 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:21.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.856+0000 7f63f3fff640 1 -- 172.21.15.88:0/61382709 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f4001a00 con 0x7f63fc071e30 2023-12-08T08:21:21.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.856+0000 7f63f3fff640 1 -- 172.21.15.88:0/61382709 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ec0a5430 con 0x7f63fc071e30 2023-12-08T08:21:21.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.856+0000 7f63f3fff640 1 -- 172.21.15.88:0/61382709 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ec0a57c0 con 0x7f63fc071e30 2023-12-08T08:21:21.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.856+0000 7f64035b8640 1 -- 172.21.15.88:0/61382709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63fc071e30 msgr2=0x7f63fc0722c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:21.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.856+0000 7f64035b8640 1 --2- 172.21.15.88:0/61382709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63fc071e30 0x7f63fc0722c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0097c0 tx=0x7f63ec01be40 comp rx=0 tx=0).stop 2023-12-08T08:21:21.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.856+0000 7f64035b8640 1 -- 172.21.15.88:0/61382709 shutdown_connections 2023-12-08T08:21:21.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.856+0000 7f64035b8640 1 --2- 172.21.15.88:0/61382709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63fc071e30 0x7f63fc0722c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:21.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.856+0000 7f64035b8640 1 -- 172.21.15.88:0/61382709 >> 172.21.15.88:0/61382709 conn(0x7f63fc0a7810 msgr2=0x7f63fc0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:21.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.860+0000 7f64035b8640 1 -- 172.21.15.88:0/61382709 shutdown_connections 2023-12-08T08:21:21.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.860+0000 7f64035b8640 1 -- 172.21.15.88:0/61382709 wait complete. 2023-12-08T08:21:21.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.860+0000 7f64035b8640 1 Processor -- start 2023-12-08T08:21:21.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.860+0000 7f64035b8640 1 -- start start 2023-12-08T08:21:21.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.860+0000 7f64035b8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63fc071e30 0x7f63fc1ee980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:21.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.860+0000 7f64035b8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63fc14fd10 0x7f63fc14c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:21.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.860+0000 7f64035b8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63fc156110 0x7f63fc147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:21.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.860+0000 7f64035b8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc14f070 con 0x7f63fc14fd10 2023-12-08T08:21:21.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.860+0000 7f64035b8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc1484c0 con 0x7f63fc071e30 2023-12-08T08:21:21.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.860+0000 7f64035b8640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc070fa0 con 0x7f63fc156110 2023-12-08T08:21:21.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.860+0000 7f6400b53640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63fc14fd10 0x7f63fc14c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:21.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.860+0000 7f6400b53640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63fc14fd10 0x7f63fc14c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33672/0 (socket says 172.21.15.88:33672) 2023-12-08T08:21:21.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.860+0000 7f6400b53640 1 -- 172.21.15.88:0/3511069006 learned_addr learned my addr 172.21.15.88:0/3511069006 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:21.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.860+0000 7f6400b53640 1 -- 172.21.15.88:0/3511069006 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63fc156110 msgr2=0x7f63fc147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:21.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.860+0000 7f6400b53640 1 --2- 172.21.15.88:0/3511069006 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63fc156110 0x7f63fc147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:21.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.860+0000 7f6400b53640 1 -- 172.21.15.88:0/3511069006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63fc071e30 msgr2=0x7f63fc1ee980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:21.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.860+0000 7f6400b53640 1 --2- 172.21.15.88:0/3511069006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63fc071e30 0x7f63fc1ee980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:21.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.860+0000 7f6400b53640 1 -- 172.21.15.88:0/3511069006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec009420 con 0x7f63fc14fd10 2023-12-08T08:21:21.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.860+0000 7f6400b53640 1 --2- 172.21.15.88:0/3511069006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63fc14fd10 0x7f63fc14c370 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f63ec01c320 tx=0x7f63ec018f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:21.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.860+0000 7f63f1ffb640 1 -- 172.21.15.88:0/3511069006 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ec004020 con 0x7f63fc14fd10 2023-12-08T08:21:21.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.860+0000 7f63f1ffb640 1 -- 172.21.15.88:0/3511069006 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ec004180 con 0x7f63fc14fd10 2023-12-08T08:21:21.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.860+0000 7f63f1ffb640 1 -- 172.21.15.88:0/3511069006 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ec0044f0 con 0x7f63fc14fd10 2023-12-08T08:21:21.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.860+0000 7f64035b8640 1 -- 172.21.15.88:0/3511069006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63fc071280 con 0x7f63fc14fd10 2023-12-08T08:21:21.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.864+0000 7f64035b8640 1 -- 172.21.15.88:0/3511069006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63fc071840 con 0x7f63fc14fd10 2023-12-08T08:21:21.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.864+0000 7f64035b8640 1 -- 172.21.15.88:0/3511069006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63fc067630 con 0x7f63fc14fd10 2023-12-08T08:21:21.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.864+0000 7f63f1ffb640 1 -- 172.21.15.88:0/3511069006 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f63ec003620 con 0x7f63fc14fd10 2023-12-08T08:21:21.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.864+0000 7f63f1ffb640 1 --2- 172.21.15.88:0/3511069006 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f63e00664a0 0x7f63e0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:21.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.864+0000 7f63f1ffb640 1 -- 172.21.15.88:0/3511069006 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f63ec11d5e0 con 0x7f63fc14fd10 2023-12-08T08:21:21.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.864+0000 7f6401354640 1 --2- 172.21.15.88:0/3511069006 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f63e00664a0 0x7f63e0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:21.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.868+0000 7f6401354640 1 --2- 172.21.15.88:0/3511069006 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f63e00664a0 0x7f63e0068960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f63f8000f70 tx=0x7f63f80079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:21.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:21.868+0000 7f63f1ffb640 1 -- 172.21.15.88:0/3511069006 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f63ec0ea6f0 con 0x7f63fc14fd10 2023-12-08T08:21:22.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.052+0000 7f64035b8640 1 -- 172.21.15.88:0/3511069006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63fc06fc20 con 0x7f63fc14fd10 2023-12-08T08:21:22.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.052+0000 7f63f1ffb640 1 -- 172.21.15.88:0/3511069006 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6133 (secure 0 0 0) 0x7f63ec0edd10 con 0x7f63fc14fd10 2023-12-08T08:21:22.055 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:22.055 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4978,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3372523869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3372523869},{"type":"v1","addr":"172.21.15.148:6834","nonce":3372523869}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4085245492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":4085245492},{"type":"v1","addr":"172.21.15.148:6835","nonce":4085245492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:21:05.130882+0000","modified":"2023-12-08T08:21:08.148991+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5049},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5049":{"gid":5049,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/181654220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":181654220},{"type":"v1","addr":"172.21.15.88:6837","nonce":181654220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:21:18.029250+0000","modified":"2023-12-08T08:21:21.056129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.88:6836/4274252181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":4274252181},{"type":"v1","addr":"172.21.15.88:6836","nonce":4274252181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-08T08:21:22.056 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 22 2023-12-08T08:21:22.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.052+0000 7f64035b8640 1 -- 172.21.15.88:0/3511069006 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f63e00664a0 msgr2=0x7f63e0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:22.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.052+0000 7f64035b8640 1 --2- 172.21.15.88:0/3511069006 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f63e00664a0 0x7f63e0068960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f63f8000f70 tx=0x7f63f80079c0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.052+0000 7f64035b8640 1 -- 172.21.15.88:0/3511069006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63fc14fd10 msgr2=0x7f63fc14c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:22.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.052+0000 7f64035b8640 1 --2- 172.21.15.88:0/3511069006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63fc14fd10 0x7f63fc14c370 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f63ec01c320 tx=0x7f63ec018f30 comp rx=0 tx=0).stop 2023-12-08T08:21:22.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.052+0000 7f64035b8640 1 -- 172.21.15.88:0/3511069006 shutdown_connections 2023-12-08T08:21:22.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.052+0000 7f64035b8640 1 --2- 172.21.15.88:0/3511069006 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f63e00664a0 0x7f63e0068960 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.052+0000 7f64035b8640 1 --2- 172.21.15.88:0/3511069006 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f63fc156110 0x7f63fc147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.052+0000 7f64035b8640 1 --2- 172.21.15.88:0/3511069006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63fc14fd10 0x7f63fc14c370 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.052+0000 7f64035b8640 1 --2- 172.21.15.88:0/3511069006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63fc071e30 0x7f63fc1ee980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.052+0000 7f64035b8640 1 -- 172.21.15.88:0/3511069006 >> 172.21.15.88:0/3511069006 conn(0x7f63fc0a7810 msgr2=0x7f63fc0a8900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:22.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.052+0000 7f64035b8640 1 -- 172.21.15.88:0/3511069006 shutdown_connections 2023-12-08T08:21:22.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.052+0000 7f64035b8640 1 -- 172.21.15.88:0/3511069006 wait complete. 2023-12-08T08:21:22.077 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:21:22.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.212+0000 7fe8d8d57640 1 Processor -- start 2023-12-08T08:21:22.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.212+0000 7fe8d8d57640 1 -- start start 2023-12-08T08:21:22.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.212+0000 7fe8d8d57640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8d414fd10 0x7fe8d40a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:22.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.212+0000 7fe8d8d57640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe8d4156110 0x7fe8d41565c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:22.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.212+0000 7fe8d8d57640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d40c5710 con 0x7fe8d40a5300 2023-12-08T08:21:22.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.212+0000 7fe8d8d57640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d406c5e0 con 0x7fe8d4156110 2023-12-08T08:21:22.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.212+0000 7fe8d8d57640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d4155c80 con 0x7fe8d414fd10 2023-12-08T08:21:22.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.212+0000 7fe8d2d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe8d4156110 0x7fe8d41565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:22.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.212+0000 7fe8d2d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe8d4156110 0x7fe8d41565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33688/0 (socket says 172.21.15.88:33688) 2023-12-08T08:21:22.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.212+0000 7fe8d2d9d640 1 -- 172.21.15.88:0/392951833 learned_addr learned my addr 172.21.15.88:0/392951833 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:22.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.212+0000 7fe8d259c640 1 --2- 172.21.15.88:0/392951833 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8d414fd10 0x7fe8d40a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:22.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.212+0000 7fe8d2d9d640 1 -- 172.21.15.88:0/392951833 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8d414fd10 msgr2=0x7fe8d40a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:22.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.212+0000 7fe8d2d9d640 1 --2- 172.21.15.88:0/392951833 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8d414fd10 0x7fe8d40a4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.212+0000 7fe8d2d9d640 1 -- 172.21.15.88:0/392951833 >> v1:172.21.15.148:6789/0 conn(0x7fe8d40a5300 legacy=0x7fe8d4071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:22.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.212+0000 7fe8d2d9d640 1 -- 172.21.15.88:0/392951833 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d40c4e70 con 0x7fe8d4156110 2023-12-08T08:21:22.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.216+0000 7fe8d2d9d640 1 --2- 172.21.15.88:0/392951833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8d4156110 0x7fe8d41565c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc009e50 tx=0x7fe8cc01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7b30d1d19b13b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:22.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.216+0000 7fe8d159a640 1 -- 172.21.15.88:0/392951833 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc0a5780 con 0x7fe8d4156110 2023-12-08T08:21:22.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.216+0000 7fe8d159a640 1 -- 172.21.15.88:0/392951833 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8cc0a58e0 con 0x7fe8d4156110 2023-12-08T08:21:22.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.216+0000 7fe8d159a640 1 -- 172.21.15.88:0/392951833 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc0a5c70 con 0x7fe8d4156110 2023-12-08T08:21:22.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.216+0000 7fe8d8d57640 1 -- 172.21.15.88:0/392951833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8d4156110 msgr2=0x7fe8d41565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:22.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.216+0000 7fe8d8d57640 1 --2- 172.21.15.88:0/392951833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8d4156110 0x7fe8d41565c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc009e50 tx=0x7fe8cc01c8c0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.216+0000 7fe8d8d57640 1 -- 172.21.15.88:0/392951833 shutdown_connections 2023-12-08T08:21:22.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.216+0000 7fe8d8d57640 1 --2- 172.21.15.88:0/392951833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8d4156110 0x7fe8d41565c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.216+0000 7fe8d8d57640 1 --2- 172.21.15.88:0/392951833 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8d414fd10 0x7fe8d40a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.216+0000 7fe8d8d57640 1 -- 172.21.15.88:0/392951833 >> 172.21.15.88:0/392951833 conn(0x7fe8d40a7810 msgr2=0x7fe8d40a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:22.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.216+0000 7fe8d8d57640 1 -- 172.21.15.88:0/392951833 shutdown_connections 2023-12-08T08:21:22.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.216+0000 7fe8d8d57640 1 -- 172.21.15.88:0/392951833 wait complete. 2023-12-08T08:21:22.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.220+0000 7fe8d8d57640 1 Processor -- start 2023-12-08T08:21:22.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.220+0000 7fe8d8d57640 1 -- start start 2023-12-08T08:21:22.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.220+0000 7fe8d8d57640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8d40a5300 0x7fe8d4147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:22.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.220+0000 7fe8d8d57640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8d414fd10 0x7fe8d413fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:22.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.220+0000 7fe8d8d57640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8d4156110 0x7fe8d4140180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:22.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.220+0000 7fe8d8d57640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d41eb270 con 0x7fe8d414fd10 2023-12-08T08:21:22.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.220+0000 7fe8d8d57640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d41ea940 con 0x7fe8d40a5300 2023-12-08T08:21:22.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.220+0000 7fe8d8d57640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d41eac20 con 0x7fe8d4156110 2023-12-08T08:21:22.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.220+0000 7fe8d1d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8d414fd10 0x7fe8d413fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:22.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.220+0000 7fe8d1d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8d414fd10 0x7fe8d413fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33704/0 (socket says 172.21.15.88:33704) 2023-12-08T08:21:22.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.220+0000 7fe8d1d9b640 1 -- 172.21.15.88:0/4015543704 learned_addr learned my addr 172.21.15.88:0/4015543704 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:22.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.220+0000 7fe8d259c640 1 --2- 172.21.15.88:0/4015543704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8d40a5300 0x7fe8d4147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:22.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.220+0000 7fe8d2d9d640 1 --2- 172.21.15.88:0/4015543704 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8d4156110 0x7fe8d4140180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:22.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.220+0000 7fe8d1d9b640 1 -- 172.21.15.88:0/4015543704 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8d4156110 msgr2=0x7fe8d4140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:22.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.220+0000 7fe8d1d9b640 1 --2- 172.21.15.88:0/4015543704 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8d4156110 0x7fe8d4140180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.220+0000 7fe8d1d9b640 1 -- 172.21.15.88:0/4015543704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8d40a5300 msgr2=0x7fe8d4147180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:22.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.220+0000 7fe8d1d9b640 1 --2- 172.21.15.88:0/4015543704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8d40a5300 0x7fe8d4147180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.220+0000 7fe8d1d9b640 1 -- 172.21.15.88:0/4015543704 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8cc009b30 con 0x7fe8d414fd10 2023-12-08T08:21:22.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.220+0000 7fe8d1d9b640 1 --2- 172.21.15.88:0/4015543704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8d414fd10 0x7fe8d413fc40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe8c800c500 tx=0x7fe8c800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:22.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.220+0000 7fe8c2ffd640 1 -- 172.21.15.88:0/4015543704 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8005220 con 0x7fe8d414fd10 2023-12-08T08:21:22.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.220+0000 7fe8c2ffd640 1 -- 172.21.15.88:0/4015543704 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c8005380 con 0x7fe8d414fd10 2023-12-08T08:21:22.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.220+0000 7fe8c2ffd640 1 -- 172.21.15.88:0/4015543704 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8007270 con 0x7fe8d414fd10 2023-12-08T08:21:22.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.220+0000 7fe8d8d57640 1 -- 172.21.15.88:0/4015543704 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d41eaf00 con 0x7fe8d414fd10 2023-12-08T08:21:22.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.220+0000 7fe8d8d57640 1 -- 172.21.15.88:0/4015543704 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d41ea5f0 con 0x7fe8d414fd10 2023-12-08T08:21:22.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.220+0000 7fe8d8d57640 1 -- 172.21.15.88:0/4015543704 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d40ab830 con 0x7fe8d414fd10 2023-12-08T08:21:22.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.224+0000 7fe8c2ffd640 1 -- 172.21.15.88:0/4015543704 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe8c80073d0 con 0x7fe8d414fd10 2023-12-08T08:21:22.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.224+0000 7fe8c2ffd640 1 --2- 172.21.15.88:0/4015543704 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe8b4066470 0x7fe8b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:22.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.224+0000 7fe8c2ffd640 1 -- 172.21.15.88:0/4015543704 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe8c8083990 con 0x7fe8d414fd10 2023-12-08T08:21:22.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.224+0000 7fe8d259c640 1 --2- 172.21.15.88:0/4015543704 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe8b4066470 0x7fe8b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:22.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.224+0000 7fe8d259c640 1 --2- 172.21.15.88:0/4015543704 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe8b4066470 0x7fe8b4068930 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe8d415c330 tx=0x7fe8c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:22.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.228+0000 7fe8c2ffd640 1 -- 172.21.15.88:0/4015543704 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe8c8050b70 con 0x7fe8d414fd10 2023-12-08T08:21:22.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.376+0000 7fe8d8d57640 1 -- 172.21.15.88:0/4015543704 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8d4067630 con 0x7fe8d414fd10 2023-12-08T08:21:22.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.376+0000 7fe8c2ffd640 1 -- 172.21.15.88:0/4015543704 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20205 (secure 0 0 0) 0x7fe8c8054190 con 0x7fe8d414fd10 2023-12-08T08:21:22.381 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:22.381 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":35,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:21:19.666744+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:21:03.690721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-08T08:21:04.127786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:21:16.039054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:21:17.029894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:21:22.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.380+0000 7fe8d8d57640 1 -- 172.21.15.88:0/4015543704 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe8b4066470 msgr2=0x7fe8b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:22.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.380+0000 7fe8d8d57640 1 --2- 172.21.15.88:0/4015543704 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe8b4066470 0x7fe8b4068930 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe8d415c330 tx=0x7fe8c4008040 comp rx=0 tx=0).stop 2023-12-08T08:21:22.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.380+0000 7fe8d8d57640 1 -- 172.21.15.88:0/4015543704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8d414fd10 msgr2=0x7fe8d413fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:22.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.380+0000 7fe8d8d57640 1 --2- 172.21.15.88:0/4015543704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8d414fd10 0x7fe8d413fc40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe8c800c500 tx=0x7fe8c800c9c0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.380+0000 7fe8d8d57640 1 -- 172.21.15.88:0/4015543704 shutdown_connections 2023-12-08T08:21:22.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.380+0000 7fe8d8d57640 1 --2- 172.21.15.88:0/4015543704 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe8b4066470 0x7fe8b4068930 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.380+0000 7fe8d8d57640 1 --2- 172.21.15.88:0/4015543704 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe8d4156110 0x7fe8d4140180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.380+0000 7fe8d8d57640 1 --2- 172.21.15.88:0/4015543704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8d414fd10 0x7fe8d413fc40 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.380+0000 7fe8d8d57640 1 --2- 172.21.15.88:0/4015543704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8d40a5300 0x7fe8d4147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.380+0000 7fe8d8d57640 1 -- 172.21.15.88:0/4015543704 >> 172.21.15.88:0/4015543704 conn(0x7fe8d40a7810 msgr2=0x7fe8d40a8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:22.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.380+0000 7fe8d8d57640 1 -- 172.21.15.88:0/4015543704 shutdown_connections 2023-12-08T08:21:22.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.380+0000 7fe8d8d57640 1 -- 172.21.15.88:0/4015543704 wait complete. 2023-12-08T08:21:22.402 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-08T08:21:22.402 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:21:22.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.536+0000 7f746bae3640 1 Processor -- start 2023-12-08T08:21:22.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.536+0000 7f746bae3640 1 -- start start 2023-12-08T08:21:22.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.536+0000 7f746bae3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f74640af4c0 0x7f7464154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:22.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.536+0000 7f746bae3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f746406c100 0x7f74640c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:22.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.536+0000 7f746bae3640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74640c4890 con 0x7f74640c67d0 2023-12-08T08:21:22.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.536+0000 7f746bae3640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7464155460 con 0x7f74640af4c0 2023-12-08T08:21:22.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.536+0000 7f746bae3640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74640af8a0 con 0x7f746406c100 2023-12-08T08:21:22.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.536+0000 7f746987f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f74640af4c0 0x7f7464154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:22.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.536+0000 7f746987f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f74640af4c0 0x7f7464154f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33718/0 (socket says 172.21.15.88:33718) 2023-12-08T08:21:22.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.536+0000 7f746987f640 1 -- 172.21.15.88:0/251716800 learned_addr learned my addr 172.21.15.88:0/251716800 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:22.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.536+0000 7f746a080640 1 --2- 172.21.15.88:0/251716800 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f746406c100 0x7f74640c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:22.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.536+0000 7f746987f640 1 -- 172.21.15.88:0/251716800 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f746406c100 msgr2=0x7f74640c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:22.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.536+0000 7f746987f640 1 --2- 172.21.15.88:0/251716800 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f746406c100 0x7f74640c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.536+0000 7f746987f640 1 -- 172.21.15.88:0/251716800 >> v1:172.21.15.148:6789/0 conn(0x7f74640c67d0 legacy=0x7f746406b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:22.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.536+0000 7f746987f640 1 -- 172.21.15.88:0/251716800 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74640c4b30 con 0x7f74640af4c0 2023-12-08T08:21:22.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.540+0000 7f746987f640 1 --2- 172.21.15.88:0/251716800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74640af4c0 0x7f7464154f20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7460009870 tx=0x7f746001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cbcdb3f92c9900b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:22.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.540+0000 7f746887d640 1 -- 172.21.15.88:0/251716800 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74600ab680 con 0x7f74640af4c0 2023-12-08T08:21:22.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.540+0000 7f746887d640 1 -- 172.21.15.88:0/251716800 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74600ab7e0 con 0x7f74640af4c0 2023-12-08T08:21:22.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.540+0000 7f746887d640 1 -- 172.21.15.88:0/251716800 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74600abb70 con 0x7f74640af4c0 2023-12-08T08:21:22.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.540+0000 7f746bae3640 1 -- 172.21.15.88:0/251716800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74640af4c0 msgr2=0x7f7464154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:22.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.540+0000 7f746bae3640 1 --2- 172.21.15.88:0/251716800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74640af4c0 0x7f7464154f20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7460009870 tx=0x7f746001c480 comp rx=0 tx=0).stop 2023-12-08T08:21:22.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.540+0000 7f746bae3640 1 -- 172.21.15.88:0/251716800 shutdown_connections 2023-12-08T08:21:22.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.540+0000 7f746bae3640 1 --2- 172.21.15.88:0/251716800 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f746406c100 0x7f74640c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.540+0000 7f746bae3640 1 --2- 172.21.15.88:0/251716800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74640af4c0 0x7f7464154f20 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.540+0000 7f746bae3640 1 -- 172.21.15.88:0/251716800 >> 172.21.15.88:0/251716800 conn(0x7f74640ab9d0 msgr2=0x7f74640abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:22.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.540+0000 7f746bae3640 1 -- 172.21.15.88:0/251716800 shutdown_connections 2023-12-08T08:21:22.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.540+0000 7f746bae3640 1 -- 172.21.15.88:0/251716800 wait complete. 2023-12-08T08:21:22.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.544+0000 7f746bae3640 1 Processor -- start 2023-12-08T08:21:22.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.544+0000 7f746bae3640 1 -- start start 2023-12-08T08:21:22.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.544+0000 7f746bae3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f746406c100 0x7f7464151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:22.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.544+0000 7f746bae3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74640af4c0 0x7f746414e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:22.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.544+0000 7f746bae3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74640c67d0 0x7f746414e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:22.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.544+0000 7f746bae3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7464152310 con 0x7f74640c67d0 2023-12-08T08:21:22.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.544+0000 7f746bae3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746414eb20 con 0x7f746406c100 2023-12-08T08:21:22.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.544+0000 7f746bae3640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74641f0370 con 0x7f74640af4c0 2023-12-08T08:21:22.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.544+0000 7f746a080640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74640c67d0 0x7f746414e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:22.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.544+0000 7f746a080640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74640c67d0 0x7f746414e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33730/0 (socket says 172.21.15.88:33730) 2023-12-08T08:21:22.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.544+0000 7f746a080640 1 -- 172.21.15.88:0/402499071 learned_addr learned my addr 172.21.15.88:0/402499071 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:22.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.544+0000 7f746987f640 1 --2- 172.21.15.88:0/402499071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f746406c100 0x7f7464151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:22.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.544+0000 7f746907e640 1 --2- 172.21.15.88:0/402499071 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74640af4c0 0x7f746414e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:22.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.544+0000 7f746a080640 1 -- 172.21.15.88:0/402499071 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74640af4c0 msgr2=0x7f746414e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:22.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.544+0000 7f746a080640 1 --2- 172.21.15.88:0/402499071 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74640af4c0 0x7f746414e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.544+0000 7f746a080640 1 -- 172.21.15.88:0/402499071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f746406c100 msgr2=0x7f7464151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:22.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.544+0000 7f746a080640 1 --2- 172.21.15.88:0/402499071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f746406c100 0x7f7464151410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.544+0000 7f746a080640 1 -- 172.21.15.88:0/402499071 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74600094d0 con 0x7f74640c67d0 2023-12-08T08:21:22.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.544+0000 7f746a080640 1 --2- 172.21.15.88:0/402499071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74640c67d0 0x7f746414e5e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f745c007d80 tx=0x7f745c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:22.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.544+0000 7f745a7fc640 1 -- 172.21.15.88:0/402499071 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c014420 con 0x7f74640c67d0 2023-12-08T08:21:22.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.544+0000 7f745a7fc640 1 -- 172.21.15.88:0/402499071 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745c014580 con 0x7f74640c67d0 2023-12-08T08:21:22.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.544+0000 7f745a7fc640 1 -- 172.21.15.88:0/402499071 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c014930 con 0x7f74640c67d0 2023-12-08T08:21:22.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.544+0000 7f746bae3640 1 -- 172.21.15.88:0/402499071 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7464152560 con 0x7f74640c67d0 2023-12-08T08:21:22.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.544+0000 7f746bae3640 1 -- 172.21.15.88:0/402499071 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7464152b20 con 0x7f74640c67d0 2023-12-08T08:21:22.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.548+0000 7f746bae3640 1 -- 172.21.15.88:0/402499071 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7464067630 con 0x7f74640c67d0 2023-12-08T08:21:22.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.548+0000 7f745a7fc640 1 -- 172.21.15.88:0/402499071 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f745c014a90 con 0x7f74640c67d0 2023-12-08T08:21:22.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.548+0000 7f745a7fc640 1 --2- 172.21.15.88:0/402499071 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f74480664a0 0x7f7448068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:22.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.548+0000 7f745a7fc640 1 -- 172.21.15.88:0/402499071 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f745c084910 con 0x7f74640c67d0 2023-12-08T08:21:22.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.548+0000 7f746987f640 1 --2- 172.21.15.88:0/402499071 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f74480664a0 0x7f7448068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:22.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.548+0000 7f746987f640 1 --2- 172.21.15.88:0/402499071 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f74480664a0 0x7f7448068960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f74600af000 tx=0x7f74600b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:22.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.552+0000 7f745a7fc640 1 -- 172.21.15.88:0/402499071 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f745c051ae0 con 0x7f74640c67d0 2023-12-08T08:21:22.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.700+0000 7f746bae3640 1 -- 172.21.15.88:0/402499071 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f74640c6f10 con 0x7f74480664a0 2023-12-08T08:21:22.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.716+0000 7f745a7fc640 1 -- 172.21.15.88:0/402499071 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+521952 (secure 0 0 0) 0x7f74640c6f10 con 0x7f74480664a0 2023-12-08T08:21:22.719 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:22.727 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:21:22.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.720+0000 7f746bae3640 1 -- 172.21.15.88:0/402499071 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f74480664a0 msgr2=0x7f7448068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:22.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.720+0000 7f746bae3640 1 --2- 172.21.15.88:0/402499071 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f74480664a0 0x7f7448068960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f74600af000 tx=0x7f74600b6040 comp rx=0 tx=0).stop 2023-12-08T08:21:22.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.720+0000 7f746bae3640 1 -- 172.21.15.88:0/402499071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74640c67d0 msgr2=0x7f746414e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:22.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.720+0000 7f746bae3640 1 --2- 172.21.15.88:0/402499071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74640c67d0 0x7f746414e5e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f745c007d80 tx=0x7f745c00e4b0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.720+0000 7f746bae3640 1 -- 172.21.15.88:0/402499071 shutdown_connections 2023-12-08T08:21:22.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.720+0000 7f746bae3640 1 --2- 172.21.15.88:0/402499071 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f74480664a0 0x7f7448068960 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.720+0000 7f746bae3640 1 --2- 172.21.15.88:0/402499071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74640c67d0 0x7f746414e5e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.720+0000 7f746bae3640 1 --2- 172.21.15.88:0/402499071 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74640af4c0 0x7f746414e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.720+0000 7f746bae3640 1 --2- 172.21.15.88:0/402499071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f746406c100 0x7f7464151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.720+0000 7f746bae3640 1 -- 172.21.15.88:0/402499071 >> 172.21.15.88:0/402499071 conn(0x7f74640ab9d0 msgr2=0x7f74640aafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:22.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.720+0000 7f746bae3640 1 -- 172.21.15.88:0/402499071 shutdown_connections 2023-12-08T08:21:22.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.720+0000 7f746bae3640 1 -- 172.21.15.88:0/402499071 wait complete. 2023-12-08T08:21:22.741 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2023-12-08T08:21:20.759545+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":202,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219180,"kb_used_data":3020,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755540,"statfs":{"total":773094113280,"available":772869672960,"internally_reserved":0,"allocated":3092480,"data_stored":2321852,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1241,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.118031"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.658802+0000","last_change":"2023-12-08T08:21:17.658802+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.658802+0000","last_undegraded":"2023-12-08T08:21:17.658802+0000","last_fullsized":"2023-12-08T08:21:17.658802+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654128+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:21:16.654128+0000","last_peered":"2023-12-08T08:21:16.654128+0000","last_clean":"2023-12-08T08:21:16.654128+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:21:16.654128+0000","last_undegraded":"2023-12-08T08:21:16.654128+0000","last_fullsized":"2023-12-08T08:21:16.654128+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.650554+0000","last_change":"2023-12-08T08:21:04.776417+0000","last_active":"2023-12-08T08:21:16.650554+0000","last_peered":"2023-12-08T08:21:16.650554+0000","last_clean":"2023-12-08T08:21:16.650554+0000","last_became_active":"2023-12-08T08:21:04.776117+0000","last_became_peered":"2023-12-08T08:21:04.776117+0000","last_unstale":"2023-12-08T08:21:16.650554+0000","last_undegraded":"2023-12-08T08:21:16.650554+0000","last_fullsized":"2023-12-08T08:21:16.650554+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:45:05.142948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654266+0000","last_change":"2023-12-08T08:21:05.536640+0000","last_active":"2023-12-08T08:21:16.654266+0000","last_peered":"2023-12-08T08:21:16.654266+0000","last_clean":"2023-12-08T08:21:16.654266+0000","last_became_active":"2023-12-08T08:21:05.536368+0000","last_became_peered":"2023-12-08T08:21:05.536368+0000","last_unstale":"2023-12-08T08:21:16.654266+0000","last_undegraded":"2023-12-08T08:21:16.654266+0000","last_fullsized":"2023-12-08T08:21:16.654266+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:59:00.606587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.687045+0000","last_change":"2023-12-08T08:21:17.684153+0000","last_active":"2023-12-08T08:21:17.687045+0000","last_peered":"2023-12-08T08:21:17.687045+0000","last_clean":"2023-12-08T08:21:17.687045+0000","last_became_active":"2023-12-08T08:21:17.683886+0000","last_became_peered":"2023-12-08T08:21:17.683886+0000","last_unstale":"2023-12-08T08:21:17.687045+0000","last_undegraded":"2023-12-08T08:21:17.687045+0000","last_fullsized":"2023-12-08T08:21:17.687045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:37.006561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.671758+0000","last_change":"2023-12-08T08:21:17.671758+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.671758+0000","last_undegraded":"2023-12-08T08:21:17.671758+0000","last_fullsized":"2023-12-08T08:21:17.671758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643858+0000","last_change":"2023-12-08T08:21:04.781980+0000","last_active":"2023-12-08T08:21:16.643858+0000","last_peered":"2023-12-08T08:21:16.643858+0000","last_clean":"2023-12-08T08:21:16.643858+0000","last_became_active":"2023-12-08T08:21:04.781716+0000","last_became_peered":"2023-12-08T08:21:04.781716+0000","last_unstale":"2023-12-08T08:21:16.643858+0000","last_undegraded":"2023-12-08T08:21:16.643858+0000","last_fullsized":"2023-12-08T08:21:16.643858+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:03.400233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648438+0000","last_change":"2023-12-08T08:21:05.529530+0000","last_active":"2023-12-08T08:21:16.648438+0000","last_peered":"2023-12-08T08:21:16.648438+0000","last_clean":"2023-12-08T08:21:16.648438+0000","last_became_active":"2023-12-08T08:21:05.529080+0000","last_became_peered":"2023-12-08T08:21:05.529080+0000","last_unstale":"2023-12-08T08:21:16.648438+0000","last_undegraded":"2023-12-08T08:21:16.648438+0000","last_fullsized":"2023-12-08T08:21:16.648438+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:51.183842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686147+0000","last_change":"2023-12-08T08:21:17.682622+0000","last_active":"2023-12-08T08:21:17.686147+0000","last_peered":"2023-12-08T08:21:17.686147+0000","last_clean":"2023-12-08T08:21:17.686147+0000","last_became_active":"2023-12-08T08:21:17.676302+0000","last_became_peered":"2023-12-08T08:21:17.676302+0000","last_unstale":"2023-12-08T08:21:17.686147+0000","last_undegraded":"2023-12-08T08:21:17.686147+0000","last_fullsized":"2023-12-08T08:21:17.686147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:15.257930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.665725+0000","last_change":"2023-12-08T08:21:17.665725+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.665725+0000","last_undegraded":"2023-12-08T08:21:17.665725+0000","last_fullsized":"2023-12-08T08:21:17.665725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648651+0000","last_change":"2023-12-08T08:21:04.768138+0000","last_active":"2023-12-08T08:21:16.648651+0000","last_peered":"2023-12-08T08:21:16.648651+0000","last_clean":"2023-12-08T08:21:16.648651+0000","last_became_active":"2023-12-08T08:21:04.767873+0000","last_became_peered":"2023-12-08T08:21:04.767873+0000","last_unstale":"2023-12-08T08:21:16.648651+0000","last_undegraded":"2023-12-08T08:21:16.648651+0000","last_fullsized":"2023-12-08T08:21:16.648651+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:45:05.142948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643753+0000","last_change":"2023-12-08T08:21:05.526701+0000","last_active":"2023-12-08T08:21:16.643753+0000","last_peered":"2023-12-08T08:21:16.643753+0000","last_clean":"2023-12-08T08:21:16.643753+0000","last_became_active":"2023-12-08T08:21:05.526275+0000","last_became_peered":"2023-12-08T08:21:05.526275+0000","last_unstale":"2023-12-08T08:21:16.643753+0000","last_undegraded":"2023-12-08T08:21:16.643753+0000","last_fullsized":"2023-12-08T08:21:16.643753+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:59:00.606587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686309+0000","last_change":"2023-12-08T08:21:17.682917+0000","last_active":"2023-12-08T08:21:17.686309+0000","last_peered":"2023-12-08T08:21:17.686309+0000","last_clean":"2023-12-08T08:21:17.686309+0000","last_became_active":"2023-12-08T08:21:17.681822+0000","last_became_peered":"2023-12-08T08:21:17.681822+0000","last_unstale":"2023-12-08T08:21:17.686309+0000","last_undegraded":"2023-12-08T08:21:17.686309+0000","last_fullsized":"2023-12-08T08:21:17.686309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:37.006561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.655138+0000","last_change":"2023-12-08T08:21:17.655138+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.655138+0000","last_undegraded":"2023-12-08T08:21:17.655138+0000","last_fullsized":"2023-12-08T08:21:17.655138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652749+0000","last_change":"2023-12-08T08:21:04.776576+0000","last_active":"2023-12-08T08:21:16.652749+0000","last_peered":"2023-12-08T08:21:16.652749+0000","last_clean":"2023-12-08T08:21:16.652749+0000","last_became_active":"2023-12-08T08:21:04.773627+0000","last_became_peered":"2023-12-08T08:21:04.773627+0000","last_unstale":"2023-12-08T08:21:16.652749+0000","last_undegraded":"2023-12-08T08:21:16.652749+0000","last_fullsized":"2023-12-08T08:21:16.652749+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:12.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654667+0000","last_change":"2023-12-08T08:21:05.528356+0000","last_active":"2023-12-08T08:21:16.654667+0000","last_peered":"2023-12-08T08:21:16.654667+0000","last_clean":"2023-12-08T08:21:16.654667+0000","last_became_active":"2023-12-08T08:21:05.528102+0000","last_became_peered":"2023-12-08T08:21:05.528102+0000","last_unstale":"2023-12-08T08:21:16.654667+0000","last_undegraded":"2023-12-08T08:21:16.654667+0000","last_fullsized":"2023-12-08T08:21:16.654667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:51.183842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.675479+0000","last_change":"2023-12-08T08:21:17.673005+0000","last_active":"2023-12-08T08:21:17.675479+0000","last_peered":"2023-12-08T08:21:17.675479+0000","last_clean":"2023-12-08T08:21:17.675479+0000","last_became_active":"2023-12-08T08:21:17.672648+0000","last_became_peered":"2023-12-08T08:21:17.672648+0000","last_unstale":"2023-12-08T08:21:17.675479+0000","last_undegraded":"2023-12-08T08:21:17.675479+0000","last_fullsized":"2023-12-08T08:21:17.675479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:51:05.544383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.663000+0000","last_change":"2023-12-08T08:21:17.663000+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.663000+0000","last_undegraded":"2023-12-08T08:21:17.663000+0000","last_fullsized":"2023-12-08T08:21:17.663000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654354+0000","last_change":"2023-12-08T08:21:04.764784+0000","last_active":"2023-12-08T08:21:16.654354+0000","last_peered":"2023-12-08T08:21:16.654354+0000","last_clean":"2023-12-08T08:21:16.654354+0000","last_became_active":"2023-12-08T08:21:04.764580+0000","last_became_peered":"2023-12-08T08:21:04.764580+0000","last_unstale":"2023-12-08T08:21:16.654354+0000","last_undegraded":"2023-12-08T08:21:16.654354+0000","last_fullsized":"2023-12-08T08:21:16.654354+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:51:05.330323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.650596+0000","last_change":"2023-12-08T08:21:05.529399+0000","last_active":"2023-12-08T08:21:16.650596+0000","last_peered":"2023-12-08T08:21:16.650596+0000","last_clean":"2023-12-08T08:21:16.650596+0000","last_became_active":"2023-12-08T08:21:05.529054+0000","last_became_peered":"2023-12-08T08:21:05.529054+0000","last_unstale":"2023-12-08T08:21:16.650596+0000","last_undegraded":"2023-12-08T08:21:16.650596+0000","last_fullsized":"2023-12-08T08:21:16.650596+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:09.020416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.682208+0000","last_change":"2023-12-08T08:21:17.680157+0000","last_active":"2023-12-08T08:21:17.682208+0000","last_peered":"2023-12-08T08:21:17.682208+0000","last_clean":"2023-12-08T08:21:17.682208+0000","last_became_active":"2023-12-08T08:21:17.679947+0000","last_became_peered":"2023-12-08T08:21:17.679947+0000","last_unstale":"2023-12-08T08:21:17.682208+0000","last_undegraded":"2023-12-08T08:21:17.682208+0000","last_fullsized":"2023-12-08T08:21:17.682208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:37.129163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.663369+0000","last_change":"2023-12-08T08:21:17.663369+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.663369+0000","last_undegraded":"2023-12-08T08:21:17.663369+0000","last_fullsized":"2023-12-08T08:21:17.663369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651312+0000","last_change":"2023-12-08T08:21:04.769119+0000","last_active":"2023-12-08T08:21:16.651312+0000","last_peered":"2023-12-08T08:21:16.651312+0000","last_clean":"2023-12-08T08:21:16.651312+0000","last_became_active":"2023-12-08T08:21:04.768807+0000","last_became_peered":"2023-12-08T08:21:04.768807+0000","last_unstale":"2023-12-08T08:21:16.651312+0000","last_undegraded":"2023-12-08T08:21:16.651312+0000","last_fullsized":"2023-12-08T08:21:16.651312+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:29.810210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654195+0000","last_change":"2023-12-08T08:21:05.525845+0000","last_active":"2023-12-08T08:21:16.654195+0000","last_peered":"2023-12-08T08:21:16.654195+0000","last_clean":"2023-12-08T08:21:16.654195+0000","last_became_active":"2023-12-08T08:21:05.525546+0000","last_became_peered":"2023-12-08T08:21:05.525546+0000","last_unstale":"2023-12-08T08:21:16.654195+0000","last_undegraded":"2023-12-08T08:21:16.654195+0000","last_fullsized":"2023-12-08T08:21:16.654195+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:44.030312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686444+0000","last_change":"2023-12-08T08:21:17.682436+0000","last_active":"2023-12-08T08:21:17.686444+0000","last_peered":"2023-12-08T08:21:17.686444+0000","last_clean":"2023-12-08T08:21:17.686444+0000","last_became_active":"2023-12-08T08:21:17.682222+0000","last_became_peered":"2023-12-08T08:21:17.682222+0000","last_unstale":"2023-12-08T08:21:17.686444+0000","last_undegraded":"2023-12-08T08:21:17.686444+0000","last_fullsized":"2023-12-08T08:21:17.686444+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:49:31.201437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659513+0000","last_change":"2023-12-08T08:21:17.659513+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659513+0000","last_undegraded":"2023-12-08T08:21:17.659513+0000","last_fullsized":"2023-12-08T08:21:17.659513+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654403+0000","last_change":"2023-12-08T08:21:04.771189+0000","last_active":"2023-12-08T08:21:16.654403+0000","last_peered":"2023-12-08T08:21:16.654403+0000","last_clean":"2023-12-08T08:21:16.654403+0000","last_became_active":"2023-12-08T08:21:04.770913+0000","last_became_peered":"2023-12-08T08:21:04.770913+0000","last_unstale":"2023-12-08T08:21:16.654403+0000","last_undegraded":"2023-12-08T08:21:16.654403+0000","last_fullsized":"2023-12-08T08:21:16.654403+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:58:22.885070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.656834+0000","last_change":"2023-12-08T08:21:05.537968+0000","last_active":"2023-12-08T08:21:16.656834+0000","last_peered":"2023-12-08T08:21:16.656834+0000","last_clean":"2023-12-08T08:21:16.656834+0000","last_became_active":"2023-12-08T08:21:05.537190+0000","last_became_peered":"2023-12-08T08:21:05.537190+0000","last_unstale":"2023-12-08T08:21:16.656834+0000","last_undegraded":"2023-12-08T08:21:16.656834+0000","last_fullsized":"2023-12-08T08:21:16.656834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:49.782105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.689179+0000","last_change":"2023-12-08T08:21:17.684922+0000","last_active":"2023-12-08T08:21:17.689179+0000","last_peered":"2023-12-08T08:21:17.689179+0000","last_clean":"2023-12-08T08:21:17.689179+0000","last_became_active":"2023-12-08T08:21:17.684661+0000","last_became_peered":"2023-12-08T08:21:17.684661+0000","last_unstale":"2023-12-08T08:21:17.689179+0000","last_undegraded":"2023-12-08T08:21:17.689179+0000","last_fullsized":"2023-12-08T08:21:17.689179+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:42.863062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.656454+0000","last_change":"2023-12-08T08:21:17.656454+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.656454+0000","last_undegraded":"2023-12-08T08:21:17.656454+0000","last_fullsized":"2023-12-08T08:21:17.656454+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652074+0000","last_change":"2023-12-08T08:21:04.774731+0000","last_active":"2023-12-08T08:21:16.652074+0000","last_peered":"2023-12-08T08:21:16.652074+0000","last_clean":"2023-12-08T08:21:16.652074+0000","last_became_active":"2023-12-08T08:21:04.773894+0000","last_became_peered":"2023-12-08T08:21:04.773894+0000","last_unstale":"2023-12-08T08:21:16.652074+0000","last_undegraded":"2023-12-08T08:21:16.652074+0000","last_fullsized":"2023-12-08T08:21:16.652074+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:46.416448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652665+0000","last_change":"2023-12-08T08:21:05.540583+0000","last_active":"2023-12-08T08:21:16.652665+0000","last_peered":"2023-12-08T08:21:16.652665+0000","last_clean":"2023-12-08T08:21:16.652665+0000","last_became_active":"2023-12-08T08:21:05.540350+0000","last_became_peered":"2023-12-08T08:21:05.540350+0000","last_unstale":"2023-12-08T08:21:16.652665+0000","last_undegraded":"2023-12-08T08:21:16.652665+0000","last_fullsized":"2023-12-08T08:21:16.652665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:46:44.526151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.685385+0000","last_change":"2023-12-08T08:21:17.679399+0000","last_active":"2023-12-08T08:21:17.685385+0000","last_peered":"2023-12-08T08:21:17.685385+0000","last_clean":"2023-12-08T08:21:17.685385+0000","last_became_active":"2023-12-08T08:21:17.679103+0000","last_became_peered":"2023-12-08T08:21:17.679103+0000","last_unstale":"2023-12-08T08:21:17.685385+0000","last_undegraded":"2023-12-08T08:21:17.685385+0000","last_fullsized":"2023-12-08T08:21:17.685385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:11:38.595950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.662267+0000","last_change":"2023-12-08T08:21:17.662267+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.662267+0000","last_undegraded":"2023-12-08T08:21:17.662267+0000","last_fullsized":"2023-12-08T08:21:17.662267+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655121+0000","last_change":"2023-12-08T08:21:04.778519+0000","last_active":"2023-12-08T08:21:16.655121+0000","last_peered":"2023-12-08T08:21:16.655121+0000","last_clean":"2023-12-08T08:21:16.655121+0000","last_became_active":"2023-12-08T08:21:04.778208+0000","last_became_peered":"2023-12-08T08:21:04.778208+0000","last_unstale":"2023-12-08T08:21:16.655121+0000","last_undegraded":"2023-12-08T08:21:16.655121+0000","last_fullsized":"2023-12-08T08:21:16.655121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:36.535172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654305+0000","last_change":"2023-12-08T08:21:05.530364+0000","last_active":"2023-12-08T08:21:16.654305+0000","last_peered":"2023-12-08T08:21:16.654305+0000","last_clean":"2023-12-08T08:21:16.654305+0000","last_became_active":"2023-12-08T08:21:05.530046+0000","last_became_peered":"2023-12-08T08:21:05.530046+0000","last_unstale":"2023-12-08T08:21:16.654305+0000","last_undegraded":"2023-12-08T08:21:16.654305+0000","last_fullsized":"2023-12-08T08:21:16.654305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.368162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.684614+0000","last_change":"2023-12-08T08:21:17.680178+0000","last_active":"2023-12-08T08:21:17.684614+0000","last_peered":"2023-12-08T08:21:17.684614+0000","last_clean":"2023-12-08T08:21:17.684614+0000","last_became_active":"2023-12-08T08:21:17.679880+0000","last_became_peered":"2023-12-08T08:21:17.679880+0000","last_unstale":"2023-12-08T08:21:17.684614+0000","last_undegraded":"2023-12-08T08:21:17.684614+0000","last_fullsized":"2023-12-08T08:21:17.684614+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:54.148326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.673219+0000","last_change":"2023-12-08T08:21:17.673219+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.673219+0000","last_undegraded":"2023-12-08T08:21:17.673219+0000","last_fullsized":"2023-12-08T08:21:17.673219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648603+0000","last_change":"2023-12-08T08:21:04.771979+0000","last_active":"2023-12-08T08:21:16.648603+0000","last_peered":"2023-12-08T08:21:16.648603+0000","last_clean":"2023-12-08T08:21:16.648603+0000","last_became_active":"2023-12-08T08:21:04.771656+0000","last_became_peered":"2023-12-08T08:21:04.771656+0000","last_unstale":"2023-12-08T08:21:16.648603+0000","last_undegraded":"2023-12-08T08:21:16.648603+0000","last_fullsized":"2023-12-08T08:21:16.648603+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:46:43.523269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649282+0000","last_change":"2023-12-08T08:21:05.538591+0000","last_active":"2023-12-08T08:21:16.649282+0000","last_peered":"2023-12-08T08:21:16.649282+0000","last_clean":"2023-12-08T08:21:16.649282+0000","last_became_active":"2023-12-08T08:21:05.538303+0000","last_became_peered":"2023-12-08T08:21:05.538303+0000","last_unstale":"2023-12-08T08:21:16.649282+0000","last_undegraded":"2023-12-08T08:21:16.649282+0000","last_fullsized":"2023-12-08T08:21:16.649282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:45:35.860546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686482+0000","last_change":"2023-12-08T08:21:17.682782+0000","last_active":"2023-12-08T08:21:17.686482+0000","last_peered":"2023-12-08T08:21:17.686482+0000","last_clean":"2023-12-08T08:21:17.686482+0000","last_became_active":"2023-12-08T08:21:17.681371+0000","last_became_peered":"2023-12-08T08:21:17.681371+0000","last_unstale":"2023-12-08T08:21:17.686482+0000","last_undegraded":"2023-12-08T08:21:17.686482+0000","last_fullsized":"2023-12-08T08:21:17.686482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:41:10.487912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.657337+0000","last_change":"2023-12-08T08:21:17.657337+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.657337+0000","last_undegraded":"2023-12-08T08:21:17.657337+0000","last_fullsized":"2023-12-08T08:21:17.657337+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.650676+0000","last_change":"2023-12-08T08:21:04.776313+0000","last_active":"2023-12-08T08:21:16.650676+0000","last_peered":"2023-12-08T08:21:16.650676+0000","last_clean":"2023-12-08T08:21:16.650676+0000","last_became_active":"2023-12-08T08:21:04.775894+0000","last_became_peered":"2023-12-08T08:21:04.775894+0000","last_unstale":"2023-12-08T08:21:16.650676+0000","last_undegraded":"2023-12-08T08:21:16.650676+0000","last_fullsized":"2023-12-08T08:21:16.650676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:13.006406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649886+0000","last_change":"2023-12-08T08:21:05.537164+0000","last_active":"2023-12-08T08:21:16.649886+0000","last_peered":"2023-12-08T08:21:16.649886+0000","last_clean":"2023-12-08T08:21:16.649886+0000","last_became_active":"2023-12-08T08:21:05.536915+0000","last_became_peered":"2023-12-08T08:21:05.536915+0000","last_unstale":"2023-12-08T08:21:16.649886+0000","last_undegraded":"2023-12-08T08:21:16.649886+0000","last_fullsized":"2023-12-08T08:21:16.649886+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:14.009289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.676342+0000","last_change":"2023-12-08T08:21:17.673958+0000","last_active":"2023-12-08T08:21:17.676342+0000","last_peered":"2023-12-08T08:21:17.676342+0000","last_clean":"2023-12-08T08:21:17.676342+0000","last_became_active":"2023-12-08T08:21:17.673637+0000","last_became_peered":"2023-12-08T08:21:17.673637+0000","last_unstale":"2023-12-08T08:21:17.676342+0000","last_undegraded":"2023-12-08T08:21:17.676342+0000","last_fullsized":"2023-12-08T08:21:17.676342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:54.148326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659996+0000","last_change":"2023-12-08T08:21:17.659996+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659996+0000","last_undegraded":"2023-12-08T08:21:17.659996+0000","last_fullsized":"2023-12-08T08:21:17.659996+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654170+0000","last_change":"2023-12-08T08:21:04.768985+0000","last_active":"2023-12-08T08:21:16.654170+0000","last_peered":"2023-12-08T08:21:16.654170+0000","last_clean":"2023-12-08T08:21:16.654170+0000","last_became_active":"2023-12-08T08:21:04.768693+0000","last_became_peered":"2023-12-08T08:21:04.768693+0000","last_unstale":"2023-12-08T08:21:16.654170+0000","last_undegraded":"2023-12-08T08:21:16.654170+0000","last_fullsized":"2023-12-08T08:21:16.654170+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:29.810210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649619+0000","last_change":"2023-12-08T08:21:05.542434+0000","last_active":"2023-12-08T08:21:16.649619+0000","last_peered":"2023-12-08T08:21:16.649619+0000","last_clean":"2023-12-08T08:21:16.649619+0000","last_became_active":"2023-12-08T08:21:05.542218+0000","last_became_peered":"2023-12-08T08:21:05.542218+0000","last_unstale":"2023-12-08T08:21:16.649619+0000","last_undegraded":"2023-12-08T08:21:16.649619+0000","last_fullsized":"2023-12-08T08:21:16.649619+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:16:19.580755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.674800+0000","last_change":"2023-12-08T08:21:17.668067+0000","last_active":"2023-12-08T08:21:17.674800+0000","last_peered":"2023-12-08T08:21:17.674800+0000","last_clean":"2023-12-08T08:21:17.674800+0000","last_became_active":"2023-12-08T08:21:17.667751+0000","last_became_peered":"2023-12-08T08:21:17.667751+0000","last_unstale":"2023-12-08T08:21:17.674800+0000","last_undegraded":"2023-12-08T08:21:17.674800+0000","last_fullsized":"2023-12-08T08:21:17.674800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:25.581863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.657341+0000","last_change":"2023-12-08T08:21:17.657341+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.657341+0000","last_undegraded":"2023-12-08T08:21:17.657341+0000","last_fullsized":"2023-12-08T08:21:17.657341+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648875+0000","last_change":"2023-12-08T08:21:04.775274+0000","last_active":"2023-12-08T08:21:16.648875+0000","last_peered":"2023-12-08T08:21:16.648875+0000","last_clean":"2023-12-08T08:21:16.648875+0000","last_became_active":"2023-12-08T08:21:04.774961+0000","last_became_peered":"2023-12-08T08:21:04.774961+0000","last_unstale":"2023-12-08T08:21:16.648875+0000","last_undegraded":"2023-12-08T08:21:16.648875+0000","last_fullsized":"2023-12-08T08:21:16.648875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:03.400233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652649+0000","last_change":"2023-12-08T08:21:05.534904+0000","last_active":"2023-12-08T08:21:16.652649+0000","last_peered":"2023-12-08T08:21:16.652649+0000","last_clean":"2023-12-08T08:21:16.652649+0000","last_became_active":"2023-12-08T08:21:05.534637+0000","last_became_peered":"2023-12-08T08:21:05.534637+0000","last_unstale":"2023-12-08T08:21:16.652649+0000","last_undegraded":"2023-12-08T08:21:16.652649+0000","last_fullsized":"2023-12-08T08:21:16.652649+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:40:41.034391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686389+0000","last_change":"2023-12-08T08:21:17.682559+0000","last_active":"2023-12-08T08:21:17.686389+0000","last_peered":"2023-12-08T08:21:17.686389+0000","last_clean":"2023-12-08T08:21:17.686389+0000","last_became_active":"2023-12-08T08:21:17.675578+0000","last_became_peered":"2023-12-08T08:21:17.675578+0000","last_unstale":"2023-12-08T08:21:17.686389+0000","last_undegraded":"2023-12-08T08:21:17.686389+0000","last_fullsized":"2023-12-08T08:21:17.686389+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:46:01.671872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.658216+0000","last_change":"2023-12-08T08:21:17.658216+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.658216+0000","last_undegraded":"2023-12-08T08:21:17.658216+0000","last_fullsized":"2023-12-08T08:21:17.658216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649140+0000","last_change":"2023-12-08T08:21:04.770820+0000","last_active":"2023-12-08T08:21:16.649140+0000","last_peered":"2023-12-08T08:21:16.649140+0000","last_clean":"2023-12-08T08:21:16.649140+0000","last_became_active":"2023-12-08T08:21:04.767804+0000","last_became_peered":"2023-12-08T08:21:04.767804+0000","last_unstale":"2023-12-08T08:21:16.649140+0000","last_undegraded":"2023-12-08T08:21:16.649140+0000","last_fullsized":"2023-12-08T08:21:16.649140+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:58:22.885070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651163+0000","last_change":"2023-12-08T08:21:05.521567+0000","last_active":"2023-12-08T08:21:16.651163+0000","last_peered":"2023-12-08T08:21:16.651163+0000","last_clean":"2023-12-08T08:21:16.651163+0000","last_became_active":"2023-12-08T08:21:05.521289+0000","last_became_peered":"2023-12-08T08:21:05.521289+0000","last_unstale":"2023-12-08T08:21:16.651163+0000","last_undegraded":"2023-12-08T08:21:16.651163+0000","last_fullsized":"2023-12-08T08:21:16.651163+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:11.477913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.689245+0000","last_change":"2023-12-08T08:21:17.683937+0000","last_active":"2023-12-08T08:21:17.689245+0000","last_peered":"2023-12-08T08:21:17.689245+0000","last_clean":"2023-12-08T08:21:17.689245+0000","last_became_active":"2023-12-08T08:21:17.683574+0000","last_became_peered":"2023-12-08T08:21:17.683574+0000","last_unstale":"2023-12-08T08:21:17.689245+0000","last_undegraded":"2023-12-08T08:21:17.689245+0000","last_fullsized":"2023-12-08T08:21:17.689245+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:58:35.777720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.662363+0000","last_change":"2023-12-08T08:21:17.662363+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.662363+0000","last_undegraded":"2023-12-08T08:21:17.662363+0000","last_fullsized":"2023-12-08T08:21:17.662363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649148+0000","last_change":"2023-12-08T08:21:04.776652+0000","last_active":"2023-12-08T08:21:16.649148+0000","last_peered":"2023-12-08T08:21:16.649148+0000","last_clean":"2023-12-08T08:21:16.649148+0000","last_became_active":"2023-12-08T08:21:04.776345+0000","last_became_peered":"2023-12-08T08:21:04.776345+0000","last_unstale":"2023-12-08T08:21:16.649148+0000","last_undegraded":"2023-12-08T08:21:16.649148+0000","last_fullsized":"2023-12-08T08:21:16.649148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:46.416448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.656832+0000","last_change":"2023-12-08T08:21:05.538159+0000","last_active":"2023-12-08T08:21:16.656832+0000","last_peered":"2023-12-08T08:21:16.656832+0000","last_clean":"2023-12-08T08:21:16.656832+0000","last_became_active":"2023-12-08T08:21:05.537601+0000","last_became_peered":"2023-12-08T08:21:05.537601+0000","last_unstale":"2023-12-08T08:21:16.656832+0000","last_undegraded":"2023-12-08T08:21:16.656832+0000","last_fullsized":"2023-12-08T08:21:16.656832+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:09:56.356105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.680296+0000","last_change":"2023-12-08T08:21:17.675955+0000","last_active":"2023-12-08T08:21:17.680296+0000","last_peered":"2023-12-08T08:21:17.680296+0000","last_clean":"2023-12-08T08:21:17.680296+0000","last_became_active":"2023-12-08T08:21:17.675547+0000","last_became_peered":"2023-12-08T08:21:17.675547+0000","last_unstale":"2023-12-08T08:21:17.680296+0000","last_undegraded":"2023-12-08T08:21:17.680296+0000","last_fullsized":"2023-12-08T08:21:17.680296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:59.826879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.662129+0000","last_change":"2023-12-08T08:21:17.662129+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.662129+0000","last_undegraded":"2023-12-08T08:21:17.662129+0000","last_fullsized":"2023-12-08T08:21:17.662129+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651983+0000","last_change":"2023-12-08T08:21:04.785414+0000","last_active":"2023-12-08T08:21:16.651983+0000","last_peered":"2023-12-08T08:21:16.651983+0000","last_clean":"2023-12-08T08:21:16.651983+0000","last_became_active":"2023-12-08T08:21:04.785198+0000","last_became_peered":"2023-12-08T08:21:04.785198+0000","last_unstale":"2023-12-08T08:21:16.651983+0000","last_undegraded":"2023-12-08T08:21:16.651983+0000","last_fullsized":"2023-12-08T08:21:16.651983+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:03.400233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649085+0000","last_change":"2023-12-08T08:21:05.537706+0000","last_active":"2023-12-08T08:21:16.649085+0000","last_peered":"2023-12-08T08:21:16.649085+0000","last_clean":"2023-12-08T08:21:16.649085+0000","last_became_active":"2023-12-08T08:21:05.537282+0000","last_became_peered":"2023-12-08T08:21:05.537282+0000","last_unstale":"2023-12-08T08:21:16.649085+0000","last_undegraded":"2023-12-08T08:21:16.649085+0000","last_fullsized":"2023-12-08T08:21:16.649085+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:13.692096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.687157+0000","last_change":"2023-12-08T08:21:17.685511+0000","last_active":"2023-12-08T08:21:17.687157+0000","last_peered":"2023-12-08T08:21:17.687157+0000","last_clean":"2023-12-08T08:21:17.687157+0000","last_became_active":"2023-12-08T08:21:17.685173+0000","last_became_peered":"2023-12-08T08:21:17.685173+0000","last_unstale":"2023-12-08T08:21:17.687157+0000","last_undegraded":"2023-12-08T08:21:17.687157+0000","last_fullsized":"2023-12-08T08:21:17.687157+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:55:55.550300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.658627+0000","last_change":"2023-12-08T08:21:17.658627+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.658627+0000","last_undegraded":"2023-12-08T08:21:17.658627+0000","last_fullsized":"2023-12-08T08:21:17.658627+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643854+0000","last_change":"2023-12-08T08:21:04.775742+0000","last_active":"2023-12-08T08:21:16.643854+0000","last_peered":"2023-12-08T08:21:16.643854+0000","last_clean":"2023-12-08T08:21:16.643854+0000","last_became_active":"2023-12-08T08:21:04.775482+0000","last_became_peered":"2023-12-08T08:21:04.775482+0000","last_unstale":"2023-12-08T08:21:16.643854+0000","last_undegraded":"2023-12-08T08:21:16.643854+0000","last_fullsized":"2023-12-08T08:21:16.643854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:46.416448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.650561+0000","last_change":"2023-12-08T08:21:05.528065+0000","last_active":"2023-12-08T08:21:16.650561+0000","last_peered":"2023-12-08T08:21:16.650561+0000","last_clean":"2023-12-08T08:21:16.650561+0000","last_became_active":"2023-12-08T08:21:05.527792+0000","last_became_peered":"2023-12-08T08:21:05.527792+0000","last_unstale":"2023-12-08T08:21:16.650561+0000","last_undegraded":"2023-12-08T08:21:16.650561+0000","last_fullsized":"2023-12-08T08:21:16.650561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:51:06.333206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.683125+0000","last_change":"2023-12-08T08:21:17.677690+0000","last_active":"2023-12-08T08:21:17.683125+0000","last_peered":"2023-12-08T08:21:17.683125+0000","last_clean":"2023-12-08T08:21:17.683125+0000","last_became_active":"2023-12-08T08:21:17.677376+0000","last_became_peered":"2023-12-08T08:21:17.677376+0000","last_unstale":"2023-12-08T08:21:17.683125+0000","last_undegraded":"2023-12-08T08:21:17.683125+0000","last_fullsized":"2023-12-08T08:21:17.683125+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:55:55.550300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661062+0000","last_change":"2023-12-08T08:21:17.661062+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661062+0000","last_undegraded":"2023-12-08T08:21:17.661062+0000","last_fullsized":"2023-12-08T08:21:17.661062+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643764+0000","last_change":"2023-12-08T08:21:04.781520+0000","last_active":"2023-12-08T08:21:16.643764+0000","last_peered":"2023-12-08T08:21:16.643764+0000","last_clean":"2023-12-08T08:21:16.643764+0000","last_became_active":"2023-12-08T08:21:04.781236+0000","last_became_peered":"2023-12-08T08:21:04.781236+0000","last_unstale":"2023-12-08T08:21:16.643764+0000","last_undegraded":"2023-12-08T08:21:16.643764+0000","last_fullsized":"2023-12-08T08:21:16.643764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:14:17.281881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.653811+0000","last_change":"2023-12-08T08:21:05.544369+0000","last_active":"2023-12-08T08:21:16.653811+0000","last_peered":"2023-12-08T08:21:16.653811+0000","last_clean":"2023-12-08T08:21:16.653811+0000","last_became_active":"2023-12-08T08:21:05.544090+0000","last_became_peered":"2023-12-08T08:21:05.544090+0000","last_unstale":"2023-12-08T08:21:16.653811+0000","last_undegraded":"2023-12-08T08:21:16.653811+0000","last_fullsized":"2023-12-08T08:21:16.653811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:25.239396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.685476+0000","last_change":"2023-12-08T08:21:17.681233+0000","last_active":"2023-12-08T08:21:17.685476+0000","last_peered":"2023-12-08T08:21:17.685476+0000","last_clean":"2023-12-08T08:21:17.685476+0000","last_became_active":"2023-12-08T08:21:17.680645+0000","last_became_peered":"2023-12-08T08:21:17.680645+0000","last_unstale":"2023-12-08T08:21:17.685476+0000","last_undegraded":"2023-12-08T08:21:17.685476+0000","last_fullsized":"2023-12-08T08:21:17.685476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:50:42.502393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661129+0000","last_change":"2023-12-08T08:21:17.661129+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661129+0000","last_undegraded":"2023-12-08T08:21:17.661129+0000","last_fullsized":"2023-12-08T08:21:17.661129+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652680+0000","last_change":"2023-12-08T08:21:04.778563+0000","last_active":"2023-12-08T08:21:16.652680+0000","last_peered":"2023-12-08T08:21:16.652680+0000","last_clean":"2023-12-08T08:21:16.652680+0000","last_became_active":"2023-12-08T08:21:04.778275+0000","last_became_peered":"2023-12-08T08:21:04.778275+0000","last_unstale":"2023-12-08T08:21:16.652680+0000","last_undegraded":"2023-12-08T08:21:16.652680+0000","last_fullsized":"2023-12-08T08:21:16.652680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:45:05.142948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644069+0000","last_change":"2023-12-08T08:21:05.528470+0000","last_active":"2023-12-08T08:21:16.644069+0000","last_peered":"2023-12-08T08:21:16.644069+0000","last_clean":"2023-12-08T08:21:16.644069+0000","last_became_active":"2023-12-08T08:21:05.528125+0000","last_became_peered":"2023-12-08T08:21:05.528125+0000","last_unstale":"2023-12-08T08:21:16.644069+0000","last_undegraded":"2023-12-08T08:21:16.644069+0000","last_fullsized":"2023-12-08T08:21:16.644069+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.368162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.675089+0000","last_change":"2023-12-08T08:21:17.670281+0000","last_active":"2023-12-08T08:21:17.675089+0000","last_peered":"2023-12-08T08:21:17.675089+0000","last_clean":"2023-12-08T08:21:17.675089+0000","last_became_active":"2023-12-08T08:21:17.670085+0000","last_became_peered":"2023-12-08T08:21:17.670085+0000","last_unstale":"2023-12-08T08:21:17.675089+0000","last_undegraded":"2023-12-08T08:21:17.675089+0000","last_fullsized":"2023-12-08T08:21:17.675089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:20.486293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.667977+0000","last_change":"2023-12-08T08:21:17.667977+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.667977+0000","last_undegraded":"2023-12-08T08:21:17.667977+0000","last_fullsized":"2023-12-08T08:21:17.667977+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648818+0000","last_change":"2023-12-08T08:21:04.773643+0000","last_active":"2023-12-08T08:21:16.648818+0000","last_peered":"2023-12-08T08:21:16.648818+0000","last_clean":"2023-12-08T08:21:16.648818+0000","last_became_active":"2023-12-08T08:21:04.773361+0000","last_became_peered":"2023-12-08T08:21:04.773361+0000","last_unstale":"2023-12-08T08:21:16.648818+0000","last_undegraded":"2023-12-08T08:21:16.648818+0000","last_fullsized":"2023-12-08T08:21:16.648818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:08.017533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652611+0000","last_change":"2023-12-08T08:21:05.543017+0000","last_active":"2023-12-08T08:21:16.652611+0000","last_peered":"2023-12-08T08:21:16.652611+0000","last_clean":"2023-12-08T08:21:16.652611+0000","last_became_active":"2023-12-08T08:21:05.542729+0000","last_became_peered":"2023-12-08T08:21:05.542729+0000","last_unstale":"2023-12-08T08:21:16.652611+0000","last_undegraded":"2023-12-08T08:21:16.652611+0000","last_fullsized":"2023-12-08T08:21:16.652611+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:19.928543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.680377+0000","last_change":"2023-12-08T08:21:17.672426+0000","last_active":"2023-12-08T08:21:17.680377+0000","last_peered":"2023-12-08T08:21:17.680377+0000","last_clean":"2023-12-08T08:21:17.680377+0000","last_became_active":"2023-12-08T08:21:17.672079+0000","last_became_peered":"2023-12-08T08:21:17.672079+0000","last_unstale":"2023-12-08T08:21:17.680377+0000","last_undegraded":"2023-12-08T08:21:17.680377+0000","last_fullsized":"2023-12-08T08:21:17.680377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:11:38.595950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.660226+0000","last_change":"2023-12-08T08:21:17.660226+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.660226+0000","last_undegraded":"2023-12-08T08:21:17.660226+0000","last_fullsized":"2023-12-08T08:21:17.660226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"31'8","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644372+0000","last_change":"2023-12-08T08:21:04.778814+0000","last_active":"2023-12-08T08:21:16.644372+0000","last_peered":"2023-12-08T08:21:16.644372+0000","last_clean":"2023-12-08T08:21:16.644372+0000","last_became_active":"2023-12-08T08:21:04.778501+0000","last_became_peered":"2023-12-08T08:21:04.778501+0000","last_unstale":"2023-12-08T08:21:16.644372+0000","last_undegraded":"2023-12-08T08:21:16.644372+0000","last_fullsized":"2023-12-08T08:21:16.644372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:50:52.651732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655964+0000","last_change":"2023-12-08T08:21:05.540670+0000","last_active":"2023-12-08T08:21:16.655964+0000","last_peered":"2023-12-08T08:21:16.655964+0000","last_clean":"2023-12-08T08:21:16.655964+0000","last_became_active":"2023-12-08T08:21:05.539546+0000","last_became_peered":"2023-12-08T08:21:05.539546+0000","last_unstale":"2023-12-08T08:21:16.655964+0000","last_undegraded":"2023-12-08T08:21:16.655964+0000","last_fullsized":"2023-12-08T08:21:16.655964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:20:39.875619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.678590+0000","last_change":"2023-12-08T08:21:17.668240+0000","last_active":"2023-12-08T08:21:17.678590+0000","last_peered":"2023-12-08T08:21:17.678590+0000","last_clean":"2023-12-08T08:21:17.678590+0000","last_became_active":"2023-12-08T08:21:17.667990+0000","last_became_peered":"2023-12-08T08:21:17.667990+0000","last_unstale":"2023-12-08T08:21:17.678590+0000","last_undegraded":"2023-12-08T08:21:17.678590+0000","last_fullsized":"2023-12-08T08:21:17.678590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:54.911358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.656815+0000","last_change":"2023-12-08T08:21:17.656815+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.656815+0000","last_undegraded":"2023-12-08T08:21:17.656815+0000","last_fullsized":"2023-12-08T08:21:17.656815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.656147+0000","last_change":"2023-12-08T08:21:04.782195+0000","last_active":"2023-12-08T08:21:16.656147+0000","last_peered":"2023-12-08T08:21:16.656147+0000","last_clean":"2023-12-08T08:21:16.656147+0000","last_became_active":"2023-12-08T08:21:04.781298+0000","last_became_peered":"2023-12-08T08:21:04.781298+0000","last_unstale":"2023-12-08T08:21:16.656147+0000","last_undegraded":"2023-12-08T08:21:16.656147+0000","last_fullsized":"2023-12-08T08:21:16.656147+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:12.689213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644226+0000","last_change":"2023-12-08T08:21:05.532372+0000","last_active":"2023-12-08T08:21:16.644226+0000","last_peered":"2023-12-08T08:21:16.644226+0000","last_clean":"2023-12-08T08:21:16.644226+0000","last_became_active":"2023-12-08T08:21:05.531767+0000","last_became_peered":"2023-12-08T08:21:05.531767+0000","last_unstale":"2023-12-08T08:21:16.644226+0000","last_undegraded":"2023-12-08T08:21:16.644226+0000","last_fullsized":"2023-12-08T08:21:16.644226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:30.973295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686218+0000","last_change":"2023-12-08T08:21:17.682631+0000","last_active":"2023-12-08T08:21:17.686218+0000","last_peered":"2023-12-08T08:21:17.686218+0000","last_clean":"2023-12-08T08:21:17.686218+0000","last_became_active":"2023-12-08T08:21:17.677727+0000","last_became_peered":"2023-12-08T08:21:17.677727+0000","last_unstale":"2023-12-08T08:21:17.686218+0000","last_undegraded":"2023-12-08T08:21:17.686218+0000","last_fullsized":"2023-12-08T08:21:17.686218+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:10:08.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661135+0000","last_change":"2023-12-08T08:21:17.661135+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661135+0000","last_undegraded":"2023-12-08T08:21:17.661135+0000","last_fullsized":"2023-12-08T08:21:17.661135+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654331+0000","last_change":"2023-12-08T08:21:04.786064+0000","last_active":"2023-12-08T08:21:16.654331+0000","last_peered":"2023-12-08T08:21:16.654331+0000","last_clean":"2023-12-08T08:21:16.654331+0000","last_became_active":"2023-12-08T08:21:04.785859+0000","last_became_peered":"2023-12-08T08:21:04.785859+0000","last_unstale":"2023-12-08T08:21:16.654331+0000","last_undegraded":"2023-12-08T08:21:16.654331+0000","last_fullsized":"2023-12-08T08:21:16.654331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:12.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644317+0000","last_change":"2023-12-08T08:21:05.532644+0000","last_active":"2023-12-08T08:21:16.644317+0000","last_peered":"2023-12-08T08:21:16.644317+0000","last_clean":"2023-12-08T08:21:16.644317+0000","last_became_active":"2023-12-08T08:21:05.530404+0000","last_became_peered":"2023-12-08T08:21:05.530404+0000","last_unstale":"2023-12-08T08:21:16.644317+0000","last_undegraded":"2023-12-08T08:21:16.644317+0000","last_fullsized":"2023-12-08T08:21:16.644317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:05:11.193024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.684441+0000","last_change":"2023-12-08T08:21:17.677740+0000","last_active":"2023-12-08T08:21:17.684441+0000","last_peered":"2023-12-08T08:21:17.684441+0000","last_clean":"2023-12-08T08:21:17.684441+0000","last_became_active":"2023-12-08T08:21:17.672121+0000","last_became_peered":"2023-12-08T08:21:17.672121+0000","last_unstale":"2023-12-08T08:21:17.684441+0000","last_undegraded":"2023-12-08T08:21:17.684441+0000","last_fullsized":"2023-12-08T08:21:17.684441+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:20.910184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.664339+0000","last_change":"2023-12-08T08:21:17.664339+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.664339+0000","last_undegraded":"2023-12-08T08:21:17.664339+0000","last_fullsized":"2023-12-08T08:21:17.664339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644467+0000","last_change":"2023-12-08T08:21:04.782800+0000","last_active":"2023-12-08T08:21:16.644467+0000","last_peered":"2023-12-08T08:21:16.644467+0000","last_clean":"2023-12-08T08:21:16.644467+0000","last_became_active":"2023-12-08T08:21:04.782531+0000","last_became_peered":"2023-12-08T08:21:04.782531+0000","last_unstale":"2023-12-08T08:21:16.644467+0000","last_undegraded":"2023-12-08T08:21:16.644467+0000","last_fullsized":"2023-12-08T08:21:16.644467+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:42.018708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.656002+0000","last_change":"2023-12-08T08:21:05.533947+0000","last_active":"2023-12-08T08:21:16.656002+0000","last_peered":"2023-12-08T08:21:16.656002+0000","last_clean":"2023-12-08T08:21:16.656002+0000","last_became_active":"2023-12-08T08:21:05.533554+0000","last_became_peered":"2023-12-08T08:21:05.533554+0000","last_unstale":"2023-12-08T08:21:16.656002+0000","last_undegraded":"2023-12-08T08:21:16.656002+0000","last_fullsized":"2023-12-08T08:21:16.656002+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:25.239396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.685462+0000","last_change":"2023-12-08T08:21:17.679519+0000","last_active":"2023-12-08T08:21:17.685462+0000","last_peered":"2023-12-08T08:21:17.685462+0000","last_clean":"2023-12-08T08:21:17.685462+0000","last_became_active":"2023-12-08T08:21:17.679265+0000","last_became_peered":"2023-12-08T08:21:17.679265+0000","last_unstale":"2023-12-08T08:21:17.685462+0000","last_undegraded":"2023-12-08T08:21:17.685462+0000","last_fullsized":"2023-12-08T08:21:17.685462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:12.057342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659167+0000","last_change":"2023-12-08T08:21:17.659167+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659167+0000","last_undegraded":"2023-12-08T08:21:17.659167+0000","last_fullsized":"2023-12-08T08:21:17.659167+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648603+0000","last_change":"2023-12-08T08:21:04.776553+0000","last_active":"2023-12-08T08:21:16.648603+0000","last_peered":"2023-12-08T08:21:16.648603+0000","last_clean":"2023-12-08T08:21:16.648603+0000","last_became_active":"2023-12-08T08:21:04.773755+0000","last_became_peered":"2023-12-08T08:21:04.773755+0000","last_unstale":"2023-12-08T08:21:16.648603+0000","last_undegraded":"2023-12-08T08:21:16.648603+0000","last_fullsized":"2023-12-08T08:21:16.648603+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:12.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651140+0000","last_change":"2023-12-08T08:21:05.536397+0000","last_active":"2023-12-08T08:21:16.651140+0000","last_peered":"2023-12-08T08:21:16.651140+0000","last_clean":"2023-12-08T08:21:16.651140+0000","last_became_active":"2023-12-08T08:21:05.536103+0000","last_became_peered":"2023-12-08T08:21:05.536103+0000","last_unstale":"2023-12-08T08:21:16.651140+0000","last_undegraded":"2023-12-08T08:21:16.651140+0000","last_fullsized":"2023-12-08T08:21:16.651140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:44.030312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.674675+0000","last_change":"2023-12-08T08:21:17.671190+0000","last_active":"2023-12-08T08:21:17.674675+0000","last_peered":"2023-12-08T08:21:17.674675+0000","last_clean":"2023-12-08T08:21:17.674675+0000","last_became_active":"2023-12-08T08:21:17.670895+0000","last_became_peered":"2023-12-08T08:21:17.670895+0000","last_unstale":"2023-12-08T08:21:17.674675+0000","last_undegraded":"2023-12-08T08:21:17.674675+0000","last_fullsized":"2023-12-08T08:21:17.674675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:42.863062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.655881+0000","last_change":"2023-12-08T08:21:17.655881+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.655881+0000","last_undegraded":"2023-12-08T08:21:17.655881+0000","last_fullsized":"2023-12-08T08:21:17.655881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643850+0000","last_change":"2023-12-08T08:21:04.780723+0000","last_active":"2023-12-08T08:21:16.643850+0000","last_peered":"2023-12-08T08:21:16.643850+0000","last_clean":"2023-12-08T08:21:16.643850+0000","last_became_active":"2023-12-08T08:21:04.780436+0000","last_became_peered":"2023-12-08T08:21:04.780436+0000","last_unstale":"2023-12-08T08:21:16.643850+0000","last_undegraded":"2023-12-08T08:21:16.643850+0000","last_fullsized":"2023-12-08T08:21:16.643850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:12.689213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648504+0000","last_change":"2023-12-08T08:21:05.535708+0000","last_active":"2023-12-08T08:21:16.648504+0000","last_peered":"2023-12-08T08:21:16.648504+0000","last_clean":"2023-12-08T08:21:16.648504+0000","last_became_active":"2023-12-08T08:21:05.527959+0000","last_became_peered":"2023-12-08T08:21:05.527959+0000","last_unstale":"2023-12-08T08:21:16.648504+0000","last_undegraded":"2023-12-08T08:21:16.648504+0000","last_fullsized":"2023-12-08T08:21:16.648504+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:14:18.284764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.685488+0000","last_change":"2023-12-08T08:21:17.681447+0000","last_active":"2023-12-08T08:21:17.685488+0000","last_peered":"2023-12-08T08:21:17.685488+0000","last_clean":"2023-12-08T08:21:17.685488+0000","last_became_active":"2023-12-08T08:21:17.680989+0000","last_became_peered":"2023-12-08T08:21:17.680989+0000","last_unstale":"2023-12-08T08:21:17.685488+0000","last_undegraded":"2023-12-08T08:21:17.685488+0000","last_fullsized":"2023-12-08T08:21:17.685488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:24.695194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661815+0000","last_change":"2023-12-08T08:21:17.661815+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661815+0000","last_undegraded":"2023-12-08T08:21:17.661815+0000","last_fullsized":"2023-12-08T08:21:17.661815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649335+0000","last_change":"2023-12-08T08:21:04.783596+0000","last_active":"2023-12-08T08:21:16.649335+0000","last_peered":"2023-12-08T08:21:16.649335+0000","last_clean":"2023-12-08T08:21:16.649335+0000","last_became_active":"2023-12-08T08:21:04.783159+0000","last_became_peered":"2023-12-08T08:21:04.783159+0000","last_unstale":"2023-12-08T08:21:16.649335+0000","last_undegraded":"2023-12-08T08:21:16.649335+0000","last_fullsized":"2023-12-08T08:21:16.649335+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:43.027429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655533+0000","last_change":"2023-12-08T08:21:05.537414+0000","last_active":"2023-12-08T08:21:16.655533+0000","last_peered":"2023-12-08T08:21:16.655533+0000","last_clean":"2023-12-08T08:21:16.655533+0000","last_became_active":"2023-12-08T08:21:05.537137+0000","last_became_peered":"2023-12-08T08:21:05.537137+0000","last_unstale":"2023-12-08T08:21:16.655533+0000","last_undegraded":"2023-12-08T08:21:16.655533+0000","last_fullsized":"2023-12-08T08:21:16.655533+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:08.596525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.677172+0000","last_change":"2023-12-08T08:21:17.676027+0000","last_active":"2023-12-08T08:21:17.677172+0000","last_peered":"2023-12-08T08:21:17.677172+0000","last_clean":"2023-12-08T08:21:17.677172+0000","last_became_active":"2023-12-08T08:21:17.675823+0000","last_became_peered":"2023-12-08T08:21:17.675823+0000","last_unstale":"2023-12-08T08:21:17.677172+0000","last_undegraded":"2023-12-08T08:21:17.677172+0000","last_fullsized":"2023-12-08T08:21:17.677172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:14:30.174532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.656636+0000","last_change":"2023-12-08T08:21:17.656636+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.656636+0000","last_undegraded":"2023-12-08T08:21:17.656636+0000","last_fullsized":"2023-12-08T08:21:17.656636+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648820+0000","last_change":"2023-12-08T08:21:04.784944+0000","last_active":"2023-12-08T08:21:16.648820+0000","last_peered":"2023-12-08T08:21:16.648820+0000","last_clean":"2023-12-08T08:21:16.648820+0000","last_became_active":"2023-12-08T08:21:04.784657+0000","last_became_peered":"2023-12-08T08:21:04.784657+0000","last_unstale":"2023-12-08T08:21:16.648820+0000","last_undegraded":"2023-12-08T08:21:16.648820+0000","last_fullsized":"2023-12-08T08:21:16.648820+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:51:05.330323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654537+0000","last_change":"2023-12-08T08:21:05.542808+0000","last_active":"2023-12-08T08:21:16.654537+0000","last_peered":"2023-12-08T08:21:16.654537+0000","last_clean":"2023-12-08T08:21:16.654537+0000","last_became_active":"2023-12-08T08:21:05.542495+0000","last_became_peered":"2023-12-08T08:21:05.542495+0000","last_unstale":"2023-12-08T08:21:16.654537+0000","last_undegraded":"2023-12-08T08:21:16.654537+0000","last_fullsized":"2023-12-08T08:21:16.654537+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:50:53.654615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.684879+0000","last_change":"2023-12-08T08:21:17.681699+0000","last_active":"2023-12-08T08:21:17.684879+0000","last_peered":"2023-12-08T08:21:17.684879+0000","last_clean":"2023-12-08T08:21:17.684879+0000","last_became_active":"2023-12-08T08:21:17.681356+0000","last_became_peered":"2023-12-08T08:21:17.681356+0000","last_unstale":"2023-12-08T08:21:17.684879+0000","last_undegraded":"2023-12-08T08:21:17.684879+0000","last_fullsized":"2023-12-08T08:21:17.684879+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:31:02.865086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.664497+0000","last_change":"2023-12-08T08:21:17.664497+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.664497+0000","last_undegraded":"2023-12-08T08:21:17.664497+0000","last_fullsized":"2023-12-08T08:21:17.664497+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.682731+0000","last_change":"2023-12-08T08:21:17.674547+0000","last_active":"2023-12-08T08:21:17.682731+0000","last_peered":"2023-12-08T08:21:17.682731+0000","last_clean":"2023-12-08T08:21:17.682731+0000","last_became_active":"2023-12-08T08:21:17.674313+0000","last_became_peered":"2023-12-08T08:21:17.674313+0000","last_unstale":"2023-12-08T08:21:17.682731+0000","last_undegraded":"2023-12-08T08:21:17.682731+0000","last_fullsized":"2023-12-08T08:21:17.682731+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:17.857771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652533+0000","last_change":"2023-12-08T08:21:04.773475+0000","last_active":"2023-12-08T08:21:16.652533+0000","last_peered":"2023-12-08T08:21:16.652533+0000","last_clean":"2023-12-08T08:21:16.652533+0000","last_became_active":"2023-12-08T08:21:04.773125+0000","last_became_peered":"2023-12-08T08:21:04.773125+0000","last_unstale":"2023-12-08T08:21:16.652533+0000","last_undegraded":"2023-12-08T08:21:16.652533+0000","last_fullsized":"2023-12-08T08:21:16.652533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:00:34.107681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652344+0000","last_change":"2023-12-08T08:21:05.527749+0000","last_active":"2023-12-08T08:21:16.652344+0000","last_peered":"2023-12-08T08:21:16.652344+0000","last_clean":"2023-12-08T08:21:16.652344+0000","last_became_active":"2023-12-08T08:21:05.527397+0000","last_became_peered":"2023-12-08T08:21:05.527397+0000","last_unstale":"2023-12-08T08:21:16.652344+0000","last_undegraded":"2023-12-08T08:21:16.652344+0000","last_fullsized":"2023-12-08T08:21:16.652344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:13.692096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.662777+0000","last_change":"2023-12-08T08:21:17.662777+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.662777+0000","last_undegraded":"2023-12-08T08:21:17.662777+0000","last_fullsized":"2023-12-08T08:21:17.662777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686471+0000","last_change":"2023-12-08T08:21:17.682288+0000","last_active":"2023-12-08T08:21:17.686471+0000","last_peered":"2023-12-08T08:21:17.686471+0000","last_clean":"2023-12-08T08:21:17.686471+0000","last_became_active":"2023-12-08T08:21:17.680967+0000","last_became_peered":"2023-12-08T08:21:17.680967+0000","last_unstale":"2023-12-08T08:21:17.686471+0000","last_undegraded":"2023-12-08T08:21:17.686471+0000","last_fullsized":"2023-12-08T08:21:17.686471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:02:38.255209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644131+0000","last_change":"2023-12-08T08:21:04.778223+0000","last_active":"2023-12-08T08:21:16.644131+0000","last_peered":"2023-12-08T08:21:16.644131+0000","last_clean":"2023-12-08T08:21:16.644131+0000","last_became_active":"2023-12-08T08:21:04.777902+0000","last_became_peered":"2023-12-08T08:21:04.777902+0000","last_unstale":"2023-12-08T08:21:16.644131+0000","last_undegraded":"2023-12-08T08:21:16.644131+0000","last_fullsized":"2023-12-08T08:21:16.644131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:07.593642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649143+0000","last_change":"2023-12-08T08:21:05.532257+0000","last_active":"2023-12-08T08:21:16.649143+0000","last_peered":"2023-12-08T08:21:16.649143+0000","last_clean":"2023-12-08T08:21:16.649143+0000","last_became_active":"2023-12-08T08:21:05.531965+0000","last_became_peered":"2023-12-08T08:21:05.531965+0000","last_unstale":"2023-12-08T08:21:16.649143+0000","last_undegraded":"2023-12-08T08:21:16.649143+0000","last_fullsized":"2023-12-08T08:21:16.649143+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:23.756612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.660842+0000","last_change":"2023-12-08T08:21:17.660842+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.660842+0000","last_undegraded":"2023-12-08T08:21:17.660842+0000","last_fullsized":"2023-12-08T08:21:17.660842+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654313+0000","last_change":"2023-12-08T08:21:04.780684+0000","last_active":"2023-12-08T08:21:16.654313+0000","last_peered":"2023-12-08T08:21:16.654313+0000","last_clean":"2023-12-08T08:21:16.654313+0000","last_became_active":"2023-12-08T08:21:04.780321+0000","last_became_peered":"2023-12-08T08:21:04.780321+0000","last_unstale":"2023-12-08T08:21:16.654313+0000","last_undegraded":"2023-12-08T08:21:16.654313+0000","last_fullsized":"2023-12-08T08:21:16.654313+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:13.006406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652155+0000","last_change":"2023-12-08T08:21:05.531374+0000","last_active":"2023-12-08T08:21:16.652155+0000","last_peered":"2023-12-08T08:21:16.652155+0000","last_clean":"2023-12-08T08:21:16.652155+0000","last_became_active":"2023-12-08T08:21:05.531104+0000","last_became_peered":"2023-12-08T08:21:05.531104+0000","last_unstale":"2023-12-08T08:21:16.652155+0000","last_undegraded":"2023-12-08T08:21:16.652155+0000","last_fullsized":"2023-12-08T08:21:16.652155+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:04.403116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686260+0000","last_change":"2023-12-08T08:21:17.684363+0000","last_active":"2023-12-08T08:21:17.686260+0000","last_peered":"2023-12-08T08:21:17.686260+0000","last_clean":"2023-12-08T08:21:17.686260+0000","last_became_active":"2023-12-08T08:21:17.683896+0000","last_became_peered":"2023-12-08T08:21:17.683896+0000","last_unstale":"2023-12-08T08:21:17.686260+0000","last_undegraded":"2023-12-08T08:21:17.686260+0000","last_fullsized":"2023-12-08T08:21:17.686260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:31:02.865086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.663742+0000","last_change":"2023-12-08T08:21:17.663742+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.663742+0000","last_undegraded":"2023-12-08T08:21:17.663742+0000","last_fullsized":"2023-12-08T08:21:17.663742+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652248+0000","last_change":"2023-12-08T08:21:04.777030+0000","last_active":"2023-12-08T08:21:16.652248+0000","last_peered":"2023-12-08T08:21:16.652248+0000","last_clean":"2023-12-08T08:21:16.652248+0000","last_became_active":"2023-12-08T08:21:04.775911+0000","last_became_peered":"2023-12-08T08:21:04.775911+0000","last_unstale":"2023-12-08T08:21:16.652248+0000","last_undegraded":"2023-12-08T08:21:16.652248+0000","last_fullsized":"2023-12-08T08:21:16.652248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:29.810210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654250+0000","last_change":"2023-12-08T08:21:05.532180+0000","last_active":"2023-12-08T08:21:16.654250+0000","last_peered":"2023-12-08T08:21:16.654250+0000","last_clean":"2023-12-08T08:21:16.654250+0000","last_became_active":"2023-12-08T08:21:05.529640+0000","last_became_peered":"2023-12-08T08:21:05.529640+0000","last_unstale":"2023-12-08T08:21:16.654250+0000","last_undegraded":"2023-12-08T08:21:16.654250+0000","last_fullsized":"2023-12-08T08:21:16.654250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:11.477913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.685108+0000","last_change":"2023-12-08T08:21:17.680905+0000","last_active":"2023-12-08T08:21:17.685108+0000","last_peered":"2023-12-08T08:21:17.685108+0000","last_clean":"2023-12-08T08:21:17.685108+0000","last_became_active":"2023-12-08T08:21:17.680651+0000","last_became_peered":"2023-12-08T08:21:17.680651+0000","last_unstale":"2023-12-08T08:21:17.685108+0000","last_undegraded":"2023-12-08T08:21:17.685108+0000","last_fullsized":"2023-12-08T08:21:17.685108+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:15.257930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.656547+0000","last_change":"2023-12-08T08:21:17.656547+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.656547+0000","last_undegraded":"2023-12-08T08:21:17.656547+0000","last_fullsized":"2023-12-08T08:21:17.656547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.653722+0000","last_change":"2023-12-08T08:21:05.539808+0000","last_active":"2023-12-08T08:21:16.653722+0000","last_peered":"2023-12-08T08:21:16.653722+0000","last_clean":"2023-12-08T08:21:16.653722+0000","last_became_active":"2023-12-08T08:21:05.539443+0000","last_became_peered":"2023-12-08T08:21:05.539443+0000","last_unstale":"2023-12-08T08:21:16.653722+0000","last_undegraded":"2023-12-08T08:21:16.653722+0000","last_fullsized":"2023-12-08T08:21:16.653722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:20:39.875619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661094+0000","last_change":"2023-12-08T08:21:17.661094+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661094+0000","last_undegraded":"2023-12-08T08:21:17.661094+0000","last_fullsized":"2023-12-08T08:21:17.661094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.650483+0000","last_change":"2023-12-08T08:21:05.532086+0000","last_active":"2023-12-08T08:21:16.650483+0000","last_peered":"2023-12-08T08:21:16.650483+0000","last_clean":"2023-12-08T08:21:16.650483+0000","last_became_active":"2023-12-08T08:21:05.531583+0000","last_became_peered":"2023-12-08T08:21:05.531583+0000","last_unstale":"2023-12-08T08:21:16.650483+0000","last_undegraded":"2023-12-08T08:21:16.650483+0000","last_fullsized":"2023-12-08T08:21:16.650483+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:13.936073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.658349+0000","last_change":"2023-12-08T08:21:17.658349+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.658349+0000","last_undegraded":"2023-12-08T08:21:17.658349+0000","last_fullsized":"2023-12-08T08:21:17.658349+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654484+0000","last_change":"2023-12-08T08:21:05.530432+0000","last_active":"2023-12-08T08:21:16.654484+0000","last_peered":"2023-12-08T08:21:16.654484+0000","last_clean":"2023-12-08T08:21:16.654484+0000","last_became_active":"2023-12-08T08:21:05.530065+0000","last_became_peered":"2023-12-08T08:21:05.530065+0000","last_unstale":"2023-12-08T08:21:16.654484+0000","last_undegraded":"2023-12-08T08:21:16.654484+0000","last_fullsized":"2023-12-08T08:21:16.654484+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:43.021591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.667972+0000","last_change":"2023-12-08T08:21:17.667972+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.667972+0000","last_undegraded":"2023-12-08T08:21:17.667972+0000","last_fullsized":"2023-12-08T08:21:17.667972+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648680+0000","last_change":"2023-12-08T08:21:05.531803+0000","last_active":"2023-12-08T08:21:16.648680+0000","last_peered":"2023-12-08T08:21:16.648680+0000","last_clean":"2023-12-08T08:21:16.648680+0000","last_became_active":"2023-12-08T08:21:05.531470+0000","last_became_peered":"2023-12-08T08:21:05.531470+0000","last_unstale":"2023-12-08T08:21:16.648680+0000","last_undegraded":"2023-12-08T08:21:16.648680+0000","last_fullsized":"2023-12-08T08:21:16.648680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:37.538055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659142+0000","last_change":"2023-12-08T08:21:17.659142+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659142+0000","last_undegraded":"2023-12-08T08:21:17.659142+0000","last_fullsized":"2023-12-08T08:21:17.659142+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655770+0000","last_change":"2023-12-08T08:21:05.538326+0000","last_active":"2023-12-08T08:21:16.655770+0000","last_peered":"2023-12-08T08:21:16.655770+0000","last_clean":"2023-12-08T08:21:16.655770+0000","last_became_active":"2023-12-08T08:21:05.538042+0000","last_became_peered":"2023-12-08T08:21:05.538042+0000","last_unstale":"2023-12-08T08:21:16.655770+0000","last_undegraded":"2023-12-08T08:21:16.655770+0000","last_fullsized":"2023-12-08T08:21:16.655770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:30.973295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.663984+0000","last_change":"2023-12-08T08:21:17.663984+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.663984+0000","last_undegraded":"2023-12-08T08:21:17.663984+0000","last_fullsized":"2023-12-08T08:21:17.663984+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652267+0000","last_change":"2023-12-08T08:21:05.538170+0000","last_active":"2023-12-08T08:21:16.652267+0000","last_peered":"2023-12-08T08:21:16.652267+0000","last_clean":"2023-12-08T08:21:16.652267+0000","last_became_active":"2023-12-08T08:21:05.537834+0000","last_became_peered":"2023-12-08T08:21:05.537834+0000","last_unstale":"2023-12-08T08:21:16.652267+0000","last_undegraded":"2023-12-08T08:21:16.652267+0000","last_fullsized":"2023-12-08T08:21:16.652267+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:23.756612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.664256+0000","last_change":"2023-12-08T08:21:17.664256+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.664256+0000","last_undegraded":"2023-12-08T08:21:17.664256+0000","last_fullsized":"2023-12-08T08:21:17.664256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644283+0000","last_change":"2023-12-08T08:21:05.532516+0000","last_active":"2023-12-08T08:21:16.644283+0000","last_peered":"2023-12-08T08:21:16.644283+0000","last_clean":"2023-12-08T08:21:16.644283+0000","last_became_active":"2023-12-08T08:21:05.531827+0000","last_became_peered":"2023-12-08T08:21:05.531827+0000","last_unstale":"2023-12-08T08:21:16.644283+0000","last_undegraded":"2023-12-08T08:21:16.644283+0000","last_fullsized":"2023-12-08T08:21:16.644283+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:49:59.047557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.655852+0000","last_change":"2023-12-08T08:21:17.655852+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.655852+0000","last_undegraded":"2023-12-08T08:21:17.655852+0000","last_fullsized":"2023-12-08T08:21:17.655852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651828+0000","last_change":"2023-12-08T08:21:05.531201+0000","last_active":"2023-12-08T08:21:16.651828+0000","last_peered":"2023-12-08T08:21:16.651828+0000","last_clean":"2023-12-08T08:21:16.651828+0000","last_became_active":"2023-12-08T08:21:05.530935+0000","last_became_peered":"2023-12-08T08:21:05.530935+0000","last_unstale":"2023-12-08T08:21:16.651828+0000","last_undegraded":"2023-12-08T08:21:16.651828+0000","last_fullsized":"2023-12-08T08:21:16.651828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:37.538055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659185+0000","last_change":"2023-12-08T08:21:17.659185+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659185+0000","last_undegraded":"2023-12-08T08:21:17.659185+0000","last_fullsized":"2023-12-08T08:21:17.659185+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655029+0000","last_change":"2023-12-08T08:21:05.535454+0000","last_active":"2023-12-08T08:21:16.655029+0000","last_peered":"2023-12-08T08:21:16.655029+0000","last_clean":"2023-12-08T08:21:16.655029+0000","last_became_active":"2023-12-08T08:21:05.535095+0000","last_became_peered":"2023-12-08T08:21:05.535095+0000","last_unstale":"2023-12-08T08:21:16.655029+0000","last_undegraded":"2023-12-08T08:21:16.655029+0000","last_fullsized":"2023-12-08T08:21:16.655029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:50:53.654615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.663922+0000","last_change":"2023-12-08T08:21:17.663922+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.663922+0000","last_undegraded":"2023-12-08T08:21:17.663922+0000","last_fullsized":"2023-12-08T08:21:17.663922+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.653808+0000","last_change":"2023-12-08T08:21:05.534953+0000","last_active":"2023-12-08T08:21:16.653808+0000","last_peered":"2023-12-08T08:21:16.653808+0000","last_clean":"2023-12-08T08:21:16.653808+0000","last_became_active":"2023-12-08T08:21:05.531291+0000","last_became_peered":"2023-12-08T08:21:05.531291+0000","last_unstale":"2023-12-08T08:21:16.653808+0000","last_undegraded":"2023-12-08T08:21:16.653808+0000","last_fullsized":"2023-12-08T08:21:16.653808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:47.419331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661714+0000","last_change":"2023-12-08T08:21:17.661714+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661714+0000","last_undegraded":"2023-12-08T08:21:17.661714+0000","last_fullsized":"2023-12-08T08:21:17.661714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649166+0000","last_change":"2023-12-08T08:21:05.529673+0000","last_active":"2023-12-08T08:21:16.649166+0000","last_peered":"2023-12-08T08:21:16.649166+0000","last_clean":"2023-12-08T08:21:16.649166+0000","last_became_active":"2023-12-08T08:21:05.528239+0000","last_became_peered":"2023-12-08T08:21:05.528239+0000","last_unstale":"2023-12-08T08:21:16.649166+0000","last_undegraded":"2023-12-08T08:21:16.649166+0000","last_fullsized":"2023-12-08T08:21:16.649166+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:19.928543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.660989+0000","last_change":"2023-12-08T08:21:17.660989+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.660989+0000","last_undegraded":"2023-12-08T08:21:17.660989+0000","last_fullsized":"2023-12-08T08:21:17.660989+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648574+0000","last_change":"2023-12-08T08:21:05.523783+0000","last_active":"2023-12-08T08:21:16.648574+0000","last_peered":"2023-12-08T08:21:16.648574+0000","last_clean":"2023-12-08T08:21:16.648574+0000","last_became_active":"2023-12-08T08:21:05.523509+0000","last_became_peered":"2023-12-08T08:21:05.523509+0000","last_unstale":"2023-12-08T08:21:16.648574+0000","last_undegraded":"2023-12-08T08:21:16.648574+0000","last_fullsized":"2023-12-08T08:21:16.648574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:11.477913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.657354+0000","last_change":"2023-12-08T08:21:17.657354+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.657354+0000","last_undegraded":"2023-12-08T08:21:17.657354+0000","last_fullsized":"2023-12-08T08:21:17.657354+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.650201+0000","last_change":"2023-12-08T08:21:05.538014+0000","last_active":"2023-12-08T08:21:16.650201+0000","last_peered":"2023-12-08T08:21:16.650201+0000","last_clean":"2023-12-08T08:21:16.650201+0000","last_became_active":"2023-12-08T08:21:05.537721+0000","last_became_peered":"2023-12-08T08:21:05.537721+0000","last_unstale":"2023-12-08T08:21:16.650201+0000","last_undegraded":"2023-12-08T08:21:16.650201+0000","last_fullsized":"2023-12-08T08:21:16.650201+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:30.813093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.655768+0000","last_change":"2023-12-08T08:21:17.655768+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.655768+0000","last_undegraded":"2023-12-08T08:21:17.655768+0000","last_fullsized":"2023-12-08T08:21:17.655768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644042+0000","last_change":"2023-12-08T08:21:05.525566+0000","last_active":"2023-12-08T08:21:16.644042+0000","last_peered":"2023-12-08T08:21:16.644042+0000","last_clean":"2023-12-08T08:21:16.644042+0000","last_became_active":"2023-12-08T08:21:05.525251+0000","last_became_peered":"2023-12-08T08:21:05.525251+0000","last_unstale":"2023-12-08T08:21:16.644042+0000","last_undegraded":"2023-12-08T08:21:16.644042+0000","last_fullsized":"2023-12-08T08:21:16.644042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:09:56.356105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.657863+0000","last_change":"2023-12-08T08:21:17.657863+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.657863+0000","last_undegraded":"2023-12-08T08:21:17.657863+0000","last_fullsized":"2023-12-08T08:21:17.657863+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644225+0000","last_change":"2023-12-08T08:21:05.530770+0000","last_active":"2023-12-08T08:21:16.644225+0000","last_peered":"2023-12-08T08:21:16.644225+0000","last_clean":"2023-12-08T08:21:16.644225+0000","last_became_active":"2023-12-08T08:21:05.530517+0000","last_became_peered":"2023-12-08T08:21:05.530517+0000","last_unstale":"2023-12-08T08:21:16.644225+0000","last_undegraded":"2023-12-08T08:21:16.644225+0000","last_fullsized":"2023-12-08T08:21:16.644225+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:05.968004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661813+0000","last_change":"2023-12-08T08:21:17.661813+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661813+0000","last_undegraded":"2023-12-08T08:21:17.661813+0000","last_fullsized":"2023-12-08T08:21:17.661813+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654550+0000","last_change":"2023-12-08T08:21:05.532053+0000","last_active":"2023-12-08T08:21:16.654550+0000","last_peered":"2023-12-08T08:21:16.654550+0000","last_clean":"2023-12-08T08:21:16.654550+0000","last_became_active":"2023-12-08T08:21:05.531799+0000","last_became_peered":"2023-12-08T08:21:05.531799+0000","last_unstale":"2023-12-08T08:21:16.654550+0000","last_undegraded":"2023-12-08T08:21:16.654550+0000","last_fullsized":"2023-12-08T08:21:16.654550+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:05.968004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659709+0000","last_change":"2023-12-08T08:21:17.659709+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659709+0000","last_undegraded":"2023-12-08T08:21:17.659709+0000","last_fullsized":"2023-12-08T08:21:17.659709+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654066+0000","last_change":"2023-12-08T08:21:05.535656+0000","last_active":"2023-12-08T08:21:16.654066+0000","last_peered":"2023-12-08T08:21:16.654066+0000","last_clean":"2023-12-08T08:21:16.654066+0000","last_became_active":"2023-12-08T08:21:05.535310+0000","last_became_peered":"2023-12-08T08:21:05.535310+0000","last_unstale":"2023-12-08T08:21:16.654066+0000","last_undegraded":"2023-12-08T08:21:16.654066+0000","last_fullsized":"2023-12-08T08:21:16.654066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:09:56.356105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.657854+0000","last_change":"2023-12-08T08:21:17.657854+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.657854+0000","last_undegraded":"2023-12-08T08:21:17.657854+0000","last_fullsized":"2023-12-08T08:21:17.657854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655138+0000","last_change":"2023-12-08T08:21:05.529395+0000","last_active":"2023-12-08T08:21:16.655138+0000","last_peered":"2023-12-08T08:21:16.655138+0000","last_clean":"2023-12-08T08:21:16.655138+0000","last_became_active":"2023-12-08T08:21:05.529089+0000","last_became_peered":"2023-12-08T08:21:05.529089+0000","last_unstale":"2023-12-08T08:21:16.655138+0000","last_undegraded":"2023-12-08T08:21:16.655138+0000","last_fullsized":"2023-12-08T08:21:16.655138+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:43.021591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661007+0000","last_change":"2023-12-08T08:21:17.661007+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661007+0000","last_undegraded":"2023-12-08T08:21:17.661007+0000","last_fullsized":"2023-12-08T08:21:17.661007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643962+0000","last_change":"2023-12-08T08:21:05.527949+0000","last_active":"2023-12-08T08:21:16.643962+0000","last_peered":"2023-12-08T08:21:16.643962+0000","last_clean":"2023-12-08T08:21:16.643962+0000","last_became_active":"2023-12-08T08:21:05.527215+0000","last_became_peered":"2023-12-08T08:21:05.527215+0000","last_unstale":"2023-12-08T08:21:16.643962+0000","last_undegraded":"2023-12-08T08:21:16.643962+0000","last_fullsized":"2023-12-08T08:21:16.643962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:25.239396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.671345+0000","last_change":"2023-12-08T08:21:17.671345+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.671345+0000","last_undegraded":"2023-12-08T08:21:17.671345+0000","last_fullsized":"2023-12-08T08:21:17.671345+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649424+0000","last_change":"2023-12-08T08:21:05.530318+0000","last_active":"2023-12-08T08:21:16.649424+0000","last_peered":"2023-12-08T08:21:16.649424+0000","last_clean":"2023-12-08T08:21:16.649424+0000","last_became_active":"2023-12-08T08:21:05.529990+0000","last_became_peered":"2023-12-08T08:21:05.529990+0000","last_unstale":"2023-12-08T08:21:16.649424+0000","last_undegraded":"2023-12-08T08:21:16.649424+0000","last_fullsized":"2023-12-08T08:21:16.649424+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:54:39.738546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.660112+0000","last_change":"2023-12-08T08:21:17.660112+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.660112+0000","last_undegraded":"2023-12-08T08:21:17.660112+0000","last_fullsized":"2023-12-08T08:21:17.660112+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655723+0000","last_change":"2023-12-08T08:21:05.540446+0000","last_active":"2023-12-08T08:21:16.655723+0000","last_peered":"2023-12-08T08:21:16.655723+0000","last_clean":"2023-12-08T08:21:16.655723+0000","last_became_active":"2023-12-08T08:21:05.540024+0000","last_became_peered":"2023-12-08T08:21:05.540024+0000","last_unstale":"2023-12-08T08:21:16.655723+0000","last_undegraded":"2023-12-08T08:21:16.655723+0000","last_fullsized":"2023-12-08T08:21:16.655723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:59:00.606587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.660303+0000","last_change":"2023-12-08T08:21:17.660303+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.660303+0000","last_undegraded":"2023-12-08T08:21:17.660303+0000","last_fullsized":"2023-12-08T08:21:17.660303+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654222+0000","last_change":"2023-12-08T08:21:05.536252+0000","last_active":"2023-12-08T08:21:16.654222+0000","last_peered":"2023-12-08T08:21:16.654222+0000","last_clean":"2023-12-08T08:21:16.654222+0000","last_became_active":"2023-12-08T08:21:05.535964+0000","last_became_peered":"2023-12-08T08:21:05.535964+0000","last_unstale":"2023-12-08T08:21:16.654222+0000","last_undegraded":"2023-12-08T08:21:16.654222+0000","last_fullsized":"2023-12-08T08:21:16.654222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:30.973295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.664875+0000","last_change":"2023-12-08T08:21:17.664875+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.664875+0000","last_undegraded":"2023-12-08T08:21:17.664875+0000","last_fullsized":"2023-12-08T08:21:17.664875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651605+0000","last_change":"2023-12-08T08:21:05.533444+0000","last_active":"2023-12-08T08:21:16.651605+0000","last_peered":"2023-12-08T08:21:16.651605+0000","last_clean":"2023-12-08T08:21:16.651605+0000","last_became_active":"2023-12-08T08:21:05.533146+0000","last_became_peered":"2023-12-08T08:21:05.533146+0000","last_unstale":"2023-12-08T08:21:16.651605+0000","last_undegraded":"2023-12-08T08:21:16.651605+0000","last_fullsized":"2023-12-08T08:21:16.651605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:14:18.284764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659761+0000","last_change":"2023-12-08T08:21:17.659761+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659761+0000","last_undegraded":"2023-12-08T08:21:17.659761+0000","last_fullsized":"2023-12-08T08:21:17.659761+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649422+0000","last_change":"2023-12-08T08:21:05.525741+0000","last_active":"2023-12-08T08:21:16.649422+0000","last_peered":"2023-12-08T08:21:16.649422+0000","last_clean":"2023-12-08T08:21:16.649422+0000","last_became_active":"2023-12-08T08:21:05.525406+0000","last_became_peered":"2023-12-08T08:21:05.525406+0000","last_unstale":"2023-12-08T08:21:16.649422+0000","last_undegraded":"2023-12-08T08:21:16.649422+0000","last_fullsized":"2023-12-08T08:21:16.649422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:08.596525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.673727+0000","last_change":"2023-12-08T08:21:17.673727+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.673727+0000","last_undegraded":"2023-12-08T08:21:17.673727+0000","last_fullsized":"2023-12-08T08:21:17.673727+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.653633+0000","last_change":"2023-12-08T08:21:05.537523+0000","last_active":"2023-12-08T08:21:16.653633+0000","last_peered":"2023-12-08T08:21:16.653633+0000","last_clean":"2023-12-08T08:21:16.653633+0000","last_became_active":"2023-12-08T08:21:05.537263+0000","last_became_peered":"2023-12-08T08:21:05.537263+0000","last_unstale":"2023-12-08T08:21:16.653633+0000","last_undegraded":"2023-12-08T08:21:16.653633+0000","last_fullsized":"2023-12-08T08:21:16.653633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:08.596525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.668335+0000","last_change":"2023-12-08T08:21:17.668335+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.668335+0000","last_undegraded":"2023-12-08T08:21:17.668335+0000","last_fullsized":"2023-12-08T08:21:17.668335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654426+0000","last_change":"2023-12-08T08:21:05.534310+0000","last_active":"2023-12-08T08:21:16.654426+0000","last_peered":"2023-12-08T08:21:16.654426+0000","last_clean":"2023-12-08T08:21:16.654426+0000","last_became_active":"2023-12-08T08:21:05.534003+0000","last_became_peered":"2023-12-08T08:21:05.534003+0000","last_unstale":"2023-12-08T08:21:16.654426+0000","last_undegraded":"2023-12-08T08:21:16.654426+0000","last_fullsized":"2023-12-08T08:21:16.654426+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:49.782105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659794+0000","last_change":"2023-12-08T08:21:17.659794+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659794+0000","last_undegraded":"2023-12-08T08:21:17.659794+0000","last_fullsized":"2023-12-08T08:21:17.659794+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643900+0000","last_change":"2023-12-08T08:21:05.543535+0000","last_active":"2023-12-08T08:21:16.643900+0000","last_peered":"2023-12-08T08:21:16.643900+0000","last_clean":"2023-12-08T08:21:16.643900+0000","last_became_active":"2023-12-08T08:21:05.543244+0000","last_became_peered":"2023-12-08T08:21:05.543244+0000","last_unstale":"2023-12-08T08:21:16.643900+0000","last_undegraded":"2023-12-08T08:21:16.643900+0000","last_fullsized":"2023-12-08T08:21:16.643900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:20:39.875619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.662257+0000","last_change":"2023-12-08T08:21:17.662257+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.662257+0000","last_undegraded":"2023-12-08T08:21:17.662257+0000","last_fullsized":"2023-12-08T08:21:17.662257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649277+0000","last_change":"2023-12-08T08:21:05.532561+0000","last_active":"2023-12-08T08:21:16.649277+0000","last_peered":"2023-12-08T08:21:16.649277+0000","last_clean":"2023-12-08T08:21:16.649277+0000","last_became_active":"2023-12-08T08:21:05.532254+0000","last_became_peered":"2023-12-08T08:21:05.532254+0000","last_unstale":"2023-12-08T08:21:16.649277+0000","last_undegraded":"2023-12-08T08:21:16.649277+0000","last_fullsized":"2023-12-08T08:21:16.649277+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:30:51.157799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.668437+0000","last_change":"2023-12-08T08:21:17.668437+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.668437+0000","last_undegraded":"2023-12-08T08:21:17.668437+0000","last_fullsized":"2023-12-08T08:21:17.668437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651087+0000","last_change":"2023-12-08T08:21:05.528111+0000","last_active":"2023-12-08T08:21:16.651087+0000","last_peered":"2023-12-08T08:21:16.651087+0000","last_clean":"2023-12-08T08:21:16.651087+0000","last_became_active":"2023-12-08T08:21:05.527809+0000","last_became_peered":"2023-12-08T08:21:05.527809+0000","last_unstale":"2023-12-08T08:21:16.651087+0000","last_undegraded":"2023-12-08T08:21:16.651087+0000","last_fullsized":"2023-12-08T08:21:16.651087+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:51.183842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.662012+0000","last_change":"2023-12-08T08:21:17.662012+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.662012+0000","last_undegraded":"2023-12-08T08:21:17.662012+0000","last_fullsized":"2023-12-08T08:21:17.662012+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.656056+0000","last_change":"2023-12-08T08:21:05.534658+0000","last_active":"2023-12-08T08:21:16.656056+0000","last_peered":"2023-12-08T08:21:16.656056+0000","last_clean":"2023-12-08T08:21:16.656056+0000","last_became_active":"2023-12-08T08:21:05.534383+0000","last_became_peered":"2023-12-08T08:21:05.534383+0000","last_unstale":"2023-12-08T08:21:16.656056+0000","last_undegraded":"2023-12-08T08:21:16.656056+0000","last_fullsized":"2023-12-08T08:21:16.656056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.368162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.660063+0000","last_change":"2023-12-08T08:21:17.660063+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.660063+0000","last_undegraded":"2023-12-08T08:21:17.660063+0000","last_fullsized":"2023-12-08T08:21:17.660063+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644195+0000","last_change":"2023-12-08T08:21:05.527659+0000","last_active":"2023-12-08T08:21:16.644195+0000","last_peered":"2023-12-08T08:21:16.644195+0000","last_clean":"2023-12-08T08:21:16.644195+0000","last_became_active":"2023-12-08T08:21:05.527361+0000","last_became_peered":"2023-12-08T08:21:05.527361+0000","last_unstale":"2023-12-08T08:21:16.644195+0000","last_undegraded":"2023-12-08T08:21:16.644195+0000","last_fullsized":"2023-12-08T08:21:16.644195+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:49.782105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.655156+0000","last_change":"2023-12-08T08:21:17.655156+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.655156+0000","last_undegraded":"2023-12-08T08:21:17.655156+0000","last_fullsized":"2023-12-08T08:21:17.655156+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652062+0000","last_change":"2023-12-08T08:21:05.540661+0000","last_active":"2023-12-08T08:21:16.652062+0000","last_peered":"2023-12-08T08:21:16.652062+0000","last_clean":"2023-12-08T08:21:16.652062+0000","last_became_active":"2023-12-08T08:21:05.539125+0000","last_became_peered":"2023-12-08T08:21:05.539125+0000","last_unstale":"2023-12-08T08:21:16.652062+0000","last_undegraded":"2023-12-08T08:21:16.652062+0000","last_fullsized":"2023-12-08T08:21:16.652062+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:58:23.887952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":731231,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.63100000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.72799999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.81699999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.71099999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.68700000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":141389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.74399999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.84899999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.72699999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.77900000000000003}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.80400000000000005}]},{"osd":5,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.82799999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.70599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":141445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.65200000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.75}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.81200000000000006}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.77000000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.78600000000000003}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.876}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.753}]},{"osd":1,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.64300000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.86799999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.81899999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.71199999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.90500000000000003}]},{"osd":7,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.73299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":151024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.443},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.46600000000000003}]},{"osd":1,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.50800000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.62},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.69399999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68200000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.71299999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.73699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":140843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.0270000000000001,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.34000000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.37},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.42199999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.55800000000000005}]},{"osd":5,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":3.637,"5min":3.637,"15min":3.637},"last":0.49399999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.54500000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.67500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":143902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2210000000000001,"5min":5.2210000000000001,"15min":5.2210000000000001},"last":0.374},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":8.3200000000000003,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.439}]},{"osd":2,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":8.2070000000000007,"5min":8.2070000000000007,"15min":8.2070000000000007},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":4.351,"5min":4.351,"15min":4.351},"last":0.42199999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":8.1479999999999997,"5min":8.1479999999999997,"15min":8.1479999999999997},"last":0.495},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.3150000000000004,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.47499999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":4.8470000000000004,"5min":4.8470000000000004,"15min":4.8470000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":4.7939999999999996,"5min":4.7939999999999996,"15min":4.7939999999999996},"last":0.71399999999999997}]},{"osd":5,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":4.7240000000000002,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":4.5830000000000002,"5min":4.5830000000000002,"15min":4.5830000000000002},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":4.7699999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.624},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":4.6289999999999996,"5min":4.6289999999999996,"15min":4.6289999999999996},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":4.665,"5min":4.665,"15min":4.665},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":4.8140000000000001,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.75800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":731141,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":8.2799999999999994,"5min":8.2799999999999994,"15min":8.2799999999999994},"last":0.46800000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":7.9290000000000003,"5min":7.9290000000000003,"15min":7.9290000000000003},"last":0.33900000000000002},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":8.0890000000000004,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.51500000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":4.6550000000000002,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.439},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":7.8890000000000002,"5min":7.8890000000000002,"15min":7.8890000000000002},"last":0.38}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":7.9649999999999999,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":8.0579999999999998,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.68300000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":7.835,"5min":7.835,"15min":7.835},"last":0.65900000000000003}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":8.0239999999999991,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.58799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:21:22.750 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:21:22.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f210a7f5640 1 Processor -- start 2023-12-08T08:21:22.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f210a7f5640 1 -- start start 2023-12-08T08:21:22.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f210a7f5640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2104154f20 0x7f210406b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:22.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f210a7f5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f210406c380 con 0x7f21040af4c0 2023-12-08T08:21:22.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f210a7f5640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21040c4890 con 0x7f210406bf30 2023-12-08T08:21:22.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f210a7f5640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21041553a0 con 0x7f2104154f20 2023-12-08T08:21:22.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f2103fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f21040af4c0 0x7f21040c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46738/0 (socket says 172.21.15.88:46738) 2023-12-08T08:21:22.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f2103fff640 1 -- 172.21.15.88:0/3331481730 learned_addr learned my addr 172.21.15.88:0/3331481730 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:22.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f21037fe640 1 --2- 172.21.15.88:0/3331481730 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2104154f20 0x7f210406b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:22.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f2102ffd640 1 -- 172.21.15.88:0/3331481730 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4207046224 0 0) 0x7f210406c380 con 0x7f21040af4c0 2023-12-08T08:21:22.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f2102ffd640 1 -- 172.21.15.88:0/3331481730 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20ec003530 con 0x7f21040af4c0 2023-12-08T08:21:22.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f2102ffd640 1 -- 172.21.15.88:0/3331481730 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2373376878 0 0) 0x7f20ec003530 con 0x7f21040af4c0 2023-12-08T08:21:22.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f2102ffd640 1 -- 172.21.15.88:0/3331481730 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2104154f20 msgr2=0x7f210406b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:22.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f2102ffd640 1 --2- 172.21.15.88:0/3331481730 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2104154f20 0x7f210406b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f2102ffd640 1 -- 172.21.15.88:0/3331481730 >> v1:172.21.15.148:6789/0 conn(0x7f210406bf30 legacy=0x7f210415ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:22.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f2102ffd640 1 -- 172.21.15.88:0/3331481730 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21040af8a0 con 0x7f21040af4c0 2023-12-08T08:21:22.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f2102ffd640 1 -- 172.21.15.88:0/3331481730 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f20f4001680 con 0x7f21040af4c0 2023-12-08T08:21:22.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f2102ffd640 1 -- 172.21.15.88:0/3331481730 >> v1:172.21.15.88:6789/0 conn(0x7f21040af4c0 legacy=0x7f21040c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:22.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f2102ffd640 1 --2- 172.21.15.88:0/3331481730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20ec0039b0 0x7f20ec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:22.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f2102ffd640 1 --2- 172.21.15.88:0/3331481730 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20ec004360 0x7f20ec004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:22.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f2102ffd640 1 --2- 172.21.15.88:0/3331481730 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2104154f20 0x7f20ec005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:22.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f2102ffd640 1 -- 172.21.15.88:0/3331481730 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21041553a0 con 0x7f20ec004360 2023-12-08T08:21:22.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f2102ffd640 1 -- 172.21.15.88:0/3331481730 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec00ba70 con 0x7f20ec0039b0 2023-12-08T08:21:22.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f2102ffd640 1 -- 172.21.15.88:0/3331481730 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec00bc30 con 0x7f2104154f20 2023-12-08T08:21:22.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f21037fe640 1 --2- 172.21.15.88:0/3331481730 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20ec004360 0x7f20ec004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:22.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f2103fff640 1 --2- 172.21.15.88:0/3331481730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20ec0039b0 0x7f20ec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:22.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f2108d92640 1 --2- 172.21.15.88:0/3331481730 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2104154f20 0x7f20ec005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:22.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f21037fe640 1 -- 172.21.15.88:0/3331481730 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2104154f20 msgr2=0x7f20ec005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:22.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f21037fe640 1 --2- 172.21.15.88:0/3331481730 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2104154f20 0x7f20ec005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f21037fe640 1 -- 172.21.15.88:0/3331481730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20ec0039b0 msgr2=0x7f20ec003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:22.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f21037fe640 1 --2- 172.21.15.88:0/3331481730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20ec0039b0 0x7f20ec003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f21037fe640 1 -- 172.21.15.88:0/3331481730 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec003530 con 0x7f20ec004360 2023-12-08T08:21:22.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.924+0000 7f2103fff640 1 --2- 172.21.15.88:0/3331481730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20ec0039b0 0x7f20ec003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:22.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.928+0000 7f21037fe640 1 --2- 172.21.15.88:0/3331481730 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20ec004360 0x7f20ec004830 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f20f8009ae0 tx=0x7f20f801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af6fa84cd96e72b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:22.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.928+0000 7f2102ffd640 1 -- 172.21.15.88:0/3331481730 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f80a5640 con 0x7f20ec004360 2023-12-08T08:21:22.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.928+0000 7f2102ffd640 1 -- 172.21.15.88:0/3331481730 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f80a57a0 con 0x7f20ec004360 2023-12-08T08:21:22.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.928+0000 7f2102ffd640 1 -- 172.21.15.88:0/3331481730 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f80a5b50 con 0x7f20ec004360 2023-12-08T08:21:22.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.928+0000 7f210a7f5640 1 -- 172.21.15.88:0/3331481730 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20ec004360 msgr2=0x7f20ec004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:22.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.928+0000 7f210a7f5640 1 --2- 172.21.15.88:0/3331481730 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20ec004360 0x7f20ec004830 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f20f8009ae0 tx=0x7f20f801ca50 comp rx=0 tx=0).stop 2023-12-08T08:21:22.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.928+0000 7f2108d92640 1 -- 172.21.15.88:0/3331481730 reap_dead start 2023-12-08T08:21:22.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.928+0000 7f210a7f5640 1 -- 172.21.15.88:0/3331481730 shutdown_connections 2023-12-08T08:21:22.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.928+0000 7f210a7f5640 1 -- 172.21.15.88:0/3331481730 >> 172.21.15.88:0/3331481730 conn(0x7f21040ab9d0 msgr2=0x7f21040abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:22.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.928+0000 7f210a7f5640 1 -- 172.21.15.88:0/3331481730 shutdown_connections 2023-12-08T08:21:22.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.928+0000 7f210a7f5640 1 -- 172.21.15.88:0/3331481730 wait complete. 2023-12-08T08:21:22.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.932+0000 7f210a7f5640 1 Processor -- start 2023-12-08T08:21:22.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.932+0000 7f210a7f5640 1 -- start start 2023-12-08T08:21:22.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.932+0000 7f210a7f5640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20ec004360 0x7f210414d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:22.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.932+0000 7f210a7f5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21040aa350 0x7f210414f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:22.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.932+0000 7f210a7f5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2104142f80 0x7f2104143430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:22.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.932+0000 7f210a7f5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2104152c20 con 0x7f2104142f80 2023-12-08T08:21:22.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.932+0000 7f210a7f5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2104143970 con 0x7f21040aa350 2023-12-08T08:21:22.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.932+0000 7f210a7f5640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2104152310 con 0x7f20ec004360 2023-12-08T08:21:22.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.932+0000 7f2108d92640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2104142f80 0x7f2104143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:22.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.932+0000 7f2108d92640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2104142f80 0x7f2104143430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33752/0 (socket says 172.21.15.88:33752) 2023-12-08T08:21:22.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.932+0000 7f2108d92640 1 -- 172.21.15.88:0/2063936674 learned_addr learned my addr 172.21.15.88:0/2063936674 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:22.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.932+0000 7f21037fe640 1 --2- 172.21.15.88:0/2063936674 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21040aa350 0x7f210414f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:22.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.932+0000 7f2103fff640 1 --2- 172.21.15.88:0/2063936674 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20ec004360 0x7f210414d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:22.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.932+0000 7f2108d92640 1 -- 172.21.15.88:0/2063936674 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20ec004360 msgr2=0x7f210414d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:22.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.932+0000 7f2108d92640 1 --2- 172.21.15.88:0/2063936674 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20ec004360 0x7f210414d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.932+0000 7f2108d92640 1 -- 172.21.15.88:0/2063936674 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21040aa350 msgr2=0x7f210414f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:22.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.932+0000 7f2108d92640 1 --2- 172.21.15.88:0/2063936674 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21040aa350 0x7f210414f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:22.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.932+0000 7f2108d92640 1 -- 172.21.15.88:0/2063936674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21041eada0 con 0x7f2104142f80 2023-12-08T08:21:22.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.932+0000 7f2108d92640 1 --2- 172.21.15.88:0/2063936674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2104142f80 0x7f2104143430 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f21040ac810 tx=0x7f20fc010e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:22.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.932+0000 7f2100ff9640 1 -- 172.21.15.88:0/2063936674 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20fc003d90 con 0x7f2104142f80 2023-12-08T08:21:22.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.932+0000 7f2100ff9640 1 -- 172.21.15.88:0/2063936674 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20fc00d070 con 0x7f2104142f80 2023-12-08T08:21:22.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.932+0000 7f210a7f5640 1 -- 172.21.15.88:0/2063936674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21041525d0 con 0x7f2104142f80 2023-12-08T08:21:22.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.932+0000 7f2100ff9640 1 -- 172.21.15.88:0/2063936674 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20fc00e9f0 con 0x7f2104142f80 2023-12-08T08:21:22.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.936+0000 7f210a7f5640 1 -- 172.21.15.88:0/2063936674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f210414fac0 con 0x7f2104142f80 2023-12-08T08:21:22.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.936+0000 7f210a7f5640 1 -- 172.21.15.88:0/2063936674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2104067630 con 0x7f2104142f80 2023-12-08T08:21:22.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.936+0000 7f2100ff9640 1 -- 172.21.15.88:0/2063936674 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f20fc00eb50 con 0x7f2104142f80 2023-12-08T08:21:22.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.936+0000 7f2100ff9640 1 --2- 172.21.15.88:0/2063936674 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f20f00664a0 0x7f20f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:22.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.936+0000 7f2100ff9640 1 -- 172.21.15.88:0/2063936674 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f20fc087090 con 0x7f2104142f80 2023-12-08T08:21:22.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.936+0000 7f2103fff640 1 --2- 172.21.15.88:0/2063936674 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f20f00664a0 0x7f20f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:22.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.936+0000 7f2103fff640 1 --2- 172.21.15.88:0/2063936674 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f20f00664a0 0x7f20f0068960 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f20f4000c10 tx=0x7f20f4007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:22.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:22.940+0000 7f2100ff9640 1 -- 172.21.15.88:0/2063936674 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f20fc0542f0 con 0x7f2104142f80 2023-12-08T08:21:23.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.088+0000 7f210a7f5640 1 -- 172.21.15.88:0/2063936674 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2104152a80 con 0x7f20f00664a0 2023-12-08T08:21:23.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.100+0000 7f2100ff9640 1 -- 172.21.15.88:0/2063936674 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+521952 (secure 0 0 0) 0x7f20f4011990 con 0x7f20f00664a0 2023-12-08T08:21:23.107 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:23.111 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:21:23.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.104+0000 7f210a7f5640 1 -- 172.21.15.88:0/2063936674 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f20f00664a0 msgr2=0x7f20f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:23.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.104+0000 7f210a7f5640 1 --2- 172.21.15.88:0/2063936674 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f20f00664a0 0x7f20f0068960 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f20f4000c10 tx=0x7f20f4007040 comp rx=0 tx=0).stop 2023-12-08T08:21:23.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.104+0000 7f210a7f5640 1 -- 172.21.15.88:0/2063936674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2104142f80 msgr2=0x7f2104143430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:23.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.104+0000 7f210a7f5640 1 --2- 172.21.15.88:0/2063936674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2104142f80 0x7f2104143430 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f21040ac810 tx=0x7f20fc010e90 comp rx=0 tx=0).stop 2023-12-08T08:21:23.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.104+0000 7f210a7f5640 1 -- 172.21.15.88:0/2063936674 shutdown_connections 2023-12-08T08:21:23.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.104+0000 7f210a7f5640 1 --2- 172.21.15.88:0/2063936674 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f20f00664a0 0x7f20f0068960 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:23.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.104+0000 7f210a7f5640 1 --2- 172.21.15.88:0/2063936674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2104142f80 0x7f2104143430 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:23.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.104+0000 7f210a7f5640 1 --2- 172.21.15.88:0/2063936674 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21040aa350 0x7f210414f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:23.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.104+0000 7f210a7f5640 1 --2- 172.21.15.88:0/2063936674 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20ec004360 0x7f210414d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:23.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.104+0000 7f210a7f5640 1 -- 172.21.15.88:0/2063936674 >> 172.21.15.88:0/2063936674 conn(0x7f21040ab9d0 msgr2=0x7f21040abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:23.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.104+0000 7f210a7f5640 1 -- 172.21.15.88:0/2063936674 shutdown_connections 2023-12-08T08:21:23.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.104+0000 7f210a7f5640 1 -- 172.21.15.88:0/2063936674 wait complete. 2023-12-08T08:21:23.126 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-12-08T08:21:22.759928+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":202,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219180,"kb_used_data":3020,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755540,"statfs":{"total":773094113280,"available":772869672960,"internally_reserved":0,"allocated":3092480,"data_stored":2321852,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1241,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001180"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.658802+0000","last_change":"2023-12-08T08:21:17.658802+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.658802+0000","last_undegraded":"2023-12-08T08:21:17.658802+0000","last_fullsized":"2023-12-08T08:21:17.658802+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654128+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:21:16.654128+0000","last_peered":"2023-12-08T08:21:16.654128+0000","last_clean":"2023-12-08T08:21:16.654128+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:21:16.654128+0000","last_undegraded":"2023-12-08T08:21:16.654128+0000","last_fullsized":"2023-12-08T08:21:16.654128+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.650554+0000","last_change":"2023-12-08T08:21:04.776417+0000","last_active":"2023-12-08T08:21:16.650554+0000","last_peered":"2023-12-08T08:21:16.650554+0000","last_clean":"2023-12-08T08:21:16.650554+0000","last_became_active":"2023-12-08T08:21:04.776117+0000","last_became_peered":"2023-12-08T08:21:04.776117+0000","last_unstale":"2023-12-08T08:21:16.650554+0000","last_undegraded":"2023-12-08T08:21:16.650554+0000","last_fullsized":"2023-12-08T08:21:16.650554+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:45:05.142948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654266+0000","last_change":"2023-12-08T08:21:05.536640+0000","last_active":"2023-12-08T08:21:16.654266+0000","last_peered":"2023-12-08T08:21:16.654266+0000","last_clean":"2023-12-08T08:21:16.654266+0000","last_became_active":"2023-12-08T08:21:05.536368+0000","last_became_peered":"2023-12-08T08:21:05.536368+0000","last_unstale":"2023-12-08T08:21:16.654266+0000","last_undegraded":"2023-12-08T08:21:16.654266+0000","last_fullsized":"2023-12-08T08:21:16.654266+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:59:00.606587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.687045+0000","last_change":"2023-12-08T08:21:17.684153+0000","last_active":"2023-12-08T08:21:17.687045+0000","last_peered":"2023-12-08T08:21:17.687045+0000","last_clean":"2023-12-08T08:21:17.687045+0000","last_became_active":"2023-12-08T08:21:17.683886+0000","last_became_peered":"2023-12-08T08:21:17.683886+0000","last_unstale":"2023-12-08T08:21:17.687045+0000","last_undegraded":"2023-12-08T08:21:17.687045+0000","last_fullsized":"2023-12-08T08:21:17.687045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:37.006561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.671758+0000","last_change":"2023-12-08T08:21:17.671758+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.671758+0000","last_undegraded":"2023-12-08T08:21:17.671758+0000","last_fullsized":"2023-12-08T08:21:17.671758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643858+0000","last_change":"2023-12-08T08:21:04.781980+0000","last_active":"2023-12-08T08:21:16.643858+0000","last_peered":"2023-12-08T08:21:16.643858+0000","last_clean":"2023-12-08T08:21:16.643858+0000","last_became_active":"2023-12-08T08:21:04.781716+0000","last_became_peered":"2023-12-08T08:21:04.781716+0000","last_unstale":"2023-12-08T08:21:16.643858+0000","last_undegraded":"2023-12-08T08:21:16.643858+0000","last_fullsized":"2023-12-08T08:21:16.643858+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:03.400233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648438+0000","last_change":"2023-12-08T08:21:05.529530+0000","last_active":"2023-12-08T08:21:16.648438+0000","last_peered":"2023-12-08T08:21:16.648438+0000","last_clean":"2023-12-08T08:21:16.648438+0000","last_became_active":"2023-12-08T08:21:05.529080+0000","last_became_peered":"2023-12-08T08:21:05.529080+0000","last_unstale":"2023-12-08T08:21:16.648438+0000","last_undegraded":"2023-12-08T08:21:16.648438+0000","last_fullsized":"2023-12-08T08:21:16.648438+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:51.183842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686147+0000","last_change":"2023-12-08T08:21:17.682622+0000","last_active":"2023-12-08T08:21:17.686147+0000","last_peered":"2023-12-08T08:21:17.686147+0000","last_clean":"2023-12-08T08:21:17.686147+0000","last_became_active":"2023-12-08T08:21:17.676302+0000","last_became_peered":"2023-12-08T08:21:17.676302+0000","last_unstale":"2023-12-08T08:21:17.686147+0000","last_undegraded":"2023-12-08T08:21:17.686147+0000","last_fullsized":"2023-12-08T08:21:17.686147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:15.257930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.665725+0000","last_change":"2023-12-08T08:21:17.665725+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.665725+0000","last_undegraded":"2023-12-08T08:21:17.665725+0000","last_fullsized":"2023-12-08T08:21:17.665725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648651+0000","last_change":"2023-12-08T08:21:04.768138+0000","last_active":"2023-12-08T08:21:16.648651+0000","last_peered":"2023-12-08T08:21:16.648651+0000","last_clean":"2023-12-08T08:21:16.648651+0000","last_became_active":"2023-12-08T08:21:04.767873+0000","last_became_peered":"2023-12-08T08:21:04.767873+0000","last_unstale":"2023-12-08T08:21:16.648651+0000","last_undegraded":"2023-12-08T08:21:16.648651+0000","last_fullsized":"2023-12-08T08:21:16.648651+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:45:05.142948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643753+0000","last_change":"2023-12-08T08:21:05.526701+0000","last_active":"2023-12-08T08:21:16.643753+0000","last_peered":"2023-12-08T08:21:16.643753+0000","last_clean":"2023-12-08T08:21:16.643753+0000","last_became_active":"2023-12-08T08:21:05.526275+0000","last_became_peered":"2023-12-08T08:21:05.526275+0000","last_unstale":"2023-12-08T08:21:16.643753+0000","last_undegraded":"2023-12-08T08:21:16.643753+0000","last_fullsized":"2023-12-08T08:21:16.643753+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:59:00.606587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686309+0000","last_change":"2023-12-08T08:21:17.682917+0000","last_active":"2023-12-08T08:21:17.686309+0000","last_peered":"2023-12-08T08:21:17.686309+0000","last_clean":"2023-12-08T08:21:17.686309+0000","last_became_active":"2023-12-08T08:21:17.681822+0000","last_became_peered":"2023-12-08T08:21:17.681822+0000","last_unstale":"2023-12-08T08:21:17.686309+0000","last_undegraded":"2023-12-08T08:21:17.686309+0000","last_fullsized":"2023-12-08T08:21:17.686309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:37.006561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.655138+0000","last_change":"2023-12-08T08:21:17.655138+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.655138+0000","last_undegraded":"2023-12-08T08:21:17.655138+0000","last_fullsized":"2023-12-08T08:21:17.655138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652749+0000","last_change":"2023-12-08T08:21:04.776576+0000","last_active":"2023-12-08T08:21:16.652749+0000","last_peered":"2023-12-08T08:21:16.652749+0000","last_clean":"2023-12-08T08:21:16.652749+0000","last_became_active":"2023-12-08T08:21:04.773627+0000","last_became_peered":"2023-12-08T08:21:04.773627+0000","last_unstale":"2023-12-08T08:21:16.652749+0000","last_undegraded":"2023-12-08T08:21:16.652749+0000","last_fullsized":"2023-12-08T08:21:16.652749+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:12.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654667+0000","last_change":"2023-12-08T08:21:05.528356+0000","last_active":"2023-12-08T08:21:16.654667+0000","last_peered":"2023-12-08T08:21:16.654667+0000","last_clean":"2023-12-08T08:21:16.654667+0000","last_became_active":"2023-12-08T08:21:05.528102+0000","last_became_peered":"2023-12-08T08:21:05.528102+0000","last_unstale":"2023-12-08T08:21:16.654667+0000","last_undegraded":"2023-12-08T08:21:16.654667+0000","last_fullsized":"2023-12-08T08:21:16.654667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:51.183842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.675479+0000","last_change":"2023-12-08T08:21:17.673005+0000","last_active":"2023-12-08T08:21:17.675479+0000","last_peered":"2023-12-08T08:21:17.675479+0000","last_clean":"2023-12-08T08:21:17.675479+0000","last_became_active":"2023-12-08T08:21:17.672648+0000","last_became_peered":"2023-12-08T08:21:17.672648+0000","last_unstale":"2023-12-08T08:21:17.675479+0000","last_undegraded":"2023-12-08T08:21:17.675479+0000","last_fullsized":"2023-12-08T08:21:17.675479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:51:05.544383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.663000+0000","last_change":"2023-12-08T08:21:17.663000+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.663000+0000","last_undegraded":"2023-12-08T08:21:17.663000+0000","last_fullsized":"2023-12-08T08:21:17.663000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654354+0000","last_change":"2023-12-08T08:21:04.764784+0000","last_active":"2023-12-08T08:21:16.654354+0000","last_peered":"2023-12-08T08:21:16.654354+0000","last_clean":"2023-12-08T08:21:16.654354+0000","last_became_active":"2023-12-08T08:21:04.764580+0000","last_became_peered":"2023-12-08T08:21:04.764580+0000","last_unstale":"2023-12-08T08:21:16.654354+0000","last_undegraded":"2023-12-08T08:21:16.654354+0000","last_fullsized":"2023-12-08T08:21:16.654354+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:51:05.330323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.650596+0000","last_change":"2023-12-08T08:21:05.529399+0000","last_active":"2023-12-08T08:21:16.650596+0000","last_peered":"2023-12-08T08:21:16.650596+0000","last_clean":"2023-12-08T08:21:16.650596+0000","last_became_active":"2023-12-08T08:21:05.529054+0000","last_became_peered":"2023-12-08T08:21:05.529054+0000","last_unstale":"2023-12-08T08:21:16.650596+0000","last_undegraded":"2023-12-08T08:21:16.650596+0000","last_fullsized":"2023-12-08T08:21:16.650596+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:09.020416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.682208+0000","last_change":"2023-12-08T08:21:17.680157+0000","last_active":"2023-12-08T08:21:17.682208+0000","last_peered":"2023-12-08T08:21:17.682208+0000","last_clean":"2023-12-08T08:21:17.682208+0000","last_became_active":"2023-12-08T08:21:17.679947+0000","last_became_peered":"2023-12-08T08:21:17.679947+0000","last_unstale":"2023-12-08T08:21:17.682208+0000","last_undegraded":"2023-12-08T08:21:17.682208+0000","last_fullsized":"2023-12-08T08:21:17.682208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:37.129163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.663369+0000","last_change":"2023-12-08T08:21:17.663369+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.663369+0000","last_undegraded":"2023-12-08T08:21:17.663369+0000","last_fullsized":"2023-12-08T08:21:17.663369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651312+0000","last_change":"2023-12-08T08:21:04.769119+0000","last_active":"2023-12-08T08:21:16.651312+0000","last_peered":"2023-12-08T08:21:16.651312+0000","last_clean":"2023-12-08T08:21:16.651312+0000","last_became_active":"2023-12-08T08:21:04.768807+0000","last_became_peered":"2023-12-08T08:21:04.768807+0000","last_unstale":"2023-12-08T08:21:16.651312+0000","last_undegraded":"2023-12-08T08:21:16.651312+0000","last_fullsized":"2023-12-08T08:21:16.651312+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:29.810210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654195+0000","last_change":"2023-12-08T08:21:05.525845+0000","last_active":"2023-12-08T08:21:16.654195+0000","last_peered":"2023-12-08T08:21:16.654195+0000","last_clean":"2023-12-08T08:21:16.654195+0000","last_became_active":"2023-12-08T08:21:05.525546+0000","last_became_peered":"2023-12-08T08:21:05.525546+0000","last_unstale":"2023-12-08T08:21:16.654195+0000","last_undegraded":"2023-12-08T08:21:16.654195+0000","last_fullsized":"2023-12-08T08:21:16.654195+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:44.030312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686444+0000","last_change":"2023-12-08T08:21:17.682436+0000","last_active":"2023-12-08T08:21:17.686444+0000","last_peered":"2023-12-08T08:21:17.686444+0000","last_clean":"2023-12-08T08:21:17.686444+0000","last_became_active":"2023-12-08T08:21:17.682222+0000","last_became_peered":"2023-12-08T08:21:17.682222+0000","last_unstale":"2023-12-08T08:21:17.686444+0000","last_undegraded":"2023-12-08T08:21:17.686444+0000","last_fullsized":"2023-12-08T08:21:17.686444+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:49:31.201437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659513+0000","last_change":"2023-12-08T08:21:17.659513+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659513+0000","last_undegraded":"2023-12-08T08:21:17.659513+0000","last_fullsized":"2023-12-08T08:21:17.659513+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654403+0000","last_change":"2023-12-08T08:21:04.771189+0000","last_active":"2023-12-08T08:21:16.654403+0000","last_peered":"2023-12-08T08:21:16.654403+0000","last_clean":"2023-12-08T08:21:16.654403+0000","last_became_active":"2023-12-08T08:21:04.770913+0000","last_became_peered":"2023-12-08T08:21:04.770913+0000","last_unstale":"2023-12-08T08:21:16.654403+0000","last_undegraded":"2023-12-08T08:21:16.654403+0000","last_fullsized":"2023-12-08T08:21:16.654403+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:58:22.885070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.656834+0000","last_change":"2023-12-08T08:21:05.537968+0000","last_active":"2023-12-08T08:21:16.656834+0000","last_peered":"2023-12-08T08:21:16.656834+0000","last_clean":"2023-12-08T08:21:16.656834+0000","last_became_active":"2023-12-08T08:21:05.537190+0000","last_became_peered":"2023-12-08T08:21:05.537190+0000","last_unstale":"2023-12-08T08:21:16.656834+0000","last_undegraded":"2023-12-08T08:21:16.656834+0000","last_fullsized":"2023-12-08T08:21:16.656834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:49.782105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.689179+0000","last_change":"2023-12-08T08:21:17.684922+0000","last_active":"2023-12-08T08:21:17.689179+0000","last_peered":"2023-12-08T08:21:17.689179+0000","last_clean":"2023-12-08T08:21:17.689179+0000","last_became_active":"2023-12-08T08:21:17.684661+0000","last_became_peered":"2023-12-08T08:21:17.684661+0000","last_unstale":"2023-12-08T08:21:17.689179+0000","last_undegraded":"2023-12-08T08:21:17.689179+0000","last_fullsized":"2023-12-08T08:21:17.689179+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:42.863062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.656454+0000","last_change":"2023-12-08T08:21:17.656454+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.656454+0000","last_undegraded":"2023-12-08T08:21:17.656454+0000","last_fullsized":"2023-12-08T08:21:17.656454+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652074+0000","last_change":"2023-12-08T08:21:04.774731+0000","last_active":"2023-12-08T08:21:16.652074+0000","last_peered":"2023-12-08T08:21:16.652074+0000","last_clean":"2023-12-08T08:21:16.652074+0000","last_became_active":"2023-12-08T08:21:04.773894+0000","last_became_peered":"2023-12-08T08:21:04.773894+0000","last_unstale":"2023-12-08T08:21:16.652074+0000","last_undegraded":"2023-12-08T08:21:16.652074+0000","last_fullsized":"2023-12-08T08:21:16.652074+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:46.416448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652665+0000","last_change":"2023-12-08T08:21:05.540583+0000","last_active":"2023-12-08T08:21:16.652665+0000","last_peered":"2023-12-08T08:21:16.652665+0000","last_clean":"2023-12-08T08:21:16.652665+0000","last_became_active":"2023-12-08T08:21:05.540350+0000","last_became_peered":"2023-12-08T08:21:05.540350+0000","last_unstale":"2023-12-08T08:21:16.652665+0000","last_undegraded":"2023-12-08T08:21:16.652665+0000","last_fullsized":"2023-12-08T08:21:16.652665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:46:44.526151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.685385+0000","last_change":"2023-12-08T08:21:17.679399+0000","last_active":"2023-12-08T08:21:17.685385+0000","last_peered":"2023-12-08T08:21:17.685385+0000","last_clean":"2023-12-08T08:21:17.685385+0000","last_became_active":"2023-12-08T08:21:17.679103+0000","last_became_peered":"2023-12-08T08:21:17.679103+0000","last_unstale":"2023-12-08T08:21:17.685385+0000","last_undegraded":"2023-12-08T08:21:17.685385+0000","last_fullsized":"2023-12-08T08:21:17.685385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:11:38.595950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.662267+0000","last_change":"2023-12-08T08:21:17.662267+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.662267+0000","last_undegraded":"2023-12-08T08:21:17.662267+0000","last_fullsized":"2023-12-08T08:21:17.662267+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655121+0000","last_change":"2023-12-08T08:21:04.778519+0000","last_active":"2023-12-08T08:21:16.655121+0000","last_peered":"2023-12-08T08:21:16.655121+0000","last_clean":"2023-12-08T08:21:16.655121+0000","last_became_active":"2023-12-08T08:21:04.778208+0000","last_became_peered":"2023-12-08T08:21:04.778208+0000","last_unstale":"2023-12-08T08:21:16.655121+0000","last_undegraded":"2023-12-08T08:21:16.655121+0000","last_fullsized":"2023-12-08T08:21:16.655121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:36.535172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654305+0000","last_change":"2023-12-08T08:21:05.530364+0000","last_active":"2023-12-08T08:21:16.654305+0000","last_peered":"2023-12-08T08:21:16.654305+0000","last_clean":"2023-12-08T08:21:16.654305+0000","last_became_active":"2023-12-08T08:21:05.530046+0000","last_became_peered":"2023-12-08T08:21:05.530046+0000","last_unstale":"2023-12-08T08:21:16.654305+0000","last_undegraded":"2023-12-08T08:21:16.654305+0000","last_fullsized":"2023-12-08T08:21:16.654305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.368162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.684614+0000","last_change":"2023-12-08T08:21:17.680178+0000","last_active":"2023-12-08T08:21:17.684614+0000","last_peered":"2023-12-08T08:21:17.684614+0000","last_clean":"2023-12-08T08:21:17.684614+0000","last_became_active":"2023-12-08T08:21:17.679880+0000","last_became_peered":"2023-12-08T08:21:17.679880+0000","last_unstale":"2023-12-08T08:21:17.684614+0000","last_undegraded":"2023-12-08T08:21:17.684614+0000","last_fullsized":"2023-12-08T08:21:17.684614+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:54.148326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.673219+0000","last_change":"2023-12-08T08:21:17.673219+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.673219+0000","last_undegraded":"2023-12-08T08:21:17.673219+0000","last_fullsized":"2023-12-08T08:21:17.673219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648603+0000","last_change":"2023-12-08T08:21:04.771979+0000","last_active":"2023-12-08T08:21:16.648603+0000","last_peered":"2023-12-08T08:21:16.648603+0000","last_clean":"2023-12-08T08:21:16.648603+0000","last_became_active":"2023-12-08T08:21:04.771656+0000","last_became_peered":"2023-12-08T08:21:04.771656+0000","last_unstale":"2023-12-08T08:21:16.648603+0000","last_undegraded":"2023-12-08T08:21:16.648603+0000","last_fullsized":"2023-12-08T08:21:16.648603+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:46:43.523269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649282+0000","last_change":"2023-12-08T08:21:05.538591+0000","last_active":"2023-12-08T08:21:16.649282+0000","last_peered":"2023-12-08T08:21:16.649282+0000","last_clean":"2023-12-08T08:21:16.649282+0000","last_became_active":"2023-12-08T08:21:05.538303+0000","last_became_peered":"2023-12-08T08:21:05.538303+0000","last_unstale":"2023-12-08T08:21:16.649282+0000","last_undegraded":"2023-12-08T08:21:16.649282+0000","last_fullsized":"2023-12-08T08:21:16.649282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:45:35.860546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686482+0000","last_change":"2023-12-08T08:21:17.682782+0000","last_active":"2023-12-08T08:21:17.686482+0000","last_peered":"2023-12-08T08:21:17.686482+0000","last_clean":"2023-12-08T08:21:17.686482+0000","last_became_active":"2023-12-08T08:21:17.681371+0000","last_became_peered":"2023-12-08T08:21:17.681371+0000","last_unstale":"2023-12-08T08:21:17.686482+0000","last_undegraded":"2023-12-08T08:21:17.686482+0000","last_fullsized":"2023-12-08T08:21:17.686482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:41:10.487912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.657337+0000","last_change":"2023-12-08T08:21:17.657337+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.657337+0000","last_undegraded":"2023-12-08T08:21:17.657337+0000","last_fullsized":"2023-12-08T08:21:17.657337+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.650676+0000","last_change":"2023-12-08T08:21:04.776313+0000","last_active":"2023-12-08T08:21:16.650676+0000","last_peered":"2023-12-08T08:21:16.650676+0000","last_clean":"2023-12-08T08:21:16.650676+0000","last_became_active":"2023-12-08T08:21:04.775894+0000","last_became_peered":"2023-12-08T08:21:04.775894+0000","last_unstale":"2023-12-08T08:21:16.650676+0000","last_undegraded":"2023-12-08T08:21:16.650676+0000","last_fullsized":"2023-12-08T08:21:16.650676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:13.006406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649886+0000","last_change":"2023-12-08T08:21:05.537164+0000","last_active":"2023-12-08T08:21:16.649886+0000","last_peered":"2023-12-08T08:21:16.649886+0000","last_clean":"2023-12-08T08:21:16.649886+0000","last_became_active":"2023-12-08T08:21:05.536915+0000","last_became_peered":"2023-12-08T08:21:05.536915+0000","last_unstale":"2023-12-08T08:21:16.649886+0000","last_undegraded":"2023-12-08T08:21:16.649886+0000","last_fullsized":"2023-12-08T08:21:16.649886+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:14.009289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.676342+0000","last_change":"2023-12-08T08:21:17.673958+0000","last_active":"2023-12-08T08:21:17.676342+0000","last_peered":"2023-12-08T08:21:17.676342+0000","last_clean":"2023-12-08T08:21:17.676342+0000","last_became_active":"2023-12-08T08:21:17.673637+0000","last_became_peered":"2023-12-08T08:21:17.673637+0000","last_unstale":"2023-12-08T08:21:17.676342+0000","last_undegraded":"2023-12-08T08:21:17.676342+0000","last_fullsized":"2023-12-08T08:21:17.676342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:54.148326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659996+0000","last_change":"2023-12-08T08:21:17.659996+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659996+0000","last_undegraded":"2023-12-08T08:21:17.659996+0000","last_fullsized":"2023-12-08T08:21:17.659996+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654170+0000","last_change":"2023-12-08T08:21:04.768985+0000","last_active":"2023-12-08T08:21:16.654170+0000","last_peered":"2023-12-08T08:21:16.654170+0000","last_clean":"2023-12-08T08:21:16.654170+0000","last_became_active":"2023-12-08T08:21:04.768693+0000","last_became_peered":"2023-12-08T08:21:04.768693+0000","last_unstale":"2023-12-08T08:21:16.654170+0000","last_undegraded":"2023-12-08T08:21:16.654170+0000","last_fullsized":"2023-12-08T08:21:16.654170+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:29.810210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649619+0000","last_change":"2023-12-08T08:21:05.542434+0000","last_active":"2023-12-08T08:21:16.649619+0000","last_peered":"2023-12-08T08:21:16.649619+0000","last_clean":"2023-12-08T08:21:16.649619+0000","last_became_active":"2023-12-08T08:21:05.542218+0000","last_became_peered":"2023-12-08T08:21:05.542218+0000","last_unstale":"2023-12-08T08:21:16.649619+0000","last_undegraded":"2023-12-08T08:21:16.649619+0000","last_fullsized":"2023-12-08T08:21:16.649619+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:16:19.580755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.674800+0000","last_change":"2023-12-08T08:21:17.668067+0000","last_active":"2023-12-08T08:21:17.674800+0000","last_peered":"2023-12-08T08:21:17.674800+0000","last_clean":"2023-12-08T08:21:17.674800+0000","last_became_active":"2023-12-08T08:21:17.667751+0000","last_became_peered":"2023-12-08T08:21:17.667751+0000","last_unstale":"2023-12-08T08:21:17.674800+0000","last_undegraded":"2023-12-08T08:21:17.674800+0000","last_fullsized":"2023-12-08T08:21:17.674800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:25.581863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.657341+0000","last_change":"2023-12-08T08:21:17.657341+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.657341+0000","last_undegraded":"2023-12-08T08:21:17.657341+0000","last_fullsized":"2023-12-08T08:21:17.657341+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648875+0000","last_change":"2023-12-08T08:21:04.775274+0000","last_active":"2023-12-08T08:21:16.648875+0000","last_peered":"2023-12-08T08:21:16.648875+0000","last_clean":"2023-12-08T08:21:16.648875+0000","last_became_active":"2023-12-08T08:21:04.774961+0000","last_became_peered":"2023-12-08T08:21:04.774961+0000","last_unstale":"2023-12-08T08:21:16.648875+0000","last_undegraded":"2023-12-08T08:21:16.648875+0000","last_fullsized":"2023-12-08T08:21:16.648875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:03.400233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652649+0000","last_change":"2023-12-08T08:21:05.534904+0000","last_active":"2023-12-08T08:21:16.652649+0000","last_peered":"2023-12-08T08:21:16.652649+0000","last_clean":"2023-12-08T08:21:16.652649+0000","last_became_active":"2023-12-08T08:21:05.534637+0000","last_became_peered":"2023-12-08T08:21:05.534637+0000","last_unstale":"2023-12-08T08:21:16.652649+0000","last_undegraded":"2023-12-08T08:21:16.652649+0000","last_fullsized":"2023-12-08T08:21:16.652649+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:40:41.034391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686389+0000","last_change":"2023-12-08T08:21:17.682559+0000","last_active":"2023-12-08T08:21:17.686389+0000","last_peered":"2023-12-08T08:21:17.686389+0000","last_clean":"2023-12-08T08:21:17.686389+0000","last_became_active":"2023-12-08T08:21:17.675578+0000","last_became_peered":"2023-12-08T08:21:17.675578+0000","last_unstale":"2023-12-08T08:21:17.686389+0000","last_undegraded":"2023-12-08T08:21:17.686389+0000","last_fullsized":"2023-12-08T08:21:17.686389+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:46:01.671872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.658216+0000","last_change":"2023-12-08T08:21:17.658216+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.658216+0000","last_undegraded":"2023-12-08T08:21:17.658216+0000","last_fullsized":"2023-12-08T08:21:17.658216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649140+0000","last_change":"2023-12-08T08:21:04.770820+0000","last_active":"2023-12-08T08:21:16.649140+0000","last_peered":"2023-12-08T08:21:16.649140+0000","last_clean":"2023-12-08T08:21:16.649140+0000","last_became_active":"2023-12-08T08:21:04.767804+0000","last_became_peered":"2023-12-08T08:21:04.767804+0000","last_unstale":"2023-12-08T08:21:16.649140+0000","last_undegraded":"2023-12-08T08:21:16.649140+0000","last_fullsized":"2023-12-08T08:21:16.649140+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:58:22.885070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651163+0000","last_change":"2023-12-08T08:21:05.521567+0000","last_active":"2023-12-08T08:21:16.651163+0000","last_peered":"2023-12-08T08:21:16.651163+0000","last_clean":"2023-12-08T08:21:16.651163+0000","last_became_active":"2023-12-08T08:21:05.521289+0000","last_became_peered":"2023-12-08T08:21:05.521289+0000","last_unstale":"2023-12-08T08:21:16.651163+0000","last_undegraded":"2023-12-08T08:21:16.651163+0000","last_fullsized":"2023-12-08T08:21:16.651163+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:11.477913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.689245+0000","last_change":"2023-12-08T08:21:17.683937+0000","last_active":"2023-12-08T08:21:17.689245+0000","last_peered":"2023-12-08T08:21:17.689245+0000","last_clean":"2023-12-08T08:21:17.689245+0000","last_became_active":"2023-12-08T08:21:17.683574+0000","last_became_peered":"2023-12-08T08:21:17.683574+0000","last_unstale":"2023-12-08T08:21:17.689245+0000","last_undegraded":"2023-12-08T08:21:17.689245+0000","last_fullsized":"2023-12-08T08:21:17.689245+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:58:35.777720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.662363+0000","last_change":"2023-12-08T08:21:17.662363+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.662363+0000","last_undegraded":"2023-12-08T08:21:17.662363+0000","last_fullsized":"2023-12-08T08:21:17.662363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649148+0000","last_change":"2023-12-08T08:21:04.776652+0000","last_active":"2023-12-08T08:21:16.649148+0000","last_peered":"2023-12-08T08:21:16.649148+0000","last_clean":"2023-12-08T08:21:16.649148+0000","last_became_active":"2023-12-08T08:21:04.776345+0000","last_became_peered":"2023-12-08T08:21:04.776345+0000","last_unstale":"2023-12-08T08:21:16.649148+0000","last_undegraded":"2023-12-08T08:21:16.649148+0000","last_fullsized":"2023-12-08T08:21:16.649148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:46.416448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.656832+0000","last_change":"2023-12-08T08:21:05.538159+0000","last_active":"2023-12-08T08:21:16.656832+0000","last_peered":"2023-12-08T08:21:16.656832+0000","last_clean":"2023-12-08T08:21:16.656832+0000","last_became_active":"2023-12-08T08:21:05.537601+0000","last_became_peered":"2023-12-08T08:21:05.537601+0000","last_unstale":"2023-12-08T08:21:16.656832+0000","last_undegraded":"2023-12-08T08:21:16.656832+0000","last_fullsized":"2023-12-08T08:21:16.656832+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:09:56.356105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.680296+0000","last_change":"2023-12-08T08:21:17.675955+0000","last_active":"2023-12-08T08:21:17.680296+0000","last_peered":"2023-12-08T08:21:17.680296+0000","last_clean":"2023-12-08T08:21:17.680296+0000","last_became_active":"2023-12-08T08:21:17.675547+0000","last_became_peered":"2023-12-08T08:21:17.675547+0000","last_unstale":"2023-12-08T08:21:17.680296+0000","last_undegraded":"2023-12-08T08:21:17.680296+0000","last_fullsized":"2023-12-08T08:21:17.680296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:59.826879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.662129+0000","last_change":"2023-12-08T08:21:17.662129+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.662129+0000","last_undegraded":"2023-12-08T08:21:17.662129+0000","last_fullsized":"2023-12-08T08:21:17.662129+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651983+0000","last_change":"2023-12-08T08:21:04.785414+0000","last_active":"2023-12-08T08:21:16.651983+0000","last_peered":"2023-12-08T08:21:16.651983+0000","last_clean":"2023-12-08T08:21:16.651983+0000","last_became_active":"2023-12-08T08:21:04.785198+0000","last_became_peered":"2023-12-08T08:21:04.785198+0000","last_unstale":"2023-12-08T08:21:16.651983+0000","last_undegraded":"2023-12-08T08:21:16.651983+0000","last_fullsized":"2023-12-08T08:21:16.651983+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:03.400233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649085+0000","last_change":"2023-12-08T08:21:05.537706+0000","last_active":"2023-12-08T08:21:16.649085+0000","last_peered":"2023-12-08T08:21:16.649085+0000","last_clean":"2023-12-08T08:21:16.649085+0000","last_became_active":"2023-12-08T08:21:05.537282+0000","last_became_peered":"2023-12-08T08:21:05.537282+0000","last_unstale":"2023-12-08T08:21:16.649085+0000","last_undegraded":"2023-12-08T08:21:16.649085+0000","last_fullsized":"2023-12-08T08:21:16.649085+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:13.692096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.687157+0000","last_change":"2023-12-08T08:21:17.685511+0000","last_active":"2023-12-08T08:21:17.687157+0000","last_peered":"2023-12-08T08:21:17.687157+0000","last_clean":"2023-12-08T08:21:17.687157+0000","last_became_active":"2023-12-08T08:21:17.685173+0000","last_became_peered":"2023-12-08T08:21:17.685173+0000","last_unstale":"2023-12-08T08:21:17.687157+0000","last_undegraded":"2023-12-08T08:21:17.687157+0000","last_fullsized":"2023-12-08T08:21:17.687157+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:55:55.550300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.658627+0000","last_change":"2023-12-08T08:21:17.658627+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.658627+0000","last_undegraded":"2023-12-08T08:21:17.658627+0000","last_fullsized":"2023-12-08T08:21:17.658627+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643854+0000","last_change":"2023-12-08T08:21:04.775742+0000","last_active":"2023-12-08T08:21:16.643854+0000","last_peered":"2023-12-08T08:21:16.643854+0000","last_clean":"2023-12-08T08:21:16.643854+0000","last_became_active":"2023-12-08T08:21:04.775482+0000","last_became_peered":"2023-12-08T08:21:04.775482+0000","last_unstale":"2023-12-08T08:21:16.643854+0000","last_undegraded":"2023-12-08T08:21:16.643854+0000","last_fullsized":"2023-12-08T08:21:16.643854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:46.416448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.650561+0000","last_change":"2023-12-08T08:21:05.528065+0000","last_active":"2023-12-08T08:21:16.650561+0000","last_peered":"2023-12-08T08:21:16.650561+0000","last_clean":"2023-12-08T08:21:16.650561+0000","last_became_active":"2023-12-08T08:21:05.527792+0000","last_became_peered":"2023-12-08T08:21:05.527792+0000","last_unstale":"2023-12-08T08:21:16.650561+0000","last_undegraded":"2023-12-08T08:21:16.650561+0000","last_fullsized":"2023-12-08T08:21:16.650561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:51:06.333206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.683125+0000","last_change":"2023-12-08T08:21:17.677690+0000","last_active":"2023-12-08T08:21:17.683125+0000","last_peered":"2023-12-08T08:21:17.683125+0000","last_clean":"2023-12-08T08:21:17.683125+0000","last_became_active":"2023-12-08T08:21:17.677376+0000","last_became_peered":"2023-12-08T08:21:17.677376+0000","last_unstale":"2023-12-08T08:21:17.683125+0000","last_undegraded":"2023-12-08T08:21:17.683125+0000","last_fullsized":"2023-12-08T08:21:17.683125+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:55:55.550300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661062+0000","last_change":"2023-12-08T08:21:17.661062+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661062+0000","last_undegraded":"2023-12-08T08:21:17.661062+0000","last_fullsized":"2023-12-08T08:21:17.661062+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643764+0000","last_change":"2023-12-08T08:21:04.781520+0000","last_active":"2023-12-08T08:21:16.643764+0000","last_peered":"2023-12-08T08:21:16.643764+0000","last_clean":"2023-12-08T08:21:16.643764+0000","last_became_active":"2023-12-08T08:21:04.781236+0000","last_became_peered":"2023-12-08T08:21:04.781236+0000","last_unstale":"2023-12-08T08:21:16.643764+0000","last_undegraded":"2023-12-08T08:21:16.643764+0000","last_fullsized":"2023-12-08T08:21:16.643764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:14:17.281881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.653811+0000","last_change":"2023-12-08T08:21:05.544369+0000","last_active":"2023-12-08T08:21:16.653811+0000","last_peered":"2023-12-08T08:21:16.653811+0000","last_clean":"2023-12-08T08:21:16.653811+0000","last_became_active":"2023-12-08T08:21:05.544090+0000","last_became_peered":"2023-12-08T08:21:05.544090+0000","last_unstale":"2023-12-08T08:21:16.653811+0000","last_undegraded":"2023-12-08T08:21:16.653811+0000","last_fullsized":"2023-12-08T08:21:16.653811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:25.239396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.685476+0000","last_change":"2023-12-08T08:21:17.681233+0000","last_active":"2023-12-08T08:21:17.685476+0000","last_peered":"2023-12-08T08:21:17.685476+0000","last_clean":"2023-12-08T08:21:17.685476+0000","last_became_active":"2023-12-08T08:21:17.680645+0000","last_became_peered":"2023-12-08T08:21:17.680645+0000","last_unstale":"2023-12-08T08:21:17.685476+0000","last_undegraded":"2023-12-08T08:21:17.685476+0000","last_fullsized":"2023-12-08T08:21:17.685476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:50:42.502393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661129+0000","last_change":"2023-12-08T08:21:17.661129+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661129+0000","last_undegraded":"2023-12-08T08:21:17.661129+0000","last_fullsized":"2023-12-08T08:21:17.661129+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652680+0000","last_change":"2023-12-08T08:21:04.778563+0000","last_active":"2023-12-08T08:21:16.652680+0000","last_peered":"2023-12-08T08:21:16.652680+0000","last_clean":"2023-12-08T08:21:16.652680+0000","last_became_active":"2023-12-08T08:21:04.778275+0000","last_became_peered":"2023-12-08T08:21:04.778275+0000","last_unstale":"2023-12-08T08:21:16.652680+0000","last_undegraded":"2023-12-08T08:21:16.652680+0000","last_fullsized":"2023-12-08T08:21:16.652680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:45:05.142948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644069+0000","last_change":"2023-12-08T08:21:05.528470+0000","last_active":"2023-12-08T08:21:16.644069+0000","last_peered":"2023-12-08T08:21:16.644069+0000","last_clean":"2023-12-08T08:21:16.644069+0000","last_became_active":"2023-12-08T08:21:05.528125+0000","last_became_peered":"2023-12-08T08:21:05.528125+0000","last_unstale":"2023-12-08T08:21:16.644069+0000","last_undegraded":"2023-12-08T08:21:16.644069+0000","last_fullsized":"2023-12-08T08:21:16.644069+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.368162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.675089+0000","last_change":"2023-12-08T08:21:17.670281+0000","last_active":"2023-12-08T08:21:17.675089+0000","last_peered":"2023-12-08T08:21:17.675089+0000","last_clean":"2023-12-08T08:21:17.675089+0000","last_became_active":"2023-12-08T08:21:17.670085+0000","last_became_peered":"2023-12-08T08:21:17.670085+0000","last_unstale":"2023-12-08T08:21:17.675089+0000","last_undegraded":"2023-12-08T08:21:17.675089+0000","last_fullsized":"2023-12-08T08:21:17.675089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:20.486293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.667977+0000","last_change":"2023-12-08T08:21:17.667977+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.667977+0000","last_undegraded":"2023-12-08T08:21:17.667977+0000","last_fullsized":"2023-12-08T08:21:17.667977+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648818+0000","last_change":"2023-12-08T08:21:04.773643+0000","last_active":"2023-12-08T08:21:16.648818+0000","last_peered":"2023-12-08T08:21:16.648818+0000","last_clean":"2023-12-08T08:21:16.648818+0000","last_became_active":"2023-12-08T08:21:04.773361+0000","last_became_peered":"2023-12-08T08:21:04.773361+0000","last_unstale":"2023-12-08T08:21:16.648818+0000","last_undegraded":"2023-12-08T08:21:16.648818+0000","last_fullsized":"2023-12-08T08:21:16.648818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:08.017533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652611+0000","last_change":"2023-12-08T08:21:05.543017+0000","last_active":"2023-12-08T08:21:16.652611+0000","last_peered":"2023-12-08T08:21:16.652611+0000","last_clean":"2023-12-08T08:21:16.652611+0000","last_became_active":"2023-12-08T08:21:05.542729+0000","last_became_peered":"2023-12-08T08:21:05.542729+0000","last_unstale":"2023-12-08T08:21:16.652611+0000","last_undegraded":"2023-12-08T08:21:16.652611+0000","last_fullsized":"2023-12-08T08:21:16.652611+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:19.928543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.680377+0000","last_change":"2023-12-08T08:21:17.672426+0000","last_active":"2023-12-08T08:21:17.680377+0000","last_peered":"2023-12-08T08:21:17.680377+0000","last_clean":"2023-12-08T08:21:17.680377+0000","last_became_active":"2023-12-08T08:21:17.672079+0000","last_became_peered":"2023-12-08T08:21:17.672079+0000","last_unstale":"2023-12-08T08:21:17.680377+0000","last_undegraded":"2023-12-08T08:21:17.680377+0000","last_fullsized":"2023-12-08T08:21:17.680377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:11:38.595950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.660226+0000","last_change":"2023-12-08T08:21:17.660226+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.660226+0000","last_undegraded":"2023-12-08T08:21:17.660226+0000","last_fullsized":"2023-12-08T08:21:17.660226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"31'8","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644372+0000","last_change":"2023-12-08T08:21:04.778814+0000","last_active":"2023-12-08T08:21:16.644372+0000","last_peered":"2023-12-08T08:21:16.644372+0000","last_clean":"2023-12-08T08:21:16.644372+0000","last_became_active":"2023-12-08T08:21:04.778501+0000","last_became_peered":"2023-12-08T08:21:04.778501+0000","last_unstale":"2023-12-08T08:21:16.644372+0000","last_undegraded":"2023-12-08T08:21:16.644372+0000","last_fullsized":"2023-12-08T08:21:16.644372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:50:52.651732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655964+0000","last_change":"2023-12-08T08:21:05.540670+0000","last_active":"2023-12-08T08:21:16.655964+0000","last_peered":"2023-12-08T08:21:16.655964+0000","last_clean":"2023-12-08T08:21:16.655964+0000","last_became_active":"2023-12-08T08:21:05.539546+0000","last_became_peered":"2023-12-08T08:21:05.539546+0000","last_unstale":"2023-12-08T08:21:16.655964+0000","last_undegraded":"2023-12-08T08:21:16.655964+0000","last_fullsized":"2023-12-08T08:21:16.655964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:20:39.875619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.678590+0000","last_change":"2023-12-08T08:21:17.668240+0000","last_active":"2023-12-08T08:21:17.678590+0000","last_peered":"2023-12-08T08:21:17.678590+0000","last_clean":"2023-12-08T08:21:17.678590+0000","last_became_active":"2023-12-08T08:21:17.667990+0000","last_became_peered":"2023-12-08T08:21:17.667990+0000","last_unstale":"2023-12-08T08:21:17.678590+0000","last_undegraded":"2023-12-08T08:21:17.678590+0000","last_fullsized":"2023-12-08T08:21:17.678590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:54.911358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.656815+0000","last_change":"2023-12-08T08:21:17.656815+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.656815+0000","last_undegraded":"2023-12-08T08:21:17.656815+0000","last_fullsized":"2023-12-08T08:21:17.656815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.656147+0000","last_change":"2023-12-08T08:21:04.782195+0000","last_active":"2023-12-08T08:21:16.656147+0000","last_peered":"2023-12-08T08:21:16.656147+0000","last_clean":"2023-12-08T08:21:16.656147+0000","last_became_active":"2023-12-08T08:21:04.781298+0000","last_became_peered":"2023-12-08T08:21:04.781298+0000","last_unstale":"2023-12-08T08:21:16.656147+0000","last_undegraded":"2023-12-08T08:21:16.656147+0000","last_fullsized":"2023-12-08T08:21:16.656147+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:12.689213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644226+0000","last_change":"2023-12-08T08:21:05.532372+0000","last_active":"2023-12-08T08:21:16.644226+0000","last_peered":"2023-12-08T08:21:16.644226+0000","last_clean":"2023-12-08T08:21:16.644226+0000","last_became_active":"2023-12-08T08:21:05.531767+0000","last_became_peered":"2023-12-08T08:21:05.531767+0000","last_unstale":"2023-12-08T08:21:16.644226+0000","last_undegraded":"2023-12-08T08:21:16.644226+0000","last_fullsized":"2023-12-08T08:21:16.644226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:30.973295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686218+0000","last_change":"2023-12-08T08:21:17.682631+0000","last_active":"2023-12-08T08:21:17.686218+0000","last_peered":"2023-12-08T08:21:17.686218+0000","last_clean":"2023-12-08T08:21:17.686218+0000","last_became_active":"2023-12-08T08:21:17.677727+0000","last_became_peered":"2023-12-08T08:21:17.677727+0000","last_unstale":"2023-12-08T08:21:17.686218+0000","last_undegraded":"2023-12-08T08:21:17.686218+0000","last_fullsized":"2023-12-08T08:21:17.686218+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:10:08.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661135+0000","last_change":"2023-12-08T08:21:17.661135+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661135+0000","last_undegraded":"2023-12-08T08:21:17.661135+0000","last_fullsized":"2023-12-08T08:21:17.661135+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654331+0000","last_change":"2023-12-08T08:21:04.786064+0000","last_active":"2023-12-08T08:21:16.654331+0000","last_peered":"2023-12-08T08:21:16.654331+0000","last_clean":"2023-12-08T08:21:16.654331+0000","last_became_active":"2023-12-08T08:21:04.785859+0000","last_became_peered":"2023-12-08T08:21:04.785859+0000","last_unstale":"2023-12-08T08:21:16.654331+0000","last_undegraded":"2023-12-08T08:21:16.654331+0000","last_fullsized":"2023-12-08T08:21:16.654331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:12.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644317+0000","last_change":"2023-12-08T08:21:05.532644+0000","last_active":"2023-12-08T08:21:16.644317+0000","last_peered":"2023-12-08T08:21:16.644317+0000","last_clean":"2023-12-08T08:21:16.644317+0000","last_became_active":"2023-12-08T08:21:05.530404+0000","last_became_peered":"2023-12-08T08:21:05.530404+0000","last_unstale":"2023-12-08T08:21:16.644317+0000","last_undegraded":"2023-12-08T08:21:16.644317+0000","last_fullsized":"2023-12-08T08:21:16.644317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:05:11.193024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.684441+0000","last_change":"2023-12-08T08:21:17.677740+0000","last_active":"2023-12-08T08:21:17.684441+0000","last_peered":"2023-12-08T08:21:17.684441+0000","last_clean":"2023-12-08T08:21:17.684441+0000","last_became_active":"2023-12-08T08:21:17.672121+0000","last_became_peered":"2023-12-08T08:21:17.672121+0000","last_unstale":"2023-12-08T08:21:17.684441+0000","last_undegraded":"2023-12-08T08:21:17.684441+0000","last_fullsized":"2023-12-08T08:21:17.684441+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:20.910184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.664339+0000","last_change":"2023-12-08T08:21:17.664339+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.664339+0000","last_undegraded":"2023-12-08T08:21:17.664339+0000","last_fullsized":"2023-12-08T08:21:17.664339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644467+0000","last_change":"2023-12-08T08:21:04.782800+0000","last_active":"2023-12-08T08:21:16.644467+0000","last_peered":"2023-12-08T08:21:16.644467+0000","last_clean":"2023-12-08T08:21:16.644467+0000","last_became_active":"2023-12-08T08:21:04.782531+0000","last_became_peered":"2023-12-08T08:21:04.782531+0000","last_unstale":"2023-12-08T08:21:16.644467+0000","last_undegraded":"2023-12-08T08:21:16.644467+0000","last_fullsized":"2023-12-08T08:21:16.644467+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:42.018708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.656002+0000","last_change":"2023-12-08T08:21:05.533947+0000","last_active":"2023-12-08T08:21:16.656002+0000","last_peered":"2023-12-08T08:21:16.656002+0000","last_clean":"2023-12-08T08:21:16.656002+0000","last_became_active":"2023-12-08T08:21:05.533554+0000","last_became_peered":"2023-12-08T08:21:05.533554+0000","last_unstale":"2023-12-08T08:21:16.656002+0000","last_undegraded":"2023-12-08T08:21:16.656002+0000","last_fullsized":"2023-12-08T08:21:16.656002+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:25.239396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.685462+0000","last_change":"2023-12-08T08:21:17.679519+0000","last_active":"2023-12-08T08:21:17.685462+0000","last_peered":"2023-12-08T08:21:17.685462+0000","last_clean":"2023-12-08T08:21:17.685462+0000","last_became_active":"2023-12-08T08:21:17.679265+0000","last_became_peered":"2023-12-08T08:21:17.679265+0000","last_unstale":"2023-12-08T08:21:17.685462+0000","last_undegraded":"2023-12-08T08:21:17.685462+0000","last_fullsized":"2023-12-08T08:21:17.685462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:12.057342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659167+0000","last_change":"2023-12-08T08:21:17.659167+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659167+0000","last_undegraded":"2023-12-08T08:21:17.659167+0000","last_fullsized":"2023-12-08T08:21:17.659167+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648603+0000","last_change":"2023-12-08T08:21:04.776553+0000","last_active":"2023-12-08T08:21:16.648603+0000","last_peered":"2023-12-08T08:21:16.648603+0000","last_clean":"2023-12-08T08:21:16.648603+0000","last_became_active":"2023-12-08T08:21:04.773755+0000","last_became_peered":"2023-12-08T08:21:04.773755+0000","last_unstale":"2023-12-08T08:21:16.648603+0000","last_undegraded":"2023-12-08T08:21:16.648603+0000","last_fullsized":"2023-12-08T08:21:16.648603+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:12.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651140+0000","last_change":"2023-12-08T08:21:05.536397+0000","last_active":"2023-12-08T08:21:16.651140+0000","last_peered":"2023-12-08T08:21:16.651140+0000","last_clean":"2023-12-08T08:21:16.651140+0000","last_became_active":"2023-12-08T08:21:05.536103+0000","last_became_peered":"2023-12-08T08:21:05.536103+0000","last_unstale":"2023-12-08T08:21:16.651140+0000","last_undegraded":"2023-12-08T08:21:16.651140+0000","last_fullsized":"2023-12-08T08:21:16.651140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:44.030312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.674675+0000","last_change":"2023-12-08T08:21:17.671190+0000","last_active":"2023-12-08T08:21:17.674675+0000","last_peered":"2023-12-08T08:21:17.674675+0000","last_clean":"2023-12-08T08:21:17.674675+0000","last_became_active":"2023-12-08T08:21:17.670895+0000","last_became_peered":"2023-12-08T08:21:17.670895+0000","last_unstale":"2023-12-08T08:21:17.674675+0000","last_undegraded":"2023-12-08T08:21:17.674675+0000","last_fullsized":"2023-12-08T08:21:17.674675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:42.863062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.655881+0000","last_change":"2023-12-08T08:21:17.655881+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.655881+0000","last_undegraded":"2023-12-08T08:21:17.655881+0000","last_fullsized":"2023-12-08T08:21:17.655881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643850+0000","last_change":"2023-12-08T08:21:04.780723+0000","last_active":"2023-12-08T08:21:16.643850+0000","last_peered":"2023-12-08T08:21:16.643850+0000","last_clean":"2023-12-08T08:21:16.643850+0000","last_became_active":"2023-12-08T08:21:04.780436+0000","last_became_peered":"2023-12-08T08:21:04.780436+0000","last_unstale":"2023-12-08T08:21:16.643850+0000","last_undegraded":"2023-12-08T08:21:16.643850+0000","last_fullsized":"2023-12-08T08:21:16.643850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:12.689213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648504+0000","last_change":"2023-12-08T08:21:05.535708+0000","last_active":"2023-12-08T08:21:16.648504+0000","last_peered":"2023-12-08T08:21:16.648504+0000","last_clean":"2023-12-08T08:21:16.648504+0000","last_became_active":"2023-12-08T08:21:05.527959+0000","last_became_peered":"2023-12-08T08:21:05.527959+0000","last_unstale":"2023-12-08T08:21:16.648504+0000","last_undegraded":"2023-12-08T08:21:16.648504+0000","last_fullsized":"2023-12-08T08:21:16.648504+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:14:18.284764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.685488+0000","last_change":"2023-12-08T08:21:17.681447+0000","last_active":"2023-12-08T08:21:17.685488+0000","last_peered":"2023-12-08T08:21:17.685488+0000","last_clean":"2023-12-08T08:21:17.685488+0000","last_became_active":"2023-12-08T08:21:17.680989+0000","last_became_peered":"2023-12-08T08:21:17.680989+0000","last_unstale":"2023-12-08T08:21:17.685488+0000","last_undegraded":"2023-12-08T08:21:17.685488+0000","last_fullsized":"2023-12-08T08:21:17.685488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:24.695194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661815+0000","last_change":"2023-12-08T08:21:17.661815+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661815+0000","last_undegraded":"2023-12-08T08:21:17.661815+0000","last_fullsized":"2023-12-08T08:21:17.661815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649335+0000","last_change":"2023-12-08T08:21:04.783596+0000","last_active":"2023-12-08T08:21:16.649335+0000","last_peered":"2023-12-08T08:21:16.649335+0000","last_clean":"2023-12-08T08:21:16.649335+0000","last_became_active":"2023-12-08T08:21:04.783159+0000","last_became_peered":"2023-12-08T08:21:04.783159+0000","last_unstale":"2023-12-08T08:21:16.649335+0000","last_undegraded":"2023-12-08T08:21:16.649335+0000","last_fullsized":"2023-12-08T08:21:16.649335+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:43.027429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655533+0000","last_change":"2023-12-08T08:21:05.537414+0000","last_active":"2023-12-08T08:21:16.655533+0000","last_peered":"2023-12-08T08:21:16.655533+0000","last_clean":"2023-12-08T08:21:16.655533+0000","last_became_active":"2023-12-08T08:21:05.537137+0000","last_became_peered":"2023-12-08T08:21:05.537137+0000","last_unstale":"2023-12-08T08:21:16.655533+0000","last_undegraded":"2023-12-08T08:21:16.655533+0000","last_fullsized":"2023-12-08T08:21:16.655533+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:08.596525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.677172+0000","last_change":"2023-12-08T08:21:17.676027+0000","last_active":"2023-12-08T08:21:17.677172+0000","last_peered":"2023-12-08T08:21:17.677172+0000","last_clean":"2023-12-08T08:21:17.677172+0000","last_became_active":"2023-12-08T08:21:17.675823+0000","last_became_peered":"2023-12-08T08:21:17.675823+0000","last_unstale":"2023-12-08T08:21:17.677172+0000","last_undegraded":"2023-12-08T08:21:17.677172+0000","last_fullsized":"2023-12-08T08:21:17.677172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:14:30.174532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.656636+0000","last_change":"2023-12-08T08:21:17.656636+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.656636+0000","last_undegraded":"2023-12-08T08:21:17.656636+0000","last_fullsized":"2023-12-08T08:21:17.656636+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648820+0000","last_change":"2023-12-08T08:21:04.784944+0000","last_active":"2023-12-08T08:21:16.648820+0000","last_peered":"2023-12-08T08:21:16.648820+0000","last_clean":"2023-12-08T08:21:16.648820+0000","last_became_active":"2023-12-08T08:21:04.784657+0000","last_became_peered":"2023-12-08T08:21:04.784657+0000","last_unstale":"2023-12-08T08:21:16.648820+0000","last_undegraded":"2023-12-08T08:21:16.648820+0000","last_fullsized":"2023-12-08T08:21:16.648820+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:51:05.330323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654537+0000","last_change":"2023-12-08T08:21:05.542808+0000","last_active":"2023-12-08T08:21:16.654537+0000","last_peered":"2023-12-08T08:21:16.654537+0000","last_clean":"2023-12-08T08:21:16.654537+0000","last_became_active":"2023-12-08T08:21:05.542495+0000","last_became_peered":"2023-12-08T08:21:05.542495+0000","last_unstale":"2023-12-08T08:21:16.654537+0000","last_undegraded":"2023-12-08T08:21:16.654537+0000","last_fullsized":"2023-12-08T08:21:16.654537+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:50:53.654615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.684879+0000","last_change":"2023-12-08T08:21:17.681699+0000","last_active":"2023-12-08T08:21:17.684879+0000","last_peered":"2023-12-08T08:21:17.684879+0000","last_clean":"2023-12-08T08:21:17.684879+0000","last_became_active":"2023-12-08T08:21:17.681356+0000","last_became_peered":"2023-12-08T08:21:17.681356+0000","last_unstale":"2023-12-08T08:21:17.684879+0000","last_undegraded":"2023-12-08T08:21:17.684879+0000","last_fullsized":"2023-12-08T08:21:17.684879+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:31:02.865086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.664497+0000","last_change":"2023-12-08T08:21:17.664497+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.664497+0000","last_undegraded":"2023-12-08T08:21:17.664497+0000","last_fullsized":"2023-12-08T08:21:17.664497+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.682731+0000","last_change":"2023-12-08T08:21:17.674547+0000","last_active":"2023-12-08T08:21:17.682731+0000","last_peered":"2023-12-08T08:21:17.682731+0000","last_clean":"2023-12-08T08:21:17.682731+0000","last_became_active":"2023-12-08T08:21:17.674313+0000","last_became_peered":"2023-12-08T08:21:17.674313+0000","last_unstale":"2023-12-08T08:21:17.682731+0000","last_undegraded":"2023-12-08T08:21:17.682731+0000","last_fullsized":"2023-12-08T08:21:17.682731+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:17.857771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652533+0000","last_change":"2023-12-08T08:21:04.773475+0000","last_active":"2023-12-08T08:21:16.652533+0000","last_peered":"2023-12-08T08:21:16.652533+0000","last_clean":"2023-12-08T08:21:16.652533+0000","last_became_active":"2023-12-08T08:21:04.773125+0000","last_became_peered":"2023-12-08T08:21:04.773125+0000","last_unstale":"2023-12-08T08:21:16.652533+0000","last_undegraded":"2023-12-08T08:21:16.652533+0000","last_fullsized":"2023-12-08T08:21:16.652533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:00:34.107681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652344+0000","last_change":"2023-12-08T08:21:05.527749+0000","last_active":"2023-12-08T08:21:16.652344+0000","last_peered":"2023-12-08T08:21:16.652344+0000","last_clean":"2023-12-08T08:21:16.652344+0000","last_became_active":"2023-12-08T08:21:05.527397+0000","last_became_peered":"2023-12-08T08:21:05.527397+0000","last_unstale":"2023-12-08T08:21:16.652344+0000","last_undegraded":"2023-12-08T08:21:16.652344+0000","last_fullsized":"2023-12-08T08:21:16.652344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:13.692096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.662777+0000","last_change":"2023-12-08T08:21:17.662777+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.662777+0000","last_undegraded":"2023-12-08T08:21:17.662777+0000","last_fullsized":"2023-12-08T08:21:17.662777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686471+0000","last_change":"2023-12-08T08:21:17.682288+0000","last_active":"2023-12-08T08:21:17.686471+0000","last_peered":"2023-12-08T08:21:17.686471+0000","last_clean":"2023-12-08T08:21:17.686471+0000","last_became_active":"2023-12-08T08:21:17.680967+0000","last_became_peered":"2023-12-08T08:21:17.680967+0000","last_unstale":"2023-12-08T08:21:17.686471+0000","last_undegraded":"2023-12-08T08:21:17.686471+0000","last_fullsized":"2023-12-08T08:21:17.686471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:02:38.255209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644131+0000","last_change":"2023-12-08T08:21:04.778223+0000","last_active":"2023-12-08T08:21:16.644131+0000","last_peered":"2023-12-08T08:21:16.644131+0000","last_clean":"2023-12-08T08:21:16.644131+0000","last_became_active":"2023-12-08T08:21:04.777902+0000","last_became_peered":"2023-12-08T08:21:04.777902+0000","last_unstale":"2023-12-08T08:21:16.644131+0000","last_undegraded":"2023-12-08T08:21:16.644131+0000","last_fullsized":"2023-12-08T08:21:16.644131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:07.593642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649143+0000","last_change":"2023-12-08T08:21:05.532257+0000","last_active":"2023-12-08T08:21:16.649143+0000","last_peered":"2023-12-08T08:21:16.649143+0000","last_clean":"2023-12-08T08:21:16.649143+0000","last_became_active":"2023-12-08T08:21:05.531965+0000","last_became_peered":"2023-12-08T08:21:05.531965+0000","last_unstale":"2023-12-08T08:21:16.649143+0000","last_undegraded":"2023-12-08T08:21:16.649143+0000","last_fullsized":"2023-12-08T08:21:16.649143+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:23.756612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.660842+0000","last_change":"2023-12-08T08:21:17.660842+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.660842+0000","last_undegraded":"2023-12-08T08:21:17.660842+0000","last_fullsized":"2023-12-08T08:21:17.660842+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654313+0000","last_change":"2023-12-08T08:21:04.780684+0000","last_active":"2023-12-08T08:21:16.654313+0000","last_peered":"2023-12-08T08:21:16.654313+0000","last_clean":"2023-12-08T08:21:16.654313+0000","last_became_active":"2023-12-08T08:21:04.780321+0000","last_became_peered":"2023-12-08T08:21:04.780321+0000","last_unstale":"2023-12-08T08:21:16.654313+0000","last_undegraded":"2023-12-08T08:21:16.654313+0000","last_fullsized":"2023-12-08T08:21:16.654313+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:13.006406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652155+0000","last_change":"2023-12-08T08:21:05.531374+0000","last_active":"2023-12-08T08:21:16.652155+0000","last_peered":"2023-12-08T08:21:16.652155+0000","last_clean":"2023-12-08T08:21:16.652155+0000","last_became_active":"2023-12-08T08:21:05.531104+0000","last_became_peered":"2023-12-08T08:21:05.531104+0000","last_unstale":"2023-12-08T08:21:16.652155+0000","last_undegraded":"2023-12-08T08:21:16.652155+0000","last_fullsized":"2023-12-08T08:21:16.652155+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:04.403116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686260+0000","last_change":"2023-12-08T08:21:17.684363+0000","last_active":"2023-12-08T08:21:17.686260+0000","last_peered":"2023-12-08T08:21:17.686260+0000","last_clean":"2023-12-08T08:21:17.686260+0000","last_became_active":"2023-12-08T08:21:17.683896+0000","last_became_peered":"2023-12-08T08:21:17.683896+0000","last_unstale":"2023-12-08T08:21:17.686260+0000","last_undegraded":"2023-12-08T08:21:17.686260+0000","last_fullsized":"2023-12-08T08:21:17.686260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:31:02.865086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.663742+0000","last_change":"2023-12-08T08:21:17.663742+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.663742+0000","last_undegraded":"2023-12-08T08:21:17.663742+0000","last_fullsized":"2023-12-08T08:21:17.663742+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652248+0000","last_change":"2023-12-08T08:21:04.777030+0000","last_active":"2023-12-08T08:21:16.652248+0000","last_peered":"2023-12-08T08:21:16.652248+0000","last_clean":"2023-12-08T08:21:16.652248+0000","last_became_active":"2023-12-08T08:21:04.775911+0000","last_became_peered":"2023-12-08T08:21:04.775911+0000","last_unstale":"2023-12-08T08:21:16.652248+0000","last_undegraded":"2023-12-08T08:21:16.652248+0000","last_fullsized":"2023-12-08T08:21:16.652248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:29.810210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654250+0000","last_change":"2023-12-08T08:21:05.532180+0000","last_active":"2023-12-08T08:21:16.654250+0000","last_peered":"2023-12-08T08:21:16.654250+0000","last_clean":"2023-12-08T08:21:16.654250+0000","last_became_active":"2023-12-08T08:21:05.529640+0000","last_became_peered":"2023-12-08T08:21:05.529640+0000","last_unstale":"2023-12-08T08:21:16.654250+0000","last_undegraded":"2023-12-08T08:21:16.654250+0000","last_fullsized":"2023-12-08T08:21:16.654250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:11.477913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.685108+0000","last_change":"2023-12-08T08:21:17.680905+0000","last_active":"2023-12-08T08:21:17.685108+0000","last_peered":"2023-12-08T08:21:17.685108+0000","last_clean":"2023-12-08T08:21:17.685108+0000","last_became_active":"2023-12-08T08:21:17.680651+0000","last_became_peered":"2023-12-08T08:21:17.680651+0000","last_unstale":"2023-12-08T08:21:17.685108+0000","last_undegraded":"2023-12-08T08:21:17.685108+0000","last_fullsized":"2023-12-08T08:21:17.685108+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:15.257930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.656547+0000","last_change":"2023-12-08T08:21:17.656547+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.656547+0000","last_undegraded":"2023-12-08T08:21:17.656547+0000","last_fullsized":"2023-12-08T08:21:17.656547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.653722+0000","last_change":"2023-12-08T08:21:05.539808+0000","last_active":"2023-12-08T08:21:16.653722+0000","last_peered":"2023-12-08T08:21:16.653722+0000","last_clean":"2023-12-08T08:21:16.653722+0000","last_became_active":"2023-12-08T08:21:05.539443+0000","last_became_peered":"2023-12-08T08:21:05.539443+0000","last_unstale":"2023-12-08T08:21:16.653722+0000","last_undegraded":"2023-12-08T08:21:16.653722+0000","last_fullsized":"2023-12-08T08:21:16.653722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:20:39.875619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661094+0000","last_change":"2023-12-08T08:21:17.661094+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661094+0000","last_undegraded":"2023-12-08T08:21:17.661094+0000","last_fullsized":"2023-12-08T08:21:17.661094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.650483+0000","last_change":"2023-12-08T08:21:05.532086+0000","last_active":"2023-12-08T08:21:16.650483+0000","last_peered":"2023-12-08T08:21:16.650483+0000","last_clean":"2023-12-08T08:21:16.650483+0000","last_became_active":"2023-12-08T08:21:05.531583+0000","last_became_peered":"2023-12-08T08:21:05.531583+0000","last_unstale":"2023-12-08T08:21:16.650483+0000","last_undegraded":"2023-12-08T08:21:16.650483+0000","last_fullsized":"2023-12-08T08:21:16.650483+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:13.936073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.658349+0000","last_change":"2023-12-08T08:21:17.658349+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.658349+0000","last_undegraded":"2023-12-08T08:21:17.658349+0000","last_fullsized":"2023-12-08T08:21:17.658349+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654484+0000","last_change":"2023-12-08T08:21:05.530432+0000","last_active":"2023-12-08T08:21:16.654484+0000","last_peered":"2023-12-08T08:21:16.654484+0000","last_clean":"2023-12-08T08:21:16.654484+0000","last_became_active":"2023-12-08T08:21:05.530065+0000","last_became_peered":"2023-12-08T08:21:05.530065+0000","last_unstale":"2023-12-08T08:21:16.654484+0000","last_undegraded":"2023-12-08T08:21:16.654484+0000","last_fullsized":"2023-12-08T08:21:16.654484+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:43.021591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.667972+0000","last_change":"2023-12-08T08:21:17.667972+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.667972+0000","last_undegraded":"2023-12-08T08:21:17.667972+0000","last_fullsized":"2023-12-08T08:21:17.667972+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648680+0000","last_change":"2023-12-08T08:21:05.531803+0000","last_active":"2023-12-08T08:21:16.648680+0000","last_peered":"2023-12-08T08:21:16.648680+0000","last_clean":"2023-12-08T08:21:16.648680+0000","last_became_active":"2023-12-08T08:21:05.531470+0000","last_became_peered":"2023-12-08T08:21:05.531470+0000","last_unstale":"2023-12-08T08:21:16.648680+0000","last_undegraded":"2023-12-08T08:21:16.648680+0000","last_fullsized":"2023-12-08T08:21:16.648680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:37.538055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659142+0000","last_change":"2023-12-08T08:21:17.659142+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659142+0000","last_undegraded":"2023-12-08T08:21:17.659142+0000","last_fullsized":"2023-12-08T08:21:17.659142+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655770+0000","last_change":"2023-12-08T08:21:05.538326+0000","last_active":"2023-12-08T08:21:16.655770+0000","last_peered":"2023-12-08T08:21:16.655770+0000","last_clean":"2023-12-08T08:21:16.655770+0000","last_became_active":"2023-12-08T08:21:05.538042+0000","last_became_peered":"2023-12-08T08:21:05.538042+0000","last_unstale":"2023-12-08T08:21:16.655770+0000","last_undegraded":"2023-12-08T08:21:16.655770+0000","last_fullsized":"2023-12-08T08:21:16.655770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:30.973295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.663984+0000","last_change":"2023-12-08T08:21:17.663984+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.663984+0000","last_undegraded":"2023-12-08T08:21:17.663984+0000","last_fullsized":"2023-12-08T08:21:17.663984+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652267+0000","last_change":"2023-12-08T08:21:05.538170+0000","last_active":"2023-12-08T08:21:16.652267+0000","last_peered":"2023-12-08T08:21:16.652267+0000","last_clean":"2023-12-08T08:21:16.652267+0000","last_became_active":"2023-12-08T08:21:05.537834+0000","last_became_peered":"2023-12-08T08:21:05.537834+0000","last_unstale":"2023-12-08T08:21:16.652267+0000","last_undegraded":"2023-12-08T08:21:16.652267+0000","last_fullsized":"2023-12-08T08:21:16.652267+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:23.756612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.664256+0000","last_change":"2023-12-08T08:21:17.664256+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.664256+0000","last_undegraded":"2023-12-08T08:21:17.664256+0000","last_fullsized":"2023-12-08T08:21:17.664256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644283+0000","last_change":"2023-12-08T08:21:05.532516+0000","last_active":"2023-12-08T08:21:16.644283+0000","last_peered":"2023-12-08T08:21:16.644283+0000","last_clean":"2023-12-08T08:21:16.644283+0000","last_became_active":"2023-12-08T08:21:05.531827+0000","last_became_peered":"2023-12-08T08:21:05.531827+0000","last_unstale":"2023-12-08T08:21:16.644283+0000","last_undegraded":"2023-12-08T08:21:16.644283+0000","last_fullsized":"2023-12-08T08:21:16.644283+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:49:59.047557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.655852+0000","last_change":"2023-12-08T08:21:17.655852+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.655852+0000","last_undegraded":"2023-12-08T08:21:17.655852+0000","last_fullsized":"2023-12-08T08:21:17.655852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651828+0000","last_change":"2023-12-08T08:21:05.531201+0000","last_active":"2023-12-08T08:21:16.651828+0000","last_peered":"2023-12-08T08:21:16.651828+0000","last_clean":"2023-12-08T08:21:16.651828+0000","last_became_active":"2023-12-08T08:21:05.530935+0000","last_became_peered":"2023-12-08T08:21:05.530935+0000","last_unstale":"2023-12-08T08:21:16.651828+0000","last_undegraded":"2023-12-08T08:21:16.651828+0000","last_fullsized":"2023-12-08T08:21:16.651828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:37.538055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659185+0000","last_change":"2023-12-08T08:21:17.659185+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659185+0000","last_undegraded":"2023-12-08T08:21:17.659185+0000","last_fullsized":"2023-12-08T08:21:17.659185+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655029+0000","last_change":"2023-12-08T08:21:05.535454+0000","last_active":"2023-12-08T08:21:16.655029+0000","last_peered":"2023-12-08T08:21:16.655029+0000","last_clean":"2023-12-08T08:21:16.655029+0000","last_became_active":"2023-12-08T08:21:05.535095+0000","last_became_peered":"2023-12-08T08:21:05.535095+0000","last_unstale":"2023-12-08T08:21:16.655029+0000","last_undegraded":"2023-12-08T08:21:16.655029+0000","last_fullsized":"2023-12-08T08:21:16.655029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:50:53.654615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.663922+0000","last_change":"2023-12-08T08:21:17.663922+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.663922+0000","last_undegraded":"2023-12-08T08:21:17.663922+0000","last_fullsized":"2023-12-08T08:21:17.663922+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.653808+0000","last_change":"2023-12-08T08:21:05.534953+0000","last_active":"2023-12-08T08:21:16.653808+0000","last_peered":"2023-12-08T08:21:16.653808+0000","last_clean":"2023-12-08T08:21:16.653808+0000","last_became_active":"2023-12-08T08:21:05.531291+0000","last_became_peered":"2023-12-08T08:21:05.531291+0000","last_unstale":"2023-12-08T08:21:16.653808+0000","last_undegraded":"2023-12-08T08:21:16.653808+0000","last_fullsized":"2023-12-08T08:21:16.653808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:47.419331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661714+0000","last_change":"2023-12-08T08:21:17.661714+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661714+0000","last_undegraded":"2023-12-08T08:21:17.661714+0000","last_fullsized":"2023-12-08T08:21:17.661714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649166+0000","last_change":"2023-12-08T08:21:05.529673+0000","last_active":"2023-12-08T08:21:16.649166+0000","last_peered":"2023-12-08T08:21:16.649166+0000","last_clean":"2023-12-08T08:21:16.649166+0000","last_became_active":"2023-12-08T08:21:05.528239+0000","last_became_peered":"2023-12-08T08:21:05.528239+0000","last_unstale":"2023-12-08T08:21:16.649166+0000","last_undegraded":"2023-12-08T08:21:16.649166+0000","last_fullsized":"2023-12-08T08:21:16.649166+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:19.928543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.660989+0000","last_change":"2023-12-08T08:21:17.660989+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.660989+0000","last_undegraded":"2023-12-08T08:21:17.660989+0000","last_fullsized":"2023-12-08T08:21:17.660989+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648574+0000","last_change":"2023-12-08T08:21:05.523783+0000","last_active":"2023-12-08T08:21:16.648574+0000","last_peered":"2023-12-08T08:21:16.648574+0000","last_clean":"2023-12-08T08:21:16.648574+0000","last_became_active":"2023-12-08T08:21:05.523509+0000","last_became_peered":"2023-12-08T08:21:05.523509+0000","last_unstale":"2023-12-08T08:21:16.648574+0000","last_undegraded":"2023-12-08T08:21:16.648574+0000","last_fullsized":"2023-12-08T08:21:16.648574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:11.477913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.657354+0000","last_change":"2023-12-08T08:21:17.657354+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.657354+0000","last_undegraded":"2023-12-08T08:21:17.657354+0000","last_fullsized":"2023-12-08T08:21:17.657354+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.650201+0000","last_change":"2023-12-08T08:21:05.538014+0000","last_active":"2023-12-08T08:21:16.650201+0000","last_peered":"2023-12-08T08:21:16.650201+0000","last_clean":"2023-12-08T08:21:16.650201+0000","last_became_active":"2023-12-08T08:21:05.537721+0000","last_became_peered":"2023-12-08T08:21:05.537721+0000","last_unstale":"2023-12-08T08:21:16.650201+0000","last_undegraded":"2023-12-08T08:21:16.650201+0000","last_fullsized":"2023-12-08T08:21:16.650201+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:30.813093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.655768+0000","last_change":"2023-12-08T08:21:17.655768+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.655768+0000","last_undegraded":"2023-12-08T08:21:17.655768+0000","last_fullsized":"2023-12-08T08:21:17.655768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644042+0000","last_change":"2023-12-08T08:21:05.525566+0000","last_active":"2023-12-08T08:21:16.644042+0000","last_peered":"2023-12-08T08:21:16.644042+0000","last_clean":"2023-12-08T08:21:16.644042+0000","last_became_active":"2023-12-08T08:21:05.525251+0000","last_became_peered":"2023-12-08T08:21:05.525251+0000","last_unstale":"2023-12-08T08:21:16.644042+0000","last_undegraded":"2023-12-08T08:21:16.644042+0000","last_fullsized":"2023-12-08T08:21:16.644042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:09:56.356105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.657863+0000","last_change":"2023-12-08T08:21:17.657863+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.657863+0000","last_undegraded":"2023-12-08T08:21:17.657863+0000","last_fullsized":"2023-12-08T08:21:17.657863+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644225+0000","last_change":"2023-12-08T08:21:05.530770+0000","last_active":"2023-12-08T08:21:16.644225+0000","last_peered":"2023-12-08T08:21:16.644225+0000","last_clean":"2023-12-08T08:21:16.644225+0000","last_became_active":"2023-12-08T08:21:05.530517+0000","last_became_peered":"2023-12-08T08:21:05.530517+0000","last_unstale":"2023-12-08T08:21:16.644225+0000","last_undegraded":"2023-12-08T08:21:16.644225+0000","last_fullsized":"2023-12-08T08:21:16.644225+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:05.968004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661813+0000","last_change":"2023-12-08T08:21:17.661813+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661813+0000","last_undegraded":"2023-12-08T08:21:17.661813+0000","last_fullsized":"2023-12-08T08:21:17.661813+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654550+0000","last_change":"2023-12-08T08:21:05.532053+0000","last_active":"2023-12-08T08:21:16.654550+0000","last_peered":"2023-12-08T08:21:16.654550+0000","last_clean":"2023-12-08T08:21:16.654550+0000","last_became_active":"2023-12-08T08:21:05.531799+0000","last_became_peered":"2023-12-08T08:21:05.531799+0000","last_unstale":"2023-12-08T08:21:16.654550+0000","last_undegraded":"2023-12-08T08:21:16.654550+0000","last_fullsized":"2023-12-08T08:21:16.654550+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:05.968004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659709+0000","last_change":"2023-12-08T08:21:17.659709+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659709+0000","last_undegraded":"2023-12-08T08:21:17.659709+0000","last_fullsized":"2023-12-08T08:21:17.659709+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654066+0000","last_change":"2023-12-08T08:21:05.535656+0000","last_active":"2023-12-08T08:21:16.654066+0000","last_peered":"2023-12-08T08:21:16.654066+0000","last_clean":"2023-12-08T08:21:16.654066+0000","last_became_active":"2023-12-08T08:21:05.535310+0000","last_became_peered":"2023-12-08T08:21:05.535310+0000","last_unstale":"2023-12-08T08:21:16.654066+0000","last_undegraded":"2023-12-08T08:21:16.654066+0000","last_fullsized":"2023-12-08T08:21:16.654066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:09:56.356105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.657854+0000","last_change":"2023-12-08T08:21:17.657854+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.657854+0000","last_undegraded":"2023-12-08T08:21:17.657854+0000","last_fullsized":"2023-12-08T08:21:17.657854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655138+0000","last_change":"2023-12-08T08:21:05.529395+0000","last_active":"2023-12-08T08:21:16.655138+0000","last_peered":"2023-12-08T08:21:16.655138+0000","last_clean":"2023-12-08T08:21:16.655138+0000","last_became_active":"2023-12-08T08:21:05.529089+0000","last_became_peered":"2023-12-08T08:21:05.529089+0000","last_unstale":"2023-12-08T08:21:16.655138+0000","last_undegraded":"2023-12-08T08:21:16.655138+0000","last_fullsized":"2023-12-08T08:21:16.655138+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:43.021591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661007+0000","last_change":"2023-12-08T08:21:17.661007+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661007+0000","last_undegraded":"2023-12-08T08:21:17.661007+0000","last_fullsized":"2023-12-08T08:21:17.661007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643962+0000","last_change":"2023-12-08T08:21:05.527949+0000","last_active":"2023-12-08T08:21:16.643962+0000","last_peered":"2023-12-08T08:21:16.643962+0000","last_clean":"2023-12-08T08:21:16.643962+0000","last_became_active":"2023-12-08T08:21:05.527215+0000","last_became_peered":"2023-12-08T08:21:05.527215+0000","last_unstale":"2023-12-08T08:21:16.643962+0000","last_undegraded":"2023-12-08T08:21:16.643962+0000","last_fullsized":"2023-12-08T08:21:16.643962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:25.239396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.671345+0000","last_change":"2023-12-08T08:21:17.671345+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.671345+0000","last_undegraded":"2023-12-08T08:21:17.671345+0000","last_fullsized":"2023-12-08T08:21:17.671345+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649424+0000","last_change":"2023-12-08T08:21:05.530318+0000","last_active":"2023-12-08T08:21:16.649424+0000","last_peered":"2023-12-08T08:21:16.649424+0000","last_clean":"2023-12-08T08:21:16.649424+0000","last_became_active":"2023-12-08T08:21:05.529990+0000","last_became_peered":"2023-12-08T08:21:05.529990+0000","last_unstale":"2023-12-08T08:21:16.649424+0000","last_undegraded":"2023-12-08T08:21:16.649424+0000","last_fullsized":"2023-12-08T08:21:16.649424+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:54:39.738546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.660112+0000","last_change":"2023-12-08T08:21:17.660112+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.660112+0000","last_undegraded":"2023-12-08T08:21:17.660112+0000","last_fullsized":"2023-12-08T08:21:17.660112+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655723+0000","last_change":"2023-12-08T08:21:05.540446+0000","last_active":"2023-12-08T08:21:16.655723+0000","last_peered":"2023-12-08T08:21:16.655723+0000","last_clean":"2023-12-08T08:21:16.655723+0000","last_became_active":"2023-12-08T08:21:05.540024+0000","last_became_peered":"2023-12-08T08:21:05.540024+0000","last_unstale":"2023-12-08T08:21:16.655723+0000","last_undegraded":"2023-12-08T08:21:16.655723+0000","last_fullsized":"2023-12-08T08:21:16.655723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:59:00.606587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.660303+0000","last_change":"2023-12-08T08:21:17.660303+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.660303+0000","last_undegraded":"2023-12-08T08:21:17.660303+0000","last_fullsized":"2023-12-08T08:21:17.660303+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654222+0000","last_change":"2023-12-08T08:21:05.536252+0000","last_active":"2023-12-08T08:21:16.654222+0000","last_peered":"2023-12-08T08:21:16.654222+0000","last_clean":"2023-12-08T08:21:16.654222+0000","last_became_active":"2023-12-08T08:21:05.535964+0000","last_became_peered":"2023-12-08T08:21:05.535964+0000","last_unstale":"2023-12-08T08:21:16.654222+0000","last_undegraded":"2023-12-08T08:21:16.654222+0000","last_fullsized":"2023-12-08T08:21:16.654222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:30.973295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.664875+0000","last_change":"2023-12-08T08:21:17.664875+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.664875+0000","last_undegraded":"2023-12-08T08:21:17.664875+0000","last_fullsized":"2023-12-08T08:21:17.664875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651605+0000","last_change":"2023-12-08T08:21:05.533444+0000","last_active":"2023-12-08T08:21:16.651605+0000","last_peered":"2023-12-08T08:21:16.651605+0000","last_clean":"2023-12-08T08:21:16.651605+0000","last_became_active":"2023-12-08T08:21:05.533146+0000","last_became_peered":"2023-12-08T08:21:05.533146+0000","last_unstale":"2023-12-08T08:21:16.651605+0000","last_undegraded":"2023-12-08T08:21:16.651605+0000","last_fullsized":"2023-12-08T08:21:16.651605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:14:18.284764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659761+0000","last_change":"2023-12-08T08:21:17.659761+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659761+0000","last_undegraded":"2023-12-08T08:21:17.659761+0000","last_fullsized":"2023-12-08T08:21:17.659761+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649422+0000","last_change":"2023-12-08T08:21:05.525741+0000","last_active":"2023-12-08T08:21:16.649422+0000","last_peered":"2023-12-08T08:21:16.649422+0000","last_clean":"2023-12-08T08:21:16.649422+0000","last_became_active":"2023-12-08T08:21:05.525406+0000","last_became_peered":"2023-12-08T08:21:05.525406+0000","last_unstale":"2023-12-08T08:21:16.649422+0000","last_undegraded":"2023-12-08T08:21:16.649422+0000","last_fullsized":"2023-12-08T08:21:16.649422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:08.596525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.673727+0000","last_change":"2023-12-08T08:21:17.673727+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.673727+0000","last_undegraded":"2023-12-08T08:21:17.673727+0000","last_fullsized":"2023-12-08T08:21:17.673727+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.653633+0000","last_change":"2023-12-08T08:21:05.537523+0000","last_active":"2023-12-08T08:21:16.653633+0000","last_peered":"2023-12-08T08:21:16.653633+0000","last_clean":"2023-12-08T08:21:16.653633+0000","last_became_active":"2023-12-08T08:21:05.537263+0000","last_became_peered":"2023-12-08T08:21:05.537263+0000","last_unstale":"2023-12-08T08:21:16.653633+0000","last_undegraded":"2023-12-08T08:21:16.653633+0000","last_fullsized":"2023-12-08T08:21:16.653633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:08.596525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.668335+0000","last_change":"2023-12-08T08:21:17.668335+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.668335+0000","last_undegraded":"2023-12-08T08:21:17.668335+0000","last_fullsized":"2023-12-08T08:21:17.668335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654426+0000","last_change":"2023-12-08T08:21:05.534310+0000","last_active":"2023-12-08T08:21:16.654426+0000","last_peered":"2023-12-08T08:21:16.654426+0000","last_clean":"2023-12-08T08:21:16.654426+0000","last_became_active":"2023-12-08T08:21:05.534003+0000","last_became_peered":"2023-12-08T08:21:05.534003+0000","last_unstale":"2023-12-08T08:21:16.654426+0000","last_undegraded":"2023-12-08T08:21:16.654426+0000","last_fullsized":"2023-12-08T08:21:16.654426+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:49.782105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659794+0000","last_change":"2023-12-08T08:21:17.659794+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659794+0000","last_undegraded":"2023-12-08T08:21:17.659794+0000","last_fullsized":"2023-12-08T08:21:17.659794+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643900+0000","last_change":"2023-12-08T08:21:05.543535+0000","last_active":"2023-12-08T08:21:16.643900+0000","last_peered":"2023-12-08T08:21:16.643900+0000","last_clean":"2023-12-08T08:21:16.643900+0000","last_became_active":"2023-12-08T08:21:05.543244+0000","last_became_peered":"2023-12-08T08:21:05.543244+0000","last_unstale":"2023-12-08T08:21:16.643900+0000","last_undegraded":"2023-12-08T08:21:16.643900+0000","last_fullsized":"2023-12-08T08:21:16.643900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:20:39.875619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.662257+0000","last_change":"2023-12-08T08:21:17.662257+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.662257+0000","last_undegraded":"2023-12-08T08:21:17.662257+0000","last_fullsized":"2023-12-08T08:21:17.662257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649277+0000","last_change":"2023-12-08T08:21:05.532561+0000","last_active":"2023-12-08T08:21:16.649277+0000","last_peered":"2023-12-08T08:21:16.649277+0000","last_clean":"2023-12-08T08:21:16.649277+0000","last_became_active":"2023-12-08T08:21:05.532254+0000","last_became_peered":"2023-12-08T08:21:05.532254+0000","last_unstale":"2023-12-08T08:21:16.649277+0000","last_undegraded":"2023-12-08T08:21:16.649277+0000","last_fullsized":"2023-12-08T08:21:16.649277+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:30:51.157799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.668437+0000","last_change":"2023-12-08T08:21:17.668437+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.668437+0000","last_undegraded":"2023-12-08T08:21:17.668437+0000","last_fullsized":"2023-12-08T08:21:17.668437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651087+0000","last_change":"2023-12-08T08:21:05.528111+0000","last_active":"2023-12-08T08:21:16.651087+0000","last_peered":"2023-12-08T08:21:16.651087+0000","last_clean":"2023-12-08T08:21:16.651087+0000","last_became_active":"2023-12-08T08:21:05.527809+0000","last_became_peered":"2023-12-08T08:21:05.527809+0000","last_unstale":"2023-12-08T08:21:16.651087+0000","last_undegraded":"2023-12-08T08:21:16.651087+0000","last_fullsized":"2023-12-08T08:21:16.651087+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:51.183842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.662012+0000","last_change":"2023-12-08T08:21:17.662012+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.662012+0000","last_undegraded":"2023-12-08T08:21:17.662012+0000","last_fullsized":"2023-12-08T08:21:17.662012+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.656056+0000","last_change":"2023-12-08T08:21:05.534658+0000","last_active":"2023-12-08T08:21:16.656056+0000","last_peered":"2023-12-08T08:21:16.656056+0000","last_clean":"2023-12-08T08:21:16.656056+0000","last_became_active":"2023-12-08T08:21:05.534383+0000","last_became_peered":"2023-12-08T08:21:05.534383+0000","last_unstale":"2023-12-08T08:21:16.656056+0000","last_undegraded":"2023-12-08T08:21:16.656056+0000","last_fullsized":"2023-12-08T08:21:16.656056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.368162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.660063+0000","last_change":"2023-12-08T08:21:17.660063+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.660063+0000","last_undegraded":"2023-12-08T08:21:17.660063+0000","last_fullsized":"2023-12-08T08:21:17.660063+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644195+0000","last_change":"2023-12-08T08:21:05.527659+0000","last_active":"2023-12-08T08:21:16.644195+0000","last_peered":"2023-12-08T08:21:16.644195+0000","last_clean":"2023-12-08T08:21:16.644195+0000","last_became_active":"2023-12-08T08:21:05.527361+0000","last_became_peered":"2023-12-08T08:21:05.527361+0000","last_unstale":"2023-12-08T08:21:16.644195+0000","last_undegraded":"2023-12-08T08:21:16.644195+0000","last_fullsized":"2023-12-08T08:21:16.644195+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:49.782105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.655156+0000","last_change":"2023-12-08T08:21:17.655156+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.655156+0000","last_undegraded":"2023-12-08T08:21:17.655156+0000","last_fullsized":"2023-12-08T08:21:17.655156+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652062+0000","last_change":"2023-12-08T08:21:05.540661+0000","last_active":"2023-12-08T08:21:16.652062+0000","last_peered":"2023-12-08T08:21:16.652062+0000","last_clean":"2023-12-08T08:21:16.652062+0000","last_became_active":"2023-12-08T08:21:05.539125+0000","last_became_peered":"2023-12-08T08:21:05.539125+0000","last_unstale":"2023-12-08T08:21:16.652062+0000","last_undegraded":"2023-12-08T08:21:16.652062+0000","last_fullsized":"2023-12-08T08:21:16.652062+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:58:23.887952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":731231,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.63100000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.72799999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.81699999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.71099999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.68700000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":141389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.74399999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.84899999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.72699999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.77900000000000003}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.80400000000000005}]},{"osd":5,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.82799999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.70599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":141445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.65200000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.75}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.81200000000000006}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.77000000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.78600000000000003}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.876}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.753}]},{"osd":1,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.64300000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.86799999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.81899999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.71199999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.90500000000000003}]},{"osd":7,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.73299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":151024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.443},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.46600000000000003}]},{"osd":1,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.50800000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.62},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.69399999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68200000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.71299999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.73699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":140843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.0270000000000001,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.34000000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.37},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.42199999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.55800000000000005}]},{"osd":5,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":3.637,"5min":3.637,"15min":3.637},"last":0.49399999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.54500000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.67500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":143902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2210000000000001,"5min":5.2210000000000001,"15min":5.2210000000000001},"last":0.374},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":8.3200000000000003,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.439}]},{"osd":2,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":8.2070000000000007,"5min":8.2070000000000007,"15min":8.2070000000000007},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":4.351,"5min":4.351,"15min":4.351},"last":0.42199999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":8.1479999999999997,"5min":8.1479999999999997,"15min":8.1479999999999997},"last":0.495},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.3150000000000004,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.47499999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":4.8470000000000004,"5min":4.8470000000000004,"15min":4.8470000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":4.7939999999999996,"5min":4.7939999999999996,"15min":4.7939999999999996},"last":0.71399999999999997}]},{"osd":5,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":4.7240000000000002,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":4.5830000000000002,"5min":4.5830000000000002,"15min":4.5830000000000002},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":4.7699999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.624},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":4.6289999999999996,"5min":4.6289999999999996,"15min":4.6289999999999996},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":4.665,"5min":4.665,"15min":4.665},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":4.8140000000000001,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.75800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":731141,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":8.2799999999999994,"5min":8.2799999999999994,"15min":8.2799999999999994},"last":0.46800000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":7.9290000000000003,"5min":7.9290000000000003,"15min":7.9290000000000003},"last":0.33900000000000002},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":8.0890000000000004,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.51500000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":4.6550000000000002,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.439},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":7.8890000000000002,"5min":7.8890000000000002,"15min":7.8890000000000002},"last":0.38}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":7.9649999999999999,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":8.0579999999999998,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.68300000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":7.835,"5min":7.835,"15min":7.835},"last":0.65900000000000003}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":8.0239999999999991,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.58799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:21:23.135 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:21:23.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.304+0000 7f9f25cc9640 1 Processor -- start 2023-12-08T08:21:23.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.304+0000 7f9f25cc9640 1 -- start start 2023-12-08T08:21:23.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.304+0000 7f9f25cc9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9f2006c100 0x7f9f2015fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.304+0000 7f9f25cc9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f200c4890 con 0x7f9f20154f20 2023-12-08T08:21:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.304+0000 7f9f25cc9640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f201553d0 con 0x7f9f200af4c0 2023-12-08T08:21:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.304+0000 7f9f25cc9640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f200af8a0 con 0x7f9f2006c100 2023-12-08T08:21:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.304+0000 7f9f1ffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9f2006c100 0x7f9f2015fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.304+0000 7f9f1effd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9f20154f20 0x7f9f2006b9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46750/0 (socket says 172.21.15.88:46750) 2023-12-08T08:21:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.304+0000 7f9f1effd640 1 -- 172.21.15.88:0/3553847042 learned_addr learned my addr 172.21.15.88:0/3553847042 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.304+0000 7f9f1ffff640 1 -- 172.21.15.88:0/3553847042 >> v1:172.21.15.148:6789/0 conn(0x7f9f200af4c0 legacy=0x7f9f200c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:23.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.304+0000 7f9f1ffff640 1 -- 172.21.15.88:0/3553847042 >> v1:172.21.15.88:6789/0 conn(0x7f9f20154f20 legacy=0x7f9f2006b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:23.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.304+0000 7f9f1ffff640 1 -- 172.21.15.88:0/3553847042 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f200c4b30 con 0x7f9f2006c100 2023-12-08T08:21:23.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.308+0000 7f9f1ffff640 1 --2- 172.21.15.88:0/3553847042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f2006c100 0x7f9f2015fe30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9f18009d90 tx=0x7f9f1801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e44ae396503306a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:23.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.308+0000 7f9f1e7fc640 1 -- 172.21.15.88:0/3553847042 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f180a5950 con 0x7f9f2006c100 2023-12-08T08:21:23.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.308+0000 7f9f1e7fc640 1 -- 172.21.15.88:0/3553847042 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f180a5ab0 con 0x7f9f2006c100 2023-12-08T08:21:23.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.308+0000 7f9f1e7fc640 1 -- 172.21.15.88:0/3553847042 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f180a5e40 con 0x7f9f2006c100 2023-12-08T08:21:23.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.308+0000 7f9f25cc9640 1 -- 172.21.15.88:0/3553847042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f2006c100 msgr2=0x7f9f2015fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:23.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.308+0000 7f9f25cc9640 1 --2- 172.21.15.88:0/3553847042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f2006c100 0x7f9f2015fe30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9f18009d90 tx=0x7f9f1801c890 comp rx=0 tx=0).stop 2023-12-08T08:21:23.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.308+0000 7f9f25cc9640 1 -- 172.21.15.88:0/3553847042 shutdown_connections 2023-12-08T08:21:23.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.308+0000 7f9f25cc9640 1 --2- 172.21.15.88:0/3553847042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f2006c100 0x7f9f2015fe30 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:23.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.308+0000 7f9f25cc9640 1 -- 172.21.15.88:0/3553847042 >> 172.21.15.88:0/3553847042 conn(0x7f9f200ab9d0 msgr2=0x7f9f200abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:23.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.308+0000 7f9f25cc9640 1 -- 172.21.15.88:0/3553847042 shutdown_connections 2023-12-08T08:21:23.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.308+0000 7f9f25cc9640 1 -- 172.21.15.88:0/3553847042 wait complete. 2023-12-08T08:21:23.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.312+0000 7f9f25cc9640 1 Processor -- start 2023-12-08T08:21:23.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.312+0000 7f9f25cc9640 1 -- start start 2023-12-08T08:21:23.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.312+0000 7f9f25cc9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f2006c100 0x7f9f200c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:23.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.312+0000 7f9f25cc9640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f200af4c0 0x7f9f20144f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:23.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.312+0000 7f9f25cc9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f20154f20 0x7f9f201460f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:23.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.312+0000 7f9f25cc9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f20144a90 con 0x7f9f2006c100 2023-12-08T08:21:23.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.312+0000 7f9f25cc9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f200c8c40 con 0x7f9f20154f20 2023-12-08T08:21:23.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.312+0000 7f9f25cc9640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f20143e80 con 0x7f9f200af4c0 2023-12-08T08:21:23.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.312+0000 7f9f1f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f2006c100 0x7f9f200c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:23.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.312+0000 7f9f1f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f2006c100 0x7f9f200c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33764/0 (socket says 172.21.15.88:33764) 2023-12-08T08:21:23.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.312+0000 7f9f1f7fe640 1 -- 172.21.15.88:0/1912585967 learned_addr learned my addr 172.21.15.88:0/1912585967 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:23.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.312+0000 7f9f1effd640 1 --2- 172.21.15.88:0/1912585967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f200af4c0 0x7f9f20144f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:23.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.312+0000 7f9f1ffff640 1 --2- 172.21.15.88:0/1912585967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f20154f20 0x7f9f201460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:23.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.312+0000 7f9f1f7fe640 1 -- 172.21.15.88:0/1912585967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f200af4c0 msgr2=0x7f9f20144f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:23.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.312+0000 7f9f1f7fe640 1 --2- 172.21.15.88:0/1912585967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f200af4c0 0x7f9f20144f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:23.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.312+0000 7f9f1f7fe640 1 -- 172.21.15.88:0/1912585967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f20154f20 msgr2=0x7f9f201460f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:23.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.312+0000 7f9f1f7fe640 1 --2- 172.21.15.88:0/1912585967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f20154f20 0x7f9f201460f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:23.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.312+0000 7f9f1f7fe640 1 -- 172.21.15.88:0/1912585967 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f18009a70 con 0x7f9f2006c100 2023-12-08T08:21:23.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.312+0000 7f9f1f7fe640 1 --2- 172.21.15.88:0/1912585967 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f2006c100 0x7f9f200c8700 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000c500 tx=0x7f9f1000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:23.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.312+0000 7f9f07fff640 1 -- 172.21.15.88:0/1912585967 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f10005220 con 0x7f9f2006c100 2023-12-08T08:21:23.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.312+0000 7f9f07fff640 1 -- 172.21.15.88:0/1912585967 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f10005380 con 0x7f9f2006c100 2023-12-08T08:21:23.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.312+0000 7f9f07fff640 1 -- 172.21.15.88:0/1912585967 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f10007270 con 0x7f9f2006c100 2023-12-08T08:21:23.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.312+0000 7f9f25cc9640 1 -- 172.21.15.88:0/1912585967 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f20144160 con 0x7f9f2006c100 2023-12-08T08:21:23.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.312+0000 7f9f25cc9640 1 -- 172.21.15.88:0/1912585967 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f20144720 con 0x7f9f2006c100 2023-12-08T08:21:23.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.312+0000 7f9f25cc9640 1 -- 172.21.15.88:0/1912585967 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f20067630 con 0x7f9f2006c100 2023-12-08T08:21:23.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.316+0000 7f9f07fff640 1 -- 172.21.15.88:0/1912585967 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9f100073d0 con 0x7f9f2006c100 2023-12-08T08:21:23.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.316+0000 7f9f07fff640 1 --2- 172.21.15.88:0/1912585967 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9f0c066470 0x7f9f0c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:23.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.316+0000 7f9f07fff640 1 -- 172.21.15.88:0/1912585967 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9f10083b10 con 0x7f9f2006c100 2023-12-08T08:21:23.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.316+0000 7f9f1effd640 1 --2- 172.21.15.88:0/1912585967 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9f0c066470 0x7f9f0c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:23.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.316+0000 7f9f1effd640 1 --2- 172.21.15.88:0/1912585967 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9f0c066470 0x7f9f0c068930 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9f20160180 tx=0x7f9f14009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:23.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.320+0000 7f9f07fff640 1 -- 172.21.15.88:0/1912585967 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9f10050c40 con 0x7f9f2006c100 2023-12-08T08:21:23.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.468+0000 7f9f25cc9640 1 -- 172.21.15.88:0/1912585967 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9f200c77b0 con 0x7f9f0c066470 2023-12-08T08:21:23.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.480+0000 7f9f07fff640 1 -- 172.21.15.88:0/1912585967 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+521952 (secure 0 0 0) 0x7f9f200c77b0 con 0x7f9f0c066470 2023-12-08T08:21:23.488 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:23.492 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:21:23.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.484+0000 7f9f25cc9640 1 -- 172.21.15.88:0/1912585967 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9f0c066470 msgr2=0x7f9f0c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:23.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.484+0000 7f9f25cc9640 1 --2- 172.21.15.88:0/1912585967 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9f0c066470 0x7f9f0c068930 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9f20160180 tx=0x7f9f14009040 comp rx=0 tx=0).stop 2023-12-08T08:21:23.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.484+0000 7f9f25cc9640 1 -- 172.21.15.88:0/1912585967 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f2006c100 msgr2=0x7f9f200c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:23.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.484+0000 7f9f25cc9640 1 --2- 172.21.15.88:0/1912585967 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f2006c100 0x7f9f200c8700 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000c500 tx=0x7f9f1000c9c0 comp rx=0 tx=0).stop 2023-12-08T08:21:23.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.484+0000 7f9f25cc9640 1 -- 172.21.15.88:0/1912585967 shutdown_connections 2023-12-08T08:21:23.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.484+0000 7f9f25cc9640 1 --2- 172.21.15.88:0/1912585967 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9f0c066470 0x7f9f0c068930 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:23.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.484+0000 7f9f25cc9640 1 --2- 172.21.15.88:0/1912585967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f20154f20 0x7f9f201460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:23.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.484+0000 7f9f25cc9640 1 --2- 172.21.15.88:0/1912585967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9f200af4c0 0x7f9f20144f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:23.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.484+0000 7f9f25cc9640 1 --2- 172.21.15.88:0/1912585967 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f2006c100 0x7f9f200c8700 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:23.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.484+0000 7f9f25cc9640 1 -- 172.21.15.88:0/1912585967 >> 172.21.15.88:0/1912585967 conn(0x7f9f200ab9d0 msgr2=0x7f9f201530d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:23.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.484+0000 7f9f25cc9640 1 -- 172.21.15.88:0/1912585967 shutdown_connections 2023-12-08T08:21:23.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.484+0000 7f9f25cc9640 1 -- 172.21.15.88:0/1912585967 wait complete. 2023-12-08T08:21:23.507 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-12-08T08:21:22.759928+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":202,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219180,"kb_used_data":3020,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755540,"statfs":{"total":773094113280,"available":772869672960,"internally_reserved":0,"allocated":3092480,"data_stored":2321852,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1241,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001180"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.658802+0000","last_change":"2023-12-08T08:21:17.658802+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.658802+0000","last_undegraded":"2023-12-08T08:21:17.658802+0000","last_fullsized":"2023-12-08T08:21:17.658802+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654128+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:21:16.654128+0000","last_peered":"2023-12-08T08:21:16.654128+0000","last_clean":"2023-12-08T08:21:16.654128+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:21:16.654128+0000","last_undegraded":"2023-12-08T08:21:16.654128+0000","last_fullsized":"2023-12-08T08:21:16.654128+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.650554+0000","last_change":"2023-12-08T08:21:04.776417+0000","last_active":"2023-12-08T08:21:16.650554+0000","last_peered":"2023-12-08T08:21:16.650554+0000","last_clean":"2023-12-08T08:21:16.650554+0000","last_became_active":"2023-12-08T08:21:04.776117+0000","last_became_peered":"2023-12-08T08:21:04.776117+0000","last_unstale":"2023-12-08T08:21:16.650554+0000","last_undegraded":"2023-12-08T08:21:16.650554+0000","last_fullsized":"2023-12-08T08:21:16.650554+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:45:05.142948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654266+0000","last_change":"2023-12-08T08:21:05.536640+0000","last_active":"2023-12-08T08:21:16.654266+0000","last_peered":"2023-12-08T08:21:16.654266+0000","last_clean":"2023-12-08T08:21:16.654266+0000","last_became_active":"2023-12-08T08:21:05.536368+0000","last_became_peered":"2023-12-08T08:21:05.536368+0000","last_unstale":"2023-12-08T08:21:16.654266+0000","last_undegraded":"2023-12-08T08:21:16.654266+0000","last_fullsized":"2023-12-08T08:21:16.654266+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:59:00.606587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.687045+0000","last_change":"2023-12-08T08:21:17.684153+0000","last_active":"2023-12-08T08:21:17.687045+0000","last_peered":"2023-12-08T08:21:17.687045+0000","last_clean":"2023-12-08T08:21:17.687045+0000","last_became_active":"2023-12-08T08:21:17.683886+0000","last_became_peered":"2023-12-08T08:21:17.683886+0000","last_unstale":"2023-12-08T08:21:17.687045+0000","last_undegraded":"2023-12-08T08:21:17.687045+0000","last_fullsized":"2023-12-08T08:21:17.687045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:37.006561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.671758+0000","last_change":"2023-12-08T08:21:17.671758+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.671758+0000","last_undegraded":"2023-12-08T08:21:17.671758+0000","last_fullsized":"2023-12-08T08:21:17.671758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643858+0000","last_change":"2023-12-08T08:21:04.781980+0000","last_active":"2023-12-08T08:21:16.643858+0000","last_peered":"2023-12-08T08:21:16.643858+0000","last_clean":"2023-12-08T08:21:16.643858+0000","last_became_active":"2023-12-08T08:21:04.781716+0000","last_became_peered":"2023-12-08T08:21:04.781716+0000","last_unstale":"2023-12-08T08:21:16.643858+0000","last_undegraded":"2023-12-08T08:21:16.643858+0000","last_fullsized":"2023-12-08T08:21:16.643858+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:03.400233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648438+0000","last_change":"2023-12-08T08:21:05.529530+0000","last_active":"2023-12-08T08:21:16.648438+0000","last_peered":"2023-12-08T08:21:16.648438+0000","last_clean":"2023-12-08T08:21:16.648438+0000","last_became_active":"2023-12-08T08:21:05.529080+0000","last_became_peered":"2023-12-08T08:21:05.529080+0000","last_unstale":"2023-12-08T08:21:16.648438+0000","last_undegraded":"2023-12-08T08:21:16.648438+0000","last_fullsized":"2023-12-08T08:21:16.648438+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:51.183842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686147+0000","last_change":"2023-12-08T08:21:17.682622+0000","last_active":"2023-12-08T08:21:17.686147+0000","last_peered":"2023-12-08T08:21:17.686147+0000","last_clean":"2023-12-08T08:21:17.686147+0000","last_became_active":"2023-12-08T08:21:17.676302+0000","last_became_peered":"2023-12-08T08:21:17.676302+0000","last_unstale":"2023-12-08T08:21:17.686147+0000","last_undegraded":"2023-12-08T08:21:17.686147+0000","last_fullsized":"2023-12-08T08:21:17.686147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:15.257930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.665725+0000","last_change":"2023-12-08T08:21:17.665725+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.665725+0000","last_undegraded":"2023-12-08T08:21:17.665725+0000","last_fullsized":"2023-12-08T08:21:17.665725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648651+0000","last_change":"2023-12-08T08:21:04.768138+0000","last_active":"2023-12-08T08:21:16.648651+0000","last_peered":"2023-12-08T08:21:16.648651+0000","last_clean":"2023-12-08T08:21:16.648651+0000","last_became_active":"2023-12-08T08:21:04.767873+0000","last_became_peered":"2023-12-08T08:21:04.767873+0000","last_unstale":"2023-12-08T08:21:16.648651+0000","last_undegraded":"2023-12-08T08:21:16.648651+0000","last_fullsized":"2023-12-08T08:21:16.648651+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:45:05.142948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643753+0000","last_change":"2023-12-08T08:21:05.526701+0000","last_active":"2023-12-08T08:21:16.643753+0000","last_peered":"2023-12-08T08:21:16.643753+0000","last_clean":"2023-12-08T08:21:16.643753+0000","last_became_active":"2023-12-08T08:21:05.526275+0000","last_became_peered":"2023-12-08T08:21:05.526275+0000","last_unstale":"2023-12-08T08:21:16.643753+0000","last_undegraded":"2023-12-08T08:21:16.643753+0000","last_fullsized":"2023-12-08T08:21:16.643753+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:59:00.606587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686309+0000","last_change":"2023-12-08T08:21:17.682917+0000","last_active":"2023-12-08T08:21:17.686309+0000","last_peered":"2023-12-08T08:21:17.686309+0000","last_clean":"2023-12-08T08:21:17.686309+0000","last_became_active":"2023-12-08T08:21:17.681822+0000","last_became_peered":"2023-12-08T08:21:17.681822+0000","last_unstale":"2023-12-08T08:21:17.686309+0000","last_undegraded":"2023-12-08T08:21:17.686309+0000","last_fullsized":"2023-12-08T08:21:17.686309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:37.006561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.655138+0000","last_change":"2023-12-08T08:21:17.655138+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.655138+0000","last_undegraded":"2023-12-08T08:21:17.655138+0000","last_fullsized":"2023-12-08T08:21:17.655138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652749+0000","last_change":"2023-12-08T08:21:04.776576+0000","last_active":"2023-12-08T08:21:16.652749+0000","last_peered":"2023-12-08T08:21:16.652749+0000","last_clean":"2023-12-08T08:21:16.652749+0000","last_became_active":"2023-12-08T08:21:04.773627+0000","last_became_peered":"2023-12-08T08:21:04.773627+0000","last_unstale":"2023-12-08T08:21:16.652749+0000","last_undegraded":"2023-12-08T08:21:16.652749+0000","last_fullsized":"2023-12-08T08:21:16.652749+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:12.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654667+0000","last_change":"2023-12-08T08:21:05.528356+0000","last_active":"2023-12-08T08:21:16.654667+0000","last_peered":"2023-12-08T08:21:16.654667+0000","last_clean":"2023-12-08T08:21:16.654667+0000","last_became_active":"2023-12-08T08:21:05.528102+0000","last_became_peered":"2023-12-08T08:21:05.528102+0000","last_unstale":"2023-12-08T08:21:16.654667+0000","last_undegraded":"2023-12-08T08:21:16.654667+0000","last_fullsized":"2023-12-08T08:21:16.654667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:51.183842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.675479+0000","last_change":"2023-12-08T08:21:17.673005+0000","last_active":"2023-12-08T08:21:17.675479+0000","last_peered":"2023-12-08T08:21:17.675479+0000","last_clean":"2023-12-08T08:21:17.675479+0000","last_became_active":"2023-12-08T08:21:17.672648+0000","last_became_peered":"2023-12-08T08:21:17.672648+0000","last_unstale":"2023-12-08T08:21:17.675479+0000","last_undegraded":"2023-12-08T08:21:17.675479+0000","last_fullsized":"2023-12-08T08:21:17.675479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:51:05.544383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.663000+0000","last_change":"2023-12-08T08:21:17.663000+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.663000+0000","last_undegraded":"2023-12-08T08:21:17.663000+0000","last_fullsized":"2023-12-08T08:21:17.663000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654354+0000","last_change":"2023-12-08T08:21:04.764784+0000","last_active":"2023-12-08T08:21:16.654354+0000","last_peered":"2023-12-08T08:21:16.654354+0000","last_clean":"2023-12-08T08:21:16.654354+0000","last_became_active":"2023-12-08T08:21:04.764580+0000","last_became_peered":"2023-12-08T08:21:04.764580+0000","last_unstale":"2023-12-08T08:21:16.654354+0000","last_undegraded":"2023-12-08T08:21:16.654354+0000","last_fullsized":"2023-12-08T08:21:16.654354+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:51:05.330323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.650596+0000","last_change":"2023-12-08T08:21:05.529399+0000","last_active":"2023-12-08T08:21:16.650596+0000","last_peered":"2023-12-08T08:21:16.650596+0000","last_clean":"2023-12-08T08:21:16.650596+0000","last_became_active":"2023-12-08T08:21:05.529054+0000","last_became_peered":"2023-12-08T08:21:05.529054+0000","last_unstale":"2023-12-08T08:21:16.650596+0000","last_undegraded":"2023-12-08T08:21:16.650596+0000","last_fullsized":"2023-12-08T08:21:16.650596+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:09.020416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.682208+0000","last_change":"2023-12-08T08:21:17.680157+0000","last_active":"2023-12-08T08:21:17.682208+0000","last_peered":"2023-12-08T08:21:17.682208+0000","last_clean":"2023-12-08T08:21:17.682208+0000","last_became_active":"2023-12-08T08:21:17.679947+0000","last_became_peered":"2023-12-08T08:21:17.679947+0000","last_unstale":"2023-12-08T08:21:17.682208+0000","last_undegraded":"2023-12-08T08:21:17.682208+0000","last_fullsized":"2023-12-08T08:21:17.682208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:37.129163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.663369+0000","last_change":"2023-12-08T08:21:17.663369+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.663369+0000","last_undegraded":"2023-12-08T08:21:17.663369+0000","last_fullsized":"2023-12-08T08:21:17.663369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651312+0000","last_change":"2023-12-08T08:21:04.769119+0000","last_active":"2023-12-08T08:21:16.651312+0000","last_peered":"2023-12-08T08:21:16.651312+0000","last_clean":"2023-12-08T08:21:16.651312+0000","last_became_active":"2023-12-08T08:21:04.768807+0000","last_became_peered":"2023-12-08T08:21:04.768807+0000","last_unstale":"2023-12-08T08:21:16.651312+0000","last_undegraded":"2023-12-08T08:21:16.651312+0000","last_fullsized":"2023-12-08T08:21:16.651312+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:29.810210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654195+0000","last_change":"2023-12-08T08:21:05.525845+0000","last_active":"2023-12-08T08:21:16.654195+0000","last_peered":"2023-12-08T08:21:16.654195+0000","last_clean":"2023-12-08T08:21:16.654195+0000","last_became_active":"2023-12-08T08:21:05.525546+0000","last_became_peered":"2023-12-08T08:21:05.525546+0000","last_unstale":"2023-12-08T08:21:16.654195+0000","last_undegraded":"2023-12-08T08:21:16.654195+0000","last_fullsized":"2023-12-08T08:21:16.654195+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:44.030312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686444+0000","last_change":"2023-12-08T08:21:17.682436+0000","last_active":"2023-12-08T08:21:17.686444+0000","last_peered":"2023-12-08T08:21:17.686444+0000","last_clean":"2023-12-08T08:21:17.686444+0000","last_became_active":"2023-12-08T08:21:17.682222+0000","last_became_peered":"2023-12-08T08:21:17.682222+0000","last_unstale":"2023-12-08T08:21:17.686444+0000","last_undegraded":"2023-12-08T08:21:17.686444+0000","last_fullsized":"2023-12-08T08:21:17.686444+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:49:31.201437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659513+0000","last_change":"2023-12-08T08:21:17.659513+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659513+0000","last_undegraded":"2023-12-08T08:21:17.659513+0000","last_fullsized":"2023-12-08T08:21:17.659513+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654403+0000","last_change":"2023-12-08T08:21:04.771189+0000","last_active":"2023-12-08T08:21:16.654403+0000","last_peered":"2023-12-08T08:21:16.654403+0000","last_clean":"2023-12-08T08:21:16.654403+0000","last_became_active":"2023-12-08T08:21:04.770913+0000","last_became_peered":"2023-12-08T08:21:04.770913+0000","last_unstale":"2023-12-08T08:21:16.654403+0000","last_undegraded":"2023-12-08T08:21:16.654403+0000","last_fullsized":"2023-12-08T08:21:16.654403+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:58:22.885070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.656834+0000","last_change":"2023-12-08T08:21:05.537968+0000","last_active":"2023-12-08T08:21:16.656834+0000","last_peered":"2023-12-08T08:21:16.656834+0000","last_clean":"2023-12-08T08:21:16.656834+0000","last_became_active":"2023-12-08T08:21:05.537190+0000","last_became_peered":"2023-12-08T08:21:05.537190+0000","last_unstale":"2023-12-08T08:21:16.656834+0000","last_undegraded":"2023-12-08T08:21:16.656834+0000","last_fullsized":"2023-12-08T08:21:16.656834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:49.782105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.689179+0000","last_change":"2023-12-08T08:21:17.684922+0000","last_active":"2023-12-08T08:21:17.689179+0000","last_peered":"2023-12-08T08:21:17.689179+0000","last_clean":"2023-12-08T08:21:17.689179+0000","last_became_active":"2023-12-08T08:21:17.684661+0000","last_became_peered":"2023-12-08T08:21:17.684661+0000","last_unstale":"2023-12-08T08:21:17.689179+0000","last_undegraded":"2023-12-08T08:21:17.689179+0000","last_fullsized":"2023-12-08T08:21:17.689179+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:42.863062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.656454+0000","last_change":"2023-12-08T08:21:17.656454+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.656454+0000","last_undegraded":"2023-12-08T08:21:17.656454+0000","last_fullsized":"2023-12-08T08:21:17.656454+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652074+0000","last_change":"2023-12-08T08:21:04.774731+0000","last_active":"2023-12-08T08:21:16.652074+0000","last_peered":"2023-12-08T08:21:16.652074+0000","last_clean":"2023-12-08T08:21:16.652074+0000","last_became_active":"2023-12-08T08:21:04.773894+0000","last_became_peered":"2023-12-08T08:21:04.773894+0000","last_unstale":"2023-12-08T08:21:16.652074+0000","last_undegraded":"2023-12-08T08:21:16.652074+0000","last_fullsized":"2023-12-08T08:21:16.652074+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:46.416448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652665+0000","last_change":"2023-12-08T08:21:05.540583+0000","last_active":"2023-12-08T08:21:16.652665+0000","last_peered":"2023-12-08T08:21:16.652665+0000","last_clean":"2023-12-08T08:21:16.652665+0000","last_became_active":"2023-12-08T08:21:05.540350+0000","last_became_peered":"2023-12-08T08:21:05.540350+0000","last_unstale":"2023-12-08T08:21:16.652665+0000","last_undegraded":"2023-12-08T08:21:16.652665+0000","last_fullsized":"2023-12-08T08:21:16.652665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:46:44.526151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.685385+0000","last_change":"2023-12-08T08:21:17.679399+0000","last_active":"2023-12-08T08:21:17.685385+0000","last_peered":"2023-12-08T08:21:17.685385+0000","last_clean":"2023-12-08T08:21:17.685385+0000","last_became_active":"2023-12-08T08:21:17.679103+0000","last_became_peered":"2023-12-08T08:21:17.679103+0000","last_unstale":"2023-12-08T08:21:17.685385+0000","last_undegraded":"2023-12-08T08:21:17.685385+0000","last_fullsized":"2023-12-08T08:21:17.685385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:11:38.595950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.662267+0000","last_change":"2023-12-08T08:21:17.662267+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.662267+0000","last_undegraded":"2023-12-08T08:21:17.662267+0000","last_fullsized":"2023-12-08T08:21:17.662267+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655121+0000","last_change":"2023-12-08T08:21:04.778519+0000","last_active":"2023-12-08T08:21:16.655121+0000","last_peered":"2023-12-08T08:21:16.655121+0000","last_clean":"2023-12-08T08:21:16.655121+0000","last_became_active":"2023-12-08T08:21:04.778208+0000","last_became_peered":"2023-12-08T08:21:04.778208+0000","last_unstale":"2023-12-08T08:21:16.655121+0000","last_undegraded":"2023-12-08T08:21:16.655121+0000","last_fullsized":"2023-12-08T08:21:16.655121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:36.535172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654305+0000","last_change":"2023-12-08T08:21:05.530364+0000","last_active":"2023-12-08T08:21:16.654305+0000","last_peered":"2023-12-08T08:21:16.654305+0000","last_clean":"2023-12-08T08:21:16.654305+0000","last_became_active":"2023-12-08T08:21:05.530046+0000","last_became_peered":"2023-12-08T08:21:05.530046+0000","last_unstale":"2023-12-08T08:21:16.654305+0000","last_undegraded":"2023-12-08T08:21:16.654305+0000","last_fullsized":"2023-12-08T08:21:16.654305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.368162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.684614+0000","last_change":"2023-12-08T08:21:17.680178+0000","last_active":"2023-12-08T08:21:17.684614+0000","last_peered":"2023-12-08T08:21:17.684614+0000","last_clean":"2023-12-08T08:21:17.684614+0000","last_became_active":"2023-12-08T08:21:17.679880+0000","last_became_peered":"2023-12-08T08:21:17.679880+0000","last_unstale":"2023-12-08T08:21:17.684614+0000","last_undegraded":"2023-12-08T08:21:17.684614+0000","last_fullsized":"2023-12-08T08:21:17.684614+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:54.148326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.673219+0000","last_change":"2023-12-08T08:21:17.673219+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.673219+0000","last_undegraded":"2023-12-08T08:21:17.673219+0000","last_fullsized":"2023-12-08T08:21:17.673219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648603+0000","last_change":"2023-12-08T08:21:04.771979+0000","last_active":"2023-12-08T08:21:16.648603+0000","last_peered":"2023-12-08T08:21:16.648603+0000","last_clean":"2023-12-08T08:21:16.648603+0000","last_became_active":"2023-12-08T08:21:04.771656+0000","last_became_peered":"2023-12-08T08:21:04.771656+0000","last_unstale":"2023-12-08T08:21:16.648603+0000","last_undegraded":"2023-12-08T08:21:16.648603+0000","last_fullsized":"2023-12-08T08:21:16.648603+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:46:43.523269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649282+0000","last_change":"2023-12-08T08:21:05.538591+0000","last_active":"2023-12-08T08:21:16.649282+0000","last_peered":"2023-12-08T08:21:16.649282+0000","last_clean":"2023-12-08T08:21:16.649282+0000","last_became_active":"2023-12-08T08:21:05.538303+0000","last_became_peered":"2023-12-08T08:21:05.538303+0000","last_unstale":"2023-12-08T08:21:16.649282+0000","last_undegraded":"2023-12-08T08:21:16.649282+0000","last_fullsized":"2023-12-08T08:21:16.649282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:45:35.860546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686482+0000","last_change":"2023-12-08T08:21:17.682782+0000","last_active":"2023-12-08T08:21:17.686482+0000","last_peered":"2023-12-08T08:21:17.686482+0000","last_clean":"2023-12-08T08:21:17.686482+0000","last_became_active":"2023-12-08T08:21:17.681371+0000","last_became_peered":"2023-12-08T08:21:17.681371+0000","last_unstale":"2023-12-08T08:21:17.686482+0000","last_undegraded":"2023-12-08T08:21:17.686482+0000","last_fullsized":"2023-12-08T08:21:17.686482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:41:10.487912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.657337+0000","last_change":"2023-12-08T08:21:17.657337+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.657337+0000","last_undegraded":"2023-12-08T08:21:17.657337+0000","last_fullsized":"2023-12-08T08:21:17.657337+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.650676+0000","last_change":"2023-12-08T08:21:04.776313+0000","last_active":"2023-12-08T08:21:16.650676+0000","last_peered":"2023-12-08T08:21:16.650676+0000","last_clean":"2023-12-08T08:21:16.650676+0000","last_became_active":"2023-12-08T08:21:04.775894+0000","last_became_peered":"2023-12-08T08:21:04.775894+0000","last_unstale":"2023-12-08T08:21:16.650676+0000","last_undegraded":"2023-12-08T08:21:16.650676+0000","last_fullsized":"2023-12-08T08:21:16.650676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:13.006406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649886+0000","last_change":"2023-12-08T08:21:05.537164+0000","last_active":"2023-12-08T08:21:16.649886+0000","last_peered":"2023-12-08T08:21:16.649886+0000","last_clean":"2023-12-08T08:21:16.649886+0000","last_became_active":"2023-12-08T08:21:05.536915+0000","last_became_peered":"2023-12-08T08:21:05.536915+0000","last_unstale":"2023-12-08T08:21:16.649886+0000","last_undegraded":"2023-12-08T08:21:16.649886+0000","last_fullsized":"2023-12-08T08:21:16.649886+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:14.009289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.676342+0000","last_change":"2023-12-08T08:21:17.673958+0000","last_active":"2023-12-08T08:21:17.676342+0000","last_peered":"2023-12-08T08:21:17.676342+0000","last_clean":"2023-12-08T08:21:17.676342+0000","last_became_active":"2023-12-08T08:21:17.673637+0000","last_became_peered":"2023-12-08T08:21:17.673637+0000","last_unstale":"2023-12-08T08:21:17.676342+0000","last_undegraded":"2023-12-08T08:21:17.676342+0000","last_fullsized":"2023-12-08T08:21:17.676342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:54.148326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659996+0000","last_change":"2023-12-08T08:21:17.659996+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659996+0000","last_undegraded":"2023-12-08T08:21:17.659996+0000","last_fullsized":"2023-12-08T08:21:17.659996+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654170+0000","last_change":"2023-12-08T08:21:04.768985+0000","last_active":"2023-12-08T08:21:16.654170+0000","last_peered":"2023-12-08T08:21:16.654170+0000","last_clean":"2023-12-08T08:21:16.654170+0000","last_became_active":"2023-12-08T08:21:04.768693+0000","last_became_peered":"2023-12-08T08:21:04.768693+0000","last_unstale":"2023-12-08T08:21:16.654170+0000","last_undegraded":"2023-12-08T08:21:16.654170+0000","last_fullsized":"2023-12-08T08:21:16.654170+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:29.810210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649619+0000","last_change":"2023-12-08T08:21:05.542434+0000","last_active":"2023-12-08T08:21:16.649619+0000","last_peered":"2023-12-08T08:21:16.649619+0000","last_clean":"2023-12-08T08:21:16.649619+0000","last_became_active":"2023-12-08T08:21:05.542218+0000","last_became_peered":"2023-12-08T08:21:05.542218+0000","last_unstale":"2023-12-08T08:21:16.649619+0000","last_undegraded":"2023-12-08T08:21:16.649619+0000","last_fullsized":"2023-12-08T08:21:16.649619+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:16:19.580755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.674800+0000","last_change":"2023-12-08T08:21:17.668067+0000","last_active":"2023-12-08T08:21:17.674800+0000","last_peered":"2023-12-08T08:21:17.674800+0000","last_clean":"2023-12-08T08:21:17.674800+0000","last_became_active":"2023-12-08T08:21:17.667751+0000","last_became_peered":"2023-12-08T08:21:17.667751+0000","last_unstale":"2023-12-08T08:21:17.674800+0000","last_undegraded":"2023-12-08T08:21:17.674800+0000","last_fullsized":"2023-12-08T08:21:17.674800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:25.581863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.657341+0000","last_change":"2023-12-08T08:21:17.657341+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.657341+0000","last_undegraded":"2023-12-08T08:21:17.657341+0000","last_fullsized":"2023-12-08T08:21:17.657341+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648875+0000","last_change":"2023-12-08T08:21:04.775274+0000","last_active":"2023-12-08T08:21:16.648875+0000","last_peered":"2023-12-08T08:21:16.648875+0000","last_clean":"2023-12-08T08:21:16.648875+0000","last_became_active":"2023-12-08T08:21:04.774961+0000","last_became_peered":"2023-12-08T08:21:04.774961+0000","last_unstale":"2023-12-08T08:21:16.648875+0000","last_undegraded":"2023-12-08T08:21:16.648875+0000","last_fullsized":"2023-12-08T08:21:16.648875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:03.400233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652649+0000","last_change":"2023-12-08T08:21:05.534904+0000","last_active":"2023-12-08T08:21:16.652649+0000","last_peered":"2023-12-08T08:21:16.652649+0000","last_clean":"2023-12-08T08:21:16.652649+0000","last_became_active":"2023-12-08T08:21:05.534637+0000","last_became_peered":"2023-12-08T08:21:05.534637+0000","last_unstale":"2023-12-08T08:21:16.652649+0000","last_undegraded":"2023-12-08T08:21:16.652649+0000","last_fullsized":"2023-12-08T08:21:16.652649+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:40:41.034391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686389+0000","last_change":"2023-12-08T08:21:17.682559+0000","last_active":"2023-12-08T08:21:17.686389+0000","last_peered":"2023-12-08T08:21:17.686389+0000","last_clean":"2023-12-08T08:21:17.686389+0000","last_became_active":"2023-12-08T08:21:17.675578+0000","last_became_peered":"2023-12-08T08:21:17.675578+0000","last_unstale":"2023-12-08T08:21:17.686389+0000","last_undegraded":"2023-12-08T08:21:17.686389+0000","last_fullsized":"2023-12-08T08:21:17.686389+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:46:01.671872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.658216+0000","last_change":"2023-12-08T08:21:17.658216+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.658216+0000","last_undegraded":"2023-12-08T08:21:17.658216+0000","last_fullsized":"2023-12-08T08:21:17.658216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649140+0000","last_change":"2023-12-08T08:21:04.770820+0000","last_active":"2023-12-08T08:21:16.649140+0000","last_peered":"2023-12-08T08:21:16.649140+0000","last_clean":"2023-12-08T08:21:16.649140+0000","last_became_active":"2023-12-08T08:21:04.767804+0000","last_became_peered":"2023-12-08T08:21:04.767804+0000","last_unstale":"2023-12-08T08:21:16.649140+0000","last_undegraded":"2023-12-08T08:21:16.649140+0000","last_fullsized":"2023-12-08T08:21:16.649140+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:58:22.885070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651163+0000","last_change":"2023-12-08T08:21:05.521567+0000","last_active":"2023-12-08T08:21:16.651163+0000","last_peered":"2023-12-08T08:21:16.651163+0000","last_clean":"2023-12-08T08:21:16.651163+0000","last_became_active":"2023-12-08T08:21:05.521289+0000","last_became_peered":"2023-12-08T08:21:05.521289+0000","last_unstale":"2023-12-08T08:21:16.651163+0000","last_undegraded":"2023-12-08T08:21:16.651163+0000","last_fullsized":"2023-12-08T08:21:16.651163+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:11.477913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.689245+0000","last_change":"2023-12-08T08:21:17.683937+0000","last_active":"2023-12-08T08:21:17.689245+0000","last_peered":"2023-12-08T08:21:17.689245+0000","last_clean":"2023-12-08T08:21:17.689245+0000","last_became_active":"2023-12-08T08:21:17.683574+0000","last_became_peered":"2023-12-08T08:21:17.683574+0000","last_unstale":"2023-12-08T08:21:17.689245+0000","last_undegraded":"2023-12-08T08:21:17.689245+0000","last_fullsized":"2023-12-08T08:21:17.689245+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:58:35.777720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.662363+0000","last_change":"2023-12-08T08:21:17.662363+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.662363+0000","last_undegraded":"2023-12-08T08:21:17.662363+0000","last_fullsized":"2023-12-08T08:21:17.662363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649148+0000","last_change":"2023-12-08T08:21:04.776652+0000","last_active":"2023-12-08T08:21:16.649148+0000","last_peered":"2023-12-08T08:21:16.649148+0000","last_clean":"2023-12-08T08:21:16.649148+0000","last_became_active":"2023-12-08T08:21:04.776345+0000","last_became_peered":"2023-12-08T08:21:04.776345+0000","last_unstale":"2023-12-08T08:21:16.649148+0000","last_undegraded":"2023-12-08T08:21:16.649148+0000","last_fullsized":"2023-12-08T08:21:16.649148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:46.416448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.656832+0000","last_change":"2023-12-08T08:21:05.538159+0000","last_active":"2023-12-08T08:21:16.656832+0000","last_peered":"2023-12-08T08:21:16.656832+0000","last_clean":"2023-12-08T08:21:16.656832+0000","last_became_active":"2023-12-08T08:21:05.537601+0000","last_became_peered":"2023-12-08T08:21:05.537601+0000","last_unstale":"2023-12-08T08:21:16.656832+0000","last_undegraded":"2023-12-08T08:21:16.656832+0000","last_fullsized":"2023-12-08T08:21:16.656832+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:09:56.356105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.680296+0000","last_change":"2023-12-08T08:21:17.675955+0000","last_active":"2023-12-08T08:21:17.680296+0000","last_peered":"2023-12-08T08:21:17.680296+0000","last_clean":"2023-12-08T08:21:17.680296+0000","last_became_active":"2023-12-08T08:21:17.675547+0000","last_became_peered":"2023-12-08T08:21:17.675547+0000","last_unstale":"2023-12-08T08:21:17.680296+0000","last_undegraded":"2023-12-08T08:21:17.680296+0000","last_fullsized":"2023-12-08T08:21:17.680296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:59.826879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.662129+0000","last_change":"2023-12-08T08:21:17.662129+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.662129+0000","last_undegraded":"2023-12-08T08:21:17.662129+0000","last_fullsized":"2023-12-08T08:21:17.662129+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651983+0000","last_change":"2023-12-08T08:21:04.785414+0000","last_active":"2023-12-08T08:21:16.651983+0000","last_peered":"2023-12-08T08:21:16.651983+0000","last_clean":"2023-12-08T08:21:16.651983+0000","last_became_active":"2023-12-08T08:21:04.785198+0000","last_became_peered":"2023-12-08T08:21:04.785198+0000","last_unstale":"2023-12-08T08:21:16.651983+0000","last_undegraded":"2023-12-08T08:21:16.651983+0000","last_fullsized":"2023-12-08T08:21:16.651983+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:03.400233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649085+0000","last_change":"2023-12-08T08:21:05.537706+0000","last_active":"2023-12-08T08:21:16.649085+0000","last_peered":"2023-12-08T08:21:16.649085+0000","last_clean":"2023-12-08T08:21:16.649085+0000","last_became_active":"2023-12-08T08:21:05.537282+0000","last_became_peered":"2023-12-08T08:21:05.537282+0000","last_unstale":"2023-12-08T08:21:16.649085+0000","last_undegraded":"2023-12-08T08:21:16.649085+0000","last_fullsized":"2023-12-08T08:21:16.649085+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:13.692096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.687157+0000","last_change":"2023-12-08T08:21:17.685511+0000","last_active":"2023-12-08T08:21:17.687157+0000","last_peered":"2023-12-08T08:21:17.687157+0000","last_clean":"2023-12-08T08:21:17.687157+0000","last_became_active":"2023-12-08T08:21:17.685173+0000","last_became_peered":"2023-12-08T08:21:17.685173+0000","last_unstale":"2023-12-08T08:21:17.687157+0000","last_undegraded":"2023-12-08T08:21:17.687157+0000","last_fullsized":"2023-12-08T08:21:17.687157+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:55:55.550300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.658627+0000","last_change":"2023-12-08T08:21:17.658627+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.658627+0000","last_undegraded":"2023-12-08T08:21:17.658627+0000","last_fullsized":"2023-12-08T08:21:17.658627+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643854+0000","last_change":"2023-12-08T08:21:04.775742+0000","last_active":"2023-12-08T08:21:16.643854+0000","last_peered":"2023-12-08T08:21:16.643854+0000","last_clean":"2023-12-08T08:21:16.643854+0000","last_became_active":"2023-12-08T08:21:04.775482+0000","last_became_peered":"2023-12-08T08:21:04.775482+0000","last_unstale":"2023-12-08T08:21:16.643854+0000","last_undegraded":"2023-12-08T08:21:16.643854+0000","last_fullsized":"2023-12-08T08:21:16.643854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:46.416448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.650561+0000","last_change":"2023-12-08T08:21:05.528065+0000","last_active":"2023-12-08T08:21:16.650561+0000","last_peered":"2023-12-08T08:21:16.650561+0000","last_clean":"2023-12-08T08:21:16.650561+0000","last_became_active":"2023-12-08T08:21:05.527792+0000","last_became_peered":"2023-12-08T08:21:05.527792+0000","last_unstale":"2023-12-08T08:21:16.650561+0000","last_undegraded":"2023-12-08T08:21:16.650561+0000","last_fullsized":"2023-12-08T08:21:16.650561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:51:06.333206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.683125+0000","last_change":"2023-12-08T08:21:17.677690+0000","last_active":"2023-12-08T08:21:17.683125+0000","last_peered":"2023-12-08T08:21:17.683125+0000","last_clean":"2023-12-08T08:21:17.683125+0000","last_became_active":"2023-12-08T08:21:17.677376+0000","last_became_peered":"2023-12-08T08:21:17.677376+0000","last_unstale":"2023-12-08T08:21:17.683125+0000","last_undegraded":"2023-12-08T08:21:17.683125+0000","last_fullsized":"2023-12-08T08:21:17.683125+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:55:55.550300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661062+0000","last_change":"2023-12-08T08:21:17.661062+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661062+0000","last_undegraded":"2023-12-08T08:21:17.661062+0000","last_fullsized":"2023-12-08T08:21:17.661062+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643764+0000","last_change":"2023-12-08T08:21:04.781520+0000","last_active":"2023-12-08T08:21:16.643764+0000","last_peered":"2023-12-08T08:21:16.643764+0000","last_clean":"2023-12-08T08:21:16.643764+0000","last_became_active":"2023-12-08T08:21:04.781236+0000","last_became_peered":"2023-12-08T08:21:04.781236+0000","last_unstale":"2023-12-08T08:21:16.643764+0000","last_undegraded":"2023-12-08T08:21:16.643764+0000","last_fullsized":"2023-12-08T08:21:16.643764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:14:17.281881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.653811+0000","last_change":"2023-12-08T08:21:05.544369+0000","last_active":"2023-12-08T08:21:16.653811+0000","last_peered":"2023-12-08T08:21:16.653811+0000","last_clean":"2023-12-08T08:21:16.653811+0000","last_became_active":"2023-12-08T08:21:05.544090+0000","last_became_peered":"2023-12-08T08:21:05.544090+0000","last_unstale":"2023-12-08T08:21:16.653811+0000","last_undegraded":"2023-12-08T08:21:16.653811+0000","last_fullsized":"2023-12-08T08:21:16.653811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:25.239396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.685476+0000","last_change":"2023-12-08T08:21:17.681233+0000","last_active":"2023-12-08T08:21:17.685476+0000","last_peered":"2023-12-08T08:21:17.685476+0000","last_clean":"2023-12-08T08:21:17.685476+0000","last_became_active":"2023-12-08T08:21:17.680645+0000","last_became_peered":"2023-12-08T08:21:17.680645+0000","last_unstale":"2023-12-08T08:21:17.685476+0000","last_undegraded":"2023-12-08T08:21:17.685476+0000","last_fullsized":"2023-12-08T08:21:17.685476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:50:42.502393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661129+0000","last_change":"2023-12-08T08:21:17.661129+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661129+0000","last_undegraded":"2023-12-08T08:21:17.661129+0000","last_fullsized":"2023-12-08T08:21:17.661129+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652680+0000","last_change":"2023-12-08T08:21:04.778563+0000","last_active":"2023-12-08T08:21:16.652680+0000","last_peered":"2023-12-08T08:21:16.652680+0000","last_clean":"2023-12-08T08:21:16.652680+0000","last_became_active":"2023-12-08T08:21:04.778275+0000","last_became_peered":"2023-12-08T08:21:04.778275+0000","last_unstale":"2023-12-08T08:21:16.652680+0000","last_undegraded":"2023-12-08T08:21:16.652680+0000","last_fullsized":"2023-12-08T08:21:16.652680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:45:05.142948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644069+0000","last_change":"2023-12-08T08:21:05.528470+0000","last_active":"2023-12-08T08:21:16.644069+0000","last_peered":"2023-12-08T08:21:16.644069+0000","last_clean":"2023-12-08T08:21:16.644069+0000","last_became_active":"2023-12-08T08:21:05.528125+0000","last_became_peered":"2023-12-08T08:21:05.528125+0000","last_unstale":"2023-12-08T08:21:16.644069+0000","last_undegraded":"2023-12-08T08:21:16.644069+0000","last_fullsized":"2023-12-08T08:21:16.644069+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.368162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.675089+0000","last_change":"2023-12-08T08:21:17.670281+0000","last_active":"2023-12-08T08:21:17.675089+0000","last_peered":"2023-12-08T08:21:17.675089+0000","last_clean":"2023-12-08T08:21:17.675089+0000","last_became_active":"2023-12-08T08:21:17.670085+0000","last_became_peered":"2023-12-08T08:21:17.670085+0000","last_unstale":"2023-12-08T08:21:17.675089+0000","last_undegraded":"2023-12-08T08:21:17.675089+0000","last_fullsized":"2023-12-08T08:21:17.675089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:20.486293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.667977+0000","last_change":"2023-12-08T08:21:17.667977+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.667977+0000","last_undegraded":"2023-12-08T08:21:17.667977+0000","last_fullsized":"2023-12-08T08:21:17.667977+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648818+0000","last_change":"2023-12-08T08:21:04.773643+0000","last_active":"2023-12-08T08:21:16.648818+0000","last_peered":"2023-12-08T08:21:16.648818+0000","last_clean":"2023-12-08T08:21:16.648818+0000","last_became_active":"2023-12-08T08:21:04.773361+0000","last_became_peered":"2023-12-08T08:21:04.773361+0000","last_unstale":"2023-12-08T08:21:16.648818+0000","last_undegraded":"2023-12-08T08:21:16.648818+0000","last_fullsized":"2023-12-08T08:21:16.648818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:08.017533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652611+0000","last_change":"2023-12-08T08:21:05.543017+0000","last_active":"2023-12-08T08:21:16.652611+0000","last_peered":"2023-12-08T08:21:16.652611+0000","last_clean":"2023-12-08T08:21:16.652611+0000","last_became_active":"2023-12-08T08:21:05.542729+0000","last_became_peered":"2023-12-08T08:21:05.542729+0000","last_unstale":"2023-12-08T08:21:16.652611+0000","last_undegraded":"2023-12-08T08:21:16.652611+0000","last_fullsized":"2023-12-08T08:21:16.652611+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:19.928543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.680377+0000","last_change":"2023-12-08T08:21:17.672426+0000","last_active":"2023-12-08T08:21:17.680377+0000","last_peered":"2023-12-08T08:21:17.680377+0000","last_clean":"2023-12-08T08:21:17.680377+0000","last_became_active":"2023-12-08T08:21:17.672079+0000","last_became_peered":"2023-12-08T08:21:17.672079+0000","last_unstale":"2023-12-08T08:21:17.680377+0000","last_undegraded":"2023-12-08T08:21:17.680377+0000","last_fullsized":"2023-12-08T08:21:17.680377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:11:38.595950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.660226+0000","last_change":"2023-12-08T08:21:17.660226+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.660226+0000","last_undegraded":"2023-12-08T08:21:17.660226+0000","last_fullsized":"2023-12-08T08:21:17.660226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"31'8","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644372+0000","last_change":"2023-12-08T08:21:04.778814+0000","last_active":"2023-12-08T08:21:16.644372+0000","last_peered":"2023-12-08T08:21:16.644372+0000","last_clean":"2023-12-08T08:21:16.644372+0000","last_became_active":"2023-12-08T08:21:04.778501+0000","last_became_peered":"2023-12-08T08:21:04.778501+0000","last_unstale":"2023-12-08T08:21:16.644372+0000","last_undegraded":"2023-12-08T08:21:16.644372+0000","last_fullsized":"2023-12-08T08:21:16.644372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:50:52.651732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655964+0000","last_change":"2023-12-08T08:21:05.540670+0000","last_active":"2023-12-08T08:21:16.655964+0000","last_peered":"2023-12-08T08:21:16.655964+0000","last_clean":"2023-12-08T08:21:16.655964+0000","last_became_active":"2023-12-08T08:21:05.539546+0000","last_became_peered":"2023-12-08T08:21:05.539546+0000","last_unstale":"2023-12-08T08:21:16.655964+0000","last_undegraded":"2023-12-08T08:21:16.655964+0000","last_fullsized":"2023-12-08T08:21:16.655964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:20:39.875619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.678590+0000","last_change":"2023-12-08T08:21:17.668240+0000","last_active":"2023-12-08T08:21:17.678590+0000","last_peered":"2023-12-08T08:21:17.678590+0000","last_clean":"2023-12-08T08:21:17.678590+0000","last_became_active":"2023-12-08T08:21:17.667990+0000","last_became_peered":"2023-12-08T08:21:17.667990+0000","last_unstale":"2023-12-08T08:21:17.678590+0000","last_undegraded":"2023-12-08T08:21:17.678590+0000","last_fullsized":"2023-12-08T08:21:17.678590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:54.911358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.656815+0000","last_change":"2023-12-08T08:21:17.656815+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.656815+0000","last_undegraded":"2023-12-08T08:21:17.656815+0000","last_fullsized":"2023-12-08T08:21:17.656815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.656147+0000","last_change":"2023-12-08T08:21:04.782195+0000","last_active":"2023-12-08T08:21:16.656147+0000","last_peered":"2023-12-08T08:21:16.656147+0000","last_clean":"2023-12-08T08:21:16.656147+0000","last_became_active":"2023-12-08T08:21:04.781298+0000","last_became_peered":"2023-12-08T08:21:04.781298+0000","last_unstale":"2023-12-08T08:21:16.656147+0000","last_undegraded":"2023-12-08T08:21:16.656147+0000","last_fullsized":"2023-12-08T08:21:16.656147+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:12.689213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644226+0000","last_change":"2023-12-08T08:21:05.532372+0000","last_active":"2023-12-08T08:21:16.644226+0000","last_peered":"2023-12-08T08:21:16.644226+0000","last_clean":"2023-12-08T08:21:16.644226+0000","last_became_active":"2023-12-08T08:21:05.531767+0000","last_became_peered":"2023-12-08T08:21:05.531767+0000","last_unstale":"2023-12-08T08:21:16.644226+0000","last_undegraded":"2023-12-08T08:21:16.644226+0000","last_fullsized":"2023-12-08T08:21:16.644226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:30.973295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686218+0000","last_change":"2023-12-08T08:21:17.682631+0000","last_active":"2023-12-08T08:21:17.686218+0000","last_peered":"2023-12-08T08:21:17.686218+0000","last_clean":"2023-12-08T08:21:17.686218+0000","last_became_active":"2023-12-08T08:21:17.677727+0000","last_became_peered":"2023-12-08T08:21:17.677727+0000","last_unstale":"2023-12-08T08:21:17.686218+0000","last_undegraded":"2023-12-08T08:21:17.686218+0000","last_fullsized":"2023-12-08T08:21:17.686218+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:10:08.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661135+0000","last_change":"2023-12-08T08:21:17.661135+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661135+0000","last_undegraded":"2023-12-08T08:21:17.661135+0000","last_fullsized":"2023-12-08T08:21:17.661135+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654331+0000","last_change":"2023-12-08T08:21:04.786064+0000","last_active":"2023-12-08T08:21:16.654331+0000","last_peered":"2023-12-08T08:21:16.654331+0000","last_clean":"2023-12-08T08:21:16.654331+0000","last_became_active":"2023-12-08T08:21:04.785859+0000","last_became_peered":"2023-12-08T08:21:04.785859+0000","last_unstale":"2023-12-08T08:21:16.654331+0000","last_undegraded":"2023-12-08T08:21:16.654331+0000","last_fullsized":"2023-12-08T08:21:16.654331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:12.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644317+0000","last_change":"2023-12-08T08:21:05.532644+0000","last_active":"2023-12-08T08:21:16.644317+0000","last_peered":"2023-12-08T08:21:16.644317+0000","last_clean":"2023-12-08T08:21:16.644317+0000","last_became_active":"2023-12-08T08:21:05.530404+0000","last_became_peered":"2023-12-08T08:21:05.530404+0000","last_unstale":"2023-12-08T08:21:16.644317+0000","last_undegraded":"2023-12-08T08:21:16.644317+0000","last_fullsized":"2023-12-08T08:21:16.644317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:05:11.193024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.684441+0000","last_change":"2023-12-08T08:21:17.677740+0000","last_active":"2023-12-08T08:21:17.684441+0000","last_peered":"2023-12-08T08:21:17.684441+0000","last_clean":"2023-12-08T08:21:17.684441+0000","last_became_active":"2023-12-08T08:21:17.672121+0000","last_became_peered":"2023-12-08T08:21:17.672121+0000","last_unstale":"2023-12-08T08:21:17.684441+0000","last_undegraded":"2023-12-08T08:21:17.684441+0000","last_fullsized":"2023-12-08T08:21:17.684441+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:20.910184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.664339+0000","last_change":"2023-12-08T08:21:17.664339+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.664339+0000","last_undegraded":"2023-12-08T08:21:17.664339+0000","last_fullsized":"2023-12-08T08:21:17.664339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644467+0000","last_change":"2023-12-08T08:21:04.782800+0000","last_active":"2023-12-08T08:21:16.644467+0000","last_peered":"2023-12-08T08:21:16.644467+0000","last_clean":"2023-12-08T08:21:16.644467+0000","last_became_active":"2023-12-08T08:21:04.782531+0000","last_became_peered":"2023-12-08T08:21:04.782531+0000","last_unstale":"2023-12-08T08:21:16.644467+0000","last_undegraded":"2023-12-08T08:21:16.644467+0000","last_fullsized":"2023-12-08T08:21:16.644467+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:42.018708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.656002+0000","last_change":"2023-12-08T08:21:05.533947+0000","last_active":"2023-12-08T08:21:16.656002+0000","last_peered":"2023-12-08T08:21:16.656002+0000","last_clean":"2023-12-08T08:21:16.656002+0000","last_became_active":"2023-12-08T08:21:05.533554+0000","last_became_peered":"2023-12-08T08:21:05.533554+0000","last_unstale":"2023-12-08T08:21:16.656002+0000","last_undegraded":"2023-12-08T08:21:16.656002+0000","last_fullsized":"2023-12-08T08:21:16.656002+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:25.239396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.685462+0000","last_change":"2023-12-08T08:21:17.679519+0000","last_active":"2023-12-08T08:21:17.685462+0000","last_peered":"2023-12-08T08:21:17.685462+0000","last_clean":"2023-12-08T08:21:17.685462+0000","last_became_active":"2023-12-08T08:21:17.679265+0000","last_became_peered":"2023-12-08T08:21:17.679265+0000","last_unstale":"2023-12-08T08:21:17.685462+0000","last_undegraded":"2023-12-08T08:21:17.685462+0000","last_fullsized":"2023-12-08T08:21:17.685462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:12.057342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659167+0000","last_change":"2023-12-08T08:21:17.659167+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659167+0000","last_undegraded":"2023-12-08T08:21:17.659167+0000","last_fullsized":"2023-12-08T08:21:17.659167+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648603+0000","last_change":"2023-12-08T08:21:04.776553+0000","last_active":"2023-12-08T08:21:16.648603+0000","last_peered":"2023-12-08T08:21:16.648603+0000","last_clean":"2023-12-08T08:21:16.648603+0000","last_became_active":"2023-12-08T08:21:04.773755+0000","last_became_peered":"2023-12-08T08:21:04.773755+0000","last_unstale":"2023-12-08T08:21:16.648603+0000","last_undegraded":"2023-12-08T08:21:16.648603+0000","last_fullsized":"2023-12-08T08:21:16.648603+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:12.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651140+0000","last_change":"2023-12-08T08:21:05.536397+0000","last_active":"2023-12-08T08:21:16.651140+0000","last_peered":"2023-12-08T08:21:16.651140+0000","last_clean":"2023-12-08T08:21:16.651140+0000","last_became_active":"2023-12-08T08:21:05.536103+0000","last_became_peered":"2023-12-08T08:21:05.536103+0000","last_unstale":"2023-12-08T08:21:16.651140+0000","last_undegraded":"2023-12-08T08:21:16.651140+0000","last_fullsized":"2023-12-08T08:21:16.651140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:44.030312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.674675+0000","last_change":"2023-12-08T08:21:17.671190+0000","last_active":"2023-12-08T08:21:17.674675+0000","last_peered":"2023-12-08T08:21:17.674675+0000","last_clean":"2023-12-08T08:21:17.674675+0000","last_became_active":"2023-12-08T08:21:17.670895+0000","last_became_peered":"2023-12-08T08:21:17.670895+0000","last_unstale":"2023-12-08T08:21:17.674675+0000","last_undegraded":"2023-12-08T08:21:17.674675+0000","last_fullsized":"2023-12-08T08:21:17.674675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:42.863062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.655881+0000","last_change":"2023-12-08T08:21:17.655881+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.655881+0000","last_undegraded":"2023-12-08T08:21:17.655881+0000","last_fullsized":"2023-12-08T08:21:17.655881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643850+0000","last_change":"2023-12-08T08:21:04.780723+0000","last_active":"2023-12-08T08:21:16.643850+0000","last_peered":"2023-12-08T08:21:16.643850+0000","last_clean":"2023-12-08T08:21:16.643850+0000","last_became_active":"2023-12-08T08:21:04.780436+0000","last_became_peered":"2023-12-08T08:21:04.780436+0000","last_unstale":"2023-12-08T08:21:16.643850+0000","last_undegraded":"2023-12-08T08:21:16.643850+0000","last_fullsized":"2023-12-08T08:21:16.643850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:12.689213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648504+0000","last_change":"2023-12-08T08:21:05.535708+0000","last_active":"2023-12-08T08:21:16.648504+0000","last_peered":"2023-12-08T08:21:16.648504+0000","last_clean":"2023-12-08T08:21:16.648504+0000","last_became_active":"2023-12-08T08:21:05.527959+0000","last_became_peered":"2023-12-08T08:21:05.527959+0000","last_unstale":"2023-12-08T08:21:16.648504+0000","last_undegraded":"2023-12-08T08:21:16.648504+0000","last_fullsized":"2023-12-08T08:21:16.648504+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:14:18.284764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.685488+0000","last_change":"2023-12-08T08:21:17.681447+0000","last_active":"2023-12-08T08:21:17.685488+0000","last_peered":"2023-12-08T08:21:17.685488+0000","last_clean":"2023-12-08T08:21:17.685488+0000","last_became_active":"2023-12-08T08:21:17.680989+0000","last_became_peered":"2023-12-08T08:21:17.680989+0000","last_unstale":"2023-12-08T08:21:17.685488+0000","last_undegraded":"2023-12-08T08:21:17.685488+0000","last_fullsized":"2023-12-08T08:21:17.685488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:24.695194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661815+0000","last_change":"2023-12-08T08:21:17.661815+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661815+0000","last_undegraded":"2023-12-08T08:21:17.661815+0000","last_fullsized":"2023-12-08T08:21:17.661815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649335+0000","last_change":"2023-12-08T08:21:04.783596+0000","last_active":"2023-12-08T08:21:16.649335+0000","last_peered":"2023-12-08T08:21:16.649335+0000","last_clean":"2023-12-08T08:21:16.649335+0000","last_became_active":"2023-12-08T08:21:04.783159+0000","last_became_peered":"2023-12-08T08:21:04.783159+0000","last_unstale":"2023-12-08T08:21:16.649335+0000","last_undegraded":"2023-12-08T08:21:16.649335+0000","last_fullsized":"2023-12-08T08:21:16.649335+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:43.027429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655533+0000","last_change":"2023-12-08T08:21:05.537414+0000","last_active":"2023-12-08T08:21:16.655533+0000","last_peered":"2023-12-08T08:21:16.655533+0000","last_clean":"2023-12-08T08:21:16.655533+0000","last_became_active":"2023-12-08T08:21:05.537137+0000","last_became_peered":"2023-12-08T08:21:05.537137+0000","last_unstale":"2023-12-08T08:21:16.655533+0000","last_undegraded":"2023-12-08T08:21:16.655533+0000","last_fullsized":"2023-12-08T08:21:16.655533+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:08.596525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.677172+0000","last_change":"2023-12-08T08:21:17.676027+0000","last_active":"2023-12-08T08:21:17.677172+0000","last_peered":"2023-12-08T08:21:17.677172+0000","last_clean":"2023-12-08T08:21:17.677172+0000","last_became_active":"2023-12-08T08:21:17.675823+0000","last_became_peered":"2023-12-08T08:21:17.675823+0000","last_unstale":"2023-12-08T08:21:17.677172+0000","last_undegraded":"2023-12-08T08:21:17.677172+0000","last_fullsized":"2023-12-08T08:21:17.677172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:14:30.174532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.656636+0000","last_change":"2023-12-08T08:21:17.656636+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.656636+0000","last_undegraded":"2023-12-08T08:21:17.656636+0000","last_fullsized":"2023-12-08T08:21:17.656636+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648820+0000","last_change":"2023-12-08T08:21:04.784944+0000","last_active":"2023-12-08T08:21:16.648820+0000","last_peered":"2023-12-08T08:21:16.648820+0000","last_clean":"2023-12-08T08:21:16.648820+0000","last_became_active":"2023-12-08T08:21:04.784657+0000","last_became_peered":"2023-12-08T08:21:04.784657+0000","last_unstale":"2023-12-08T08:21:16.648820+0000","last_undegraded":"2023-12-08T08:21:16.648820+0000","last_fullsized":"2023-12-08T08:21:16.648820+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:51:05.330323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654537+0000","last_change":"2023-12-08T08:21:05.542808+0000","last_active":"2023-12-08T08:21:16.654537+0000","last_peered":"2023-12-08T08:21:16.654537+0000","last_clean":"2023-12-08T08:21:16.654537+0000","last_became_active":"2023-12-08T08:21:05.542495+0000","last_became_peered":"2023-12-08T08:21:05.542495+0000","last_unstale":"2023-12-08T08:21:16.654537+0000","last_undegraded":"2023-12-08T08:21:16.654537+0000","last_fullsized":"2023-12-08T08:21:16.654537+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:50:53.654615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.684879+0000","last_change":"2023-12-08T08:21:17.681699+0000","last_active":"2023-12-08T08:21:17.684879+0000","last_peered":"2023-12-08T08:21:17.684879+0000","last_clean":"2023-12-08T08:21:17.684879+0000","last_became_active":"2023-12-08T08:21:17.681356+0000","last_became_peered":"2023-12-08T08:21:17.681356+0000","last_unstale":"2023-12-08T08:21:17.684879+0000","last_undegraded":"2023-12-08T08:21:17.684879+0000","last_fullsized":"2023-12-08T08:21:17.684879+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:31:02.865086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.664497+0000","last_change":"2023-12-08T08:21:17.664497+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.664497+0000","last_undegraded":"2023-12-08T08:21:17.664497+0000","last_fullsized":"2023-12-08T08:21:17.664497+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.682731+0000","last_change":"2023-12-08T08:21:17.674547+0000","last_active":"2023-12-08T08:21:17.682731+0000","last_peered":"2023-12-08T08:21:17.682731+0000","last_clean":"2023-12-08T08:21:17.682731+0000","last_became_active":"2023-12-08T08:21:17.674313+0000","last_became_peered":"2023-12-08T08:21:17.674313+0000","last_unstale":"2023-12-08T08:21:17.682731+0000","last_undegraded":"2023-12-08T08:21:17.682731+0000","last_fullsized":"2023-12-08T08:21:17.682731+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:17.857771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652533+0000","last_change":"2023-12-08T08:21:04.773475+0000","last_active":"2023-12-08T08:21:16.652533+0000","last_peered":"2023-12-08T08:21:16.652533+0000","last_clean":"2023-12-08T08:21:16.652533+0000","last_became_active":"2023-12-08T08:21:04.773125+0000","last_became_peered":"2023-12-08T08:21:04.773125+0000","last_unstale":"2023-12-08T08:21:16.652533+0000","last_undegraded":"2023-12-08T08:21:16.652533+0000","last_fullsized":"2023-12-08T08:21:16.652533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:00:34.107681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652344+0000","last_change":"2023-12-08T08:21:05.527749+0000","last_active":"2023-12-08T08:21:16.652344+0000","last_peered":"2023-12-08T08:21:16.652344+0000","last_clean":"2023-12-08T08:21:16.652344+0000","last_became_active":"2023-12-08T08:21:05.527397+0000","last_became_peered":"2023-12-08T08:21:05.527397+0000","last_unstale":"2023-12-08T08:21:16.652344+0000","last_undegraded":"2023-12-08T08:21:16.652344+0000","last_fullsized":"2023-12-08T08:21:16.652344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:13.692096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.662777+0000","last_change":"2023-12-08T08:21:17.662777+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.662777+0000","last_undegraded":"2023-12-08T08:21:17.662777+0000","last_fullsized":"2023-12-08T08:21:17.662777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686471+0000","last_change":"2023-12-08T08:21:17.682288+0000","last_active":"2023-12-08T08:21:17.686471+0000","last_peered":"2023-12-08T08:21:17.686471+0000","last_clean":"2023-12-08T08:21:17.686471+0000","last_became_active":"2023-12-08T08:21:17.680967+0000","last_became_peered":"2023-12-08T08:21:17.680967+0000","last_unstale":"2023-12-08T08:21:17.686471+0000","last_undegraded":"2023-12-08T08:21:17.686471+0000","last_fullsized":"2023-12-08T08:21:17.686471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:02:38.255209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644131+0000","last_change":"2023-12-08T08:21:04.778223+0000","last_active":"2023-12-08T08:21:16.644131+0000","last_peered":"2023-12-08T08:21:16.644131+0000","last_clean":"2023-12-08T08:21:16.644131+0000","last_became_active":"2023-12-08T08:21:04.777902+0000","last_became_peered":"2023-12-08T08:21:04.777902+0000","last_unstale":"2023-12-08T08:21:16.644131+0000","last_undegraded":"2023-12-08T08:21:16.644131+0000","last_fullsized":"2023-12-08T08:21:16.644131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:07.593642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649143+0000","last_change":"2023-12-08T08:21:05.532257+0000","last_active":"2023-12-08T08:21:16.649143+0000","last_peered":"2023-12-08T08:21:16.649143+0000","last_clean":"2023-12-08T08:21:16.649143+0000","last_became_active":"2023-12-08T08:21:05.531965+0000","last_became_peered":"2023-12-08T08:21:05.531965+0000","last_unstale":"2023-12-08T08:21:16.649143+0000","last_undegraded":"2023-12-08T08:21:16.649143+0000","last_fullsized":"2023-12-08T08:21:16.649143+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:23.756612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.660842+0000","last_change":"2023-12-08T08:21:17.660842+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.660842+0000","last_undegraded":"2023-12-08T08:21:17.660842+0000","last_fullsized":"2023-12-08T08:21:17.660842+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654313+0000","last_change":"2023-12-08T08:21:04.780684+0000","last_active":"2023-12-08T08:21:16.654313+0000","last_peered":"2023-12-08T08:21:16.654313+0000","last_clean":"2023-12-08T08:21:16.654313+0000","last_became_active":"2023-12-08T08:21:04.780321+0000","last_became_peered":"2023-12-08T08:21:04.780321+0000","last_unstale":"2023-12-08T08:21:16.654313+0000","last_undegraded":"2023-12-08T08:21:16.654313+0000","last_fullsized":"2023-12-08T08:21:16.654313+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:13.006406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652155+0000","last_change":"2023-12-08T08:21:05.531374+0000","last_active":"2023-12-08T08:21:16.652155+0000","last_peered":"2023-12-08T08:21:16.652155+0000","last_clean":"2023-12-08T08:21:16.652155+0000","last_became_active":"2023-12-08T08:21:05.531104+0000","last_became_peered":"2023-12-08T08:21:05.531104+0000","last_unstale":"2023-12-08T08:21:16.652155+0000","last_undegraded":"2023-12-08T08:21:16.652155+0000","last_fullsized":"2023-12-08T08:21:16.652155+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:04.403116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686260+0000","last_change":"2023-12-08T08:21:17.684363+0000","last_active":"2023-12-08T08:21:17.686260+0000","last_peered":"2023-12-08T08:21:17.686260+0000","last_clean":"2023-12-08T08:21:17.686260+0000","last_became_active":"2023-12-08T08:21:17.683896+0000","last_became_peered":"2023-12-08T08:21:17.683896+0000","last_unstale":"2023-12-08T08:21:17.686260+0000","last_undegraded":"2023-12-08T08:21:17.686260+0000","last_fullsized":"2023-12-08T08:21:17.686260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:31:02.865086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.663742+0000","last_change":"2023-12-08T08:21:17.663742+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.663742+0000","last_undegraded":"2023-12-08T08:21:17.663742+0000","last_fullsized":"2023-12-08T08:21:17.663742+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652248+0000","last_change":"2023-12-08T08:21:04.777030+0000","last_active":"2023-12-08T08:21:16.652248+0000","last_peered":"2023-12-08T08:21:16.652248+0000","last_clean":"2023-12-08T08:21:16.652248+0000","last_became_active":"2023-12-08T08:21:04.775911+0000","last_became_peered":"2023-12-08T08:21:04.775911+0000","last_unstale":"2023-12-08T08:21:16.652248+0000","last_undegraded":"2023-12-08T08:21:16.652248+0000","last_fullsized":"2023-12-08T08:21:16.652248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:29.810210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654250+0000","last_change":"2023-12-08T08:21:05.532180+0000","last_active":"2023-12-08T08:21:16.654250+0000","last_peered":"2023-12-08T08:21:16.654250+0000","last_clean":"2023-12-08T08:21:16.654250+0000","last_became_active":"2023-12-08T08:21:05.529640+0000","last_became_peered":"2023-12-08T08:21:05.529640+0000","last_unstale":"2023-12-08T08:21:16.654250+0000","last_undegraded":"2023-12-08T08:21:16.654250+0000","last_fullsized":"2023-12-08T08:21:16.654250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:11.477913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.685108+0000","last_change":"2023-12-08T08:21:17.680905+0000","last_active":"2023-12-08T08:21:17.685108+0000","last_peered":"2023-12-08T08:21:17.685108+0000","last_clean":"2023-12-08T08:21:17.685108+0000","last_became_active":"2023-12-08T08:21:17.680651+0000","last_became_peered":"2023-12-08T08:21:17.680651+0000","last_unstale":"2023-12-08T08:21:17.685108+0000","last_undegraded":"2023-12-08T08:21:17.685108+0000","last_fullsized":"2023-12-08T08:21:17.685108+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:15.257930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.656547+0000","last_change":"2023-12-08T08:21:17.656547+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.656547+0000","last_undegraded":"2023-12-08T08:21:17.656547+0000","last_fullsized":"2023-12-08T08:21:17.656547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.653722+0000","last_change":"2023-12-08T08:21:05.539808+0000","last_active":"2023-12-08T08:21:16.653722+0000","last_peered":"2023-12-08T08:21:16.653722+0000","last_clean":"2023-12-08T08:21:16.653722+0000","last_became_active":"2023-12-08T08:21:05.539443+0000","last_became_peered":"2023-12-08T08:21:05.539443+0000","last_unstale":"2023-12-08T08:21:16.653722+0000","last_undegraded":"2023-12-08T08:21:16.653722+0000","last_fullsized":"2023-12-08T08:21:16.653722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:20:39.875619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661094+0000","last_change":"2023-12-08T08:21:17.661094+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661094+0000","last_undegraded":"2023-12-08T08:21:17.661094+0000","last_fullsized":"2023-12-08T08:21:17.661094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.650483+0000","last_change":"2023-12-08T08:21:05.532086+0000","last_active":"2023-12-08T08:21:16.650483+0000","last_peered":"2023-12-08T08:21:16.650483+0000","last_clean":"2023-12-08T08:21:16.650483+0000","last_became_active":"2023-12-08T08:21:05.531583+0000","last_became_peered":"2023-12-08T08:21:05.531583+0000","last_unstale":"2023-12-08T08:21:16.650483+0000","last_undegraded":"2023-12-08T08:21:16.650483+0000","last_fullsized":"2023-12-08T08:21:16.650483+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:13.936073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.658349+0000","last_change":"2023-12-08T08:21:17.658349+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.658349+0000","last_undegraded":"2023-12-08T08:21:17.658349+0000","last_fullsized":"2023-12-08T08:21:17.658349+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654484+0000","last_change":"2023-12-08T08:21:05.530432+0000","last_active":"2023-12-08T08:21:16.654484+0000","last_peered":"2023-12-08T08:21:16.654484+0000","last_clean":"2023-12-08T08:21:16.654484+0000","last_became_active":"2023-12-08T08:21:05.530065+0000","last_became_peered":"2023-12-08T08:21:05.530065+0000","last_unstale":"2023-12-08T08:21:16.654484+0000","last_undegraded":"2023-12-08T08:21:16.654484+0000","last_fullsized":"2023-12-08T08:21:16.654484+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:43.021591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.667972+0000","last_change":"2023-12-08T08:21:17.667972+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.667972+0000","last_undegraded":"2023-12-08T08:21:17.667972+0000","last_fullsized":"2023-12-08T08:21:17.667972+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648680+0000","last_change":"2023-12-08T08:21:05.531803+0000","last_active":"2023-12-08T08:21:16.648680+0000","last_peered":"2023-12-08T08:21:16.648680+0000","last_clean":"2023-12-08T08:21:16.648680+0000","last_became_active":"2023-12-08T08:21:05.531470+0000","last_became_peered":"2023-12-08T08:21:05.531470+0000","last_unstale":"2023-12-08T08:21:16.648680+0000","last_undegraded":"2023-12-08T08:21:16.648680+0000","last_fullsized":"2023-12-08T08:21:16.648680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:37.538055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659142+0000","last_change":"2023-12-08T08:21:17.659142+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659142+0000","last_undegraded":"2023-12-08T08:21:17.659142+0000","last_fullsized":"2023-12-08T08:21:17.659142+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655770+0000","last_change":"2023-12-08T08:21:05.538326+0000","last_active":"2023-12-08T08:21:16.655770+0000","last_peered":"2023-12-08T08:21:16.655770+0000","last_clean":"2023-12-08T08:21:16.655770+0000","last_became_active":"2023-12-08T08:21:05.538042+0000","last_became_peered":"2023-12-08T08:21:05.538042+0000","last_unstale":"2023-12-08T08:21:16.655770+0000","last_undegraded":"2023-12-08T08:21:16.655770+0000","last_fullsized":"2023-12-08T08:21:16.655770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:30.973295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.663984+0000","last_change":"2023-12-08T08:21:17.663984+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.663984+0000","last_undegraded":"2023-12-08T08:21:17.663984+0000","last_fullsized":"2023-12-08T08:21:17.663984+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652267+0000","last_change":"2023-12-08T08:21:05.538170+0000","last_active":"2023-12-08T08:21:16.652267+0000","last_peered":"2023-12-08T08:21:16.652267+0000","last_clean":"2023-12-08T08:21:16.652267+0000","last_became_active":"2023-12-08T08:21:05.537834+0000","last_became_peered":"2023-12-08T08:21:05.537834+0000","last_unstale":"2023-12-08T08:21:16.652267+0000","last_undegraded":"2023-12-08T08:21:16.652267+0000","last_fullsized":"2023-12-08T08:21:16.652267+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:23.756612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.664256+0000","last_change":"2023-12-08T08:21:17.664256+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.664256+0000","last_undegraded":"2023-12-08T08:21:17.664256+0000","last_fullsized":"2023-12-08T08:21:17.664256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644283+0000","last_change":"2023-12-08T08:21:05.532516+0000","last_active":"2023-12-08T08:21:16.644283+0000","last_peered":"2023-12-08T08:21:16.644283+0000","last_clean":"2023-12-08T08:21:16.644283+0000","last_became_active":"2023-12-08T08:21:05.531827+0000","last_became_peered":"2023-12-08T08:21:05.531827+0000","last_unstale":"2023-12-08T08:21:16.644283+0000","last_undegraded":"2023-12-08T08:21:16.644283+0000","last_fullsized":"2023-12-08T08:21:16.644283+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:49:59.047557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.655852+0000","last_change":"2023-12-08T08:21:17.655852+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.655852+0000","last_undegraded":"2023-12-08T08:21:17.655852+0000","last_fullsized":"2023-12-08T08:21:17.655852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651828+0000","last_change":"2023-12-08T08:21:05.531201+0000","last_active":"2023-12-08T08:21:16.651828+0000","last_peered":"2023-12-08T08:21:16.651828+0000","last_clean":"2023-12-08T08:21:16.651828+0000","last_became_active":"2023-12-08T08:21:05.530935+0000","last_became_peered":"2023-12-08T08:21:05.530935+0000","last_unstale":"2023-12-08T08:21:16.651828+0000","last_undegraded":"2023-12-08T08:21:16.651828+0000","last_fullsized":"2023-12-08T08:21:16.651828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:37.538055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659185+0000","last_change":"2023-12-08T08:21:17.659185+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659185+0000","last_undegraded":"2023-12-08T08:21:17.659185+0000","last_fullsized":"2023-12-08T08:21:17.659185+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655029+0000","last_change":"2023-12-08T08:21:05.535454+0000","last_active":"2023-12-08T08:21:16.655029+0000","last_peered":"2023-12-08T08:21:16.655029+0000","last_clean":"2023-12-08T08:21:16.655029+0000","last_became_active":"2023-12-08T08:21:05.535095+0000","last_became_peered":"2023-12-08T08:21:05.535095+0000","last_unstale":"2023-12-08T08:21:16.655029+0000","last_undegraded":"2023-12-08T08:21:16.655029+0000","last_fullsized":"2023-12-08T08:21:16.655029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:50:53.654615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.663922+0000","last_change":"2023-12-08T08:21:17.663922+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.663922+0000","last_undegraded":"2023-12-08T08:21:17.663922+0000","last_fullsized":"2023-12-08T08:21:17.663922+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.653808+0000","last_change":"2023-12-08T08:21:05.534953+0000","last_active":"2023-12-08T08:21:16.653808+0000","last_peered":"2023-12-08T08:21:16.653808+0000","last_clean":"2023-12-08T08:21:16.653808+0000","last_became_active":"2023-12-08T08:21:05.531291+0000","last_became_peered":"2023-12-08T08:21:05.531291+0000","last_unstale":"2023-12-08T08:21:16.653808+0000","last_undegraded":"2023-12-08T08:21:16.653808+0000","last_fullsized":"2023-12-08T08:21:16.653808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:47.419331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661714+0000","last_change":"2023-12-08T08:21:17.661714+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661714+0000","last_undegraded":"2023-12-08T08:21:17.661714+0000","last_fullsized":"2023-12-08T08:21:17.661714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649166+0000","last_change":"2023-12-08T08:21:05.529673+0000","last_active":"2023-12-08T08:21:16.649166+0000","last_peered":"2023-12-08T08:21:16.649166+0000","last_clean":"2023-12-08T08:21:16.649166+0000","last_became_active":"2023-12-08T08:21:05.528239+0000","last_became_peered":"2023-12-08T08:21:05.528239+0000","last_unstale":"2023-12-08T08:21:16.649166+0000","last_undegraded":"2023-12-08T08:21:16.649166+0000","last_fullsized":"2023-12-08T08:21:16.649166+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:19.928543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.660989+0000","last_change":"2023-12-08T08:21:17.660989+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.660989+0000","last_undegraded":"2023-12-08T08:21:17.660989+0000","last_fullsized":"2023-12-08T08:21:17.660989+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648574+0000","last_change":"2023-12-08T08:21:05.523783+0000","last_active":"2023-12-08T08:21:16.648574+0000","last_peered":"2023-12-08T08:21:16.648574+0000","last_clean":"2023-12-08T08:21:16.648574+0000","last_became_active":"2023-12-08T08:21:05.523509+0000","last_became_peered":"2023-12-08T08:21:05.523509+0000","last_unstale":"2023-12-08T08:21:16.648574+0000","last_undegraded":"2023-12-08T08:21:16.648574+0000","last_fullsized":"2023-12-08T08:21:16.648574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:11.477913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.657354+0000","last_change":"2023-12-08T08:21:17.657354+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.657354+0000","last_undegraded":"2023-12-08T08:21:17.657354+0000","last_fullsized":"2023-12-08T08:21:17.657354+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.650201+0000","last_change":"2023-12-08T08:21:05.538014+0000","last_active":"2023-12-08T08:21:16.650201+0000","last_peered":"2023-12-08T08:21:16.650201+0000","last_clean":"2023-12-08T08:21:16.650201+0000","last_became_active":"2023-12-08T08:21:05.537721+0000","last_became_peered":"2023-12-08T08:21:05.537721+0000","last_unstale":"2023-12-08T08:21:16.650201+0000","last_undegraded":"2023-12-08T08:21:16.650201+0000","last_fullsized":"2023-12-08T08:21:16.650201+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:30.813093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.655768+0000","last_change":"2023-12-08T08:21:17.655768+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.655768+0000","last_undegraded":"2023-12-08T08:21:17.655768+0000","last_fullsized":"2023-12-08T08:21:17.655768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644042+0000","last_change":"2023-12-08T08:21:05.525566+0000","last_active":"2023-12-08T08:21:16.644042+0000","last_peered":"2023-12-08T08:21:16.644042+0000","last_clean":"2023-12-08T08:21:16.644042+0000","last_became_active":"2023-12-08T08:21:05.525251+0000","last_became_peered":"2023-12-08T08:21:05.525251+0000","last_unstale":"2023-12-08T08:21:16.644042+0000","last_undegraded":"2023-12-08T08:21:16.644042+0000","last_fullsized":"2023-12-08T08:21:16.644042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:09:56.356105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.657863+0000","last_change":"2023-12-08T08:21:17.657863+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.657863+0000","last_undegraded":"2023-12-08T08:21:17.657863+0000","last_fullsized":"2023-12-08T08:21:17.657863+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644225+0000","last_change":"2023-12-08T08:21:05.530770+0000","last_active":"2023-12-08T08:21:16.644225+0000","last_peered":"2023-12-08T08:21:16.644225+0000","last_clean":"2023-12-08T08:21:16.644225+0000","last_became_active":"2023-12-08T08:21:05.530517+0000","last_became_peered":"2023-12-08T08:21:05.530517+0000","last_unstale":"2023-12-08T08:21:16.644225+0000","last_undegraded":"2023-12-08T08:21:16.644225+0000","last_fullsized":"2023-12-08T08:21:16.644225+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:05.968004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661813+0000","last_change":"2023-12-08T08:21:17.661813+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661813+0000","last_undegraded":"2023-12-08T08:21:17.661813+0000","last_fullsized":"2023-12-08T08:21:17.661813+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654550+0000","last_change":"2023-12-08T08:21:05.532053+0000","last_active":"2023-12-08T08:21:16.654550+0000","last_peered":"2023-12-08T08:21:16.654550+0000","last_clean":"2023-12-08T08:21:16.654550+0000","last_became_active":"2023-12-08T08:21:05.531799+0000","last_became_peered":"2023-12-08T08:21:05.531799+0000","last_unstale":"2023-12-08T08:21:16.654550+0000","last_undegraded":"2023-12-08T08:21:16.654550+0000","last_fullsized":"2023-12-08T08:21:16.654550+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:05.968004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659709+0000","last_change":"2023-12-08T08:21:17.659709+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659709+0000","last_undegraded":"2023-12-08T08:21:17.659709+0000","last_fullsized":"2023-12-08T08:21:17.659709+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654066+0000","last_change":"2023-12-08T08:21:05.535656+0000","last_active":"2023-12-08T08:21:16.654066+0000","last_peered":"2023-12-08T08:21:16.654066+0000","last_clean":"2023-12-08T08:21:16.654066+0000","last_became_active":"2023-12-08T08:21:05.535310+0000","last_became_peered":"2023-12-08T08:21:05.535310+0000","last_unstale":"2023-12-08T08:21:16.654066+0000","last_undegraded":"2023-12-08T08:21:16.654066+0000","last_fullsized":"2023-12-08T08:21:16.654066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:09:56.356105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.657854+0000","last_change":"2023-12-08T08:21:17.657854+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.657854+0000","last_undegraded":"2023-12-08T08:21:17.657854+0000","last_fullsized":"2023-12-08T08:21:17.657854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655138+0000","last_change":"2023-12-08T08:21:05.529395+0000","last_active":"2023-12-08T08:21:16.655138+0000","last_peered":"2023-12-08T08:21:16.655138+0000","last_clean":"2023-12-08T08:21:16.655138+0000","last_became_active":"2023-12-08T08:21:05.529089+0000","last_became_peered":"2023-12-08T08:21:05.529089+0000","last_unstale":"2023-12-08T08:21:16.655138+0000","last_undegraded":"2023-12-08T08:21:16.655138+0000","last_fullsized":"2023-12-08T08:21:16.655138+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:43.021591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661007+0000","last_change":"2023-12-08T08:21:17.661007+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661007+0000","last_undegraded":"2023-12-08T08:21:17.661007+0000","last_fullsized":"2023-12-08T08:21:17.661007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643962+0000","last_change":"2023-12-08T08:21:05.527949+0000","last_active":"2023-12-08T08:21:16.643962+0000","last_peered":"2023-12-08T08:21:16.643962+0000","last_clean":"2023-12-08T08:21:16.643962+0000","last_became_active":"2023-12-08T08:21:05.527215+0000","last_became_peered":"2023-12-08T08:21:05.527215+0000","last_unstale":"2023-12-08T08:21:16.643962+0000","last_undegraded":"2023-12-08T08:21:16.643962+0000","last_fullsized":"2023-12-08T08:21:16.643962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:25.239396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.671345+0000","last_change":"2023-12-08T08:21:17.671345+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.671345+0000","last_undegraded":"2023-12-08T08:21:17.671345+0000","last_fullsized":"2023-12-08T08:21:17.671345+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649424+0000","last_change":"2023-12-08T08:21:05.530318+0000","last_active":"2023-12-08T08:21:16.649424+0000","last_peered":"2023-12-08T08:21:16.649424+0000","last_clean":"2023-12-08T08:21:16.649424+0000","last_became_active":"2023-12-08T08:21:05.529990+0000","last_became_peered":"2023-12-08T08:21:05.529990+0000","last_unstale":"2023-12-08T08:21:16.649424+0000","last_undegraded":"2023-12-08T08:21:16.649424+0000","last_fullsized":"2023-12-08T08:21:16.649424+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:54:39.738546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.660112+0000","last_change":"2023-12-08T08:21:17.660112+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.660112+0000","last_undegraded":"2023-12-08T08:21:17.660112+0000","last_fullsized":"2023-12-08T08:21:17.660112+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655723+0000","last_change":"2023-12-08T08:21:05.540446+0000","last_active":"2023-12-08T08:21:16.655723+0000","last_peered":"2023-12-08T08:21:16.655723+0000","last_clean":"2023-12-08T08:21:16.655723+0000","last_became_active":"2023-12-08T08:21:05.540024+0000","last_became_peered":"2023-12-08T08:21:05.540024+0000","last_unstale":"2023-12-08T08:21:16.655723+0000","last_undegraded":"2023-12-08T08:21:16.655723+0000","last_fullsized":"2023-12-08T08:21:16.655723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:59:00.606587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.660303+0000","last_change":"2023-12-08T08:21:17.660303+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.660303+0000","last_undegraded":"2023-12-08T08:21:17.660303+0000","last_fullsized":"2023-12-08T08:21:17.660303+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654222+0000","last_change":"2023-12-08T08:21:05.536252+0000","last_active":"2023-12-08T08:21:16.654222+0000","last_peered":"2023-12-08T08:21:16.654222+0000","last_clean":"2023-12-08T08:21:16.654222+0000","last_became_active":"2023-12-08T08:21:05.535964+0000","last_became_peered":"2023-12-08T08:21:05.535964+0000","last_unstale":"2023-12-08T08:21:16.654222+0000","last_undegraded":"2023-12-08T08:21:16.654222+0000","last_fullsized":"2023-12-08T08:21:16.654222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:30.973295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.664875+0000","last_change":"2023-12-08T08:21:17.664875+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.664875+0000","last_undegraded":"2023-12-08T08:21:17.664875+0000","last_fullsized":"2023-12-08T08:21:17.664875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651605+0000","last_change":"2023-12-08T08:21:05.533444+0000","last_active":"2023-12-08T08:21:16.651605+0000","last_peered":"2023-12-08T08:21:16.651605+0000","last_clean":"2023-12-08T08:21:16.651605+0000","last_became_active":"2023-12-08T08:21:05.533146+0000","last_became_peered":"2023-12-08T08:21:05.533146+0000","last_unstale":"2023-12-08T08:21:16.651605+0000","last_undegraded":"2023-12-08T08:21:16.651605+0000","last_fullsized":"2023-12-08T08:21:16.651605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:14:18.284764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659761+0000","last_change":"2023-12-08T08:21:17.659761+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659761+0000","last_undegraded":"2023-12-08T08:21:17.659761+0000","last_fullsized":"2023-12-08T08:21:17.659761+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649422+0000","last_change":"2023-12-08T08:21:05.525741+0000","last_active":"2023-12-08T08:21:16.649422+0000","last_peered":"2023-12-08T08:21:16.649422+0000","last_clean":"2023-12-08T08:21:16.649422+0000","last_became_active":"2023-12-08T08:21:05.525406+0000","last_became_peered":"2023-12-08T08:21:05.525406+0000","last_unstale":"2023-12-08T08:21:16.649422+0000","last_undegraded":"2023-12-08T08:21:16.649422+0000","last_fullsized":"2023-12-08T08:21:16.649422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:08.596525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.673727+0000","last_change":"2023-12-08T08:21:17.673727+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.673727+0000","last_undegraded":"2023-12-08T08:21:17.673727+0000","last_fullsized":"2023-12-08T08:21:17.673727+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.653633+0000","last_change":"2023-12-08T08:21:05.537523+0000","last_active":"2023-12-08T08:21:16.653633+0000","last_peered":"2023-12-08T08:21:16.653633+0000","last_clean":"2023-12-08T08:21:16.653633+0000","last_became_active":"2023-12-08T08:21:05.537263+0000","last_became_peered":"2023-12-08T08:21:05.537263+0000","last_unstale":"2023-12-08T08:21:16.653633+0000","last_undegraded":"2023-12-08T08:21:16.653633+0000","last_fullsized":"2023-12-08T08:21:16.653633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:08.596525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.668335+0000","last_change":"2023-12-08T08:21:17.668335+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.668335+0000","last_undegraded":"2023-12-08T08:21:17.668335+0000","last_fullsized":"2023-12-08T08:21:17.668335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654426+0000","last_change":"2023-12-08T08:21:05.534310+0000","last_active":"2023-12-08T08:21:16.654426+0000","last_peered":"2023-12-08T08:21:16.654426+0000","last_clean":"2023-12-08T08:21:16.654426+0000","last_became_active":"2023-12-08T08:21:05.534003+0000","last_became_peered":"2023-12-08T08:21:05.534003+0000","last_unstale":"2023-12-08T08:21:16.654426+0000","last_undegraded":"2023-12-08T08:21:16.654426+0000","last_fullsized":"2023-12-08T08:21:16.654426+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:49.782105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659794+0000","last_change":"2023-12-08T08:21:17.659794+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659794+0000","last_undegraded":"2023-12-08T08:21:17.659794+0000","last_fullsized":"2023-12-08T08:21:17.659794+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643900+0000","last_change":"2023-12-08T08:21:05.543535+0000","last_active":"2023-12-08T08:21:16.643900+0000","last_peered":"2023-12-08T08:21:16.643900+0000","last_clean":"2023-12-08T08:21:16.643900+0000","last_became_active":"2023-12-08T08:21:05.543244+0000","last_became_peered":"2023-12-08T08:21:05.543244+0000","last_unstale":"2023-12-08T08:21:16.643900+0000","last_undegraded":"2023-12-08T08:21:16.643900+0000","last_fullsized":"2023-12-08T08:21:16.643900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:20:39.875619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.662257+0000","last_change":"2023-12-08T08:21:17.662257+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.662257+0000","last_undegraded":"2023-12-08T08:21:17.662257+0000","last_fullsized":"2023-12-08T08:21:17.662257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649277+0000","last_change":"2023-12-08T08:21:05.532561+0000","last_active":"2023-12-08T08:21:16.649277+0000","last_peered":"2023-12-08T08:21:16.649277+0000","last_clean":"2023-12-08T08:21:16.649277+0000","last_became_active":"2023-12-08T08:21:05.532254+0000","last_became_peered":"2023-12-08T08:21:05.532254+0000","last_unstale":"2023-12-08T08:21:16.649277+0000","last_undegraded":"2023-12-08T08:21:16.649277+0000","last_fullsized":"2023-12-08T08:21:16.649277+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:30:51.157799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.668437+0000","last_change":"2023-12-08T08:21:17.668437+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.668437+0000","last_undegraded":"2023-12-08T08:21:17.668437+0000","last_fullsized":"2023-12-08T08:21:17.668437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651087+0000","last_change":"2023-12-08T08:21:05.528111+0000","last_active":"2023-12-08T08:21:16.651087+0000","last_peered":"2023-12-08T08:21:16.651087+0000","last_clean":"2023-12-08T08:21:16.651087+0000","last_became_active":"2023-12-08T08:21:05.527809+0000","last_became_peered":"2023-12-08T08:21:05.527809+0000","last_unstale":"2023-12-08T08:21:16.651087+0000","last_undegraded":"2023-12-08T08:21:16.651087+0000","last_fullsized":"2023-12-08T08:21:16.651087+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:51.183842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.662012+0000","last_change":"2023-12-08T08:21:17.662012+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.662012+0000","last_undegraded":"2023-12-08T08:21:17.662012+0000","last_fullsized":"2023-12-08T08:21:17.662012+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.656056+0000","last_change":"2023-12-08T08:21:05.534658+0000","last_active":"2023-12-08T08:21:16.656056+0000","last_peered":"2023-12-08T08:21:16.656056+0000","last_clean":"2023-12-08T08:21:16.656056+0000","last_became_active":"2023-12-08T08:21:05.534383+0000","last_became_peered":"2023-12-08T08:21:05.534383+0000","last_unstale":"2023-12-08T08:21:16.656056+0000","last_undegraded":"2023-12-08T08:21:16.656056+0000","last_fullsized":"2023-12-08T08:21:16.656056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.368162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.660063+0000","last_change":"2023-12-08T08:21:17.660063+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.660063+0000","last_undegraded":"2023-12-08T08:21:17.660063+0000","last_fullsized":"2023-12-08T08:21:17.660063+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644195+0000","last_change":"2023-12-08T08:21:05.527659+0000","last_active":"2023-12-08T08:21:16.644195+0000","last_peered":"2023-12-08T08:21:16.644195+0000","last_clean":"2023-12-08T08:21:16.644195+0000","last_became_active":"2023-12-08T08:21:05.527361+0000","last_became_peered":"2023-12-08T08:21:05.527361+0000","last_unstale":"2023-12-08T08:21:16.644195+0000","last_undegraded":"2023-12-08T08:21:16.644195+0000","last_fullsized":"2023-12-08T08:21:16.644195+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:49.782105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.655156+0000","last_change":"2023-12-08T08:21:17.655156+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.655156+0000","last_undegraded":"2023-12-08T08:21:17.655156+0000","last_fullsized":"2023-12-08T08:21:17.655156+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652062+0000","last_change":"2023-12-08T08:21:05.540661+0000","last_active":"2023-12-08T08:21:16.652062+0000","last_peered":"2023-12-08T08:21:16.652062+0000","last_clean":"2023-12-08T08:21:16.652062+0000","last_became_active":"2023-12-08T08:21:05.539125+0000","last_became_peered":"2023-12-08T08:21:05.539125+0000","last_unstale":"2023-12-08T08:21:16.652062+0000","last_undegraded":"2023-12-08T08:21:16.652062+0000","last_fullsized":"2023-12-08T08:21:16.652062+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:58:23.887952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":731231,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.63100000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.72799999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.81699999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.71099999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.68700000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":141389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.74399999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.84899999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.72699999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.77900000000000003}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.80400000000000005}]},{"osd":5,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.82799999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.70599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":141445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.65200000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.75}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.81200000000000006}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.77000000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.78600000000000003}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.876}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.753}]},{"osd":1,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.64300000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.86799999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.81899999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.71199999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.90500000000000003}]},{"osd":7,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.73299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":151024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.443},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.46600000000000003}]},{"osd":1,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.50800000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.62},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.69399999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68200000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.71299999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.73699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":140843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.0270000000000001,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.34000000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.37},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.42199999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.55800000000000005}]},{"osd":5,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":3.637,"5min":3.637,"15min":3.637},"last":0.49399999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.54500000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.67500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":143902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2210000000000001,"5min":5.2210000000000001,"15min":5.2210000000000001},"last":0.374},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":8.3200000000000003,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.439}]},{"osd":2,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":8.2070000000000007,"5min":8.2070000000000007,"15min":8.2070000000000007},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":4.351,"5min":4.351,"15min":4.351},"last":0.42199999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":8.1479999999999997,"5min":8.1479999999999997,"15min":8.1479999999999997},"last":0.495},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.3150000000000004,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.47499999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":4.8470000000000004,"5min":4.8470000000000004,"15min":4.8470000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":4.7939999999999996,"5min":4.7939999999999996,"15min":4.7939999999999996},"last":0.71399999999999997}]},{"osd":5,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":4.7240000000000002,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":4.5830000000000002,"5min":4.5830000000000002,"15min":4.5830000000000002},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":4.7699999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.624},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":4.6289999999999996,"5min":4.6289999999999996,"15min":4.6289999999999996},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":4.665,"5min":4.665,"15min":4.665},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":4.8140000000000001,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.75800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":731141,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":8.2799999999999994,"5min":8.2799999999999994,"15min":8.2799999999999994},"last":0.46800000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":7.9290000000000003,"5min":7.9290000000000003,"15min":7.9290000000000003},"last":0.33900000000000002},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":8.0890000000000004,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.51500000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":4.6550000000000002,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.439},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":7.8890000000000002,"5min":7.8890000000000002,"15min":7.8890000000000002},"last":0.38}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":7.9649999999999999,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":8.0579999999999998,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.68300000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":7.835,"5min":7.835,"15min":7.835},"last":0.65900000000000003}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":8.0239999999999991,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.58799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:21:23.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2023-12-08T08:21:23.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.658802+0000', 'last_change': '2023-12-08T08:21:17.658802+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.658802+0000', 'last_undegraded': '2023-12-08T08:21:17.658802+0000', 'last_fullsized': '2023-12-08T08:21:17.658802+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:21:23.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2023-12-08T08:21:23.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.671758+0000', 'last_change': '2023-12-08T08:21:17.671758+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.671758+0000', 'last_undegraded': '2023-12-08T08:21:17.671758+0000', 'last_fullsized': '2023-12-08T08:21:17.671758+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:21:23.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2023-12-08T08:21:23.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.665725+0000', 'last_change': '2023-12-08T08:21:17.665725+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.665725+0000', 'last_undegraded': '2023-12-08T08:21:17.665725+0000', 'last_fullsized': '2023-12-08T08:21:17.665725+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:21:23.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-12-08T08:21:23.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.655138+0000', 'last_change': '2023-12-08T08:21:17.655138+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.655138+0000', 'last_undegraded': '2023-12-08T08:21:17.655138+0000', 'last_fullsized': '2023-12-08T08:21:17.655138+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:21:23.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2023-12-08T08:21:23.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.663000+0000', 'last_change': '2023-12-08T08:21:17.663000+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.663000+0000', 'last_undegraded': '2023-12-08T08:21:17.663000+0000', 'last_fullsized': '2023-12-08T08:21:17.663000+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:21:23.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-12-08T08:21:23.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.663369+0000', 'last_change': '2023-12-08T08:21:17.663369+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.663369+0000', 'last_undegraded': '2023-12-08T08:21:17.663369+0000', 'last_fullsized': '2023-12-08T08:21:17.663369+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:21:23.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2023-12-08T08:21:23.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.659513+0000', 'last_change': '2023-12-08T08:21:17.659513+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.659513+0000', 'last_undegraded': '2023-12-08T08:21:17.659513+0000', 'last_fullsized': '2023-12-08T08:21:17.659513+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:21:23.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2023-12-08T08:21:23.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.656454+0000', 'last_change': '2023-12-08T08:21:17.656454+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.656454+0000', 'last_undegraded': '2023-12-08T08:21:17.656454+0000', 'last_fullsized': '2023-12-08T08:21:17.656454+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:21:23.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2023-12-08T08:21:23.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.662267+0000', 'last_change': '2023-12-08T08:21:17.662267+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.662267+0000', 'last_undegraded': '2023-12-08T08:21:17.662267+0000', 'last_fullsized': '2023-12-08T08:21:17.662267+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:21:23.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2023-12-08T08:21:23.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.673219+0000', 'last_change': '2023-12-08T08:21:17.673219+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.673219+0000', 'last_undegraded': '2023-12-08T08:21:17.673219+0000', 'last_fullsized': '2023-12-08T08:21:17.673219+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:21:23.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2023-12-08T08:21:23.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.657337+0000', 'last_change': '2023-12-08T08:21:17.657337+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.657337+0000', 'last_undegraded': '2023-12-08T08:21:17.657337+0000', 'last_fullsized': '2023-12-08T08:21:17.657337+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:21:23.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2023-12-08T08:21:23.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.659996+0000', 'last_change': '2023-12-08T08:21:17.659996+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.659996+0000', 'last_undegraded': '2023-12-08T08:21:17.659996+0000', 'last_fullsized': '2023-12-08T08:21:17.659996+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:21:23.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2023-12-08T08:21:23.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.657341+0000', 'last_change': '2023-12-08T08:21:17.657341+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.657341+0000', 'last_undegraded': '2023-12-08T08:21:17.657341+0000', 'last_fullsized': '2023-12-08T08:21:17.657341+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:21:23.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2023-12-08T08:21:23.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.658216+0000', 'last_change': '2023-12-08T08:21:17.658216+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.658216+0000', 'last_undegraded': '2023-12-08T08:21:17.658216+0000', 'last_fullsized': '2023-12-08T08:21:17.658216+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:21:23.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-12-08T08:21:23.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.662363+0000', 'last_change': '2023-12-08T08:21:17.662363+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.662363+0000', 'last_undegraded': '2023-12-08T08:21:17.662363+0000', 'last_fullsized': '2023-12-08T08:21:17.662363+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:21:23.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-12-08T08:21:23.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.662129+0000', 'last_change': '2023-12-08T08:21:17.662129+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.662129+0000', 'last_undegraded': '2023-12-08T08:21:17.662129+0000', 'last_fullsized': '2023-12-08T08:21:17.662129+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:21:23.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2023-12-08T08:21:23.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.658627+0000', 'last_change': '2023-12-08T08:21:17.658627+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.658627+0000', 'last_undegraded': '2023-12-08T08:21:17.658627+0000', 'last_fullsized': '2023-12-08T08:21:17.658627+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:21:23.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-12-08T08:21:23.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.661062+0000', 'last_change': '2023-12-08T08:21:17.661062+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.661062+0000', 'last_undegraded': '2023-12-08T08:21:17.661062+0000', 'last_fullsized': '2023-12-08T08:21:17.661062+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:21:23.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2023-12-08T08:21:23.520 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.661129+0000', 'last_change': '2023-12-08T08:21:17.661129+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.661129+0000', 'last_undegraded': '2023-12-08T08:21:17.661129+0000', 'last_fullsized': '2023-12-08T08:21:17.661129+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:21:23.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2023-12-08T08:21:23.520 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.667977+0000', 'last_change': '2023-12-08T08:21:17.667977+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.667977+0000', 'last_undegraded': '2023-12-08T08:21:17.667977+0000', 'last_fullsized': '2023-12-08T08:21:17.667977+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:21:23.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2023-12-08T08:21:23.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.660226+0000', 'last_change': '2023-12-08T08:21:17.660226+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.660226+0000', 'last_undegraded': '2023-12-08T08:21:17.660226+0000', 'last_fullsized': '2023-12-08T08:21:17.660226+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:21:23.521 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-12-08T08:21:23.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.656815+0000', 'last_change': '2023-12-08T08:21:17.656815+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.656815+0000', 'last_undegraded': '2023-12-08T08:21:17.656815+0000', 'last_fullsized': '2023-12-08T08:21:17.656815+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:21:23.521 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2023-12-08T08:21:23.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.661135+0000', 'last_change': '2023-12-08T08:21:17.661135+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.661135+0000', 'last_undegraded': '2023-12-08T08:21:17.661135+0000', 'last_fullsized': '2023-12-08T08:21:17.661135+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:21:23.521 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2023-12-08T08:21:23.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.664339+0000', 'last_change': '2023-12-08T08:21:17.664339+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.664339+0000', 'last_undegraded': '2023-12-08T08:21:17.664339+0000', 'last_fullsized': '2023-12-08T08:21:17.664339+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:21:23.521 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2023-12-08T08:21:23.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.659167+0000', 'last_change': '2023-12-08T08:21:17.659167+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.659167+0000', 'last_undegraded': '2023-12-08T08:21:17.659167+0000', 'last_fullsized': '2023-12-08T08:21:17.659167+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:21:23.522 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-12-08T08:21:23.522 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.655881+0000', 'last_change': '2023-12-08T08:21:17.655881+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.655881+0000', 'last_undegraded': '2023-12-08T08:21:17.655881+0000', 'last_fullsized': '2023-12-08T08:21:17.655881+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:21:23.522 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-12-08T08:21:23.522 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.661815+0000', 'last_change': '2023-12-08T08:21:17.661815+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.661815+0000', 'last_undegraded': '2023-12-08T08:21:17.661815+0000', 'last_fullsized': '2023-12-08T08:21:17.661815+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:21:23.522 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2023-12-08T08:21:23.522 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.656636+0000', 'last_change': '2023-12-08T08:21:17.656636+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.656636+0000', 'last_undegraded': '2023-12-08T08:21:17.656636+0000', 'last_fullsized': '2023-12-08T08:21:17.656636+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:21:23.522 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-12-08T08:21:23.522 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.664497+0000', 'last_change': '2023-12-08T08:21:17.664497+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.664497+0000', 'last_undegraded': '2023-12-08T08:21:17.664497+0000', 'last_fullsized': '2023-12-08T08:21:17.664497+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:21:23.523 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2023-12-08T08:21:23.523 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.662777+0000', 'last_change': '2023-12-08T08:21:17.662777+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.662777+0000', 'last_undegraded': '2023-12-08T08:21:17.662777+0000', 'last_fullsized': '2023-12-08T08:21:17.662777+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:21:23.523 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2023-12-08T08:21:23.523 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.660842+0000', 'last_change': '2023-12-08T08:21:17.660842+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.660842+0000', 'last_undegraded': '2023-12-08T08:21:17.660842+0000', 'last_fullsized': '2023-12-08T08:21:17.660842+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:21:23.523 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2023-12-08T08:21:23.523 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.663742+0000', 'last_change': '2023-12-08T08:21:17.663742+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.663742+0000', 'last_undegraded': '2023-12-08T08:21:17.663742+0000', 'last_fullsized': '2023-12-08T08:21:17.663742+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:21:23.523 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2023-12-08T08:21:23.523 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.656547+0000', 'last_change': '2023-12-08T08:21:17.656547+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.656547+0000', 'last_undegraded': '2023-12-08T08:21:17.656547+0000', 'last_fullsized': '2023-12-08T08:21:17.656547+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:21:23.523 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2023-12-08T08:21:23.523 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.661094+0000', 'last_change': '2023-12-08T08:21:17.661094+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.661094+0000', 'last_undegraded': '2023-12-08T08:21:17.661094+0000', 'last_fullsized': '2023-12-08T08:21:17.661094+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:21:23.523 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2023-12-08T08:21:23.523 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.658349+0000', 'last_change': '2023-12-08T08:21:17.658349+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.658349+0000', 'last_undegraded': '2023-12-08T08:21:17.658349+0000', 'last_fullsized': '2023-12-08T08:21:17.658349+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:21:23.524 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2023-12-08T08:21:23.524 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.667972+0000', 'last_change': '2023-12-08T08:21:17.667972+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.667972+0000', 'last_undegraded': '2023-12-08T08:21:17.667972+0000', 'last_fullsized': '2023-12-08T08:21:17.667972+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:21:23.524 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2023-12-08T08:21:23.524 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.659142+0000', 'last_change': '2023-12-08T08:21:17.659142+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.659142+0000', 'last_undegraded': '2023-12-08T08:21:17.659142+0000', 'last_fullsized': '2023-12-08T08:21:17.659142+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:21:23.524 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2023-12-08T08:21:23.524 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.663984+0000', 'last_change': '2023-12-08T08:21:17.663984+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.663984+0000', 'last_undegraded': '2023-12-08T08:21:17.663984+0000', 'last_fullsized': '2023-12-08T08:21:17.663984+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:21:23.524 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2023-12-08T08:21:23.524 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.664256+0000', 'last_change': '2023-12-08T08:21:17.664256+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.664256+0000', 'last_undegraded': '2023-12-08T08:21:17.664256+0000', 'last_fullsized': '2023-12-08T08:21:17.664256+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:21:23.524 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2023-12-08T08:21:23.524 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.655852+0000', 'last_change': '2023-12-08T08:21:17.655852+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.655852+0000', 'last_undegraded': '2023-12-08T08:21:17.655852+0000', 'last_fullsized': '2023-12-08T08:21:17.655852+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:21:23.524 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2023-12-08T08:21:23.525 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.659185+0000', 'last_change': '2023-12-08T08:21:17.659185+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.659185+0000', 'last_undegraded': '2023-12-08T08:21:17.659185+0000', 'last_fullsized': '2023-12-08T08:21:17.659185+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:21:23.525 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2023-12-08T08:21:23.525 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.663922+0000', 'last_change': '2023-12-08T08:21:17.663922+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.663922+0000', 'last_undegraded': '2023-12-08T08:21:17.663922+0000', 'last_fullsized': '2023-12-08T08:21:17.663922+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:21:23.525 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2023-12-08T08:21:23.525 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.661714+0000', 'last_change': '2023-12-08T08:21:17.661714+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.661714+0000', 'last_undegraded': '2023-12-08T08:21:17.661714+0000', 'last_fullsized': '2023-12-08T08:21:17.661714+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:21:23.525 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2023-12-08T08:21:23.525 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.660989+0000', 'last_change': '2023-12-08T08:21:17.660989+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.660989+0000', 'last_undegraded': '2023-12-08T08:21:17.660989+0000', 'last_fullsized': '2023-12-08T08:21:17.660989+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:21:23.525 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2023-12-08T08:21:23.525 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.657354+0000', 'last_change': '2023-12-08T08:21:17.657354+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.657354+0000', 'last_undegraded': '2023-12-08T08:21:17.657354+0000', 'last_fullsized': '2023-12-08T08:21:17.657354+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:21:23.525 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2023-12-08T08:21:23.526 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.655768+0000', 'last_change': '2023-12-08T08:21:17.655768+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.655768+0000', 'last_undegraded': '2023-12-08T08:21:17.655768+0000', 'last_fullsized': '2023-12-08T08:21:17.655768+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:21:23.526 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2023-12-08T08:21:23.526 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.657863+0000', 'last_change': '2023-12-08T08:21:17.657863+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.657863+0000', 'last_undegraded': '2023-12-08T08:21:17.657863+0000', 'last_fullsized': '2023-12-08T08:21:17.657863+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:21:23.526 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2023-12-08T08:21:23.526 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.661813+0000', 'last_change': '2023-12-08T08:21:17.661813+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.661813+0000', 'last_undegraded': '2023-12-08T08:21:17.661813+0000', 'last_fullsized': '2023-12-08T08:21:17.661813+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:21:23.526 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2023-12-08T08:21:23.526 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.659709+0000', 'last_change': '2023-12-08T08:21:17.659709+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.659709+0000', 'last_undegraded': '2023-12-08T08:21:17.659709+0000', 'last_fullsized': '2023-12-08T08:21:17.659709+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:21:23.526 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2023-12-08T08:21:23.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.657854+0000', 'last_change': '2023-12-08T08:21:17.657854+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.657854+0000', 'last_undegraded': '2023-12-08T08:21:17.657854+0000', 'last_fullsized': '2023-12-08T08:21:17.657854+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:21:23.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2023-12-08T08:21:23.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.661007+0000', 'last_change': '2023-12-08T08:21:17.661007+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.661007+0000', 'last_undegraded': '2023-12-08T08:21:17.661007+0000', 'last_fullsized': '2023-12-08T08:21:17.661007+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:21:23.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2023-12-08T08:21:23.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.671345+0000', 'last_change': '2023-12-08T08:21:17.671345+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.671345+0000', 'last_undegraded': '2023-12-08T08:21:17.671345+0000', 'last_fullsized': '2023-12-08T08:21:17.671345+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:21:23.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2023-12-08T08:21:23.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.660112+0000', 'last_change': '2023-12-08T08:21:17.660112+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.660112+0000', 'last_undegraded': '2023-12-08T08:21:17.660112+0000', 'last_fullsized': '2023-12-08T08:21:17.660112+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:21:23.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2023-12-08T08:21:23.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.660303+0000', 'last_change': '2023-12-08T08:21:17.660303+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.660303+0000', 'last_undegraded': '2023-12-08T08:21:17.660303+0000', 'last_fullsized': '2023-12-08T08:21:17.660303+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:21:23.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2023-12-08T08:21:23.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.664875+0000', 'last_change': '2023-12-08T08:21:17.664875+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.664875+0000', 'last_undegraded': '2023-12-08T08:21:17.664875+0000', 'last_fullsized': '2023-12-08T08:21:17.664875+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:21:23.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2023-12-08T08:21:23.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.659761+0000', 'last_change': '2023-12-08T08:21:17.659761+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.659761+0000', 'last_undegraded': '2023-12-08T08:21:17.659761+0000', 'last_fullsized': '2023-12-08T08:21:17.659761+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:21:23.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2023-12-08T08:21:23.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.673727+0000', 'last_change': '2023-12-08T08:21:17.673727+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.673727+0000', 'last_undegraded': '2023-12-08T08:21:17.673727+0000', 'last_fullsized': '2023-12-08T08:21:17.673727+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:21:23.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2023-12-08T08:21:23.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.668335+0000', 'last_change': '2023-12-08T08:21:17.668335+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.668335+0000', 'last_undegraded': '2023-12-08T08:21:17.668335+0000', 'last_fullsized': '2023-12-08T08:21:17.668335+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:21:23.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2023-12-08T08:21:23.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.659794+0000', 'last_change': '2023-12-08T08:21:17.659794+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.659794+0000', 'last_undegraded': '2023-12-08T08:21:17.659794+0000', 'last_fullsized': '2023-12-08T08:21:17.659794+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:21:23.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2023-12-08T08:21:23.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.662257+0000', 'last_change': '2023-12-08T08:21:17.662257+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.662257+0000', 'last_undegraded': '2023-12-08T08:21:17.662257+0000', 'last_fullsized': '2023-12-08T08:21:17.662257+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:21:23.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2023-12-08T08:21:23.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.668437+0000', 'last_change': '2023-12-08T08:21:17.668437+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.668437+0000', 'last_undegraded': '2023-12-08T08:21:17.668437+0000', 'last_fullsized': '2023-12-08T08:21:17.668437+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:21:23.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2023-12-08T08:21:23.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.662012+0000', 'last_change': '2023-12-08T08:21:17.662012+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.662012+0000', 'last_undegraded': '2023-12-08T08:21:17.662012+0000', 'last_fullsized': '2023-12-08T08:21:17.662012+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:21:23.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2023-12-08T08:21:23.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.660063+0000', 'last_change': '2023-12-08T08:21:17.660063+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.660063+0000', 'last_undegraded': '2023-12-08T08:21:17.660063+0000', 'last_fullsized': '2023-12-08T08:21:17.660063+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:21:23.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2023-12-08T08:21:23.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:21:17.655156+0000', 'last_change': '2023-12-08T08:21:17.655156+0000', 'last_active': '2023-12-08T08:21:17.641609+0000', 'last_peered': '2023-12-08T08:21:17.641609+0000', 'last_clean': '2023-12-08T08:21:17.641609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:21:17.655156+0000', 'last_undegraded': '2023-12-08T08:21:17.655156+0000', 'last_fullsized': '2023-12-08T08:21:17.655156+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'last_clean_scrub_stamp': '2023-12-08T08:21:17.641609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:21:23.530 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-08T08:21:23.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.684+0000 7f0ddef01640 1 Processor -- start 2023-12-08T08:21:23.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.688+0000 7f0ddef01640 1 -- start start 2023-12-08T08:21:23.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.688+0000 7f0ddef01640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0dd814e7e0 0x7f0dd80c2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:23.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.688+0000 7f0ddef01640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0dd8157b10 0x7f0dd8157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:23.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.688+0000 7f0ddef01640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dd8155110 con 0x7f0dd80c5e10 2023-12-08T08:21:23.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.688+0000 7f0ddef01640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd8154520 con 0x7f0dd814e7e0 2023-12-08T08:21:23.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.688+0000 7f0ddef01640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd81547e0 con 0x7f0dd8157b10 2023-12-08T08:21:23.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.688+0000 7f0dcffff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0dd80c5e10 0x7f0dd80a6ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46752/0 (socket says 172.21.15.88:46752) 2023-12-08T08:21:23.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.688+0000 7f0dcffff640 1 -- 172.21.15.88:0/1804999629 learned_addr learned my addr 172.21.15.88:0/1804999629 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:23.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.688+0000 7f0ddcc9d640 1 --2- 172.21.15.88:0/1804999629 >> v2:172.21.15.88:3300/0 conn(0x7f0dd814e7e0 0x7f0dd80c2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:23.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.688+0000 7f0ddd49e640 1 --2- 172.21.15.88:0/1804999629 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0dd8157b10 0x7f0dd8157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:23.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.688+0000 7f0dcf7fe640 1 -- 172.21.15.88:0/1804999629 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2656216458 0 0) 0x7f0dd8155110 con 0x7f0dd80c5e10 2023-12-08T08:21:23.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.688+0000 7f0dcf7fe640 1 -- 172.21.15.88:0/1804999629 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dc0003530 con 0x7f0dd80c5e10 2023-12-08T08:21:23.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.688+0000 7f0ddcc9d640 1 -- 172.21.15.88:0/1804999629 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0dd8157b10 msgr2=0x7f0dd8157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:23.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.688+0000 7f0ddcc9d640 1 --2- 172.21.15.88:0/1804999629 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0dd8157b10 0x7f0dd8157fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:23.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.688+0000 7f0ddcc9d640 1 -- 172.21.15.88:0/1804999629 >> v1:172.21.15.88:6789/0 conn(0x7f0dd80c5e10 legacy=0x7f0dd80a6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:23.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.688+0000 7f0ddcc9d640 1 -- 172.21.15.88:0/1804999629 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd8154ac0 con 0x7f0dd814e7e0 2023-12-08T08:21:23.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.692+0000 7f0ddcc9d640 1 --2- 172.21.15.88:0/1804999629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dd814e7e0 0x7f0dd80c2810 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40097c0 tx=0x7f0dd401c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539363d594b2788a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:23.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.692+0000 7f0dcf7fe640 1 -- 172.21.15.88:0/1804999629 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd40ab600 con 0x7f0dd814e7e0 2023-12-08T08:21:23.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.692+0000 7f0dcf7fe640 1 -- 172.21.15.88:0/1804999629 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd40a7050 con 0x7f0dd814e7e0 2023-12-08T08:21:23.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.692+0000 7f0dcf7fe640 1 -- 172.21.15.88:0/1804999629 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd40ab960 con 0x7f0dd814e7e0 2023-12-08T08:21:23.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.692+0000 7f0ddef01640 1 -- 172.21.15.88:0/1804999629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dd814e7e0 msgr2=0x7f0dd80c2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:23.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.692+0000 7f0ddef01640 1 --2- 172.21.15.88:0/1804999629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dd814e7e0 0x7f0dd80c2810 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40097c0 tx=0x7f0dd401c330 comp rx=0 tx=0).stop 2023-12-08T08:21:23.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.692+0000 7f0ddef01640 1 -- 172.21.15.88:0/1804999629 shutdown_connections 2023-12-08T08:21:23.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.692+0000 7f0ddef01640 1 --2- 172.21.15.88:0/1804999629 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0dd8157b10 0x7f0dd8157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:23.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.692+0000 7f0ddef01640 1 --2- 172.21.15.88:0/1804999629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dd814e7e0 0x7f0dd80c2810 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:23.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.692+0000 7f0ddef01640 1 -- 172.21.15.88:0/1804999629 >> 172.21.15.88:0/1804999629 conn(0x7f0dd80c7c60 msgr2=0x7f0dd80c8070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:23.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.692+0000 7f0ddef01640 1 -- 172.21.15.88:0/1804999629 shutdown_connections 2023-12-08T08:21:23.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.692+0000 7f0ddef01640 1 -- 172.21.15.88:0/1804999629 wait complete. 2023-12-08T08:21:23.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.692+0000 7f0ddef01640 1 Processor -- start 2023-12-08T08:21:23.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.692+0000 7f0ddef01640 1 -- start start 2023-12-08T08:21:23.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.696+0000 7f0ddef01640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0dd80c5e10 0x7f0dd806e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:23.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.696+0000 7f0ddef01640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dd814e7e0 0x7f0dd806e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:23.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.696+0000 7f0ddef01640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dd8157b10 0x7f0dd806c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:23.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.696+0000 7f0ddef01640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd8145830 con 0x7f0dd814e7e0 2023-12-08T08:21:23.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.696+0000 7f0ddef01640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd814d390 con 0x7f0dd8157b10 2023-12-08T08:21:23.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.696+0000 7f0ddef01640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd814d670 con 0x7f0dd80c5e10 2023-12-08T08:21:23.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.696+0000 7f0dcffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dd814e7e0 0x7f0dd806e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:23.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.696+0000 7f0dcffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dd814e7e0 0x7f0dd806e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33790/0 (socket says 172.21.15.88:33790) 2023-12-08T08:21:23.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.696+0000 7f0dcffff640 1 -- 172.21.15.88:0/3600057102 learned_addr learned my addr 172.21.15.88:0/3600057102 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:23.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.696+0000 7f0ddd49e640 1 --2- 172.21.15.88:0/3600057102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dd8157b10 0x7f0dd806c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:23.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.696+0000 7f0ddcc9d640 1 --2- 172.21.15.88:0/3600057102 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0dd80c5e10 0x7f0dd806e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:23.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.696+0000 7f0dcffff640 1 -- 172.21.15.88:0/3600057102 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0dd80c5e10 msgr2=0x7f0dd806e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:23.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.696+0000 7f0dcffff640 1 --2- 172.21.15.88:0/3600057102 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0dd80c5e10 0x7f0dd806e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:23.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.696+0000 7f0dcffff640 1 -- 172.21.15.88:0/3600057102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dd8157b10 msgr2=0x7f0dd806c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:23.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.696+0000 7f0dcffff640 1 --2- 172.21.15.88:0/3600057102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dd8157b10 0x7f0dd806c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:23.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.696+0000 7f0dcffff640 1 -- 172.21.15.88:0/3600057102 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd4009420 con 0x7f0dd814e7e0 2023-12-08T08:21:23.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.696+0000 7f0dcffff640 1 --2- 172.21.15.88:0/3600057102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dd814e7e0 0x7f0dd806e820 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0dc800c390 tx=0x7f0dc800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:23.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.696+0000 7f0dcd7fa640 1 -- 172.21.15.88:0/3600057102 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8005cf0 con 0x7f0dd814e7e0 2023-12-08T08:21:23.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.696+0000 7f0dcd7fa640 1 -- 172.21.15.88:0/3600057102 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc8005e70 con 0x7f0dd814e7e0 2023-12-08T08:21:23.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.696+0000 7f0dcd7fa640 1 -- 172.21.15.88:0/3600057102 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc80072f0 con 0x7f0dd814e7e0 2023-12-08T08:21:23.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.696+0000 7f0ddef01640 1 -- 172.21.15.88:0/3600057102 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd814d950 con 0x7f0dd814e7e0 2023-12-08T08:21:23.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.696+0000 7f0ddef01640 1 -- 172.21.15.88:0/3600057102 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd80adef0 con 0x7f0dd814e7e0 2023-12-08T08:21:23.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.700+0000 7f0ddef01640 1 -- 172.21.15.88:0/3600057102 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd806c0a0 con 0x7f0dd814e7e0 2023-12-08T08:21:23.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.700+0000 7f0dcd7fa640 1 -- 172.21.15.88:0/3600057102 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0dc8007450 con 0x7f0dd814e7e0 2023-12-08T08:21:23.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.700+0000 7f0dcd7fa640 1 --2- 172.21.15.88:0/3600057102 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0dc40664a0 0x7f0dc4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:23.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.700+0000 7f0dcd7fa640 1 -- 172.21.15.88:0/3600057102 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0dc80836a0 con 0x7f0dd814e7e0 2023-12-08T08:21:23.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.700+0000 7f0ddcc9d640 1 --2- 172.21.15.88:0/3600057102 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0dc40664a0 0x7f0dc4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:23.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.700+0000 7f0ddcc9d640 1 --2- 172.21.15.88:0/3600057102 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0dc40664a0 0x7f0dc4068960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40ad000 tx=0x7f0dd4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:23.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.704+0000 7f0dcd7fa640 1 -- 172.21.15.88:0/3600057102 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0dc8050930 con 0x7f0dd814e7e0 2023-12-08T08:21:23.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.908+0000 7f0ddef01640 1 -- 172.21.15.88:0/3600057102 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f0dd8067630 con 0x7f0dd814e7e0 2023-12-08T08:21:23.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.908+0000 7f0dcd7fa640 1 -- 172.21.15.88:0/3600057102 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1747 (secure 0 0 0) 0x7f0dc80176f0 con 0x7f0dd814e7e0 2023-12-08T08:21:23.913 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:23.913 INFO:teuthology.orchestra.run.smithi088.stdout:{"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":88,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":35,"num_osds":8,"num_up_osds":8,"osd_up_since":1702023607,"num_in_osds":8,"osd_in_since":1702023598,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":129},{"state_name":"creating+peering","count":64}],"num_pgs":193,"num_pools":5,"num_objects":24,"data_bytes":594273,"bytes_used":224440320,"bytes_avail":772869672960,"bytes_total":773094113280,"inactive_pgs_ratio":0.33160620927810669,"write_bytes_sec":341,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":22,"id":2,"up":1,"in":1,"max":1,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5046},{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5049}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2023-12-08T08:21:08.757430+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-08T08:21:23.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.912+0000 7f0ddef01640 1 -- 172.21.15.88:0/3600057102 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0dc40664a0 msgr2=0x7f0dc4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:23.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.912+0000 7f0ddef01640 1 --2- 172.21.15.88:0/3600057102 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0dc40664a0 0x7f0dc4068960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40ad000 tx=0x7f0dd4008040 comp rx=0 tx=0).stop 2023-12-08T08:21:23.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.912+0000 7f0ddef01640 1 -- 172.21.15.88:0/3600057102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dd814e7e0 msgr2=0x7f0dd806e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:23.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.912+0000 7f0ddef01640 1 --2- 172.21.15.88:0/3600057102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dd814e7e0 0x7f0dd806e820 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0dc800c390 tx=0x7f0dc800c850 comp rx=0 tx=0).stop 2023-12-08T08:21:23.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.912+0000 7f0ddef01640 1 -- 172.21.15.88:0/3600057102 shutdown_connections 2023-12-08T08:21:23.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.912+0000 7f0ddef01640 1 --2- 172.21.15.88:0/3600057102 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0dc40664a0 0x7f0dc4068960 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:23.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.912+0000 7f0ddef01640 1 --2- 172.21.15.88:0/3600057102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dd8157b10 0x7f0dd806c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:23.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.912+0000 7f0ddef01640 1 --2- 172.21.15.88:0/3600057102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dd814e7e0 0x7f0dd806e820 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:23.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.912+0000 7f0ddef01640 1 --2- 172.21.15.88:0/3600057102 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0dd80c5e10 0x7f0dd806e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:23.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.912+0000 7f0ddef01640 1 -- 172.21.15.88:0/3600057102 >> 172.21.15.88:0/3600057102 conn(0x7f0dd80c7c60 msgr2=0x7f0dd81522e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:23.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.912+0000 7f0ddef01640 1 -- 172.21.15.88:0/3600057102 shutdown_connections 2023-12-08T08:21:23.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:23.912+0000 7f0ddef01640 1 -- 172.21.15.88:0/3600057102 wait complete. 2023-12-08T08:21:23.934 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-08T08:21:23.934 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:21:24.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.068+0000 7f0539294640 1 Processor -- start 2023-12-08T08:21:24.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.068+0000 7f0539294640 1 -- start start 2023-12-08T08:21:24.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.068+0000 7f0539294640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f05340ca190 0x7f05340ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:24.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.068+0000 7f0539294640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05340c5140 con 0x7f053414e570 2023-12-08T08:21:24.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.068+0000 7f0539294640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05340c4b80 con 0x7f0534154fd0 2023-12-08T08:21:24.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.068+0000 7f0539294640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05340c4e60 con 0x7f05340ca190 2023-12-08T08:21:24.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.068+0000 7f0532ffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f053414e570 0x7f05340c7cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46758/0 (socket says 172.21.15.88:46758) 2023-12-08T08:21:24.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.068+0000 7f0532ffd640 1 -- 172.21.15.88:0/2905764472 learned_addr learned my addr 172.21.15.88:0/2905764472 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:24.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.072+0000 7f05337fe640 1 --2- 172.21.15.88:0/2905764472 >> v2:172.21.15.148:3300/0 conn(0x7f05340ca190 0x7f05340ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:24.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.072+0000 7f05327fc640 1 -- 172.21.15.88:0/2905764472 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250844237 0 0) 0x7f05340c5140 con 0x7f053414e570 2023-12-08T08:21:24.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.072+0000 7f05327fc640 1 -- 172.21.15.88:0/2905764472 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0520003530 con 0x7f053414e570 2023-12-08T08:21:24.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.072+0000 7f05327fc640 1 -- 172.21.15.88:0/2905764472 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1419373188 0 0) 0x7f0520003530 con 0x7f053414e570 2023-12-08T08:21:24.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.072+0000 7f05327fc640 1 -- 172.21.15.88:0/2905764472 >> v2:172.21.15.148:3300/0 conn(0x7f05340ca190 msgr2=0x7f05340ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:24.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.072+0000 7f05327fc640 1 --2- 172.21.15.88:0/2905764472 >> v2:172.21.15.148:3300/0 conn(0x7f05340ca190 0x7f05340ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:24.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.072+0000 7f05327fc640 1 -- 172.21.15.88:0/2905764472 >> v1:172.21.15.148:6789/0 conn(0x7f0534154fd0 legacy=0x7f05341584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:24.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.072+0000 7f05327fc640 1 -- 172.21.15.88:0/2905764472 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0534157ce0 con 0x7f053414e570 2023-12-08T08:21:24.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.072+0000 7f05327fc640 1 -- 172.21.15.88:0/2905764472 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f0524001a00 con 0x7f053414e570 2023-12-08T08:21:24.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.072+0000 7f05337fe640 1 --2- 172.21.15.88:0/2905764472 >> v2:172.21.15.148:3300/0 conn(0x7f05340ca190 0x7f05340ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:21:24.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.072+0000 7f05327fc640 1 -- 172.21.15.88:0/2905764472 >> v1:172.21.15.88:6789/0 conn(0x7f053414e570 legacy=0x7f05340c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:24.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.072+0000 7f05327fc640 1 --2- 172.21.15.88:0/2905764472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0520003980 0x7f0520003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:24.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.072+0000 7f05327fc640 1 --2- 172.21.15.88:0/2905764472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05200047d0 0x7f0520004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:24.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.072+0000 7f05327fc640 1 --2- 172.21.15.88:0/2905764472 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0520005190 0x7f052000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:24.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.072+0000 7f05327fc640 1 -- 172.21.15.88:0/2905764472 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05340c4e60 con 0x7f05200047d0 2023-12-08T08:21:24.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.072+0000 7f05327fc640 1 -- 172.21.15.88:0/2905764472 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052000c130 con 0x7f0520003980 2023-12-08T08:21:24.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.072+0000 7f05327fc640 1 -- 172.21.15.88:0/2905764472 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f052000c2f0 con 0x7f0520005190 2023-12-08T08:21:24.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.072+0000 7f052a7fc640 1 --2- 172.21.15.88:0/2905764472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05200047d0 0x7f0520004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:24.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.072+0000 7f0532ffd640 1 --2- 172.21.15.88:0/2905764472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0520003980 0x7f0520003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:24.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.072+0000 7f05337fe640 1 --2- 172.21.15.88:0/2905764472 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0520005190 0x7f052000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:24.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.072+0000 7f052a7fc640 1 -- 172.21.15.88:0/2905764472 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0520005190 msgr2=0x7f052000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:24.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.072+0000 7f052a7fc640 1 --2- 172.21.15.88:0/2905764472 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0520005190 0x7f052000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:24.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.072+0000 7f052a7fc640 1 -- 172.21.15.88:0/2905764472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0520003980 msgr2=0x7f0520003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:24.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.072+0000 7f052a7fc640 1 --2- 172.21.15.88:0/2905764472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0520003980 0x7f0520003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:24.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.072+0000 7f052a7fc640 1 -- 172.21.15.88:0/2905764472 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0520003530 con 0x7f05200047d0 2023-12-08T08:21:24.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.072+0000 7f05337fe640 1 -- 172.21.15.88:0/2905764472 reap_dead start 2023-12-08T08:21:24.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.076+0000 7f052a7fc640 1 --2- 172.21.15.88:0/2905764472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05200047d0 0x7f0520004c50 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f051c001780 tx=0x7f051c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9da50cdd09c6e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:24.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.076+0000 7f05327fc640 1 -- 172.21.15.88:0/2905764472 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c0052d0 con 0x7f05200047d0 2023-12-08T08:21:24.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.076+0000 7f05327fc640 1 -- 172.21.15.88:0/2905764472 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051c0a7050 con 0x7f05200047d0 2023-12-08T08:21:24.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.076+0000 7f05327fc640 1 -- 172.21.15.88:0/2905764472 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c003600 con 0x7f05200047d0 2023-12-08T08:21:24.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.076+0000 7f0539294640 1 -- 172.21.15.88:0/2905764472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05200047d0 msgr2=0x7f0520004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:24.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.076+0000 7f0539294640 1 --2- 172.21.15.88:0/2905764472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05200047d0 0x7f0520004c50 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f051c001780 tx=0x7f051c01c3d0 comp rx=0 tx=0).stop 2023-12-08T08:21:24.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.076+0000 7f0539294640 1 -- 172.21.15.88:0/2905764472 shutdown_connections 2023-12-08T08:21:24.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.076+0000 7f0539294640 1 --2- 172.21.15.88:0/2905764472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05200047d0 0x7f0520004c50 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:24.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.076+0000 7f0539294640 1 -- 172.21.15.88:0/2905764472 >> 172.21.15.88:0/2905764472 conn(0x7f05340abb10 msgr2=0x7f05340abf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:24.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.076+0000 7f0539294640 1 -- 172.21.15.88:0/2905764472 shutdown_connections 2023-12-08T08:21:24.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.076+0000 7f0539294640 1 -- 172.21.15.88:0/2905764472 wait complete. 2023-12-08T08:21:24.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.076+0000 7f0539294640 1 Processor -- start 2023-12-08T08:21:24.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.076+0000 7f0539294640 1 -- start start 2023-12-08T08:21:24.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.076+0000 7f0539294640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f05200047d0 0x7f0534145a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:24.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.076+0000 7f0539294640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05341f0690 0x7f053414ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:24.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.076+0000 7f0539294640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0534144d50 0x7f05341451e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:24.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.076+0000 7f0539294640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05340aa4c0 con 0x7f0534144d50 2023-12-08T08:21:24.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.076+0000 7f0539294640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05341f0b20 con 0x7f05341f0690 2023-12-08T08:21:24.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.076+0000 7f0539294640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05341f0e00 con 0x7f05200047d0 2023-12-08T08:21:24.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.080+0000 7f05337fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0534144d50 0x7f05341451e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:24.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.080+0000 7f05337fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0534144d50 0x7f05341451e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33810/0 (socket says 172.21.15.88:33810) 2023-12-08T08:21:24.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.080+0000 7f05337fe640 1 -- 172.21.15.88:0/2848340669 learned_addr learned my addr 172.21.15.88:0/2848340669 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:24.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.080+0000 7f052a7fc640 1 --2- 172.21.15.88:0/2848340669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05341f0690 0x7f053414ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:24.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.080+0000 7f0532ffd640 1 --2- 172.21.15.88:0/2848340669 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f05200047d0 0x7f0534145a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:24.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.080+0000 7f05337fe640 1 -- 172.21.15.88:0/2848340669 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f05200047d0 msgr2=0x7f0534145a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:24.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.080+0000 7f05337fe640 1 --2- 172.21.15.88:0/2848340669 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f05200047d0 0x7f0534145a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:24.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.080+0000 7f05337fe640 1 -- 172.21.15.88:0/2848340669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05341f0690 msgr2=0x7f053414ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:24.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.080+0000 7f05337fe640 1 --2- 172.21.15.88:0/2848340669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05341f0690 0x7f053414ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:24.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.080+0000 7f05337fe640 1 -- 172.21.15.88:0/2848340669 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05341f10e0 con 0x7f0534144d50 2023-12-08T08:21:24.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.080+0000 7f0532ffd640 1 --2- 172.21.15.88:0/2848340669 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f05200047d0 0x7f0534145a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:24.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.080+0000 7f05337fe640 1 --2- 172.21.15.88:0/2848340669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0534144d50 0x7f05341451e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f053406c540 tx=0x7f052c011c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:24.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.080+0000 7f052bfff640 1 -- 172.21.15.88:0/2848340669 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c004230 con 0x7f0534144d50 2023-12-08T08:21:24.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.080+0000 7f052bfff640 1 -- 172.21.15.88:0/2848340669 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c004390 con 0x7f0534144d50 2023-12-08T08:21:24.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.080+0000 7f052bfff640 1 -- 172.21.15.88:0/2848340669 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c00f8b0 con 0x7f0534144d50 2023-12-08T08:21:24.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.080+0000 7f0539294640 1 -- 172.21.15.88:0/2848340669 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05341f13c0 con 0x7f0534144d50 2023-12-08T08:21:24.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.080+0000 7f0539294640 1 -- 172.21.15.88:0/2848340669 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0534145f50 con 0x7f0534144d50 2023-12-08T08:21:24.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.080+0000 7f0539294640 1 -- 172.21.15.88:0/2848340669 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05340ade20 con 0x7f0534144d50 2023-12-08T08:21:24.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.080+0000 7f052bfff640 1 -- 172.21.15.88:0/2848340669 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f052c00fa10 con 0x7f0534144d50 2023-12-08T08:21:24.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.080+0000 7f052bfff640 1 --2- 172.21.15.88:0/2848340669 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0514066470 0x7f0514068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:24.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.084+0000 7f052bfff640 1 -- 172.21.15.88:0/2848340669 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f052c084580 con 0x7f0534144d50 2023-12-08T08:21:24.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.084+0000 7f0532ffd640 1 --2- 172.21.15.88:0/2848340669 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0514066470 0x7f0514068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:24.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.084+0000 7f0532ffd640 1 --2- 172.21.15.88:0/2848340669 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0514066470 0x7f0514068930 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f05340693e0 tx=0x7f0524009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:24.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.088+0000 7f052bfff640 1 -- 172.21.15.88:0/2848340669 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f05340ade20 con 0x7f0534144d50 2023-12-08T08:21:24.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.236+0000 7f0539294640 1 -- 172.21.15.88:0/2848340669 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f05341f0f70 con 0x7f0514066470 2023-12-08T08:21:24.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.248+0000 7f052bfff640 1 -- 172.21.15.88:0/2848340669 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+521952 (secure 0 0 0) 0x7f05341f0f70 con 0x7f0514066470 2023-12-08T08:21:24.255 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:24.259 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:21:24.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.252+0000 7f0539294640 1 -- 172.21.15.88:0/2848340669 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0514066470 msgr2=0x7f0514068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:24.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.252+0000 7f0539294640 1 --2- 172.21.15.88:0/2848340669 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0514066470 0x7f0514068930 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f05340693e0 tx=0x7f0524009040 comp rx=0 tx=0).stop 2023-12-08T08:21:24.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.252+0000 7f0539294640 1 -- 172.21.15.88:0/2848340669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0534144d50 msgr2=0x7f05341451e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:24.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.252+0000 7f0539294640 1 --2- 172.21.15.88:0/2848340669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0534144d50 0x7f05341451e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f053406c540 tx=0x7f052c011c90 comp rx=0 tx=0).stop 2023-12-08T08:21:24.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.252+0000 7f0539294640 1 -- 172.21.15.88:0/2848340669 shutdown_connections 2023-12-08T08:21:24.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.252+0000 7f0539294640 1 --2- 172.21.15.88:0/2848340669 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0514066470 0x7f0514068930 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:24.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.252+0000 7f0539294640 1 --2- 172.21.15.88:0/2848340669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0534144d50 0x7f05341451e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:24.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.252+0000 7f0539294640 1 --2- 172.21.15.88:0/2848340669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05341f0690 0x7f053414ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:24.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.252+0000 7f0539294640 1 --2- 172.21.15.88:0/2848340669 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f05200047d0 0x7f0534145a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:24.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.252+0000 7f0539294640 1 -- 172.21.15.88:0/2848340669 >> 172.21.15.88:0/2848340669 conn(0x7f05340abb10 msgr2=0x7f053414d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:24.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.252+0000 7f0539294640 1 -- 172.21.15.88:0/2848340669 shutdown_connections 2023-12-08T08:21:24.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:24.252+0000 7f0539294640 1 -- 172.21.15.88:0/2848340669 wait complete. 2023-12-08T08:21:24.274 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-12-08T08:21:22.759928+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":202,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219180,"kb_used_data":3020,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755540,"statfs":{"total":773094113280,"available":772869672960,"internally_reserved":0,"allocated":3092480,"data_stored":2321852,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1241,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001180"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.658802+0000","last_change":"2023-12-08T08:21:17.658802+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.658802+0000","last_undegraded":"2023-12-08T08:21:17.658802+0000","last_fullsized":"2023-12-08T08:21:17.658802+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654128+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:21:16.654128+0000","last_peered":"2023-12-08T08:21:16.654128+0000","last_clean":"2023-12-08T08:21:16.654128+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:21:16.654128+0000","last_undegraded":"2023-12-08T08:21:16.654128+0000","last_fullsized":"2023-12-08T08:21:16.654128+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.650554+0000","last_change":"2023-12-08T08:21:04.776417+0000","last_active":"2023-12-08T08:21:16.650554+0000","last_peered":"2023-12-08T08:21:16.650554+0000","last_clean":"2023-12-08T08:21:16.650554+0000","last_became_active":"2023-12-08T08:21:04.776117+0000","last_became_peered":"2023-12-08T08:21:04.776117+0000","last_unstale":"2023-12-08T08:21:16.650554+0000","last_undegraded":"2023-12-08T08:21:16.650554+0000","last_fullsized":"2023-12-08T08:21:16.650554+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:45:05.142948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654266+0000","last_change":"2023-12-08T08:21:05.536640+0000","last_active":"2023-12-08T08:21:16.654266+0000","last_peered":"2023-12-08T08:21:16.654266+0000","last_clean":"2023-12-08T08:21:16.654266+0000","last_became_active":"2023-12-08T08:21:05.536368+0000","last_became_peered":"2023-12-08T08:21:05.536368+0000","last_unstale":"2023-12-08T08:21:16.654266+0000","last_undegraded":"2023-12-08T08:21:16.654266+0000","last_fullsized":"2023-12-08T08:21:16.654266+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:59:00.606587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.687045+0000","last_change":"2023-12-08T08:21:17.684153+0000","last_active":"2023-12-08T08:21:17.687045+0000","last_peered":"2023-12-08T08:21:17.687045+0000","last_clean":"2023-12-08T08:21:17.687045+0000","last_became_active":"2023-12-08T08:21:17.683886+0000","last_became_peered":"2023-12-08T08:21:17.683886+0000","last_unstale":"2023-12-08T08:21:17.687045+0000","last_undegraded":"2023-12-08T08:21:17.687045+0000","last_fullsized":"2023-12-08T08:21:17.687045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:37.006561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.671758+0000","last_change":"2023-12-08T08:21:17.671758+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.671758+0000","last_undegraded":"2023-12-08T08:21:17.671758+0000","last_fullsized":"2023-12-08T08:21:17.671758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643858+0000","last_change":"2023-12-08T08:21:04.781980+0000","last_active":"2023-12-08T08:21:16.643858+0000","last_peered":"2023-12-08T08:21:16.643858+0000","last_clean":"2023-12-08T08:21:16.643858+0000","last_became_active":"2023-12-08T08:21:04.781716+0000","last_became_peered":"2023-12-08T08:21:04.781716+0000","last_unstale":"2023-12-08T08:21:16.643858+0000","last_undegraded":"2023-12-08T08:21:16.643858+0000","last_fullsized":"2023-12-08T08:21:16.643858+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:03.400233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648438+0000","last_change":"2023-12-08T08:21:05.529530+0000","last_active":"2023-12-08T08:21:16.648438+0000","last_peered":"2023-12-08T08:21:16.648438+0000","last_clean":"2023-12-08T08:21:16.648438+0000","last_became_active":"2023-12-08T08:21:05.529080+0000","last_became_peered":"2023-12-08T08:21:05.529080+0000","last_unstale":"2023-12-08T08:21:16.648438+0000","last_undegraded":"2023-12-08T08:21:16.648438+0000","last_fullsized":"2023-12-08T08:21:16.648438+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:51.183842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686147+0000","last_change":"2023-12-08T08:21:17.682622+0000","last_active":"2023-12-08T08:21:17.686147+0000","last_peered":"2023-12-08T08:21:17.686147+0000","last_clean":"2023-12-08T08:21:17.686147+0000","last_became_active":"2023-12-08T08:21:17.676302+0000","last_became_peered":"2023-12-08T08:21:17.676302+0000","last_unstale":"2023-12-08T08:21:17.686147+0000","last_undegraded":"2023-12-08T08:21:17.686147+0000","last_fullsized":"2023-12-08T08:21:17.686147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:15.257930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.665725+0000","last_change":"2023-12-08T08:21:17.665725+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.665725+0000","last_undegraded":"2023-12-08T08:21:17.665725+0000","last_fullsized":"2023-12-08T08:21:17.665725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648651+0000","last_change":"2023-12-08T08:21:04.768138+0000","last_active":"2023-12-08T08:21:16.648651+0000","last_peered":"2023-12-08T08:21:16.648651+0000","last_clean":"2023-12-08T08:21:16.648651+0000","last_became_active":"2023-12-08T08:21:04.767873+0000","last_became_peered":"2023-12-08T08:21:04.767873+0000","last_unstale":"2023-12-08T08:21:16.648651+0000","last_undegraded":"2023-12-08T08:21:16.648651+0000","last_fullsized":"2023-12-08T08:21:16.648651+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:45:05.142948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643753+0000","last_change":"2023-12-08T08:21:05.526701+0000","last_active":"2023-12-08T08:21:16.643753+0000","last_peered":"2023-12-08T08:21:16.643753+0000","last_clean":"2023-12-08T08:21:16.643753+0000","last_became_active":"2023-12-08T08:21:05.526275+0000","last_became_peered":"2023-12-08T08:21:05.526275+0000","last_unstale":"2023-12-08T08:21:16.643753+0000","last_undegraded":"2023-12-08T08:21:16.643753+0000","last_fullsized":"2023-12-08T08:21:16.643753+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:59:00.606587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686309+0000","last_change":"2023-12-08T08:21:17.682917+0000","last_active":"2023-12-08T08:21:17.686309+0000","last_peered":"2023-12-08T08:21:17.686309+0000","last_clean":"2023-12-08T08:21:17.686309+0000","last_became_active":"2023-12-08T08:21:17.681822+0000","last_became_peered":"2023-12-08T08:21:17.681822+0000","last_unstale":"2023-12-08T08:21:17.686309+0000","last_undegraded":"2023-12-08T08:21:17.686309+0000","last_fullsized":"2023-12-08T08:21:17.686309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:37.006561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.655138+0000","last_change":"2023-12-08T08:21:17.655138+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.655138+0000","last_undegraded":"2023-12-08T08:21:17.655138+0000","last_fullsized":"2023-12-08T08:21:17.655138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652749+0000","last_change":"2023-12-08T08:21:04.776576+0000","last_active":"2023-12-08T08:21:16.652749+0000","last_peered":"2023-12-08T08:21:16.652749+0000","last_clean":"2023-12-08T08:21:16.652749+0000","last_became_active":"2023-12-08T08:21:04.773627+0000","last_became_peered":"2023-12-08T08:21:04.773627+0000","last_unstale":"2023-12-08T08:21:16.652749+0000","last_undegraded":"2023-12-08T08:21:16.652749+0000","last_fullsized":"2023-12-08T08:21:16.652749+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:12.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654667+0000","last_change":"2023-12-08T08:21:05.528356+0000","last_active":"2023-12-08T08:21:16.654667+0000","last_peered":"2023-12-08T08:21:16.654667+0000","last_clean":"2023-12-08T08:21:16.654667+0000","last_became_active":"2023-12-08T08:21:05.528102+0000","last_became_peered":"2023-12-08T08:21:05.528102+0000","last_unstale":"2023-12-08T08:21:16.654667+0000","last_undegraded":"2023-12-08T08:21:16.654667+0000","last_fullsized":"2023-12-08T08:21:16.654667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:51.183842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.675479+0000","last_change":"2023-12-08T08:21:17.673005+0000","last_active":"2023-12-08T08:21:17.675479+0000","last_peered":"2023-12-08T08:21:17.675479+0000","last_clean":"2023-12-08T08:21:17.675479+0000","last_became_active":"2023-12-08T08:21:17.672648+0000","last_became_peered":"2023-12-08T08:21:17.672648+0000","last_unstale":"2023-12-08T08:21:17.675479+0000","last_undegraded":"2023-12-08T08:21:17.675479+0000","last_fullsized":"2023-12-08T08:21:17.675479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:51:05.544383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.663000+0000","last_change":"2023-12-08T08:21:17.663000+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.663000+0000","last_undegraded":"2023-12-08T08:21:17.663000+0000","last_fullsized":"2023-12-08T08:21:17.663000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654354+0000","last_change":"2023-12-08T08:21:04.764784+0000","last_active":"2023-12-08T08:21:16.654354+0000","last_peered":"2023-12-08T08:21:16.654354+0000","last_clean":"2023-12-08T08:21:16.654354+0000","last_became_active":"2023-12-08T08:21:04.764580+0000","last_became_peered":"2023-12-08T08:21:04.764580+0000","last_unstale":"2023-12-08T08:21:16.654354+0000","last_undegraded":"2023-12-08T08:21:16.654354+0000","last_fullsized":"2023-12-08T08:21:16.654354+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:51:05.330323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.650596+0000","last_change":"2023-12-08T08:21:05.529399+0000","last_active":"2023-12-08T08:21:16.650596+0000","last_peered":"2023-12-08T08:21:16.650596+0000","last_clean":"2023-12-08T08:21:16.650596+0000","last_became_active":"2023-12-08T08:21:05.529054+0000","last_became_peered":"2023-12-08T08:21:05.529054+0000","last_unstale":"2023-12-08T08:21:16.650596+0000","last_undegraded":"2023-12-08T08:21:16.650596+0000","last_fullsized":"2023-12-08T08:21:16.650596+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:09.020416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.682208+0000","last_change":"2023-12-08T08:21:17.680157+0000","last_active":"2023-12-08T08:21:17.682208+0000","last_peered":"2023-12-08T08:21:17.682208+0000","last_clean":"2023-12-08T08:21:17.682208+0000","last_became_active":"2023-12-08T08:21:17.679947+0000","last_became_peered":"2023-12-08T08:21:17.679947+0000","last_unstale":"2023-12-08T08:21:17.682208+0000","last_undegraded":"2023-12-08T08:21:17.682208+0000","last_fullsized":"2023-12-08T08:21:17.682208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:37.129163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.663369+0000","last_change":"2023-12-08T08:21:17.663369+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.663369+0000","last_undegraded":"2023-12-08T08:21:17.663369+0000","last_fullsized":"2023-12-08T08:21:17.663369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651312+0000","last_change":"2023-12-08T08:21:04.769119+0000","last_active":"2023-12-08T08:21:16.651312+0000","last_peered":"2023-12-08T08:21:16.651312+0000","last_clean":"2023-12-08T08:21:16.651312+0000","last_became_active":"2023-12-08T08:21:04.768807+0000","last_became_peered":"2023-12-08T08:21:04.768807+0000","last_unstale":"2023-12-08T08:21:16.651312+0000","last_undegraded":"2023-12-08T08:21:16.651312+0000","last_fullsized":"2023-12-08T08:21:16.651312+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:29.810210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654195+0000","last_change":"2023-12-08T08:21:05.525845+0000","last_active":"2023-12-08T08:21:16.654195+0000","last_peered":"2023-12-08T08:21:16.654195+0000","last_clean":"2023-12-08T08:21:16.654195+0000","last_became_active":"2023-12-08T08:21:05.525546+0000","last_became_peered":"2023-12-08T08:21:05.525546+0000","last_unstale":"2023-12-08T08:21:16.654195+0000","last_undegraded":"2023-12-08T08:21:16.654195+0000","last_fullsized":"2023-12-08T08:21:16.654195+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:44.030312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686444+0000","last_change":"2023-12-08T08:21:17.682436+0000","last_active":"2023-12-08T08:21:17.686444+0000","last_peered":"2023-12-08T08:21:17.686444+0000","last_clean":"2023-12-08T08:21:17.686444+0000","last_became_active":"2023-12-08T08:21:17.682222+0000","last_became_peered":"2023-12-08T08:21:17.682222+0000","last_unstale":"2023-12-08T08:21:17.686444+0000","last_undegraded":"2023-12-08T08:21:17.686444+0000","last_fullsized":"2023-12-08T08:21:17.686444+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:49:31.201437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659513+0000","last_change":"2023-12-08T08:21:17.659513+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659513+0000","last_undegraded":"2023-12-08T08:21:17.659513+0000","last_fullsized":"2023-12-08T08:21:17.659513+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654403+0000","last_change":"2023-12-08T08:21:04.771189+0000","last_active":"2023-12-08T08:21:16.654403+0000","last_peered":"2023-12-08T08:21:16.654403+0000","last_clean":"2023-12-08T08:21:16.654403+0000","last_became_active":"2023-12-08T08:21:04.770913+0000","last_became_peered":"2023-12-08T08:21:04.770913+0000","last_unstale":"2023-12-08T08:21:16.654403+0000","last_undegraded":"2023-12-08T08:21:16.654403+0000","last_fullsized":"2023-12-08T08:21:16.654403+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:58:22.885070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.656834+0000","last_change":"2023-12-08T08:21:05.537968+0000","last_active":"2023-12-08T08:21:16.656834+0000","last_peered":"2023-12-08T08:21:16.656834+0000","last_clean":"2023-12-08T08:21:16.656834+0000","last_became_active":"2023-12-08T08:21:05.537190+0000","last_became_peered":"2023-12-08T08:21:05.537190+0000","last_unstale":"2023-12-08T08:21:16.656834+0000","last_undegraded":"2023-12-08T08:21:16.656834+0000","last_fullsized":"2023-12-08T08:21:16.656834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:49.782105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.689179+0000","last_change":"2023-12-08T08:21:17.684922+0000","last_active":"2023-12-08T08:21:17.689179+0000","last_peered":"2023-12-08T08:21:17.689179+0000","last_clean":"2023-12-08T08:21:17.689179+0000","last_became_active":"2023-12-08T08:21:17.684661+0000","last_became_peered":"2023-12-08T08:21:17.684661+0000","last_unstale":"2023-12-08T08:21:17.689179+0000","last_undegraded":"2023-12-08T08:21:17.689179+0000","last_fullsized":"2023-12-08T08:21:17.689179+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:42.863062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.656454+0000","last_change":"2023-12-08T08:21:17.656454+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.656454+0000","last_undegraded":"2023-12-08T08:21:17.656454+0000","last_fullsized":"2023-12-08T08:21:17.656454+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652074+0000","last_change":"2023-12-08T08:21:04.774731+0000","last_active":"2023-12-08T08:21:16.652074+0000","last_peered":"2023-12-08T08:21:16.652074+0000","last_clean":"2023-12-08T08:21:16.652074+0000","last_became_active":"2023-12-08T08:21:04.773894+0000","last_became_peered":"2023-12-08T08:21:04.773894+0000","last_unstale":"2023-12-08T08:21:16.652074+0000","last_undegraded":"2023-12-08T08:21:16.652074+0000","last_fullsized":"2023-12-08T08:21:16.652074+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:46.416448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652665+0000","last_change":"2023-12-08T08:21:05.540583+0000","last_active":"2023-12-08T08:21:16.652665+0000","last_peered":"2023-12-08T08:21:16.652665+0000","last_clean":"2023-12-08T08:21:16.652665+0000","last_became_active":"2023-12-08T08:21:05.540350+0000","last_became_peered":"2023-12-08T08:21:05.540350+0000","last_unstale":"2023-12-08T08:21:16.652665+0000","last_undegraded":"2023-12-08T08:21:16.652665+0000","last_fullsized":"2023-12-08T08:21:16.652665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:46:44.526151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.685385+0000","last_change":"2023-12-08T08:21:17.679399+0000","last_active":"2023-12-08T08:21:17.685385+0000","last_peered":"2023-12-08T08:21:17.685385+0000","last_clean":"2023-12-08T08:21:17.685385+0000","last_became_active":"2023-12-08T08:21:17.679103+0000","last_became_peered":"2023-12-08T08:21:17.679103+0000","last_unstale":"2023-12-08T08:21:17.685385+0000","last_undegraded":"2023-12-08T08:21:17.685385+0000","last_fullsized":"2023-12-08T08:21:17.685385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:11:38.595950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.662267+0000","last_change":"2023-12-08T08:21:17.662267+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.662267+0000","last_undegraded":"2023-12-08T08:21:17.662267+0000","last_fullsized":"2023-12-08T08:21:17.662267+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655121+0000","last_change":"2023-12-08T08:21:04.778519+0000","last_active":"2023-12-08T08:21:16.655121+0000","last_peered":"2023-12-08T08:21:16.655121+0000","last_clean":"2023-12-08T08:21:16.655121+0000","last_became_active":"2023-12-08T08:21:04.778208+0000","last_became_peered":"2023-12-08T08:21:04.778208+0000","last_unstale":"2023-12-08T08:21:16.655121+0000","last_undegraded":"2023-12-08T08:21:16.655121+0000","last_fullsized":"2023-12-08T08:21:16.655121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:36.535172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654305+0000","last_change":"2023-12-08T08:21:05.530364+0000","last_active":"2023-12-08T08:21:16.654305+0000","last_peered":"2023-12-08T08:21:16.654305+0000","last_clean":"2023-12-08T08:21:16.654305+0000","last_became_active":"2023-12-08T08:21:05.530046+0000","last_became_peered":"2023-12-08T08:21:05.530046+0000","last_unstale":"2023-12-08T08:21:16.654305+0000","last_undegraded":"2023-12-08T08:21:16.654305+0000","last_fullsized":"2023-12-08T08:21:16.654305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.368162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.684614+0000","last_change":"2023-12-08T08:21:17.680178+0000","last_active":"2023-12-08T08:21:17.684614+0000","last_peered":"2023-12-08T08:21:17.684614+0000","last_clean":"2023-12-08T08:21:17.684614+0000","last_became_active":"2023-12-08T08:21:17.679880+0000","last_became_peered":"2023-12-08T08:21:17.679880+0000","last_unstale":"2023-12-08T08:21:17.684614+0000","last_undegraded":"2023-12-08T08:21:17.684614+0000","last_fullsized":"2023-12-08T08:21:17.684614+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:54.148326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.673219+0000","last_change":"2023-12-08T08:21:17.673219+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.673219+0000","last_undegraded":"2023-12-08T08:21:17.673219+0000","last_fullsized":"2023-12-08T08:21:17.673219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648603+0000","last_change":"2023-12-08T08:21:04.771979+0000","last_active":"2023-12-08T08:21:16.648603+0000","last_peered":"2023-12-08T08:21:16.648603+0000","last_clean":"2023-12-08T08:21:16.648603+0000","last_became_active":"2023-12-08T08:21:04.771656+0000","last_became_peered":"2023-12-08T08:21:04.771656+0000","last_unstale":"2023-12-08T08:21:16.648603+0000","last_undegraded":"2023-12-08T08:21:16.648603+0000","last_fullsized":"2023-12-08T08:21:16.648603+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:46:43.523269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649282+0000","last_change":"2023-12-08T08:21:05.538591+0000","last_active":"2023-12-08T08:21:16.649282+0000","last_peered":"2023-12-08T08:21:16.649282+0000","last_clean":"2023-12-08T08:21:16.649282+0000","last_became_active":"2023-12-08T08:21:05.538303+0000","last_became_peered":"2023-12-08T08:21:05.538303+0000","last_unstale":"2023-12-08T08:21:16.649282+0000","last_undegraded":"2023-12-08T08:21:16.649282+0000","last_fullsized":"2023-12-08T08:21:16.649282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:45:35.860546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686482+0000","last_change":"2023-12-08T08:21:17.682782+0000","last_active":"2023-12-08T08:21:17.686482+0000","last_peered":"2023-12-08T08:21:17.686482+0000","last_clean":"2023-12-08T08:21:17.686482+0000","last_became_active":"2023-12-08T08:21:17.681371+0000","last_became_peered":"2023-12-08T08:21:17.681371+0000","last_unstale":"2023-12-08T08:21:17.686482+0000","last_undegraded":"2023-12-08T08:21:17.686482+0000","last_fullsized":"2023-12-08T08:21:17.686482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:41:10.487912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.657337+0000","last_change":"2023-12-08T08:21:17.657337+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.657337+0000","last_undegraded":"2023-12-08T08:21:17.657337+0000","last_fullsized":"2023-12-08T08:21:17.657337+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.650676+0000","last_change":"2023-12-08T08:21:04.776313+0000","last_active":"2023-12-08T08:21:16.650676+0000","last_peered":"2023-12-08T08:21:16.650676+0000","last_clean":"2023-12-08T08:21:16.650676+0000","last_became_active":"2023-12-08T08:21:04.775894+0000","last_became_peered":"2023-12-08T08:21:04.775894+0000","last_unstale":"2023-12-08T08:21:16.650676+0000","last_undegraded":"2023-12-08T08:21:16.650676+0000","last_fullsized":"2023-12-08T08:21:16.650676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:13.006406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649886+0000","last_change":"2023-12-08T08:21:05.537164+0000","last_active":"2023-12-08T08:21:16.649886+0000","last_peered":"2023-12-08T08:21:16.649886+0000","last_clean":"2023-12-08T08:21:16.649886+0000","last_became_active":"2023-12-08T08:21:05.536915+0000","last_became_peered":"2023-12-08T08:21:05.536915+0000","last_unstale":"2023-12-08T08:21:16.649886+0000","last_undegraded":"2023-12-08T08:21:16.649886+0000","last_fullsized":"2023-12-08T08:21:16.649886+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:14.009289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.676342+0000","last_change":"2023-12-08T08:21:17.673958+0000","last_active":"2023-12-08T08:21:17.676342+0000","last_peered":"2023-12-08T08:21:17.676342+0000","last_clean":"2023-12-08T08:21:17.676342+0000","last_became_active":"2023-12-08T08:21:17.673637+0000","last_became_peered":"2023-12-08T08:21:17.673637+0000","last_unstale":"2023-12-08T08:21:17.676342+0000","last_undegraded":"2023-12-08T08:21:17.676342+0000","last_fullsized":"2023-12-08T08:21:17.676342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:54.148326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659996+0000","last_change":"2023-12-08T08:21:17.659996+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659996+0000","last_undegraded":"2023-12-08T08:21:17.659996+0000","last_fullsized":"2023-12-08T08:21:17.659996+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654170+0000","last_change":"2023-12-08T08:21:04.768985+0000","last_active":"2023-12-08T08:21:16.654170+0000","last_peered":"2023-12-08T08:21:16.654170+0000","last_clean":"2023-12-08T08:21:16.654170+0000","last_became_active":"2023-12-08T08:21:04.768693+0000","last_became_peered":"2023-12-08T08:21:04.768693+0000","last_unstale":"2023-12-08T08:21:16.654170+0000","last_undegraded":"2023-12-08T08:21:16.654170+0000","last_fullsized":"2023-12-08T08:21:16.654170+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:29.810210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649619+0000","last_change":"2023-12-08T08:21:05.542434+0000","last_active":"2023-12-08T08:21:16.649619+0000","last_peered":"2023-12-08T08:21:16.649619+0000","last_clean":"2023-12-08T08:21:16.649619+0000","last_became_active":"2023-12-08T08:21:05.542218+0000","last_became_peered":"2023-12-08T08:21:05.542218+0000","last_unstale":"2023-12-08T08:21:16.649619+0000","last_undegraded":"2023-12-08T08:21:16.649619+0000","last_fullsized":"2023-12-08T08:21:16.649619+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:16:19.580755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.674800+0000","last_change":"2023-12-08T08:21:17.668067+0000","last_active":"2023-12-08T08:21:17.674800+0000","last_peered":"2023-12-08T08:21:17.674800+0000","last_clean":"2023-12-08T08:21:17.674800+0000","last_became_active":"2023-12-08T08:21:17.667751+0000","last_became_peered":"2023-12-08T08:21:17.667751+0000","last_unstale":"2023-12-08T08:21:17.674800+0000","last_undegraded":"2023-12-08T08:21:17.674800+0000","last_fullsized":"2023-12-08T08:21:17.674800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:25.581863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.657341+0000","last_change":"2023-12-08T08:21:17.657341+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.657341+0000","last_undegraded":"2023-12-08T08:21:17.657341+0000","last_fullsized":"2023-12-08T08:21:17.657341+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648875+0000","last_change":"2023-12-08T08:21:04.775274+0000","last_active":"2023-12-08T08:21:16.648875+0000","last_peered":"2023-12-08T08:21:16.648875+0000","last_clean":"2023-12-08T08:21:16.648875+0000","last_became_active":"2023-12-08T08:21:04.774961+0000","last_became_peered":"2023-12-08T08:21:04.774961+0000","last_unstale":"2023-12-08T08:21:16.648875+0000","last_undegraded":"2023-12-08T08:21:16.648875+0000","last_fullsized":"2023-12-08T08:21:16.648875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:03.400233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652649+0000","last_change":"2023-12-08T08:21:05.534904+0000","last_active":"2023-12-08T08:21:16.652649+0000","last_peered":"2023-12-08T08:21:16.652649+0000","last_clean":"2023-12-08T08:21:16.652649+0000","last_became_active":"2023-12-08T08:21:05.534637+0000","last_became_peered":"2023-12-08T08:21:05.534637+0000","last_unstale":"2023-12-08T08:21:16.652649+0000","last_undegraded":"2023-12-08T08:21:16.652649+0000","last_fullsized":"2023-12-08T08:21:16.652649+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:40:41.034391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686389+0000","last_change":"2023-12-08T08:21:17.682559+0000","last_active":"2023-12-08T08:21:17.686389+0000","last_peered":"2023-12-08T08:21:17.686389+0000","last_clean":"2023-12-08T08:21:17.686389+0000","last_became_active":"2023-12-08T08:21:17.675578+0000","last_became_peered":"2023-12-08T08:21:17.675578+0000","last_unstale":"2023-12-08T08:21:17.686389+0000","last_undegraded":"2023-12-08T08:21:17.686389+0000","last_fullsized":"2023-12-08T08:21:17.686389+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:46:01.671872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.658216+0000","last_change":"2023-12-08T08:21:17.658216+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.658216+0000","last_undegraded":"2023-12-08T08:21:17.658216+0000","last_fullsized":"2023-12-08T08:21:17.658216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649140+0000","last_change":"2023-12-08T08:21:04.770820+0000","last_active":"2023-12-08T08:21:16.649140+0000","last_peered":"2023-12-08T08:21:16.649140+0000","last_clean":"2023-12-08T08:21:16.649140+0000","last_became_active":"2023-12-08T08:21:04.767804+0000","last_became_peered":"2023-12-08T08:21:04.767804+0000","last_unstale":"2023-12-08T08:21:16.649140+0000","last_undegraded":"2023-12-08T08:21:16.649140+0000","last_fullsized":"2023-12-08T08:21:16.649140+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:58:22.885070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651163+0000","last_change":"2023-12-08T08:21:05.521567+0000","last_active":"2023-12-08T08:21:16.651163+0000","last_peered":"2023-12-08T08:21:16.651163+0000","last_clean":"2023-12-08T08:21:16.651163+0000","last_became_active":"2023-12-08T08:21:05.521289+0000","last_became_peered":"2023-12-08T08:21:05.521289+0000","last_unstale":"2023-12-08T08:21:16.651163+0000","last_undegraded":"2023-12-08T08:21:16.651163+0000","last_fullsized":"2023-12-08T08:21:16.651163+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:11.477913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.689245+0000","last_change":"2023-12-08T08:21:17.683937+0000","last_active":"2023-12-08T08:21:17.689245+0000","last_peered":"2023-12-08T08:21:17.689245+0000","last_clean":"2023-12-08T08:21:17.689245+0000","last_became_active":"2023-12-08T08:21:17.683574+0000","last_became_peered":"2023-12-08T08:21:17.683574+0000","last_unstale":"2023-12-08T08:21:17.689245+0000","last_undegraded":"2023-12-08T08:21:17.689245+0000","last_fullsized":"2023-12-08T08:21:17.689245+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:58:35.777720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.662363+0000","last_change":"2023-12-08T08:21:17.662363+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.662363+0000","last_undegraded":"2023-12-08T08:21:17.662363+0000","last_fullsized":"2023-12-08T08:21:17.662363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649148+0000","last_change":"2023-12-08T08:21:04.776652+0000","last_active":"2023-12-08T08:21:16.649148+0000","last_peered":"2023-12-08T08:21:16.649148+0000","last_clean":"2023-12-08T08:21:16.649148+0000","last_became_active":"2023-12-08T08:21:04.776345+0000","last_became_peered":"2023-12-08T08:21:04.776345+0000","last_unstale":"2023-12-08T08:21:16.649148+0000","last_undegraded":"2023-12-08T08:21:16.649148+0000","last_fullsized":"2023-12-08T08:21:16.649148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:46.416448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.656832+0000","last_change":"2023-12-08T08:21:05.538159+0000","last_active":"2023-12-08T08:21:16.656832+0000","last_peered":"2023-12-08T08:21:16.656832+0000","last_clean":"2023-12-08T08:21:16.656832+0000","last_became_active":"2023-12-08T08:21:05.537601+0000","last_became_peered":"2023-12-08T08:21:05.537601+0000","last_unstale":"2023-12-08T08:21:16.656832+0000","last_undegraded":"2023-12-08T08:21:16.656832+0000","last_fullsized":"2023-12-08T08:21:16.656832+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:09:56.356105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.680296+0000","last_change":"2023-12-08T08:21:17.675955+0000","last_active":"2023-12-08T08:21:17.680296+0000","last_peered":"2023-12-08T08:21:17.680296+0000","last_clean":"2023-12-08T08:21:17.680296+0000","last_became_active":"2023-12-08T08:21:17.675547+0000","last_became_peered":"2023-12-08T08:21:17.675547+0000","last_unstale":"2023-12-08T08:21:17.680296+0000","last_undegraded":"2023-12-08T08:21:17.680296+0000","last_fullsized":"2023-12-08T08:21:17.680296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:59.826879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.662129+0000","last_change":"2023-12-08T08:21:17.662129+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.662129+0000","last_undegraded":"2023-12-08T08:21:17.662129+0000","last_fullsized":"2023-12-08T08:21:17.662129+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651983+0000","last_change":"2023-12-08T08:21:04.785414+0000","last_active":"2023-12-08T08:21:16.651983+0000","last_peered":"2023-12-08T08:21:16.651983+0000","last_clean":"2023-12-08T08:21:16.651983+0000","last_became_active":"2023-12-08T08:21:04.785198+0000","last_became_peered":"2023-12-08T08:21:04.785198+0000","last_unstale":"2023-12-08T08:21:16.651983+0000","last_undegraded":"2023-12-08T08:21:16.651983+0000","last_fullsized":"2023-12-08T08:21:16.651983+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:03.400233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649085+0000","last_change":"2023-12-08T08:21:05.537706+0000","last_active":"2023-12-08T08:21:16.649085+0000","last_peered":"2023-12-08T08:21:16.649085+0000","last_clean":"2023-12-08T08:21:16.649085+0000","last_became_active":"2023-12-08T08:21:05.537282+0000","last_became_peered":"2023-12-08T08:21:05.537282+0000","last_unstale":"2023-12-08T08:21:16.649085+0000","last_undegraded":"2023-12-08T08:21:16.649085+0000","last_fullsized":"2023-12-08T08:21:16.649085+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:13.692096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.687157+0000","last_change":"2023-12-08T08:21:17.685511+0000","last_active":"2023-12-08T08:21:17.687157+0000","last_peered":"2023-12-08T08:21:17.687157+0000","last_clean":"2023-12-08T08:21:17.687157+0000","last_became_active":"2023-12-08T08:21:17.685173+0000","last_became_peered":"2023-12-08T08:21:17.685173+0000","last_unstale":"2023-12-08T08:21:17.687157+0000","last_undegraded":"2023-12-08T08:21:17.687157+0000","last_fullsized":"2023-12-08T08:21:17.687157+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:55:55.550300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.658627+0000","last_change":"2023-12-08T08:21:17.658627+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.658627+0000","last_undegraded":"2023-12-08T08:21:17.658627+0000","last_fullsized":"2023-12-08T08:21:17.658627+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643854+0000","last_change":"2023-12-08T08:21:04.775742+0000","last_active":"2023-12-08T08:21:16.643854+0000","last_peered":"2023-12-08T08:21:16.643854+0000","last_clean":"2023-12-08T08:21:16.643854+0000","last_became_active":"2023-12-08T08:21:04.775482+0000","last_became_peered":"2023-12-08T08:21:04.775482+0000","last_unstale":"2023-12-08T08:21:16.643854+0000","last_undegraded":"2023-12-08T08:21:16.643854+0000","last_fullsized":"2023-12-08T08:21:16.643854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:46.416448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.650561+0000","last_change":"2023-12-08T08:21:05.528065+0000","last_active":"2023-12-08T08:21:16.650561+0000","last_peered":"2023-12-08T08:21:16.650561+0000","last_clean":"2023-12-08T08:21:16.650561+0000","last_became_active":"2023-12-08T08:21:05.527792+0000","last_became_peered":"2023-12-08T08:21:05.527792+0000","last_unstale":"2023-12-08T08:21:16.650561+0000","last_undegraded":"2023-12-08T08:21:16.650561+0000","last_fullsized":"2023-12-08T08:21:16.650561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:51:06.333206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.683125+0000","last_change":"2023-12-08T08:21:17.677690+0000","last_active":"2023-12-08T08:21:17.683125+0000","last_peered":"2023-12-08T08:21:17.683125+0000","last_clean":"2023-12-08T08:21:17.683125+0000","last_became_active":"2023-12-08T08:21:17.677376+0000","last_became_peered":"2023-12-08T08:21:17.677376+0000","last_unstale":"2023-12-08T08:21:17.683125+0000","last_undegraded":"2023-12-08T08:21:17.683125+0000","last_fullsized":"2023-12-08T08:21:17.683125+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:55:55.550300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661062+0000","last_change":"2023-12-08T08:21:17.661062+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661062+0000","last_undegraded":"2023-12-08T08:21:17.661062+0000","last_fullsized":"2023-12-08T08:21:17.661062+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643764+0000","last_change":"2023-12-08T08:21:04.781520+0000","last_active":"2023-12-08T08:21:16.643764+0000","last_peered":"2023-12-08T08:21:16.643764+0000","last_clean":"2023-12-08T08:21:16.643764+0000","last_became_active":"2023-12-08T08:21:04.781236+0000","last_became_peered":"2023-12-08T08:21:04.781236+0000","last_unstale":"2023-12-08T08:21:16.643764+0000","last_undegraded":"2023-12-08T08:21:16.643764+0000","last_fullsized":"2023-12-08T08:21:16.643764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:14:17.281881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.653811+0000","last_change":"2023-12-08T08:21:05.544369+0000","last_active":"2023-12-08T08:21:16.653811+0000","last_peered":"2023-12-08T08:21:16.653811+0000","last_clean":"2023-12-08T08:21:16.653811+0000","last_became_active":"2023-12-08T08:21:05.544090+0000","last_became_peered":"2023-12-08T08:21:05.544090+0000","last_unstale":"2023-12-08T08:21:16.653811+0000","last_undegraded":"2023-12-08T08:21:16.653811+0000","last_fullsized":"2023-12-08T08:21:16.653811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:25.239396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.685476+0000","last_change":"2023-12-08T08:21:17.681233+0000","last_active":"2023-12-08T08:21:17.685476+0000","last_peered":"2023-12-08T08:21:17.685476+0000","last_clean":"2023-12-08T08:21:17.685476+0000","last_became_active":"2023-12-08T08:21:17.680645+0000","last_became_peered":"2023-12-08T08:21:17.680645+0000","last_unstale":"2023-12-08T08:21:17.685476+0000","last_undegraded":"2023-12-08T08:21:17.685476+0000","last_fullsized":"2023-12-08T08:21:17.685476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:50:42.502393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661129+0000","last_change":"2023-12-08T08:21:17.661129+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661129+0000","last_undegraded":"2023-12-08T08:21:17.661129+0000","last_fullsized":"2023-12-08T08:21:17.661129+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652680+0000","last_change":"2023-12-08T08:21:04.778563+0000","last_active":"2023-12-08T08:21:16.652680+0000","last_peered":"2023-12-08T08:21:16.652680+0000","last_clean":"2023-12-08T08:21:16.652680+0000","last_became_active":"2023-12-08T08:21:04.778275+0000","last_became_peered":"2023-12-08T08:21:04.778275+0000","last_unstale":"2023-12-08T08:21:16.652680+0000","last_undegraded":"2023-12-08T08:21:16.652680+0000","last_fullsized":"2023-12-08T08:21:16.652680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:45:05.142948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644069+0000","last_change":"2023-12-08T08:21:05.528470+0000","last_active":"2023-12-08T08:21:16.644069+0000","last_peered":"2023-12-08T08:21:16.644069+0000","last_clean":"2023-12-08T08:21:16.644069+0000","last_became_active":"2023-12-08T08:21:05.528125+0000","last_became_peered":"2023-12-08T08:21:05.528125+0000","last_unstale":"2023-12-08T08:21:16.644069+0000","last_undegraded":"2023-12-08T08:21:16.644069+0000","last_fullsized":"2023-12-08T08:21:16.644069+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.368162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.675089+0000","last_change":"2023-12-08T08:21:17.670281+0000","last_active":"2023-12-08T08:21:17.675089+0000","last_peered":"2023-12-08T08:21:17.675089+0000","last_clean":"2023-12-08T08:21:17.675089+0000","last_became_active":"2023-12-08T08:21:17.670085+0000","last_became_peered":"2023-12-08T08:21:17.670085+0000","last_unstale":"2023-12-08T08:21:17.675089+0000","last_undegraded":"2023-12-08T08:21:17.675089+0000","last_fullsized":"2023-12-08T08:21:17.675089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:20.486293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.667977+0000","last_change":"2023-12-08T08:21:17.667977+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.667977+0000","last_undegraded":"2023-12-08T08:21:17.667977+0000","last_fullsized":"2023-12-08T08:21:17.667977+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648818+0000","last_change":"2023-12-08T08:21:04.773643+0000","last_active":"2023-12-08T08:21:16.648818+0000","last_peered":"2023-12-08T08:21:16.648818+0000","last_clean":"2023-12-08T08:21:16.648818+0000","last_became_active":"2023-12-08T08:21:04.773361+0000","last_became_peered":"2023-12-08T08:21:04.773361+0000","last_unstale":"2023-12-08T08:21:16.648818+0000","last_undegraded":"2023-12-08T08:21:16.648818+0000","last_fullsized":"2023-12-08T08:21:16.648818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:08.017533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652611+0000","last_change":"2023-12-08T08:21:05.543017+0000","last_active":"2023-12-08T08:21:16.652611+0000","last_peered":"2023-12-08T08:21:16.652611+0000","last_clean":"2023-12-08T08:21:16.652611+0000","last_became_active":"2023-12-08T08:21:05.542729+0000","last_became_peered":"2023-12-08T08:21:05.542729+0000","last_unstale":"2023-12-08T08:21:16.652611+0000","last_undegraded":"2023-12-08T08:21:16.652611+0000","last_fullsized":"2023-12-08T08:21:16.652611+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:19.928543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.680377+0000","last_change":"2023-12-08T08:21:17.672426+0000","last_active":"2023-12-08T08:21:17.680377+0000","last_peered":"2023-12-08T08:21:17.680377+0000","last_clean":"2023-12-08T08:21:17.680377+0000","last_became_active":"2023-12-08T08:21:17.672079+0000","last_became_peered":"2023-12-08T08:21:17.672079+0000","last_unstale":"2023-12-08T08:21:17.680377+0000","last_undegraded":"2023-12-08T08:21:17.680377+0000","last_fullsized":"2023-12-08T08:21:17.680377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:11:38.595950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.660226+0000","last_change":"2023-12-08T08:21:17.660226+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.660226+0000","last_undegraded":"2023-12-08T08:21:17.660226+0000","last_fullsized":"2023-12-08T08:21:17.660226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"31'8","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644372+0000","last_change":"2023-12-08T08:21:04.778814+0000","last_active":"2023-12-08T08:21:16.644372+0000","last_peered":"2023-12-08T08:21:16.644372+0000","last_clean":"2023-12-08T08:21:16.644372+0000","last_became_active":"2023-12-08T08:21:04.778501+0000","last_became_peered":"2023-12-08T08:21:04.778501+0000","last_unstale":"2023-12-08T08:21:16.644372+0000","last_undegraded":"2023-12-08T08:21:16.644372+0000","last_fullsized":"2023-12-08T08:21:16.644372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:50:52.651732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655964+0000","last_change":"2023-12-08T08:21:05.540670+0000","last_active":"2023-12-08T08:21:16.655964+0000","last_peered":"2023-12-08T08:21:16.655964+0000","last_clean":"2023-12-08T08:21:16.655964+0000","last_became_active":"2023-12-08T08:21:05.539546+0000","last_became_peered":"2023-12-08T08:21:05.539546+0000","last_unstale":"2023-12-08T08:21:16.655964+0000","last_undegraded":"2023-12-08T08:21:16.655964+0000","last_fullsized":"2023-12-08T08:21:16.655964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:20:39.875619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.678590+0000","last_change":"2023-12-08T08:21:17.668240+0000","last_active":"2023-12-08T08:21:17.678590+0000","last_peered":"2023-12-08T08:21:17.678590+0000","last_clean":"2023-12-08T08:21:17.678590+0000","last_became_active":"2023-12-08T08:21:17.667990+0000","last_became_peered":"2023-12-08T08:21:17.667990+0000","last_unstale":"2023-12-08T08:21:17.678590+0000","last_undegraded":"2023-12-08T08:21:17.678590+0000","last_fullsized":"2023-12-08T08:21:17.678590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:54.911358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.656815+0000","last_change":"2023-12-08T08:21:17.656815+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.656815+0000","last_undegraded":"2023-12-08T08:21:17.656815+0000","last_fullsized":"2023-12-08T08:21:17.656815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.656147+0000","last_change":"2023-12-08T08:21:04.782195+0000","last_active":"2023-12-08T08:21:16.656147+0000","last_peered":"2023-12-08T08:21:16.656147+0000","last_clean":"2023-12-08T08:21:16.656147+0000","last_became_active":"2023-12-08T08:21:04.781298+0000","last_became_peered":"2023-12-08T08:21:04.781298+0000","last_unstale":"2023-12-08T08:21:16.656147+0000","last_undegraded":"2023-12-08T08:21:16.656147+0000","last_fullsized":"2023-12-08T08:21:16.656147+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:12.689213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644226+0000","last_change":"2023-12-08T08:21:05.532372+0000","last_active":"2023-12-08T08:21:16.644226+0000","last_peered":"2023-12-08T08:21:16.644226+0000","last_clean":"2023-12-08T08:21:16.644226+0000","last_became_active":"2023-12-08T08:21:05.531767+0000","last_became_peered":"2023-12-08T08:21:05.531767+0000","last_unstale":"2023-12-08T08:21:16.644226+0000","last_undegraded":"2023-12-08T08:21:16.644226+0000","last_fullsized":"2023-12-08T08:21:16.644226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:30.973295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686218+0000","last_change":"2023-12-08T08:21:17.682631+0000","last_active":"2023-12-08T08:21:17.686218+0000","last_peered":"2023-12-08T08:21:17.686218+0000","last_clean":"2023-12-08T08:21:17.686218+0000","last_became_active":"2023-12-08T08:21:17.677727+0000","last_became_peered":"2023-12-08T08:21:17.677727+0000","last_unstale":"2023-12-08T08:21:17.686218+0000","last_undegraded":"2023-12-08T08:21:17.686218+0000","last_fullsized":"2023-12-08T08:21:17.686218+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:10:08.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661135+0000","last_change":"2023-12-08T08:21:17.661135+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661135+0000","last_undegraded":"2023-12-08T08:21:17.661135+0000","last_fullsized":"2023-12-08T08:21:17.661135+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654331+0000","last_change":"2023-12-08T08:21:04.786064+0000","last_active":"2023-12-08T08:21:16.654331+0000","last_peered":"2023-12-08T08:21:16.654331+0000","last_clean":"2023-12-08T08:21:16.654331+0000","last_became_active":"2023-12-08T08:21:04.785859+0000","last_became_peered":"2023-12-08T08:21:04.785859+0000","last_unstale":"2023-12-08T08:21:16.654331+0000","last_undegraded":"2023-12-08T08:21:16.654331+0000","last_fullsized":"2023-12-08T08:21:16.654331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:12.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644317+0000","last_change":"2023-12-08T08:21:05.532644+0000","last_active":"2023-12-08T08:21:16.644317+0000","last_peered":"2023-12-08T08:21:16.644317+0000","last_clean":"2023-12-08T08:21:16.644317+0000","last_became_active":"2023-12-08T08:21:05.530404+0000","last_became_peered":"2023-12-08T08:21:05.530404+0000","last_unstale":"2023-12-08T08:21:16.644317+0000","last_undegraded":"2023-12-08T08:21:16.644317+0000","last_fullsized":"2023-12-08T08:21:16.644317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:05:11.193024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.684441+0000","last_change":"2023-12-08T08:21:17.677740+0000","last_active":"2023-12-08T08:21:17.684441+0000","last_peered":"2023-12-08T08:21:17.684441+0000","last_clean":"2023-12-08T08:21:17.684441+0000","last_became_active":"2023-12-08T08:21:17.672121+0000","last_became_peered":"2023-12-08T08:21:17.672121+0000","last_unstale":"2023-12-08T08:21:17.684441+0000","last_undegraded":"2023-12-08T08:21:17.684441+0000","last_fullsized":"2023-12-08T08:21:17.684441+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:20.910184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.664339+0000","last_change":"2023-12-08T08:21:17.664339+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.664339+0000","last_undegraded":"2023-12-08T08:21:17.664339+0000","last_fullsized":"2023-12-08T08:21:17.664339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644467+0000","last_change":"2023-12-08T08:21:04.782800+0000","last_active":"2023-12-08T08:21:16.644467+0000","last_peered":"2023-12-08T08:21:16.644467+0000","last_clean":"2023-12-08T08:21:16.644467+0000","last_became_active":"2023-12-08T08:21:04.782531+0000","last_became_peered":"2023-12-08T08:21:04.782531+0000","last_unstale":"2023-12-08T08:21:16.644467+0000","last_undegraded":"2023-12-08T08:21:16.644467+0000","last_fullsized":"2023-12-08T08:21:16.644467+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:42.018708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.656002+0000","last_change":"2023-12-08T08:21:05.533947+0000","last_active":"2023-12-08T08:21:16.656002+0000","last_peered":"2023-12-08T08:21:16.656002+0000","last_clean":"2023-12-08T08:21:16.656002+0000","last_became_active":"2023-12-08T08:21:05.533554+0000","last_became_peered":"2023-12-08T08:21:05.533554+0000","last_unstale":"2023-12-08T08:21:16.656002+0000","last_undegraded":"2023-12-08T08:21:16.656002+0000","last_fullsized":"2023-12-08T08:21:16.656002+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:25.239396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.685462+0000","last_change":"2023-12-08T08:21:17.679519+0000","last_active":"2023-12-08T08:21:17.685462+0000","last_peered":"2023-12-08T08:21:17.685462+0000","last_clean":"2023-12-08T08:21:17.685462+0000","last_became_active":"2023-12-08T08:21:17.679265+0000","last_became_peered":"2023-12-08T08:21:17.679265+0000","last_unstale":"2023-12-08T08:21:17.685462+0000","last_undegraded":"2023-12-08T08:21:17.685462+0000","last_fullsized":"2023-12-08T08:21:17.685462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:12.057342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659167+0000","last_change":"2023-12-08T08:21:17.659167+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659167+0000","last_undegraded":"2023-12-08T08:21:17.659167+0000","last_fullsized":"2023-12-08T08:21:17.659167+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648603+0000","last_change":"2023-12-08T08:21:04.776553+0000","last_active":"2023-12-08T08:21:16.648603+0000","last_peered":"2023-12-08T08:21:16.648603+0000","last_clean":"2023-12-08T08:21:16.648603+0000","last_became_active":"2023-12-08T08:21:04.773755+0000","last_became_peered":"2023-12-08T08:21:04.773755+0000","last_unstale":"2023-12-08T08:21:16.648603+0000","last_undegraded":"2023-12-08T08:21:16.648603+0000","last_fullsized":"2023-12-08T08:21:16.648603+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:12.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651140+0000","last_change":"2023-12-08T08:21:05.536397+0000","last_active":"2023-12-08T08:21:16.651140+0000","last_peered":"2023-12-08T08:21:16.651140+0000","last_clean":"2023-12-08T08:21:16.651140+0000","last_became_active":"2023-12-08T08:21:05.536103+0000","last_became_peered":"2023-12-08T08:21:05.536103+0000","last_unstale":"2023-12-08T08:21:16.651140+0000","last_undegraded":"2023-12-08T08:21:16.651140+0000","last_fullsized":"2023-12-08T08:21:16.651140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:44.030312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.674675+0000","last_change":"2023-12-08T08:21:17.671190+0000","last_active":"2023-12-08T08:21:17.674675+0000","last_peered":"2023-12-08T08:21:17.674675+0000","last_clean":"2023-12-08T08:21:17.674675+0000","last_became_active":"2023-12-08T08:21:17.670895+0000","last_became_peered":"2023-12-08T08:21:17.670895+0000","last_unstale":"2023-12-08T08:21:17.674675+0000","last_undegraded":"2023-12-08T08:21:17.674675+0000","last_fullsized":"2023-12-08T08:21:17.674675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:42.863062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.655881+0000","last_change":"2023-12-08T08:21:17.655881+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.655881+0000","last_undegraded":"2023-12-08T08:21:17.655881+0000","last_fullsized":"2023-12-08T08:21:17.655881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643850+0000","last_change":"2023-12-08T08:21:04.780723+0000","last_active":"2023-12-08T08:21:16.643850+0000","last_peered":"2023-12-08T08:21:16.643850+0000","last_clean":"2023-12-08T08:21:16.643850+0000","last_became_active":"2023-12-08T08:21:04.780436+0000","last_became_peered":"2023-12-08T08:21:04.780436+0000","last_unstale":"2023-12-08T08:21:16.643850+0000","last_undegraded":"2023-12-08T08:21:16.643850+0000","last_fullsized":"2023-12-08T08:21:16.643850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:12.689213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648504+0000","last_change":"2023-12-08T08:21:05.535708+0000","last_active":"2023-12-08T08:21:16.648504+0000","last_peered":"2023-12-08T08:21:16.648504+0000","last_clean":"2023-12-08T08:21:16.648504+0000","last_became_active":"2023-12-08T08:21:05.527959+0000","last_became_peered":"2023-12-08T08:21:05.527959+0000","last_unstale":"2023-12-08T08:21:16.648504+0000","last_undegraded":"2023-12-08T08:21:16.648504+0000","last_fullsized":"2023-12-08T08:21:16.648504+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:14:18.284764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.685488+0000","last_change":"2023-12-08T08:21:17.681447+0000","last_active":"2023-12-08T08:21:17.685488+0000","last_peered":"2023-12-08T08:21:17.685488+0000","last_clean":"2023-12-08T08:21:17.685488+0000","last_became_active":"2023-12-08T08:21:17.680989+0000","last_became_peered":"2023-12-08T08:21:17.680989+0000","last_unstale":"2023-12-08T08:21:17.685488+0000","last_undegraded":"2023-12-08T08:21:17.685488+0000","last_fullsized":"2023-12-08T08:21:17.685488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:24.695194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661815+0000","last_change":"2023-12-08T08:21:17.661815+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661815+0000","last_undegraded":"2023-12-08T08:21:17.661815+0000","last_fullsized":"2023-12-08T08:21:17.661815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649335+0000","last_change":"2023-12-08T08:21:04.783596+0000","last_active":"2023-12-08T08:21:16.649335+0000","last_peered":"2023-12-08T08:21:16.649335+0000","last_clean":"2023-12-08T08:21:16.649335+0000","last_became_active":"2023-12-08T08:21:04.783159+0000","last_became_peered":"2023-12-08T08:21:04.783159+0000","last_unstale":"2023-12-08T08:21:16.649335+0000","last_undegraded":"2023-12-08T08:21:16.649335+0000","last_fullsized":"2023-12-08T08:21:16.649335+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:43.027429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655533+0000","last_change":"2023-12-08T08:21:05.537414+0000","last_active":"2023-12-08T08:21:16.655533+0000","last_peered":"2023-12-08T08:21:16.655533+0000","last_clean":"2023-12-08T08:21:16.655533+0000","last_became_active":"2023-12-08T08:21:05.537137+0000","last_became_peered":"2023-12-08T08:21:05.537137+0000","last_unstale":"2023-12-08T08:21:16.655533+0000","last_undegraded":"2023-12-08T08:21:16.655533+0000","last_fullsized":"2023-12-08T08:21:16.655533+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:08.596525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.677172+0000","last_change":"2023-12-08T08:21:17.676027+0000","last_active":"2023-12-08T08:21:17.677172+0000","last_peered":"2023-12-08T08:21:17.677172+0000","last_clean":"2023-12-08T08:21:17.677172+0000","last_became_active":"2023-12-08T08:21:17.675823+0000","last_became_peered":"2023-12-08T08:21:17.675823+0000","last_unstale":"2023-12-08T08:21:17.677172+0000","last_undegraded":"2023-12-08T08:21:17.677172+0000","last_fullsized":"2023-12-08T08:21:17.677172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:14:30.174532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.656636+0000","last_change":"2023-12-08T08:21:17.656636+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.656636+0000","last_undegraded":"2023-12-08T08:21:17.656636+0000","last_fullsized":"2023-12-08T08:21:17.656636+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648820+0000","last_change":"2023-12-08T08:21:04.784944+0000","last_active":"2023-12-08T08:21:16.648820+0000","last_peered":"2023-12-08T08:21:16.648820+0000","last_clean":"2023-12-08T08:21:16.648820+0000","last_became_active":"2023-12-08T08:21:04.784657+0000","last_became_peered":"2023-12-08T08:21:04.784657+0000","last_unstale":"2023-12-08T08:21:16.648820+0000","last_undegraded":"2023-12-08T08:21:16.648820+0000","last_fullsized":"2023-12-08T08:21:16.648820+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:51:05.330323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654537+0000","last_change":"2023-12-08T08:21:05.542808+0000","last_active":"2023-12-08T08:21:16.654537+0000","last_peered":"2023-12-08T08:21:16.654537+0000","last_clean":"2023-12-08T08:21:16.654537+0000","last_became_active":"2023-12-08T08:21:05.542495+0000","last_became_peered":"2023-12-08T08:21:05.542495+0000","last_unstale":"2023-12-08T08:21:16.654537+0000","last_undegraded":"2023-12-08T08:21:16.654537+0000","last_fullsized":"2023-12-08T08:21:16.654537+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:50:53.654615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.684879+0000","last_change":"2023-12-08T08:21:17.681699+0000","last_active":"2023-12-08T08:21:17.684879+0000","last_peered":"2023-12-08T08:21:17.684879+0000","last_clean":"2023-12-08T08:21:17.684879+0000","last_became_active":"2023-12-08T08:21:17.681356+0000","last_became_peered":"2023-12-08T08:21:17.681356+0000","last_unstale":"2023-12-08T08:21:17.684879+0000","last_undegraded":"2023-12-08T08:21:17.684879+0000","last_fullsized":"2023-12-08T08:21:17.684879+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:31:02.865086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.664497+0000","last_change":"2023-12-08T08:21:17.664497+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.664497+0000","last_undegraded":"2023-12-08T08:21:17.664497+0000","last_fullsized":"2023-12-08T08:21:17.664497+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.682731+0000","last_change":"2023-12-08T08:21:17.674547+0000","last_active":"2023-12-08T08:21:17.682731+0000","last_peered":"2023-12-08T08:21:17.682731+0000","last_clean":"2023-12-08T08:21:17.682731+0000","last_became_active":"2023-12-08T08:21:17.674313+0000","last_became_peered":"2023-12-08T08:21:17.674313+0000","last_unstale":"2023-12-08T08:21:17.682731+0000","last_undegraded":"2023-12-08T08:21:17.682731+0000","last_fullsized":"2023-12-08T08:21:17.682731+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:17.857771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652533+0000","last_change":"2023-12-08T08:21:04.773475+0000","last_active":"2023-12-08T08:21:16.652533+0000","last_peered":"2023-12-08T08:21:16.652533+0000","last_clean":"2023-12-08T08:21:16.652533+0000","last_became_active":"2023-12-08T08:21:04.773125+0000","last_became_peered":"2023-12-08T08:21:04.773125+0000","last_unstale":"2023-12-08T08:21:16.652533+0000","last_undegraded":"2023-12-08T08:21:16.652533+0000","last_fullsized":"2023-12-08T08:21:16.652533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:00:34.107681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652344+0000","last_change":"2023-12-08T08:21:05.527749+0000","last_active":"2023-12-08T08:21:16.652344+0000","last_peered":"2023-12-08T08:21:16.652344+0000","last_clean":"2023-12-08T08:21:16.652344+0000","last_became_active":"2023-12-08T08:21:05.527397+0000","last_became_peered":"2023-12-08T08:21:05.527397+0000","last_unstale":"2023-12-08T08:21:16.652344+0000","last_undegraded":"2023-12-08T08:21:16.652344+0000","last_fullsized":"2023-12-08T08:21:16.652344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:13.692096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.662777+0000","last_change":"2023-12-08T08:21:17.662777+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.662777+0000","last_undegraded":"2023-12-08T08:21:17.662777+0000","last_fullsized":"2023-12-08T08:21:17.662777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686471+0000","last_change":"2023-12-08T08:21:17.682288+0000","last_active":"2023-12-08T08:21:17.686471+0000","last_peered":"2023-12-08T08:21:17.686471+0000","last_clean":"2023-12-08T08:21:17.686471+0000","last_became_active":"2023-12-08T08:21:17.680967+0000","last_became_peered":"2023-12-08T08:21:17.680967+0000","last_unstale":"2023-12-08T08:21:17.686471+0000","last_undegraded":"2023-12-08T08:21:17.686471+0000","last_fullsized":"2023-12-08T08:21:17.686471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:02:38.255209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644131+0000","last_change":"2023-12-08T08:21:04.778223+0000","last_active":"2023-12-08T08:21:16.644131+0000","last_peered":"2023-12-08T08:21:16.644131+0000","last_clean":"2023-12-08T08:21:16.644131+0000","last_became_active":"2023-12-08T08:21:04.777902+0000","last_became_peered":"2023-12-08T08:21:04.777902+0000","last_unstale":"2023-12-08T08:21:16.644131+0000","last_undegraded":"2023-12-08T08:21:16.644131+0000","last_fullsized":"2023-12-08T08:21:16.644131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:07.593642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649143+0000","last_change":"2023-12-08T08:21:05.532257+0000","last_active":"2023-12-08T08:21:16.649143+0000","last_peered":"2023-12-08T08:21:16.649143+0000","last_clean":"2023-12-08T08:21:16.649143+0000","last_became_active":"2023-12-08T08:21:05.531965+0000","last_became_peered":"2023-12-08T08:21:05.531965+0000","last_unstale":"2023-12-08T08:21:16.649143+0000","last_undegraded":"2023-12-08T08:21:16.649143+0000","last_fullsized":"2023-12-08T08:21:16.649143+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:23.756612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.660842+0000","last_change":"2023-12-08T08:21:17.660842+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.660842+0000","last_undegraded":"2023-12-08T08:21:17.660842+0000","last_fullsized":"2023-12-08T08:21:17.660842+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654313+0000","last_change":"2023-12-08T08:21:04.780684+0000","last_active":"2023-12-08T08:21:16.654313+0000","last_peered":"2023-12-08T08:21:16.654313+0000","last_clean":"2023-12-08T08:21:16.654313+0000","last_became_active":"2023-12-08T08:21:04.780321+0000","last_became_peered":"2023-12-08T08:21:04.780321+0000","last_unstale":"2023-12-08T08:21:16.654313+0000","last_undegraded":"2023-12-08T08:21:16.654313+0000","last_fullsized":"2023-12-08T08:21:16.654313+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:13.006406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652155+0000","last_change":"2023-12-08T08:21:05.531374+0000","last_active":"2023-12-08T08:21:16.652155+0000","last_peered":"2023-12-08T08:21:16.652155+0000","last_clean":"2023-12-08T08:21:16.652155+0000","last_became_active":"2023-12-08T08:21:05.531104+0000","last_became_peered":"2023-12-08T08:21:05.531104+0000","last_unstale":"2023-12-08T08:21:16.652155+0000","last_undegraded":"2023-12-08T08:21:16.652155+0000","last_fullsized":"2023-12-08T08:21:16.652155+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:04.403116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.686260+0000","last_change":"2023-12-08T08:21:17.684363+0000","last_active":"2023-12-08T08:21:17.686260+0000","last_peered":"2023-12-08T08:21:17.686260+0000","last_clean":"2023-12-08T08:21:17.686260+0000","last_became_active":"2023-12-08T08:21:17.683896+0000","last_became_peered":"2023-12-08T08:21:17.683896+0000","last_unstale":"2023-12-08T08:21:17.686260+0000","last_undegraded":"2023-12-08T08:21:17.686260+0000","last_fullsized":"2023-12-08T08:21:17.686260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:31:02.865086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.663742+0000","last_change":"2023-12-08T08:21:17.663742+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.663742+0000","last_undegraded":"2023-12-08T08:21:17.663742+0000","last_fullsized":"2023-12-08T08:21:17.663742+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652248+0000","last_change":"2023-12-08T08:21:04.777030+0000","last_active":"2023-12-08T08:21:16.652248+0000","last_peered":"2023-12-08T08:21:16.652248+0000","last_clean":"2023-12-08T08:21:16.652248+0000","last_became_active":"2023-12-08T08:21:04.775911+0000","last_became_peered":"2023-12-08T08:21:04.775911+0000","last_unstale":"2023-12-08T08:21:16.652248+0000","last_undegraded":"2023-12-08T08:21:16.652248+0000","last_fullsized":"2023-12-08T08:21:16.652248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:29.810210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654250+0000","last_change":"2023-12-08T08:21:05.532180+0000","last_active":"2023-12-08T08:21:16.654250+0000","last_peered":"2023-12-08T08:21:16.654250+0000","last_clean":"2023-12-08T08:21:16.654250+0000","last_became_active":"2023-12-08T08:21:05.529640+0000","last_became_peered":"2023-12-08T08:21:05.529640+0000","last_unstale":"2023-12-08T08:21:16.654250+0000","last_undegraded":"2023-12-08T08:21:16.654250+0000","last_fullsized":"2023-12-08T08:21:16.654250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:11.477913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-08T08:21:17.685108+0000","last_change":"2023-12-08T08:21:17.680905+0000","last_active":"2023-12-08T08:21:17.685108+0000","last_peered":"2023-12-08T08:21:17.685108+0000","last_clean":"2023-12-08T08:21:17.685108+0000","last_became_active":"2023-12-08T08:21:17.680651+0000","last_became_peered":"2023-12-08T08:21:17.680651+0000","last_unstale":"2023-12-08T08:21:17.685108+0000","last_undegraded":"2023-12-08T08:21:17.685108+0000","last_fullsized":"2023-12-08T08:21:17.685108+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:15.257930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.656547+0000","last_change":"2023-12-08T08:21:17.656547+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.656547+0000","last_undegraded":"2023-12-08T08:21:17.656547+0000","last_fullsized":"2023-12-08T08:21:17.656547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.653722+0000","last_change":"2023-12-08T08:21:05.539808+0000","last_active":"2023-12-08T08:21:16.653722+0000","last_peered":"2023-12-08T08:21:16.653722+0000","last_clean":"2023-12-08T08:21:16.653722+0000","last_became_active":"2023-12-08T08:21:05.539443+0000","last_became_peered":"2023-12-08T08:21:05.539443+0000","last_unstale":"2023-12-08T08:21:16.653722+0000","last_undegraded":"2023-12-08T08:21:16.653722+0000","last_fullsized":"2023-12-08T08:21:16.653722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:20:39.875619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661094+0000","last_change":"2023-12-08T08:21:17.661094+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661094+0000","last_undegraded":"2023-12-08T08:21:17.661094+0000","last_fullsized":"2023-12-08T08:21:17.661094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.650483+0000","last_change":"2023-12-08T08:21:05.532086+0000","last_active":"2023-12-08T08:21:16.650483+0000","last_peered":"2023-12-08T08:21:16.650483+0000","last_clean":"2023-12-08T08:21:16.650483+0000","last_became_active":"2023-12-08T08:21:05.531583+0000","last_became_peered":"2023-12-08T08:21:05.531583+0000","last_unstale":"2023-12-08T08:21:16.650483+0000","last_undegraded":"2023-12-08T08:21:16.650483+0000","last_fullsized":"2023-12-08T08:21:16.650483+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:13.936073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.658349+0000","last_change":"2023-12-08T08:21:17.658349+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.658349+0000","last_undegraded":"2023-12-08T08:21:17.658349+0000","last_fullsized":"2023-12-08T08:21:17.658349+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654484+0000","last_change":"2023-12-08T08:21:05.530432+0000","last_active":"2023-12-08T08:21:16.654484+0000","last_peered":"2023-12-08T08:21:16.654484+0000","last_clean":"2023-12-08T08:21:16.654484+0000","last_became_active":"2023-12-08T08:21:05.530065+0000","last_became_peered":"2023-12-08T08:21:05.530065+0000","last_unstale":"2023-12-08T08:21:16.654484+0000","last_undegraded":"2023-12-08T08:21:16.654484+0000","last_fullsized":"2023-12-08T08:21:16.654484+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:43.021591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.667972+0000","last_change":"2023-12-08T08:21:17.667972+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.667972+0000","last_undegraded":"2023-12-08T08:21:17.667972+0000","last_fullsized":"2023-12-08T08:21:17.667972+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648680+0000","last_change":"2023-12-08T08:21:05.531803+0000","last_active":"2023-12-08T08:21:16.648680+0000","last_peered":"2023-12-08T08:21:16.648680+0000","last_clean":"2023-12-08T08:21:16.648680+0000","last_became_active":"2023-12-08T08:21:05.531470+0000","last_became_peered":"2023-12-08T08:21:05.531470+0000","last_unstale":"2023-12-08T08:21:16.648680+0000","last_undegraded":"2023-12-08T08:21:16.648680+0000","last_fullsized":"2023-12-08T08:21:16.648680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:37.538055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659142+0000","last_change":"2023-12-08T08:21:17.659142+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659142+0000","last_undegraded":"2023-12-08T08:21:17.659142+0000","last_fullsized":"2023-12-08T08:21:17.659142+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655770+0000","last_change":"2023-12-08T08:21:05.538326+0000","last_active":"2023-12-08T08:21:16.655770+0000","last_peered":"2023-12-08T08:21:16.655770+0000","last_clean":"2023-12-08T08:21:16.655770+0000","last_became_active":"2023-12-08T08:21:05.538042+0000","last_became_peered":"2023-12-08T08:21:05.538042+0000","last_unstale":"2023-12-08T08:21:16.655770+0000","last_undegraded":"2023-12-08T08:21:16.655770+0000","last_fullsized":"2023-12-08T08:21:16.655770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:30.973295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.663984+0000","last_change":"2023-12-08T08:21:17.663984+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.663984+0000","last_undegraded":"2023-12-08T08:21:17.663984+0000","last_fullsized":"2023-12-08T08:21:17.663984+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652267+0000","last_change":"2023-12-08T08:21:05.538170+0000","last_active":"2023-12-08T08:21:16.652267+0000","last_peered":"2023-12-08T08:21:16.652267+0000","last_clean":"2023-12-08T08:21:16.652267+0000","last_became_active":"2023-12-08T08:21:05.537834+0000","last_became_peered":"2023-12-08T08:21:05.537834+0000","last_unstale":"2023-12-08T08:21:16.652267+0000","last_undegraded":"2023-12-08T08:21:16.652267+0000","last_fullsized":"2023-12-08T08:21:16.652267+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:23.756612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.664256+0000","last_change":"2023-12-08T08:21:17.664256+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.664256+0000","last_undegraded":"2023-12-08T08:21:17.664256+0000","last_fullsized":"2023-12-08T08:21:17.664256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644283+0000","last_change":"2023-12-08T08:21:05.532516+0000","last_active":"2023-12-08T08:21:16.644283+0000","last_peered":"2023-12-08T08:21:16.644283+0000","last_clean":"2023-12-08T08:21:16.644283+0000","last_became_active":"2023-12-08T08:21:05.531827+0000","last_became_peered":"2023-12-08T08:21:05.531827+0000","last_unstale":"2023-12-08T08:21:16.644283+0000","last_undegraded":"2023-12-08T08:21:16.644283+0000","last_fullsized":"2023-12-08T08:21:16.644283+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:49:59.047557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.655852+0000","last_change":"2023-12-08T08:21:17.655852+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.655852+0000","last_undegraded":"2023-12-08T08:21:17.655852+0000","last_fullsized":"2023-12-08T08:21:17.655852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651828+0000","last_change":"2023-12-08T08:21:05.531201+0000","last_active":"2023-12-08T08:21:16.651828+0000","last_peered":"2023-12-08T08:21:16.651828+0000","last_clean":"2023-12-08T08:21:16.651828+0000","last_became_active":"2023-12-08T08:21:05.530935+0000","last_became_peered":"2023-12-08T08:21:05.530935+0000","last_unstale":"2023-12-08T08:21:16.651828+0000","last_undegraded":"2023-12-08T08:21:16.651828+0000","last_fullsized":"2023-12-08T08:21:16.651828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:37.538055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659185+0000","last_change":"2023-12-08T08:21:17.659185+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659185+0000","last_undegraded":"2023-12-08T08:21:17.659185+0000","last_fullsized":"2023-12-08T08:21:17.659185+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655029+0000","last_change":"2023-12-08T08:21:05.535454+0000","last_active":"2023-12-08T08:21:16.655029+0000","last_peered":"2023-12-08T08:21:16.655029+0000","last_clean":"2023-12-08T08:21:16.655029+0000","last_became_active":"2023-12-08T08:21:05.535095+0000","last_became_peered":"2023-12-08T08:21:05.535095+0000","last_unstale":"2023-12-08T08:21:16.655029+0000","last_undegraded":"2023-12-08T08:21:16.655029+0000","last_fullsized":"2023-12-08T08:21:16.655029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:50:53.654615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.663922+0000","last_change":"2023-12-08T08:21:17.663922+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.663922+0000","last_undegraded":"2023-12-08T08:21:17.663922+0000","last_fullsized":"2023-12-08T08:21:17.663922+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.653808+0000","last_change":"2023-12-08T08:21:05.534953+0000","last_active":"2023-12-08T08:21:16.653808+0000","last_peered":"2023-12-08T08:21:16.653808+0000","last_clean":"2023-12-08T08:21:16.653808+0000","last_became_active":"2023-12-08T08:21:05.531291+0000","last_became_peered":"2023-12-08T08:21:05.531291+0000","last_unstale":"2023-12-08T08:21:16.653808+0000","last_undegraded":"2023-12-08T08:21:16.653808+0000","last_fullsized":"2023-12-08T08:21:16.653808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:47.419331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661714+0000","last_change":"2023-12-08T08:21:17.661714+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661714+0000","last_undegraded":"2023-12-08T08:21:17.661714+0000","last_fullsized":"2023-12-08T08:21:17.661714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649166+0000","last_change":"2023-12-08T08:21:05.529673+0000","last_active":"2023-12-08T08:21:16.649166+0000","last_peered":"2023-12-08T08:21:16.649166+0000","last_clean":"2023-12-08T08:21:16.649166+0000","last_became_active":"2023-12-08T08:21:05.528239+0000","last_became_peered":"2023-12-08T08:21:05.528239+0000","last_unstale":"2023-12-08T08:21:16.649166+0000","last_undegraded":"2023-12-08T08:21:16.649166+0000","last_fullsized":"2023-12-08T08:21:16.649166+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:19.928543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.660989+0000","last_change":"2023-12-08T08:21:17.660989+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.660989+0000","last_undegraded":"2023-12-08T08:21:17.660989+0000","last_fullsized":"2023-12-08T08:21:17.660989+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.648574+0000","last_change":"2023-12-08T08:21:05.523783+0000","last_active":"2023-12-08T08:21:16.648574+0000","last_peered":"2023-12-08T08:21:16.648574+0000","last_clean":"2023-12-08T08:21:16.648574+0000","last_became_active":"2023-12-08T08:21:05.523509+0000","last_became_peered":"2023-12-08T08:21:05.523509+0000","last_unstale":"2023-12-08T08:21:16.648574+0000","last_undegraded":"2023-12-08T08:21:16.648574+0000","last_fullsized":"2023-12-08T08:21:16.648574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:11.477913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.657354+0000","last_change":"2023-12-08T08:21:17.657354+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.657354+0000","last_undegraded":"2023-12-08T08:21:17.657354+0000","last_fullsized":"2023-12-08T08:21:17.657354+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.650201+0000","last_change":"2023-12-08T08:21:05.538014+0000","last_active":"2023-12-08T08:21:16.650201+0000","last_peered":"2023-12-08T08:21:16.650201+0000","last_clean":"2023-12-08T08:21:16.650201+0000","last_became_active":"2023-12-08T08:21:05.537721+0000","last_became_peered":"2023-12-08T08:21:05.537721+0000","last_unstale":"2023-12-08T08:21:16.650201+0000","last_undegraded":"2023-12-08T08:21:16.650201+0000","last_fullsized":"2023-12-08T08:21:16.650201+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:30.813093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.655768+0000","last_change":"2023-12-08T08:21:17.655768+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.655768+0000","last_undegraded":"2023-12-08T08:21:17.655768+0000","last_fullsized":"2023-12-08T08:21:17.655768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644042+0000","last_change":"2023-12-08T08:21:05.525566+0000","last_active":"2023-12-08T08:21:16.644042+0000","last_peered":"2023-12-08T08:21:16.644042+0000","last_clean":"2023-12-08T08:21:16.644042+0000","last_became_active":"2023-12-08T08:21:05.525251+0000","last_became_peered":"2023-12-08T08:21:05.525251+0000","last_unstale":"2023-12-08T08:21:16.644042+0000","last_undegraded":"2023-12-08T08:21:16.644042+0000","last_fullsized":"2023-12-08T08:21:16.644042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:09:56.356105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.657863+0000","last_change":"2023-12-08T08:21:17.657863+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.657863+0000","last_undegraded":"2023-12-08T08:21:17.657863+0000","last_fullsized":"2023-12-08T08:21:17.657863+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644225+0000","last_change":"2023-12-08T08:21:05.530770+0000","last_active":"2023-12-08T08:21:16.644225+0000","last_peered":"2023-12-08T08:21:16.644225+0000","last_clean":"2023-12-08T08:21:16.644225+0000","last_became_active":"2023-12-08T08:21:05.530517+0000","last_became_peered":"2023-12-08T08:21:05.530517+0000","last_unstale":"2023-12-08T08:21:16.644225+0000","last_undegraded":"2023-12-08T08:21:16.644225+0000","last_fullsized":"2023-12-08T08:21:16.644225+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:05.968004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661813+0000","last_change":"2023-12-08T08:21:17.661813+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661813+0000","last_undegraded":"2023-12-08T08:21:17.661813+0000","last_fullsized":"2023-12-08T08:21:17.661813+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654550+0000","last_change":"2023-12-08T08:21:05.532053+0000","last_active":"2023-12-08T08:21:16.654550+0000","last_peered":"2023-12-08T08:21:16.654550+0000","last_clean":"2023-12-08T08:21:16.654550+0000","last_became_active":"2023-12-08T08:21:05.531799+0000","last_became_peered":"2023-12-08T08:21:05.531799+0000","last_unstale":"2023-12-08T08:21:16.654550+0000","last_undegraded":"2023-12-08T08:21:16.654550+0000","last_fullsized":"2023-12-08T08:21:16.654550+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:05.968004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659709+0000","last_change":"2023-12-08T08:21:17.659709+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659709+0000","last_undegraded":"2023-12-08T08:21:17.659709+0000","last_fullsized":"2023-12-08T08:21:17.659709+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654066+0000","last_change":"2023-12-08T08:21:05.535656+0000","last_active":"2023-12-08T08:21:16.654066+0000","last_peered":"2023-12-08T08:21:16.654066+0000","last_clean":"2023-12-08T08:21:16.654066+0000","last_became_active":"2023-12-08T08:21:05.535310+0000","last_became_peered":"2023-12-08T08:21:05.535310+0000","last_unstale":"2023-12-08T08:21:16.654066+0000","last_undegraded":"2023-12-08T08:21:16.654066+0000","last_fullsized":"2023-12-08T08:21:16.654066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:09:56.356105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.657854+0000","last_change":"2023-12-08T08:21:17.657854+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.657854+0000","last_undegraded":"2023-12-08T08:21:17.657854+0000","last_fullsized":"2023-12-08T08:21:17.657854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655138+0000","last_change":"2023-12-08T08:21:05.529395+0000","last_active":"2023-12-08T08:21:16.655138+0000","last_peered":"2023-12-08T08:21:16.655138+0000","last_clean":"2023-12-08T08:21:16.655138+0000","last_became_active":"2023-12-08T08:21:05.529089+0000","last_became_peered":"2023-12-08T08:21:05.529089+0000","last_unstale":"2023-12-08T08:21:16.655138+0000","last_undegraded":"2023-12-08T08:21:16.655138+0000","last_fullsized":"2023-12-08T08:21:16.655138+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:43.021591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.661007+0000","last_change":"2023-12-08T08:21:17.661007+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.661007+0000","last_undegraded":"2023-12-08T08:21:17.661007+0000","last_fullsized":"2023-12-08T08:21:17.661007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643962+0000","last_change":"2023-12-08T08:21:05.527949+0000","last_active":"2023-12-08T08:21:16.643962+0000","last_peered":"2023-12-08T08:21:16.643962+0000","last_clean":"2023-12-08T08:21:16.643962+0000","last_became_active":"2023-12-08T08:21:05.527215+0000","last_became_peered":"2023-12-08T08:21:05.527215+0000","last_unstale":"2023-12-08T08:21:16.643962+0000","last_undegraded":"2023-12-08T08:21:16.643962+0000","last_fullsized":"2023-12-08T08:21:16.643962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:25.239396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.671345+0000","last_change":"2023-12-08T08:21:17.671345+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.671345+0000","last_undegraded":"2023-12-08T08:21:17.671345+0000","last_fullsized":"2023-12-08T08:21:17.671345+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649424+0000","last_change":"2023-12-08T08:21:05.530318+0000","last_active":"2023-12-08T08:21:16.649424+0000","last_peered":"2023-12-08T08:21:16.649424+0000","last_clean":"2023-12-08T08:21:16.649424+0000","last_became_active":"2023-12-08T08:21:05.529990+0000","last_became_peered":"2023-12-08T08:21:05.529990+0000","last_unstale":"2023-12-08T08:21:16.649424+0000","last_undegraded":"2023-12-08T08:21:16.649424+0000","last_fullsized":"2023-12-08T08:21:16.649424+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:54:39.738546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.660112+0000","last_change":"2023-12-08T08:21:17.660112+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.660112+0000","last_undegraded":"2023-12-08T08:21:17.660112+0000","last_fullsized":"2023-12-08T08:21:17.660112+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.655723+0000","last_change":"2023-12-08T08:21:05.540446+0000","last_active":"2023-12-08T08:21:16.655723+0000","last_peered":"2023-12-08T08:21:16.655723+0000","last_clean":"2023-12-08T08:21:16.655723+0000","last_became_active":"2023-12-08T08:21:05.540024+0000","last_became_peered":"2023-12-08T08:21:05.540024+0000","last_unstale":"2023-12-08T08:21:16.655723+0000","last_undegraded":"2023-12-08T08:21:16.655723+0000","last_fullsized":"2023-12-08T08:21:16.655723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:59:00.606587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.660303+0000","last_change":"2023-12-08T08:21:17.660303+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.660303+0000","last_undegraded":"2023-12-08T08:21:17.660303+0000","last_fullsized":"2023-12-08T08:21:17.660303+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654222+0000","last_change":"2023-12-08T08:21:05.536252+0000","last_active":"2023-12-08T08:21:16.654222+0000","last_peered":"2023-12-08T08:21:16.654222+0000","last_clean":"2023-12-08T08:21:16.654222+0000","last_became_active":"2023-12-08T08:21:05.535964+0000","last_became_peered":"2023-12-08T08:21:05.535964+0000","last_unstale":"2023-12-08T08:21:16.654222+0000","last_undegraded":"2023-12-08T08:21:16.654222+0000","last_fullsized":"2023-12-08T08:21:16.654222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:30.973295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.664875+0000","last_change":"2023-12-08T08:21:17.664875+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.664875+0000","last_undegraded":"2023-12-08T08:21:17.664875+0000","last_fullsized":"2023-12-08T08:21:17.664875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651605+0000","last_change":"2023-12-08T08:21:05.533444+0000","last_active":"2023-12-08T08:21:16.651605+0000","last_peered":"2023-12-08T08:21:16.651605+0000","last_clean":"2023-12-08T08:21:16.651605+0000","last_became_active":"2023-12-08T08:21:05.533146+0000","last_became_peered":"2023-12-08T08:21:05.533146+0000","last_unstale":"2023-12-08T08:21:16.651605+0000","last_undegraded":"2023-12-08T08:21:16.651605+0000","last_fullsized":"2023-12-08T08:21:16.651605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:14:18.284764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659761+0000","last_change":"2023-12-08T08:21:17.659761+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659761+0000","last_undegraded":"2023-12-08T08:21:17.659761+0000","last_fullsized":"2023-12-08T08:21:17.659761+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649422+0000","last_change":"2023-12-08T08:21:05.525741+0000","last_active":"2023-12-08T08:21:16.649422+0000","last_peered":"2023-12-08T08:21:16.649422+0000","last_clean":"2023-12-08T08:21:16.649422+0000","last_became_active":"2023-12-08T08:21:05.525406+0000","last_became_peered":"2023-12-08T08:21:05.525406+0000","last_unstale":"2023-12-08T08:21:16.649422+0000","last_undegraded":"2023-12-08T08:21:16.649422+0000","last_fullsized":"2023-12-08T08:21:16.649422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:08.596525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.673727+0000","last_change":"2023-12-08T08:21:17.673727+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.673727+0000","last_undegraded":"2023-12-08T08:21:17.673727+0000","last_fullsized":"2023-12-08T08:21:17.673727+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.653633+0000","last_change":"2023-12-08T08:21:05.537523+0000","last_active":"2023-12-08T08:21:16.653633+0000","last_peered":"2023-12-08T08:21:16.653633+0000","last_clean":"2023-12-08T08:21:16.653633+0000","last_became_active":"2023-12-08T08:21:05.537263+0000","last_became_peered":"2023-12-08T08:21:05.537263+0000","last_unstale":"2023-12-08T08:21:16.653633+0000","last_undegraded":"2023-12-08T08:21:16.653633+0000","last_fullsized":"2023-12-08T08:21:16.653633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:08.596525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.668335+0000","last_change":"2023-12-08T08:21:17.668335+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.668335+0000","last_undegraded":"2023-12-08T08:21:17.668335+0000","last_fullsized":"2023-12-08T08:21:17.668335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.654426+0000","last_change":"2023-12-08T08:21:05.534310+0000","last_active":"2023-12-08T08:21:16.654426+0000","last_peered":"2023-12-08T08:21:16.654426+0000","last_clean":"2023-12-08T08:21:16.654426+0000","last_became_active":"2023-12-08T08:21:05.534003+0000","last_became_peered":"2023-12-08T08:21:05.534003+0000","last_unstale":"2023-12-08T08:21:16.654426+0000","last_undegraded":"2023-12-08T08:21:16.654426+0000","last_fullsized":"2023-12-08T08:21:16.654426+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:49.782105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.659794+0000","last_change":"2023-12-08T08:21:17.659794+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.659794+0000","last_undegraded":"2023-12-08T08:21:17.659794+0000","last_fullsized":"2023-12-08T08:21:17.659794+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.643900+0000","last_change":"2023-12-08T08:21:05.543535+0000","last_active":"2023-12-08T08:21:16.643900+0000","last_peered":"2023-12-08T08:21:16.643900+0000","last_clean":"2023-12-08T08:21:16.643900+0000","last_became_active":"2023-12-08T08:21:05.543244+0000","last_became_peered":"2023-12-08T08:21:05.543244+0000","last_unstale":"2023-12-08T08:21:16.643900+0000","last_undegraded":"2023-12-08T08:21:16.643900+0000","last_fullsized":"2023-12-08T08:21:16.643900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:20:39.875619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.662257+0000","last_change":"2023-12-08T08:21:17.662257+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.662257+0000","last_undegraded":"2023-12-08T08:21:17.662257+0000","last_fullsized":"2023-12-08T08:21:17.662257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.649277+0000","last_change":"2023-12-08T08:21:05.532561+0000","last_active":"2023-12-08T08:21:16.649277+0000","last_peered":"2023-12-08T08:21:16.649277+0000","last_clean":"2023-12-08T08:21:16.649277+0000","last_became_active":"2023-12-08T08:21:05.532254+0000","last_became_peered":"2023-12-08T08:21:05.532254+0000","last_unstale":"2023-12-08T08:21:16.649277+0000","last_undegraded":"2023-12-08T08:21:16.649277+0000","last_fullsized":"2023-12-08T08:21:16.649277+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:30:51.157799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.668437+0000","last_change":"2023-12-08T08:21:17.668437+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.668437+0000","last_undegraded":"2023-12-08T08:21:17.668437+0000","last_fullsized":"2023-12-08T08:21:17.668437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.651087+0000","last_change":"2023-12-08T08:21:05.528111+0000","last_active":"2023-12-08T08:21:16.651087+0000","last_peered":"2023-12-08T08:21:16.651087+0000","last_clean":"2023-12-08T08:21:16.651087+0000","last_became_active":"2023-12-08T08:21:05.527809+0000","last_became_peered":"2023-12-08T08:21:05.527809+0000","last_unstale":"2023-12-08T08:21:16.651087+0000","last_undegraded":"2023-12-08T08:21:16.651087+0000","last_fullsized":"2023-12-08T08:21:16.651087+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:51.183842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.662012+0000","last_change":"2023-12-08T08:21:17.662012+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.662012+0000","last_undegraded":"2023-12-08T08:21:17.662012+0000","last_fullsized":"2023-12-08T08:21:17.662012+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.656056+0000","last_change":"2023-12-08T08:21:05.534658+0000","last_active":"2023-12-08T08:21:16.656056+0000","last_peered":"2023-12-08T08:21:16.656056+0000","last_clean":"2023-12-08T08:21:16.656056+0000","last_became_active":"2023-12-08T08:21:05.534383+0000","last_became_peered":"2023-12-08T08:21:05.534383+0000","last_unstale":"2023-12-08T08:21:16.656056+0000","last_undegraded":"2023-12-08T08:21:16.656056+0000","last_fullsized":"2023-12-08T08:21:16.656056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.368162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.660063+0000","last_change":"2023-12-08T08:21:17.660063+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.660063+0000","last_undegraded":"2023-12-08T08:21:17.660063+0000","last_fullsized":"2023-12-08T08:21:17.660063+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.644195+0000","last_change":"2023-12-08T08:21:05.527659+0000","last_active":"2023-12-08T08:21:16.644195+0000","last_peered":"2023-12-08T08:21:16.644195+0000","last_clean":"2023-12-08T08:21:16.644195+0000","last_became_active":"2023-12-08T08:21:05.527361+0000","last_became_peered":"2023-12-08T08:21:05.527361+0000","last_unstale":"2023-12-08T08:21:16.644195+0000","last_undegraded":"2023-12-08T08:21:16.644195+0000","last_fullsized":"2023-12-08T08:21:16.644195+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:49.782105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-12-08T08:21:17.655156+0000","last_change":"2023-12-08T08:21:17.655156+0000","last_active":"2023-12-08T08:21:17.641609+0000","last_peered":"2023-12-08T08:21:17.641609+0000","last_clean":"2023-12-08T08:21:17.641609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:21:17.655156+0000","last_undegraded":"2023-12-08T08:21:17.655156+0000","last_fullsized":"2023-12-08T08:21:17.655156+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-08T08:21:16.652062+0000","last_change":"2023-12-08T08:21:05.540661+0000","last_active":"2023-12-08T08:21:16.652062+0000","last_peered":"2023-12-08T08:21:16.652062+0000","last_clean":"2023-12-08T08:21:16.652062+0000","last_became_active":"2023-12-08T08:21:05.539125+0000","last_became_peered":"2023-12-08T08:21:05.539125+0000","last_unstale":"2023-12-08T08:21:16.652062+0000","last_undegraded":"2023-12-08T08:21:16.652062+0000","last_fullsized":"2023-12-08T08:21:16.652062+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:58:23.887952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":731231,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.63100000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.72799999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.81699999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.71099999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.68700000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":141389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.74399999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.84899999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.72699999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.77900000000000003}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.80400000000000005}]},{"osd":5,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.82799999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.70599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":141445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.65200000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.75}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.81200000000000006}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.77000000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.78600000000000003}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.876}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.753}]},{"osd":1,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.64300000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.86799999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.81899999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.71199999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.90500000000000003}]},{"osd":7,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.73299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":151024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.443},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.46600000000000003}]},{"osd":1,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.50800000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.62},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.69399999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68200000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.71299999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.73699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":140843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.0270000000000001,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.34000000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.37},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.42199999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.55800000000000005}]},{"osd":5,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":3.637,"5min":3.637,"15min":3.637},"last":0.49399999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.54500000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.67500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":143902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2210000000000001,"5min":5.2210000000000001,"15min":5.2210000000000001},"last":0.374},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":8.3200000000000003,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.439}]},{"osd":2,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":8.2070000000000007,"5min":8.2070000000000007,"15min":8.2070000000000007},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":4.351,"5min":4.351,"15min":4.351},"last":0.42199999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":8.1479999999999997,"5min":8.1479999999999997,"15min":8.1479999999999997},"last":0.495},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.3150000000000004,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.47499999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":4.8470000000000004,"5min":4.8470000000000004,"15min":4.8470000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":4.7939999999999996,"5min":4.7939999999999996,"15min":4.7939999999999996},"last":0.71399999999999997}]},{"osd":5,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":4.7240000000000002,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":4.5830000000000002,"5min":4.5830000000000002,"15min":4.5830000000000002},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":4.7699999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.624},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":4.6289999999999996,"5min":4.6289999999999996,"15min":4.6289999999999996},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":4.665,"5min":4.665,"15min":4.665},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":4.8140000000000001,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.75800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":731141,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":8.2799999999999994,"5min":8.2799999999999994,"15min":8.2799999999999994},"last":0.46800000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":7.9290000000000003,"5min":7.9290000000000003,"15min":7.9290000000000003},"last":0.33900000000000002},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":8.0890000000000004,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.51500000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":4.6550000000000002,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.439},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":7.8890000000000002,"5min":7.8890000000000002,"15min":7.8890000000000002},"last":0.38}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":7.9649999999999999,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":8.0579999999999998,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.68300000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":7.835,"5min":7.835,"15min":7.835},"last":0.65900000000000003}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":8.0239999999999991,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.58799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:21:27.285 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:21:27.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.431+0000 7f88f2459640 1 Processor -- start 2023-12-08T08:21:27.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.431+0000 7f88f2459640 1 -- start start 2023-12-08T08:21:27.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.431+0000 7f88f2459640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f88ec151b90 0x7f88ec0c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:27.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.431+0000 7f88f2459640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88ec06c670 0x7f88ec0c6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:27.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.431+0000 7f88f2459640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f88ec0c6b50 0x7f88ec06b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:27.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.431+0000 7f88f2459640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88ec0c5800 con 0x7f88ec151b90 2023-12-08T08:21:27.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.431+0000 7f88f2459640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88ec0c8400 con 0x7f88ec0c6b50 2023-12-08T08:21:27.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.431+0000 7f88f2459640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec155390 con 0x7f88ec06c670 2023-12-08T08:21:27.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.431+0000 7f88f1457640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f88ec151b90 0x7f88ec0c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:27.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.431+0000 7f88f1457640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f88ec151b90 0x7f88ec0c7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33812/0 (socket says 172.21.15.88:33812) 2023-12-08T08:21:27.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.431+0000 7f88f1457640 1 -- 172.21.15.88:0/3257874957 learned_addr learned my addr 172.21.15.88:0/3257874957 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:27.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.431+0000 7f88f1c58640 1 --2- 172.21.15.88:0/3257874957 >> v2:172.21.15.148:3300/0 conn(0x7f88ec0c6b50 0x7f88ec06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:27.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.431+0000 7f88f0c56640 1 --2- 172.21.15.88:0/3257874957 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88ec06c670 0x7f88ec0c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:27.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.431+0000 7f88f1457640 1 -- 172.21.15.88:0/3257874957 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88ec06c670 msgr2=0x7f88ec0c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:27.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.431+0000 7f88f1457640 1 --2- 172.21.15.88:0/3257874957 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88ec06c670 0x7f88ec0c6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.431+0000 7f88f1457640 1 -- 172.21.15.88:0/3257874957 >> v2:172.21.15.148:3300/0 conn(0x7f88ec0c6b50 msgr2=0x7f88ec06b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:27.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.431+0000 7f88f1457640 1 --2- 172.21.15.88:0/3257874957 >> v2:172.21.15.148:3300/0 conn(0x7f88ec0c6b50 0x7f88ec06b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.431+0000 7f88f1457640 1 -- 172.21.15.88:0/3257874957 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ec154780 con 0x7f88ec151b90 2023-12-08T08:21:27.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.435+0000 7f88f1457640 1 --2- 172.21.15.88:0/3257874957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88ec151b90 0x7f88ec0c7ec0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0c0d20 tx=0x7f88e801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8162f0f007e6c5a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:27.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.435+0000 7f88e3fff640 1 -- 172.21.15.88:0/3257874957 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec06c160 con 0x7f88ec151b90 2023-12-08T08:21:27.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.435+0000 7f88e3fff640 1 -- 172.21.15.88:0/3257874957 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e80ab600 con 0x7f88ec151b90 2023-12-08T08:21:27.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.435+0000 7f88e3fff640 1 -- 172.21.15.88:0/3257874957 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e80ab990 con 0x7f88ec151b90 2023-12-08T08:21:27.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.435+0000 7f88f2459640 1 -- 172.21.15.88:0/3257874957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88ec151b90 msgr2=0x7f88ec0c7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:27.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.435+0000 7f88f2459640 1 --2- 172.21.15.88:0/3257874957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88ec151b90 0x7f88ec0c7ec0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0c0d20 tx=0x7f88e801c440 comp rx=0 tx=0).stop 2023-12-08T08:21:27.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.435+0000 7f88f2459640 1 -- 172.21.15.88:0/3257874957 shutdown_connections 2023-12-08T08:21:27.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.435+0000 7f88f2459640 1 --2- 172.21.15.88:0/3257874957 >> v2:172.21.15.148:3300/0 conn(0x7f88ec0c6b50 0x7f88ec06b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.435+0000 7f88f2459640 1 --2- 172.21.15.88:0/3257874957 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88ec06c670 0x7f88ec0c6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.435+0000 7f88f2459640 1 --2- 172.21.15.88:0/3257874957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88ec151b90 0x7f88ec0c7ec0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.435+0000 7f88f2459640 1 -- 172.21.15.88:0/3257874957 >> 172.21.15.88:0/3257874957 conn(0x7f88ec0aba00 msgr2=0x7f88ec0abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:27.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.435+0000 7f88f2459640 1 -- 172.21.15.88:0/3257874957 shutdown_connections 2023-12-08T08:21:27.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.435+0000 7f88f2459640 1 -- 172.21.15.88:0/3257874957 wait complete. 2023-12-08T08:21:27.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.435+0000 7f88f2459640 1 Processor -- start 2023-12-08T08:21:27.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.439+0000 7f88f2459640 1 -- start start 2023-12-08T08:21:27.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.439+0000 7f88f2459640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88ec06c670 0x7f88ec1f0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:27.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.439+0000 7f88f2459640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88ec0c6b50 0x7f88ec153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:27.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.439+0000 7f88f2459640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88ec151b90 0x7f88ec0c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:27.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.439+0000 7f88f2459640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec0c3da0 con 0x7f88ec0c6b50 2023-12-08T08:21:27.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.439+0000 7f88f2459640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec0c1920 con 0x7f88ec151b90 2023-12-08T08:21:27.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.439+0000 7f88f2459640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec0c1c00 con 0x7f88ec06c670 2023-12-08T08:21:27.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.439+0000 7f88f0c56640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88ec0c6b50 0x7f88ec153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:27.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.439+0000 7f88f0c56640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88ec0c6b50 0x7f88ec153680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33822/0 (socket says 172.21.15.88:33822) 2023-12-08T08:21:27.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.439+0000 7f88f0c56640 1 -- 172.21.15.88:0/2718451814 learned_addr learned my addr 172.21.15.88:0/2718451814 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:27.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.439+0000 7f88f0c56640 1 -- 172.21.15.88:0/2718451814 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88ec06c670 msgr2=0x7f88ec1f0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:27.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.439+0000 7f88f1457640 1 --2- 172.21.15.88:0/2718451814 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88ec06c670 0x7f88ec1f0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:27.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.439+0000 7f88f0c56640 1 --2- 172.21.15.88:0/2718451814 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88ec06c670 0x7f88ec1f0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.439+0000 7f88f0c56640 1 -- 172.21.15.88:0/2718451814 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88ec151b90 msgr2=0x7f88ec0c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:27.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.439+0000 7f88f0c56640 1 --2- 172.21.15.88:0/2718451814 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88ec151b90 0x7f88ec0c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.439+0000 7f88f0c56640 1 -- 172.21.15.88:0/2718451814 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e80094d0 con 0x7f88ec0c6b50 2023-12-08T08:21:27.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.439+0000 7f88f0c56640 1 --2- 172.21.15.88:0/2718451814 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88ec0c6b50 0x7f88ec153680 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f88dc00d800 tx=0x7f88dc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:27.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.439+0000 7f88e1ffb640 1 -- 172.21.15.88:0/2718451814 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc00b6c0 con 0x7f88ec0c6b50 2023-12-08T08:21:27.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.439+0000 7f88e1ffb640 1 -- 172.21.15.88:0/2718451814 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88dc00b820 con 0x7f88ec0c6b50 2023-12-08T08:21:27.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.439+0000 7f88f2459640 1 -- 172.21.15.88:0/2718451814 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88ec1eff60 con 0x7f88ec0c6b50 2023-12-08T08:21:27.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.439+0000 7f88e1ffb640 1 -- 172.21.15.88:0/2718451814 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc00bb90 con 0x7f88ec0c6b50 2023-12-08T08:21:27.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.439+0000 7f88f2459640 1 -- 172.21.15.88:0/2718451814 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88ec1f0520 con 0x7f88ec0c6b50 2023-12-08T08:21:27.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.439+0000 7f88f2459640 1 -- 172.21.15.88:0/2718451814 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88ec0674b0 con 0x7f88ec0c6b50 2023-12-08T08:21:27.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.443+0000 7f88e1ffb640 1 -- 172.21.15.88:0/2718451814 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f88dc00bcf0 con 0x7f88ec0c6b50 2023-12-08T08:21:27.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.443+0000 7f88e1ffb640 1 --2- 172.21.15.88:0/2718451814 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f88d0066470 0x7f88d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:27.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.443+0000 7f88e1ffb640 1 -- 172.21.15.88:0/2718451814 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f88dc0846d0 con 0x7f88ec0c6b50 2023-12-08T08:21:27.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.443+0000 7f88f1457640 1 --2- 172.21.15.88:0/2718451814 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f88d0066470 0x7f88d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:27.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.443+0000 7f88f1457640 1 --2- 172.21.15.88:0/2718451814 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f88d0066470 0x7f88d0068930 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f88e80af000 tx=0x7f88e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:27.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.447+0000 7f88e1ffb640 1 -- 172.21.15.88:0/2718451814 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f88dc051880 con 0x7f88ec0c6b50 2023-12-08T08:21:27.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.591+0000 7f88f2459640 1 -- 172.21.15.88:0/2718451814 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88ec0c7ba0 con 0x7f88d0066470 2023-12-08T08:21:27.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.607+0000 7f88e1ffb640 1 -- 172.21.15.88:0/2718451814 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527289 (secure 0 0 0) 0x7f88ec0c7ba0 con 0x7f88d0066470 2023-12-08T08:21:27.615 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:27.619 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:21:27.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.611+0000 7f88f2459640 1 -- 172.21.15.88:0/2718451814 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f88d0066470 msgr2=0x7f88d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:27.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.611+0000 7f88f2459640 1 --2- 172.21.15.88:0/2718451814 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f88d0066470 0x7f88d0068930 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f88e80af000 tx=0x7f88e8008040 comp rx=0 tx=0).stop 2023-12-08T08:21:27.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.611+0000 7f88f2459640 1 -- 172.21.15.88:0/2718451814 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88ec0c6b50 msgr2=0x7f88ec153680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:27.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.611+0000 7f88f2459640 1 --2- 172.21.15.88:0/2718451814 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88ec0c6b50 0x7f88ec153680 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f88dc00d800 tx=0x7f88dc00dcc0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.611+0000 7f88f2459640 1 -- 172.21.15.88:0/2718451814 shutdown_connections 2023-12-08T08:21:27.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.611+0000 7f88f2459640 1 --2- 172.21.15.88:0/2718451814 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f88d0066470 0x7f88d0068930 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.611+0000 7f88f2459640 1 --2- 172.21.15.88:0/2718451814 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88ec151b90 0x7f88ec0c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.611+0000 7f88f2459640 1 --2- 172.21.15.88:0/2718451814 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88ec0c6b50 0x7f88ec153680 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.611+0000 7f88f2459640 1 --2- 172.21.15.88:0/2718451814 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88ec06c670 0x7f88ec1f0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.611+0000 7f88f2459640 1 -- 172.21.15.88:0/2718451814 >> 172.21.15.88:0/2718451814 conn(0x7f88ec0aba00 msgr2=0x7f88ec14d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:27.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.611+0000 7f88f2459640 1 -- 172.21.15.88:0/2718451814 shutdown_connections 2023-12-08T08:21:27.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.611+0000 7f88f2459640 1 -- 172.21.15.88:0/2718451814 wait complete. 2023-12-08T08:21:27.634 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2023-12-08T08:21:26.761111+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":352,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219576,"kb_used_data":3360,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755144,"statfs":{"total":773094113280,"available":772869267456,"internally_reserved":0,"allocated":3440640,"data_stored":2494846,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.108907"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.779910+0000","last_change":"2023-12-08T08:21:18.687183+0000","last_active":"2023-12-08T08:21:19.779910+0000","last_peered":"2023-12-08T08:21:19.779910+0000","last_clean":"2023-12-08T08:21:19.779910+0000","last_became_active":"2023-12-08T08:21:18.677794+0000","last_became_peered":"2023-12-08T08:21:18.677794+0000","last_unstale":"2023-12-08T08:21:19.779910+0000","last_undegraded":"2023-12-08T08:21:19.779910+0000","last_fullsized":"2023-12-08T08:21:19.779910+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:14.361994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.656895+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:21:18.656895+0000","last_peered":"2023-12-08T08:21:18.656895+0000","last_clean":"2023-12-08T08:21:18.656895+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:21:18.656895+0000","last_undegraded":"2023-12-08T08:21:18.656895+0000","last_fullsized":"2023-12-08T08:21:18.656895+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.665931+0000","last_change":"2023-12-08T08:21:04.776417+0000","last_active":"2023-12-08T08:21:18.665931+0000","last_peered":"2023-12-08T08:21:18.665931+0000","last_clean":"2023-12-08T08:21:18.665931+0000","last_became_active":"2023-12-08T08:21:04.776117+0000","last_became_peered":"2023-12-08T08:21:04.776117+0000","last_unstale":"2023-12-08T08:21:18.665931+0000","last_undegraded":"2023-12-08T08:21:18.665931+0000","last_fullsized":"2023-12-08T08:21:18.665931+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:45:05.142948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.657142+0000","last_change":"2023-12-08T08:21:05.536640+0000","last_active":"2023-12-08T08:21:18.657142+0000","last_peered":"2023-12-08T08:21:18.657142+0000","last_clean":"2023-12-08T08:21:18.657142+0000","last_became_active":"2023-12-08T08:21:05.536368+0000","last_became_peered":"2023-12-08T08:21:05.536368+0000","last_unstale":"2023-12-08T08:21:18.657142+0000","last_undegraded":"2023-12-08T08:21:18.657142+0000","last_fullsized":"2023-12-08T08:21:18.657142+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:59:00.606587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.697456+0000","last_change":"2023-12-08T08:21:17.684153+0000","last_active":"2023-12-08T08:21:18.697456+0000","last_peered":"2023-12-08T08:21:18.697456+0000","last_clean":"2023-12-08T08:21:18.697456+0000","last_became_active":"2023-12-08T08:21:17.683886+0000","last_became_peered":"2023-12-08T08:21:17.683886+0000","last_unstale":"2023-12-08T08:21:18.697456+0000","last_undegraded":"2023-12-08T08:21:18.697456+0000","last_fullsized":"2023-12-08T08:21:18.697456+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:56:25.672598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.778407+0000","last_change":"2023-12-08T08:21:18.694844+0000","last_active":"2023-12-08T08:21:19.778407+0000","last_peered":"2023-12-08T08:21:19.778407+0000","last_clean":"2023-12-08T08:21:19.778407+0000","last_became_active":"2023-12-08T08:21:18.694574+0000","last_became_peered":"2023-12-08T08:21:18.694574+0000","last_unstale":"2023-12-08T08:21:19.778407+0000","last_undegraded":"2023-12-08T08:21:19.778407+0000","last_fullsized":"2023-12-08T08:21:19.778407+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:49:08.543253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.655953+0000","last_change":"2023-12-08T08:21:04.781980+0000","last_active":"2023-12-08T08:21:18.655953+0000","last_peered":"2023-12-08T08:21:18.655953+0000","last_clean":"2023-12-08T08:21:18.655953+0000","last_became_active":"2023-12-08T08:21:04.781716+0000","last_became_peered":"2023-12-08T08:21:04.781716+0000","last_unstale":"2023-12-08T08:21:18.655953+0000","last_undegraded":"2023-12-08T08:21:18.655953+0000","last_fullsized":"2023-12-08T08:21:18.655953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:03.400233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.662426+0000","last_change":"2023-12-08T08:21:05.529530+0000","last_active":"2023-12-08T08:21:18.662426+0000","last_peered":"2023-12-08T08:21:18.662426+0000","last_clean":"2023-12-08T08:21:18.662426+0000","last_became_active":"2023-12-08T08:21:05.529080+0000","last_became_peered":"2023-12-08T08:21:05.529080+0000","last_unstale":"2023-12-08T08:21:18.662426+0000","last_undegraded":"2023-12-08T08:21:18.662426+0000","last_fullsized":"2023-12-08T08:21:18.662426+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:51.183842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.663088+0000","last_change":"2023-12-08T08:21:17.682622+0000","last_active":"2023-12-08T08:21:18.663088+0000","last_peered":"2023-12-08T08:21:18.663088+0000","last_clean":"2023-12-08T08:21:18.663088+0000","last_became_active":"2023-12-08T08:21:17.676302+0000","last_became_peered":"2023-12-08T08:21:17.676302+0000","last_unstale":"2023-12-08T08:21:18.663088+0000","last_undegraded":"2023-12-08T08:21:18.663088+0000","last_fullsized":"2023-12-08T08:21:18.663088+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:49:31.201437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.778378+0000","last_change":"2023-12-08T08:21:18.677353+0000","last_active":"2023-12-08T08:21:19.778378+0000","last_peered":"2023-12-08T08:21:19.778378+0000","last_clean":"2023-12-08T08:21:19.778378+0000","last_became_active":"2023-12-08T08:21:18.677089+0000","last_became_peered":"2023-12-08T08:21:18.677089+0000","last_unstale":"2023-12-08T08:21:19.778378+0000","last_undegraded":"2023-12-08T08:21:19.778378+0000","last_fullsized":"2023-12-08T08:21:19.778378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:56.568686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.662611+0000","last_change":"2023-12-08T08:21:04.768138+0000","last_active":"2023-12-08T08:21:18.662611+0000","last_peered":"2023-12-08T08:21:18.662611+0000","last_clean":"2023-12-08T08:21:18.662611+0000","last_became_active":"2023-12-08T08:21:04.767873+0000","last_became_peered":"2023-12-08T08:21:04.767873+0000","last_unstale":"2023-12-08T08:21:18.662611+0000","last_undegraded":"2023-12-08T08:21:18.662611+0000","last_fullsized":"2023-12-08T08:21:18.662611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:45:05.142948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.655870+0000","last_change":"2023-12-08T08:21:05.526701+0000","last_active":"2023-12-08T08:21:18.655870+0000","last_peered":"2023-12-08T08:21:18.655870+0000","last_clean":"2023-12-08T08:21:18.655870+0000","last_became_active":"2023-12-08T08:21:05.526275+0000","last_became_peered":"2023-12-08T08:21:05.526275+0000","last_unstale":"2023-12-08T08:21:18.655870+0000","last_undegraded":"2023-12-08T08:21:18.655870+0000","last_fullsized":"2023-12-08T08:21:18.655870+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:59:00.606587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.657239+0000","last_change":"2023-12-08T08:21:17.682917+0000","last_active":"2023-12-08T08:21:18.657239+0000","last_peered":"2023-12-08T08:21:18.657239+0000","last_clean":"2023-12-08T08:21:18.657239+0000","last_became_active":"2023-12-08T08:21:17.681822+0000","last_became_peered":"2023-12-08T08:21:17.681822+0000","last_unstale":"2023-12-08T08:21:18.657239+0000","last_undegraded":"2023-12-08T08:21:18.657239+0000","last_fullsized":"2023-12-08T08:21:18.657239+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:50:49.236450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.779160+0000","last_change":"2023-12-08T08:21:18.676164+0000","last_active":"2023-12-08T08:21:19.779160+0000","last_peered":"2023-12-08T08:21:19.779160+0000","last_clean":"2023-12-08T08:21:19.779160+0000","last_became_active":"2023-12-08T08:21:18.675895+0000","last_became_peered":"2023-12-08T08:21:18.675895+0000","last_unstale":"2023-12-08T08:21:19.779160+0000","last_undegraded":"2023-12-08T08:21:19.779160+0000","last_fullsized":"2023-12-08T08:21:19.779160+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:25.703198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.664354+0000","last_change":"2023-12-08T08:21:04.776576+0000","last_active":"2023-12-08T08:21:18.664354+0000","last_peered":"2023-12-08T08:21:18.664354+0000","last_clean":"2023-12-08T08:21:18.664354+0000","last_became_active":"2023-12-08T08:21:04.773627+0000","last_became_peered":"2023-12-08T08:21:04.773627+0000","last_unstale":"2023-12-08T08:21:18.664354+0000","last_undegraded":"2023-12-08T08:21:18.664354+0000","last_fullsized":"2023-12-08T08:21:18.664354+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:12.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.663597+0000","last_change":"2023-12-08T08:21:05.528356+0000","last_active":"2023-12-08T08:21:18.663597+0000","last_peered":"2023-12-08T08:21:18.663597+0000","last_clean":"2023-12-08T08:21:18.663597+0000","last_became_active":"2023-12-08T08:21:05.528102+0000","last_became_peered":"2023-12-08T08:21:05.528102+0000","last_unstale":"2023-12-08T08:21:18.663597+0000","last_undegraded":"2023-12-08T08:21:18.663597+0000","last_fullsized":"2023-12-08T08:21:18.663597+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:51.183842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.659729+0000","last_change":"2023-12-08T08:21:17.673005+0000","last_active":"2023-12-08T08:21:18.659729+0000","last_peered":"2023-12-08T08:21:18.659729+0000","last_clean":"2023-12-08T08:21:18.659729+0000","last_became_active":"2023-12-08T08:21:17.672648+0000","last_became_peered":"2023-12-08T08:21:17.672648+0000","last_unstale":"2023-12-08T08:21:18.659729+0000","last_undegraded":"2023-12-08T08:21:18.659729+0000","last_fullsized":"2023-12-08T08:21:18.659729+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:05:23.082791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.678489+0000","last_change":"2023-12-08T08:21:18.687098+0000","last_active":"2023-12-08T08:21:19.678489+0000","last_peered":"2023-12-08T08:21:19.678489+0000","last_clean":"2023-12-08T08:21:19.678489+0000","last_became_active":"2023-12-08T08:21:18.685905+0000","last_became_peered":"2023-12-08T08:21:18.685905+0000","last_unstale":"2023-12-08T08:21:19.678489+0000","last_undegraded":"2023-12-08T08:21:19.678489+0000","last_fullsized":"2023-12-08T08:21:19.678489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:44:58.497416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.664170+0000","last_change":"2023-12-08T08:21:04.764784+0000","last_active":"2023-12-08T08:21:18.664170+0000","last_peered":"2023-12-08T08:21:18.664170+0000","last_clean":"2023-12-08T08:21:18.664170+0000","last_became_active":"2023-12-08T08:21:04.764580+0000","last_became_peered":"2023-12-08T08:21:04.764580+0000","last_unstale":"2023-12-08T08:21:18.664170+0000","last_undegraded":"2023-12-08T08:21:18.664170+0000","last_fullsized":"2023-12-08T08:21:18.664170+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:51:05.330323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.667925+0000","last_change":"2023-12-08T08:21:05.529399+0000","last_active":"2023-12-08T08:21:18.667925+0000","last_peered":"2023-12-08T08:21:18.667925+0000","last_clean":"2023-12-08T08:21:18.667925+0000","last_became_active":"2023-12-08T08:21:05.529054+0000","last_became_peered":"2023-12-08T08:21:05.529054+0000","last_unstale":"2023-12-08T08:21:18.667925+0000","last_undegraded":"2023-12-08T08:21:18.667925+0000","last_fullsized":"2023-12-08T08:21:18.667925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:09.020416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.663377+0000","last_change":"2023-12-08T08:21:17.680157+0000","last_active":"2023-12-08T08:21:18.663377+0000","last_peered":"2023-12-08T08:21:18.663377+0000","last_clean":"2023-12-08T08:21:18.663377+0000","last_became_active":"2023-12-08T08:21:17.679947+0000","last_became_peered":"2023-12-08T08:21:17.679947+0000","last_unstale":"2023-12-08T08:21:18.663377+0000","last_undegraded":"2023-12-08T08:21:18.663377+0000","last_fullsized":"2023-12-08T08:21:18.663377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:50:10.937324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.782112+0000","last_change":"2023-12-08T08:21:18.689813+0000","last_active":"2023-12-08T08:21:19.782112+0000","last_peered":"2023-12-08T08:21:19.782112+0000","last_clean":"2023-12-08T08:21:19.782112+0000","last_became_active":"2023-12-08T08:21:18.689518+0000","last_became_peered":"2023-12-08T08:21:18.689518+0000","last_unstale":"2023-12-08T08:21:19.782112+0000","last_undegraded":"2023-12-08T08:21:19.782112+0000","last_fullsized":"2023-12-08T08:21:19.782112+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:11:39.603954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.662328+0000","last_change":"2023-12-08T08:21:04.769119+0000","last_active":"2023-12-08T08:21:18.662328+0000","last_peered":"2023-12-08T08:21:18.662328+0000","last_clean":"2023-12-08T08:21:18.662328+0000","last_became_active":"2023-12-08T08:21:04.768807+0000","last_became_peered":"2023-12-08T08:21:04.768807+0000","last_unstale":"2023-12-08T08:21:18.662328+0000","last_undegraded":"2023-12-08T08:21:18.662328+0000","last_fullsized":"2023-12-08T08:21:18.662328+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:29.810210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.661851+0000","last_change":"2023-12-08T08:21:05.525845+0000","last_active":"2023-12-08T08:21:18.661851+0000","last_peered":"2023-12-08T08:21:18.661851+0000","last_clean":"2023-12-08T08:21:18.661851+0000","last_became_active":"2023-12-08T08:21:05.525546+0000","last_became_peered":"2023-12-08T08:21:05.525546+0000","last_unstale":"2023-12-08T08:21:18.661851+0000","last_undegraded":"2023-12-08T08:21:18.661851+0000","last_fullsized":"2023-12-08T08:21:18.661851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:44.030312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.658845+0000","last_change":"2023-12-08T08:21:17.682436+0000","last_active":"2023-12-08T08:21:18.658845+0000","last_peered":"2023-12-08T08:21:18.658845+0000","last_clean":"2023-12-08T08:21:18.658845+0000","last_became_active":"2023-12-08T08:21:17.682222+0000","last_became_peered":"2023-12-08T08:21:17.682222+0000","last_unstale":"2023-12-08T08:21:18.658845+0000","last_undegraded":"2023-12-08T08:21:18.658845+0000","last_fullsized":"2023-12-08T08:21:18.658845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:09:30.896248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.780935+0000","last_change":"2023-12-08T08:21:18.684372+0000","last_active":"2023-12-08T08:21:19.780935+0000","last_peered":"2023-12-08T08:21:19.780935+0000","last_clean":"2023-12-08T08:21:19.780935+0000","last_became_active":"2023-12-08T08:21:18.684018+0000","last_became_peered":"2023-12-08T08:21:18.684018+0000","last_unstale":"2023-12-08T08:21:19.780935+0000","last_undegraded":"2023-12-08T08:21:19.780935+0000","last_fullsized":"2023-12-08T08:21:19.780935+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:48.241679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.662708+0000","last_change":"2023-12-08T08:21:04.771189+0000","last_active":"2023-12-08T08:21:18.662708+0000","last_peered":"2023-12-08T08:21:18.662708+0000","last_clean":"2023-12-08T08:21:18.662708+0000","last_became_active":"2023-12-08T08:21:04.770913+0000","last_became_peered":"2023-12-08T08:21:04.770913+0000","last_unstale":"2023-12-08T08:21:18.662708+0000","last_undegraded":"2023-12-08T08:21:18.662708+0000","last_fullsized":"2023-12-08T08:21:18.662708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:58:22.885070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.677512+0000","last_change":"2023-12-08T08:21:05.537968+0000","last_active":"2023-12-08T08:21:18.677512+0000","last_peered":"2023-12-08T08:21:18.677512+0000","last_clean":"2023-12-08T08:21:18.677512+0000","last_became_active":"2023-12-08T08:21:05.537190+0000","last_became_peered":"2023-12-08T08:21:05.537190+0000","last_unstale":"2023-12-08T08:21:18.677512+0000","last_undegraded":"2023-12-08T08:21:18.677512+0000","last_fullsized":"2023-12-08T08:21:18.677512+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:49.782105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.661317+0000","last_change":"2023-12-08T08:21:17.684922+0000","last_active":"2023-12-08T08:21:18.661317+0000","last_peered":"2023-12-08T08:21:18.661317+0000","last_clean":"2023-12-08T08:21:18.661317+0000","last_became_active":"2023-12-08T08:21:17.684661+0000","last_became_peered":"2023-12-08T08:21:17.684661+0000","last_unstale":"2023-12-08T08:21:18.661317+0000","last_undegraded":"2023-12-08T08:21:18.661317+0000","last_fullsized":"2023-12-08T08:21:18.661317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:17.857771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.778966+0000","last_change":"2023-12-08T08:21:18.676535+0000","last_active":"2023-12-08T08:21:19.778966+0000","last_peered":"2023-12-08T08:21:19.778966+0000","last_clean":"2023-12-08T08:21:19.778966+0000","last_became_active":"2023-12-08T08:21:18.676217+0000","last_became_peered":"2023-12-08T08:21:18.676217+0000","last_unstale":"2023-12-08T08:21:19.778966+0000","last_undegraded":"2023-12-08T08:21:19.778966+0000","last_fullsized":"2023-12-08T08:21:19.778966+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:49:40.221530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.667236+0000","last_change":"2023-12-08T08:21:04.774731+0000","last_active":"2023-12-08T08:21:18.667236+0000","last_peered":"2023-12-08T08:21:18.667236+0000","last_clean":"2023-12-08T08:21:18.667236+0000","last_became_active":"2023-12-08T08:21:04.773894+0000","last_became_peered":"2023-12-08T08:21:04.773894+0000","last_unstale":"2023-12-08T08:21:18.667236+0000","last_undegraded":"2023-12-08T08:21:18.667236+0000","last_fullsized":"2023-12-08T08:21:18.667236+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:46.416448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.679834+0000","last_change":"2023-12-08T08:21:05.540583+0000","last_active":"2023-12-08T08:21:18.679834+0000","last_peered":"2023-12-08T08:21:18.679834+0000","last_clean":"2023-12-08T08:21:18.679834+0000","last_became_active":"2023-12-08T08:21:05.540350+0000","last_became_peered":"2023-12-08T08:21:05.540350+0000","last_unstale":"2023-12-08T08:21:18.679834+0000","last_undegraded":"2023-12-08T08:21:18.679834+0000","last_fullsized":"2023-12-08T08:21:18.679834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:46:44.526151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.657450+0000","last_change":"2023-12-08T08:21:17.679399+0000","last_active":"2023-12-08T08:21:18.657450+0000","last_peered":"2023-12-08T08:21:18.657450+0000","last_clean":"2023-12-08T08:21:18.657450+0000","last_became_active":"2023-12-08T08:21:17.679103+0000","last_became_peered":"2023-12-08T08:21:17.679103+0000","last_unstale":"2023-12-08T08:21:18.657450+0000","last_undegraded":"2023-12-08T08:21:18.657450+0000","last_fullsized":"2023-12-08T08:21:18.657450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:44:57.489412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.678673+0000","last_change":"2023-12-08T08:21:18.684990+0000","last_active":"2023-12-08T08:21:19.678673+0000","last_peered":"2023-12-08T08:21:19.678673+0000","last_clean":"2023-12-08T08:21:19.678673+0000","last_became_active":"2023-12-08T08:21:18.684692+0000","last_became_peered":"2023-12-08T08:21:18.684692+0000","last_unstale":"2023-12-08T08:21:19.678673+0000","last_undegraded":"2023-12-08T08:21:19.678673+0000","last_fullsized":"2023-12-08T08:21:19.678673+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:31:03.873090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.671060+0000","last_change":"2023-12-08T08:21:04.778519+0000","last_active":"2023-12-08T08:21:18.671060+0000","last_peered":"2023-12-08T08:21:18.671060+0000","last_clean":"2023-12-08T08:21:18.671060+0000","last_became_active":"2023-12-08T08:21:04.778208+0000","last_became_peered":"2023-12-08T08:21:04.778208+0000","last_unstale":"2023-12-08T08:21:18.671060+0000","last_undegraded":"2023-12-08T08:21:18.671060+0000","last_fullsized":"2023-12-08T08:21:18.671060+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:36.535172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.657191+0000","last_change":"2023-12-08T08:21:05.530364+0000","last_active":"2023-12-08T08:21:18.657191+0000","last_peered":"2023-12-08T08:21:18.657191+0000","last_clean":"2023-12-08T08:21:18.657191+0000","last_became_active":"2023-12-08T08:21:05.530046+0000","last_became_peered":"2023-12-08T08:21:05.530046+0000","last_unstale":"2023-12-08T08:21:18.657191+0000","last_undegraded":"2023-12-08T08:21:18.657191+0000","last_fullsized":"2023-12-08T08:21:18.657191+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.368162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.669757+0000","last_change":"2023-12-08T08:21:17.680178+0000","last_active":"2023-12-08T08:21:18.669757+0000","last_peered":"2023-12-08T08:21:18.669757+0000","last_clean":"2023-12-08T08:21:18.669757+0000","last_became_active":"2023-12-08T08:21:17.679880+0000","last_became_peered":"2023-12-08T08:21:17.679880+0000","last_unstale":"2023-12-08T08:21:18.669757+0000","last_undegraded":"2023-12-08T08:21:18.669757+0000","last_fullsized":"2023-12-08T08:21:18.669757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:50:42.502393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.778106+0000","last_change":"2023-12-08T08:21:18.694775+0000","last_active":"2023-12-08T08:21:19.778106+0000","last_peered":"2023-12-08T08:21:19.778106+0000","last_clean":"2023-12-08T08:21:19.778106+0000","last_became_active":"2023-12-08T08:21:18.694607+0000","last_became_peered":"2023-12-08T08:21:18.694607+0000","last_unstale":"2023-12-08T08:21:19.778106+0000","last_undegraded":"2023-12-08T08:21:19.778106+0000","last_fullsized":"2023-12-08T08:21:19.778106+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:58:46.580928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.662524+0000","last_change":"2023-12-08T08:21:04.771979+0000","last_active":"2023-12-08T08:21:18.662524+0000","last_peered":"2023-12-08T08:21:18.662524+0000","last_clean":"2023-12-08T08:21:18.662524+0000","last_became_active":"2023-12-08T08:21:04.771656+0000","last_became_peered":"2023-12-08T08:21:04.771656+0000","last_unstale":"2023-12-08T08:21:18.662524+0000","last_undegraded":"2023-12-08T08:21:18.662524+0000","last_fullsized":"2023-12-08T08:21:18.662524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:46:43.523269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.677238+0000","last_change":"2023-12-08T08:21:05.538591+0000","last_active":"2023-12-08T08:21:18.677238+0000","last_peered":"2023-12-08T08:21:18.677238+0000","last_clean":"2023-12-08T08:21:18.677238+0000","last_became_active":"2023-12-08T08:21:05.538303+0000","last_became_peered":"2023-12-08T08:21:05.538303+0000","last_unstale":"2023-12-08T08:21:18.677238+0000","last_undegraded":"2023-12-08T08:21:18.677238+0000","last_fullsized":"2023-12-08T08:21:18.677238+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:45:35.860546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.697321+0000","last_change":"2023-12-08T08:21:17.682782+0000","last_active":"2023-12-08T08:21:18.697321+0000","last_peered":"2023-12-08T08:21:18.697321+0000","last_clean":"2023-12-08T08:21:18.697321+0000","last_became_active":"2023-12-08T08:21:17.681371+0000","last_became_peered":"2023-12-08T08:21:17.681371+0000","last_unstale":"2023-12-08T08:21:18.697321+0000","last_undegraded":"2023-12-08T08:21:18.697321+0000","last_fullsized":"2023-12-08T08:21:18.697321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:40:39.583448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.778154+0000","last_change":"2023-12-08T08:21:18.672042+0000","last_active":"2023-12-08T08:21:19.778154+0000","last_peered":"2023-12-08T08:21:19.778154+0000","last_clean":"2023-12-08T08:21:19.778154+0000","last_became_active":"2023-12-08T08:21:18.671788+0000","last_became_peered":"2023-12-08T08:21:18.671788+0000","last_unstale":"2023-12-08T08:21:19.778154+0000","last_undegraded":"2023-12-08T08:21:19.778154+0000","last_fullsized":"2023-12-08T08:21:19.778154+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:56:26.680603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.662122+0000","last_change":"2023-12-08T08:21:04.776313+0000","last_active":"2023-12-08T08:21:18.662122+0000","last_peered":"2023-12-08T08:21:18.662122+0000","last_clean":"2023-12-08T08:21:18.662122+0000","last_became_active":"2023-12-08T08:21:04.775894+0000","last_became_peered":"2023-12-08T08:21:04.775894+0000","last_unstale":"2023-12-08T08:21:18.662122+0000","last_undegraded":"2023-12-08T08:21:18.662122+0000","last_fullsized":"2023-12-08T08:21:18.662122+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:13.006406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.668292+0000","last_change":"2023-12-08T08:21:05.537164+0000","last_active":"2023-12-08T08:21:18.668292+0000","last_peered":"2023-12-08T08:21:18.668292+0000","last_clean":"2023-12-08T08:21:18.668292+0000","last_became_active":"2023-12-08T08:21:05.536915+0000","last_became_peered":"2023-12-08T08:21:05.536915+0000","last_unstale":"2023-12-08T08:21:18.668292+0000","last_undegraded":"2023-12-08T08:21:18.668292+0000","last_fullsized":"2023-12-08T08:21:18.668292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:14.009289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.657775+0000","last_change":"2023-12-08T08:21:17.673958+0000","last_active":"2023-12-08T08:21:18.657775+0000","last_peered":"2023-12-08T08:21:18.657775+0000","last_clean":"2023-12-08T08:21:18.657775+0000","last_became_active":"2023-12-08T08:21:17.673637+0000","last_became_peered":"2023-12-08T08:21:17.673637+0000","last_unstale":"2023-12-08T08:21:18.657775+0000","last_undegraded":"2023-12-08T08:21:18.657775+0000","last_fullsized":"2023-12-08T08:21:18.657775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:05:08.249225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.778597+0000","last_change":"2023-12-08T08:21:18.687115+0000","last_active":"2023-12-08T08:21:19.778597+0000","last_peered":"2023-12-08T08:21:19.778597+0000","last_clean":"2023-12-08T08:21:19.778597+0000","last_became_active":"2023-12-08T08:21:18.686763+0000","last_became_peered":"2023-12-08T08:21:18.686763+0000","last_unstale":"2023-12-08T08:21:19.778597+0000","last_undegraded":"2023-12-08T08:21:19.778597+0000","last_fullsized":"2023-12-08T08:21:19.778597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:14:31.182536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.664026+0000","last_change":"2023-12-08T08:21:04.768985+0000","last_active":"2023-12-08T08:21:18.664026+0000","last_peered":"2023-12-08T08:21:18.664026+0000","last_clean":"2023-12-08T08:21:18.664026+0000","last_became_active":"2023-12-08T08:21:04.768693+0000","last_became_peered":"2023-12-08T08:21:04.768693+0000","last_unstale":"2023-12-08T08:21:18.664026+0000","last_undegraded":"2023-12-08T08:21:18.664026+0000","last_fullsized":"2023-12-08T08:21:18.664026+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:29.810210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.667523+0000","last_change":"2023-12-08T08:21:05.542434+0000","last_active":"2023-12-08T08:21:18.667523+0000","last_peered":"2023-12-08T08:21:18.667523+0000","last_clean":"2023-12-08T08:21:18.667523+0000","last_became_active":"2023-12-08T08:21:05.542218+0000","last_became_peered":"2023-12-08T08:21:05.542218+0000","last_unstale":"2023-12-08T08:21:18.667523+0000","last_undegraded":"2023-12-08T08:21:18.667523+0000","last_fullsized":"2023-12-08T08:21:18.667523+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:16:19.580755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.659642+0000","last_change":"2023-12-08T08:21:17.668067+0000","last_active":"2023-12-08T08:21:18.659642+0000","last_peered":"2023-12-08T08:21:18.659642+0000","last_clean":"2023-12-08T08:21:18.659642+0000","last_became_active":"2023-12-08T08:21:17.667751+0000","last_became_peered":"2023-12-08T08:21:17.667751+0000","last_unstale":"2023-12-08T08:21:18.659642+0000","last_undegraded":"2023-12-08T08:21:18.659642+0000","last_fullsized":"2023-12-08T08:21:18.659642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:17.857771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.780075+0000","last_change":"2023-12-08T08:21:18.685879+0000","last_active":"2023-12-08T08:21:19.780075+0000","last_peered":"2023-12-08T08:21:19.780075+0000","last_clean":"2023-12-08T08:21:19.780075+0000","last_became_active":"2023-12-08T08:21:18.685528+0000","last_became_peered":"2023-12-08T08:21:18.685528+0000","last_unstale":"2023-12-08T08:21:19.780075+0000","last_undegraded":"2023-12-08T08:21:19.780075+0000","last_fullsized":"2023-12-08T08:21:19.780075+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:46.865985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.666108+0000","last_change":"2023-12-08T08:21:04.775274+0000","last_active":"2023-12-08T08:21:18.666108+0000","last_peered":"2023-12-08T08:21:18.666108+0000","last_clean":"2023-12-08T08:21:18.666108+0000","last_became_active":"2023-12-08T08:21:04.774961+0000","last_became_peered":"2023-12-08T08:21:04.774961+0000","last_unstale":"2023-12-08T08:21:18.666108+0000","last_undegraded":"2023-12-08T08:21:18.666108+0000","last_fullsized":"2023-12-08T08:21:18.666108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:03.400233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.676038+0000","last_change":"2023-12-08T08:21:05.534904+0000","last_active":"2023-12-08T08:21:18.676038+0000","last_peered":"2023-12-08T08:21:18.676038+0000","last_clean":"2023-12-08T08:21:18.676038+0000","last_became_active":"2023-12-08T08:21:05.534637+0000","last_became_peered":"2023-12-08T08:21:05.534637+0000","last_unstale":"2023-12-08T08:21:18.676038+0000","last_undegraded":"2023-12-08T08:21:18.676038+0000","last_fullsized":"2023-12-08T08:21:18.676038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:40:41.034391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.698866+0000","last_change":"2023-12-08T08:21:17.682559+0000","last_active":"2023-12-08T08:21:18.698866+0000","last_peered":"2023-12-08T08:21:18.698866+0000","last_clean":"2023-12-08T08:21:18.698866+0000","last_became_active":"2023-12-08T08:21:17.675578+0000","last_became_peered":"2023-12-08T08:21:17.675578+0000","last_unstale":"2023-12-08T08:21:18.698866+0000","last_undegraded":"2023-12-08T08:21:18.698866+0000","last_fullsized":"2023-12-08T08:21:18.698866+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:50:42.502393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.780728+0000","last_change":"2023-12-08T08:21:18.689396+0000","last_active":"2023-12-08T08:21:19.780728+0000","last_peered":"2023-12-08T08:21:19.780728+0000","last_clean":"2023-12-08T08:21:19.780728+0000","last_became_active":"2023-12-08T08:21:18.689128+0000","last_became_peered":"2023-12-08T08:21:18.689128+0000","last_unstale":"2023-12-08T08:21:19.780728+0000","last_undegraded":"2023-12-08T08:21:19.780728+0000","last_fullsized":"2023-12-08T08:21:19.780728+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:20:52.773390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.666476+0000","last_change":"2023-12-08T08:21:04.770820+0000","last_active":"2023-12-08T08:21:18.666476+0000","last_peered":"2023-12-08T08:21:18.666476+0000","last_clean":"2023-12-08T08:21:18.666476+0000","last_became_active":"2023-12-08T08:21:04.767804+0000","last_became_peered":"2023-12-08T08:21:04.767804+0000","last_unstale":"2023-12-08T08:21:18.666476+0000","last_undegraded":"2023-12-08T08:21:18.666476+0000","last_fullsized":"2023-12-08T08:21:18.666476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:58:22.885070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.661533+0000","last_change":"2023-12-08T08:21:05.521567+0000","last_active":"2023-12-08T08:21:18.661533+0000","last_peered":"2023-12-08T08:21:18.661533+0000","last_clean":"2023-12-08T08:21:18.661533+0000","last_became_active":"2023-12-08T08:21:05.521289+0000","last_became_peered":"2023-12-08T08:21:05.521289+0000","last_unstale":"2023-12-08T08:21:18.661533+0000","last_undegraded":"2023-12-08T08:21:18.661533+0000","last_fullsized":"2023-12-08T08:21:18.661533+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:11.477913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.701055+0000","last_change":"2023-12-08T08:21:17.683937+0000","last_active":"2023-12-08T08:21:18.701055+0000","last_peered":"2023-12-08T08:21:18.701055+0000","last_clean":"2023-12-08T08:21:18.701055+0000","last_became_active":"2023-12-08T08:21:17.683574+0000","last_became_peered":"2023-12-08T08:21:17.683574+0000","last_unstale":"2023-12-08T08:21:18.701055+0000","last_undegraded":"2023-12-08T08:21:18.701055+0000","last_fullsized":"2023-12-08T08:21:18.701055+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:49.427823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.781179+0000","last_change":"2023-12-08T08:21:18.674713+0000","last_active":"2023-12-08T08:21:19.781179+0000","last_peered":"2023-12-08T08:21:19.781179+0000","last_clean":"2023-12-08T08:21:19.781179+0000","last_became_active":"2023-12-08T08:21:18.674437+0000","last_became_peered":"2023-12-08T08:21:18.674437+0000","last_unstale":"2023-12-08T08:21:19.781179+0000","last_undegraded":"2023-12-08T08:21:19.781179+0000","last_fullsized":"2023-12-08T08:21:19.781179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:55.156330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.666997+0000","last_change":"2023-12-08T08:21:04.776652+0000","last_active":"2023-12-08T08:21:18.666997+0000","last_peered":"2023-12-08T08:21:18.666997+0000","last_clean":"2023-12-08T08:21:18.666997+0000","last_became_active":"2023-12-08T08:21:04.776345+0000","last_became_peered":"2023-12-08T08:21:04.776345+0000","last_unstale":"2023-12-08T08:21:18.666997+0000","last_undegraded":"2023-12-08T08:21:18.666997+0000","last_fullsized":"2023-12-08T08:21:18.666997+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:46.416448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.677389+0000","last_change":"2023-12-08T08:21:05.538159+0000","last_active":"2023-12-08T08:21:18.677389+0000","last_peered":"2023-12-08T08:21:18.677389+0000","last_clean":"2023-12-08T08:21:18.677389+0000","last_became_active":"2023-12-08T08:21:05.537601+0000","last_became_peered":"2023-12-08T08:21:05.537601+0000","last_unstale":"2023-12-08T08:21:18.677389+0000","last_undegraded":"2023-12-08T08:21:18.677389+0000","last_fullsized":"2023-12-08T08:21:18.677389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:09:56.356105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.658593+0000","last_change":"2023-12-08T08:21:17.675955+0000","last_active":"2023-12-08T08:21:18.658593+0000","last_peered":"2023-12-08T08:21:18.658593+0000","last_clean":"2023-12-08T08:21:18.658593+0000","last_became_active":"2023-12-08T08:21:17.675547+0000","last_became_peered":"2023-12-08T08:21:17.675547+0000","last_unstale":"2023-12-08T08:21:18.658593+0000","last_undegraded":"2023-12-08T08:21:18.658593+0000","last_fullsized":"2023-12-08T08:21:18.658593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:45.857980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.781316+0000","last_change":"2023-12-08T08:21:18.682889+0000","last_active":"2023-12-08T08:21:19.781316+0000","last_peered":"2023-12-08T08:21:19.781316+0000","last_clean":"2023-12-08T08:21:19.781316+0000","last_became_active":"2023-12-08T08:21:18.682466+0000","last_became_peered":"2023-12-08T08:21:18.682466+0000","last_unstale":"2023-12-08T08:21:19.781316+0000","last_undegraded":"2023-12-08T08:21:19.781316+0000","last_fullsized":"2023-12-08T08:21:19.781316+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:31:03.873090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.667140+0000","last_change":"2023-12-08T08:21:04.785414+0000","last_active":"2023-12-08T08:21:18.667140+0000","last_peered":"2023-12-08T08:21:18.667140+0000","last_clean":"2023-12-08T08:21:18.667140+0000","last_became_active":"2023-12-08T08:21:04.785198+0000","last_became_peered":"2023-12-08T08:21:04.785198+0000","last_unstale":"2023-12-08T08:21:18.667140+0000","last_undegraded":"2023-12-08T08:21:18.667140+0000","last_fullsized":"2023-12-08T08:21:18.667140+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:03.400233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.666918+0000","last_change":"2023-12-08T08:21:05.537706+0000","last_active":"2023-12-08T08:21:18.666918+0000","last_peered":"2023-12-08T08:21:18.666918+0000","last_clean":"2023-12-08T08:21:18.666918+0000","last_became_active":"2023-12-08T08:21:05.537282+0000","last_became_peered":"2023-12-08T08:21:05.537282+0000","last_unstale":"2023-12-08T08:21:18.666918+0000","last_undegraded":"2023-12-08T08:21:18.666918+0000","last_fullsized":"2023-12-08T08:21:18.666918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:13.692096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.700433+0000","last_change":"2023-12-08T08:21:17.685511+0000","last_active":"2023-12-08T08:21:18.700433+0000","last_peered":"2023-12-08T08:21:18.700433+0000","last_clean":"2023-12-08T08:21:18.700433+0000","last_became_active":"2023-12-08T08:21:17.685173+0000","last_became_peered":"2023-12-08T08:21:17.685173+0000","last_unstale":"2023-12-08T08:21:18.700433+0000","last_undegraded":"2023-12-08T08:21:18.700433+0000","last_fullsized":"2023-12-08T08:21:18.700433+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:50:49.236450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.779638+0000","last_change":"2023-12-08T08:21:18.695242+0000","last_active":"2023-12-08T08:21:19.779638+0000","last_peered":"2023-12-08T08:21:19.779638+0000","last_clean":"2023-12-08T08:21:19.779638+0000","last_became_active":"2023-12-08T08:21:18.692672+0000","last_became_peered":"2023-12-08T08:21:18.692672+0000","last_unstale":"2023-12-08T08:21:19.779638+0000","last_undegraded":"2023-12-08T08:21:19.779638+0000","last_fullsized":"2023-12-08T08:21:19.779638+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:46:56.356473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.656045+0000","last_change":"2023-12-08T08:21:04.775742+0000","last_active":"2023-12-08T08:21:18.656045+0000","last_peered":"2023-12-08T08:21:18.656045+0000","last_clean":"2023-12-08T08:21:18.656045+0000","last_became_active":"2023-12-08T08:21:04.775482+0000","last_became_peered":"2023-12-08T08:21:04.775482+0000","last_unstale":"2023-12-08T08:21:18.656045+0000","last_undegraded":"2023-12-08T08:21:18.656045+0000","last_fullsized":"2023-12-08T08:21:18.656045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:46.416448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.665404+0000","last_change":"2023-12-08T08:21:05.528065+0000","last_active":"2023-12-08T08:21:18.665404+0000","last_peered":"2023-12-08T08:21:18.665404+0000","last_clean":"2023-12-08T08:21:18.665404+0000","last_became_active":"2023-12-08T08:21:05.527792+0000","last_became_peered":"2023-12-08T08:21:05.527792+0000","last_unstale":"2023-12-08T08:21:18.665404+0000","last_undegraded":"2023-12-08T08:21:18.665404+0000","last_fullsized":"2023-12-08T08:21:18.665404+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:51:06.333206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.656429+0000","last_change":"2023-12-08T08:21:17.677690+0000","last_active":"2023-12-08T08:21:18.656429+0000","last_peered":"2023-12-08T08:21:18.656429+0000","last_clean":"2023-12-08T08:21:18.656429+0000","last_became_active":"2023-12-08T08:21:17.677376+0000","last_became_peered":"2023-12-08T08:21:17.677376+0000","last_unstale":"2023-12-08T08:21:18.656429+0000","last_undegraded":"2023-12-08T08:21:18.656429+0000","last_fullsized":"2023-12-08T08:21:18.656429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:59.826879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.780831+0000","last_change":"2023-12-08T08:21:18.688790+0000","last_active":"2023-12-08T08:21:19.780831+0000","last_peered":"2023-12-08T08:21:19.780831+0000","last_clean":"2023-12-08T08:21:19.780831+0000","last_became_active":"2023-12-08T08:21:18.688463+0000","last_became_peered":"2023-12-08T08:21:18.688463+0000","last_unstale":"2023-12-08T08:21:19.780831+0000","last_undegraded":"2023-12-08T08:21:19.780831+0000","last_fullsized":"2023-12-08T08:21:19.780831+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:05:24.090796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.657346+0000","last_change":"2023-12-08T08:21:04.781520+0000","last_active":"2023-12-08T08:21:18.657346+0000","last_peered":"2023-12-08T08:21:18.657346+0000","last_clean":"2023-12-08T08:21:18.657346+0000","last_became_active":"2023-12-08T08:21:04.781236+0000","last_became_peered":"2023-12-08T08:21:04.781236+0000","last_unstale":"2023-12-08T08:21:18.657346+0000","last_undegraded":"2023-12-08T08:21:18.657346+0000","last_fullsized":"2023-12-08T08:21:18.657346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:14:17.281881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.656418+0000","last_change":"2023-12-08T08:21:05.544369+0000","last_active":"2023-12-08T08:21:18.656418+0000","last_peered":"2023-12-08T08:21:18.656418+0000","last_clean":"2023-12-08T08:21:18.656418+0000","last_became_active":"2023-12-08T08:21:05.544090+0000","last_became_peered":"2023-12-08T08:21:05.544090+0000","last_unstale":"2023-12-08T08:21:18.656418+0000","last_undegraded":"2023-12-08T08:21:18.656418+0000","last_fullsized":"2023-12-08T08:21:18.656418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:25.239396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.700028+0000","last_change":"2023-12-08T08:21:17.681233+0000","last_active":"2023-12-08T08:21:18.700028+0000","last_peered":"2023-12-08T08:21:18.700028+0000","last_clean":"2023-12-08T08:21:18.700028+0000","last_became_active":"2023-12-08T08:21:17.680645+0000","last_became_peered":"2023-12-08T08:21:17.680645+0000","last_unstale":"2023-12-08T08:21:18.700028+0000","last_undegraded":"2023-12-08T08:21:18.700028+0000","last_fullsized":"2023-12-08T08:21:18.700028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:11:15.844028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.779606+0000","last_change":"2023-12-08T08:21:18.670121+0000","last_active":"2023-12-08T08:21:19.779606+0000","last_peered":"2023-12-08T08:21:19.779606+0000","last_clean":"2023-12-08T08:21:19.779606+0000","last_became_active":"2023-12-08T08:21:18.669778+0000","last_became_peered":"2023-12-08T08:21:18.669778+0000","last_unstale":"2023-12-08T08:21:19.779606+0000","last_undegraded":"2023-12-08T08:21:19.779606+0000","last_fullsized":"2023-12-08T08:21:19.779606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:45:18.499264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.664312+0000","last_change":"2023-12-08T08:21:04.778563+0000","last_active":"2023-12-08T08:21:18.664312+0000","last_peered":"2023-12-08T08:21:18.664312+0000","last_clean":"2023-12-08T08:21:18.664312+0000","last_became_active":"2023-12-08T08:21:04.778275+0000","last_became_peered":"2023-12-08T08:21:04.778275+0000","last_unstale":"2023-12-08T08:21:18.664312+0000","last_undegraded":"2023-12-08T08:21:18.664312+0000","last_fullsized":"2023-12-08T08:21:18.664312+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:45:05.142948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.658800+0000","last_change":"2023-12-08T08:21:05.528470+0000","last_active":"2023-12-08T08:21:18.658800+0000","last_peered":"2023-12-08T08:21:18.658800+0000","last_clean":"2023-12-08T08:21:18.658800+0000","last_became_active":"2023-12-08T08:21:05.528125+0000","last_became_peered":"2023-12-08T08:21:05.528125+0000","last_unstale":"2023-12-08T08:21:18.658800+0000","last_undegraded":"2023-12-08T08:21:18.658800+0000","last_fullsized":"2023-12-08T08:21:18.658800+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.368162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.699033+0000","last_change":"2023-12-08T08:21:17.670281+0000","last_active":"2023-12-08T08:21:18.699033+0000","last_peered":"2023-12-08T08:21:18.699033+0000","last_clean":"2023-12-08T08:21:18.699033+0000","last_became_active":"2023-12-08T08:21:17.670085+0000","last_became_peered":"2023-12-08T08:21:17.670085+0000","last_unstale":"2023-12-08T08:21:18.699033+0000","last_undegraded":"2023-12-08T08:21:18.699033+0000","last_fullsized":"2023-12-08T08:21:18.699033+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:46:01.671872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.777882+0000","last_change":"2023-12-08T08:21:18.677415+0000","last_active":"2023-12-08T08:21:19.777882+0000","last_peered":"2023-12-08T08:21:19.777882+0000","last_clean":"2023-12-08T08:21:19.777882+0000","last_became_active":"2023-12-08T08:21:18.677132+0000","last_became_peered":"2023-12-08T08:21:18.677132+0000","last_unstale":"2023-12-08T08:21:19.777882+0000","last_undegraded":"2023-12-08T08:21:19.777882+0000","last_fullsized":"2023-12-08T08:21:19.777882+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:42:19.330340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.665674+0000","last_change":"2023-12-08T08:21:04.773643+0000","last_active":"2023-12-08T08:21:18.665674+0000","last_peered":"2023-12-08T08:21:18.665674+0000","last_clean":"2023-12-08T08:21:18.665674+0000","last_became_active":"2023-12-08T08:21:04.773361+0000","last_became_peered":"2023-12-08T08:21:04.773361+0000","last_unstale":"2023-12-08T08:21:18.665674+0000","last_undegraded":"2023-12-08T08:21:18.665674+0000","last_fullsized":"2023-12-08T08:21:18.665674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:08.017533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.663916+0000","last_change":"2023-12-08T08:21:05.543017+0000","last_active":"2023-12-08T08:21:18.663916+0000","last_peered":"2023-12-08T08:21:18.663916+0000","last_clean":"2023-12-08T08:21:18.663916+0000","last_became_active":"2023-12-08T08:21:05.542729+0000","last_became_peered":"2023-12-08T08:21:05.542729+0000","last_unstale":"2023-12-08T08:21:18.663916+0000","last_undegraded":"2023-12-08T08:21:18.663916+0000","last_fullsized":"2023-12-08T08:21:18.663916+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:19.928543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.657256+0000","last_change":"2023-12-08T08:21:17.672426+0000","last_active":"2023-12-08T08:21:18.657256+0000","last_peered":"2023-12-08T08:21:18.657256+0000","last_clean":"2023-12-08T08:21:18.657256+0000","last_became_active":"2023-12-08T08:21:17.672079+0000","last_became_peered":"2023-12-08T08:21:17.672079+0000","last_unstale":"2023-12-08T08:21:18.657256+0000","last_undegraded":"2023-12-08T08:21:18.657256+0000","last_fullsized":"2023-12-08T08:21:18.657256+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:45:17.491260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.781943+0000","last_change":"2023-12-08T08:21:18.673244+0000","last_active":"2023-12-08T08:21:19.781943+0000","last_peered":"2023-12-08T08:21:19.781943+0000","last_clean":"2023-12-08T08:21:19.781943+0000","last_became_active":"2023-12-08T08:21:18.671470+0000","last_became_peered":"2023-12-08T08:21:18.671470+0000","last_unstale":"2023-12-08T08:21:19.781943+0000","last_undegraded":"2023-12-08T08:21:19.781943+0000","last_fullsized":"2023-12-08T08:21:19.781943+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:11:16.852032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"31'8","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.658886+0000","last_change":"2023-12-08T08:21:04.778814+0000","last_active":"2023-12-08T08:21:18.658886+0000","last_peered":"2023-12-08T08:21:18.658886+0000","last_clean":"2023-12-08T08:21:18.658886+0000","last_became_active":"2023-12-08T08:21:04.778501+0000","last_became_peered":"2023-12-08T08:21:04.778501+0000","last_unstale":"2023-12-08T08:21:18.658886+0000","last_undegraded":"2023-12-08T08:21:18.658886+0000","last_fullsized":"2023-12-08T08:21:18.658886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:50:52.651732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.676830+0000","last_change":"2023-12-08T08:21:05.540670+0000","last_active":"2023-12-08T08:21:18.676830+0000","last_peered":"2023-12-08T08:21:18.676830+0000","last_clean":"2023-12-08T08:21:18.676830+0000","last_became_active":"2023-12-08T08:21:05.539546+0000","last_became_peered":"2023-12-08T08:21:05.539546+0000","last_unstale":"2023-12-08T08:21:18.676830+0000","last_undegraded":"2023-12-08T08:21:18.676830+0000","last_fullsized":"2023-12-08T08:21:18.676830+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:20:39.875619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.662327+0000","last_change":"2023-12-08T08:21:17.668240+0000","last_active":"2023-12-08T08:21:18.662327+0000","last_peered":"2023-12-08T08:21:18.662327+0000","last_clean":"2023-12-08T08:21:18.662327+0000","last_became_active":"2023-12-08T08:21:17.667990+0000","last_became_peered":"2023-12-08T08:21:17.667990+0000","last_unstale":"2023-12-08T08:21:18.662327+0000","last_undegraded":"2023-12-08T08:21:18.662327+0000","last_fullsized":"2023-12-08T08:21:18.662327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:59.826879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.780526+0000","last_change":"2023-12-08T08:21:18.687161+0000","last_active":"2023-12-08T08:21:19.780526+0000","last_peered":"2023-12-08T08:21:19.780526+0000","last_clean":"2023-12-08T08:21:19.780526+0000","last_became_active":"2023-12-08T08:21:18.686856+0000","last_became_peered":"2023-12-08T08:21:18.686856+0000","last_unstale":"2023-12-08T08:21:19.780526+0000","last_undegraded":"2023-12-08T08:21:19.780526+0000","last_fullsized":"2023-12-08T08:21:19.780526+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:30:13.109897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.676997+0000","last_change":"2023-12-08T08:21:04.782195+0000","last_active":"2023-12-08T08:21:18.676997+0000","last_peered":"2023-12-08T08:21:18.676997+0000","last_clean":"2023-12-08T08:21:18.676997+0000","last_became_active":"2023-12-08T08:21:04.781298+0000","last_became_peered":"2023-12-08T08:21:04.781298+0000","last_unstale":"2023-12-08T08:21:18.676997+0000","last_undegraded":"2023-12-08T08:21:18.676997+0000","last_fullsized":"2023-12-08T08:21:18.676997+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:12.689213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.658798+0000","last_change":"2023-12-08T08:21:05.532372+0000","last_active":"2023-12-08T08:21:18.658798+0000","last_peered":"2023-12-08T08:21:18.658798+0000","last_clean":"2023-12-08T08:21:18.658798+0000","last_became_active":"2023-12-08T08:21:05.531767+0000","last_became_peered":"2023-12-08T08:21:05.531767+0000","last_unstale":"2023-12-08T08:21:18.658798+0000","last_undegraded":"2023-12-08T08:21:18.658798+0000","last_fullsized":"2023-12-08T08:21:18.658798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:30.973295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.663733+0000","last_change":"2023-12-08T08:21:17.682631+0000","last_active":"2023-12-08T08:21:18.663733+0000","last_peered":"2023-12-08T08:21:18.663733+0000","last_clean":"2023-12-08T08:21:18.663733+0000","last_became_active":"2023-12-08T08:21:17.677727+0000","last_became_peered":"2023-12-08T08:21:17.677727+0000","last_unstale":"2023-12-08T08:21:18.663733+0000","last_undegraded":"2023-12-08T08:21:18.663733+0000","last_fullsized":"2023-12-08T08:21:18.663733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:02:38.255209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.780799+0000","last_change":"2023-12-08T08:21:18.676921+0000","last_active":"2023-12-08T08:21:19.780799+0000","last_peered":"2023-12-08T08:21:19.780799+0000","last_clean":"2023-12-08T08:21:19.780799+0000","last_became_active":"2023-12-08T08:21:18.676600+0000","last_became_peered":"2023-12-08T08:21:18.676600+0000","last_unstale":"2023-12-08T08:21:19.780799+0000","last_undegraded":"2023-12-08T08:21:19.780799+0000","last_fullsized":"2023-12-08T08:21:19.780799+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:46:56.356473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.662627+0000","last_change":"2023-12-08T08:21:04.786064+0000","last_active":"2023-12-08T08:21:18.662627+0000","last_peered":"2023-12-08T08:21:18.662627+0000","last_clean":"2023-12-08T08:21:18.662627+0000","last_became_active":"2023-12-08T08:21:04.785859+0000","last_became_peered":"2023-12-08T08:21:04.785859+0000","last_unstale":"2023-12-08T08:21:18.662627+0000","last_undegraded":"2023-12-08T08:21:18.662627+0000","last_fullsized":"2023-12-08T08:21:18.662627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:12.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.659309+0000","last_change":"2023-12-08T08:21:05.532644+0000","last_active":"2023-12-08T08:21:18.659309+0000","last_peered":"2023-12-08T08:21:18.659309+0000","last_clean":"2023-12-08T08:21:18.659309+0000","last_became_active":"2023-12-08T08:21:05.530404+0000","last_became_peered":"2023-12-08T08:21:05.530404+0000","last_unstale":"2023-12-08T08:21:18.659309+0000","last_undegraded":"2023-12-08T08:21:18.659309+0000","last_fullsized":"2023-12-08T08:21:18.659309+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:05:11.193024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'6","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.703107+0000","last_change":"2023-12-08T08:21:17.677740+0000","last_active":"2023-12-08T08:21:18.703107+0000","last_peered":"2023-12-08T08:21:18.703107+0000","last_clean":"2023-12-08T08:21:18.703107+0000","last_became_active":"2023-12-08T08:21:17.672121+0000","last_became_peered":"2023-12-08T08:21:17.672121+0000","last_unstale":"2023-12-08T08:21:18.703107+0000","last_undegraded":"2023-12-08T08:21:18.703107+0000","last_fullsized":"2023-12-08T08:21:18.703107+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:23.367681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.780435+0000","last_change":"2023-12-08T08:21:18.694806+0000","last_active":"2023-12-08T08:21:19.780435+0000","last_peered":"2023-12-08T08:21:19.780435+0000","last_clean":"2023-12-08T08:21:19.780435+0000","last_became_active":"2023-12-08T08:21:18.694507+0000","last_became_peered":"2023-12-08T08:21:18.694507+0000","last_unstale":"2023-12-08T08:21:19.780435+0000","last_undegraded":"2023-12-08T08:21:19.780435+0000","last_fullsized":"2023-12-08T08:21:19.780435+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:13:11.136499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.659443+0000","last_change":"2023-12-08T08:21:04.782800+0000","last_active":"2023-12-08T08:21:18.659443+0000","last_peered":"2023-12-08T08:21:18.659443+0000","last_clean":"2023-12-08T08:21:18.659443+0000","last_became_active":"2023-12-08T08:21:04.782531+0000","last_became_peered":"2023-12-08T08:21:04.782531+0000","last_unstale":"2023-12-08T08:21:18.659443+0000","last_undegraded":"2023-12-08T08:21:18.659443+0000","last_fullsized":"2023-12-08T08:21:18.659443+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:42.018708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.677266+0000","last_change":"2023-12-08T08:21:05.533947+0000","last_active":"2023-12-08T08:21:18.677266+0000","last_peered":"2023-12-08T08:21:18.677266+0000","last_clean":"2023-12-08T08:21:18.677266+0000","last_became_active":"2023-12-08T08:21:05.533554+0000","last_became_peered":"2023-12-08T08:21:05.533554+0000","last_unstale":"2023-12-08T08:21:18.677266+0000","last_undegraded":"2023-12-08T08:21:18.677266+0000","last_fullsized":"2023-12-08T08:21:18.677266+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:25.239396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"34'3","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.694740+0000","last_change":"2023-12-08T08:21:17.679519+0000","last_active":"2023-12-08T08:21:18.694740+0000","last_peered":"2023-12-08T08:21:18.694740+0000","last_clean":"2023-12-08T08:21:18.694740+0000","last_became_active":"2023-12-08T08:21:17.679265+0000","last_became_peered":"2023-12-08T08:21:17.679265+0000","last_unstale":"2023-12-08T08:21:18.694740+0000","last_undegraded":"2023-12-08T08:21:18.694740+0000","last_fullsized":"2023-12-08T08:21:18.694740+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:24.695194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.779505+0000","last_change":"2023-12-08T08:21:18.698679+0000","last_active":"2023-12-08T08:21:19.779505+0000","last_peered":"2023-12-08T08:21:19.779505+0000","last_clean":"2023-12-08T08:21:19.779505+0000","last_became_active":"2023-12-08T08:21:18.697569+0000","last_became_peered":"2023-12-08T08:21:18.697569+0000","last_unstale":"2023-12-08T08:21:19.779505+0000","last_undegraded":"2023-12-08T08:21:19.779505+0000","last_fullsized":"2023-12-08T08:21:19.779505+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:45:18.499264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.665048+0000","last_change":"2023-12-08T08:21:04.776553+0000","last_active":"2023-12-08T08:21:18.665048+0000","last_peered":"2023-12-08T08:21:18.665048+0000","last_clean":"2023-12-08T08:21:18.665048+0000","last_became_active":"2023-12-08T08:21:04.773755+0000","last_became_peered":"2023-12-08T08:21:04.773755+0000","last_unstale":"2023-12-08T08:21:18.665048+0000","last_undegraded":"2023-12-08T08:21:18.665048+0000","last_fullsized":"2023-12-08T08:21:18.665048+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:12.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.663537+0000","last_change":"2023-12-08T08:21:05.536397+0000","last_active":"2023-12-08T08:21:18.663537+0000","last_peered":"2023-12-08T08:21:18.663537+0000","last_clean":"2023-12-08T08:21:18.663537+0000","last_became_active":"2023-12-08T08:21:05.536103+0000","last_became_peered":"2023-12-08T08:21:05.536103+0000","last_unstale":"2023-12-08T08:21:18.663537+0000","last_undegraded":"2023-12-08T08:21:18.663537+0000","last_fullsized":"2023-12-08T08:21:18.663537+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:44.030312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.685569+0000","last_change":"2023-12-08T08:21:17.671190+0000","last_active":"2023-12-08T08:21:18.685569+0000","last_peered":"2023-12-08T08:21:18.685569+0000","last_clean":"2023-12-08T08:21:18.685569+0000","last_became_active":"2023-12-08T08:21:17.670895+0000","last_became_peered":"2023-12-08T08:21:17.670895+0000","last_unstale":"2023-12-08T08:21:18.685569+0000","last_undegraded":"2023-12-08T08:21:18.685569+0000","last_fullsized":"2023-12-08T08:21:18.685569+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:59.826879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.779458+0000","last_change":"2023-12-08T08:21:18.693020+0000","last_active":"2023-12-08T08:21:19.779458+0000","last_peered":"2023-12-08T08:21:19.779458+0000","last_clean":"2023-12-08T08:21:19.779458+0000","last_became_active":"2023-12-08T08:21:18.692716+0000","last_became_peered":"2023-12-08T08:21:18.692716+0000","last_unstale":"2023-12-08T08:21:19.779458+0000","last_undegraded":"2023-12-08T08:21:19.779458+0000","last_fullsized":"2023-12-08T08:21:19.779458+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:44:58.497416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.657370+0000","last_change":"2023-12-08T08:21:04.780723+0000","last_active":"2023-12-08T08:21:18.657370+0000","last_peered":"2023-12-08T08:21:18.657370+0000","last_clean":"2023-12-08T08:21:18.657370+0000","last_became_active":"2023-12-08T08:21:04.780436+0000","last_became_peered":"2023-12-08T08:21:04.780436+0000","last_unstale":"2023-12-08T08:21:18.657370+0000","last_undegraded":"2023-12-08T08:21:18.657370+0000","last_fullsized":"2023-12-08T08:21:18.657370+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:12.689213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.664957+0000","last_change":"2023-12-08T08:21:05.535708+0000","last_active":"2023-12-08T08:21:18.664957+0000","last_peered":"2023-12-08T08:21:18.664957+0000","last_clean":"2023-12-08T08:21:18.664957+0000","last_became_active":"2023-12-08T08:21:05.527959+0000","last_became_peered":"2023-12-08T08:21:05.527959+0000","last_unstale":"2023-12-08T08:21:18.664957+0000","last_undegraded":"2023-12-08T08:21:18.664957+0000","last_fullsized":"2023-12-08T08:21:18.664957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:14:18.284764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.697207+0000","last_change":"2023-12-08T08:21:17.681447+0000","last_active":"2023-12-08T08:21:18.697207+0000","last_peered":"2023-12-08T08:21:18.697207+0000","last_clean":"2023-12-08T08:21:18.697207+0000","last_became_active":"2023-12-08T08:21:17.680989+0000","last_became_peered":"2023-12-08T08:21:17.680989+0000","last_unstale":"2023-12-08T08:21:18.697207+0000","last_undegraded":"2023-12-08T08:21:18.697207+0000","last_fullsized":"2023-12-08T08:21:18.697207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:13.353990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.779346+0000","last_change":"2023-12-08T08:21:18.679948+0000","last_active":"2023-12-08T08:21:19.779346+0000","last_peered":"2023-12-08T08:21:19.779346+0000","last_clean":"2023-12-08T08:21:19.779346+0000","last_became_active":"2023-12-08T08:21:18.679366+0000","last_became_peered":"2023-12-08T08:21:18.679366+0000","last_unstale":"2023-12-08T08:21:19.779346+0000","last_undegraded":"2023-12-08T08:21:19.779346+0000","last_fullsized":"2023-12-08T08:21:19.779346+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:46:02.679876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.663209+0000","last_change":"2023-12-08T08:21:04.783596+0000","last_active":"2023-12-08T08:21:18.663209+0000","last_peered":"2023-12-08T08:21:18.663209+0000","last_clean":"2023-12-08T08:21:18.663209+0000","last_became_active":"2023-12-08T08:21:04.783159+0000","last_became_peered":"2023-12-08T08:21:04.783159+0000","last_unstale":"2023-12-08T08:21:18.663209+0000","last_undegraded":"2023-12-08T08:21:18.663209+0000","last_fullsized":"2023-12-08T08:21:18.663209+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:43.027429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.676370+0000","last_change":"2023-12-08T08:21:05.537414+0000","last_active":"2023-12-08T08:21:18.676370+0000","last_peered":"2023-12-08T08:21:18.676370+0000","last_clean":"2023-12-08T08:21:18.676370+0000","last_became_active":"2023-12-08T08:21:05.537137+0000","last_became_peered":"2023-12-08T08:21:05.537137+0000","last_unstale":"2023-12-08T08:21:18.676370+0000","last_undegraded":"2023-12-08T08:21:18.676370+0000","last_fullsized":"2023-12-08T08:21:18.676370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:08.596525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.659482+0000","last_change":"2023-12-08T08:21:17.676027+0000","last_active":"2023-12-08T08:21:18.659482+0000","last_peered":"2023-12-08T08:21:18.659482+0000","last_clean":"2023-12-08T08:21:18.659482+0000","last_became_active":"2023-12-08T08:21:17.675823+0000","last_became_peered":"2023-12-08T08:21:17.675823+0000","last_unstale":"2023-12-08T08:21:18.659482+0000","last_undegraded":"2023-12-08T08:21:18.659482+0000","last_fullsized":"2023-12-08T08:21:18.659482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:10:08.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.777792+0000","last_change":"2023-12-08T08:21:18.671175+0000","last_active":"2023-12-08T08:21:19.777792+0000","last_peered":"2023-12-08T08:21:19.777792+0000","last_clean":"2023-12-08T08:21:19.777792+0000","last_became_active":"2023-12-08T08:21:18.670782+0000","last_became_peered":"2023-12-08T08:21:18.670782+0000","last_unstale":"2023-12-08T08:21:19.777792+0000","last_undegraded":"2023-12-08T08:21:19.777792+0000","last_fullsized":"2023-12-08T08:21:19.777792+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:50:50.244454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.665576+0000","last_change":"2023-12-08T08:21:04.784944+0000","last_active":"2023-12-08T08:21:18.665576+0000","last_peered":"2023-12-08T08:21:18.665576+0000","last_clean":"2023-12-08T08:21:18.665576+0000","last_became_active":"2023-12-08T08:21:04.784657+0000","last_became_peered":"2023-12-08T08:21:04.784657+0000","last_unstale":"2023-12-08T08:21:18.665576+0000","last_undegraded":"2023-12-08T08:21:18.665576+0000","last_fullsized":"2023-12-08T08:21:18.665576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:51:05.330323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.656487+0000","last_change":"2023-12-08T08:21:05.542808+0000","last_active":"2023-12-08T08:21:18.656487+0000","last_peered":"2023-12-08T08:21:18.656487+0000","last_clean":"2023-12-08T08:21:18.656487+0000","last_became_active":"2023-12-08T08:21:05.542495+0000","last_became_peered":"2023-12-08T08:21:05.542495+0000","last_unstale":"2023-12-08T08:21:18.656487+0000","last_undegraded":"2023-12-08T08:21:18.656487+0000","last_fullsized":"2023-12-08T08:21:18.656487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:50:53.654615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.669754+0000","last_change":"2023-12-08T08:21:17.681699+0000","last_active":"2023-12-08T08:21:18.669754+0000","last_peered":"2023-12-08T08:21:18.669754+0000","last_clean":"2023-12-08T08:21:18.669754+0000","last_became_active":"2023-12-08T08:21:17.681356+0000","last_became_peered":"2023-12-08T08:21:17.681356+0000","last_unstale":"2023-12-08T08:21:18.669754+0000","last_undegraded":"2023-12-08T08:21:18.669754+0000","last_fullsized":"2023-12-08T08:21:18.669754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:02:38.255209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.781960+0000","last_change":"2023-12-08T08:21:18.676231+0000","last_active":"2023-12-08T08:21:19.781960+0000","last_peered":"2023-12-08T08:21:19.781960+0000","last_clean":"2023-12-08T08:21:19.781960+0000","last_became_active":"2023-12-08T08:21:18.675645+0000","last_became_peered":"2023-12-08T08:21:18.675645+0000","last_unstale":"2023-12-08T08:21:19.781960+0000","last_undegraded":"2023-12-08T08:21:19.781960+0000","last_fullsized":"2023-12-08T08:21:19.781960+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:55:56.558304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.692712+0000","last_change":"2023-12-08T08:21:17.674547+0000","last_active":"2023-12-08T08:21:18.692712+0000","last_peered":"2023-12-08T08:21:18.692712+0000","last_clean":"2023-12-08T08:21:18.692712+0000","last_became_active":"2023-12-08T08:21:17.674313+0000","last_became_peered":"2023-12-08T08:21:17.674313+0000","last_unstale":"2023-12-08T08:21:18.692712+0000","last_undegraded":"2023-12-08T08:21:18.692712+0000","last_fullsized":"2023-12-08T08:21:18.692712+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:41:10.487912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.667883+0000","last_change":"2023-12-08T08:21:04.773475+0000","last_active":"2023-12-08T08:21:18.667883+0000","last_peered":"2023-12-08T08:21:18.667883+0000","last_clean":"2023-12-08T08:21:18.667883+0000","last_became_active":"2023-12-08T08:21:04.773125+0000","last_became_peered":"2023-12-08T08:21:04.773125+0000","last_unstale":"2023-12-08T08:21:18.667883+0000","last_undegraded":"2023-12-08T08:21:18.667883+0000","last_fullsized":"2023-12-08T08:21:18.667883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:00:34.107681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.663048+0000","last_change":"2023-12-08T08:21:05.527749+0000","last_active":"2023-12-08T08:21:18.663048+0000","last_peered":"2023-12-08T08:21:18.663048+0000","last_clean":"2023-12-08T08:21:18.663048+0000","last_became_active":"2023-12-08T08:21:05.527397+0000","last_became_peered":"2023-12-08T08:21:05.527397+0000","last_unstale":"2023-12-08T08:21:18.663048+0000","last_undegraded":"2023-12-08T08:21:18.663048+0000","last_fullsized":"2023-12-08T08:21:18.663048+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:13.692096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.679182+0000","last_change":"2023-12-08T08:21:18.669518+0000","last_active":"2023-12-08T08:21:19.679182+0000","last_peered":"2023-12-08T08:21:19.679182+0000","last_clean":"2023-12-08T08:21:19.679182+0000","last_became_active":"2023-12-08T08:21:18.669037+0000","last_became_peered":"2023-12-08T08:21:18.669037+0000","last_unstale":"2023-12-08T08:21:19.679182+0000","last_undegraded":"2023-12-08T08:21:19.679182+0000","last_fullsized":"2023-12-08T08:21:19.679182+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:55:56.558304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"34'4","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.700181+0000","last_change":"2023-12-08T08:21:17.682288+0000","last_active":"2023-12-08T08:21:18.700181+0000","last_peered":"2023-12-08T08:21:18.700181+0000","last_clean":"2023-12-08T08:21:18.700181+0000","last_became_active":"2023-12-08T08:21:17.680967+0000","last_became_peered":"2023-12-08T08:21:17.680967+0000","last_unstale":"2023-12-08T08:21:18.700181+0000","last_undegraded":"2023-12-08T08:21:18.700181+0000","last_fullsized":"2023-12-08T08:21:18.700181+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:44:13.905463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.658685+0000","last_change":"2023-12-08T08:21:04.778223+0000","last_active":"2023-12-08T08:21:18.658685+0000","last_peered":"2023-12-08T08:21:18.658685+0000","last_clean":"2023-12-08T08:21:18.658685+0000","last_became_active":"2023-12-08T08:21:04.777902+0000","last_became_peered":"2023-12-08T08:21:04.777902+0000","last_unstale":"2023-12-08T08:21:18.658685+0000","last_undegraded":"2023-12-08T08:21:18.658685+0000","last_fullsized":"2023-12-08T08:21:18.658685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:07.593642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.666014+0000","last_change":"2023-12-08T08:21:05.532257+0000","last_active":"2023-12-08T08:21:18.666014+0000","last_peered":"2023-12-08T08:21:18.666014+0000","last_clean":"2023-12-08T08:21:18.666014+0000","last_became_active":"2023-12-08T08:21:05.531965+0000","last_became_peered":"2023-12-08T08:21:05.531965+0000","last_unstale":"2023-12-08T08:21:18.666014+0000","last_undegraded":"2023-12-08T08:21:18.666014+0000","last_fullsized":"2023-12-08T08:21:18.666014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:23.756612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.679036+0000","last_change":"2023-12-08T08:21:18.680426+0000","last_active":"2023-12-08T08:21:19.679036+0000","last_peered":"2023-12-08T08:21:19.679036+0000","last_clean":"2023-12-08T08:21:19.679036+0000","last_became_active":"2023-12-08T08:21:18.680034+0000","last_became_peered":"2023-12-08T08:21:18.680034+0000","last_unstale":"2023-12-08T08:21:19.679036+0000","last_undegraded":"2023-12-08T08:21:19.679036+0000","last_fullsized":"2023-12-08T08:21:19.679036+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:38.014565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.662551+0000","last_change":"2023-12-08T08:21:04.780684+0000","last_active":"2023-12-08T08:21:18.662551+0000","last_peered":"2023-12-08T08:21:18.662551+0000","last_clean":"2023-12-08T08:21:18.662551+0000","last_became_active":"2023-12-08T08:21:04.780321+0000","last_became_peered":"2023-12-08T08:21:04.780321+0000","last_unstale":"2023-12-08T08:21:18.662551+0000","last_undegraded":"2023-12-08T08:21:18.662551+0000","last_fullsized":"2023-12-08T08:21:18.662551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:13.006406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.662691+0000","last_change":"2023-12-08T08:21:05.531374+0000","last_active":"2023-12-08T08:21:18.662691+0000","last_peered":"2023-12-08T08:21:18.662691+0000","last_clean":"2023-12-08T08:21:18.662691+0000","last_became_active":"2023-12-08T08:21:05.531104+0000","last_became_peered":"2023-12-08T08:21:05.531104+0000","last_unstale":"2023-12-08T08:21:18.662691+0000","last_undegraded":"2023-12-08T08:21:18.662691+0000","last_fullsized":"2023-12-08T08:21:18.662691+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:04.403116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.684807+0000","last_change":"2023-12-08T08:21:17.684363+0000","last_active":"2023-12-08T08:21:18.684807+0000","last_peered":"2023-12-08T08:21:18.684807+0000","last_clean":"2023-12-08T08:21:18.684807+0000","last_became_active":"2023-12-08T08:21:17.683896+0000","last_became_peered":"2023-12-08T08:21:17.683896+0000","last_unstale":"2023-12-08T08:21:18.684807+0000","last_undegraded":"2023-12-08T08:21:18.684807+0000","last_fullsized":"2023-12-08T08:21:18.684807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:41:10.487912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.679249+0000","last_change":"2023-12-08T08:21:18.683551+0000","last_active":"2023-12-08T08:21:19.679249+0000","last_peered":"2023-12-08T08:21:19.679249+0000","last_clean":"2023-12-08T08:21:19.679249+0000","last_became_active":"2023-12-08T08:21:18.683245+0000","last_became_peered":"2023-12-08T08:21:18.683245+0000","last_unstale":"2023-12-08T08:21:19.679249+0000","last_undegraded":"2023-12-08T08:21:19.679249+0000","last_fullsized":"2023-12-08T08:21:19.679249+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:30:13.109897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.662791+0000","last_change":"2023-12-08T08:21:04.777030+0000","last_active":"2023-12-08T08:21:18.662791+0000","last_peered":"2023-12-08T08:21:18.662791+0000","last_clean":"2023-12-08T08:21:18.662791+0000","last_became_active":"2023-12-08T08:21:04.775911+0000","last_became_peered":"2023-12-08T08:21:04.775911+0000","last_unstale":"2023-12-08T08:21:18.662791+0000","last_undegraded":"2023-12-08T08:21:18.662791+0000","last_fullsized":"2023-12-08T08:21:18.662791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:03.740954+0000","last_clean_scrub_stamp":"2023-12-08T08:21:03.740954+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:29.810210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.662465+0000","last_change":"2023-12-08T08:21:05.532180+0000","last_active":"2023-12-08T08:21:18.662465+0000","last_peered":"2023-12-08T08:21:18.662465+0000","last_clean":"2023-12-08T08:21:18.662465+0000","last_became_active":"2023-12-08T08:21:05.529640+0000","last_became_peered":"2023-12-08T08:21:05.529640+0000","last_unstale":"2023-12-08T08:21:18.662465+0000","last_undegraded":"2023-12-08T08:21:18.662465+0000","last_fullsized":"2023-12-08T08:21:18.662465+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:11.477913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.696464+0000","last_change":"2023-12-08T08:21:17.680905+0000","last_active":"2023-12-08T08:21:18.696464+0000","last_peered":"2023-12-08T08:21:18.696464+0000","last_clean":"2023-12-08T08:21:18.696464+0000","last_became_active":"2023-12-08T08:21:17.680651+0000","last_became_peered":"2023-12-08T08:21:17.680651+0000","last_unstale":"2023-12-08T08:21:18.696464+0000","last_undegraded":"2023-12-08T08:21:18.696464+0000","last_fullsized":"2023-12-08T08:21:18.696464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:16.633604+0000","last_clean_scrub_stamp":"2023-12-08T08:21:16.633604+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:54.148326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.779293+0000","last_change":"2023-12-08T08:21:18.692149+0000","last_active":"2023-12-08T08:21:19.779293+0000","last_peered":"2023-12-08T08:21:19.779293+0000","last_clean":"2023-12-08T08:21:19.779293+0000","last_became_active":"2023-12-08T08:21:18.691852+0000","last_became_peered":"2023-12-08T08:21:18.691852+0000","last_unstale":"2023-12-08T08:21:19.779293+0000","last_undegraded":"2023-12-08T08:21:19.779293+0000","last_fullsized":"2023-12-08T08:21:19.779293+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:50:50.244454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.656692+0000","last_change":"2023-12-08T08:21:05.539808+0000","last_active":"2023-12-08T08:21:18.656692+0000","last_peered":"2023-12-08T08:21:18.656692+0000","last_clean":"2023-12-08T08:21:18.656692+0000","last_became_active":"2023-12-08T08:21:05.539443+0000","last_became_peered":"2023-12-08T08:21:05.539443+0000","last_unstale":"2023-12-08T08:21:18.656692+0000","last_undegraded":"2023-12-08T08:21:18.656692+0000","last_fullsized":"2023-12-08T08:21:18.656692+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:20:39.875619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.781024+0000","last_change":"2023-12-08T08:21:18.680562+0000","last_active":"2023-12-08T08:21:19.781024+0000","last_peered":"2023-12-08T08:21:19.781024+0000","last_clean":"2023-12-08T08:21:19.781024+0000","last_became_active":"2023-12-08T08:21:18.679460+0000","last_became_peered":"2023-12-08T08:21:18.679460+0000","last_unstale":"2023-12-08T08:21:19.781024+0000","last_undegraded":"2023-12-08T08:21:19.781024+0000","last_fullsized":"2023-12-08T08:21:19.781024+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:50:11.945329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.665146+0000","last_change":"2023-12-08T08:21:05.532086+0000","last_active":"2023-12-08T08:21:18.665146+0000","last_peered":"2023-12-08T08:21:18.665146+0000","last_clean":"2023-12-08T08:21:18.665146+0000","last_became_active":"2023-12-08T08:21:05.531583+0000","last_became_peered":"2023-12-08T08:21:05.531583+0000","last_unstale":"2023-12-08T08:21:18.665146+0000","last_undegraded":"2023-12-08T08:21:18.665146+0000","last_fullsized":"2023-12-08T08:21:18.665146+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:02:13.936073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.779131+0000","last_change":"2023-12-08T08:21:18.686979+0000","last_active":"2023-12-08T08:21:19.779131+0000","last_peered":"2023-12-08T08:21:19.779131+0000","last_clean":"2023-12-08T08:21:19.779131+0000","last_became_active":"2023-12-08T08:21:18.686503+0000","last_became_peered":"2023-12-08T08:21:18.686503+0000","last_unstale":"2023-12-08T08:21:19.779131+0000","last_undegraded":"2023-12-08T08:21:19.779131+0000","last_fullsized":"2023-12-08T08:21:19.779131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:21.494297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.656389+0000","last_change":"2023-12-08T08:21:05.530432+0000","last_active":"2023-12-08T08:21:18.656389+0000","last_peered":"2023-12-08T08:21:18.656389+0000","last_clean":"2023-12-08T08:21:18.656389+0000","last_became_active":"2023-12-08T08:21:05.530065+0000","last_became_peered":"2023-12-08T08:21:05.530065+0000","last_unstale":"2023-12-08T08:21:18.656389+0000","last_undegraded":"2023-12-08T08:21:18.656389+0000","last_fullsized":"2023-12-08T08:21:18.656389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:43.021591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.778223+0000","last_change":"2023-12-08T08:21:18.685405+0000","last_active":"2023-12-08T08:21:19.778223+0000","last_peered":"2023-12-08T08:21:19.778223+0000","last_clean":"2023-12-08T08:21:19.778223+0000","last_became_active":"2023-12-08T08:21:18.683530+0000","last_became_peered":"2023-12-08T08:21:18.683530+0000","last_unstale":"2023-12-08T08:21:19.778223+0000","last_undegraded":"2023-12-08T08:21:19.778223+0000","last_fullsized":"2023-12-08T08:21:19.778223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:16:58.247035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.665478+0000","last_change":"2023-12-08T08:21:05.531803+0000","last_active":"2023-12-08T08:21:18.665478+0000","last_peered":"2023-12-08T08:21:18.665478+0000","last_clean":"2023-12-08T08:21:18.665478+0000","last_became_active":"2023-12-08T08:21:05.531470+0000","last_became_peered":"2023-12-08T08:21:05.531470+0000","last_unstale":"2023-12-08T08:21:18.665478+0000","last_undegraded":"2023-12-08T08:21:18.665478+0000","last_fullsized":"2023-12-08T08:21:18.665478+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:37.538055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.778826+0000","last_change":"2023-12-08T08:21:18.687822+0000","last_active":"2023-12-08T08:21:19.778826+0000","last_peered":"2023-12-08T08:21:19.778826+0000","last_clean":"2023-12-08T08:21:19.778826+0000","last_became_active":"2023-12-08T08:21:18.687555+0000","last_became_peered":"2023-12-08T08:21:18.687555+0000","last_unstale":"2023-12-08T08:21:19.778826+0000","last_undegraded":"2023-12-08T08:21:19.778826+0000","last_fullsized":"2023-12-08T08:21:19.778826+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:26.589867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.679457+0000","last_change":"2023-12-08T08:21:05.538326+0000","last_active":"2023-12-08T08:21:18.679457+0000","last_peered":"2023-12-08T08:21:18.679457+0000","last_clean":"2023-12-08T08:21:18.679457+0000","last_became_active":"2023-12-08T08:21:05.538042+0000","last_became_peered":"2023-12-08T08:21:05.538042+0000","last_unstale":"2023-12-08T08:21:18.679457+0000","last_undegraded":"2023-12-08T08:21:18.679457+0000","last_fullsized":"2023-12-08T08:21:18.679457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:30.973295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.782031+0000","last_change":"2023-12-08T08:21:18.675967+0000","last_active":"2023-12-08T08:21:19.782031+0000","last_peered":"2023-12-08T08:21:19.782031+0000","last_clean":"2023-12-08T08:21:19.782031+0000","last_became_active":"2023-12-08T08:21:18.675260+0000","last_became_peered":"2023-12-08T08:21:18.675260+0000","last_unstale":"2023-12-08T08:21:19.782031+0000","last_undegraded":"2023-12-08T08:21:19.782031+0000","last_fullsized":"2023-12-08T08:21:19.782031+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:13.065346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.663126+0000","last_change":"2023-12-08T08:21:05.538170+0000","last_active":"2023-12-08T08:21:18.663126+0000","last_peered":"2023-12-08T08:21:18.663126+0000","last_clean":"2023-12-08T08:21:18.663126+0000","last_became_active":"2023-12-08T08:21:05.537834+0000","last_became_peered":"2023-12-08T08:21:05.537834+0000","last_unstale":"2023-12-08T08:21:18.663126+0000","last_undegraded":"2023-12-08T08:21:18.663126+0000","last_fullsized":"2023-12-08T08:21:18.663126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:23.756612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.679137+0000","last_change":"2023-12-08T08:21:18.685917+0000","last_active":"2023-12-08T08:21:19.679137+0000","last_peered":"2023-12-08T08:21:19.679137+0000","last_clean":"2023-12-08T08:21:19.679137+0000","last_became_active":"2023-12-08T08:21:18.685241+0000","last_became_peered":"2023-12-08T08:21:18.685241+0000","last_unstale":"2023-12-08T08:21:19.679137+0000","last_undegraded":"2023-12-08T08:21:19.679137+0000","last_fullsized":"2023-12-08T08:21:19.679137+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:17:07.445675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.661046+0000","last_change":"2023-12-08T08:21:05.532516+0000","last_active":"2023-12-08T08:21:18.661046+0000","last_peered":"2023-12-08T08:21:18.661046+0000","last_clean":"2023-12-08T08:21:18.661046+0000","last_became_active":"2023-12-08T08:21:05.531827+0000","last_became_peered":"2023-12-08T08:21:05.531827+0000","last_unstale":"2023-12-08T08:21:18.661046+0000","last_undegraded":"2023-12-08T08:21:18.661046+0000","last_fullsized":"2023-12-08T08:21:18.661046+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:49:59.047557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.779307+0000","last_change":"2023-12-08T08:21:18.684963+0000","last_active":"2023-12-08T08:21:19.779307+0000","last_peered":"2023-12-08T08:21:19.779307+0000","last_clean":"2023-12-08T08:21:19.779307+0000","last_became_active":"2023-12-08T08:21:18.684659+0000","last_became_peered":"2023-12-08T08:21:18.684659+0000","last_unstale":"2023-12-08T08:21:19.779307+0000","last_undegraded":"2023-12-08T08:21:19.779307+0000","last_fullsized":"2023-12-08T08:21:19.779307+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:56:26.680603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.666996+0000","last_change":"2023-12-08T08:21:05.531201+0000","last_active":"2023-12-08T08:21:18.666996+0000","last_peered":"2023-12-08T08:21:18.666996+0000","last_clean":"2023-12-08T08:21:18.666996+0000","last_became_active":"2023-12-08T08:21:05.530935+0000","last_became_peered":"2023-12-08T08:21:05.530935+0000","last_unstale":"2023-12-08T08:21:18.666996+0000","last_undegraded":"2023-12-08T08:21:18.666996+0000","last_fullsized":"2023-12-08T08:21:18.666996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:37.538055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.778712+0000","last_change":"2023-12-08T08:21:18.675671+0000","last_active":"2023-12-08T08:21:19.778712+0000","last_peered":"2023-12-08T08:21:19.778712+0000","last_clean":"2023-12-08T08:21:19.778712+0000","last_became_active":"2023-12-08T08:21:18.675394+0000","last_became_peered":"2023-12-08T08:21:18.675394+0000","last_unstale":"2023-12-08T08:21:19.778712+0000","last_undegraded":"2023-12-08T08:21:19.778712+0000","last_fullsized":"2023-12-08T08:21:19.778712+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:05:09.257229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.670966+0000","last_change":"2023-12-08T08:21:05.535454+0000","last_active":"2023-12-08T08:21:18.670966+0000","last_peered":"2023-12-08T08:21:18.670966+0000","last_clean":"2023-12-08T08:21:18.670966+0000","last_became_active":"2023-12-08T08:21:05.535095+0000","last_became_peered":"2023-12-08T08:21:05.535095+0000","last_unstale":"2023-12-08T08:21:18.670966+0000","last_undegraded":"2023-12-08T08:21:18.670966+0000","last_fullsized":"2023-12-08T08:21:18.670966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:50:53.654615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.779031+0000","last_change":"2023-12-08T08:21:18.677913+0000","last_active":"2023-12-08T08:21:19.779031+0000","last_peered":"2023-12-08T08:21:19.779031+0000","last_clean":"2023-12-08T08:21:19.779031+0000","last_became_active":"2023-12-08T08:21:18.676873+0000","last_became_peered":"2023-12-08T08:21:18.676873+0000","last_unstale":"2023-12-08T08:21:19.779031+0000","last_undegraded":"2023-12-08T08:21:19.779031+0000","last_fullsized":"2023-12-08T08:21:19.779031+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:01:41.440330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.659726+0000","last_change":"2023-12-08T08:21:05.534953+0000","last_active":"2023-12-08T08:21:18.659726+0000","last_peered":"2023-12-08T08:21:18.659726+0000","last_clean":"2023-12-08T08:21:18.659726+0000","last_became_active":"2023-12-08T08:21:05.531291+0000","last_became_peered":"2023-12-08T08:21:05.531291+0000","last_unstale":"2023-12-08T08:21:18.659726+0000","last_undegraded":"2023-12-08T08:21:18.659726+0000","last_fullsized":"2023-12-08T08:21:18.659726+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:05:47.419331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.779191+0000","last_change":"2023-12-08T08:21:18.682424+0000","last_active":"2023-12-08T08:21:19.779191+0000","last_peered":"2023-12-08T08:21:19.779191+0000","last_clean":"2023-12-08T08:21:19.779191+0000","last_became_active":"2023-12-08T08:21:18.681983+0000","last_became_peered":"2023-12-08T08:21:18.681983+0000","last_unstale":"2023-12-08T08:21:19.779191+0000","last_undegraded":"2023-12-08T08:21:19.779191+0000","last_fullsized":"2023-12-08T08:21:19.779191+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:43.871066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.662954+0000","last_change":"2023-12-08T08:21:05.529673+0000","last_active":"2023-12-08T08:21:18.662954+0000","last_peered":"2023-12-08T08:21:18.662954+0000","last_clean":"2023-12-08T08:21:18.662954+0000","last_became_active":"2023-12-08T08:21:05.528239+0000","last_became_peered":"2023-12-08T08:21:05.528239+0000","last_unstale":"2023-12-08T08:21:18.662954+0000","last_undegraded":"2023-12-08T08:21:18.662954+0000","last_fullsized":"2023-12-08T08:21:18.662954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:19.928543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.780524+0000","last_change":"2023-12-08T08:21:18.680134+0000","last_active":"2023-12-08T08:21:19.780524+0000","last_peered":"2023-12-08T08:21:19.780524+0000","last_clean":"2023-12-08T08:21:19.780524+0000","last_became_active":"2023-12-08T08:21:18.679407+0000","last_became_peered":"2023-12-08T08:21:18.679407+0000","last_unstale":"2023-12-08T08:21:19.780524+0000","last_undegraded":"2023-12-08T08:21:19.780524+0000","last_fullsized":"2023-12-08T08:21:19.780524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:18.865776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.665388+0000","last_change":"2023-12-08T08:21:05.523783+0000","last_active":"2023-12-08T08:21:18.665388+0000","last_peered":"2023-12-08T08:21:18.665388+0000","last_clean":"2023-12-08T08:21:18.665388+0000","last_became_active":"2023-12-08T08:21:05.523509+0000","last_became_peered":"2023-12-08T08:21:05.523509+0000","last_unstale":"2023-12-08T08:21:18.665388+0000","last_undegraded":"2023-12-08T08:21:18.665388+0000","last_fullsized":"2023-12-08T08:21:18.665388+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:11.477913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.780432+0000","last_change":"2023-12-08T08:21:18.687180+0000","last_active":"2023-12-08T08:21:19.780432+0000","last_peered":"2023-12-08T08:21:19.780432+0000","last_clean":"2023-12-08T08:21:19.780432+0000","last_became_active":"2023-12-08T08:21:18.686932+0000","last_became_peered":"2023-12-08T08:21:18.686932+0000","last_unstale":"2023-12-08T08:21:19.780432+0000","last_undegraded":"2023-12-08T08:21:19.780432+0000","last_fullsized":"2023-12-08T08:21:19.780432+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:17:07.445675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.667807+0000","last_change":"2023-12-08T08:21:05.538014+0000","last_active":"2023-12-08T08:21:18.667807+0000","last_peered":"2023-12-08T08:21:18.667807+0000","last_clean":"2023-12-08T08:21:18.667807+0000","last_became_active":"2023-12-08T08:21:05.537721+0000","last_became_peered":"2023-12-08T08:21:05.537721+0000","last_unstale":"2023-12-08T08:21:18.667807+0000","last_undegraded":"2023-12-08T08:21:18.667807+0000","last_fullsized":"2023-12-08T08:21:18.667807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:30.813093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.780283+0000","last_change":"2023-12-08T08:21:18.686610+0000","last_active":"2023-12-08T08:21:19.780283+0000","last_peered":"2023-12-08T08:21:19.780283+0000","last_clean":"2023-12-08T08:21:19.780283+0000","last_became_active":"2023-12-08T08:21:18.686336+0000","last_became_peered":"2023-12-08T08:21:18.686336+0000","last_unstale":"2023-12-08T08:21:19.780283+0000","last_undegraded":"2023-12-08T08:21:19.780283+0000","last_fullsized":"2023-12-08T08:21:19.780283+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:49:40.221530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.658596+0000","last_change":"2023-12-08T08:21:05.525566+0000","last_active":"2023-12-08T08:21:18.658596+0000","last_peered":"2023-12-08T08:21:18.658596+0000","last_clean":"2023-12-08T08:21:18.658596+0000","last_became_active":"2023-12-08T08:21:05.525251+0000","last_became_peered":"2023-12-08T08:21:05.525251+0000","last_unstale":"2023-12-08T08:21:18.658596+0000","last_undegraded":"2023-12-08T08:21:18.658596+0000","last_fullsized":"2023-12-08T08:21:18.658596+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:09:56.356105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.779156+0000","last_change":"2023-12-08T08:21:18.698449+0000","last_active":"2023-12-08T08:21:19.779156+0000","last_peered":"2023-12-08T08:21:19.779156+0000","last_clean":"2023-12-08T08:21:19.779156+0000","last_became_active":"2023-12-08T08:21:18.698167+0000","last_became_peered":"2023-12-08T08:21:18.698167+0000","last_unstale":"2023-12-08T08:21:19.779156+0000","last_undegraded":"2023-12-08T08:21:19.779156+0000","last_fullsized":"2023-12-08T08:21:19.779156+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:55.919363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.659976+0000","last_change":"2023-12-08T08:21:05.530770+0000","last_active":"2023-12-08T08:21:18.659976+0000","last_peered":"2023-12-08T08:21:18.659976+0000","last_clean":"2023-12-08T08:21:18.659976+0000","last_became_active":"2023-12-08T08:21:05.530517+0000","last_became_peered":"2023-12-08T08:21:05.530517+0000","last_unstale":"2023-12-08T08:21:18.659976+0000","last_undegraded":"2023-12-08T08:21:18.659976+0000","last_fullsized":"2023-12-08T08:21:18.659976+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:05.968004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.781383+0000","last_change":"2023-12-08T08:21:18.688658+0000","last_active":"2023-12-08T08:21:19.781383+0000","last_peered":"2023-12-08T08:21:19.781383+0000","last_clean":"2023-12-08T08:21:19.781383+0000","last_became_active":"2023-12-08T08:21:18.688287+0000","last_became_peered":"2023-12-08T08:21:18.688287+0000","last_unstale":"2023-12-08T08:21:19.781383+0000","last_undegraded":"2023-12-08T08:21:19.781383+0000","last_fullsized":"2023-12-08T08:21:19.781383+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:38.014565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.658415+0000","last_change":"2023-12-08T08:21:05.532053+0000","last_active":"2023-12-08T08:21:18.658415+0000","last_peered":"2023-12-08T08:21:18.658415+0000","last_clean":"2023-12-08T08:21:18.658415+0000","last_became_active":"2023-12-08T08:21:05.531799+0000","last_became_peered":"2023-12-08T08:21:05.531799+0000","last_unstale":"2023-12-08T08:21:18.658415+0000","last_undegraded":"2023-12-08T08:21:18.658415+0000","last_fullsized":"2023-12-08T08:21:18.658415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:12:05.968004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.778444+0000","last_change":"2023-12-08T08:21:18.672224+0000","last_active":"2023-12-08T08:21:19.778444+0000","last_peered":"2023-12-08T08:21:19.778444+0000","last_clean":"2023-12-08T08:21:19.778444+0000","last_became_active":"2023-12-08T08:21:18.671835+0000","last_became_peered":"2023-12-08T08:21:18.671835+0000","last_unstale":"2023-12-08T08:21:19.778444+0000","last_undegraded":"2023-12-08T08:21:19.778444+0000","last_fullsized":"2023-12-08T08:21:19.778444+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:44:58.497416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.656785+0000","last_change":"2023-12-08T08:21:05.535656+0000","last_active":"2023-12-08T08:21:18.656785+0000","last_peered":"2023-12-08T08:21:18.656785+0000","last_clean":"2023-12-08T08:21:18.656785+0000","last_became_active":"2023-12-08T08:21:05.535310+0000","last_became_peered":"2023-12-08T08:21:05.535310+0000","last_unstale":"2023-12-08T08:21:18.656785+0000","last_undegraded":"2023-12-08T08:21:18.656785+0000","last_fullsized":"2023-12-08T08:21:18.656785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:09:56.356105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.779307+0000","last_change":"2023-12-08T08:21:18.687226+0000","last_active":"2023-12-08T08:21:19.779307+0000","last_peered":"2023-12-08T08:21:19.779307+0000","last_clean":"2023-12-08T08:21:19.779307+0000","last_became_active":"2023-12-08T08:21:18.687041+0000","last_became_peered":"2023-12-08T08:21:18.687041+0000","last_unstale":"2023-12-08T08:21:19.779307+0000","last_undegraded":"2023-12-08T08:21:19.779307+0000","last_fullsized":"2023-12-08T08:21:19.779307+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:51:06.552387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.669585+0000","last_change":"2023-12-08T08:21:05.529395+0000","last_active":"2023-12-08T08:21:18.669585+0000","last_peered":"2023-12-08T08:21:18.669585+0000","last_clean":"2023-12-08T08:21:18.669585+0000","last_became_active":"2023-12-08T08:21:05.529089+0000","last_became_peered":"2023-12-08T08:21:05.529089+0000","last_unstale":"2023-12-08T08:21:18.669585+0000","last_undegraded":"2023-12-08T08:21:18.669585+0000","last_fullsized":"2023-12-08T08:21:18.669585+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:43.021591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.779336+0000","last_change":"2023-12-08T08:21:18.691398+0000","last_active":"2023-12-08T08:21:19.779336+0000","last_peered":"2023-12-08T08:21:19.779336+0000","last_clean":"2023-12-08T08:21:19.779336+0000","last_became_active":"2023-12-08T08:21:18.691078+0000","last_became_peered":"2023-12-08T08:21:18.691078+0000","last_unstale":"2023-12-08T08:21:19.779336+0000","last_undegraded":"2023-12-08T08:21:19.779336+0000","last_fullsized":"2023-12-08T08:21:19.779336+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:10:09.253877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.657990+0000","last_change":"2023-12-08T08:21:05.527949+0000","last_active":"2023-12-08T08:21:18.657990+0000","last_peered":"2023-12-08T08:21:18.657990+0000","last_clean":"2023-12-08T08:21:18.657990+0000","last_became_active":"2023-12-08T08:21:05.527215+0000","last_became_peered":"2023-12-08T08:21:05.527215+0000","last_unstale":"2023-12-08T08:21:18.657990+0000","last_undegraded":"2023-12-08T08:21:18.657990+0000","last_fullsized":"2023-12-08T08:21:18.657990+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:25.239396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.778088+0000","last_change":"2023-12-08T08:21:18.671029+0000","last_active":"2023-12-08T08:21:19.778088+0000","last_peered":"2023-12-08T08:21:19.778088+0000","last_clean":"2023-12-08T08:21:19.778088+0000","last_became_active":"2023-12-08T08:21:18.670822+0000","last_became_peered":"2023-12-08T08:21:18.670822+0000","last_unstale":"2023-12-08T08:21:19.778088+0000","last_undegraded":"2023-12-08T08:21:19.778088+0000","last_fullsized":"2023-12-08T08:21:19.778088+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:01.144949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.668208+0000","last_change":"2023-12-08T08:21:05.530318+0000","last_active":"2023-12-08T08:21:18.668208+0000","last_peered":"2023-12-08T08:21:18.668208+0000","last_clean":"2023-12-08T08:21:18.668208+0000","last_became_active":"2023-12-08T08:21:05.529990+0000","last_became_peered":"2023-12-08T08:21:05.529990+0000","last_unstale":"2023-12-08T08:21:18.668208+0000","last_undegraded":"2023-12-08T08:21:18.668208+0000","last_fullsized":"2023-12-08T08:21:18.668208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:54:39.738546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.779669+0000","last_change":"2023-12-08T08:21:18.687381+0000","last_active":"2023-12-08T08:21:19.779669+0000","last_peered":"2023-12-08T08:21:19.779669+0000","last_clean":"2023-12-08T08:21:19.779669+0000","last_became_active":"2023-12-08T08:21:18.686929+0000","last_became_peered":"2023-12-08T08:21:18.686929+0000","last_unstale":"2023-12-08T08:21:19.779669+0000","last_undegraded":"2023-12-08T08:21:19.779669+0000","last_fullsized":"2023-12-08T08:21:19.779669+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:48.241679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.679372+0000","last_change":"2023-12-08T08:21:05.540446+0000","last_active":"2023-12-08T08:21:18.679372+0000","last_peered":"2023-12-08T08:21:18.679372+0000","last_clean":"2023-12-08T08:21:18.679372+0000","last_became_active":"2023-12-08T08:21:05.540024+0000","last_became_peered":"2023-12-08T08:21:05.540024+0000","last_unstale":"2023-12-08T08:21:18.679372+0000","last_undegraded":"2023-12-08T08:21:18.679372+0000","last_fullsized":"2023-12-08T08:21:18.679372+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:59:00.606587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.780056+0000","last_change":"2023-12-08T08:21:18.674586+0000","last_active":"2023-12-08T08:21:19.780056+0000","last_peered":"2023-12-08T08:21:19.780056+0000","last_clean":"2023-12-08T08:21:19.780056+0000","last_became_active":"2023-12-08T08:21:18.674109+0000","last_became_peered":"2023-12-08T08:21:18.674109+0000","last_unstale":"2023-12-08T08:21:19.780056+0000","last_undegraded":"2023-12-08T08:21:19.780056+0000","last_fullsized":"2023-12-08T08:21:19.780056+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:11:16.852032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.657676+0000","last_change":"2023-12-08T08:21:05.536252+0000","last_active":"2023-12-08T08:21:18.657676+0000","last_peered":"2023-12-08T08:21:18.657676+0000","last_clean":"2023-12-08T08:21:18.657676+0000","last_became_active":"2023-12-08T08:21:05.535964+0000","last_became_peered":"2023-12-08T08:21:05.535964+0000","last_unstale":"2023-12-08T08:21:18.657676+0000","last_undegraded":"2023-12-08T08:21:18.657676+0000","last_fullsized":"2023-12-08T08:21:18.657676+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:30.973295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.679077+0000","last_change":"2023-12-08T08:21:18.689234+0000","last_active":"2023-12-08T08:21:19.679077+0000","last_peered":"2023-12-08T08:21:19.679077+0000","last_clean":"2023-12-08T08:21:19.679077+0000","last_became_active":"2023-12-08T08:21:18.685606+0000","last_became_peered":"2023-12-08T08:21:18.685606+0000","last_unstale":"2023-12-08T08:21:19.679077+0000","last_undegraded":"2023-12-08T08:21:19.679077+0000","last_fullsized":"2023-12-08T08:21:19.679077+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:49:40.221530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.666750+0000","last_change":"2023-12-08T08:21:05.533444+0000","last_active":"2023-12-08T08:21:18.666750+0000","last_peered":"2023-12-08T08:21:18.666750+0000","last_clean":"2023-12-08T08:21:18.666750+0000","last_became_active":"2023-12-08T08:21:05.533146+0000","last_became_peered":"2023-12-08T08:21:05.533146+0000","last_unstale":"2023-12-08T08:21:18.666750+0000","last_undegraded":"2023-12-08T08:21:18.666750+0000","last_fullsized":"2023-12-08T08:21:18.666750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:14:18.284764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.779450+0000","last_change":"2023-12-08T08:21:18.673904+0000","last_active":"2023-12-08T08:21:19.779450+0000","last_peered":"2023-12-08T08:21:19.779450+0000","last_clean":"2023-12-08T08:21:19.779450+0000","last_became_active":"2023-12-08T08:21:18.673630+0000","last_became_peered":"2023-12-08T08:21:18.673630+0000","last_unstale":"2023-12-08T08:21:19.779450+0000","last_undegraded":"2023-12-08T08:21:19.779450+0000","last_fullsized":"2023-12-08T08:21:19.779450+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:30:13.109897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.663952+0000","last_change":"2023-12-08T08:21:05.525741+0000","last_active":"2023-12-08T08:21:18.663952+0000","last_peered":"2023-12-08T08:21:18.663952+0000","last_clean":"2023-12-08T08:21:18.663952+0000","last_became_active":"2023-12-08T08:21:05.525406+0000","last_became_peered":"2023-12-08T08:21:05.525406+0000","last_unstale":"2023-12-08T08:21:18.663952+0000","last_undegraded":"2023-12-08T08:21:18.663952+0000","last_fullsized":"2023-12-08T08:21:18.663952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:08.596525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.778017+0000","last_change":"2023-12-08T08:21:18.672379+0000","last_active":"2023-12-08T08:21:19.778017+0000","last_peered":"2023-12-08T08:21:19.778017+0000","last_clean":"2023-12-08T08:21:19.778017+0000","last_became_active":"2023-12-08T08:21:18.672095+0000","last_became_peered":"2023-12-08T08:21:18.672095+0000","last_unstale":"2023-12-08T08:21:19.778017+0000","last_undegraded":"2023-12-08T08:21:19.778017+0000","last_fullsized":"2023-12-08T08:21:19.778017+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:38:26.207972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.656168+0000","last_change":"2023-12-08T08:21:05.537523+0000","last_active":"2023-12-08T08:21:18.656168+0000","last_peered":"2023-12-08T08:21:18.656168+0000","last_clean":"2023-12-08T08:21:18.656168+0000","last_became_active":"2023-12-08T08:21:05.537263+0000","last_became_peered":"2023-12-08T08:21:05.537263+0000","last_unstale":"2023-12-08T08:21:18.656168+0000","last_undegraded":"2023-12-08T08:21:18.656168+0000","last_fullsized":"2023-12-08T08:21:18.656168+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:08.596525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.678927+0000","last_change":"2023-12-08T08:21:18.698066+0000","last_active":"2023-12-08T08:21:19.678927+0000","last_peered":"2023-12-08T08:21:19.678927+0000","last_clean":"2023-12-08T08:21:19.678927+0000","last_became_active":"2023-12-08T08:21:18.697214+0000","last_became_peered":"2023-12-08T08:21:18.697214+0000","last_unstale":"2023-12-08T08:21:19.678927+0000","last_undegraded":"2023-12-08T08:21:19.678927+0000","last_fullsized":"2023-12-08T08:21:19.678927+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:05:09.257229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.657359+0000","last_change":"2023-12-08T08:21:05.534310+0000","last_active":"2023-12-08T08:21:18.657359+0000","last_peered":"2023-12-08T08:21:18.657359+0000","last_clean":"2023-12-08T08:21:18.657359+0000","last_became_active":"2023-12-08T08:21:05.534003+0000","last_became_peered":"2023-12-08T08:21:05.534003+0000","last_unstale":"2023-12-08T08:21:18.657359+0000","last_undegraded":"2023-12-08T08:21:18.657359+0000","last_fullsized":"2023-12-08T08:21:18.657359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:49.782105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.777714+0000","last_change":"2023-12-08T08:21:18.671019+0000","last_active":"2023-12-08T08:21:19.777714+0000","last_peered":"2023-12-08T08:21:19.777714+0000","last_clean":"2023-12-08T08:21:19.777714+0000","last_became_active":"2023-12-08T08:21:18.670466+0000","last_became_peered":"2023-12-08T08:21:18.670466+0000","last_unstale":"2023-12-08T08:21:19.777714+0000","last_undegraded":"2023-12-08T08:21:19.777714+0000","last_fullsized":"2023-12-08T08:21:19.777714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:25.703198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.657914+0000","last_change":"2023-12-08T08:21:05.543535+0000","last_active":"2023-12-08T08:21:18.657914+0000","last_peered":"2023-12-08T08:21:18.657914+0000","last_clean":"2023-12-08T08:21:18.657914+0000","last_became_active":"2023-12-08T08:21:05.543244+0000","last_became_peered":"2023-12-08T08:21:05.543244+0000","last_unstale":"2023-12-08T08:21:18.657914+0000","last_undegraded":"2023-12-08T08:21:18.657914+0000","last_fullsized":"2023-12-08T08:21:18.657914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:20:39.875619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.779470+0000","last_change":"2023-12-08T08:21:18.675357+0000","last_active":"2023-12-08T08:21:19.779470+0000","last_peered":"2023-12-08T08:21:19.779470+0000","last_clean":"2023-12-08T08:21:19.779470+0000","last_became_active":"2023-12-08T08:21:18.675113+0000","last_became_peered":"2023-12-08T08:21:18.675113+0000","last_unstale":"2023-12-08T08:21:19.779470+0000","last_undegraded":"2023-12-08T08:21:19.779470+0000","last_fullsized":"2023-12-08T08:21:19.779470+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:30:13.109897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.668130+0000","last_change":"2023-12-08T08:21:05.532561+0000","last_active":"2023-12-08T08:21:18.668130+0000","last_peered":"2023-12-08T08:21:18.668130+0000","last_clean":"2023-12-08T08:21:18.668130+0000","last_became_active":"2023-12-08T08:21:05.532254+0000","last_became_peered":"2023-12-08T08:21:05.532254+0000","last_unstale":"2023-12-08T08:21:18.668130+0000","last_undegraded":"2023-12-08T08:21:18.668130+0000","last_fullsized":"2023-12-08T08:21:18.668130+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:30:51.157799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.679274+0000","last_change":"2023-12-08T08:21:18.698580+0000","last_active":"2023-12-08T08:21:19.679274+0000","last_peered":"2023-12-08T08:21:19.679274+0000","last_clean":"2023-12-08T08:21:19.679274+0000","last_became_active":"2023-12-08T08:21:18.698244+0000","last_became_peered":"2023-12-08T08:21:18.698244+0000","last_unstale":"2023-12-08T08:21:19.679274+0000","last_undegraded":"2023-12-08T08:21:19.679274+0000","last_fullsized":"2023-12-08T08:21:19.679274+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:45:18.499264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.661457+0000","last_change":"2023-12-08T08:21:05.528111+0000","last_active":"2023-12-08T08:21:18.661457+0000","last_peered":"2023-12-08T08:21:18.661457+0000","last_clean":"2023-12-08T08:21:18.661457+0000","last_became_active":"2023-12-08T08:21:05.527809+0000","last_became_peered":"2023-12-08T08:21:05.527809+0000","last_unstale":"2023-12-08T08:21:18.661457+0000","last_undegraded":"2023-12-08T08:21:18.661457+0000","last_fullsized":"2023-12-08T08:21:18.661457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:51.183842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.781623+0000","last_change":"2023-12-08T08:21:18.669190+0000","last_active":"2023-12-08T08:21:19.781623+0000","last_peered":"2023-12-08T08:21:19.781623+0000","last_clean":"2023-12-08T08:21:19.781623+0000","last_became_active":"2023-12-08T08:21:18.668881+0000","last_became_peered":"2023-12-08T08:21:18.668881+0000","last_unstale":"2023-12-08T08:21:19.781623+0000","last_undegraded":"2023-12-08T08:21:19.781623+0000","last_fullsized":"2023-12-08T08:21:19.781623+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:14.361994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.676910+0000","last_change":"2023-12-08T08:21:05.534658+0000","last_active":"2023-12-08T08:21:18.676910+0000","last_peered":"2023-12-08T08:21:18.676910+0000","last_clean":"2023-12-08T08:21:18.676910+0000","last_became_active":"2023-12-08T08:21:05.534383+0000","last_became_peered":"2023-12-08T08:21:05.534383+0000","last_unstale":"2023-12-08T08:21:18.676910+0000","last_undegraded":"2023-12-08T08:21:18.676910+0000","last_fullsized":"2023-12-08T08:21:18.676910+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.368162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.779078+0000","last_change":"2023-12-08T08:21:18.695694+0000","last_active":"2023-12-08T08:21:19.779078+0000","last_peered":"2023-12-08T08:21:19.779078+0000","last_clean":"2023-12-08T08:21:19.779078+0000","last_became_active":"2023-12-08T08:21:18.694997+0000","last_became_peered":"2023-12-08T08:21:18.694997+0000","last_unstale":"2023-12-08T08:21:19.779078+0000","last_undegraded":"2023-12-08T08:21:19.779078+0000","last_fullsized":"2023-12-08T08:21:19.779078+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:17:07.445675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.659897+0000","last_change":"2023-12-08T08:21:05.527659+0000","last_active":"2023-12-08T08:21:18.659897+0000","last_peered":"2023-12-08T08:21:18.659897+0000","last_clean":"2023-12-08T08:21:18.659897+0000","last_became_active":"2023-12-08T08:21:05.527361+0000","last_became_peered":"2023-12-08T08:21:05.527361+0000","last_unstale":"2023-12-08T08:21:18.659897+0000","last_undegraded":"2023-12-08T08:21:18.659897+0000","last_fullsized":"2023-12-08T08:21:18.659897+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:49.782105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-08T08:21:19.779471+0000","last_change":"2023-12-08T08:21:18.684928+0000","last_active":"2023-12-08T08:21:19.779471+0000","last_peered":"2023-12-08T08:21:19.779471+0000","last_clean":"2023-12-08T08:21:19.779471+0000","last_became_active":"2023-12-08T08:21:18.684619+0000","last_became_peered":"2023-12-08T08:21:18.684619+0000","last_unstale":"2023-12-08T08:21:19.779471+0000","last_undegraded":"2023-12-08T08:21:19.779471+0000","last_fullsized":"2023-12-08T08:21:19.779471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:17.641609+0000","last_clean_scrub_stamp":"2023-12-08T08:21:17.641609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:05:09.257229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:21:18.662582+0000","last_change":"2023-12-08T08:21:05.540661+0000","last_active":"2023-12-08T08:21:18.662582+0000","last_peered":"2023-12-08T08:21:18.662582+0000","last_clean":"2023-12-08T08:21:18.662582+0000","last_became_active":"2023-12-08T08:21:05.539125+0000","last_became_peered":"2023-12-08T08:21:05.539125+0000","last_unstale":"2023-12-08T08:21:18.662582+0000","last_undegraded":"2023-12-08T08:21:18.662582+0000","last_fullsized":"2023-12-08T08:21:18.662582+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:21:04.743837+0000","last_clean_scrub_stamp":"2023-12-08T08:21:04.743837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:58:23.887952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":753233,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.63100000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.72799999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.81699999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.71099999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.68700000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":163973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.90700000000000003}]},{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.95499999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.81299999999999994}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.753},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.83099999999999996}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.877},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.65900000000000003}]},{"osd":5,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.84599999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.88900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":163427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.80600000000000005}]},{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.73499999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.93300000000000005}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.91800000000000004}]},{"osd":6,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.69399999999999995}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.85799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":164401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.63300000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.745}]},{"osd":2,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.76400000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.71999999999999997}]},{"osd":5,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.505},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.58199999999999996}]},{"osd":6,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.55700000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.60999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":425984,"data_stored":166452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.497}]},{"osd":1,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.41999999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.62}]},{"osd":5,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.71999999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.73999999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.69699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":164389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.316},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.0270000000000001,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.46200000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.442},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.48799999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.41799999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.83099999999999996}]},{"osd":5,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.748},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":3.637,"5min":3.637,"15min":3.637},"last":0.64800000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.70499999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.85599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":165884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2210000000000001,"5min":5.2210000000000001,"15min":5.2210000000000001},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":8.3200000000000003,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.42499999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":8.2070000000000007,"5min":8.2070000000000007,"15min":8.2070000000000007},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":4.351,"5min":4.351,"15min":4.351},"last":0.46100000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":8.1479999999999997,"5min":8.1479999999999997,"15min":8.1479999999999997},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.3150000000000004,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.38800000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":4.8470000000000004,"5min":4.8470000000000004,"15min":4.8470000000000004},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":4.7939999999999996,"5min":4.7939999999999996,"15min":4.7939999999999996},"last":0.82799999999999996}]},{"osd":5,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":4.7240000000000002,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":4.5830000000000002,"5min":4.5830000000000002,"15min":4.5830000000000002},"last":0.72199999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":4.7699999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":4.6289999999999996,"5min":4.6289999999999996,"15min":4.6289999999999996},"last":0.81399999999999995}]},{"osd":7,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":4.665,"5min":4.665,"15min":4.665},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":4.8140000000000001,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.66600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":466944,"data_stored":753087,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":8.2799999999999994,"5min":8.2799999999999994,"15min":8.2799999999999994},"last":0.42799999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":7.9290000000000003,"5min":7.9290000000000003,"15min":7.9290000000000003},"last":0.54400000000000004},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":8.0890000000000004,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.33300000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":4.6550000000000002,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":7.8890000000000002,"5min":7.8890000000000002,"15min":7.8890000000000002},"last":0.52100000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":7.9649999999999999,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.73199999999999998}]},{"osd":5,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":8.0579999999999998,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.98899999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":7.835,"5min":7.835,"15min":7.835},"last":0.81599999999999995}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":8.0239999999999991,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.753}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:21:27.642 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-08T08:21:27.642 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-12-08T08:21:27.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.823+0000 7f20161c4640 1 Processor -- start 2023-12-08T08:21:27.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.823+0000 7f20161c4640 1 -- start start 2023-12-08T08:21:27.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.823+0000 7f20161c4640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f201014fc30 0x7f20100c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:27.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.823+0000 7f20161c4640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f201006d840 0x7f20100c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:27.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.823+0000 7f20161c4640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2010152910 con 0x7f201014f850 2023-12-08T08:21:27.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.823+0000 7f20161c4640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20100c2240 con 0x7f201006d840 2023-12-08T08:21:27.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.823+0000 7f20161c4640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2010152bf0 con 0x7f201014fc30 2023-12-08T08:21:27.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.823+0000 7f200effd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f201014fc30 0x7f20100c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:27.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.823+0000 7f200effd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f201014fc30 0x7f20100c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:57188/0 (socket says 172.21.15.88:57188) 2023-12-08T08:21:27.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.823+0000 7f200effd640 1 -- 172.21.15.88:0/2916993574 learned_addr learned my addr 172.21.15.88:0/2916993574 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:27.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.823+0000 7f200ffff640 1 --2- 172.21.15.88:0/2916993574 >> v2:172.21.15.148:3300/0 conn(0x7f201006d840 0x7f20100c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:27.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.823+0000 7f200effd640 1 -- 172.21.15.88:0/2916993574 >> v2:172.21.15.148:3300/0 conn(0x7f201006d840 msgr2=0x7f20100c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:27.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.823+0000 7f200effd640 1 --2- 172.21.15.88:0/2916993574 >> v2:172.21.15.148:3300/0 conn(0x7f201006d840 0x7f20100c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.823+0000 7f200effd640 1 -- 172.21.15.88:0/2916993574 >> v1:172.21.15.148:6789/0 conn(0x7f201014f850 legacy=0x7f20100aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:27.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.823+0000 7f200effd640 1 -- 172.21.15.88:0/2916993574 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2010152ed0 con 0x7f201014fc30 2023-12-08T08:21:27.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.827+0000 7f200effd640 1 --2- 172.21.15.88:0/2916993574 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f201014fc30 0x7f20100c3cd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2004009870 tx=0x7f200401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93c16275ab4af991 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:27.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.827+0000 7f200e7fc640 1 -- 172.21.15.88:0/2916993574 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20040ab670 con 0x7f201014fc30 2023-12-08T08:21:27.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.827+0000 7f200e7fc640 1 -- 172.21.15.88:0/2916993574 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20040ab7d0 con 0x7f201014fc30 2023-12-08T08:21:27.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.827+0000 7f200e7fc640 1 -- 172.21.15.88:0/2916993574 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20040abb60 con 0x7f201014fc30 2023-12-08T08:21:27.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.827+0000 7f20161c4640 1 -- 172.21.15.88:0/2916993574 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f201014fc30 msgr2=0x7f20100c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:27.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.827+0000 7f20161c4640 1 --2- 172.21.15.88:0/2916993574 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f201014fc30 0x7f20100c3cd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2004009870 tx=0x7f200401c540 comp rx=0 tx=0).stop 2023-12-08T08:21:27.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.827+0000 7f20161c4640 1 -- 172.21.15.88:0/2916993574 shutdown_connections 2023-12-08T08:21:27.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.827+0000 7f20161c4640 1 --2- 172.21.15.88:0/2916993574 >> v2:172.21.15.148:3300/0 conn(0x7f201006d840 0x7f20100c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.827+0000 7f20161c4640 1 --2- 172.21.15.88:0/2916993574 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f201014fc30 0x7f20100c3cd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.827+0000 7f20161c4640 1 -- 172.21.15.88:0/2916993574 >> 172.21.15.88:0/2916993574 conn(0x7f20100c59f0 msgr2=0x7f20100c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:27.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.827+0000 7f20161c4640 1 -- 172.21.15.88:0/2916993574 shutdown_connections 2023-12-08T08:21:27.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.827+0000 7f20161c4640 1 -- 172.21.15.88:0/2916993574 wait complete. 2023-12-08T08:21:27.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.831+0000 7f20161c4640 1 Processor -- start 2023-12-08T08:21:27.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.831+0000 7f20161c4640 1 -- start start 2023-12-08T08:21:27.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.831+0000 7f20161c4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f201006d840 0x7f2010156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:27.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.831+0000 7f20161c4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f201014f850 0x7f2010148290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:27.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.831+0000 7f20161c4640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f201014fc30 0x7f2010144cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:27.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.831+0000 7f20161c4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2010146ec0 con 0x7f201006d840 2023-12-08T08:21:27.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.831+0000 7f20161c4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20101e9920 con 0x7f201014f850 2023-12-08T08:21:27.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.831+0000 7f20161c4640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20101e9c00 con 0x7f201014fc30 2023-12-08T08:21:27.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.831+0000 7f200f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f201006d840 0x7f2010156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:27.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.831+0000 7f200f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f201006d840 0x7f2010156470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33830/0 (socket says 172.21.15.88:33830) 2023-12-08T08:21:27.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.831+0000 7f200f7fe640 1 -- 172.21.15.88:0/4271412990 learned_addr learned my addr 172.21.15.88:0/4271412990 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:27.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.831+0000 7f200ffff640 1 --2- 172.21.15.88:0/4271412990 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f201014fc30 0x7f2010144cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:27.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.831+0000 7f200effd640 1 --2- 172.21.15.88:0/4271412990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f201014f850 0x7f2010148290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:27.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.831+0000 7f200f7fe640 1 -- 172.21.15.88:0/4271412990 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f201014fc30 msgr2=0x7f2010144cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:27.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.831+0000 7f200f7fe640 1 --2- 172.21.15.88:0/4271412990 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f201014fc30 0x7f2010144cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.831+0000 7f200f7fe640 1 -- 172.21.15.88:0/4271412990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f201014f850 msgr2=0x7f2010148290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:27.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.831+0000 7f200f7fe640 1 --2- 172.21.15.88:0/4271412990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f201014f850 0x7f2010148290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.831+0000 7f200f7fe640 1 -- 172.21.15.88:0/4271412990 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20040094d0 con 0x7f201006d840 2023-12-08T08:21:27.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.831+0000 7f200f7fe640 1 --2- 172.21.15.88:0/4271412990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f201006d840 0x7f2010156470 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f200000c500 tx=0x7f200000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:27.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.831+0000 7f1ff7fff640 1 -- 172.21.15.88:0/4271412990 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2000005220 con 0x7f201006d840 2023-12-08T08:21:27.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.831+0000 7f1ff7fff640 1 -- 172.21.15.88:0/4271412990 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2000005380 con 0x7f201006d840 2023-12-08T08:21:27.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.831+0000 7f20161c4640 1 -- 172.21.15.88:0/4271412990 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20101e9ee0 con 0x7f201006d840 2023-12-08T08:21:27.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.831+0000 7f1ff7fff640 1 -- 172.21.15.88:0/4271412990 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2000007270 con 0x7f201006d840 2023-12-08T08:21:27.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.831+0000 7f20161c4640 1 -- 172.21.15.88:0/4271412990 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20101487d0 con 0x7f201006d840 2023-12-08T08:21:27.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.835+0000 7f20161c4640 1 -- 172.21.15.88:0/4271412990 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2010067630 con 0x7f201006d840 2023-12-08T08:21:27.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.835+0000 7f1ff7fff640 1 -- 172.21.15.88:0/4271412990 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f20000073d0 con 0x7f201006d840 2023-12-08T08:21:27.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.835+0000 7f1ff7fff640 1 --2- 172.21.15.88:0/4271412990 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1ffc066470 0x7f1ffc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:27.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.835+0000 7f1ff7fff640 1 -- 172.21.15.88:0/4271412990 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2000083b10 con 0x7f201006d840 2023-12-08T08:21:27.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.835+0000 7f200effd640 1 --2- 172.21.15.88:0/4271412990 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1ffc066470 0x7f1ffc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:27.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.835+0000 7f200effd640 1 --2- 172.21.15.88:0/4271412990 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1ffc066470 0x7f1ffc068930 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f20040af000 tx=0x7f20040a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:27.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:27.839+0000 7f1ff7fff640 1 -- 172.21.15.88:0/4271412990 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2000050c40 con 0x7f201006d840 2023-12-08T08:21:28.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.043+0000 7f20161c4640 1 -- 172.21.15.88:0/4271412990 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f20100a4a90 con 0x7f201006d840 2023-12-08T08:21:28.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.043+0000 7f1ff7fff640 1 -- 172.21.15.88:0/4271412990 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v12) v1 ==== 185+0+142 (secure 0 0 0) 0x7f2000054260 con 0x7f201006d840 2023-12-08T08:21:28.049 INFO:teuthology.orchestra.run.smithi088.stdout:[client.1] 2023-12-08T08:21:28.049 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCJ0XJld2rjOBAAUnEIBuqXHktNpqFW/Ikf7g== 2023-12-08T08:21:28.049 INFO:teuthology.orchestra.run.smithi088.stdout: caps mds = "allow" 2023-12-08T08:21:28.049 INFO:teuthology.orchestra.run.smithi088.stdout: caps mon = "allow r" 2023-12-08T08:21:28.049 INFO:teuthology.orchestra.run.smithi088.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-12-08T08:21:28.050 INFO:teuthology.orchestra.run.smithi088.stderr:updated caps for client.1 2023-12-08T08:21:28.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.047+0000 7f20161c4640 1 -- 172.21.15.88:0/4271412990 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1ffc066470 msgr2=0x7f1ffc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:28.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.047+0000 7f20161c4640 1 --2- 172.21.15.88:0/4271412990 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1ffc066470 0x7f1ffc068930 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f20040af000 tx=0x7f20040a7000 comp rx=0 tx=0).stop 2023-12-08T08:21:28.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.047+0000 7f20161c4640 1 -- 172.21.15.88:0/4271412990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f201006d840 msgr2=0x7f2010156470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:28.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.047+0000 7f20161c4640 1 --2- 172.21.15.88:0/4271412990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f201006d840 0x7f2010156470 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f200000c500 tx=0x7f200000c9c0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.047+0000 7f20161c4640 1 -- 172.21.15.88:0/4271412990 shutdown_connections 2023-12-08T08:21:28.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.047+0000 7f20161c4640 1 --2- 172.21.15.88:0/4271412990 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1ffc066470 0x7f1ffc068930 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.047+0000 7f20161c4640 1 --2- 172.21.15.88:0/4271412990 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f201014fc30 0x7f2010144cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.047+0000 7f20161c4640 1 --2- 172.21.15.88:0/4271412990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f201014f850 0x7f2010148290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.047+0000 7f20161c4640 1 --2- 172.21.15.88:0/4271412990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f201006d840 0x7f2010156470 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.047+0000 7f20161c4640 1 -- 172.21.15.88:0/4271412990 >> 172.21.15.88:0/4271412990 conn(0x7f20100c59f0 msgr2=0x7f201006cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:28.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.047+0000 7f20161c4640 1 -- 172.21.15.88:0/4271412990 shutdown_connections 2023-12-08T08:21:28.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.047+0000 7f20161c4640 1 -- 172.21.15.88:0/4271412990 wait complete. 2023-12-08T08:21:28.071 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:21:28.071 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:21:28.081 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:21:28.081 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:21:28.135 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:21:28.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.267+0000 7ff519032640 1 Processor -- start 2023-12-08T08:21:28.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.267+0000 7ff519032640 1 -- start start 2023-12-08T08:21:28.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.267+0000 7ff519032640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5140bfce0 0x7ff51414e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:28.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.267+0000 7ff519032640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff51406ccc0 0x7ff5140c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:28.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.267+0000 7ff519032640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff514151690 con 0x7ff51406bef0 2023-12-08T08:21:28.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.267+0000 7ff519032640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff51414e930 con 0x7ff51406ccc0 2023-12-08T08:21:28.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.267+0000 7ff519032640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff514151bc0 con 0x7ff5140bfce0 2023-12-08T08:21:28.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.271+0000 7ff512d9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff51406bef0 0x7ff51406c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46762/0 (socket says 172.21.15.88:46762) 2023-12-08T08:21:28.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.271+0000 7ff51359e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff51406ccc0 0x7ff5140c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:28.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.271+0000 7ff512d9d640 1 -- 172.21.15.88:0/264336240 learned_addr learned my addr 172.21.15.88:0/264336240 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:28.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.271+0000 7ff51259c640 1 --2- 172.21.15.88:0/264336240 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5140bfce0 0x7ff51414e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:28.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.271+0000 7ff51359e640 1 -- 172.21.15.88:0/264336240 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5140bfce0 msgr2=0x7ff51414e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:28.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.271+0000 7ff51359e640 1 --2- 172.21.15.88:0/264336240 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5140bfce0 0x7ff51414e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.271+0000 7ff51359e640 1 -- 172.21.15.88:0/264336240 >> v1:172.21.15.88:6789/0 conn(0x7ff51406bef0 legacy=0x7ff51406c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:28.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.271+0000 7ff51359e640 1 -- 172.21.15.88:0/264336240 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5141518e0 con 0x7ff51406ccc0 2023-12-08T08:21:28.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.271+0000 7ff511d9b640 1 -- 172.21.15.88:0/264336240 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1686600303 0 0) 0x7ff514151690 con 0x7ff51406bef0 2023-12-08T08:21:28.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.271+0000 7ff51359e640 1 --2- 172.21.15.88:0/264336240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff51406ccc0 0x7ff5140c3960 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff50c009d90 tx=0x7ff50c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a77da615b651bbb5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:28.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.271+0000 7ff511d9b640 1 -- 172.21.15.88:0/264336240 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c0a5780 con 0x7ff51406ccc0 2023-12-08T08:21:28.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.271+0000 7ff511d9b640 1 -- 172.21.15.88:0/264336240 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50c0a58e0 con 0x7ff51406ccc0 2023-12-08T08:21:28.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.271+0000 7ff511d9b640 1 -- 172.21.15.88:0/264336240 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c0a5c70 con 0x7ff51406ccc0 2023-12-08T08:21:28.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.275+0000 7ff519032640 1 -- 172.21.15.88:0/264336240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff51406ccc0 msgr2=0x7ff5140c3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:28.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.275+0000 7ff519032640 1 --2- 172.21.15.88:0/264336240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff51406ccc0 0x7ff5140c3960 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff50c009d90 tx=0x7ff50c01c8c0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.275+0000 7ff519032640 1 -- 172.21.15.88:0/264336240 shutdown_connections 2023-12-08T08:21:28.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.275+0000 7ff519032640 1 --2- 172.21.15.88:0/264336240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff51406ccc0 0x7ff5140c3960 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.275+0000 7ff519032640 1 --2- 172.21.15.88:0/264336240 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5140bfce0 0x7ff51414e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.275+0000 7ff519032640 1 -- 172.21.15.88:0/264336240 >> 172.21.15.88:0/264336240 conn(0x7ff5140a7810 msgr2=0x7ff5140a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:28.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.275+0000 7ff519032640 1 -- 172.21.15.88:0/264336240 shutdown_connections 2023-12-08T08:21:28.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.275+0000 7ff519032640 1 -- 172.21.15.88:0/264336240 wait complete. 2023-12-08T08:21:28.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.275+0000 7ff519032640 1 Processor -- start 2023-12-08T08:21:28.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.275+0000 7ff519032640 1 -- start start 2023-12-08T08:21:28.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.275+0000 7ff519032640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff51406bef0 0x7ff514152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:28.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.275+0000 7ff519032640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff51406ccc0 0x7ff5141447d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:28.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.275+0000 7ff519032640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5140bfce0 0x7ff514145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:28.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.275+0000 7ff519032640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5141eaa30 con 0x7ff51406bef0 2023-12-08T08:21:28.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.275+0000 7ff519032640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51414a730 con 0x7ff51406ccc0 2023-12-08T08:21:28.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.275+0000 7ff519032640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5141ea750 con 0x7ff5140bfce0 2023-12-08T08:21:28.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.275+0000 7ff512d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff51406bef0 0x7ff514152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:28.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.275+0000 7ff512d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff51406bef0 0x7ff514152fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33846/0 (socket says 172.21.15.88:33846) 2023-12-08T08:21:28.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.275+0000 7ff512d9d640 1 -- 172.21.15.88:0/508890087 learned_addr learned my addr 172.21.15.88:0/508890087 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:28.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.275+0000 7ff51359e640 1 --2- 172.21.15.88:0/508890087 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5140bfce0 0x7ff514145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:28.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.275+0000 7ff51259c640 1 --2- 172.21.15.88:0/508890087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff51406ccc0 0x7ff5141447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:28.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.275+0000 7ff512d9d640 1 -- 172.21.15.88:0/508890087 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5140bfce0 msgr2=0x7ff514145ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:28.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.275+0000 7ff512d9d640 1 --2- 172.21.15.88:0/508890087 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5140bfce0 0x7ff514145ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.275+0000 7ff512d9d640 1 -- 172.21.15.88:0/508890087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff51406ccc0 msgr2=0x7ff5141447d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:28.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.275+0000 7ff512d9d640 1 --2- 172.21.15.88:0/508890087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff51406ccc0 0x7ff5141447d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.275+0000 7ff512d9d640 1 -- 172.21.15.88:0/508890087 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c009a70 con 0x7ff51406bef0 2023-12-08T08:21:28.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.279+0000 7ff512d9d640 1 --2- 172.21.15.88:0/508890087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff51406bef0 0x7ff514152fd0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff5040011f0 tx=0x7ff50400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:28.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.279+0000 7ff4fb7fe640 1 -- 172.21.15.88:0/508890087 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5040074e0 con 0x7ff51406bef0 2023-12-08T08:21:28.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.279+0000 7ff4fb7fe640 1 -- 172.21.15.88:0/508890087 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff504007640 con 0x7ff51406bef0 2023-12-08T08:21:28.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.279+0000 7ff519032640 1 -- 172.21.15.88:0/508890087 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff51406d2d0 con 0x7ff51406bef0 2023-12-08T08:21:28.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.279+0000 7ff4fb7fe640 1 -- 172.21.15.88:0/508890087 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff504004a10 con 0x7ff51406bef0 2023-12-08T08:21:28.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.279+0000 7ff519032640 1 -- 172.21.15.88:0/508890087 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5141453a0 con 0x7ff51406bef0 2023-12-08T08:21:28.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.279+0000 7ff519032640 1 -- 172.21.15.88:0/508890087 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff514067630 con 0x7ff51406bef0 2023-12-08T08:21:28.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.279+0000 7ff4fb7fe640 1 -- 172.21.15.88:0/508890087 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff504004b70 con 0x7ff51406bef0 2023-12-08T08:21:28.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.279+0000 7ff4fb7fe640 1 --2- 172.21.15.88:0/508890087 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff500066470 0x7ff500068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:28.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.279+0000 7ff4fb7fe640 1 -- 172.21.15.88:0/508890087 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff5040832d0 con 0x7ff51406bef0 2023-12-08T08:21:28.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.279+0000 7ff51259c640 1 --2- 172.21.15.88:0/508890087 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff500066470 0x7ff500068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:28.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.283+0000 7ff51259c640 1 --2- 172.21.15.88:0/508890087 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff500066470 0x7ff500068930 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff5140a7120 tx=0x7ff508008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:28.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.283+0000 7ff4fb7fe640 1 -- 172.21.15.88:0/508890087 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff504050490 con 0x7ff51406bef0 2023-12-08T08:21:28.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.435+0000 7ff519032640 1 -- 172.21.15.88:0/508890087 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5140c5370 con 0x7ff51406bef0 2023-12-08T08:21:28.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.435+0000 7ff4fb7fe640 1 -- 172.21.15.88:0/508890087 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20205 (secure 0 0 0) 0x7ff504053ab0 con 0x7ff51406bef0 2023-12-08T08:21:28.441 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:28.441 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":35,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:21:19.666744+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:21:03.690721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-08T08:21:04.127786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:21:16.039054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:21:17.029894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:21:28.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.439+0000 7ff519032640 1 -- 172.21.15.88:0/508890087 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff500066470 msgr2=0x7ff500068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:28.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.439+0000 7ff519032640 1 --2- 172.21.15.88:0/508890087 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff500066470 0x7ff500068930 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff5140a7120 tx=0x7ff508008040 comp rx=0 tx=0).stop 2023-12-08T08:21:28.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.439+0000 7ff519032640 1 -- 172.21.15.88:0/508890087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff51406bef0 msgr2=0x7ff514152fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:28.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.439+0000 7ff519032640 1 --2- 172.21.15.88:0/508890087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff51406bef0 0x7ff514152fd0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff5040011f0 tx=0x7ff50400c9b0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.439+0000 7ff519032640 1 -- 172.21.15.88:0/508890087 shutdown_connections 2023-12-08T08:21:28.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.439+0000 7ff519032640 1 --2- 172.21.15.88:0/508890087 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff500066470 0x7ff500068930 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.439+0000 7ff519032640 1 --2- 172.21.15.88:0/508890087 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff5140bfce0 0x7ff514145ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.439+0000 7ff519032640 1 --2- 172.21.15.88:0/508890087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff51406ccc0 0x7ff5141447d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.439+0000 7ff519032640 1 --2- 172.21.15.88:0/508890087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff51406bef0 0x7ff514152fd0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.439+0000 7ff519032640 1 -- 172.21.15.88:0/508890087 >> 172.21.15.88:0/508890087 conn(0x7ff5140a7810 msgr2=0x7ff51414cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:28.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.439+0000 7ff519032640 1 -- 172.21.15.88:0/508890087 shutdown_connections 2023-12-08T08:21:28.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.439+0000 7ff519032640 1 -- 172.21.15.88:0/508890087 wait complete. 2023-12-08T08:21:28.462 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:21:03.690721+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:21:04.127786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:21:16.039054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:21:17.029894+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:21:28.463 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:21:28.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.599+0000 7f7b45879640 1 Processor -- start 2023-12-08T08:21:28.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.599+0000 7f7b45879640 1 -- start start 2023-12-08T08:21:28.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.599+0000 7f7b45879640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7b400c47e0 0x7f7b400c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:28.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.599+0000 7f7b45879640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b40155400 con 0x7f7b400c92e0 2023-12-08T08:21:28.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.599+0000 7f7b45879640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b40154830 con 0x7f7b400c83d0 2023-12-08T08:21:28.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.599+0000 7f7b45879640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b400c5830 con 0x7f7b400c47e0 2023-12-08T08:21:28.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.603+0000 7f7b3effd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7b400c47e0 0x7f7b400c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:28.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.603+0000 7f7b3f7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7b400c92e0 0x7f7b4015eec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46764/0 (socket says 172.21.15.88:46764) 2023-12-08T08:21:28.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.603+0000 7f7b3f7fe640 1 -- 172.21.15.88:0/2421533005 learned_addr learned my addr 172.21.15.88:0/2421533005 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:28.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.603+0000 7f7b3e7fc640 1 -- 172.21.15.88:0/2421533005 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486029410 0 0) 0x7f7b40155400 con 0x7f7b400c92e0 2023-12-08T08:21:28.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.603+0000 7f7b3e7fc640 1 -- 172.21.15.88:0/2421533005 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b2c003530 con 0x7f7b400c92e0 2023-12-08T08:21:28.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.603+0000 7f7b3effd640 1 -- 172.21.15.88:0/2421533005 >> v1:172.21.15.148:6789/0 conn(0x7f7b400c83d0 legacy=0x7f7b400c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:28.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.603+0000 7f7b3effd640 1 -- 172.21.15.88:0/2421533005 >> v1:172.21.15.88:6789/0 conn(0x7f7b400c92e0 legacy=0x7f7b4015eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:28.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.603+0000 7f7b3effd640 1 -- 172.21.15.88:0/2421533005 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b40154ad0 con 0x7f7b400c47e0 2023-12-08T08:21:28.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.603+0000 7f7b3effd640 1 --2- 172.21.15.88:0/2421533005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b400c47e0 0x7f7b400c4bc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7b300097c0 tx=0x7f7b3001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358d2e54b9859dcd server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:28.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.603+0000 7f7b3e7fc640 1 -- 172.21.15.88:0/2421533005 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300ab600 con 0x7f7b400c47e0 2023-12-08T08:21:28.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.603+0000 7f7b3e7fc640 1 -- 172.21.15.88:0/2421533005 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b300a7050 con 0x7f7b400c47e0 2023-12-08T08:21:28.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.603+0000 7f7b3e7fc640 1 -- 172.21.15.88:0/2421533005 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300ab960 con 0x7f7b400c47e0 2023-12-08T08:21:28.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b45879640 1 -- 172.21.15.88:0/2421533005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b400c47e0 msgr2=0x7f7b400c4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:28.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b45879640 1 --2- 172.21.15.88:0/2421533005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b400c47e0 0x7f7b400c4bc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7b300097c0 tx=0x7f7b3001c3f0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b45879640 1 -- 172.21.15.88:0/2421533005 shutdown_connections 2023-12-08T08:21:28.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b45879640 1 --2- 172.21.15.88:0/2421533005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b400c47e0 0x7f7b400c4bc0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b45879640 1 -- 172.21.15.88:0/2421533005 >> 172.21.15.88:0/2421533005 conn(0x7f7b400ab920 msgr2=0x7f7b400abd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:28.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b45879640 1 -- 172.21.15.88:0/2421533005 shutdown_connections 2023-12-08T08:21:28.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b45879640 1 -- 172.21.15.88:0/2421533005 wait complete. 2023-12-08T08:21:28.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b45879640 1 Processor -- start 2023-12-08T08:21:28.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b45879640 1 -- start start 2023-12-08T08:21:28.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b45879640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b400c47e0 0x7f7b40147390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:28.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b45879640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b400c83d0 0x7f7b400bf250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:28.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b45879640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b400c92e0 0x7f7b400bf790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:28.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b45879640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400c3e60 con 0x7f7b400c47e0 2023-12-08T08:21:28.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b45879640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b401478d0 con 0x7f7b400c92e0 2023-12-08T08:21:28.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b45879640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400c22e0 con 0x7f7b400c83d0 2023-12-08T08:21:28.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b3effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b400c47e0 0x7f7b40147390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:28.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b3effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b400c47e0 0x7f7b40147390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33860/0 (socket says 172.21.15.88:33860) 2023-12-08T08:21:28.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b3effd640 1 -- 172.21.15.88:0/342941872 learned_addr learned my addr 172.21.15.88:0/342941872 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:28.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b37fff640 1 --2- 172.21.15.88:0/342941872 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b400c83d0 0x7f7b400bf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:28.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b3effd640 1 -- 172.21.15.88:0/342941872 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b400c83d0 msgr2=0x7f7b400bf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:28.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b3effd640 1 --2- 172.21.15.88:0/342941872 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b400c83d0 0x7f7b400bf250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b3f7fe640 1 --2- 172.21.15.88:0/342941872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b400c92e0 0x7f7b400bf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:28.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b3effd640 1 -- 172.21.15.88:0/342941872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b400c92e0 msgr2=0x7f7b400bf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:28.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b3effd640 1 --2- 172.21.15.88:0/342941872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b400c92e0 0x7f7b400bf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b3effd640 1 -- 172.21.15.88:0/342941872 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b30009420 con 0x7f7b400c47e0 2023-12-08T08:21:28.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b37fff640 1 --2- 172.21.15.88:0/342941872 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b400c83d0 0x7f7b400bf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:28.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b3f7fe640 1 --2- 172.21.15.88:0/342941872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b400c92e0 0x7f7b400bf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:28.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.607+0000 7f7b3effd640 1 --2- 172.21.15.88:0/342941872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b400c47e0 0x7f7b40147390 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7b3001a020 tx=0x7f7b3001ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:28.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.611+0000 7f7b3cff9640 1 -- 172.21.15.88:0/342941872 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b30004020 con 0x7f7b400c47e0 2023-12-08T08:21:28.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.611+0000 7f7b3cff9640 1 -- 172.21.15.88:0/342941872 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b30004180 con 0x7f7b400c47e0 2023-12-08T08:21:28.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.611+0000 7f7b3cff9640 1 -- 172.21.15.88:0/342941872 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300044f0 con 0x7f7b400c47e0 2023-12-08T08:21:28.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.611+0000 7f7b45879640 1 -- 172.21.15.88:0/342941872 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b400c25c0 con 0x7f7b400c47e0 2023-12-08T08:21:28.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.611+0000 7f7b45879640 1 -- 172.21.15.88:0/342941872 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b400c2b80 con 0x7f7b400c47e0 2023-12-08T08:21:28.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.611+0000 7f7b45879640 1 -- 172.21.15.88:0/342941872 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b400a9810 con 0x7f7b400c47e0 2023-12-08T08:21:28.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.611+0000 7f7b3cff9640 1 -- 172.21.15.88:0/342941872 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7b30003620 con 0x7f7b400c47e0 2023-12-08T08:21:28.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.611+0000 7f7b3cff9640 1 --2- 172.21.15.88:0/342941872 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7b20066470 0x7f7b20068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:28.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.611+0000 7f7b3cff9640 1 -- 172.21.15.88:0/342941872 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7b3011e720 con 0x7f7b400c47e0 2023-12-08T08:21:28.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.611+0000 7f7b37fff640 1 --2- 172.21.15.88:0/342941872 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7b20066470 0x7f7b20068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:28.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.615+0000 7f7b37fff640 1 --2- 172.21.15.88:0/342941872 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7b20066470 0x7f7b20068930 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7b4014bfc0 tx=0x7f7b28009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:28.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.615+0000 7f7b3cff9640 1 -- 172.21.15.88:0/342941872 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7b300eb8c0 con 0x7f7b400c47e0 2023-12-08T08:21:28.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.771+0000 7f7b45879640 1 -- 172.21.15.88:0/342941872 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7b40067630 con 0x7f7b400c47e0 2023-12-08T08:21:28.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.771+0000 7f7b3cff9640 1 -- 172.21.15.88:0/342941872 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7b300c30a0 con 0x7f7b400c47e0 2023-12-08T08:21:28.774 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:21:28.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.771+0000 7f7b45879640 1 -- 172.21.15.88:0/342941872 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7b20066470 msgr2=0x7f7b20068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:28.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.771+0000 7f7b45879640 1 --2- 172.21.15.88:0/342941872 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7b20066470 0x7f7b20068930 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7b4014bfc0 tx=0x7f7b28009040 comp rx=0 tx=0).stop 2023-12-08T08:21:28.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.771+0000 7f7b45879640 1 -- 172.21.15.88:0/342941872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b400c47e0 msgr2=0x7f7b40147390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:28.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.771+0000 7f7b45879640 1 --2- 172.21.15.88:0/342941872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b400c47e0 0x7f7b40147390 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7b3001a020 tx=0x7f7b3001ac30 comp rx=0 tx=0).stop 2023-12-08T08:21:28.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.771+0000 7f7b45879640 1 -- 172.21.15.88:0/342941872 shutdown_connections 2023-12-08T08:21:28.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.771+0000 7f7b45879640 1 --2- 172.21.15.88:0/342941872 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7b20066470 0x7f7b20068930 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.771+0000 7f7b45879640 1 --2- 172.21.15.88:0/342941872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b400c92e0 0x7f7b400bf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.771+0000 7f7b45879640 1 --2- 172.21.15.88:0/342941872 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b400c83d0 0x7f7b400bf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.771+0000 7f7b45879640 1 --2- 172.21.15.88:0/342941872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b400c47e0 0x7f7b40147390 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.771+0000 7f7b45879640 1 -- 172.21.15.88:0/342941872 >> 172.21.15.88:0/342941872 conn(0x7f7b400ab920 msgr2=0x7f7b400c4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:28.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.771+0000 7f7b45879640 1 -- 172.21.15.88:0/342941872 shutdown_connections 2023-12-08T08:21:28.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.771+0000 7f7b45879640 1 -- 172.21.15.88:0/342941872 wait complete. 2023-12-08T08:21:28.796 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:21:28.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.935+0000 7f7346432640 1 Processor -- start 2023-12-08T08:21:28.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.935+0000 7f7346432640 1 -- start start 2023-12-08T08:21:28.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.935+0000 7f7346432640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f734014b1e0 0x7f73400c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:28.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.935+0000 7f7346432640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f73400c5300 0x7f73400a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:28.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.935+0000 7f7346432640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73400a4e20 con 0x7f7340151280 2023-12-08T08:21:28.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.935+0000 7f7346432640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73401558d0 con 0x7f73400c5300 2023-12-08T08:21:28.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.935+0000 7f7346432640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73400a50e0 con 0x7f734014b1e0 2023-12-08T08:21:28.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.935+0000 7f733f7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f73400c5300 0x7f73400a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:28.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.935+0000 7f73449cf640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7340151280 0x7f7340151710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46780/0 (socket says 172.21.15.88:46780) 2023-12-08T08:21:28.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.935+0000 7f73449cf640 1 -- 172.21.15.88:0/3689418775 learned_addr learned my addr 172.21.15.88:0/3689418775 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:28.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.935+0000 7f733ffff640 1 --2- 172.21.15.88:0/3689418775 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f734014b1e0 0x7f73400c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:28.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.935+0000 7f733f7fe640 1 -- 172.21.15.88:0/3689418775 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f734014b1e0 msgr2=0x7f73400c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:28.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.935+0000 7f733f7fe640 1 --2- 172.21.15.88:0/3689418775 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f734014b1e0 0x7f73400c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.935+0000 7f733f7fe640 1 -- 172.21.15.88:0/3689418775 >> v1:172.21.15.88:6789/0 conn(0x7f7340151280 legacy=0x7f7340151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:28.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.935+0000 7f733f7fe640 1 -- 172.21.15.88:0/3689418775 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73400c0f00 con 0x7f73400c5300 2023-12-08T08:21:28.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.935+0000 7f733ffff640 1 --2- 172.21.15.88:0/3689418775 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f734014b1e0 0x7f73400c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:28.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.939+0000 7f733f7fe640 1 --2- 172.21.15.88:0/3689418775 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73400c5300 0x7f73400a9c30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f73340097c0 tx=0x7f733401e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1cb87e30b61342e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:28.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.939+0000 7f733effd640 1 -- 172.21.15.88:0/3689418775 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73340ac610 con 0x7f73400c5300 2023-12-08T08:21:28.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.939+0000 7f733effd640 1 -- 172.21.15.88:0/3689418775 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73340a8040 con 0x7f73400c5300 2023-12-08T08:21:28.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.939+0000 7f733effd640 1 -- 172.21.15.88:0/3689418775 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73340ac990 con 0x7f73400c5300 2023-12-08T08:21:28.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.939+0000 7f7346432640 1 -- 172.21.15.88:0/3689418775 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73400c5300 msgr2=0x7f73400a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:28.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.939+0000 7f7346432640 1 --2- 172.21.15.88:0/3689418775 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73400c5300 0x7f73400a9c30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f73340097c0 tx=0x7f733401e690 comp rx=0 tx=0).stop 2023-12-08T08:21:28.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.939+0000 7f7346432640 1 -- 172.21.15.88:0/3689418775 shutdown_connections 2023-12-08T08:21:28.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.939+0000 7f7346432640 1 --2- 172.21.15.88:0/3689418775 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73400c5300 0x7f73400a9c30 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.939+0000 7f7346432640 1 --2- 172.21.15.88:0/3689418775 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f734014b1e0 0x7f73400c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.939+0000 7f7346432640 1 -- 172.21.15.88:0/3689418775 >> 172.21.15.88:0/3689418775 conn(0x7f73400c59f0 msgr2=0x7f73400c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:28.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.939+0000 7f7346432640 1 -- 172.21.15.88:0/3689418775 shutdown_connections 2023-12-08T08:21:28.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.939+0000 7f7346432640 1 -- 172.21.15.88:0/3689418775 wait complete. 2023-12-08T08:21:28.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.943+0000 7f7346432640 1 Processor -- start 2023-12-08T08:21:28.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.943+0000 7f7346432640 1 -- start start 2023-12-08T08:21:28.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.943+0000 7f7346432640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73400c5300 0x7f73400befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:28.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.943+0000 7f7346432640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f734014b1e0 0x7f734013e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:28.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.943+0000 7f7346432640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7340151280 0x7f73400a69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:28.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.943+0000 7f7346432640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73400c6480 con 0x7f7340151280 2023-12-08T08:21:28.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.943+0000 7f7346432640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73401f0370 con 0x7f73400c5300 2023-12-08T08:21:28.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.943+0000 7f7346432640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73401f0eb0 con 0x7f734014b1e0 2023-12-08T08:21:28.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.943+0000 7f73449cf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7340151280 0x7f73400a69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:28.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.943+0000 7f73449cf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7340151280 0x7f73400a69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33882/0 (socket says 172.21.15.88:33882) 2023-12-08T08:21:28.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.943+0000 7f73449cf640 1 -- 172.21.15.88:0/1996008397 learned_addr learned my addr 172.21.15.88:0/1996008397 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:28.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.943+0000 7f733f7fe640 1 --2- 172.21.15.88:0/1996008397 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f734014b1e0 0x7f734013e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:28.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.943+0000 7f733ffff640 1 --2- 172.21.15.88:0/1996008397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73400c5300 0x7f73400befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:28.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.943+0000 7f73449cf640 1 -- 172.21.15.88:0/1996008397 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f734014b1e0 msgr2=0x7f734013e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:28.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.943+0000 7f73449cf640 1 --2- 172.21.15.88:0/1996008397 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f734014b1e0 0x7f734013e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.943+0000 7f73449cf640 1 -- 172.21.15.88:0/1996008397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73400c5300 msgr2=0x7f73400befc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:28.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.943+0000 7f73449cf640 1 --2- 172.21.15.88:0/1996008397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73400c5300 0x7f73400befc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.943+0000 7f73449cf640 1 -- 172.21.15.88:0/1996008397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7334009420 con 0x7f7340151280 2023-12-08T08:21:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.943+0000 7f73449cf640 1 --2- 172.21.15.88:0/1996008397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7340151280 0x7f73400a69d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7338002240 tx=0x7f733800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.943+0000 7f733cff9640 1 -- 172.21.15.88:0/1996008397 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733800abd0 con 0x7f7340151280 2023-12-08T08:21:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.943+0000 7f733cff9640 1 -- 172.21.15.88:0/1996008397 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733800ad30 con 0x7f7340151280 2023-12-08T08:21:28.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.943+0000 7f733cff9640 1 -- 172.21.15.88:0/1996008397 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733800aea0 con 0x7f7340151280 2023-12-08T08:21:28.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.943+0000 7f7346432640 1 -- 172.21.15.88:0/1996008397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73401f0580 con 0x7f7340151280 2023-12-08T08:21:28.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.943+0000 7f7346432640 1 -- 172.21.15.88:0/1996008397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73401f0b40 con 0x7f7340151280 2023-12-08T08:21:28.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.943+0000 7f7346432640 1 -- 172.21.15.88:0/1996008397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73401f1060 con 0x7f7340151280 2023-12-08T08:21:28.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.947+0000 7f733cff9640 1 -- 172.21.15.88:0/1996008397 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7338007070 con 0x7f7340151280 2023-12-08T08:21:28.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.947+0000 7f733cff9640 1 --2- 172.21.15.88:0/1996008397 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f732c0664a0 0x7f732c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:28.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.947+0000 7f733cff9640 1 -- 172.21.15.88:0/1996008397 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7338083fd0 con 0x7f7340151280 2023-12-08T08:21:28.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.947+0000 7f733ffff640 1 --2- 172.21.15.88:0/1996008397 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f732c0664a0 0x7f732c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:28.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.947+0000 7f733ffff640 1 --2- 172.21.15.88:0/1996008397 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f732c0664a0 0x7f732c068960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f734014a940 tx=0x7f7330008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:28.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:28.951+0000 7f733cff9640 1 -- 172.21.15.88:0/1996008397 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f73380511a0 con 0x7f7340151280 2023-12-08T08:21:29.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.103+0000 7f7346432640 1 -- 172.21.15.88:0/1996008397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7340067630 con 0x7f7340151280 2023-12-08T08:21:29.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.103+0000 7f733cff9640 1 -- 172.21.15.88:0/1996008397 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f73380547c0 con 0x7f7340151280 2023-12-08T08:21:29.107 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:21:29.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.103+0000 7f7346432640 1 -- 172.21.15.88:0/1996008397 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f732c0664a0 msgr2=0x7f732c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:29.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.103+0000 7f7346432640 1 --2- 172.21.15.88:0/1996008397 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f732c0664a0 0x7f732c068960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f734014a940 tx=0x7f7330008040 comp rx=0 tx=0).stop 2023-12-08T08:21:29.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.103+0000 7f7346432640 1 -- 172.21.15.88:0/1996008397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7340151280 msgr2=0x7f73400a69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:29.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.103+0000 7f7346432640 1 --2- 172.21.15.88:0/1996008397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7340151280 0x7f73400a69d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7338002240 tx=0x7f733800cf00 comp rx=0 tx=0).stop 2023-12-08T08:21:29.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.103+0000 7f7346432640 1 -- 172.21.15.88:0/1996008397 shutdown_connections 2023-12-08T08:21:29.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.103+0000 7f7346432640 1 --2- 172.21.15.88:0/1996008397 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f732c0664a0 0x7f732c068960 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.103+0000 7f7346432640 1 --2- 172.21.15.88:0/1996008397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7340151280 0x7f73400a69d0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.103+0000 7f7346432640 1 --2- 172.21.15.88:0/1996008397 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f734014b1e0 0x7f734013e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.103+0000 7f7346432640 1 --2- 172.21.15.88:0/1996008397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73400c5300 0x7f73400befc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.103+0000 7f7346432640 1 -- 172.21.15.88:0/1996008397 >> 172.21.15.88:0/1996008397 conn(0x7f73400c59f0 msgr2=0x7f73401424b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:29.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.103+0000 7f7346432640 1 -- 172.21.15.88:0/1996008397 shutdown_connections 2023-12-08T08:21:29.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.103+0000 7f7346432640 1 -- 172.21.15.88:0/1996008397 wait complete. 2023-12-08T08:21:29.127 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:21:29.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.263+0000 7ff67772a640 1 Processor -- start 2023-12-08T08:21:29.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.263+0000 7ff67772a640 1 -- start start 2023-12-08T08:21:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.263+0000 7ff67772a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff67015c680 0x7ff6700c0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.263+0000 7ff67772a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff67006bce0 con 0x7ff6700c0e10 2023-12-08T08:21:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.263+0000 7ff67772a640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6700c2270 con 0x7ff670156200 2023-12-08T08:21:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.263+0000 7ff67772a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff67006d8d0 con 0x7ff67015c680 2023-12-08T08:21:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.263+0000 7ff675cc7640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff67015c680 0x7ff6700c0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.263+0000 7ff674cc5640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff6700c0e10 0x7ff67015bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46796/0 (socket says 172.21.15.88:46796) 2023-12-08T08:21:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.263+0000 7ff674cc5640 1 -- 172.21.15.88:0/763151908 learned_addr learned my addr 172.21.15.88:0/763151908 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:29.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.263+0000 7ff675cc7640 1 -- 172.21.15.88:0/763151908 >> v1:172.21.15.148:6789/0 conn(0x7ff670156200 legacy=0x7ff6700c1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:29.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.263+0000 7ff675cc7640 1 -- 172.21.15.88:0/763151908 >> v1:172.21.15.88:6789/0 conn(0x7ff6700c0e10 legacy=0x7ff67015bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:29.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.263+0000 7ff675cc7640 1 -- 172.21.15.88:0/763151908 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff67015cc60 con 0x7ff67015c680 2023-12-08T08:21:29.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.267+0000 7ff675cc7640 1 --2- 172.21.15.88:0/763151908 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff67015c680 0x7ff6700c0370 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff668009d90 tx=0x7ff66801c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afbdbbf56409b6ec server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.267+0000 7ff667fff640 1 -- 172.21.15.88:0/763151908 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6680a66c0 con 0x7ff67015c680 2023-12-08T08:21:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.267+0000 7ff667fff640 1 -- 172.21.15.88:0/763151908 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6680a6820 con 0x7ff67015c680 2023-12-08T08:21:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.267+0000 7ff667fff640 1 -- 172.21.15.88:0/763151908 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6680a6bb0 con 0x7ff67015c680 2023-12-08T08:21:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.267+0000 7ff67772a640 1 -- 172.21.15.88:0/763151908 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff67015c680 msgr2=0x7ff6700c0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.267+0000 7ff67772a640 1 --2- 172.21.15.88:0/763151908 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff67015c680 0x7ff6700c0370 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff668009d90 tx=0x7ff66801c7f0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.267+0000 7ff67772a640 1 -- 172.21.15.88:0/763151908 shutdown_connections 2023-12-08T08:21:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.267+0000 7ff67772a640 1 --2- 172.21.15.88:0/763151908 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff67015c680 0x7ff6700c0370 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.267+0000 7ff67772a640 1 -- 172.21.15.88:0/763151908 >> 172.21.15.88:0/763151908 conn(0x7ff6700c59f0 msgr2=0x7ff6700c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.267+0000 7ff67772a640 1 -- 172.21.15.88:0/763151908 shutdown_connections 2023-12-08T08:21:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.267+0000 7ff67772a640 1 -- 172.21.15.88:0/763151908 wait complete. 2023-12-08T08:21:29.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.271+0000 7ff67772a640 1 Processor -- start 2023-12-08T08:21:29.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.271+0000 7ff67772a640 1 -- start start 2023-12-08T08:21:29.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.271+0000 7ff67772a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6700c0e10 0x7ff6700aaf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:29.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.271+0000 7ff67772a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff670156200 0x7ff67014fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:29.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.271+0000 7ff67772a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff67015c680 0x7ff67014b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:29.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.271+0000 7ff67772a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff670152430 con 0x7ff6700c0e10 2023-12-08T08:21:29.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.271+0000 7ff67772a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6701f49e0 con 0x7ff67015c680 2023-12-08T08:21:29.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.271+0000 7ff67772a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6701530f0 con 0x7ff670156200 2023-12-08T08:21:29.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.271+0000 7ff6754c6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6700c0e10 0x7ff6700aaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:29.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.271+0000 7ff6754c6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6700c0e10 0x7ff6700aaf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33894/0 (socket says 172.21.15.88:33894) 2023-12-08T08:21:29.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.271+0000 7ff6754c6640 1 -- 172.21.15.88:0/3853578710 learned_addr learned my addr 172.21.15.88:0/3853578710 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:29.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.271+0000 7ff675cc7640 1 --2- 172.21.15.88:0/3853578710 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff67015c680 0x7ff67014b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:29.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.271+0000 7ff674cc5640 1 --2- 172.21.15.88:0/3853578710 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff670156200 0x7ff67014fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:29.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.271+0000 7ff6754c6640 1 -- 172.21.15.88:0/3853578710 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff670156200 msgr2=0x7ff67014fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:29.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.271+0000 7ff6754c6640 1 --2- 172.21.15.88:0/3853578710 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff670156200 0x7ff67014fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.271+0000 7ff6754c6640 1 -- 172.21.15.88:0/3853578710 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff67015c680 msgr2=0x7ff67014b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:29.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.271+0000 7ff6754c6640 1 --2- 172.21.15.88:0/3853578710 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff67015c680 0x7ff67014b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.271+0000 7ff6754c6640 1 -- 172.21.15.88:0/3853578710 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff668009a70 con 0x7ff6700c0e10 2023-12-08T08:21:29.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.271+0000 7ff675cc7640 1 --2- 172.21.15.88:0/3853578710 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff67015c680 0x7ff67014b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:29.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.271+0000 7ff6754c6640 1 --2- 172.21.15.88:0/3853578710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6700c0e10 0x7ff6700aaf20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff66c00c450 tx=0x7ff66c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:29.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.271+0000 7ff665ffb640 1 -- 172.21.15.88:0/3853578710 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c012830 con 0x7ff6700c0e10 2023-12-08T08:21:29.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.271+0000 7ff665ffb640 1 -- 172.21.15.88:0/3853578710 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66c0129b0 con 0x7ff6700c0e10 2023-12-08T08:21:29.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.271+0000 7ff665ffb640 1 -- 172.21.15.88:0/3853578710 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c012d60 con 0x7ff6700c0e10 2023-12-08T08:21:29.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.271+0000 7ff67772a640 1 -- 172.21.15.88:0/3853578710 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6701f4390 con 0x7ff6700c0e10 2023-12-08T08:21:29.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.271+0000 7ff67772a640 1 -- 172.21.15.88:0/3853578710 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6700aa0e0 con 0x7ff6700c0e10 2023-12-08T08:21:29.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.275+0000 7ff67772a640 1 -- 172.21.15.88:0/3853578710 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6701f41f0 con 0x7ff6700c0e10 2023-12-08T08:21:29.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.275+0000 7ff665ffb640 1 -- 172.21.15.88:0/3853578710 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff66c01c460 con 0x7ff6700c0e10 2023-12-08T08:21:29.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.275+0000 7ff665ffb640 1 --2- 172.21.15.88:0/3853578710 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff654066470 0x7ff654068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:29.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.275+0000 7ff665ffb640 1 -- 172.21.15.88:0/3853578710 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff66c084160 con 0x7ff6700c0e10 2023-12-08T08:21:29.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.275+0000 7ff674cc5640 1 --2- 172.21.15.88:0/3853578710 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff654066470 0x7ff654068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:29.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.275+0000 7ff674cc5640 1 --2- 172.21.15.88:0/3853578710 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff654066470 0x7ff654068930 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff6700aa470 tx=0x7ff660009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:29.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.279+0000 7ff665ffb640 1 -- 172.21.15.88:0/3853578710 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff6701f41f0 con 0x7ff6700c0e10 2023-12-08T08:21:29.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.427+0000 7ff67772a640 1 -- 172.21.15.88:0/3853578710 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff6701f41f0 con 0x7ff6700c0e10 2023-12-08T08:21:29.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.427+0000 7ff665ffb640 1 -- 172.21.15.88:0/3853578710 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff6701f41f0 con 0x7ff6700c0e10 2023-12-08T08:21:29.432 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:21:29.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.427+0000 7ff67772a640 1 -- 172.21.15.88:0/3853578710 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff654066470 msgr2=0x7ff654068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:29.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.427+0000 7ff67772a640 1 --2- 172.21.15.88:0/3853578710 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff654066470 0x7ff654068930 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff6700aa470 tx=0x7ff660009040 comp rx=0 tx=0).stop 2023-12-08T08:21:29.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.427+0000 7ff67772a640 1 -- 172.21.15.88:0/3853578710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6700c0e10 msgr2=0x7ff6700aaf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:29.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.427+0000 7ff67772a640 1 --2- 172.21.15.88:0/3853578710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6700c0e10 0x7ff6700aaf20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff66c00c450 tx=0x7ff66c00c910 comp rx=0 tx=0).stop 2023-12-08T08:21:29.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.431+0000 7ff67772a640 1 -- 172.21.15.88:0/3853578710 shutdown_connections 2023-12-08T08:21:29.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.431+0000 7ff67772a640 1 --2- 172.21.15.88:0/3853578710 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff654066470 0x7ff654068930 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.431+0000 7ff67772a640 1 --2- 172.21.15.88:0/3853578710 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff67015c680 0x7ff67014b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.431+0000 7ff67772a640 1 --2- 172.21.15.88:0/3853578710 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff670156200 0x7ff67014fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.431+0000 7ff67772a640 1 --2- 172.21.15.88:0/3853578710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6700c0e10 0x7ff6700aaf20 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.431+0000 7ff67772a640 1 -- 172.21.15.88:0/3853578710 >> 172.21.15.88:0/3853578710 conn(0x7ff6700c59f0 msgr2=0x7ff6700c1680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:29.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.431+0000 7ff67772a640 1 -- 172.21.15.88:0/3853578710 shutdown_connections 2023-12-08T08:21:29.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.431+0000 7ff67772a640 1 -- 172.21.15.88:0/3853578710 wait complete. 2023-12-08T08:21:29.452 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:21:29.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.591+0000 7f20eaac9640 1 Processor -- start 2023-12-08T08:21:29.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.591+0000 7f20eaac9640 1 -- start start 2023-12-08T08:21:29.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.591+0000 7f20eaac9640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20e414fc30 0x7f20e40c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:29.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.591+0000 7f20eaac9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f20e406d840 0x7f20e40c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:29.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.591+0000 7f20eaac9640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e4152910 con 0x7f20e414f850 2023-12-08T08:21:29.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.591+0000 7f20eaac9640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e40c2240 con 0x7f20e406d840 2023-12-08T08:21:29.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.591+0000 7f20eaac9640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e4152bf0 con 0x7f20e414fc30 2023-12-08T08:21:29.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.591+0000 7f20e9066640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f20e406d840 0x7f20e40c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:29.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.595+0000 7f20e9066640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f20e406d840 0x7f20e40c4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33908/0 (socket says 172.21.15.88:33908) 2023-12-08T08:21:29.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.595+0000 7f20e9066640 1 -- 172.21.15.88:0/3620000496 learned_addr learned my addr 172.21.15.88:0/3620000496 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:29.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.595+0000 7f20dbfff640 1 --2- 172.21.15.88:0/3620000496 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20e414fc30 0x7f20e40c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:29.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.595+0000 7f20e9066640 1 -- 172.21.15.88:0/3620000496 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20e414fc30 msgr2=0x7f20e40c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:29.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.595+0000 7f20e9066640 1 --2- 172.21.15.88:0/3620000496 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20e414fc30 0x7f20e40c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.595+0000 7f20e9066640 1 -- 172.21.15.88:0/3620000496 >> v1:172.21.15.148:6789/0 conn(0x7f20e414f850 legacy=0x7f20e40aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:29.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.595+0000 7f20e9066640 1 -- 172.21.15.88:0/3620000496 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e4152ed0 con 0x7f20e406d840 2023-12-08T08:21:29.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.595+0000 7f20dbfff640 1 --2- 172.21.15.88:0/3620000496 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20e414fc30 0x7f20e40c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:29.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.595+0000 7f20e9066640 1 --2- 172.21.15.88:0/3620000496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20e406d840 0x7f20e40c4210 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f20dc009e50 tx=0x7f20dc01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=269ff9af0703649 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:29.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.595+0000 7f20db7fe640 1 -- 172.21.15.88:0/3620000496 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc0a5780 con 0x7f20e406d840 2023-12-08T08:21:29.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.595+0000 7f20db7fe640 1 -- 172.21.15.88:0/3620000496 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20dc0a58e0 con 0x7f20e406d840 2023-12-08T08:21:29.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.595+0000 7f20db7fe640 1 -- 172.21.15.88:0/3620000496 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc0a5c70 con 0x7f20e406d840 2023-12-08T08:21:29.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.599+0000 7f20eaac9640 1 -- 172.21.15.88:0/3620000496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20e406d840 msgr2=0x7f20e40c4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:29.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.599+0000 7f20eaac9640 1 --2- 172.21.15.88:0/3620000496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20e406d840 0x7f20e40c4210 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f20dc009e50 tx=0x7f20dc01c9d0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.599+0000 7f20eaac9640 1 -- 172.21.15.88:0/3620000496 shutdown_connections 2023-12-08T08:21:29.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.599+0000 7f20eaac9640 1 --2- 172.21.15.88:0/3620000496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20e406d840 0x7f20e40c4210 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.599+0000 7f20eaac9640 1 --2- 172.21.15.88:0/3620000496 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20e414fc30 0x7f20e40c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.599+0000 7f20eaac9640 1 -- 172.21.15.88:0/3620000496 >> 172.21.15.88:0/3620000496 conn(0x7f20e40c59f0 msgr2=0x7f20e40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:29.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.599+0000 7f20eaac9640 1 -- 172.21.15.88:0/3620000496 shutdown_connections 2023-12-08T08:21:29.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.599+0000 7f20eaac9640 1 -- 172.21.15.88:0/3620000496 wait complete. 2023-12-08T08:21:29.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.599+0000 7f20eaac9640 1 Processor -- start 2023-12-08T08:21:29.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.599+0000 7f20eaac9640 1 -- start start 2023-12-08T08:21:29.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.599+0000 7f20eaac9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20e406d840 0x7f20e40a9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:29.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.599+0000 7f20eaac9640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20e414f850 0x7f20e414aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:29.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.599+0000 7f20eaac9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e414fc30 0x7f20e40a5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:29.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.599+0000 7f20eaac9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e4154030 con 0x7f20e406d840 2023-12-08T08:21:29.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.599+0000 7f20eaac9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e4149fe0 con 0x7f20e414fc30 2023-12-08T08:21:29.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.599+0000 7f20eaac9640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e40a9550 con 0x7f20e414f850 2023-12-08T08:21:29.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.599+0000 7f20e8865640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20e406d840 0x7f20e40a9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:29.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.599+0000 7f20e8865640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20e406d840 0x7f20e40a9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33912/0 (socket says 172.21.15.88:33912) 2023-12-08T08:21:29.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.599+0000 7f20e8865640 1 -- 172.21.15.88:0/2226027739 learned_addr learned my addr 172.21.15.88:0/2226027739 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:29.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.599+0000 7f20e9066640 1 --2- 172.21.15.88:0/2226027739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e414fc30 0x7f20e40a5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:29.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.599+0000 7f20dbfff640 1 --2- 172.21.15.88:0/2226027739 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20e414f850 0x7f20e414aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:29.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.599+0000 7f20e8865640 1 -- 172.21.15.88:0/2226027739 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20e414f850 msgr2=0x7f20e414aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:29.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.599+0000 7f20e8865640 1 --2- 172.21.15.88:0/2226027739 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20e414f850 0x7f20e414aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.599+0000 7f20e8865640 1 -- 172.21.15.88:0/2226027739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e414fc30 msgr2=0x7f20e40a5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:29.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.599+0000 7f20e8865640 1 --2- 172.21.15.88:0/2226027739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e414fc30 0x7f20e40a5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.599+0000 7f20e8865640 1 -- 172.21.15.88:0/2226027739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc009b30 con 0x7f20e406d840 2023-12-08T08:21:29.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.603+0000 7f20e8865640 1 --2- 172.21.15.88:0/2226027739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20e406d840 0x7f20e40a9010 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f20e000c4b0 tx=0x7f20e000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:29.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.603+0000 7f20d97fa640 1 -- 172.21.15.88:0/2226027739 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e0012830 con 0x7f20e406d840 2023-12-08T08:21:29.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.603+0000 7f20d97fa640 1 -- 172.21.15.88:0/2226027739 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e00129b0 con 0x7f20e406d840 2023-12-08T08:21:29.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.603+0000 7f20eaac9640 1 -- 172.21.15.88:0/2226027739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e414ba10 con 0x7f20e406d840 2023-12-08T08:21:29.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.603+0000 7f20d97fa640 1 -- 172.21.15.88:0/2226027739 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e0012d60 con 0x7f20e406d840 2023-12-08T08:21:29.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.603+0000 7f20eaac9640 1 -- 172.21.15.88:0/2226027739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e414a230 con 0x7f20e406d840 2023-12-08T08:21:29.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.603+0000 7f20eaac9640 1 -- 172.21.15.88:0/2226027739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e4067630 con 0x7f20e406d840 2023-12-08T08:21:29.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.603+0000 7f20d97fa640 1 -- 172.21.15.88:0/2226027739 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f20e001c460 con 0x7f20e406d840 2023-12-08T08:21:29.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.603+0000 7f20d97fa640 1 --2- 172.21.15.88:0/2226027739 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f20d00664a0 0x7f20d0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:29.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.603+0000 7f20d97fa640 1 -- 172.21.15.88:0/2226027739 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f20e0083fe0 con 0x7f20e406d840 2023-12-08T08:21:29.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.603+0000 7f20dbfff640 1 --2- 172.21.15.88:0/2226027739 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f20d00664a0 0x7f20d0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:29.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.607+0000 7f20dbfff640 1 --2- 172.21.15.88:0/2226027739 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f20d00664a0 0x7f20d0068960 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f20d4006fd0 tx=0x7f20d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:29.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.607+0000 7f20d97fa640 1 -- 172.21.15.88:0/2226027739 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f20e00510f0 con 0x7f20e406d840 2023-12-08T08:21:29.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.763+0000 7f20eaac9640 1 -- 172.21.15.88:0/2226027739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f20e40a4a90 con 0x7f20e406d840 2023-12-08T08:21:29.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.763+0000 7f20d97fa640 1 -- 172.21.15.88:0/2226027739 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v35) v1 ==== 105+0+11 (secure 0 0 0) 0x7f20e0054710 con 0x7f20e406d840 2023-12-08T08:21:29.769 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:21:29.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.767+0000 7f20eaac9640 1 -- 172.21.15.88:0/2226027739 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f20d00664a0 msgr2=0x7f20d0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:29.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.767+0000 7f20eaac9640 1 --2- 172.21.15.88:0/2226027739 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f20d00664a0 0x7f20d0068960 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f20d4006fd0 tx=0x7f20d4008040 comp rx=0 tx=0).stop 2023-12-08T08:21:29.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.767+0000 7f20eaac9640 1 -- 172.21.15.88:0/2226027739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20e406d840 msgr2=0x7f20e40a9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:29.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.767+0000 7f20eaac9640 1 --2- 172.21.15.88:0/2226027739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20e406d840 0x7f20e40a9010 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f20e000c4b0 tx=0x7f20e000c970 comp rx=0 tx=0).stop 2023-12-08T08:21:29.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.767+0000 7f20eaac9640 1 -- 172.21.15.88:0/2226027739 shutdown_connections 2023-12-08T08:21:29.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.767+0000 7f20eaac9640 1 --2- 172.21.15.88:0/2226027739 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f20d00664a0 0x7f20d0068960 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.767+0000 7f20eaac9640 1 --2- 172.21.15.88:0/2226027739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e414fc30 0x7f20e40a5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.767+0000 7f20eaac9640 1 --2- 172.21.15.88:0/2226027739 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20e414f850 0x7f20e414aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.767+0000 7f20eaac9640 1 --2- 172.21.15.88:0/2226027739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20e406d840 0x7f20e40a9010 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.767+0000 7f20eaac9640 1 -- 172.21.15.88:0/2226027739 >> 172.21.15.88:0/2226027739 conn(0x7f20e40c59f0 msgr2=0x7f20e40c3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:29.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.767+0000 7f20eaac9640 1 -- 172.21.15.88:0/2226027739 shutdown_connections 2023-12-08T08:21:29.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.767+0000 7f20eaac9640 1 -- 172.21.15.88:0/2226027739 wait complete. 2023-12-08T08:21:29.791 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:21:29.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.927+0000 7fdca0494640 1 Processor -- start 2023-12-08T08:21:29.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.927+0000 7fdca0494640 1 -- start start 2023-12-08T08:21:29.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.927+0000 7fdca0494640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdc9814f850 0x7fdc980aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:29.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.927+0000 7fdca0494640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc9814fc30 0x7fdc980c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:29.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.927+0000 7fdca0494640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdc9806d840 0x7fdc980c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:29.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.927+0000 7fdca0494640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc980c2240 con 0x7fdc9814f850 2023-12-08T08:21:29.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.927+0000 7fdca0494640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc98152910 con 0x7fdc9806d840 2023-12-08T08:21:29.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.927+0000 7fdca0494640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc98152bf0 con 0x7fdc9814fc30 2023-12-08T08:21:29.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.927+0000 7fdc9e230640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdc9814f850 0x7fdc980aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:29.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.927+0000 7fdc9e230640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdc9814f850 0x7fdc980aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33922/0 (socket says 172.21.15.88:33922) 2023-12-08T08:21:29.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.927+0000 7fdc9e230640 1 -- 172.21.15.88:0/56022569 learned_addr learned my addr 172.21.15.88:0/56022569 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:29.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.927+0000 7fdc9ea31640 1 --2- 172.21.15.88:0/56022569 >> v2:172.21.15.148:3300/0 conn(0x7fdc9806d840 0x7fdc980c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:29.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.927+0000 7fdc9da2f640 1 --2- 172.21.15.88:0/56022569 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc9814fc30 0x7fdc980c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:29.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.927+0000 7fdc9e230640 1 -- 172.21.15.88:0/56022569 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc9814fc30 msgr2=0x7fdc980c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:29.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.927+0000 7fdc9e230640 1 --2- 172.21.15.88:0/56022569 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc9814fc30 0x7fdc980c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.927+0000 7fdc9e230640 1 -- 172.21.15.88:0/56022569 >> v2:172.21.15.148:3300/0 conn(0x7fdc9806d840 msgr2=0x7fdc980c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:29.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.927+0000 7fdc9e230640 1 --2- 172.21.15.88:0/56022569 >> v2:172.21.15.148:3300/0 conn(0x7fdc9806d840 0x7fdc980c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.927+0000 7fdc9e230640 1 -- 172.21.15.88:0/56022569 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc98152ed0 con 0x7fdc9814f850 2023-12-08T08:21:29.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.927+0000 7fdc9da2f640 1 --2- 172.21.15.88:0/56022569 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc9814fc30 0x7fdc980c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:29.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.931+0000 7fdc9e230640 1 --2- 172.21.15.88:0/56022569 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc9814f850 0x7fdc980aacf0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fdc9806e1a0 tx=0x7fdc9401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ffba70b853ad686 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:29.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.931+0000 7fdc9d22e640 1 -- 172.21.15.88:0/56022569 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc940aa640 con 0x7fdc9814f850 2023-12-08T08:21:29.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.931+0000 7fdc9d22e640 1 -- 172.21.15.88:0/56022569 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc940aa7a0 con 0x7fdc9814f850 2023-12-08T08:21:29.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.931+0000 7fdc9d22e640 1 -- 172.21.15.88:0/56022569 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc940aab30 con 0x7fdc9814f850 2023-12-08T08:21:29.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.931+0000 7fdca0494640 1 -- 172.21.15.88:0/56022569 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc9814f850 msgr2=0x7fdc980aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:29.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.931+0000 7fdca0494640 1 --2- 172.21.15.88:0/56022569 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc9814f850 0x7fdc980aacf0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fdc9806e1a0 tx=0x7fdc9401c500 comp rx=0 tx=0).stop 2023-12-08T08:21:29.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.931+0000 7fdca0494640 1 -- 172.21.15.88:0/56022569 shutdown_connections 2023-12-08T08:21:29.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.931+0000 7fdca0494640 1 --2- 172.21.15.88:0/56022569 >> v2:172.21.15.148:3300/0 conn(0x7fdc9806d840 0x7fdc980c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.931+0000 7fdca0494640 1 --2- 172.21.15.88:0/56022569 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc9814fc30 0x7fdc980c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.931+0000 7fdca0494640 1 --2- 172.21.15.88:0/56022569 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc9814f850 0x7fdc980aacf0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.931+0000 7fdca0494640 1 -- 172.21.15.88:0/56022569 >> 172.21.15.88:0/56022569 conn(0x7fdc980c59f0 msgr2=0x7fdc980c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:29.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.931+0000 7fdca0494640 1 -- 172.21.15.88:0/56022569 shutdown_connections 2023-12-08T08:21:29.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.931+0000 7fdca0494640 1 -- 172.21.15.88:0/56022569 wait complete. 2023-12-08T08:21:29.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.935+0000 7fdca0494640 1 Processor -- start 2023-12-08T08:21:29.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.935+0000 7fdca0494640 1 -- start start 2023-12-08T08:21:29.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.935+0000 7fdca0494640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc9806d840 0x7fdc98150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:29.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.935+0000 7fdca0494640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc9814f850 0x7fdc980a6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:29.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.935+0000 7fdca0494640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc9814fc30 0x7fdc981ed690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:29.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.935+0000 7fdca0494640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc981f1740 con 0x7fdc9806d840 2023-12-08T08:21:29.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.935+0000 7fdca0494640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc981f1a20 con 0x7fdc9814fc30 2023-12-08T08:21:29.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.935+0000 7fdca0494640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9815b600 con 0x7fdc9814f850 2023-12-08T08:21:29.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.935+0000 7fdc9e230640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc9806d840 0x7fdc98150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:29.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.935+0000 7fdc9e230640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc9806d840 0x7fdc98150c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33928/0 (socket says 172.21.15.88:33928) 2023-12-08T08:21:29.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.935+0000 7fdc9e230640 1 -- 172.21.15.88:0/3743891340 learned_addr learned my addr 172.21.15.88:0/3743891340 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:29.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.935+0000 7fdc9ea31640 1 --2- 172.21.15.88:0/3743891340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc9814fc30 0x7fdc981ed690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:29.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.935+0000 7fdc9da2f640 1 --2- 172.21.15.88:0/3743891340 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc9814f850 0x7fdc980a6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:29.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.935+0000 7fdc9e230640 1 -- 172.21.15.88:0/3743891340 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc9814f850 msgr2=0x7fdc980a6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:29.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.935+0000 7fdc9e230640 1 --2- 172.21.15.88:0/3743891340 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc9814f850 0x7fdc980a6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.935+0000 7fdc9e230640 1 -- 172.21.15.88:0/3743891340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc9814fc30 msgr2=0x7fdc981ed690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:29.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.935+0000 7fdc9e230640 1 --2- 172.21.15.88:0/3743891340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc9814fc30 0x7fdc981ed690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:29.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.935+0000 7fdc9e230640 1 -- 172.21.15.88:0/3743891340 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc940094d0 con 0x7fdc9806d840 2023-12-08T08:21:29.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.935+0000 7fdc9da2f640 1 --2- 172.21.15.88:0/3743891340 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc9814f850 0x7fdc980a6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:29.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.935+0000 7fdc9ea31640 1 --2- 172.21.15.88:0/3743891340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc9814fc30 0x7fdc981ed690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:29.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.935+0000 7fdc9e230640 1 --2- 172.21.15.88:0/3743891340 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc9806d840 0x7fdc98150c10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdc9401abb0 tx=0x7fdc9401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:29.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.935+0000 7fdc8effd640 1 -- 172.21.15.88:0/3743891340 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc940bd5f0 con 0x7fdc9806d840 2023-12-08T08:21:29.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.935+0000 7fdc8effd640 1 -- 172.21.15.88:0/3743891340 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc940bd750 con 0x7fdc9806d840 2023-12-08T08:21:29.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.935+0000 7fdca0494640 1 -- 172.21.15.88:0/3743891340 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc9815b8e0 con 0x7fdc9806d840 2023-12-08T08:21:29.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.935+0000 7fdc8effd640 1 -- 172.21.15.88:0/3743891340 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc940bdb00 con 0x7fdc9806d840 2023-12-08T08:21:29.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.935+0000 7fdca0494640 1 -- 172.21.15.88:0/3743891340 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc980a7360 con 0x7fdc9806d840 2023-12-08T08:21:29.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.939+0000 7fdca0494640 1 -- 172.21.15.88:0/3743891340 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc9815bb20 con 0x7fdc9806d840 2023-12-08T08:21:29.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.939+0000 7fdc8effd640 1 -- 172.21.15.88:0/3743891340 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdc940a8050 con 0x7fdc9806d840 2023-12-08T08:21:29.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.939+0000 7fdc8effd640 1 --2- 172.21.15.88:0/3743891340 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdc7c066470 0x7fdc7c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:29.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.939+0000 7fdc8effd640 1 -- 172.21.15.88:0/3743891340 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdc9411e8b0 con 0x7fdc9806d840 2023-12-08T08:21:29.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.939+0000 7fdc9da2f640 1 --2- 172.21.15.88:0/3743891340 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdc7c066470 0x7fdc7c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:29.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.939+0000 7fdc9da2f640 1 --2- 172.21.15.88:0/3743891340 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdc7c066470 0x7fdc7c068930 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdc9814eac0 tx=0x7fdc88008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:29.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:29.943+0000 7fdc8effd640 1 -- 172.21.15.88:0/3743891340 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdc940ebb90 con 0x7fdc9806d840 2023-12-08T08:21:30.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.099+0000 7fdca0494640 1 -- 172.21.15.88:0/3743891340 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fdc981526d0 con 0x7fdc9806d840 2023-12-08T08:21:30.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.099+0000 7fdc8effd640 1 -- 172.21.15.88:0/3743891340 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v35) v1 ==== 101+0+11 (secure 0 0 0) 0x7fdc981526d0 con 0x7fdc9806d840 2023-12-08T08:21:30.104 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:21:30.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.099+0000 7fdca0494640 1 -- 172.21.15.88:0/3743891340 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdc7c066470 msgr2=0x7fdc7c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:30.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.099+0000 7fdca0494640 1 --2- 172.21.15.88:0/3743891340 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdc7c066470 0x7fdc7c068930 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdc9814eac0 tx=0x7fdc88008040 comp rx=0 tx=0).stop 2023-12-08T08:21:30.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.099+0000 7fdca0494640 1 -- 172.21.15.88:0/3743891340 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc9806d840 msgr2=0x7fdc98150c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:30.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.099+0000 7fdca0494640 1 --2- 172.21.15.88:0/3743891340 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc9806d840 0x7fdc98150c10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdc9401abb0 tx=0x7fdc9401ad40 comp rx=0 tx=0).stop 2023-12-08T08:21:30.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.103+0000 7fdca0494640 1 -- 172.21.15.88:0/3743891340 shutdown_connections 2023-12-08T08:21:30.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.103+0000 7fdca0494640 1 --2- 172.21.15.88:0/3743891340 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdc7c066470 0x7fdc7c068930 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:30.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.103+0000 7fdca0494640 1 --2- 172.21.15.88:0/3743891340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc9814fc30 0x7fdc981ed690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:30.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.103+0000 7fdca0494640 1 --2- 172.21.15.88:0/3743891340 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdc9814f850 0x7fdc980a6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:30.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.103+0000 7fdca0494640 1 --2- 172.21.15.88:0/3743891340 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc9806d840 0x7fdc98150c10 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:30.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.103+0000 7fdca0494640 1 -- 172.21.15.88:0/3743891340 >> 172.21.15.88:0/3743891340 conn(0x7fdc980c59f0 msgr2=0x7fdc9806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:30.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.103+0000 7fdca0494640 1 -- 172.21.15.88:0/3743891340 shutdown_connections 2023-12-08T08:21:30.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.103+0000 7fdca0494640 1 -- 172.21.15.88:0/3743891340 wait complete. 2023-12-08T08:21:30.125 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:21:30.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.259+0000 7f946f9df640 1 Processor -- start 2023-12-08T08:21:30.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.259+0000 7f946f9df640 1 -- start start 2023-12-08T08:21:30.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.259+0000 7f946f9df640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9468154390 0x7f94680c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:30.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.259+0000 7f946f9df640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94680c2110 0x7f94680c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:30.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.259+0000 7f946f9df640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94680a93d0 con 0x7f94680c4f80 2023-12-08T08:21:30.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.259+0000 7f946f9df640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94680aa1c0 con 0x7f9468154390 2023-12-08T08:21:30.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.259+0000 7f946f9df640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9468154770 con 0x7f94680c2110 2023-12-08T08:21:30.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.259+0000 7f946d77b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9468154390 0x7f94680c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:30.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.259+0000 7f946df7c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f94680c4f80 0x7f94680c61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57482/0 (socket says 172.21.15.88:57482) 2023-12-08T08:21:30.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.259+0000 7f946df7c640 1 -- 172.21.15.88:0/3768341765 learned_addr learned my addr 172.21.15.88:0/3768341765 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:30.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.259+0000 7f946cf7a640 1 --2- 172.21.15.88:0/3768341765 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94680c2110 0x7f94680c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:30.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.259+0000 7f946d77b640 1 -- 172.21.15.88:0/3768341765 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94680c2110 msgr2=0x7f94680c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:30.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.259+0000 7f946d77b640 1 --2- 172.21.15.88:0/3768341765 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94680c2110 0x7f94680c5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:30.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.259+0000 7f946d77b640 1 -- 172.21.15.88:0/3768341765 >> v1:172.21.15.88:6789/0 conn(0x7f94680c4f80 legacy=0x7f94680c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:30.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.259+0000 7f946d77b640 1 -- 172.21.15.88:0/3768341765 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94680a9640 con 0x7f9468154390 2023-12-08T08:21:30.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.263+0000 7f946d77b640 1 --2- 172.21.15.88:0/3768341765 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9468154390 0x7f94680c4a40 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f94640097c0 tx=0x7f946401e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed0bcb690e834ca3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:30.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.263+0000 7f945ffff640 1 -- 172.21.15.88:0/3768341765 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94640ac610 con 0x7f9468154390 2023-12-08T08:21:30.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.263+0000 7f945ffff640 1 -- 172.21.15.88:0/3768341765 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94640a8040 con 0x7f9468154390 2023-12-08T08:21:30.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.263+0000 7f945ffff640 1 -- 172.21.15.88:0/3768341765 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94640ac990 con 0x7f9468154390 2023-12-08T08:21:30.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.263+0000 7f946f9df640 1 -- 172.21.15.88:0/3768341765 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9468154390 msgr2=0x7f94680c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:30.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.263+0000 7f946f9df640 1 --2- 172.21.15.88:0/3768341765 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9468154390 0x7f94680c4a40 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f94640097c0 tx=0x7f946401e690 comp rx=0 tx=0).stop 2023-12-08T08:21:30.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.263+0000 7f946f9df640 1 -- 172.21.15.88:0/3768341765 shutdown_connections 2023-12-08T08:21:30.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.263+0000 7f946f9df640 1 --2- 172.21.15.88:0/3768341765 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94680c2110 0x7f94680c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:30.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.263+0000 7f946f9df640 1 --2- 172.21.15.88:0/3768341765 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9468154390 0x7f94680c4a40 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:30.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.263+0000 7f946f9df640 1 -- 172.21.15.88:0/3768341765 >> 172.21.15.88:0/3768341765 conn(0x7f946806b220 msgr2=0x7f94680a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:30.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.263+0000 7f946f9df640 1 -- 172.21.15.88:0/3768341765 shutdown_connections 2023-12-08T08:21:30.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.263+0000 7f946f9df640 1 -- 172.21.15.88:0/3768341765 wait complete. 2023-12-08T08:21:30.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.267+0000 7f946f9df640 1 Processor -- start 2023-12-08T08:21:30.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.267+0000 7f946f9df640 1 -- start start 2023-12-08T08:21:30.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.267+0000 7f946f9df640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94680c2110 0x7f94681f5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:30.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.267+0000 7f946f9df640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94680c4f80 0x7f94680a3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:30.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.267+0000 7f946f9df640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9468154390 0x7f9468142b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:30.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.267+0000 7f946f9df640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94681f6280 con 0x7f94680c4f80 2023-12-08T08:21:30.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.267+0000 7f946f9df640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94680a4140 con 0x7f94680c2110 2023-12-08T08:21:30.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.267+0000 7f946f9df640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94681f5df0 con 0x7f9468154390 2023-12-08T08:21:30.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.267+0000 7f946cf7a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94680c4f80 0x7f94680a3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:30.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.267+0000 7f946cf7a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94680c4f80 0x7f94680a3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38898/0 (socket says 172.21.15.88:38898) 2023-12-08T08:21:30.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.267+0000 7f946cf7a640 1 -- 172.21.15.88:0/3090191630 learned_addr learned my addr 172.21.15.88:0/3090191630 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:30.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.267+0000 7f946d77b640 1 --2- 172.21.15.88:0/3090191630 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94680c2110 0x7f94681f5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:30.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.267+0000 7f946df7c640 1 --2- 172.21.15.88:0/3090191630 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9468154390 0x7f9468142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:30.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.267+0000 7f946cf7a640 1 -- 172.21.15.88:0/3090191630 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9468154390 msgr2=0x7f9468142b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:30.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.267+0000 7f946cf7a640 1 --2- 172.21.15.88:0/3090191630 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9468154390 0x7f9468142b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:30.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.267+0000 7f946cf7a640 1 -- 172.21.15.88:0/3090191630 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94680c2110 msgr2=0x7f94681f5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:30.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.267+0000 7f946cf7a640 1 --2- 172.21.15.88:0/3090191630 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94680c2110 0x7f94681f5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:30.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.267+0000 7f946cf7a640 1 -- 172.21.15.88:0/3090191630 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9464009420 con 0x7f94680c4f80 2023-12-08T08:21:30.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.267+0000 7f946df7c640 1 --2- 172.21.15.88:0/3090191630 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9468154390 0x7f9468142b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:30.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.267+0000 7f946cf7a640 1 --2- 172.21.15.88:0/3090191630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94680c4f80 0x7f94680a3880 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f945800d800 tx=0x7f945800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:30.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.267+0000 7f945dffb640 1 -- 172.21.15.88:0/3090191630 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945800b6c0 con 0x7f94680c4f80 2023-12-08T08:21:30.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.267+0000 7f945dffb640 1 -- 172.21.15.88:0/3090191630 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945800b820 con 0x7f94680c4f80 2023-12-08T08:21:30.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.267+0000 7f946f9df640 1 -- 172.21.15.88:0/3090191630 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9468147910 con 0x7f94680c4f80 2023-12-08T08:21:30.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.267+0000 7f945dffb640 1 -- 172.21.15.88:0/3090191630 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945800bb90 con 0x7f94680c4f80 2023-12-08T08:21:30.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.267+0000 7f946f9df640 1 -- 172.21.15.88:0/3090191630 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94681f5a50 con 0x7f94680c4f80 2023-12-08T08:21:30.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.267+0000 7f946f9df640 1 -- 172.21.15.88:0/3090191630 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9468067630 con 0x7f94680c4f80 2023-12-08T08:21:30.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.271+0000 7f945dffb640 1 -- 172.21.15.88:0/3090191630 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f945800bcf0 con 0x7f94680c4f80 2023-12-08T08:21:30.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.271+0000 7f945dffb640 1 --2- 172.21.15.88:0/3090191630 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f944c066470 0x7f944c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:30.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.271+0000 7f945dffb640 1 -- 172.21.15.88:0/3090191630 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f94580845d0 con 0x7f94680c4f80 2023-12-08T08:21:30.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.271+0000 7f946d77b640 1 --2- 172.21.15.88:0/3090191630 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f944c066470 0x7f944c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:30.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.271+0000 7f946d77b640 1 --2- 172.21.15.88:0/3090191630 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f944c066470 0x7f944c068930 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f94640b0000 tx=0x7f94640a9000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:30.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.275+0000 7f945dffb640 1 -- 172.21.15.88:0/3090191630 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9458051780 con 0x7f94680c4f80 2023-12-08T08:21:30.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.435+0000 7f946f9df640 1 -- 172.21.15.88:0/3090191630 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f94680c66d0 con 0x7f94680c4f80 2023-12-08T08:21:30.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.435+0000 7f945dffb640 1 -- 172.21.15.88:0/3090191630 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9458054da0 con 0x7f94680c4f80 2023-12-08T08:21:30.439 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-12-08T08:21:30.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.435+0000 7f946f9df640 1 -- 172.21.15.88:0/3090191630 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f944c066470 msgr2=0x7f944c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:30.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.435+0000 7f946f9df640 1 --2- 172.21.15.88:0/3090191630 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f944c066470 0x7f944c068930 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f94640b0000 tx=0x7f94640a9000 comp rx=0 tx=0).stop 2023-12-08T08:21:30.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.435+0000 7f946f9df640 1 -- 172.21.15.88:0/3090191630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94680c4f80 msgr2=0x7f94680a3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:30.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.435+0000 7f946f9df640 1 --2- 172.21.15.88:0/3090191630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94680c4f80 0x7f94680a3880 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f945800d800 tx=0x7f945800dcc0 comp rx=0 tx=0).stop 2023-12-08T08:21:30.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.435+0000 7f946f9df640 1 -- 172.21.15.88:0/3090191630 shutdown_connections 2023-12-08T08:21:30.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.435+0000 7f946f9df640 1 --2- 172.21.15.88:0/3090191630 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f944c066470 0x7f944c068930 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:30.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.435+0000 7f946f9df640 1 --2- 172.21.15.88:0/3090191630 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9468154390 0x7f9468142b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:30.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.435+0000 7f946f9df640 1 --2- 172.21.15.88:0/3090191630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94680c4f80 0x7f94680a3880 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:30.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.435+0000 7f946f9df640 1 --2- 172.21.15.88:0/3090191630 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94680c2110 0x7f94681f5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:30.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.435+0000 7f946f9df640 1 -- 172.21.15.88:0/3090191630 >> 172.21.15.88:0/3090191630 conn(0x7f946806b220 msgr2=0x7f94681518a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:30.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.435+0000 7f946f9df640 1 -- 172.21.15.88:0/3090191630 shutdown_connections 2023-12-08T08:21:30.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.435+0000 7f946f9df640 1 -- 172.21.15.88:0/3090191630 wait complete. 2023-12-08T08:21:30.459 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-08T08:21:30.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:30.459 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-08T08:21:30.490 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-12-08T08:21:30.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:30.490 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-08T08:21:30.544 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:21:30.544 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:21:30.595 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354676k,nr_inodes=4088669,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9389 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-08T08:21:30.595 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:21:30.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.727+0000 7f864a9f5640 1 Processor -- start 2023-12-08T08:21:30.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.727+0000 7f864a9f5640 1 -- start start 2023-12-08T08:21:30.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.731+0000 7f864a9f5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f864406bef0 0x7f86440bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:30.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.731+0000 7f864a9f5640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f864406c5b0 0x7f864406ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:30.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.731+0000 7f864a9f5640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8644151690 con 0x7f864414e3f0 2023-12-08T08:21:30.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.731+0000 7f864a9f5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8644151bc0 con 0x7f864406bef0 2023-12-08T08:21:30.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.731+0000 7f864a9f5640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86441518e0 con 0x7f864406c5b0 2023-12-08T08:21:30.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.731+0000 7f86437fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f864406bef0 0x7f86440bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:30.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.731+0000 7f86437fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f864406bef0 0x7f86440bfce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38904/0 (socket says 172.21.15.88:38904) 2023-12-08T08:21:30.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.731+0000 7f86437fe640 1 -- 172.21.15.88:0/3763475421 learned_addr learned my addr 172.21.15.88:0/3763475421 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:30.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.731+0000 7f86437fe640 1 -- 172.21.15.88:0/3763475421 >> v2:172.21.15.148:3300/0 conn(0x7f864406c5b0 msgr2=0x7f864406ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:30.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.731+0000 7f8648f92640 1 --2- 172.21.15.88:0/3763475421 >> v2:172.21.15.148:3300/0 conn(0x7f864406c5b0 0x7f864406ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:30.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.731+0000 7f86437fe640 1 --2- 172.21.15.88:0/3763475421 >> v2:172.21.15.148:3300/0 conn(0x7f864406c5b0 0x7f864406ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:30.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.731+0000 7f86437fe640 1 -- 172.21.15.88:0/3763475421 >> v1:172.21.15.148:6789/0 conn(0x7f864414e3f0 legacy=0x7f86440c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:30.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.731+0000 7f86437fe640 1 -- 172.21.15.88:0/3763475421 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86440c1de0 con 0x7f864406bef0 2023-12-08T08:21:30.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.731+0000 7f8648f92640 1 --2- 172.21.15.88:0/3763475421 >> v2:172.21.15.148:3300/0 conn(0x7f864406c5b0 0x7f864406ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:30.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.735+0000 7f86437fe640 1 --2- 172.21.15.88:0/3763475421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f864406bef0 0x7f86440bfce0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8644070480 tx=0x7f863801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c1041fe2eb6185 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:30.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.735+0000 7f8642ffd640 1 -- 172.21.15.88:0/3763475421 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86380ad640 con 0x7f864406bef0 2023-12-08T08:21:30.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.735+0000 7f8642ffd640 1 -- 172.21.15.88:0/3763475421 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86380ad7a0 con 0x7f864406bef0 2023-12-08T08:21:30.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.735+0000 7f8642ffd640 1 -- 172.21.15.88:0/3763475421 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86380adb30 con 0x7f864406bef0 2023-12-08T08:21:30.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.735+0000 7f864a9f5640 1 -- 172.21.15.88:0/3763475421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f864406bef0 msgr2=0x7f86440bfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:30.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.735+0000 7f864a9f5640 1 --2- 172.21.15.88:0/3763475421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f864406bef0 0x7f86440bfce0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8644070480 tx=0x7f863801c400 comp rx=0 tx=0).stop 2023-12-08T08:21:30.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.735+0000 7f864a9f5640 1 -- 172.21.15.88:0/3763475421 shutdown_connections 2023-12-08T08:21:30.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.735+0000 7f864a9f5640 1 --2- 172.21.15.88:0/3763475421 >> v2:172.21.15.148:3300/0 conn(0x7f864406c5b0 0x7f864406ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:30.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.735+0000 7f864a9f5640 1 --2- 172.21.15.88:0/3763475421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f864406bef0 0x7f86440bfce0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:30.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.735+0000 7f864a9f5640 1 -- 172.21.15.88:0/3763475421 >> 172.21.15.88:0/3763475421 conn(0x7f86440a7810 msgr2=0x7f86440a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:30.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.735+0000 7f864a9f5640 1 -- 172.21.15.88:0/3763475421 shutdown_connections 2023-12-08T08:21:30.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.735+0000 7f864a9f5640 1 -- 172.21.15.88:0/3763475421 wait complete. 2023-12-08T08:21:30.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.735+0000 7f864a9f5640 1 Processor -- start 2023-12-08T08:21:30.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.735+0000 7f864a9f5640 1 -- start start 2023-12-08T08:21:30.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.735+0000 7f864a9f5640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f864406bef0 0x7f86440bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:30.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.735+0000 7f864a9f5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f864406c5b0 0x7f86440bf630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:30.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.735+0000 7f864a9f5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f864414e3f0 0x7f8644071110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:30.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.735+0000 7f864a9f5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86440bfd50 con 0x7f864414e3f0 2023-12-08T08:21:30.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.735+0000 7f864a9f5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86441489c0 con 0x7f864406c5b0 2023-12-08T08:21:30.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.735+0000 7f864a9f5640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86441ed7f0 con 0x7f864406bef0 2023-12-08T08:21:30.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.739+0000 7f8648f92640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f864414e3f0 0x7f8644071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:30.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.739+0000 7f8648f92640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f864414e3f0 0x7f8644071110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38910/0 (socket says 172.21.15.88:38910) 2023-12-08T08:21:30.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.739+0000 7f8648f92640 1 -- 172.21.15.88:0/1554162887 learned_addr learned my addr 172.21.15.88:0/1554162887 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:30.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.739+0000 7f8643fff640 1 --2- 172.21.15.88:0/1554162887 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f864406bef0 0x7f86440bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:30.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.739+0000 7f86437fe640 1 --2- 172.21.15.88:0/1554162887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f864406c5b0 0x7f86440bf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:30.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.739+0000 7f8648f92640 1 -- 172.21.15.88:0/1554162887 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f864406bef0 msgr2=0x7f86440bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:30.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.739+0000 7f8648f92640 1 --2- 172.21.15.88:0/1554162887 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f864406bef0 0x7f86440bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:30.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.739+0000 7f8648f92640 1 -- 172.21.15.88:0/1554162887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f864406c5b0 msgr2=0x7f86440bf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:30.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.739+0000 7f8648f92640 1 --2- 172.21.15.88:0/1554162887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f864406c5b0 0x7f86440bf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:30.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.739+0000 7f8648f92640 1 -- 172.21.15.88:0/1554162887 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86380094d0 con 0x7f864414e3f0 2023-12-08T08:21:30.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.739+0000 7f8648f92640 1 --2- 172.21.15.88:0/1554162887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f864414e3f0 0x7f8644071110 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f863c00ce40 tx=0x7f863c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:30.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.739+0000 7f8640ff9640 1 -- 172.21.15.88:0/1554162887 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c00d840 con 0x7f864414e3f0 2023-12-08T08:21:30.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.739+0000 7f8640ff9640 1 -- 172.21.15.88:0/1554162887 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c00d9a0 con 0x7f864414e3f0 2023-12-08T08:21:30.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.739+0000 7f8640ff9640 1 -- 172.21.15.88:0/1554162887 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c00dd50 con 0x7f864414e3f0 2023-12-08T08:21:30.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.739+0000 7f864a9f5640 1 -- 172.21.15.88:0/1554162887 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86441edad0 con 0x7f864414e3f0 2023-12-08T08:21:30.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.739+0000 7f864a9f5640 1 -- 172.21.15.88:0/1554162887 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86440a6de0 con 0x7f864414e3f0 2023-12-08T08:21:30.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.739+0000 7f864a9f5640 1 -- 172.21.15.88:0/1554162887 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86441edcc0 con 0x7f864414e3f0 2023-12-08T08:21:30.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.739+0000 7f8640ff9640 1 -- 172.21.15.88:0/1554162887 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f863c01e3b0 con 0x7f864414e3f0 2023-12-08T08:21:30.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.743+0000 7f8640ff9640 1 --2- 172.21.15.88:0/1554162887 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8630066470 0x7f8630068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:30.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.743+0000 7f8640ff9640 1 -- 172.21.15.88:0/1554162887 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f863c084b60 con 0x7f864414e3f0 2023-12-08T08:21:30.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.743+0000 7f8643fff640 1 --2- 172.21.15.88:0/1554162887 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8630066470 0x7f8630068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:30.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.743+0000 7f8643fff640 1 --2- 172.21.15.88:0/1554162887 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8630066470 0x7f8630068930 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f86440a8250 tx=0x7f8634009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:30.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.747+0000 7f8640ff9640 1 -- 172.21.15.88:0/1554162887 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f863c051d20 con 0x7f864414e3f0 2023-12-08T08:21:30.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.931+0000 7f864a9f5640 1 -- 172.21.15.88:0/1554162887 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8644067630 con 0x7f864414e3f0 2023-12-08T08:21:30.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.931+0000 7f8640ff9640 1 -- 172.21.15.88:0/1554162887 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+149 (secure 0 0 0) 0x7f863c01a020 con 0x7f864414e3f0 2023-12-08T08:21:30.935 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:21:30.935 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-08T08:21:30.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.931+0000 7f864a9f5640 1 -- 172.21.15.88:0/1554162887 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8630066470 msgr2=0x7f8630068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:30.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.931+0000 7f864a9f5640 1 --2- 172.21.15.88:0/1554162887 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8630066470 0x7f8630068930 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f86440a8250 tx=0x7f8634009060 comp rx=0 tx=0).stop 2023-12-08T08:21:30.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.931+0000 7f864a9f5640 1 -- 172.21.15.88:0/1554162887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f864414e3f0 msgr2=0x7f8644071110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:30.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.931+0000 7f864a9f5640 1 --2- 172.21.15.88:0/1554162887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f864414e3f0 0x7f8644071110 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f863c00ce40 tx=0x7f863c00a710 comp rx=0 tx=0).stop 2023-12-08T08:21:30.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.931+0000 7f864a9f5640 1 -- 172.21.15.88:0/1554162887 shutdown_connections 2023-12-08T08:21:30.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.931+0000 7f864a9f5640 1 --2- 172.21.15.88:0/1554162887 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8630066470 0x7f8630068930 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:30.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.931+0000 7f864a9f5640 1 --2- 172.21.15.88:0/1554162887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f864414e3f0 0x7f8644071110 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:30.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.931+0000 7f864a9f5640 1 --2- 172.21.15.88:0/1554162887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f864406c5b0 0x7f86440bf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:30.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.931+0000 7f864a9f5640 1 --2- 172.21.15.88:0/1554162887 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f864406bef0 0x7f86440bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:30.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.931+0000 7f864a9f5640 1 -- 172.21.15.88:0/1554162887 >> 172.21.15.88:0/1554162887 conn(0x7f86440a7810 msgr2=0x7f864414c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:30.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.931+0000 7f864a9f5640 1 -- 172.21.15.88:0/1554162887 shutdown_connections 2023-12-08T08:21:30.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:30.931+0000 7f864a9f5640 1 -- 172.21.15.88:0/1554162887 wait complete. 2023-12-08T08:21:30.955 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-08T08:21:30.956 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:21:30.956 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-12-08T08:21:30.956 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-08T08:21:30.956 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-08T08:21:30.956 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-08T08:21:30.956 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-08T08:21:30.956 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:21:30.956 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:21:30.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:30.956 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-12-08T08:21:30.967 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:21:30.967 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:21:30.967 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:21:30.967 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:30.967 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-12-08T08:21:30.967 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:30.967 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:21:30.967 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:21:30.967 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-12-08T08:21:30.967 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:21:30.967 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:21:30.967 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-12-08T08:21:30.967 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:21:30.968 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:21:30.968 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:21:30.968 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:21:30.968 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-08T08:21:30.968 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42348sec preferred_lft 42348sec 2023-12-08T08:21:30.968 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-12-08T08:21:30.968 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:30.968 INFO:teuthology.orchestra.run.smithi148.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-08T08:21:30.968 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 02:42:93:b7:1f:fa brd ff:ff:ff:ff:ff:ff 2023-12-08T08:21:30.968 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-08T08:21:30.968 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:30.968 INFO:teuthology.orchestra.run.smithi148.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:21:30.968 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-08T08:21:30.968 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:21:30.969 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:30.969 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-08T08:21:30.969 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:30.969 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:21:30.969 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:21:30.969 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-08T08:21:30.969 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:30.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:30.970 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:21:31.034 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-12-08T08:21:31.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:31.037 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-12-08T08:21:31.094 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-12-08T08:21:31.094 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:21:31.094 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-08T08:21:31.094 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-08T08:21:31.094 INFO:teuthology.orchestra.run.smithi148.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-08T08:21:31.094 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-08T08:21:31.094 INFO:teuthology.orchestra.run.smithi148.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:21:31.094 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:21:31.094 INFO:teuthology.orchestra.run.smithi148.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:21:31.094 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:21:31.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:31.095 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-12-08T08:21:31.095 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-12-08T08:21:31.095 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-08T08:21:31.095 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-08T08:21:31.095 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-08T08:21:31.095 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-12-08T08:21:31.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:31.194 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-12-08T08:21:31.203 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-08T08:21:31.204 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:21:31.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:31.204 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-12-08T08:21:31.271 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:21:31.271 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-08T08:21:31.322 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:21:31.323 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:21:31.323 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:21:31.374 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-12-08T08:21:31.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:31.374 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:21:31.470 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:21:31.470 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:21:31.484 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:21:31.485 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:21:31.485 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-12-08T08:21:31.485 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with new device syntax: 1@681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3.cephfs2=/ 2023-12-08T08:21:31.485 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.88:3300/172.21.15.148:3300/172.21.15.148:3301" will pass to kernel 2023-12-08T08:21:31.489 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T08:21:31.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:31.489 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:21:31.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:31.511 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:21:31.573 INFO:teuthology.orchestra.run.smithi148.stdout:client4979 2023-12-08T08:21:31.574 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:21:31.574 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:21:31.622 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs authorize cephfs client.testuser / rw 2023-12-08T08:21:31.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.763+0000 7f4456ff8640 1 Processor -- start 2023-12-08T08:21:31.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.763+0000 7f4456ff8640 1 -- start start 2023-12-08T08:21:31.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.763+0000 7f4456ff8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44500c5300 0x7f44500a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:31.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.763+0000 7f4456ff8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44500a4e20 con 0x7f445014b1e0 2023-12-08T08:21:31.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.763+0000 7f4456ff8640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44500a50e0 con 0x7f44501548c0 2023-12-08T08:21:31.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.763+0000 7f4456ff8640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44500c0f00 con 0x7f44500c5300 2023-12-08T08:21:31.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.763+0000 7f4454d94640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f445014b1e0 0x7f44500c1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57484/0 (socket says 172.21.15.88:57484) 2023-12-08T08:21:31.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.763+0000 7f4454d94640 1 -- 172.21.15.88:0/2656837595 learned_addr learned my addr 172.21.15.88:0/2656837595 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:31.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.763+0000 7f444ffff640 1 --2- 172.21.15.88:0/2656837595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44500c5300 0x7f44500a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:31.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.763+0000 7f444f7fe640 1 -- 172.21.15.88:0/2656837595 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1547043367 0 0) 0x7f44500a4e20 con 0x7f445014b1e0 2023-12-08T08:21:31.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.763+0000 7f444f7fe640 1 -- 172.21.15.88:0/2656837595 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4440003530 con 0x7f445014b1e0 2023-12-08T08:21:31.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.763+0000 7f444f7fe640 1 -- 172.21.15.88:0/2656837595 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3835531530 0 0) 0x7f44500a50e0 con 0x7f44501548c0 2023-12-08T08:21:31.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.763+0000 7f444f7fe640 1 -- 172.21.15.88:0/2656837595 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44500a4e20 con 0x7f44501548c0 2023-12-08T08:21:31.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.763+0000 7f444ffff640 1 -- 172.21.15.88:0/2656837595 >> v1:172.21.15.148:6789/0 conn(0x7f44501548c0 legacy=0x7f4450154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:31.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.763+0000 7f444ffff640 1 -- 172.21.15.88:0/2656837595 >> v1:172.21.15.88:6789/0 conn(0x7f445014b1e0 legacy=0x7f44500c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:31.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.763+0000 7f444ffff640 1 -- 172.21.15.88:0/2656837595 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44500c11e0 con 0x7f44500c5300 2023-12-08T08:21:31.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.767+0000 7f444ffff640 1 --2- 172.21.15.88:0/2656837595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44500c5300 0x7f44500a9c30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f443c0097f0 tx=0x7f443c01c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2097b19d0bbd531d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:31.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.767+0000 7f444f7fe640 1 -- 172.21.15.88:0/2656837595 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c0ab600 con 0x7f44500c5300 2023-12-08T08:21:31.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.767+0000 7f444f7fe640 1 -- 172.21.15.88:0/2656837595 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443c0a7050 con 0x7f44500c5300 2023-12-08T08:21:31.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.767+0000 7f444f7fe640 1 -- 172.21.15.88:0/2656837595 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c0ab980 con 0x7f44500c5300 2023-12-08T08:21:31.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.767+0000 7f4456ff8640 1 -- 172.21.15.88:0/2656837595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44500c5300 msgr2=0x7f44500a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:31.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.767+0000 7f4456ff8640 1 --2- 172.21.15.88:0/2656837595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44500c5300 0x7f44500a9c30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f443c0097f0 tx=0x7f443c01c4c0 comp rx=0 tx=0).stop 2023-12-08T08:21:31.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.767+0000 7f4456ff8640 1 -- 172.21.15.88:0/2656837595 shutdown_connections 2023-12-08T08:21:31.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.767+0000 7f4456ff8640 1 --2- 172.21.15.88:0/2656837595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44500c5300 0x7f44500a9c30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:31.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.767+0000 7f4456ff8640 1 -- 172.21.15.88:0/2656837595 >> 172.21.15.88:0/2656837595 conn(0x7f44500c59f0 msgr2=0x7f44500c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:31.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.767+0000 7f4456ff8640 1 -- 172.21.15.88:0/2656837595 shutdown_connections 2023-12-08T08:21:31.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.767+0000 7f4456ff8640 1 -- 172.21.15.88:0/2656837595 wait complete. 2023-12-08T08:21:31.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.771+0000 7f4456ff8640 1 Processor -- start 2023-12-08T08:21:31.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.771+0000 7f4456ff8640 1 -- start start 2023-12-08T08:21:31.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.771+0000 7f4456ff8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44500c5300 0x7f445014e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:31.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.771+0000 7f4456ff8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f445014b1e0 0x7f44500a65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:31.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.771+0000 7f4456ff8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44501548c0 0x7f44501ecee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:31.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.771+0000 7f4456ff8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445014de20 con 0x7f44500c5300 2023-12-08T08:21:31.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.771+0000 7f4456ff8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445014daf0 con 0x7f445014b1e0 2023-12-08T08:21:31.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.771+0000 7f4456ff8640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4450148320 con 0x7f44501548c0 2023-12-08T08:21:31.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.771+0000 7f4454d94640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44500c5300 0x7f445014e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:31.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.771+0000 7f4454d94640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44500c5300 0x7f445014e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38924/0 (socket says 172.21.15.88:38924) 2023-12-08T08:21:31.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.771+0000 7f4454d94640 1 -- 172.21.15.88:0/3127209217 learned_addr learned my addr 172.21.15.88:0/3127209217 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:31.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.771+0000 7f444ffff640 1 --2- 172.21.15.88:0/3127209217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f445014b1e0 0x7f44500a65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:31.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.771+0000 7f4455595640 1 --2- 172.21.15.88:0/3127209217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44501548c0 0x7f44501ecee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:31.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.771+0000 7f4454d94640 1 -- 172.21.15.88:0/3127209217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44501548c0 msgr2=0x7f44501ecee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:31.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.771+0000 7f4454d94640 1 --2- 172.21.15.88:0/3127209217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44501548c0 0x7f44501ecee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:31.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.771+0000 7f4454d94640 1 -- 172.21.15.88:0/3127209217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f445014b1e0 msgr2=0x7f44500a65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:31.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.771+0000 7f4454d94640 1 --2- 172.21.15.88:0/3127209217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f445014b1e0 0x7f44500a65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:31.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.771+0000 7f4454d94640 1 -- 172.21.15.88:0/3127209217 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c009420 con 0x7f44500c5300 2023-12-08T08:21:31.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.771+0000 7f4455595640 1 --2- 172.21.15.88:0/3127209217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44501548c0 0x7f44501ecee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:31.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.771+0000 7f4454d94640 1 --2- 172.21.15.88:0/3127209217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44500c5300 0x7f445014e2b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f444400c500 tx=0x7f444400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:31.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.771+0000 7f444d7fa640 1 -- 172.21.15.88:0/3127209217 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4444005cf0 con 0x7f44500c5300 2023-12-08T08:21:31.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.771+0000 7f444d7fa640 1 -- 172.21.15.88:0/3127209217 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4444005e50 con 0x7f44500c5300 2023-12-08T08:21:31.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.771+0000 7f444d7fa640 1 -- 172.21.15.88:0/3127209217 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4444007310 con 0x7f44500c5300 2023-12-08T08:21:31.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.771+0000 7f4456ff8640 1 -- 172.21.15.88:0/3127209217 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f445014ba80 con 0x7f44500c5300 2023-12-08T08:21:31.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.771+0000 7f4456ff8640 1 -- 172.21.15.88:0/3127209217 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44500a6b10 con 0x7f44500c5300 2023-12-08T08:21:31.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.775+0000 7f4456ff8640 1 -- 172.21.15.88:0/3127209217 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4450067630 con 0x7f44500c5300 2023-12-08T08:21:31.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.775+0000 7f444d7fa640 1 -- 172.21.15.88:0/3127209217 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4444007470 con 0x7f44500c5300 2023-12-08T08:21:31.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.775+0000 7f444d7fa640 1 --2- 172.21.15.88:0/3127209217 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4434066470 0x7f4434068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:31.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.775+0000 7f444d7fa640 1 -- 172.21.15.88:0/3127209217 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f44440837c0 con 0x7f44500c5300 2023-12-08T08:21:31.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.775+0000 7f444ffff640 1 --2- 172.21.15.88:0/3127209217 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4434066470 0x7f4434068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:31.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.775+0000 7f444ffff640 1 --2- 172.21.15.88:0/3127209217 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4434066470 0x7f4434068930 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f443c0ad000 tx=0x7f443c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:31.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.779+0000 7f444d7fa640 1 -- 172.21.15.88:0/3127209217 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4444050980 con 0x7f44500c5300 2023-12-08T08:21:31.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.959+0000 7f4456ff8640 1 -- 172.21.15.88:0/3127209217 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]} v 0) v1 -- 0x7f44500c0500 con 0x7f44500c5300 2023-12-08T08:21:31.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.963+0000 7f444d7fa640 1 -- 172.21.15.88:0/3127209217 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]}]=0 v13) v1 ==== 134+0+185 (secure 0 0 0) 0x7f44440170d0 con 0x7f44500c5300 2023-12-08T08:21:31.968 INFO:teuthology.orchestra.run.smithi088.stdout:[client.testuser] 2023-12-08T08:21:31.968 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQAL0nJlCYBrORAAC4ib+QAXhveVa/QJJs6Srw== 2023-12-08T08:21:31.968 INFO:teuthology.orchestra.run.smithi088.stdout: caps mds = "allow rw fsname=cephfs" 2023-12-08T08:21:31.968 INFO:teuthology.orchestra.run.smithi088.stdout: caps mon = "allow r fsname=cephfs" 2023-12-08T08:21:31.969 INFO:teuthology.orchestra.run.smithi088.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-08T08:21:31.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.967+0000 7f4456ff8640 1 -- 172.21.15.88:0/3127209217 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4434066470 msgr2=0x7f4434068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:31.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.967+0000 7f4456ff8640 1 --2- 172.21.15.88:0/3127209217 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4434066470 0x7f4434068930 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f443c0ad000 tx=0x7f443c008040 comp rx=0 tx=0).stop 2023-12-08T08:21:31.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.967+0000 7f4456ff8640 1 -- 172.21.15.88:0/3127209217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44500c5300 msgr2=0x7f445014e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:31.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.967+0000 7f4456ff8640 1 --2- 172.21.15.88:0/3127209217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44500c5300 0x7f445014e2b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f444400c500 tx=0x7f444400c9c0 comp rx=0 tx=0).stop 2023-12-08T08:21:31.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.967+0000 7f4456ff8640 1 -- 172.21.15.88:0/3127209217 shutdown_connections 2023-12-08T08:21:31.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.967+0000 7f4456ff8640 1 --2- 172.21.15.88:0/3127209217 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4434066470 0x7f4434068930 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:31.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.967+0000 7f4456ff8640 1 --2- 172.21.15.88:0/3127209217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44501548c0 0x7f44501ecee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:31.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.967+0000 7f4456ff8640 1 --2- 172.21.15.88:0/3127209217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f445014b1e0 0x7f44500a65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:31.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.967+0000 7f4456ff8640 1 --2- 172.21.15.88:0/3127209217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44500c5300 0x7f445014e2b0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:31.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.967+0000 7f4456ff8640 1 -- 172.21.15.88:0/3127209217 >> 172.21.15.88:0/3127209217 conn(0x7f44500c59f0 msgr2=0x7f44500c36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:31.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.967+0000 7f4456ff8640 1 -- 172.21.15.88:0/3127209217 shutdown_connections 2023-12-08T08:21:31.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:31.967+0000 7f4456ff8640 1 -- 172.21.15.88:0/3127209217 wait complete. 2023-12-08T08:21:31.989 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2023-12-08T08:21:31.998 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.n6LyuSOFeg 2023-12-08T08:21:31.998 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:21:31.999 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/tmp/tmp.n6LyuSOFeg 2023-12-08T08:21:32.053 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:21:32.053 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:21:32.105 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:21:32.106 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:21:32.158 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:21:32.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.335+0000 7f03e131e640 1 Processor -- start 2023-12-08T08:21:32.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.335+0000 7f03e131e640 1 -- start start 2023-12-08T08:21:32.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.335+0000 7f03e131e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f03dc0c65f0 0x7f03dc0c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:32.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.335+0000 7f03e131e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03dc0c8200 0x7f03dc0c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:32.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.335+0000 7f03e131e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03dc151f20 con 0x7f03dc0c9040 2023-12-08T08:21:32.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.335+0000 7f03e131e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03dc154450 con 0x7f03dc0c65f0 2023-12-08T08:21:32.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.335+0000 7f03e131e640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc154710 con 0x7f03dc0c8200 2023-12-08T08:21:32.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.335+0000 7f03e0b1d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f03dc0c9040 0x7f03dc1579c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57498/0 (socket says 172.21.15.88:57498) 2023-12-08T08:21:32.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.335+0000 7f03e0b1d640 1 -- 172.21.15.88:0/688997035 learned_addr learned my addr 172.21.15.88:0/688997035 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:32.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.335+0000 7f03dbfff640 1 --2- 172.21.15.88:0/688997035 >> v2:172.21.15.88:3300/0 conn(0x7f03dc0c65f0 0x7f03dc0c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:32.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.335+0000 7f03db7fe640 1 --2- 172.21.15.88:0/688997035 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03dc0c8200 0x7f03dc0c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:32.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.335+0000 7f03daffd640 1 -- 172.21.15.88:0/688997035 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066832063 0 0) 0x7f03dc151f20 con 0x7f03dc0c9040 2023-12-08T08:21:32.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.335+0000 7f03daffd640 1 -- 172.21.15.88:0/688997035 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03c4003530 con 0x7f03dc0c9040 2023-12-08T08:21:32.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.335+0000 7f03dbfff640 1 -- 172.21.15.88:0/688997035 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03dc0c8200 msgr2=0x7f03dc0c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:32.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.335+0000 7f03dbfff640 1 --2- 172.21.15.88:0/688997035 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03dc0c8200 0x7f03dc0c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:32.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.335+0000 7f03daffd640 1 -- 172.21.15.88:0/688997035 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 699549057 0 0) 0x7f03c4003530 con 0x7f03dc0c9040 2023-12-08T08:21:32.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.335+0000 7f03dbfff640 1 -- 172.21.15.88:0/688997035 >> v1:172.21.15.88:6789/0 conn(0x7f03dc0c9040 legacy=0x7f03dc1579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:32.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.335+0000 7f03dbfff640 1 -- 172.21.15.88:0/688997035 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc1549f0 con 0x7f03dc0c65f0 2023-12-08T08:21:32.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.339+0000 7f03dbfff640 1 --2- 172.21.15.88:0/688997035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03dc0c65f0 0x7f03dc0c69d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f03cc0097c0 tx=0x7f03cc01c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8133c51ed6d7e663 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:32.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.339+0000 7f03daffd640 1 -- 172.21.15.88:0/688997035 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d4001a00 con 0x7f03dc0c65f0 2023-12-08T08:21:32.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.339+0000 7f03daffd640 1 -- 172.21.15.88:0/688997035 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03cc0a7050 con 0x7f03dc0c65f0 2023-12-08T08:21:32.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.339+0000 7f03daffd640 1 -- 172.21.15.88:0/688997035 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc0ab600 con 0x7f03dc0c65f0 2023-12-08T08:21:32.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.339+0000 7f03e131e640 1 -- 172.21.15.88:0/688997035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03dc0c65f0 msgr2=0x7f03dc0c69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:32.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.339+0000 7f03e131e640 1 --2- 172.21.15.88:0/688997035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03dc0c65f0 0x7f03dc0c69d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f03cc0097c0 tx=0x7f03cc01c2e0 comp rx=0 tx=0).stop 2023-12-08T08:21:32.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.339+0000 7f03e131e640 1 -- 172.21.15.88:0/688997035 shutdown_connections 2023-12-08T08:21:32.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.339+0000 7f03e131e640 1 --2- 172.21.15.88:0/688997035 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03dc0c8200 0x7f03dc0c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:32.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.339+0000 7f03e131e640 1 --2- 172.21.15.88:0/688997035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03dc0c65f0 0x7f03dc0c69d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:32.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.339+0000 7f03e131e640 1 -- 172.21.15.88:0/688997035 >> 172.21.15.88:0/688997035 conn(0x7f03dc0ab730 msgr2=0x7f03dc0abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:32.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.339+0000 7f03e131e640 1 -- 172.21.15.88:0/688997035 shutdown_connections 2023-12-08T08:21:32.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.339+0000 7f03e131e640 1 -- 172.21.15.88:0/688997035 wait complete. 2023-12-08T08:21:32.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.343+0000 7f03e131e640 1 Processor -- start 2023-12-08T08:21:32.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.343+0000 7f03e131e640 1 -- start start 2023-12-08T08:21:32.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.343+0000 7f03e131e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03dc0c65f0 0x7f03dc15f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:32.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.343+0000 7f03e131e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03dc0c8200 0x7f03dc151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:32.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.343+0000 7f03e131e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03dc0c9040 0x7f03dc0ac7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:32.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.343+0000 7f03e131e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc14f2c0 con 0x7f03dc0c9040 2023-12-08T08:21:32.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.343+0000 7f03e131e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc1ed930 con 0x7f03dc0c65f0 2023-12-08T08:21:32.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.343+0000 7f03e131e640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc1ecd20 con 0x7f03dc0c8200 2023-12-08T08:21:32.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.343+0000 7f03e0b1d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03dc0c9040 0x7f03dc0ac7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:32.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.343+0000 7f03e0b1d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03dc0c9040 0x7f03dc0ac7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38932/0 (socket says 172.21.15.88:38932) 2023-12-08T08:21:32.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.343+0000 7f03e0b1d640 1 -- 172.21.15.88:0/413938229 learned_addr learned my addr 172.21.15.88:0/413938229 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:32.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.343+0000 7f03dbfff640 1 --2- 172.21.15.88:0/413938229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03dc0c65f0 0x7f03dc15f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:32.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.343+0000 7f03db7fe640 1 --2- 172.21.15.88:0/413938229 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03dc0c8200 0x7f03dc151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:32.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.343+0000 7f03e0b1d640 1 -- 172.21.15.88:0/413938229 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03dc0c8200 msgr2=0x7f03dc151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:32.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.343+0000 7f03e0b1d640 1 --2- 172.21.15.88:0/413938229 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03dc0c8200 0x7f03dc151130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:32.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.343+0000 7f03e0b1d640 1 -- 172.21.15.88:0/413938229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03dc0c65f0 msgr2=0x7f03dc15f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:32.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.343+0000 7f03e0b1d640 1 --2- 172.21.15.88:0/413938229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03dc0c65f0 0x7f03dc15f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:32.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.343+0000 7f03e0b1d640 1 -- 172.21.15.88:0/413938229 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03cc009420 con 0x7f03dc0c9040 2023-12-08T08:21:32.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.343+0000 7f03db7fe640 1 --2- 172.21.15.88:0/413938229 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03dc0c8200 0x7f03dc151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:32.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.343+0000 7f03e0b1d640 1 --2- 172.21.15.88:0/413938229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03dc0c9040 0x7f03dc0ac7f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f03d400cc00 tx=0x7f03d400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:32.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.343+0000 7f03d8ff9640 1 -- 172.21.15.88:0/413938229 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d400ce10 con 0x7f03dc0c9040 2023-12-08T08:21:32.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.343+0000 7f03d8ff9640 1 -- 172.21.15.88:0/413938229 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d4012400 con 0x7f03dc0c9040 2023-12-08T08:21:32.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.343+0000 7f03e131e640 1 -- 172.21.15.88:0/413938229 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03dc1ed000 con 0x7f03dc0c9040 2023-12-08T08:21:32.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.343+0000 7f03d8ff9640 1 -- 172.21.15.88:0/413938229 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d40127b0 con 0x7f03dc0c9040 2023-12-08T08:21:32.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.343+0000 7f03e131e640 1 -- 172.21.15.88:0/413938229 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03dc1ed5c0 con 0x7f03dc0c9040 2023-12-08T08:21:32.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.343+0000 7f03e131e640 1 -- 172.21.15.88:0/413938229 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03dc0ac5c0 con 0x7f03dc0c9040 2023-12-08T08:21:32.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.347+0000 7f03d8ff9640 1 -- 172.21.15.88:0/413938229 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f03d4012910 con 0x7f03dc0c9040 2023-12-08T08:21:32.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.347+0000 7f03d8ff9640 1 --2- 172.21.15.88:0/413938229 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f03c8066470 0x7f03c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:32.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.347+0000 7f03d8ff9640 1 -- 172.21.15.88:0/413938229 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f03d4084830 con 0x7f03dc0c9040 2023-12-08T08:21:32.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.347+0000 7f03dbfff640 1 --2- 172.21.15.88:0/413938229 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f03c8066470 0x7f03c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:32.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.347+0000 7f03dbfff640 1 --2- 172.21.15.88:0/413938229 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f03c8066470 0x7f03c8068930 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f03cc0ad000 tx=0x7f03cc0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:32.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.351+0000 7f03d8ff9640 1 -- 172.21.15.88:0/413938229 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f03dc0ac5c0 con 0x7f03dc0c9040 2023-12-08T08:21:32.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.499+0000 7f03e131e640 1 -- 172.21.15.88:0/413938229 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03dc0ac5c0 con 0x7f03dc0c9040 2023-12-08T08:21:32.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.503+0000 7f03d8ff9640 1 -- 172.21.15.88:0/413938229 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20205 (secure 0 0 0) 0x7f03dc0ac5c0 con 0x7f03dc0c9040 2023-12-08T08:21:32.506 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:32.506 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":35,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:21:19.666744+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:21:03.690721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-08T08:21:04.127786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:21:16.039054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:21:17.029894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:21:32.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.503+0000 7f03e131e640 1 -- 172.21.15.88:0/413938229 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f03c8066470 msgr2=0x7f03c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:32.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.503+0000 7f03e131e640 1 --2- 172.21.15.88:0/413938229 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f03c8066470 0x7f03c8068930 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f03cc0ad000 tx=0x7f03cc0a6000 comp rx=0 tx=0).stop 2023-12-08T08:21:32.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.503+0000 7f03e131e640 1 -- 172.21.15.88:0/413938229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03dc0c9040 msgr2=0x7f03dc0ac7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:32.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.503+0000 7f03e131e640 1 --2- 172.21.15.88:0/413938229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03dc0c9040 0x7f03dc0ac7f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f03d400cc00 tx=0x7f03d400a430 comp rx=0 tx=0).stop 2023-12-08T08:21:32.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.503+0000 7f03e131e640 1 -- 172.21.15.88:0/413938229 shutdown_connections 2023-12-08T08:21:32.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.503+0000 7f03e131e640 1 --2- 172.21.15.88:0/413938229 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f03c8066470 0x7f03c8068930 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:32.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.503+0000 7f03e131e640 1 --2- 172.21.15.88:0/413938229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03dc0c9040 0x7f03dc0ac7f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:32.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.503+0000 7f03e131e640 1 --2- 172.21.15.88:0/413938229 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f03dc0c8200 0x7f03dc151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:32.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.503+0000 7f03e131e640 1 --2- 172.21.15.88:0/413938229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03dc0c65f0 0x7f03dc15f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:32.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.503+0000 7f03e131e640 1 -- 172.21.15.88:0/413938229 >> 172.21.15.88:0/413938229 conn(0x7f03dc0ab730 msgr2=0x7f03dc0aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:32.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.503+0000 7f03e131e640 1 -- 172.21.15.88:0/413938229 shutdown_connections 2023-12-08T08:21:32.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.503+0000 7f03e131e640 1 -- 172.21.15.88:0/413938229 wait complete. 2023-12-08T08:21:32.527 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:21:03.690721+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:21:04.127786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:21:16.039054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:21:17.029894+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:21:32.528 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:21:32.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.663+0000 7fc889557640 1 Processor -- start 2023-12-08T08:21:32.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.663+0000 7fc889557640 1 -- start start 2023-12-08T08:21:32.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.663+0000 7fc889557640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc8840c5300 0x7fc8840a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:32.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.663+0000 7fc889557640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8841548c0 0x7fc884154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc889557640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8840a4e20 con 0x7fc88414b1e0 2023-12-08T08:21:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc889557640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8840a50e0 con 0x7fc8840c5300 2023-12-08T08:21:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc889557640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8840c0f00 con 0x7fc8841548c0 2023-12-08T08:21:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc882ffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc88414b1e0 0x7fc8840c1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57510/0 (socket says 172.21.15.88:57510) 2023-12-08T08:21:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc882ffd640 1 -- 172.21.15.88:0/2158960907 learned_addr learned my addr 172.21.15.88:0/2158960907 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:32.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc8837fe640 1 --2- 172.21.15.88:0/2158960907 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8841548c0 0x7fc884154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:32.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc8827fc640 1 --2- 172.21.15.88:0/2158960907 >> v2:172.21.15.148:3300/0 conn(0x7fc8840c5300 0x7fc8840a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:32.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc881ffb640 1 -- 172.21.15.88:0/2158960907 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2572164372 0 0) 0x7fc8840a4e20 con 0x7fc88414b1e0 2023-12-08T08:21:32.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc881ffb640 1 -- 172.21.15.88:0/2158960907 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc86c003530 con 0x7fc88414b1e0 2023-12-08T08:21:32.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc881ffb640 1 -- 172.21.15.88:0/2158960907 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3068974550 0 0) 0x7fc86c003530 con 0x7fc88414b1e0 2023-12-08T08:21:32.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc881ffb640 1 -- 172.21.15.88:0/2158960907 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8841548c0 msgr2=0x7fc884154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:32.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc881ffb640 1 --2- 172.21.15.88:0/2158960907 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8841548c0 0x7fc884154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:32.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc881ffb640 1 -- 172.21.15.88:0/2158960907 >> v2:172.21.15.148:3300/0 conn(0x7fc8840c5300 msgr2=0x7fc8840a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:32.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc881ffb640 1 --2- 172.21.15.88:0/2158960907 >> v2:172.21.15.148:3300/0 conn(0x7fc8840c5300 0x7fc8840a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:32.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc881ffb640 1 -- 172.21.15.88:0/2158960907 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8840c11e0 con 0x7fc88414b1e0 2023-12-08T08:21:32.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc881ffb640 1 -- 172.21.15.88:0/2158960907 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7fc8740016a0 con 0x7fc88414b1e0 2023-12-08T08:21:32.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc881ffb640 1 -- 172.21.15.88:0/2158960907 >> v1:172.21.15.88:6789/0 conn(0x7fc88414b1e0 legacy=0x7fc8840c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:32.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc881ffb640 1 --2- 172.21.15.88:0/2158960907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc86c003980 0x7fc86c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:32.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc881ffb640 1 --2- 172.21.15.88:0/2158960907 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8841548c0 0x7fc86c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:32.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc881ffb640 1 --2- 172.21.15.88:0/2158960907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc86c004d10 0x7fc86c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:32.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc881ffb640 1 -- 172.21.15.88:0/2158960907 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8840a50e0 con 0x7fc86c003980 2023-12-08T08:21:32.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc881ffb640 1 -- 172.21.15.88:0/2158960907 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8840c0f00 con 0x7fc86c004d10 2023-12-08T08:21:32.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc881ffb640 1 -- 172.21.15.88:0/2158960907 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c00b990 con 0x7fc8841548c0 2023-12-08T08:21:32.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc882ffd640 1 --2- 172.21.15.88:0/2158960907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc86c003980 0x7fc86c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:32.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc8837fe640 1 --2- 172.21.15.88:0/2158960907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc86c004d10 0x7fc86c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:32.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc8827fc640 1 --2- 172.21.15.88:0/2158960907 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8841548c0 0x7fc86c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:32.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc882ffd640 1 -- 172.21.15.88:0/2158960907 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8841548c0 msgr2=0x7fc86c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:32.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc882ffd640 1 --2- 172.21.15.88:0/2158960907 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8841548c0 0x7fc86c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:32.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc882ffd640 1 -- 172.21.15.88:0/2158960907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc86c004d10 msgr2=0x7fc86c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:32.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc882ffd640 1 --2- 172.21.15.88:0/2158960907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc86c004d10 0x7fc86c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:32.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc882ffd640 1 -- 172.21.15.88:0/2158960907 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86c003530 con 0x7fc86c003980 2023-12-08T08:21:32.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.667+0000 7fc8827fc640 1 --2- 172.21.15.88:0/2158960907 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8841548c0 0x7fc86c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:32.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.671+0000 7fc882ffd640 1 --2- 172.21.15.88:0/2158960907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc86c003980 0x7fc86c003da0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc87400c190 tx=0x7fc87401cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6c5f61e225234c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:32.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.671+0000 7fc881ffb640 1 -- 172.21.15.88:0/2158960907 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8740058e0 con 0x7fc86c003980 2023-12-08T08:21:32.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.671+0000 7fc881ffb640 1 -- 172.21.15.88:0/2158960907 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc874005a40 con 0x7fc86c003980 2023-12-08T08:21:32.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.671+0000 7fc881ffb640 1 -- 172.21.15.88:0/2158960907 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc874005df0 con 0x7fc86c003980 2023-12-08T08:21:32.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.671+0000 7fc889557640 1 -- 172.21.15.88:0/2158960907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc86c003980 msgr2=0x7fc86c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:32.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.671+0000 7fc889557640 1 --2- 172.21.15.88:0/2158960907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc86c003980 0x7fc86c003da0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc87400c190 tx=0x7fc87401cb60 comp rx=0 tx=0).stop 2023-12-08T08:21:32.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.671+0000 7fc8837fe640 1 -- 172.21.15.88:0/2158960907 reap_dead start 2023-12-08T08:21:32.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.671+0000 7fc889557640 1 -- 172.21.15.88:0/2158960907 shutdown_connections 2023-12-08T08:21:32.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.671+0000 7fc889557640 1 -- 172.21.15.88:0/2158960907 >> 172.21.15.88:0/2158960907 conn(0x7fc8840c59f0 msgr2=0x7fc8840c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:32.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.671+0000 7fc889557640 1 -- 172.21.15.88:0/2158960907 shutdown_connections 2023-12-08T08:21:32.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.671+0000 7fc889557640 1 -- 172.21.15.88:0/2158960907 wait complete. 2023-12-08T08:21:32.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.671+0000 7fc889557640 1 Processor -- start 2023-12-08T08:21:32.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.671+0000 7fc889557640 1 -- start start 2023-12-08T08:21:32.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.675+0000 7fc889557640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc86c003980 0x7fc88406fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:32.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.675+0000 7fc889557640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc884150840 0x7fc8841ea8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:32.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.675+0000 7fc889557640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc884150de0 0x7fc8841eae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:32.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.675+0000 7fc889557640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8841ea430 con 0x7fc884150840 2023-12-08T08:21:32.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.675+0000 7fc889557640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8841eb370 con 0x7fc884150de0 2023-12-08T08:21:32.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.675+0000 7fc889557640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc884151510 con 0x7fc86c003980 2023-12-08T08:21:32.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.675+0000 7fc8827fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc884150840 0x7fc8841ea8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:32.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.675+0000 7fc8827fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc884150840 0x7fc8841ea8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38942/0 (socket says 172.21.15.88:38942) 2023-12-08T08:21:32.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.675+0000 7fc8827fc640 1 -- 172.21.15.88:0/3164102851 learned_addr learned my addr 172.21.15.88:0/3164102851 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:32.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.675+0000 7fc882ffd640 1 --2- 172.21.15.88:0/3164102851 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc86c003980 0x7fc88406fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:32.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.675+0000 7fc8837fe640 1 --2- 172.21.15.88:0/3164102851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc884150de0 0x7fc8841eae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:32.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.675+0000 7fc8827fc640 1 -- 172.21.15.88:0/3164102851 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc86c003980 msgr2=0x7fc88406fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:32.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.675+0000 7fc8827fc640 1 --2- 172.21.15.88:0/3164102851 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc86c003980 0x7fc88406fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:32.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.675+0000 7fc8827fc640 1 -- 172.21.15.88:0/3164102851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc884150de0 msgr2=0x7fc8841eae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:32.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.675+0000 7fc8827fc640 1 --2- 172.21.15.88:0/3164102851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc884150de0 0x7fc8841eae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:32.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.675+0000 7fc8827fc640 1 -- 172.21.15.88:0/3164102851 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8841517f0 con 0x7fc884150840 2023-12-08T08:21:32.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.675+0000 7fc8827fc640 1 --2- 172.21.15.88:0/3164102851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc884150840 0x7fc8841ea8f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc8780115d0 tx=0x7fc878011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:32.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.675+0000 7fc86b7fe640 1 -- 172.21.15.88:0/3164102851 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc878004220 con 0x7fc884150840 2023-12-08T08:21:32.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.675+0000 7fc86b7fe640 1 -- 172.21.15.88:0/3164102851 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc878004380 con 0x7fc884150840 2023-12-08T08:21:32.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.675+0000 7fc86b7fe640 1 -- 172.21.15.88:0/3164102851 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87800f8f0 con 0x7fc884150840 2023-12-08T08:21:32.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.675+0000 7fc889557640 1 -- 172.21.15.88:0/3164102851 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc884151dd0 con 0x7fc884150840 2023-12-08T08:21:32.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.675+0000 7fc889557640 1 -- 172.21.15.88:0/3164102851 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc884070260 con 0x7fc884150840 2023-12-08T08:21:32.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.675+0000 7fc889557640 1 -- 172.21.15.88:0/3164102851 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc884067630 con 0x7fc884150840 2023-12-08T08:21:32.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.675+0000 7fc86b7fe640 1 -- 172.21.15.88:0/3164102851 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc87800fa50 con 0x7fc884150840 2023-12-08T08:21:32.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.679+0000 7fc86b7fe640 1 --2- 172.21.15.88:0/3164102851 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc870066470 0x7fc870068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:32.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.679+0000 7fc86b7fe640 1 -- 172.21.15.88:0/3164102851 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc8780845b0 con 0x7fc884150840 2023-12-08T08:21:32.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.679+0000 7fc882ffd640 1 --2- 172.21.15.88:0/3164102851 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc870066470 0x7fc870068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:32.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.679+0000 7fc882ffd640 1 --2- 172.21.15.88:0/3164102851 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc870066470 0x7fc870068930 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc8740aa000 tx=0x7fc8740019d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:32.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.683+0000 7fc86b7fe640 1 -- 172.21.15.88:0/3164102851 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc878051770 con 0x7fc884150840 2023-12-08T08:21:32.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.835+0000 7fc889557640 1 -- 172.21.15.88:0/3164102851 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc884073fd0 con 0x7fc884150840 2023-12-08T08:21:32.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.835+0000 7fc86b7fe640 1 -- 172.21.15.88:0/3164102851 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc878022020 con 0x7fc884150840 2023-12-08T08:21:32.839 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:21:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.835+0000 7fc889557640 1 -- 172.21.15.88:0/3164102851 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc870066470 msgr2=0x7fc870068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.835+0000 7fc889557640 1 --2- 172.21.15.88:0/3164102851 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc870066470 0x7fc870068930 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc8740aa000 tx=0x7fc8740019d0 comp rx=0 tx=0).stop 2023-12-08T08:21:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.835+0000 7fc889557640 1 -- 172.21.15.88:0/3164102851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc884150840 msgr2=0x7fc8841ea8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.835+0000 7fc889557640 1 --2- 172.21.15.88:0/3164102851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc884150840 0x7fc8841ea8f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc8780115d0 tx=0x7fc878011a90 comp rx=0 tx=0).stop 2023-12-08T08:21:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.835+0000 7fc889557640 1 -- 172.21.15.88:0/3164102851 shutdown_connections 2023-12-08T08:21:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.835+0000 7fc889557640 1 --2- 172.21.15.88:0/3164102851 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc870066470 0x7fc870068930 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.835+0000 7fc889557640 1 --2- 172.21.15.88:0/3164102851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc884150de0 0x7fc8841eae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.835+0000 7fc889557640 1 --2- 172.21.15.88:0/3164102851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc884150840 0x7fc8841ea8f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.835+0000 7fc889557640 1 --2- 172.21.15.88:0/3164102851 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc86c003980 0x7fc88406fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.835+0000 7fc889557640 1 -- 172.21.15.88:0/3164102851 >> 172.21.15.88:0/3164102851 conn(0x7fc8840c59f0 msgr2=0x7fc8840c4180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.835+0000 7fc889557640 1 -- 172.21.15.88:0/3164102851 shutdown_connections 2023-12-08T08:21:32.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.839+0000 7fc889557640 1 -- 172.21.15.88:0/3164102851 wait complete. 2023-12-08T08:21:32.860 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:21:33.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.995+0000 7f21a56bb640 1 Processor -- start 2023-12-08T08:21:33.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.995+0000 7f21a56bb640 1 -- start start 2023-12-08T08:21:33.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.999+0000 7f21a56bb640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f21a00bf2d0 0x7f21a0151970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:33.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.999+0000 7f21a56bb640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21a00c98f0 0x7f21a0151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:33.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.999+0000 7f21a56bb640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a0158780 con 0x7f21a00c6030 2023-12-08T08:21:33.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.999+0000 7f21a56bb640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a00c0300 con 0x7f21a00bf2d0 2023-12-08T08:21:33.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.999+0000 7f21a56bb640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a0157b70 con 0x7f21a00c98f0 2023-12-08T08:21:33.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.999+0000 7f21967fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f21a00c6030 0x7f21a00c7cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57516/0 (socket says 172.21.15.88:57516) 2023-12-08T08:21:33.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.999+0000 7f21967fc640 1 -- 172.21.15.88:0/332092456 learned_addr learned my addr 172.21.15.88:0/332092456 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:33.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.999+0000 7f219effd640 1 --2- 172.21.15.88:0/332092456 >> v2:172.21.15.88:3300/0 conn(0x7f21a00bf2d0 0x7f21a0151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:33.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.999+0000 7f219f7fe640 1 --2- 172.21.15.88:0/332092456 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21a00c98f0 0x7f21a0151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:33.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.999+0000 7f219effd640 1 -- 172.21.15.88:0/332092456 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21a00c98f0 msgr2=0x7f21a0151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:33.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.999+0000 7f219effd640 1 --2- 172.21.15.88:0/332092456 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21a00c98f0 0x7f21a0151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.999+0000 7f219effd640 1 -- 172.21.15.88:0/332092456 >> v1:172.21.15.88:6789/0 conn(0x7f21a00c6030 legacy=0x7f21a00c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:33.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.999+0000 7f219effd640 1 -- 172.21.15.88:0/332092456 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a0157e50 con 0x7f21a00bf2d0 2023-12-08T08:21:33.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.999+0000 7f219e7fc640 1 -- 172.21.15.88:0/332092456 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4235568204 0 0) 0x7f21a0158780 con 0x7f21a00c6030 2023-12-08T08:21:33.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.999+0000 7f219effd640 1 --2- 172.21.15.88:0/332092456 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21a00bf2d0 0x7f21a0151970 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2190009d90 tx=0x7f219001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1cd1cbd3b02bf62 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:33.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:32.999+0000 7f219e7fc640 1 -- 172.21.15.88:0/332092456 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21900a59e0 con 0x7f21a00bf2d0 2023-12-08T08:21:33.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.003+0000 7f219e7fc640 1 -- 172.21.15.88:0/332092456 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21900a5b40 con 0x7f21a00bf2d0 2023-12-08T08:21:33.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.003+0000 7f219e7fc640 1 -- 172.21.15.88:0/332092456 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21900ad440 con 0x7f21a00bf2d0 2023-12-08T08:21:33.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.003+0000 7f21a56bb640 1 -- 172.21.15.88:0/332092456 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21a00bf2d0 msgr2=0x7f21a0151970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:33.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.003+0000 7f21a56bb640 1 --2- 172.21.15.88:0/332092456 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21a00bf2d0 0x7f21a0151970 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2190009d90 tx=0x7f219001c920 comp rx=0 tx=0).stop 2023-12-08T08:21:33.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.003+0000 7f21a56bb640 1 -- 172.21.15.88:0/332092456 shutdown_connections 2023-12-08T08:21:33.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.003+0000 7f21a56bb640 1 --2- 172.21.15.88:0/332092456 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21a00c98f0 0x7f21a0151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.003+0000 7f21a56bb640 1 --2- 172.21.15.88:0/332092456 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21a00bf2d0 0x7f21a0151970 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.003+0000 7f21a56bb640 1 -- 172.21.15.88:0/332092456 >> 172.21.15.88:0/332092456 conn(0x7f21a00c9dc0 msgr2=0x7f21a00ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:33.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.003+0000 7f21a56bb640 1 -- 172.21.15.88:0/332092456 shutdown_connections 2023-12-08T08:21:33.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.003+0000 7f21a56bb640 1 -- 172.21.15.88:0/332092456 wait complete. 2023-12-08T08:21:33.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.003+0000 7f21a56bb640 1 Processor -- start 2023-12-08T08:21:33.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.003+0000 7f21a56bb640 1 -- start start 2023-12-08T08:21:33.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.003+0000 7f21a56bb640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21a00bf2d0 0x7f21a014ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:33.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.003+0000 7f21a56bb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21a00c6030 0x7f21a006c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:33.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.003+0000 7f21a56bb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21a00c98f0 0x7f21a01549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:33.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.003+0000 7f21a56bb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a0140380 con 0x7f21a00c6030 2023-12-08T08:21:33.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.003+0000 7f21a56bb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a01eda70 con 0x7f21a00c98f0 2023-12-08T08:21:33.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.003+0000 7f21a56bb640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a014bc50 con 0x7f21a00bf2d0 2023-12-08T08:21:33.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.003+0000 7f21967fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21a00c6030 0x7f21a006c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:33.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.003+0000 7f21967fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21a00c6030 0x7f21a006c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38952/0 (socket says 172.21.15.88:38952) 2023-12-08T08:21:33.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.003+0000 7f21967fc640 1 -- 172.21.15.88:0/937147452 learned_addr learned my addr 172.21.15.88:0/937147452 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:33.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.003+0000 7f219effd640 1 --2- 172.21.15.88:0/937147452 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21a00bf2d0 0x7f21a014ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:33.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.003+0000 7f219f7fe640 1 --2- 172.21.15.88:0/937147452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21a00c98f0 0x7f21a01549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:33.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.007+0000 7f21967fc640 1 -- 172.21.15.88:0/937147452 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21a00bf2d0 msgr2=0x7f21a014ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:33.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.007+0000 7f21967fc640 1 --2- 172.21.15.88:0/937147452 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21a00bf2d0 0x7f21a014ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.007+0000 7f21967fc640 1 -- 172.21.15.88:0/937147452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21a00c98f0 msgr2=0x7f21a01549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:33.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.007+0000 7f21967fc640 1 --2- 172.21.15.88:0/937147452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21a00c98f0 0x7f21a01549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.007+0000 7f21967fc640 1 -- 172.21.15.88:0/937147452 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2190009a70 con 0x7f21a00c6030 2023-12-08T08:21:33.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.007+0000 7f21967fc640 1 --2- 172.21.15.88:0/937147452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21a00c6030 0x7f21a006c4b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f21880011f0 tx=0x7f218800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:33.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.007+0000 7f2197fff640 1 -- 172.21.15.88:0/937147452 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21880074e0 con 0x7f21a00c6030 2023-12-08T08:21:33.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.007+0000 7f2197fff640 1 -- 172.21.15.88:0/937147452 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2188007640 con 0x7f21a00c6030 2023-12-08T08:21:33.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.007+0000 7f2197fff640 1 -- 172.21.15.88:0/937147452 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21880049f0 con 0x7f21a00c6030 2023-12-08T08:21:33.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.007+0000 7f21a56bb640 1 -- 172.21.15.88:0/937147452 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a01ece60 con 0x7f21a00c6030 2023-12-08T08:21:33.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.007+0000 7f21a56bb640 1 -- 172.21.15.88:0/937147452 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a01ed420 con 0x7f21a00c6030 2023-12-08T08:21:33.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.007+0000 7f21a56bb640 1 -- 172.21.15.88:0/937147452 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a0067630 con 0x7f21a00c6030 2023-12-08T08:21:33.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.007+0000 7f2197fff640 1 -- 172.21.15.88:0/937147452 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2188004b50 con 0x7f21a00c6030 2023-12-08T08:21:33.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.007+0000 7f2197fff640 1 --2- 172.21.15.88:0/937147452 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2180066470 0x7f2180068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:33.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.007+0000 7f2197fff640 1 -- 172.21.15.88:0/937147452 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2188083f50 con 0x7f21a00c6030 2023-12-08T08:21:33.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.007+0000 7f219effd640 1 --2- 172.21.15.88:0/937147452 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2180066470 0x7f2180068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:33.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.011+0000 7f219effd640 1 --2- 172.21.15.88:0/937147452 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2180066470 0x7f2180068930 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f21900af000 tx=0x7f21900a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:33.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.011+0000 7f2197fff640 1 -- 172.21.15.88:0/937147452 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2188051100 con 0x7f21a00c6030 2023-12-08T08:21:33.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.163+0000 7f21a56bb640 1 -- 172.21.15.88:0/937147452 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f21a0157570 con 0x7f21a00c6030 2023-12-08T08:21:33.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.163+0000 7f2197fff640 1 -- 172.21.15.88:0/937147452 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2188054720 con 0x7f21a00c6030 2023-12-08T08:21:33.167 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:21:33.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.163+0000 7f21a56bb640 1 -- 172.21.15.88:0/937147452 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2180066470 msgr2=0x7f2180068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:33.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.163+0000 7f21a56bb640 1 --2- 172.21.15.88:0/937147452 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2180066470 0x7f2180068930 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f21900af000 tx=0x7f21900a7070 comp rx=0 tx=0).stop 2023-12-08T08:21:33.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.163+0000 7f21a56bb640 1 -- 172.21.15.88:0/937147452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21a00c6030 msgr2=0x7f21a006c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:33.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.163+0000 7f21a56bb640 1 --2- 172.21.15.88:0/937147452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21a00c6030 0x7f21a006c4b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f21880011f0 tx=0x7f218800c8f0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.163+0000 7f21a56bb640 1 -- 172.21.15.88:0/937147452 shutdown_connections 2023-12-08T08:21:33.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.163+0000 7f21a56bb640 1 --2- 172.21.15.88:0/937147452 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2180066470 0x7f2180068930 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.163+0000 7f21a56bb640 1 --2- 172.21.15.88:0/937147452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21a00c98f0 0x7f21a01549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.163+0000 7f21a56bb640 1 --2- 172.21.15.88:0/937147452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21a00c6030 0x7f21a006c4b0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.163+0000 7f21a56bb640 1 --2- 172.21.15.88:0/937147452 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f21a00bf2d0 0x7f21a014ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.163+0000 7f21a56bb640 1 -- 172.21.15.88:0/937147452 >> 172.21.15.88:0/937147452 conn(0x7f21a00c9dc0 msgr2=0x7f21a00ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:33.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.163+0000 7f21a56bb640 1 -- 172.21.15.88:0/937147452 shutdown_connections 2023-12-08T08:21:33.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.163+0000 7f21a56bb640 1 -- 172.21.15.88:0/937147452 wait complete. 2023-12-08T08:21:33.188 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:21:33.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.323+0000 7f473e53e640 1 Processor -- start 2023-12-08T08:21:33.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.323+0000 7f473e53e640 1 -- start start 2023-12-08T08:21:33.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.323+0000 7f473e53e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f473814f850 0x7f47380aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:33.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.323+0000 7f473e53e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4738152910 con 0x7f473806d840 2023-12-08T08:21:33.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.323+0000 7f473e53e640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4738152bf0 con 0x7f473814fc30 2023-12-08T08:21:33.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.323+0000 7f473e53e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47380c2240 con 0x7f473814f850 2023-12-08T08:21:33.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.327+0000 7f4737fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f473814f850 0x7f47380aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:33.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.327+0000 7f4737fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f473814f850 0x7f47380aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38958/0 (socket says 172.21.15.88:38958) 2023-12-08T08:21:33.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.327+0000 7f4737fff640 1 -- 172.21.15.88:0/3437845454 learned_addr learned my addr 172.21.15.88:0/3437845454 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:33.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.327+0000 7f4737fff640 1 -- 172.21.15.88:0/3437845454 >> v1:172.21.15.148:6789/0 conn(0x7f473814fc30 legacy=0x7f47380c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:33.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.327+0000 7f4737fff640 1 -- 172.21.15.88:0/3437845454 >> v1:172.21.15.88:6789/0 conn(0x7f473806d840 legacy=0x7f47380c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:33.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.327+0000 7f4737fff640 1 -- 172.21.15.88:0/3437845454 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4738152ed0 con 0x7f473814f850 2023-12-08T08:21:33.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.327+0000 7f4737fff640 1 --2- 172.21.15.88:0/3437845454 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f473814f850 0x7f47380aacf0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4728009870 tx=0x7f472801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb11581a93592ea server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:33.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.327+0000 7f4736ffd640 1 -- 172.21.15.88:0/3437845454 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47280aa430 con 0x7f473814f850 2023-12-08T08:21:33.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.327+0000 7f4736ffd640 1 -- 172.21.15.88:0/3437845454 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47280aa590 con 0x7f473814f850 2023-12-08T08:21:33.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.327+0000 7f4736ffd640 1 -- 172.21.15.88:0/3437845454 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47280aa920 con 0x7f473814f850 2023-12-08T08:21:33.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.331+0000 7f473e53e640 1 -- 172.21.15.88:0/3437845454 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f473814f850 msgr2=0x7f47380aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:33.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.331+0000 7f473e53e640 1 --2- 172.21.15.88:0/3437845454 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f473814f850 0x7f47380aacf0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4728009870 tx=0x7f472801c4b0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.331+0000 7f473e53e640 1 -- 172.21.15.88:0/3437845454 shutdown_connections 2023-12-08T08:21:33.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.331+0000 7f473e53e640 1 --2- 172.21.15.88:0/3437845454 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f473814f850 0x7f47380aacf0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.331+0000 7f473e53e640 1 -- 172.21.15.88:0/3437845454 >> 172.21.15.88:0/3437845454 conn(0x7f47380c59f0 msgr2=0x7f47380c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:33.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.331+0000 7f473e53e640 1 -- 172.21.15.88:0/3437845454 shutdown_connections 2023-12-08T08:21:33.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.331+0000 7f473e53e640 1 -- 172.21.15.88:0/3437845454 wait complete. 2023-12-08T08:21:33.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.331+0000 7f473e53e640 1 Processor -- start 2023-12-08T08:21:33.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.331+0000 7f473e53e640 1 -- start start 2023-12-08T08:21:33.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.331+0000 7f473e53e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f473806d840 0x7f4738072740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:33.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.331+0000 7f473e53e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f473814f850 0x7f47381f1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:33.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.331+0000 7f473e53e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f473814fc30 0x7f473814b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:33.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.331+0000 7f473e53e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473814a390 con 0x7f473814fc30 2023-12-08T08:21:33.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.331+0000 7f473e53e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47381f2000 con 0x7f473814f850 2023-12-08T08:21:33.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.331+0000 7f473e53e640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473814d860 con 0x7f473806d840 2023-12-08T08:21:33.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.331+0000 7f473cadb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f473814fc30 0x7f473814b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:33.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.331+0000 7f473cadb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f473814fc30 0x7f473814b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38974/0 (socket says 172.21.15.88:38974) 2023-12-08T08:21:33.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.331+0000 7f473cadb640 1 -- 172.21.15.88:0/1941280119 learned_addr learned my addr 172.21.15.88:0/1941280119 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:33.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.331+0000 7f4737fff640 1 --2- 172.21.15.88:0/1941280119 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f473806d840 0x7f4738072740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:33.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.331+0000 7f47377fe640 1 --2- 172.21.15.88:0/1941280119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f473814f850 0x7f47381f1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:33.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.331+0000 7f473cadb640 1 -- 172.21.15.88:0/1941280119 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f473806d840 msgr2=0x7f4738072740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:33.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.331+0000 7f473cadb640 1 --2- 172.21.15.88:0/1941280119 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f473806d840 0x7f4738072740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.331+0000 7f473cadb640 1 -- 172.21.15.88:0/1941280119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f473814f850 msgr2=0x7f47381f1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:33.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.331+0000 7f473cadb640 1 --2- 172.21.15.88:0/1941280119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f473814f850 0x7f47381f1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.331+0000 7f473cadb640 1 -- 172.21.15.88:0/1941280119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47280094d0 con 0x7f473814fc30 2023-12-08T08:21:33.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.335+0000 7f473cadb640 1 --2- 172.21.15.88:0/1941280119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f473814fc30 0x7f473814b210 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f473000c770 tx=0x7f473000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:33.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.335+0000 7f4734ff9640 1 -- 172.21.15.88:0/1941280119 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4730003b80 con 0x7f473814fc30 2023-12-08T08:21:33.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.335+0000 7f4734ff9640 1 -- 172.21.15.88:0/1941280119 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4730003ce0 con 0x7f473814fc30 2023-12-08T08:21:33.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.335+0000 7f4734ff9640 1 -- 172.21.15.88:0/1941280119 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473000aa90 con 0x7f473814fc30 2023-12-08T08:21:33.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.335+0000 7f473e53e640 1 -- 172.21.15.88:0/1941280119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4738149c20 con 0x7f473814fc30 2023-12-08T08:21:33.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.335+0000 7f473e53e640 1 -- 172.21.15.88:0/1941280119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f473814a520 con 0x7f473814fc30 2023-12-08T08:21:33.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.335+0000 7f473e53e640 1 -- 172.21.15.88:0/1941280119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4738067630 con 0x7f473814fc30 2023-12-08T08:21:33.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.335+0000 7f4734ff9640 1 -- 172.21.15.88:0/1941280119 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f473000abf0 con 0x7f473814fc30 2023-12-08T08:21:33.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.335+0000 7f4734ff9640 1 --2- 172.21.15.88:0/1941280119 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f47240664a0 0x7f4724068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:33.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.335+0000 7f4734ff9640 1 -- 172.21.15.88:0/1941280119 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4730083f60 con 0x7f473814fc30 2023-12-08T08:21:33.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.335+0000 7f4737fff640 1 --2- 172.21.15.88:0/1941280119 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f47240664a0 0x7f4724068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:33.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.339+0000 7f4737fff640 1 --2- 172.21.15.88:0/1941280119 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f47240664a0 0x7f4724068960 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f47280ae000 tx=0x7f47280a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:33.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.339+0000 7f4734ff9640 1 -- 172.21.15.88:0/1941280119 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4730051110 con 0x7f473814fc30 2023-12-08T08:21:33.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.487+0000 7f473e53e640 1 -- 172.21.15.88:0/1941280119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f47380724a0 con 0x7f473814fc30 2023-12-08T08:21:33.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.487+0000 7f4734ff9640 1 -- 172.21.15.88:0/1941280119 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4730054730 con 0x7f473814fc30 2023-12-08T08:21:33.492 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:21:33.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.491+0000 7f473e53e640 1 -- 172.21.15.88:0/1941280119 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f47240664a0 msgr2=0x7f4724068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:33.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.491+0000 7f473e53e640 1 --2- 172.21.15.88:0/1941280119 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f47240664a0 0x7f4724068960 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f47280ae000 tx=0x7f47280a7000 comp rx=0 tx=0).stop 2023-12-08T08:21:33.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.491+0000 7f473e53e640 1 -- 172.21.15.88:0/1941280119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f473814fc30 msgr2=0x7f473814b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:33.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.491+0000 7f473e53e640 1 --2- 172.21.15.88:0/1941280119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f473814fc30 0x7f473814b210 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f473000c770 tx=0x7f473000cc30 comp rx=0 tx=0).stop 2023-12-08T08:21:33.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.491+0000 7f473e53e640 1 -- 172.21.15.88:0/1941280119 shutdown_connections 2023-12-08T08:21:33.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.491+0000 7f473e53e640 1 --2- 172.21.15.88:0/1941280119 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f47240664a0 0x7f4724068960 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.491+0000 7f473e53e640 1 --2- 172.21.15.88:0/1941280119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f473814fc30 0x7f473814b210 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.491+0000 7f473e53e640 1 --2- 172.21.15.88:0/1941280119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f473814f850 0x7f47381f1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.491+0000 7f473e53e640 1 --2- 172.21.15.88:0/1941280119 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f473806d840 0x7f4738072740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.491+0000 7f473e53e640 1 -- 172.21.15.88:0/1941280119 >> 172.21.15.88:0/1941280119 conn(0x7f47380c59f0 msgr2=0x7f473806cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:33.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.491+0000 7f473e53e640 1 -- 172.21.15.88:0/1941280119 shutdown_connections 2023-12-08T08:21:33.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.491+0000 7f473e53e640 1 -- 172.21.15.88:0/1941280119 wait complete. 2023-12-08T08:21:33.514 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:21:33.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.651+0000 7fd128846640 1 Processor -- start 2023-12-08T08:21:33.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.651+0000 7fd128846640 1 -- start start 2023-12-08T08:21:33.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.651+0000 7fd128846640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd124154f20 0x7fd124158050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:33.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.651+0000 7fd128846640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd124158590 0x7fd12415ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:33.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.651+0000 7fd128846640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1241589c0 con 0x7fd1240af550 2023-12-08T08:21:33.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.651+0000 7fd128846640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1241553d0 con 0x7fd124154f20 2023-12-08T08:21:33.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.651+0000 7fd128846640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1240af930 con 0x7fd124158590 2023-12-08T08:21:33.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.651+0000 7fd119d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd124154f20 0x7fd124158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:33.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.651+0000 7fd12259c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd1240af550 0x7fd1240c4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57540/0 (socket says 172.21.15.88:57540) 2023-12-08T08:21:33.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.651+0000 7fd12259c640 1 -- 172.21.15.88:0/1050070981 learned_addr learned my addr 172.21.15.88:0/1050070981 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:33.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.651+0000 7fd119d9b640 1 -- 172.21.15.88:0/1050070981 >> v2:172.21.15.148:3300/0 conn(0x7fd124158590 msgr2=0x7fd12415ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:33.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.651+0000 7fd122d9d640 1 --2- 172.21.15.88:0/1050070981 >> v2:172.21.15.148:3300/0 conn(0x7fd124158590 0x7fd12415ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:33.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.651+0000 7fd119d9b640 1 --2- 172.21.15.88:0/1050070981 >> v2:172.21.15.148:3300/0 conn(0x7fd124158590 0x7fd12415ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.651+0000 7fd119d9b640 1 -- 172.21.15.88:0/1050070981 >> v1:172.21.15.88:6789/0 conn(0x7fd1240af550 legacy=0x7fd1240c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:33.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.651+0000 7fd121d9b640 1 -- 172.21.15.88:0/1050070981 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2116598070 0 0) 0x7fd10c001120 con 0x7fd1240af550 2023-12-08T08:21:33.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.651+0000 7fd119d9b640 1 -- 172.21.15.88:0/1050070981 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1240c67a0 con 0x7fd124154f20 2023-12-08T08:21:33.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.651+0000 7fd122d9d640 1 --2- 172.21.15.88:0/1050070981 >> v2:172.21.15.148:3300/0 conn(0x7fd124158590 0x7fd12415ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:33.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.655+0000 7fd119d9b640 1 --2- 172.21.15.88:0/1050070981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd124154f20 0x7fd124158050 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd1240aca00 tx=0x7fd11401c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf80a54fcfcb1e76 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:33.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.655+0000 7fd121d9b640 1 -- 172.21.15.88:0/1050070981 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1140ab600 con 0x7fd124154f20 2023-12-08T08:21:33.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.655+0000 7fd121d9b640 1 -- 172.21.15.88:0/1050070981 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1140a7050 con 0x7fd124154f20 2023-12-08T08:21:33.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.655+0000 7fd121d9b640 1 -- 172.21.15.88:0/1050070981 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1140ab980 con 0x7fd124154f20 2023-12-08T08:21:33.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.655+0000 7fd128846640 1 -- 172.21.15.88:0/1050070981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd124154f20 msgr2=0x7fd124158050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:33.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.655+0000 7fd128846640 1 --2- 172.21.15.88:0/1050070981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd124154f20 0x7fd124158050 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd1240aca00 tx=0x7fd11401c320 comp rx=0 tx=0).stop 2023-12-08T08:21:33.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.655+0000 7fd128846640 1 -- 172.21.15.88:0/1050070981 shutdown_connections 2023-12-08T08:21:33.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.655+0000 7fd128846640 1 --2- 172.21.15.88:0/1050070981 >> v2:172.21.15.148:3300/0 conn(0x7fd124158590 0x7fd12415ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.655+0000 7fd128846640 1 --2- 172.21.15.88:0/1050070981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd124154f20 0x7fd124158050 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.655+0000 7fd128846640 1 -- 172.21.15.88:0/1050070981 >> 172.21.15.88:0/1050070981 conn(0x7fd1240668d0 msgr2=0x7fd1240ab980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:33.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.655+0000 7fd128846640 1 -- 172.21.15.88:0/1050070981 shutdown_connections 2023-12-08T08:21:33.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.655+0000 7fd128846640 1 -- 172.21.15.88:0/1050070981 wait complete. 2023-12-08T08:21:33.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.659+0000 7fd128846640 1 Processor -- start 2023-12-08T08:21:33.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.659+0000 7fd128846640 1 -- start start 2023-12-08T08:21:33.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.659+0000 7fd128846640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1240af550 0x7fd1241f0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:33.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.659+0000 7fd128846640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd124154f20 0x7fd1240c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:33.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.659+0000 7fd128846640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd124158590 0x7fd1240c23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:33.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.659+0000 7fd128846640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1240ab200 con 0x7fd1240af550 2023-12-08T08:21:33.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.659+0000 7fd128846640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1240ac730 con 0x7fd124154f20 2023-12-08T08:21:33.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.659+0000 7fd128846640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1241effd0 con 0x7fd124158590 2023-12-08T08:21:33.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.659+0000 7fd12259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1240af550 0x7fd1241f0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:33.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.659+0000 7fd12259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1240af550 0x7fd1241f0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38988/0 (socket says 172.21.15.88:38988) 2023-12-08T08:21:33.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.659+0000 7fd12259c640 1 -- 172.21.15.88:0/221814502 learned_addr learned my addr 172.21.15.88:0/221814502 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:33.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.659+0000 7fd12259c640 1 -- 172.21.15.88:0/221814502 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd124158590 msgr2=0x7fd1240c23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:33.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.659+0000 7fd12259c640 1 --2- 172.21.15.88:0/221814502 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd124158590 0x7fd1240c23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.659+0000 7fd12259c640 1 -- 172.21.15.88:0/221814502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd124154f20 msgr2=0x7fd1240c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:33.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.659+0000 7fd119d9b640 1 --2- 172.21.15.88:0/221814502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd124154f20 0x7fd1240c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:33.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.659+0000 7fd12259c640 1 --2- 172.21.15.88:0/221814502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd124154f20 0x7fd1240c7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.659+0000 7fd12259c640 1 -- 172.21.15.88:0/221814502 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd114009420 con 0x7fd1240af550 2023-12-08T08:21:33.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.659+0000 7fd119d9b640 1 --2- 172.21.15.88:0/221814502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd124154f20 0x7fd1240c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:33.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.659+0000 7fd12259c640 1 --2- 172.21.15.88:0/221814502 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1240af550 0x7fd1241f0a20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd10c00c780 tx=0x7fd10c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:33.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.659+0000 7fd11b7fe640 1 -- 172.21.15.88:0/221814502 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10c0072d0 con 0x7fd1240af550 2023-12-08T08:21:33.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.659+0000 7fd11b7fe640 1 -- 172.21.15.88:0/221814502 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10c007450 con 0x7fd1240af550 2023-12-08T08:21:33.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.659+0000 7fd128846640 1 -- 172.21.15.88:0/221814502 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1240a9f90 con 0x7fd1240af550 2023-12-08T08:21:33.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.659+0000 7fd11b7fe640 1 -- 172.21.15.88:0/221814502 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10c0047f0 con 0x7fd1240af550 2023-12-08T08:21:33.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.659+0000 7fd128846640 1 -- 172.21.15.88:0/221814502 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1241f0500 con 0x7fd1240af550 2023-12-08T08:21:33.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.663+0000 7fd128846640 1 -- 172.21.15.88:0/221814502 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1241f06f0 con 0x7fd1240af550 2023-12-08T08:21:33.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.663+0000 7fd11b7fe640 1 -- 172.21.15.88:0/221814502 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd10c004950 con 0x7fd1240af550 2023-12-08T08:21:33.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.663+0000 7fd11b7fe640 1 --2- 172.21.15.88:0/221814502 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd1040664a0 0x7fd104068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:33.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.663+0000 7fd11b7fe640 1 -- 172.21.15.88:0/221814502 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd10c083170 con 0x7fd1240af550 2023-12-08T08:21:33.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.663+0000 7fd119d9b640 1 --2- 172.21.15.88:0/221814502 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd1040664a0 0x7fd104068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:33.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.663+0000 7fd119d9b640 1 --2- 172.21.15.88:0/221814502 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd1040664a0 0x7fd104068960 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd1140ad000 tx=0x7fd114008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:33.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.667+0000 7fd11b7fe640 1 -- 172.21.15.88:0/221814502 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd10c050320 con 0x7fd1240af550 2023-12-08T08:21:33.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.819+0000 7fd128846640 1 -- 172.21.15.88:0/221814502 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd124067630 con 0x7fd1240af550 2023-12-08T08:21:33.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.819+0000 7fd11b7fe640 1 -- 172.21.15.88:0/221814502 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v35) v1 ==== 105+0+11 (secure 0 0 0) 0x7fd10c053940 con 0x7fd1240af550 2023-12-08T08:21:33.824 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:21:33.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.823+0000 7fd128846640 1 -- 172.21.15.88:0/221814502 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd1040664a0 msgr2=0x7fd104068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:33.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.823+0000 7fd128846640 1 --2- 172.21.15.88:0/221814502 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd1040664a0 0x7fd104068960 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd1140ad000 tx=0x7fd114008040 comp rx=0 tx=0).stop 2023-12-08T08:21:33.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.823+0000 7fd128846640 1 -- 172.21.15.88:0/221814502 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1240af550 msgr2=0x7fd1241f0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:33.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.823+0000 7fd128846640 1 --2- 172.21.15.88:0/221814502 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1240af550 0x7fd1241f0a20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd10c00c780 tx=0x7fd10c00cc40 comp rx=0 tx=0).stop 2023-12-08T08:21:33.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.823+0000 7fd128846640 1 -- 172.21.15.88:0/221814502 shutdown_connections 2023-12-08T08:21:33.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.823+0000 7fd128846640 1 --2- 172.21.15.88:0/221814502 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd1040664a0 0x7fd104068960 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.823+0000 7fd128846640 1 --2- 172.21.15.88:0/221814502 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd124158590 0x7fd1240c23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.823+0000 7fd128846640 1 --2- 172.21.15.88:0/221814502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd124154f20 0x7fd1240c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.823+0000 7fd128846640 1 --2- 172.21.15.88:0/221814502 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1240af550 0x7fd1241f0a20 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.823+0000 7fd128846640 1 -- 172.21.15.88:0/221814502 >> 172.21.15.88:0/221814502 conn(0x7fd1240668d0 msgr2=0x7fd1240c4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:33.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.823+0000 7fd128846640 1 -- 172.21.15.88:0/221814502 shutdown_connections 2023-12-08T08:21:33.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.823+0000 7fd128846640 1 -- 172.21.15.88:0/221814502 wait complete. 2023-12-08T08:21:33.845 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:21:33.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd887232640 1 Processor -- start 2023-12-08T08:21:33.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd887232640 1 -- start start 2023-12-08T08:21:33.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd887232640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd88014f850 0x7fd8800aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:33.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd887232640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd880152910 con 0x7fd88014fc30 2023-12-08T08:21:33.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd887232640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd880152bf0 con 0x7fd88006d840 2023-12-08T08:21:33.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd887232640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8800c2240 con 0x7fd88014f850 2023-12-08T08:21:33.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd877fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd88014fc30 0x7fd8800c3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57550/0 (socket says 172.21.15.88:57550) 2023-12-08T08:21:33.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd877fff640 1 -- 172.21.15.88:0/1408131894 learned_addr learned my addr 172.21.15.88:0/1408131894 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:33.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd884fce640 1 --2- 172.21.15.88:0/1408131894 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd88014f850 0x7fd8800aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:33.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd8777fe640 1 -- 172.21.15.88:0/1408131894 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3337649034 0 0) 0x7fd880152910 con 0x7fd88014fc30 2023-12-08T08:21:33.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd8777fe640 1 -- 172.21.15.88:0/1408131894 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd868003530 con 0x7fd88014fc30 2023-12-08T08:21:33.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd8777fe640 1 -- 172.21.15.88:0/1408131894 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3350750175 0 0) 0x7fd868003530 con 0x7fd88014fc30 2023-12-08T08:21:33.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd8777fe640 1 -- 172.21.15.88:0/1408131894 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd88014f850 msgr2=0x7fd8800aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:33.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd8777fe640 1 --2- 172.21.15.88:0/1408131894 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd88014f850 0x7fd8800aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd8777fe640 1 -- 172.21.15.88:0/1408131894 >> v1:172.21.15.148:6789/0 conn(0x7fd88006d840 legacy=0x7fd8800c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:33.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd8777fe640 1 -- 172.21.15.88:0/1408131894 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd880152ed0 con 0x7fd88014fc30 2023-12-08T08:21:33.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd8777fe640 1 -- 172.21.15.88:0/1408131894 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7fd870001680 con 0x7fd88014fc30 2023-12-08T08:21:33.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd8777fe640 1 -- 172.21.15.88:0/1408131894 >> v1:172.21.15.88:6789/0 conn(0x7fd88014fc30 legacy=0x7fd8800c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:33.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd8777fe640 1 --2- 172.21.15.88:0/1408131894 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd88014f850 0x7fd8680039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:33.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd8777fe640 1 --2- 172.21.15.88:0/1408131894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd868003f30 0x7fd8680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:33.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd8777fe640 1 --2- 172.21.15.88:0/1408131894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd868004d10 0x7fd868005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:33.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd8777fe640 1 -- 172.21.15.88:0/1408131894 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8800c2240 con 0x7fd868004d10 2023-12-08T08:21:33.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd8777fe640 1 -- 172.21.15.88:0/1408131894 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86800bb20 con 0x7fd868003f30 2023-12-08T08:21:33.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd8777fe640 1 -- 172.21.15.88:0/1408131894 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86800bce0 con 0x7fd88014f850 2023-12-08T08:21:33.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd8857cf640 1 --2- 172.21.15.88:0/1408131894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd868004d10 0x7fd868005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:33.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd877fff640 1 --2- 172.21.15.88:0/1408131894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd868003f30 0x7fd8680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:33.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd884fce640 1 --2- 172.21.15.88:0/1408131894 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd88014f850 0x7fd8680039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:33.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd8857cf640 1 -- 172.21.15.88:0/1408131894 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd88014f850 msgr2=0x7fd8680039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:33.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd8857cf640 1 --2- 172.21.15.88:0/1408131894 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd88014f850 0x7fd8680039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd8857cf640 1 -- 172.21.15.88:0/1408131894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd868003f30 msgr2=0x7fd8680047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:33.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd8857cf640 1 --2- 172.21.15.88:0/1408131894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd868003f30 0x7fd8680047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.983+0000 7fd8857cf640 1 -- 172.21.15.88:0/1408131894 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd868003530 con 0x7fd868004d10 2023-12-08T08:21:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.987+0000 7fd8857cf640 1 --2- 172.21.15.88:0/1408131894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd868004d10 0x7fd868005190 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd878001e40 tx=0x7fd87801c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1dabaf036e58c96 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.987+0000 7fd8777fe640 1 -- 172.21.15.88:0/1408131894 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878003b80 con 0x7fd868004d10 2023-12-08T08:21:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.987+0000 7fd8777fe640 1 -- 172.21.15.88:0/1408131894 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd878003ce0 con 0x7fd868004d10 2023-12-08T08:21:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.987+0000 7fd8777fe640 1 -- 172.21.15.88:0/1408131894 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8780052c0 con 0x7fd868004d10 2023-12-08T08:21:33.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.987+0000 7fd887232640 1 -- 172.21.15.88:0/1408131894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd868004d10 msgr2=0x7fd868005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:33.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.987+0000 7fd887232640 1 --2- 172.21.15.88:0/1408131894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd868004d10 0x7fd868005190 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd878001e40 tx=0x7fd87801c740 comp rx=0 tx=0).stop 2023-12-08T08:21:33.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.987+0000 7fd8857cf640 1 -- 172.21.15.88:0/1408131894 reap_dead start 2023-12-08T08:21:33.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.987+0000 7fd887232640 1 -- 172.21.15.88:0/1408131894 shutdown_connections 2023-12-08T08:21:33.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.987+0000 7fd887232640 1 -- 172.21.15.88:0/1408131894 >> 172.21.15.88:0/1408131894 conn(0x7fd8800c59f0 msgr2=0x7fd8800c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:33.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.987+0000 7fd887232640 1 -- 172.21.15.88:0/1408131894 shutdown_connections 2023-12-08T08:21:33.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.987+0000 7fd887232640 1 -- 172.21.15.88:0/1408131894 wait complete. 2023-12-08T08:21:33.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.991+0000 7fd887232640 1 Processor -- start 2023-12-08T08:21:33.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.991+0000 7fd887232640 1 -- start start 2023-12-08T08:21:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.991+0000 7fd887232640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd868004d10 0x7fd880155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.991+0000 7fd887232640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd880070120 0x7fd880151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.991+0000 7fd887232640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd88014bf70 0x7fd88014c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.991+0000 7fd887232640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd880070a30 con 0x7fd868004d10 2023-12-08T08:21:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.991+0000 7fd887232640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88014c930 con 0x7fd88014bf70 2023-12-08T08:21:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.991+0000 7fd887232640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd880156790 con 0x7fd880070120 2023-12-08T08:21:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.991+0000 7fd884fce640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd868004d10 0x7fd880155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:33.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.991+0000 7fd884fce640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd868004d10 0x7fd880155860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39004/0 (socket says 172.21.15.88:39004) 2023-12-08T08:21:33.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.991+0000 7fd884fce640 1 -- 172.21.15.88:0/2463837706 learned_addr learned my addr 172.21.15.88:0/2463837706 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:33.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.991+0000 7fd8857cf640 1 --2- 172.21.15.88:0/2463837706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd88014bf70 0x7fd88014c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:33.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.991+0000 7fd877fff640 1 --2- 172.21.15.88:0/2463837706 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd880070120 0x7fd880151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:33.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.991+0000 7fd884fce640 1 -- 172.21.15.88:0/2463837706 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd880070120 msgr2=0x7fd880151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:33.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.991+0000 7fd884fce640 1 --2- 172.21.15.88:0/2463837706 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd880070120 0x7fd880151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.991+0000 7fd884fce640 1 -- 172.21.15.88:0/2463837706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd88014bf70 msgr2=0x7fd88014c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:33.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.991+0000 7fd884fce640 1 --2- 172.21.15.88:0/2463837706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd88014bf70 0x7fd88014c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:33.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.991+0000 7fd884fce640 1 -- 172.21.15.88:0/2463837706 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd880070580 con 0x7fd868004d10 2023-12-08T08:21:33.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.991+0000 7fd8857cf640 1 --2- 172.21.15.88:0/2463837706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd88014bf70 0x7fd88014c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:33.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.991+0000 7fd884fce640 1 --2- 172.21.15.88:0/2463837706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd868004d10 0x7fd880155860 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd87c011a30 tx=0x7fd87c011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:33.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.991+0000 7fd8757fa640 1 -- 172.21.15.88:0/2463837706 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87c00fbb0 con 0x7fd868004d10 2023-12-08T08:21:33.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.991+0000 7fd8757fa640 1 -- 172.21.15.88:0/2463837706 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87c00fd10 con 0x7fd868004d10 2023-12-08T08:21:33.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.991+0000 7fd8757fa640 1 -- 172.21.15.88:0/2463837706 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87c014680 con 0x7fd868004d10 2023-12-08T08:21:34.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.991+0000 7fd887232640 1 -- 172.21.15.88:0/2463837706 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd880156160 con 0x7fd868004d10 2023-12-08T08:21:34.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.991+0000 7fd887232640 1 -- 172.21.15.88:0/2463837706 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8800729d0 con 0x7fd868004d10 2023-12-08T08:21:34.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.995+0000 7fd887232640 1 -- 172.21.15.88:0/2463837706 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd880067630 con 0x7fd868004d10 2023-12-08T08:21:34.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.995+0000 7fd8757fa640 1 -- 172.21.15.88:0/2463837706 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd87c0147e0 con 0x7fd868004d10 2023-12-08T08:21:34.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.995+0000 7fd8757fa640 1 --2- 172.21.15.88:0/2463837706 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd86c066470 0x7fd86c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:34.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.995+0000 7fd8757fa640 1 -- 172.21.15.88:0/2463837706 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd87c084b90 con 0x7fd868004d10 2023-12-08T08:21:34.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.995+0000 7fd877fff640 1 --2- 172.21.15.88:0/2463837706 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd86c066470 0x7fd86c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:34.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.995+0000 7fd877fff640 1 --2- 172.21.15.88:0/2463837706 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd86c066470 0x7fd86c068930 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd88014ee40 tx=0x7fd870009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:34.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:33.999+0000 7fd8757fa640 1 -- 172.21.15.88:0/2463837706 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd87c051cd0 con 0x7fd868004d10 2023-12-08T08:21:34.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.151+0000 7fd887232640 1 -- 172.21.15.88:0/2463837706 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fd880156950 con 0x7fd868004d10 2023-12-08T08:21:34.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.151+0000 7fd8757fa640 1 -- 172.21.15.88:0/2463837706 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v35) v1 ==== 101+0+11 (secure 0 0 0) 0x7fd87c022020 con 0x7fd868004d10 2023-12-08T08:21:34.155 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:21:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.151+0000 7fd887232640 1 -- 172.21.15.88:0/2463837706 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd86c066470 msgr2=0x7fd86c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.151+0000 7fd887232640 1 --2- 172.21.15.88:0/2463837706 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd86c066470 0x7fd86c068930 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd88014ee40 tx=0x7fd870009040 comp rx=0 tx=0).stop 2023-12-08T08:21:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.151+0000 7fd887232640 1 -- 172.21.15.88:0/2463837706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd868004d10 msgr2=0x7fd880155860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.151+0000 7fd887232640 1 --2- 172.21.15.88:0/2463837706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd868004d10 0x7fd880155860 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd87c011a30 tx=0x7fd87c011ef0 comp rx=0 tx=0).stop 2023-12-08T08:21:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.151+0000 7fd887232640 1 -- 172.21.15.88:0/2463837706 shutdown_connections 2023-12-08T08:21:34.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.151+0000 7fd887232640 1 --2- 172.21.15.88:0/2463837706 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd86c066470 0x7fd86c068930 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:34.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.151+0000 7fd887232640 1 --2- 172.21.15.88:0/2463837706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd88014bf70 0x7fd88014c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:34.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.151+0000 7fd887232640 1 --2- 172.21.15.88:0/2463837706 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd880070120 0x7fd880151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:34.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.151+0000 7fd887232640 1 --2- 172.21.15.88:0/2463837706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd868004d10 0x7fd880155860 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:34.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.151+0000 7fd887232640 1 -- 172.21.15.88:0/2463837706 >> 172.21.15.88:0/2463837706 conn(0x7fd8800c59f0 msgr2=0x7fd8800c5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:34.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.151+0000 7fd887232640 1 -- 172.21.15.88:0/2463837706 shutdown_connections 2023-12-08T08:21:34.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.151+0000 7fd887232640 1 -- 172.21.15.88:0/2463837706 wait complete. 2023-12-08T08:21:34.178 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:21:34.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.311+0000 7fd64a93e640 1 Processor -- start 2023-12-08T08:21:34.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.311+0000 7fd64a93e640 1 -- start start 2023-12-08T08:21:34.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.311+0000 7fd64a93e640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd6440a5370 0x7fd64414f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:34.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.311+0000 7fd64a93e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6441524b0 con 0x7fd6440a4f90 2023-12-08T08:21:34.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.311+0000 7fd64a93e640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6440c62f0 con 0x7fd644072810 2023-12-08T08:21:34.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.311+0000 7fd64a93e640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6440c60d0 con 0x7fd6440a5370 2023-12-08T08:21:34.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.311+0000 7fd643fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd6440a4f90 0x7fd6440c59c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57566/0 (socket says 172.21.15.88:57566) 2023-12-08T08:21:34.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.311+0000 7fd643fff640 1 -- 172.21.15.88:0/1087675685 learned_addr learned my addr 172.21.15.88:0/1087675685 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:34.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.311+0000 7fd6437fe640 1 --2- 172.21.15.88:0/1087675685 >> v2:172.21.15.148:3300/0 conn(0x7fd6440a5370 0x7fd64414f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.315+0000 7fd642ffd640 1 -- 172.21.15.88:0/1087675685 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2842666690 0 0) 0x7fd6441524b0 con 0x7fd6440a4f90 2023-12-08T08:21:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.315+0000 7fd642ffd640 1 -- 172.21.15.88:0/1087675685 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd62c003530 con 0x7fd6440a4f90 2023-12-08T08:21:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.315+0000 7fd6437fe640 1 -- 172.21.15.88:0/1087675685 >> v1:172.21.15.148:6789/0 conn(0x7fd644072810 legacy=0x7fd6440c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.315+0000 7fd642ffd640 1 -- 172.21.15.88:0/1087675685 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 307253685 0 0) 0x7fd62c003530 con 0x7fd6440a4f90 2023-12-08T08:21:34.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.315+0000 7fd6437fe640 1 -- 172.21.15.88:0/1087675685 >> v1:172.21.15.88:6789/0 conn(0x7fd6440a4f90 legacy=0x7fd6440c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:34.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.315+0000 7fd6437fe640 1 -- 172.21.15.88:0/1087675685 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd644152770 con 0x7fd6440a5370 2023-12-08T08:21:34.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.315+0000 7fd6437fe640 1 --2- 172.21.15.88:0/1087675685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6440a5370 0x7fd64414f870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd6441526a0 tx=0x7fd63801c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6263ffeb9cdf29be server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:34.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.315+0000 7fd642ffd640 1 -- 172.21.15.88:0/1087675685 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd634001680 con 0x7fd6440a5370 2023-12-08T08:21:34.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.315+0000 7fd642ffd640 1 -- 172.21.15.88:0/1087675685 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6380a7050 con 0x7fd6440a5370 2023-12-08T08:21:34.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.315+0000 7fd642ffd640 1 -- 172.21.15.88:0/1087675685 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6380ab600 con 0x7fd6440a5370 2023-12-08T08:21:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.319+0000 7fd64a93e640 1 -- 172.21.15.88:0/1087675685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6440a5370 msgr2=0x7fd64414f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.319+0000 7fd64a93e640 1 --2- 172.21.15.88:0/1087675685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6440a5370 0x7fd64414f870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd6441526a0 tx=0x7fd63801c310 comp rx=0 tx=0).stop 2023-12-08T08:21:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.319+0000 7fd64a93e640 1 -- 172.21.15.88:0/1087675685 shutdown_connections 2023-12-08T08:21:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.319+0000 7fd64a93e640 1 --2- 172.21.15.88:0/1087675685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6440a5370 0x7fd64414f870 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.319+0000 7fd64a93e640 1 -- 172.21.15.88:0/1087675685 >> 172.21.15.88:0/1087675685 conn(0x7fd64406b220 msgr2=0x7fd6440a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.319+0000 7fd64a93e640 1 -- 172.21.15.88:0/1087675685 shutdown_connections 2023-12-08T08:21:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.319+0000 7fd64a93e640 1 -- 172.21.15.88:0/1087675685 wait complete. 2023-12-08T08:21:34.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.319+0000 7fd64a93e640 1 Processor -- start 2023-12-08T08:21:34.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.319+0000 7fd64a93e640 1 -- start start 2023-12-08T08:21:34.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.319+0000 7fd64a93e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd644072810 0x7fd6441f0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:34.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.319+0000 7fd64a93e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6440a4f90 0x7fd644151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:34.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.319+0000 7fd64a93e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6440a5370 0x7fd644070c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:34.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.319+0000 7fd64a93e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64414a750 con 0x7fd6440a4f90 2023-12-08T08:21:34.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.319+0000 7fd64a93e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6441f1370 con 0x7fd6440a5370 2023-12-08T08:21:34.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.319+0000 7fd64a93e640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6440a9690 con 0x7fd644072810 2023-12-08T08:21:34.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.319+0000 7fd6437fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6440a4f90 0x7fd644151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:34.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.319+0000 7fd6437fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6440a4f90 0x7fd644151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39020/0 (socket says 172.21.15.88:39020) 2023-12-08T08:21:34.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.319+0000 7fd6437fe640 1 -- 172.21.15.88:0/2450949945 learned_addr learned my addr 172.21.15.88:0/2450949945 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.319+0000 7fd648edb640 1 --2- 172.21.15.88:0/2450949945 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6440a5370 0x7fd644070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.319+0000 7fd643fff640 1 --2- 172.21.15.88:0/2450949945 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd644072810 0x7fd6441f0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.319+0000 7fd6437fe640 1 -- 172.21.15.88:0/2450949945 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd644072810 msgr2=0x7fd6441f0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.319+0000 7fd6437fe640 1 --2- 172.21.15.88:0/2450949945 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd644072810 0x7fd6441f0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.319+0000 7fd6437fe640 1 -- 172.21.15.88:0/2450949945 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6440a5370 msgr2=0x7fd644070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.319+0000 7fd6437fe640 1 --2- 172.21.15.88:0/2450949945 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6440a5370 0x7fd644070c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.319+0000 7fd6437fe640 1 -- 172.21.15.88:0/2450949945 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd638009420 con 0x7fd6440a4f90 2023-12-08T08:21:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.319+0000 7fd648edb640 1 --2- 172.21.15.88:0/2450949945 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6440a5370 0x7fd644070c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.319+0000 7fd6437fe640 1 --2- 172.21.15.88:0/2450949945 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6440a4f90 0x7fd644151e60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd638000c10 tx=0x7fd6380190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:34.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.323+0000 7fd640ff9640 1 -- 172.21.15.88:0/2450949945 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd638003ab0 con 0x7fd6440a4f90 2023-12-08T08:21:34.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.323+0000 7fd640ff9640 1 -- 172.21.15.88:0/2450949945 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd638003c10 con 0x7fd6440a4f90 2023-12-08T08:21:34.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.323+0000 7fd640ff9640 1 -- 172.21.15.88:0/2450949945 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6380ab400 con 0x7fd6440a4f90 2023-12-08T08:21:34.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.323+0000 7fd64a93e640 1 -- 172.21.15.88:0/2450949945 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6440a9970 con 0x7fd6440a4f90 2023-12-08T08:21:34.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.323+0000 7fd64a93e640 1 -- 172.21.15.88:0/2450949945 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd64414a370 con 0x7fd6440a4f90 2023-12-08T08:21:34.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.323+0000 7fd64a93e640 1 -- 172.21.15.88:0/2450949945 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd64414a890 con 0x7fd6440a4f90 2023-12-08T08:21:34.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.323+0000 7fd640ff9640 1 -- 172.21.15.88:0/2450949945 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd6380b2040 con 0x7fd6440a4f90 2023-12-08T08:21:34.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.323+0000 7fd640ff9640 1 --2- 172.21.15.88:0/2450949945 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd630066470 0x7fd630068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:34.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.323+0000 7fd640ff9640 1 -- 172.21.15.88:0/2450949945 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd63811e0a0 con 0x7fd6440a4f90 2023-12-08T08:21:34.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.323+0000 7fd643fff640 1 --2- 172.21.15.88:0/2450949945 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd630066470 0x7fd630068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:34.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.327+0000 7fd643fff640 1 --2- 172.21.15.88:0/2450949945 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd630066470 0x7fd630068930 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd6340011f0 tx=0x7fd634009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:34.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.327+0000 7fd640ff9640 1 -- 172.21.15.88:0/2450949945 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd64414a890 con 0x7fd6440a4f90 2023-12-08T08:21:34.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.487+0000 7fd64a93e640 1 -- 172.21.15.88:0/2450949945 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd64414a890 con 0x7fd6440a4f90 2023-12-08T08:21:34.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.487+0000 7fd640ff9640 1 -- 172.21.15.88:0/2450949945 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd64414a890 con 0x7fd6440a4f90 2023-12-08T08:21:34.493 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-12-08T08:21:34.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.491+0000 7fd64a93e640 1 -- 172.21.15.88:0/2450949945 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd630066470 msgr2=0x7fd630068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:34.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.491+0000 7fd64a93e640 1 --2- 172.21.15.88:0/2450949945 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd630066470 0x7fd630068930 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd6340011f0 tx=0x7fd634009040 comp rx=0 tx=0).stop 2023-12-08T08:21:34.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.491+0000 7fd64a93e640 1 -- 172.21.15.88:0/2450949945 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6440a4f90 msgr2=0x7fd644151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:34.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.491+0000 7fd64a93e640 1 --2- 172.21.15.88:0/2450949945 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6440a4f90 0x7fd644151e60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd638000c10 tx=0x7fd6380190b0 comp rx=0 tx=0).stop 2023-12-08T08:21:34.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.491+0000 7fd64a93e640 1 -- 172.21.15.88:0/2450949945 shutdown_connections 2023-12-08T08:21:34.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.491+0000 7fd64a93e640 1 --2- 172.21.15.88:0/2450949945 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd630066470 0x7fd630068930 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:34.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.491+0000 7fd64a93e640 1 --2- 172.21.15.88:0/2450949945 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6440a5370 0x7fd644070c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:34.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.491+0000 7fd64a93e640 1 --2- 172.21.15.88:0/2450949945 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6440a4f90 0x7fd644151e60 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:34.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.491+0000 7fd64a93e640 1 --2- 172.21.15.88:0/2450949945 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd644072810 0x7fd6441f0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:34.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.491+0000 7fd64a93e640 1 -- 172.21.15.88:0/2450949945 >> 172.21.15.88:0/2450949945 conn(0x7fd64406b220 msgr2=0x7fd6440c3720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:34.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.491+0000 7fd64a93e640 1 -- 172.21.15.88:0/2450949945 shutdown_connections 2023-12-08T08:21:34.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.491+0000 7fd64a93e640 1 -- 172.21.15.88:0/2450949945 wait complete. 2023-12-08T08:21:34.514 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-08T08:21:34.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:34.514 DEBUG:teuthology.orchestra.run.smithi088:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-08T08:21:34.544 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2023-12-08T08:21:34.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:34.545 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-08T08:21:34.598 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:21:34.598 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:21:34.650 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5383 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-08T08:21:34.650 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:21:34.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.827+0000 7fca7671d640 1 Processor -- start 2023-12-08T08:21:34.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.827+0000 7fca7671d640 1 -- start start 2023-12-08T08:21:34.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.827+0000 7fca7671d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca700af4c0 0x7fca70154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:34.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.827+0000 7fca7671d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fca700c67d0 0x7fca700c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:34.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.827+0000 7fca7671d640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca700c4890 con 0x7fca7006b9f0 2023-12-08T08:21:34.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.827+0000 7fca7671d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca70155460 con 0x7fca700c67d0 2023-12-08T08:21:34.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.827+0000 7fca7671d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca700af8a0 con 0x7fca700af4c0 2023-12-08T08:21:34.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.827+0000 7fca6f7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fca700c67d0 0x7fca700c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:34.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.827+0000 7fca6f7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fca700c67d0 0x7fca700c6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39026/0 (socket says 172.21.15.88:39026) 2023-12-08T08:21:34.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.827+0000 7fca6f7fe640 1 -- 172.21.15.88:0/1286531861 learned_addr learned my addr 172.21.15.88:0/1286531861 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:34.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.827+0000 7fca6ffff640 1 --2- 172.21.15.88:0/1286531861 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca700af4c0 0x7fca70154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:34.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.827+0000 7fca6f7fe640 1 -- 172.21.15.88:0/1286531861 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca700af4c0 msgr2=0x7fca70154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:34.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.827+0000 7fca6f7fe640 1 --2- 172.21.15.88:0/1286531861 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca700af4c0 0x7fca70154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:34.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.827+0000 7fca6f7fe640 1 -- 172.21.15.88:0/1286531861 >> v1:172.21.15.148:6789/0 conn(0x7fca7006b9f0 legacy=0x7fca70157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:34.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.827+0000 7fca6f7fe640 1 -- 172.21.15.88:0/1286531861 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca700c4b30 con 0x7fca700c67d0 2023-12-08T08:21:34.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.831+0000 7fca6f7fe640 1 --2- 172.21.15.88:0/1286531861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca700c67d0 0x7fca700c6c50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fca64009870 tx=0x7fca6401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc51b6b2c0203db2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:34.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.831+0000 7fca6effd640 1 -- 172.21.15.88:0/1286531861 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca640ab680 con 0x7fca700c67d0 2023-12-08T08:21:34.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.831+0000 7fca6effd640 1 -- 172.21.15.88:0/1286531861 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca640ab7e0 con 0x7fca700c67d0 2023-12-08T08:21:34.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.831+0000 7fca6effd640 1 -- 172.21.15.88:0/1286531861 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca640abb70 con 0x7fca700c67d0 2023-12-08T08:21:34.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.831+0000 7fca7671d640 1 -- 172.21.15.88:0/1286531861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca700c67d0 msgr2=0x7fca700c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:34.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.831+0000 7fca7671d640 1 --2- 172.21.15.88:0/1286531861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca700c67d0 0x7fca700c6c50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fca64009870 tx=0x7fca6401c480 comp rx=0 tx=0).stop 2023-12-08T08:21:34.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.831+0000 7fca7671d640 1 -- 172.21.15.88:0/1286531861 shutdown_connections 2023-12-08T08:21:34.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.831+0000 7fca7671d640 1 --2- 172.21.15.88:0/1286531861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca700c67d0 0x7fca700c6c50 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:34.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.831+0000 7fca7671d640 1 --2- 172.21.15.88:0/1286531861 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca700af4c0 0x7fca70154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:34.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.831+0000 7fca7671d640 1 -- 172.21.15.88:0/1286531861 >> 172.21.15.88:0/1286531861 conn(0x7fca700ab9d0 msgr2=0x7fca700abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:34.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.831+0000 7fca7671d640 1 -- 172.21.15.88:0/1286531861 shutdown_connections 2023-12-08T08:21:34.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.831+0000 7fca7671d640 1 -- 172.21.15.88:0/1286531861 wait complete. 2023-12-08T08:21:34.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.835+0000 7fca7671d640 1 Processor -- start 2023-12-08T08:21:34.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.835+0000 7fca7671d640 1 -- start start 2023-12-08T08:21:34.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.835+0000 7fca7671d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca7006b9f0 0x7fca7014fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:34.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.835+0000 7fca7671d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca700af4c0 0x7fca70152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:34.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.835+0000 7fca7671d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca700c67d0 0x7fca70149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:34.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.835+0000 7fca7671d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca701ed6a0 con 0x7fca7006b9f0 2023-12-08T08:21:34.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.835+0000 7fca7671d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca70153e60 con 0x7fca700c67d0 2023-12-08T08:21:34.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.835+0000 7fca7671d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca70153380 con 0x7fca700af4c0 2023-12-08T08:21:34.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.835+0000 7fca6ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca7006b9f0 0x7fca7014fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:34.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.835+0000 7fca6ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca7006b9f0 0x7fca7014fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39028/0 (socket says 172.21.15.88:39028) 2023-12-08T08:21:34.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.835+0000 7fca6ffff640 1 -- 172.21.15.88:0/3337972094 learned_addr learned my addr 172.21.15.88:0/3337972094 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:34.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.835+0000 7fca6f7fe640 1 --2- 172.21.15.88:0/3337972094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca700af4c0 0x7fca70152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:34.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.835+0000 7fca74cba640 1 --2- 172.21.15.88:0/3337972094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca700c67d0 0x7fca70149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:34.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.835+0000 7fca6ffff640 1 -- 172.21.15.88:0/3337972094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca700af4c0 msgr2=0x7fca70152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:34.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.835+0000 7fca6ffff640 1 --2- 172.21.15.88:0/3337972094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca700af4c0 0x7fca70152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:34.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.835+0000 7fca6ffff640 1 -- 172.21.15.88:0/3337972094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca700c67d0 msgr2=0x7fca70149f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:34.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.835+0000 7fca6ffff640 1 --2- 172.21.15.88:0/3337972094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca700c67d0 0x7fca70149f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:34.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.835+0000 7fca6ffff640 1 -- 172.21.15.88:0/3337972094 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca640094d0 con 0x7fca7006b9f0 2023-12-08T08:21:34.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.835+0000 7fca6ffff640 1 --2- 172.21.15.88:0/3337972094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca7006b9f0 0x7fca7014fe80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fca6000d800 tx=0x7fca6000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:34.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.835+0000 7fca6cff9640 1 -- 172.21.15.88:0/3337972094 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6000b6c0 con 0x7fca7006b9f0 2023-12-08T08:21:34.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.835+0000 7fca6cff9640 1 -- 172.21.15.88:0/3337972094 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6000b820 con 0x7fca7006b9f0 2023-12-08T08:21:34.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.835+0000 7fca7671d640 1 -- 172.21.15.88:0/3337972094 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca70153660 con 0x7fca7006b9f0 2023-12-08T08:21:34.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.835+0000 7fca6cff9640 1 -- 172.21.15.88:0/3337972094 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6000bb90 con 0x7fca7006b9f0 2023-12-08T08:21:34.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.835+0000 7fca7671d640 1 -- 172.21.15.88:0/3337972094 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca70153070 con 0x7fca7006b9f0 2023-12-08T08:21:34.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.839+0000 7fca7671d640 1 -- 172.21.15.88:0/3337972094 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca70067630 con 0x7fca7006b9f0 2023-12-08T08:21:34.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.839+0000 7fca6cff9640 1 -- 172.21.15.88:0/3337972094 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fca6000bcf0 con 0x7fca7006b9f0 2023-12-08T08:21:34.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.839+0000 7fca6cff9640 1 --2- 172.21.15.88:0/3337972094 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fca5c066470 0x7fca5c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:34.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.839+0000 7fca6cff9640 1 -- 172.21.15.88:0/3337972094 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fca60084780 con 0x7fca7006b9f0 2023-12-08T08:21:34.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.839+0000 7fca6f7fe640 1 --2- 172.21.15.88:0/3337972094 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fca5c066470 0x7fca5c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:34.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.839+0000 7fca6f7fe640 1 --2- 172.21.15.88:0/3337972094 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fca5c066470 0x7fca5c068930 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fca640af000 tx=0x7fca640a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:34.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:34.843+0000 7fca6cff9640 1 -- 172.21.15.88:0/3337972094 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fca60051890 con 0x7fca7006b9f0 2023-12-08T08:21:35.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:35.027+0000 7fca7671d640 1 -- 172.21.15.88:0/3337972094 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fca7006c7a0 con 0x7fca7006b9f0 2023-12-08T08:21:35.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:35.027+0000 7fca6cff9640 1 -- 172.21.15.88:0/3337972094 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+149 (secure 0 0 0) 0x7fca60011340 con 0x7fca7006b9f0 2023-12-08T08:21:35.031 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:21:35.031 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-08T08:21:35.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:35.027+0000 7fca7671d640 1 -- 172.21.15.88:0/3337972094 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fca5c066470 msgr2=0x7fca5c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:35.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:35.027+0000 7fca7671d640 1 --2- 172.21.15.88:0/3337972094 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fca5c066470 0x7fca5c068930 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fca640af000 tx=0x7fca640a7000 comp rx=0 tx=0).stop 2023-12-08T08:21:35.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:35.027+0000 7fca7671d640 1 -- 172.21.15.88:0/3337972094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca7006b9f0 msgr2=0x7fca7014fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:35.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:35.027+0000 7fca7671d640 1 --2- 172.21.15.88:0/3337972094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca7006b9f0 0x7fca7014fe80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fca6000d800 tx=0x7fca6000dcc0 comp rx=0 tx=0).stop 2023-12-08T08:21:35.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:35.027+0000 7fca7671d640 1 -- 172.21.15.88:0/3337972094 shutdown_connections 2023-12-08T08:21:35.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:35.027+0000 7fca7671d640 1 --2- 172.21.15.88:0/3337972094 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fca5c066470 0x7fca5c068930 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:35.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:35.027+0000 7fca7671d640 1 --2- 172.21.15.88:0/3337972094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca700c67d0 0x7fca70149f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:35.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:35.027+0000 7fca7671d640 1 --2- 172.21.15.88:0/3337972094 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca700af4c0 0x7fca70152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:35.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:35.027+0000 7fca7671d640 1 --2- 172.21.15.88:0/3337972094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca7006b9f0 0x7fca7014fe80 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:35.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:35.027+0000 7fca7671d640 1 -- 172.21.15.88:0/3337972094 >> 172.21.15.88:0/3337972094 conn(0x7fca700ab9d0 msgr2=0x7fca70157a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:35.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:35.027+0000 7fca7671d640 1 -- 172.21.15.88:0/3337972094 shutdown_connections 2023-12-08T08:21:35.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:35.027+0000 7fca7671d640 1 -- 172.21.15.88:0/3337972094 wait complete. 2023-12-08T08:21:35.052 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-08T08:21:35.052 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:21:35.052 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2023-12-08T08:21:35.052 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-08T08:21:35.052 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T08:21:35.052 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-08T08:21:35.052 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-08T08:21:35.052 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.n6LyuSOFeg 2023-12-08T08:21:35.052 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2023-12-08T08:21:35.061 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.dJTbk9zWdk 2023-12-08T08:21:35.061 DEBUG:teuthology.orchestra.run.smithi088:> sudo cp /tmp/tmp.n6LyuSOFeg /tmp/tmp.dJTbk9zWdk 2023-12-08T08:21:35.125 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.dJTbk9zWdk 2023-12-08T08:21:35.245 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.dJTbk9zWdk is 185B 2023-12-08T08:21:35.261 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.dJTbk9zWdk 2023-12-08T08:21:35.269 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQAL0nJlCYBrORAAC4ib+QAXhveVa/QJJs6Srw== caps mds = "allow rw fsname=cephfs" caps mon = "allow r fsname=cephfs" caps osd = "allow rw tag cephfs data=cephfs" 2023-12-08T08:21:35.269 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:21:35.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:35.269 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2023-12-08T08:21:35.318 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:21:35.318 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:21:35.318 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:21:35.319 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:35.319 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-12-08T08:21:35.319 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:35.319 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:21:35.319 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:21:35.319 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2023-12-08T08:21:35.319 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:21:35.319 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:21:35.319 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2023-12-08T08:21:35.319 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:21:35.319 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2023-12-08T08:21:35.319 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:21:35.319 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2023-12-08T08:21:35.319 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-08T08:21:35.319 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42363sec preferred_lft 42363sec 2023-12-08T08:21:35.320 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2023-12-08T08:21:35.320 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:35.320 INFO:teuthology.orchestra.run.smithi088.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-08T08:21:35.320 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 02:42:cd:51:97:e3 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:21:35.320 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-08T08:21:35.320 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:35.320 INFO:teuthology.orchestra.run.smithi088.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:21:35.320 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-08T08:21:35.320 INFO:teuthology.orchestra.run.smithi088.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:21:35.320 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:35.320 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-08T08:21:35.320 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:35.320 INFO:teuthology.orchestra.run.smithi088.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:21:35.320 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:21:35.320 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-08T08:21:35.321 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:21:35.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:35.321 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:21:35.379 INFO:teuthology.orchestra.run.smithi088.stdout:1 2023-12-08T08:21:35.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:35.381 DEBUG:teuthology.orchestra.run.smithi088:> route 2023-12-08T08:21:35.441 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2023-12-08T08:21:35.441 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:21:35.441 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-08T08:21:35.441 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-08T08:21:35.441 INFO:teuthology.orchestra.run.smithi088.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-08T08:21:35.442 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-08T08:21:35.442 INFO:teuthology.orchestra.run.smithi088.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:21:35.442 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:21:35.442 INFO:teuthology.orchestra.run.smithi088.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:21:35.442 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:21:35.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:35.442 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-12-08T08:21:35.442 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-12-08T08:21:35.442 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-08T08:21:35.442 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-08T08:21:35.443 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-08T08:21:35.443 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-12-08T08:21:35.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:35.537 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-12-08T08:21:35.548 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-08T08:21:35.548 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:21:35.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:35.548 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2023-12-08T08:21:35.610 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:21:35.610 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-08T08:21:35.662 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:21:35.662 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:21:35.666 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:21:35.713 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:21:35.713 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/tmp/tmp.n6LyuSOFeg of=/dev/stdout 2023-12-08T08:21:35.762 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-12-08T08:21:35.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:35.762 DEBUG:teuthology.orchestra.run.smithi088:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQAL0nJlCYBrORAAC4ib+QAXhveVa/QJJs6Srw==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:21:35.855 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,secret=AQAL0nJlCYBrORAAC4ib+QAXhveVa/QJJs6Srw==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:21:35.855 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:21:35.855 INFO:teuthology.orchestra.run.smithi088.stdout:keyring.get_secret failed 2023-12-08T08:21:35.865 INFO:teuthology.orchestra.run.smithi088.stderr:mount.ceph: kernel BUG! 2023-12-08T08:21:35.865 INFO:teuthology.orchestra.run.smithi088.stderr:mount error: no mds server is up or the cluster is laggy 2023-12-08T08:21:35.866 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,secret=AQAL0nJlCYBrORAAC4ib+QAXhveVa/QJJs6Srw==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:21:35.867 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:21:35.867 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-12-08T08:21:35.867 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: trying mount with new device syntax: testuser@681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3.cephfs2=/ 2023-12-08T08:21:35.867 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.88:3300/172.21.15.148:3300/172.21.15.148:3301" will pass to kernel 2023-12-08T08:21:35.870 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-08T08:21:35.870 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-12-08T08:21:35.870 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-08T08:21:35.871 DEBUG:teuthology.orchestra.run.smithi088:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:21:35.996 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:21:36.081 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-08T08:21:36.081 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:21:36.081 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:21:36.091 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5383 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-08T08:21:36.091 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:21:36.091 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:21:36.101 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:21:36.101 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:21:36.155 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:21:36.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.287+0000 7f7da58c9640 1 Processor -- start 2023-12-08T08:21:36.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.287+0000 7f7da58c9640 1 -- start start 2023-12-08T08:21:36.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.291+0000 7f7da58c9640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7da0154fd0 0x7f7da01584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:36.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.291+0000 7f7da58c9640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7da00ca190 0x7f7da00ca600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:36.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.291+0000 7f7da58c9640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7da00c5140 con 0x7f7da014e570 2023-12-08T08:21:36.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.291+0000 7f7da58c9640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7da00c4b80 con 0x7f7da00ca190 2023-12-08T08:21:36.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.291+0000 7f7da58c9640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da00c4e60 con 0x7f7da0154fd0 2023-12-08T08:21:36.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.291+0000 7f7d9f7fe640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7da00ca190 0x7f7da00ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:36.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.291+0000 7f7d97fff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7da0154fd0 0x7f7da01584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:36.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.291+0000 7f7d97fff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7da0154fd0 0x7f7da01584e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:34316/0 (socket says 172.21.15.88:34316) 2023-12-08T08:21:36.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.291+0000 7f7d97fff640 1 -- 172.21.15.88:0/4187417852 learned_addr learned my addr 172.21.15.88:0/4187417852 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:36.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.291+0000 7f7d97fff640 1 -- 172.21.15.88:0/4187417852 >> v2:172.21.15.148:3300/0 conn(0x7f7da00ca190 msgr2=0x7f7da00ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:36.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.291+0000 7f7d97fff640 1 --2- 172.21.15.88:0/4187417852 >> v2:172.21.15.148:3300/0 conn(0x7f7da00ca190 0x7f7da00ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:36.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.291+0000 7f7d97fff640 1 -- 172.21.15.88:0/4187417852 >> v1:172.21.15.148:6789/0 conn(0x7f7da014e570 legacy=0x7f7da00c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:36.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.291+0000 7f7d97fff640 1 -- 172.21.15.88:0/4187417852 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da0157ce0 con 0x7f7da0154fd0 2023-12-08T08:21:36.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.291+0000 7f7d9e7fc640 1 -- 172.21.15.88:0/4187417852 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827174368 0 0) 0x7f7da00c5140 con 0x7f7da014e570 2023-12-08T08:21:36.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.295+0000 7f7d97fff640 1 --2- 172.21.15.88:0/4187417852 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7da0154fd0 0x7f7da01584e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7d88009870 tx=0x7f7d8801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3958416cbcfe6ea1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:36.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.295+0000 7f7d9e7fc640 1 -- 172.21.15.88:0/4187417852 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d880a6040 con 0x7f7da0154fd0 2023-12-08T08:21:36.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.295+0000 7f7d9e7fc640 1 -- 172.21.15.88:0/4187417852 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d880aa600 con 0x7f7da0154fd0 2023-12-08T08:21:36.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.295+0000 7f7d9e7fc640 1 -- 172.21.15.88:0/4187417852 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d880aa990 con 0x7f7da0154fd0 2023-12-08T08:21:36.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.295+0000 7f7da58c9640 1 -- 172.21.15.88:0/4187417852 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7da0154fd0 msgr2=0x7f7da01584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:36.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.295+0000 7f7da58c9640 1 --2- 172.21.15.88:0/4187417852 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7da0154fd0 0x7f7da01584e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7d88009870 tx=0x7f7d8801c480 comp rx=0 tx=0).stop 2023-12-08T08:21:36.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.295+0000 7f7da58c9640 1 -- 172.21.15.88:0/4187417852 shutdown_connections 2023-12-08T08:21:36.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.295+0000 7f7da58c9640 1 --2- 172.21.15.88:0/4187417852 >> v2:172.21.15.148:3300/0 conn(0x7f7da00ca190 0x7f7da00ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:36.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.295+0000 7f7da58c9640 1 --2- 172.21.15.88:0/4187417852 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7da0154fd0 0x7f7da01584e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:36.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.295+0000 7f7da58c9640 1 -- 172.21.15.88:0/4187417852 >> 172.21.15.88:0/4187417852 conn(0x7f7da00abb10 msgr2=0x7f7da00abf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:36.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.295+0000 7f7da58c9640 1 -- 172.21.15.88:0/4187417852 shutdown_connections 2023-12-08T08:21:36.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.295+0000 7f7da58c9640 1 -- 172.21.15.88:0/4187417852 wait complete. 2023-12-08T08:21:36.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.295+0000 7f7da58c9640 1 Processor -- start 2023-12-08T08:21:36.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.295+0000 7f7da58c9640 1 -- start start 2023-12-08T08:21:36.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.299+0000 7f7da58c9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7da00ca190 0x7f7da01536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:36.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.299+0000 7f7da58c9640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7da014e570 0x7f7da0153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:36.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.299+0000 7f7da58c9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7da0154fd0 0x7f7da014b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:36.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.299+0000 7f7da58c9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da0157a90 con 0x7f7da00ca190 2023-12-08T08:21:36.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.299+0000 7f7da58c9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da01577b0 con 0x7f7da0154fd0 2023-12-08T08:21:36.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.299+0000 7f7da58c9640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da014a6d0 con 0x7f7da014e570 2023-12-08T08:21:36.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.299+0000 7f7d9effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7da00ca190 0x7f7da01536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:36.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.299+0000 7f7d9effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7da00ca190 0x7f7da01536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39040/0 (socket says 172.21.15.88:39040) 2023-12-08T08:21:36.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.299+0000 7f7d9effd640 1 -- 172.21.15.88:0/4206658467 learned_addr learned my addr 172.21.15.88:0/4206658467 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:36.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.299+0000 7f7d97fff640 1 --2- 172.21.15.88:0/4206658467 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7da014e570 0x7f7da0153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:36.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.299+0000 7f7d9f7fe640 1 --2- 172.21.15.88:0/4206658467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7da0154fd0 0x7f7da014b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:36.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.299+0000 7f7d9effd640 1 -- 172.21.15.88:0/4206658467 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7da014e570 msgr2=0x7f7da0153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:36.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.299+0000 7f7d9effd640 1 --2- 172.21.15.88:0/4206658467 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7da014e570 0x7f7da0153c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:36.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.299+0000 7f7d9effd640 1 -- 172.21.15.88:0/4206658467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7da0154fd0 msgr2=0x7f7da014b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:36.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.299+0000 7f7d9effd640 1 --2- 172.21.15.88:0/4206658467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7da0154fd0 0x7f7da014b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:36.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.299+0000 7f7d9effd640 1 -- 172.21.15.88:0/4206658467 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d880094d0 con 0x7f7da00ca190 2023-12-08T08:21:36.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.299+0000 7f7d9f7fe640 1 --2- 172.21.15.88:0/4206658467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7da0154fd0 0x7f7da014b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:36.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.299+0000 7f7d9effd640 1 --2- 172.21.15.88:0/4206658467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7da00ca190 0x7f7da01536f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000c3f0 tx=0x7f7d9000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:36.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.299+0000 7f7d9cff9640 1 -- 172.21.15.88:0/4206658467 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d900052d0 con 0x7f7da00ca190 2023-12-08T08:21:36.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.299+0000 7f7d9cff9640 1 -- 172.21.15.88:0/4206658467 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d90005450 con 0x7f7da00ca190 2023-12-08T08:21:36.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.299+0000 7f7d9cff9640 1 -- 172.21.15.88:0/4206658467 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d90003860 con 0x7f7da00ca190 2023-12-08T08:21:36.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.299+0000 7f7da58c9640 1 -- 172.21.15.88:0/4206658467 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da014a9b0 con 0x7f7da00ca190 2023-12-08T08:21:36.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.299+0000 7f7da58c9640 1 -- 172.21.15.88:0/4206658467 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da01573f0 con 0x7f7da00ca190 2023-12-08T08:21:36.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.299+0000 7f7da58c9640 1 -- 172.21.15.88:0/4206658467 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da006c830 con 0x7f7da00ca190 2023-12-08T08:21:36.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.299+0000 7f7d9cff9640 1 -- 172.21.15.88:0/4206658467 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7d900039c0 con 0x7f7da00ca190 2023-12-08T08:21:36.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.303+0000 7f7d9cff9640 1 --2- 172.21.15.88:0/4206658467 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7d80066470 0x7f7d80068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:36.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.303+0000 7f7d9cff9640 1 -- 172.21.15.88:0/4206658467 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7d90083750 con 0x7f7da00ca190 2023-12-08T08:21:36.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.303+0000 7f7d97fff640 1 --2- 172.21.15.88:0/4206658467 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7d80066470 0x7f7d80068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:36.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.303+0000 7f7d97fff640 1 --2- 172.21.15.88:0/4206658467 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7d80066470 0x7f7d80068930 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7d880ae000 tx=0x7f7d880b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:36.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.307+0000 7f7d9cff9640 1 -- 172.21.15.88:0/4206658467 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7d90050910 con 0x7f7da00ca190 2023-12-08T08:21:36.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.455+0000 7f7da58c9640 1 -- 172.21.15.88:0/4206658467 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7da015eb10 con 0x7f7da00ca190 2023-12-08T08:21:36.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.459+0000 7f7d9cff9640 1 -- 172.21.15.88:0/4206658467 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20205 (secure 0 0 0) 0x7f7d90053f30 con 0x7f7da00ca190 2023-12-08T08:21:36.462 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:36.462 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":35,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:21:19.666744+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:21:03.690721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-08T08:21:04.127786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:21:16.039054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:21:17.029894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:21:36.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.459+0000 7f7da58c9640 1 -- 172.21.15.88:0/4206658467 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7d80066470 msgr2=0x7f7d80068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:36.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.459+0000 7f7da58c9640 1 --2- 172.21.15.88:0/4206658467 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7d80066470 0x7f7d80068930 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7d880ae000 tx=0x7f7d880b5040 comp rx=0 tx=0).stop 2023-12-08T08:21:36.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.459+0000 7f7da58c9640 1 -- 172.21.15.88:0/4206658467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7da00ca190 msgr2=0x7f7da01536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:36.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.459+0000 7f7da58c9640 1 --2- 172.21.15.88:0/4206658467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7da00ca190 0x7f7da01536f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000c3f0 tx=0x7f7d9000c8b0 comp rx=0 tx=0).stop 2023-12-08T08:21:36.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.459+0000 7f7da58c9640 1 -- 172.21.15.88:0/4206658467 shutdown_connections 2023-12-08T08:21:36.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.459+0000 7f7da58c9640 1 --2- 172.21.15.88:0/4206658467 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7d80066470 0x7f7d80068930 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:36.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.459+0000 7f7da58c9640 1 --2- 172.21.15.88:0/4206658467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7da0154fd0 0x7f7da014b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:36.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.459+0000 7f7da58c9640 1 --2- 172.21.15.88:0/4206658467 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7da014e570 0x7f7da0153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:36.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.459+0000 7f7da58c9640 1 --2- 172.21.15.88:0/4206658467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7da00ca190 0x7f7da01536f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:36.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.459+0000 7f7da58c9640 1 -- 172.21.15.88:0/4206658467 >> 172.21.15.88:0/4206658467 conn(0x7f7da00abb10 msgr2=0x7f7da00abef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:36.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.459+0000 7f7da58c9640 1 -- 172.21.15.88:0/4206658467 shutdown_connections 2023-12-08T08:21:36.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.459+0000 7f7da58c9640 1 -- 172.21.15.88:0/4206658467 wait complete. 2023-12-08T08:21:36.483 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:21:03.690721+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:21:04.127786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:21:16.039054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:21:17.029894+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:21:36.483 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:21:36.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa19bf8640 1 Processor -- start 2023-12-08T08:21:36.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa19bf8640 1 -- start start 2023-12-08T08:21:36.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa19bf8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa140bf2d0 0x7faa14151970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:36.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa19bf8640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faa140c6030 0x7faa14151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:36.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa19bf8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa14158780 con 0x7faa140c98f0 2023-12-08T08:21:36.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa19bf8640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa140c0300 con 0x7faa140c6030 2023-12-08T08:21:36.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa19bf8640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa14157b70 con 0x7faa140bf2d0 2023-12-08T08:21:36.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa13fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7faa140c98f0 0x7faa140c7cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57576/0 (socket says 172.21.15.88:57576) 2023-12-08T08:21:36.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa13fff640 1 -- 172.21.15.88:0/1711993129 learned_addr learned my addr 172.21.15.88:0/1711993129 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:36.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa127fc640 1 -- 172.21.15.88:0/1711993129 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3133162090 0 0) 0x7faa14158780 con 0x7faa140c98f0 2023-12-08T08:21:36.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa127fc640 1 -- 172.21.15.88:0/1711993129 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9fc003530 con 0x7faa140c98f0 2023-12-08T08:21:36.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa12ffd640 1 --2- 172.21.15.88:0/1711993129 >> v2:172.21.15.148:3300/0 conn(0x7faa140c6030 0x7faa14151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:36.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa137fe640 1 --2- 172.21.15.88:0/1711993129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa140bf2d0 0x7faa14151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:36.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa127fc640 1 -- 172.21.15.88:0/1711993129 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1004457485 0 0) 0x7fa9fc003530 con 0x7faa140c98f0 2023-12-08T08:21:36.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa127fc640 1 -- 172.21.15.88:0/1711993129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa140bf2d0 msgr2=0x7faa14151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:36.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa127fc640 1 --2- 172.21.15.88:0/1711993129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa140bf2d0 0x7faa14151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:36.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa127fc640 1 -- 172.21.15.88:0/1711993129 >> v2:172.21.15.148:3300/0 conn(0x7faa140c6030 msgr2=0x7faa14151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:36.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa127fc640 1 --2- 172.21.15.88:0/1711993129 >> v2:172.21.15.148:3300/0 conn(0x7faa140c6030 0x7faa14151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:36.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa127fc640 1 -- 172.21.15.88:0/1711993129 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa14157e50 con 0x7faa140c98f0 2023-12-08T08:21:36.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa127fc640 1 -- 172.21.15.88:0/1711993129 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7faa0c001a00 con 0x7faa140c98f0 2023-12-08T08:21:36.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa12ffd640 1 --2- 172.21.15.88:0/1711993129 >> v2:172.21.15.148:3300/0 conn(0x7faa140c6030 0x7faa14151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:36.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa137fe640 1 --2- 172.21.15.88:0/1711993129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa140bf2d0 0x7faa14151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:36.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa127fc640 1 -- 172.21.15.88:0/1711993129 >> v1:172.21.15.88:6789/0 conn(0x7faa140c98f0 legacy=0x7faa140c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:36.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa127fc640 1 --2- 172.21.15.88:0/1711993129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa140bf2d0 0x7fa9fc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:36.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa127fc640 1 --2- 172.21.15.88:0/1711993129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9fc003f70 0x7fa9fc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:36.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa127fc640 1 --2- 172.21.15.88:0/1711993129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9fc004d10 0x7fa9fc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:36.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa127fc640 1 -- 172.21.15.88:0/1711993129 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa14157b70 con 0x7fa9fc003f70 2023-12-08T08:21:36.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa127fc640 1 -- 172.21.15.88:0/1711993129 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc00b9f0 con 0x7fa9fc004d10 2023-12-08T08:21:36.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.619+0000 7faa127fc640 1 -- 172.21.15.88:0/1711993129 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc00bbb0 con 0x7faa140bf2d0 2023-12-08T08:21:36.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.623+0000 7faa12ffd640 1 --2- 172.21.15.88:0/1711993129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9fc003f70 0x7fa9fc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:36.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.623+0000 7faa13fff640 1 --2- 172.21.15.88:0/1711993129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9fc004d10 0x7fa9fc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:36.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.623+0000 7faa137fe640 1 --2- 172.21.15.88:0/1711993129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa140bf2d0 0x7fa9fc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:36.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.623+0000 7faa12ffd640 1 -- 172.21.15.88:0/1711993129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa140bf2d0 msgr2=0x7fa9fc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:36.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.623+0000 7faa12ffd640 1 --2- 172.21.15.88:0/1711993129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa140bf2d0 0x7fa9fc003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:36.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.623+0000 7faa12ffd640 1 -- 172.21.15.88:0/1711993129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9fc004d10 msgr2=0x7fa9fc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:36.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.623+0000 7faa12ffd640 1 --2- 172.21.15.88:0/1711993129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9fc004d10 0x7fa9fc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:36.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.623+0000 7faa12ffd640 1 -- 172.21.15.88:0/1711993129 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9fc003530 con 0x7fa9fc003f70 2023-12-08T08:21:36.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.623+0000 7faa13fff640 1 --2- 172.21.15.88:0/1711993129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9fc004d10 0x7fa9fc005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:36.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.623+0000 7faa12ffd640 1 --2- 172.21.15.88:0/1711993129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9fc003f70 0x7fa9fc0047d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7faa080098d0 tx=0x7faa0801c630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef46fc08fd813d2d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:36.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.623+0000 7faa127fc640 1 -- 172.21.15.88:0/1711993129 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa080a6640 con 0x7fa9fc003f70 2023-12-08T08:21:36.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.623+0000 7faa127fc640 1 -- 172.21.15.88:0/1711993129 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa080a67a0 con 0x7fa9fc003f70 2023-12-08T08:21:36.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.623+0000 7faa127fc640 1 -- 172.21.15.88:0/1711993129 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa080a6b10 con 0x7fa9fc003f70 2023-12-08T08:21:36.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.627+0000 7faa19bf8640 1 -- 172.21.15.88:0/1711993129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9fc003f70 msgr2=0x7fa9fc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:36.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.627+0000 7faa19bf8640 1 --2- 172.21.15.88:0/1711993129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9fc003f70 0x7fa9fc0047d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7faa080098d0 tx=0x7faa0801c630 comp rx=0 tx=0).stop 2023-12-08T08:21:36.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.627+0000 7faa13fff640 1 -- 172.21.15.88:0/1711993129 reap_dead start 2023-12-08T08:21:36.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.627+0000 7faa19bf8640 1 -- 172.21.15.88:0/1711993129 shutdown_connections 2023-12-08T08:21:36.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.627+0000 7faa19bf8640 1 -- 172.21.15.88:0/1711993129 >> 172.21.15.88:0/1711993129 conn(0x7faa140c9dc0 msgr2=0x7faa140ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:36.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.627+0000 7faa19bf8640 1 -- 172.21.15.88:0/1711993129 shutdown_connections 2023-12-08T08:21:36.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.627+0000 7faa19bf8640 1 -- 172.21.15.88:0/1711993129 wait complete. 2023-12-08T08:21:36.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.627+0000 7faa19bf8640 1 Processor -- start 2023-12-08T08:21:36.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.627+0000 7faa19bf8640 1 -- start start 2023-12-08T08:21:36.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.627+0000 7faa19bf8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9fc003f70 0x7faa140ad650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:36.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.627+0000 7faa19bf8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa1414ced0 0x7faa140aab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:36.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.627+0000 7faa19bf8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa140adf50 0x7faa1414bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:36.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.627+0000 7faa19bf8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa140adb90 con 0x7fa9fc003f70 2023-12-08T08:21:36.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.627+0000 7faa19bf8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa141e99d0 con 0x7faa1414ced0 2023-12-08T08:21:36.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.627+0000 7faa19bf8640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1414b4a0 con 0x7faa140adf50 2023-12-08T08:21:36.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.627+0000 7faa137fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9fc003f70 0x7faa140ad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:36.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.627+0000 7faa137fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9fc003f70 0x7faa140ad650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39060/0 (socket says 172.21.15.88:39060) 2023-12-08T08:21:36.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.627+0000 7faa137fe640 1 -- 172.21.15.88:0/692600927 learned_addr learned my addr 172.21.15.88:0/692600927 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:36.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.627+0000 7faa13fff640 1 --2- 172.21.15.88:0/692600927 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa140adf50 0x7faa1414bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:36.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.627+0000 7faa12ffd640 1 --2- 172.21.15.88:0/692600927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa1414ced0 0x7faa140aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:36.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.627+0000 7faa137fe640 1 -- 172.21.15.88:0/692600927 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa140adf50 msgr2=0x7faa1414bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:36.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.627+0000 7faa137fe640 1 --2- 172.21.15.88:0/692600927 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa140adf50 0x7faa1414bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:36.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.627+0000 7faa137fe640 1 -- 172.21.15.88:0/692600927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa1414ced0 msgr2=0x7faa140aab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:36.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.627+0000 7faa137fe640 1 --2- 172.21.15.88:0/692600927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa1414ced0 0x7faa140aab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:36.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.627+0000 7faa137fe640 1 -- 172.21.15.88:0/692600927 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1414b780 con 0x7fa9fc003f70 2023-12-08T08:21:36.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.627+0000 7faa13fff640 1 --2- 172.21.15.88:0/692600927 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa140adf50 0x7faa1414bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:36.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.627+0000 7faa12ffd640 1 --2- 172.21.15.88:0/692600927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa1414ced0 0x7faa140aab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:36.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.631+0000 7faa137fe640 1 --2- 172.21.15.88:0/692600927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9fc003f70 0x7faa140ad650 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7faa04010890 tx=0x7faa04010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:36.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.631+0000 7fa9fbfff640 1 -- 172.21.15.88:0/692600927 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0400cb40 con 0x7fa9fc003f70 2023-12-08T08:21:36.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.631+0000 7fa9fbfff640 1 -- 172.21.15.88:0/692600927 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0400cca0 con 0x7fa9fc003f70 2023-12-08T08:21:36.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.631+0000 7faa19bf8640 1 -- 172.21.15.88:0/692600927 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa1414ba60 con 0x7fa9fc003f70 2023-12-08T08:21:36.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.631+0000 7fa9fbfff640 1 -- 172.21.15.88:0/692600927 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa040156b0 con 0x7fa9fc003f70 2023-12-08T08:21:36.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.631+0000 7faa19bf8640 1 -- 172.21.15.88:0/692600927 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa14157510 con 0x7fa9fc003f70 2023-12-08T08:21:36.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.631+0000 7faa19bf8640 1 -- 172.21.15.88:0/692600927 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa1414b300 con 0x7fa9fc003f70 2023-12-08T08:21:36.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.631+0000 7fa9fbfff640 1 -- 172.21.15.88:0/692600927 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faa04015810 con 0x7fa9fc003f70 2023-12-08T08:21:36.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.631+0000 7fa9fbfff640 1 --2- 172.21.15.88:0/692600927 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faa000664a0 0x7faa00068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:36.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.631+0000 7fa9fbfff640 1 -- 172.21.15.88:0/692600927 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7faa040849f0 con 0x7fa9fc003f70 2023-12-08T08:21:36.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.631+0000 7faa12ffd640 1 --2- 172.21.15.88:0/692600927 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faa000664a0 0x7faa00068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:36.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.635+0000 7faa12ffd640 1 --2- 172.21.15.88:0/692600927 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faa000664a0 0x7faa00068960 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7faa080ae000 tx=0x7faa080046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:36.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.635+0000 7fa9fbfff640 1 -- 172.21.15.88:0/692600927 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faa1414b300 con 0x7fa9fc003f70 2023-12-08T08:21:36.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.791+0000 7faa19bf8640 1 -- 172.21.15.88:0/692600927 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faa1414b300 con 0x7fa9fc003f70 2023-12-08T08:21:36.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.791+0000 7fa9fbfff640 1 -- 172.21.15.88:0/692600927 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7faa1414b300 con 0x7fa9fc003f70 2023-12-08T08:21:36.795 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:21:36.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.791+0000 7faa19bf8640 1 -- 172.21.15.88:0/692600927 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faa000664a0 msgr2=0x7faa00068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:36.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.791+0000 7faa19bf8640 1 --2- 172.21.15.88:0/692600927 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faa000664a0 0x7faa00068960 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7faa080ae000 tx=0x7faa080046d0 comp rx=0 tx=0).stop 2023-12-08T08:21:36.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.791+0000 7faa19bf8640 1 -- 172.21.15.88:0/692600927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9fc003f70 msgr2=0x7faa140ad650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:36.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.791+0000 7faa19bf8640 1 --2- 172.21.15.88:0/692600927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9fc003f70 0x7faa140ad650 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7faa04010890 tx=0x7faa04010d50 comp rx=0 tx=0).stop 2023-12-08T08:21:36.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.791+0000 7faa19bf8640 1 -- 172.21.15.88:0/692600927 shutdown_connections 2023-12-08T08:21:36.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.791+0000 7faa19bf8640 1 --2- 172.21.15.88:0/692600927 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faa000664a0 0x7faa00068960 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:36.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.791+0000 7faa19bf8640 1 --2- 172.21.15.88:0/692600927 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa140adf50 0x7faa1414bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:36.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.791+0000 7faa19bf8640 1 --2- 172.21.15.88:0/692600927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa1414ced0 0x7faa140aab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:36.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.791+0000 7faa19bf8640 1 --2- 172.21.15.88:0/692600927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9fc003f70 0x7faa140ad650 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:36.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.791+0000 7faa19bf8640 1 -- 172.21.15.88:0/692600927 >> 172.21.15.88:0/692600927 conn(0x7faa140c9dc0 msgr2=0x7faa1414d420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:36.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.791+0000 7faa19bf8640 1 -- 172.21.15.88:0/692600927 shutdown_connections 2023-12-08T08:21:36.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.791+0000 7faa19bf8640 1 -- 172.21.15.88:0/692600927 wait complete. 2023-12-08T08:21:36.815 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:21:36.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.951+0000 7fbe04ff8640 1 Processor -- start 2023-12-08T08:21:36.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.951+0000 7fbe04ff8640 1 -- start start 2023-12-08T08:21:36.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.955+0000 7fbe04ff8640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbe00151db0 0x7fbe000a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:36.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.955+0000 7fbe04ff8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe000c4a20 0x7fbe000c14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:36.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.955+0000 7fbe04ff8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe000a65d0 con 0x7fbe000c19e0 2023-12-08T08:21:36.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.955+0000 7fbe04ff8640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe00154570 con 0x7fbe00151db0 2023-12-08T08:21:36.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.955+0000 7fbe04ff8640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe00155520 con 0x7fbe000c4a20 2023-12-08T08:21:36.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.955+0000 7fbdfed9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbe000c19e0 0x7fbe00157b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57586/0 (socket says 172.21.15.88:57586) 2023-12-08T08:21:36.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.955+0000 7fbdfed9d640 1 -- 172.21.15.88:0/572613666 learned_addr learned my addr 172.21.15.88:0/572613666 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:36.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.955+0000 7fbdfdd9b640 1 --2- 172.21.15.88:0/572613666 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe000c4a20 0x7fbe000c14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:36.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.955+0000 7fbdfe59c640 1 --2- 172.21.15.88:0/572613666 >> v2:172.21.15.148:3300/0 conn(0x7fbe00151db0 0x7fbe000a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:36.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.955+0000 7fbdfd59a640 1 -- 172.21.15.88:0/572613666 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993972725 0 0) 0x7fbe000a65d0 con 0x7fbe000c19e0 2023-12-08T08:21:36.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.955+0000 7fbdfd59a640 1 -- 172.21.15.88:0/572613666 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbde8003530 con 0x7fbe000c19e0 2023-12-08T08:21:36.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.955+0000 7fbdfd59a640 1 -- 172.21.15.88:0/572613666 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 856672401 0 0) 0x7fbde8003530 con 0x7fbe000c19e0 2023-12-08T08:21:36.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.955+0000 7fbdfe59c640 1 -- 172.21.15.88:0/572613666 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe000c4a20 msgr2=0x7fbe000c14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:36.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.955+0000 7fbdfe59c640 1 --2- 172.21.15.88:0/572613666 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe000c4a20 0x7fbe000c14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:36.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.955+0000 7fbdfe59c640 1 -- 172.21.15.88:0/572613666 >> v1:172.21.15.88:6789/0 conn(0x7fbe000c19e0 legacy=0x7fbe00157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:36.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.955+0000 7fbdfe59c640 1 -- 172.21.15.88:0/572613666 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe00154780 con 0x7fbe00151db0 2023-12-08T08:21:36.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.955+0000 7fbdfdd9b640 1 --2- 172.21.15.88:0/572613666 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe000c4a20 0x7fbe000c14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:21:36.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.959+0000 7fbdfe59c640 1 --2- 172.21.15.88:0/572613666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe00151db0 0x7fbe000a5f40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbdf00097c0 tx=0x7fbdf001c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=815e91e6ca01705f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:36.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.959+0000 7fbdfd59a640 1 -- 172.21.15.88:0/572613666 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8001a00 con 0x7fbe00151db0 2023-12-08T08:21:36.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.959+0000 7fbdfd59a640 1 -- 172.21.15.88:0/572613666 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf00a7050 con 0x7fbe00151db0 2023-12-08T08:21:36.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.959+0000 7fbdfd59a640 1 -- 172.21.15.88:0/572613666 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf00ab620 con 0x7fbe00151db0 2023-12-08T08:21:36.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.959+0000 7fbe04ff8640 1 -- 172.21.15.88:0/572613666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe00151db0 msgr2=0x7fbe000a5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:36.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.959+0000 7fbe04ff8640 1 --2- 172.21.15.88:0/572613666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe00151db0 0x7fbe000a5f40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbdf00097c0 tx=0x7fbdf001c310 comp rx=0 tx=0).stop 2023-12-08T08:21:36.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.959+0000 7fbe04ff8640 1 -- 172.21.15.88:0/572613666 shutdown_connections 2023-12-08T08:21:36.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.959+0000 7fbe04ff8640 1 --2- 172.21.15.88:0/572613666 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe000c4a20 0x7fbe000c14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:36.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.959+0000 7fbe04ff8640 1 --2- 172.21.15.88:0/572613666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe00151db0 0x7fbe000a5f40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:36.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.959+0000 7fbe04ff8640 1 -- 172.21.15.88:0/572613666 >> 172.21.15.88:0/572613666 conn(0x7fbe000c6b20 msgr2=0x7fbe000c6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:36.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.959+0000 7fbe04ff8640 1 -- 172.21.15.88:0/572613666 shutdown_connections 2023-12-08T08:21:36.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.959+0000 7fbe04ff8640 1 -- 172.21.15.88:0/572613666 wait complete. 2023-12-08T08:21:36.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.959+0000 7fbe04ff8640 1 Processor -- start 2023-12-08T08:21:36.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.959+0000 7fbe04ff8640 1 -- start start 2023-12-08T08:21:36.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.959+0000 7fbe04ff8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe000c19e0 0x7fbe0014e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:36.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.959+0000 7fbe04ff8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe000c4a20 0x7fbe00071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:36.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.959+0000 7fbe04ff8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe00151db0 0x7fbe00156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:36.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.959+0000 7fbe04ff8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe001f0e90 con 0x7fbe000c4a20 2023-12-08T08:21:36.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.959+0000 7fbe04ff8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe001f00d0 con 0x7fbe00151db0 2023-12-08T08:21:36.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.959+0000 7fbe04ff8640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe001f03b0 con 0x7fbe000c19e0 2023-12-08T08:21:36.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.963+0000 7fbdfe59c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe000c19e0 0x7fbe0014e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:36.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.963+0000 7fbdfdd9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe000c4a20 0x7fbe00071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:36.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.963+0000 7fbdfe59c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe000c19e0 0x7fbe0014e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:34382/0 (socket says 172.21.15.88:34382) 2023-12-08T08:21:36.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.963+0000 7fbdfe59c640 1 -- 172.21.15.88:0/4023826225 learned_addr learned my addr 172.21.15.88:0/4023826225 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:36.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.963+0000 7fbdfdd9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe000c4a20 0x7fbe00071fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39062/0 (socket says 172.21.15.88:39062) 2023-12-08T08:21:36.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.963+0000 7fbdfed9d640 1 --2- 172.21.15.88:0/4023826225 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe00151db0 0x7fbe00156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:36.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.963+0000 7fbdfdd9b640 1 -- 172.21.15.88:0/4023826225 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe000c19e0 msgr2=0x7fbe0014e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:36.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.963+0000 7fbdfdd9b640 1 --2- 172.21.15.88:0/4023826225 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe000c19e0 0x7fbe0014e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:36.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.963+0000 7fbdfdd9b640 1 -- 172.21.15.88:0/4023826225 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe00151db0 msgr2=0x7fbe00156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:36.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.963+0000 7fbdfdd9b640 1 --2- 172.21.15.88:0/4023826225 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe00151db0 0x7fbe00156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:36.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.963+0000 7fbdfdd9b640 1 -- 172.21.15.88:0/4023826225 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf4009420 con 0x7fbe000c4a20 2023-12-08T08:21:36.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.963+0000 7fbdfdd9b640 1 --2- 172.21.15.88:0/4023826225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe000c4a20 0x7fbe00071fb0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400e9b0 tx=0x7fbdf400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:36.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.963+0000 7fbdeeffd640 1 -- 172.21.15.88:0/4023826225 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf400c9a0 con 0x7fbe000c4a20 2023-12-08T08:21:36.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.963+0000 7fbdeeffd640 1 -- 172.21.15.88:0/4023826225 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf400cb00 con 0x7fbe000c4a20 2023-12-08T08:21:36.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.963+0000 7fbdeeffd640 1 -- 172.21.15.88:0/4023826225 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4013470 con 0x7fbe000c4a20 2023-12-08T08:21:36.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.963+0000 7fbe04ff8640 1 -- 172.21.15.88:0/4023826225 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf0009420 con 0x7fbe000c4a20 2023-12-08T08:21:36.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.963+0000 7fbe04ff8640 1 -- 172.21.15.88:0/4023826225 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe001f0970 con 0x7fbe000c4a20 2023-12-08T08:21:36.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.963+0000 7fbe04ff8640 1 -- 172.21.15.88:0/4023826225 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe00067630 con 0x7fbe000c4a20 2023-12-08T08:21:36.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.963+0000 7fbdeeffd640 1 -- 172.21.15.88:0/4023826225 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbdf40135d0 con 0x7fbe000c4a20 2023-12-08T08:21:36.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.967+0000 7fbdeeffd640 1 --2- 172.21.15.88:0/4023826225 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbde0066470 0x7fbde0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:36.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.967+0000 7fbdeeffd640 1 -- 172.21.15.88:0/4023826225 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fbdf40843f0 con 0x7fbe000c4a20 2023-12-08T08:21:36.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.967+0000 7fbdfe59c640 1 --2- 172.21.15.88:0/4023826225 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbde0066470 0x7fbde0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:36.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.967+0000 7fbdfe59c640 1 --2- 172.21.15.88:0/4023826225 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbde0066470 0x7fbde0068930 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbdf00097c0 tx=0x7fbdf00a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:36.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:36.967+0000 7fbdeeffd640 1 -- 172.21.15.88:0/4023826225 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbdf4051520 con 0x7fbe000c4a20 2023-12-08T08:21:37.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.119+0000 7fbe04ff8640 1 -- 172.21.15.88:0/4023826225 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbe000c0af0 con 0x7fbe000c4a20 2023-12-08T08:21:37.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.119+0000 7fbdeeffd640 1 -- 172.21.15.88:0/4023826225 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbdf4054b40 con 0x7fbe000c4a20 2023-12-08T08:21:37.124 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:21:37.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.119+0000 7fbe04ff8640 1 -- 172.21.15.88:0/4023826225 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbde0066470 msgr2=0x7fbde0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:37.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.119+0000 7fbe04ff8640 1 --2- 172.21.15.88:0/4023826225 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbde0066470 0x7fbde0068930 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbdf00097c0 tx=0x7fbdf00a6000 comp rx=0 tx=0).stop 2023-12-08T08:21:37.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.119+0000 7fbe04ff8640 1 -- 172.21.15.88:0/4023826225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe000c4a20 msgr2=0x7fbe00071fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:37.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.119+0000 7fbe04ff8640 1 --2- 172.21.15.88:0/4023826225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe000c4a20 0x7fbe00071fb0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400e9b0 tx=0x7fbdf400ee70 comp rx=0 tx=0).stop 2023-12-08T08:21:37.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.123+0000 7fbe04ff8640 1 -- 172.21.15.88:0/4023826225 shutdown_connections 2023-12-08T08:21:37.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.123+0000 7fbe04ff8640 1 --2- 172.21.15.88:0/4023826225 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbde0066470 0x7fbde0068930 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.123+0000 7fbe04ff8640 1 --2- 172.21.15.88:0/4023826225 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe00151db0 0x7fbe00156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.123+0000 7fbe04ff8640 1 --2- 172.21.15.88:0/4023826225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe000c4a20 0x7fbe00071fb0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.123+0000 7fbe04ff8640 1 --2- 172.21.15.88:0/4023826225 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe000c19e0 0x7fbe0014e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.123+0000 7fbe04ff8640 1 -- 172.21.15.88:0/4023826225 >> 172.21.15.88:0/4023826225 conn(0x7fbe000c6b20 msgr2=0x7fbe000c6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:37.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.123+0000 7fbe04ff8640 1 -- 172.21.15.88:0/4023826225 shutdown_connections 2023-12-08T08:21:37.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.123+0000 7fbe04ff8640 1 -- 172.21.15.88:0/4023826225 wait complete. 2023-12-08T08:21:37.144 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:21:37.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.279+0000 7f7d97572640 1 Processor -- start 2023-12-08T08:21:37.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.279+0000 7f7d97572640 1 -- start start 2023-12-08T08:21:37.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.279+0000 7f7d97572640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7d9014f850 0x7f7d900aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:37.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.279+0000 7f7d97572640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7d9014fc30 0x7f7d900c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:37.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.279+0000 7f7d97572640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d9006d840 0x7f7d900c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:37.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.279+0000 7f7d97572640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d900c2240 con 0x7f7d9014fc30 2023-12-08T08:21:37.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.279+0000 7f7d97572640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d90152910 con 0x7f7d9014f850 2023-12-08T08:21:37.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.279+0000 7f7d97572640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d90152bf0 con 0x7f7d9006d840 2023-12-08T08:21:37.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.283+0000 7f7d94b0d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7d9014fc30 0x7f7d900c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:37.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.283+0000 7f7d94b0d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7d9014fc30 0x7f7d900c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39078/0 (socket says 172.21.15.88:39078) 2023-12-08T08:21:37.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.283+0000 7f7d94b0d640 1 -- 172.21.15.88:0/3852295737 learned_addr learned my addr 172.21.15.88:0/3852295737 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:37.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.283+0000 7f7d95b0f640 1 --2- 172.21.15.88:0/3852295737 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d9006d840 0x7f7d900c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:37.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.283+0000 7f7d9530e640 1 --2- 172.21.15.88:0/3852295737 >> v2:172.21.15.148:3300/0 conn(0x7f7d9014f850 0x7f7d900aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:37.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.283+0000 7f7d94b0d640 1 -- 172.21.15.88:0/3852295737 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d9006d840 msgr2=0x7f7d900c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:37.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.283+0000 7f7d94b0d640 1 --2- 172.21.15.88:0/3852295737 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d9006d840 0x7f7d900c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.283+0000 7f7d94b0d640 1 -- 172.21.15.88:0/3852295737 >> v2:172.21.15.148:3300/0 conn(0x7f7d9014f850 msgr2=0x7f7d900aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:37.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.283+0000 7f7d94b0d640 1 --2- 172.21.15.88:0/3852295737 >> v2:172.21.15.148:3300/0 conn(0x7f7d9014f850 0x7f7d900aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.283+0000 7f7d94b0d640 1 -- 172.21.15.88:0/3852295737 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d90152ed0 con 0x7f7d9014fc30 2023-12-08T08:21:37.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.283+0000 7f7d94b0d640 1 --2- 172.21.15.88:0/3852295737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d9014fc30 0x7f7d900c3cd0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7d90066f50 tx=0x7f7d8001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ccbdc79a4e4b0f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:37.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.283+0000 7f7d87fff640 1 -- 172.21.15.88:0/3852295737 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d800aa640 con 0x7f7d9014fc30 2023-12-08T08:21:37.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.283+0000 7f7d87fff640 1 -- 172.21.15.88:0/3852295737 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d800aa7a0 con 0x7f7d9014fc30 2023-12-08T08:21:37.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.283+0000 7f7d87fff640 1 -- 172.21.15.88:0/3852295737 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d800aab30 con 0x7f7d9014fc30 2023-12-08T08:21:37.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.287+0000 7f7d97572640 1 -- 172.21.15.88:0/3852295737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d9014fc30 msgr2=0x7f7d900c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:37.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.287+0000 7f7d97572640 1 --2- 172.21.15.88:0/3852295737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d9014fc30 0x7f7d900c3cd0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7d90066f50 tx=0x7f7d8001c500 comp rx=0 tx=0).stop 2023-12-08T08:21:37.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.287+0000 7f7d97572640 1 -- 172.21.15.88:0/3852295737 shutdown_connections 2023-12-08T08:21:37.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.287+0000 7f7d97572640 1 --2- 172.21.15.88:0/3852295737 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d9006d840 0x7f7d900c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.287+0000 7f7d97572640 1 --2- 172.21.15.88:0/3852295737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d9014fc30 0x7f7d900c3cd0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.287+0000 7f7d97572640 1 --2- 172.21.15.88:0/3852295737 >> v2:172.21.15.148:3300/0 conn(0x7f7d9014f850 0x7f7d900aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.287+0000 7f7d97572640 1 -- 172.21.15.88:0/3852295737 >> 172.21.15.88:0/3852295737 conn(0x7f7d900c59f0 msgr2=0x7f7d900c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:37.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.287+0000 7f7d97572640 1 -- 172.21.15.88:0/3852295737 shutdown_connections 2023-12-08T08:21:37.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.287+0000 7f7d97572640 1 -- 172.21.15.88:0/3852295737 wait complete. 2023-12-08T08:21:37.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.287+0000 7f7d97572640 1 Processor -- start 2023-12-08T08:21:37.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.287+0000 7f7d97572640 1 -- start start 2023-12-08T08:21:37.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.287+0000 7f7d97572640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d9006d840 0x7f7d901f1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:37.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.287+0000 7f7d97572640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d9014f850 0x7f7d901551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:37.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.287+0000 7f7d97572640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d9014fc30 0x7f7d901ed9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:37.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.287+0000 7f7d97572640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d901ed2d0 con 0x7f7d9014fc30 2023-12-08T08:21:37.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.287+0000 7f7d97572640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d901f1790 con 0x7f7d9006d840 2023-12-08T08:21:37.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.287+0000 7f7d97572640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d900a91d0 con 0x7f7d9014f850 2023-12-08T08:21:37.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.287+0000 7f7d95b0f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d9014fc30 0x7f7d901ed9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:37.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.287+0000 7f7d95b0f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d9014fc30 0x7f7d901ed9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39094/0 (socket says 172.21.15.88:39094) 2023-12-08T08:21:37.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.287+0000 7f7d95b0f640 1 -- 172.21.15.88:0/1125317284 learned_addr learned my addr 172.21.15.88:0/1125317284 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:37.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.287+0000 7f7d94b0d640 1 --2- 172.21.15.88:0/1125317284 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d9014f850 0x7f7d901551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:37.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.287+0000 7f7d9530e640 1 --2- 172.21.15.88:0/1125317284 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d9006d840 0x7f7d901f1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:37.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.287+0000 7f7d95b0f640 1 -- 172.21.15.88:0/1125317284 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d9014f850 msgr2=0x7f7d901551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:37.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.287+0000 7f7d95b0f640 1 --2- 172.21.15.88:0/1125317284 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d9014f850 0x7f7d901551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.291+0000 7f7d95b0f640 1 -- 172.21.15.88:0/1125317284 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d9006d840 msgr2=0x7f7d901f1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:37.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.291+0000 7f7d95b0f640 1 --2- 172.21.15.88:0/1125317284 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d9006d840 0x7f7d901f1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.291+0000 7f7d95b0f640 1 -- 172.21.15.88:0/1125317284 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d800094d0 con 0x7f7d9014fc30 2023-12-08T08:21:37.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.291+0000 7f7d95b0f640 1 --2- 172.21.15.88:0/1125317284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d9014fc30 0x7f7d901ed9c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7d8800eed0 tx=0x7f7d8800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:37.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.291+0000 7f7d85ffb640 1 -- 172.21.15.88:0/1125317284 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88010040 con 0x7f7d9014fc30 2023-12-08T08:21:37.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.291+0000 7f7d85ffb640 1 -- 172.21.15.88:0/1125317284 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d88014400 con 0x7f7d9014fc30 2023-12-08T08:21:37.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.291+0000 7f7d85ffb640 1 -- 172.21.15.88:0/1125317284 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88009ea0 con 0x7f7d9014fc30 2023-12-08T08:21:37.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.291+0000 7f7d97572640 1 -- 172.21.15.88:0/1125317284 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d900aab10 con 0x7f7d9014fc30 2023-12-08T08:21:37.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.291+0000 7f7d97572640 1 -- 172.21.15.88:0/1125317284 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d900a9420 con 0x7f7d9014fc30 2023-12-08T08:21:37.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.291+0000 7f7d97572640 1 -- 172.21.15.88:0/1125317284 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d901ed6b0 con 0x7f7d9014fc30 2023-12-08T08:21:37.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.291+0000 7f7d85ffb640 1 -- 172.21.15.88:0/1125317284 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7d880147b0 con 0x7f7d9014fc30 2023-12-08T08:21:37.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.291+0000 7f7d85ffb640 1 --2- 172.21.15.88:0/1125317284 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7d74066470 0x7f7d74068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:37.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.291+0000 7f7d85ffb640 1 -- 172.21.15.88:0/1125317284 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7d88084710 con 0x7f7d9014fc30 2023-12-08T08:21:37.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.291+0000 7f7d9530e640 1 --2- 172.21.15.88:0/1125317284 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7d74066470 0x7f7d74068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:37.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.295+0000 7f7d9530e640 1 --2- 172.21.15.88:0/1125317284 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7d74066470 0x7f7d74068930 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c007a60 tx=0x7f7d8c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:37.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.295+0000 7f7d85ffb640 1 -- 172.21.15.88:0/1125317284 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7d88051970 con 0x7f7d9014fc30 2023-12-08T08:21:37.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.447+0000 7f7d97572640 1 -- 172.21.15.88:0/1125317284 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7d90067630 con 0x7f7d9014fc30 2023-12-08T08:21:37.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.447+0000 7f7d85ffb640 1 -- 172.21.15.88:0/1125317284 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7d88054f90 con 0x7f7d9014fc30 2023-12-08T08:21:37.452 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:21:37.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.451+0000 7f7d97572640 1 -- 172.21.15.88:0/1125317284 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7d74066470 msgr2=0x7f7d74068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:37.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.451+0000 7f7d97572640 1 --2- 172.21.15.88:0/1125317284 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7d74066470 0x7f7d74068930 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c007a60 tx=0x7f7d8c008040 comp rx=0 tx=0).stop 2023-12-08T08:21:37.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.451+0000 7f7d97572640 1 -- 172.21.15.88:0/1125317284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d9014fc30 msgr2=0x7f7d901ed9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:37.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.451+0000 7f7d97572640 1 --2- 172.21.15.88:0/1125317284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d9014fc30 0x7f7d901ed9c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7d8800eed0 tx=0x7f7d8800b480 comp rx=0 tx=0).stop 2023-12-08T08:21:37.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.451+0000 7f7d97572640 1 -- 172.21.15.88:0/1125317284 shutdown_connections 2023-12-08T08:21:37.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.451+0000 7f7d97572640 1 --2- 172.21.15.88:0/1125317284 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7d74066470 0x7f7d74068930 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.451+0000 7f7d97572640 1 --2- 172.21.15.88:0/1125317284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d9014fc30 0x7f7d901ed9c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.451+0000 7f7d97572640 1 --2- 172.21.15.88:0/1125317284 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d9014f850 0x7f7d901551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.451+0000 7f7d97572640 1 --2- 172.21.15.88:0/1125317284 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d9006d840 0x7f7d901f1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.451+0000 7f7d97572640 1 -- 172.21.15.88:0/1125317284 >> 172.21.15.88:0/1125317284 conn(0x7f7d900c59f0 msgr2=0x7f7d9006d060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:37.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.451+0000 7f7d97572640 1 -- 172.21.15.88:0/1125317284 shutdown_connections 2023-12-08T08:21:37.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.451+0000 7f7d97572640 1 -- 172.21.15.88:0/1125317284 wait complete. 2023-12-08T08:21:37.473 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:21:37.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.611+0000 7f7f6e879640 1 Processor -- start 2023-12-08T08:21:37.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.611+0000 7f7f6e879640 1 -- start start 2023-12-08T08:21:37.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.615+0000 7f7f6e879640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7f68151db0 0x7f7f680a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:37.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.615+0000 7f7f6e879640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7f68157b60 0x7f7f68157f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:37.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.615+0000 7f7f6e879640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f680a65d0 con 0x7f7f680c4a20 2023-12-08T08:21:37.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.615+0000 7f7f6e879640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f68154570 con 0x7f7f68157b60 2023-12-08T08:21:37.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.615+0000 7f7f6e879640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f68155520 con 0x7f7f68151db0 2023-12-08T08:21:37.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.615+0000 7f7f6ce16640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7f68157b60 0x7f7f68157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:37.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.615+0000 7f7f6ce16640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7f68157b60 0x7f7f68157f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39108/0 (socket says 172.21.15.88:39108) 2023-12-08T08:21:37.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.615+0000 7f7f6ce16640 1 -- 172.21.15.88:0/1046381364 learned_addr learned my addr 172.21.15.88:0/1046381364 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:37.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.615+0000 7f7f67fff640 1 --2- 172.21.15.88:0/1046381364 >> v2:172.21.15.148:3300/0 conn(0x7f7f68151db0 0x7f7f680a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:37.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.615+0000 7f7f6ce16640 1 -- 172.21.15.88:0/1046381364 >> v2:172.21.15.148:3300/0 conn(0x7f7f68151db0 msgr2=0x7f7f680a5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:37.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.615+0000 7f7f6ce16640 1 --2- 172.21.15.88:0/1046381364 >> v2:172.21.15.148:3300/0 conn(0x7f7f68151db0 0x7f7f680a5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.615+0000 7f7f6ce16640 1 -- 172.21.15.88:0/1046381364 >> v1:172.21.15.148:6789/0 conn(0x7f7f680c4a20 legacy=0x7f7f680c14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:37.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.615+0000 7f7f6ce16640 1 -- 172.21.15.88:0/1046381364 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f68154780 con 0x7f7f68157b60 2023-12-08T08:21:37.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.615+0000 7f7f67fff640 1 --2- 172.21.15.88:0/1046381364 >> v2:172.21.15.148:3300/0 conn(0x7f7f68151db0 0x7f7f680a5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:37.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.619+0000 7f7f6ce16640 1 --2- 172.21.15.88:0/1046381364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f68157b60 0x7f7f68157f90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7f680a9360 tx=0x7f7f6001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186a373ce8f88954 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:37.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.619+0000 7f7f66ffd640 1 -- 172.21.15.88:0/1046381364 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f600a56b0 con 0x7f7f68157b60 2023-12-08T08:21:37.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.619+0000 7f7f66ffd640 1 -- 172.21.15.88:0/1046381364 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f600a5810 con 0x7f7f68157b60 2023-12-08T08:21:37.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.619+0000 7f7f66ffd640 1 -- 172.21.15.88:0/1046381364 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f600a5ba0 con 0x7f7f68157b60 2023-12-08T08:21:37.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.619+0000 7f7f6e879640 1 -- 172.21.15.88:0/1046381364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f68157b60 msgr2=0x7f7f68157f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:37.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.619+0000 7f7f6e879640 1 --2- 172.21.15.88:0/1046381364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f68157b60 0x7f7f68157f90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7f680a9360 tx=0x7f7f6001c900 comp rx=0 tx=0).stop 2023-12-08T08:21:37.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.619+0000 7f7f6e879640 1 -- 172.21.15.88:0/1046381364 shutdown_connections 2023-12-08T08:21:37.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.619+0000 7f7f6e879640 1 --2- 172.21.15.88:0/1046381364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f68157b60 0x7f7f68157f90 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.619+0000 7f7f6e879640 1 --2- 172.21.15.88:0/1046381364 >> v2:172.21.15.148:3300/0 conn(0x7f7f68151db0 0x7f7f680a5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.619+0000 7f7f6e879640 1 -- 172.21.15.88:0/1046381364 >> 172.21.15.88:0/1046381364 conn(0x7f7f680c6b20 msgr2=0x7f7f680c6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:37.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.619+0000 7f7f6e879640 1 -- 172.21.15.88:0/1046381364 shutdown_connections 2023-12-08T08:21:37.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.619+0000 7f7f6e879640 1 -- 172.21.15.88:0/1046381364 wait complete. 2023-12-08T08:21:37.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.619+0000 7f7f6e879640 1 Processor -- start 2023-12-08T08:21:37.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.619+0000 7f7f6e879640 1 -- start start 2023-12-08T08:21:37.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.623+0000 7f7f6e879640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f680c4a20 0x7f7f681451e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:37.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.623+0000 7f7f6e879640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f68151db0 0x7f7f68143bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:37.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.623+0000 7f7f6e879640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f68157b60 0x7f7f68146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:37.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.623+0000 7f7f6e879640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f68152750 con 0x7f7f68151db0 2023-12-08T08:21:37.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.623+0000 7f7f6e879640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f68142e90 con 0x7f7f68157b60 2023-12-08T08:21:37.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.623+0000 7f7f6e879640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f68153d80 con 0x7f7f680c4a20 2023-12-08T08:21:37.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.623+0000 7f7f677fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f68151db0 0x7f7f68143bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:37.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.623+0000 7f7f677fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f68151db0 0x7f7f68143bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39120/0 (socket says 172.21.15.88:39120) 2023-12-08T08:21:37.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.623+0000 7f7f677fe640 1 -- 172.21.15.88:0/1897624877 learned_addr learned my addr 172.21.15.88:0/1897624877 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:37.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.623+0000 7f7f6ce16640 1 --2- 172.21.15.88:0/1897624877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f68157b60 0x7f7f68146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:37.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.623+0000 7f7f67fff640 1 --2- 172.21.15.88:0/1897624877 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f680c4a20 0x7f7f681451e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:37.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.623+0000 7f7f677fe640 1 -- 172.21.15.88:0/1897624877 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f680c4a20 msgr2=0x7f7f681451e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:37.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.623+0000 7f7f677fe640 1 --2- 172.21.15.88:0/1897624877 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f680c4a20 0x7f7f681451e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.623+0000 7f7f677fe640 1 -- 172.21.15.88:0/1897624877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f68157b60 msgr2=0x7f7f68146f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:37.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.623+0000 7f7f677fe640 1 --2- 172.21.15.88:0/1897624877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f68157b60 0x7f7f68146f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.623+0000 7f7f677fe640 1 -- 172.21.15.88:0/1897624877 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f60009b30 con 0x7f7f68151db0 2023-12-08T08:21:37.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.623+0000 7f7f677fe640 1 --2- 172.21.15.88:0/1897624877 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f68151db0 0x7f7f68143bf0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00c480 tx=0x7f7f5c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:37.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.623+0000 7f7f64ff9640 1 -- 172.21.15.88:0/1897624877 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c012830 con 0x7f7f68151db0 2023-12-08T08:21:37.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.623+0000 7f7f64ff9640 1 -- 172.21.15.88:0/1897624877 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5c0129b0 con 0x7f7f68151db0 2023-12-08T08:21:37.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.623+0000 7f7f64ff9640 1 -- 172.21.15.88:0/1897624877 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c012d60 con 0x7f7f68151db0 2023-12-08T08:21:37.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.623+0000 7f7f6e879640 1 -- 172.21.15.88:0/1897624877 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f68145720 con 0x7f7f68151db0 2023-12-08T08:21:37.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.623+0000 7f7f6e879640 1 -- 172.21.15.88:0/1897624877 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f681445f0 con 0x7f7f68151db0 2023-12-08T08:21:37.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.623+0000 7f7f6e879640 1 -- 172.21.15.88:0/1897624877 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f68067630 con 0x7f7f68151db0 2023-12-08T08:21:37.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.623+0000 7f7f64ff9640 1 -- 172.21.15.88:0/1897624877 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7f5c01c460 con 0x7f7f68151db0 2023-12-08T08:21:37.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.627+0000 7f7f64ff9640 1 --2- 172.21.15.88:0/1897624877 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7f54066470 0x7f7f54068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:37.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.627+0000 7f7f64ff9640 1 -- 172.21.15.88:0/1897624877 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7f5c083fa0 con 0x7f7f68151db0 2023-12-08T08:21:37.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.627+0000 7f7f67fff640 1 --2- 172.21.15.88:0/1897624877 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7f54066470 0x7f7f54068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:37.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.627+0000 7f7f67fff640 1 --2- 172.21.15.88:0/1897624877 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7f54066470 0x7f7f54068930 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7f5800ab60 tx=0x7f7f58008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:37.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.631+0000 7f7f64ff9640 1 -- 172.21.15.88:0/1897624877 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7f5c051160 con 0x7f7f68151db0 2023-12-08T08:21:37.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.779+0000 7f7f6e879640 1 -- 172.21.15.88:0/1897624877 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7f680c0af0 con 0x7f7f68151db0 2023-12-08T08:21:37.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.779+0000 7f7f64ff9640 1 -- 172.21.15.88:0/1897624877 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v35) v1 ==== 105+0+11 (secure 0 0 0) 0x7f7f5c054780 con 0x7f7f68151db0 2023-12-08T08:21:37.784 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:21:37.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.783+0000 7f7f6e879640 1 -- 172.21.15.88:0/1897624877 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7f54066470 msgr2=0x7f7f54068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:37.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.783+0000 7f7f6e879640 1 --2- 172.21.15.88:0/1897624877 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7f54066470 0x7f7f54068930 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7f5800ab60 tx=0x7f7f58008040 comp rx=0 tx=0).stop 2023-12-08T08:21:37.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.783+0000 7f7f6e879640 1 -- 172.21.15.88:0/1897624877 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f68151db0 msgr2=0x7f7f68143bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:37.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.783+0000 7f7f6e879640 1 --2- 172.21.15.88:0/1897624877 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f68151db0 0x7f7f68143bf0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00c480 tx=0x7f7f5c00c940 comp rx=0 tx=0).stop 2023-12-08T08:21:37.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.783+0000 7f7f6e879640 1 -- 172.21.15.88:0/1897624877 shutdown_connections 2023-12-08T08:21:37.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.783+0000 7f7f6e879640 1 --2- 172.21.15.88:0/1897624877 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7f54066470 0x7f7f54068930 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.783+0000 7f7f6e879640 1 --2- 172.21.15.88:0/1897624877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f68157b60 0x7f7f68146f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.783+0000 7f7f6e879640 1 --2- 172.21.15.88:0/1897624877 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f68151db0 0x7f7f68143bf0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.783+0000 7f7f6e879640 1 --2- 172.21.15.88:0/1897624877 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7f680c4a20 0x7f7f681451e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.783+0000 7f7f6e879640 1 -- 172.21.15.88:0/1897624877 >> 172.21.15.88:0/1897624877 conn(0x7f7f680c6b20 msgr2=0x7f7f680c3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:37.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.783+0000 7f7f6e879640 1 -- 172.21.15.88:0/1897624877 shutdown_connections 2023-12-08T08:21:37.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.783+0000 7f7f6e879640 1 -- 172.21.15.88:0/1897624877 wait complete. 2023-12-08T08:21:37.807 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:21:37.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.943+0000 7fc9791df640 1 Processor -- start 2023-12-08T08:21:37.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.943+0000 7fc9791df640 1 -- start start 2023-12-08T08:21:37.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.943+0000 7fc9791df640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc9740c5300 0x7fc9740a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:37.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.943+0000 7fc9791df640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9741548c0 0x7fc974154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:37.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.943+0000 7fc9791df640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9740a4e20 con 0x7fc97414b1e0 2023-12-08T08:21:37.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.943+0000 7fc9791df640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9740a50e0 con 0x7fc9740c5300 2023-12-08T08:21:37.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.943+0000 7fc9791df640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740c0f00 con 0x7fc9741548c0 2023-12-08T08:21:37.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.943+0000 7fc96a59c640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc9740c5300 0x7fc9740a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:37.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.943+0000 7fc972d9d640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc97414b1e0 0x7fc9740c1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:47842/0 (socket says 172.21.15.88:47842) 2023-12-08T08:21:37.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.943+0000 7fc972d9d640 1 -- 172.21.15.88:0/2980664919 learned_addr learned my addr 172.21.15.88:0/2980664919 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:37.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.943+0000 7fc96a59c640 1 --2- 172.21.15.88:0/2980664919 >> v2:172.21.15.148:3300/0 conn(0x7fc9740c5300 0x7fc9740a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:51378/0 (socket says 172.21.15.88:51378) 2023-12-08T08:21:37.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.943+0000 7fc97359e640 1 --2- 172.21.15.88:0/2980664919 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9741548c0 0x7fc974154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:37.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.943+0000 7fc96a59c640 1 -- 172.21.15.88:0/2980664919 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9741548c0 msgr2=0x7fc974154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:37.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.943+0000 7fc96a59c640 1 --2- 172.21.15.88:0/2980664919 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9741548c0 0x7fc974154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.943+0000 7fc96a59c640 1 -- 172.21.15.88:0/2980664919 >> v1:172.21.15.148:6789/0 conn(0x7fc97414b1e0 legacy=0x7fc9740c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:37.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.943+0000 7fc96a59c640 1 -- 172.21.15.88:0/2980664919 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9740c11e0 con 0x7fc9740c5300 2023-12-08T08:21:37.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.943+0000 7fc97359e640 1 --2- 172.21.15.88:0/2980664919 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9741548c0 0x7fc974154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:21:37.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.947+0000 7fc96a59c640 1 --2- 172.21.15.88:0/2980664919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9740c5300 0x7fc9740a9c30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc95c009d90 tx=0x7fc95c01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=349c4ab8af6afdbe server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:37.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.947+0000 7fc97259c640 1 -- 172.21.15.88:0/2980664919 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c0a5920 con 0x7fc9740c5300 2023-12-08T08:21:37.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.947+0000 7fc97259c640 1 -- 172.21.15.88:0/2980664919 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c0a5a80 con 0x7fc9740c5300 2023-12-08T08:21:37.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.947+0000 7fc97259c640 1 -- 172.21.15.88:0/2980664919 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c0a5e10 con 0x7fc9740c5300 2023-12-08T08:21:37.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.947+0000 7fc9791df640 1 -- 172.21.15.88:0/2980664919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9740c5300 msgr2=0x7fc9740a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:37.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.947+0000 7fc9791df640 1 --2- 172.21.15.88:0/2980664919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9740c5300 0x7fc9740a9c30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc95c009d90 tx=0x7fc95c01c950 comp rx=0 tx=0).stop 2023-12-08T08:21:37.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.947+0000 7fc9791df640 1 -- 172.21.15.88:0/2980664919 shutdown_connections 2023-12-08T08:21:37.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.947+0000 7fc9791df640 1 --2- 172.21.15.88:0/2980664919 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9741548c0 0x7fc974154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.947+0000 7fc9791df640 1 --2- 172.21.15.88:0/2980664919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9740c5300 0x7fc9740a9c30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.947+0000 7fc9791df640 1 -- 172.21.15.88:0/2980664919 >> 172.21.15.88:0/2980664919 conn(0x7fc9740c59f0 msgr2=0x7fc9740c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:37.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.947+0000 7fc9791df640 1 -- 172.21.15.88:0/2980664919 shutdown_connections 2023-12-08T08:21:37.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.947+0000 7fc9791df640 1 -- 172.21.15.88:0/2980664919 wait complete. 2023-12-08T08:21:37.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.951+0000 7fc9791df640 1 Processor -- start 2023-12-08T08:21:37.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.951+0000 7fc9791df640 1 -- start start 2023-12-08T08:21:37.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.951+0000 7fc9791df640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9740c5300 0x7fc9740a6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:37.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.951+0000 7fc9791df640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc97414b1e0 0x7fc974143750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:37.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.951+0000 7fc9791df640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9741548c0 0x7fc9741f07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:37.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.951+0000 7fc9791df640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc974142b40 con 0x7fc97414b1e0 2023-12-08T08:21:37.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.951+0000 7fc9791df640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc974144ee0 con 0x7fc9741548c0 2023-12-08T08:21:37.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.951+0000 7fc9791df640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc974146ca0 con 0x7fc9740c5300 2023-12-08T08:21:37.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.951+0000 7fc96a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc97414b1e0 0x7fc974143750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:37.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.951+0000 7fc972d9d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9740c5300 0x7fc9740a6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:37.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.951+0000 7fc96a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc97414b1e0 0x7fc974143750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39126/0 (socket says 172.21.15.88:39126) 2023-12-08T08:21:37.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.951+0000 7fc96a59c640 1 -- 172.21.15.88:0/4075823269 learned_addr learned my addr 172.21.15.88:0/4075823269 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:37.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.951+0000 7fc97359e640 1 --2- 172.21.15.88:0/4075823269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9741548c0 0x7fc9741f07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:37.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.951+0000 7fc96a59c640 1 -- 172.21.15.88:0/4075823269 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9740c5300 msgr2=0x7fc9740a6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:37.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.951+0000 7fc96a59c640 1 --2- 172.21.15.88:0/4075823269 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9740c5300 0x7fc9740a6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.951+0000 7fc96a59c640 1 -- 172.21.15.88:0/4075823269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9741548c0 msgr2=0x7fc9741f07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:37.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.951+0000 7fc96a59c640 1 --2- 172.21.15.88:0/4075823269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9741548c0 0x7fc9741f07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:37.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.951+0000 7fc96a59c640 1 -- 172.21.15.88:0/4075823269 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c009420 con 0x7fc97414b1e0 2023-12-08T08:21:37.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.951+0000 7fc972d9d640 1 --2- 172.21.15.88:0/4075823269 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9740c5300 0x7fc9740a6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:21:37.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.951+0000 7fc96a59c640 1 --2- 172.21.15.88:0/4075823269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc97414b1e0 0x7fc974143750 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc95c01b000 tx=0x7fc95c0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:37.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.951+0000 7fc96bfff640 1 -- 172.21.15.88:0/4075823269 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c0aee20 con 0x7fc97414b1e0 2023-12-08T08:21:37.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.951+0000 7fc96bfff640 1 -- 172.21.15.88:0/4075823269 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c009450 con 0x7fc97414b1e0 2023-12-08T08:21:37.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.951+0000 7fc96bfff640 1 -- 172.21.15.88:0/4075823269 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c0b7650 con 0x7fc97414b1e0 2023-12-08T08:21:37.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.951+0000 7fc9791df640 1 -- 172.21.15.88:0/4075823269 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc95c009a70 con 0x7fc97414b1e0 2023-12-08T08:21:37.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.951+0000 7fc9791df640 1 -- 172.21.15.88:0/4075823269 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9740a7080 con 0x7fc97414b1e0 2023-12-08T08:21:37.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.955+0000 7fc9791df640 1 -- 172.21.15.88:0/4075823269 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc974149ca0 con 0x7fc97414b1e0 2023-12-08T08:21:37.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.955+0000 7fc96bfff640 1 -- 172.21.15.88:0/4075823269 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc95c0b4050 con 0x7fc97414b1e0 2023-12-08T08:21:37.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.955+0000 7fc96bfff640 1 --2- 172.21.15.88:0/4075823269 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc954066470 0x7fc954068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:37.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.955+0000 7fc96bfff640 1 -- 172.21.15.88:0/4075823269 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc95c11f280 con 0x7fc97414b1e0 2023-12-08T08:21:37.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.955+0000 7fc972d9d640 1 --2- 172.21.15.88:0/4075823269 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc954066470 0x7fc954068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:37.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.955+0000 7fc972d9d640 1 --2- 172.21.15.88:0/4075823269 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc954066470 0x7fc954068930 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc964000f70 tx=0x7fc964009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:37.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:37.959+0000 7fc96bfff640 1 -- 172.21.15.88:0/4075823269 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc95c0ec300 con 0x7fc97414b1e0 2023-12-08T08:21:38.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.107+0000 7fc9791df640 1 -- 172.21.15.88:0/4075823269 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fc9740ab440 con 0x7fc97414b1e0 2023-12-08T08:21:38.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.107+0000 7fc96bfff640 1 -- 172.21.15.88:0/4075823269 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v35) v1 ==== 101+0+11 (secure 0 0 0) 0x7fc95c0ef920 con 0x7fc97414b1e0 2023-12-08T08:21:38.113 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:21:38.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.107+0000 7fc9791df640 1 -- 172.21.15.88:0/4075823269 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc954066470 msgr2=0x7fc954068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:38.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.107+0000 7fc9791df640 1 --2- 172.21.15.88:0/4075823269 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc954066470 0x7fc954068930 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc964000f70 tx=0x7fc964009040 comp rx=0 tx=0).stop 2023-12-08T08:21:38.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.107+0000 7fc9791df640 1 -- 172.21.15.88:0/4075823269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc97414b1e0 msgr2=0x7fc974143750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:38.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.107+0000 7fc9791df640 1 --2- 172.21.15.88:0/4075823269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc97414b1e0 0x7fc974143750 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc95c01b000 tx=0x7fc95c0196f0 comp rx=0 tx=0).stop 2023-12-08T08:21:38.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.107+0000 7fc9791df640 1 -- 172.21.15.88:0/4075823269 shutdown_connections 2023-12-08T08:21:38.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.107+0000 7fc9791df640 1 --2- 172.21.15.88:0/4075823269 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc954066470 0x7fc954068930 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:38.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.107+0000 7fc9791df640 1 --2- 172.21.15.88:0/4075823269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9741548c0 0x7fc9741f07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:38.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.107+0000 7fc9791df640 1 --2- 172.21.15.88:0/4075823269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc97414b1e0 0x7fc974143750 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:38.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.107+0000 7fc9791df640 1 --2- 172.21.15.88:0/4075823269 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9740c5300 0x7fc9740a6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:38.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.107+0000 7fc9791df640 1 -- 172.21.15.88:0/4075823269 >> 172.21.15.88:0/4075823269 conn(0x7fc9740c59f0 msgr2=0x7fc9741526f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:38.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.107+0000 7fc9791df640 1 -- 172.21.15.88:0/4075823269 shutdown_connections 2023-12-08T08:21:38.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.107+0000 7fc9791df640 1 -- 172.21.15.88:0/4075823269 wait complete. 2023-12-08T08:21:38.132 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:21:38.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.267+0000 7f669c06b640 1 Processor -- start 2023-12-08T08:21:38.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.267+0000 7f669c06b640 1 -- start start 2023-12-08T08:21:38.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.267+0000 7f669c06b640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f669415cba0 0x7f669406d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:38.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.267+0000 7f669c06b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f669406d6a0 0x7f66940a9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:38.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.267+0000 7f669c06b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f669415c710 con 0x7f6694152d30 2023-12-08T08:21:38.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.267+0000 7f669c06b640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669406c360 con 0x7f669406d6a0 2023-12-08T08:21:38.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.267+0000 7f669c06b640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669415d000 con 0x7f669415cba0 2023-12-08T08:21:38.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.267+0000 7f6699e07640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6694152d30 0x7f66940c3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57594/0 (socket says 172.21.15.88:57594) 2023-12-08T08:21:38.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.267+0000 7f6699e07640 1 -- 172.21.15.88:0/86011624 learned_addr learned my addr 172.21.15.88:0/86011624 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:38.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.267+0000 7f669a608640 1 --2- 172.21.15.88:0/86011624 >> v2:172.21.15.88:3300/0 conn(0x7f669406d6a0 0x7f66940a9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:38.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.267+0000 7f6699606640 1 --2- 172.21.15.88:0/86011624 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f669415cba0 0x7f669406d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:38.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.267+0000 7f6698e05640 1 -- 172.21.15.88:0/86011624 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2049474846 0 0) 0x7f669415c710 con 0x7f6694152d30 2023-12-08T08:21:38.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.267+0000 7f6698e05640 1 -- 172.21.15.88:0/86011624 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6680003530 con 0x7f6694152d30 2023-12-08T08:21:38.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.267+0000 7f669a608640 1 -- 172.21.15.88:0/86011624 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f669415cba0 msgr2=0x7f669406d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:38.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.267+0000 7f669a608640 1 --2- 172.21.15.88:0/86011624 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f669415cba0 0x7f669406d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:38.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.267+0000 7f669a608640 1 -- 172.21.15.88:0/86011624 >> v1:172.21.15.88:6789/0 conn(0x7f6694152d30 legacy=0x7f66940c3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:38.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.267+0000 7f669a608640 1 -- 172.21.15.88:0/86011624 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66940c4040 con 0x7f669406d6a0 2023-12-08T08:21:38.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.271+0000 7f669a608640 1 --2- 172.21.15.88:0/86011624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f669406d6a0 0x7f66940a9af0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f668c009d90 tx=0x7f668c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce79b4e076c08ead server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:38.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.271+0000 7f6698e05640 1 -- 172.21.15.88:0/86011624 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c0a5a10 con 0x7f669406d6a0 2023-12-08T08:21:38.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.271+0000 7f6698e05640 1 -- 172.21.15.88:0/86011624 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668c0a5b70 con 0x7f669406d6a0 2023-12-08T08:21:38.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.271+0000 7f6698e05640 1 -- 172.21.15.88:0/86011624 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c0ad440 con 0x7f669406d6a0 2023-12-08T08:21:38.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.271+0000 7f669c06b640 1 -- 172.21.15.88:0/86011624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f669406d6a0 msgr2=0x7f66940a9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:38.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.271+0000 7f669c06b640 1 --2- 172.21.15.88:0/86011624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f669406d6a0 0x7f66940a9af0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f668c009d90 tx=0x7f668c01c950 comp rx=0 tx=0).stop 2023-12-08T08:21:38.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.271+0000 7f669c06b640 1 -- 172.21.15.88:0/86011624 shutdown_connections 2023-12-08T08:21:38.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.271+0000 7f669c06b640 1 --2- 172.21.15.88:0/86011624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f669406d6a0 0x7f66940a9af0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:38.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.271+0000 7f669c06b640 1 --2- 172.21.15.88:0/86011624 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f669415cba0 0x7f669406d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:38.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.271+0000 7f669c06b640 1 -- 172.21.15.88:0/86011624 >> 172.21.15.88:0/86011624 conn(0x7f669406b220 msgr2=0x7f66940a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:38.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.271+0000 7f669c06b640 1 -- 172.21.15.88:0/86011624 shutdown_connections 2023-12-08T08:21:38.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.271+0000 7f669c06b640 1 -- 172.21.15.88:0/86011624 wait complete. 2023-12-08T08:21:38.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.271+0000 7f669c06b640 1 Processor -- start 2023-12-08T08:21:38.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.275+0000 7f669c06b640 1 -- start start 2023-12-08T08:21:38.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.275+0000 7f669c06b640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f669406d6a0 0x7f6694148a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:38.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.275+0000 7f669c06b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6694152d30 0x7f669415b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:38.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.275+0000 7f669c06b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f669415cba0 0x7f6694150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:38.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.275+0000 7f669c06b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66940a6970 con 0x7f6694152d30 2023-12-08T08:21:38.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.275+0000 7f669c06b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66940a58d0 con 0x7f669415cba0 2023-12-08T08:21:38.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.275+0000 7f669c06b640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66940a5bb0 con 0x7f669406d6a0 2023-12-08T08:21:38.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.275+0000 7f6699606640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6694152d30 0x7f669415b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:38.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.275+0000 7f6699606640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6694152d30 0x7f669415b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39132/0 (socket says 172.21.15.88:39132) 2023-12-08T08:21:38.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.275+0000 7f6699606640 1 -- 172.21.15.88:0/2096248679 learned_addr learned my addr 172.21.15.88:0/2096248679 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:38.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.275+0000 7f6699e07640 1 --2- 172.21.15.88:0/2096248679 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f669406d6a0 0x7f6694148a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:38.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.275+0000 7f669a608640 1 --2- 172.21.15.88:0/2096248679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f669415cba0 0x7f6694150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:38.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.275+0000 7f6699606640 1 -- 172.21.15.88:0/2096248679 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f669406d6a0 msgr2=0x7f6694148a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:38.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.275+0000 7f6699606640 1 --2- 172.21.15.88:0/2096248679 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f669406d6a0 0x7f6694148a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:38.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.275+0000 7f6699606640 1 -- 172.21.15.88:0/2096248679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f669415cba0 msgr2=0x7f6694150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:38.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.275+0000 7f6699606640 1 --2- 172.21.15.88:0/2096248679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f669415cba0 0x7f6694150c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:38.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.275+0000 7f6699606640 1 -- 172.21.15.88:0/2096248679 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668c009a70 con 0x7f6694152d30 2023-12-08T08:21:38.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.275+0000 7f669a608640 1 --2- 172.21.15.88:0/2096248679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f669415cba0 0x7f6694150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:38.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.275+0000 7f6699606640 1 --2- 172.21.15.88:0/2096248679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6694152d30 0x7f669415b180 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f668400e870 tx=0x7f668400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:38.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.275+0000 7f668a7fc640 1 -- 172.21.15.88:0/2096248679 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6684009510 con 0x7f6694152d30 2023-12-08T08:21:38.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.275+0000 7f668a7fc640 1 -- 172.21.15.88:0/2096248679 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668400eec0 con 0x7f6694152d30 2023-12-08T08:21:38.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.275+0000 7f668a7fc640 1 -- 172.21.15.88:0/2096248679 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668400cb40 con 0x7f6694152d30 2023-12-08T08:21:38.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.275+0000 7f669c06b640 1 -- 172.21.15.88:0/2096248679 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66940a5e90 con 0x7f6694152d30 2023-12-08T08:21:38.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.275+0000 7f669c06b640 1 -- 172.21.15.88:0/2096248679 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66940a6450 con 0x7f6694152d30 2023-12-08T08:21:38.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.275+0000 7f669c06b640 1 -- 172.21.15.88:0/2096248679 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66940a6610 con 0x7f6694152d30 2023-12-08T08:21:38.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.279+0000 7f668a7fc640 1 -- 172.21.15.88:0/2096248679 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f668400cca0 con 0x7f6694152d30 2023-12-08T08:21:38.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.279+0000 7f668a7fc640 1 --2- 172.21.15.88:0/2096248679 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6678066470 0x7f6678068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:38.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.279+0000 7f668a7fc640 1 -- 172.21.15.88:0/2096248679 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f66840842c0 con 0x7f6694152d30 2023-12-08T08:21:38.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.279+0000 7f6699e07640 1 --2- 172.21.15.88:0/2096248679 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6678066470 0x7f6678068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:38.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.279+0000 7f6699e07640 1 --2- 172.21.15.88:0/2096248679 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6678066470 0x7f6678068930 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f66900011f0 tx=0x7f6690007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:38.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.283+0000 7f668a7fc640 1 -- 172.21.15.88:0/2096248679 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6684051480 con 0x7f6694152d30 2023-12-08T08:21:38.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.443+0000 7f669c06b640 1 -- 172.21.15.88:0/2096248679 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6694067630 con 0x7f6694152d30 2023-12-08T08:21:38.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.443+0000 7f668a7fc640 1 -- 172.21.15.88:0/2096248679 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6684054aa0 con 0x7f6694152d30 2023-12-08T08:21:38.447 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-12-08T08:21:38.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.443+0000 7f669c06b640 1 -- 172.21.15.88:0/2096248679 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6678066470 msgr2=0x7f6678068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:38.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.443+0000 7f669c06b640 1 --2- 172.21.15.88:0/2096248679 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6678066470 0x7f6678068930 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f66900011f0 tx=0x7f6690007d40 comp rx=0 tx=0).stop 2023-12-08T08:21:38.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.443+0000 7f669c06b640 1 -- 172.21.15.88:0/2096248679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6694152d30 msgr2=0x7f669415b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:38.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.443+0000 7f669c06b640 1 --2- 172.21.15.88:0/2096248679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6694152d30 0x7f669415b180 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f668400e870 tx=0x7f668400ec70 comp rx=0 tx=0).stop 2023-12-08T08:21:38.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.443+0000 7f669c06b640 1 -- 172.21.15.88:0/2096248679 shutdown_connections 2023-12-08T08:21:38.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.443+0000 7f669c06b640 1 --2- 172.21.15.88:0/2096248679 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6678066470 0x7f6678068930 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:38.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.443+0000 7f669c06b640 1 --2- 172.21.15.88:0/2096248679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f669415cba0 0x7f6694150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:38.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.443+0000 7f669c06b640 1 --2- 172.21.15.88:0/2096248679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6694152d30 0x7f669415b180 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:38.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.443+0000 7f669c06b640 1 --2- 172.21.15.88:0/2096248679 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f669406d6a0 0x7f6694148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:38.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.443+0000 7f669c06b640 1 -- 172.21.15.88:0/2096248679 >> 172.21.15.88:0/2096248679 conn(0x7f669406b220 msgr2=0x7f6694159f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:38.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.443+0000 7f669c06b640 1 -- 172.21.15.88:0/2096248679 shutdown_connections 2023-12-08T08:21:38.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.443+0000 7f669c06b640 1 -- 172.21.15.88:0/2096248679 wait complete. 2023-12-08T08:21:38.468 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-08T08:21:38.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:38.468 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-08T08:21:38.499 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-12-08T08:21:38.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:38.499 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-08T08:21:38.552 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:21:38.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.683+0000 7ff8b60e3640 1 Processor -- start 2023-12-08T08:21:38.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.683+0000 7ff8b60e3640 1 -- start start 2023-12-08T08:21:38.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.687+0000 7ff8b60e3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8b006d2b0 0x7ff8b006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:38.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.687+0000 7ff8b60e3640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff8b00c3b80 0x7ff8b00c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:38.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.687+0000 7ff8b60e3640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b006bb80 con 0x7ff8b006c020 2023-12-08T08:21:38.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.687+0000 7ff8b60e3640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b00c5840 con 0x7ff8b00c3b80 2023-12-08T08:21:38.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.687+0000 7ff8b60e3640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b01515c0 con 0x7ff8b006d2b0 2023-12-08T08:21:38.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.687+0000 7ff8aeffd640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff8b00c3b80 0x7ff8b00c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:38.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.687+0000 7ff8af7fe640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8b006d2b0 0x7ff8b006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:38.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.687+0000 7ff8aeffd640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff8b00c3b80 0x7ff8b00c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:51408/0 (socket says 172.21.15.88:51408) 2023-12-08T08:21:38.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.687+0000 7ff8aeffd640 1 -- 172.21.15.88:0/4183490296 learned_addr learned my addr 172.21.15.88:0/4183490296 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:38.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.687+0000 7ff8af7fe640 1 -- 172.21.15.88:0/4183490296 >> v2:172.21.15.148:3300/0 conn(0x7ff8b00c3b80 msgr2=0x7ff8b00c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:38.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.687+0000 7ff8af7fe640 1 --2- 172.21.15.88:0/4183490296 >> v2:172.21.15.148:3300/0 conn(0x7ff8b00c3b80 0x7ff8b00c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:38.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.687+0000 7ff8af7fe640 1 -- 172.21.15.88:0/4183490296 >> v1:172.21.15.148:6789/0 conn(0x7ff8b006c020 legacy=0x7ff8b006c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:38.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.687+0000 7ff8af7fe640 1 -- 172.21.15.88:0/4183490296 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b01518a0 con 0x7ff8b006d2b0 2023-12-08T08:21:38.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.687+0000 7ff8aeffd640 1 --2- 172.21.15.88:0/4183490296 >> v2:172.21.15.148:3300/0 conn(0x7ff8b00c3b80 0x7ff8b00c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:21:38.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.691+0000 7ff8af7fe640 1 --2- 172.21.15.88:0/4183490296 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8b006d2b0 0x7ff8b006d690 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff8a000ba60 tx=0x7ff8a001eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62ffcdb404363fd3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:38.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.691+0000 7ff8ae7fc640 1 -- 172.21.15.88:0/4183490296 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a00a7a00 con 0x7ff8b006d2b0 2023-12-08T08:21:38.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.691+0000 7ff8ae7fc640 1 -- 172.21.15.88:0/4183490296 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a00a7b60 con 0x7ff8b006d2b0 2023-12-08T08:21:38.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.691+0000 7ff8ae7fc640 1 -- 172.21.15.88:0/4183490296 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a00af440 con 0x7ff8b006d2b0 2023-12-08T08:21:38.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.691+0000 7ff8b60e3640 1 -- 172.21.15.88:0/4183490296 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8b006d2b0 msgr2=0x7ff8b006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:38.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.691+0000 7ff8b60e3640 1 --2- 172.21.15.88:0/4183490296 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8b006d2b0 0x7ff8b006d690 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff8a000ba60 tx=0x7ff8a001eb20 comp rx=0 tx=0).stop 2023-12-08T08:21:38.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.691+0000 7ff8b60e3640 1 -- 172.21.15.88:0/4183490296 shutdown_connections 2023-12-08T08:21:38.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.691+0000 7ff8b60e3640 1 --2- 172.21.15.88:0/4183490296 >> v2:172.21.15.148:3300/0 conn(0x7ff8b00c3b80 0x7ff8b00c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:38.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.691+0000 7ff8b60e3640 1 --2- 172.21.15.88:0/4183490296 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8b006d2b0 0x7ff8b006d690 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:38.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.691+0000 7ff8b60e3640 1 -- 172.21.15.88:0/4183490296 >> 172.21.15.88:0/4183490296 conn(0x7ff8b00a7810 msgr2=0x7ff8b00a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:38.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.691+0000 7ff8b60e3640 1 -- 172.21.15.88:0/4183490296 shutdown_connections 2023-12-08T08:21:38.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.691+0000 7ff8b60e3640 1 -- 172.21.15.88:0/4183490296 wait complete. 2023-12-08T08:21:38.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.691+0000 7ff8b60e3640 1 Processor -- start 2023-12-08T08:21:38.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.691+0000 7ff8b60e3640 1 -- start start 2023-12-08T08:21:38.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.695+0000 7ff8b60e3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b006c020 0x7ff8b00aa250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:38.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.695+0000 7ff8b60e3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8b006d2b0 0x7ff8b00c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:38.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.695+0000 7ff8b60e3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8b00c3b80 0x7ff8b01ed570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:38.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.695+0000 7ff8b60e3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b01ed0e0 con 0x7ff8b006c020 2023-12-08T08:21:38.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.695+0000 7ff8b60e3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b01f11a0 con 0x7ff8b006d2b0 2023-12-08T08:21:38.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.695+0000 7ff8b60e3640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b01ecd90 con 0x7ff8b00c3b80 2023-12-08T08:21:38.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.695+0000 7ff8af7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b006c020 0x7ff8b00aa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:38.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.695+0000 7ff8af7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b006c020 0x7ff8b00aa250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39138/0 (socket says 172.21.15.88:39138) 2023-12-08T08:21:38.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.695+0000 7ff8af7fe640 1 -- 172.21.15.88:0/3644744436 learned_addr learned my addr 172.21.15.88:0/3644744436 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:38.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.695+0000 7ff8aeffd640 1 --2- 172.21.15.88:0/3644744436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8b006d2b0 0x7ff8b00c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:38.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.695+0000 7ff8affff640 1 --2- 172.21.15.88:0/3644744436 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8b00c3b80 0x7ff8b01ed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:38.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.695+0000 7ff8af7fe640 1 -- 172.21.15.88:0/3644744436 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8b00c3b80 msgr2=0x7ff8b01ed570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:38.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.695+0000 7ff8af7fe640 1 --2- 172.21.15.88:0/3644744436 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8b00c3b80 0x7ff8b01ed570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:38.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.695+0000 7ff8af7fe640 1 -- 172.21.15.88:0/3644744436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8b006d2b0 msgr2=0x7ff8b00c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:38.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.695+0000 7ff8af7fe640 1 --2- 172.21.15.88:0/3644744436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8b006d2b0 0x7ff8b00c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:38.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.695+0000 7ff8af7fe640 1 -- 172.21.15.88:0/3644744436 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a40094d0 con 0x7ff8b006c020 2023-12-08T08:21:38.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.695+0000 7ff8affff640 1 --2- 172.21.15.88:0/3644744436 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8b00c3b80 0x7ff8b01ed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:38.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.695+0000 7ff8af7fe640 1 --2- 172.21.15.88:0/3644744436 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b006c020 0x7ff8b00aa250 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff8a001c750 tx=0x7ff8a001b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:38.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.695+0000 7ff897fff640 1 -- 172.21.15.88:0/3644744436 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a00b0cc0 con 0x7ff8b006c020 2023-12-08T08:21:38.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.695+0000 7ff897fff640 1 -- 172.21.15.88:0/3644744436 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a00b0e20 con 0x7ff8b006c020 2023-12-08T08:21:38.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.695+0000 7ff8b60e3640 1 -- 172.21.15.88:0/3644744436 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a000b6c0 con 0x7ff8b006c020 2023-12-08T08:21:38.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.695+0000 7ff897fff640 1 -- 172.21.15.88:0/3644744436 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a00ba670 con 0x7ff8b006c020 2023-12-08T08:21:38.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.695+0000 7ff8b60e3640 1 -- 172.21.15.88:0/3644744436 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b014ef80 con 0x7ff8b006c020 2023-12-08T08:21:38.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.695+0000 7ff8b60e3640 1 -- 172.21.15.88:0/3644744436 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b00a82b0 con 0x7ff8b006c020 2023-12-08T08:21:38.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.699+0000 7ff897fff640 1 -- 172.21.15.88:0/3644744436 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff8a00b6070 con 0x7ff8b006c020 2023-12-08T08:21:38.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.699+0000 7ff897fff640 1 --2- 172.21.15.88:0/3644744436 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff89c0664a0 0x7ff89c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:38.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.699+0000 7ff897fff640 1 -- 172.21.15.88:0/3644744436 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff8a011f220 con 0x7ff8b006c020 2023-12-08T08:21:38.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.699+0000 7ff8aeffd640 1 --2- 172.21.15.88:0/3644744436 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff89c0664a0 0x7ff89c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:38.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.699+0000 7ff8aeffd640 1 --2- 172.21.15.88:0/3644744436 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff89c0664a0 0x7ff89c068960 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff8b014bd80 tx=0x7ff8a4009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:38.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.703+0000 7ff897fff640 1 -- 172.21.15.88:0/3644744436 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff8a00ec330 con 0x7ff8b006c020 2023-12-08T08:21:38.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.883+0000 7ff8b60e3640 1 -- 172.21.15.88:0/3644744436 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8b0067630 con 0x7ff8b006c020 2023-12-08T08:21:38.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.883+0000 7ff897fff640 1 -- 172.21.15.88:0/3644744436 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6133 (secure 0 0 0) 0x7ff8a00ef950 con 0x7ff8b006c020 2023-12-08T08:21:38.889 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:38.889 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4978,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3372523869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3372523869},{"type":"v1","addr":"172.21.15.148:6834","nonce":3372523869}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4085245492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":4085245492},{"type":"v1","addr":"172.21.15.148:6835","nonce":4085245492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:21:05.130882+0000","modified":"2023-12-08T08:21:08.148991+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5049},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5049":{"gid":5049,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/181654220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":181654220},{"type":"v1","addr":"172.21.15.88:6837","nonce":181654220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:21:18.029250+0000","modified":"2023-12-08T08:21:21.056129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.88:6836/4274252181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":4274252181},{"type":"v1","addr":"172.21.15.88:6836","nonce":4274252181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-08T08:21:38.890 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 22 2023-12-08T08:21:38.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.887+0000 7ff8b60e3640 1 -- 172.21.15.88:0/3644744436 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff89c0664a0 msgr2=0x7ff89c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:38.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.887+0000 7ff8b60e3640 1 --2- 172.21.15.88:0/3644744436 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff89c0664a0 0x7ff89c068960 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff8b014bd80 tx=0x7ff8a4009240 comp rx=0 tx=0).stop 2023-12-08T08:21:38.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.887+0000 7ff8b60e3640 1 -- 172.21.15.88:0/3644744436 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b006c020 msgr2=0x7ff8b00aa250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:38.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.887+0000 7ff8b60e3640 1 --2- 172.21.15.88:0/3644744436 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b006c020 0x7ff8b00aa250 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff8a001c750 tx=0x7ff8a001b8c0 comp rx=0 tx=0).stop 2023-12-08T08:21:38.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.887+0000 7ff8b60e3640 1 -- 172.21.15.88:0/3644744436 shutdown_connections 2023-12-08T08:21:38.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.887+0000 7ff8b60e3640 1 --2- 172.21.15.88:0/3644744436 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff89c0664a0 0x7ff89c068960 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:38.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.887+0000 7ff8b60e3640 1 --2- 172.21.15.88:0/3644744436 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff8b00c3b80 0x7ff8b01ed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:38.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.887+0000 7ff8b60e3640 1 --2- 172.21.15.88:0/3644744436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8b006d2b0 0x7ff8b00c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:38.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.887+0000 7ff8b60e3640 1 --2- 172.21.15.88:0/3644744436 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8b006c020 0x7ff8b00aa250 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:38.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.887+0000 7ff8b60e3640 1 -- 172.21.15.88:0/3644744436 >> 172.21.15.88:0/3644744436 conn(0x7ff8b00a7810 msgr2=0x7ff8b006c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:38.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.887+0000 7ff8b60e3640 1 -- 172.21.15.88:0/3644744436 shutdown_connections 2023-12-08T08:21:38.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:38.887+0000 7ff8b60e3640 1 -- 172.21.15.88:0/3644744436 wait complete. 2023-12-08T08:21:38.911 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:21:39.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.043+0000 7f9d80980640 1 Processor -- start 2023-12-08T08:21:39.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.043+0000 7f9d80980640 1 -- start start 2023-12-08T08:21:39.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.043+0000 7f9d80980640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9d7c151bf0 0x7f9d7c06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:39.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.043+0000 7f9d80980640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d7c06d890 0x7f9d7c154610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:39.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.047+0000 7f9d80980640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9d7c06bb00 0x7f9d7c154b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:39.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.047+0000 7f9d80980640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d7c158a40 con 0x7f9d7c151bf0 2023-12-08T08:21:39.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.047+0000 7f9d80980640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d7c1584c0 con 0x7f9d7c06bb00 2023-12-08T08:21:39.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.047+0000 7f9d80980640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c158760 con 0x7f9d7c06d890 2023-12-08T08:21:39.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.047+0000 7f9d7a59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9d7c151bf0 0x7f9d7c06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:39.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.047+0000 7f9d7a59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9d7c151bf0 0x7f9d7c06b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39152/0 (socket says 172.21.15.88:39152) 2023-12-08T08:21:39.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.047+0000 7f9d7a59c640 1 -- 172.21.15.88:0/4176235949 learned_addr learned my addr 172.21.15.88:0/4176235949 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:39.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.047+0000 7f9d79d9b640 1 --2- 172.21.15.88:0/4176235949 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d7c06d890 0x7f9d7c154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:39.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.047+0000 7f9d7ad9d640 1 --2- 172.21.15.88:0/4176235949 >> v2:172.21.15.148:3300/0 conn(0x7f9d7c06bb00 0x7f9d7c154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:39.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.047+0000 7f9d7a59c640 1 -- 172.21.15.88:0/4176235949 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d7c06d890 msgr2=0x7f9d7c154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:39.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.047+0000 7f9d7a59c640 1 --2- 172.21.15.88:0/4176235949 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d7c06d890 0x7f9d7c154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.047+0000 7f9d7a59c640 1 -- 172.21.15.88:0/4176235949 >> v2:172.21.15.148:3300/0 conn(0x7f9d7c06bb00 msgr2=0x7f9d7c154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:39.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.047+0000 7f9d7a59c640 1 --2- 172.21.15.88:0/4176235949 >> v2:172.21.15.148:3300/0 conn(0x7f9d7c06bb00 0x7f9d7c154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.047+0000 7f9d7a59c640 1 -- 172.21.15.88:0/4176235949 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c0c0ce0 con 0x7f9d7c151bf0 2023-12-08T08:21:39.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.047+0000 7f9d7a59c640 1 --2- 172.21.15.88:0/4176235949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d7c151bf0 0x7f9d7c06b5c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c0667c0 tx=0x7f9d6c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28bb83f03ab8a074 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:39.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.047+0000 7f9d7959a640 1 -- 172.21.15.88:0/4176235949 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c0aa5f0 con 0x7f9d7c151bf0 2023-12-08T08:21:39.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.047+0000 7f9d7959a640 1 -- 172.21.15.88:0/4176235949 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6c0aa750 con 0x7f9d7c151bf0 2023-12-08T08:21:39.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.047+0000 7f9d7959a640 1 -- 172.21.15.88:0/4176235949 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c0aaae0 con 0x7f9d7c151bf0 2023-12-08T08:21:39.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.051+0000 7f9d80980640 1 -- 172.21.15.88:0/4176235949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d7c151bf0 msgr2=0x7f9d7c06b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:39.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.051+0000 7f9d80980640 1 --2- 172.21.15.88:0/4176235949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d7c151bf0 0x7f9d7c06b5c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c0667c0 tx=0x7f9d6c01c4d0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.051+0000 7f9d80980640 1 -- 172.21.15.88:0/4176235949 shutdown_connections 2023-12-08T08:21:39.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.051+0000 7f9d80980640 1 --2- 172.21.15.88:0/4176235949 >> v2:172.21.15.148:3300/0 conn(0x7f9d7c06bb00 0x7f9d7c154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.051+0000 7f9d80980640 1 --2- 172.21.15.88:0/4176235949 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d7c06d890 0x7f9d7c154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.051+0000 7f9d80980640 1 --2- 172.21.15.88:0/4176235949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d7c151bf0 0x7f9d7c06b5c0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.051+0000 7f9d80980640 1 -- 172.21.15.88:0/4176235949 >> 172.21.15.88:0/4176235949 conn(0x7f9d7c0c61f0 msgr2=0x7f9d7c0c6600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:39.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.051+0000 7f9d80980640 1 -- 172.21.15.88:0/4176235949 shutdown_connections 2023-12-08T08:21:39.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.051+0000 7f9d80980640 1 -- 172.21.15.88:0/4176235949 wait complete. 2023-12-08T08:21:39.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.051+0000 7f9d80980640 1 Processor -- start 2023-12-08T08:21:39.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.051+0000 7f9d80980640 1 -- start start 2023-12-08T08:21:39.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.051+0000 7f9d80980640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d7c06bb00 0x7f9d7c0707e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:39.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.051+0000 7f9d80980640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d7c06d890 0x7f9d7c13f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:39.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.051+0000 7f9d80980640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d7c151bf0 0x7f9d7c13fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:39.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.051+0000 7f9d80980640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c0715b0 con 0x7f9d7c06d890 2023-12-08T08:21:39.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.051+0000 7f9d80980640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c072af0 con 0x7f9d7c151bf0 2023-12-08T08:21:39.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.051+0000 7f9d80980640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c140050 con 0x7f9d7c06bb00 2023-12-08T08:21:39.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.051+0000 7f9d79d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d7c06d890 0x7f9d7c13f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:39.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.051+0000 7f9d79d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d7c06d890 0x7f9d7c13f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39154/0 (socket says 172.21.15.88:39154) 2023-12-08T08:21:39.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.051+0000 7f9d79d9b640 1 -- 172.21.15.88:0/3162267439 learned_addr learned my addr 172.21.15.88:0/3162267439 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:39.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.051+0000 7f9d7a59c640 1 --2- 172.21.15.88:0/3162267439 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d7c06bb00 0x7f9d7c0707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:39.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.051+0000 7f9d7ad9d640 1 --2- 172.21.15.88:0/3162267439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d7c151bf0 0x7f9d7c13fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:39.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.055+0000 7f9d79d9b640 1 -- 172.21.15.88:0/3162267439 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d7c06bb00 msgr2=0x7f9d7c0707e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:39.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.055+0000 7f9d79d9b640 1 --2- 172.21.15.88:0/3162267439 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d7c06bb00 0x7f9d7c0707e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.055+0000 7f9d79d9b640 1 -- 172.21.15.88:0/3162267439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d7c151bf0 msgr2=0x7f9d7c13fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:39.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.055+0000 7f9d79d9b640 1 --2- 172.21.15.88:0/3162267439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d7c151bf0 0x7f9d7c13fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.055+0000 7f9d79d9b640 1 -- 172.21.15.88:0/3162267439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6c0094d0 con 0x7f9d7c06d890 2023-12-08T08:21:39.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.055+0000 7f9d79d9b640 1 --2- 172.21.15.88:0/3162267439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d7c06d890 0x7f9d7c13f5d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9d7000e930 tx=0x7f9d7000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:39.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.055+0000 7f9d6affd640 1 -- 172.21.15.88:0/3162267439 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d70009690 con 0x7f9d7c06d890 2023-12-08T08:21:39.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.055+0000 7f9d6affd640 1 -- 172.21.15.88:0/3162267439 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7000ca00 con 0x7f9d7c06d890 2023-12-08T08:21:39.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.055+0000 7f9d6affd640 1 -- 172.21.15.88:0/3162267439 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7000cd70 con 0x7f9d7c06d890 2023-12-08T08:21:39.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.055+0000 7f9d80980640 1 -- 172.21.15.88:0/3162267439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d7c1f0a60 con 0x7f9d7c06d890 2023-12-08T08:21:39.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.055+0000 7f9d80980640 1 -- 172.21.15.88:0/3162267439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7c072570 con 0x7f9d7c06d890 2023-12-08T08:21:39.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.055+0000 7f9d80980640 1 -- 172.21.15.88:0/3162267439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d7c0a93c0 con 0x7f9d7c06d890 2023-12-08T08:21:39.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.055+0000 7f9d6affd640 1 -- 172.21.15.88:0/3162267439 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9d70013470 con 0x7f9d7c06d890 2023-12-08T08:21:39.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.055+0000 7f9d6affd640 1 --2- 172.21.15.88:0/3162267439 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9d5c066470 0x7f9d5c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:39.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.055+0000 7f9d6affd640 1 -- 172.21.15.88:0/3162267439 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9d70084300 con 0x7f9d7c06d890 2023-12-08T08:21:39.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.055+0000 7f9d7a59c640 1 --2- 172.21.15.88:0/3162267439 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9d5c066470 0x7f9d5c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:39.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.059+0000 7f9d7a59c640 1 --2- 172.21.15.88:0/3162267439 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9d5c066470 0x7f9d5c068930 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c0ae000 tx=0x7f9d6c0b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:39.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.059+0000 7f9d6affd640 1 -- 172.21.15.88:0/3162267439 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9d70051590 con 0x7f9d7c06d890 2023-12-08T08:21:39.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.211+0000 7f9d80980640 1 -- 172.21.15.88:0/3162267439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d7c0723b0 con 0x7f9d7c06d890 2023-12-08T08:21:39.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.211+0000 7f9d6affd640 1 -- 172.21.15.88:0/3162267439 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20205 (secure 0 0 0) 0x7f9d70054bb0 con 0x7f9d7c06d890 2023-12-08T08:21:39.217 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:39.218 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":35,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:21:19.666744+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:21:03.690721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-08T08:21:04.127786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:21:16.039054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:21:17.029894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:21:39.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.215+0000 7f9d80980640 1 -- 172.21.15.88:0/3162267439 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9d5c066470 msgr2=0x7f9d5c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:39.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.215+0000 7f9d80980640 1 --2- 172.21.15.88:0/3162267439 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9d5c066470 0x7f9d5c068930 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c0ae000 tx=0x7f9d6c0b5040 comp rx=0 tx=0).stop 2023-12-08T08:21:39.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.215+0000 7f9d80980640 1 -- 172.21.15.88:0/3162267439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d7c06d890 msgr2=0x7f9d7c13f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:39.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.215+0000 7f9d80980640 1 --2- 172.21.15.88:0/3162267439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d7c06d890 0x7f9d7c13f5d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9d7000e930 tx=0x7f9d7000edf0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.215+0000 7f9d80980640 1 -- 172.21.15.88:0/3162267439 shutdown_connections 2023-12-08T08:21:39.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.215+0000 7f9d80980640 1 --2- 172.21.15.88:0/3162267439 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9d5c066470 0x7f9d5c068930 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.215+0000 7f9d80980640 1 --2- 172.21.15.88:0/3162267439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d7c151bf0 0x7f9d7c13fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.215+0000 7f9d80980640 1 --2- 172.21.15.88:0/3162267439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d7c06d890 0x7f9d7c13f5d0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.215+0000 7f9d80980640 1 --2- 172.21.15.88:0/3162267439 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9d7c06bb00 0x7f9d7c0707e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.215+0000 7f9d80980640 1 -- 172.21.15.88:0/3162267439 >> 172.21.15.88:0/3162267439 conn(0x7f9d7c0c61f0 msgr2=0x7f9d7c14bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:39.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.215+0000 7f9d80980640 1 -- 172.21.15.88:0/3162267439 shutdown_connections 2023-12-08T08:21:39.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.215+0000 7f9d80980640 1 -- 172.21.15.88:0/3162267439 wait complete. 2023-12-08T08:21:39.238 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:21:03.690721+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:21:04.127786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:21:16.039054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:21:17.029894+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:21:39.238 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:21:39.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.375+0000 7f1f4a481640 1 Processor -- start 2023-12-08T08:21:39.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.375+0000 7f1f4a481640 1 -- start start 2023-12-08T08:21:39.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.375+0000 7f1f4a481640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1f4406c630 0x7f1f440c3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:39.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.375+0000 7f1f4a481640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f441591a0 0x7f1f440c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:39.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.375+0000 7f1f4a481640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f4406bfd0 con 0x7f1f44155d30 2023-12-08T08:21:39.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.375+0000 7f1f4a481640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f44159740 con 0x7f1f4406c630 2023-12-08T08:21:39.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.375+0000 7f1f4a481640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f44156110 con 0x7f1f441591a0 2023-12-08T08:21:39.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.375+0000 7f1f48c7e640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1f4406c630 0x7f1f440c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:39.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.375+0000 7f1f49c80640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f441591a0 0x7f1f440c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:39.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.375+0000 7f1f4947f640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f1f44155d30 0x7f1f440c05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:47860/0 (socket says 172.21.15.88:47860) 2023-12-08T08:21:39.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.375+0000 7f1f48c7e640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1f4406c630 0x7f1f440c3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:51444/0 (socket says 172.21.15.88:51444) 2023-12-08T08:21:39.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.375+0000 7f1f4947f640 1 -- 172.21.15.88:0/4037737039 learned_addr learned my addr 172.21.15.88:0/4037737039 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:39.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.375+0000 7f1f48c7e640 1 -- 172.21.15.88:0/4037737039 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f441591a0 msgr2=0x7f1f440c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:39.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.375+0000 7f1f48c7e640 1 --2- 172.21.15.88:0/4037737039 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f441591a0 0x7f1f440c3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.375+0000 7f1f48c7e640 1 -- 172.21.15.88:0/4037737039 >> v1:172.21.15.148:6789/0 conn(0x7f1f44155d30 legacy=0x7f1f440c05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:39.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.375+0000 7f1f48c7e640 1 -- 172.21.15.88:0/4037737039 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4406c270 con 0x7f1f4406c630 2023-12-08T08:21:39.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.375+0000 7f1f49c80640 1 --2- 172.21.15.88:0/4037737039 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f441591a0 0x7f1f440c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:21:39.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.379+0000 7f1f48c7e640 1 --2- 172.21.15.88:0/4037737039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f4406c630 0x7f1f440c3750 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1f340097c0 tx=0x7f1f3401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e195e9c26bf7919b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:39.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.379+0000 7f1f3bfff640 1 -- 172.21.15.88:0/4037737039 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f340ab600 con 0x7f1f4406c630 2023-12-08T08:21:39.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.379+0000 7f1f3bfff640 1 -- 172.21.15.88:0/4037737039 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f340a7050 con 0x7f1f4406c630 2023-12-08T08:21:39.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.379+0000 7f1f3bfff640 1 -- 172.21.15.88:0/4037737039 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f340ab980 con 0x7f1f4406c630 2023-12-08T08:21:39.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.379+0000 7f1f4a481640 1 -- 172.21.15.88:0/4037737039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f4406c630 msgr2=0x7f1f440c3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:39.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.379+0000 7f1f4a481640 1 --2- 172.21.15.88:0/4037737039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f4406c630 0x7f1f440c3750 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1f340097c0 tx=0x7f1f3401c3f0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.379+0000 7f1f4a481640 1 -- 172.21.15.88:0/4037737039 shutdown_connections 2023-12-08T08:21:39.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.379+0000 7f1f4a481640 1 --2- 172.21.15.88:0/4037737039 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f441591a0 0x7f1f440c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.379+0000 7f1f4a481640 1 --2- 172.21.15.88:0/4037737039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f4406c630 0x7f1f440c3750 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.379+0000 7f1f4a481640 1 -- 172.21.15.88:0/4037737039 >> 172.21.15.88:0/4037737039 conn(0x7f1f440c2350 msgr2=0x7f1f440c2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:39.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.379+0000 7f1f4a481640 1 -- 172.21.15.88:0/4037737039 shutdown_connections 2023-12-08T08:21:39.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.379+0000 7f1f4a481640 1 -- 172.21.15.88:0/4037737039 wait complete. 2023-12-08T08:21:39.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.383+0000 7f1f4a481640 1 Processor -- start 2023-12-08T08:21:39.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.383+0000 7f1f4a481640 1 -- start start 2023-12-08T08:21:39.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.383+0000 7f1f4a481640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f4406c630 0x7f1f440aa290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:39.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.383+0000 7f1f4a481640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f44155d30 0x7f1f4414e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:39.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.383+0000 7f1f4a481640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f441591a0 0x7f1f4414f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:39.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.383+0000 7f1f4a481640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f44159da0 con 0x7f1f44155d30 2023-12-08T08:21:39.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.383+0000 7f1f4a481640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f440aac40 con 0x7f1f4406c630 2023-12-08T08:21:39.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.383+0000 7f1f4a481640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f441f4960 con 0x7f1f441591a0 2023-12-08T08:21:39.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.383+0000 7f1f48c7e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f44155d30 0x7f1f4414e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:39.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.383+0000 7f1f48c7e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f44155d30 0x7f1f4414e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39170/0 (socket says 172.21.15.88:39170) 2023-12-08T08:21:39.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.383+0000 7f1f48c7e640 1 -- 172.21.15.88:0/2449304699 learned_addr learned my addr 172.21.15.88:0/2449304699 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:39.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.383+0000 7f1f4947f640 1 --2- 172.21.15.88:0/2449304699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f4406c630 0x7f1f440aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:39.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.383+0000 7f1f49c80640 1 --2- 172.21.15.88:0/2449304699 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f441591a0 0x7f1f4414f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:39.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.383+0000 7f1f48c7e640 1 -- 172.21.15.88:0/2449304699 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f441591a0 msgr2=0x7f1f4414f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:39.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.383+0000 7f1f48c7e640 1 --2- 172.21.15.88:0/2449304699 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f441591a0 0x7f1f4414f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.383+0000 7f1f48c7e640 1 -- 172.21.15.88:0/2449304699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f4406c630 msgr2=0x7f1f440aa290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:39.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.383+0000 7f1f48c7e640 1 --2- 172.21.15.88:0/2449304699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f4406c630 0x7f1f440aa290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.383+0000 7f1f48c7e640 1 -- 172.21.15.88:0/2449304699 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c009a70 con 0x7f1f44155d30 2023-12-08T08:21:39.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.383+0000 7f1f48c7e640 1 --2- 172.21.15.88:0/2449304699 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f44155d30 0x7f1f4414e9c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1f340097c0 tx=0x7f1f34019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:39.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.383+0000 7f1f39ffb640 1 -- 172.21.15.88:0/2449304699 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f34006e20 con 0x7f1f44155d30 2023-12-08T08:21:39.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.383+0000 7f1f39ffb640 1 -- 172.21.15.88:0/2449304699 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f340b4430 con 0x7f1f44155d30 2023-12-08T08:21:39.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.383+0000 7f1f39ffb640 1 -- 172.21.15.88:0/2449304699 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f340b47c0 con 0x7f1f44155d30 2023-12-08T08:21:39.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.383+0000 7f1f4a481640 1 -- 172.21.15.88:0/2449304699 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f34009420 con 0x7f1f44155d30 2023-12-08T08:21:39.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.383+0000 7f1f4a481640 1 -- 172.21.15.88:0/2449304699 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f440aa960 con 0x7f1f44155d30 2023-12-08T08:21:39.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.387+0000 7f1f4a481640 1 -- 172.21.15.88:0/2449304699 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f440674b0 con 0x7f1f44155d30 2023-12-08T08:21:39.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.387+0000 7f1f39ffb640 1 -- 172.21.15.88:0/2449304699 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1f340b2040 con 0x7f1f44155d30 2023-12-08T08:21:39.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.387+0000 7f1f39ffb640 1 --2- 172.21.15.88:0/2449304699 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1f280664a0 0x7f1f28068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:39.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.387+0000 7f1f39ffb640 1 -- 172.21.15.88:0/2449304699 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1f3411de20 con 0x7f1f44155d30 2023-12-08T08:21:39.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.387+0000 7f1f4947f640 1 --2- 172.21.15.88:0/2449304699 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1f280664a0 0x7f1f28068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:39.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.387+0000 7f1f4947f640 1 --2- 172.21.15.88:0/2449304699 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1f280664a0 0x7f1f28068960 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1f40005890 tx=0x7f1f40009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:39.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.391+0000 7f1f39ffb640 1 -- 172.21.15.88:0/2449304699 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1f340eafb0 con 0x7f1f44155d30 2023-12-08T08:21:39.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.543+0000 7f1f4a481640 1 -- 172.21.15.88:0/2449304699 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1f4415cb90 con 0x7f1f44155d30 2023-12-08T08:21:39.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.543+0000 7f1f39ffb640 1 -- 172.21.15.88:0/2449304699 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1f340b0020 con 0x7f1f44155d30 2023-12-08T08:21:39.548 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:21:39.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.543+0000 7f1f4a481640 1 -- 172.21.15.88:0/2449304699 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1f280664a0 msgr2=0x7f1f28068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:39.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.547+0000 7f1f4a481640 1 --2- 172.21.15.88:0/2449304699 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1f280664a0 0x7f1f28068960 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1f40005890 tx=0x7f1f40009040 comp rx=0 tx=0).stop 2023-12-08T08:21:39.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.547+0000 7f1f4a481640 1 -- 172.21.15.88:0/2449304699 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f44155d30 msgr2=0x7f1f4414e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:39.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.547+0000 7f1f4a481640 1 --2- 172.21.15.88:0/2449304699 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f44155d30 0x7f1f4414e9c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1f340097c0 tx=0x7f1f34019190 comp rx=0 tx=0).stop 2023-12-08T08:21:39.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.547+0000 7f1f4a481640 1 -- 172.21.15.88:0/2449304699 shutdown_connections 2023-12-08T08:21:39.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.547+0000 7f1f4a481640 1 --2- 172.21.15.88:0/2449304699 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1f280664a0 0x7f1f28068960 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.547+0000 7f1f4a481640 1 --2- 172.21.15.88:0/2449304699 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f441591a0 0x7f1f4414f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.547+0000 7f1f4a481640 1 --2- 172.21.15.88:0/2449304699 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f44155d30 0x7f1f4414e9c0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.547+0000 7f1f4a481640 1 --2- 172.21.15.88:0/2449304699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f4406c630 0x7f1f440aa290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.547+0000 7f1f4a481640 1 -- 172.21.15.88:0/2449304699 >> 172.21.15.88:0/2449304699 conn(0x7f1f440c2350 msgr2=0x7f1f440c0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:39.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.547+0000 7f1f4a481640 1 -- 172.21.15.88:0/2449304699 shutdown_connections 2023-12-08T08:21:39.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.547+0000 7f1f4a481640 1 -- 172.21.15.88:0/2449304699 wait complete. 2023-12-08T08:21:39.570 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:21:39.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.707+0000 7fe216a32640 1 Processor -- start 2023-12-08T08:21:39.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.707+0000 7fe216a32640 1 -- start start 2023-12-08T08:21:39.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.707+0000 7fe216a32640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe21014b1e0 0x7fe2100c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:39.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.707+0000 7fe216a32640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2101548c0 0x7fe210154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:39.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.707+0000 7fe216a32640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2100a4e20 con 0x7fe2100c5300 2023-12-08T08:21:39.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.707+0000 7fe216a32640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2100a50e0 con 0x7fe21014b1e0 2023-12-08T08:21:39.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.707+0000 7fe216a32640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2100c0f00 con 0x7fe2101548c0 2023-12-08T08:21:39.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.707+0000 7fe20ffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe21014b1e0 0x7fe2100c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:39.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.707+0000 7fe20ffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe21014b1e0 0x7fe2100c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39184/0 (socket says 172.21.15.88:39184) 2023-12-08T08:21:39.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.707+0000 7fe20ffff640 1 -- 172.21.15.88:0/835334680 learned_addr learned my addr 172.21.15.88:0/835334680 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:39.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.707+0000 7fe214fcf640 1 --2- 172.21.15.88:0/835334680 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2101548c0 0x7fe210154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:39.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.707+0000 7fe20ffff640 1 -- 172.21.15.88:0/835334680 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2101548c0 msgr2=0x7fe210154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:39.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.707+0000 7fe20ffff640 1 --2- 172.21.15.88:0/835334680 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2101548c0 0x7fe210154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.707+0000 7fe20ffff640 1 -- 172.21.15.88:0/835334680 >> v1:172.21.15.148:6789/0 conn(0x7fe2100c5300 legacy=0x7fe2100a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:39.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.707+0000 7fe20ffff640 1 -- 172.21.15.88:0/835334680 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2100c11e0 con 0x7fe21014b1e0 2023-12-08T08:21:39.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.711+0000 7fe20ffff640 1 --2- 172.21.15.88:0/835334680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe21014b1e0 0x7fe2100c1700 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe2100c4150 tx=0x7fe20001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749e53a53a939e35 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:39.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.711+0000 7fe20effd640 1 -- 172.21.15.88:0/835334680 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2000ac410 con 0x7fe21014b1e0 2023-12-08T08:21:39.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.711+0000 7fe20effd640 1 -- 172.21.15.88:0/835334680 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2000ac570 con 0x7fe21014b1e0 2023-12-08T08:21:39.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.711+0000 7fe20effd640 1 -- 172.21.15.88:0/835334680 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2000ac900 con 0x7fe21014b1e0 2023-12-08T08:21:39.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.711+0000 7fe216a32640 1 -- 172.21.15.88:0/835334680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe21014b1e0 msgr2=0x7fe2100c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:39.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.711+0000 7fe216a32640 1 --2- 172.21.15.88:0/835334680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe21014b1e0 0x7fe2100c1700 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe2100c4150 tx=0x7fe20001c4e0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.711+0000 7fe216a32640 1 -- 172.21.15.88:0/835334680 shutdown_connections 2023-12-08T08:21:39.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.711+0000 7fe216a32640 1 --2- 172.21.15.88:0/835334680 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe2101548c0 0x7fe210154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.711+0000 7fe216a32640 1 --2- 172.21.15.88:0/835334680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe21014b1e0 0x7fe2100c1700 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.711+0000 7fe216a32640 1 -- 172.21.15.88:0/835334680 >> 172.21.15.88:0/835334680 conn(0x7fe2100c59f0 msgr2=0x7fe2100c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:39.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.711+0000 7fe216a32640 1 -- 172.21.15.88:0/835334680 shutdown_connections 2023-12-08T08:21:39.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.711+0000 7fe216a32640 1 -- 172.21.15.88:0/835334680 wait complete. 2023-12-08T08:21:39.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.715+0000 7fe216a32640 1 Processor -- start 2023-12-08T08:21:39.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.715+0000 7fe216a32640 1 -- start start 2023-12-08T08:21:39.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.715+0000 7fe216a32640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2100c5300 0x7fe2100722a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:39.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.715+0000 7fe216a32640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe21014b1e0 0x7fe2100701d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:39.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.715+0000 7fe216a32640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2101548c0 0x7fe21014db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:39.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.715+0000 7fe216a32640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe210143db0 con 0x7fe2101548c0 2023-12-08T08:21:39.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.715+0000 7fe216a32640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21014d700 con 0x7fe2100c5300 2023-12-08T08:21:39.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.715+0000 7fe216a32640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe210144570 con 0x7fe21014b1e0 2023-12-08T08:21:39.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.715+0000 7fe214fcf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2101548c0 0x7fe21014db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:39.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.715+0000 7fe214fcf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2101548c0 0x7fe21014db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39194/0 (socket says 172.21.15.88:39194) 2023-12-08T08:21:39.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.715+0000 7fe214fcf640 1 -- 172.21.15.88:0/3977578486 learned_addr learned my addr 172.21.15.88:0/3977578486 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:39.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.715+0000 7fe20ffff640 1 --2- 172.21.15.88:0/3977578486 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2100c5300 0x7fe2100722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:39.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.715+0000 7fe20f7fe640 1 --2- 172.21.15.88:0/3977578486 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe21014b1e0 0x7fe2100701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:39.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.715+0000 7fe214fcf640 1 -- 172.21.15.88:0/3977578486 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe21014b1e0 msgr2=0x7fe2100701d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:39.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.715+0000 7fe214fcf640 1 --2- 172.21.15.88:0/3977578486 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe21014b1e0 0x7fe2100701d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.715+0000 7fe214fcf640 1 -- 172.21.15.88:0/3977578486 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2100c5300 msgr2=0x7fe2100722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:39.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.715+0000 7fe214fcf640 1 --2- 172.21.15.88:0/3977578486 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2100c5300 0x7fe2100722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.715+0000 7fe214fcf640 1 -- 172.21.15.88:0/3977578486 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2000094d0 con 0x7fe2101548c0 2023-12-08T08:21:39.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.715+0000 7fe214fcf640 1 --2- 172.21.15.88:0/3977578486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2101548c0 0x7fe21014db90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe208007e60 tx=0x7fe20800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:39.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.715+0000 7fe20cff9640 1 -- 172.21.15.88:0/3977578486 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe208014420 con 0x7fe2101548c0 2023-12-08T08:21:39.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.715+0000 7fe20cff9640 1 -- 172.21.15.88:0/3977578486 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2080145a0 con 0x7fe2101548c0 2023-12-08T08:21:39.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.715+0000 7fe216a32640 1 -- 172.21.15.88:0/3977578486 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe21014bd70 con 0x7fe2101548c0 2023-12-08T08:21:39.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.715+0000 7fe20cff9640 1 -- 172.21.15.88:0/3977578486 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe208014950 con 0x7fe2101548c0 2023-12-08T08:21:39.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.715+0000 7fe216a32640 1 -- 172.21.15.88:0/3977578486 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2101ebae0 con 0x7fe2101548c0 2023-12-08T08:21:39.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.719+0000 7fe216a32640 1 -- 172.21.15.88:0/3977578486 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe210067630 con 0x7fe2101548c0 2023-12-08T08:21:39.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.719+0000 7fe20cff9640 1 -- 172.21.15.88:0/3977578486 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe208014ab0 con 0x7fe2101548c0 2023-12-08T08:21:39.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.719+0000 7fe20cff9640 1 --2- 172.21.15.88:0/3977578486 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe1fc0664a0 0x7fe1fc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:39.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.719+0000 7fe20cff9640 1 -- 172.21.15.88:0/3977578486 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe2080849c0 con 0x7fe2101548c0 2023-12-08T08:21:39.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.719+0000 7fe20ffff640 1 --2- 172.21.15.88:0/3977578486 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe1fc0664a0 0x7fe1fc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:39.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.719+0000 7fe20ffff640 1 --2- 172.21.15.88:0/3977578486 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe1fc0664a0 0x7fe1fc068960 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe2000ae000 tx=0x7fe200008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:39.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.723+0000 7fe20cff9640 1 -- 172.21.15.88:0/3977578486 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe208051b80 con 0x7fe2101548c0 2023-12-08T08:21:39.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.875+0000 7fe216a32640 1 -- 172.21.15.88:0/3977578486 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe210073fd0 con 0x7fe2101548c0 2023-12-08T08:21:39.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.875+0000 7fe20cff9640 1 -- 172.21.15.88:0/3977578486 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe2080551a0 con 0x7fe2101548c0 2023-12-08T08:21:39.879 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:21:39.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.875+0000 7fe216a32640 1 -- 172.21.15.88:0/3977578486 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe1fc0664a0 msgr2=0x7fe1fc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:39.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.875+0000 7fe216a32640 1 --2- 172.21.15.88:0/3977578486 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe1fc0664a0 0x7fe1fc068960 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe2000ae000 tx=0x7fe200008040 comp rx=0 tx=0).stop 2023-12-08T08:21:39.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.875+0000 7fe216a32640 1 -- 172.21.15.88:0/3977578486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2101548c0 msgr2=0x7fe21014db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:39.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.875+0000 7fe216a32640 1 --2- 172.21.15.88:0/3977578486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2101548c0 0x7fe21014db90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe208007e60 tx=0x7fe20800e4b0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.875+0000 7fe216a32640 1 -- 172.21.15.88:0/3977578486 shutdown_connections 2023-12-08T08:21:39.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.875+0000 7fe216a32640 1 --2- 172.21.15.88:0/3977578486 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe1fc0664a0 0x7fe1fc068960 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.875+0000 7fe216a32640 1 --2- 172.21.15.88:0/3977578486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2101548c0 0x7fe21014db90 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.875+0000 7fe216a32640 1 --2- 172.21.15.88:0/3977578486 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe21014b1e0 0x7fe2100701d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.875+0000 7fe216a32640 1 --2- 172.21.15.88:0/3977578486 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2100c5300 0x7fe2100722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:39.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.875+0000 7fe216a32640 1 -- 172.21.15.88:0/3977578486 >> 172.21.15.88:0/3977578486 conn(0x7fe2100c59f0 msgr2=0x7fe2100c2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:39.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.875+0000 7fe216a32640 1 -- 172.21.15.88:0/3977578486 shutdown_connections 2023-12-08T08:21:39.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:39.875+0000 7fe216a32640 1 -- 172.21.15.88:0/3977578486 wait complete. 2023-12-08T08:21:39.901 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:21:40.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.035+0000 7f17ec7f8640 1 Processor -- start 2023-12-08T08:21:40.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.035+0000 7f17ec7f8640 1 -- start start 2023-12-08T08:21:40.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.035+0000 7f17ec7f8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f17e41516a0 0x7f17e40c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:40.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.035+0000 7f17ec7f8640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f17e40c46c0 0x7f17e406bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:40.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.035+0000 7f17ec7f8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17e4151210 con 0x7f17e414e2a0 2023-12-08T08:21:40.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.035+0000 7f17ec7f8640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e4151b50 con 0x7f17e41516a0 2023-12-08T08:21:40.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.035+0000 7f17ec7f8640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e414e680 con 0x7f17e40c46c0 2023-12-08T08:21:40.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.039+0000 7f17ea594640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f17e414e2a0 0x7f17e40a9460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57608/0 (socket says 172.21.15.88:57608) 2023-12-08T08:21:40.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.039+0000 7f17ea594640 1 -- 172.21.15.88:0/2870376182 learned_addr learned my addr 172.21.15.88:0/2870376182 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:40.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.039+0000 7f17e9d93640 1 --2- 172.21.15.88:0/2870376182 >> v2:172.21.15.88:3300/0 conn(0x7f17e41516a0 0x7f17e40c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:40.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.039+0000 7f17ead95640 1 --2- 172.21.15.88:0/2870376182 >> v2:172.21.15.148:3300/0 conn(0x7f17e40c46c0 0x7f17e406bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:40.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.039+0000 7f17e9592640 1 -- 172.21.15.88:0/2870376182 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3042172515 0 0) 0x7f17e4151210 con 0x7f17e414e2a0 2023-12-08T08:21:40.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.039+0000 7f17e9592640 1 -- 172.21.15.88:0/2870376182 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17d0005740 con 0x7f17e414e2a0 2023-12-08T08:21:40.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.039+0000 7f17e9d93640 1 -- 172.21.15.88:0/2870376182 >> v2:172.21.15.148:3300/0 conn(0x7f17e40c46c0 msgr2=0x7f17e406bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:40.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.039+0000 7f17e9d93640 1 --2- 172.21.15.88:0/2870376182 >> v2:172.21.15.148:3300/0 conn(0x7f17e40c46c0 0x7f17e406bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.039+0000 7f17e9d93640 1 -- 172.21.15.88:0/2870376182 >> v1:172.21.15.88:6789/0 conn(0x7f17e414e2a0 legacy=0x7f17e40a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:40.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.039+0000 7f17e9d93640 1 -- 172.21.15.88:0/2870376182 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e40a9b70 con 0x7f17e41516a0 2023-12-08T08:21:40.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.039+0000 7f17e9d93640 1 --2- 172.21.15.88:0/2870376182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17e41516a0 0x7f17e40c4180 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f17e40c2420 tx=0x7f17d401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd53d9cb22b2e6b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:40.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.039+0000 7f17e9592640 1 -- 172.21.15.88:0/2870376182 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d40ab600 con 0x7f17e41516a0 2023-12-08T08:21:40.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.039+0000 7f17e9592640 1 -- 172.21.15.88:0/2870376182 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d40a7050 con 0x7f17e41516a0 2023-12-08T08:21:40.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.039+0000 7f17e9592640 1 -- 172.21.15.88:0/2870376182 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d40ab960 con 0x7f17e41516a0 2023-12-08T08:21:40.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.043+0000 7f17ec7f8640 1 -- 172.21.15.88:0/2870376182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17e41516a0 msgr2=0x7f17e40c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:40.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.043+0000 7f17ec7f8640 1 --2- 172.21.15.88:0/2870376182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17e41516a0 0x7f17e40c4180 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f17e40c2420 tx=0x7f17d401c460 comp rx=0 tx=0).stop 2023-12-08T08:21:40.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.043+0000 7f17ec7f8640 1 -- 172.21.15.88:0/2870376182 shutdown_connections 2023-12-08T08:21:40.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.043+0000 7f17ec7f8640 1 --2- 172.21.15.88:0/2870376182 >> v2:172.21.15.148:3300/0 conn(0x7f17e40c46c0 0x7f17e406bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.043+0000 7f17ec7f8640 1 --2- 172.21.15.88:0/2870376182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17e41516a0 0x7f17e40c4180 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.043+0000 7f17ec7f8640 1 -- 172.21.15.88:0/2870376182 >> 172.21.15.88:0/2870376182 conn(0x7f17e40c59f0 msgr2=0x7f17e40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:40.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.043+0000 7f17ec7f8640 1 -- 172.21.15.88:0/2870376182 shutdown_connections 2023-12-08T08:21:40.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.043+0000 7f17ec7f8640 1 -- 172.21.15.88:0/2870376182 wait complete. 2023-12-08T08:21:40.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.043+0000 7f17ec7f8640 1 Processor -- start 2023-12-08T08:21:40.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.043+0000 7f17ec7f8640 1 -- start start 2023-12-08T08:21:40.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.043+0000 7f17ec7f8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17e40c46c0 0x7f17e4159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:40.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.043+0000 7f17ec7f8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17e414e2a0 0x7f17e41429b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:40.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.043+0000 7f17ec7f8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17e41516a0 0x7f17e4142ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:40.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.043+0000 7f17ec7f8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e40c0e30 con 0x7f17e41516a0 2023-12-08T08:21:40.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.043+0000 7f17ec7f8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e41f0da0 con 0x7f17e414e2a0 2023-12-08T08:21:40.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.043+0000 7f17ec7f8640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e4143430 con 0x7f17e40c46c0 2023-12-08T08:21:40.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.043+0000 7f17ead95640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17e41516a0 0x7f17e4142ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:40.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.043+0000 7f17ead95640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17e41516a0 0x7f17e4142ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39208/0 (socket says 172.21.15.88:39208) 2023-12-08T08:21:40.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.043+0000 7f17ead95640 1 -- 172.21.15.88:0/1474807809 learned_addr learned my addr 172.21.15.88:0/1474807809 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:40.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.043+0000 7f17ea594640 1 --2- 172.21.15.88:0/1474807809 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17e40c46c0 0x7f17e4159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:40.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.043+0000 7f17e9d93640 1 --2- 172.21.15.88:0/1474807809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17e414e2a0 0x7f17e41429b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:40.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.043+0000 7f17ead95640 1 -- 172.21.15.88:0/1474807809 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17e40c46c0 msgr2=0x7f17e4159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:40.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.043+0000 7f17ead95640 1 --2- 172.21.15.88:0/1474807809 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17e40c46c0 0x7f17e4159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.043+0000 7f17ead95640 1 -- 172.21.15.88:0/1474807809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17e414e2a0 msgr2=0x7f17e41429b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:40.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.043+0000 7f17ead95640 1 --2- 172.21.15.88:0/1474807809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17e414e2a0 0x7f17e41429b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.043+0000 7f17ead95640 1 -- 172.21.15.88:0/1474807809 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d4009420 con 0x7f17e41516a0 2023-12-08T08:21:40.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.047+0000 7f17ead95640 1 --2- 172.21.15.88:0/1474807809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17e41516a0 0x7f17e4142ef0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f17dc007e60 tx=0x7f17dc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:40.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.047+0000 7f17daffd640 1 -- 172.21.15.88:0/1474807809 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc014420 con 0x7f17e41516a0 2023-12-08T08:21:40.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.047+0000 7f17daffd640 1 -- 172.21.15.88:0/1474807809 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17dc0145a0 con 0x7f17e41516a0 2023-12-08T08:21:40.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.047+0000 7f17ec7f8640 1 -- 172.21.15.88:0/1474807809 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e41f1230 con 0x7f17e41516a0 2023-12-08T08:21:40.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.047+0000 7f17daffd640 1 -- 172.21.15.88:0/1474807809 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc014950 con 0x7f17e41516a0 2023-12-08T08:21:40.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.047+0000 7f17ec7f8640 1 -- 172.21.15.88:0/1474807809 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e41f0470 con 0x7f17e41516a0 2023-12-08T08:21:40.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.047+0000 7f17ec7f8640 1 -- 172.21.15.88:0/1474807809 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e41f0f30 con 0x7f17e41516a0 2023-12-08T08:21:40.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.047+0000 7f17daffd640 1 -- 172.21.15.88:0/1474807809 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f17dc014ab0 con 0x7f17e41516a0 2023-12-08T08:21:40.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.047+0000 7f17daffd640 1 --2- 172.21.15.88:0/1474807809 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f17c8066470 0x7f17c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:40.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.047+0000 7f17daffd640 1 -- 172.21.15.88:0/1474807809 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f17dc084920 con 0x7f17e41516a0 2023-12-08T08:21:40.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.047+0000 7f17ea594640 1 --2- 172.21.15.88:0/1474807809 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f17c8066470 0x7f17c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:40.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.051+0000 7f17ea594640 1 --2- 172.21.15.88:0/1474807809 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f17c8066470 0x7f17c8068930 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f17e0007fd0 tx=0x7f17e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:40.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.051+0000 7f17daffd640 1 -- 172.21.15.88:0/1474807809 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f17dc051b80 con 0x7f17e41516a0 2023-12-08T08:21:40.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.199+0000 7f17ec7f8640 1 -- 172.21.15.88:0/1474807809 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f17e4067630 con 0x7f17e41516a0 2023-12-08T08:21:40.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.203+0000 7f17daffd640 1 -- 172.21.15.88:0/1474807809 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f17dc0551a0 con 0x7f17e41516a0 2023-12-08T08:21:40.206 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:21:40.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.203+0000 7f17ec7f8640 1 -- 172.21.15.88:0/1474807809 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f17c8066470 msgr2=0x7f17c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:40.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.203+0000 7f17ec7f8640 1 --2- 172.21.15.88:0/1474807809 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f17c8066470 0x7f17c8068930 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f17e0007fd0 tx=0x7f17e0009040 comp rx=0 tx=0).stop 2023-12-08T08:21:40.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.203+0000 7f17ec7f8640 1 -- 172.21.15.88:0/1474807809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17e41516a0 msgr2=0x7f17e4142ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:40.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.203+0000 7f17ec7f8640 1 --2- 172.21.15.88:0/1474807809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17e41516a0 0x7f17e4142ef0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f17dc007e60 tx=0x7f17dc00e4b0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.203+0000 7f17ec7f8640 1 -- 172.21.15.88:0/1474807809 shutdown_connections 2023-12-08T08:21:40.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.203+0000 7f17ec7f8640 1 --2- 172.21.15.88:0/1474807809 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f17c8066470 0x7f17c8068930 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.203+0000 7f17ec7f8640 1 --2- 172.21.15.88:0/1474807809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17e41516a0 0x7f17e4142ef0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.203+0000 7f17ec7f8640 1 --2- 172.21.15.88:0/1474807809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17e414e2a0 0x7f17e41429b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.203+0000 7f17ec7f8640 1 --2- 172.21.15.88:0/1474807809 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17e40c46c0 0x7f17e4159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.203+0000 7f17ec7f8640 1 -- 172.21.15.88:0/1474807809 >> 172.21.15.88:0/1474807809 conn(0x7f17e40c59f0 msgr2=0x7f17e40a9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:40.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.203+0000 7f17ec7f8640 1 -- 172.21.15.88:0/1474807809 shutdown_connections 2023-12-08T08:21:40.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.203+0000 7f17ec7f8640 1 -- 172.21.15.88:0/1474807809 wait complete. 2023-12-08T08:21:40.226 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:21:40.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.359+0000 7f99c2765640 1 Processor -- start 2023-12-08T08:21:40.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99c2765640 1 -- start start 2023-12-08T08:21:40.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99c2765640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99bc159c40 0x7f99bc15c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:40.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99c2765640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc0a4e20 con 0x7f99bc14b1e0 2023-12-08T08:21:40.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99c2765640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc0a50e0 con 0x7f99bc0c5300 2023-12-08T08:21:40.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99c2765640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc1558d0 con 0x7f99bc159c40 2023-12-08T08:21:40.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99bbfff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f99bc14b1e0 0x7f99bc0c1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41266/0 (socket says 172.21.15.88:41266) 2023-12-08T08:21:40.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99bbfff640 1 -- 172.21.15.88:0/3995361591 learned_addr learned my addr 172.21.15.88:0/3995361591 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:40.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99c0d02640 1 --2- 172.21.15.88:0/3995361591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99bc159c40 0x7f99bc15c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:40.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99baffd640 1 -- 172.21.15.88:0/3995361591 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2864066249 0 0) 0x7f99bc0a4e20 con 0x7f99bc14b1e0 2023-12-08T08:21:40.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99baffd640 1 -- 172.21.15.88:0/3995361591 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99a4005740 con 0x7f99bc14b1e0 2023-12-08T08:21:40.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99baffd640 1 -- 172.21.15.88:0/3995361591 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3488466968 0 0) 0x7f99a4005740 con 0x7f99bc14b1e0 2023-12-08T08:21:40.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99baffd640 1 -- 172.21.15.88:0/3995361591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99bc159c40 msgr2=0x7f99bc15c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:40.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99baffd640 1 --2- 172.21.15.88:0/3995361591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99bc159c40 0x7f99bc15c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99baffd640 1 -- 172.21.15.88:0/3995361591 >> v1:172.21.15.148:6789/0 conn(0x7f99bc0c5300 legacy=0x7f99bc0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:40.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99baffd640 1 -- 172.21.15.88:0/3995361591 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc0c0f00 con 0x7f99bc14b1e0 2023-12-08T08:21:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99baffd640 1 -- 172.21.15.88:0/3995361591 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f99ac001680 con 0x7f99bc14b1e0 2023-12-08T08:21:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99baffd640 1 -- 172.21.15.88:0/3995361591 >> v1:172.21.15.88:6789/0 conn(0x7f99bc14b1e0 legacy=0x7f99bc0c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99baffd640 1 --2- 172.21.15.88:0/3995361591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4005bc0 0x7f99a4005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99baffd640 1 --2- 172.21.15.88:0/3995361591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99bc159c40 0x7f99a40069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99baffd640 1 --2- 172.21.15.88:0/3995361591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99a4006f20 0x7f99a40073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99baffd640 1 -- 172.21.15.88:0/3995361591 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc1558d0 con 0x7f99a4005bc0 2023-12-08T08:21:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99baffd640 1 -- 172.21.15.88:0/3995361591 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a400dc80 con 0x7f99a4006f20 2023-12-08T08:21:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99baffd640 1 -- 172.21.15.88:0/3995361591 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a400de40 con 0x7f99bc159c40 2023-12-08T08:21:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99bbfff640 1 --2- 172.21.15.88:0/3995361591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4005bc0 0x7f99a4005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99bb7fe640 1 --2- 172.21.15.88:0/3995361591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99bc159c40 0x7f99a40069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99c0d02640 1 --2- 172.21.15.88:0/3995361591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99a4006f20 0x7f99a40073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99bbfff640 1 -- 172.21.15.88:0/3995361591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99bc159c40 msgr2=0x7f99a40069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99bbfff640 1 --2- 172.21.15.88:0/3995361591 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99bc159c40 0x7f99a40069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99bbfff640 1 -- 172.21.15.88:0/3995361591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99a4006f20 msgr2=0x7f99a40073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:40.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99bbfff640 1 --2- 172.21.15.88:0/3995361591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99a4006f20 0x7f99a40073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.363+0000 7f99bbfff640 1 -- 172.21.15.88:0/3995361591 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a4005740 con 0x7f99a4005bc0 2023-12-08T08:21:40.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.367+0000 7f99bbfff640 1 --2- 172.21.15.88:0/3995361591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4005bc0 0x7f99a4005fe0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f99ac001ec0 tx=0x7f99ac01cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd667752aeb1cd0e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:40.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.367+0000 7f99baffd640 1 -- 172.21.15.88:0/3995361591 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac005ae0 con 0x7f99a4005bc0 2023-12-08T08:21:40.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.367+0000 7f99baffd640 1 -- 172.21.15.88:0/3995361591 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac005c40 con 0x7f99a4005bc0 2023-12-08T08:21:40.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.367+0000 7f99baffd640 1 -- 172.21.15.88:0/3995361591 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac007070 con 0x7f99a4005bc0 2023-12-08T08:21:40.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.367+0000 7f99c2765640 1 -- 172.21.15.88:0/3995361591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4005bc0 msgr2=0x7f99a4005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:40.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.367+0000 7f99c2765640 1 --2- 172.21.15.88:0/3995361591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4005bc0 0x7f99a4005fe0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f99ac001ec0 tx=0x7f99ac01cb40 comp rx=0 tx=0).stop 2023-12-08T08:21:40.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.367+0000 7f99c0d02640 1 -- 172.21.15.88:0/3995361591 reap_dead start 2023-12-08T08:21:40.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.367+0000 7f99c2765640 1 -- 172.21.15.88:0/3995361591 shutdown_connections 2023-12-08T08:21:40.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.367+0000 7f99c2765640 1 -- 172.21.15.88:0/3995361591 >> 172.21.15.88:0/3995361591 conn(0x7f99bc0c59f0 msgr2=0x7f99bc0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:40.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.367+0000 7f99c2765640 1 -- 172.21.15.88:0/3995361591 shutdown_connections 2023-12-08T08:21:40.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.367+0000 7f99c2765640 1 -- 172.21.15.88:0/3995361591 wait complete. 2023-12-08T08:21:40.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.371+0000 7f99c2765640 1 Processor -- start 2023-12-08T08:21:40.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.371+0000 7f99c2765640 1 -- start start 2023-12-08T08:21:40.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.371+0000 7f99c2765640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4005bc0 0x7f99bc072630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:40.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.371+0000 7f99c2765640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99bc154860 0x7f99bc06d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:40.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.371+0000 7f99c2765640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99bc06d5d0 0x7f99bc1f0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:40.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.371+0000 7f99c2765640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc153710 con 0x7f99a4005bc0 2023-12-08T08:21:40.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.371+0000 7f99c2765640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc154290 con 0x7f99bc154860 2023-12-08T08:21:40.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.371+0000 7f99c2765640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc072b70 con 0x7f99bc06d5d0 2023-12-08T08:21:40.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.371+0000 7f99bbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4005bc0 0x7f99bc072630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:40.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.371+0000 7f99bbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4005bc0 0x7f99bc072630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56938/0 (socket says 172.21.15.88:56938) 2023-12-08T08:21:40.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.371+0000 7f99bbfff640 1 -- 172.21.15.88:0/4265760666 learned_addr learned my addr 172.21.15.88:0/4265760666 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:40.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.371+0000 7f99bb7fe640 1 --2- 172.21.15.88:0/4265760666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99bc154860 0x7f99bc06d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:40.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.371+0000 7f99c0d02640 1 --2- 172.21.15.88:0/4265760666 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99bc06d5d0 0x7f99bc1f0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:40.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.371+0000 7f99bbfff640 1 -- 172.21.15.88:0/4265760666 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99bc06d5d0 msgr2=0x7f99bc1f0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:40.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.371+0000 7f99bbfff640 1 --2- 172.21.15.88:0/4265760666 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99bc06d5d0 0x7f99bc1f0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.371+0000 7f99bbfff640 1 -- 172.21.15.88:0/4265760666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99bc154860 msgr2=0x7f99bc06d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:40.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.371+0000 7f99bbfff640 1 --2- 172.21.15.88:0/4265760666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99bc154860 0x7f99bc06d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.371+0000 7f99bbfff640 1 -- 172.21.15.88:0/4265760666 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc151fe0 con 0x7f99a4005bc0 2023-12-08T08:21:40.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.371+0000 7f99bbfff640 1 --2- 172.21.15.88:0/4265760666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4005bc0 0x7f99bc072630 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f99ac001ec0 tx=0x7f99a4007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:40.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.371+0000 7f99b8ff9640 1 -- 172.21.15.88:0/4265760666 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac0b4070 con 0x7f99a4005bc0 2023-12-08T08:21:40.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.371+0000 7f99b8ff9640 1 -- 172.21.15.88:0/4265760666 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac0047f0 con 0x7f99a4005bc0 2023-12-08T08:21:40.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.371+0000 7f99c2765640 1 -- 172.21.15.88:0/4265760666 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99bc153960 con 0x7f99a4005bc0 2023-12-08T08:21:40.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.371+0000 7f99b8ff9640 1 -- 172.21.15.88:0/4265760666 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac004b60 con 0x7f99a4005bc0 2023-12-08T08:21:40.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.371+0000 7f99c2765640 1 -- 172.21.15.88:0/4265760666 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99bc153f20 con 0x7f99a4005bc0 2023-12-08T08:21:40.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.371+0000 7f99c2765640 1 -- 172.21.15.88:0/4265760666 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99bc067630 con 0x7f99a4005bc0 2023-12-08T08:21:40.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.375+0000 7f99b8ff9640 1 -- 172.21.15.88:0/4265760666 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f99ac0b7070 con 0x7f99a4005bc0 2023-12-08T08:21:40.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.375+0000 7f99b8ff9640 1 --2- 172.21.15.88:0/4265760666 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f99a8066470 0x7f99a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:40.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.375+0000 7f99b8ff9640 1 -- 172.21.15.88:0/4265760666 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f99bc14b7d0 con 0x7f99a4005bc0 2023-12-08T08:21:40.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.375+0000 7f99bb7fe640 1 --2- 172.21.15.88:0/4265760666 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f99a8066470 0x7f99a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:40.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.375+0000 7f99bb7fe640 1 --2- 172.21.15.88:0/4265760666 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f99a8066470 0x7f99a8068930 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0c65c0 tx=0x7f99b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:40.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.379+0000 7f99b8ff9640 1 -- 172.21.15.88:0/4265760666 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f99ac0ea5a0 con 0x7f99a4005bc0 2023-12-08T08:21:40.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.527+0000 7f99c2765640 1 -- 172.21.15.88:0/4265760666 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f99bc0bfbd0 con 0x7f99a4005bc0 2023-12-08T08:21:40.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.527+0000 7f99b8ff9640 1 -- 172.21.15.88:0/4265760666 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v35) v1 ==== 105+0+11 (secure 0 0 0) 0x7f99ac0edbc0 con 0x7f99a4005bc0 2023-12-08T08:21:40.534 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:21:40.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.531+0000 7f99c2765640 1 -- 172.21.15.88:0/4265760666 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f99a8066470 msgr2=0x7f99a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:40.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.531+0000 7f99c2765640 1 --2- 172.21.15.88:0/4265760666 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f99a8066470 0x7f99a8068930 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0c65c0 tx=0x7f99b0009040 comp rx=0 tx=0).stop 2023-12-08T08:21:40.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.531+0000 7f99c2765640 1 -- 172.21.15.88:0/4265760666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4005bc0 msgr2=0x7f99bc072630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:40.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.531+0000 7f99c2765640 1 --2- 172.21.15.88:0/4265760666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4005bc0 0x7f99bc072630 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f99ac001ec0 tx=0x7f99a4007a10 comp rx=0 tx=0).stop 2023-12-08T08:21:40.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.531+0000 7f99c2765640 1 -- 172.21.15.88:0/4265760666 shutdown_connections 2023-12-08T08:21:40.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.531+0000 7f99c2765640 1 --2- 172.21.15.88:0/4265760666 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f99a8066470 0x7f99a8068930 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.531+0000 7f99c2765640 1 --2- 172.21.15.88:0/4265760666 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99bc06d5d0 0x7f99bc1f0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.531+0000 7f99c2765640 1 --2- 172.21.15.88:0/4265760666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99bc154860 0x7f99bc06d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.531+0000 7f99c2765640 1 --2- 172.21.15.88:0/4265760666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4005bc0 0x7f99bc072630 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.531+0000 7f99c2765640 1 -- 172.21.15.88:0/4265760666 >> 172.21.15.88:0/4265760666 conn(0x7f99bc0c59f0 msgr2=0x7f99bc0aaf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:40.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.531+0000 7f99c2765640 1 -- 172.21.15.88:0/4265760666 shutdown_connections 2023-12-08T08:21:40.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.531+0000 7f99c2765640 1 -- 172.21.15.88:0/4265760666 wait complete. 2023-12-08T08:21:40.555 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:21:40.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.691+0000 7f2b00efe640 1 Processor -- start 2023-12-08T08:21:40.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.691+0000 7f2b00efe640 1 -- start start 2023-12-08T08:21:40.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.691+0000 7f2b00efe640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2afc14b1e0 0x7f2afc0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:40.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.691+0000 7f2b00efe640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2afc0c5300 0x7f2afc0a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:40.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.691+0000 7f2b00efe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2afc151280 0x7f2afc151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:40.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.691+0000 7f2b00efe640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2afc0a4e20 con 0x7f2afc151280 2023-12-08T08:21:40.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.691+0000 7f2b00efe640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2afc0a50e0 con 0x7f2afc0c5300 2023-12-08T08:21:40.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.691+0000 7f2b00efe640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc0c0f00 con 0x7f2afc14b1e0 2023-12-08T08:21:40.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.691+0000 7f2afad9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2afc151280 0x7f2afc151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:40.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.691+0000 7f2afad9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2afc151280 0x7f2afc151710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56940/0 (socket says 172.21.15.88:56940) 2023-12-08T08:21:40.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.691+0000 7f2afad9d640 1 -- 172.21.15.88:0/170837595 learned_addr learned my addr 172.21.15.88:0/170837595 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:40.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.691+0000 7f2afa59c640 1 --2- 172.21.15.88:0/170837595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2afc14b1e0 0x7f2afc0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:40.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.691+0000 7f2af3fff640 1 --2- 172.21.15.88:0/170837595 >> v2:172.21.15.148:3300/0 conn(0x7f2afc0c5300 0x7f2afc0a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:40.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.691+0000 7f2afad9d640 1 -- 172.21.15.88:0/170837595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2afc14b1e0 msgr2=0x7f2afc0c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:40.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.691+0000 7f2afad9d640 1 --2- 172.21.15.88:0/170837595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2afc14b1e0 0x7f2afc0c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.691+0000 7f2afad9d640 1 -- 172.21.15.88:0/170837595 >> v2:172.21.15.148:3300/0 conn(0x7f2afc0c5300 msgr2=0x7f2afc0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:40.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.691+0000 7f2afad9d640 1 --2- 172.21.15.88:0/170837595 >> v2:172.21.15.148:3300/0 conn(0x7f2afc0c5300 0x7f2afc0a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.691+0000 7f2afad9d640 1 -- 172.21.15.88:0/170837595 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc0c11e0 con 0x7f2afc151280 2023-12-08T08:21:40.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.695+0000 7f2afad9d640 1 --2- 172.21.15.88:0/170837595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2afc151280 0x7f2afc151710 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2afc06f790 tx=0x7f2af401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40246a0caccc5581 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:40.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.695+0000 7f2af9d9b640 1 -- 172.21.15.88:0/170837595 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af40a56e0 con 0x7f2afc151280 2023-12-08T08:21:40.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.695+0000 7f2af9d9b640 1 -- 172.21.15.88:0/170837595 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af40a5840 con 0x7f2afc151280 2023-12-08T08:21:40.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.695+0000 7f2af9d9b640 1 -- 172.21.15.88:0/170837595 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af40a5bd0 con 0x7f2afc151280 2023-12-08T08:21:40.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.695+0000 7f2b00efe640 1 -- 172.21.15.88:0/170837595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2afc151280 msgr2=0x7f2afc151710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:40.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.695+0000 7f2b00efe640 1 --2- 172.21.15.88:0/170837595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2afc151280 0x7f2afc151710 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2afc06f790 tx=0x7f2af401c9d0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.695+0000 7f2b00efe640 1 -- 172.21.15.88:0/170837595 shutdown_connections 2023-12-08T08:21:40.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.695+0000 7f2b00efe640 1 --2- 172.21.15.88:0/170837595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2afc151280 0x7f2afc151710 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.695+0000 7f2b00efe640 1 --2- 172.21.15.88:0/170837595 >> v2:172.21.15.148:3300/0 conn(0x7f2afc0c5300 0x7f2afc0a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.695+0000 7f2b00efe640 1 --2- 172.21.15.88:0/170837595 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2afc14b1e0 0x7f2afc0c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.695+0000 7f2b00efe640 1 -- 172.21.15.88:0/170837595 >> 172.21.15.88:0/170837595 conn(0x7f2afc0c59f0 msgr2=0x7f2afc0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:40.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.695+0000 7f2b00efe640 1 -- 172.21.15.88:0/170837595 shutdown_connections 2023-12-08T08:21:40.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.695+0000 7f2b00efe640 1 -- 172.21.15.88:0/170837595 wait complete. 2023-12-08T08:21:40.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.699+0000 7f2b00efe640 1 Processor -- start 2023-12-08T08:21:40.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.699+0000 7f2b00efe640 1 -- start start 2023-12-08T08:21:40.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.699+0000 7f2b00efe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2afc0c5300 0x7f2afc153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:40.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.699+0000 7f2b00efe640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2afc14b1e0 0x7f2afc072050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:40.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.699+0000 7f2b00efe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2afc151280 0x7f2afc072590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:40.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.699+0000 7f2b00efe640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc0a5680 con 0x7f2afc151280 2023-12-08T08:21:40.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.699+0000 7f2b00efe640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc1478d0 con 0x7f2afc0c5300 2023-12-08T08:21:40.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.699+0000 7f2b00efe640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc0a6550 con 0x7f2afc14b1e0 2023-12-08T08:21:40.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.699+0000 7f2afad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2afc151280 0x7f2afc072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:40.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.699+0000 7f2afad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2afc151280 0x7f2afc072590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56946/0 (socket says 172.21.15.88:56946) 2023-12-08T08:21:40.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.699+0000 7f2afad9d640 1 -- 172.21.15.88:0/3080619176 learned_addr learned my addr 172.21.15.88:0/3080619176 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:40.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.699+0000 7f2afa59c640 1 --2- 172.21.15.88:0/3080619176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2afc0c5300 0x7f2afc153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:40.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.699+0000 7f2af3fff640 1 --2- 172.21.15.88:0/3080619176 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2afc14b1e0 0x7f2afc072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:40.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.699+0000 7f2afad9d640 1 -- 172.21.15.88:0/3080619176 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2afc14b1e0 msgr2=0x7f2afc072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:40.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.699+0000 7f2afad9d640 1 --2- 172.21.15.88:0/3080619176 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2afc14b1e0 0x7f2afc072050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.699+0000 7f2afad9d640 1 -- 172.21.15.88:0/3080619176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2afc0c5300 msgr2=0x7f2afc153a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:40.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.699+0000 7f2afad9d640 1 --2- 172.21.15.88:0/3080619176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2afc0c5300 0x7f2afc153a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.699+0000 7f2afad9d640 1 -- 172.21.15.88:0/3080619176 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af4009b30 con 0x7f2afc151280 2023-12-08T08:21:40.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.699+0000 7f2afad9d640 1 --2- 172.21.15.88:0/3080619176 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2afc151280 0x7f2afc072590 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2af40af040 tx=0x7f2af4019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:40.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.699+0000 7f2af2ffd640 1 -- 172.21.15.88:0/3080619176 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af40a56e0 con 0x7f2afc151280 2023-12-08T08:21:40.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.699+0000 7f2af2ffd640 1 -- 172.21.15.88:0/3080619176 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af40b8670 con 0x7f2afc151280 2023-12-08T08:21:40.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.699+0000 7f2af2ffd640 1 -- 172.21.15.88:0/3080619176 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af40b8a00 con 0x7f2afc151280 2023-12-08T08:21:40.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.699+0000 7f2b00efe640 1 -- 172.21.15.88:0/3080619176 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2afc072ad0 con 0x7f2afc151280 2023-12-08T08:21:40.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.699+0000 7f2b00efe640 1 -- 172.21.15.88:0/3080619176 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2afc0a6d60 con 0x7f2afc151280 2023-12-08T08:21:40.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.703+0000 7f2b00efe640 1 -- 172.21.15.88:0/3080619176 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2afc067630 con 0x7f2afc151280 2023-12-08T08:21:40.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.703+0000 7f2af2ffd640 1 -- 172.21.15.88:0/3080619176 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2af40b8b60 con 0x7f2afc151280 2023-12-08T08:21:40.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.703+0000 7f2af2ffd640 1 --2- 172.21.15.88:0/3080619176 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2adc066470 0x7f2adc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:40.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.703+0000 7f2af2ffd640 1 -- 172.21.15.88:0/3080619176 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2af411f3e0 con 0x7f2afc151280 2023-12-08T08:21:40.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.703+0000 7f2afa59c640 1 --2- 172.21.15.88:0/3080619176 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2adc066470 0x7f2adc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:40.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.703+0000 7f2afa59c640 1 --2- 172.21.15.88:0/3080619176 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2adc066470 0x7f2adc068930 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009b60 tx=0x7f2aec009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:40.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.707+0000 7f2af2ffd640 1 -- 172.21.15.88:0/3080619176 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2af40ec5a0 con 0x7f2afc151280 2023-12-08T08:21:40.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.859+0000 7f2b00efe640 1 -- 172.21.15.88:0/3080619176 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f2afc151830 con 0x7f2afc151280 2023-12-08T08:21:40.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.859+0000 7f2af2ffd640 1 -- 172.21.15.88:0/3080619176 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v35) v1 ==== 101+0+11 (secure 0 0 0) 0x7f2af4009510 con 0x7f2afc151280 2023-12-08T08:21:40.865 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:21:40.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.863+0000 7f2b00efe640 1 -- 172.21.15.88:0/3080619176 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2adc066470 msgr2=0x7f2adc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:40.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.863+0000 7f2b00efe640 1 --2- 172.21.15.88:0/3080619176 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2adc066470 0x7f2adc068930 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009b60 tx=0x7f2aec009190 comp rx=0 tx=0).stop 2023-12-08T08:21:40.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.863+0000 7f2b00efe640 1 -- 172.21.15.88:0/3080619176 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2afc151280 msgr2=0x7f2afc072590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:40.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.863+0000 7f2b00efe640 1 --2- 172.21.15.88:0/3080619176 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2afc151280 0x7f2afc072590 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2af40af040 tx=0x7f2af4019770 comp rx=0 tx=0).stop 2023-12-08T08:21:40.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.863+0000 7f2b00efe640 1 -- 172.21.15.88:0/3080619176 shutdown_connections 2023-12-08T08:21:40.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.863+0000 7f2b00efe640 1 --2- 172.21.15.88:0/3080619176 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2adc066470 0x7f2adc068930 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.863+0000 7f2b00efe640 1 --2- 172.21.15.88:0/3080619176 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2afc151280 0x7f2afc072590 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.863+0000 7f2b00efe640 1 --2- 172.21.15.88:0/3080619176 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2afc14b1e0 0x7f2afc072050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.863+0000 7f2b00efe640 1 --2- 172.21.15.88:0/3080619176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2afc0c5300 0x7f2afc153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:40.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.863+0000 7f2b00efe640 1 -- 172.21.15.88:0/3080619176 >> 172.21.15.88:0/3080619176 conn(0x7f2afc0c59f0 msgr2=0x7f2afc0c2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:40.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.863+0000 7f2b00efe640 1 -- 172.21.15.88:0/3080619176 shutdown_connections 2023-12-08T08:21:40.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:40.863+0000 7f2b00efe640 1 -- 172.21.15.88:0/3080619176 wait complete. 2023-12-08T08:21:40.886 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:21:41.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.019+0000 7fd7edbaa640 1 Processor -- start 2023-12-08T08:21:41.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.019+0000 7fd7edbaa640 1 -- start start 2023-12-08T08:21:41.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.019+0000 7fd7edbaa640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd7e80af4c0 0x7fd7e8154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:41.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.019+0000 7fd7edbaa640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7e806c100 0x7fd7e80c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:41.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.019+0000 7fd7edbaa640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e80c4890 con 0x7fd7e80c67d0 2023-12-08T08:21:41.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.019+0000 7fd7edbaa640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e8155460 con 0x7fd7e80af4c0 2023-12-08T08:21:41.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.019+0000 7fd7edbaa640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e80af8a0 con 0x7fd7e806c100 2023-12-08T08:21:41.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.019+0000 7fd7e77fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd7e80af4c0 0x7fd7e8154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:41.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.019+0000 7fd7e77fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd7e80af4c0 0x7fd7e8154f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56958/0 (socket says 172.21.15.88:56958) 2023-12-08T08:21:41.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.019+0000 7fd7e77fe640 1 -- 172.21.15.88:0/649553894 learned_addr learned my addr 172.21.15.88:0/649553894 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:41.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.019+0000 7fd7e7fff640 1 --2- 172.21.15.88:0/649553894 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7e806c100 0x7fd7e80c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:41.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.019+0000 7fd7e77fe640 1 -- 172.21.15.88:0/649553894 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7e806c100 msgr2=0x7fd7e80c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:41.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.019+0000 7fd7e77fe640 1 --2- 172.21.15.88:0/649553894 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7e806c100 0x7fd7e80c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.019+0000 7fd7e77fe640 1 -- 172.21.15.88:0/649553894 >> v1:172.21.15.148:6789/0 conn(0x7fd7e80c67d0 legacy=0x7fd7e806b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:41.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.019+0000 7fd7e77fe640 1 -- 172.21.15.88:0/649553894 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e80c4b30 con 0x7fd7e80af4c0 2023-12-08T08:21:41.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.023+0000 7fd7e77fe640 1 --2- 172.21.15.88:0/649553894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7e80af4c0 0x7fd7e8154f20 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8009870 tx=0x7fd7d801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ee336b312c9fc3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:41.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.023+0000 7fd7e67fc640 1 -- 172.21.15.88:0/649553894 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d80ab680 con 0x7fd7e80af4c0 2023-12-08T08:21:41.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.023+0000 7fd7e67fc640 1 -- 172.21.15.88:0/649553894 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d80ab7e0 con 0x7fd7e80af4c0 2023-12-08T08:21:41.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.023+0000 7fd7e67fc640 1 -- 172.21.15.88:0/649553894 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d80abb70 con 0x7fd7e80af4c0 2023-12-08T08:21:41.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.023+0000 7fd7edbaa640 1 -- 172.21.15.88:0/649553894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7e80af4c0 msgr2=0x7fd7e8154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:41.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.023+0000 7fd7edbaa640 1 --2- 172.21.15.88:0/649553894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7e80af4c0 0x7fd7e8154f20 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8009870 tx=0x7fd7d801c480 comp rx=0 tx=0).stop 2023-12-08T08:21:41.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.023+0000 7fd7edbaa640 1 -- 172.21.15.88:0/649553894 shutdown_connections 2023-12-08T08:21:41.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.023+0000 7fd7edbaa640 1 --2- 172.21.15.88:0/649553894 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7e806c100 0x7fd7e80c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.023+0000 7fd7edbaa640 1 --2- 172.21.15.88:0/649553894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7e80af4c0 0x7fd7e8154f20 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.023+0000 7fd7edbaa640 1 -- 172.21.15.88:0/649553894 >> 172.21.15.88:0/649553894 conn(0x7fd7e80ab9d0 msgr2=0x7fd7e80abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:41.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.023+0000 7fd7edbaa640 1 -- 172.21.15.88:0/649553894 shutdown_connections 2023-12-08T08:21:41.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.023+0000 7fd7edbaa640 1 -- 172.21.15.88:0/649553894 wait complete. 2023-12-08T08:21:41.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.027+0000 7fd7edbaa640 1 Processor -- start 2023-12-08T08:21:41.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.027+0000 7fd7edbaa640 1 -- start start 2023-12-08T08:21:41.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.027+0000 7fd7edbaa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7e806c100 0x7fd7e8152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.027+0000 7fd7edbaa640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7e80af4c0 0x7fd7e8151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.027+0000 7fd7edbaa640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7e80c67d0 0x7fd7e81ed160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.027+0000 7fd7edbaa640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e8154f40 con 0x7fd7e806c100 2023-12-08T08:21:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.027+0000 7fd7edbaa640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e80c0d40 con 0x7fd7e80af4c0 2023-12-08T08:21:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.027+0000 7fd7edbaa640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e81f0d70 con 0x7fd7e80c67d0 2023-12-08T08:21:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.027+0000 7fd7e77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7e806c100 0x7fd7e8152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.027+0000 7fd7e77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7e806c100 0x7fd7e8152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56964/0 (socket says 172.21.15.88:56964) 2023-12-08T08:21:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.027+0000 7fd7e77fe640 1 -- 172.21.15.88:0/1820417199 learned_addr learned my addr 172.21.15.88:0/1820417199 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.027+0000 7fd7e7fff640 1 --2- 172.21.15.88:0/1820417199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7e80c67d0 0x7fd7e81ed160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.027+0000 7fd7e6ffd640 1 --2- 172.21.15.88:0/1820417199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7e80af4c0 0x7fd7e8151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.027+0000 7fd7e77fe640 1 -- 172.21.15.88:0/1820417199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7e80c67d0 msgr2=0x7fd7e81ed160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.027+0000 7fd7e77fe640 1 --2- 172.21.15.88:0/1820417199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7e80c67d0 0x7fd7e81ed160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.027+0000 7fd7e77fe640 1 -- 172.21.15.88:0/1820417199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7e80af4c0 msgr2=0x7fd7e8151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.027+0000 7fd7e77fe640 1 --2- 172.21.15.88:0/1820417199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7e80af4c0 0x7fd7e8151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.027+0000 7fd7e77fe640 1 -- 172.21.15.88:0/1820417199 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d80094d0 con 0x7fd7e806c100 2023-12-08T08:21:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.027+0000 7fd7e6ffd640 1 --2- 172.21.15.88:0/1820417199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7e80af4c0 0x7fd7e8151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.027+0000 7fd7e77fe640 1 --2- 172.21.15.88:0/1820417199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7e806c100 0x7fd7e8152e60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd7d80ad040 tx=0x7fd7d801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.027+0000 7fd7cffff640 1 -- 172.21.15.88:0/1820417199 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d80b4800 con 0x7fd7e806c100 2023-12-08T08:21:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.027+0000 7fd7cffff640 1 -- 172.21.15.88:0/1820417199 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d80b4960 con 0x7fd7e806c100 2023-12-08T08:21:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.027+0000 7fd7edbaa640 1 -- 172.21.15.88:0/1820417199 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e81eccd0 con 0x7fd7e806c100 2023-12-08T08:21:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.027+0000 7fd7cffff640 1 -- 172.21.15.88:0/1820417199 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d80b4d10 con 0x7fd7e806c100 2023-12-08T08:21:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.027+0000 7fd7edbaa640 1 -- 172.21.15.88:0/1820417199 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e80c3a80 con 0x7fd7e806c100 2023-12-08T08:21:41.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.031+0000 7fd7edbaa640 1 -- 172.21.15.88:0/1820417199 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e8067630 con 0x7fd7e806c100 2023-12-08T08:21:41.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.031+0000 7fd7cffff640 1 -- 172.21.15.88:0/1820417199 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd7d80c7440 con 0x7fd7e806c100 2023-12-08T08:21:41.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.031+0000 7fd7cffff640 1 --2- 172.21.15.88:0/1820417199 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd7d40664a0 0x7fd7d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:41.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.031+0000 7fd7cffff640 1 -- 172.21.15.88:0/1820417199 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd7d811f090 con 0x7fd7e806c100 2023-12-08T08:21:41.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.031+0000 7fd7e6ffd640 1 --2- 172.21.15.88:0/1820417199 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd7d40664a0 0x7fd7d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:41.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.031+0000 7fd7e6ffd640 1 --2- 172.21.15.88:0/1820417199 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd7d40664a0 0x7fd7d4068960 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd7e81ea730 tx=0x7fd7dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:41.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.035+0000 7fd7cffff640 1 -- 172.21.15.88:0/1820417199 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd7d80ec250 con 0x7fd7e806c100 2023-12-08T08:21:41.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.215+0000 7fd7edbaa640 1 -- 172.21.15.88:0/1820417199 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7e806c7a0 con 0x7fd7e806c100 2023-12-08T08:21:41.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.215+0000 7fd7cffff640 1 -- 172.21.15.88:0/1820417199 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6133 (secure 0 0 0) 0x7fd7d80ef870 con 0x7fd7e806c100 2023-12-08T08:21:41.220 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:41.220 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4978,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3372523869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3372523869},{"type":"v1","addr":"172.21.15.148:6834","nonce":3372523869}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4085245492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":4085245492},{"type":"v1","addr":"172.21.15.148:6835","nonce":4085245492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:21:05.130882+0000","modified":"2023-12-08T08:21:08.148991+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5049},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5049":{"gid":5049,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/181654220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":181654220},{"type":"v1","addr":"172.21.15.88:6837","nonce":181654220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:21:18.029250+0000","modified":"2023-12-08T08:21:21.056129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.88:6836/4274252181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":4274252181},{"type":"v1","addr":"172.21.15.88:6836","nonce":4274252181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-08T08:21:41.221 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 22 2023-12-08T08:21:41.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.219+0000 7fd7edbaa640 1 -- 172.21.15.88:0/1820417199 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd7d40664a0 msgr2=0x7fd7d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:41.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.219+0000 7fd7edbaa640 1 --2- 172.21.15.88:0/1820417199 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd7d40664a0 0x7fd7d4068960 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd7e81ea730 tx=0x7fd7dc009040 comp rx=0 tx=0).stop 2023-12-08T08:21:41.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.219+0000 7fd7edbaa640 1 -- 172.21.15.88:0/1820417199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7e806c100 msgr2=0x7fd7e8152e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:41.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.219+0000 7fd7edbaa640 1 --2- 172.21.15.88:0/1820417199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7e806c100 0x7fd7e8152e60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd7d80ad040 tx=0x7fd7d801acc0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.219+0000 7fd7edbaa640 1 -- 172.21.15.88:0/1820417199 shutdown_connections 2023-12-08T08:21:41.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.219+0000 7fd7edbaa640 1 --2- 172.21.15.88:0/1820417199 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd7d40664a0 0x7fd7d4068960 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.219+0000 7fd7edbaa640 1 --2- 172.21.15.88:0/1820417199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7e80c67d0 0x7fd7e81ed160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.219+0000 7fd7edbaa640 1 --2- 172.21.15.88:0/1820417199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7e80af4c0 0x7fd7e8151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.219+0000 7fd7edbaa640 1 --2- 172.21.15.88:0/1820417199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7e806c100 0x7fd7e8152e60 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.219+0000 7fd7edbaa640 1 -- 172.21.15.88:0/1820417199 >> 172.21.15.88:0/1820417199 conn(0x7fd7e80ab9d0 msgr2=0x7fd7e8155cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:41.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.219+0000 7fd7edbaa640 1 -- 172.21.15.88:0/1820417199 shutdown_connections 2023-12-08T08:21:41.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.219+0000 7fd7edbaa640 1 -- 172.21.15.88:0/1820417199 wait complete. 2023-12-08T08:21:41.241 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:21:41.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.375+0000 7f2ef9879640 1 Processor -- start 2023-12-08T08:21:41.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.375+0000 7f2ef9879640 1 -- start start 2023-12-08T08:21:41.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.375+0000 7f2ef9879640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2ef4154f00 0x7f2ef406b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:41.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.375+0000 7f2ef9879640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2ef40c7d30 0x7f2ef406bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:41.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.375+0000 7f2ef9879640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef40c8450 con 0x7f2ef40af4d0 2023-12-08T08:21:41.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.375+0000 7f2ef9879640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef40af8b0 con 0x7f2ef40c7d30 2023-12-08T08:21:41.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.375+0000 7f2ef9879640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef4155470 con 0x7f2ef4154f00 2023-12-08T08:21:41.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.375+0000 7f2ef37fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2ef40c7d30 0x7f2ef406bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:41.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.375+0000 7f2ef37fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2ef40c7d30 0x7f2ef406bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56966/0 (socket says 172.21.15.88:56966) 2023-12-08T08:21:41.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.375+0000 7f2ef37fe640 1 -- 172.21.15.88:0/3528272631 learned_addr learned my addr 172.21.15.88:0/3528272631 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:41.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.375+0000 7f2eea7fc640 1 --2- 172.21.15.88:0/3528272631 >> v2:172.21.15.148:3300/0 conn(0x7f2ef4154f00 0x7f2ef406b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:41.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.375+0000 7f2ef37fe640 1 -- 172.21.15.88:0/3528272631 >> v2:172.21.15.148:3300/0 conn(0x7f2ef4154f00 msgr2=0x7f2ef406b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:41.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.375+0000 7f2ef37fe640 1 --2- 172.21.15.88:0/3528272631 >> v2:172.21.15.148:3300/0 conn(0x7f2ef4154f00 0x7f2ef406b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.375+0000 7f2ef37fe640 1 -- 172.21.15.88:0/3528272631 >> v1:172.21.15.148:6789/0 conn(0x7f2ef40af4d0 legacy=0x7f2ef40c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:41.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.375+0000 7f2ef37fe640 1 -- 172.21.15.88:0/3528272631 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef40c48c0 con 0x7f2ef40c7d30 2023-12-08T08:21:41.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.375+0000 7f2eea7fc640 1 --2- 172.21.15.88:0/3528272631 >> v2:172.21.15.148:3300/0 conn(0x7f2ef4154f00 0x7f2ef406b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:41.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.379+0000 7f2ef37fe640 1 --2- 172.21.15.88:0/3528272631 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ef40c7d30 0x7f2ef406bc50 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2ef40aca80 tx=0x7f2eec01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f5c251997b93f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:41.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.379+0000 7f2ef27fc640 1 -- 172.21.15.88:0/3528272631 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec0ac410 con 0x7f2ef40c7d30 2023-12-08T08:21:41.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.379+0000 7f2ef27fc640 1 -- 172.21.15.88:0/3528272631 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eec0ac570 con 0x7f2ef40c7d30 2023-12-08T08:21:41.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.379+0000 7f2ef27fc640 1 -- 172.21.15.88:0/3528272631 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec0ac900 con 0x7f2ef40c7d30 2023-12-08T08:21:41.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.379+0000 7f2ef9879640 1 -- 172.21.15.88:0/3528272631 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ef40c7d30 msgr2=0x7f2ef406bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:41.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.379+0000 7f2ef9879640 1 --2- 172.21.15.88:0/3528272631 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ef40c7d30 0x7f2ef406bc50 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2ef40aca80 tx=0x7f2eec01c3b0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.379+0000 7f2ef9879640 1 -- 172.21.15.88:0/3528272631 shutdown_connections 2023-12-08T08:21:41.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.379+0000 7f2ef9879640 1 --2- 172.21.15.88:0/3528272631 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ef40c7d30 0x7f2ef406bc50 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.379+0000 7f2ef9879640 1 --2- 172.21.15.88:0/3528272631 >> v2:172.21.15.148:3300/0 conn(0x7f2ef4154f00 0x7f2ef406b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.379+0000 7f2ef9879640 1 -- 172.21.15.88:0/3528272631 >> 172.21.15.88:0/3528272631 conn(0x7f2ef40aba00 msgr2=0x7f2ef40abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:41.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.379+0000 7f2ef9879640 1 -- 172.21.15.88:0/3528272631 shutdown_connections 2023-12-08T08:21:41.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.379+0000 7f2ef9879640 1 -- 172.21.15.88:0/3528272631 wait complete. 2023-12-08T08:21:41.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.383+0000 7f2ef9879640 1 Processor -- start 2023-12-08T08:21:41.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.383+0000 7f2ef9879640 1 -- start start 2023-12-08T08:21:41.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.383+0000 7f2ef9879640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ef40af4d0 0x7f2ef40acd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:41.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.383+0000 7f2ef9879640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ef40c7d30 0x7f2ef41504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:41.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.383+0000 7f2ef9879640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ef4154f00 0x7f2ef4150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:41.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.383+0000 7f2ef9879640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef40adb80 con 0x7f2ef40c7d30 2023-12-08T08:21:41.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.383+0000 7f2ef9879640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef4145cd0 con 0x7f2ef40af4d0 2023-12-08T08:21:41.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.383+0000 7f2ef9879640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef41f2100 con 0x7f2ef4154f00 2023-12-08T08:21:41.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.383+0000 7f2eea7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ef40c7d30 0x7f2ef41504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:41.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.383+0000 7f2eea7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ef40c7d30 0x7f2ef41504d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56976/0 (socket says 172.21.15.88:56976) 2023-12-08T08:21:41.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.383+0000 7f2eea7fc640 1 -- 172.21.15.88:0/3350499846 learned_addr learned my addr 172.21.15.88:0/3350499846 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:41.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.383+0000 7f2ef37fe640 1 --2- 172.21.15.88:0/3350499846 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ef4154f00 0x7f2ef4150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:41.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.383+0000 7f2ef2ffd640 1 --2- 172.21.15.88:0/3350499846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ef40af4d0 0x7f2ef40acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:41.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.383+0000 7f2eea7fc640 1 -- 172.21.15.88:0/3350499846 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ef4154f00 msgr2=0x7f2ef4150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:41.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.383+0000 7f2eea7fc640 1 --2- 172.21.15.88:0/3350499846 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ef4154f00 0x7f2ef4150a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.383+0000 7f2eea7fc640 1 -- 172.21.15.88:0/3350499846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ef40af4d0 msgr2=0x7f2ef40acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:41.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.383+0000 7f2eea7fc640 1 --2- 172.21.15.88:0/3350499846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ef40af4d0 0x7f2ef40acd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.383+0000 7f2eea7fc640 1 -- 172.21.15.88:0/3350499846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eec0094d0 con 0x7f2ef40c7d30 2023-12-08T08:21:41.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.383+0000 7f2eea7fc640 1 --2- 172.21.15.88:0/3350499846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ef40c7d30 0x7f2ef41504d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2edc009fa0 tx=0x7f2edc00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:41.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.383+0000 7f2ef0ff9640 1 -- 172.21.15.88:0/3350499846 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc003ba0 con 0x7f2ef40c7d30 2023-12-08T08:21:41.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.383+0000 7f2ef0ff9640 1 -- 172.21.15.88:0/3350499846 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2edc00f040 con 0x7f2ef40c7d30 2023-12-08T08:21:41.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.383+0000 7f2ef0ff9640 1 -- 172.21.15.88:0/3350499846 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc004030 con 0x7f2ef40c7d30 2023-12-08T08:21:41.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.383+0000 7f2ef9879640 1 -- 172.21.15.88:0/3350499846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef41f10e0 con 0x7f2ef40c7d30 2023-12-08T08:21:41.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.383+0000 7f2ef9879640 1 -- 172.21.15.88:0/3350499846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef41f16a0 con 0x7f2ef40c7d30 2023-12-08T08:21:41.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.387+0000 7f2ef9879640 1 -- 172.21.15.88:0/3350499846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef4067630 con 0x7f2ef40c7d30 2023-12-08T08:21:41.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.387+0000 7f2ef0ff9640 1 -- 172.21.15.88:0/3350499846 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2edc004190 con 0x7f2ef40c7d30 2023-12-08T08:21:41.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.387+0000 7f2ef0ff9640 1 --2- 172.21.15.88:0/3350499846 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2ed4066470 0x7f2ed4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:41.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.387+0000 7f2ef0ff9640 1 -- 172.21.15.88:0/3350499846 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2edc0844c0 con 0x7f2ef40c7d30 2023-12-08T08:21:41.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.387+0000 7f2ef2ffd640 1 --2- 172.21.15.88:0/3350499846 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2ed4066470 0x7f2ed4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:41.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.387+0000 7f2ef2ffd640 1 --2- 172.21.15.88:0/3350499846 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2ed4066470 0x7f2ed4068930 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4000f70 tx=0x7f2ee4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:41.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.391+0000 7f2ef0ff9640 1 -- 172.21.15.88:0/3350499846 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2edc0515f0 con 0x7f2ef40c7d30 2023-12-08T08:21:41.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.539+0000 7f2ef9879640 1 -- 172.21.15.88:0/3350499846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ef406c880 con 0x7f2ef40c7d30 2023-12-08T08:21:41.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.543+0000 7f2ef0ff9640 1 -- 172.21.15.88:0/3350499846 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20205 (secure 0 0 0) 0x7f2edc054c10 con 0x7f2ef40c7d30 2023-12-08T08:21:41.547 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:41.547 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":35,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:21:19.666744+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:21:03.690721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-08T08:21:04.127786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:21:16.039054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:21:17.029894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:21:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.543+0000 7f2ef9879640 1 -- 172.21.15.88:0/3350499846 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2ed4066470 msgr2=0x7f2ed4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.543+0000 7f2ef9879640 1 --2- 172.21.15.88:0/3350499846 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2ed4066470 0x7f2ed4068930 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4000f70 tx=0x7f2ee4009040 comp rx=0 tx=0).stop 2023-12-08T08:21:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.543+0000 7f2ef9879640 1 -- 172.21.15.88:0/3350499846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ef40c7d30 msgr2=0x7f2ef41504d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.543+0000 7f2ef9879640 1 --2- 172.21.15.88:0/3350499846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ef40c7d30 0x7f2ef41504d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2edc009fa0 tx=0x7f2edc00d560 comp rx=0 tx=0).stop 2023-12-08T08:21:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.543+0000 7f2ef9879640 1 -- 172.21.15.88:0/3350499846 shutdown_connections 2023-12-08T08:21:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.543+0000 7f2ef9879640 1 --2- 172.21.15.88:0/3350499846 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2ed4066470 0x7f2ed4068930 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.543+0000 7f2ef9879640 1 --2- 172.21.15.88:0/3350499846 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ef4154f00 0x7f2ef4150a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.543+0000 7f2ef9879640 1 --2- 172.21.15.88:0/3350499846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ef40c7d30 0x7f2ef41504d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.543+0000 7f2ef9879640 1 --2- 172.21.15.88:0/3350499846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ef40af4d0 0x7f2ef40acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.543+0000 7f2ef9879640 1 -- 172.21.15.88:0/3350499846 >> 172.21.15.88:0/3350499846 conn(0x7f2ef40aba00 msgr2=0x7f2ef40c9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:41.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.543+0000 7f2ef9879640 1 -- 172.21.15.88:0/3350499846 shutdown_connections 2023-12-08T08:21:41.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.543+0000 7f2ef9879640 1 -- 172.21.15.88:0/3350499846 wait complete. 2023-12-08T08:21:41.571 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-08T08:21:41.571 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:21:41.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.707+0000 7fdcf3654640 1 Processor -- start 2023-12-08T08:21:41.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.707+0000 7fdcf3654640 1 -- start start 2023-12-08T08:21:41.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.707+0000 7fdcf3654640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdcec0bee90 0x7fdcec0bf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:41.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.707+0000 7fdcf3654640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdcec154740 0x7fdcec154b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:41.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.707+0000 7fdcf3654640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcec157cf0 con 0x7fdcec14b2a0 2023-12-08T08:21:41.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.707+0000 7fdcf3654640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcec06c3a0 con 0x7fdcec0bee90 2023-12-08T08:21:41.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.707+0000 7fdcf3654640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcec0a55d0 con 0x7fdcec154740 2023-12-08T08:21:41.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.707+0000 7fdcf13f0640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdcec14b2a0 0x7fdcec0a4ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41276/0 (socket says 172.21.15.88:41276) 2023-12-08T08:21:41.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.707+0000 7fdcf13f0640 1 -- 172.21.15.88:0/793594015 learned_addr learned my addr 172.21.15.88:0/793594015 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:41.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.707+0000 7fdcf0bef640 1 --2- 172.21.15.88:0/793594015 >> v2:172.21.15.88:3300/0 conn(0x7fdcec0bee90 0x7fdcec0bf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:41.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.707+0000 7fdcf1bf1640 1 --2- 172.21.15.88:0/793594015 >> v2:172.21.15.148:3300/0 conn(0x7fdcec154740 0x7fdcec154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:41.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.707+0000 7fdce3fff640 1 -- 172.21.15.88:0/793594015 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1670635427 0 0) 0x7fdcec157cf0 con 0x7fdcec14b2a0 2023-12-08T08:21:41.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.707+0000 7fdce3fff640 1 -- 172.21.15.88:0/793594015 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcd8003530 con 0x7fdcec14b2a0 2023-12-08T08:21:41.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.707+0000 7fdcf0bef640 1 -- 172.21.15.88:0/793594015 >> v2:172.21.15.148:3300/0 conn(0x7fdcec154740 msgr2=0x7fdcec154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:41.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.707+0000 7fdcf0bef640 1 --2- 172.21.15.88:0/793594015 >> v2:172.21.15.148:3300/0 conn(0x7fdcec154740 0x7fdcec154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.707+0000 7fdcf0bef640 1 -- 172.21.15.88:0/793594015 >> v1:172.21.15.88:6789/0 conn(0x7fdcec14b2a0 legacy=0x7fdcec0a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:41.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.707+0000 7fdcf0bef640 1 -- 172.21.15.88:0/793594015 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcec157fd0 con 0x7fdcec0bee90 2023-12-08T08:21:41.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.711+0000 7fdcf0bef640 1 --2- 172.21.15.88:0/793594015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcec0bee90 0x7fdcec0bf310 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdcec1523c0 tx=0x7fdcdc01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a9bd01fec8ae632 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:41.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.711+0000 7fdce3fff640 1 -- 172.21.15.88:0/793594015 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc0ab600 con 0x7fdcec0bee90 2023-12-08T08:21:41.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.711+0000 7fdce3fff640 1 -- 172.21.15.88:0/793594015 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcdc0a7050 con 0x7fdcec0bee90 2023-12-08T08:21:41.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.711+0000 7fdce3fff640 1 -- 172.21.15.88:0/793594015 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc0ab980 con 0x7fdcec0bee90 2023-12-08T08:21:41.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.711+0000 7fdcf3654640 1 -- 172.21.15.88:0/793594015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcec0bee90 msgr2=0x7fdcec0bf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:41.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.711+0000 7fdcf3654640 1 --2- 172.21.15.88:0/793594015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcec0bee90 0x7fdcec0bf310 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdcec1523c0 tx=0x7fdcdc01c340 comp rx=0 tx=0).stop 2023-12-08T08:21:41.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.711+0000 7fdcf3654640 1 -- 172.21.15.88:0/793594015 shutdown_connections 2023-12-08T08:21:41.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.711+0000 7fdcf3654640 1 --2- 172.21.15.88:0/793594015 >> v2:172.21.15.148:3300/0 conn(0x7fdcec154740 0x7fdcec154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.711+0000 7fdcf3654640 1 --2- 172.21.15.88:0/793594015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcec0bee90 0x7fdcec0bf310 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.711+0000 7fdcf3654640 1 -- 172.21.15.88:0/793594015 >> 172.21.15.88:0/793594015 conn(0x7fdcec0a7810 msgr2=0x7fdcec0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:41.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.711+0000 7fdcf3654640 1 -- 172.21.15.88:0/793594015 shutdown_connections 2023-12-08T08:21:41.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.711+0000 7fdcf3654640 1 -- 172.21.15.88:0/793594015 wait complete. 2023-12-08T08:21:41.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.715+0000 7fdcf3654640 1 Processor -- start 2023-12-08T08:21:41.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.715+0000 7fdcf3654640 1 -- start start 2023-12-08T08:21:41.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.715+0000 7fdcf3654640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcec0bee90 0x7fdcec1ed990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:41.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.715+0000 7fdcf3654640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcec14b2a0 0x7fdcec149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:41.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.715+0000 7fdcf3654640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdcec154740 0x7fdcec153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:41.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.715+0000 7fdcf3654640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcec1541f0 con 0x7fdcec14b2a0 2023-12-08T08:21:41.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.715+0000 7fdcf3654640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcec152540 con 0x7fdcec0bee90 2023-12-08T08:21:41.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.715+0000 7fdcf3654640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcec1ed500 con 0x7fdcec154740 2023-12-08T08:21:41.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.715+0000 7fdcf0bef640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcec14b2a0 0x7fdcec149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:41.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.715+0000 7fdcf13f0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcec0bee90 0x7fdcec1ed990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:41.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.715+0000 7fdcf0bef640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcec14b2a0 0x7fdcec149620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56998/0 (socket says 172.21.15.88:56998) 2023-12-08T08:21:41.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.715+0000 7fdcf0bef640 1 -- 172.21.15.88:0/436962348 learned_addr learned my addr 172.21.15.88:0/436962348 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:41.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.715+0000 7fdcf1bf1640 1 --2- 172.21.15.88:0/436962348 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdcec154740 0x7fdcec153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:41.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.715+0000 7fdcf0bef640 1 -- 172.21.15.88:0/436962348 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdcec154740 msgr2=0x7fdcec153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:41.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.715+0000 7fdcf0bef640 1 --2- 172.21.15.88:0/436962348 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdcec154740 0x7fdcec153cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.715+0000 7fdcf0bef640 1 -- 172.21.15.88:0/436962348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcec0bee90 msgr2=0x7fdcec1ed990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:41.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.715+0000 7fdcf0bef640 1 --2- 172.21.15.88:0/436962348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcec0bee90 0x7fdcec1ed990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.715+0000 7fdcf0bef640 1 -- 172.21.15.88:0/436962348 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc009420 con 0x7fdcec14b2a0 2023-12-08T08:21:41.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.715+0000 7fdcf1bf1640 1 --2- 172.21.15.88:0/436962348 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdcec154740 0x7fdcec153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:41.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.715+0000 7fdcf0bef640 1 --2- 172.21.15.88:0/436962348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcec14b2a0 0x7fdcec149620 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0ae040 tx=0x7fdcdc0190e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:41.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.715+0000 7fdce1ffb640 1 -- 172.21.15.88:0/436962348 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc0b4430 con 0x7fdcec14b2a0 2023-12-08T08:21:41.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.715+0000 7fdce1ffb640 1 -- 172.21.15.88:0/436962348 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcdc0b45b0 con 0x7fdcec14b2a0 2023-12-08T08:21:41.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.715+0000 7fdce1ffb640 1 -- 172.21.15.88:0/436962348 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc0b4960 con 0x7fdcec14b2a0 2023-12-08T08:21:41.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.715+0000 7fdcf3654640 1 -- 172.21.15.88:0/436962348 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcec0a7640 con 0x7fdcec14b2a0 2023-12-08T08:21:41.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.715+0000 7fdcf3654640 1 -- 172.21.15.88:0/436962348 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcec149f70 con 0x7fdcec14b2a0 2023-12-08T08:21:41.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.719+0000 7fdcf3654640 1 -- 172.21.15.88:0/436962348 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcec1ed670 con 0x7fdcec14b2a0 2023-12-08T08:21:41.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.719+0000 7fdce1ffb640 1 -- 172.21.15.88:0/436962348 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdcdc0b2040 con 0x7fdcec14b2a0 2023-12-08T08:21:41.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.719+0000 7fdce1ffb640 1 --2- 172.21.15.88:0/436962348 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdcd0066470 0x7fdcd0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:41.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.719+0000 7fdce1ffb640 1 -- 172.21.15.88:0/436962348 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdcdc11df80 con 0x7fdcec14b2a0 2023-12-08T08:21:41.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.719+0000 7fdcf13f0640 1 --2- 172.21.15.88:0/436962348 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdcd0066470 0x7fdcd0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:41.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.719+0000 7fdcf13f0640 1 --2- 172.21.15.88:0/436962348 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdcd0066470 0x7fdcd0068930 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdce80011f0 tx=0x7fdce8007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:41.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.723+0000 7fdce1ffb640 1 -- 172.21.15.88:0/436962348 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdcdc0eb090 con 0x7fdcec14b2a0 2023-12-08T08:21:41.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.907+0000 7fdcf3654640 1 -- 172.21.15.88:0/436962348 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdcec067630 con 0x7fdcec14b2a0 2023-12-08T08:21:41.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.907+0000 7fdce1ffb640 1 -- 172.21.15.88:0/436962348 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6133 (secure 0 0 0) 0x7fdcdc0ee6b0 con 0x7fdcec14b2a0 2023-12-08T08:21:41.911 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:41.911 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4978,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3372523869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3372523869},{"type":"v1","addr":"172.21.15.148:6834","nonce":3372523869}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4085245492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":4085245492},{"type":"v1","addr":"172.21.15.148:6835","nonce":4085245492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:21:05.130882+0000","modified":"2023-12-08T08:21:08.148991+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5049},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5049":{"gid":5049,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/181654220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":181654220},{"type":"v1","addr":"172.21.15.88:6837","nonce":181654220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:21:18.029250+0000","modified":"2023-12-08T08:21:21.056129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.88:6836/4274252181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":4274252181},{"type":"v1","addr":"172.21.15.88:6836","nonce":4274252181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-08T08:21:41.912 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 22 2023-12-08T08:21:41.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.907+0000 7fdcf3654640 1 -- 172.21.15.88:0/436962348 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdcd0066470 msgr2=0x7fdcd0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:41.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.907+0000 7fdcf3654640 1 --2- 172.21.15.88:0/436962348 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdcd0066470 0x7fdcd0068930 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdce80011f0 tx=0x7fdce8007d40 comp rx=0 tx=0).stop 2023-12-08T08:21:41.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.907+0000 7fdcf3654640 1 -- 172.21.15.88:0/436962348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcec14b2a0 msgr2=0x7fdcec149620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:41.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.907+0000 7fdcf3654640 1 --2- 172.21.15.88:0/436962348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcec14b2a0 0x7fdcec149620 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0ae040 tx=0x7fdcdc0190e0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.907+0000 7fdcf3654640 1 -- 172.21.15.88:0/436962348 shutdown_connections 2023-12-08T08:21:41.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.907+0000 7fdcf3654640 1 --2- 172.21.15.88:0/436962348 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdcd0066470 0x7fdcd0068930 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.907+0000 7fdcf3654640 1 --2- 172.21.15.88:0/436962348 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdcec154740 0x7fdcec153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.907+0000 7fdcf3654640 1 --2- 172.21.15.88:0/436962348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcec14b2a0 0x7fdcec149620 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.907+0000 7fdcf3654640 1 --2- 172.21.15.88:0/436962348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcec0bee90 0x7fdcec1ed990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:41.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.907+0000 7fdcf3654640 1 -- 172.21.15.88:0/436962348 >> 172.21.15.88:0/436962348 conn(0x7fdcec0a7810 msgr2=0x7fdcec148ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:41.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.907+0000 7fdcf3654640 1 -- 172.21.15.88:0/436962348 shutdown_connections 2023-12-08T08:21:41.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:41.907+0000 7fdcf3654640 1 -- 172.21.15.88:0/436962348 wait complete. 2023-12-08T08:21:41.933 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:21:42.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.067+0000 7f833a557640 1 Processor -- start 2023-12-08T08:21:42.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.067+0000 7f833a557640 1 -- start start 2023-12-08T08:21:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.067+0000 7f833a557640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f83340af4c0 0x7f8334154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.067+0000 7f833a557640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f833406c100 0x7f83340c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.067+0000 7f833a557640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83340c4890 con 0x7f83340c67d0 2023-12-08T08:21:42.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.067+0000 7f833a557640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8334155460 con 0x7f83340af4c0 2023-12-08T08:21:42.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.067+0000 7f833a557640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83340af8a0 con 0x7f833406c100 2023-12-08T08:21:42.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.067+0000 7f8333fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f83340af4c0 0x7f8334154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:42.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.067+0000 7f83337fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f83340c67d0 0x7f833406b9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41278/0 (socket says 172.21.15.88:41278) 2023-12-08T08:21:42.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.067+0000 7f83337fe640 1 -- 172.21.15.88:0/2500682894 learned_addr learned my addr 172.21.15.88:0/2500682894 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:42.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.067+0000 7f8333fff640 1 -- 172.21.15.88:0/2500682894 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f833406c100 msgr2=0x7f83340c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:42.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.067+0000 7f8333fff640 1 --2- 172.21.15.88:0/2500682894 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f833406c100 0x7f83340c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.067+0000 7f8333fff640 1 -- 172.21.15.88:0/2500682894 >> v1:172.21.15.88:6789/0 conn(0x7f83340c67d0 legacy=0x7f833406b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:42.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.067+0000 7f8333fff640 1 -- 172.21.15.88:0/2500682894 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83340c4b30 con 0x7f83340af4c0 2023-12-08T08:21:42.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.071+0000 7f8333fff640 1 --2- 172.21.15.88:0/2500682894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83340af4c0 0x7f8334154f20 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f83240097c0 tx=0x7f832401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f6b2a780bc062f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:42.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.071+0000 7f8332ffd640 1 -- 172.21.15.88:0/2500682894 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83240ac620 con 0x7f83340af4c0 2023-12-08T08:21:42.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.071+0000 7f8332ffd640 1 -- 172.21.15.88:0/2500682894 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83240ac780 con 0x7f83340af4c0 2023-12-08T08:21:42.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.071+0000 7f8332ffd640 1 -- 172.21.15.88:0/2500682894 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83240acb10 con 0x7f83340af4c0 2023-12-08T08:21:42.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.071+0000 7f833a557640 1 -- 172.21.15.88:0/2500682894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83340af4c0 msgr2=0x7f8334154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:42.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.071+0000 7f833a557640 1 --2- 172.21.15.88:0/2500682894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83340af4c0 0x7f8334154f20 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f83240097c0 tx=0x7f832401c3c0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.071+0000 7f833a557640 1 -- 172.21.15.88:0/2500682894 shutdown_connections 2023-12-08T08:21:42.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.071+0000 7f833a557640 1 --2- 172.21.15.88:0/2500682894 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f833406c100 0x7f83340c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.071+0000 7f833a557640 1 --2- 172.21.15.88:0/2500682894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83340af4c0 0x7f8334154f20 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.071+0000 7f833a557640 1 -- 172.21.15.88:0/2500682894 >> 172.21.15.88:0/2500682894 conn(0x7f83340ab9d0 msgr2=0x7f83340abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:42.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.071+0000 7f833a557640 1 -- 172.21.15.88:0/2500682894 shutdown_connections 2023-12-08T08:21:42.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.071+0000 7f833a557640 1 -- 172.21.15.88:0/2500682894 wait complete. 2023-12-08T08:21:42.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.075+0000 7f833a557640 1 Processor -- start 2023-12-08T08:21:42.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.075+0000 7f833a557640 1 -- start start 2023-12-08T08:21:42.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.075+0000 7f833a557640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f833406c100 0x7f83341ecf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:42.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.075+0000 7f833a557640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83340af4c0 0x7f833414bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:42.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.075+0000 7f833a557640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83340c67d0 0x7f83340c34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:42.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.075+0000 7f833a557640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83340ae2a0 con 0x7f83340af4c0 2023-12-08T08:21:42.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.075+0000 7f833a557640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83341ed470 con 0x7f83340c67d0 2023-12-08T08:21:42.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.075+0000 7f833a557640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83340ad340 con 0x7f833406c100 2023-12-08T08:21:42.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.075+0000 7f83337fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83340af4c0 0x7f833414bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:42.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.075+0000 7f83337fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83340af4c0 0x7f833414bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57030/0 (socket says 172.21.15.88:57030) 2023-12-08T08:21:42.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.075+0000 7f83337fe640 1 -- 172.21.15.88:0/2732511670 learned_addr learned my addr 172.21.15.88:0/2732511670 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:42.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.075+0000 7f8333fff640 1 --2- 172.21.15.88:0/2732511670 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f833406c100 0x7f83341ecf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.075+0000 7f8338af4640 1 --2- 172.21.15.88:0/2732511670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83340c67d0 0x7f83340c34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.075+0000 7f83337fe640 1 -- 172.21.15.88:0/2732511670 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f833406c100 msgr2=0x7f83341ecf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.075+0000 7f83337fe640 1 --2- 172.21.15.88:0/2732511670 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f833406c100 0x7f83341ecf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.075+0000 7f83337fe640 1 -- 172.21.15.88:0/2732511670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83340c67d0 msgr2=0x7f83340c34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.075+0000 7f83337fe640 1 --2- 172.21.15.88:0/2732511670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83340c67d0 0x7f83340c34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.075+0000 7f83337fe640 1 -- 172.21.15.88:0/2732511670 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8324009420 con 0x7f83340af4c0 2023-12-08T08:21:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.075+0000 7f8338af4640 1 --2- 172.21.15.88:0/2732511670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83340c67d0 0x7f83340c34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.075+0000 7f83337fe640 1 --2- 172.21.15.88:0/2732511670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83340af4c0 0x7f833414bd00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f832800c530 tx=0x7f832800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.075+0000 7f8330ff9640 1 -- 172.21.15.88:0/2732511670 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8328005cf0 con 0x7f83340af4c0 2023-12-08T08:21:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.075+0000 7f8330ff9640 1 -- 172.21.15.88:0/2732511670 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8328005e50 con 0x7f83340af4c0 2023-12-08T08:21:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.075+0000 7f8330ff9640 1 -- 172.21.15.88:0/2732511670 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8328007270 con 0x7f83340af4c0 2023-12-08T08:21:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.075+0000 7f833a557640 1 -- 172.21.15.88:0/2732511670 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83340adbe0 con 0x7f83340af4c0 2023-12-08T08:21:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.075+0000 7f833a557640 1 -- 172.21.15.88:0/2732511670 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83340ad590 con 0x7f83340af4c0 2023-12-08T08:21:42.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.075+0000 7f833a557640 1 -- 172.21.15.88:0/2732511670 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8334067630 con 0x7f83340af4c0 2023-12-08T08:21:42.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.079+0000 7f8330ff9640 1 -- 172.21.15.88:0/2732511670 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f83280073d0 con 0x7f83340af4c0 2023-12-08T08:21:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.079+0000 7f8330ff9640 1 --2- 172.21.15.88:0/2732511670 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8320066470 0x7f8320068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.079+0000 7f8330ff9640 1 -- 172.21.15.88:0/2732511670 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f83280835e0 con 0x7f83340af4c0 2023-12-08T08:21:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.079+0000 7f8333fff640 1 --2- 172.21.15.88:0/2732511670 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8320066470 0x7f8320068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.079+0000 7f8333fff640 1 --2- 172.21.15.88:0/2732511670 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8320066470 0x7f8320068930 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f83240ae000 tx=0x7f83240a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:42.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.083+0000 7f8330ff9640 1 -- 172.21.15.88:0/2732511670 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8328050840 con 0x7f83340af4c0 2023-12-08T08:21:42.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.263+0000 7f833a557640 1 -- 172.21.15.88:0/2732511670 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83341501a0 con 0x7f83340af4c0 2023-12-08T08:21:42.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.263+0000 7f8330ff9640 1 -- 172.21.15.88:0/2732511670 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6133 (secure 0 0 0) 0x7f8328053e60 con 0x7f83340af4c0 2023-12-08T08:21:42.267 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:42.267 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4978,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3372523869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3372523869},{"type":"v1","addr":"172.21.15.148:6834","nonce":3372523869}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4085245492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":4085245492},{"type":"v1","addr":"172.21.15.148:6835","nonce":4085245492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:21:05.130882+0000","modified":"2023-12-08T08:21:08.148991+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5049},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5049":{"gid":5049,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/181654220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":181654220},{"type":"v1","addr":"172.21.15.88:6837","nonce":181654220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:21:18.029250+0000","modified":"2023-12-08T08:21:21.056129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.88:6836/4274252181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":4274252181},{"type":"v1","addr":"172.21.15.88:6836","nonce":4274252181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-08T08:21:42.267 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 22 2023-12-08T08:21:42.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.263+0000 7f833a557640 1 -- 172.21.15.88:0/2732511670 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8320066470 msgr2=0x7f8320068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.263+0000 7f833a557640 1 --2- 172.21.15.88:0/2732511670 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8320066470 0x7f8320068930 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f83240ae000 tx=0x7f83240a7000 comp rx=0 tx=0).stop 2023-12-08T08:21:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.263+0000 7f833a557640 1 -- 172.21.15.88:0/2732511670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83340af4c0 msgr2=0x7f833414bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.263+0000 7f833a557640 1 --2- 172.21.15.88:0/2732511670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83340af4c0 0x7f833414bd00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f832800c530 tx=0x7f832800c9f0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.263+0000 7f833a557640 1 -- 172.21.15.88:0/2732511670 shutdown_connections 2023-12-08T08:21:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.263+0000 7f833a557640 1 --2- 172.21.15.88:0/2732511670 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8320066470 0x7f8320068930 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.263+0000 7f833a557640 1 --2- 172.21.15.88:0/2732511670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83340c67d0 0x7f83340c34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.263+0000 7f833a557640 1 --2- 172.21.15.88:0/2732511670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83340af4c0 0x7f833414bd00 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.263+0000 7f833a557640 1 --2- 172.21.15.88:0/2732511670 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f833406c100 0x7f83341ecf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.263+0000 7f833a557640 1 -- 172.21.15.88:0/2732511670 >> 172.21.15.88:0/2732511670 conn(0x7f83340ab9d0 msgr2=0x7f833406b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.263+0000 7f833a557640 1 -- 172.21.15.88:0/2732511670 shutdown_connections 2023-12-08T08:21:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.263+0000 7f833a557640 1 -- 172.21.15.88:0/2732511670 wait complete. 2023-12-08T08:21:42.287 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:21:42.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.419+0000 7fa5c13aa640 1 Processor -- start 2023-12-08T08:21:42.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.423+0000 7fa5c13aa640 1 -- start start 2023-12-08T08:21:42.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.423+0000 7fa5c13aa640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5bc06eda0 0x7fa5bc0c0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:42.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.423+0000 7fa5c13aa640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa5bc0c5fb0 0x7fa5bc0c1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:42.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.423+0000 7fa5c13aa640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5bc0a6f50 con 0x7fa5bc151b70 2023-12-08T08:21:42.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.423+0000 7fa5c13aa640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5bc154f00 con 0x7fa5bc0c5fb0 2023-12-08T08:21:42.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.423+0000 7fa5c13aa640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc1551c0 con 0x7fa5bc06eda0 2023-12-08T08:21:42.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.423+0000 7fa5baffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa5bc151b70 0x7fa5bc06f620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41288/0 (socket says 172.21.15.88:41288) 2023-12-08T08:21:42.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.423+0000 7fa5baffd640 1 -- 172.21.15.88:0/1834565884 learned_addr learned my addr 172.21.15.88:0/1834565884 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:42.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.423+0000 7fa5b3fff640 1 --2- 172.21.15.88:0/1834565884 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5bc06eda0 0x7fa5bc0c0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:42.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.423+0000 7fa5bb7fe640 1 --2- 172.21.15.88:0/1834565884 >> v2:172.21.15.148:3300/0 conn(0x7fa5bc0c5fb0 0x7fa5bc0c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:42.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.423+0000 7fa5ba7fc640 1 -- 172.21.15.88:0/1834565884 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 656072416 0 0) 0x7fa5bc0a6f50 con 0x7fa5bc151b70 2023-12-08T08:21:42.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.423+0000 7fa5ba7fc640 1 -- 172.21.15.88:0/1834565884 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5a8003530 con 0x7fa5bc151b70 2023-12-08T08:21:42.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.423+0000 7fa5ba7fc640 1 -- 172.21.15.88:0/1834565884 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 354212397 0 0) 0x7fa5a8003530 con 0x7fa5bc151b70 2023-12-08T08:21:42.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.423+0000 7fa5b3fff640 1 -- 172.21.15.88:0/1834565884 >> v2:172.21.15.148:3300/0 conn(0x7fa5bc0c5fb0 msgr2=0x7fa5bc0c1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:42.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.423+0000 7fa5b3fff640 1 --2- 172.21.15.88:0/1834565884 >> v2:172.21.15.148:3300/0 conn(0x7fa5bc0c5fb0 0x7fa5bc0c1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.423+0000 7fa5b3fff640 1 -- 172.21.15.88:0/1834565884 >> v1:172.21.15.88:6789/0 conn(0x7fa5bc151b70 legacy=0x7fa5bc06f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:42.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.423+0000 7fa5b3fff640 1 -- 172.21.15.88:0/1834565884 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc0a71a0 con 0x7fa5bc06eda0 2023-12-08T08:21:42.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.427+0000 7fa5b3fff640 1 --2- 172.21.15.88:0/1834565884 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5bc06eda0 0x7fa5bc0c0f20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40097c0 tx=0x7fa5a401c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e5a921cfef570f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:42.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.427+0000 7fa5ba7fc640 1 -- 172.21.15.88:0/1834565884 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac001680 con 0x7fa5bc06eda0 2023-12-08T08:21:42.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.427+0000 7fa5ba7fc640 1 -- 172.21.15.88:0/1834565884 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a40a7050 con 0x7fa5bc06eda0 2023-12-08T08:21:42.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.427+0000 7fa5ba7fc640 1 -- 172.21.15.88:0/1834565884 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a40ab600 con 0x7fa5bc06eda0 2023-12-08T08:21:42.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.427+0000 7fa5c13aa640 1 -- 172.21.15.88:0/1834565884 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5bc06eda0 msgr2=0x7fa5bc0c0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:42.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.427+0000 7fa5c13aa640 1 --2- 172.21.15.88:0/1834565884 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5bc06eda0 0x7fa5bc0c0f20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40097c0 tx=0x7fa5a401c3a0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.427+0000 7fa5c13aa640 1 -- 172.21.15.88:0/1834565884 shutdown_connections 2023-12-08T08:21:42.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.427+0000 7fa5c13aa640 1 --2- 172.21.15.88:0/1834565884 >> v2:172.21.15.148:3300/0 conn(0x7fa5bc0c5fb0 0x7fa5bc0c1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.427+0000 7fa5c13aa640 1 --2- 172.21.15.88:0/1834565884 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5bc06eda0 0x7fa5bc0c0f20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.427+0000 7fa5c13aa640 1 -- 172.21.15.88:0/1834565884 >> 172.21.15.88:0/1834565884 conn(0x7fa5bc0c7af0 msgr2=0x7fa5bc0c7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:42.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.427+0000 7fa5c13aa640 1 -- 172.21.15.88:0/1834565884 shutdown_connections 2023-12-08T08:21:42.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.427+0000 7fa5c13aa640 1 -- 172.21.15.88:0/1834565884 wait complete. 2023-12-08T08:21:42.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.427+0000 7fa5c13aa640 1 Processor -- start 2023-12-08T08:21:42.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.431+0000 7fa5c13aa640 1 -- start start 2023-12-08T08:21:42.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.431+0000 7fa5c13aa640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5bc06eda0 0x7fa5bc143df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:42.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.431+0000 7fa5c13aa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5bc0c5fb0 0x7fa5bc0a9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:42.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.431+0000 7fa5c13aa640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5bc151b70 0x7fa5bc0a8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:42.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.431+0000 7fa5c13aa640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc154500 con 0x7fa5bc0c5fb0 2023-12-08T08:21:42.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.431+0000 7fa5c13aa640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc0aa550 con 0x7fa5bc06eda0 2023-12-08T08:21:42.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.431+0000 7fa5c13aa640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc153e40 con 0x7fa5bc151b70 2023-12-08T08:21:42.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.431+0000 7fa5b3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5bc0c5fb0 0x7fa5bc0a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:42.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.431+0000 7fa5b3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5bc0c5fb0 0x7fa5bc0a9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57038/0 (socket says 172.21.15.88:57038) 2023-12-08T08:21:42.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.431+0000 7fa5b3fff640 1 -- 172.21.15.88:0/1146232549 learned_addr learned my addr 172.21.15.88:0/1146232549 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:42.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.431+0000 7fa5baffd640 1 --2- 172.21.15.88:0/1146232549 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5bc06eda0 0x7fa5bc143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:42.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.431+0000 7fa5bb7fe640 1 --2- 172.21.15.88:0/1146232549 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5bc151b70 0x7fa5bc0a8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:42.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.431+0000 7fa5b3fff640 1 -- 172.21.15.88:0/1146232549 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5bc151b70 msgr2=0x7fa5bc0a8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:42.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.431+0000 7fa5b3fff640 1 --2- 172.21.15.88:0/1146232549 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5bc151b70 0x7fa5bc0a8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.431+0000 7fa5b3fff640 1 -- 172.21.15.88:0/1146232549 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5bc06eda0 msgr2=0x7fa5bc143df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:42.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.431+0000 7fa5b3fff640 1 --2- 172.21.15.88:0/1146232549 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5bc06eda0 0x7fa5bc143df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.431+0000 7fa5b3fff640 1 -- 172.21.15.88:0/1146232549 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a4009420 con 0x7fa5bc0c5fb0 2023-12-08T08:21:42.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.431+0000 7fa5b3fff640 1 --2- 172.21.15.88:0/1146232549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5bc0c5fb0 0x7fa5bc0a9760 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa5a401aa50 tx=0x7fa5a4019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:42.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.431+0000 7fa5b37fe640 1 -- 172.21.15.88:0/1146232549 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a40b4400 con 0x7fa5bc0c5fb0 2023-12-08T08:21:42.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.431+0000 7fa5b37fe640 1 -- 172.21.15.88:0/1146232549 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a40b4560 con 0x7fa5bc0c5fb0 2023-12-08T08:21:42.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.431+0000 7fa5c13aa640 1 -- 172.21.15.88:0/1146232549 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5bc154120 con 0x7fa5bc0c5fb0 2023-12-08T08:21:42.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.431+0000 7fa5b37fe640 1 -- 172.21.15.88:0/1146232549 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a40b48f0 con 0x7fa5bc0c5fb0 2023-12-08T08:21:42.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.431+0000 7fa5c13aa640 1 -- 172.21.15.88:0/1146232549 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5bc0a9ca0 con 0x7fa5bc0c5fb0 2023-12-08T08:21:42.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.431+0000 7fa5c13aa640 1 -- 172.21.15.88:0/1146232549 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5bc0a84e0 con 0x7fa5bc0c5fb0 2023-12-08T08:21:42.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.435+0000 7fa5b37fe640 1 -- 172.21.15.88:0/1146232549 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa5a40b2040 con 0x7fa5bc0c5fb0 2023-12-08T08:21:42.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.435+0000 7fa5b37fe640 1 --2- 172.21.15.88:0/1146232549 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa59c066470 0x7fa59c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:42.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.435+0000 7fa5b37fe640 1 -- 172.21.15.88:0/1146232549 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa5a411e160 con 0x7fa5bc0c5fb0 2023-12-08T08:21:42.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.435+0000 7fa5baffd640 1 --2- 172.21.15.88:0/1146232549 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa59c066470 0x7fa59c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:42.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.435+0000 7fa5baffd640 1 --2- 172.21.15.88:0/1146232549 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa59c066470 0x7fa59c068930 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac006b60 tx=0x7fa5ac001dd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:42.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.439+0000 7fa5b37fe640 1 -- 172.21.15.88:0/1146232549 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa5a40eb320 con 0x7fa5bc0c5fb0 2023-12-08T08:21:42.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.595+0000 7fa5c13aa640 1 -- 172.21.15.88:0/1146232549 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5bc0674b0 con 0x7fa5bc0c5fb0 2023-12-08T08:21:42.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.595+0000 7fa5b37fe640 1 -- 172.21.15.88:0/1146232549 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20205 (secure 0 0 0) 0x7fa5a40ee940 con 0x7fa5bc0c5fb0 2023-12-08T08:21:42.599 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:42.599 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":35,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:21:19.666744+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:21:03.690721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-08T08:21:04.127786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:21:16.039054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:21:17.029894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:21:42.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.595+0000 7fa5c13aa640 1 -- 172.21.15.88:0/1146232549 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa59c066470 msgr2=0x7fa59c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:42.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.595+0000 7fa5c13aa640 1 --2- 172.21.15.88:0/1146232549 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa59c066470 0x7fa59c068930 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac006b60 tx=0x7fa5ac001dd0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.595+0000 7fa5c13aa640 1 -- 172.21.15.88:0/1146232549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5bc0c5fb0 msgr2=0x7fa5bc0a9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:42.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.595+0000 7fa5c13aa640 1 --2- 172.21.15.88:0/1146232549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5bc0c5fb0 0x7fa5bc0a9760 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa5a401aa50 tx=0x7fa5a4019140 comp rx=0 tx=0).stop 2023-12-08T08:21:42.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.595+0000 7fa5c13aa640 1 -- 172.21.15.88:0/1146232549 shutdown_connections 2023-12-08T08:21:42.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.595+0000 7fa5c13aa640 1 --2- 172.21.15.88:0/1146232549 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa59c066470 0x7fa59c068930 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.595+0000 7fa5c13aa640 1 --2- 172.21.15.88:0/1146232549 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5bc151b70 0x7fa5bc0a8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.595+0000 7fa5c13aa640 1 --2- 172.21.15.88:0/1146232549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5bc0c5fb0 0x7fa5bc0a9760 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.595+0000 7fa5c13aa640 1 --2- 172.21.15.88:0/1146232549 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5bc06eda0 0x7fa5bc143df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.595+0000 7fa5c13aa640 1 -- 172.21.15.88:0/1146232549 >> 172.21.15.88:0/1146232549 conn(0x7fa5bc0c7af0 msgr2=0x7fa5bc14ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:42.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.595+0000 7fa5c13aa640 1 -- 172.21.15.88:0/1146232549 shutdown_connections 2023-12-08T08:21:42.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.595+0000 7fa5c13aa640 1 -- 172.21.15.88:0/1146232549 wait complete. 2023-12-08T08:21:42.621 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-08T08:21:42.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.759+0000 7f6bccfe4640 1 Processor -- start 2023-12-08T08:21:42.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.759+0000 7f6bccfe4640 1 -- start start 2023-12-08T08:21:42.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.759+0000 7f6bccfe4640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6bc814e5e0 0x7f6bc80a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:42.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.759+0000 7f6bccfe4640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6bc80a5050 0x7f6bc80c4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:42.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.759+0000 7f6bccfe4640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc80c2040 con 0x7f6bc814e9c0 2023-12-08T08:21:42.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.759+0000 7f6bccfe4640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc80a9610 con 0x7f6bc814e5e0 2023-12-08T08:21:42.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.759+0000 7f6bccfe4640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc80c3730 con 0x7f6bc80a5050 2023-12-08T08:21:42.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.759+0000 7f6bc7fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6bc814e9c0 0x7f6bc80c5720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41294/0 (socket says 172.21.15.88:41294) 2023-12-08T08:21:42.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.759+0000 7f6bc7fff640 1 -- 172.21.15.88:0/806646834 learned_addr learned my addr 172.21.15.88:0/806646834 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:42.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.759+0000 7f6bc77fe640 1 --2- 172.21.15.88:0/806646834 >> v2:172.21.15.148:3300/0 conn(0x7f6bc814e5e0 0x7f6bc80a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:42.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.759+0000 7f6bc6ffd640 1 --2- 172.21.15.88:0/806646834 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6bc80a5050 0x7f6bc80c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:42.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.759+0000 7f6bc67fc640 1 -- 172.21.15.88:0/806646834 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2666016186 0 0) 0x7f6bc80c2040 con 0x7f6bc814e9c0 2023-12-08T08:21:42.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.759+0000 7f6bc67fc640 1 -- 172.21.15.88:0/806646834 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bb0007940 con 0x7f6bc814e9c0 2023-12-08T08:21:42.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.759+0000 7f6bc6ffd640 1 -- 172.21.15.88:0/806646834 >> v2:172.21.15.148:3300/0 conn(0x7f6bc814e5e0 msgr2=0x7f6bc80a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:42.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.759+0000 7f6bc6ffd640 1 --2- 172.21.15.88:0/806646834 >> v2:172.21.15.148:3300/0 conn(0x7f6bc814e5e0 0x7f6bc80a9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.759+0000 7f6bc6ffd640 1 -- 172.21.15.88:0/806646834 >> v1:172.21.15.88:6789/0 conn(0x7f6bc814e9c0 legacy=0x7f6bc80c5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:42.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.759+0000 7f6bc6ffd640 1 -- 172.21.15.88:0/806646834 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc80aa0c0 con 0x7f6bc80a5050 2023-12-08T08:21:42.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.763+0000 7f6bc6ffd640 1 --2- 172.21.15.88:0/806646834 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6bc80a5050 0x7f6bc80c4480 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc0097f0 tx=0x7f6bbc01c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1ed0a51bad0bbff server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:42.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.763+0000 7f6bc67fc640 1 -- 172.21.15.88:0/806646834 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc0a6650 con 0x7f6bc80a5050 2023-12-08T08:21:42.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.763+0000 7f6bc67fc640 1 -- 172.21.15.88:0/806646834 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc0a67b0 con 0x7f6bc80a5050 2023-12-08T08:21:42.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.763+0000 7f6bc67fc640 1 -- 172.21.15.88:0/806646834 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc0a6b40 con 0x7f6bc80a5050 2023-12-08T08:21:42.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.763+0000 7f6bccfe4640 1 -- 172.21.15.88:0/806646834 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6bc80a5050 msgr2=0x7f6bc80c4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:42.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.763+0000 7f6bccfe4640 1 --2- 172.21.15.88:0/806646834 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6bc80a5050 0x7f6bc80c4480 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc0097f0 tx=0x7f6bbc01c680 comp rx=0 tx=0).stop 2023-12-08T08:21:42.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.763+0000 7f6bccfe4640 1 -- 172.21.15.88:0/806646834 shutdown_connections 2023-12-08T08:21:42.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.763+0000 7f6bccfe4640 1 --2- 172.21.15.88:0/806646834 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6bc80a5050 0x7f6bc80c4480 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.763+0000 7f6bccfe4640 1 --2- 172.21.15.88:0/806646834 >> v2:172.21.15.148:3300/0 conn(0x7f6bc814e5e0 0x7f6bc80a9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.763+0000 7f6bccfe4640 1 -- 172.21.15.88:0/806646834 >> 172.21.15.88:0/806646834 conn(0x7f6bc80c2270 msgr2=0x7f6bc80c2680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:42.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.763+0000 7f6bccfe4640 1 -- 172.21.15.88:0/806646834 shutdown_connections 2023-12-08T08:21:42.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.763+0000 7f6bccfe4640 1 -- 172.21.15.88:0/806646834 wait complete. 2023-12-08T08:21:42.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.767+0000 7f6bccfe4640 1 Processor -- start 2023-12-08T08:21:42.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.767+0000 7f6bccfe4640 1 -- start start 2023-12-08T08:21:42.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.767+0000 7f6bccfe4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bc80a5050 0x7f6bc81501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.767+0000 7f6bccfe4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bc814e5e0 0x7f6bc81ea120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.767+0000 7f6bccfe4640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6bc814e9c0 0x7f6bc81ea660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.767+0000 7f6bccfe4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc8144390 con 0x7f6bc814e5e0 2023-12-08T08:21:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.767+0000 7f6bccfe4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc81e99b0 con 0x7f6bc80a5050 2023-12-08T08:21:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.767+0000 7f6bccfe4640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc814a930 con 0x7f6bc814e9c0 2023-12-08T08:21:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.767+0000 7f6bc6ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bc814e5e0 0x7f6bc81ea120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.767+0000 7f6bc6ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bc814e5e0 0x7f6bc81ea120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57052/0 (socket says 172.21.15.88:57052) 2023-12-08T08:21:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.767+0000 7f6bc6ffd640 1 -- 172.21.15.88:0/2462236379 learned_addr learned my addr 172.21.15.88:0/2462236379 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.767+0000 7f6bc77fe640 1 --2- 172.21.15.88:0/2462236379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bc80a5050 0x7f6bc81501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.767+0000 7f6bc7fff640 1 --2- 172.21.15.88:0/2462236379 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6bc814e9c0 0x7f6bc81ea660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.767+0000 7f6bc6ffd640 1 -- 172.21.15.88:0/2462236379 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6bc814e9c0 msgr2=0x7f6bc81ea660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.767+0000 7f6bc6ffd640 1 --2- 172.21.15.88:0/2462236379 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6bc814e9c0 0x7f6bc81ea660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.767+0000 7f6bc6ffd640 1 -- 172.21.15.88:0/2462236379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bc80a5050 msgr2=0x7f6bc81501e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.767+0000 7f6bc6ffd640 1 --2- 172.21.15.88:0/2462236379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bc80a5050 0x7f6bc81501e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.767+0000 7f6bc6ffd640 1 -- 172.21.15.88:0/2462236379 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc009420 con 0x7f6bc814e5e0 2023-12-08T08:21:42.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.767+0000 7f6bc77fe640 1 --2- 172.21.15.88:0/2462236379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bc80a5050 0x7f6bc81501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:42.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.767+0000 7f6bc6ffd640 1 --2- 172.21.15.88:0/2462236379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bc814e5e0 0x7f6bc81ea120 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc01a2b0 tx=0x7f6bbc019420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:42.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.767+0000 7f6baffff640 1 -- 172.21.15.88:0/2462236379 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc0b1650 con 0x7f6bc814e5e0 2023-12-08T08:21:42.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.767+0000 7f6baffff640 1 -- 172.21.15.88:0/2462236379 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc0b17b0 con 0x7f6bc814e5e0 2023-12-08T08:21:42.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.767+0000 7f6bccfe4640 1 -- 172.21.15.88:0/2462236379 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc814a650 con 0x7f6bc814e5e0 2023-12-08T08:21:42.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.767+0000 7f6baffff640 1 -- 172.21.15.88:0/2462236379 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc0b1b60 con 0x7f6bc814e5e0 2023-12-08T08:21:42.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.767+0000 7f6bccfe4640 1 -- 172.21.15.88:0/2462236379 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc81ec7d0 con 0x7f6bc814e5e0 2023-12-08T08:21:42.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.771+0000 7f6bccfe4640 1 -- 172.21.15.88:0/2462236379 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc80674b0 con 0x7f6bc814e5e0 2023-12-08T08:21:42.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.771+0000 7f6baffff640 1 -- 172.21.15.88:0/2462236379 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6bbc0b1cc0 con 0x7f6bc814e5e0 2023-12-08T08:21:42.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.771+0000 7f6baffff640 1 --2- 172.21.15.88:0/2462236379 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6bb4066470 0x7f6bb4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:42.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.771+0000 7f6baffff640 1 -- 172.21.15.88:0/2462236379 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6bbc11e600 con 0x7f6bc814e5e0 2023-12-08T08:21:42.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.771+0000 7f6bc77fe640 1 --2- 172.21.15.88:0/2462236379 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6bb4066470 0x7f6bb4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:42.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.771+0000 7f6bc77fe640 1 --2- 172.21.15.88:0/2462236379 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6bb4066470 0x7f6bb4068930 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009bb0 tx=0x7f6bb8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:42.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.775+0000 7f6baffff640 1 -- 172.21.15.88:0/2462236379 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6bbc0eb680 con 0x7f6bc814e5e0 2023-12-08T08:21:42.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.959+0000 7f6bccfe4640 1 -- 172.21.15.88:0/2462236379 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6bc806dcd0 con 0x7f6bc814e5e0 2023-12-08T08:21:42.964 INFO:tasks.ceph.mon.a.smithi088.stderr:2023-12-08T08:21:42.959+0000 7f9f56907640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-08T08:21:42.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.963+0000 7f6baffff640 1 -- 172.21.15.88:0/2462236379 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6bbc0eeca0 con 0x7f6bc814e5e0 2023-12-08T08:21:42.966 INFO:teuthology.orchestra.run.smithi088.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-08T08:21:42.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.967+0000 7f6bccfe4640 1 -- 172.21.15.88:0/2462236379 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6bb4066470 msgr2=0x7f6bb4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:42.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.967+0000 7f6bccfe4640 1 --2- 172.21.15.88:0/2462236379 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6bb4066470 0x7f6bb4068930 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009bb0 tx=0x7f6bb8008040 comp rx=0 tx=0).stop 2023-12-08T08:21:42.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.967+0000 7f6bccfe4640 1 -- 172.21.15.88:0/2462236379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bc814e5e0 msgr2=0x7f6bc81ea120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:42.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.967+0000 7f6bccfe4640 1 --2- 172.21.15.88:0/2462236379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bc814e5e0 0x7f6bc81ea120 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc01a2b0 tx=0x7f6bbc019420 comp rx=0 tx=0).stop 2023-12-08T08:21:42.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.967+0000 7f6bccfe4640 1 -- 172.21.15.88:0/2462236379 shutdown_connections 2023-12-08T08:21:42.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.967+0000 7f6bccfe4640 1 --2- 172.21.15.88:0/2462236379 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6bb4066470 0x7f6bb4068930 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.967+0000 7f6bccfe4640 1 --2- 172.21.15.88:0/2462236379 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6bc814e9c0 0x7f6bc81ea660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.967+0000 7f6bccfe4640 1 --2- 172.21.15.88:0/2462236379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bc814e5e0 0x7f6bc81ea120 secure :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc01a2b0 tx=0x7f6bbc019420 comp rx=0 tx=0).stop 2023-12-08T08:21:42.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.967+0000 7f6bccfe4640 1 --2- 172.21.15.88:0/2462236379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bc80a5050 0x7f6bc81501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:42.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.967+0000 7f6bccfe4640 1 -- 172.21.15.88:0/2462236379 >> 172.21.15.88:0/2462236379 conn(0x7f6bc80c2270 msgr2=0x7f6bc8146f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:42.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.967+0000 7f6bccfe4640 1 -- 172.21.15.88:0/2462236379 shutdown_connections 2023-12-08T08:21:42.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:42.967+0000 7f6bccfe4640 1 -- 172.21.15.88:0/2462236379 wait complete. 2023-12-08T08:21:42.976 INFO:tasks.ceph.mds.a.smithi088.stderr: -2895> 2023-12-08T08:21:10.652+0000 7f5e956e6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:21:42.992 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-08T08:21:43.026 INFO:tasks.ceph.mds.a.smithi088.stdout:starting mds.a at 2023-12-08T08:21:43.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.131+0000 7f2376017640 1 Processor -- start 2023-12-08T08:21:43.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.131+0000 7f2376017640 1 -- start start 2023-12-08T08:21:43.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.131+0000 7f2376017640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f237014b1e0 0x7f23700c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:43.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f2376017640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23700a4e20 con 0x7f23700c5300 2023-12-08T08:21:43.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f2376017640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23700a50e0 con 0x7f23701548c0 2023-12-08T08:21:43.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f2376017640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23700c0f00 con 0x7f237014b1e0 2023-12-08T08:21:43.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f2367fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f23700c5300 0x7f23700a9c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41308/0 (socket says 172.21.15.88:41308) 2023-12-08T08:21:43.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f2367fff640 1 -- 172.21.15.88:0/3925794949 learned_addr learned my addr 172.21.15.88:0/3925794949 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:43.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f236f7fe640 1 --2- 172.21.15.88:0/3925794949 >> v2:172.21.15.148:3300/0 conn(0x7f237014b1e0 0x7f23700c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:43.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f236effd640 1 -- 172.21.15.88:0/3925794949 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579163091 0 0) 0x7f23700a4e20 con 0x7f23700c5300 2023-12-08T08:21:43.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f236effd640 1 -- 172.21.15.88:0/3925794949 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f235c005740 con 0x7f23700c5300 2023-12-08T08:21:43.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f236effd640 1 -- 172.21.15.88:0/3925794949 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 526163726 0 0) 0x7f235c005740 con 0x7f23700c5300 2023-12-08T08:21:43.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f236effd640 1 -- 172.21.15.88:0/3925794949 >> v2:172.21.15.148:3300/0 conn(0x7f237014b1e0 msgr2=0x7f23700c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:43.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f236effd640 1 --2- 172.21.15.88:0/3925794949 >> v2:172.21.15.148:3300/0 conn(0x7f237014b1e0 0x7f23700c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:43.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f236effd640 1 -- 172.21.15.88:0/3925794949 >> v1:172.21.15.148:6789/0 conn(0x7f23701548c0 legacy=0x7f2370154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:43.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f236effd640 1 -- 172.21.15.88:0/3925794949 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23700c11e0 con 0x7f23700c5300 2023-12-08T08:21:43.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f236effd640 1 -- 172.21.15.88:0/3925794949 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f2358001680 con 0x7f23700c5300 2023-12-08T08:21:43.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f236effd640 1 -- 172.21.15.88:0/3925794949 >> v1:172.21.15.88:6789/0 conn(0x7f23700c5300 legacy=0x7f23700a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:43.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f236effd640 1 --2- 172.21.15.88:0/3925794949 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f235c005b90 0x7f235c005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:43.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f236effd640 1 --2- 172.21.15.88:0/3925794949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f235c0069e0 0x7f235c006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:43.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f236effd640 1 --2- 172.21.15.88:0/3925794949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f235c0073a0 0x7f235c00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:43.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f236effd640 1 -- 172.21.15.88:0/3925794949 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23700c0f00 con 0x7f235c0073a0 2023-12-08T08:21:43.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f236effd640 1 -- 172.21.15.88:0/3925794949 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c00e240 con 0x7f235c0069e0 2023-12-08T08:21:43.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f236effd640 1 -- 172.21.15.88:0/3925794949 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235c00e400 con 0x7f235c005b90 2023-12-08T08:21:43.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f236f7fe640 1 --2- 172.21.15.88:0/3925794949 >> v2:172.21.15.148:3300/0 conn(0x7f237014b1e0 0x7f23700c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:21:43.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f236ffff640 1 --2- 172.21.15.88:0/3925794949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f235c0073a0 0x7f235c00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:43.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f2367fff640 1 --2- 172.21.15.88:0/3925794949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f235c0069e0 0x7f235c006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:43.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f236f7fe640 1 --2- 172.21.15.88:0/3925794949 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f235c005b90 0x7f235c005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:43.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f236ffff640 1 -- 172.21.15.88:0/3925794949 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f235c005b90 msgr2=0x7f235c005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:43.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f236ffff640 1 --2- 172.21.15.88:0/3925794949 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f235c005b90 0x7f235c005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:43.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f236ffff640 1 -- 172.21.15.88:0/3925794949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f235c0069e0 msgr2=0x7f235c006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:43.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f236ffff640 1 --2- 172.21.15.88:0/3925794949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f235c0069e0 0x7f235c006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:43.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.135+0000 7f236ffff640 1 -- 172.21.15.88:0/3925794949 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235c005740 con 0x7f235c0073a0 2023-12-08T08:21:43.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.139+0000 7f236ffff640 1 -- 172.21.15.88:0/3925794949 reap_dead start 2023-12-08T08:21:43.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.139+0000 7f236ffff640 1 --2- 172.21.15.88:0/3925794949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f235c0073a0 0x7f235c00dba0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f2368001e70 tx=0x7f236801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ea33cd663837a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:43.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.139+0000 7f236effd640 1 -- 172.21.15.88:0/3925794949 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2368003b80 con 0x7f235c0073a0 2023-12-08T08:21:43.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.139+0000 7f236effd640 1 -- 172.21.15.88:0/3925794949 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2368003d00 con 0x7f235c0073a0 2023-12-08T08:21:43.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.139+0000 7f236effd640 1 -- 172.21.15.88:0/3925794949 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2368005260 con 0x7f235c0073a0 2023-12-08T08:21:43.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.139+0000 7f2376017640 1 -- 172.21.15.88:0/3925794949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f235c0073a0 msgr2=0x7f235c00dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:43.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.139+0000 7f2376017640 1 --2- 172.21.15.88:0/3925794949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f235c0073a0 0x7f235c00dba0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f2368001e70 tx=0x7f236801c760 comp rx=0 tx=0).stop 2023-12-08T08:21:43.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.139+0000 7f2376017640 1 -- 172.21.15.88:0/3925794949 shutdown_connections 2023-12-08T08:21:43.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.139+0000 7f2376017640 1 --2- 172.21.15.88:0/3925794949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f235c0073a0 0x7f235c00dba0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:43.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.139+0000 7f2376017640 1 -- 172.21.15.88:0/3925794949 >> 172.21.15.88:0/3925794949 conn(0x7f23700c59f0 msgr2=0x7f23700c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:43.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.139+0000 7f2376017640 1 -- 172.21.15.88:0/3925794949 shutdown_connections 2023-12-08T08:21:43.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.139+0000 7f2376017640 1 -- 172.21.15.88:0/3925794949 wait complete. 2023-12-08T08:21:43.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.139+0000 7f2376017640 1 Processor -- start 2023-12-08T08:21:43.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.139+0000 7f2376017640 1 -- start start 2023-12-08T08:21:43.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.143+0000 7f2376017640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f235c0073a0 0x7f23700aaa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:43.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.143+0000 7f2376017640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23701469f0 0x7f2370146e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:43.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.143+0000 7f2376017640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f237014c890 0x7f237014cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:43.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.143+0000 7f2376017640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237014c2b0 con 0x7f235c0073a0 2023-12-08T08:21:43.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.143+0000 7f2376017640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23701e5f50 con 0x7f23701469f0 2023-12-08T08:21:43.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.143+0000 7f2376017640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23701e63e0 con 0x7f237014c890 2023-12-08T08:21:43.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.143+0000 7f236f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f235c0073a0 0x7f23700aaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:43.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.143+0000 7f236f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f235c0073a0 0x7f23700aaa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57104/0 (socket says 172.21.15.88:57104) 2023-12-08T08:21:43.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.143+0000 7f236f7fe640 1 -- 172.21.15.88:0/2927535305 learned_addr learned my addr 172.21.15.88:0/2927535305 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:43.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.143+0000 7f2367fff640 1 --2- 172.21.15.88:0/2927535305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23701469f0 0x7f2370146e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:43.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.143+0000 7f236ffff640 1 --2- 172.21.15.88:0/2927535305 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f237014c890 0x7f237014cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:43.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.143+0000 7f236f7fe640 1 -- 172.21.15.88:0/2927535305 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f237014c890 msgr2=0x7f237014cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:43.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.143+0000 7f236f7fe640 1 --2- 172.21.15.88:0/2927535305 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f237014c890 0x7f237014cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:43.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.143+0000 7f236f7fe640 1 -- 172.21.15.88:0/2927535305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23701469f0 msgr2=0x7f2370146e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:43.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.143+0000 7f236f7fe640 1 --2- 172.21.15.88:0/2927535305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23701469f0 0x7f2370146e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:43.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.143+0000 7f236f7fe640 1 -- 172.21.15.88:0/2927535305 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23701e8d60 con 0x7f235c0073a0 2023-12-08T08:21:43.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.143+0000 7f236f7fe640 1 --2- 172.21.15.88:0/2927535305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f235c0073a0 0x7f23700aaa60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2360011930 tx=0x7f2360011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:43.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.143+0000 7f236cff9640 1 -- 172.21.15.88:0/2927535305 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2360009650 con 0x7f235c0073a0 2023-12-08T08:21:43.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.143+0000 7f236cff9640 1 -- 172.21.15.88:0/2927535305 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236000f9d0 con 0x7f235c0073a0 2023-12-08T08:21:43.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.143+0000 7f2376017640 1 -- 172.21.15.88:0/2927535305 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23701e8a80 con 0x7f235c0073a0 2023-12-08T08:21:43.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.143+0000 7f236cff9640 1 -- 172.21.15.88:0/2927535305 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236000fd40 con 0x7f235c0073a0 2023-12-08T08:21:43.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.143+0000 7f2376017640 1 -- 172.21.15.88:0/2927535305 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23701e5900 con 0x7f235c0073a0 2023-12-08T08:21:43.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.143+0000 7f2376017640 1 -- 172.21.15.88:0/2927535305 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2370067630 con 0x7f235c0073a0 2023-12-08T08:21:43.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.143+0000 7f236cff9640 1 -- 172.21.15.88:0/2927535305 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2360015460 con 0x7f235c0073a0 2023-12-08T08:21:43.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.147+0000 7f236cff9640 1 --2- 172.21.15.88:0/2927535305 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2350066470 0x7f2350068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:43.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.147+0000 7f236cff9640 1 -- 172.21.15.88:0/2927535305 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f2360084b90 con 0x7f235c0073a0 2023-12-08T08:21:43.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.147+0000 7f2367fff640 1 --2- 172.21.15.88:0/2927535305 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2350066470 0x7f2350068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:43.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.147+0000 7f2367fff640 1 --2- 172.21.15.88:0/2927535305 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2350066470 0x7f2350068930 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f23700c3dd0 tx=0x7f2358001180 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:43.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.151+0000 7f236cff9640 1 -- 172.21.15.88:0/2927535305 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2360051bc0 con 0x7f235c0073a0 2023-12-08T08:21:43.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.331+0000 7f2376017640 1 -- 172.21.15.88:0/2927535305 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2370149eb0 con 0x7f235c0073a0 2023-12-08T08:21:43.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.963+0000 7f236cff9640 1 -- 172.21.15.88:0/2927535305 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7f236000fea0 con 0x7f235c0073a0 2023-12-08T08:21:43.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.967+0000 7f2376017640 1 -- 172.21.15.88:0/2927535305 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2350066470 msgr2=0x7f2350068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:43.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.967+0000 7f2376017640 1 --2- 172.21.15.88:0/2927535305 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2350066470 0x7f2350068930 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f23700c3dd0 tx=0x7f2358001180 comp rx=0 tx=0).stop 2023-12-08T08:21:43.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.967+0000 7f2376017640 1 -- 172.21.15.88:0/2927535305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f235c0073a0 msgr2=0x7f23700aaa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:43.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.967+0000 7f2376017640 1 --2- 172.21.15.88:0/2927535305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f235c0073a0 0x7f23700aaa60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2360011930 tx=0x7f2360011d30 comp rx=0 tx=0).stop 2023-12-08T08:21:43.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.967+0000 7f2376017640 1 -- 172.21.15.88:0/2927535305 shutdown_connections 2023-12-08T08:21:43.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.967+0000 7f2376017640 1 --2- 172.21.15.88:0/2927535305 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2350066470 0x7f2350068930 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:43.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.967+0000 7f2376017640 1 --2- 172.21.15.88:0/2927535305 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f237014c890 0x7f237014cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:43.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.967+0000 7f2376017640 1 --2- 172.21.15.88:0/2927535305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23701469f0 0x7f2370146e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:43.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.967+0000 7f2376017640 1 --2- 172.21.15.88:0/2927535305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f235c0073a0 0x7f23700aaa60 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:43.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.967+0000 7f2376017640 1 -- 172.21.15.88:0/2927535305 >> 172.21.15.88:0/2927535305 conn(0x7f23700c59f0 msgr2=0x7f23701db3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:43.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.967+0000 7f2376017640 1 -- 172.21.15.88:0/2927535305 shutdown_connections 2023-12-08T08:21:43.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:43.967+0000 7f2376017640 1 -- 172.21.15.88:0/2927535305 wait complete. 2023-12-08T08:21:43.993 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-08T08:21:44.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e0a501640 1 Processor -- start 2023-12-08T08:21:44.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e0a501640 1 -- start start 2023-12-08T08:21:44.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e0a501640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e0414f850 0x7f3e040aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:44.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e0a501640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e04152910 con 0x7f3e0406d840 2023-12-08T08:21:44.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e0a501640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e04152bf0 con 0x7f3e0414fc30 2023-12-08T08:21:44.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e0a501640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e040c2240 con 0x7f3e0414f850 2023-12-08T08:21:44.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e08a9e640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3e0406d840 0x7f3e040c43e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41318/0 (socket says 172.21.15.88:41318) 2023-12-08T08:21:44.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e08a9e640 1 -- 172.21.15.88:0/264810617 learned_addr learned my addr 172.21.15.88:0/264810617 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:44.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e03fff640 1 --2- 172.21.15.88:0/264810617 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e0414f850 0x7f3e040aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:44.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e02ffd640 1 -- 172.21.15.88:0/264810617 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958067566 0 0) 0x7f3e04152910 con 0x7f3e0406d840 2023-12-08T08:21:44.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e02ffd640 1 -- 172.21.15.88:0/264810617 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dec003530 con 0x7f3e0406d840 2023-12-08T08:21:44.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e02ffd640 1 -- 172.21.15.88:0/264810617 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1021928752 0 0) 0x7f3e04152bf0 con 0x7f3e0414fc30 2023-12-08T08:21:44.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e02ffd640 1 -- 172.21.15.88:0/264810617 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e04152910 con 0x7f3e0414fc30 2023-12-08T08:21:44.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e02ffd640 1 -- 172.21.15.88:0/264810617 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3085762006 0 0) 0x7f3dec003530 con 0x7f3e0406d840 2023-12-08T08:21:44.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e02ffd640 1 -- 172.21.15.88:0/264810617 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e0414f850 msgr2=0x7f3e040aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:44.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e02ffd640 1 --2- 172.21.15.88:0/264810617 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e0414f850 0x7f3e040aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:44.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e02ffd640 1 -- 172.21.15.88:0/264810617 >> v1:172.21.15.148:6789/0 conn(0x7f3e0414fc30 legacy=0x7f3e040c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:44.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e02ffd640 1 -- 172.21.15.88:0/264810617 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e04152ed0 con 0x7f3e0406d840 2023-12-08T08:21:44.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e02ffd640 1 -- 172.21.15.88:0/264810617 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f3dfc001a00 con 0x7f3e0406d840 2023-12-08T08:21:44.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e02ffd640 1 -- 172.21.15.88:0/264810617 >> v1:172.21.15.88:6789/0 conn(0x7f3e0406d840 legacy=0x7f3e040c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:44.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e02ffd640 1 --2- 172.21.15.88:0/264810617 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e0414f850 0x7f3dec003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:44.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e02ffd640 1 --2- 172.21.15.88:0/264810617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dec0040a0 0x7f3dec0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:44.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e02ffd640 1 --2- 172.21.15.88:0/264810617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dec004d10 0x7f3dec005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:44.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e02ffd640 1 -- 172.21.15.88:0/264810617 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e040c2240 con 0x7f3dec004d10 2023-12-08T08:21:44.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e02ffd640 1 -- 172.21.15.88:0/264810617 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec00bb20 con 0x7f3dec0040a0 2023-12-08T08:21:44.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e02ffd640 1 -- 172.21.15.88:0/264810617 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec00bcb0 con 0x7f3e0414f850 2023-12-08T08:21:44.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e08a9e640 1 --2- 172.21.15.88:0/264810617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dec004d10 0x7f3dec005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:44.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e03fff640 1 --2- 172.21.15.88:0/264810617 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e0414f850 0x7f3dec003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:44.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e037fe640 1 --2- 172.21.15.88:0/264810617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dec0040a0 0x7f3dec0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:44.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e08a9e640 1 -- 172.21.15.88:0/264810617 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e0414f850 msgr2=0x7f3dec003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:44.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e08a9e640 1 --2- 172.21.15.88:0/264810617 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e0414f850 0x7f3dec003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:44.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e08a9e640 1 -- 172.21.15.88:0/264810617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dec0040a0 msgr2=0x7f3dec0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:44.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e08a9e640 1 --2- 172.21.15.88:0/264810617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dec0040a0 0x7f3dec0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:44.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.179+0000 7f3e08a9e640 1 -- 172.21.15.88:0/264810617 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec003530 con 0x7f3dec004d10 2023-12-08T08:21:44.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.183+0000 7f3e03fff640 1 --2- 172.21.15.88:0/264810617 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e0414f850 0x7f3dec003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:21:44.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.183+0000 7f3e08a9e640 1 --2- 172.21.15.88:0/264810617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dec004d10 0x7f3dec005190 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3e0406dc90 tx=0x7f3dfc01d280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a028f90344febf server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:44.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.183+0000 7f3e02ffd640 1 -- 172.21.15.88:0/264810617 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc0ad630 con 0x7f3dec004d10 2023-12-08T08:21:44.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.183+0000 7f3e02ffd640 1 -- 172.21.15.88:0/264810617 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dfc0a8070 con 0x7f3dec004d10 2023-12-08T08:21:44.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.183+0000 7f3e02ffd640 1 -- 172.21.15.88:0/264810617 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc0ada30 con 0x7f3dec004d10 2023-12-08T08:21:44.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.183+0000 7f3e0a501640 1 -- 172.21.15.88:0/264810617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dec004d10 msgr2=0x7f3dec005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:44.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.183+0000 7f3e0a501640 1 --2- 172.21.15.88:0/264810617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dec004d10 0x7f3dec005190 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3e0406dc90 tx=0x7f3dfc01d280 comp rx=0 tx=0).stop 2023-12-08T08:21:44.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.183+0000 7f3e08a9e640 1 -- 172.21.15.88:0/264810617 reap_dead start 2023-12-08T08:21:44.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.183+0000 7f3e0a501640 1 -- 172.21.15.88:0/264810617 shutdown_connections 2023-12-08T08:21:44.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.183+0000 7f3e0a501640 1 -- 172.21.15.88:0/264810617 >> 172.21.15.88:0/264810617 conn(0x7f3e040c59f0 msgr2=0x7f3e040c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:44.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.183+0000 7f3e0a501640 1 -- 172.21.15.88:0/264810617 shutdown_connections 2023-12-08T08:21:44.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.183+0000 7f3e0a501640 1 -- 172.21.15.88:0/264810617 wait complete. 2023-12-08T08:21:44.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.187+0000 7f3e0a501640 1 Processor -- start 2023-12-08T08:21:44.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.187+0000 7f3e0a501640 1 -- start start 2023-12-08T08:21:44.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.187+0000 7f3e0a501640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dec004d10 0x7f3e04156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:44.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.187+0000 7f3e0a501640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e040ba950 0x7f3e04071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:44.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.187+0000 7f3e0a501640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e04153520 0x7f3e0414c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:44.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.187+0000 7f3e0a501640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e040bb680 con 0x7f3e040ba950 2023-12-08T08:21:44.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.187+0000 7f3e0a501640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e040bfe90 con 0x7f3dec004d10 2023-12-08T08:21:44.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.187+0000 7f3e0a501640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e040bb030 con 0x7f3e04153520 2023-12-08T08:21:44.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.187+0000 7f3e037fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e040ba950 0x7f3e04071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:44.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.187+0000 7f3e037fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e040ba950 0x7f3e04071ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57134/0 (socket says 172.21.15.88:57134) 2023-12-08T08:21:44.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.187+0000 7f3e037fe640 1 -- 172.21.15.88:0/854184588 learned_addr learned my addr 172.21.15.88:0/854184588 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:44.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.187+0000 7f3e03fff640 1 --2- 172.21.15.88:0/854184588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dec004d10 0x7f3e04156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:44.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.187+0000 7f3e08a9e640 1 --2- 172.21.15.88:0/854184588 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e04153520 0x7f3e0414c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:44.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.187+0000 7f3e037fe640 1 -- 172.21.15.88:0/854184588 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e04153520 msgr2=0x7f3e0414c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:44.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.187+0000 7f3e037fe640 1 --2- 172.21.15.88:0/854184588 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e04153520 0x7f3e0414c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:44.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.187+0000 7f3e037fe640 1 -- 172.21.15.88:0/854184588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dec004d10 msgr2=0x7f3e04156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:44.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.187+0000 7f3e037fe640 1 --2- 172.21.15.88:0/854184588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dec004d10 0x7f3e04156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:44.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.187+0000 7f3e037fe640 1 -- 172.21.15.88:0/854184588 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e040badb0 con 0x7f3e040ba950 2023-12-08T08:21:44.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.187+0000 7f3e08a9e640 1 --2- 172.21.15.88:0/854184588 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e04153520 0x7f3e0414c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:44.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.187+0000 7f3e037fe640 1 --2- 172.21.15.88:0/854184588 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e040ba950 0x7f3e04071ef0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3df8012830 tx=0x7f3df8012c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.187+0000 7f3e00ff9640 1 -- 172.21.15.88:0/854184588 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df8010bd0 con 0x7f3e040ba950 2023-12-08T08:21:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.187+0000 7f3e00ff9640 1 -- 172.21.15.88:0/854184588 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df8010d50 con 0x7f3e040ba950 2023-12-08T08:21:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.187+0000 7f3e00ff9640 1 -- 172.21.15.88:0/854184588 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df80166c0 con 0x7f3e040ba950 2023-12-08T08:21:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.187+0000 7f3e0a501640 1 -- 172.21.15.88:0/854184588 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e040bf8f0 con 0x7f3e040ba950 2023-12-08T08:21:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.191+0000 7f3e0a501640 1 -- 172.21.15.88:0/854184588 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e04156060 con 0x7f3e040ba950 2023-12-08T08:21:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.191+0000 7f3e0a501640 1 -- 172.21.15.88:0/854184588 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e04067630 con 0x7f3e040ba950 2023-12-08T08:21:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.191+0000 7f3e00ff9640 1 -- 172.21.15.88:0/854184588 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3df8016820 con 0x7f3e040ba950 2023-12-08T08:21:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.191+0000 7f3e00ff9640 1 --2- 172.21.15.88:0/854184588 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3df00664a0 0x7f3df0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.191+0000 7f3e00ff9640 1 -- 172.21.15.88:0/854184588 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f3df8087a30 con 0x7f3e040ba950 2023-12-08T08:21:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.191+0000 7f3e03fff640 1 --2- 172.21.15.88:0/854184588 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3df00664a0 0x7f3df0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:44.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.191+0000 7f3e03fff640 1 --2- 172.21.15.88:0/854184588 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3df00664a0 0x7f3df0068960 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009d80 tx=0x7f3df4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:44.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.195+0000 7f3e00ff9640 1 -- 172.21.15.88:0/854184588 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3df8054af0 con 0x7f3e040ba950 2023-12-08T08:21:44.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.347+0000 7f3e0a501640 1 -- 172.21.15.88:0/854184588 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3e040a4a90 con 0x7f3e040ba950 2023-12-08T08:21:44.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.967+0000 7f3e00ff9640 1 -- 172.21.15.88:0/854184588 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3df8058110 con 0x7f3e040ba950 2023-12-08T08:21:44.972 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' removed 2023-12-08T08:21:44.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.971+0000 7f3e0a501640 1 -- 172.21.15.88:0/854184588 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3df00664a0 msgr2=0x7f3df0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:44.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.971+0000 7f3e0a501640 1 --2- 172.21.15.88:0/854184588 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3df00664a0 0x7f3df0068960 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009d80 tx=0x7f3df4009190 comp rx=0 tx=0).stop 2023-12-08T08:21:44.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.971+0000 7f3e0a501640 1 -- 172.21.15.88:0/854184588 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e040ba950 msgr2=0x7f3e04071ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:44.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.971+0000 7f3e0a501640 1 --2- 172.21.15.88:0/854184588 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e040ba950 0x7f3e04071ef0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3df8012830 tx=0x7f3df8012c30 comp rx=0 tx=0).stop 2023-12-08T08:21:44.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.971+0000 7f3e0a501640 1 -- 172.21.15.88:0/854184588 shutdown_connections 2023-12-08T08:21:44.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.971+0000 7f3e0a501640 1 --2- 172.21.15.88:0/854184588 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3df00664a0 0x7f3df0068960 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:44.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.971+0000 7f3e0a501640 1 --2- 172.21.15.88:0/854184588 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e04153520 0x7f3e0414c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:44.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.971+0000 7f3e0a501640 1 --2- 172.21.15.88:0/854184588 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e040ba950 0x7f3e04071ef0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:44.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.971+0000 7f3e0a501640 1 --2- 172.21.15.88:0/854184588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dec004d10 0x7f3e04156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:44.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.971+0000 7f3e0a501640 1 -- 172.21.15.88:0/854184588 >> 172.21.15.88:0/854184588 conn(0x7f3e040c59f0 msgr2=0x7f3e0415d330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:44.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.971+0000 7f3e0a501640 1 -- 172.21.15.88:0/854184588 shutdown_connections 2023-12-08T08:21:44.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:44.971+0000 7f3e0a501640 1 -- 172.21.15.88:0/854184588 wait complete. 2023-12-08T08:21:45.000 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-08T08:21:45.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.143+0000 7fb873c79640 1 Processor -- start 2023-12-08T08:21:45.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.143+0000 7fb873c79640 1 -- start start 2023-12-08T08:21:45.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.143+0000 7fb873c79640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb86c14e2a0 0x7fb86c1516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:45.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.143+0000 7fb873c79640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb86c0a9460 0x7fb86c0c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:45.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.143+0000 7fb873c79640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb86c151210 con 0x7fb86c0a98e0 2023-12-08T08:21:45.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.143+0000 7fb873c79640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb86c14e680 con 0x7fb86c0a9460 2023-12-08T08:21:45.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.143+0000 7fb873c79640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c150be0 con 0x7fb86c14e2a0 2023-12-08T08:21:45.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.143+0000 7fb871214640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb86c0a9460 0x7fb86c0c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:45.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.143+0000 7fb871214640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb86c0a9460 0x7fb86c0c4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57148/0 (socket says 172.21.15.88:57148) 2023-12-08T08:21:45.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.143+0000 7fb871214640 1 -- 172.21.15.88:0/1828664727 learned_addr learned my addr 172.21.15.88:0/1828664727 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:45.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.143+0000 7fb871a15640 1 --2- 172.21.15.88:0/1828664727 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb86c14e2a0 0x7fb86c1516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:45.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.143+0000 7fb871214640 1 -- 172.21.15.88:0/1828664727 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb86c14e2a0 msgr2=0x7fb86c1516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:45.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.143+0000 7fb871214640 1 --2- 172.21.15.88:0/1828664727 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb86c14e2a0 0x7fb86c1516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:45.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.143+0000 7fb871214640 1 -- 172.21.15.88:0/1828664727 >> v1:172.21.15.148:6789/0 conn(0x7fb86c0a98e0 legacy=0x7fb86c06bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:45.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.143+0000 7fb871214640 1 -- 172.21.15.88:0/1828664727 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86c0c53c0 con 0x7fb86c0a9460 2023-12-08T08:21:45.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.147+0000 7fb871214640 1 --2- 172.21.15.88:0/1828664727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb86c0a9460 0x7fb86c0c4180 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009870 tx=0x7fb85c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c63b7383b953e9b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:45.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.147+0000 7fb870a13640 1 -- 172.21.15.88:0/1828664727 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c0ab600 con 0x7fb86c0a9460 2023-12-08T08:21:45.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.147+0000 7fb870a13640 1 -- 172.21.15.88:0/1828664727 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c0a7050 con 0x7fb86c0a9460 2023-12-08T08:21:45.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.147+0000 7fb870a13640 1 -- 172.21.15.88:0/1828664727 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c0ab980 con 0x7fb86c0a9460 2023-12-08T08:21:45.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.147+0000 7fb873c79640 1 -- 172.21.15.88:0/1828664727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb86c0a9460 msgr2=0x7fb86c0c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:45.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.147+0000 7fb873c79640 1 --2- 172.21.15.88:0/1828664727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb86c0a9460 0x7fb86c0c4180 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009870 tx=0x7fb85c01c500 comp rx=0 tx=0).stop 2023-12-08T08:21:45.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.147+0000 7fb873c79640 1 -- 172.21.15.88:0/1828664727 shutdown_connections 2023-12-08T08:21:45.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.147+0000 7fb873c79640 1 --2- 172.21.15.88:0/1828664727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb86c0a9460 0x7fb86c0c4180 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:45.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.147+0000 7fb873c79640 1 --2- 172.21.15.88:0/1828664727 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb86c14e2a0 0x7fb86c1516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:45.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.147+0000 7fb873c79640 1 -- 172.21.15.88:0/1828664727 >> 172.21.15.88:0/1828664727 conn(0x7fb86c0c59f0 msgr2=0x7fb86c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:45.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.147+0000 7fb873c79640 1 -- 172.21.15.88:0/1828664727 shutdown_connections 2023-12-08T08:21:45.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.147+0000 7fb873c79640 1 -- 172.21.15.88:0/1828664727 wait complete. 2023-12-08T08:21:45.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.151+0000 7fb873c79640 1 Processor -- start 2023-12-08T08:21:45.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.151+0000 7fb873c79640 1 -- start start 2023-12-08T08:21:45.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.151+0000 7fb873c79640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb86c0a9460 0x7fb86c072190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:45.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.151+0000 7fb873c79640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb86c0a98e0 0x7fb86c0726d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:45.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.151+0000 7fb873c79640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb86c14e2a0 0x7fb86c1449d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:45.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.151+0000 7fb873c79640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c071af0 con 0x7fb86c14e2a0 2023-12-08T08:21:45.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.151+0000 7fb873c79640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c070290 con 0x7fb86c0a98e0 2023-12-08T08:21:45.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.151+0000 7fb873c79640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c070810 con 0x7fb86c0a9460 2023-12-08T08:21:45.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.151+0000 7fb872216640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb86c14e2a0 0x7fb86c1449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:45.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.151+0000 7fb872216640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb86c14e2a0 0x7fb86c1449d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57156/0 (socket says 172.21.15.88:57156) 2023-12-08T08:21:45.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.151+0000 7fb872216640 1 -- 172.21.15.88:0/1498719271 learned_addr learned my addr 172.21.15.88:0/1498719271 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:45.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.151+0000 7fb871214640 1 --2- 172.21.15.88:0/1498719271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb86c0a98e0 0x7fb86c0726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:45.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.151+0000 7fb871a15640 1 --2- 172.21.15.88:0/1498719271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb86c0a9460 0x7fb86c072190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:45.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.151+0000 7fb872216640 1 -- 172.21.15.88:0/1498719271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb86c0a9460 msgr2=0x7fb86c072190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:45.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.151+0000 7fb872216640 1 --2- 172.21.15.88:0/1498719271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb86c0a9460 0x7fb86c072190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:45.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.151+0000 7fb872216640 1 -- 172.21.15.88:0/1498719271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb86c0a98e0 msgr2=0x7fb86c0726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:45.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.151+0000 7fb872216640 1 --2- 172.21.15.88:0/1498719271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb86c0a98e0 0x7fb86c0726d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:45.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.151+0000 7fb872216640 1 -- 172.21.15.88:0/1498719271 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c0094d0 con 0x7fb86c14e2a0 2023-12-08T08:21:45.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.151+0000 7fb872216640 1 --2- 172.21.15.88:0/1498719271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb86c14e2a0 0x7fb86c1449d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb86400c780 tx=0x7fb86400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:45.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.151+0000 7fb8627fc640 1 -- 172.21.15.88:0/1498719271 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86400a9f0 con 0x7fb86c14e2a0 2023-12-08T08:21:45.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.151+0000 7fb8627fc640 1 -- 172.21.15.88:0/1498719271 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86400ce90 con 0x7fb86c14e2a0 2023-12-08T08:21:45.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.151+0000 7fb8627fc640 1 -- 172.21.15.88:0/1498719271 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86400add0 con 0x7fb86c14e2a0 2023-12-08T08:21:45.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.151+0000 7fb873c79640 1 -- 172.21.15.88:0/1498719271 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86c1eb830 con 0x7fb86c14e2a0 2023-12-08T08:21:45.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.151+0000 7fb873c79640 1 -- 172.21.15.88:0/1498719271 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86c0704a0 con 0x7fb86c14e2a0 2023-12-08T08:21:45.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.151+0000 7fb873c79640 1 -- 172.21.15.88:0/1498719271 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb86c0abc50 con 0x7fb86c14e2a0 2023-12-08T08:21:45.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.155+0000 7fb8627fc640 1 -- 172.21.15.88:0/1498719271 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb864012420 con 0x7fb86c14e2a0 2023-12-08T08:21:45.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.155+0000 7fb8627fc640 1 --2- 172.21.15.88:0/1498719271 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb8500664a0 0x7fb850068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:45.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.155+0000 7fb8627fc640 1 -- 172.21.15.88:0/1498719271 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6213+0+0 (secure 0 0 0) 0x7fb864083d80 con 0x7fb86c14e2a0 2023-12-08T08:21:45.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.155+0000 7fb871a15640 1 --2- 172.21.15.88:0/1498719271 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb8500664a0 0x7fb850068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:45.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.155+0000 7fb871a15640 1 --2- 172.21.15.88:0/1498719271 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb8500664a0 0x7fb850068960 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb86c14ba30 tx=0x7fb868008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:45.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.159+0000 7fb8627fc640 1 -- 172.21.15.88:0/1498719271 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb8640510a0 con 0x7fb86c14e2a0 2023-12-08T08:21:45.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.307+0000 7fb873c79640 1 -- 172.21.15.88:0/1498719271 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb86c067630 con 0x7fb86c14e2a0 2023-12-08T08:21:45.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.967+0000 7fb8627fc640 1 -- 172.21.15.88:0/1498719271 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb8640160d0 con 0x7fb86c14e2a0 2023-12-08T08:21:45.974 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' removed 2023-12-08T08:21:45.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.971+0000 7fb873c79640 1 -- 172.21.15.88:0/1498719271 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb8500664a0 msgr2=0x7fb850068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:45.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.971+0000 7fb873c79640 1 --2- 172.21.15.88:0/1498719271 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb8500664a0 0x7fb850068960 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb86c14ba30 tx=0x7fb868008040 comp rx=0 tx=0).stop 2023-12-08T08:21:45.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.971+0000 7fb873c79640 1 -- 172.21.15.88:0/1498719271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb86c14e2a0 msgr2=0x7fb86c1449d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:45.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.971+0000 7fb873c79640 1 --2- 172.21.15.88:0/1498719271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb86c14e2a0 0x7fb86c1449d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb86400c780 tx=0x7fb86400cc40 comp rx=0 tx=0).stop 2023-12-08T08:21:45.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.971+0000 7fb873c79640 1 -- 172.21.15.88:0/1498719271 shutdown_connections 2023-12-08T08:21:45.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.971+0000 7fb873c79640 1 --2- 172.21.15.88:0/1498719271 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb8500664a0 0x7fb850068960 secure :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb86c14ba30 tx=0x7fb868008040 comp rx=0 tx=0).stop 2023-12-08T08:21:45.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.971+0000 7fb873c79640 1 --2- 172.21.15.88:0/1498719271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb86c14e2a0 0x7fb86c1449d0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:45.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.971+0000 7fb873c79640 1 --2- 172.21.15.88:0/1498719271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb86c0a98e0 0x7fb86c0726d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:45.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.971+0000 7fb873c79640 1 --2- 172.21.15.88:0/1498719271 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb86c0a9460 0x7fb86c072190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:45.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.971+0000 7fb873c79640 1 -- 172.21.15.88:0/1498719271 >> 172.21.15.88:0/1498719271 conn(0x7fb86c0c59f0 msgr2=0x7fb86c0c2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:45.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.975+0000 7fb873c79640 1 -- 172.21.15.88:0/1498719271 shutdown_connections 2023-12-08T08:21:45.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:45.975+0000 7fb873c79640 1 -- 172.21.15.88:0/1498719271 wait complete. 2023-12-08T08:21:46.001 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:21:46.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.135+0000 7fd7cdc9c640 1 Processor -- start 2023-12-08T08:21:46.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.135+0000 7fd7cdc9c640 1 -- start start 2023-12-08T08:21:46.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.135+0000 7fd7cdc9c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7c8151e80 0x7fd7c8072850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.135+0000 7fd7cdc9c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd7c8154520 0x7fd7c81549a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.135+0000 7fd7cdc9c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c806b060 con 0x7fd7c80a6370 2023-12-08T08:21:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.135+0000 7fd7cdc9c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c80a67b0 con 0x7fd7c8154520 2023-12-08T08:21:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.135+0000 7fd7cdc9c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c8070d30 con 0x7fd7c8151e80 2023-12-08T08:21:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.135+0000 7fd7c7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd7c8154520 0x7fd7c81549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.135+0000 7fd7c6ffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd7c80a6370 0x7fd7c80c0010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41330/0 (socket says 172.21.15.88:41330) 2023-12-08T08:21:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.135+0000 7fd7c6ffd640 1 -- 172.21.15.88:0/2941148325 learned_addr learned my addr 172.21.15.88:0/2941148325 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.135+0000 7fd7c77fe640 1 --2- 172.21.15.88:0/2941148325 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7c8151e80 0x7fd7c8072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.135+0000 7fd7c7fff640 1 -- 172.21.15.88:0/2941148325 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7c8151e80 msgr2=0x7fd7c8072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.135+0000 7fd7c7fff640 1 --2- 172.21.15.88:0/2941148325 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7c8151e80 0x7fd7c8072850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.135+0000 7fd7c7fff640 1 -- 172.21.15.88:0/2941148325 >> v1:172.21.15.88:6789/0 conn(0x7fd7c80a6370 legacy=0x7fd7c80c0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.135+0000 7fd7c7fff640 1 -- 172.21.15.88:0/2941148325 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c806b300 con 0x7fd7c8154520 2023-12-08T08:21:46.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.135+0000 7fd7c67fc640 1 -- 172.21.15.88:0/2941148325 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 943963772 0 0) 0x7fd7c806b060 con 0x7fd7c80a6370 2023-12-08T08:21:46.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.139+0000 7fd7c7fff640 1 --2- 172.21.15.88:0/2941148325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c8154520 0x7fd7c81549a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009d90 tx=0x7fd7c001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2021dc2e9d9d517 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:46.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.139+0000 7fd7c67fc640 1 -- 172.21.15.88:0/2941148325 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c00a5810 con 0x7fd7c8154520 2023-12-08T08:21:46.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.139+0000 7fd7c67fc640 1 -- 172.21.15.88:0/2941148325 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c00a5970 con 0x7fd7c8154520 2023-12-08T08:21:46.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.139+0000 7fd7c67fc640 1 -- 172.21.15.88:0/2941148325 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c00a5d00 con 0x7fd7c8154520 2023-12-08T08:21:46.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.139+0000 7fd7cdc9c640 1 -- 172.21.15.88:0/2941148325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c8154520 msgr2=0x7fd7c81549a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:46.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.139+0000 7fd7cdc9c640 1 --2- 172.21.15.88:0/2941148325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c8154520 0x7fd7c81549a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009d90 tx=0x7fd7c001c950 comp rx=0 tx=0).stop 2023-12-08T08:21:46.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.139+0000 7fd7cdc9c640 1 -- 172.21.15.88:0/2941148325 shutdown_connections 2023-12-08T08:21:46.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.139+0000 7fd7cdc9c640 1 --2- 172.21.15.88:0/2941148325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c8154520 0x7fd7c81549a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.139+0000 7fd7cdc9c640 1 --2- 172.21.15.88:0/2941148325 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7c8151e80 0x7fd7c8072850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.139+0000 7fd7cdc9c640 1 -- 172.21.15.88:0/2941148325 >> 172.21.15.88:0/2941148325 conn(0x7fd7c80a8990 msgr2=0x7fd7c80a8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:46.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.139+0000 7fd7cdc9c640 1 -- 172.21.15.88:0/2941148325 shutdown_connections 2023-12-08T08:21:46.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.139+0000 7fd7cdc9c640 1 -- 172.21.15.88:0/2941148325 wait complete. 2023-12-08T08:21:46.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.143+0000 7fd7cdc9c640 1 Processor -- start 2023-12-08T08:21:46.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.143+0000 7fd7cdc9c640 1 -- start start 2023-12-08T08:21:46.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.143+0000 7fd7cdc9c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c80a6370 0x7fd7c81473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.143+0000 7fd7cdc9c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7c8151e80 0x7fd7c8143150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.143+0000 7fd7cdc9c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7c8154520 0x7fd7c8143690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.143+0000 7fd7cdc9c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c8142cc0 con 0x7fd7c80a6370 2023-12-08T08:21:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.143+0000 7fd7cdc9c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c80c14a0 con 0x7fd7c8154520 2023-12-08T08:21:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.143+0000 7fd7cdc9c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c8141f50 con 0x7fd7c8151e80 2023-12-08T08:21:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.143+0000 7fd7c77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c80a6370 0x7fd7c81473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.143+0000 7fd7c77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c80a6370 0x7fd7c81473d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57176/0 (socket says 172.21.15.88:57176) 2023-12-08T08:21:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.143+0000 7fd7c77fe640 1 -- 172.21.15.88:0/1005433242 learned_addr learned my addr 172.21.15.88:0/1005433242 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.143+0000 7fd7c6ffd640 1 --2- 172.21.15.88:0/1005433242 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7c8151e80 0x7fd7c8143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.143+0000 7fd7c77fe640 1 -- 172.21.15.88:0/1005433242 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7c8151e80 msgr2=0x7fd7c8143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.143+0000 7fd7c77fe640 1 --2- 172.21.15.88:0/1005433242 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7c8151e80 0x7fd7c8143150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.143+0000 7fd7c77fe640 1 -- 172.21.15.88:0/1005433242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7c8154520 msgr2=0x7fd7c8143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.143+0000 7fd7c77fe640 1 --2- 172.21.15.88:0/1005433242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7c8154520 0x7fd7c8143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.143+0000 7fd7c77fe640 1 -- 172.21.15.88:0/1005433242 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c0009a70 con 0x7fd7c80a6370 2023-12-08T08:21:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.143+0000 7fd7c6ffd640 1 --2- 172.21.15.88:0/1005433242 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7c8151e80 0x7fd7c8143150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.143+0000 7fd7c77fe640 1 --2- 172.21.15.88:0/1005433242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c80a6370 0x7fd7c81473d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fd7b800d800 tx=0x7fd7b800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.143+0000 7fd7affff640 1 -- 172.21.15.88:0/1005433242 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b800b6c0 con 0x7fd7c80a6370 2023-12-08T08:21:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.143+0000 7fd7affff640 1 -- 172.21.15.88:0/1005433242 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b800b820 con 0x7fd7c80a6370 2023-12-08T08:21:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.143+0000 7fd7affff640 1 -- 172.21.15.88:0/1005433242 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b800bb90 con 0x7fd7c80a6370 2023-12-08T08:21:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.143+0000 7fd7cdc9c640 1 -- 172.21.15.88:0/1005433242 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c80c1760 con 0x7fd7c80a6370 2023-12-08T08:21:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.143+0000 7fd7cdc9c640 1 -- 172.21.15.88:0/1005433242 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c8147910 con 0x7fd7c80a6370 2023-12-08T08:21:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.147+0000 7fd7cdc9c640 1 -- 172.21.15.88:0/1005433242 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c8067630 con 0x7fd7c80a6370 2023-12-08T08:21:46.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.147+0000 7fd7affff640 1 -- 172.21.15.88:0/1005433242 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd7b800bcf0 con 0x7fd7c80a6370 2023-12-08T08:21:46.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.147+0000 7fd7affff640 1 --2- 172.21.15.88:0/1005433242 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd7b4066470 0x7fd7b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:46.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.147+0000 7fd7affff640 1 -- 172.21.15.88:0/1005433242 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fd7b80844e0 con 0x7fd7c80a6370 2023-12-08T08:21:46.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.147+0000 7fd7c6ffd640 1 --2- 172.21.15.88:0/1005433242 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd7b4066470 0x7fd7b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:46.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.147+0000 7fd7c6ffd640 1 --2- 172.21.15.88:0/1005433242 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd7b4066470 0x7fd7b4068930 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd7c80a8100 tx=0x7fd7bc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:46.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.151+0000 7fd7affff640 1 -- 172.21.15.88:0/1005433242 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd7b8051870 con 0x7fd7c80a6370 2023-12-08T08:21:46.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.299+0000 7fd7cdc9c640 1 -- 172.21.15.88:0/1005433242 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7c80a9600 con 0x7fd7c80a6370 2023-12-08T08:21:46.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.303+0000 7fd7affff640 1 -- 172.21.15.88:0/1005433242 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16620 (secure 0 0 0) 0x7fd7b8054e90 con 0x7fd7c80a6370 2023-12-08T08:21:46.307 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:46.307 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":38,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:21:45.969917+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:21:16.039054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:21:17.029894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6837/181654220":"2023-12-09T08:21:42.962792+0000","172.21.15.88:6835/181654220":"2023-12-09T08:21:42.962792+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:21:46.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.303+0000 7fd7cdc9c640 1 -- 172.21.15.88:0/1005433242 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd7b4066470 msgr2=0x7fd7b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:46.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.303+0000 7fd7cdc9c640 1 --2- 172.21.15.88:0/1005433242 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd7b4066470 0x7fd7b4068930 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd7c80a8100 tx=0x7fd7bc009040 comp rx=0 tx=0).stop 2023-12-08T08:21:46.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.303+0000 7fd7cdc9c640 1 -- 172.21.15.88:0/1005433242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c80a6370 msgr2=0x7fd7c81473d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:46.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.303+0000 7fd7cdc9c640 1 --2- 172.21.15.88:0/1005433242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c80a6370 0x7fd7c81473d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fd7b800d800 tx=0x7fd7b800dcc0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.303+0000 7fd7cdc9c640 1 -- 172.21.15.88:0/1005433242 shutdown_connections 2023-12-08T08:21:46.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.303+0000 7fd7cdc9c640 1 --2- 172.21.15.88:0/1005433242 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd7b4066470 0x7fd7b4068930 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.303+0000 7fd7cdc9c640 1 --2- 172.21.15.88:0/1005433242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7c8154520 0x7fd7c8143690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.303+0000 7fd7cdc9c640 1 --2- 172.21.15.88:0/1005433242 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd7c8151e80 0x7fd7c8143150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.303+0000 7fd7cdc9c640 1 --2- 172.21.15.88:0/1005433242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c80a6370 0x7fd7c81473d0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.303+0000 7fd7cdc9c640 1 -- 172.21.15.88:0/1005433242 >> 172.21.15.88:0/1005433242 conn(0x7fd7c80a8990 msgr2=0x7fd7c806dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:46.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.303+0000 7fd7cdc9c640 1 -- 172.21.15.88:0/1005433242 shutdown_connections 2023-12-08T08:21:46.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.303+0000 7fd7cdc9c640 1 -- 172.21.15.88:0/1005433242 wait complete. 2023-12-08T08:21:46.328 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:21:16.039054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:21:17.029894+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:21:46.329 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:21:46.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.463+0000 7fcf3e3d1640 1 Processor -- start 2023-12-08T08:21:46.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.463+0000 7fcf3e3d1640 1 -- start start 2023-12-08T08:21:46.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.463+0000 7fcf3e3d1640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcf38151a20 0x7fcf38157a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:46.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.463+0000 7fcf3e3d1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcf3806b5c0 0x7fcf3806ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:46.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.463+0000 7fcf3e3d1640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf381547f0 con 0x7fcf3806e890 2023-12-08T08:21:46.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.463+0000 7fcf3e3d1640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf380c2720 con 0x7fcf3806b5c0 2023-12-08T08:21:46.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.463+0000 7fcf3e3d1640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf381544a0 con 0x7fcf38151a20 2023-12-08T08:21:46.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.467+0000 7fcf377fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcf3806e890 0x7fcf38154c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41344/0 (socket says 172.21.15.88:41344) 2023-12-08T08:21:46.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.467+0000 7fcf377fe640 1 -- 172.21.15.88:0/4135246972 learned_addr learned my addr 172.21.15.88:0/4135246972 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:46.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.467+0000 7fcf3c96e640 1 --2- 172.21.15.88:0/4135246972 >> v2:172.21.15.88:3300/0 conn(0x7fcf3806b5c0 0x7fcf3806ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:46.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.467+0000 7fcf37fff640 1 --2- 172.21.15.88:0/4135246972 >> v2:172.21.15.148:3300/0 conn(0x7fcf38151a20 0x7fcf38157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:46.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.467+0000 7fcf36ffd640 1 -- 172.21.15.88:0/4135246972 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1049459960 0 0) 0x7fcf381547f0 con 0x7fcf3806e890 2023-12-08T08:21:46.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.467+0000 7fcf36ffd640 1 -- 172.21.15.88:0/4135246972 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf20003530 con 0x7fcf3806e890 2023-12-08T08:21:46.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.467+0000 7fcf3c96e640 1 -- 172.21.15.88:0/4135246972 >> v2:172.21.15.148:3300/0 conn(0x7fcf38151a20 msgr2=0x7fcf38157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:46.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.467+0000 7fcf3c96e640 1 --2- 172.21.15.88:0/4135246972 >> v2:172.21.15.148:3300/0 conn(0x7fcf38151a20 0x7fcf38157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.467+0000 7fcf3c96e640 1 -- 172.21.15.88:0/4135246972 >> v1:172.21.15.88:6789/0 conn(0x7fcf3806e890 legacy=0x7fcf38154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:46.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.467+0000 7fcf3c96e640 1 -- 172.21.15.88:0/4135246972 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf38155390 con 0x7fcf3806b5c0 2023-12-08T08:21:46.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.467+0000 7fcf3c96e640 1 --2- 172.21.15.88:0/4135246972 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf3806b5c0 0x7fcf3806ba30 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fcf3806f820 tx=0x7fcf3001c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b921013967a5d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:46.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.467+0000 7fcf36ffd640 1 -- 172.21.15.88:0/4135246972 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf300a5880 con 0x7fcf3806b5c0 2023-12-08T08:21:46.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.467+0000 7fcf36ffd640 1 -- 172.21.15.88:0/4135246972 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf300a59e0 con 0x7fcf3806b5c0 2023-12-08T08:21:46.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.467+0000 7fcf36ffd640 1 -- 172.21.15.88:0/4135246972 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf300a5d70 con 0x7fcf3806b5c0 2023-12-08T08:21:46.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.471+0000 7fcf3e3d1640 1 -- 172.21.15.88:0/4135246972 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf3806b5c0 msgr2=0x7fcf3806ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:46.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.471+0000 7fcf3e3d1640 1 --2- 172.21.15.88:0/4135246972 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf3806b5c0 0x7fcf3806ba30 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fcf3806f820 tx=0x7fcf3001c7c0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.471+0000 7fcf3e3d1640 1 -- 172.21.15.88:0/4135246972 shutdown_connections 2023-12-08T08:21:46.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.471+0000 7fcf3e3d1640 1 --2- 172.21.15.88:0/4135246972 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf3806b5c0 0x7fcf3806ba30 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.471+0000 7fcf3e3d1640 1 --2- 172.21.15.88:0/4135246972 >> v2:172.21.15.148:3300/0 conn(0x7fcf38151a20 0x7fcf38157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.471+0000 7fcf3e3d1640 1 -- 172.21.15.88:0/4135246972 >> 172.21.15.88:0/4135246972 conn(0x7fcf380c2e20 msgr2=0x7fcf380c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:46.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.471+0000 7fcf3e3d1640 1 -- 172.21.15.88:0/4135246972 shutdown_connections 2023-12-08T08:21:46.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.471+0000 7fcf3e3d1640 1 -- 172.21.15.88:0/4135246972 wait complete. 2023-12-08T08:21:46.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.471+0000 7fcf3e3d1640 1 Processor -- start 2023-12-08T08:21:46.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.471+0000 7fcf3e3d1640 1 -- start start 2023-12-08T08:21:46.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.471+0000 7fcf3e3d1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf3806b5c0 0x7fcf38154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:46.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.471+0000 7fcf3e3d1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf3806e890 0x7fcf380aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:46.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.471+0000 7fcf3e3d1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf38151a20 0x7fcf38158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:46.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.471+0000 7fcf3e3d1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf381ed610 con 0x7fcf3806b5c0 2023-12-08T08:21:46.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.471+0000 7fcf3e3d1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf381edb40 con 0x7fcf38151a20 2023-12-08T08:21:46.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.471+0000 7fcf3e3d1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf381ed860 con 0x7fcf3806e890 2023-12-08T08:21:46.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.471+0000 7fcf37fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf3806b5c0 0x7fcf38154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:46.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.471+0000 7fcf37fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf3806b5c0 0x7fcf38154cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57206/0 (socket says 172.21.15.88:57206) 2023-12-08T08:21:46.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.471+0000 7fcf37fff640 1 -- 172.21.15.88:0/2839911839 learned_addr learned my addr 172.21.15.88:0/2839911839 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:46.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.471+0000 7fcf377fe640 1 --2- 172.21.15.88:0/2839911839 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf3806e890 0x7fcf380aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:46.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.471+0000 7fcf3c96e640 1 --2- 172.21.15.88:0/2839911839 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf38151a20 0x7fcf38158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:46.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.471+0000 7fcf37fff640 1 -- 172.21.15.88:0/2839911839 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf3806e890 msgr2=0x7fcf380aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:46.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.471+0000 7fcf37fff640 1 --2- 172.21.15.88:0/2839911839 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf3806e890 0x7fcf380aa8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.471+0000 7fcf37fff640 1 -- 172.21.15.88:0/2839911839 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf38151a20 msgr2=0x7fcf38158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:46.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.471+0000 7fcf37fff640 1 --2- 172.21.15.88:0/2839911839 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf38151a20 0x7fcf38158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.471+0000 7fcf37fff640 1 -- 172.21.15.88:0/2839911839 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf30009a70 con 0x7fcf3806b5c0 2023-12-08T08:21:46.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.471+0000 7fcf3c96e640 1 --2- 172.21.15.88:0/2839911839 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf38151a20 0x7fcf38158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:46.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.475+0000 7fcf37fff640 1 --2- 172.21.15.88:0/2839911839 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf3806b5c0 0x7fcf38154cc0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800e930 tx=0x7fcf2800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:46.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.475+0000 7fcf34ff9640 1 -- 172.21.15.88:0/2839911839 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf28009690 con 0x7fcf3806b5c0 2023-12-08T08:21:46.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.475+0000 7fcf34ff9640 1 -- 172.21.15.88:0/2839911839 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2800ca00 con 0x7fcf3806b5c0 2023-12-08T08:21:46.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.475+0000 7fcf34ff9640 1 -- 172.21.15.88:0/2839911839 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2800cd70 con 0x7fcf3806b5c0 2023-12-08T08:21:46.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.475+0000 7fcf3e3d1640 1 -- 172.21.15.88:0/2839911839 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf38157b90 con 0x7fcf3806b5c0 2023-12-08T08:21:46.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.475+0000 7fcf3e3d1640 1 -- 172.21.15.88:0/2839911839 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf380c3660 con 0x7fcf3806b5c0 2023-12-08T08:21:46.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.475+0000 7fcf3e3d1640 1 -- 172.21.15.88:0/2839911839 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf38066660 con 0x7fcf3806b5c0 2023-12-08T08:21:46.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.475+0000 7fcf34ff9640 1 -- 172.21.15.88:0/2839911839 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcf28013470 con 0x7fcf3806b5c0 2023-12-08T08:21:46.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.475+0000 7fcf34ff9640 1 --2- 172.21.15.88:0/2839911839 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcf240664a0 0x7fcf24068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:46.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.475+0000 7fcf34ff9640 1 -- 172.21.15.88:0/2839911839 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fcf28084120 con 0x7fcf3806b5c0 2023-12-08T08:21:46.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.475+0000 7fcf377fe640 1 --2- 172.21.15.88:0/2839911839 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcf240664a0 0x7fcf24068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:46.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.479+0000 7fcf377fe640 1 --2- 172.21.15.88:0/2839911839 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcf240664a0 0x7fcf24068960 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcf381523a0 tx=0x7fcf2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:46.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.479+0000 7fcf34ff9640 1 -- 172.21.15.88:0/2839911839 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcf280515f0 con 0x7fcf3806b5c0 2023-12-08T08:21:46.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.647+0000 7fcf3e3d1640 1 -- 172.21.15.88:0/2839911839 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf38067630 con 0x7fcf3806b5c0 2023-12-08T08:21:46.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.647+0000 7fcf34ff9640 1 -- 172.21.15.88:0/2839911839 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf28054c10 con 0x7fcf3806b5c0 2023-12-08T08:21:46.652 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:21:46.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.651+0000 7fcf3e3d1640 1 -- 172.21.15.88:0/2839911839 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcf240664a0 msgr2=0x7fcf24068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:46.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.651+0000 7fcf3e3d1640 1 --2- 172.21.15.88:0/2839911839 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcf240664a0 0x7fcf24068960 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcf381523a0 tx=0x7fcf2c009040 comp rx=0 tx=0).stop 2023-12-08T08:21:46.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.651+0000 7fcf3e3d1640 1 -- 172.21.15.88:0/2839911839 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf3806b5c0 msgr2=0x7fcf38154cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:46.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.651+0000 7fcf3e3d1640 1 --2- 172.21.15.88:0/2839911839 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf3806b5c0 0x7fcf38154cc0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800e930 tx=0x7fcf2800edf0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.651+0000 7fcf3e3d1640 1 -- 172.21.15.88:0/2839911839 shutdown_connections 2023-12-08T08:21:46.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.651+0000 7fcf3e3d1640 1 --2- 172.21.15.88:0/2839911839 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcf240664a0 0x7fcf24068960 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.651+0000 7fcf3e3d1640 1 --2- 172.21.15.88:0/2839911839 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf38151a20 0x7fcf38158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.651+0000 7fcf3e3d1640 1 --2- 172.21.15.88:0/2839911839 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf3806e890 0x7fcf380aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.651+0000 7fcf3e3d1640 1 --2- 172.21.15.88:0/2839911839 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf3806b5c0 0x7fcf38154cc0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.651+0000 7fcf3e3d1640 1 -- 172.21.15.88:0/2839911839 >> 172.21.15.88:0/2839911839 conn(0x7fcf380c2e20 msgr2=0x7fcf38070ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:46.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.651+0000 7fcf3e3d1640 1 -- 172.21.15.88:0/2839911839 shutdown_connections 2023-12-08T08:21:46.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.651+0000 7fcf3e3d1640 1 -- 172.21.15.88:0/2839911839 wait complete. 2023-12-08T08:21:46.673 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:21:46.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f7822f57640 1 Processor -- start 2023-12-08T08:21:46.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f7822f57640 1 -- start start 2023-12-08T08:21:46.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f7822f57640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f781c0c5300 0x7f781c0a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:46.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f7822f57640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f781c0a4e20 con 0x7f781c1548c0 2023-12-08T08:21:46.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f7822f57640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f781c0a50e0 con 0x7f781c14b1e0 2023-12-08T08:21:46.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f7822f57640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f781c0c0f00 con 0x7f781c0c5300 2023-12-08T08:21:46.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f78214f4640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f781c1548c0 0x7f781c154d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41354/0 (socket says 172.21.15.88:41354) 2023-12-08T08:21:46.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f78214f4640 1 -- 172.21.15.88:0/3498029431 learned_addr learned my addr 172.21.15.88:0/3498029431 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:46.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f7813fff640 1 --2- 172.21.15.88:0/3498029431 >> v2:172.21.15.148:3300/0 conn(0x7f781c0c5300 0x7f781c0a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:46.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f78137fe640 1 -- 172.21.15.88:0/3498029431 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3512374855 0 0) 0x7f781c0a4e20 con 0x7f781c1548c0 2023-12-08T08:21:46.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f78137fe640 1 -- 172.21.15.88:0/3498029431 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7804003530 con 0x7f781c1548c0 2023-12-08T08:21:46.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f78137fe640 1 -- 172.21.15.88:0/3498029431 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1850753249 0 0) 0x7f7804003530 con 0x7f781c1548c0 2023-12-08T08:21:46.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f78137fe640 1 -- 172.21.15.88:0/3498029431 >> v2:172.21.15.148:3300/0 conn(0x7f781c0c5300 msgr2=0x7f781c0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:46.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f78137fe640 1 --2- 172.21.15.88:0/3498029431 >> v2:172.21.15.148:3300/0 conn(0x7f781c0c5300 0x7f781c0a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f78137fe640 1 -- 172.21.15.88:0/3498029431 >> v1:172.21.15.148:6789/0 conn(0x7f781c14b1e0 legacy=0x7f781c0c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:46.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f78137fe640 1 -- 172.21.15.88:0/3498029431 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c0c11e0 con 0x7f781c1548c0 2023-12-08T08:21:46.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f78137fe640 1 -- 172.21.15.88:0/3498029431 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f7814001a00 con 0x7f781c1548c0 2023-12-08T08:21:46.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f78137fe640 1 -- 172.21.15.88:0/3498029431 >> v1:172.21.15.88:6789/0 conn(0x7f781c1548c0 legacy=0x7f781c154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:46.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f78137fe640 1 --2- 172.21.15.88:0/3498029431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7804003980 0x7f7804003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:46.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f78137fe640 1 --2- 172.21.15.88:0/3498029431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78040047d0 0x7f7804004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:46.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f78137fe640 1 --2- 172.21.15.88:0/3498029431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7804005190 0x7f780400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:46.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f78137fe640 1 -- 172.21.15.88:0/3498029431 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c0c0f00 con 0x7f7804003980 2023-12-08T08:21:46.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f78137fe640 1 -- 172.21.15.88:0/3498029431 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780400e240 con 0x7f78040047d0 2023-12-08T08:21:46.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f78137fe640 1 -- 172.21.15.88:0/3498029431 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780400e400 con 0x7f7804005190 2023-12-08T08:21:46.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f7820cf3640 1 --2- 172.21.15.88:0/3498029431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7804003980 0x7f7804003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:46.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f7813fff640 1 --2- 172.21.15.88:0/3498029431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78040047d0 0x7f7804004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:46.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f78214f4640 1 --2- 172.21.15.88:0/3498029431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7804005190 0x7f780400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:46.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f7820cf3640 1 -- 172.21.15.88:0/3498029431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7804005190 msgr2=0x7f780400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:46.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f7820cf3640 1 --2- 172.21.15.88:0/3498029431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7804005190 0x7f780400dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f7820cf3640 1 -- 172.21.15.88:0/3498029431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78040047d0 msgr2=0x7f7804004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:46.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f7820cf3640 1 --2- 172.21.15.88:0/3498029431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78040047d0 0x7f7804004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f7820cf3640 1 -- 172.21.15.88:0/3498029431 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7804003530 con 0x7f7804003980 2023-12-08T08:21:46.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.811+0000 7f78214f4640 1 -- 172.21.15.88:0/3498029431 reap_dead start 2023-12-08T08:21:46.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.815+0000 7f7820cf3640 1 --2- 172.21.15.88:0/3498029431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7804003980 0x7f7804003da0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7818001780 tx=0x7f781801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bab0712a40f32f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:46.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.815+0000 7f78137fe640 1 -- 172.21.15.88:0/3498029431 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78180052d0 con 0x7f7804003980 2023-12-08T08:21:46.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.815+0000 7f78137fe640 1 -- 172.21.15.88:0/3498029431 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78180a7050 con 0x7f7804003980 2023-12-08T08:21:46.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.815+0000 7f78137fe640 1 -- 172.21.15.88:0/3498029431 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7818003600 con 0x7f7804003980 2023-12-08T08:21:46.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.815+0000 7f7822f57640 1 -- 172.21.15.88:0/3498029431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7804003980 msgr2=0x7f7804003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:46.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.815+0000 7f7822f57640 1 --2- 172.21.15.88:0/3498029431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7804003980 0x7f7804003da0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7818001780 tx=0x7f781801c3e0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.815+0000 7f7822f57640 1 -- 172.21.15.88:0/3498029431 shutdown_connections 2023-12-08T08:21:46.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.815+0000 7f7822f57640 1 --2- 172.21.15.88:0/3498029431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7804003980 0x7f7804003da0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.815+0000 7f7822f57640 1 -- 172.21.15.88:0/3498029431 >> 172.21.15.88:0/3498029431 conn(0x7f781c0c59f0 msgr2=0x7f781c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:46.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.815+0000 7f7822f57640 1 -- 172.21.15.88:0/3498029431 shutdown_connections 2023-12-08T08:21:46.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.815+0000 7f7822f57640 1 -- 172.21.15.88:0/3498029431 wait complete. 2023-12-08T08:21:46.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.819+0000 7f7822f57640 1 Processor -- start 2023-12-08T08:21:46.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.819+0000 7f7822f57640 1 -- start start 2023-12-08T08:21:46.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.819+0000 7f7822f57640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7804003980 0x7f781c0a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:46.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.819+0000 7f7822f57640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f781c142410 0x7f781c142d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:46.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.819+0000 7f7822f57640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f781c06d2d0 0x7f781c1ed270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:46.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.819+0000 7f7822f57640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c141ee0 con 0x7f781c06d2d0 2023-12-08T08:21:46.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.819+0000 7f7822f57640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c06ce40 con 0x7f7804003980 2023-12-08T08:21:46.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.819+0000 7f7822f57640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781c14a460 con 0x7f781c142410 2023-12-08T08:21:46.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.819+0000 7f78214f4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f781c06d2d0 0x7f781c1ed270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:46.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.819+0000 7f78214f4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f781c06d2d0 0x7f781c1ed270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57232/0 (socket says 172.21.15.88:57232) 2023-12-08T08:21:46.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.819+0000 7f78214f4640 1 -- 172.21.15.88:0/2033248712 learned_addr learned my addr 172.21.15.88:0/2033248712 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:46.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.819+0000 7f7813fff640 1 --2- 172.21.15.88:0/2033248712 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f781c142410 0x7f781c142d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:46.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.819+0000 7f7820cf3640 1 --2- 172.21.15.88:0/2033248712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7804003980 0x7f781c0a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:46.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.819+0000 7f78214f4640 1 -- 172.21.15.88:0/2033248712 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f781c142410 msgr2=0x7f781c142d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:46.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.819+0000 7f78214f4640 1 --2- 172.21.15.88:0/2033248712 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f781c142410 0x7f781c142d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.819+0000 7f78214f4640 1 -- 172.21.15.88:0/2033248712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7804003980 msgr2=0x7f781c0a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:46.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.819+0000 7f78214f4640 1 --2- 172.21.15.88:0/2033248712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7804003980 0x7f781c0a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.819+0000 7f78214f4640 1 -- 172.21.15.88:0/2033248712 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c0c1d20 con 0x7f781c06d2d0 2023-12-08T08:21:46.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.819+0000 7f7813fff640 1 --2- 172.21.15.88:0/2033248712 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f781c142410 0x7f781c142d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:46.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.819+0000 7f78214f4640 1 --2- 172.21.15.88:0/2033248712 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f781c06d2d0 0x7f781c1ed270 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f781c0bfff0 tx=0x7f7814007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:46.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.819+0000 7f78117fa640 1 -- 172.21.15.88:0/2033248712 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781400eaa0 con 0x7f781c06d2d0 2023-12-08T08:21:46.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.819+0000 7f78117fa640 1 -- 172.21.15.88:0/2033248712 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781400ec00 con 0x7f781c06d2d0 2023-12-08T08:21:46.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.819+0000 7f78117fa640 1 -- 172.21.15.88:0/2033248712 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7814013420 con 0x7f781c06d2d0 2023-12-08T08:21:46.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.819+0000 7f7822f57640 1 -- 172.21.15.88:0/2033248712 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f781c14aa00 con 0x7f781c06d2d0 2023-12-08T08:21:46.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.819+0000 7f7822f57640 1 -- 172.21.15.88:0/2033248712 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f781c14a720 con 0x7f781c06d2d0 2023-12-08T08:21:46.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.823+0000 7f7822f57640 1 -- 172.21.15.88:0/2033248712 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f781c067630 con 0x7f781c06d2d0 2023-12-08T08:21:46.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.823+0000 7f78117fa640 1 -- 172.21.15.88:0/2033248712 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7814013580 con 0x7f781c06d2d0 2023-12-08T08:21:46.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.823+0000 7f78117fa640 1 --2- 172.21.15.88:0/2033248712 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7808066470 0x7f7808068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:46.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.823+0000 7f78117fa640 1 -- 172.21.15.88:0/2033248712 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f7814084310 con 0x7f781c06d2d0 2023-12-08T08:21:46.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.823+0000 7f7820cf3640 1 --2- 172.21.15.88:0/2033248712 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7808066470 0x7f7808068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:46.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.823+0000 7f7820cf3640 1 --2- 172.21.15.88:0/2033248712 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7808066470 0x7f7808068930 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7818001750 tx=0x7f78180011a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:46.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.827+0000 7f78117fa640 1 -- 172.21.15.88:0/2033248712 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7814055120 con 0x7f781c06d2d0 2023-12-08T08:21:46.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.975+0000 7f7822f57640 1 -- 172.21.15.88:0/2033248712 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f781c06cf80 con 0x7f781c06d2d0 2023-12-08T08:21:46.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.979+0000 7f78117fa640 1 -- 172.21.15.88:0/2033248712 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v38) v1 ==== 105+0+11 (secure 0 0 0) 0x7f7814054cb0 con 0x7f781c06d2d0 2023-12-08T08:21:46.983 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:21:46.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.979+0000 7f7822f57640 1 -- 172.21.15.88:0/2033248712 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7808066470 msgr2=0x7f7808068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:46.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.979+0000 7f7822f57640 1 --2- 172.21.15.88:0/2033248712 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7808066470 0x7f7808068930 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7818001750 tx=0x7f78180011a0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.979+0000 7f7822f57640 1 -- 172.21.15.88:0/2033248712 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f781c06d2d0 msgr2=0x7f781c1ed270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:46.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.979+0000 7f7822f57640 1 --2- 172.21.15.88:0/2033248712 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f781c06d2d0 0x7f781c1ed270 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f781c0bfff0 tx=0x7f7814007bc0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.979+0000 7f7822f57640 1 -- 172.21.15.88:0/2033248712 shutdown_connections 2023-12-08T08:21:46.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.979+0000 7f7822f57640 1 --2- 172.21.15.88:0/2033248712 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7808066470 0x7f7808068930 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.979+0000 7f7822f57640 1 --2- 172.21.15.88:0/2033248712 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f781c06d2d0 0x7f781c1ed270 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.979+0000 7f7822f57640 1 --2- 172.21.15.88:0/2033248712 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f781c142410 0x7f781c142d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.979+0000 7f7822f57640 1 --2- 172.21.15.88:0/2033248712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7804003980 0x7f781c0a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:46.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.979+0000 7f7822f57640 1 -- 172.21.15.88:0/2033248712 >> 172.21.15.88:0/2033248712 conn(0x7f781c0c59f0 msgr2=0x7f781c0aa460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:46.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.979+0000 7f7822f57640 1 -- 172.21.15.88:0/2033248712 shutdown_connections 2023-12-08T08:21:46.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:46.979+0000 7f7822f57640 1 -- 172.21.15.88:0/2033248712 wait complete. 2023-12-08T08:21:47.004 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:21:47.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.379+0000 7fc6390fe640 1 Processor -- start 2023-12-08T08:21:47.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.379+0000 7fc6390fe640 1 -- start start 2023-12-08T08:21:47.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.379+0000 7fc6390fe640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6341516a0 0x7fc6340c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:47.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.379+0000 7fc6390fe640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc634151b20 con 0x7fc63414e2a0 2023-12-08T08:21:47.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.379+0000 7fc6390fe640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc634151210 con 0x7fc6340c46c0 2023-12-08T08:21:47.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.379+0000 7fc6390fe640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63414e680 con 0x7fc6341516a0 2023-12-08T08:21:47.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.379+0000 7fc632d9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc63414e2a0 0x7fc6340a9460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41364/0 (socket says 172.21.15.88:41364) 2023-12-08T08:21:47.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.379+0000 7fc632d9d640 1 -- 172.21.15.88:0/2514194495 learned_addr learned my addr 172.21.15.88:0/2514194495 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:47.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.383+0000 7fc62a59c640 1 --2- 172.21.15.88:0/2514194495 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6341516a0 0x7fc6340c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:47.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.383+0000 7fc63259c640 1 -- 172.21.15.88:0/2514194495 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1817639526 0 0) 0x7fc61c001120 con 0x7fc63414e2a0 2023-12-08T08:21:47.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.383+0000 7fc63259c640 1 -- 172.21.15.88:0/2514194495 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc620003530 con 0x7fc63414e2a0 2023-12-08T08:21:47.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.383+0000 7fc63259c640 1 -- 172.21.15.88:0/2514194495 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2598346379 0 0) 0x7fc620003530 con 0x7fc63414e2a0 2023-12-08T08:21:47.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.383+0000 7fc63259c640 1 -- 172.21.15.88:0/2514194495 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6341516a0 msgr2=0x7fc6340c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:47.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.383+0000 7fc63259c640 1 --2- 172.21.15.88:0/2514194495 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6341516a0 0x7fc6340c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:47.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.383+0000 7fc63259c640 1 -- 172.21.15.88:0/2514194495 >> v1:172.21.15.148:6789/0 conn(0x7fc6340c46c0 legacy=0x7fc63406bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:47.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.383+0000 7fc63259c640 1 -- 172.21.15.88:0/2514194495 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6340a9b70 con 0x7fc63414e2a0 2023-12-08T08:21:47.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.383+0000 7fc63259c640 1 -- 172.21.15.88:0/2514194495 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7fc61c001810 con 0x7fc63414e2a0 2023-12-08T08:21:47.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.383+0000 7fc63259c640 1 -- 172.21.15.88:0/2514194495 >> v1:172.21.15.88:6789/0 conn(0x7fc63414e2a0 legacy=0x7fc6340a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:47.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.383+0000 7fc63259c640 1 --2- 172.21.15.88:0/2514194495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6200039b0 0x7fc620003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:47.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.383+0000 7fc63259c640 1 --2- 172.21.15.88:0/2514194495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc620004360 0x7fc620004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:47.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.383+0000 7fc63259c640 1 --2- 172.21.15.88:0/2514194495 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6341516a0 0x7fc620005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:47.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.383+0000 7fc63259c640 1 -- 172.21.15.88:0/2514194495 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63414e680 con 0x7fc6200039b0 2023-12-08T08:21:47.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.383+0000 7fc63259c640 1 -- 172.21.15.88:0/2514194495 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62000caa0 con 0x7fc620004360 2023-12-08T08:21:47.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.383+0000 7fc63259c640 1 -- 172.21.15.88:0/2514194495 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62000ba10 con 0x7fc6341516a0 2023-12-08T08:21:47.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.383+0000 7fc632d9d640 1 --2- 172.21.15.88:0/2514194495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6200039b0 0x7fc620003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:47.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.383+0000 7fc62a59c640 1 --2- 172.21.15.88:0/2514194495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc620004360 0x7fc620004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:47.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.383+0000 7fc63359e640 1 --2- 172.21.15.88:0/2514194495 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6341516a0 0x7fc620005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:47.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.383+0000 7fc632d9d640 1 -- 172.21.15.88:0/2514194495 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6341516a0 msgr2=0x7fc620005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:47.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.383+0000 7fc632d9d640 1 --2- 172.21.15.88:0/2514194495 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6341516a0 0x7fc620005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:47.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.383+0000 7fc632d9d640 1 -- 172.21.15.88:0/2514194495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc620004360 msgr2=0x7fc620004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:47.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.383+0000 7fc632d9d640 1 --2- 172.21.15.88:0/2514194495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc620004360 0x7fc620004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:47.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.383+0000 7fc632d9d640 1 -- 172.21.15.88:0/2514194495 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc620003530 con 0x7fc6200039b0 2023-12-08T08:21:47.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.383+0000 7fc62a59c640 1 --2- 172.21.15.88:0/2514194495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc620004360 0x7fc620004830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:47.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.387+0000 7fc632d9d640 1 --2- 172.21.15.88:0/2514194495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6200039b0 0x7fc620003d90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00c190 tx=0x7fc61c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da5a8aa57346e09 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:47.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.387+0000 7fc63259c640 1 -- 172.21.15.88:0/2514194495 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c0058e0 con 0x7fc6200039b0 2023-12-08T08:21:47.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.387+0000 7fc63259c640 1 -- 172.21.15.88:0/2514194495 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c005a40 con 0x7fc6200039b0 2023-12-08T08:21:47.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.387+0000 7fc63259c640 1 -- 172.21.15.88:0/2514194495 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c005df0 con 0x7fc6200039b0 2023-12-08T08:21:47.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.387+0000 7fc6390fe640 1 -- 172.21.15.88:0/2514194495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6200039b0 msgr2=0x7fc620003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:47.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.387+0000 7fc6390fe640 1 --2- 172.21.15.88:0/2514194495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6200039b0 0x7fc620003d90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00c190 tx=0x7fc61c01cc20 comp rx=0 tx=0).stop 2023-12-08T08:21:47.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.387+0000 7fc63359e640 1 -- 172.21.15.88:0/2514194495 reap_dead start 2023-12-08T08:21:47.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.387+0000 7fc6390fe640 1 -- 172.21.15.88:0/2514194495 shutdown_connections 2023-12-08T08:21:47.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.387+0000 7fc6390fe640 1 -- 172.21.15.88:0/2514194495 >> 172.21.15.88:0/2514194495 conn(0x7fc6340c59f0 msgr2=0x7fc6340c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:47.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.387+0000 7fc6390fe640 1 -- 172.21.15.88:0/2514194495 shutdown_connections 2023-12-08T08:21:47.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.387+0000 7fc6390fe640 1 -- 172.21.15.88:0/2514194495 wait complete. 2023-12-08T08:21:47.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.387+0000 7fc6390fe640 1 Processor -- start 2023-12-08T08:21:47.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.387+0000 7fc6390fe640 1 -- start start 2023-12-08T08:21:47.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.391+0000 7fc6390fe640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6200039b0 0x7fc634145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:47.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.391+0000 7fc6390fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc634145790 0x7fc6340c16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:47.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.391+0000 7fc6390fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6341effb0 0x7fc6341f0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:47.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.391+0000 7fc6390fe640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6341f0970 con 0x7fc634145790 2023-12-08T08:21:47.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.391+0000 7fc6390fe640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6341503c0 con 0x7fc6341effb0 2023-12-08T08:21:47.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.391+0000 7fc6390fe640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6341508f0 con 0x7fc6200039b0 2023-12-08T08:21:47.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.391+0000 7fc62a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc634145790 0x7fc6340c16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:47.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.391+0000 7fc62a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc634145790 0x7fc6340c16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57238/0 (socket says 172.21.15.88:57238) 2023-12-08T08:21:47.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.391+0000 7fc62a59c640 1 -- 172.21.15.88:0/2456281738 learned_addr learned my addr 172.21.15.88:0/2456281738 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:47.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.391+0000 7fc632d9d640 1 --2- 172.21.15.88:0/2456281738 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6200039b0 0x7fc634145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:47.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.391+0000 7fc63359e640 1 --2- 172.21.15.88:0/2456281738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6341effb0 0x7fc6341f0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:47.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.391+0000 7fc62a59c640 1 -- 172.21.15.88:0/2456281738 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6200039b0 msgr2=0x7fc634145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:47.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.391+0000 7fc62a59c640 1 --2- 172.21.15.88:0/2456281738 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6200039b0 0x7fc634145cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:47.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.391+0000 7fc62a59c640 1 -- 172.21.15.88:0/2456281738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6341effb0 msgr2=0x7fc6341f0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:47.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.391+0000 7fc62a59c640 1 --2- 172.21.15.88:0/2456281738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6341effb0 0x7fc6341f0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:47.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.391+0000 7fc62a59c640 1 -- 172.21.15.88:0/2456281738 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63414d0e0 con 0x7fc634145790 2023-12-08T08:21:47.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.391+0000 7fc63359e640 1 --2- 172.21.15.88:0/2456281738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6341effb0 0x7fc6341f0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:47.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.391+0000 7fc62a59c640 1 --2- 172.21.15.88:0/2456281738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc634145790 0x7fc6340c16e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc624009fd0 tx=0x7fc624011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:47.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.391+0000 7fc62bfff640 1 -- 172.21.15.88:0/2456281738 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc624004220 con 0x7fc634145790 2023-12-08T08:21:47.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.391+0000 7fc62bfff640 1 -- 172.21.15.88:0/2456281738 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc624004380 con 0x7fc634145790 2023-12-08T08:21:47.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.391+0000 7fc62bfff640 1 -- 172.21.15.88:0/2456281738 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62400f9e0 con 0x7fc634145790 2023-12-08T08:21:47.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.391+0000 7fc6390fe640 1 -- 172.21.15.88:0/2456281738 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc634150610 con 0x7fc634145790 2023-12-08T08:21:47.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.391+0000 7fc6390fe640 1 -- 172.21.15.88:0/2456281738 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc63414cd70 con 0x7fc634145790 2023-12-08T08:21:47.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.391+0000 7fc6390fe640 1 -- 172.21.15.88:0/2456281738 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc63414c8f0 con 0x7fc634145790 2023-12-08T08:21:47.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.391+0000 7fc62bfff640 1 -- 172.21.15.88:0/2456281738 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc62400fb40 con 0x7fc634145790 2023-12-08T08:21:47.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.395+0000 7fc62bfff640 1 --2- 172.21.15.88:0/2456281738 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc614066470 0x7fc614068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:47.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.395+0000 7fc62bfff640 1 -- 172.21.15.88:0/2456281738 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fc6240843d0 con 0x7fc634145790 2023-12-08T08:21:47.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.395+0000 7fc632d9d640 1 --2- 172.21.15.88:0/2456281738 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc614066470 0x7fc614068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:47.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.395+0000 7fc632d9d640 1 --2- 172.21.15.88:0/2456281738 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc614066470 0x7fc614068930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00c190 tx=0x7fc61c0b1040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:47.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.399+0000 7fc62bfff640 1 -- 172.21.15.88:0/2456281738 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc63414c8f0 con 0x7fc634145790 2023-12-08T08:21:47.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.547+0000 7fc6390fe640 1 -- 172.21.15.88:0/2456281738 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fc63414c8f0 con 0x7fc634145790 2023-12-08T08:21:47.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.547+0000 7fc62bfff640 1 -- 172.21.15.88:0/2456281738 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v38) v1 ==== 101+0+11 (secure 0 0 0) 0x7fc63414c8f0 con 0x7fc634145790 2023-12-08T08:21:47.551 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:21:47.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.547+0000 7fc6390fe640 1 -- 172.21.15.88:0/2456281738 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc614066470 msgr2=0x7fc614068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:47.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.547+0000 7fc6390fe640 1 --2- 172.21.15.88:0/2456281738 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc614066470 0x7fc614068930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00c190 tx=0x7fc61c0b1040 comp rx=0 tx=0).stop 2023-12-08T08:21:47.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.547+0000 7fc6390fe640 1 -- 172.21.15.88:0/2456281738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc634145790 msgr2=0x7fc6340c16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:47.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.547+0000 7fc6390fe640 1 --2- 172.21.15.88:0/2456281738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc634145790 0x7fc6340c16e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc624009fd0 tx=0x7fc624011b30 comp rx=0 tx=0).stop 2023-12-08T08:21:47.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.547+0000 7fc6390fe640 1 -- 172.21.15.88:0/2456281738 shutdown_connections 2023-12-08T08:21:47.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.547+0000 7fc6390fe640 1 --2- 172.21.15.88:0/2456281738 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc614066470 0x7fc614068930 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:47.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.547+0000 7fc6390fe640 1 --2- 172.21.15.88:0/2456281738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6341effb0 0x7fc6341f0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:47.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.547+0000 7fc6390fe640 1 --2- 172.21.15.88:0/2456281738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc634145790 0x7fc6340c16e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:47.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.547+0000 7fc6390fe640 1 --2- 172.21.15.88:0/2456281738 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6200039b0 0x7fc634145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:47.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.547+0000 7fc6390fe640 1 -- 172.21.15.88:0/2456281738 >> 172.21.15.88:0/2456281738 conn(0x7fc6340c59f0 msgr2=0x7fc6341561b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:47.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.547+0000 7fc6390fe640 1 -- 172.21.15.88:0/2456281738 shutdown_connections 2023-12-08T08:21:47.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.547+0000 7fc6390fe640 1 -- 172.21.15.88:0/2456281738 wait complete. 2023-12-08T08:21:47.572 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:21:47.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.703+0000 7fe4a2901640 1 Processor -- start 2023-12-08T08:21:47.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.707+0000 7fe4a2901640 1 -- start start 2023-12-08T08:21:47.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.707+0000 7fe4a2901640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe49c14f9d0 0x7fe49c0662a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:47.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.707+0000 7fe4a2901640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49c06de50 con 0x7fe49c071450 2023-12-08T08:21:47.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.707+0000 7fe4a2901640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49c06e2e0 con 0x7fe49c06e710 2023-12-08T08:21:47.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.707+0000 7fe4a2901640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c071ff0 con 0x7fe49c14f9d0 2023-12-08T08:21:47.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.707+0000 7fe4a0e9e640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe49c071450 0x7fe49c0718e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41366/0 (socket says 172.21.15.88:41366) 2023-12-08T08:21:47.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.707+0000 7fe4a0e9e640 1 -- 172.21.15.88:0/1462562806 learned_addr learned my addr 172.21.15.88:0/1462562806 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:47.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.707+0000 7fe49bfff640 1 --2- 172.21.15.88:0/1462562806 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe49c14f9d0 0x7fe49c0662a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:47.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.707+0000 7fe49affd640 1 -- 172.21.15.88:0/1462562806 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2852320187 0 0) 0x7fe49c06de50 con 0x7fe49c071450 2023-12-08T08:21:47.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.707+0000 7fe49affd640 1 -- 172.21.15.88:0/1462562806 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe484003530 con 0x7fe49c071450 2023-12-08T08:21:47.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.707+0000 7fe49affd640 1 -- 172.21.15.88:0/1462562806 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645641122 0 0) 0x7fe49c06e2e0 con 0x7fe49c06e710 2023-12-08T08:21:47.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.707+0000 7fe49affd640 1 -- 172.21.15.88:0/1462562806 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe49c06de50 con 0x7fe49c06e710 2023-12-08T08:21:47.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.707+0000 7fe49bfff640 1 -- 172.21.15.88:0/1462562806 >> v1:172.21.15.148:6789/0 conn(0x7fe49c06e710 legacy=0x7fe49c06b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:47.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.707+0000 7fe49affd640 1 -- 172.21.15.88:0/1462562806 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4244122444 0 0) 0x7fe484003530 con 0x7fe49c071450 2023-12-08T08:21:47.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.707+0000 7fe49bfff640 1 -- 172.21.15.88:0/1462562806 >> v1:172.21.15.88:6789/0 conn(0x7fe49c071450 legacy=0x7fe49c0718e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:47.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.707+0000 7fe49bfff640 1 -- 172.21.15.88:0/1462562806 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c066930 con 0x7fe49c14f9d0 2023-12-08T08:21:47.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.711+0000 7fe49bfff640 1 --2- 172.21.15.88:0/1462562806 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe49c14f9d0 0x7fe49c0662a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0097f0 tx=0x7fe48c01c2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1547999a4a4ccda4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:47.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.711+0000 7fe49affd640 1 -- 172.21.15.88:0/1462562806 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494001a00 con 0x7fe49c14f9d0 2023-12-08T08:21:47.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.711+0000 7fe49affd640 1 -- 172.21.15.88:0/1462562806 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48c0a7050 con 0x7fe49c14f9d0 2023-12-08T08:21:47.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.711+0000 7fe49affd640 1 -- 172.21.15.88:0/1462562806 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c0ab620 con 0x7fe49c14f9d0 2023-12-08T08:21:47.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.711+0000 7fe4a2901640 1 -- 172.21.15.88:0/1462562806 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe49c14f9d0 msgr2=0x7fe49c0662a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:47.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.711+0000 7fe4a2901640 1 --2- 172.21.15.88:0/1462562806 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe49c14f9d0 0x7fe49c0662a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0097f0 tx=0x7fe48c01c2a0 comp rx=0 tx=0).stop 2023-12-08T08:21:47.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.711+0000 7fe4a2901640 1 -- 172.21.15.88:0/1462562806 shutdown_connections 2023-12-08T08:21:47.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.711+0000 7fe4a2901640 1 --2- 172.21.15.88:0/1462562806 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe49c14f9d0 0x7fe49c0662a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:47.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.711+0000 7fe4a2901640 1 -- 172.21.15.88:0/1462562806 >> 172.21.15.88:0/1462562806 conn(0x7fe49c0c61f0 msgr2=0x7fe49c0c6600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:47.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.711+0000 7fe4a2901640 1 -- 172.21.15.88:0/1462562806 shutdown_connections 2023-12-08T08:21:47.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.711+0000 7fe4a2901640 1 -- 172.21.15.88:0/1462562806 wait complete. 2023-12-08T08:21:47.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.711+0000 7fe4a2901640 1 Processor -- start 2023-12-08T08:21:47.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.715+0000 7fe4a2901640 1 -- start start 2023-12-08T08:21:47.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.715+0000 7fe4a2901640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe49c06e710 0x7fe49c146b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:47.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.715+0000 7fe4a2901640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe49c071450 0x7fe49c0c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:47.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.715+0000 7fe4a2901640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe49c14f9d0 0x7fe49c140ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:47.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.715+0000 7fe4a2901640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c0aa670 con 0x7fe49c14f9d0 2023-12-08T08:21:47.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.715+0000 7fe4a2901640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c0aa910 con 0x7fe49c071450 2023-12-08T08:21:47.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.715+0000 7fe4a2901640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c144e90 con 0x7fe49c06e710 2023-12-08T08:21:47.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.715+0000 7fe4a0e9e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe49c14f9d0 0x7fe49c140ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:47.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.715+0000 7fe49bfff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe49c06e710 0x7fe49c146b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:47.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.715+0000 7fe4a0e9e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe49c14f9d0 0x7fe49c140ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57244/0 (socket says 172.21.15.88:57244) 2023-12-08T08:21:47.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.715+0000 7fe4a0e9e640 1 -- 172.21.15.88:0/1459488654 learned_addr learned my addr 172.21.15.88:0/1459488654 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:47.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.715+0000 7fe49b7fe640 1 --2- 172.21.15.88:0/1459488654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe49c071450 0x7fe49c0c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:47.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.715+0000 7fe4a0e9e640 1 -- 172.21.15.88:0/1459488654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe49c06e710 msgr2=0x7fe49c146b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:47.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.715+0000 7fe4a0e9e640 1 --2- 172.21.15.88:0/1459488654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe49c06e710 0x7fe49c146b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:47.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.715+0000 7fe4a0e9e640 1 -- 172.21.15.88:0/1459488654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe49c071450 msgr2=0x7fe49c0c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:47.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.715+0000 7fe4a0e9e640 1 --2- 172.21.15.88:0/1459488654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe49c071450 0x7fe49c0c4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:47.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.715+0000 7fe4a0e9e640 1 -- 172.21.15.88:0/1459488654 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c009420 con 0x7fe49c14f9d0 2023-12-08T08:21:47.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.715+0000 7fe4a0e9e640 1 --2- 172.21.15.88:0/1459488654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe49c14f9d0 0x7fe49c140ac0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe494001fb0 tx=0x7fe49400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:47.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.715+0000 7fe498ff9640 1 -- 172.21.15.88:0/1459488654 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494012400 con 0x7fe49c14f9d0 2023-12-08T08:21:47.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.715+0000 7fe498ff9640 1 -- 172.21.15.88:0/1459488654 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe494012560 con 0x7fe49c14f9d0 2023-12-08T08:21:47.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.715+0000 7fe498ff9640 1 -- 172.21.15.88:0/1459488654 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494012910 con 0x7fe49c14f9d0 2023-12-08T08:21:47.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.715+0000 7fe4a2901640 1 -- 172.21.15.88:0/1459488654 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49c1470d0 con 0x7fe49c14f9d0 2023-12-08T08:21:47.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.715+0000 7fe4a2901640 1 -- 172.21.15.88:0/1459488654 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49c0a9b80 con 0x7fe49c14f9d0 2023-12-08T08:21:47.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.715+0000 7fe4a2901640 1 -- 172.21.15.88:0/1459488654 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe49c073bd0 con 0x7fe49c14f9d0 2023-12-08T08:21:47.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.719+0000 7fe498ff9640 1 -- 172.21.15.88:0/1459488654 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe494012a70 con 0x7fe49c14f9d0 2023-12-08T08:21:47.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.719+0000 7fe498ff9640 1 --2- 172.21.15.88:0/1459488654 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe488066470 0x7fe488068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:47.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.719+0000 7fe498ff9640 1 -- 172.21.15.88:0/1459488654 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fe4940845c0 con 0x7fe49c14f9d0 2023-12-08T08:21:47.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.719+0000 7fe49bfff640 1 --2- 172.21.15.88:0/1459488654 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe488066470 0x7fe488068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:47.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.719+0000 7fe49bfff640 1 --2- 172.21.15.88:0/1459488654 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe488066470 0x7fe488068930 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0ad000 tx=0x7fe48c0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:47.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.723+0000 7fe498ff9640 1 -- 172.21.15.88:0/1459488654 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe494051a80 con 0x7fe49c14f9d0 2023-12-08T08:21:47.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.903+0000 7fe4a2901640 1 -- 172.21.15.88:0/1459488654 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe49c0aaa80 con 0x7fe49c14f9d0 2023-12-08T08:21:47.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.903+0000 7fe498ff9640 1 -- 172.21.15.88:0/1459488654 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4918 (secure 0 0 0) 0x7fe4940550a0 con 0x7fe49c14f9d0 2023-12-08T08:21:47.907 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:47.907 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4978,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3372523869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3372523869},{"type":"v1","addr":"172.21.15.148:6834","nonce":3372523869}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4085245492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":4085245492},{"type":"v1","addr":"172.21.15.148:6835","nonce":4085245492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/957673221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":957673221},{"type":"v1","addr":"172.21.15.88:6837","nonce":957673221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:21:18.029250+0000","modified":"2023-12-08T08:21:21.056129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.88:6836/4274252181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":4274252181},{"type":"v1","addr":"172.21.15.88:6836","nonce":4274252181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-08T08:21:47.908 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 24 2023-12-08T08:21:47.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.903+0000 7fe4a2901640 1 -- 172.21.15.88:0/1459488654 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe488066470 msgr2=0x7fe488068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:47.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.903+0000 7fe4a2901640 1 --2- 172.21.15.88:0/1459488654 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe488066470 0x7fe488068930 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0ad000 tx=0x7fe48c0a6000 comp rx=0 tx=0).stop 2023-12-08T08:21:47.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.903+0000 7fe4a2901640 1 -- 172.21.15.88:0/1459488654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe49c14f9d0 msgr2=0x7fe49c140ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:47.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.903+0000 7fe4a2901640 1 --2- 172.21.15.88:0/1459488654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe49c14f9d0 0x7fe49c140ac0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe494001fb0 tx=0x7fe49400a430 comp rx=0 tx=0).stop 2023-12-08T08:21:47.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.903+0000 7fe4a2901640 1 -- 172.21.15.88:0/1459488654 shutdown_connections 2023-12-08T08:21:47.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.903+0000 7fe4a2901640 1 --2- 172.21.15.88:0/1459488654 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe488066470 0x7fe488068930 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:47.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.903+0000 7fe4a2901640 1 --2- 172.21.15.88:0/1459488654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe49c14f9d0 0x7fe49c140ac0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:47.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.903+0000 7fe4a2901640 1 --2- 172.21.15.88:0/1459488654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe49c071450 0x7fe49c0c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:47.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.903+0000 7fe4a2901640 1 --2- 172.21.15.88:0/1459488654 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe49c06e710 0x7fe49c146b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:47.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.903+0000 7fe4a2901640 1 -- 172.21.15.88:0/1459488654 >> 172.21.15.88:0/1459488654 conn(0x7fe49c0c61f0 msgr2=0x7fe49c0733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:47.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.903+0000 7fe4a2901640 1 -- 172.21.15.88:0/1459488654 shutdown_connections 2023-12-08T08:21:47.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:47.903+0000 7fe4a2901640 1 -- 172.21.15.88:0/1459488654 wait complete. 2023-12-08T08:21:47.928 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:21:48.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.063+0000 7fad424e4640 1 Processor -- start 2023-12-08T08:21:48.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.063+0000 7fad424e4640 1 -- start start 2023-12-08T08:21:48.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.063+0000 7fad424e4640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad3c154f20 0x7fad3c06b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:48.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.063+0000 7fad424e4640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fad3c06bf30 0x7fad3c15ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.063+0000 7fad424e4640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad3c06c380 con 0x7fad3c0af4c0 2023-12-08T08:21:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.063+0000 7fad424e4640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad3c0c4890 con 0x7fad3c06bf30 2023-12-08T08:21:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.063+0000 7fad424e4640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c1553a0 con 0x7fad3c154f20 2023-12-08T08:21:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.063+0000 7fad3bfff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fad3c0af4c0 0x7fad3c0c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41368/0 (socket says 172.21.15.88:41368) 2023-12-08T08:21:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.063+0000 7fad3bfff640 1 -- 172.21.15.88:0/996804018 learned_addr learned my addr 172.21.15.88:0/996804018 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.063+0000 7fad3b7fe640 1 --2- 172.21.15.88:0/996804018 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad3c154f20 0x7fad3c06b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.063+0000 7fad40a81640 1 --2- 172.21.15.88:0/996804018 >> v2:172.21.15.148:3300/0 conn(0x7fad3c06bf30 0x7fad3c15ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.063+0000 7fad3affd640 1 -- 172.21.15.88:0/996804018 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095326950 0 0) 0x7fad3c06c380 con 0x7fad3c0af4c0 2023-12-08T08:21:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.063+0000 7fad3affd640 1 -- 172.21.15.88:0/996804018 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad24003530 con 0x7fad3c0af4c0 2023-12-08T08:21:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.063+0000 7fad3affd640 1 -- 172.21.15.88:0/996804018 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1886806276 0 0) 0x7fad24003530 con 0x7fad3c0af4c0 2023-12-08T08:21:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.063+0000 7fad3b7fe640 1 -- 172.21.15.88:0/996804018 >> v2:172.21.15.148:3300/0 conn(0x7fad3c06bf30 msgr2=0x7fad3c15ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.063+0000 7fad3b7fe640 1 --2- 172.21.15.88:0/996804018 >> v2:172.21.15.148:3300/0 conn(0x7fad3c06bf30 0x7fad3c15ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.063+0000 7fad3b7fe640 1 -- 172.21.15.88:0/996804018 >> v1:172.21.15.88:6789/0 conn(0x7fad3c0af4c0 legacy=0x7fad3c0c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.063+0000 7fad3b7fe640 1 -- 172.21.15.88:0/996804018 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3c0af8a0 con 0x7fad3c154f20 2023-12-08T08:21:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.063+0000 7fad40a81640 1 --2- 172.21.15.88:0/996804018 >> v2:172.21.15.148:3300/0 conn(0x7fad3c06bf30 0x7fad3c15ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:21:48.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.067+0000 7fad3b7fe640 1 --2- 172.21.15.88:0/996804018 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad3c154f20 0x7fad3c06b9f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fad300097c0 tx=0x7fad3001c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52c1739dea16a128 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:48.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.067+0000 7fad3affd640 1 -- 172.21.15.88:0/996804018 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2c001680 con 0x7fad3c154f20 2023-12-08T08:21:48.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.067+0000 7fad3affd640 1 -- 172.21.15.88:0/996804018 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad300a7050 con 0x7fad3c154f20 2023-12-08T08:21:48.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.067+0000 7fad3affd640 1 -- 172.21.15.88:0/996804018 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad300ab620 con 0x7fad3c154f20 2023-12-08T08:21:48.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.067+0000 7fad424e4640 1 -- 172.21.15.88:0/996804018 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad3c154f20 msgr2=0x7fad3c06b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:48.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.067+0000 7fad424e4640 1 --2- 172.21.15.88:0/996804018 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad3c154f20 0x7fad3c06b9f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fad300097c0 tx=0x7fad3001c2e0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.067+0000 7fad424e4640 1 -- 172.21.15.88:0/996804018 shutdown_connections 2023-12-08T08:21:48.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.067+0000 7fad424e4640 1 --2- 172.21.15.88:0/996804018 >> v2:172.21.15.148:3300/0 conn(0x7fad3c06bf30 0x7fad3c15ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.067+0000 7fad424e4640 1 --2- 172.21.15.88:0/996804018 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad3c154f20 0x7fad3c06b9f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.067+0000 7fad424e4640 1 -- 172.21.15.88:0/996804018 >> 172.21.15.88:0/996804018 conn(0x7fad3c0ab9d0 msgr2=0x7fad3c0abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:48.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.067+0000 7fad424e4640 1 -- 172.21.15.88:0/996804018 shutdown_connections 2023-12-08T08:21:48.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.067+0000 7fad424e4640 1 -- 172.21.15.88:0/996804018 wait complete. 2023-12-08T08:21:48.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.071+0000 7fad424e4640 1 Processor -- start 2023-12-08T08:21:48.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.071+0000 7fad424e4640 1 -- start start 2023-12-08T08:21:48.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.071+0000 7fad424e4640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad3c06bf30 0x7fad3c0c0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:48.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.071+0000 7fad424e4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad3c0af4c0 0x7fad3c1ed0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:48.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.071+0000 7fad424e4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad3c154f20 0x7fad3c1ed620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:48.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.071+0000 7fad424e4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c144260 con 0x7fad3c0af4c0 2023-12-08T08:21:48.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.071+0000 7fad424e4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c1ecc00 con 0x7fad3c154f20 2023-12-08T08:21:48.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.071+0000 7fad424e4640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c1439c0 con 0x7fad3c06bf30 2023-12-08T08:21:48.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.071+0000 7fad3b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad3c0af4c0 0x7fad3c1ed0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:48.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.071+0000 7fad3b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad3c0af4c0 0x7fad3c1ed0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57254/0 (socket says 172.21.15.88:57254) 2023-12-08T08:21:48.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.071+0000 7fad3b7fe640 1 -- 172.21.15.88:0/1353216388 learned_addr learned my addr 172.21.15.88:0/1353216388 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:48.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.071+0000 7fad3bfff640 1 --2- 172.21.15.88:0/1353216388 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad3c06bf30 0x7fad3c0c0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:48.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.071+0000 7fad40a81640 1 --2- 172.21.15.88:0/1353216388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad3c154f20 0x7fad3c1ed620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:48.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.071+0000 7fad3b7fe640 1 -- 172.21.15.88:0/1353216388 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad3c06bf30 msgr2=0x7fad3c0c0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:48.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.071+0000 7fad3b7fe640 1 --2- 172.21.15.88:0/1353216388 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad3c06bf30 0x7fad3c0c0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.071+0000 7fad3b7fe640 1 -- 172.21.15.88:0/1353216388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad3c154f20 msgr2=0x7fad3c1ed620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:48.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.071+0000 7fad3b7fe640 1 --2- 172.21.15.88:0/1353216388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad3c154f20 0x7fad3c1ed620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.071+0000 7fad3b7fe640 1 -- 172.21.15.88:0/1353216388 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad34009a70 con 0x7fad3c0af4c0 2023-12-08T08:21:48.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.071+0000 7fad3bfff640 1 --2- 172.21.15.88:0/1353216388 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad3c06bf30 0x7fad3c0c0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:48.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.071+0000 7fad40a81640 1 --2- 172.21.15.88:0/1353216388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad3c154f20 0x7fad3c1ed620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:48.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.071+0000 7fad3b7fe640 1 --2- 172.21.15.88:0/1353216388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad3c0af4c0 0x7fad3c1ed0e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fad3001cb80 tx=0x7fad30019080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:48.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.071+0000 7fad38ff9640 1 -- 172.21.15.88:0/1353216388 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad300b5470 con 0x7fad3c0af4c0 2023-12-08T08:21:48.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.071+0000 7fad38ff9640 1 -- 172.21.15.88:0/1353216388 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad300b55f0 con 0x7fad3c0af4c0 2023-12-08T08:21:48.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.071+0000 7fad38ff9640 1 -- 172.21.15.88:0/1353216388 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad300b59a0 con 0x7fad3c0af4c0 2023-12-08T08:21:48.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.071+0000 7fad424e4640 1 -- 172.21.15.88:0/1353216388 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad30009420 con 0x7fad3c0af4c0 2023-12-08T08:21:48.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.071+0000 7fad424e4640 1 -- 172.21.15.88:0/1353216388 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad3c143f80 con 0x7fad3c0af4c0 2023-12-08T08:21:48.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.075+0000 7fad424e4640 1 -- 172.21.15.88:0/1353216388 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad3c1eca60 con 0x7fad3c0af4c0 2023-12-08T08:21:48.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.075+0000 7fad38ff9640 1 -- 172.21.15.88:0/1353216388 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fad300b2040 con 0x7fad3c0af4c0 2023-12-08T08:21:48.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.075+0000 7fad38ff9640 1 --2- 172.21.15.88:0/1353216388 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fad28066470 0x7fad28068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:48.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.075+0000 7fad38ff9640 1 -- 172.21.15.88:0/1353216388 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fad3011e2e0 con 0x7fad3c0af4c0 2023-12-08T08:21:48.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.075+0000 7fad3bfff640 1 --2- 172.21.15.88:0/1353216388 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fad28066470 0x7fad28068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:48.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.075+0000 7fad3bfff640 1 --2- 172.21.15.88:0/1353216388 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fad28066470 0x7fad28068930 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fad2c005890 tx=0x7fad2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:48.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.079+0000 7fad38ff9640 1 -- 172.21.15.88:0/1353216388 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fad3c1eca60 con 0x7fad3c0af4c0 2023-12-08T08:21:48.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.231+0000 7fad424e4640 1 -- 172.21.15.88:0/1353216388 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad3c1eca60 con 0x7fad3c0af4c0 2023-12-08T08:21:48.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.231+0000 7fad38ff9640 1 -- 172.21.15.88:0/1353216388 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16620 (secure 0 0 0) 0x7fad3c1eca60 con 0x7fad3c0af4c0 2023-12-08T08:21:48.237 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:48.238 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":38,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:21:45.969917+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:21:16.039054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:21:17.029894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6837/181654220":"2023-12-09T08:21:42.962792+0000","172.21.15.88:6835/181654220":"2023-12-09T08:21:42.962792+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:21:48.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.235+0000 7fad424e4640 1 -- 172.21.15.88:0/1353216388 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fad28066470 msgr2=0x7fad28068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:48.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.235+0000 7fad424e4640 1 --2- 172.21.15.88:0/1353216388 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fad28066470 0x7fad28068930 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fad2c005890 tx=0x7fad2c009040 comp rx=0 tx=0).stop 2023-12-08T08:21:48.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.235+0000 7fad424e4640 1 -- 172.21.15.88:0/1353216388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad3c0af4c0 msgr2=0x7fad3c1ed0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:48.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.235+0000 7fad424e4640 1 --2- 172.21.15.88:0/1353216388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad3c0af4c0 0x7fad3c1ed0e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fad3001cb80 tx=0x7fad30019080 comp rx=0 tx=0).stop 2023-12-08T08:21:48.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.235+0000 7fad424e4640 1 -- 172.21.15.88:0/1353216388 shutdown_connections 2023-12-08T08:21:48.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.235+0000 7fad424e4640 1 --2- 172.21.15.88:0/1353216388 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fad28066470 0x7fad28068930 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.235+0000 7fad424e4640 1 --2- 172.21.15.88:0/1353216388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad3c154f20 0x7fad3c1ed620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.235+0000 7fad424e4640 1 --2- 172.21.15.88:0/1353216388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad3c0af4c0 0x7fad3c1ed0e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.235+0000 7fad424e4640 1 --2- 172.21.15.88:0/1353216388 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fad3c06bf30 0x7fad3c0c0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.235+0000 7fad424e4640 1 -- 172.21.15.88:0/1353216388 >> 172.21.15.88:0/1353216388 conn(0x7fad3c0ab9d0 msgr2=0x7fad3c14a740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:48.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.235+0000 7fad424e4640 1 -- 172.21.15.88:0/1353216388 shutdown_connections 2023-12-08T08:21:48.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.235+0000 7fad424e4640 1 -- 172.21.15.88:0/1353216388 wait complete. 2023-12-08T08:21:48.259 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-12-08T08:21:48.259 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:21:48.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.391+0000 7f92c1a17640 1 Processor -- start 2023-12-08T08:21:48.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.391+0000 7f92c1a17640 1 -- start start 2023-12-08T08:21:48.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.391+0000 7f92c1a17640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92bc0c3b80 0x7f92bc06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:48.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.391+0000 7f92c1a17640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92bc06bb80 con 0x7f92bc06d2b0 2023-12-08T08:21:48.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.391+0000 7f92c1a17640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92bc0c5790 con 0x7f92bc0c5300 2023-12-08T08:21:48.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.391+0000 7f92c1a17640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc1515c0 con 0x7f92bc0c3b80 2023-12-08T08:21:48.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.391+0000 7f92baffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f92bc06d2b0 0x7f92bc06c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41370/0 (socket says 172.21.15.88:41370) 2023-12-08T08:21:48.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.391+0000 7f92baffd640 1 -- 172.21.15.88:0/1943364896 learned_addr learned my addr 172.21.15.88:0/1943364896 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:48.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.395+0000 7f92ba7fc640 1 --2- 172.21.15.88:0/1943364896 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92bc0c3b80 0x7f92bc06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:48.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.395+0000 7f92b9ffb640 1 -- 172.21.15.88:0/1943364896 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3735404901 0 0) 0x7f92bc06bb80 con 0x7f92bc06d2b0 2023-12-08T08:21:48.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.395+0000 7f92b9ffb640 1 -- 172.21.15.88:0/1943364896 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92a4003530 con 0x7f92bc06d2b0 2023-12-08T08:21:48.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.395+0000 7f92b9ffb640 1 -- 172.21.15.88:0/1943364896 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2498285808 0 0) 0x7f92a4003530 con 0x7f92bc06d2b0 2023-12-08T08:21:48.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.395+0000 7f92b9ffb640 1 -- 172.21.15.88:0/1943364896 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92bc0c3b80 msgr2=0x7f92bc06d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:48.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.395+0000 7f92b9ffb640 1 --2- 172.21.15.88:0/1943364896 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92bc0c3b80 0x7f92bc06d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.395+0000 7f92b9ffb640 1 -- 172.21.15.88:0/1943364896 >> v1:172.21.15.148:6789/0 conn(0x7f92bc0c5300 legacy=0x7f92bc06c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:48.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.395+0000 7f92b9ffb640 1 -- 172.21.15.88:0/1943364896 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc1518a0 con 0x7f92bc06d2b0 2023-12-08T08:21:48.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.395+0000 7f92b9ffb640 1 -- 172.21.15.88:0/1943364896 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f92ac001680 con 0x7f92bc06d2b0 2023-12-08T08:21:48.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.395+0000 7f92b9ffb640 1 -- 172.21.15.88:0/1943364896 >> v1:172.21.15.88:6789/0 conn(0x7f92bc06d2b0 legacy=0x7f92bc06c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:48.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.395+0000 7f92b9ffb640 1 --2- 172.21.15.88:0/1943364896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92a40039b0 0x7f92a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:48.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.395+0000 7f92b9ffb640 1 --2- 172.21.15.88:0/1943364896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92a40047d0 0x7f92a4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:48.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.395+0000 7f92b9ffb640 1 --2- 172.21.15.88:0/1943364896 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92bc0c3b80 0x7f92a4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:48.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.395+0000 7f92b9ffb640 1 -- 172.21.15.88:0/1943364896 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc1515c0 con 0x7f92a40039b0 2023-12-08T08:21:48.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.395+0000 7f92b9ffb640 1 -- 172.21.15.88:0/1943364896 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a400ba40 con 0x7f92a40047d0 2023-12-08T08:21:48.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.395+0000 7f92b9ffb640 1 -- 172.21.15.88:0/1943364896 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a400bc00 con 0x7f92bc0c3b80 2023-12-08T08:21:48.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.395+0000 7f92baffd640 1 --2- 172.21.15.88:0/1943364896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92a40039b0 0x7f92a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:48.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.395+0000 7f92ba7fc640 1 --2- 172.21.15.88:0/1943364896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92a40047d0 0x7f92a4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:48.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.395+0000 7f92bb7fe640 1 --2- 172.21.15.88:0/1943364896 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92bc0c3b80 0x7f92a4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:48.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.395+0000 7f92baffd640 1 -- 172.21.15.88:0/1943364896 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92bc0c3b80 msgr2=0x7f92a4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:48.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.395+0000 7f92baffd640 1 --2- 172.21.15.88:0/1943364896 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92bc0c3b80 0x7f92a4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.395+0000 7f92baffd640 1 -- 172.21.15.88:0/1943364896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92a40047d0 msgr2=0x7f92a4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:48.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.395+0000 7f92baffd640 1 --2- 172.21.15.88:0/1943364896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92a40047d0 0x7f92a4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.395+0000 7f92baffd640 1 -- 172.21.15.88:0/1943364896 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a4003530 con 0x7f92a40039b0 2023-12-08T08:21:48.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.399+0000 7f92baffd640 1 --2- 172.21.15.88:0/1943364896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92a40039b0 0x7f92a4003dd0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f92ac00c210 tx=0x7f92ac01cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5217281494356e3a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:48.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.399+0000 7f92b9ffb640 1 -- 172.21.15.88:0/1943364896 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac005ae0 con 0x7f92a40039b0 2023-12-08T08:21:48.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.399+0000 7f92b9ffb640 1 -- 172.21.15.88:0/1943364896 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ac005c40 con 0x7f92a40039b0 2023-12-08T08:21:48.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.399+0000 7f92b9ffb640 1 -- 172.21.15.88:0/1943364896 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac0a57c0 con 0x7f92a40039b0 2023-12-08T08:21:48.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.399+0000 7f92c1a17640 1 -- 172.21.15.88:0/1943364896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92a40039b0 msgr2=0x7f92a4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:48.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.399+0000 7f92c1a17640 1 --2- 172.21.15.88:0/1943364896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92a40039b0 0x7f92a4003dd0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f92ac00c210 tx=0x7f92ac01cbd0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.399+0000 7f92bb7fe640 1 -- 172.21.15.88:0/1943364896 reap_dead start 2023-12-08T08:21:48.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.399+0000 7f92c1a17640 1 -- 172.21.15.88:0/1943364896 shutdown_connections 2023-12-08T08:21:48.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.399+0000 7f92c1a17640 1 -- 172.21.15.88:0/1943364896 >> 172.21.15.88:0/1943364896 conn(0x7f92bc0a7810 msgr2=0x7f92bc0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:48.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.399+0000 7f92c1a17640 1 -- 172.21.15.88:0/1943364896 shutdown_connections 2023-12-08T08:21:48.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.399+0000 7f92c1a17640 1 -- 172.21.15.88:0/1943364896 wait complete. 2023-12-08T08:21:48.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.399+0000 7f92c1a17640 1 Processor -- start 2023-12-08T08:21:48.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.399+0000 7f92c1a17640 1 -- start start 2023-12-08T08:21:48.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.403+0000 7f92c1a17640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92a40039b0 0x7f92bc1492a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:48.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.403+0000 7f92c1a17640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92bc14d2c0 0x7f92bc146080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:48.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.403+0000 7f92c1a17640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92bc149c10 0x7f92bc1465c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:48.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.403+0000 7f92c1a17640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc14da00 con 0x7f92a40039b0 2023-12-08T08:21:48.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.403+0000 7f92c1a17640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc1474f0 con 0x7f92bc149c10 2023-12-08T08:21:48.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.403+0000 7f92c1a17640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc150940 con 0x7f92bc14d2c0 2023-12-08T08:21:48.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.403+0000 7f92baffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92a40039b0 0x7f92bc1492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:48.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.403+0000 7f92baffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92a40039b0 0x7f92bc1492a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57262/0 (socket says 172.21.15.88:57262) 2023-12-08T08:21:48.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.403+0000 7f92baffd640 1 -- 172.21.15.88:0/4023067093 learned_addr learned my addr 172.21.15.88:0/4023067093 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:48.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.403+0000 7f92bb7fe640 1 --2- 172.21.15.88:0/4023067093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92bc149c10 0x7f92bc1465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:48.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.403+0000 7f92ba7fc640 1 --2- 172.21.15.88:0/4023067093 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92bc14d2c0 0x7f92bc146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:48.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.403+0000 7f92baffd640 1 -- 172.21.15.88:0/4023067093 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92bc14d2c0 msgr2=0x7f92bc146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:48.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.403+0000 7f92baffd640 1 --2- 172.21.15.88:0/4023067093 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92bc14d2c0 0x7f92bc146080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.403+0000 7f92baffd640 1 -- 172.21.15.88:0/4023067093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92bc149c10 msgr2=0x7f92bc1465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:48.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.403+0000 7f92baffd640 1 --2- 172.21.15.88:0/4023067093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92bc149c10 0x7f92bc1465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.403+0000 7f92baffd640 1 -- 172.21.15.88:0/4023067093 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc14ef80 con 0x7f92a40039b0 2023-12-08T08:21:48.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.403+0000 7f92baffd640 1 --2- 172.21.15.88:0/4023067093 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92a40039b0 0x7f92bc1492a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f92ac001940 tx=0x7f92a4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:48.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.403+0000 7f92a3fff640 1 -- 172.21.15.88:0/4023067093 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac0b4070 con 0x7f92a40039b0 2023-12-08T08:21:48.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.403+0000 7f92a3fff640 1 -- 172.21.15.88:0/4023067093 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ac005e30 con 0x7f92a40039b0 2023-12-08T08:21:48.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.403+0000 7f92c1a17640 1 -- 172.21.15.88:0/4023067093 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92bc146b00 con 0x7f92a40039b0 2023-12-08T08:21:48.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.403+0000 7f92a3fff640 1 -- 172.21.15.88:0/4023067093 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac0a57c0 con 0x7f92a40039b0 2023-12-08T08:21:48.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.403+0000 7f92c1a17640 1 -- 172.21.15.88:0/4023067093 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92bc1eed40 con 0x7f92a40039b0 2023-12-08T08:21:48.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.403+0000 7f92c1a17640 1 -- 172.21.15.88:0/4023067093 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92bc0a82b0 con 0x7f92a40039b0 2023-12-08T08:21:48.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.403+0000 7f92a3fff640 1 -- 172.21.15.88:0/4023067093 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f92ac0a5920 con 0x7f92a40039b0 2023-12-08T08:21:48.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.407+0000 7f92a3fff640 1 --2- 172.21.15.88:0/4023067093 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f92a80664a0 0x7f92a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:48.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.407+0000 7f92a3fff640 1 -- 172.21.15.88:0/4023067093 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f92ac11d650 con 0x7f92a40039b0 2023-12-08T08:21:48.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.407+0000 7f92ba7fc640 1 --2- 172.21.15.88:0/4023067093 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f92a80664a0 0x7f92a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:48.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.407+0000 7f92ba7fc640 1 --2- 172.21.15.88:0/4023067093 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f92a80664a0 0x7f92a8068960 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f92bc1ebc10 tx=0x7f92b0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:48.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.411+0000 7f92a3fff640 1 -- 172.21.15.88:0/4023067093 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f92ac0eab10 con 0x7f92a40039b0 2023-12-08T08:21:48.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.591+0000 7f92c1a17640 1 -- 172.21.15.88:0/4023067093 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92bc1eef30 con 0x7f92a40039b0 2023-12-08T08:21:48.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.591+0000 7f92a3fff640 1 -- 172.21.15.88:0/4023067093 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f92ac0ee130 con 0x7f92a40039b0 2023-12-08T08:21:48.596 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:48.596 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4978,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3372523869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3372523869},{"type":"v1","addr":"172.21.15.148:6834","nonce":3372523869}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4085245492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":4085245492},{"type":"v1","addr":"172.21.15.148:6835","nonce":4085245492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/957673221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":957673221},{"type":"v1","addr":"172.21.15.88:6837","nonce":957673221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:21:18.029250+0000","modified":"2023-12-08T08:21:21.056129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.88:6836/4274252181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":4274252181},{"type":"v1","addr":"172.21.15.88:6836","nonce":4274252181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-08T08:21:48.596 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 24 2023-12-08T08:21:48.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.591+0000 7f92c1a17640 1 -- 172.21.15.88:0/4023067093 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f92a80664a0 msgr2=0x7f92a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:48.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.591+0000 7f92c1a17640 1 --2- 172.21.15.88:0/4023067093 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f92a80664a0 0x7f92a8068960 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f92bc1ebc10 tx=0x7f92b0009190 comp rx=0 tx=0).stop 2023-12-08T08:21:48.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.591+0000 7f92c1a17640 1 -- 172.21.15.88:0/4023067093 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92a40039b0 msgr2=0x7f92bc1492a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:48.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.591+0000 7f92c1a17640 1 --2- 172.21.15.88:0/4023067093 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92a40039b0 0x7f92bc1492a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f92ac001940 tx=0x7f92a4005800 comp rx=0 tx=0).stop 2023-12-08T08:21:48.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.595+0000 7f92c1a17640 1 -- 172.21.15.88:0/4023067093 shutdown_connections 2023-12-08T08:21:48.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.595+0000 7f92c1a17640 1 --2- 172.21.15.88:0/4023067093 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f92a80664a0 0x7f92a8068960 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.595+0000 7f92c1a17640 1 --2- 172.21.15.88:0/4023067093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92bc149c10 0x7f92bc1465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.595+0000 7f92c1a17640 1 --2- 172.21.15.88:0/4023067093 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92bc14d2c0 0x7f92bc146080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.595+0000 7f92c1a17640 1 --2- 172.21.15.88:0/4023067093 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92a40039b0 0x7f92bc1492a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.595+0000 7f92c1a17640 1 -- 172.21.15.88:0/4023067093 >> 172.21.15.88:0/4023067093 conn(0x7f92bc0a7810 msgr2=0x7f92bc071c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:48.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.595+0000 7f92c1a17640 1 -- 172.21.15.88:0/4023067093 shutdown_connections 2023-12-08T08:21:48.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.595+0000 7f92c1a17640 1 -- 172.21.15.88:0/4023067093 wait complete. 2023-12-08T08:21:48.617 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:21:48.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.747+0000 7f1f41494640 1 Processor -- start 2023-12-08T08:21:48.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.747+0000 7f1f41494640 1 -- start start 2023-12-08T08:21:48.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.751+0000 7f1f41494640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1f3c0ca3c0 0x7f1f3c154580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:48.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.751+0000 7f1f41494640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1f3c0c7dd0 0x7f1f3c158210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:48.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.751+0000 7f1f41494640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3c06bc80 con 0x7f1f3c158750 2023-12-08T08:21:48.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.751+0000 7f1f41494640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3c157e10 con 0x7f1f3c0ca3c0 2023-12-08T08:21:48.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.751+0000 7f1f41494640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3c0c5120 con 0x7f1f3c0c7dd0 2023-12-08T08:21:48.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.751+0000 7f1f3affd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1f3c0ca3c0 0x7f1f3c154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:48.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.751+0000 7f1f3affd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1f3c0ca3c0 0x7f1f3c154580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57272/0 (socket says 172.21.15.88:57272) 2023-12-08T08:21:48.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.751+0000 7f1f3affd640 1 -- 172.21.15.88:0/3393383136 learned_addr learned my addr 172.21.15.88:0/3393383136 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:48.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.751+0000 7f1f3a7fc640 1 --2- 172.21.15.88:0/3393383136 >> v2:172.21.15.148:3300/0 conn(0x7f1f3c0c7dd0 0x7f1f3c158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:48.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.751+0000 7f1f3affd640 1 -- 172.21.15.88:0/3393383136 >> v2:172.21.15.148:3300/0 conn(0x7f1f3c0c7dd0 msgr2=0x7f1f3c158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:48.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.751+0000 7f1f3affd640 1 --2- 172.21.15.88:0/3393383136 >> v2:172.21.15.148:3300/0 conn(0x7f1f3c0c7dd0 0x7f1f3c158210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.751+0000 7f1f3affd640 1 -- 172.21.15.88:0/3393383136 >> v1:172.21.15.148:6789/0 conn(0x7f1f3c158750 legacy=0x7f1f3c14aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:48.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.751+0000 7f1f3affd640 1 -- 172.21.15.88:0/3393383136 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c154ac0 con 0x7f1f3c0ca3c0 2023-12-08T08:21:48.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.755+0000 7f1f3affd640 1 --2- 172.21.15.88:0/3393383136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f3c0ca3c0 0x7f1f3c154580 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c0a9780 tx=0x7f1f2c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76b70369f7a9c84 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:48.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.755+0000 7f1f39ffb640 1 -- 172.21.15.88:0/3393383136 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c0ab670 con 0x7f1f3c0ca3c0 2023-12-08T08:21:48.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.755+0000 7f1f39ffb640 1 -- 172.21.15.88:0/3393383136 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2c0ab7d0 con 0x7f1f3c0ca3c0 2023-12-08T08:21:48.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.755+0000 7f1f39ffb640 1 -- 172.21.15.88:0/3393383136 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c0abb60 con 0x7f1f3c0ca3c0 2023-12-08T08:21:48.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.755+0000 7f1f41494640 1 -- 172.21.15.88:0/3393383136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f3c0ca3c0 msgr2=0x7f1f3c154580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:48.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.755+0000 7f1f41494640 1 --2- 172.21.15.88:0/3393383136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f3c0ca3c0 0x7f1f3c154580 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c0a9780 tx=0x7f1f2c01c470 comp rx=0 tx=0).stop 2023-12-08T08:21:48.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.755+0000 7f1f41494640 1 -- 172.21.15.88:0/3393383136 shutdown_connections 2023-12-08T08:21:48.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.755+0000 7f1f41494640 1 --2- 172.21.15.88:0/3393383136 >> v2:172.21.15.148:3300/0 conn(0x7f1f3c0c7dd0 0x7f1f3c158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.755+0000 7f1f41494640 1 --2- 172.21.15.88:0/3393383136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f3c0ca3c0 0x7f1f3c154580 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.755+0000 7f1f41494640 1 -- 172.21.15.88:0/3393383136 >> 172.21.15.88:0/3393383136 conn(0x7f1f3c0666a0 msgr2=0x7f1f3c066ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:48.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.755+0000 7f1f41494640 1 -- 172.21.15.88:0/3393383136 shutdown_connections 2023-12-08T08:21:48.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.755+0000 7f1f41494640 1 -- 172.21.15.88:0/3393383136 wait complete. 2023-12-08T08:21:48.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.755+0000 7f1f41494640 1 Processor -- start 2023-12-08T08:21:48.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.755+0000 7f1f41494640 1 -- start start 2023-12-08T08:21:48.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.755+0000 7f1f41494640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f3c0c7dd0 0x7f1f3c0c3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:48.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.755+0000 7f1f41494640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f3c0ca3c0 0x7f1f3c14d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:48.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.755+0000 7f1f41494640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f3c158750 0x7f1f3c0c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:48.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.755+0000 7f1f41494640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c0c3d40 con 0x7f1f3c0ca3c0 2023-12-08T08:21:48.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.755+0000 7f1f41494640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c0c2710 con 0x7f1f3c158750 2023-12-08T08:21:48.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.755+0000 7f1f41494640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c148bf0 con 0x7f1f3c0c7dd0 2023-12-08T08:21:48.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.759+0000 7f1f3a7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f3c0ca3c0 0x7f1f3c14d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:48.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.759+0000 7f1f3a7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f3c0ca3c0 0x7f1f3c14d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57280/0 (socket says 172.21.15.88:57280) 2023-12-08T08:21:48.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.759+0000 7f1f3a7fc640 1 -- 172.21.15.88:0/976152586 learned_addr learned my addr 172.21.15.88:0/976152586 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:48.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.759+0000 7f1f3affd640 1 --2- 172.21.15.88:0/976152586 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f3c0c7dd0 0x7f1f3c0c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:48.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.759+0000 7f1f3b7fe640 1 --2- 172.21.15.88:0/976152586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f3c158750 0x7f1f3c0c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:48.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.759+0000 7f1f3a7fc640 1 -- 172.21.15.88:0/976152586 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f3c0c7dd0 msgr2=0x7f1f3c0c3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:48.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.759+0000 7f1f3a7fc640 1 --2- 172.21.15.88:0/976152586 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f3c0c7dd0 0x7f1f3c0c3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.759+0000 7f1f3a7fc640 1 -- 172.21.15.88:0/976152586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f3c158750 msgr2=0x7f1f3c0c0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:48.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.759+0000 7f1f3a7fc640 1 --2- 172.21.15.88:0/976152586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f3c158750 0x7f1f3c0c0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.759+0000 7f1f3a7fc640 1 -- 172.21.15.88:0/976152586 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2c0094d0 con 0x7f1f3c0ca3c0 2023-12-08T08:21:48.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.759+0000 7f1f3a7fc640 1 --2- 172.21.15.88:0/976152586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f3c0ca3c0 0x7f1f3c14d9d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1f3000e930 tx=0x7f1f3000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:48.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.759+0000 7f1f237fe640 1 -- 172.21.15.88:0/976152586 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f30009690 con 0x7f1f3c0ca3c0 2023-12-08T08:21:48.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.759+0000 7f1f237fe640 1 -- 172.21.15.88:0/976152586 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3000ca00 con 0x7f1f3c0ca3c0 2023-12-08T08:21:48.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.759+0000 7f1f237fe640 1 -- 172.21.15.88:0/976152586 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3000cd70 con 0x7f1f3c0ca3c0 2023-12-08T08:21:48.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.759+0000 7f1f41494640 1 -- 172.21.15.88:0/976152586 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f3c0bf920 con 0x7f1f3c0ca3c0 2023-12-08T08:21:48.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.759+0000 7f1f41494640 1 -- 172.21.15.88:0/976152586 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3c0bf2d0 con 0x7f1f3c0ca3c0 2023-12-08T08:21:48.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.759+0000 7f1f41494640 1 -- 172.21.15.88:0/976152586 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3c0bf130 con 0x7f1f3c0ca3c0 2023-12-08T08:21:48.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.759+0000 7f1f237fe640 1 -- 172.21.15.88:0/976152586 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1f30013470 con 0x7f1f3c0ca3c0 2023-12-08T08:21:48.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.759+0000 7f1f237fe640 1 --2- 172.21.15.88:0/976152586 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1f28066470 0x7f1f28068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:48.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.763+0000 7f1f237fe640 1 -- 172.21.15.88:0/976152586 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f1f30084240 con 0x7f1f3c0ca3c0 2023-12-08T08:21:48.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.763+0000 7f1f3affd640 1 --2- 172.21.15.88:0/976152586 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1f28066470 0x7f1f28068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:48.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.763+0000 7f1f3affd640 1 --2- 172.21.15.88:0/976152586 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1f28066470 0x7f1f28068930 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0af000 tx=0x7f1f2c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:48.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.767+0000 7f1f237fe640 1 -- 172.21.15.88:0/976152586 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1f3c0bf130 con 0x7f1f3c0ca3c0 2023-12-08T08:21:48.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.947+0000 7f1f41494640 1 -- 172.21.15.88:0/976152586 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f3c0bf130 con 0x7f1f3c0ca3c0 2023-12-08T08:21:48.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.947+0000 7f1f237fe640 1 -- 172.21.15.88:0/976152586 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f1f3c0bf130 con 0x7f1f3c0ca3c0 2023-12-08T08:21:48.953 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:48.953 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4978,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3372523869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3372523869},{"type":"v1","addr":"172.21.15.148:6834","nonce":3372523869}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4085245492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":4085245492},{"type":"v1","addr":"172.21.15.148:6835","nonce":4085245492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/957673221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":957673221},{"type":"v1","addr":"172.21.15.88:6837","nonce":957673221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:21:18.029250+0000","modified":"2023-12-08T08:21:21.056129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.88:6836/4274252181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":4274252181},{"type":"v1","addr":"172.21.15.88:6836","nonce":4274252181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-08T08:21:48.954 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 24 2023-12-08T08:21:48.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.951+0000 7f1f41494640 1 -- 172.21.15.88:0/976152586 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1f28066470 msgr2=0x7f1f28068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:48.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.951+0000 7f1f41494640 1 --2- 172.21.15.88:0/976152586 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1f28066470 0x7f1f28068930 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0af000 tx=0x7f1f2c0a7000 comp rx=0 tx=0).stop 2023-12-08T08:21:48.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.951+0000 7f1f41494640 1 -- 172.21.15.88:0/976152586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f3c0ca3c0 msgr2=0x7f1f3c14d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:48.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.951+0000 7f1f41494640 1 --2- 172.21.15.88:0/976152586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f3c0ca3c0 0x7f1f3c14d9d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1f3000e930 tx=0x7f1f3000edf0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.951+0000 7f1f41494640 1 -- 172.21.15.88:0/976152586 shutdown_connections 2023-12-08T08:21:48.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.951+0000 7f1f41494640 1 --2- 172.21.15.88:0/976152586 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1f28066470 0x7f1f28068930 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.951+0000 7f1f41494640 1 --2- 172.21.15.88:0/976152586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f3c158750 0x7f1f3c0c0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.951+0000 7f1f41494640 1 --2- 172.21.15.88:0/976152586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f3c0ca3c0 0x7f1f3c14d9d0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.951+0000 7f1f41494640 1 --2- 172.21.15.88:0/976152586 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1f3c0c7dd0 0x7f1f3c0c3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:48.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.951+0000 7f1f41494640 1 -- 172.21.15.88:0/976152586 >> 172.21.15.88:0/976152586 conn(0x7f1f3c0666a0 msgr2=0x7f1f3c156fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:48.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.951+0000 7f1f41494640 1 -- 172.21.15.88:0/976152586 shutdown_connections 2023-12-08T08:21:48.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:48.951+0000 7f1f41494640 1 -- 172.21.15.88:0/976152586 wait complete. 2023-12-08T08:21:48.974 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:21:49.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.107+0000 7f967853e640 1 Processor -- start 2023-12-08T08:21:49.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.107+0000 7f967853e640 1 -- start start 2023-12-08T08:21:49.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.107+0000 7f967853e640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9670071e30 0x7f96700722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:49.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.107+0000 7f967853e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9670156110 0x7f96701565a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:49.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.107+0000 7f967853e640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96700c5710 con 0x7f967014fd10 2023-12-08T08:21:49.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.107+0000 7f967853e640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f967006c5e0 con 0x7f9670071e30 2023-12-08T08:21:49.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.107+0000 7f967853e640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9670155c80 con 0x7f9670156110 2023-12-08T08:21:49.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.111+0000 7f9676adb640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9670156110 0x7f96701565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:49.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.111+0000 7f9675ad9640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9670071e30 0x7f96700722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:49.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.111+0000 7f9676adb640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9670156110 0x7f96701565a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:49424/0 (socket says 172.21.15.88:49424) 2023-12-08T08:21:49.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.111+0000 7f9676adb640 1 -- 172.21.15.88:0/2264754905 learned_addr learned my addr 172.21.15.88:0/2264754905 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:49.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.111+0000 7f9676adb640 1 -- 172.21.15.88:0/2264754905 >> v2:172.21.15.148:3300/0 conn(0x7f9670071e30 msgr2=0x7f96700722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:49.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.111+0000 7f9676adb640 1 --2- 172.21.15.88:0/2264754905 >> v2:172.21.15.148:3300/0 conn(0x7f9670071e30 0x7f96700722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:49.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.111+0000 7f9676adb640 1 -- 172.21.15.88:0/2264754905 >> v1:172.21.15.148:6789/0 conn(0x7f967014fd10 legacy=0x7f96700a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:49.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.111+0000 7f9676adb640 1 -- 172.21.15.88:0/2264754905 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96700c4e70 con 0x7f9670156110 2023-12-08T08:21:49.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.111+0000 7f9676adb640 1 --2- 172.21.15.88:0/2264754905 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9670156110 0x7f96701565a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9668009e50 tx=0x7f966801c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b84559e8c1128c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:49.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.111+0000 7f96752d8640 1 -- 172.21.15.88:0/2264754905 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96680a5780 con 0x7f9670156110 2023-12-08T08:21:49.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.111+0000 7f96752d8640 1 -- 172.21.15.88:0/2264754905 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96680a58e0 con 0x7f9670156110 2023-12-08T08:21:49.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.111+0000 7f96752d8640 1 -- 172.21.15.88:0/2264754905 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96680a5c70 con 0x7f9670156110 2023-12-08T08:21:49.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.115+0000 7f967853e640 1 -- 172.21.15.88:0/2264754905 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9670156110 msgr2=0x7f96701565a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:49.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.115+0000 7f967853e640 1 --2- 172.21.15.88:0/2264754905 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9670156110 0x7f96701565a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9668009e50 tx=0x7f966801c8c0 comp rx=0 tx=0).stop 2023-12-08T08:21:49.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.115+0000 7f967853e640 1 -- 172.21.15.88:0/2264754905 shutdown_connections 2023-12-08T08:21:49.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.115+0000 7f967853e640 1 --2- 172.21.15.88:0/2264754905 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9670156110 0x7f96701565a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:49.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.115+0000 7f967853e640 1 --2- 172.21.15.88:0/2264754905 >> v2:172.21.15.148:3300/0 conn(0x7f9670071e30 0x7f96700722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:49.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.115+0000 7f967853e640 1 -- 172.21.15.88:0/2264754905 >> 172.21.15.88:0/2264754905 conn(0x7f96700a7810 msgr2=0x7f96700a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:49.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.115+0000 7f967853e640 1 -- 172.21.15.88:0/2264754905 shutdown_connections 2023-12-08T08:21:49.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.115+0000 7f967853e640 1 -- 172.21.15.88:0/2264754905 wait complete. 2023-12-08T08:21:49.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.115+0000 7f967853e640 1 Processor -- start 2023-12-08T08:21:49.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.115+0000 7f967853e640 1 -- start start 2023-12-08T08:21:49.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.115+0000 7f967853e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9670071e30 0x7f96700a6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:49.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.115+0000 7f967853e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f967014fd10 0x7f9670149c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:49.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.115+0000 7f967853e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9670156110 0x7f967014a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:49.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.115+0000 7f967853e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967014a6f0 con 0x7f9670156110 2023-12-08T08:21:49.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.115+0000 7f967853e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96701eb4a0 con 0x7f967014fd10 2023-12-08T08:21:49.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.115+0000 7f967853e640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96701eb9d0 con 0x7f9670071e30 2023-12-08T08:21:49.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.115+0000 7f9676adb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9670156110 0x7f967014a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:49.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.115+0000 7f9676adb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9670156110 0x7f967014a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57284/0 (socket says 172.21.15.88:57284) 2023-12-08T08:21:49.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.115+0000 7f9676adb640 1 -- 172.21.15.88:0/850553025 learned_addr learned my addr 172.21.15.88:0/850553025 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:49.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.115+0000 7f96762da640 1 --2- 172.21.15.88:0/850553025 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9670071e30 0x7f96700a6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:49.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.115+0000 7f9675ad9640 1 --2- 172.21.15.88:0/850553025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f967014fd10 0x7f9670149c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:49.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.119+0000 7f9676adb640 1 -- 172.21.15.88:0/850553025 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9670071e30 msgr2=0x7f96700a6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:49.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.119+0000 7f9676adb640 1 --2- 172.21.15.88:0/850553025 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9670071e30 0x7f96700a6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:49.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.119+0000 7f9676adb640 1 -- 172.21.15.88:0/850553025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f967014fd10 msgr2=0x7f9670149c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:49.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.119+0000 7f9676adb640 1 --2- 172.21.15.88:0/850553025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f967014fd10 0x7f9670149c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:49.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.119+0000 7f9676adb640 1 -- 172.21.15.88:0/850553025 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9668009b30 con 0x7f9670156110 2023-12-08T08:21:49.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.119+0000 7f9676adb640 1 --2- 172.21.15.88:0/850553025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9670156110 0x7f967014a1b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f96680af040 tx=0x7f9668019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:49.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.119+0000 7f9666ffd640 1 -- 172.21.15.88:0/850553025 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96680b8640 con 0x7f9670156110 2023-12-08T08:21:49.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.119+0000 7f9666ffd640 1 -- 172.21.15.88:0/850553025 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96680b87a0 con 0x7f9670156110 2023-12-08T08:21:49.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.119+0000 7f9666ffd640 1 -- 172.21.15.88:0/850553025 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96680b8b50 con 0x7f9670156110 2023-12-08T08:21:49.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.119+0000 7f967853e640 1 -- 172.21.15.88:0/850553025 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96701eb6f0 con 0x7f9670156110 2023-12-08T08:21:49.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.119+0000 7f967853e640 1 -- 172.21.15.88:0/850553025 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96700c3280 con 0x7f9670156110 2023-12-08T08:21:49.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.119+0000 7f967853e640 1 -- 172.21.15.88:0/850553025 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9670072800 con 0x7f9670156110 2023-12-08T08:21:49.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.119+0000 7f9666ffd640 1 -- 172.21.15.88:0/850553025 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f96680b8cb0 con 0x7f9670156110 2023-12-08T08:21:49.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.119+0000 7f9666ffd640 1 --2- 172.21.15.88:0/850553025 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f96540664a0 0x7f9654068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:49.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.119+0000 7f9666ffd640 1 -- 172.21.15.88:0/850553025 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f966811e8a0 con 0x7f9670156110 2023-12-08T08:21:49.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.119+0000 7f96762da640 1 --2- 172.21.15.88:0/850553025 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f96540664a0 0x7f9654068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:49.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.123+0000 7f96762da640 1 --2- 172.21.15.88:0/850553025 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f96540664a0 0x7f9654068960 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f96700a7110 tx=0x7f966c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:49.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.123+0000 7f9666ffd640 1 -- 172.21.15.88:0/850553025 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f96680ebd70 con 0x7f9670156110 2023-12-08T08:21:49.201 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:21:49.205 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:21:49.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.275+0000 7f967853e640 1 -- 172.21.15.88:0/850553025 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96700c2de0 con 0x7f9670156110 2023-12-08T08:21:49.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.279+0000 7f9666ffd640 1 -- 172.21.15.88:0/850553025 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16620 (secure 0 0 0) 0x7f9668009510 con 0x7f9670156110 2023-12-08T08:21:49.283 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:49.283 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":38,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:21:45.969917+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:21:16.039054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:21:17.029894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6837/181654220":"2023-12-09T08:21:42.962792+0000","172.21.15.88:6835/181654220":"2023-12-09T08:21:42.962792+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:21:49.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.279+0000 7f967853e640 1 -- 172.21.15.88:0/850553025 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f96540664a0 msgr2=0x7f9654068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:49.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.279+0000 7f967853e640 1 --2- 172.21.15.88:0/850553025 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f96540664a0 0x7f9654068960 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f96700a7110 tx=0x7f966c009040 comp rx=0 tx=0).stop 2023-12-08T08:21:49.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.279+0000 7f967853e640 1 -- 172.21.15.88:0/850553025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9670156110 msgr2=0x7f967014a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:49.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.279+0000 7f967853e640 1 --2- 172.21.15.88:0/850553025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9670156110 0x7f967014a1b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f96680af040 tx=0x7f9668019660 comp rx=0 tx=0).stop 2023-12-08T08:21:49.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.279+0000 7f967853e640 1 -- 172.21.15.88:0/850553025 shutdown_connections 2023-12-08T08:21:49.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.279+0000 7f967853e640 1 --2- 172.21.15.88:0/850553025 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f96540664a0 0x7f9654068960 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:49.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.279+0000 7f967853e640 1 --2- 172.21.15.88:0/850553025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9670156110 0x7f967014a1b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:49.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.279+0000 7f967853e640 1 --2- 172.21.15.88:0/850553025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f967014fd10 0x7f9670149c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:49.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.279+0000 7f967853e640 1 --2- 172.21.15.88:0/850553025 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9670071e30 0x7f96700a6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:49.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.279+0000 7f967853e640 1 -- 172.21.15.88:0/850553025 >> 172.21.15.88:0/850553025 conn(0x7f96700a7810 msgr2=0x7f9670154850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:49.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.279+0000 7f967853e640 1 -- 172.21.15.88:0/850553025 shutdown_connections 2023-12-08T08:21:49.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.279+0000 7f967853e640 1 -- 172.21.15.88:0/850553025 wait complete. 2023-12-08T08:21:49.304 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-12-08T08:21:49.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.479+0000 7f58d6fdf640 1 Processor -- start 2023-12-08T08:21:49.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.479+0000 7f58d6fdf640 1 -- start start 2023-12-08T08:21:49.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.479+0000 7f58d6fdf640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f58d00c47b0 0x7f58d00c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:49.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.479+0000 7f58d6fdf640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d00c6840 con 0x7f58d00bd550 2023-12-08T08:21:49.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.479+0000 7f58d6fdf640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d0158a00 con 0x7f58d0155950 2023-12-08T08:21:49.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.479+0000 7f58d6fdf640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d00af870 con 0x7f58d00c47b0 2023-12-08T08:21:49.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.479+0000 7f58c7fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f58d00bd550 0x7f58d0154ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41386/0 (socket says 172.21.15.88:41386) 2023-12-08T08:21:49.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.479+0000 7f58c7fff640 1 -- 172.21.15.88:0/3686521716 learned_addr learned my addr 172.21.15.88:0/3686521716 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:49.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.479+0000 7f58d4d7b640 1 --2- 172.21.15.88:0/3686521716 >> v2:172.21.15.148:3300/0 conn(0x7f58d00c47b0 0x7f58d00c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:49.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.479+0000 7f58c77fe640 1 -- 172.21.15.88:0/3686521716 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4018322830 0 0) 0x7f58d00c6840 con 0x7f58d00bd550 2023-12-08T08:21:49.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.479+0000 7f58c77fe640 1 -- 172.21.15.88:0/3686521716 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58b8003530 con 0x7f58d00bd550 2023-12-08T08:21:49.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.479+0000 7f58c77fe640 1 -- 172.21.15.88:0/3686521716 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1299690674 0 0) 0x7f58b8003530 con 0x7f58d00bd550 2023-12-08T08:21:49.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.479+0000 7f58c77fe640 1 -- 172.21.15.88:0/3686521716 >> v2:172.21.15.148:3300/0 conn(0x7f58d00c47b0 msgr2=0x7f58d00c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:49.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.479+0000 7f58c77fe640 1 --2- 172.21.15.88:0/3686521716 >> v2:172.21.15.148:3300/0 conn(0x7f58d00c47b0 0x7f58d00c4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:49.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.479+0000 7f58c77fe640 1 -- 172.21.15.88:0/3686521716 >> v1:172.21.15.148:6789/0 conn(0x7f58d0155950 legacy=0x7f58d01582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:49.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.479+0000 7f58c77fe640 1 -- 172.21.15.88:0/3686521716 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d00c6a70 con 0x7f58d00bd550 2023-12-08T08:21:49.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.479+0000 7f58c77fe640 1 -- 172.21.15.88:0/3686521716 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f58c0001680 con 0x7f58d00bd550 2023-12-08T08:21:49.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.479+0000 7f58c77fe640 1 -- 172.21.15.88:0/3686521716 >> v1:172.21.15.88:6789/0 conn(0x7f58d00bd550 legacy=0x7f58d0154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:49.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.479+0000 7f58c77fe640 1 --2- 172.21.15.88:0/3686521716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58b8003980 0x7f58b8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:49.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.479+0000 7f58c77fe640 1 --2- 172.21.15.88:0/3686521716 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58b80047d0 0x7f58b8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:49.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.479+0000 7f58c77fe640 1 --2- 172.21.15.88:0/3686521716 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58b8005190 0x7f58b800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:49.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.479+0000 7f58c77fe640 1 -- 172.21.15.88:0/3686521716 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d00af870 con 0x7f58b8003980 2023-12-08T08:21:49.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.479+0000 7f58c77fe640 1 -- 172.21.15.88:0/3686521716 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b800c130 con 0x7f58b8005190 2023-12-08T08:21:49.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.479+0000 7f58c77fe640 1 -- 172.21.15.88:0/3686521716 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b800c2f0 con 0x7f58b80047d0 2023-12-08T08:21:49.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.483+0000 7f58d4d7b640 1 --2- 172.21.15.88:0/3686521716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58b8003980 0x7f58b8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:49.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.483+0000 7f58d557c640 1 --2- 172.21.15.88:0/3686521716 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58b8005190 0x7f58b800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:49.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.483+0000 7f58c7fff640 1 --2- 172.21.15.88:0/3686521716 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58b80047d0 0x7f58b8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:49.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.483+0000 7f58d4d7b640 1 -- 172.21.15.88:0/3686521716 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58b80047d0 msgr2=0x7f58b8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:49.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.483+0000 7f58d4d7b640 1 --2- 172.21.15.88:0/3686521716 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58b80047d0 0x7f58b8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:49.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.483+0000 7f58d4d7b640 1 -- 172.21.15.88:0/3686521716 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58b8005190 msgr2=0x7f58b800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:49.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.483+0000 7f58d4d7b640 1 --2- 172.21.15.88:0/3686521716 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58b8005190 0x7f58b800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:49.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.483+0000 7f58d557c640 1 -- 172.21.15.88:0/3686521716 reap_dead start 2023-12-08T08:21:49.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.483+0000 7f58d4d7b640 1 -- 172.21.15.88:0/3686521716 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b8003530 con 0x7f58b8003980 2023-12-08T08:21:49.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.483+0000 7f58d4d7b640 1 --2- 172.21.15.88:0/3686521716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58b8003980 0x7f58b8003da0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f58cc009ae0 tx=0x7f58cc01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e2f2b1dfcebac6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:49.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.483+0000 7f58c77fe640 1 -- 172.21.15.88:0/3686521716 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc0a5530 con 0x7f58b8003980 2023-12-08T08:21:49.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.483+0000 7f58c77fe640 1 -- 172.21.15.88:0/3686521716 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58cc0a5690 con 0x7f58b8003980 2023-12-08T08:21:49.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.483+0000 7f58c77fe640 1 -- 172.21.15.88:0/3686521716 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc0a5a40 con 0x7f58b8003980 2023-12-08T08:21:49.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.483+0000 7f58d6fdf640 1 -- 172.21.15.88:0/3686521716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58b8003980 msgr2=0x7f58b8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:49.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.483+0000 7f58d6fdf640 1 --2- 172.21.15.88:0/3686521716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58b8003980 0x7f58b8003da0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f58cc009ae0 tx=0x7f58cc01ca50 comp rx=0 tx=0).stop 2023-12-08T08:21:49.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.487+0000 7f58d6fdf640 1 -- 172.21.15.88:0/3686521716 shutdown_connections 2023-12-08T08:21:49.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.487+0000 7f58d6fdf640 1 --2- 172.21.15.88:0/3686521716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58b8003980 0x7f58b8003da0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:49.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.487+0000 7f58d6fdf640 1 -- 172.21.15.88:0/3686521716 >> 172.21.15.88:0/3686521716 conn(0x7f58d00aba00 msgr2=0x7f58d00abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:49.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.487+0000 7f58d6fdf640 1 -- 172.21.15.88:0/3686521716 shutdown_connections 2023-12-08T08:21:49.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.487+0000 7f58d6fdf640 1 -- 172.21.15.88:0/3686521716 wait complete. 2023-12-08T08:21:49.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.487+0000 7f58d6fdf640 1 Processor -- start 2023-12-08T08:21:49.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.487+0000 7f58d6fdf640 1 -- start start 2023-12-08T08:21:49.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.487+0000 7f58d6fdf640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58b8003980 0x7f58d01546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:49.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.487+0000 7f58d6fdf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58d014e010 0x7f58d01f0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:49.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.487+0000 7f58d6fdf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d014c1f0 0x7f58d01f1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:49.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.487+0000 7f58d6fdf640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d01f1690 con 0x7f58d014e010 2023-12-08T08:21:49.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.487+0000 7f58d6fdf640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d014bca0 con 0x7f58d014c1f0 2023-12-08T08:21:49.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.487+0000 7f58d6fdf640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d00c0130 con 0x7f58b8003980 2023-12-08T08:21:49.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.487+0000 7f58c7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58d014e010 0x7f58d01f0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:49.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.487+0000 7f58c7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58d014e010 0x7f58d01f0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57302/0 (socket says 172.21.15.88:57302) 2023-12-08T08:21:49.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.487+0000 7f58c7fff640 1 -- 172.21.15.88:0/995433505 learned_addr learned my addr 172.21.15.88:0/995433505 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:49.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.487+0000 7f58d4d7b640 1 --2- 172.21.15.88:0/995433505 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58b8003980 0x7f58d01546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:49.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.487+0000 7f58d557c640 1 --2- 172.21.15.88:0/995433505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d014c1f0 0x7f58d01f1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:49.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.487+0000 7f58c7fff640 1 -- 172.21.15.88:0/995433505 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58b8003980 msgr2=0x7f58d01546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.487+0000 7f58c7fff640 1 --2- 172.21.15.88:0/995433505 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58b8003980 0x7f58d01546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.487+0000 7f58c7fff640 1 -- 172.21.15.88:0/995433505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d014c1f0 msgr2=0x7f58d01f1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.487+0000 7f58c7fff640 1 --2- 172.21.15.88:0/995433505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d014c1f0 0x7f58d01f1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.487+0000 7f58c7fff640 1 -- 172.21.15.88:0/995433505 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d00c0410 con 0x7f58d014e010 2023-12-08T08:21:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.487+0000 7f58d557c640 1 --2- 172.21.15.88:0/995433505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d014c1f0 0x7f58d01f1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.491+0000 7f58c7fff640 1 --2- 172.21.15.88:0/995433505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58d014e010 0x7f58d01f0c10 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f58c0001b60 tx=0x7f58c000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.491+0000 7f58c57fa640 1 -- 172.21.15.88:0/995433505 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c000ee60 con 0x7f58d014e010 2023-12-08T08:21:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.491+0000 7f58c57fa640 1 -- 172.21.15.88:0/995433505 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c000c8d0 con 0x7f58d014e010 2023-12-08T08:21:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.491+0000 7f58c57fa640 1 -- 172.21.15.88:0/995433505 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c000cc60 con 0x7f58d014e010 2023-12-08T08:21:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.491+0000 7f58d6fdf640 1 -- 172.21.15.88:0/995433505 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d00c06f0 con 0x7f58d014e010 2023-12-08T08:21:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.491+0000 7f58d6fdf640 1 -- 172.21.15.88:0/995433505 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d014e940 con 0x7f58d014e010 2023-12-08T08:21:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.491+0000 7f58d6fdf640 1 -- 172.21.15.88:0/995433505 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d01f0930 con 0x7f58d014e010 2023-12-08T08:21:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.491+0000 7f58c57fa640 1 -- 172.21.15.88:0/995433505 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f58c001d460 con 0x7f58d014e010 2023-12-08T08:21:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.491+0000 7f58c57fa640 1 --2- 172.21.15.88:0/995433505 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f58bc066470 0x7f58bc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.491+0000 7f58c57fa640 1 -- 172.21.15.88:0/995433505 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f58c0083de0 con 0x7f58d014e010 2023-12-08T08:21:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.491+0000 7f58d4d7b640 1 --2- 172.21.15.88:0/995433505 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f58bc066470 0x7f58bc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.491+0000 7f58d4d7b640 1 --2- 172.21.15.88:0/995433505 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f58bc066470 0x7f58bc068930 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f58cc0af000 tx=0x7f58cc0046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:49.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.495+0000 7f58c57fa640 1 -- 172.21.15.88:0/995433505 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f58d01f0930 con 0x7f58d014e010 2023-12-08T08:21:49.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.675+0000 7f58d6fdf640 1 -- 172.21.15.88:0/995433505 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f58d01f0930 con 0x7f58d014e010 2023-12-08T08:21:49.682 INFO:tasks.ceph.mon.a.smithi088.stderr:2023-12-08T08:21:49.679+0000 7f9f56907640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-08T08:21:49.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.679+0000 7f58c57fa640 1 -- 172.21.15.88:0/995433505 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 163+0+0 (secure 0 0 0) 0x7f58d01f0930 con 0x7f58d014e010 2023-12-08T08:21:49.685 INFO:teuthology.orchestra.run.smithi088.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-08T08:21:49.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.683+0000 7f58d6fdf640 1 -- 172.21.15.88:0/995433505 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f58bc066470 msgr2=0x7f58bc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:49.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.683+0000 7f58d6fdf640 1 --2- 172.21.15.88:0/995433505 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f58bc066470 0x7f58bc068930 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f58cc0af000 tx=0x7f58cc0046d0 comp rx=0 tx=0).stop 2023-12-08T08:21:49.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.683+0000 7f58d6fdf640 1 -- 172.21.15.88:0/995433505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58d014e010 msgr2=0x7f58d01f0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:49.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.683+0000 7f58d6fdf640 1 --2- 172.21.15.88:0/995433505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58d014e010 0x7f58d01f0c10 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f58c0001b60 tx=0x7f58c000ec10 comp rx=0 tx=0).stop 2023-12-08T08:21:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.683+0000 7f58d6fdf640 1 -- 172.21.15.88:0/995433505 shutdown_connections 2023-12-08T08:21:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.683+0000 7f58d6fdf640 1 --2- 172.21.15.88:0/995433505 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f58bc066470 0x7f58bc068930 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.683+0000 7f58d6fdf640 1 --2- 172.21.15.88:0/995433505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d014c1f0 0x7f58d01f1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.683+0000 7f58d6fdf640 1 --2- 172.21.15.88:0/995433505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58d014e010 0x7f58d01f0c10 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.683+0000 7f58d6fdf640 1 --2- 172.21.15.88:0/995433505 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f58b8003980 0x7f58d01546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:49.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.683+0000 7f58d6fdf640 1 -- 172.21.15.88:0/995433505 >> 172.21.15.88:0/995433505 conn(0x7f58d00aba00 msgr2=0x7f58d0153770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:49.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.683+0000 7f58d6fdf640 1 -- 172.21.15.88:0/995433505 shutdown_connections 2023-12-08T08:21:49.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.683+0000 7f58d6fdf640 1 -- 172.21.15.88:0/995433505 wait complete. 2023-12-08T08:21:49.693 INFO:tasks.ceph.mds.c.smithi088.stderr: -2187> 2023-12-08T08:21:20.656+0000 7f74acf06640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:21:49.709 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-12-08T08:21:49.738 INFO:tasks.ceph.mds.c.smithi088.stdout:starting mds.c at 2023-12-08T08:21:49.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.847+0000 7fd0e1cd6640 1 Processor -- start 2023-12-08T08:21:49.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.847+0000 7fd0e1cd6640 1 -- start start 2023-12-08T08:21:49.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.847+0000 7fd0e1cd6640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd0dc0c83d0 0x7fd0dc0c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:49.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.847+0000 7fd0e1cd6640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0dc0c92e0 0x7fd0dc15eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:49.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.847+0000 7fd0e1cd6640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0dc155400 con 0x7fd0dc0c47e0 2023-12-08T08:21:49.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.847+0000 7fd0e1cd6640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0dc0c5830 con 0x7fd0dc0c83d0 2023-12-08T08:21:49.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.847+0000 7fd0e1cd6640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc154620 con 0x7fd0dc0c92e0 2023-12-08T08:21:49.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.847+0000 7fd0daffd640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd0dc0c83d0 0x7fd0dc0c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:49.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.847+0000 7fd0dbfff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0dc0c92e0 0x7fd0dc15eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:49.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.847+0000 7fd0dbfff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0dc0c92e0 0x7fd0dc15eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:49480/0 (socket says 172.21.15.88:49480) 2023-12-08T08:21:49.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.847+0000 7fd0dbfff640 1 -- 172.21.15.88:0/1868982092 learned_addr learned my addr 172.21.15.88:0/1868982092 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:49.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.847+0000 7fd0daffd640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd0dc0c83d0 0x7fd0dc0c4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:37550/0 (socket says 172.21.15.88:37550) 2023-12-08T08:21:49.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.847+0000 7fd0dbfff640 1 -- 172.21.15.88:0/1868982092 >> v2:172.21.15.148:3300/0 conn(0x7fd0dc0c83d0 msgr2=0x7fd0dc0c4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:49.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.847+0000 7fd0dbfff640 1 --2- 172.21.15.88:0/1868982092 >> v2:172.21.15.148:3300/0 conn(0x7fd0dc0c83d0 0x7fd0dc0c4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:49.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.847+0000 7fd0dbfff640 1 -- 172.21.15.88:0/1868982092 >> v1:172.21.15.148:6789/0 conn(0x7fd0dc0c47e0 legacy=0x7fd0dc0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:49.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.847+0000 7fd0da7fc640 1 -- 172.21.15.88:0/1868982092 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2656804570 0 0) 0x7fd0dc155400 con 0x7fd0dc0c47e0 2023-12-08T08:21:49.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.847+0000 7fd0dbfff640 1 -- 172.21.15.88:0/1868982092 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0dc154830 con 0x7fd0dc0c92e0 2023-12-08T08:21:49.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.851+0000 7fd0dbfff640 1 --2- 172.21.15.88:0/1868982092 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0dc0c92e0 0x7fd0dc15eec0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009e50 tx=0x7fd0d401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93421ecfe6e3bab8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:49.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.851+0000 7fd0da7fc640 1 -- 172.21.15.88:0/1868982092 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d40a5720 con 0x7fd0dc0c92e0 2023-12-08T08:21:49.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.851+0000 7fd0da7fc640 1 -- 172.21.15.88:0/1868982092 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d40a5880 con 0x7fd0dc0c92e0 2023-12-08T08:21:49.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.851+0000 7fd0da7fc640 1 -- 172.21.15.88:0/1868982092 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d40a5c10 con 0x7fd0dc0c92e0 2023-12-08T08:21:49.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.851+0000 7fd0e1cd6640 1 -- 172.21.15.88:0/1868982092 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0dc0c92e0 msgr2=0x7fd0dc15eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:49.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.851+0000 7fd0e1cd6640 1 --2- 172.21.15.88:0/1868982092 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0dc0c92e0 0x7fd0dc15eec0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009e50 tx=0x7fd0d401c950 comp rx=0 tx=0).stop 2023-12-08T08:21:49.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.851+0000 7fd0e1cd6640 1 -- 172.21.15.88:0/1868982092 shutdown_connections 2023-12-08T08:21:49.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.851+0000 7fd0e1cd6640 1 --2- 172.21.15.88:0/1868982092 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0dc0c92e0 0x7fd0dc15eec0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:49.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.851+0000 7fd0e1cd6640 1 --2- 172.21.15.88:0/1868982092 >> v2:172.21.15.148:3300/0 conn(0x7fd0dc0c83d0 0x7fd0dc0c4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:49.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.851+0000 7fd0e1cd6640 1 -- 172.21.15.88:0/1868982092 >> 172.21.15.88:0/1868982092 conn(0x7fd0dc0ab920 msgr2=0x7fd0dc0abd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:49.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.851+0000 7fd0e1cd6640 1 -- 172.21.15.88:0/1868982092 shutdown_connections 2023-12-08T08:21:49.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.851+0000 7fd0e1cd6640 1 -- 172.21.15.88:0/1868982092 wait complete. 2023-12-08T08:21:49.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.855+0000 7fd0e1cd6640 1 Processor -- start 2023-12-08T08:21:49.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.855+0000 7fd0e1cd6640 1 -- start start 2023-12-08T08:21:49.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.855+0000 7fd0e1cd6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0dc0c47e0 0x7fd0dc145950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:49.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.855+0000 7fd0e1cd6640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0dc0c83d0 0x7fd0dc147d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:49.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.855+0000 7fd0e1cd6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0dc0c92e0 0x7fd0dc1579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:49.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.855+0000 7fd0e1cd6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc156490 con 0x7fd0dc0c92e0 2023-12-08T08:21:49.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.855+0000 7fd0e1cd6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc157570 con 0x7fd0dc0c47e0 2023-12-08T08:21:49.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.855+0000 7fd0e1cd6640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc1560d0 con 0x7fd0dc0c83d0 2023-12-08T08:21:49.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.855+0000 7fd0dbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0dc0c92e0 0x7fd0dc1579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:49.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.855+0000 7fd0dbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0dc0c92e0 0x7fd0dc1579e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57332/0 (socket says 172.21.15.88:57332) 2023-12-08T08:21:49.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.855+0000 7fd0dbfff640 1 -- 172.21.15.88:0/1005725443 learned_addr learned my addr 172.21.15.88:0/1005725443 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:49.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.855+0000 7fd0db7fe640 1 --2- 172.21.15.88:0/1005725443 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0dc0c47e0 0x7fd0dc145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:49.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.855+0000 7fd0daffd640 1 --2- 172.21.15.88:0/1005725443 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0dc0c83d0 0x7fd0dc147d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:49.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.855+0000 7fd0dbfff640 1 -- 172.21.15.88:0/1005725443 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0dc0c83d0 msgr2=0x7fd0dc147d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:49.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.855+0000 7fd0dbfff640 1 --2- 172.21.15.88:0/1005725443 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0dc0c83d0 0x7fd0dc147d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:49.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.855+0000 7fd0dbfff640 1 -- 172.21.15.88:0/1005725443 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0dc0c47e0 msgr2=0x7fd0dc145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:49.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.855+0000 7fd0dbfff640 1 --2- 172.21.15.88:0/1005725443 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0dc0c47e0 0x7fd0dc145950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:49.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.855+0000 7fd0dbfff640 1 -- 172.21.15.88:0/1005725443 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d4009b30 con 0x7fd0dc0c92e0 2023-12-08T08:21:49.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.855+0000 7fd0dbfff640 1 --2- 172.21.15.88:0/1005725443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0dc0c92e0 0x7fd0dc1579e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40af040 tx=0x7fd0d40196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:49.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.855+0000 7fd0c3fff640 1 -- 172.21.15.88:0/1005725443 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d40b8670 con 0x7fd0dc0c92e0 2023-12-08T08:21:49.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.855+0000 7fd0c3fff640 1 -- 172.21.15.88:0/1005725443 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d40b87d0 con 0x7fd0dc0c92e0 2023-12-08T08:21:49.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.855+0000 7fd0c3fff640 1 -- 172.21.15.88:0/1005725443 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d40b8b60 con 0x7fd0dc0c92e0 2023-12-08T08:21:49.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.855+0000 7fd0e1cd6640 1 -- 172.21.15.88:0/1005725443 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0dc1515f0 con 0x7fd0dc0c92e0 2023-12-08T08:21:49.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.855+0000 7fd0e1cd6640 1 -- 172.21.15.88:0/1005725443 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0dc1f07c0 con 0x7fd0dc0c92e0 2023-12-08T08:21:49.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.859+0000 7fd0e1cd6640 1 -- 172.21.15.88:0/1005725443 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0dc1576e0 con 0x7fd0dc0c92e0 2023-12-08T08:21:49.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.859+0000 7fd0c3fff640 1 -- 172.21.15.88:0/1005725443 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd0d40b8cc0 con 0x7fd0dc0c92e0 2023-12-08T08:21:49.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.859+0000 7fd0c3fff640 1 --2- 172.21.15.88:0/1005725443 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd0c80664a0 0x7fd0c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:49.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.859+0000 7fd0c3fff640 1 -- 172.21.15.88:0/1005725443 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5885+0+0 (secure 0 0 0) 0x7fd0d411f2a0 con 0x7fd0dc0c92e0 2023-12-08T08:21:49.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.859+0000 7fd0db7fe640 1 --2- 172.21.15.88:0/1005725443 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd0c80664a0 0x7fd0c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:49.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.859+0000 7fd0db7fe640 1 --2- 172.21.15.88:0/1005725443 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd0c80664a0 0x7fd0c8068960 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc000f70 tx=0x7fd0cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:49.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:49.863+0000 7fd0c3fff640 1 -- 172.21.15.88:0/1005725443 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd0d40ec710 con 0x7fd0dc0c92e0 2023-12-08T08:21:50.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.043+0000 7fd0e1cd6640 1 -- 172.21.15.88:0/1005725443 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd0dc067630 con 0x7fd0dc0c92e0 2023-12-08T08:21:50.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.683+0000 7fd0c3fff640 1 -- 172.21.15.88:0/1005725443 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 105+0+0 (secure 0 0 0) 0x7fd0d4009510 con 0x7fd0dc0c92e0 2023-12-08T08:21:50.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.687+0000 7fd0e1cd6640 1 -- 172.21.15.88:0/1005725443 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd0c80664a0 msgr2=0x7fd0c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:50.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.687+0000 7fd0e1cd6640 1 --2- 172.21.15.88:0/1005725443 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd0c80664a0 0x7fd0c8068960 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc000f70 tx=0x7fd0cc009040 comp rx=0 tx=0).stop 2023-12-08T08:21:50.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.687+0000 7fd0e1cd6640 1 -- 172.21.15.88:0/1005725443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0dc0c92e0 msgr2=0x7fd0dc1579e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:50.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.687+0000 7fd0e1cd6640 1 --2- 172.21.15.88:0/1005725443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0dc0c92e0 0x7fd0dc1579e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40af040 tx=0x7fd0d40196f0 comp rx=0 tx=0).stop 2023-12-08T08:21:50.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.687+0000 7fd0e1cd6640 1 -- 172.21.15.88:0/1005725443 shutdown_connections 2023-12-08T08:21:50.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.687+0000 7fd0e1cd6640 1 --2- 172.21.15.88:0/1005725443 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd0c80664a0 0x7fd0c8068960 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:50.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.687+0000 7fd0e1cd6640 1 --2- 172.21.15.88:0/1005725443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0dc0c92e0 0x7fd0dc1579e0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:50.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.687+0000 7fd0e1cd6640 1 --2- 172.21.15.88:0/1005725443 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0dc0c83d0 0x7fd0dc147d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:50.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.687+0000 7fd0e1cd6640 1 --2- 172.21.15.88:0/1005725443 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0dc0c47e0 0x7fd0dc145950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:50.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.687+0000 7fd0e1cd6640 1 -- 172.21.15.88:0/1005725443 >> 172.21.15.88:0/1005725443 conn(0x7fd0dc0ab920 msgr2=0x7fd0dc06b960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:50.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.687+0000 7fd0e1cd6640 1 -- 172.21.15.88:0/1005725443 shutdown_connections 2023-12-08T08:21:50.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.687+0000 7fd0e1cd6640 1 -- 172.21.15.88:0/1005725443 wait complete. 2023-12-08T08:21:50.712 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-12-08T08:21:50.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.895+0000 7f0a74f01640 1 Processor -- start 2023-12-08T08:21:50.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.895+0000 7f0a74f01640 1 -- start start 2023-12-08T08:21:50.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.895+0000 7f0a74f01640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0a7014b1e0 0x7f0a700c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:50.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.895+0000 7f0a74f01640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a700c5300 0x7f0a700a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:50.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.895+0000 7f0a74f01640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a700a4e20 con 0x7f0a70151280 2023-12-08T08:21:50.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.895+0000 7f0a74f01640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a701558d0 con 0x7f0a7014b1e0 2023-12-08T08:21:50.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.895+0000 7f0a74f01640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a700a50e0 con 0x7f0a700c5300 2023-12-08T08:21:50.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.895+0000 7f0a6e59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0a7014b1e0 0x7f0a700c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:50.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.899+0000 7f0a6e59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0a7014b1e0 0x7f0a700c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42484/0 (socket says 172.21.15.88:42484) 2023-12-08T08:21:50.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.899+0000 7f0a6e59c640 1 -- 172.21.15.88:0/3718109077 learned_addr learned my addr 172.21.15.88:0/3718109077 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:50.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.899+0000 7f0a65d9b640 1 --2- 172.21.15.88:0/3718109077 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a700c5300 0x7f0a700a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:50.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.899+0000 7f0a6e59c640 1 -- 172.21.15.88:0/3718109077 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a700c5300 msgr2=0x7f0a700a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:50.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.899+0000 7f0a6e59c640 1 --2- 172.21.15.88:0/3718109077 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a700c5300 0x7f0a700a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:50.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.899+0000 7f0a6e59c640 1 -- 172.21.15.88:0/3718109077 >> v1:172.21.15.148:6789/0 conn(0x7f0a70151280 legacy=0x7f0a70151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:50.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.899+0000 7f0a6e59c640 1 -- 172.21.15.88:0/3718109077 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a700c0f00 con 0x7f0a7014b1e0 2023-12-08T08:21:50.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.899+0000 7f0a6e59c640 1 --2- 172.21.15.88:0/3718109077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a7014b1e0 0x7f0a700c1700 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0a60009870 tx=0x7f0a6001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5b245b49f5b284 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:50.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.899+0000 7f0a6dd9b640 1 -- 172.21.15.88:0/3718109077 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a600ab650 con 0x7f0a7014b1e0 2023-12-08T08:21:50.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.899+0000 7f0a6dd9b640 1 -- 172.21.15.88:0/3718109077 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a600ab7b0 con 0x7f0a7014b1e0 2023-12-08T08:21:50.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.899+0000 7f0a6dd9b640 1 -- 172.21.15.88:0/3718109077 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a600abb40 con 0x7f0a7014b1e0 2023-12-08T08:21:50.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.899+0000 7f0a74f01640 1 -- 172.21.15.88:0/3718109077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a7014b1e0 msgr2=0x7f0a700c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:50.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.899+0000 7f0a74f01640 1 --2- 172.21.15.88:0/3718109077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a7014b1e0 0x7f0a700c1700 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0a60009870 tx=0x7f0a6001c540 comp rx=0 tx=0).stop 2023-12-08T08:21:50.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.903+0000 7f0a74f01640 1 -- 172.21.15.88:0/3718109077 shutdown_connections 2023-12-08T08:21:50.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.903+0000 7f0a74f01640 1 --2- 172.21.15.88:0/3718109077 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a700c5300 0x7f0a700a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:50.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.903+0000 7f0a74f01640 1 --2- 172.21.15.88:0/3718109077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a7014b1e0 0x7f0a700c1700 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:50.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.903+0000 7f0a74f01640 1 -- 172.21.15.88:0/3718109077 >> 172.21.15.88:0/3718109077 conn(0x7f0a700c59f0 msgr2=0x7f0a700c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:50.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.903+0000 7f0a74f01640 1 -- 172.21.15.88:0/3718109077 shutdown_connections 2023-12-08T08:21:50.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.903+0000 7f0a74f01640 1 -- 172.21.15.88:0/3718109077 wait complete. 2023-12-08T08:21:50.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.903+0000 7f0a74f01640 1 Processor -- start 2023-12-08T08:21:50.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.903+0000 7f0a74f01640 1 -- start start 2023-12-08T08:21:50.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.903+0000 7f0a74f01640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a700c5300 0x7f0a70142b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:50.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.903+0000 7f0a74f01640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a7014b1e0 0x7f0a70143080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:50.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.903+0000 7f0a74f01640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a70151280 0x7f0a701ee4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:50.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.903+0000 7f0a74f01640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a70154da0 con 0x7f0a700c5300 2023-12-08T08:21:50.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.903+0000 7f0a74f01640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a701556e0 con 0x7f0a70151280 2023-12-08T08:21:50.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.903+0000 7f0a74f01640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a701435c0 con 0x7f0a7014b1e0 2023-12-08T08:21:50.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.903+0000 7f0a6e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a700c5300 0x7f0a70142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:50.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.903+0000 7f0a6e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a700c5300 0x7f0a70142b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42492/0 (socket says 172.21.15.88:42492) 2023-12-08T08:21:50.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.903+0000 7f0a6e59c640 1 -- 172.21.15.88:0/4280315989 learned_addr learned my addr 172.21.15.88:0/4280315989 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:50.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.903+0000 7f0a65d9b640 1 --2- 172.21.15.88:0/4280315989 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a7014b1e0 0x7f0a70143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:50.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.903+0000 7f0a6ed9d640 1 --2- 172.21.15.88:0/4280315989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a70151280 0x7f0a701ee4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:50.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.903+0000 7f0a6e59c640 1 -- 172.21.15.88:0/4280315989 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a7014b1e0 msgr2=0x7f0a70143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:50.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.903+0000 7f0a6e59c640 1 --2- 172.21.15.88:0/4280315989 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a7014b1e0 0x7f0a70143080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:50.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.903+0000 7f0a6e59c640 1 -- 172.21.15.88:0/4280315989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a70151280 msgr2=0x7f0a701ee4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:50.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.903+0000 7f0a6e59c640 1 --2- 172.21.15.88:0/4280315989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a70151280 0x7f0a701ee4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:50.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.903+0000 7f0a6e59c640 1 -- 172.21.15.88:0/4280315989 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a600094d0 con 0x7f0a700c5300 2023-12-08T08:21:50.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.907+0000 7f0a6e59c640 1 --2- 172.21.15.88:0/4280315989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a700c5300 0x7f0a70142b40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f0a600ad040 tx=0x7f0a6001ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:50.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.907+0000 7f0a677fe640 1 -- 172.21.15.88:0/4280315989 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a600b4800 con 0x7f0a700c5300 2023-12-08T08:21:50.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.907+0000 7f0a677fe640 1 -- 172.21.15.88:0/4280315989 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a600b4960 con 0x7f0a700c5300 2023-12-08T08:21:50.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.907+0000 7f0a677fe640 1 -- 172.21.15.88:0/4280315989 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a600b4d10 con 0x7f0a700c5300 2023-12-08T08:21:50.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.907+0000 7f0a74f01640 1 -- 172.21.15.88:0/4280315989 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a70153310 con 0x7f0a700c5300 2023-12-08T08:21:50.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.907+0000 7f0a74f01640 1 -- 172.21.15.88:0/4280315989 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a70155400 con 0x7f0a700c5300 2023-12-08T08:21:50.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.907+0000 7f0a74f01640 1 -- 172.21.15.88:0/4280315989 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a700aba60 con 0x7f0a700c5300 2023-12-08T08:21:50.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.907+0000 7f0a677fe640 1 -- 172.21.15.88:0/4280315989 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0a600b3380 con 0x7f0a700c5300 2023-12-08T08:21:50.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.907+0000 7f0a677fe640 1 --2- 172.21.15.88:0/4280315989 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0a50066470 0x7f0a50068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:50.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.907+0000 7f0a677fe640 1 -- 172.21.15.88:0/4280315989 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f0a6011eb80 con 0x7f0a700c5300 2023-12-08T08:21:50.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.907+0000 7f0a65d9b640 1 --2- 172.21.15.88:0/4280315989 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0a50066470 0x7f0a50068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:50.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.911+0000 7f0a65d9b640 1 --2- 172.21.15.88:0/4280315989 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0a50066470 0x7f0a50068930 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0a70150f30 tx=0x7f0a58008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:50.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:50.911+0000 7f0a677fe640 1 -- 172.21.15.88:0/4280315989 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0a600ec110 con 0x7f0a700c5300 2023-12-08T08:21:51.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:51.063+0000 7f0a74f01640 1 -- 172.21.15.88:0/4280315989 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0a70067630 con 0x7f0a700c5300 2023-12-08T08:21:52.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:51.995+0000 7f0a677fe640 1 -- 172.21.15.88:0/4280315989 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v40) v1 ==== 184+0+0 (secure 0 0 0) 0x7f0a600ef730 con 0x7f0a700c5300 2023-12-08T08:21:52.001 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs2_metadata' removed 2023-12-08T08:21:52.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:51.999+0000 7f0a74f01640 1 -- 172.21.15.88:0/4280315989 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0a50066470 msgr2=0x7f0a50068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:52.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:51.999+0000 7f0a74f01640 1 --2- 172.21.15.88:0/4280315989 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0a50066470 0x7f0a50068930 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0a70150f30 tx=0x7f0a58008040 comp rx=0 tx=0).stop 2023-12-08T08:21:52.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:51.999+0000 7f0a74f01640 1 -- 172.21.15.88:0/4280315989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a700c5300 msgr2=0x7f0a70142b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:52.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:51.999+0000 7f0a74f01640 1 --2- 172.21.15.88:0/4280315989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a700c5300 0x7f0a70142b40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f0a600ad040 tx=0x7f0a6001ad80 comp rx=0 tx=0).stop 2023-12-08T08:21:52.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:51.999+0000 7f0a74f01640 1 -- 172.21.15.88:0/4280315989 shutdown_connections 2023-12-08T08:21:52.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:51.999+0000 7f0a74f01640 1 --2- 172.21.15.88:0/4280315989 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0a50066470 0x7f0a50068930 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:52.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:51.999+0000 7f0a74f01640 1 --2- 172.21.15.88:0/4280315989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a70151280 0x7f0a701ee4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:52.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:51.999+0000 7f0a74f01640 1 --2- 172.21.15.88:0/4280315989 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a7014b1e0 0x7f0a70143080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:52.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:51.999+0000 7f0a74f01640 1 --2- 172.21.15.88:0/4280315989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a700c5300 0x7f0a70142b40 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:52.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:51.999+0000 7f0a74f01640 1 -- 172.21.15.88:0/4280315989 >> 172.21.15.88:0/4280315989 conn(0x7f0a700c59f0 msgr2=0x7f0a700c4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:52.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:51.999+0000 7f0a74f01640 1 -- 172.21.15.88:0/4280315989 shutdown_connections 2023-12-08T08:21:52.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:51.999+0000 7f0a74f01640 1 -- 172.21.15.88:0/4280315989 wait complete. 2023-12-08T08:21:52.031 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-12-08T08:21:52.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.171+0000 7f500c308640 1 Processor -- start 2023-12-08T08:21:52.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.171+0000 7f500c308640 1 -- start start 2023-12-08T08:21:52.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.171+0000 7f500c308640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f500414b1e0 0x7f50040c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:52.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.171+0000 7f500c308640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f50040c5300 0x7f50040a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:52.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.171+0000 7f500c308640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5004151280 0x7f5004151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:52.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.171+0000 7f500c308640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50040a4e20 con 0x7f50040c5300 2023-12-08T08:21:52.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.171+0000 7f500c308640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50040a50e0 con 0x7f5004151280 2023-12-08T08:21:52.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.171+0000 7f500c308640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50040c0f00 con 0x7f500414b1e0 2023-12-08T08:21:52.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.171+0000 7f50098a3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f50040c5300 0x7f50040a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:52.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.171+0000 7f50098a3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f50040c5300 0x7f50040a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42496/0 (socket says 172.21.15.88:42496) 2023-12-08T08:21:52.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.171+0000 7f50098a3640 1 -- 172.21.15.88:0/2081824987 learned_addr learned my addr 172.21.15.88:0/2081824987 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:52.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.171+0000 7f50098a3640 1 -- 172.21.15.88:0/2081824987 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f500414b1e0 msgr2=0x7f50040c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:52.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.171+0000 7f50098a3640 1 --2- 172.21.15.88:0/2081824987 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f500414b1e0 0x7f50040c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:52.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.171+0000 7f50098a3640 1 -- 172.21.15.88:0/2081824987 >> v2:172.21.15.148:3300/0 conn(0x7f5004151280 msgr2=0x7f5004151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:52.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.171+0000 7f50098a3640 1 --2- 172.21.15.88:0/2081824987 >> v2:172.21.15.148:3300/0 conn(0x7f5004151280 0x7f5004151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:52.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.171+0000 7f50098a3640 1 -- 172.21.15.88:0/2081824987 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50040c11e0 con 0x7f50040c5300 2023-12-08T08:21:52.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.175+0000 7f50098a3640 1 --2- 172.21.15.88:0/2081824987 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50040c5300 0x7f50040a9c30 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f50040c3b30 tx=0x7f4ff401e710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa6d8a43d16d3e04 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:52.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.175+0000 7f50090a2640 1 -- 172.21.15.88:0/2081824987 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff40ad670 con 0x7f50040c5300 2023-12-08T08:21:52.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.175+0000 7f50090a2640 1 -- 172.21.15.88:0/2081824987 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff40ad7d0 con 0x7f50040c5300 2023-12-08T08:21:52.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.175+0000 7f50090a2640 1 -- 172.21.15.88:0/2081824987 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff40adb60 con 0x7f50040c5300 2023-12-08T08:21:52.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.175+0000 7f500c308640 1 -- 172.21.15.88:0/2081824987 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50040c5300 msgr2=0x7f50040a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:52.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.175+0000 7f500c308640 1 --2- 172.21.15.88:0/2081824987 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50040c5300 0x7f50040a9c30 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f50040c3b30 tx=0x7f4ff401e710 comp rx=0 tx=0).stop 2023-12-08T08:21:52.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.175+0000 7f500c308640 1 -- 172.21.15.88:0/2081824987 shutdown_connections 2023-12-08T08:21:52.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.175+0000 7f500c308640 1 --2- 172.21.15.88:0/2081824987 >> v2:172.21.15.148:3300/0 conn(0x7f5004151280 0x7f5004151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:52.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.175+0000 7f500c308640 1 --2- 172.21.15.88:0/2081824987 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50040c5300 0x7f50040a9c30 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:52.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.175+0000 7f500c308640 1 --2- 172.21.15.88:0/2081824987 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f500414b1e0 0x7f50040c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:52.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.175+0000 7f500c308640 1 -- 172.21.15.88:0/2081824987 >> 172.21.15.88:0/2081824987 conn(0x7f50040c59f0 msgr2=0x7f50040c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:52.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.175+0000 7f500c308640 1 -- 172.21.15.88:0/2081824987 shutdown_connections 2023-12-08T08:21:52.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.175+0000 7f500c308640 1 -- 172.21.15.88:0/2081824987 wait complete. 2023-12-08T08:21:52.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.179+0000 7f500c308640 1 Processor -- start 2023-12-08T08:21:52.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.179+0000 7f500c308640 1 -- start start 2023-12-08T08:21:52.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.179+0000 7f500c308640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50040c5300 0x7f50040a65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:52.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.179+0000 7f500c308640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f500414b1e0 0x7f50041e9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:52.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.179+0000 7f500c308640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5004151280 0x7f5004144c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:52.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.179+0000 7f500c308640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5004146b70 con 0x7f50040c5300 2023-12-08T08:21:52.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.179+0000 7f500c308640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50041e9a70 con 0x7f500414b1e0 2023-12-08T08:21:52.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.179+0000 7f500c308640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50041e9d50 con 0x7f5004151280 2023-12-08T08:21:52.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.179+0000 7f500a0a4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50040c5300 0x7f50040a65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:52.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.179+0000 7f500a0a4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50040c5300 0x7f50040a65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42508/0 (socket says 172.21.15.88:42508) 2023-12-08T08:21:52.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.179+0000 7f500a0a4640 1 -- 172.21.15.88:0/1121359983 learned_addr learned my addr 172.21.15.88:0/1121359983 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:52.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.179+0000 7f50098a3640 1 --2- 172.21.15.88:0/1121359983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f500414b1e0 0x7f50041e9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:52.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.179+0000 7f500a8a5640 1 --2- 172.21.15.88:0/1121359983 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5004151280 0x7f5004144c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:52.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.179+0000 7f500a0a4640 1 -- 172.21.15.88:0/1121359983 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5004151280 msgr2=0x7f5004144c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:52.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.179+0000 7f500a0a4640 1 --2- 172.21.15.88:0/1121359983 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5004151280 0x7f5004144c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:52.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.179+0000 7f500a0a4640 1 -- 172.21.15.88:0/1121359983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f500414b1e0 msgr2=0x7f50041e9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:52.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.179+0000 7f500a0a4640 1 --2- 172.21.15.88:0/1121359983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f500414b1e0 0x7f50041e9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:52.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.179+0000 7f500a0a4640 1 -- 172.21.15.88:0/1121359983 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff40094d0 con 0x7f50040c5300 2023-12-08T08:21:52.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.179+0000 7f500a0a4640 1 --2- 172.21.15.88:0/1121359983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50040c5300 0x7f50040a65f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f500000b550 tx=0x7f500000ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:52.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.179+0000 7f4ffaffd640 1 -- 172.21.15.88:0/1121359983 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5000010870 con 0x7f50040c5300 2023-12-08T08:21:52.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.179+0000 7f4ffaffd640 1 -- 172.21.15.88:0/1121359983 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50000109f0 con 0x7f50040c5300 2023-12-08T08:21:52.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.179+0000 7f4ffaffd640 1 -- 172.21.15.88:0/1121359983 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5000010da0 con 0x7f50040c5300 2023-12-08T08:21:52.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.179+0000 7f500c308640 1 -- 172.21.15.88:0/1121359983 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50041ea030 con 0x7f50040c5300 2023-12-08T08:21:52.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.179+0000 7f500c308640 1 -- 172.21.15.88:0/1121359983 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50041e9760 con 0x7f50040c5300 2023-12-08T08:21:52.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.183+0000 7f500c308640 1 -- 172.21.15.88:0/1121359983 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5004067630 con 0x7f50040c5300 2023-12-08T08:21:52.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.183+0000 7f4ffaffd640 1 -- 172.21.15.88:0/1121359983 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f500000f3c0 con 0x7f50040c5300 2023-12-08T08:21:52.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.183+0000 7f4ffaffd640 1 --2- 172.21.15.88:0/1121359983 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4fe8066470 0x7f4fe8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:52.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.183+0000 7f4ffaffd640 1 -- 172.21.15.88:0/1121359983 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5445+0+0 (secure 0 0 0) 0x7f5000083e60 con 0x7f50040c5300 2023-12-08T08:21:52.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.183+0000 7f50098a3640 1 --2- 172.21.15.88:0/1121359983 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4fe8066470 0x7f4fe8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:52.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.183+0000 7f50098a3640 1 --2- 172.21.15.88:0/1121359983 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4fe8066470 0x7f4fe8068930 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4ff40b1000 tx=0x7f4ff40a9000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:52.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.187+0000 7f4ffaffd640 1 -- 172.21.15.88:0/1121359983 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5000051340 con 0x7f50040c5300 2023-12-08T08:21:52.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:52.339+0000 7f500c308640 1 -- 172.21.15.88:0/1121359983 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f50040c5dd0 con 0x7f50040c5300 2023-12-08T08:21:53.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.003+0000 7f4ffaffd640 1 -- 172.21.15.88:0/1121359983 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v41) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5000054960 con 0x7f50040c5300 2023-12-08T08:21:53.007 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs2_data' removed 2023-12-08T08:21:53.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.007+0000 7f500c308640 1 -- 172.21.15.88:0/1121359983 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4fe8066470 msgr2=0x7f4fe8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:53.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.007+0000 7f500c308640 1 --2- 172.21.15.88:0/1121359983 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4fe8066470 0x7f4fe8068930 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4ff40b1000 tx=0x7f4ff40a9000 comp rx=0 tx=0).stop 2023-12-08T08:21:53.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.007+0000 7f500c308640 1 -- 172.21.15.88:0/1121359983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50040c5300 msgr2=0x7f50040a65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:53.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.007+0000 7f500c308640 1 --2- 172.21.15.88:0/1121359983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50040c5300 0x7f50040a65f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f500000b550 tx=0x7f500000ba10 comp rx=0 tx=0).stop 2023-12-08T08:21:53.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.007+0000 7f500c308640 1 -- 172.21.15.88:0/1121359983 shutdown_connections 2023-12-08T08:21:53.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.007+0000 7f500c308640 1 --2- 172.21.15.88:0/1121359983 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4fe8066470 0x7f4fe8068930 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:53.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.007+0000 7f500c308640 1 --2- 172.21.15.88:0/1121359983 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5004151280 0x7f5004144c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:53.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.007+0000 7f500c308640 1 --2- 172.21.15.88:0/1121359983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f500414b1e0 0x7f50041e9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:53.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.007+0000 7f500c308640 1 --2- 172.21.15.88:0/1121359983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50040c5300 0x7f50040a65f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:53.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.007+0000 7f500c308640 1 -- 172.21.15.88:0/1121359983 >> 172.21.15.88:0/1121359983 conn(0x7f50040c59f0 msgr2=0x7f5004145500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:53.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.007+0000 7f500c308640 1 -- 172.21.15.88:0/1121359983 shutdown_connections 2023-12-08T08:21:53.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.007+0000 7f500c308640 1 -- 172.21.15.88:0/1121359983 wait complete. 2023-12-08T08:21:53.032 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-08T08:21:53.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.167+0000 7fd30898d640 1 Processor -- start 2023-12-08T08:21:53.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.167+0000 7fd30898d640 1 -- start start 2023-12-08T08:21:53.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.167+0000 7fd30898d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd30414e2a0 0x7fd3041516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:53.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.167+0000 7fd30898d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd304151210 con 0x7fd3040a9910 2023-12-08T08:21:53.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.167+0000 7fd30898d640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd30414e680 con 0x7fd3040a9460 2023-12-08T08:21:53.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.167+0000 7fd30898d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd304150be0 con 0x7fd30414e2a0 2023-12-08T08:21:53.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.167+0000 7fd30259c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd30414e2a0 0x7fd3041516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:53.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.167+0000 7fd302d9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd3040a9910 0x7fd30406bc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51100/0 (socket says 172.21.15.88:51100) 2023-12-08T08:21:53.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.167+0000 7fd302d9d640 1 -- 172.21.15.88:0/722627642 learned_addr learned my addr 172.21.15.88:0/722627642 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:53.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.167+0000 7fd30259c640 1 -- 172.21.15.88:0/722627642 >> v1:172.21.15.148:6789/0 conn(0x7fd3040a9460 legacy=0x7fd3040c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:53.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.167+0000 7fd301d9b640 1 -- 172.21.15.88:0/722627642 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509816274 0 0) 0x7fd304151210 con 0x7fd3040a9910 2023-12-08T08:21:53.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.167+0000 7fd30259c640 1 -- 172.21.15.88:0/722627642 >> v1:172.21.15.88:6789/0 conn(0x7fd3040a9910 legacy=0x7fd30406bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:53.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.167+0000 7fd30259c640 1 -- 172.21.15.88:0/722627642 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3040c53c0 con 0x7fd30414e2a0 2023-12-08T08:21:53.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.171+0000 7fd30259c640 1 --2- 172.21.15.88:0/722627642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd30414e2a0 0x7fd3041516a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40097c0 tx=0x7fd2f401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43dbb45d8acf47bb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:53.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.171+0000 7fd301d9b640 1 -- 172.21.15.88:0/722627642 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f40ab600 con 0x7fd30414e2a0 2023-12-08T08:21:53.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.171+0000 7fd301d9b640 1 -- 172.21.15.88:0/722627642 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f40a7050 con 0x7fd30414e2a0 2023-12-08T08:21:53.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.171+0000 7fd301d9b640 1 -- 172.21.15.88:0/722627642 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f40ab980 con 0x7fd30414e2a0 2023-12-08T08:21:53.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.171+0000 7fd30898d640 1 -- 172.21.15.88:0/722627642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd30414e2a0 msgr2=0x7fd3041516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:53.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.171+0000 7fd30898d640 1 --2- 172.21.15.88:0/722627642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd30414e2a0 0x7fd3041516a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40097c0 tx=0x7fd2f401c440 comp rx=0 tx=0).stop 2023-12-08T08:21:53.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.171+0000 7fd30898d640 1 -- 172.21.15.88:0/722627642 shutdown_connections 2023-12-08T08:21:53.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.171+0000 7fd30898d640 1 --2- 172.21.15.88:0/722627642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd30414e2a0 0x7fd3041516a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:53.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.171+0000 7fd30898d640 1 -- 172.21.15.88:0/722627642 >> 172.21.15.88:0/722627642 conn(0x7fd3040c59f0 msgr2=0x7fd3040c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:53.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.171+0000 7fd30898d640 1 -- 172.21.15.88:0/722627642 shutdown_connections 2023-12-08T08:21:53.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.171+0000 7fd30898d640 1 -- 172.21.15.88:0/722627642 wait complete. 2023-12-08T08:21:53.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.175+0000 7fd30898d640 1 Processor -- start 2023-12-08T08:21:53.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.175+0000 7fd30898d640 1 -- start start 2023-12-08T08:21:53.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.175+0000 7fd30898d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3040a9460 0x7fd3040c1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:53.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.175+0000 7fd30898d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3040a9910 0x7fd304143fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:53.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.175+0000 7fd30898d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd30414e2a0 0x7fd3041444e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:53.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.175+0000 7fd30898d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30414ae20 con 0x7fd3040a9460 2023-12-08T08:21:53.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.175+0000 7fd30898d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3041ef410 con 0x7fd3040a9910 2023-12-08T08:21:53.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.175+0000 7fd30898d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3040c21e0 con 0x7fd30414e2a0 2023-12-08T08:21:53.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.175+0000 7fd30259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3040a9460 0x7fd3040c1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:53.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.175+0000 7fd30259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3040a9460 0x7fd3040c1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42522/0 (socket says 172.21.15.88:42522) 2023-12-08T08:21:53.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.175+0000 7fd30259c640 1 -- 172.21.15.88:0/2226563573 learned_addr learned my addr 172.21.15.88:0/2226563573 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:53.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.175+0000 7fd2f9d9b640 1 --2- 172.21.15.88:0/2226563573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3040a9910 0x7fd304143fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:53.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.175+0000 7fd302d9d640 1 --2- 172.21.15.88:0/2226563573 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd30414e2a0 0x7fd3041444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:53.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.175+0000 7fd30259c640 1 -- 172.21.15.88:0/2226563573 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd30414e2a0 msgr2=0x7fd3041444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:53.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.175+0000 7fd30259c640 1 --2- 172.21.15.88:0/2226563573 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd30414e2a0 0x7fd3041444e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:53.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.175+0000 7fd30259c640 1 -- 172.21.15.88:0/2226563573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3040a9910 msgr2=0x7fd304143fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:53.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.175+0000 7fd30259c640 1 --2- 172.21.15.88:0/2226563573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3040a9910 0x7fd304143fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:53.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.175+0000 7fd30259c640 1 -- 172.21.15.88:0/2226563573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f4009420 con 0x7fd3040a9460 2023-12-08T08:21:53.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.175+0000 7fd2f9d9b640 1 --2- 172.21.15.88:0/2226563573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3040a9910 0x7fd304143fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:53.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.175+0000 7fd302d9d640 1 --2- 172.21.15.88:0/2226563573 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd30414e2a0 0x7fd3041444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:53.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.175+0000 7fd30259c640 1 --2- 172.21.15.88:0/2226563573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3040a9460 0x7fd3040c1650 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40ae040 tx=0x7fd2f401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:53.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.175+0000 7fd2fb7fe640 1 -- 172.21.15.88:0/2226563573 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f40b7650 con 0x7fd3040a9460 2023-12-08T08:21:53.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.175+0000 7fd2fb7fe640 1 -- 172.21.15.88:0/2226563573 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f40abe90 con 0x7fd3040a9460 2023-12-08T08:21:53.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.175+0000 7fd30898d640 1 -- 172.21.15.88:0/2226563573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3041ee800 con 0x7fd3040a9460 2023-12-08T08:21:53.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.175+0000 7fd2fb7fe640 1 -- 172.21.15.88:0/2226563573 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f40b7a10 con 0x7fd3040a9460 2023-12-08T08:21:53.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.175+0000 7fd30898d640 1 -- 172.21.15.88:0/2226563573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3041eedc0 con 0x7fd3040a9460 2023-12-08T08:21:53.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.179+0000 7fd30898d640 1 -- 172.21.15.88:0/2226563573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd304067630 con 0x7fd3040a9460 2023-12-08T08:21:53.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.179+0000 7fd2fb7fe640 1 -- 172.21.15.88:0/2226563573 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd2f40b7b70 con 0x7fd3040a9460 2023-12-08T08:21:53.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.179+0000 7fd2fb7fe640 1 --2- 172.21.15.88:0/2226563573 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd2e4066470 0x7fd2e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:53.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.179+0000 7fd2fb7fe640 1 -- 172.21.15.88:0/2226563573 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd2f411e380 con 0x7fd3040a9460 2023-12-08T08:21:53.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.179+0000 7fd2f9d9b640 1 --2- 172.21.15.88:0/2226563573 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd2e4066470 0x7fd2e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:53.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.179+0000 7fd2f9d9b640 1 --2- 172.21.15.88:0/2226563573 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd2e4066470 0x7fd2e4068930 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd30415c160 tx=0x7fd2ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:53.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.183+0000 7fd2fb7fe640 1 -- 172.21.15.88:0/2226563573 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd2f40ebb30 con 0x7fd3040a9460 2023-12-08T08:21:53.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.347+0000 7fd30898d640 1 -- 172.21.15.88:0/2226563573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd304150780 con 0x7fd3040a9460 2023-12-08T08:21:53.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.351+0000 7fd2fb7fe640 1 -- 172.21.15.88:0/2226563573 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd2f40ef150 con 0x7fd3040a9460 2023-12-08T08:21:53.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.351+0000 7fd30898d640 1 -- 172.21.15.88:0/2226563573 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd2e4066470 msgr2=0x7fd2e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:53.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.351+0000 7fd30898d640 1 --2- 172.21.15.88:0/2226563573 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd2e4066470 0x7fd2e4068930 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd30415c160 tx=0x7fd2ec009040 comp rx=0 tx=0).stop 2023-12-08T08:21:53.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.351+0000 7fd30898d640 1 -- 172.21.15.88:0/2226563573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3040a9460 msgr2=0x7fd3040c1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:53.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.351+0000 7fd30898d640 1 --2- 172.21.15.88:0/2226563573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3040a9460 0x7fd3040c1650 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40ae040 tx=0x7fd2f401ac80 comp rx=0 tx=0).stop 2023-12-08T08:21:53.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.351+0000 7fd30898d640 1 -- 172.21.15.88:0/2226563573 shutdown_connections 2023-12-08T08:21:53.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.351+0000 7fd30898d640 1 --2- 172.21.15.88:0/2226563573 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd2e4066470 0x7fd2e4068930 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:53.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.351+0000 7fd30898d640 1 --2- 172.21.15.88:0/2226563573 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd30414e2a0 0x7fd3041444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:53.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.351+0000 7fd30898d640 1 --2- 172.21.15.88:0/2226563573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3040a9910 0x7fd304143fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:53.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.351+0000 7fd30898d640 1 --2- 172.21.15.88:0/2226563573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3040a9460 0x7fd3040c1650 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:53.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.351+0000 7fd30898d640 1 -- 172.21.15.88:0/2226563573 >> 172.21.15.88:0/2226563573 conn(0x7fd3040c59f0 msgr2=0x7fd3040c4180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:53.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.351+0000 7fd30898d640 1 -- 172.21.15.88:0/2226563573 shutdown_connections 2023-12-08T08:21:53.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.351+0000 7fd30898d640 1 -- 172.21.15.88:0/2226563573 wait complete. 2023-12-08T08:21:53.376 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-12-08T08:21:53.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.515+0000 7f965b846640 1 Processor -- start 2023-12-08T08:21:53.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.515+0000 7f965b846640 1 -- start start 2023-12-08T08:21:53.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.515+0000 7f965b846640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f965406d2b0 0x7f965406d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:53.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.515+0000 7f965b846640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f96540c5300 0x7f965406c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:53.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.515+0000 7f965b846640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f965406bb80 con 0x7f96540c3b80 2023-12-08T08:21:53.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.515+0000 7f965b846640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f965406cc70 con 0x7f96540c5300 2023-12-08T08:21:53.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.515+0000 7f965b846640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96540c5790 con 0x7f965406d2b0 2023-12-08T08:21:53.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.519+0000 7f9659de3640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f96540c5300 0x7f965406c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:53.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.519+0000 7f96595e2640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f965406d2b0 0x7f965406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:53.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.519+0000 7f9659de3640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f96540c5300 0x7f965406c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:36584/0 (socket says 172.21.15.88:36584) 2023-12-08T08:21:53.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.519+0000 7f9659de3640 1 -- 172.21.15.88:0/3852698223 learned_addr learned my addr 172.21.15.88:0/3852698223 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:53.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.519+0000 7f9659de3640 1 -- 172.21.15.88:0/3852698223 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f965406d2b0 msgr2=0x7f965406d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:53.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.519+0000 7f9659de3640 1 --2- 172.21.15.88:0/3852698223 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f965406d2b0 0x7f965406d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:53.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.519+0000 7f9659de3640 1 -- 172.21.15.88:0/3852698223 >> v1:172.21.15.148:6789/0 conn(0x7f96540c3b80 legacy=0x7f965406c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:53.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.519+0000 7f9659de3640 1 -- 172.21.15.88:0/3852698223 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96541515c0 con 0x7f96540c5300 2023-12-08T08:21:53.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.519+0000 7f96595e2640 1 --2- 172.21.15.88:0/3852698223 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f965406d2b0 0x7f965406d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:21:53.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.519+0000 7f9659de3640 1 --2- 172.21.15.88:0/3852698223 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96540c5300 0x7f965406c730 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f964c009e50 tx=0x7f964c01c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9441fca89f92ef9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:53.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.523+0000 7f964bfff640 1 -- 172.21.15.88:0/3852698223 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c0a57c0 con 0x7f96540c5300 2023-12-08T08:21:53.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.523+0000 7f964bfff640 1 -- 172.21.15.88:0/3852698223 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964c0a5920 con 0x7f96540c5300 2023-12-08T08:21:53.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.523+0000 7f964bfff640 1 -- 172.21.15.88:0/3852698223 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c0a5cb0 con 0x7f96540c5300 2023-12-08T08:21:53.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.523+0000 7f965b846640 1 -- 172.21.15.88:0/3852698223 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96540c5300 msgr2=0x7f965406c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:53.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.523+0000 7f965b846640 1 --2- 172.21.15.88:0/3852698223 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96540c5300 0x7f965406c730 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f964c009e50 tx=0x7f964c01c9e0 comp rx=0 tx=0).stop 2023-12-08T08:21:53.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.523+0000 7f965b846640 1 -- 172.21.15.88:0/3852698223 shutdown_connections 2023-12-08T08:21:53.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.523+0000 7f965b846640 1 --2- 172.21.15.88:0/3852698223 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96540c5300 0x7f965406c730 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:53.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.523+0000 7f965b846640 1 --2- 172.21.15.88:0/3852698223 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f965406d2b0 0x7f965406d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:53.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.523+0000 7f965b846640 1 -- 172.21.15.88:0/3852698223 >> 172.21.15.88:0/3852698223 conn(0x7f96540a7810 msgr2=0x7f96540a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:53.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.523+0000 7f965b846640 1 -- 172.21.15.88:0/3852698223 shutdown_connections 2023-12-08T08:21:53.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.523+0000 7f965b846640 1 -- 172.21.15.88:0/3852698223 wait complete. 2023-12-08T08:21:53.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.523+0000 7f965b846640 1 Processor -- start 2023-12-08T08:21:53.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.523+0000 7f965b846640 1 -- start start 2023-12-08T08:21:53.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.523+0000 7f965b846640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f965406d2b0 0x7f96540a8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:53.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.523+0000 7f965b846640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96540c3b80 0x7f96541ed8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:53.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.523+0000 7f965b846640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96540c5300 0x7f96541f04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:53.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.523+0000 7f965b846640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96541ed4f0 con 0x7f96540c5300 2023-12-08T08:21:53.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.523+0000 7f965b846640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96540700d0 con 0x7f96540c3b80 2023-12-08T08:21:53.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.523+0000 7f965b846640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96541ecf00 con 0x7f965406d2b0 2023-12-08T08:21:53.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.523+0000 7f9659de3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96540c5300 0x7f96541f04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:53.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.523+0000 7f9658de1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96540c3b80 0x7f96541ed8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:53.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.523+0000 7f96595e2640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f965406d2b0 0x7f96540a8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:53.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.523+0000 7f9659de3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96540c5300 0x7f96541f04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42524/0 (socket says 172.21.15.88:42524) 2023-12-08T08:21:53.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.523+0000 7f9659de3640 1 -- 172.21.15.88:0/1762890199 learned_addr learned my addr 172.21.15.88:0/1762890199 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:53.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.527+0000 7f9659de3640 1 -- 172.21.15.88:0/1762890199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f965406d2b0 msgr2=0x7f96540a8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:53.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.527+0000 7f9659de3640 1 --2- 172.21.15.88:0/1762890199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f965406d2b0 0x7f96540a8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:53.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.527+0000 7f9659de3640 1 -- 172.21.15.88:0/1762890199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96540c3b80 msgr2=0x7f96541ed8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:53.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.527+0000 7f9659de3640 1 --2- 172.21.15.88:0/1762890199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96540c3b80 0x7f96541ed8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:53.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.527+0000 7f9659de3640 1 -- 172.21.15.88:0/1762890199 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9650009420 con 0x7f96540c5300 2023-12-08T08:21:53.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.527+0000 7f9658de1640 1 --2- 172.21.15.88:0/1762890199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96540c3b80 0x7f96541ed8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:21:53.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.527+0000 7f9659de3640 1 --2- 172.21.15.88:0/1762890199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96540c5300 0x7f96541f04f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f964c0af040 tx=0x7f964c019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:53.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.527+0000 7f9649ffb640 1 -- 172.21.15.88:0/1762890199 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c0b8640 con 0x7f96540c5300 2023-12-08T08:21:53.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.527+0000 7f9649ffb640 1 -- 172.21.15.88:0/1762890199 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964c0b87a0 con 0x7f96540c5300 2023-12-08T08:21:53.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.527+0000 7f9649ffb640 1 -- 172.21.15.88:0/1762890199 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c0b8b10 con 0x7f96540c5300 2023-12-08T08:21:53.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.527+0000 7f965b846640 1 -- 172.21.15.88:0/1762890199 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f964c009b30 con 0x7f96540c5300 2023-12-08T08:21:53.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.527+0000 7f965b846640 1 -- 172.21.15.88:0/1762890199 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f965414ef80 con 0x7f96540c5300 2023-12-08T08:21:53.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.527+0000 7f965b846640 1 -- 172.21.15.88:0/1762890199 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96541ed760 con 0x7f96540c5300 2023-12-08T08:21:53.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.527+0000 7f9649ffb640 1 -- 172.21.15.88:0/1762890199 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f964c0b8c70 con 0x7f96540c5300 2023-12-08T08:21:53.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.531+0000 7f9649ffb640 1 --2- 172.21.15.88:0/1762890199 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9638066470 0x7f9638068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:53.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.531+0000 7f9649ffb640 1 -- 172.21.15.88:0/1762890199 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f964c11ec50 con 0x7f96540c5300 2023-12-08T08:21:53.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.531+0000 7f96595e2640 1 --2- 172.21.15.88:0/1762890199 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9638066470 0x7f9638068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:53.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.531+0000 7f96595e2640 1 --2- 172.21.15.88:0/1762890199 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9638066470 0x7f9638068930 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f96540a6c80 tx=0x7f9650009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:53.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.535+0000 7f9649ffb640 1 -- 172.21.15.88:0/1762890199 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f964c124020 con 0x7f96540c5300 2023-12-08T08:21:53.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:53.735+0000 7f965b846640 1 -- 172.21.15.88:0/1762890199 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f9654067630 con 0x7f96540c5300 2023-12-08T08:21:54.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.003+0000 7f9649ffb640 1 -- 172.21.15.88:0/1762890199 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v113) v1 ==== 159+0+0 (secure 0 0 0) 0x7f964c0ec4b0 con 0x7f96540c5300 2023-12-08T08:21:54.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.007+0000 7f965b846640 1 -- 172.21.15.88:0/1762890199 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9638066470 msgr2=0x7f9638068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:54.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.007+0000 7f965b846640 1 --2- 172.21.15.88:0/1762890199 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9638066470 0x7f9638068930 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f96540a6c80 tx=0x7f9650009190 comp rx=0 tx=0).stop 2023-12-08T08:21:54.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.007+0000 7f965b846640 1 -- 172.21.15.88:0/1762890199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96540c5300 msgr2=0x7f96541f04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:54.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.007+0000 7f965b846640 1 --2- 172.21.15.88:0/1762890199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96540c5300 0x7f96541f04f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f964c0af040 tx=0x7f964c019780 comp rx=0 tx=0).stop 2023-12-08T08:21:54.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.007+0000 7f965b846640 1 -- 172.21.15.88:0/1762890199 shutdown_connections 2023-12-08T08:21:54.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.007+0000 7f965b846640 1 --2- 172.21.15.88:0/1762890199 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9638066470 0x7f9638068930 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.007+0000 7f965b846640 1 --2- 172.21.15.88:0/1762890199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96540c5300 0x7f96541f04f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.007+0000 7f965b846640 1 --2- 172.21.15.88:0/1762890199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96540c3b80 0x7f96541ed8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.007+0000 7f965b846640 1 --2- 172.21.15.88:0/1762890199 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f965406d2b0 0x7f96540a8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.007+0000 7f965b846640 1 -- 172.21.15.88:0/1762890199 >> 172.21.15.88:0/1762890199 conn(0x7f96540a7810 msgr2=0x7f96540a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:54.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.007+0000 7f965b846640 1 -- 172.21.15.88:0/1762890199 shutdown_connections 2023-12-08T08:21:54.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.007+0000 7f965b846640 1 -- 172.21.15.88:0/1762890199 wait complete. 2023-12-08T08:21:54.030 INFO:tasks.cephfs_test_runner:test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2023-12-08T08:21:54.030 INFO:tasks.cephfs_test_runner:Starting test: test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-12-08T08:21:54.031 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:21:54.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.163+0000 7f000e605640 1 Processor -- start 2023-12-08T08:21:54.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.163+0000 7f000e605640 1 -- start start 2023-12-08T08:21:54.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.163+0000 7f000e605640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0008071e30 0x7f00080722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:54.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.163+0000 7f000e605640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0008156110 0x7f00081565a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:54.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.163+0000 7f000e605640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00080c5710 con 0x7f000814fd10 2023-12-08T08:21:54.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.163+0000 7f000e605640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f000806c5e0 con 0x7f0008071e30 2023-12-08T08:21:54.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.163+0000 7f000e605640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0008155c80 con 0x7f0008156110 2023-12-08T08:21:54.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.163+0000 7f0007fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f000814fd10 0x7f00080a4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51112/0 (socket says 172.21.15.88:51112) 2023-12-08T08:21:54.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.163+0000 7f0007fff640 1 -- 172.21.15.88:0/1372079096 learned_addr learned my addr 172.21.15.88:0/1372079096 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:54.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.163+0000 7f000cba2640 1 --2- 172.21.15.88:0/1372079096 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0008156110 0x7f00081565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:54.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.163+0000 7f00077fe640 1 --2- 172.21.15.88:0/1372079096 >> v2:172.21.15.148:3300/0 conn(0x7f0008071e30 0x7f00080722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:54.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.163+0000 7f0006ffd640 1 -- 172.21.15.88:0/1372079096 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382567630 0 0) 0x7f00080c5710 con 0x7f000814fd10 2023-12-08T08:21:54.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.163+0000 7f0006ffd640 1 -- 172.21.15.88:0/1372079096 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efff0003530 con 0x7f000814fd10 2023-12-08T08:21:54.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.167+0000 7f0006ffd640 1 -- 172.21.15.88:0/1372079096 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3023481251 0 0) 0x7efff0003530 con 0x7f000814fd10 2023-12-08T08:21:54.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.167+0000 7f0006ffd640 1 -- 172.21.15.88:0/1372079096 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0008156110 msgr2=0x7f00081565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.167+0000 7f0006ffd640 1 --2- 172.21.15.88:0/1372079096 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0008156110 0x7f00081565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.167+0000 7f0006ffd640 1 -- 172.21.15.88:0/1372079096 >> v2:172.21.15.148:3300/0 conn(0x7f0008071e30 msgr2=0x7f00080722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.167+0000 7f0006ffd640 1 --2- 172.21.15.88:0/1372079096 >> v2:172.21.15.148:3300/0 conn(0x7f0008071e30 0x7f00080722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.167+0000 7f0006ffd640 1 -- 172.21.15.88:0/1372079096 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00080c4e70 con 0x7f000814fd10 2023-12-08T08:21:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.167+0000 7f0006ffd640 1 -- 172.21.15.88:0/1372079096 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7efff8001680 con 0x7f000814fd10 2023-12-08T08:21:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.167+0000 7f0006ffd640 1 -- 172.21.15.88:0/1372079096 >> v1:172.21.15.88:6789/0 conn(0x7f000814fd10 legacy=0x7f00080a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.167+0000 7f0006ffd640 1 --2- 172.21.15.88:0/1372079096 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efff0003980 0x7efff0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.167+0000 7f0006ffd640 1 --2- 172.21.15.88:0/1372079096 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0008156110 0x7efff00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.167+0000 7f0006ffd640 1 --2- 172.21.15.88:0/1372079096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efff0004d10 0x7efff0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.167+0000 7f0006ffd640 1 -- 172.21.15.88:0/1372079096 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0008155c80 con 0x7efff0003980 2023-12-08T08:21:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.167+0000 7f0006ffd640 1 -- 172.21.15.88:0/1372079096 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff000b990 con 0x7efff0004d10 2023-12-08T08:21:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.167+0000 7f0006ffd640 1 -- 172.21.15.88:0/1372079096 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff000bb50 con 0x7f0008156110 2023-12-08T08:21:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.167+0000 7f0007fff640 1 --2- 172.21.15.88:0/1372079096 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efff0003980 0x7efff0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.167+0000 7f00077fe640 1 --2- 172.21.15.88:0/1372079096 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0008156110 0x7efff00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:54.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.167+0000 7f000cba2640 1 --2- 172.21.15.88:0/1372079096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efff0004d10 0x7efff0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:54.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.167+0000 7f0007fff640 1 -- 172.21.15.88:0/1372079096 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0008156110 msgr2=0x7efff00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:54.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.167+0000 7f0007fff640 1 --2- 172.21.15.88:0/1372079096 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0008156110 0x7efff00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.167+0000 7f0007fff640 1 -- 172.21.15.88:0/1372079096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efff0004d10 msgr2=0x7efff0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:54.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.167+0000 7f0007fff640 1 --2- 172.21.15.88:0/1372079096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efff0004d10 0x7efff0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.167+0000 7f0007fff640 1 -- 172.21.15.88:0/1372079096 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff0003530 con 0x7efff0003980 2023-12-08T08:21:54.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.167+0000 7f0007fff640 1 --2- 172.21.15.88:0/1372079096 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efff0003980 0x7efff0003da0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7efff800c240 tx=0x7efff801cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1ffd5b9fe7ccc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:54.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.171+0000 7f0006ffd640 1 -- 172.21.15.88:0/1372079096 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff80a5910 con 0x7efff0003980 2023-12-08T08:21:54.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.171+0000 7f0006ffd640 1 -- 172.21.15.88:0/1372079096 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff80a5a70 con 0x7efff0003980 2023-12-08T08:21:54.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.171+0000 7f0006ffd640 1 -- 172.21.15.88:0/1372079096 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff80a5e40 con 0x7efff0003980 2023-12-08T08:21:54.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.171+0000 7f000e605640 1 -- 172.21.15.88:0/1372079096 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efff0003980 msgr2=0x7efff0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:54.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.171+0000 7f000e605640 1 --2- 172.21.15.88:0/1372079096 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efff0003980 0x7efff0003da0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7efff800c240 tx=0x7efff801cc30 comp rx=0 tx=0).stop 2023-12-08T08:21:54.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.171+0000 7f000cba2640 1 -- 172.21.15.88:0/1372079096 reap_dead start 2023-12-08T08:21:54.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.171+0000 7f000e605640 1 -- 172.21.15.88:0/1372079096 shutdown_connections 2023-12-08T08:21:54.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.171+0000 7f000e605640 1 -- 172.21.15.88:0/1372079096 >> 172.21.15.88:0/1372079096 conn(0x7f00080a7810 msgr2=0x7f00080a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:54.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.171+0000 7f000e605640 1 -- 172.21.15.88:0/1372079096 shutdown_connections 2023-12-08T08:21:54.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.171+0000 7f000e605640 1 -- 172.21.15.88:0/1372079096 wait complete. 2023-12-08T08:21:54.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.171+0000 7f000e605640 1 Processor -- start 2023-12-08T08:21:54.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.171+0000 7f000e605640 1 -- start start 2023-12-08T08:21:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.171+0000 7f000e605640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efff0003980 0x7f00081edfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.171+0000 7f000e605640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f000814bde0 0x7f00080a96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.171+0000 7f000e605640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00081ee4f0 0x7f00080a9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.171+0000 7f000e605640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00081570a0 con 0x7f00081ee4f0 2023-12-08T08:21:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.171+0000 7f000e605640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0008151310 con 0x7f000814bde0 2023-12-08T08:21:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.171+0000 7f000e605640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0008150370 con 0x7efff0003980 2023-12-08T08:21:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.171+0000 7f000cba2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00081ee4f0 0x7f00080a9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.171+0000 7f000cba2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00081ee4f0 0x7f00080a9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42540/0 (socket says 172.21.15.88:42540) 2023-12-08T08:21:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.171+0000 7f000cba2640 1 -- 172.21.15.88:0/3408659431 learned_addr learned my addr 172.21.15.88:0/3408659431 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.175+0000 7f0007fff640 1 --2- 172.21.15.88:0/3408659431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efff0003980 0x7f00081edfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.175+0000 7f00077fe640 1 --2- 172.21.15.88:0/3408659431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f000814bde0 0x7f00080a96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.175+0000 7f000cba2640 1 -- 172.21.15.88:0/3408659431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efff0003980 msgr2=0x7f00081edfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.175+0000 7f000cba2640 1 --2- 172.21.15.88:0/3408659431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efff0003980 0x7f00081edfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.175+0000 7f000cba2640 1 -- 172.21.15.88:0/3408659431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f000814bde0 msgr2=0x7f00080a96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.175+0000 7f000cba2640 1 --2- 172.21.15.88:0/3408659431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f000814bde0 0x7f00080a96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.175+0000 7f000cba2640 1 -- 172.21.15.88:0/3408659431 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00081505c0 con 0x7f00081ee4f0 2023-12-08T08:21:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.175+0000 7f00077fe640 1 --2- 172.21.15.88:0/3408659431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f000814bde0 0x7f00080a96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:54.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.175+0000 7f000cba2640 1 --2- 172.21.15.88:0/3408659431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00081ee4f0 0x7f00080a9bf0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f00080bfcd0 tx=0x7f00000115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:54.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.175+0000 7f0004ff9640 1 -- 172.21.15.88:0/3408659431 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000000e070 con 0x7f00081ee4f0 2023-12-08T08:21:54.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.175+0000 7f0004ff9640 1 -- 172.21.15.88:0/3408659431 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0000011e40 con 0x7f00081ee4f0 2023-12-08T08:21:54.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.175+0000 7f0004ff9640 1 -- 172.21.15.88:0/3408659431 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00000039a0 con 0x7f00081ee4f0 2023-12-08T08:21:54.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.175+0000 7f000e605640 1 -- 172.21.15.88:0/3408659431 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00081ee9b0 con 0x7f00081ee4f0 2023-12-08T08:21:54.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.175+0000 7f000e605640 1 -- 172.21.15.88:0/3408659431 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00080ab610 con 0x7f00081ee4f0 2023-12-08T08:21:54.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.175+0000 7f000e605640 1 -- 172.21.15.88:0/3408659431 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0008072800 con 0x7f00081ee4f0 2023-12-08T08:21:54.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.175+0000 7f0004ff9640 1 -- 172.21.15.88:0/3408659431 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0000003b20 con 0x7f00081ee4f0 2023-12-08T08:21:54.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.179+0000 7f0004ff9640 1 --2- 172.21.15.88:0/3408659431 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efff4066470 0x7efff4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:54.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.179+0000 7f0004ff9640 1 -- 172.21.15.88:0/3408659431 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f0000084090 con 0x7f00081ee4f0 2023-12-08T08:21:54.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.179+0000 7f0007fff640 1 --2- 172.21.15.88:0/3408659431 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efff4066470 0x7efff4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:54.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.179+0000 7f0007fff640 1 --2- 172.21.15.88:0/3408659431 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efff4066470 0x7efff4068930 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efff80aa000 tx=0x7efff8001a80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:54.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.183+0000 7f0004ff9640 1 -- 172.21.15.88:0/3408659431 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0000051840 con 0x7f00081ee4f0 2023-12-08T08:21:54.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.331+0000 7f000e605640 1 -- 172.21.15.88:0/3408659431 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00080ab800 con 0x7f00081ee4f0 2023-12-08T08:21:54.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.331+0000 7f0004ff9640 1 -- 172.21.15.88:0/3408659431 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+13090 (secure 0 0 0) 0x7f00080ab800 con 0x7f00081ee4f0 2023-12-08T08:21:54.337 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:54.337 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":41,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:21:52.999116+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6836/4274252181":"2023-12-09T08:21:49.680733+0000","172.21.15.88:6834/4274252181":"2023-12-09T08:21:49.680733+0000","172.21.15.88:6837/181654220":"2023-12-09T08:21:42.962792+0000","172.21.15.88:6835/181654220":"2023-12-09T08:21:42.962792+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:21:54.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.335+0000 7f000e605640 1 -- 172.21.15.88:0/3408659431 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efff4066470 msgr2=0x7efff4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:54.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.335+0000 7f000e605640 1 --2- 172.21.15.88:0/3408659431 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efff4066470 0x7efff4068930 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efff80aa000 tx=0x7efff8001a80 comp rx=0 tx=0).stop 2023-12-08T08:21:54.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.335+0000 7f000e605640 1 -- 172.21.15.88:0/3408659431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00081ee4f0 msgr2=0x7f00080a9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:54.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.335+0000 7f000e605640 1 --2- 172.21.15.88:0/3408659431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00081ee4f0 0x7f00080a9bf0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f00080bfcd0 tx=0x7f00000115a0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.335+0000 7f000e605640 1 -- 172.21.15.88:0/3408659431 shutdown_connections 2023-12-08T08:21:54.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.335+0000 7f000e605640 1 --2- 172.21.15.88:0/3408659431 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efff4066470 0x7efff4068930 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.335+0000 7f000e605640 1 --2- 172.21.15.88:0/3408659431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00081ee4f0 0x7f00080a9bf0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.335+0000 7f000e605640 1 --2- 172.21.15.88:0/3408659431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f000814bde0 0x7f00080a96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.335+0000 7f000e605640 1 --2- 172.21.15.88:0/3408659431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efff0003980 0x7f00081edfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.335+0000 7f000e605640 1 -- 172.21.15.88:0/3408659431 >> 172.21.15.88:0/3408659431 conn(0x7f00080a7810 msgr2=0x7f00080c0160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:54.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.335+0000 7f000e605640 1 -- 172.21.15.88:0/3408659431 shutdown_connections 2023-12-08T08:21:54.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.335+0000 7f000e605640 1 -- 172.21.15.88:0/3408659431 wait complete. 2023-12-08T08:21:54.358 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:21:54.359 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:21:54.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.495+0000 7ff0f7df8640 1 Processor -- start 2023-12-08T08:21:54.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.495+0000 7ff0f7df8640 1 -- start start 2023-12-08T08:21:54.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.495+0000 7ff0f7df8640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff0f00c5300 0x7ff0f00a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:54.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.495+0000 7ff0f7df8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff0f01548c0 0x7ff0f0154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:54.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.495+0000 7ff0f7df8640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f00a4e20 con 0x7ff0f014b1e0 2023-12-08T08:21:54.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.495+0000 7ff0f7df8640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f00a50e0 con 0x7ff0f01548c0 2023-12-08T08:21:54.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.495+0000 7ff0f7df8640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f00c0f00 con 0x7ff0f00c5300 2023-12-08T08:21:54.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.499+0000 7ff0f6395640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff0f01548c0 0x7ff0f0154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:54.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.499+0000 7ff0f6395640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff0f01548c0 0x7ff0f0154d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42550/0 (socket says 172.21.15.88:42550) 2023-12-08T08:21:54.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.499+0000 7ff0f6395640 1 -- 172.21.15.88:0/3133802593 learned_addr learned my addr 172.21.15.88:0/3133802593 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:54.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.499+0000 7ff0f5393640 1 --2- 172.21.15.88:0/3133802593 >> v2:172.21.15.148:3300/0 conn(0x7ff0f00c5300 0x7ff0f00a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:54.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.499+0000 7ff0f6395640 1 -- 172.21.15.88:0/3133802593 >> v2:172.21.15.148:3300/0 conn(0x7ff0f00c5300 msgr2=0x7ff0f00a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:54.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.499+0000 7ff0f6395640 1 --2- 172.21.15.88:0/3133802593 >> v2:172.21.15.148:3300/0 conn(0x7ff0f00c5300 0x7ff0f00a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.499+0000 7ff0f6395640 1 -- 172.21.15.88:0/3133802593 >> v1:172.21.15.148:6789/0 conn(0x7ff0f014b1e0 legacy=0x7ff0f00c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:54.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.499+0000 7ff0f6395640 1 -- 172.21.15.88:0/3133802593 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f00c11e0 con 0x7ff0f01548c0 2023-12-08T08:21:54.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.499+0000 7ff0f6395640 1 --2- 172.21.15.88:0/3133802593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0f01548c0 0x7ff0f0154d30 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00a9650 tx=0x7ff0e801ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a5aea11444ee6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:54.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.499+0000 7ff0f4b92640 1 -- 172.21.15.88:0/3133802593 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e80a78c0 con 0x7ff0f01548c0 2023-12-08T08:21:54.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.499+0000 7ff0f4b92640 1 -- 172.21.15.88:0/3133802593 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e80a7a20 con 0x7ff0f01548c0 2023-12-08T08:21:54.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.499+0000 7ff0f4b92640 1 -- 172.21.15.88:0/3133802593 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e80a7db0 con 0x7ff0f01548c0 2023-12-08T08:21:54.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.503+0000 7ff0f7df8640 1 -- 172.21.15.88:0/3133802593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0f01548c0 msgr2=0x7ff0f0154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:54.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.503+0000 7ff0f7df8640 1 --2- 172.21.15.88:0/3133802593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0f01548c0 0x7ff0f0154d30 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00a9650 tx=0x7ff0e801ebe0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.503+0000 7ff0f7df8640 1 -- 172.21.15.88:0/3133802593 shutdown_connections 2023-12-08T08:21:54.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.503+0000 7ff0f7df8640 1 --2- 172.21.15.88:0/3133802593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0f01548c0 0x7ff0f0154d30 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.503+0000 7ff0f7df8640 1 --2- 172.21.15.88:0/3133802593 >> v2:172.21.15.148:3300/0 conn(0x7ff0f00c5300 0x7ff0f00a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.503+0000 7ff0f7df8640 1 -- 172.21.15.88:0/3133802593 >> 172.21.15.88:0/3133802593 conn(0x7ff0f00c59f0 msgr2=0x7ff0f00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:54.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.503+0000 7ff0f7df8640 1 -- 172.21.15.88:0/3133802593 shutdown_connections 2023-12-08T08:21:54.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.503+0000 7ff0f7df8640 1 -- 172.21.15.88:0/3133802593 wait complete. 2023-12-08T08:21:54.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.503+0000 7ff0f7df8640 1 Processor -- start 2023-12-08T08:21:54.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.503+0000 7ff0f7df8640 1 -- start start 2023-12-08T08:21:54.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.503+0000 7ff0f7df8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff0f00c5300 0x7ff0f01423e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:54.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.503+0000 7ff0f7df8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0f014b1e0 0x7ff0f013c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:54.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.503+0000 7ff0f7df8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0f01548c0 0x7ff0f013c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:54.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.503+0000 7ff0f7df8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f013fa80 con 0x7ff0f01548c0 2023-12-08T08:21:54.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.503+0000 7ff0f7df8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f0140590 con 0x7ff0f014b1e0 2023-12-08T08:21:54.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.503+0000 7ff0f7df8640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f0146830 con 0x7ff0f00c5300 2023-12-08T08:21:54.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.503+0000 7ff0f6395640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0f01548c0 0x7ff0f013c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:54.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.503+0000 7ff0f6395640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0f01548c0 0x7ff0f013c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42560/0 (socket says 172.21.15.88:42560) 2023-12-08T08:21:54.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.503+0000 7ff0f6395640 1 -- 172.21.15.88:0/860971440 learned_addr learned my addr 172.21.15.88:0/860971440 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:54.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.503+0000 7ff0f5393640 1 --2- 172.21.15.88:0/860971440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0f014b1e0 0x7ff0f013c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:54.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.503+0000 7ff0f5b94640 1 --2- 172.21.15.88:0/860971440 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff0f00c5300 0x7ff0f01423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:54.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.503+0000 7ff0f6395640 1 -- 172.21.15.88:0/860971440 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff0f00c5300 msgr2=0x7ff0f01423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:54.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.503+0000 7ff0f6395640 1 --2- 172.21.15.88:0/860971440 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff0f00c5300 0x7ff0f01423e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.503+0000 7ff0f6395640 1 -- 172.21.15.88:0/860971440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0f014b1e0 msgr2=0x7ff0f013c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:54.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.503+0000 7ff0f6395640 1 --2- 172.21.15.88:0/860971440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0f014b1e0 0x7ff0f013c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.503+0000 7ff0f6395640 1 -- 172.21.15.88:0/860971440 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e8009b30 con 0x7ff0f01548c0 2023-12-08T08:21:54.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.503+0000 7ff0f6395640 1 --2- 172.21.15.88:0/860971440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0f01548c0 0x7ff0f013c6f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80b1040 tx=0x7ff0e801b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:54.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.507+0000 7ff0e67fc640 1 -- 172.21.15.88:0/860971440 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e800e150 con 0x7ff0f01548c0 2023-12-08T08:21:54.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.507+0000 7ff0e67fc640 1 -- 172.21.15.88:0/860971440 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e80073f0 con 0x7ff0f01548c0 2023-12-08T08:21:54.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.507+0000 7ff0e67fc640 1 -- 172.21.15.88:0/860971440 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8007780 con 0x7ff0f01548c0 2023-12-08T08:21:54.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.507+0000 7ff0f7df8640 1 -- 172.21.15.88:0/860971440 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f013cc30 con 0x7ff0f01548c0 2023-12-08T08:21:54.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.507+0000 7ff0f7df8640 1 -- 172.21.15.88:0/860971440 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f013ff40 con 0x7ff0f01548c0 2023-12-08T08:21:54.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.507+0000 7ff0f7df8640 1 -- 172.21.15.88:0/860971440 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f0067630 con 0x7ff0f01548c0 2023-12-08T08:21:54.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.507+0000 7ff0e67fc640 1 -- 172.21.15.88:0/860971440 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff0e80078e0 con 0x7ff0f01548c0 2023-12-08T08:21:54.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.507+0000 7ff0e67fc640 1 --2- 172.21.15.88:0/860971440 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff0d40664a0 0x7ff0d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:54.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.507+0000 7ff0e67fc640 1 -- 172.21.15.88:0/860971440 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ff0e811dcf0 con 0x7ff0f01548c0 2023-12-08T08:21:54.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.507+0000 7ff0f5b94640 1 --2- 172.21.15.88:0/860971440 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff0d40664a0 0x7ff0d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:54.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.507+0000 7ff0f5b94640 1 --2- 172.21.15.88:0/860971440 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff0d40664a0 0x7ff0d4068960 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec000f70 tx=0x7ff0ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:54.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.511+0000 7ff0e67fc640 1 -- 172.21.15.88:0/860971440 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff0e80eb370 con 0x7ff0f01548c0 2023-12-08T08:21:54.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.663+0000 7ff0f7df8640 1 -- 172.21.15.88:0/860971440 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff0f01406d0 con 0x7ff0f01548c0 2023-12-08T08:21:54.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.663+0000 7ff0e67fc640 1 -- 172.21.15.88:0/860971440 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff0e80ee990 con 0x7ff0f01548c0 2023-12-08T08:21:54.667 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:21:54.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.663+0000 7ff0f7df8640 1 -- 172.21.15.88:0/860971440 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff0d40664a0 msgr2=0x7ff0d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:54.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.663+0000 7ff0f7df8640 1 --2- 172.21.15.88:0/860971440 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff0d40664a0 0x7ff0d4068960 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec000f70 tx=0x7ff0ec009040 comp rx=0 tx=0).stop 2023-12-08T08:21:54.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.663+0000 7ff0f7df8640 1 -- 172.21.15.88:0/860971440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0f01548c0 msgr2=0x7ff0f013c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:54.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.663+0000 7ff0f7df8640 1 --2- 172.21.15.88:0/860971440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0f01548c0 0x7ff0f013c6f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80b1040 tx=0x7ff0e801b980 comp rx=0 tx=0).stop 2023-12-08T08:21:54.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.663+0000 7ff0f7df8640 1 -- 172.21.15.88:0/860971440 shutdown_connections 2023-12-08T08:21:54.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.663+0000 7ff0f7df8640 1 --2- 172.21.15.88:0/860971440 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff0d40664a0 0x7ff0d4068960 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.663+0000 7ff0f7df8640 1 --2- 172.21.15.88:0/860971440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0f01548c0 0x7ff0f013c6f0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.663+0000 7ff0f7df8640 1 --2- 172.21.15.88:0/860971440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0f014b1e0 0x7ff0f013c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.663+0000 7ff0f7df8640 1 --2- 172.21.15.88:0/860971440 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff0f00c5300 0x7ff0f01423e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.663+0000 7ff0f7df8640 1 -- 172.21.15.88:0/860971440 >> 172.21.15.88:0/860971440 conn(0x7ff0f00c59f0 msgr2=0x7ff0f00aa3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:54.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.663+0000 7ff0f7df8640 1 -- 172.21.15.88:0/860971440 shutdown_connections 2023-12-08T08:21:54.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.663+0000 7ff0f7df8640 1 -- 172.21.15.88:0/860971440 wait complete. 2023-12-08T08:21:54.688 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2023-12-08T08:21:54.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f9194f2a640 1 Processor -- start 2023-12-08T08:21:54.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f9194f2a640 1 -- start start 2023-12-08T08:21:54.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f9194f2a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f91900af4c0 0x7f9190154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:54.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f9194f2a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f919006c100 0x7f91900c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:54.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f9194f2a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91900c4890 con 0x7f91900c67d0 2023-12-08T08:21:54.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f9194f2a640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9190155460 con 0x7f91900af4c0 2023-12-08T08:21:54.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f9194f2a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91900af8a0 con 0x7f919006c100 2023-12-08T08:21:54.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918dd9b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f91900c67d0 0x7f919006b9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51124/0 (socket says 172.21.15.88:51124) 2023-12-08T08:21:54.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918dd9b640 1 -- 172.21.15.88:0/4105642612 learned_addr learned my addr 172.21.15.88:0/4105642612 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:54.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918e59c640 1 --2- 172.21.15.88:0/4105642612 >> v2:172.21.15.148:3300/0 conn(0x7f91900af4c0 0x7f9190154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:54.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918ed9d640 1 --2- 172.21.15.88:0/4105642612 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f919006c100 0x7f91900c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:54.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918d59a640 1 -- 172.21.15.88:0/4105642612 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3849354018 0 0) 0x7f91900c4890 con 0x7f91900c67d0 2023-12-08T08:21:54.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918d59a640 1 -- 172.21.15.88:0/4105642612 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9178003530 con 0x7f91900c67d0 2023-12-08T08:21:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918d59a640 1 -- 172.21.15.88:0/4105642612 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3246328571 0 0) 0x7f9178003530 con 0x7f91900c67d0 2023-12-08T08:21:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918d59a640 1 -- 172.21.15.88:0/4105642612 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f919006c100 msgr2=0x7f91900c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918d59a640 1 --2- 172.21.15.88:0/4105642612 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f919006c100 0x7f91900c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918d59a640 1 -- 172.21.15.88:0/4105642612 >> v2:172.21.15.148:3300/0 conn(0x7f91900af4c0 msgr2=0x7f9190154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918d59a640 1 --2- 172.21.15.88:0/4105642612 >> v2:172.21.15.148:3300/0 conn(0x7f91900af4c0 0x7f9190154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918d59a640 1 -- 172.21.15.88:0/4105642612 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91900c4b30 con 0x7f91900c67d0 2023-12-08T08:21:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918d59a640 1 -- 172.21.15.88:0/4105642612 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f9184001680 con 0x7f91900c67d0 2023-12-08T08:21:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918d59a640 1 -- 172.21.15.88:0/4105642612 >> v1:172.21.15.88:6789/0 conn(0x7f91900c67d0 legacy=0x7f919006b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918d59a640 1 --2- 172.21.15.88:0/4105642612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9178003980 0x7f9178003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918d59a640 1 --2- 172.21.15.88:0/4105642612 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91780047d0 0x7f9178004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918d59a640 1 --2- 172.21.15.88:0/4105642612 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f919006c100 0x7f9178005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918d59a640 1 -- 172.21.15.88:0/4105642612 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9190155460 con 0x7f91780047d0 2023-12-08T08:21:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918d59a640 1 -- 172.21.15.88:0/4105642612 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91900af8a0 con 0x7f9178003980 2023-12-08T08:21:54.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918d59a640 1 -- 172.21.15.88:0/4105642612 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917800b990 con 0x7f919006c100 2023-12-08T08:21:54.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918dd9b640 1 --2- 172.21.15.88:0/4105642612 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91780047d0 0x7f9178004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:54.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918e59c640 1 --2- 172.21.15.88:0/4105642612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9178003980 0x7f9178003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:54.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918ed9d640 1 --2- 172.21.15.88:0/4105642612 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f919006c100 0x7f9178005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:54.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918dd9b640 1 -- 172.21.15.88:0/4105642612 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f919006c100 msgr2=0x7f9178005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:54.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918dd9b640 1 --2- 172.21.15.88:0/4105642612 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f919006c100 0x7f9178005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918dd9b640 1 -- 172.21.15.88:0/4105642612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9178003980 msgr2=0x7f9178003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:54.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918dd9b640 1 --2- 172.21.15.88:0/4105642612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9178003980 0x7f9178003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.823+0000 7f918dd9b640 1 -- 172.21.15.88:0/4105642612 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9178003530 con 0x7f91780047d0 2023-12-08T08:21:54.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.827+0000 7f918dd9b640 1 --2- 172.21.15.88:0/4105642612 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91780047d0 0x7f9178004c50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f918400c240 tx=0x7f918401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe395c88d73103 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:54.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.827+0000 7f918d59a640 1 -- 172.21.15.88:0/4105642612 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91840058e0 con 0x7f91780047d0 2023-12-08T08:21:54.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.827+0000 7f918d59a640 1 -- 172.21.15.88:0/4105642612 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9184005a40 con 0x7f91780047d0 2023-12-08T08:21:54.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.827+0000 7f918d59a640 1 -- 172.21.15.88:0/4105642612 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9184005e10 con 0x7f91780047d0 2023-12-08T08:21:54.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.827+0000 7f9194f2a640 1 -- 172.21.15.88:0/4105642612 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91780047d0 msgr2=0x7f9178004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:54.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.827+0000 7f9194f2a640 1 --2- 172.21.15.88:0/4105642612 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91780047d0 0x7f9178004c50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f918400c240 tx=0x7f918401cc10 comp rx=0 tx=0).stop 2023-12-08T08:21:54.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.827+0000 7f918ed9d640 1 -- 172.21.15.88:0/4105642612 reap_dead start 2023-12-08T08:21:54.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.827+0000 7f9194f2a640 1 -- 172.21.15.88:0/4105642612 shutdown_connections 2023-12-08T08:21:54.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.827+0000 7f9194f2a640 1 -- 172.21.15.88:0/4105642612 >> 172.21.15.88:0/4105642612 conn(0x7f91900ab9d0 msgr2=0x7f91900abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:54.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.827+0000 7f9194f2a640 1 -- 172.21.15.88:0/4105642612 shutdown_connections 2023-12-08T08:21:54.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.827+0000 7f9194f2a640 1 -- 172.21.15.88:0/4105642612 wait complete. 2023-12-08T08:21:54.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.831+0000 7f9194f2a640 1 Processor -- start 2023-12-08T08:21:54.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.831+0000 7f9194f2a640 1 -- start start 2023-12-08T08:21:54.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.831+0000 7f9194f2a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91780047d0 0x7f9190159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:54.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.831+0000 7f9194f2a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9190153fa0 0x7f919015a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:54.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.831+0000 7f9194f2a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f919015a5d0 0x7f919015aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:54.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.831+0000 7f9194f2a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91901550a0 con 0x7f91780047d0 2023-12-08T08:21:54.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.831+0000 7f9194f2a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9190154d50 con 0x7f9190153fa0 2023-12-08T08:21:54.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.831+0000 7f9194f2a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91901539e0 con 0x7f919015a5d0 2023-12-08T08:21:54.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.831+0000 7f918e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91780047d0 0x7f9190159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:54.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.831+0000 7f918e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91780047d0 0x7f9190159050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42564/0 (socket says 172.21.15.88:42564) 2023-12-08T08:21:54.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.831+0000 7f918e59c640 1 -- 172.21.15.88:0/1316569005 learned_addr learned my addr 172.21.15.88:0/1316569005 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:54.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.831+0000 7f918dd9b640 1 --2- 172.21.15.88:0/1316569005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9190153fa0 0x7f919015a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:54.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.831+0000 7f918ed9d640 1 --2- 172.21.15.88:0/1316569005 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f919015a5d0 0x7f919015aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:54.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.831+0000 7f918e59c640 1 -- 172.21.15.88:0/1316569005 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f919015a5d0 msgr2=0x7f919015aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:54.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.831+0000 7f918e59c640 1 --2- 172.21.15.88:0/1316569005 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f919015a5d0 0x7f919015aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.831+0000 7f918e59c640 1 -- 172.21.15.88:0/1316569005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9190153fa0 msgr2=0x7f919015a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:54.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.831+0000 7f918e59c640 1 --2- 172.21.15.88:0/1316569005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9190153fa0 0x7f919015a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:54.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.831+0000 7f918e59c640 1 -- 172.21.15.88:0/1316569005 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9190153cc0 con 0x7f91780047d0 2023-12-08T08:21:54.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.831+0000 7f918dd9b640 1 --2- 172.21.15.88:0/1316569005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9190153fa0 0x7f919015a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:54.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.831+0000 7f918e59c640 1 --2- 172.21.15.88:0/1316569005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91780047d0 0x7f9190159050 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f91800119d0 tx=0x7f9180011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:54.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.831+0000 7f917effd640 1 -- 172.21.15.88:0/1316569005 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918000fb50 con 0x7f91780047d0 2023-12-08T08:21:54.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.831+0000 7f917effd640 1 -- 172.21.15.88:0/1316569005 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918000fcb0 con 0x7f91780047d0 2023-12-08T08:21:54.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.831+0000 7f917effd640 1 -- 172.21.15.88:0/1316569005 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9180014440 con 0x7f91780047d0 2023-12-08T08:21:54.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.831+0000 7f9194f2a640 1 -- 172.21.15.88:0/1316569005 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9190159590 con 0x7f91780047d0 2023-12-08T08:21:54.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.831+0000 7f9194f2a640 1 -- 172.21.15.88:0/1316569005 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919015b5f0 con 0x7f91780047d0 2023-12-08T08:21:54.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.835+0000 7f9194f2a640 1 -- 172.21.15.88:0/1316569005 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9190154ec0 con 0x7f91780047d0 2023-12-08T08:21:54.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.835+0000 7f917effd640 1 -- 172.21.15.88:0/1316569005 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f91800145a0 con 0x7f91780047d0 2023-12-08T08:21:54.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.835+0000 7f917effd640 1 --2- 172.21.15.88:0/1316569005 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f91700664a0 0x7f9170068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:54.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.835+0000 7f917effd640 1 -- 172.21.15.88:0/1316569005 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f9180084480 con 0x7f91780047d0 2023-12-08T08:21:54.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.835+0000 7f918dd9b640 1 --2- 172.21.15.88:0/1316569005 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f91700664a0 0x7f9170068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:54.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.835+0000 7f918dd9b640 1 --2- 172.21.15.88:0/1316569005 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f91700664a0 0x7f9170068960 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f91840aa000 tx=0x7f9184001a10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:54.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:54.839+0000 7f917effd640 1 -- 172.21.15.88:0/1316569005 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9180051c50 con 0x7f91780047d0 2023-12-08T08:21:55.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:55.043+0000 7f9194f2a640 1 -- 172.21.15.88:0/1316569005 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7f9190067630 con 0x7f91780047d0 2023-12-08T08:21:56.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.015+0000 7f917effd640 1 -- 172.21.15.88:0/1316569005 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v115) v1 ==== 187+0+0 (secure 0 0 0) 0x7f9180055270 con 0x7f91780047d0 2023-12-08T08:21:56.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.015+0000 7f9194f2a640 1 -- 172.21.15.88:0/1316569005 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f91700664a0 msgr2=0x7f9170068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:56.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.015+0000 7f9194f2a640 1 --2- 172.21.15.88:0/1316569005 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f91700664a0 0x7f9170068960 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f91840aa000 tx=0x7f9184001a10 comp rx=0 tx=0).stop 2023-12-08T08:21:56.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.015+0000 7f9194f2a640 1 -- 172.21.15.88:0/1316569005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91780047d0 msgr2=0x7f9190159050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:56.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.015+0000 7f9194f2a640 1 --2- 172.21.15.88:0/1316569005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91780047d0 0x7f9190159050 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f91800119d0 tx=0x7f9180011e90 comp rx=0 tx=0).stop 2023-12-08T08:21:56.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.015+0000 7f9194f2a640 1 -- 172.21.15.88:0/1316569005 shutdown_connections 2023-12-08T08:21:56.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.015+0000 7f9194f2a640 1 --2- 172.21.15.88:0/1316569005 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f91700664a0 0x7f9170068960 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:56.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.015+0000 7f9194f2a640 1 --2- 172.21.15.88:0/1316569005 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f919015a5d0 0x7f919015aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:56.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.015+0000 7f9194f2a640 1 --2- 172.21.15.88:0/1316569005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9190153fa0 0x7f919015a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:56.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.015+0000 7f9194f2a640 1 --2- 172.21.15.88:0/1316569005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91780047d0 0x7f9190159050 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:56.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.015+0000 7f9194f2a640 1 -- 172.21.15.88:0/1316569005 >> 172.21.15.88:0/1316569005 conn(0x7f91900ab9d0 msgr2=0x7f9190156f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:56.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.015+0000 7f9194f2a640 1 -- 172.21.15.88:0/1316569005 shutdown_connections 2023-12-08T08:21:56.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.015+0000 7f9194f2a640 1 -- 172.21.15.88:0/1316569005 wait complete. 2023-12-08T08:21:56.044 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-08T08:21:56.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.183+0000 7ffbe50c9640 1 Processor -- start 2023-12-08T08:21:56.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.183+0000 7ffbe50c9640 1 -- start start 2023-12-08T08:21:56.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.183+0000 7ffbe50c9640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ffbe014b1e0 0x7ffbe00c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:56.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.183+0000 7ffbe50c9640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbe00c5300 0x7ffbe00a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:56.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.183+0000 7ffbe50c9640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe00a4e20 con 0x7ffbe0151280 2023-12-08T08:21:56.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.183+0000 7ffbe50c9640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe01558d0 con 0x7ffbe014b1e0 2023-12-08T08:21:56.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.183+0000 7ffbe50c9640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe00a50e0 con 0x7ffbe00c5300 2023-12-08T08:21:56.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.183+0000 7ffbded9d640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ffbe014b1e0 0x7ffbe00c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:56.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.183+0000 7ffbde59c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbe00c5300 0x7ffbe00a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:56.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.187+0000 7ffbde59c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbe00c5300 0x7ffbe00a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:55144/0 (socket says 172.21.15.88:55144) 2023-12-08T08:21:56.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.187+0000 7ffbde59c640 1 -- 172.21.15.88:0/378533917 learned_addr learned my addr 172.21.15.88:0/378533917 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:56.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.187+0000 7ffbded9d640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ffbe014b1e0 0x7ffbe00c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:36666/0 (socket says 172.21.15.88:36666) 2023-12-08T08:21:56.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.187+0000 7ffbded9d640 1 -- 172.21.15.88:0/378533917 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbe00c5300 msgr2=0x7ffbe00a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:56.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.187+0000 7ffbded9d640 1 --2- 172.21.15.88:0/378533917 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbe00c5300 0x7ffbe00a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:56.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.187+0000 7ffbded9d640 1 -- 172.21.15.88:0/378533917 >> v1:172.21.15.148:6789/0 conn(0x7ffbe0151280 legacy=0x7ffbe0151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:56.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.187+0000 7ffbded9d640 1 -- 172.21.15.88:0/378533917 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe00c0f00 con 0x7ffbe014b1e0 2023-12-08T08:21:56.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.187+0000 7ffbde59c640 1 --2- 172.21.15.88:0/378533917 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbe00c5300 0x7ffbe00a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:21:56.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.187+0000 7ffbddd9b640 1 -- 172.21.15.88:0/378533917 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 879965021 0 0) 0x7ffbe00a4e20 con 0x7ffbe0151280 2023-12-08T08:21:56.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.187+0000 7ffbded9d640 1 --2- 172.21.15.88:0/378533917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbe014b1e0 0x7ffbe00c1700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00097c0 tx=0x7ffbd001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd0f74ff0f5a6612 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:56.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.187+0000 7ffbddd9b640 1 -- 172.21.15.88:0/378533917 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd00ad640 con 0x7ffbe014b1e0 2023-12-08T08:21:56.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.187+0000 7ffbddd9b640 1 -- 172.21.15.88:0/378533917 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd00ad7a0 con 0x7ffbe014b1e0 2023-12-08T08:21:56.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.187+0000 7ffbddd9b640 1 -- 172.21.15.88:0/378533917 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd00adb30 con 0x7ffbe014b1e0 2023-12-08T08:21:56.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.191+0000 7ffbe50c9640 1 -- 172.21.15.88:0/378533917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbe014b1e0 msgr2=0x7ffbe00c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:56.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.191+0000 7ffbe50c9640 1 --2- 172.21.15.88:0/378533917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbe014b1e0 0x7ffbe00c1700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00097c0 tx=0x7ffbd001c480 comp rx=0 tx=0).stop 2023-12-08T08:21:56.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.191+0000 7ffbe50c9640 1 -- 172.21.15.88:0/378533917 shutdown_connections 2023-12-08T08:21:56.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.191+0000 7ffbe50c9640 1 --2- 172.21.15.88:0/378533917 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbe00c5300 0x7ffbe00a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:56.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.191+0000 7ffbe50c9640 1 --2- 172.21.15.88:0/378533917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbe014b1e0 0x7ffbe00c1700 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:56.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.191+0000 7ffbe50c9640 1 -- 172.21.15.88:0/378533917 >> 172.21.15.88:0/378533917 conn(0x7ffbe00c59f0 msgr2=0x7ffbe00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:56.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.191+0000 7ffbe50c9640 1 -- 172.21.15.88:0/378533917 shutdown_connections 2023-12-08T08:21:56.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.191+0000 7ffbe50c9640 1 -- 172.21.15.88:0/378533917 wait complete. 2023-12-08T08:21:56.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.191+0000 7ffbe50c9640 1 Processor -- start 2023-12-08T08:21:56.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.191+0000 7ffbe50c9640 1 -- start start 2023-12-08T08:21:56.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.191+0000 7ffbe50c9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbe00c5300 0x7ffbe006d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:56.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.191+0000 7ffbe50c9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbe014b1e0 0x7ffbe0143060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:56.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.191+0000 7ffbe50c9640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbe0151280 0x7ffbe00a56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:56.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.191+0000 7ffbe50c9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe006d940 con 0x7ffbe00c5300 2023-12-08T08:21:56.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.191+0000 7ffbe50c9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe006d660 con 0x7ffbe014b1e0 2023-12-08T08:21:56.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.191+0000 7ffbe50c9640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe0148e60 con 0x7ffbe0151280 2023-12-08T08:21:56.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.191+0000 7ffbded9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbe00c5300 0x7ffbe006d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:56.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.191+0000 7ffbded9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbe00c5300 0x7ffbe006d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42566/0 (socket says 172.21.15.88:42566) 2023-12-08T08:21:56.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.191+0000 7ffbded9d640 1 -- 172.21.15.88:0/3352066603 learned_addr learned my addr 172.21.15.88:0/3352066603 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:56.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.191+0000 7ffbdf59e640 1 --2- 172.21.15.88:0/3352066603 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbe0151280 0x7ffbe00a56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:56.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.191+0000 7ffbde59c640 1 --2- 172.21.15.88:0/3352066603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbe014b1e0 0x7ffbe0143060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:56.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.195+0000 7ffbded9d640 1 -- 172.21.15.88:0/3352066603 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbe0151280 msgr2=0x7ffbe00a56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:56.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.195+0000 7ffbded9d640 1 --2- 172.21.15.88:0/3352066603 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbe0151280 0x7ffbe00a56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:56.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.195+0000 7ffbded9d640 1 -- 172.21.15.88:0/3352066603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbe014b1e0 msgr2=0x7ffbe0143060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:56.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.195+0000 7ffbded9d640 1 --2- 172.21.15.88:0/3352066603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbe014b1e0 0x7ffbe0143060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:56.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.195+0000 7ffbded9d640 1 -- 172.21.15.88:0/3352066603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd40094d0 con 0x7ffbe00c5300 2023-12-08T08:21:56.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.195+0000 7ffbde59c640 1 --2- 172.21.15.88:0/3352066603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbe014b1e0 0x7ffbe0143060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:56.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.195+0000 7ffbdf59e640 1 --2- 172.21.15.88:0/3352066603 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbe0151280 0x7ffbe00a56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:56.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.195+0000 7ffbded9d640 1 --2- 172.21.15.88:0/3352066603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbe00c5300 0x7ffbe006d020 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00b0040 tx=0x7ffbd0019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:56.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.195+0000 7ffbc77fe640 1 -- 172.21.15.88:0/3352066603 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd00b6610 con 0x7ffbe00c5300 2023-12-08T08:21:56.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.195+0000 7ffbc77fe640 1 -- 172.21.15.88:0/3352066603 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd00a6040 con 0x7ffbe00c5300 2023-12-08T08:21:56.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.195+0000 7ffbe50c9640 1 -- 172.21.15.88:0/3352066603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd0009420 con 0x7ffbe00c5300 2023-12-08T08:21:56.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.195+0000 7ffbc77fe640 1 -- 172.21.15.88:0/3352066603 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd00b6990 con 0x7ffbe00c5300 2023-12-08T08:21:56.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.195+0000 7ffbe50c9640 1 -- 172.21.15.88:0/3352066603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe0149420 con 0x7ffbe00c5300 2023-12-08T08:21:56.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.195+0000 7ffbe50c9640 1 -- 172.21.15.88:0/3352066603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe0148ca0 con 0x7ffbe00c5300 2023-12-08T08:21:56.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.195+0000 7ffbc77fe640 1 -- 172.21.15.88:0/3352066603 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffbd00b4040 con 0x7ffbe00c5300 2023-12-08T08:21:56.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.199+0000 7ffbc77fe640 1 --2- 172.21.15.88:0/3352066603 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffbcc066470 0x7ffbcc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:56.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.199+0000 7ffbc77fe640 1 -- 172.21.15.88:0/3352066603 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ffbd011dd90 con 0x7ffbe00c5300 2023-12-08T08:21:56.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.199+0000 7ffbde59c640 1 --2- 172.21.15.88:0/3352066603 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffbcc066470 0x7ffbcc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:56.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.199+0000 7ffbde59c640 1 --2- 172.21.15.88:0/3352066603 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffbcc066470 0x7ffbcc068930 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ffbe015bc20 tx=0x7ffbd4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:56.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.203+0000 7ffbc77fe640 1 -- 172.21.15.88:0/3352066603 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffbd00eb410 con 0x7ffbe00c5300 2023-12-08T08:21:56.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.351+0000 7ffbe50c9640 1 -- 172.21.15.88:0/3352066603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ffbe0067610 con 0x7ffbe00c5300 2023-12-08T08:21:56.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.355+0000 7ffbc77fe640 1 -- 172.21.15.88:0/3352066603 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7ffbd00b2020 con 0x7ffbe00c5300 2023-12-08T08:21:56.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.359+0000 7ffbe50c9640 1 -- 172.21.15.88:0/3352066603 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffbcc066470 msgr2=0x7ffbcc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:56.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.359+0000 7ffbe50c9640 1 --2- 172.21.15.88:0/3352066603 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffbcc066470 0x7ffbcc068930 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ffbe015bc20 tx=0x7ffbd4008040 comp rx=0 tx=0).stop 2023-12-08T08:21:56.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.359+0000 7ffbe50c9640 1 -- 172.21.15.88:0/3352066603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbe00c5300 msgr2=0x7ffbe006d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:56.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.359+0000 7ffbe50c9640 1 --2- 172.21.15.88:0/3352066603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbe00c5300 0x7ffbe006d020 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00b0040 tx=0x7ffbd0019220 comp rx=0 tx=0).stop 2023-12-08T08:21:56.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.359+0000 7ffbe50c9640 1 -- 172.21.15.88:0/3352066603 shutdown_connections 2023-12-08T08:21:56.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.359+0000 7ffbe50c9640 1 --2- 172.21.15.88:0/3352066603 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffbcc066470 0x7ffbcc068930 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:56.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.359+0000 7ffbe50c9640 1 --2- 172.21.15.88:0/3352066603 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffbe0151280 0x7ffbe00a56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:56.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.359+0000 7ffbe50c9640 1 --2- 172.21.15.88:0/3352066603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbe014b1e0 0x7ffbe0143060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:56.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.359+0000 7ffbe50c9640 1 --2- 172.21.15.88:0/3352066603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffbe00c5300 0x7ffbe006d020 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:56.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.359+0000 7ffbe50c9640 1 -- 172.21.15.88:0/3352066603 >> 172.21.15.88:0/3352066603 conn(0x7ffbe00c59f0 msgr2=0x7ffbe00c4180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:56.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.359+0000 7ffbe50c9640 1 -- 172.21.15.88:0/3352066603 shutdown_connections 2023-12-08T08:21:56.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.359+0000 7ffbe50c9640 1 -- 172.21.15.88:0/3352066603 wait complete. 2023-12-08T08:21:56.382 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-08T08:21:56.382 DEBUG:teuthology.orchestra.run.smithi088:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:21:56.472 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:21:56.557 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-08T08:21:56.557 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:21:56.557 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:21:56.566 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5383 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-08T08:21:56.566 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:21:56.566 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:21:56.575 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354676k,nr_inodes=4088669,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9389 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-08T08:21:56.575 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-12-08T08:21:56.576 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:21:56.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.739+0000 7f92072fe640 1 Processor -- start 2023-12-08T08:21:56.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.739+0000 7f92072fe640 1 -- start start 2023-12-08T08:21:56.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.739+0000 7f92072fe640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f920006d2b0 0x7f920006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:56.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.739+0000 7f92072fe640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f920006bb80 con 0x7f92000c5300 2023-12-08T08:21:56.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.739+0000 7f92072fe640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92000c5790 con 0x7f92000c3b80 2023-12-08T08:21:56.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.739+0000 7f92072fe640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92001515c0 con 0x7f920006d2b0 2023-12-08T08:21:56.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.743+0000 7f920589b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f92000c5300 0x7f920006c730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51132/0 (socket says 172.21.15.88:51132) 2023-12-08T08:21:56.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.743+0000 7f920589b640 1 -- 172.21.15.88:0/4010990192 learned_addr learned my addr 172.21.15.88:0/4010990192 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:56.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.743+0000 7f920509a640 1 --2- 172.21.15.88:0/4010990192 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f920006d2b0 0x7f920006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:56.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.743+0000 7f91f7fff640 1 -- 172.21.15.88:0/4010990192 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4263186282 0 0) 0x7f920006bb80 con 0x7f92000c5300 2023-12-08T08:21:56.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.743+0000 7f91f7fff640 1 -- 172.21.15.88:0/4010990192 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91ec003530 con 0x7f92000c5300 2023-12-08T08:21:56.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.743+0000 7f91f7fff640 1 -- 172.21.15.88:0/4010990192 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3287392470 0 0) 0x7f91ec003530 con 0x7f92000c5300 2023-12-08T08:21:56.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.743+0000 7f91f7fff640 1 -- 172.21.15.88:0/4010990192 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f920006d2b0 msgr2=0x7f920006d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:56.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.743+0000 7f91f7fff640 1 --2- 172.21.15.88:0/4010990192 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f920006d2b0 0x7f920006d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:56.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.743+0000 7f91f7fff640 1 -- 172.21.15.88:0/4010990192 >> v1:172.21.15.148:6789/0 conn(0x7f92000c3b80 legacy=0x7f920006c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:56.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.743+0000 7f91f7fff640 1 -- 172.21.15.88:0/4010990192 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92001518a0 con 0x7f92000c5300 2023-12-08T08:21:56.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.743+0000 7f91f7fff640 1 -- 172.21.15.88:0/4010990192 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f91f8001a00 con 0x7f92000c5300 2023-12-08T08:21:56.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.743+0000 7f91f7fff640 1 -- 172.21.15.88:0/4010990192 >> v1:172.21.15.88:6789/0 conn(0x7f92000c5300 legacy=0x7f920006c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:56.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.743+0000 7f91f7fff640 1 --2- 172.21.15.88:0/4010990192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91ec0039b0 0x7f91ec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:56.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.743+0000 7f91f7fff640 1 --2- 172.21.15.88:0/4010990192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91ec0047d0 0x7f91ec004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:56.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.743+0000 7f91f7fff640 1 --2- 172.21.15.88:0/4010990192 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f920006d2b0 0x7f91ec005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:56.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.743+0000 7f91f7fff640 1 -- 172.21.15.88:0/4010990192 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92001515c0 con 0x7f91ec0039b0 2023-12-08T08:21:56.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.743+0000 7f91f7fff640 1 -- 172.21.15.88:0/4010990192 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec00ba70 con 0x7f91ec0047d0 2023-12-08T08:21:56.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.743+0000 7f91f7fff640 1 -- 172.21.15.88:0/4010990192 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec00de40 con 0x7f920006d2b0 2023-12-08T08:21:56.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.743+0000 7f920509a640 1 --2- 172.21.15.88:0/4010990192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91ec0039b0 0x7f91ec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:56.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.743+0000 7f9204899640 1 --2- 172.21.15.88:0/4010990192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91ec0047d0 0x7f91ec004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:56.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.743+0000 7f920589b640 1 --2- 172.21.15.88:0/4010990192 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f920006d2b0 0x7f91ec005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:56.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.743+0000 7f920509a640 1 -- 172.21.15.88:0/4010990192 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f920006d2b0 msgr2=0x7f91ec005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:56.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.743+0000 7f920509a640 1 --2- 172.21.15.88:0/4010990192 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f920006d2b0 0x7f91ec005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:56.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.743+0000 7f920509a640 1 -- 172.21.15.88:0/4010990192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91ec0047d0 msgr2=0x7f91ec004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:56.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.743+0000 7f920509a640 1 --2- 172.21.15.88:0/4010990192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91ec0047d0 0x7f91ec004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:56.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.743+0000 7f920509a640 1 -- 172.21.15.88:0/4010990192 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ec003530 con 0x7f91ec0039b0 2023-12-08T08:21:56.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.743+0000 7f9204899640 1 --2- 172.21.15.88:0/4010990192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91ec0047d0 0x7f91ec004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:56.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.747+0000 7f920509a640 1 --2- 172.21.15.88:0/4010990192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91ec0039b0 0x7f91ec003dd0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009ab0 tx=0x7f91fc01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4e6dee26ee471c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:56.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.747+0000 7f91f7fff640 1 -- 172.21.15.88:0/4010990192 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc0a8430 con 0x7f91ec0039b0 2023-12-08T08:21:56.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.747+0000 7f91f7fff640 1 -- 172.21.15.88:0/4010990192 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91fc0a8590 con 0x7f91ec0039b0 2023-12-08T08:21:56.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.747+0000 7f91f7fff640 1 -- 172.21.15.88:0/4010990192 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc0a8940 con 0x7f91ec0039b0 2023-12-08T08:21:56.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.747+0000 7f92072fe640 1 -- 172.21.15.88:0/4010990192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91ec0039b0 msgr2=0x7f91ec003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:56.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.747+0000 7f92072fe640 1 --2- 172.21.15.88:0/4010990192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91ec0039b0 0x7f91ec003dd0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009ab0 tx=0x7f91fc01c9e0 comp rx=0 tx=0).stop 2023-12-08T08:21:56.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.747+0000 7f920589b640 1 -- 172.21.15.88:0/4010990192 reap_dead start 2023-12-08T08:21:56.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.747+0000 7f92072fe640 1 -- 172.21.15.88:0/4010990192 shutdown_connections 2023-12-08T08:21:56.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.747+0000 7f92072fe640 1 -- 172.21.15.88:0/4010990192 >> 172.21.15.88:0/4010990192 conn(0x7f92000a7810 msgr2=0x7f92000a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:56.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.747+0000 7f92072fe640 1 -- 172.21.15.88:0/4010990192 shutdown_connections 2023-12-08T08:21:56.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.747+0000 7f92072fe640 1 -- 172.21.15.88:0/4010990192 wait complete. 2023-12-08T08:21:56.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.747+0000 7f92072fe640 1 Processor -- start 2023-12-08T08:21:56.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.747+0000 7f92072fe640 1 -- start start 2023-12-08T08:21:56.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.751+0000 7f92072fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91ec0039b0 0x7f92000a9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:56.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.751+0000 7f92072fe640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92001e47d0 0x7f9200154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:56.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.751+0000 7f92072fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92001dcee0 0x7f92001f08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:56.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.751+0000 7f92072fe640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92000a9bc0 con 0x7f92001dcee0 2023-12-08T08:21:56.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.751+0000 7f92072fe640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9200154690 con 0x7f91ec0039b0 2023-12-08T08:21:56.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.751+0000 7f92072fe640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92000a8900 con 0x7f92001e47d0 2023-12-08T08:21:56.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.751+0000 7f920509a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91ec0039b0 0x7f92000a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:56.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.751+0000 7f920589b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92001dcee0 0x7f92001f08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:56.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.751+0000 7f920509a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91ec0039b0 0x7f92000a9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:36688/0 (socket says 172.21.15.88:36688) 2023-12-08T08:21:56.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.751+0000 7f9204899640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92001e47d0 0x7f9200154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:56.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.751+0000 7f920509a640 1 -- 172.21.15.88:0/2272125610 learned_addr learned my addr 172.21.15.88:0/2272125610 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:56.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.751+0000 7f920589b640 1 -- 172.21.15.88:0/2272125610 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92001e47d0 msgr2=0x7f9200154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:56.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.751+0000 7f920589b640 1 --2- 172.21.15.88:0/2272125610 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92001e47d0 0x7f9200154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:56.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.751+0000 7f920589b640 1 -- 172.21.15.88:0/2272125610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91ec0039b0 msgr2=0x7f92000a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:56.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.751+0000 7f920589b640 1 --2- 172.21.15.88:0/2272125610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91ec0039b0 0x7f92000a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:56.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.751+0000 7f920589b640 1 -- 172.21.15.88:0/2272125610 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920014ef80 con 0x7f92001dcee0 2023-12-08T08:21:56.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.751+0000 7f920509a640 1 --2- 172.21.15.88:0/2272125610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91ec0039b0 0x7f92000a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:21:56.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.751+0000 7f920589b640 1 --2- 172.21.15.88:0/2272125610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92001dcee0 0x7f92001f08f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9200155ae0 tx=0x7f91f8007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:56.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.751+0000 7f91f5ffb640 1 -- 172.21.15.88:0/2272125610 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f800ea80 con 0x7f92001dcee0 2023-12-08T08:21:56.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.751+0000 7f91f5ffb640 1 -- 172.21.15.88:0/2272125610 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f800ec00 con 0x7f92001dcee0 2023-12-08T08:21:56.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.751+0000 7f91f5ffb640 1 -- 172.21.15.88:0/2272125610 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f8013420 con 0x7f92001dcee0 2023-12-08T08:21:56.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.751+0000 7f92072fe640 1 -- 172.21.15.88:0/2272125610 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9200155060 con 0x7f92001dcee0 2023-12-08T08:21:56.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.751+0000 7f92072fe640 1 -- 172.21.15.88:0/2272125610 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9200155780 con 0x7f92001dcee0 2023-12-08T08:21:56.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.751+0000 7f92072fe640 1 -- 172.21.15.88:0/2272125610 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9200154800 con 0x7f92001dcee0 2023-12-08T08:21:56.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.755+0000 7f91f5ffb640 1 -- 172.21.15.88:0/2272125610 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f91f8013580 con 0x7f92001dcee0 2023-12-08T08:21:56.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.755+0000 7f91f5ffb640 1 --2- 172.21.15.88:0/2272125610 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f91e40664a0 0x7f91e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:56.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.755+0000 7f91f5ffb640 1 -- 172.21.15.88:0/2272125610 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f91f8083dd0 con 0x7f92001dcee0 2023-12-08T08:21:56.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.755+0000 7f920509a640 1 --2- 172.21.15.88:0/2272125610 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f91e40664a0 0x7f91e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:56.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.755+0000 7f920509a640 1 --2- 172.21.15.88:0/2272125610 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f91e40664a0 0x7f91e4068960 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f91fc01ca20 tx=0x7f91fc0046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:56.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.759+0000 7f91f5ffb640 1 -- 172.21.15.88:0/2272125610 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f91f8055020 con 0x7f92001dcee0 2023-12-08T08:21:56.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.935+0000 7f92072fe640 1 -- 172.21.15.88:0/2272125610 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9200067630 con 0x7f92001dcee0 2023-12-08T08:21:56.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.939+0000 7f91f5ffb640 1 -- 172.21.15.88:0/2272125610 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3699 (secure 0 0 0) 0x7f91f8054bb0 con 0x7f92001dcee0 2023-12-08T08:21:56.942 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:56.942 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4978,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3372523869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3372523869},{"type":"v1","addr":"172.21.15.148:6834","nonce":3372523869}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4085245492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":4085245492},{"type":"v1","addr":"172.21.15.148:6835","nonce":4085245492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/957673221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":957673221},{"type":"v1","addr":"172.21.15.88:6837","nonce":957673221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24},{"gid":5721,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/657392034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":657392034},{"type":"v1","addr":"172.21.15.88:6836","nonce":657392034}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[]} 2023-12-08T08:21:56.942 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 26 2023-12-08T08:21:56.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.939+0000 7f92072fe640 1 -- 172.21.15.88:0/2272125610 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f91e40664a0 msgr2=0x7f91e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:56.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.939+0000 7f92072fe640 1 --2- 172.21.15.88:0/2272125610 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f91e40664a0 0x7f91e4068960 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f91fc01ca20 tx=0x7f91fc0046d0 comp rx=0 tx=0).stop 2023-12-08T08:21:56.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.939+0000 7f92072fe640 1 -- 172.21.15.88:0/2272125610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92001dcee0 msgr2=0x7f92001f08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:56.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.939+0000 7f92072fe640 1 --2- 172.21.15.88:0/2272125610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92001dcee0 0x7f92001f08f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9200155ae0 tx=0x7f91f8007bc0 comp rx=0 tx=0).stop 2023-12-08T08:21:56.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.939+0000 7f92072fe640 1 -- 172.21.15.88:0/2272125610 shutdown_connections 2023-12-08T08:21:56.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.939+0000 7f92072fe640 1 --2- 172.21.15.88:0/2272125610 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f91e40664a0 0x7f91e4068960 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:56.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.939+0000 7f92072fe640 1 --2- 172.21.15.88:0/2272125610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92001dcee0 0x7f92001f08f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:56.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.939+0000 7f92072fe640 1 --2- 172.21.15.88:0/2272125610 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92001e47d0 0x7f9200154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:56.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.939+0000 7f92072fe640 1 --2- 172.21.15.88:0/2272125610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91ec0039b0 0x7f92000a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:56.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.939+0000 7f92072fe640 1 -- 172.21.15.88:0/2272125610 >> 172.21.15.88:0/2272125610 conn(0x7f92000a7810 msgr2=0x7f920014ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:56.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.939+0000 7f92072fe640 1 -- 172.21.15.88:0/2272125610 shutdown_connections 2023-12-08T08:21:56.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:56.939+0000 7f92072fe640 1 -- 172.21.15.88:0/2272125610 wait complete. 2023-12-08T08:21:56.963 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-08T08:21:56.963 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-08T08:21:56.963 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-08T08:21:56.963 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:21:56.963 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-08T08:21:56.963 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-08T08:21:56.964 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-08T08:21:56.964 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:21:56.964 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-08T08:21:56.964 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-08T08:21:56.964 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-08T08:21:56.964 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:21:56.964 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-08T08:21:56.965 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-08T08:21:56.965 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-08T08:21:56.965 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:21:56.977 INFO:tasks.ceph.mds.a:Stopped 2023-12-08T08:21:56.977 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-08T08:21:56.978 INFO:tasks.ceph.mds.c:Stopped 2023-12-08T08:21:56.978 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-08T08:21:56.980 INFO:tasks.ceph.mds.b:Stopped 2023-12-08T08:21:56.980 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-08T08:21:56.981 INFO:tasks.ceph.mds.d:Stopped 2023-12-08T08:21:56.981 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-08T08:21:57.024 INFO:tasks.ceph.mds.a:Started 2023-12-08T08:21:57.025 DEBUG:teuthology.parallel:result is None 2023-12-08T08:21:57.025 INFO:tasks.ceph.mds.b:Started 2023-12-08T08:21:57.025 DEBUG:teuthology.parallel:result is None 2023-12-08T08:21:57.026 INFO:tasks.ceph.mds.c:Started 2023-12-08T08:21:57.026 DEBUG:teuthology.parallel:result is None 2023-12-08T08:21:57.027 INFO:tasks.ceph.mds.d:Started 2023-12-08T08:21:57.027 DEBUG:teuthology.parallel:result is None 2023-12-08T08:21:57.028 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-08T08:21:57.111 INFO:tasks.ceph.mds.a.smithi088.stdout:starting mds.a at 2023-12-08T08:21:57.112 INFO:tasks.ceph.mds.c.smithi088.stdout:starting mds.c at 2023-12-08T08:21:57.119 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-12-08T08:21:57.119 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-12-08T08:21:57.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.171+0000 7fea9e2e4640 1 Processor -- start 2023-12-08T08:21:57.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.171+0000 7fea9e2e4640 1 -- start start 2023-12-08T08:21:57.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.171+0000 7fea9e2e4640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea980c66b0 0x7fea980a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:57.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.171+0000 7fea9e2e4640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fea9814de40 0x7fea9814e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:57.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.171+0000 7fea9e2e4640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea980a4cc0 con 0x7fea9806bc70 2023-12-08T08:21:57.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.171+0000 7fea9e2e4640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea980c23d0 con 0x7fea9814de40 2023-12-08T08:21:57.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.171+0000 7fea9e2e4640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea980c1b70 con 0x7fea980c66b0 2023-12-08T08:21:57.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.171+0000 7fea97fff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea980c66b0 0x7fea980a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:57.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.171+0000 7fea9c881640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fea9814de40 0x7fea9814e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:57.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.171+0000 7fea977fe640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fea9806bc70 0x7fea980c5a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:44436/0 (socket says 172.21.15.88:44436) 2023-12-08T08:21:57.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.171+0000 7fea977fe640 1 -- 172.21.15.88:0/8006689 learned_addr learned my addr 172.21.15.88:0/8006689 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:57.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.171+0000 7fea97fff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea980c66b0 0x7fea980a4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:55190/0 (socket says 172.21.15.88:55190) 2023-12-08T08:21:57.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.171+0000 7fea97fff640 1 -- 172.21.15.88:0/8006689 >> v2:172.21.15.148:3300/0 conn(0x7fea9814de40 msgr2=0x7fea9814e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:57.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.171+0000 7fea97fff640 1 --2- 172.21.15.88:0/8006689 >> v2:172.21.15.148:3300/0 conn(0x7fea9814de40 0x7fea9814e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:57.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.171+0000 7fea97fff640 1 -- 172.21.15.88:0/8006689 >> v1:172.21.15.148:6789/0 conn(0x7fea9806bc70 legacy=0x7fea980c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:57.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.171+0000 7fea97fff640 1 -- 172.21.15.88:0/8006689 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea980c1d80 con 0x7fea980c66b0 2023-12-08T08:21:57.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.171+0000 7fea96ffd640 1 -- 172.21.15.88:0/8006689 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2340199805 0 0) 0x7fea980a4cc0 con 0x7fea9806bc70 2023-12-08T08:21:57.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.175+0000 7fea97fff640 1 --2- 172.21.15.88:0/8006689 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea980c66b0 0x7fea980a4fa0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fea880097f0 tx=0x7fea8801c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4a43dd24320636d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:57.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.175+0000 7fea96ffd640 1 -- 172.21.15.88:0/8006689 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea880ab600 con 0x7fea980c66b0 2023-12-08T08:21:57.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.175+0000 7fea96ffd640 1 -- 172.21.15.88:0/8006689 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea880a7050 con 0x7fea980c66b0 2023-12-08T08:21:57.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.175+0000 7fea96ffd640 1 -- 172.21.15.88:0/8006689 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea880ab980 con 0x7fea980c66b0 2023-12-08T08:21:57.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.175+0000 7fea9e2e4640 1 -- 172.21.15.88:0/8006689 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea980c66b0 msgr2=0x7fea980a4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:57.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.175+0000 7fea9e2e4640 1 --2- 172.21.15.88:0/8006689 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea980c66b0 0x7fea980a4fa0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fea880097f0 tx=0x7fea8801c360 comp rx=0 tx=0).stop 2023-12-08T08:21:57.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.175+0000 7fea9e2e4640 1 -- 172.21.15.88:0/8006689 shutdown_connections 2023-12-08T08:21:57.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.175+0000 7fea9e2e4640 1 --2- 172.21.15.88:0/8006689 >> v2:172.21.15.148:3300/0 conn(0x7fea9814de40 0x7fea9814e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:57.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.175+0000 7fea9e2e4640 1 --2- 172.21.15.88:0/8006689 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea980c66b0 0x7fea980a4fa0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:57.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.175+0000 7fea9e2e4640 1 -- 172.21.15.88:0/8006689 >> 172.21.15.88:0/8006689 conn(0x7fea9806b220 msgr2=0x7fea980a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:57.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.175+0000 7fea9e2e4640 1 -- 172.21.15.88:0/8006689 shutdown_connections 2023-12-08T08:21:57.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.175+0000 7fea9e2e4640 1 -- 172.21.15.88:0/8006689 wait complete. 2023-12-08T08:21:57.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.179+0000 7fea9e2e4640 1 Processor -- start 2023-12-08T08:21:57.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.179+0000 7fea9e2e4640 1 -- start start 2023-12-08T08:21:57.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.179+0000 7fea9e2e4640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea9806bc70 0x7fea9814cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:57.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.179+0000 7fea9e2e4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea980c66b0 0x7fea981ee840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:57.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.179+0000 7fea9e2e4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea9814de40 0x7fea981eed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:57.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.179+0000 7fea9e2e4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea98072340 con 0x7fea980c66b0 2023-12-08T08:21:57.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.179+0000 7fea9e2e4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9814d320 con 0x7fea9814de40 2023-12-08T08:21:57.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.179+0000 7fea9e2e4640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9815d1e0 con 0x7fea9806bc70 2023-12-08T08:21:57.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.179+0000 7fea977fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea980c66b0 0x7fea981ee840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:57.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.179+0000 7fea977fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea980c66b0 0x7fea981ee840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42618/0 (socket says 172.21.15.88:42618) 2023-12-08T08:21:57.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.179+0000 7fea977fe640 1 -- 172.21.15.88:0/2192822467 learned_addr learned my addr 172.21.15.88:0/2192822467 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:57.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.179+0000 7fea9c881640 1 --2- 172.21.15.88:0/2192822467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea9814de40 0x7fea981eed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:57.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.179+0000 7fea97fff640 1 --2- 172.21.15.88:0/2192822467 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea9806bc70 0x7fea9814cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:57.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.179+0000 7fea9c881640 1 -- 172.21.15.88:0/2192822467 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea9806bc70 msgr2=0x7fea9814cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:57.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.179+0000 7fea9c881640 1 --2- 172.21.15.88:0/2192822467 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea9806bc70 0x7fea9814cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:57.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.179+0000 7fea9c881640 1 -- 172.21.15.88:0/2192822467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea980c66b0 msgr2=0x7fea981ee840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:57.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.179+0000 7fea9c881640 1 --2- 172.21.15.88:0/2192822467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea980c66b0 0x7fea981ee840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:57.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.179+0000 7fea9c881640 1 -- 172.21.15.88:0/2192822467 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea88009420 con 0x7fea9814de40 2023-12-08T08:21:57.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.179+0000 7fea977fe640 1 --2- 172.21.15.88:0/2192822467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea980c66b0 0x7fea981ee840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:21:57.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.179+0000 7fea9c881640 1 --2- 172.21.15.88:0/2192822467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea9814de40 0x7fea981eed80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fea9000eba0 tx=0x7fea9000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:57.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.179+0000 7fea94ff9640 1 -- 172.21.15.88:0/2192822467 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9000cd20 con 0x7fea9814de40 2023-12-08T08:21:57.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.179+0000 7fea94ff9640 1 -- 172.21.15.88:0/2192822467 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9000f040 con 0x7fea9814de40 2023-12-08T08:21:57.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.179+0000 7fea94ff9640 1 -- 172.21.15.88:0/2192822467 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea900146c0 con 0x7fea9814de40 2023-12-08T08:21:57.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.179+0000 7fea9e2e4640 1 -- 172.21.15.88:0/2192822467 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea98072590 con 0x7fea9814de40 2023-12-08T08:21:57.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.179+0000 7fea9e2e4640 1 -- 172.21.15.88:0/2192822467 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9814ad00 con 0x7fea9814de40 2023-12-08T08:21:57.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.183+0000 7fea9e2e4640 1 -- 172.21.15.88:0/2192822467 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea98067630 con 0x7fea9814de40 2023-12-08T08:21:57.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.183+0000 7fea94ff9640 1 -- 172.21.15.88:0/2192822467 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fea90014820 con 0x7fea9814de40 2023-12-08T08:21:57.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.183+0000 7fea94ff9640 1 --2- 172.21.15.88:0/2192822467 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fea840664a0 0x7fea84068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:57.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.183+0000 7fea94ff9640 1 -- 172.21.15.88:0/2192822467 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fea90084740 con 0x7fea9814de40 2023-12-08T08:21:57.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.183+0000 7fea97fff640 1 --2- 172.21.15.88:0/2192822467 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fea840664a0 0x7fea84068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:57.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.183+0000 7fea97fff640 1 --2- 172.21.15.88:0/2192822467 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fea840664a0 0x7fea84068960 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fea880ad000 tx=0x7fea880a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:57.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.187+0000 7fea94ff9640 1 -- 172.21.15.88:0/2192822467 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fea90051f00 con 0x7fea9814de40 2023-12-08T08:21:57.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:57.347+0000 7fea9e2e4640 1 -- 172.21.15.88:0/2192822467 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fea980a6140 con 0x7fea9814de40 2023-12-08T08:21:58.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.387+0000 7fea94ff9640 1 -- 172.21.15.88:0/2192822467 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v46) v1 ==== 97+0+0 (secure 0 0 0) 0x7fea90018080 con 0x7fea9814de40 2023-12-08T08:21:58.392 INFO:teuthology.orchestra.run.smithi088.stderr: removed all blocklist entries 2023-12-08T08:21:58.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.387+0000 7fea9e2e4640 1 -- 172.21.15.88:0/2192822467 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fea840664a0 msgr2=0x7fea84068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:58.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.387+0000 7fea9e2e4640 1 --2- 172.21.15.88:0/2192822467 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fea840664a0 0x7fea84068960 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fea880ad000 tx=0x7fea880a6000 comp rx=0 tx=0).stop 2023-12-08T08:21:58.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.387+0000 7fea9e2e4640 1 -- 172.21.15.88:0/2192822467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea9814de40 msgr2=0x7fea981eed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:58.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.387+0000 7fea9e2e4640 1 --2- 172.21.15.88:0/2192822467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea9814de40 0x7fea981eed80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fea9000eba0 tx=0x7fea9000c490 comp rx=0 tx=0).stop 2023-12-08T08:21:58.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.387+0000 7fea9e2e4640 1 -- 172.21.15.88:0/2192822467 shutdown_connections 2023-12-08T08:21:58.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.387+0000 7fea9e2e4640 1 --2- 172.21.15.88:0/2192822467 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fea840664a0 0x7fea84068960 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:58.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.387+0000 7fea9e2e4640 1 --2- 172.21.15.88:0/2192822467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea9814de40 0x7fea981eed80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:58.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.387+0000 7fea9e2e4640 1 --2- 172.21.15.88:0/2192822467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea980c66b0 0x7fea981ee840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:58.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.387+0000 7fea9e2e4640 1 --2- 172.21.15.88:0/2192822467 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fea9806bc70 0x7fea9814cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:58.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.387+0000 7fea9e2e4640 1 -- 172.21.15.88:0/2192822467 >> 172.21.15.88:0/2192822467 conn(0x7fea9806b220 msgr2=0x7fea98148c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:58.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.387+0000 7fea9e2e4640 1 -- 172.21.15.88:0/2192822467 shutdown_connections 2023-12-08T08:21:58.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.387+0000 7fea9e2e4640 1 -- 172.21.15.88:0/2192822467 wait complete. 2023-12-08T08:21:58.415 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-08T08:21:58.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.551+0000 7fe3655e7640 1 Processor -- start 2023-12-08T08:21:58.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.551+0000 7fe3655e7640 1 -- start start 2023-12-08T08:21:58.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.551+0000 7fe3655e7640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe36014e7e0 0x7fe3600c2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:58.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.551+0000 7fe3655e7640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe360157b10 0x7fe360157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:58.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.551+0000 7fe3655e7640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe360155110 con 0x7fe3600c5e10 2023-12-08T08:21:58.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.551+0000 7fe3655e7640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe360154520 con 0x7fe36014e7e0 2023-12-08T08:21:58.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.551+0000 7fe3655e7640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3601547e0 con 0x7fe360157b10 2023-12-08T08:21:58.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.551+0000 7fe35effd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe36014e7e0 0x7fe3600c2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:58.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.551+0000 7fe35effd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe36014e7e0 0x7fe3600c2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42624/0 (socket says 172.21.15.88:42624) 2023-12-08T08:21:58.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.551+0000 7fe35effd640 1 -- 172.21.15.88:0/762924506 learned_addr learned my addr 172.21.15.88:0/762924506 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:58.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.551+0000 7fe3567fc640 1 --1- 172.21.15.88:0/762924506 >> v1:172.21.15.88:6789/0 conn(0x7fe3600c5e10 0x7fe3600a6ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51158/0 (socket says 172.21.15.88:51158) 2023-12-08T08:21:58.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.551+0000 7fe35f7fe640 1 --2- 172.21.15.88:0/762924506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe360157b10 0x7fe360157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:58.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.551+0000 7fe35effd640 1 -- 172.21.15.88:0/762924506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe360157b10 msgr2=0x7fe360157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:58.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.551+0000 7fe35effd640 1 --2- 172.21.15.88:0/762924506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe360157b10 0x7fe360157fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:58.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.555+0000 7fe35effd640 1 -- 172.21.15.88:0/762924506 >> v1:172.21.15.88:6789/0 conn(0x7fe3600c5e10 legacy=0x7fe3600a6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:58.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.555+0000 7fe35effd640 1 -- 172.21.15.88:0/762924506 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe360154ac0 con 0x7fe36014e7e0 2023-12-08T08:21:58.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.555+0000 7fe35e7fc640 1 -- 172.21.15.88:0/762924506 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529176925 0 0) 0x7fe360155110 con 0x7fe3600c5e10 2023-12-08T08:21:58.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.555+0000 7fe35effd640 1 --2- 172.21.15.88:0/762924506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe36014e7e0 0x7fe3600c2810 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe348009870 tx=0x7fe34801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49fe887f236dc435 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:58.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.555+0000 7fe35e7fc640 1 -- 172.21.15.88:0/762924506 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3480ab600 con 0x7fe36014e7e0 2023-12-08T08:21:58.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.555+0000 7fe35e7fc640 1 -- 172.21.15.88:0/762924506 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3480a7050 con 0x7fe36014e7e0 2023-12-08T08:21:58.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.555+0000 7fe35e7fc640 1 -- 172.21.15.88:0/762924506 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3480ab980 con 0x7fe36014e7e0 2023-12-08T08:21:58.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.555+0000 7fe3655e7640 1 -- 172.21.15.88:0/762924506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe36014e7e0 msgr2=0x7fe3600c2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:58.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.555+0000 7fe3655e7640 1 --2- 172.21.15.88:0/762924506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe36014e7e0 0x7fe3600c2810 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe348009870 tx=0x7fe34801c3f0 comp rx=0 tx=0).stop 2023-12-08T08:21:58.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.555+0000 7fe3655e7640 1 -- 172.21.15.88:0/762924506 shutdown_connections 2023-12-08T08:21:58.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.555+0000 7fe3655e7640 1 --2- 172.21.15.88:0/762924506 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe360157b10 0x7fe360157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:58.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.555+0000 7fe3655e7640 1 --2- 172.21.15.88:0/762924506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe36014e7e0 0x7fe3600c2810 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:58.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.555+0000 7fe3655e7640 1 -- 172.21.15.88:0/762924506 >> 172.21.15.88:0/762924506 conn(0x7fe3600c7c60 msgr2=0x7fe3600c8070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:58.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.555+0000 7fe3655e7640 1 -- 172.21.15.88:0/762924506 shutdown_connections 2023-12-08T08:21:58.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.555+0000 7fe3655e7640 1 -- 172.21.15.88:0/762924506 wait complete. 2023-12-08T08:21:58.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.559+0000 7fe3655e7640 1 Processor -- start 2023-12-08T08:21:58.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.559+0000 7fe3655e7640 1 -- start start 2023-12-08T08:21:58.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.559+0000 7fe3655e7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3600c5e10 0x7fe3601f0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:58.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.559+0000 7fe3655e7640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe36014e7e0 0x7fe3601445b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:58.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.559+0000 7fe3655e7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe360157b10 0x7fe360140980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:58.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.559+0000 7fe3655e7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe360141cd0 con 0x7fe360157b10 2023-12-08T08:21:58.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.559+0000 7fe3655e7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3601f0190 con 0x7fe3600c5e10 2023-12-08T08:21:58.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.559+0000 7fe3655e7640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe360141080 con 0x7fe36014e7e0 2023-12-08T08:21:58.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.559+0000 7fe35f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe360157b10 0x7fe360140980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:58.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.559+0000 7fe35f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe360157b10 0x7fe360140980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42634/0 (socket says 172.21.15.88:42634) 2023-12-08T08:21:58.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.559+0000 7fe35f7fe640 1 -- 172.21.15.88:0/882639914 learned_addr learned my addr 172.21.15.88:0/882639914 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:58.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.559+0000 7fe3567fc640 1 --2- 172.21.15.88:0/882639914 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe36014e7e0 0x7fe3601445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:58.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.559+0000 7fe35effd640 1 --2- 172.21.15.88:0/882639914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3600c5e10 0x7fe3601f0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:58.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.559+0000 7fe35f7fe640 1 -- 172.21.15.88:0/882639914 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe36014e7e0 msgr2=0x7fe3601445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:58.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.559+0000 7fe35f7fe640 1 --2- 172.21.15.88:0/882639914 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe36014e7e0 0x7fe3601445b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:58.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.559+0000 7fe35f7fe640 1 -- 172.21.15.88:0/882639914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3600c5e10 msgr2=0x7fe3601f0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:58.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.559+0000 7fe35f7fe640 1 --2- 172.21.15.88:0/882639914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3600c5e10 0x7fe3601f0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:58.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.559+0000 7fe35f7fe640 1 -- 172.21.15.88:0/882639914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3480094d0 con 0x7fe360157b10 2023-12-08T08:21:58.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.559+0000 7fe35f7fe640 1 --2- 172.21.15.88:0/882639914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe360157b10 0x7fe360140980 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe358007e70 tx=0x7fe35800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:58.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.559+0000 7fe357fff640 1 -- 172.21.15.88:0/882639914 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe358014620 con 0x7fe360157b10 2023-12-08T08:21:58.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.559+0000 7fe357fff640 1 -- 172.21.15.88:0/882639914 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3580147a0 con 0x7fe360157b10 2023-12-08T08:21:58.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.559+0000 7fe357fff640 1 -- 172.21.15.88:0/882639914 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe358014b50 con 0x7fe360157b10 2023-12-08T08:21:58.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.559+0000 7fe3655e7640 1 -- 172.21.15.88:0/882639914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3601f0400 con 0x7fe360157b10 2023-12-08T08:21:58.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.559+0000 7fe3655e7640 1 -- 172.21.15.88:0/882639914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe360141360 con 0x7fe360157b10 2023-12-08T08:21:58.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.563+0000 7fe3655e7640 1 -- 172.21.15.88:0/882639914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3601ed340 con 0x7fe360157b10 2023-12-08T08:21:58.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.563+0000 7fe357fff640 1 -- 172.21.15.88:0/882639914 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe358014cb0 con 0x7fe360157b10 2023-12-08T08:21:58.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.563+0000 7fe357fff640 1 --2- 172.21.15.88:0/882639914 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe3400664a0 0x7fe340068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:58.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.563+0000 7fe357fff640 1 -- 172.21.15.88:0/882639914 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe358084430 con 0x7fe360157b10 2023-12-08T08:21:58.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.563+0000 7fe35effd640 1 --2- 172.21.15.88:0/882639914 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe3400664a0 0x7fe340068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:58.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.563+0000 7fe35effd640 1 --2- 172.21.15.88:0/882639914 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe3400664a0 0x7fe340068960 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe3480ad000 tx=0x7fe3480a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:58.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.567+0000 7fe357fff640 1 -- 172.21.15.88:0/882639914 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe358051b80 con 0x7fe360157b10 2023-12-08T08:21:58.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.767+0000 7fe3655e7640 1 -- 172.21.15.88:0/882639914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe360067630 con 0x7fe360157b10 2023-12-08T08:21:58.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.771+0000 7fe357fff640 1 -- 172.21.15.88:0/882639914 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5021 (secure 0 0 0) 0x7fe3580551a0 con 0x7fe360157b10 2023-12-08T08:21:58.774 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:58.774 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-08T08:21:58.774 INFO:teuthology.orchestra.run.smithi088.stdout: "auth_dump": [ 2023-12-08T08:21:58.774 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:58.774 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mds.a", 2023-12-08T08:21:58.775 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCJ0XJloTK6HRAAu8n+gz+R9g+apHf4wBCxeQ==", 2023-12-08T08:21:58.775 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:58.775 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-12-08T08:21:58.775 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2023-12-08T08:21:58.775 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2023-12-08T08:21:58.775 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:58.775 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:58.775 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:58.775 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:58.775 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mds.b", 2023-12-08T08:21:58.776 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCJ0XJlrbnLKRAAO9XhdXDMFK67UwNQyAt2gg==", 2023-12-08T08:21:58.776 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:58.776 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-12-08T08:21:58.776 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2023-12-08T08:21:58.776 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2023-12-08T08:21:58.776 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:58.776 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:58.776 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:58.776 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:58.776 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mds.c", 2023-12-08T08:21:58.776 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCJ0XJlDhLZJBAACSOMzN+IeMzMVLNekOe7dw==", 2023-12-08T08:21:58.776 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:58.776 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-12-08T08:21:58.777 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2023-12-08T08:21:58.777 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2023-12-08T08:21:58.777 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:58.777 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:58.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:58.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:58.777 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mds.d", 2023-12-08T08:21:58.777 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCJ0XJlWdgsMRAAuaC4T6rzN3zYLCszue26tw==", 2023-12-08T08:21:58.777 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:58.777 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-12-08T08:21:58.777 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2023-12-08T08:21:58.777 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2023-12-08T08:21:58.778 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:58.778 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:58.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:58.778 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:58.778 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.0", 2023-12-08T08:21:58.778 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCM0XJlWUyMOxAA6Q7lleuO31iXvAYMe7LWNw==", 2023-12-08T08:21:58.778 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:58.779 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-12-08T08:21:58.779 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-12-08T08:21:58.779 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:58.779 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:58.779 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:58.779 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:58.779 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.1", 2023-12-08T08:21:58.779 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCQ0XJlc0EeBxAA+a5ftRhbAX9Re+hWg9dLsQ==", 2023-12-08T08:21:58.779 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:58.779 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-12-08T08:21:58.779 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-12-08T08:21:58.779 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:58.779 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:58.780 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:58.780 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:58.780 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.2", 2023-12-08T08:21:58.780 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCT0XJlZAYzDRAAXGdagNNhMTiFIzHDaKgFQg==", 2023-12-08T08:21:58.780 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:58.780 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-12-08T08:21:58.780 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-12-08T08:21:58.780 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:58.780 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:58.780 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:58.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:58.781 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.3", 2023-12-08T08:21:58.781 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCW0XJlGa+gExAA/BQ9Po66U86hYML+eMjuUQ==", 2023-12-08T08:21:58.781 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:58.781 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-12-08T08:21:58.781 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-12-08T08:21:58.781 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:58.781 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:58.781 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:58.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:58.781 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.4", 2023-12-08T08:21:58.781 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCc0XJlvrSlHxAAEabqt1NzUyyON8/eGwqo1Q==", 2023-12-08T08:21:58.782 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:58.782 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-12-08T08:21:58.782 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-12-08T08:21:58.782 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:58.782 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:58.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:58.782 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:58.782 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.5", 2023-12-08T08:21:58.782 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCf0XJl0W+8JRAA8Twf/r3v6rJWcXMfLT0LCA==", 2023-12-08T08:21:58.782 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:58.782 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-12-08T08:21:58.782 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-12-08T08:21:58.783 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:58.783 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:58.783 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:58.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:58.783 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.6", 2023-12-08T08:21:58.783 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCi0XJljGjUKxAAOgrH0WvuIwuzZsgOki/fsA==", 2023-12-08T08:21:58.783 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:58.783 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-12-08T08:21:58.783 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-12-08T08:21:58.783 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:58.783 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:58.783 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:58.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:58.784 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.7", 2023-12-08T08:21:58.784 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCl0XJl5NI2MhAA2zOJ9DGnD4JtXTfmVjgkmw==", 2023-12-08T08:21:58.784 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:58.784 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-12-08T08:21:58.784 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-12-08T08:21:58.784 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:58.784 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:58.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:58.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:58.784 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.0", 2023-12-08T08:21:58.784 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCJ0XJlCC1UNRAARGaNCoJFAvsCcXsQY6BjFg==", 2023-12-08T08:21:58.784 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:58.784 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-12-08T08:21:58.785 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow r", 2023-12-08T08:21:58.785 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-08T08:21:58.785 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:58.785 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:58.785 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:58.785 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.1", 2023-12-08T08:21:58.785 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCJ0XJld2rjOBAAUnEIBuqXHktNpqFW/Ikf7g==", 2023-12-08T08:21:58.785 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:58.785 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-12-08T08:21:58.785 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow r", 2023-12-08T08:21:58.785 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow rw pool=cephfs2_data" 2023-12-08T08:21:58.785 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:58.785 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:58.786 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:58.786 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.admin", 2023-12-08T08:21:58.786 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCJ0XJl5zt3ARAACqokMwcpmbL/boyr7vMJvw==", 2023-12-08T08:21:58.786 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:58.786 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow *", 2023-12-08T08:21:58.786 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2023-12-08T08:21:58.786 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2023-12-08T08:21:58.786 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:58.786 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:58.786 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:58.786 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:58.786 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.testuser", 2023-12-08T08:21:58.786 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQAL0nJlCYBrORAAC4ib+QAXhveVa/QJJs6Srw==", 2023-12-08T08:21:58.787 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:58.787 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow rw fsname=cephfs", 2023-12-08T08:21:58.787 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow r fsname=cephfs", 2023-12-08T08:21:58.787 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-08T08:21:58.787 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:58.787 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:58.787 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:58.787 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mgr.x", 2023-12-08T08:21:58.787 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCJ0XJl4fEwGRAA7AYI8JM8WALXPX5s5d4ybg==", 2023-12-08T08:21:58.787 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:58.787 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow *", 2023-12-08T08:21:58.787 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile mgr", 2023-12-08T08:21:58.787 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:58.787 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:58.788 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:21:58.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:21:58.788 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mgr.y", 2023-12-08T08:21:58.788 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCJ0XJlIJRaFRAALL9eP2riyJXD1ZixzxpiWw==", 2023-12-08T08:21:58.788 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:21:58.788 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow *", 2023-12-08T08:21:58.788 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile mgr", 2023-12-08T08:21:58.788 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:21:58.788 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:58.788 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:21:58.788 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-12-08T08:21:58.788 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-08T08:21:58.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.771+0000 7fe3655e7640 1 -- 172.21.15.88:0/882639914 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe3400664a0 msgr2=0x7fe340068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:58.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.771+0000 7fe3655e7640 1 --2- 172.21.15.88:0/882639914 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe3400664a0 0x7fe340068960 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe3480ad000 tx=0x7fe3480a6000 comp rx=0 tx=0).stop 2023-12-08T08:21:58.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.771+0000 7fe3655e7640 1 -- 172.21.15.88:0/882639914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe360157b10 msgr2=0x7fe360140980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:58.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.771+0000 7fe3655e7640 1 --2- 172.21.15.88:0/882639914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe360157b10 0x7fe360140980 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe358007e70 tx=0x7fe35800e4b0 comp rx=0 tx=0).stop 2023-12-08T08:21:58.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.771+0000 7fe3655e7640 1 -- 172.21.15.88:0/882639914 shutdown_connections 2023-12-08T08:21:58.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.771+0000 7fe3655e7640 1 --2- 172.21.15.88:0/882639914 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe3400664a0 0x7fe340068960 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:58.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.771+0000 7fe3655e7640 1 --2- 172.21.15.88:0/882639914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe360157b10 0x7fe360140980 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:58.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.771+0000 7fe3655e7640 1 --2- 172.21.15.88:0/882639914 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe36014e7e0 0x7fe3601445b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:58.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.771+0000 7fe3655e7640 1 --2- 172.21.15.88:0/882639914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3600c5e10 0x7fe3601f0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:58.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.771+0000 7fe3655e7640 1 -- 172.21.15.88:0/882639914 >> 172.21.15.88:0/882639914 conn(0x7fe3600c7c60 msgr2=0x7fe360144b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:58.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.771+0000 7fe3655e7640 1 -- 172.21.15.88:0/882639914 shutdown_connections 2023-12-08T08:21:58.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.771+0000 7fe3655e7640 1 -- 172.21.15.88:0/882639914 wait complete. 2023-12-08T08:21:58.795 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2023-12-08T08:21:58.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.931+0000 7f783e701640 1 Processor -- start 2023-12-08T08:21:58.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.931+0000 7f783e701640 1 -- start start 2023-12-08T08:21:58.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.931+0000 7f783e701640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7838154390 0x7f78380c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:58.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.931+0000 7f783e701640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f78380c4f80 0x7f78380c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:58.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.931+0000 7f783e701640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78380a93d0 con 0x7f78380c2110 2023-12-08T08:21:58.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.931+0000 7f783e701640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78380aa1c0 con 0x7f78380c4f80 2023-12-08T08:21:58.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.931+0000 7f783e701640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7838154770 con 0x7f7838154390 2023-12-08T08:21:58.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.931+0000 7f783cc9e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f78380c4f80 0x7f78380c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:58.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.931+0000 7f783cc9e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f78380c4f80 0x7f78380c63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42638/0 (socket says 172.21.15.88:42638) 2023-12-08T08:21:58.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.931+0000 7f783cc9e640 1 -- 172.21.15.88:0/3100925302 learned_addr learned my addr 172.21.15.88:0/3100925302 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:58.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.931+0000 7f7837fff640 1 --2- 172.21.15.88:0/3100925302 >> v2:172.21.15.148:3300/0 conn(0x7f7838154390 0x7f78380c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:58.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.931+0000 7f783cc9e640 1 -- 172.21.15.88:0/3100925302 >> v2:172.21.15.148:3300/0 conn(0x7f7838154390 msgr2=0x7f78380c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:58.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.931+0000 7f783cc9e640 1 --2- 172.21.15.88:0/3100925302 >> v2:172.21.15.148:3300/0 conn(0x7f7838154390 0x7f78380c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:58.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.931+0000 7f783cc9e640 1 -- 172.21.15.88:0/3100925302 >> v1:172.21.15.148:6789/0 conn(0x7f78380c2110 legacy=0x7f78380c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:58.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.931+0000 7f783cc9e640 1 -- 172.21.15.88:0/3100925302 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78380a9640 con 0x7f78380c4f80 2023-12-08T08:21:58.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.935+0000 7f783cc9e640 1 --2- 172.21.15.88:0/3100925302 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78380c4f80 0x7f78380c63b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f78380a83b0 tx=0x7f783001ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84fea112be095acf server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:58.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.935+0000 7f7836ffd640 1 -- 172.21.15.88:0/3100925302 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783000b2d0 con 0x7f78380c4f80 2023-12-08T08:21:58.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.935+0000 7f7836ffd640 1 -- 172.21.15.88:0/3100925302 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783000b430 con 0x7f78380c4f80 2023-12-08T08:21:58.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.935+0000 7f7836ffd640 1 -- 172.21.15.88:0/3100925302 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78300a7ad0 con 0x7f78380c4f80 2023-12-08T08:21:58.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.935+0000 7f783e701640 1 -- 172.21.15.88:0/3100925302 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78380c4f80 msgr2=0x7f78380c63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:58.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.935+0000 7f783e701640 1 --2- 172.21.15.88:0/3100925302 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78380c4f80 0x7f78380c63b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f78380a83b0 tx=0x7f783001ebd0 comp rx=0 tx=0).stop 2023-12-08T08:21:58.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.935+0000 7f783e701640 1 -- 172.21.15.88:0/3100925302 shutdown_connections 2023-12-08T08:21:58.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.935+0000 7f783e701640 1 --2- 172.21.15.88:0/3100925302 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78380c4f80 0x7f78380c63b0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:58.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.935+0000 7f783e701640 1 --2- 172.21.15.88:0/3100925302 >> v2:172.21.15.148:3300/0 conn(0x7f7838154390 0x7f78380c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:58.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.935+0000 7f783e701640 1 -- 172.21.15.88:0/3100925302 >> 172.21.15.88:0/3100925302 conn(0x7f783806b220 msgr2=0x7f78380a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:58.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.935+0000 7f783e701640 1 -- 172.21.15.88:0/3100925302 shutdown_connections 2023-12-08T08:21:58.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.935+0000 7f783e701640 1 -- 172.21.15.88:0/3100925302 wait complete. 2023-12-08T08:21:58.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.939+0000 7f783e701640 1 Processor -- start 2023-12-08T08:21:58.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.939+0000 7f783e701640 1 -- start start 2023-12-08T08:21:58.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.939+0000 7f783e701640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f78380c2110 0x7f7838151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:58.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.939+0000 7f783e701640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78380c4f80 0x7f78380717e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:58.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.939+0000 7f783e701640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7838154390 0x7f7838147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:58.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.939+0000 7f783e701640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78381ed680 con 0x7f7838154390 2023-12-08T08:21:58.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.939+0000 7f783e701640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78381eca00 con 0x7f78380c4f80 2023-12-08T08:21:58.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.939+0000 7f783e701640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78381ecce0 con 0x7f78380c2110 2023-12-08T08:21:58.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.939+0000 7f783cc9e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7838154390 0x7f7838147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:58.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.939+0000 7f783cc9e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7838154390 0x7f7838147f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42648/0 (socket says 172.21.15.88:42648) 2023-12-08T08:21:58.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.939+0000 7f783cc9e640 1 -- 172.21.15.88:0/2978149180 learned_addr learned my addr 172.21.15.88:0/2978149180 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:58.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.939+0000 7f7837fff640 1 --2- 172.21.15.88:0/2978149180 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f78380c2110 0x7f7838151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:58.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.939+0000 7f78377fe640 1 --2- 172.21.15.88:0/2978149180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78380c4f80 0x7f78380717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:58.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.939+0000 7f783cc9e640 1 -- 172.21.15.88:0/2978149180 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f78380c2110 msgr2=0x7f7838151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:58.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.939+0000 7f783cc9e640 1 --2- 172.21.15.88:0/2978149180 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f78380c2110 0x7f7838151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:58.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.939+0000 7f783cc9e640 1 -- 172.21.15.88:0/2978149180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78380c4f80 msgr2=0x7f78380717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:58.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.939+0000 7f783cc9e640 1 --2- 172.21.15.88:0/2978149180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78380c4f80 0x7f78380717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:58.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.939+0000 7f783cc9e640 1 -- 172.21.15.88:0/2978149180 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783000bd40 con 0x7f7838154390 2023-12-08T08:21:58.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.939+0000 7f783cc9e640 1 --2- 172.21.15.88:0/2978149180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7838154390 0x7f7838147f80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f78300b1040 tx=0x7f783001b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:58.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.939+0000 7f7834ff9640 1 -- 172.21.15.88:0/2978149180 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7830009800 con 0x7f7838154390 2023-12-08T08:21:58.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.939+0000 7f7834ff9640 1 -- 172.21.15.88:0/2978149180 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7830009960 con 0x7f7838154390 2023-12-08T08:21:58.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.939+0000 7f7834ff9640 1 -- 172.21.15.88:0/2978149180 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7830009cd0 con 0x7f7838154390 2023-12-08T08:21:58.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.939+0000 7f783e701640 1 -- 172.21.15.88:0/2978149180 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78381ecfc0 con 0x7f7838154390 2023-12-08T08:21:58.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.943+0000 7f783e701640 1 -- 172.21.15.88:0/2978149180 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7838152200 con 0x7f7838154390 2023-12-08T08:21:58.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.943+0000 7f783e701640 1 -- 172.21.15.88:0/2978149180 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7838067630 con 0x7f7838154390 2023-12-08T08:21:58.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.943+0000 7f7834ff9640 1 -- 172.21.15.88:0/2978149180 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f78300ba470 con 0x7f7838154390 2023-12-08T08:21:58.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.943+0000 7f7834ff9640 1 --2- 172.21.15.88:0/2978149180 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7824066470 0x7f7824068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:58.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.943+0000 7f7834ff9640 1 -- 172.21.15.88:0/2978149180 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7830120ef0 con 0x7f7838154390 2023-12-08T08:21:58.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.943+0000 7f7837fff640 1 --2- 172.21.15.88:0/2978149180 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7824066470 0x7f7824068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:58.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.943+0000 7f7837fff640 1 --2- 172.21.15.88:0/2978149180 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7824066470 0x7f7824068930 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7828009ac0 tx=0x7f7828009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:58.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:58.947+0000 7f7834ff9640 1 -- 172.21.15.88:0/2978149180 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f78300ee800 con 0x7f7838154390 2023-12-08T08:21:59.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.151+0000 7f783e701640 1 -- 172.21.15.88:0/2978149180 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7f78381524b0 con 0x7f7838154390 2023-12-08T08:21:59.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.151+0000 7f7834ff9640 1 -- 172.21.15.88:0/2978149180 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v14) v1 ==== 85+0+0 (secure 0 0 0) 0x7f783000b720 con 0x7f7838154390 2023-12-08T08:21:59.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.155+0000 7f783e701640 1 -- 172.21.15.88:0/2978149180 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7824066470 msgr2=0x7f7824068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:59.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.155+0000 7f783e701640 1 --2- 172.21.15.88:0/2978149180 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7824066470 0x7f7824068930 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7828009ac0 tx=0x7f7828009190 comp rx=0 tx=0).stop 2023-12-08T08:21:59.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.155+0000 7f783e701640 1 -- 172.21.15.88:0/2978149180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7838154390 msgr2=0x7f7838147f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:59.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.155+0000 7f783e701640 1 --2- 172.21.15.88:0/2978149180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7838154390 0x7f7838147f80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f78300b1040 tx=0x7f783001b970 comp rx=0 tx=0).stop 2023-12-08T08:21:59.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.155+0000 7f783e701640 1 -- 172.21.15.88:0/2978149180 shutdown_connections 2023-12-08T08:21:59.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.155+0000 7f783e701640 1 --2- 172.21.15.88:0/2978149180 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7824066470 0x7f7824068930 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.155+0000 7f783e701640 1 --2- 172.21.15.88:0/2978149180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7838154390 0x7f7838147f80 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.155+0000 7f783e701640 1 --2- 172.21.15.88:0/2978149180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78380c4f80 0x7f78380717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.155+0000 7f783e701640 1 --2- 172.21.15.88:0/2978149180 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f78380c2110 0x7f7838151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.155+0000 7f783e701640 1 -- 172.21.15.88:0/2978149180 >> 172.21.15.88:0/2978149180 conn(0x7f783806b220 msgr2=0x7f783806cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:59.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.155+0000 7f783e701640 1 -- 172.21.15.88:0/2978149180 shutdown_connections 2023-12-08T08:21:59.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.155+0000 7f783e701640 1 -- 172.21.15.88:0/2978149180 wait complete. 2023-12-08T08:21:59.178 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:21:59.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc854c9c640 1 Processor -- start 2023-12-08T08:21:59.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc854c9c640 1 -- start start 2023-12-08T08:21:59.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc854c9c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc85014fd10 0x7fc8500a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:59.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc854c9c640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc850156110 0x7fc8501565c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:59.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc854c9c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8500c5710 con 0x7fc8500a5300 2023-12-08T08:21:59.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc854c9c640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc85006c5e0 con 0x7fc850156110 2023-12-08T08:21:59.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc854c9c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc850155c80 con 0x7fc85014fd10 2023-12-08T08:21:59.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc847fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc8500a5300 0x7fc850071e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51166/0 (socket says 172.21.15.88:51166) 2023-12-08T08:21:59.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc847fff640 1 -- 172.21.15.88:0/2847582763 learned_addr learned my addr 172.21.15.88:0/2847582763 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:59.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc84e59c640 1 --2- 172.21.15.88:0/2847582763 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc85014fd10 0x7fc8500a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:59.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc84dd9b640 1 -- 172.21.15.88:0/2847582763 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469488813 0 0) 0x7fc8500c5710 con 0x7fc8500a5300 2023-12-08T08:21:59.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc84dd9b640 1 -- 172.21.15.88:0/2847582763 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc83c003530 con 0x7fc8500a5300 2023-12-08T08:21:59.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc84ed9d640 1 --2- 172.21.15.88:0/2847582763 >> v2:172.21.15.148:3300/0 conn(0x7fc850156110 0x7fc8501565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:59.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc84dd9b640 1 -- 172.21.15.88:0/2847582763 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 410094089 0 0) 0x7fc83c003530 con 0x7fc8500a5300 2023-12-08T08:21:59.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc84dd9b640 1 -- 172.21.15.88:0/2847582763 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc85014fd10 msgr2=0x7fc8500a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:59.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc84dd9b640 1 --2- 172.21.15.88:0/2847582763 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc85014fd10 0x7fc8500a4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc84dd9b640 1 -- 172.21.15.88:0/2847582763 >> v2:172.21.15.148:3300/0 conn(0x7fc850156110 msgr2=0x7fc8501565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:59.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc84dd9b640 1 --2- 172.21.15.88:0/2847582763 >> v2:172.21.15.148:3300/0 conn(0x7fc850156110 0x7fc8501565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc84dd9b640 1 -- 172.21.15.88:0/2847582763 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8500c4e70 con 0x7fc8500a5300 2023-12-08T08:21:59.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc84dd9b640 1 -- 172.21.15.88:0/2847582763 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7fc838001680 con 0x7fc8500a5300 2023-12-08T08:21:59.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc84dd9b640 1 -- 172.21.15.88:0/2847582763 >> v1:172.21.15.88:6789/0 conn(0x7fc8500a5300 legacy=0x7fc850071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:59.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc84dd9b640 1 --2- 172.21.15.88:0/2847582763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc83c003980 0x7fc83c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:59.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc84dd9b640 1 --2- 172.21.15.88:0/2847582763 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc85014fd10 0x7fc83c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:59.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc84dd9b640 1 --2- 172.21.15.88:0/2847582763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc83c004d10 0x7fc83c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:59.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc84dd9b640 1 -- 172.21.15.88:0/2847582763 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc850155c80 con 0x7fc83c003980 2023-12-08T08:21:59.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc84dd9b640 1 -- 172.21.15.88:0/2847582763 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c00bb20 con 0x7fc83c004d10 2023-12-08T08:21:59.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc84dd9b640 1 -- 172.21.15.88:0/2847582763 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c00bce0 con 0x7fc85014fd10 2023-12-08T08:21:59.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc84e59c640 1 --2- 172.21.15.88:0/2847582763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc83c003980 0x7fc83c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:59.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc847fff640 1 --2- 172.21.15.88:0/2847582763 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc85014fd10 0x7fc83c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:59.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc84ed9d640 1 --2- 172.21.15.88:0/2847582763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc83c004d10 0x7fc83c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:59.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc84e59c640 1 -- 172.21.15.88:0/2847582763 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc85014fd10 msgr2=0x7fc83c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:59.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc84e59c640 1 --2- 172.21.15.88:0/2847582763 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc85014fd10 0x7fc83c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc84e59c640 1 -- 172.21.15.88:0/2847582763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc83c004d10 msgr2=0x7fc83c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:59.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc84e59c640 1 --2- 172.21.15.88:0/2847582763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc83c004d10 0x7fc83c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc84e59c640 1 -- 172.21.15.88:0/2847582763 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c003530 con 0x7fc83c003980 2023-12-08T08:21:59.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.311+0000 7fc847fff640 1 --2- 172.21.15.88:0/2847582763 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc85014fd10 0x7fc83c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:59.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.315+0000 7fc84e59c640 1 --2- 172.21.15.88:0/2847582763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc83c003980 0x7fc83c003da0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc84000ba30 tx=0x7fc84001c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47ae62a2f51602b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:59.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.315+0000 7fc84dd9b640 1 -- 172.21.15.88:0/2847582763 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8400ac5f0 con 0x7fc83c003980 2023-12-08T08:21:59.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.315+0000 7fc84dd9b640 1 -- 172.21.15.88:0/2847582763 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8400ac750 con 0x7fc83c003980 2023-12-08T08:21:59.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.315+0000 7fc84dd9b640 1 -- 172.21.15.88:0/2847582763 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8400acb00 con 0x7fc83c003980 2023-12-08T08:21:59.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.315+0000 7fc854c9c640 1 -- 172.21.15.88:0/2847582763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc83c003980 msgr2=0x7fc83c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:59.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.315+0000 7fc854c9c640 1 --2- 172.21.15.88:0/2847582763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc83c003980 0x7fc83c003da0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc84000ba30 tx=0x7fc84001c650 comp rx=0 tx=0).stop 2023-12-08T08:21:59.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.315+0000 7fc84ed9d640 1 -- 172.21.15.88:0/2847582763 reap_dead start 2023-12-08T08:21:59.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.315+0000 7fc854c9c640 1 -- 172.21.15.88:0/2847582763 shutdown_connections 2023-12-08T08:21:59.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.315+0000 7fc854c9c640 1 -- 172.21.15.88:0/2847582763 >> 172.21.15.88:0/2847582763 conn(0x7fc8500a7810 msgr2=0x7fc8500a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:59.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.315+0000 7fc854c9c640 1 -- 172.21.15.88:0/2847582763 shutdown_connections 2023-12-08T08:21:59.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.315+0000 7fc854c9c640 1 -- 172.21.15.88:0/2847582763 wait complete. 2023-12-08T08:21:59.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.319+0000 7fc854c9c640 1 Processor -- start 2023-12-08T08:21:59.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.319+0000 7fc854c9c640 1 -- start start 2023-12-08T08:21:59.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.319+0000 7fc854c9c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc83c003980 0x7fc850154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:59.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.319+0000 7fc854c9c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8500c0570 0x7fc850142ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:59.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.319+0000 7fc854c9c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc850143400 0x7fc8501ed0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:59.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.319+0000 7fc854c9c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8500c2340 con 0x7fc8500c0570 2023-12-08T08:21:59.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.319+0000 7fc854c9c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc850070d70 con 0x7fc850143400 2023-12-08T08:21:59.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.319+0000 7fc854c9c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8501488d0 con 0x7fc83c003980 2023-12-08T08:21:59.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.319+0000 7fc847fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8500c0570 0x7fc850142ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:59.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.319+0000 7fc847fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8500c0570 0x7fc850142ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42674/0 (socket says 172.21.15.88:42674) 2023-12-08T08:21:59.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.319+0000 7fc847fff640 1 -- 172.21.15.88:0/1922016528 learned_addr learned my addr 172.21.15.88:0/1922016528 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:59.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.319+0000 7fc84e59c640 1 --2- 172.21.15.88:0/1922016528 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc83c003980 0x7fc850154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:59.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.319+0000 7fc84ed9d640 1 --2- 172.21.15.88:0/1922016528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc850143400 0x7fc8501ed0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:59.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.319+0000 7fc847fff640 1 -- 172.21.15.88:0/1922016528 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc83c003980 msgr2=0x7fc850154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:59.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.319+0000 7fc847fff640 1 --2- 172.21.15.88:0/1922016528 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc83c003980 0x7fc850154cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.319+0000 7fc847fff640 1 -- 172.21.15.88:0/1922016528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc850143400 msgr2=0x7fc8501ed0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:59.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.319+0000 7fc847fff640 1 --2- 172.21.15.88:0/1922016528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc850143400 0x7fc8501ed0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.319+0000 7fc847fff640 1 -- 172.21.15.88:0/1922016528 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8500c2060 con 0x7fc8500c0570 2023-12-08T08:21:59.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.319+0000 7fc84ed9d640 1 --2- 172.21.15.88:0/1922016528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc850143400 0x7fc8501ed0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:59.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.319+0000 7fc847fff640 1 --2- 172.21.15.88:0/1922016528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8500c0570 0x7fc850142ec0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc83800e730 tx=0x7fc83800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:59.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.319+0000 7fc846ffd640 1 -- 172.21.15.88:0/1922016528 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83800ee40 con 0x7fc8500c0570 2023-12-08T08:21:59.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.319+0000 7fc846ffd640 1 -- 172.21.15.88:0/1922016528 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83800c8d0 con 0x7fc8500c0570 2023-12-08T08:21:59.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.323+0000 7fc846ffd640 1 -- 172.21.15.88:0/1922016528 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83800cc60 con 0x7fc8500c0570 2023-12-08T08:21:59.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.323+0000 7fc854c9c640 1 -- 172.21.15.88:0/1922016528 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc850148b70 con 0x7fc8500c0570 2023-12-08T08:21:59.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.323+0000 7fc854c9c640 1 -- 172.21.15.88:0/1922016528 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc850155200 con 0x7fc8500c0570 2023-12-08T08:21:59.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.323+0000 7fc854c9c640 1 -- 172.21.15.88:0/1922016528 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc850148730 con 0x7fc8500c0570 2023-12-08T08:21:59.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.323+0000 7fc846ffd640 1 -- 172.21.15.88:0/1922016528 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc838013420 con 0x7fc8500c0570 2023-12-08T08:21:59.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.323+0000 7fc846ffd640 1 --2- 172.21.15.88:0/1922016528 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc8300664a0 0x7fc830068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:59.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.323+0000 7fc846ffd640 1 -- 172.21.15.88:0/1922016528 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc838083650 con 0x7fc8500c0570 2023-12-08T08:21:59.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.323+0000 7fc84e59c640 1 --2- 172.21.15.88:0/1922016528 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc8300664a0 0x7fc830068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:59.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.323+0000 7fc84e59c640 1 --2- 172.21.15.88:0/1922016528 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc8300664a0 0x7fc830068960 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc8400b0000 tx=0x7fc8400b7040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:59.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.327+0000 7fc846ffd640 1 -- 172.21.15.88:0/1922016528 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc850148730 con 0x7fc8500c0570 2023-12-08T08:21:59.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.479+0000 7fc854c9c640 1 -- 172.21.15.88:0/1922016528 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc850148730 con 0x7fc8500c0570 2023-12-08T08:21:59.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.483+0000 7fc846ffd640 1 -- 172.21.15.88:0/1922016528 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+12833 (secure 0 0 0) 0x7fc850148730 con 0x7fc8500c0570 2023-12-08T08:21:59.486 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:21:59.487 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":46,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:21:58.383447+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:21:59.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.483+0000 7fc854c9c640 1 -- 172.21.15.88:0/1922016528 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc8300664a0 msgr2=0x7fc830068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:59.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.483+0000 7fc854c9c640 1 --2- 172.21.15.88:0/1922016528 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc8300664a0 0x7fc830068960 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc8400b0000 tx=0x7fc8400b7040 comp rx=0 tx=0).stop 2023-12-08T08:21:59.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.483+0000 7fc854c9c640 1 -- 172.21.15.88:0/1922016528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8500c0570 msgr2=0x7fc850142ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:59.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.483+0000 7fc854c9c640 1 --2- 172.21.15.88:0/1922016528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8500c0570 0x7fc850142ec0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc83800e730 tx=0x7fc83800ebf0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.483+0000 7fc854c9c640 1 -- 172.21.15.88:0/1922016528 shutdown_connections 2023-12-08T08:21:59.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.483+0000 7fc854c9c640 1 --2- 172.21.15.88:0/1922016528 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc8300664a0 0x7fc830068960 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.483+0000 7fc854c9c640 1 --2- 172.21.15.88:0/1922016528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc850143400 0x7fc8501ed0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.483+0000 7fc854c9c640 1 --2- 172.21.15.88:0/1922016528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8500c0570 0x7fc850142ec0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.483+0000 7fc854c9c640 1 --2- 172.21.15.88:0/1922016528 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc83c003980 0x7fc850154cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.483+0000 7fc854c9c640 1 -- 172.21.15.88:0/1922016528 >> 172.21.15.88:0/1922016528 conn(0x7fc8500a7810 msgr2=0x7fc85014ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:59.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.483+0000 7fc854c9c640 1 -- 172.21.15.88:0/1922016528 shutdown_connections 2023-12-08T08:21:59.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.483+0000 7fc854c9c640 1 -- 172.21.15.88:0/1922016528 wait complete. 2023-12-08T08:21:59.507 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:21:59.508 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:21:59.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.643+0000 7f9278632640 1 Processor -- start 2023-12-08T08:21:59.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.643+0000 7f9278632640 1 -- start start 2023-12-08T08:21:59.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.643+0000 7f9278632640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f927014f850 0x7f92700aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:59.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.643+0000 7f9278632640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9270152910 con 0x7f927014fc30 2023-12-08T08:21:59.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.643+0000 7f9278632640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9270152bf0 con 0x7f927006d840 2023-12-08T08:21:59.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.643+0000 7f9278632640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92700c2240 con 0x7f927014f850 2023-12-08T08:21:59.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.643+0000 7f9275bcd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f927014fc30 0x7f92700c3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51178/0 (socket says 172.21.15.88:51178) 2023-12-08T08:21:59.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.643+0000 7f9275bcd640 1 -- 172.21.15.88:0/3037640625 learned_addr learned my addr 172.21.15.88:0/3037640625 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:59.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.643+0000 7f92763ce640 1 --2- 172.21.15.88:0/3037640625 >> v2:172.21.15.148:3300/0 conn(0x7f927014f850 0x7f92700aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:59.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.643+0000 7f92753cc640 1 -- 172.21.15.88:0/3037640625 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840122100 0 0) 0x7f9270152910 con 0x7f927014fc30 2023-12-08T08:21:59.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.643+0000 7f92753cc640 1 -- 172.21.15.88:0/3037640625 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f925c003530 con 0x7f927014fc30 2023-12-08T08:21:59.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.647+0000 7f92753cc640 1 -- 172.21.15.88:0/3037640625 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 424969894 0 0) 0x7f925c003530 con 0x7f927014fc30 2023-12-08T08:21:59.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.647+0000 7f92753cc640 1 -- 172.21.15.88:0/3037640625 >> v2:172.21.15.148:3300/0 conn(0x7f927014f850 msgr2=0x7f92700aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:59.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.647+0000 7f92753cc640 1 --2- 172.21.15.88:0/3037640625 >> v2:172.21.15.148:3300/0 conn(0x7f927014f850 0x7f92700aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.647+0000 7f92753cc640 1 -- 172.21.15.88:0/3037640625 >> v1:172.21.15.148:6789/0 conn(0x7f927006d840 legacy=0x7f92700c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.647+0000 7f92753cc640 1 -- 172.21.15.88:0/3037640625 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9270152ed0 con 0x7f927014fc30 2023-12-08T08:21:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.647+0000 7f92753cc640 1 -- 172.21.15.88:0/3037640625 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f9260001680 con 0x7f927014fc30 2023-12-08T08:21:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.647+0000 7f92753cc640 1 -- 172.21.15.88:0/3037640625 >> v1:172.21.15.88:6789/0 conn(0x7f927014fc30 legacy=0x7f92700c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.647+0000 7f92753cc640 1 --2- 172.21.15.88:0/3037640625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f925c003980 0x7f925c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.647+0000 7f92753cc640 1 --2- 172.21.15.88:0/3037640625 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f925c0047d0 0x7f925c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.647+0000 7f92753cc640 1 --2- 172.21.15.88:0/3037640625 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f925c005190 0x7f925c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.647+0000 7f92753cc640 1 -- 172.21.15.88:0/3037640625 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92700c2240 con 0x7f925c005190 2023-12-08T08:21:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.647+0000 7f92753cc640 1 -- 172.21.15.88:0/3037640625 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c00c130 con 0x7f925c003980 2023-12-08T08:21:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.647+0000 7f92753cc640 1 -- 172.21.15.88:0/3037640625 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925c00c2f0 con 0x7f925c0047d0 2023-12-08T08:21:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.647+0000 7f9276bcf640 1 --2- 172.21.15.88:0/3037640625 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f925c005190 0x7f925c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.647+0000 7f92763ce640 1 --2- 172.21.15.88:0/3037640625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f925c003980 0x7f925c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.647+0000 7f9275bcd640 1 --2- 172.21.15.88:0/3037640625 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f925c0047d0 0x7f925c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:59.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.647+0000 7f9276bcf640 1 -- 172.21.15.88:0/3037640625 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f925c0047d0 msgr2=0x7f925c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:59.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.647+0000 7f9276bcf640 1 --2- 172.21.15.88:0/3037640625 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f925c0047d0 0x7f925c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.647+0000 7f9276bcf640 1 -- 172.21.15.88:0/3037640625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f925c003980 msgr2=0x7f925c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:59.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.647+0000 7f9276bcf640 1 --2- 172.21.15.88:0/3037640625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f925c003980 0x7f925c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.647+0000 7f9276bcf640 1 -- 172.21.15.88:0/3037640625 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c003530 con 0x7f925c005190 2023-12-08T08:21:59.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.647+0000 7f9276bcf640 1 -- 172.21.15.88:0/3037640625 reap_dead start 2023-12-08T08:21:59.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.647+0000 7f9276bcf640 1 --2- 172.21.15.88:0/3037640625 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f925c005190 0x7f925c00b990 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9268001e70 tx=0x7f926801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9c29816464b5b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:59.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.647+0000 7f92753cc640 1 -- 172.21.15.88:0/3037640625 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268003b80 con 0x7f925c005190 2023-12-08T08:21:59.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.647+0000 7f92753cc640 1 -- 172.21.15.88:0/3037640625 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9268003d20 con 0x7f925c005190 2023-12-08T08:21:59.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.651+0000 7f92753cc640 1 -- 172.21.15.88:0/3037640625 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268005310 con 0x7f925c005190 2023-12-08T08:21:59.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.651+0000 7f9278632640 1 -- 172.21.15.88:0/3037640625 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f925c005190 msgr2=0x7f925c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:59.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.651+0000 7f9278632640 1 --2- 172.21.15.88:0/3037640625 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f925c005190 0x7f925c00b990 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9268001e70 tx=0x7f926801c760 comp rx=0 tx=0).stop 2023-12-08T08:21:59.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.651+0000 7f9278632640 1 -- 172.21.15.88:0/3037640625 shutdown_connections 2023-12-08T08:21:59.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.651+0000 7f9278632640 1 --2- 172.21.15.88:0/3037640625 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f925c005190 0x7f925c00b990 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.651+0000 7f9278632640 1 -- 172.21.15.88:0/3037640625 >> 172.21.15.88:0/3037640625 conn(0x7f92700c59f0 msgr2=0x7f92700c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:59.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.651+0000 7f9278632640 1 -- 172.21.15.88:0/3037640625 shutdown_connections 2023-12-08T08:21:59.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.651+0000 7f9278632640 1 -- 172.21.15.88:0/3037640625 wait complete. 2023-12-08T08:21:59.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.651+0000 7f9278632640 1 Processor -- start 2023-12-08T08:21:59.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.651+0000 7f9278632640 1 -- start start 2023-12-08T08:21:59.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.651+0000 7f9278632640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f925c005190 0x7f92700a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.651+0000 7f9278632640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92701566f0 0x7f92701ece50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.651+0000 7f9278632640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f927014c560 0x7f92701ed390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.651+0000 7f9278632640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92701ed8d0 con 0x7f927014c560 2023-12-08T08:21:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.651+0000 7f9278632640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92701538b0 con 0x7f925c005190 2023-12-08T08:21:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.651+0000 7f9278632640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92700aa330 con 0x7f92701566f0 2023-12-08T08:21:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.651+0000 7f9276bcf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f927014c560 0x7f92701ed390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.651+0000 7f9276bcf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f927014c560 0x7f92701ed390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42698/0 (socket says 172.21.15.88:42698) 2023-12-08T08:21:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.651+0000 7f9276bcf640 1 -- 172.21.15.88:0/3981839627 learned_addr learned my addr 172.21.15.88:0/3981839627 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.651+0000 7f92763ce640 1 --2- 172.21.15.88:0/3981839627 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f925c005190 0x7f92700a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.651+0000 7f9275bcd640 1 --2- 172.21.15.88:0/3981839627 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92701566f0 0x7f92701ece50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.655+0000 7f9276bcf640 1 -- 172.21.15.88:0/3981839627 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92701566f0 msgr2=0x7f92701ece50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.655+0000 7f9276bcf640 1 --2- 172.21.15.88:0/3981839627 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92701566f0 0x7f92701ece50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.655+0000 7f9276bcf640 1 -- 172.21.15.88:0/3981839627 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f925c005190 msgr2=0x7f92700a9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.655+0000 7f9276bcf640 1 --2- 172.21.15.88:0/3981839627 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f925c005190 0x7f92700a9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.655+0000 7f9276bcf640 1 -- 172.21.15.88:0/3981839627 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92701ea670 con 0x7f927014c560 2023-12-08T08:21:59.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.655+0000 7f9276bcf640 1 --2- 172.21.15.88:0/3981839627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f927014c560 0x7f92701ed390 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f926801c590 tx=0x7f925c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:59.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.655+0000 7f9266ffd640 1 -- 172.21.15.88:0/3981839627 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268006d60 con 0x7f927014c560 2023-12-08T08:21:59.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.655+0000 7f9266ffd640 1 -- 172.21.15.88:0/3981839627 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9268003e90 con 0x7f927014c560 2023-12-08T08:21:59.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.655+0000 7f9278632640 1 -- 172.21.15.88:0/3981839627 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9270153ac0 con 0x7f927014c560 2023-12-08T08:21:59.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.655+0000 7f9266ffd640 1 -- 172.21.15.88:0/3981839627 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268007270 con 0x7f927014c560 2023-12-08T08:21:59.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.655+0000 7f9278632640 1 -- 172.21.15.88:0/3981839627 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92700aaee0 con 0x7f927014c560 2023-12-08T08:21:59.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.655+0000 7f9278632640 1 -- 172.21.15.88:0/3981839627 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92700aac00 con 0x7f927014c560 2023-12-08T08:21:59.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.655+0000 7f9266ffd640 1 -- 172.21.15.88:0/3981839627 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f92680073d0 con 0x7f927014c560 2023-12-08T08:21:59.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.655+0000 7f9266ffd640 1 --2- 172.21.15.88:0/3981839627 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9254066470 0x7f9254068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:59.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.659+0000 7f9266ffd640 1 -- 172.21.15.88:0/3981839627 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f926811cb40 con 0x7f927014c560 2023-12-08T08:21:59.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.659+0000 7f92763ce640 1 --2- 172.21.15.88:0/3981839627 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9254066470 0x7f9254068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:59.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.659+0000 7f92763ce640 1 --2- 172.21.15.88:0/3981839627 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9254066470 0x7f9254068930 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f926c009b60 tx=0x7f926c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:59.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.659+0000 7f9266ffd640 1 -- 172.21.15.88:0/3981839627 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f92700aac00 con 0x7f927014c560 2023-12-08T08:21:59.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.811+0000 7f9278632640 1 -- 172.21.15.88:0/3981839627 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92700aac00 con 0x7f927014c560 2023-12-08T08:21:59.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.811+0000 7f9266ffd640 1 -- 172.21.15.88:0/3981839627 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f92700aac00 con 0x7f927014c560 2023-12-08T08:21:59.818 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:21:59.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.815+0000 7f9278632640 1 -- 172.21.15.88:0/3981839627 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9254066470 msgr2=0x7f9254068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:59.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.815+0000 7f9278632640 1 --2- 172.21.15.88:0/3981839627 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9254066470 0x7f9254068930 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f926c009b60 tx=0x7f926c009190 comp rx=0 tx=0).stop 2023-12-08T08:21:59.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.815+0000 7f9278632640 1 -- 172.21.15.88:0/3981839627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f927014c560 msgr2=0x7f92701ed390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:59.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.815+0000 7f9278632640 1 --2- 172.21.15.88:0/3981839627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f927014c560 0x7f92701ed390 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f926801c590 tx=0x7f925c005800 comp rx=0 tx=0).stop 2023-12-08T08:21:59.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.815+0000 7f9278632640 1 -- 172.21.15.88:0/3981839627 shutdown_connections 2023-12-08T08:21:59.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.815+0000 7f9278632640 1 --2- 172.21.15.88:0/3981839627 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9254066470 0x7f9254068930 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.815+0000 7f9278632640 1 --2- 172.21.15.88:0/3981839627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f927014c560 0x7f92701ed390 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.815+0000 7f9278632640 1 --2- 172.21.15.88:0/3981839627 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f92701566f0 0x7f92701ece50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.815+0000 7f9278632640 1 --2- 172.21.15.88:0/3981839627 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f925c005190 0x7f92700a9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.815+0000 7f9278632640 1 -- 172.21.15.88:0/3981839627 >> 172.21.15.88:0/3981839627 conn(0x7f92700c59f0 msgr2=0x7f92700733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:59.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.815+0000 7f9278632640 1 -- 172.21.15.88:0/3981839627 shutdown_connections 2023-12-08T08:21:59.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.815+0000 7f9278632640 1 -- 172.21.15.88:0/3981839627 wait complete. 2023-12-08T08:21:59.839 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-08T08:21:59.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.971+0000 7f28fd11c640 1 Processor -- start 2023-12-08T08:21:59.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.971+0000 7f28fd11c640 1 -- start start 2023-12-08T08:21:59.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.971+0000 7f28fd11c640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f28f80af4c0 0x7f28f8154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:59.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.971+0000 7f28fd11c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28f80c67d0 0x7f28f80c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:59.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.971+0000 7f28fd11c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f80c4890 con 0x7f28f806b9f0 2023-12-08T08:21:59.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.971+0000 7f28fd11c640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f8155460 con 0x7f28f80af4c0 2023-12-08T08:21:59.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.971+0000 7f28fd11c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f80af8a0 con 0x7f28f80c67d0 2023-12-08T08:21:59.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f759e640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f28f806b9f0 0x7f28f8157a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51192/0 (socket says 172.21.15.88:51192) 2023-12-08T08:21:59.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f759e640 1 -- 172.21.15.88:0/737271819 learned_addr learned my addr 172.21.15.88:0/737271819 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:21:59.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f659c640 1 --2- 172.21.15.88:0/737271819 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28f80c67d0 0x7f28f80c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:59.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f6d9d640 1 --2- 172.21.15.88:0/737271819 >> v2:172.21.15.148:3300/0 conn(0x7f28f80af4c0 0x7f28f8154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:59.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f5d9b640 1 -- 172.21.15.88:0/737271819 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1224589014 0 0) 0x7f28f80c4890 con 0x7f28f806b9f0 2023-12-08T08:21:59.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f5d9b640 1 -- 172.21.15.88:0/737271819 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28e0003530 con 0x7f28f806b9f0 2023-12-08T08:21:59.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f5d9b640 1 -- 172.21.15.88:0/737271819 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3308364993 0 0) 0x7f28e0003530 con 0x7f28f806b9f0 2023-12-08T08:21:59.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f5d9b640 1 -- 172.21.15.88:0/737271819 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28f80c67d0 msgr2=0x7f28f80c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:59.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f5d9b640 1 --2- 172.21.15.88:0/737271819 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28f80c67d0 0x7f28f80c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f5d9b640 1 -- 172.21.15.88:0/737271819 >> v2:172.21.15.148:3300/0 conn(0x7f28f80af4c0 msgr2=0x7f28f8154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:59.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f5d9b640 1 --2- 172.21.15.88:0/737271819 >> v2:172.21.15.148:3300/0 conn(0x7f28f80af4c0 0x7f28f8154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f5d9b640 1 -- 172.21.15.88:0/737271819 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f80c4b30 con 0x7f28f806b9f0 2023-12-08T08:21:59.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f5d9b640 1 -- 172.21.15.88:0/737271819 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f28f0001a00 con 0x7f28f806b9f0 2023-12-08T08:21:59.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f5d9b640 1 -- 172.21.15.88:0/737271819 >> v1:172.21.15.88:6789/0 conn(0x7f28f806b9f0 legacy=0x7f28f8157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:59.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f5d9b640 1 --2- 172.21.15.88:0/737271819 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28f80c67d0 0x7f28e0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:59.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f5d9b640 1 --2- 172.21.15.88:0/737271819 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28e0003f00 0x7f28e00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:59.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f5d9b640 1 --2- 172.21.15.88:0/737271819 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28e0004d10 0x7f28e0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:59.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f5d9b640 1 -- 172.21.15.88:0/737271819 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f8155460 con 0x7f28e0004d10 2023-12-08T08:21:59.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f5d9b640 1 -- 172.21.15.88:0/737271819 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f80af8a0 con 0x7f28e0003f00 2023-12-08T08:21:59.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f5d9b640 1 -- 172.21.15.88:0/737271819 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e000b9e0 con 0x7f28f80c67d0 2023-12-08T08:21:59.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f759e640 1 --2- 172.21.15.88:0/737271819 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28e0004d10 0x7f28e0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:59.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f6d9d640 1 --2- 172.21.15.88:0/737271819 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28f80c67d0 0x7f28e0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:59.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f659c640 1 --2- 172.21.15.88:0/737271819 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28e0003f00 0x7f28e00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:59.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f759e640 1 -- 172.21.15.88:0/737271819 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28f80c67d0 msgr2=0x7f28e0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:59.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f759e640 1 --2- 172.21.15.88:0/737271819 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28f80c67d0 0x7f28e0003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f759e640 1 -- 172.21.15.88:0/737271819 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28e0003f00 msgr2=0x7f28e00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:59.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f759e640 1 --2- 172.21.15.88:0/737271819 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28e0003f00 0x7f28e00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.975+0000 7f28f759e640 1 -- 172.21.15.88:0/737271819 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e0003530 con 0x7f28e0004d10 2023-12-08T08:21:59.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.979+0000 7f28f759e640 1 --2- 172.21.15.88:0/737271819 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28e0004d10 0x7f28e0005190 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f28f000a860 tx=0x7f28f001faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edb80b726512ac93 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:59.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.979+0000 7f28f5d9b640 1 -- 172.21.15.88:0/737271819 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f00aa6d0 con 0x7f28e0004d10 2023-12-08T08:21:59.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.979+0000 7f28f5d9b640 1 -- 172.21.15.88:0/737271819 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f00aa830 con 0x7f28e0004d10 2023-12-08T08:21:59.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.979+0000 7f28f5d9b640 1 -- 172.21.15.88:0/737271819 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f00aac40 con 0x7f28e0004d10 2023-12-08T08:21:59.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.979+0000 7f28fd11c640 1 -- 172.21.15.88:0/737271819 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28e0004d10 msgr2=0x7f28e0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:59.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.979+0000 7f28fd11c640 1 --2- 172.21.15.88:0/737271819 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28e0004d10 0x7f28e0005190 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f28f000a860 tx=0x7f28f001faa0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.979+0000 7f28f759e640 1 -- 172.21.15.88:0/737271819 reap_dead start 2023-12-08T08:21:59.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.979+0000 7f28fd11c640 1 -- 172.21.15.88:0/737271819 shutdown_connections 2023-12-08T08:21:59.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.979+0000 7f28fd11c640 1 -- 172.21.15.88:0/737271819 >> 172.21.15.88:0/737271819 conn(0x7f28f80ab9d0 msgr2=0x7f28f80abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:59.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.979+0000 7f28fd11c640 1 -- 172.21.15.88:0/737271819 shutdown_connections 2023-12-08T08:21:59.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.979+0000 7f28fd11c640 1 -- 172.21.15.88:0/737271819 wait complete. 2023-12-08T08:21:59.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.979+0000 7f28fd11c640 1 Processor -- start 2023-12-08T08:21:59.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.979+0000 7f28fd11c640 1 -- start start 2023-12-08T08:21:59.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.983+0000 7f28fd11c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28f80c92d0 0x7f28f81ee880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:59.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.983+0000 7f28fd11c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28f814cf30 0x7f28f8148fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:59.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.983+0000 7f28fd11c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28f8149520 0x7f28f80ada70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:59.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.983+0000 7f28fd11c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f81eee60 con 0x7f28f80c92d0 2023-12-08T08:21:59.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.983+0000 7f28fd11c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f81f1ec0 con 0x7f28f814cf30 2023-12-08T08:21:59.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.983+0000 7f28fd11c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f81f2350 con 0x7f28f8149520 2023-12-08T08:21:59.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.983+0000 7f28f6d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28f80c92d0 0x7f28f81ee880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:59.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.983+0000 7f28f6d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28f80c92d0 0x7f28f81ee880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42716/0 (socket says 172.21.15.88:42716) 2023-12-08T08:21:59.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.983+0000 7f28f6d9d640 1 -- 172.21.15.88:0/1781557975 learned_addr learned my addr 172.21.15.88:0/1781557975 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:21:59.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.983+0000 7f28f6d9d640 1 -- 172.21.15.88:0/1781557975 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28f8149520 msgr2=0x7f28f80ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:59.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.983+0000 7f28f6d9d640 1 --2- 172.21.15.88:0/1781557975 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28f8149520 0x7f28f80ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.983+0000 7f28f6d9d640 1 -- 172.21.15.88:0/1781557975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28f814cf30 msgr2=0x7f28f8148fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:59.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.983+0000 7f28f6d9d640 1 --2- 172.21.15.88:0/1781557975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28f814cf30 0x7f28f8148fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:59.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.983+0000 7f28f6d9d640 1 -- 172.21.15.88:0/1781557975 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f81f1590 con 0x7f28f80c92d0 2023-12-08T08:21:59.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.983+0000 7f28f6d9d640 1 --2- 172.21.15.88:0/1781557975 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28f80c92d0 0x7f28f81ee880 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f28e8011aa0 tx=0x7f28e8011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:59.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.983+0000 7f28df7fe640 1 -- 172.21.15.88:0/1781557975 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e800faa0 con 0x7f28f80c92d0 2023-12-08T08:21:59.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.983+0000 7f28df7fe640 1 -- 172.21.15.88:0/1781557975 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e800fc00 con 0x7f28f80c92d0 2023-12-08T08:21:59.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.983+0000 7f28fd11c640 1 -- 172.21.15.88:0/1781557975 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f81f1870 con 0x7f28f80c92d0 2023-12-08T08:21:59.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.983+0000 7f28df7fe640 1 -- 172.21.15.88:0/1781557975 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e8014440 con 0x7f28f80c92d0 2023-12-08T08:21:59.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.983+0000 7f28fd11c640 1 -- 172.21.15.88:0/1781557975 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f81499a0 con 0x7f28f80c92d0 2023-12-08T08:21:59.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.983+0000 7f28fd11c640 1 -- 172.21.15.88:0/1781557975 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f8067630 con 0x7f28f80c92d0 2023-12-08T08:21:59.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.983+0000 7f28df7fe640 1 -- 172.21.15.88:0/1781557975 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f28e80145a0 con 0x7f28f80c92d0 2023-12-08T08:21:59.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.987+0000 7f28df7fe640 1 --2- 172.21.15.88:0/1781557975 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f28e40664a0 0x7f28e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:59.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.987+0000 7f28df7fe640 1 -- 172.21.15.88:0/1781557975 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f28e80843e0 con 0x7f28f80c92d0 2023-12-08T08:21:59.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.987+0000 7f28f659c640 1 --2- 172.21.15.88:0/1781557975 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f28e40664a0 0x7f28e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:59.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.987+0000 7f28f659c640 1 --2- 172.21.15.88:0/1781557975 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f28e40664a0 0x7f28e4068960 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f28f8157ea0 tx=0x7f28ec009340 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:59.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:21:59.991+0000 7f28df7fe640 1 -- 172.21.15.88:0/1781557975 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f28e8051b10 con 0x7f28f80c92d0 2023-12-08T08:22:00.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.143+0000 7f28fd11c640 1 -- 172.21.15.88:0/1781557975 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f28f806c7a0 con 0x7f28f80c92d0 2023-12-08T08:22:00.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.143+0000 7f28df7fe640 1 -- 172.21.15.88:0/1781557975 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v46) v1 ==== 84+0+65 (secure 0 0 0) 0x7f28e8055130 con 0x7f28f80c92d0 2023-12-08T08:22:00.149 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:00.149 INFO:teuthology.orchestra.run.smithi088.stdout:[ 2023-12-08T08:22:00.149 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:22:00.149 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 1, 2023-12-08T08:22:00.149 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": ".mgr" 2023-12-08T08:22:00.149 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:22:00.150 INFO:teuthology.orchestra.run.smithi088.stdout:] 2023-12-08T08:22:00.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.147+0000 7f28fd11c640 1 -- 172.21.15.88:0/1781557975 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f28e40664a0 msgr2=0x7f28e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:00.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.147+0000 7f28fd11c640 1 --2- 172.21.15.88:0/1781557975 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f28e40664a0 0x7f28e4068960 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f28f8157ea0 tx=0x7f28ec009340 comp rx=0 tx=0).stop 2023-12-08T08:22:00.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.147+0000 7f28fd11c640 1 -- 172.21.15.88:0/1781557975 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28f80c92d0 msgr2=0x7f28f81ee880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:00.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.147+0000 7f28fd11c640 1 --2- 172.21.15.88:0/1781557975 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28f80c92d0 0x7f28f81ee880 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f28e8011aa0 tx=0x7f28e8011f60 comp rx=0 tx=0).stop 2023-12-08T08:22:00.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.147+0000 7f28fd11c640 1 -- 172.21.15.88:0/1781557975 shutdown_connections 2023-12-08T08:22:00.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.147+0000 7f28fd11c640 1 --2- 172.21.15.88:0/1781557975 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f28e40664a0 0x7f28e4068960 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:00.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.147+0000 7f28fd11c640 1 --2- 172.21.15.88:0/1781557975 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f28f8149520 0x7f28f80ada70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:00.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.147+0000 7f28fd11c640 1 --2- 172.21.15.88:0/1781557975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28f814cf30 0x7f28f8148fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:00.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.147+0000 7f28fd11c640 1 --2- 172.21.15.88:0/1781557975 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28f80c92d0 0x7f28f81ee880 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:00.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.147+0000 7f28fd11c640 1 -- 172.21.15.88:0/1781557975 >> 172.21.15.88:0/1781557975 conn(0x7f28f80ab9d0 msgr2=0x7f28f80a9860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:00.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.147+0000 7f28fd11c640 1 -- 172.21.15.88:0/1781557975 shutdown_connections 2023-12-08T08:22:00.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.147+0000 7f28fd11c640 1 -- 172.21.15.88:0/1781557975 wait complete. 2023-12-08T08:22:00.170 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-08T08:22:00.170 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-08T08:22:00.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.307+0000 7ffb664aa640 1 Processor -- start 2023-12-08T08:22:00.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.307+0000 7ffb664aa640 1 -- start start 2023-12-08T08:22:00.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.307+0000 7ffb664aa640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ffb6014f850 0x7ffb600aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:00.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.307+0000 7ffb664aa640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb60152910 con 0x7ffb6014fc30 2023-12-08T08:22:00.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.307+0000 7ffb664aa640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb60152bf0 con 0x7ffb6006d840 2023-12-08T08:22:00.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.307+0000 7ffb664aa640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb600c2240 con 0x7ffb6014f850 2023-12-08T08:22:00.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.307+0000 7ffb5f7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ffb6014fc30 0x7ffb600c3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39006/0 (socket says 172.21.15.88:39006) 2023-12-08T08:22:00.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.307+0000 7ffb5f7fe640 1 -- 172.21.15.88:0/4107031450 learned_addr learned my addr 172.21.15.88:0/4107031450 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:00.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.307+0000 7ffb5ffff640 1 --2- 172.21.15.88:0/4107031450 >> v2:172.21.15.148:3300/0 conn(0x7ffb6014f850 0x7ffb600aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:00.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.307+0000 7ffb5effd640 1 -- 172.21.15.88:0/4107031450 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3366651791 0 0) 0x7ffb60152910 con 0x7ffb6014fc30 2023-12-08T08:22:00.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.307+0000 7ffb5effd640 1 -- 172.21.15.88:0/4107031450 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb48003530 con 0x7ffb6014fc30 2023-12-08T08:22:00.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.307+0000 7ffb5effd640 1 -- 172.21.15.88:0/4107031450 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3573987295 0 0) 0x7ffb48003530 con 0x7ffb6014fc30 2023-12-08T08:22:00.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.307+0000 7ffb5effd640 1 -- 172.21.15.88:0/4107031450 >> v2:172.21.15.148:3300/0 conn(0x7ffb6014f850 msgr2=0x7ffb600aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:00.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.307+0000 7ffb5effd640 1 --2- 172.21.15.88:0/4107031450 >> v2:172.21.15.148:3300/0 conn(0x7ffb6014f850 0x7ffb600aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:00.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.307+0000 7ffb5effd640 1 -- 172.21.15.88:0/4107031450 >> v1:172.21.15.148:6789/0 conn(0x7ffb6006d840 legacy=0x7ffb600c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:00.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.307+0000 7ffb5effd640 1 -- 172.21.15.88:0/4107031450 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb60152ed0 con 0x7ffb6014fc30 2023-12-08T08:22:00.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.307+0000 7ffb5effd640 1 -- 172.21.15.88:0/4107031450 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7ffb54001680 con 0x7ffb6014fc30 2023-12-08T08:22:00.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.307+0000 7ffb5effd640 1 -- 172.21.15.88:0/4107031450 >> v1:172.21.15.88:6789/0 conn(0x7ffb6014fc30 legacy=0x7ffb600c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.307+0000 7ffb5effd640 1 --2- 172.21.15.88:0/4107031450 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffb48003980 0x7ffb48003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.307+0000 7ffb5effd640 1 --2- 172.21.15.88:0/4107031450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb48004380 0x7ffb48004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.307+0000 7ffb5effd640 1 --2- 172.21.15.88:0/4107031450 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb480050f0 0x7ffb4800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.307+0000 7ffb5effd640 1 -- 172.21.15.88:0/4107031450 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb600c2240 con 0x7ffb48004380 2023-12-08T08:22:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.307+0000 7ffb5effd640 1 -- 172.21.15.88:0/4107031450 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4800c030 con 0x7ffb480050f0 2023-12-08T08:22:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.307+0000 7ffb5effd640 1 -- 172.21.15.88:0/4107031450 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4800c1f0 con 0x7ffb48003980 2023-12-08T08:22:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.307+0000 7ffb5ffff640 1 --2- 172.21.15.88:0/4107031450 >> v2:172.21.15.148:3300/0 conn(0x7ffb6014f850 0x7ffb600aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:22:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.307+0000 7ffb5f7fe640 1 --2- 172.21.15.88:0/4107031450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb48004380 0x7ffb48004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.307+0000 7ffb64a47640 1 --2- 172.21.15.88:0/4107031450 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb480050f0 0x7ffb4800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.311+0000 7ffb5ffff640 1 --2- 172.21.15.88:0/4107031450 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffb48003980 0x7ffb48003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.311+0000 7ffb5f7fe640 1 -- 172.21.15.88:0/4107031450 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffb48003980 msgr2=0x7ffb48003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.311+0000 7ffb5f7fe640 1 --2- 172.21.15.88:0/4107031450 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffb48003980 0x7ffb48003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.311+0000 7ffb5f7fe640 1 -- 172.21.15.88:0/4107031450 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb480050f0 msgr2=0x7ffb4800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.311+0000 7ffb5f7fe640 1 --2- 172.21.15.88:0/4107031450 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb480050f0 0x7ffb4800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.311+0000 7ffb5f7fe640 1 -- 172.21.15.88:0/4107031450 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb48003530 con 0x7ffb48004380 2023-12-08T08:22:00.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.311+0000 7ffb64a47640 1 -- 172.21.15.88:0/4107031450 reap_dead start 2023-12-08T08:22:00.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.311+0000 7ffb5f7fe640 1 --2- 172.21.15.88:0/4107031450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb48004380 0x7ffb48004850 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ffb5400c1c0 tx=0x7ffb5401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3e52a86452db0d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:00.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.311+0000 7ffb5effd640 1 -- 172.21.15.88:0/4107031450 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb54005ae0 con 0x7ffb48004380 2023-12-08T08:22:00.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.311+0000 7ffb5effd640 1 -- 172.21.15.88:0/4107031450 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb54005c40 con 0x7ffb48004380 2023-12-08T08:22:00.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.311+0000 7ffb5effd640 1 -- 172.21.15.88:0/4107031450 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb540a58a0 con 0x7ffb48004380 2023-12-08T08:22:00.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.311+0000 7ffb664aa640 1 -- 172.21.15.88:0/4107031450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb48004380 msgr2=0x7ffb48004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:00.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.311+0000 7ffb664aa640 1 --2- 172.21.15.88:0/4107031450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb48004380 0x7ffb48004850 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ffb5400c1c0 tx=0x7ffb5401cc20 comp rx=0 tx=0).stop 2023-12-08T08:22:00.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.311+0000 7ffb664aa640 1 -- 172.21.15.88:0/4107031450 shutdown_connections 2023-12-08T08:22:00.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.311+0000 7ffb664aa640 1 --2- 172.21.15.88:0/4107031450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb48004380 0x7ffb48004850 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:00.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.315+0000 7ffb664aa640 1 -- 172.21.15.88:0/4107031450 >> 172.21.15.88:0/4107031450 conn(0x7ffb600c59f0 msgr2=0x7ffb600c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:00.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.315+0000 7ffb664aa640 1 -- 172.21.15.88:0/4107031450 shutdown_connections 2023-12-08T08:22:00.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.315+0000 7ffb664aa640 1 -- 172.21.15.88:0/4107031450 wait complete. 2023-12-08T08:22:00.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.315+0000 7ffb664aa640 1 Processor -- start 2023-12-08T08:22:00.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.315+0000 7ffb664aa640 1 -- start start 2023-12-08T08:22:00.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.315+0000 7ffb664aa640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb48004380 0x7ffb601ea760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:00.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.315+0000 7ffb664aa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb601566e0 0x7ffb601edce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:00.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.315+0000 7ffb664aa640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffb600a8fa0 0x7ffb600befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:00.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.315+0000 7ffb664aa640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb60070570 con 0x7ffb601566e0 2023-12-08T08:22:00.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.315+0000 7ffb664aa640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb601eaca0 con 0x7ffb48004380 2023-12-08T08:22:00.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.315+0000 7ffb664aa640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb601ed290 con 0x7ffb600a8fa0 2023-12-08T08:22:00.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.315+0000 7ffb5f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb601566e0 0x7ffb601edce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:00.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.315+0000 7ffb5f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb601566e0 0x7ffb601edce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53608/0 (socket says 172.21.15.88:53608) 2023-12-08T08:22:00.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.315+0000 7ffb5f7fe640 1 -- 172.21.15.88:0/4289688623 learned_addr learned my addr 172.21.15.88:0/4289688623 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:00.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.315+0000 7ffb5ffff640 1 --2- 172.21.15.88:0/4289688623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb48004380 0x7ffb601ea760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:00.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.315+0000 7ffb64a47640 1 --2- 172.21.15.88:0/4289688623 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffb600a8fa0 0x7ffb600befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:00.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.315+0000 7ffb5f7fe640 1 -- 172.21.15.88:0/4289688623 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffb600a8fa0 msgr2=0x7ffb600befc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:00.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.315+0000 7ffb5f7fe640 1 --2- 172.21.15.88:0/4289688623 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffb600a8fa0 0x7ffb600befc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:00.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.315+0000 7ffb5f7fe640 1 -- 172.21.15.88:0/4289688623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb48004380 msgr2=0x7ffb601ea760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:00.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.315+0000 7ffb5f7fe640 1 --2- 172.21.15.88:0/4289688623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb48004380 0x7ffb601ea760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:00.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.315+0000 7ffb5f7fe640 1 -- 172.21.15.88:0/4289688623 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb601ed850 con 0x7ffb601566e0 2023-12-08T08:22:00.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.319+0000 7ffb5f7fe640 1 --2- 172.21.15.88:0/4289688623 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb601566e0 0x7ffb601edce0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ffb54001940 tx=0x7ffb48005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:00.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.319+0000 7ffb5cff9640 1 -- 172.21.15.88:0/4289688623 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb540b4070 con 0x7ffb601566e0 2023-12-08T08:22:00.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.319+0000 7ffb5cff9640 1 -- 172.21.15.88:0/4289688623 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb54001640 con 0x7ffb601566e0 2023-12-08T08:22:00.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.319+0000 7ffb5cff9640 1 -- 172.21.15.88:0/4289688623 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb540a5cd0 con 0x7ffb601566e0 2023-12-08T08:22:00.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.319+0000 7ffb664aa640 1 -- 172.21.15.88:0/4289688623 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb601ee220 con 0x7ffb601566e0 2023-12-08T08:22:00.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.319+0000 7ffb664aa640 1 -- 172.21.15.88:0/4289688623 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb60156030 con 0x7ffb601566e0 2023-12-08T08:22:00.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.319+0000 7ffb664aa640 1 -- 172.21.15.88:0/4289688623 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb601ed9e0 con 0x7ffb601566e0 2023-12-08T08:22:00.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.319+0000 7ffb5cff9640 1 -- 172.21.15.88:0/4289688623 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffb54007070 con 0x7ffb601566e0 2023-12-08T08:22:00.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.319+0000 7ffb5cff9640 1 --2- 172.21.15.88:0/4289688623 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffb4c0664a0 0x7ffb4c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:00.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.319+0000 7ffb5cff9640 1 -- 172.21.15.88:0/4289688623 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ffb5411d850 con 0x7ffb601566e0 2023-12-08T08:22:00.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.319+0000 7ffb5ffff640 1 --2- 172.21.15.88:0/4289688623 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffb4c0664a0 0x7ffb4c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:00.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.323+0000 7ffb5ffff640 1 --2- 172.21.15.88:0/4289688623 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffb4c0664a0 0x7ffb4c068960 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ffb600a6b40 tx=0x7ffb50009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:00.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.323+0000 7ffb5cff9640 1 -- 172.21.15.88:0/4289688623 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffb540eebf0 con 0x7ffb601566e0 2023-12-08T08:22:00.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:00.475+0000 7ffb664aa640 1 -- 172.21.15.88:0/4289688623 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ffb60067630 con 0x7ffb601566e0 2023-12-08T08:22:01.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.031+0000 7ffb5cff9640 1 -- 172.21.15.88:0/4289688623 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v47) v1 ==== 138+0+0 (secure 0 0 0) 0x7ffb540ee780 con 0x7ffb601566e0 2023-12-08T08:22:01.036 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' created 2023-12-08T08:22:01.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.035+0000 7ffb664aa640 1 -- 172.21.15.88:0/4289688623 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffb4c0664a0 msgr2=0x7ffb4c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:01.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.035+0000 7ffb664aa640 1 --2- 172.21.15.88:0/4289688623 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffb4c0664a0 0x7ffb4c068960 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ffb600a6b40 tx=0x7ffb50009190 comp rx=0 tx=0).stop 2023-12-08T08:22:01.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.035+0000 7ffb664aa640 1 -- 172.21.15.88:0/4289688623 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb601566e0 msgr2=0x7ffb601edce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:01.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.035+0000 7ffb664aa640 1 --2- 172.21.15.88:0/4289688623 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb601566e0 0x7ffb601edce0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ffb54001940 tx=0x7ffb48005800 comp rx=0 tx=0).stop 2023-12-08T08:22:01.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.035+0000 7ffb664aa640 1 -- 172.21.15.88:0/4289688623 shutdown_connections 2023-12-08T08:22:01.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.035+0000 7ffb664aa640 1 --2- 172.21.15.88:0/4289688623 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffb4c0664a0 0x7ffb4c068960 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:01.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.035+0000 7ffb664aa640 1 --2- 172.21.15.88:0/4289688623 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffb600a8fa0 0x7ffb600befc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:01.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.035+0000 7ffb664aa640 1 --2- 172.21.15.88:0/4289688623 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb601566e0 0x7ffb601edce0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:01.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.035+0000 7ffb664aa640 1 --2- 172.21.15.88:0/4289688623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb48004380 0x7ffb601ea760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:01.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.035+0000 7ffb664aa640 1 -- 172.21.15.88:0/4289688623 >> 172.21.15.88:0/4289688623 conn(0x7ffb600c59f0 msgr2=0x7ffb600c0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:01.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.035+0000 7ffb664aa640 1 -- 172.21.15.88:0/4289688623 shutdown_connections 2023-12-08T08:22:01.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.035+0000 7ffb664aa640 1 -- 172.21.15.88:0/4289688623 wait complete. 2023-12-08T08:22:01.068 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-08T08:22:01.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.211+0000 7f9633b2a640 1 Processor -- start 2023-12-08T08:22:01.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.211+0000 7f9633b2a640 1 -- start start 2023-12-08T08:22:01.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.211+0000 7f9633b2a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f962c156200 0x7f962c0c0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:01.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.211+0000 7f9633b2a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f962c06bce0 con 0x7f962c0c0e10 2023-12-08T08:22:01.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.211+0000 7f9633b2a640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f962c0c2270 con 0x7f962c15bf70 2023-12-08T08:22:01.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.211+0000 7f9633b2a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f962c06d8d0 con 0x7f962c156200 2023-12-08T08:22:01.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.211+0000 7f96318c6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f962c156200 0x7f962c0c0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:01.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.211+0000 7f96318c6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f962c156200 0x7f962c0c0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53616/0 (socket says 172.21.15.88:53616) 2023-12-08T08:22:01.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.211+0000 7f96318c6640 1 -- 172.21.15.88:0/1163296805 learned_addr learned my addr 172.21.15.88:0/1163296805 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:01.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.211+0000 7f96310c5640 1 --1- 172.21.15.88:0/1163296805 >> v1:172.21.15.88:6789/0 conn(0x7f962c0c0e10 0x7f962c0c1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39010/0 (socket says 172.21.15.88:39010) 2023-12-08T08:22:01.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.211+0000 7f96318c6640 1 -- 172.21.15.88:0/1163296805 >> v1:172.21.15.148:6789/0 conn(0x7f962c15bf70 legacy=0x7f962c15c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:01.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.211+0000 7f96318c6640 1 -- 172.21.15.88:0/1163296805 >> v1:172.21.15.88:6789/0 conn(0x7f962c0c0e10 legacy=0x7f962c0c1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:01.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.211+0000 7f96318c6640 1 -- 172.21.15.88:0/1163296805 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962c15cc60 con 0x7f962c156200 2023-12-08T08:22:01.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.211+0000 7f96308c4640 1 -- 172.21.15.88:0/1163296805 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512178767 0 0) 0x7f962c0c2270 con 0x7f962c15bf70 2023-12-08T08:22:01.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.215+0000 7f96318c6640 1 --2- 172.21.15.88:0/1163296805 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c156200 0x7f962c0c0370 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9628009870 tx=0x7f962801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7cb78379f8c71d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:01.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.215+0000 7f96308c4640 1 -- 172.21.15.88:0/1163296805 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96280ab600 con 0x7f962c156200 2023-12-08T08:22:01.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.215+0000 7f96308c4640 1 -- 172.21.15.88:0/1163296805 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96280a7050 con 0x7f962c156200 2023-12-08T08:22:01.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.215+0000 7f96308c4640 1 -- 172.21.15.88:0/1163296805 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96280ab980 con 0x7f962c156200 2023-12-08T08:22:01.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.215+0000 7f9633b2a640 1 -- 172.21.15.88:0/1163296805 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c156200 msgr2=0x7f962c0c0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:01.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.215+0000 7f9633b2a640 1 --2- 172.21.15.88:0/1163296805 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c156200 0x7f962c0c0370 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9628009870 tx=0x7f962801c420 comp rx=0 tx=0).stop 2023-12-08T08:22:01.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.215+0000 7f9633b2a640 1 -- 172.21.15.88:0/1163296805 shutdown_connections 2023-12-08T08:22:01.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.215+0000 7f9633b2a640 1 --2- 172.21.15.88:0/1163296805 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c156200 0x7f962c0c0370 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:01.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.215+0000 7f9633b2a640 1 -- 172.21.15.88:0/1163296805 >> 172.21.15.88:0/1163296805 conn(0x7f962c0c59f0 msgr2=0x7f962c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:01.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.215+0000 7f9633b2a640 1 -- 172.21.15.88:0/1163296805 shutdown_connections 2023-12-08T08:22:01.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.215+0000 7f9633b2a640 1 -- 172.21.15.88:0/1163296805 wait complete. 2023-12-08T08:22:01.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.219+0000 7f9633b2a640 1 Processor -- start 2023-12-08T08:22:01.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.219+0000 7f9633b2a640 1 -- start start 2023-12-08T08:22:01.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.219+0000 7f9633b2a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f962c0c0e10 0x7f962c158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:01.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.219+0000 7f9633b2a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f962c156200 0x7f962c14ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:01.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.219+0000 7f9633b2a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c15bf70 0x7f962c141ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:01.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.219+0000 7f9633b2a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962c0aafb0 con 0x7f962c15bf70 2023-12-08T08:22:01.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.219+0000 7f9633b2a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962c0aa9f0 con 0x7f962c156200 2023-12-08T08:22:01.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.219+0000 7f9633b2a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962c0aacd0 con 0x7f962c0c0e10 2023-12-08T08:22:01.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.219+0000 7f96320c7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c15bf70 0x7f962c141ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:01.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.219+0000 7f96320c7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c15bf70 0x7f962c141ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53630/0 (socket says 172.21.15.88:53630) 2023-12-08T08:22:01.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.219+0000 7f96320c7640 1 -- 172.21.15.88:0/3263799516 learned_addr learned my addr 172.21.15.88:0/3263799516 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:01.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.219+0000 7f96310c5640 1 --2- 172.21.15.88:0/3263799516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f962c156200 0x7f962c14ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:01.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.219+0000 7f96318c6640 1 --2- 172.21.15.88:0/3263799516 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f962c0c0e10 0x7f962c158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:01.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.219+0000 7f96320c7640 1 -- 172.21.15.88:0/3263799516 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f962c0c0e10 msgr2=0x7f962c158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:01.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.219+0000 7f96320c7640 1 --2- 172.21.15.88:0/3263799516 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f962c0c0e10 0x7f962c158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:01.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.219+0000 7f96320c7640 1 -- 172.21.15.88:0/3263799516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f962c156200 msgr2=0x7f962c14ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:01.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.219+0000 7f96320c7640 1 --2- 172.21.15.88:0/3263799516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f962c156200 0x7f962c14ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:01.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.219+0000 7f96320c7640 1 -- 172.21.15.88:0/3263799516 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96280094d0 con 0x7f962c15bf70 2023-12-08T08:22:01.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.219+0000 7f96320c7640 1 --2- 172.21.15.88:0/3263799516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c15bf70 0x7f962c141ca0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9624001570 tx=0x7f962400cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:01.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.219+0000 7f96227fc640 1 -- 172.21.15.88:0/3263799516 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9624003db0 con 0x7f962c15bf70 2023-12-08T08:22:01.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.219+0000 7f96227fc640 1 -- 172.21.15.88:0/3263799516 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9624005070 con 0x7f962c15bf70 2023-12-08T08:22:01.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.219+0000 7f96227fc640 1 -- 172.21.15.88:0/3263799516 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9624005420 con 0x7f962c15bf70 2023-12-08T08:22:01.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.219+0000 7f9633b2a640 1 -- 172.21.15.88:0/3263799516 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f962c0ab800 con 0x7f962c15bf70 2023-12-08T08:22:01.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.219+0000 7f9633b2a640 1 -- 172.21.15.88:0/3263799516 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f962c0bfdd0 con 0x7f962c15bf70 2023-12-08T08:22:01.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.223+0000 7f9633b2a640 1 -- 172.21.15.88:0/3263799516 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f962c0ab660 con 0x7f962c15bf70 2023-12-08T08:22:01.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.223+0000 7f96227fc640 1 -- 172.21.15.88:0/3263799516 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9624005580 con 0x7f962c15bf70 2023-12-08T08:22:01.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.223+0000 7f96227fc640 1 --2- 172.21.15.88:0/3263799516 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9610066470 0x7f9610068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:01.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.223+0000 7f96227fc640 1 -- 172.21.15.88:0/3263799516 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f96240834b0 con 0x7f962c15bf70 2023-12-08T08:22:01.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.223+0000 7f96318c6640 1 --2- 172.21.15.88:0/3263799516 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9610066470 0x7f9610068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:01.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.223+0000 7f96318c6640 1 --2- 172.21.15.88:0/3263799516 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9610066470 0x7f9610068930 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f96280ad000 tx=0x7f96280a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:01.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.227+0000 7f96227fc640 1 -- 172.21.15.88:0/3263799516 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f962c0ab660 con 0x7f962c15bf70 2023-12-08T08:22:01.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:01.379+0000 7f9633b2a640 1 -- 172.21.15.88:0/3263799516 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f962c0abd20 con 0x7f962c15bf70 2023-12-08T08:22:02.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.035+0000 7f96227fc640 1 -- 172.21.15.88:0/3263799516 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v48) v1 ==== 170+0+0 (secure 0 0 0) 0x7f962c0abd20 con 0x7f962c15bf70 2023-12-08T08:22:02.039 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' created 2023-12-08T08:22:02.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.035+0000 7f9633b2a640 1 -- 172.21.15.88:0/3263799516 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9610066470 msgr2=0x7f9610068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:02.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.035+0000 7f9633b2a640 1 --2- 172.21.15.88:0/3263799516 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9610066470 0x7f9610068930 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f96280ad000 tx=0x7f96280a6000 comp rx=0 tx=0).stop 2023-12-08T08:22:02.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.035+0000 7f9633b2a640 1 -- 172.21.15.88:0/3263799516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c15bf70 msgr2=0x7f962c141ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:02.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.035+0000 7f9633b2a640 1 --2- 172.21.15.88:0/3263799516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c15bf70 0x7f962c141ca0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9624001570 tx=0x7f962400cd20 comp rx=0 tx=0).stop 2023-12-08T08:22:02.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.039+0000 7f9633b2a640 1 -- 172.21.15.88:0/3263799516 shutdown_connections 2023-12-08T08:22:02.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.039+0000 7f9633b2a640 1 --2- 172.21.15.88:0/3263799516 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9610066470 0x7f9610068930 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:02.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.039+0000 7f9633b2a640 1 --2- 172.21.15.88:0/3263799516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f962c15bf70 0x7f962c141ca0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:02.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.039+0000 7f9633b2a640 1 --2- 172.21.15.88:0/3263799516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f962c156200 0x7f962c14ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:02.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.039+0000 7f9633b2a640 1 --2- 172.21.15.88:0/3263799516 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f962c0c0e10 0x7f962c158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:02.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.039+0000 7f9633b2a640 1 -- 172.21.15.88:0/3263799516 >> 172.21.15.88:0/3263799516 conn(0x7f962c0c59f0 msgr2=0x7f962c15c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:02.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.039+0000 7f9633b2a640 1 -- 172.21.15.88:0/3263799516 shutdown_connections 2023-12-08T08:22:02.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.039+0000 7f9633b2a640 1 -- 172.21.15.88:0/3263799516 wait complete. 2023-12-08T08:22:02.083 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-08T08:22:02.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.219+0000 7f17fd372640 1 Processor -- start 2023-12-08T08:22:02.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.219+0000 7f17fd372640 1 -- start start 2023-12-08T08:22:02.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17fd372640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17f80c1920 0x7f17f80aabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:02.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17fd372640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f80c0170 con 0x7f17f80c1540 2023-12-08T08:22:02.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17fd372640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f80a9720 con 0x7f17f81510b0 2023-12-08T08:22:02.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17fd372640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f80c1d70 con 0x7f17f80c1920 2023-12-08T08:22:02.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17f6ffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f17f80c1540 0x7f17f80c36d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39012/0 (socket says 172.21.15.88:39012) 2023-12-08T08:22:02.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17f6ffd640 1 -- 172.21.15.88:0/3876922494 learned_addr learned my addr 172.21.15.88:0/3876922494 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:02.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17f77fe640 1 --2- 172.21.15.88:0/3876922494 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17f80c1920 0x7f17f80aabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:02.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17f67fc640 1 -- 172.21.15.88:0/3876922494 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015647619 0 0) 0x7f17f80c0170 con 0x7f17f80c1540 2023-12-08T08:22:02.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17f67fc640 1 -- 172.21.15.88:0/3876922494 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17e4003530 con 0x7f17f80c1540 2023-12-08T08:22:02.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17f67fc640 1 -- 172.21.15.88:0/3876922494 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1204434807 0 0) 0x7f17e4003530 con 0x7f17f80c1540 2023-12-08T08:22:02.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17f67fc640 1 -- 172.21.15.88:0/3876922494 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17f80c1920 msgr2=0x7f17f80aabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:02.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17f67fc640 1 --2- 172.21.15.88:0/3876922494 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17f80c1920 0x7f17f80aabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:02.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17f67fc640 1 -- 172.21.15.88:0/3876922494 >> v1:172.21.15.148:6789/0 conn(0x7f17f81510b0 legacy=0x7f17f80c3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:02.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17f67fc640 1 -- 172.21.15.88:0/3876922494 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f806de60 con 0x7f17f80c1540 2023-12-08T08:22:02.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17f67fc640 1 -- 172.21.15.88:0/3876922494 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f17e8001680 con 0x7f17f80c1540 2023-12-08T08:22:02.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17f67fc640 1 -- 172.21.15.88:0/3876922494 >> v1:172.21.15.88:6789/0 conn(0x7f17f80c1540 legacy=0x7f17f80c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:02.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17f67fc640 1 --2- 172.21.15.88:0/3876922494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17e40039b0 0x7f17e4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:02.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17f67fc640 1 --2- 172.21.15.88:0/3876922494 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17f80c1920 0x7f17e40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:02.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17f67fc640 1 --2- 172.21.15.88:0/3876922494 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17e4004d10 0x7f17e4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:02.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17f67fc640 1 -- 172.21.15.88:0/3876922494 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f80c1d70 con 0x7f17e4004d10 2023-12-08T08:22:02.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17f67fc640 1 -- 172.21.15.88:0/3876922494 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e400bb20 con 0x7f17e40039b0 2023-12-08T08:22:02.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17f67fc640 1 -- 172.21.15.88:0/3876922494 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e400bcb0 con 0x7f17f80c1920 2023-12-08T08:22:02.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17f77fe640 1 --2- 172.21.15.88:0/3876922494 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17e4004d10 0x7f17e4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:02.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17f6ffd640 1 --2- 172.21.15.88:0/3876922494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17e40039b0 0x7f17e4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:02.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17effff640 1 --2- 172.21.15.88:0/3876922494 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17f80c1920 0x7f17e40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:02.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17f77fe640 1 -- 172.21.15.88:0/3876922494 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17f80c1920 msgr2=0x7f17e40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:02.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17f77fe640 1 --2- 172.21.15.88:0/3876922494 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17f80c1920 0x7f17e40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:02.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17f77fe640 1 -- 172.21.15.88:0/3876922494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17e40039b0 msgr2=0x7f17e4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:02.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17f77fe640 1 --2- 172.21.15.88:0/3876922494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17e40039b0 0x7f17e4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:02.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.223+0000 7f17f77fe640 1 -- 172.21.15.88:0/3876922494 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e4003530 con 0x7f17e4004d10 2023-12-08T08:22:02.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.227+0000 7f17f77fe640 1 --2- 172.21.15.88:0/3876922494 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17e4004d10 0x7f17e4005190 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f17f000e170 tx=0x7f17f001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4287a89fa681a772 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:02.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.227+0000 7f17f67fc640 1 -- 172.21.15.88:0/3876922494 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f00a5c50 con 0x7f17e4004d10 2023-12-08T08:22:02.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.227+0000 7f17f67fc640 1 -- 172.21.15.88:0/3876922494 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f000f040 con 0x7f17e4004d10 2023-12-08T08:22:02.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.227+0000 7f17f67fc640 1 -- 172.21.15.88:0/3876922494 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f00ad440 con 0x7f17e4004d10 2023-12-08T08:22:02.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.227+0000 7f17fd372640 1 -- 172.21.15.88:0/3876922494 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17e4004d10 msgr2=0x7f17e4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:02.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.227+0000 7f17fd372640 1 --2- 172.21.15.88:0/3876922494 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17e4004d10 0x7f17e4005190 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f17f000e170 tx=0x7f17f001cc40 comp rx=0 tx=0).stop 2023-12-08T08:22:02.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.227+0000 7f17f77fe640 1 -- 172.21.15.88:0/3876922494 reap_dead start 2023-12-08T08:22:02.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.227+0000 7f17fd372640 1 -- 172.21.15.88:0/3876922494 shutdown_connections 2023-12-08T08:22:02.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.227+0000 7f17fd372640 1 -- 172.21.15.88:0/3876922494 >> 172.21.15.88:0/3876922494 conn(0x7f17f80a7520 msgr2=0x7f17f80a7930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:02.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.227+0000 7f17fd372640 1 -- 172.21.15.88:0/3876922494 shutdown_connections 2023-12-08T08:22:02.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.227+0000 7f17fd372640 1 -- 172.21.15.88:0/3876922494 wait complete. 2023-12-08T08:22:02.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.227+0000 7f17fd372640 1 Processor -- start 2023-12-08T08:22:02.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.227+0000 7f17fd372640 1 -- start start 2023-12-08T08:22:02.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.231+0000 7f17fd372640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17e4004d10 0x7f17f806cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:02.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.231+0000 7f17fd372640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17f8070fb0 0x7f17f814a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:02.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.231+0000 7f17fd372640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17f814abc0 0x7f17f8071920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:02.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.231+0000 7f17fd372640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f8154700 con 0x7f17f814abc0 2023-12-08T08:22:02.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.231+0000 7f17fd372640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f81ed9b0 con 0x7f17f8070fb0 2023-12-08T08:22:02.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.231+0000 7f17fd372640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f81edea0 con 0x7f17e4004d10 2023-12-08T08:22:02.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.231+0000 7f17f77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17f814abc0 0x7f17f8071920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:02.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.231+0000 7f17f77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17f814abc0 0x7f17f8071920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53646/0 (socket says 172.21.15.88:53646) 2023-12-08T08:22:02.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.231+0000 7f17f77fe640 1 -- 172.21.15.88:0/1964527749 learned_addr learned my addr 172.21.15.88:0/1964527749 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:02.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.231+0000 7f17f6ffd640 1 --2- 172.21.15.88:0/1964527749 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17e4004d10 0x7f17f806cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:02.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.231+0000 7f17effff640 1 --2- 172.21.15.88:0/1964527749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17f8070fb0 0x7f17f814a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:02.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.231+0000 7f17f77fe640 1 -- 172.21.15.88:0/1964527749 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17e4004d10 msgr2=0x7f17f806cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:02.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.231+0000 7f17f77fe640 1 --2- 172.21.15.88:0/1964527749 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17e4004d10 0x7f17f806cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:02.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.231+0000 7f17f77fe640 1 -- 172.21.15.88:0/1964527749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17f8070fb0 msgr2=0x7f17f814a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:02.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.231+0000 7f17f77fe640 1 --2- 172.21.15.88:0/1964527749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17f8070fb0 0x7f17f814a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:02.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.231+0000 7f17f77fe640 1 -- 172.21.15.88:0/1964527749 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f81edbc0 con 0x7f17f814abc0 2023-12-08T08:22:02.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.231+0000 7f17f77fe640 1 --2- 172.21.15.88:0/1964527749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17f814abc0 0x7f17f8071920 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f17f000e170 tx=0x7f17f0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:02.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.231+0000 7f17ef7fe640 1 -- 172.21.15.88:0/1964527749 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f00bc070 con 0x7f17f814abc0 2023-12-08T08:22:02.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.231+0000 7f17ef7fe640 1 -- 172.21.15.88:0/1964527749 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f00039a0 con 0x7f17f814abc0 2023-12-08T08:22:02.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.231+0000 7f17fd372640 1 -- 172.21.15.88:0/1964527749 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f8154320 con 0x7f17f814abc0 2023-12-08T08:22:02.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.231+0000 7f17ef7fe640 1 -- 172.21.15.88:0/1964527749 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f00a5ea0 con 0x7f17f814abc0 2023-12-08T08:22:02.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.231+0000 7f17fd372640 1 -- 172.21.15.88:0/1964527749 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f814b040 con 0x7f17f814abc0 2023-12-08T08:22:02.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.231+0000 7f17fd372640 1 -- 172.21.15.88:0/1964527749 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f8154840 con 0x7f17f814abc0 2023-12-08T08:22:02.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.235+0000 7f17ef7fe640 1 -- 172.21.15.88:0/1964527749 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f17f00b4040 con 0x7f17f814abc0 2023-12-08T08:22:02.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.235+0000 7f17ef7fe640 1 --2- 172.21.15.88:0/1964527749 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f17d80664a0 0x7f17d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:02.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.235+0000 7f17ef7fe640 1 -- 172.21.15.88:0/1964527749 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f17f011e7e0 con 0x7f17f814abc0 2023-12-08T08:22:02.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.235+0000 7f17f6ffd640 1 --2- 172.21.15.88:0/1964527749 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f17d80664a0 0x7f17d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:02.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.235+0000 7f17f6ffd640 1 --2- 172.21.15.88:0/1964527749 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f17d80664a0 0x7f17d8068960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f17e8001c40 tx=0x7f17e8001ad0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:02.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.239+0000 7f17ef7fe640 1 -- 172.21.15.88:0/1964527749 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f17f00ebe90 con 0x7f17f814abc0 2023-12-08T08:22:02.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:02.415+0000 7f17fd372640 1 -- 172.21.15.88:0/1964527749 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f17f8154840 con 0x7f17f814abc0 2023-12-08T08:22:03.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.071+0000 7f17ef7fe640 1 -- 172.21.15.88:0/1964527749 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v28) v1 ==== 172+0+0 (secure 0 0 0) 0x7f17f8154840 con 0x7f17f814abc0 2023-12-08T08:22:03.081 INFO:teuthology.orchestra.run.smithi088.stderr:new fs with metadata pool 8 and data pool 9 2023-12-08T08:22:03.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.079+0000 7f17fd372640 1 -- 172.21.15.88:0/1964527749 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f17d80664a0 msgr2=0x7f17d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:03.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.079+0000 7f17fd372640 1 --2- 172.21.15.88:0/1964527749 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f17d80664a0 0x7f17d8068960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f17e8001c40 tx=0x7f17e8001ad0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.079+0000 7f17fd372640 1 -- 172.21.15.88:0/1964527749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17f814abc0 msgr2=0x7f17f8071920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:03.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.079+0000 7f17fd372640 1 --2- 172.21.15.88:0/1964527749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17f814abc0 0x7f17f8071920 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f17f000e170 tx=0x7f17f0009750 comp rx=0 tx=0).stop 2023-12-08T08:22:03.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.083+0000 7f17fd372640 1 -- 172.21.15.88:0/1964527749 shutdown_connections 2023-12-08T08:22:03.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.083+0000 7f17fd372640 1 --2- 172.21.15.88:0/1964527749 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f17d80664a0 0x7f17d8068960 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.083+0000 7f17fd372640 1 --2- 172.21.15.88:0/1964527749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17f814abc0 0x7f17f8071920 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.083+0000 7f17fd372640 1 --2- 172.21.15.88:0/1964527749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17f8070fb0 0x7f17f814a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.083+0000 7f17fd372640 1 --2- 172.21.15.88:0/1964527749 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17e4004d10 0x7f17f806cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.083+0000 7f17fd372640 1 -- 172.21.15.88:0/1964527749 >> 172.21.15.88:0/1964527749 conn(0x7f17f80a7520 msgr2=0x7f17f80ab300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:03.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.087+0000 7f17fd372640 1 -- 172.21.15.88:0/1964527749 shutdown_connections 2023-12-08T08:22:03.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.091+0000 7f17fd372640 1 -- 172.21.15.88:0/1964527749 wait complete. 2023-12-08T08:22:03.123 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:22:03.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.255+0000 7fd3a0f1d640 1 Processor -- start 2023-12-08T08:22:03.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.255+0000 7fd3a0f1d640 1 -- start start 2023-12-08T08:22:03.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.259+0000 7fd3a0f1d640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd39c06bef0 0x7fd39c0bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:03.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.259+0000 7fd3a0f1d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd39c151690 con 0x7fd39c14e3f0 2023-12-08T08:22:03.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.259+0000 7fd3a0f1d640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd39c151bc0 con 0x7fd39c06c5b0 2023-12-08T08:22:03.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.259+0000 7fd3a0f1d640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd39c1518e0 con 0x7fd39c06bef0 2023-12-08T08:22:03.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.259+0000 7fd39a59c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd39c14e3f0 0x7fd39c0c41f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39024/0 (socket says 172.21.15.88:39024) 2023-12-08T08:22:03.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.259+0000 7fd39a59c640 1 -- 172.21.15.88:0/2725660993 learned_addr learned my addr 172.21.15.88:0/2725660993 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:03.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.259+0000 7fd393fff640 1 --2- 172.21.15.88:0/2725660993 >> v2:172.21.15.148:3300/0 conn(0x7fd39c06bef0 0x7fd39c0bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:03.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.259+0000 7fd399d9b640 1 -- 172.21.15.88:0/2725660993 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3768401505 0 0) 0x7fd39c151690 con 0x7fd39c14e3f0 2023-12-08T08:22:03.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.259+0000 7fd399d9b640 1 -- 172.21.15.88:0/2725660993 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd388005740 con 0x7fd39c14e3f0 2023-12-08T08:22:03.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.259+0000 7fd399d9b640 1 -- 172.21.15.88:0/2725660993 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3554215994 0 0) 0x7fd388005740 con 0x7fd39c14e3f0 2023-12-08T08:22:03.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.259+0000 7fd393fff640 1 -- 172.21.15.88:0/2725660993 >> v1:172.21.15.148:6789/0 conn(0x7fd39c06c5b0 legacy=0x7fd39c06ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:03.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.259+0000 7fd393fff640 1 -- 172.21.15.88:0/2725660993 >> v1:172.21.15.88:6789/0 conn(0x7fd39c14e3f0 legacy=0x7fd39c0c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:03.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.259+0000 7fd393fff640 1 -- 172.21.15.88:0/2725660993 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39c0c1de0 con 0x7fd39c06bef0 2023-12-08T08:22:03.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.263+0000 7fd393fff640 1 --2- 172.21.15.88:0/2725660993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd39c06bef0 0x7fd39c0bfce0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd3840097c0 tx=0x7fd38401c190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f549467ce64424df server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:03.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.263+0000 7fd399d9b640 1 -- 172.21.15.88:0/2725660993 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c001680 con 0x7fd39c06bef0 2023-12-08T08:22:03.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.263+0000 7fd399d9b640 1 -- 172.21.15.88:0/2725660993 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3840a7050 con 0x7fd39c06bef0 2023-12-08T08:22:03.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.263+0000 7fd399d9b640 1 -- 172.21.15.88:0/2725660993 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3840ab620 con 0x7fd39c06bef0 2023-12-08T08:22:03.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.263+0000 7fd3a0f1d640 1 -- 172.21.15.88:0/2725660993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd39c06bef0 msgr2=0x7fd39c0bfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:03.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.263+0000 7fd3a0f1d640 1 --2- 172.21.15.88:0/2725660993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd39c06bef0 0x7fd39c0bfce0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd3840097c0 tx=0x7fd38401c190 comp rx=0 tx=0).stop 2023-12-08T08:22:03.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.263+0000 7fd3a0f1d640 1 -- 172.21.15.88:0/2725660993 shutdown_connections 2023-12-08T08:22:03.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.263+0000 7fd3a0f1d640 1 --2- 172.21.15.88:0/2725660993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd39c06bef0 0x7fd39c0bfce0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.263+0000 7fd3a0f1d640 1 -- 172.21.15.88:0/2725660993 >> 172.21.15.88:0/2725660993 conn(0x7fd39c0a7810 msgr2=0x7fd39c0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:03.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.263+0000 7fd3a0f1d640 1 -- 172.21.15.88:0/2725660993 shutdown_connections 2023-12-08T08:22:03.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.263+0000 7fd3a0f1d640 1 -- 172.21.15.88:0/2725660993 wait complete. 2023-12-08T08:22:03.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.263+0000 7fd3a0f1d640 1 Processor -- start 2023-12-08T08:22:03.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.263+0000 7fd3a0f1d640 1 -- start start 2023-12-08T08:22:03.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.267+0000 7fd3a0f1d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd39c06bef0 0x7fd39c149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:03.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.267+0000 7fd3a0f1d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd39c06c5b0 0x7fd39c1489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:03.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.267+0000 7fd3a0f1d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd39c14e3f0 0x7fd39c148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:03.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.267+0000 7fd3a0f1d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c149420 con 0x7fd39c06c5b0 2023-12-08T08:22:03.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.267+0000 7fd3a0f1d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c1ecb10 con 0x7fd39c06bef0 2023-12-08T08:22:03.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.267+0000 7fd3a0f1d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c147c20 con 0x7fd39c14e3f0 2023-12-08T08:22:03.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.267+0000 7fd393fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd39c06c5b0 0x7fd39c1489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:03.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.267+0000 7fd39a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd39c06bef0 0x7fd39c149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:03.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.267+0000 7fd393fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd39c06c5b0 0x7fd39c1489a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53656/0 (socket says 172.21.15.88:53656) 2023-12-08T08:22:03.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.267+0000 7fd393fff640 1 -- 172.21.15.88:0/3218091569 learned_addr learned my addr 172.21.15.88:0/3218091569 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:03.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.267+0000 7fd39ad9d640 1 --2- 172.21.15.88:0/3218091569 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd39c14e3f0 0x7fd39c148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:03.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.267+0000 7fd393fff640 1 -- 172.21.15.88:0/3218091569 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd39c14e3f0 msgr2=0x7fd39c148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:03.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.267+0000 7fd393fff640 1 --2- 172.21.15.88:0/3218091569 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd39c14e3f0 0x7fd39c148ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.267+0000 7fd393fff640 1 -- 172.21.15.88:0/3218091569 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd39c06bef0 msgr2=0x7fd39c149d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:03.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.267+0000 7fd393fff640 1 --2- 172.21.15.88:0/3218091569 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd39c06bef0 0x7fd39c149d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.267+0000 7fd393fff640 1 -- 172.21.15.88:0/3218091569 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd384009420 con 0x7fd39c06c5b0 2023-12-08T08:22:03.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.267+0000 7fd39a59c640 1 --2- 172.21.15.88:0/3218091569 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd39c06bef0 0x7fd39c149d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:22:03.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.267+0000 7fd393fff640 1 --2- 172.21.15.88:0/3218091569 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd39c06c5b0 0x7fd39c1489a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd3840097c0 tx=0x7fd38401a9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:03.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.267+0000 7fd392ffd640 1 -- 172.21.15.88:0/3218091569 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3840abda0 con 0x7fd39c06c5b0 2023-12-08T08:22:03.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.267+0000 7fd392ffd640 1 -- 172.21.15.88:0/3218091569 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd384004020 con 0x7fd39c06c5b0 2023-12-08T08:22:03.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.267+0000 7fd392ffd640 1 -- 172.21.15.88:0/3218091569 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd384004390 con 0x7fd39c06c5b0 2023-12-08T08:22:03.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.267+0000 7fd3a0f1d640 1 -- 172.21.15.88:0/3218091569 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd39c147ec0 con 0x7fd39c06c5b0 2023-12-08T08:22:03.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.267+0000 7fd3a0f1d640 1 -- 172.21.15.88:0/3218091569 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd39c148480 con 0x7fd39c06c5b0 2023-12-08T08:22:03.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.267+0000 7fd3a0f1d640 1 -- 172.21.15.88:0/3218091569 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39c148670 con 0x7fd39c06c5b0 2023-12-08T08:22:03.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.267+0000 7fd392ffd640 1 -- 172.21.15.88:0/3218091569 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd384003620 con 0x7fd39c06c5b0 2023-12-08T08:22:03.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.271+0000 7fd392ffd640 1 --2- 172.21.15.88:0/3218091569 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd37c066470 0x7fd37c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:03.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.271+0000 7fd392ffd640 1 -- 172.21.15.88:0/3218091569 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd38411e4d0 con 0x7fd39c06c5b0 2023-12-08T08:22:03.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.271+0000 7fd39a59c640 1 --2- 172.21.15.88:0/3218091569 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd37c066470 0x7fd37c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:03.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.271+0000 7fd39a59c640 1 --2- 172.21.15.88:0/3218091569 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd37c066470 0x7fd37c068930 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0017b0 tx=0x7fd38c001240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:03.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.275+0000 7fd392ffd640 1 -- 172.21.15.88:0/3218091569 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd3840ebb90 con 0x7fd39c06c5b0 2023-12-08T08:22:03.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.423+0000 7fd3a0f1d640 1 -- 172.21.15.88:0/3218091569 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd39c067630 con 0x7fd39c06c5b0 2023-12-08T08:22:03.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.423+0000 7fd392ffd640 1 -- 172.21.15.88:0/3218091569 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16554 (secure 0 0 0) 0x7fd3840ef1b0 con 0x7fd39c06c5b0 2023-12-08T08:22:03.429 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:03.430 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":49,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:22:02.420076+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:00.520254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:01.423493+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:22:03.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.427+0000 7fd3a0f1d640 1 -- 172.21.15.88:0/3218091569 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd37c066470 msgr2=0x7fd37c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:03.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.427+0000 7fd3a0f1d640 1 --2- 172.21.15.88:0/3218091569 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd37c066470 0x7fd37c068930 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0017b0 tx=0x7fd38c001240 comp rx=0 tx=0).stop 2023-12-08T08:22:03.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.427+0000 7fd3a0f1d640 1 -- 172.21.15.88:0/3218091569 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd39c06c5b0 msgr2=0x7fd39c1489a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:03.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.427+0000 7fd3a0f1d640 1 --2- 172.21.15.88:0/3218091569 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd39c06c5b0 0x7fd39c1489a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd3840097c0 tx=0x7fd38401a9d0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.427+0000 7fd3a0f1d640 1 -- 172.21.15.88:0/3218091569 shutdown_connections 2023-12-08T08:22:03.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.427+0000 7fd3a0f1d640 1 --2- 172.21.15.88:0/3218091569 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd37c066470 0x7fd37c068930 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.427+0000 7fd3a0f1d640 1 --2- 172.21.15.88:0/3218091569 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd39c14e3f0 0x7fd39c148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.427+0000 7fd3a0f1d640 1 --2- 172.21.15.88:0/3218091569 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd39c06c5b0 0x7fd39c1489a0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.427+0000 7fd3a0f1d640 1 --2- 172.21.15.88:0/3218091569 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd39c06bef0 0x7fd39c149d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.427+0000 7fd3a0f1d640 1 -- 172.21.15.88:0/3218091569 >> 172.21.15.88:0/3218091569 conn(0x7fd39c0a7810 msgr2=0x7fd39c0a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:03.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.427+0000 7fd3a0f1d640 1 -- 172.21.15.88:0/3218091569 shutdown_connections 2023-12-08T08:22:03.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.427+0000 7fd3a0f1d640 1 -- 172.21.15.88:0/3218091569 wait complete. 2023-12-08T08:22:03.451 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:22:03.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.583+0000 7f7399e46640 1 Processor -- start 2023-12-08T08:22:03.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.583+0000 7f7399e46640 1 -- start start 2023-12-08T08:22:03.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.587+0000 7f7399e46640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f739406bef0 0x7f73940bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:03.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.587+0000 7f7399e46640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f739406c5b0 0x7f739406ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:03.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.587+0000 7f7399e46640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7394151690 con 0x7f739414e3f0 2023-12-08T08:22:03.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.587+0000 7f7399e46640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7394151bc0 con 0x7f739406bef0 2023-12-08T08:22:03.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.587+0000 7f7399e46640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73941518e0 con 0x7f739406c5b0 2023-12-08T08:22:03.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.587+0000 7f738bfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f739406bef0 0x7f73940bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:03.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.587+0000 7f738bfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f739406bef0 0x7f73940bfce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53670/0 (socket says 172.21.15.88:53670) 2023-12-08T08:22:03.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.587+0000 7f738bfff640 1 -- 172.21.15.88:0/441214749 learned_addr learned my addr 172.21.15.88:0/441214749 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:03.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.587+0000 7f7393fff640 1 --2- 172.21.15.88:0/441214749 >> v2:172.21.15.148:3300/0 conn(0x7f739406c5b0 0x7f739406ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:03.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.587+0000 7f738bfff640 1 -- 172.21.15.88:0/441214749 >> v2:172.21.15.148:3300/0 conn(0x7f739406c5b0 msgr2=0x7f739406ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:03.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.587+0000 7f738bfff640 1 --2- 172.21.15.88:0/441214749 >> v2:172.21.15.148:3300/0 conn(0x7f739406c5b0 0x7f739406ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.587+0000 7f738bfff640 1 -- 172.21.15.88:0/441214749 >> v1:172.21.15.148:6789/0 conn(0x7f739414e3f0 legacy=0x7f73940c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:03.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.587+0000 7f738bfff640 1 -- 172.21.15.88:0/441214749 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73940c1de0 con 0x7f739406bef0 2023-12-08T08:22:03.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.591+0000 7f738bfff640 1 --2- 172.21.15.88:0/441214749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f739406bef0 0x7f73940bfce0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7394070480 tx=0x7f737c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eecc3fe68bc13336 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:03.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.591+0000 7f7392ffd640 1 -- 172.21.15.88:0/441214749 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c0ab600 con 0x7f739406bef0 2023-12-08T08:22:03.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.591+0000 7f7392ffd640 1 -- 172.21.15.88:0/441214749 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737c0a7050 con 0x7f739406bef0 2023-12-08T08:22:03.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.591+0000 7f7392ffd640 1 -- 172.21.15.88:0/441214749 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c0ab980 con 0x7f739406bef0 2023-12-08T08:22:03.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.591+0000 7f7399e46640 1 -- 172.21.15.88:0/441214749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f739406bef0 msgr2=0x7f73940bfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:03.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.591+0000 7f7399e46640 1 --2- 172.21.15.88:0/441214749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f739406bef0 0x7f73940bfce0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7394070480 tx=0x7f737c01c400 comp rx=0 tx=0).stop 2023-12-08T08:22:03.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.591+0000 7f7399e46640 1 -- 172.21.15.88:0/441214749 shutdown_connections 2023-12-08T08:22:03.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.591+0000 7f7399e46640 1 --2- 172.21.15.88:0/441214749 >> v2:172.21.15.148:3300/0 conn(0x7f739406c5b0 0x7f739406ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.591+0000 7f7399e46640 1 --2- 172.21.15.88:0/441214749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f739406bef0 0x7f73940bfce0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.591+0000 7f7399e46640 1 -- 172.21.15.88:0/441214749 >> 172.21.15.88:0/441214749 conn(0x7f73940a7810 msgr2=0x7f73940a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:03.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.591+0000 7f7399e46640 1 -- 172.21.15.88:0/441214749 shutdown_connections 2023-12-08T08:22:03.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.591+0000 7f7399e46640 1 -- 172.21.15.88:0/441214749 wait complete. 2023-12-08T08:22:03.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.591+0000 7f7399e46640 1 Processor -- start 2023-12-08T08:22:03.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.591+0000 7f7399e46640 1 -- start start 2023-12-08T08:22:03.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.591+0000 7f7399e46640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f739406bef0 0x7f7394144110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:03.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.591+0000 7f7399e46640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f739406c5b0 0x7f739415df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:03.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.595+0000 7f7399e46640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f739414e3f0 0x7f739414c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:03.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.595+0000 7f7399e46640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7394144650 con 0x7f739406c5b0 2023-12-08T08:22:03.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.595+0000 7f7399e46640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7394070a20 con 0x7f739414e3f0 2023-12-08T08:22:03.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.595+0000 7f7399e46640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7394070d00 con 0x7f739406bef0 2023-12-08T08:22:03.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.595+0000 7f738bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f739406c5b0 0x7f739415df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:03.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.595+0000 7f738bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f739406c5b0 0x7f739415df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53678/0 (socket says 172.21.15.88:53678) 2023-12-08T08:22:03.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.595+0000 7f738bfff640 1 -- 172.21.15.88:0/2237063325 learned_addr learned my addr 172.21.15.88:0/2237063325 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:03.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.595+0000 7f73937fe640 1 --2- 172.21.15.88:0/2237063325 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f739406bef0 0x7f7394144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:03.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.595+0000 7f7393fff640 1 --2- 172.21.15.88:0/2237063325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f739414e3f0 0x7f739414c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:03.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.595+0000 7f738bfff640 1 -- 172.21.15.88:0/2237063325 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f739406bef0 msgr2=0x7f7394144110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:03.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.595+0000 7f738bfff640 1 --2- 172.21.15.88:0/2237063325 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f739406bef0 0x7f7394144110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.595+0000 7f738bfff640 1 -- 172.21.15.88:0/2237063325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f739414e3f0 msgr2=0x7f739414c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:03.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.595+0000 7f738bfff640 1 --2- 172.21.15.88:0/2237063325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f739414e3f0 0x7f739414c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.595+0000 7f738bfff640 1 -- 172.21.15.88:0/2237063325 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c0094d0 con 0x7f739406c5b0 2023-12-08T08:22:03.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.595+0000 7f738bfff640 1 --2- 172.21.15.88:0/2237063325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f739406c5b0 0x7f739415df90 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f737c0ae040 tx=0x7f737c0191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:03.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.595+0000 7f7390ff9640 1 -- 172.21.15.88:0/2237063325 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c0b4440 con 0x7f739406c5b0 2023-12-08T08:22:03.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.595+0000 7f7390ff9640 1 -- 172.21.15.88:0/2237063325 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737c0a4e90 con 0x7f739406c5b0 2023-12-08T08:22:03.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.595+0000 7f7399e46640 1 -- 172.21.15.88:0/2237063325 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7394070fe0 con 0x7f739406c5b0 2023-12-08T08:22:03.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.595+0000 7f7390ff9640 1 -- 172.21.15.88:0/2237063325 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c0b47c0 con 0x7f739406c5b0 2023-12-08T08:22:03.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.595+0000 7f7399e46640 1 -- 172.21.15.88:0/2237063325 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73940715a0 con 0x7f739406c5b0 2023-12-08T08:22:03.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.595+0000 7f7399e46640 1 -- 172.21.15.88:0/2237063325 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f739415e940 con 0x7f739406c5b0 2023-12-08T08:22:03.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.595+0000 7f7390ff9640 1 -- 172.21.15.88:0/2237063325 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f737c0b2070 con 0x7f739406c5b0 2023-12-08T08:22:03.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.599+0000 7f7390ff9640 1 --2- 172.21.15.88:0/2237063325 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7374066470 0x7f7374068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:03.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.599+0000 7f7390ff9640 1 -- 172.21.15.88:0/2237063325 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f737c11dbc0 con 0x7f739406c5b0 2023-12-08T08:22:03.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.599+0000 7f73937fe640 1 --2- 172.21.15.88:0/2237063325 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7374066470 0x7f7374068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:03.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.599+0000 7f73937fe640 1 --2- 172.21.15.88:0/2237063325 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7374066470 0x7f7374068930 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f73941eaa00 tx=0x7f7384009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:03.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.603+0000 7f7390ff9640 1 -- 172.21.15.88:0/2237063325 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f739415e940 con 0x7f739406c5b0 2023-12-08T08:22:03.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.751+0000 7f7399e46640 1 -- 172.21.15.88:0/2237063325 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f739415e940 con 0x7f739406c5b0 2023-12-08T08:22:03.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.755+0000 7f7390ff9640 1 -- 172.21.15.88:0/2237063325 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16554 (secure 0 0 0) 0x7f739415e940 con 0x7f739406c5b0 2023-12-08T08:22:03.758 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:03.758 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":49,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:22:02.420076+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:00.520254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:01.423493+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:22:03.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.755+0000 7f7399e46640 1 -- 172.21.15.88:0/2237063325 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7374066470 msgr2=0x7f7374068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:03.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.755+0000 7f7399e46640 1 --2- 172.21.15.88:0/2237063325 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7374066470 0x7f7374068930 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f73941eaa00 tx=0x7f7384009060 comp rx=0 tx=0).stop 2023-12-08T08:22:03.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.755+0000 7f7399e46640 1 -- 172.21.15.88:0/2237063325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f739406c5b0 msgr2=0x7f739415df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:03.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.755+0000 7f7399e46640 1 --2- 172.21.15.88:0/2237063325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f739406c5b0 0x7f739415df90 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f737c0ae040 tx=0x7f737c0191a0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.755+0000 7f7399e46640 1 -- 172.21.15.88:0/2237063325 shutdown_connections 2023-12-08T08:22:03.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.755+0000 7f7399e46640 1 --2- 172.21.15.88:0/2237063325 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7374066470 0x7f7374068930 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.755+0000 7f7399e46640 1 --2- 172.21.15.88:0/2237063325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f739414e3f0 0x7f739414c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.755+0000 7f7399e46640 1 --2- 172.21.15.88:0/2237063325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f739406c5b0 0x7f739415df90 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.755+0000 7f7399e46640 1 --2- 172.21.15.88:0/2237063325 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f739406bef0 0x7f7394144110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.755+0000 7f7399e46640 1 -- 172.21.15.88:0/2237063325 >> 172.21.15.88:0/2237063325 conn(0x7f73940a7810 msgr2=0x7f73940c0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:03.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.755+0000 7f7399e46640 1 -- 172.21.15.88:0/2237063325 shutdown_connections 2023-12-08T08:22:03.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.755+0000 7f7399e46640 1 -- 172.21.15.88:0/2237063325 wait complete. 2023-12-08T08:22:03.779 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-08T08:22:03.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.915+0000 7f260446b640 1 Processor -- start 2023-12-08T08:22:03.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.915+0000 7f260446b640 1 -- start start 2023-12-08T08:22:03.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.919+0000 7f260446b640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f25fc1516a0 0x7f25fc0c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:03.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.919+0000 7f260446b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f25fc0c46c0 0x7f25fc06bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:03.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.919+0000 7f260446b640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25fc151210 con 0x7f25fc14e2a0 2023-12-08T08:22:03.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.919+0000 7f260446b640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25fc151b50 con 0x7f25fc0c46c0 2023-12-08T08:22:03.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.919+0000 7f260446b640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25fc14e680 con 0x7f25fc1516a0 2023-12-08T08:22:03.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.919+0000 7f2602a08640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f25fc0c46c0 0x7f25fc06bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:03.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.919+0000 7f2602a08640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f25fc0c46c0 0x7f25fc06bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53686/0 (socket says 172.21.15.88:53686) 2023-12-08T08:22:03.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.919+0000 7f2602a08640 1 -- 172.21.15.88:0/3889295677 learned_addr learned my addr 172.21.15.88:0/3889295677 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:03.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.919+0000 7f2601a06640 1 --2- 172.21.15.88:0/3889295677 >> v2:172.21.15.148:3300/0 conn(0x7f25fc1516a0 0x7f25fc0c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:03.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.919+0000 7f2602a08640 1 -- 172.21.15.88:0/3889295677 >> v2:172.21.15.148:3300/0 conn(0x7f25fc1516a0 msgr2=0x7f25fc0c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:03.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.919+0000 7f2602a08640 1 --2- 172.21.15.88:0/3889295677 >> v2:172.21.15.148:3300/0 conn(0x7f25fc1516a0 0x7f25fc0c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.919+0000 7f2602a08640 1 -- 172.21.15.88:0/3889295677 >> v1:172.21.15.148:6789/0 conn(0x7f25fc14e2a0 legacy=0x7f25fc0a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:03.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.919+0000 7f2602a08640 1 -- 172.21.15.88:0/3889295677 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25fc0a9b70 con 0x7f25fc0c46c0 2023-12-08T08:22:03.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.919+0000 7f2602a08640 1 --2- 172.21.15.88:0/3889295677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25fc0c46c0 0x7f25fc06bc80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f25fc066f50 tx=0x7f25f401ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e362caad486c7d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:03.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.923+0000 7f2601205640 1 -- 172.21.15.88:0/3889295677 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f40a7a20 con 0x7f25fc0c46c0 2023-12-08T08:22:03.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.923+0000 7f2601205640 1 -- 172.21.15.88:0/3889295677 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f40ab070 con 0x7f25fc0c46c0 2023-12-08T08:22:03.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.923+0000 7f2601205640 1 -- 172.21.15.88:0/3889295677 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f40a7da0 con 0x7f25fc0c46c0 2023-12-08T08:22:03.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.923+0000 7f260446b640 1 -- 172.21.15.88:0/3889295677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25fc0c46c0 msgr2=0x7f25fc06bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:03.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.923+0000 7f260446b640 1 --2- 172.21.15.88:0/3889295677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25fc0c46c0 0x7f25fc06bc80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f25fc066f50 tx=0x7f25f401ebd0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.923+0000 7f260446b640 1 -- 172.21.15.88:0/3889295677 shutdown_connections 2023-12-08T08:22:03.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.923+0000 7f260446b640 1 --2- 172.21.15.88:0/3889295677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25fc0c46c0 0x7f25fc06bc80 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.923+0000 7f260446b640 1 --2- 172.21.15.88:0/3889295677 >> v2:172.21.15.148:3300/0 conn(0x7f25fc1516a0 0x7f25fc0c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.923+0000 7f260446b640 1 -- 172.21.15.88:0/3889295677 >> 172.21.15.88:0/3889295677 conn(0x7f25fc0c59f0 msgr2=0x7f25fc0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:03.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.923+0000 7f260446b640 1 -- 172.21.15.88:0/3889295677 shutdown_connections 2023-12-08T08:22:03.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.923+0000 7f260446b640 1 -- 172.21.15.88:0/3889295677 wait complete. 2023-12-08T08:22:03.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.923+0000 7f260446b640 1 Processor -- start 2023-12-08T08:22:03.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.923+0000 7f260446b640 1 -- start start 2023-12-08T08:22:03.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.923+0000 7f260446b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25fc0c46c0 0x7f25fc159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:03.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.923+0000 7f260446b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25fc14e2a0 0x7f25fc14f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:03.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.923+0000 7f260446b640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f25fc1516a0 0x7f25fc1487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:03.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.923+0000 7f260446b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc1ecd60 con 0x7f25fc0c46c0 2023-12-08T08:22:03.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.923+0000 7f260446b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc153c20 con 0x7f25fc14e2a0 2023-12-08T08:22:03.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.923+0000 7f260446b640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc159920 con 0x7f25fc1516a0 2023-12-08T08:22:03.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.923+0000 7f2602207640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25fc0c46c0 0x7f25fc159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:03.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.923+0000 7f2602207640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25fc0c46c0 0x7f25fc159d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53692/0 (socket says 172.21.15.88:53692) 2023-12-08T08:22:03.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.923+0000 7f2602207640 1 -- 172.21.15.88:0/4090075028 learned_addr learned my addr 172.21.15.88:0/4090075028 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:03.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.923+0000 7f2601a06640 1 --2- 172.21.15.88:0/4090075028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25fc14e2a0 0x7f25fc14f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:03.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.923+0000 7f2602a08640 1 --2- 172.21.15.88:0/4090075028 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f25fc1516a0 0x7f25fc1487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:03.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.927+0000 7f2602207640 1 -- 172.21.15.88:0/4090075028 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f25fc1516a0 msgr2=0x7f25fc1487e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:03.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.927+0000 7f2602207640 1 --2- 172.21.15.88:0/4090075028 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f25fc1516a0 0x7f25fc1487e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.927+0000 7f2602207640 1 -- 172.21.15.88:0/4090075028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25fc14e2a0 msgr2=0x7f25fc14f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:03.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.927+0000 7f2602207640 1 --2- 172.21.15.88:0/4090075028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25fc14e2a0 0x7f25fc14f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:03.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.927+0000 7f2602207640 1 -- 172.21.15.88:0/4090075028 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f400bd40 con 0x7f25fc0c46c0 2023-12-08T08:22:03.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.927+0000 7f2601a06640 1 --2- 172.21.15.88:0/4090075028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25fc14e2a0 0x7f25fc14f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:03.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.927+0000 7f2602207640 1 --2- 172.21.15.88:0/4090075028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25fc0c46c0 0x7f25fc159d40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f25f800c500 tx=0x7f25f800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:03.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.927+0000 7f25f2ffd640 1 -- 172.21.15.88:0/4090075028 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f8005220 con 0x7f25fc0c46c0 2023-12-08T08:22:03.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.927+0000 7f25f2ffd640 1 -- 172.21.15.88:0/4090075028 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f8005380 con 0x7f25fc0c46c0 2023-12-08T08:22:03.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.927+0000 7f260446b640 1 -- 172.21.15.88:0/4090075028 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25fc1544e0 con 0x7f25fc0c46c0 2023-12-08T08:22:03.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.927+0000 7f25f2ffd640 1 -- 172.21.15.88:0/4090075028 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f8007270 con 0x7f25fc0c46c0 2023-12-08T08:22:03.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.927+0000 7f260446b640 1 -- 172.21.15.88:0/4090075028 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25fc153ec0 con 0x7f25fc0c46c0 2023-12-08T08:22:03.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.927+0000 7f260446b640 1 -- 172.21.15.88:0/4090075028 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25fc067630 con 0x7f25fc0c46c0 2023-12-08T08:22:03.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.927+0000 7f25f2ffd640 1 -- 172.21.15.88:0/4090075028 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f25f80073d0 con 0x7f25fc0c46c0 2023-12-08T08:22:03.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.927+0000 7f25f2ffd640 1 --2- 172.21.15.88:0/4090075028 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f25e0066470 0x7f25e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:03.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.927+0000 7f25f2ffd640 1 -- 172.21.15.88:0/4090075028 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25f8083720 con 0x7f25fc0c46c0 2023-12-08T08:22:03.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.927+0000 7f2601a06640 1 --2- 172.21.15.88:0/4090075028 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f25e0066470 0x7f25e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:03.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.931+0000 7f2601a06640 1 --2- 172.21.15.88:0/4090075028 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f25e0066470 0x7f25e0068930 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f25fc152330 tx=0x7f25ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:03.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:03.931+0000 7f25f2ffd640 1 -- 172.21.15.88:0/4090075028 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f25f8050bb0 con 0x7f25fc0c46c0 2023-12-08T08:22:04.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:04.119+0000 7f260446b640 1 -- 172.21.15.88:0/4090075028 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f25fc0c5100 con 0x7f25fc0c46c0 2023-12-08T08:22:05.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.079+0000 7f25f2ffd640 1 -- 172.21.15.88:0/4090075028 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7f25f80541d0 con 0x7f25fc0c46c0 2023-12-08T08:22:05.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.083+0000 7f260446b640 1 -- 172.21.15.88:0/4090075028 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f25e0066470 msgr2=0x7f25e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:05.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.083+0000 7f260446b640 1 --2- 172.21.15.88:0/4090075028 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f25e0066470 0x7f25e0068930 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f25fc152330 tx=0x7f25ec008040 comp rx=0 tx=0).stop 2023-12-08T08:22:05.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.083+0000 7f260446b640 1 -- 172.21.15.88:0/4090075028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25fc0c46c0 msgr2=0x7f25fc159d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:05.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.083+0000 7f260446b640 1 --2- 172.21.15.88:0/4090075028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25fc0c46c0 0x7f25fc159d40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f25f800c500 tx=0x7f25f800c9c0 comp rx=0 tx=0).stop 2023-12-08T08:22:05.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.083+0000 7f260446b640 1 -- 172.21.15.88:0/4090075028 shutdown_connections 2023-12-08T08:22:05.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.083+0000 7f260446b640 1 --2- 172.21.15.88:0/4090075028 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f25e0066470 0x7f25e0068930 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:05.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.083+0000 7f260446b640 1 --2- 172.21.15.88:0/4090075028 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f25fc1516a0 0x7f25fc1487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:05.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.083+0000 7f260446b640 1 --2- 172.21.15.88:0/4090075028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25fc14e2a0 0x7f25fc14f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:05.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.083+0000 7f260446b640 1 --2- 172.21.15.88:0/4090075028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25fc0c46c0 0x7f25fc159d40 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:05.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.083+0000 7f260446b640 1 -- 172.21.15.88:0/4090075028 >> 172.21.15.88:0/4090075028 conn(0x7f25fc0c59f0 msgr2=0x7f25fc15ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:05.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.083+0000 7f260446b640 1 -- 172.21.15.88:0/4090075028 shutdown_connections 2023-12-08T08:22:05.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.083+0000 7f260446b640 1 -- 172.21.15.88:0/4090075028 wait complete. 2023-12-08T08:22:05.111 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-08T08:22:05.111 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-08T08:22:05.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.251+0000 7fc14089c640 1 Processor -- start 2023-12-08T08:22:05.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.251+0000 7fc14089c640 1 -- start start 2023-12-08T08:22:05.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.251+0000 7fc14089c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc13c14b1e0 0x7fc13c0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:05.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.251+0000 7fc14089c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc13c1548c0 0x7fc13c154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:05.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.251+0000 7fc14089c640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc13c0a4e20 con 0x7fc13c0c5300 2023-12-08T08:22:05.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.251+0000 7fc14089c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc13c0a50e0 con 0x7fc13c1548c0 2023-12-08T08:22:05.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.251+0000 7fc14089c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc13c0c0f00 con 0x7fc13c14b1e0 2023-12-08T08:22:05.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.255+0000 7fc13ad9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc13c1548c0 0x7fc13c154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:05.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.255+0000 7fc13ad9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc13c1548c0 0x7fc13c154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53696/0 (socket says 172.21.15.88:53696) 2023-12-08T08:22:05.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.255+0000 7fc13ad9d640 1 -- 172.21.15.88:0/3002922228 learned_addr learned my addr 172.21.15.88:0/3002922228 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:05.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.255+0000 7fc13a59c640 1 --2- 172.21.15.88:0/3002922228 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc13c14b1e0 0x7fc13c0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:05.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.255+0000 7fc13ad9d640 1 -- 172.21.15.88:0/3002922228 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc13c14b1e0 msgr2=0x7fc13c0c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:05.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.255+0000 7fc13ad9d640 1 --2- 172.21.15.88:0/3002922228 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc13c14b1e0 0x7fc13c0c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:05.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.255+0000 7fc13ad9d640 1 -- 172.21.15.88:0/3002922228 >> v1:172.21.15.148:6789/0 conn(0x7fc13c0c5300 legacy=0x7fc13c0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:05.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.255+0000 7fc13ad9d640 1 -- 172.21.15.88:0/3002922228 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13c0c11e0 con 0x7fc13c1548c0 2023-12-08T08:22:05.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.255+0000 7fc13ad9d640 1 --2- 172.21.15.88:0/3002922228 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c1548c0 0x7fc13c154d50 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc13c0c3b30 tx=0x7fc13401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b60fa9b0a64621 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:05.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.255+0000 7fc139d9b640 1 -- 172.21.15.88:0/3002922228 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c1558b0 con 0x7fc13c1548c0 2023-12-08T08:22:05.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.255+0000 7fc139d9b640 1 -- 172.21.15.88:0/3002922228 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1340a5740 con 0x7fc13c1548c0 2023-12-08T08:22:05.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.255+0000 7fc139d9b640 1 -- 172.21.15.88:0/3002922228 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1340a5ad0 con 0x7fc13c1548c0 2023-12-08T08:22:05.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.259+0000 7fc14089c640 1 -- 172.21.15.88:0/3002922228 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c1548c0 msgr2=0x7fc13c154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:05.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.259+0000 7fc14089c640 1 --2- 172.21.15.88:0/3002922228 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c1548c0 0x7fc13c154d50 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc13c0c3b30 tx=0x7fc13401c9b0 comp rx=0 tx=0).stop 2023-12-08T08:22:05.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.259+0000 7fc14089c640 1 -- 172.21.15.88:0/3002922228 shutdown_connections 2023-12-08T08:22:05.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.259+0000 7fc14089c640 1 --2- 172.21.15.88:0/3002922228 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c1548c0 0x7fc13c154d50 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:05.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.259+0000 7fc14089c640 1 --2- 172.21.15.88:0/3002922228 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc13c14b1e0 0x7fc13c0c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:05.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.259+0000 7fc14089c640 1 -- 172.21.15.88:0/3002922228 >> 172.21.15.88:0/3002922228 conn(0x7fc13c0c59f0 msgr2=0x7fc13c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:05.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.259+0000 7fc14089c640 1 -- 172.21.15.88:0/3002922228 shutdown_connections 2023-12-08T08:22:05.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.259+0000 7fc14089c640 1 -- 172.21.15.88:0/3002922228 wait complete. 2023-12-08T08:22:05.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.259+0000 7fc14089c640 1 Processor -- start 2023-12-08T08:22:05.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.259+0000 7fc14089c640 1 -- start start 2023-12-08T08:22:05.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.259+0000 7fc14089c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c0c5300 0x7fc13c1eb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:05.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.259+0000 7fc14089c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc13c14b1e0 0x7fc13c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:05.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.259+0000 7fc14089c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc13c1548c0 0x7fc13c140510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:05.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.259+0000 7fc14089c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13c06bb40 con 0x7fc13c0c5300 2023-12-08T08:22:05.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.259+0000 7fc14089c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13c13e690 con 0x7fc13c14b1e0 2023-12-08T08:22:05.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.259+0000 7fc14089c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc13c13e970 con 0x7fc13c1548c0 2023-12-08T08:22:05.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.259+0000 7fc13a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c0c5300 0x7fc13c1eb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:05.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.259+0000 7fc13a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c0c5300 0x7fc13c1eb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53712/0 (socket says 172.21.15.88:53712) 2023-12-08T08:22:05.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.259+0000 7fc13a59c640 1 -- 172.21.15.88:0/3241887871 learned_addr learned my addr 172.21.15.88:0/3241887871 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:05.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.259+0000 7fc13ad9d640 1 --2- 172.21.15.88:0/3241887871 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc13c1548c0 0x7fc13c140510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:05.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.259+0000 7fc131d9b640 1 --2- 172.21.15.88:0/3241887871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc13c14b1e0 0x7fc13c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:05.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.259+0000 7fc13a59c640 1 -- 172.21.15.88:0/3241887871 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc13c1548c0 msgr2=0x7fc13c140510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:05.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.259+0000 7fc13a59c640 1 --2- 172.21.15.88:0/3241887871 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc13c1548c0 0x7fc13c140510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:05.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.263+0000 7fc13a59c640 1 -- 172.21.15.88:0/3241887871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc13c14b1e0 msgr2=0x7fc13c06d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:05.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.263+0000 7fc13a59c640 1 --2- 172.21.15.88:0/3241887871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc13c14b1e0 0x7fc13c06d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:05.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.263+0000 7fc13a59c640 1 -- 172.21.15.88:0/3241887871 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc134009b30 con 0x7fc13c0c5300 2023-12-08T08:22:05.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.263+0000 7fc13a59c640 1 --2- 172.21.15.88:0/3241887871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c0c5300 0x7fc13c1eb410 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc12c00d800 tx=0x7fc12c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:05.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.263+0000 7fc1337fe640 1 -- 172.21.15.88:0/3241887871 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c00b6c0 con 0x7fc13c0c5300 2023-12-08T08:22:05.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.263+0000 7fc1337fe640 1 -- 172.21.15.88:0/3241887871 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12c00b820 con 0x7fc13c0c5300 2023-12-08T08:22:05.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.263+0000 7fc1337fe640 1 -- 172.21.15.88:0/3241887871 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c00bb90 con 0x7fc13c0c5300 2023-12-08T08:22:05.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.263+0000 7fc14089c640 1 -- 172.21.15.88:0/3241887871 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc13c13ec50 con 0x7fc13c0c5300 2023-12-08T08:22:05.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.263+0000 7fc14089c640 1 -- 172.21.15.88:0/3241887871 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc13c06d840 con 0x7fc13c0c5300 2023-12-08T08:22:05.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.263+0000 7fc14089c640 1 -- 172.21.15.88:0/3241887871 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc13c067630 con 0x7fc13c0c5300 2023-12-08T08:22:05.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.263+0000 7fc1337fe640 1 -- 172.21.15.88:0/3241887871 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc12c00bcf0 con 0x7fc13c0c5300 2023-12-08T08:22:05.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.263+0000 7fc1337fe640 1 --2- 172.21.15.88:0/3241887871 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc11c0664a0 0x7fc11c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:05.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.263+0000 7fc1337fe640 1 -- 172.21.15.88:0/3241887871 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc12c084260 con 0x7fc13c0c5300 2023-12-08T08:22:05.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.263+0000 7fc131d9b640 1 --2- 172.21.15.88:0/3241887871 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc11c0664a0 0x7fc11c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:05.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.267+0000 7fc131d9b640 1 --2- 172.21.15.88:0/3241887871 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc11c0664a0 0x7fc11c068960 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc13c0c6a40 tx=0x7fc124007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:05.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.267+0000 7fc1337fe640 1 -- 172.21.15.88:0/3241887871 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc12c051780 con 0x7fc13c0c5300 2023-12-08T08:22:05.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:05.451+0000 7fc14089c640 1 -- 172.21.15.88:0/3241887871 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc13c0c3510 con 0x7fc13c0c5300 2023-12-08T08:22:06.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.083+0000 7fc1337fe640 1 -- 172.21.15.88:0/3241887871 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc12c054da0 con 0x7fc13c0c5300 2023-12-08T08:22:06.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.083+0000 7fc14089c640 1 -- 172.21.15.88:0/3241887871 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc11c0664a0 msgr2=0x7fc11c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:06.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.083+0000 7fc14089c640 1 --2- 172.21.15.88:0/3241887871 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc11c0664a0 0x7fc11c068960 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc13c0c6a40 tx=0x7fc124007e40 comp rx=0 tx=0).stop 2023-12-08T08:22:06.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.083+0000 7fc14089c640 1 -- 172.21.15.88:0/3241887871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c0c5300 msgr2=0x7fc13c1eb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:06.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.083+0000 7fc14089c640 1 --2- 172.21.15.88:0/3241887871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c0c5300 0x7fc13c1eb410 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc12c00d800 tx=0x7fc12c00dcc0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.087+0000 7fc14089c640 1 -- 172.21.15.88:0/3241887871 shutdown_connections 2023-12-08T08:22:06.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.087+0000 7fc14089c640 1 --2- 172.21.15.88:0/3241887871 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc11c0664a0 0x7fc11c068960 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.087+0000 7fc14089c640 1 --2- 172.21.15.88:0/3241887871 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc13c1548c0 0x7fc13c140510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.087+0000 7fc14089c640 1 --2- 172.21.15.88:0/3241887871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc13c14b1e0 0x7fc13c06d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.087+0000 7fc14089c640 1 --2- 172.21.15.88:0/3241887871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c0c5300 0x7fc13c1eb410 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.087+0000 7fc14089c640 1 -- 172.21.15.88:0/3241887871 >> 172.21.15.88:0/3241887871 conn(0x7fc13c0c59f0 msgr2=0x7fc13c144b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:06.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.087+0000 7fc14089c640 1 -- 172.21.15.88:0/3241887871 shutdown_connections 2023-12-08T08:22:06.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.087+0000 7fc14089c640 1 -- 172.21.15.88:0/3241887871 wait complete. 2023-12-08T08:22:06.111 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-08T08:22:06.111 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:22:06.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.247+0000 7fb6d5afe640 1 Processor -- start 2023-12-08T08:22:06.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.247+0000 7fb6d5afe640 1 -- start start 2023-12-08T08:22:06.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.247+0000 7fb6d5afe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb6d006c100 0x7fb6d015fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:06.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.247+0000 7fb6d5afe640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d00c4890 con 0x7fb6d00af4c0 2023-12-08T08:22:06.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.247+0000 7fb6d5afe640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d01553d0 con 0x7fb6d0154f20 2023-12-08T08:22:06.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.247+0000 7fb6d5afe640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d00af8a0 con 0x7fb6d006c100 2023-12-08T08:22:06.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.247+0000 7fb6cf7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb6d00af4c0 0x7fb6d00c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39028/0 (socket says 172.21.15.88:39028) 2023-12-08T08:22:06.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.247+0000 7fb6cf7fe640 1 -- 172.21.15.88:0/3348500498 learned_addr learned my addr 172.21.15.88:0/3348500498 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:06.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.247+0000 7fb6cffff640 1 --2- 172.21.15.88:0/3348500498 >> v2:172.21.15.88:3300/0 conn(0x7fb6d006c100 0x7fb6d015fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:06.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.247+0000 7fb6ceffd640 1 -- 172.21.15.88:0/3348500498 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 111818589 0 0) 0x7fb6d00c4890 con 0x7fb6d00af4c0 2023-12-08T08:22:06.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.247+0000 7fb6ceffd640 1 -- 172.21.15.88:0/3348500498 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6bc003530 con 0x7fb6d00af4c0 2023-12-08T08:22:06.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.247+0000 7fb6cffff640 1 -- 172.21.15.88:0/3348500498 >> v1:172.21.15.148:6789/0 conn(0x7fb6d0154f20 legacy=0x7fb6d006b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:06.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.247+0000 7fb6cffff640 1 -- 172.21.15.88:0/3348500498 >> v1:172.21.15.88:6789/0 conn(0x7fb6d00af4c0 legacy=0x7fb6d00c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:06.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.247+0000 7fb6cffff640 1 -- 172.21.15.88:0/3348500498 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d00c4b30 con 0x7fb6d006c100 2023-12-08T08:22:06.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.251+0000 7fb6cffff640 1 --2- 172.21.15.88:0/3348500498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6d006c100 0x7fb6d015fe30 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8009d90 tx=0x7fb6c801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e0299ba0174fe8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:06.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.251+0000 7fb6ceffd640 1 -- 172.21.15.88:0/3348500498 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c80a5950 con 0x7fb6d006c100 2023-12-08T08:22:06.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.251+0000 7fb6ceffd640 1 -- 172.21.15.88:0/3348500498 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c80a5ab0 con 0x7fb6d006c100 2023-12-08T08:22:06.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.251+0000 7fb6ceffd640 1 -- 172.21.15.88:0/3348500498 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c80a5e40 con 0x7fb6d006c100 2023-12-08T08:22:06.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.251+0000 7fb6d5afe640 1 -- 172.21.15.88:0/3348500498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6d006c100 msgr2=0x7fb6d015fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:06.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.251+0000 7fb6d5afe640 1 --2- 172.21.15.88:0/3348500498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6d006c100 0x7fb6d015fe30 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8009d90 tx=0x7fb6c801c890 comp rx=0 tx=0).stop 2023-12-08T08:22:06.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.251+0000 7fb6d5afe640 1 -- 172.21.15.88:0/3348500498 shutdown_connections 2023-12-08T08:22:06.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.251+0000 7fb6d5afe640 1 --2- 172.21.15.88:0/3348500498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6d006c100 0x7fb6d015fe30 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.251+0000 7fb6d5afe640 1 -- 172.21.15.88:0/3348500498 >> 172.21.15.88:0/3348500498 conn(0x7fb6d00ab9d0 msgr2=0x7fb6d00abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:06.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.251+0000 7fb6d5afe640 1 -- 172.21.15.88:0/3348500498 shutdown_connections 2023-12-08T08:22:06.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.251+0000 7fb6d5afe640 1 -- 172.21.15.88:0/3348500498 wait complete. 2023-12-08T08:22:06.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.255+0000 7fb6d5afe640 1 Processor -- start 2023-12-08T08:22:06.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.255+0000 7fb6d5afe640 1 -- start start 2023-12-08T08:22:06.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.255+0000 7fb6d5afe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6d006c100 0x7fb6d0149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:06.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.255+0000 7fb6d5afe640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb6d00af4c0 0x7fb6d0144d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:06.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.255+0000 7fb6d5afe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6d0154f20 0x7fb6d01470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:06.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.255+0000 7fb6d5afe640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d014b5f0 con 0x7fb6d006c100 2023-12-08T08:22:06.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.255+0000 7fb6d5afe640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d0145d70 con 0x7fb6d0154f20 2023-12-08T08:22:06.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.255+0000 7fb6d5afe640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d0146bd0 con 0x7fb6d00af4c0 2023-12-08T08:22:06.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.255+0000 7fb6cf7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6d006c100 0x7fb6d0149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:06.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.255+0000 7fb6cf7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6d006c100 0x7fb6d0149090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53738/0 (socket says 172.21.15.88:53738) 2023-12-08T08:22:06.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.255+0000 7fb6cf7fe640 1 -- 172.21.15.88:0/1324302999 learned_addr learned my addr 172.21.15.88:0/1324302999 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:06.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.255+0000 7fb6c7fff640 1 --2- 172.21.15.88:0/1324302999 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb6d00af4c0 0x7fb6d0144d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:06.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.255+0000 7fb6cffff640 1 --2- 172.21.15.88:0/1324302999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6d0154f20 0x7fb6d01470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:06.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.255+0000 7fb6cf7fe640 1 -- 172.21.15.88:0/1324302999 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb6d00af4c0 msgr2=0x7fb6d0144d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:06.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.255+0000 7fb6cf7fe640 1 --2- 172.21.15.88:0/1324302999 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb6d00af4c0 0x7fb6d0144d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.255+0000 7fb6cf7fe640 1 -- 172.21.15.88:0/1324302999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6d0154f20 msgr2=0x7fb6d01470c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:06.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.255+0000 7fb6cf7fe640 1 --2- 172.21.15.88:0/1324302999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6d0154f20 0x7fb6d01470c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.255+0000 7fb6cf7fe640 1 -- 172.21.15.88:0/1324302999 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c8009a70 con 0x7fb6d006c100 2023-12-08T08:22:06.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.255+0000 7fb6cf7fe640 1 --2- 172.21.15.88:0/1324302999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6d006c100 0x7fb6d0149090 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb6c000c500 tx=0x7fb6c000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:06.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.255+0000 7fb6ccff9640 1 -- 172.21.15.88:0/1324302999 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0005cf0 con 0x7fb6d006c100 2023-12-08T08:22:06.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.255+0000 7fb6ccff9640 1 -- 172.21.15.88:0/1324302999 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c0005e50 con 0x7fb6d006c100 2023-12-08T08:22:06.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.255+0000 7fb6ccff9640 1 -- 172.21.15.88:0/1324302999 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c00072f0 con 0x7fb6d006c100 2023-12-08T08:22:06.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.255+0000 7fb6d5afe640 1 -- 172.21.15.88:0/1324302999 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d0145fc0 con 0x7fb6d006c100 2023-12-08T08:22:06.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.255+0000 7fb6d5afe640 1 -- 172.21.15.88:0/1324302999 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d0146580 con 0x7fb6d006c100 2023-12-08T08:22:06.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.255+0000 7fb6d5afe640 1 -- 172.21.15.88:0/1324302999 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d0067630 con 0x7fb6d006c100 2023-12-08T08:22:06.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.259+0000 7fb6ccff9640 1 -- 172.21.15.88:0/1324302999 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb6c0007450 con 0x7fb6d006c100 2023-12-08T08:22:06.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.259+0000 7fb6ccff9640 1 --2- 172.21.15.88:0/1324302999 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb6b0066470 0x7fb6b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:06.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.259+0000 7fb6ccff9640 1 -- 172.21.15.88:0/1324302999 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6c00833b0 con 0x7fb6d006c100 2023-12-08T08:22:06.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.259+0000 7fb6c7fff640 1 --2- 172.21.15.88:0/1324302999 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb6b0066470 0x7fb6b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:06.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.259+0000 7fb6c7fff640 1 --2- 172.21.15.88:0/1324302999 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb6b0066470 0x7fb6b0068930 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00c7880 tx=0x7fb6b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:06.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.263+0000 7fb6ccff9640 1 -- 172.21.15.88:0/1324302999 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb6c00508d0 con 0x7fb6d006c100 2023-12-08T08:22:06.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.443+0000 7fb6d5afe640 1 -- 172.21.15.88:0/1324302999 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6d006c7a0 con 0x7fb6d006c100 2023-12-08T08:22:06.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.443+0000 7fb6ccff9640 1 -- 172.21.15.88:0/1324302999 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4916 (secure 0 0 0) 0x7fb6c0053ef0 con 0x7fb6d006c100 2023-12-08T08:22:06.447 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:06.447 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5240,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/2576328340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2576328340},{"type":"v1","addr":"172.21.15.148:6834","nonce":2576328340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5626,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/1685449423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1685449423},{"type":"v1","addr":"172.21.15.88:6836","nonce":1685449423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/604820378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":604820378},{"type":"v1","addr":"172.21.15.148:6835","nonce":604820378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:22:02.420431+0000","modified":"2023-12-08T08:22:05.454472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5793},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5793":{"gid":5793,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/4167133153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":4167133153},{"type":"v1","addr":"172.21.15.88:6837","nonce":4167133153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-08T08:22:06.447 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 32 2023-12-08T08:22:06.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.443+0000 7fb6d5afe640 1 -- 172.21.15.88:0/1324302999 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb6b0066470 msgr2=0x7fb6b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:06.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.443+0000 7fb6d5afe640 1 --2- 172.21.15.88:0/1324302999 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb6b0066470 0x7fb6b0068930 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00c7880 tx=0x7fb6b8009040 comp rx=0 tx=0).stop 2023-12-08T08:22:06.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.443+0000 7fb6d5afe640 1 -- 172.21.15.88:0/1324302999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6d006c100 msgr2=0x7fb6d0149090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:06.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.443+0000 7fb6d5afe640 1 --2- 172.21.15.88:0/1324302999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6d006c100 0x7fb6d0149090 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb6c000c500 tx=0x7fb6c000c9c0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.443+0000 7fb6d5afe640 1 -- 172.21.15.88:0/1324302999 shutdown_connections 2023-12-08T08:22:06.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.443+0000 7fb6d5afe640 1 --2- 172.21.15.88:0/1324302999 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb6b0066470 0x7fb6b0068930 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.443+0000 7fb6d5afe640 1 --2- 172.21.15.88:0/1324302999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6d0154f20 0x7fb6d01470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.443+0000 7fb6d5afe640 1 --2- 172.21.15.88:0/1324302999 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb6d00af4c0 0x7fb6d0144d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.443+0000 7fb6d5afe640 1 --2- 172.21.15.88:0/1324302999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6d006c100 0x7fb6d0149090 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.443+0000 7fb6d5afe640 1 -- 172.21.15.88:0/1324302999 >> 172.21.15.88:0/1324302999 conn(0x7fb6d00ab9d0 msgr2=0x7fb6d00733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:06.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.443+0000 7fb6d5afe640 1 -- 172.21.15.88:0/1324302999 shutdown_connections 2023-12-08T08:22:06.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.443+0000 7fb6d5afe640 1 -- 172.21.15.88:0/1324302999 wait complete. 2023-12-08T08:22:06.468 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:22:06.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.603+0000 7f52fba17640 1 Processor -- start 2023-12-08T08:22:06.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.603+0000 7f52fba17640 1 -- start start 2023-12-08T08:22:06.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.603+0000 7f52fba17640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f52f40af4c0 0x7f52f4154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:06.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.603+0000 7f52fba17640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f52f406c100 0x7f52f40c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:06.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.603+0000 7f52fba17640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f40c4890 con 0x7f52f40c67d0 2023-12-08T08:22:06.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.603+0000 7f52fba17640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f4155460 con 0x7f52f40af4c0 2023-12-08T08:22:06.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.603+0000 7f52fba17640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f40af8a0 con 0x7f52f406c100 2023-12-08T08:22:06.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.603+0000 7f52f97b3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f52f40af4c0 0x7f52f4154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:06.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.603+0000 7f52f97b3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f52f40af4c0 0x7f52f4154f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53754/0 (socket says 172.21.15.88:53754) 2023-12-08T08:22:06.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.603+0000 7f52f8fb2640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f52f40c67d0 0x7f52f406b9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39042/0 (socket says 172.21.15.88:39042) 2023-12-08T08:22:06.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.603+0000 7f52f97b3640 1 -- 172.21.15.88:0/662395507 learned_addr learned my addr 172.21.15.88:0/662395507 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:06.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.603+0000 7f52f9fb4640 1 --2- 172.21.15.88:0/662395507 >> v2:172.21.15.148:3300/0 conn(0x7f52f406c100 0x7f52f40c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:06.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.603+0000 7f52f97b3640 1 -- 172.21.15.88:0/662395507 >> v2:172.21.15.148:3300/0 conn(0x7f52f406c100 msgr2=0x7f52f40c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:06.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.603+0000 7f52f97b3640 1 --2- 172.21.15.88:0/662395507 >> v2:172.21.15.148:3300/0 conn(0x7f52f406c100 0x7f52f40c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.603+0000 7f52f97b3640 1 -- 172.21.15.88:0/662395507 >> v1:172.21.15.88:6789/0 conn(0x7f52f40c67d0 legacy=0x7f52f406b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:06.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.603+0000 7f52ebfff640 1 -- 172.21.15.88:0/662395507 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3829429198 0 0) 0x7f52f40c4890 con 0x7f52f40c67d0 2023-12-08T08:22:06.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.603+0000 7f52f97b3640 1 -- 172.21.15.88:0/662395507 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f40c4b30 con 0x7f52f40af4c0 2023-12-08T08:22:06.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.603+0000 7f52f9fb4640 1 --2- 172.21.15.88:0/662395507 >> v2:172.21.15.148:3300/0 conn(0x7f52f406c100 0x7f52f40c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:06.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.607+0000 7f52f97b3640 1 --2- 172.21.15.88:0/662395507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52f40af4c0 0x7f52f4154f20 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f52f40c9d90 tx=0x7f52f001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=708b201039a1304f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:06.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.607+0000 7f52ebfff640 1 -- 172.21.15.88:0/662395507 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f00ab640 con 0x7f52f40af4c0 2023-12-08T08:22:06.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.607+0000 7f52ebfff640 1 -- 172.21.15.88:0/662395507 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f00a7070 con 0x7f52f40af4c0 2023-12-08T08:22:06.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.607+0000 7f52ebfff640 1 -- 172.21.15.88:0/662395507 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f00ab9c0 con 0x7f52f40af4c0 2023-12-08T08:22:06.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.607+0000 7f52fba17640 1 -- 172.21.15.88:0/662395507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52f40af4c0 msgr2=0x7f52f4154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:06.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.607+0000 7f52fba17640 1 --2- 172.21.15.88:0/662395507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52f40af4c0 0x7f52f4154f20 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f52f40c9d90 tx=0x7f52f001c440 comp rx=0 tx=0).stop 2023-12-08T08:22:06.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.607+0000 7f52fba17640 1 -- 172.21.15.88:0/662395507 shutdown_connections 2023-12-08T08:22:06.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.607+0000 7f52fba17640 1 --2- 172.21.15.88:0/662395507 >> v2:172.21.15.148:3300/0 conn(0x7f52f406c100 0x7f52f40c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.607+0000 7f52fba17640 1 --2- 172.21.15.88:0/662395507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52f40af4c0 0x7f52f4154f20 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.607+0000 7f52fba17640 1 -- 172.21.15.88:0/662395507 >> 172.21.15.88:0/662395507 conn(0x7f52f40ab9d0 msgr2=0x7f52f40abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:06.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.607+0000 7f52fba17640 1 -- 172.21.15.88:0/662395507 shutdown_connections 2023-12-08T08:22:06.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.607+0000 7f52fba17640 1 -- 172.21.15.88:0/662395507 wait complete. 2023-12-08T08:22:06.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.607+0000 7f52fba17640 1 Processor -- start 2023-12-08T08:22:06.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.611+0000 7f52fba17640 1 -- start start 2023-12-08T08:22:06.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.611+0000 7f52fba17640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52f406c100 0x7f52f40bd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:06.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.611+0000 7f52fba17640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52f40af4c0 0x7f52f4154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:06.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.611+0000 7f52fba17640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52f40c67d0 0x7f52f41ed580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:06.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.611+0000 7f52fba17640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f40bda20 con 0x7f52f40af4c0 2023-12-08T08:22:06.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.611+0000 7f52fba17640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f40c2d10 con 0x7f52f40c67d0 2023-12-08T08:22:06.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.611+0000 7f52fba17640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f40c2750 con 0x7f52f406c100 2023-12-08T08:22:06.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.611+0000 7f52f8fb2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52f40af4c0 0x7f52f4154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:06.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.611+0000 7f52f8fb2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52f40af4c0 0x7f52f4154c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53756/0 (socket says 172.21.15.88:53756) 2023-12-08T08:22:06.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.611+0000 7f52f8fb2640 1 -- 172.21.15.88:0/1426805748 learned_addr learned my addr 172.21.15.88:0/1426805748 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:06.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.611+0000 7f52f97b3640 1 --2- 172.21.15.88:0/1426805748 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52f406c100 0x7f52f40bd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:06.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.611+0000 7f52f9fb4640 1 --2- 172.21.15.88:0/1426805748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52f40c67d0 0x7f52f41ed580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:06.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.611+0000 7f52f8fb2640 1 -- 172.21.15.88:0/1426805748 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52f406c100 msgr2=0x7f52f40bd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:06.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.611+0000 7f52f8fb2640 1 --2- 172.21.15.88:0/1426805748 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52f406c100 0x7f52f40bd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.611+0000 7f52f8fb2640 1 -- 172.21.15.88:0/1426805748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52f40c67d0 msgr2=0x7f52f41ed580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:06.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.611+0000 7f52f8fb2640 1 --2- 172.21.15.88:0/1426805748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52f40c67d0 0x7f52f41ed580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.611+0000 7f52f8fb2640 1 -- 172.21.15.88:0/1426805748 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f00094d0 con 0x7f52f40af4c0 2023-12-08T08:22:06.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.611+0000 7f52f8fb2640 1 --2- 172.21.15.88:0/1426805748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52f40af4c0 0x7f52f4154c60 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f52e400c520 tx=0x7f52e400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:06.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.611+0000 7f52e9ffb640 1 -- 172.21.15.88:0/1426805748 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e40074e0 con 0x7f52f40af4c0 2023-12-08T08:22:06.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.611+0000 7f52e9ffb640 1 -- 172.21.15.88:0/1426805748 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e4007640 con 0x7f52f40af4c0 2023-12-08T08:22:06.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.611+0000 7f52e9ffb640 1 -- 172.21.15.88:0/1426805748 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e40049f0 con 0x7f52f40af4c0 2023-12-08T08:22:06.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.611+0000 7f52fba17640 1 -- 172.21.15.88:0/1426805748 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f40c2a30 con 0x7f52f40af4c0 2023-12-08T08:22:06.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.611+0000 7f52fba17640 1 -- 172.21.15.88:0/1426805748 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f41ed060 con 0x7f52f40af4c0 2023-12-08T08:22:06.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.611+0000 7f52fba17640 1 -- 172.21.15.88:0/1426805748 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f4067630 con 0x7f52f40af4c0 2023-12-08T08:22:06.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.615+0000 7f52e9ffb640 1 -- 172.21.15.88:0/1426805748 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f52e4004b50 con 0x7f52f40af4c0 2023-12-08T08:22:06.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.615+0000 7f52e9ffb640 1 --2- 172.21.15.88:0/1426805748 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f52d8066470 0x7f52d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:06.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.615+0000 7f52e9ffb640 1 -- 172.21.15.88:0/1426805748 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52e4082fe0 con 0x7f52f40af4c0 2023-12-08T08:22:06.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.615+0000 7f52f97b3640 1 --2- 172.21.15.88:0/1426805748 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f52d8066470 0x7f52d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:06.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.615+0000 7f52f97b3640 1 --2- 172.21.15.88:0/1426805748 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f52d8066470 0x7f52d8068930 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f52f00af000 tx=0x7f52f00b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:06.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.619+0000 7f52e9ffb640 1 -- 172.21.15.88:0/1426805748 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f52e4050560 con 0x7f52f40af4c0 2023-12-08T08:22:06.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.767+0000 7f52fba17640 1 -- 172.21.15.88:0/1426805748 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52f415ec00 con 0x7f52f40af4c0 2023-12-08T08:22:06.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.767+0000 7f52e9ffb640 1 -- 172.21.15.88:0/1426805748 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f52e4053b80 con 0x7f52f40af4c0 2023-12-08T08:22:06.774 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:06.774 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":50,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:22:04.068463+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:00.520254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:01.423493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:22:06.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.771+0000 7f52fba17640 1 -- 172.21.15.88:0/1426805748 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f52d8066470 msgr2=0x7f52d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:06.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.771+0000 7f52fba17640 1 --2- 172.21.15.88:0/1426805748 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f52d8066470 0x7f52d8068930 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f52f00af000 tx=0x7f52f00b6040 comp rx=0 tx=0).stop 2023-12-08T08:22:06.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.771+0000 7f52fba17640 1 -- 172.21.15.88:0/1426805748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52f40af4c0 msgr2=0x7f52f4154c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:06.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.771+0000 7f52fba17640 1 --2- 172.21.15.88:0/1426805748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52f40af4c0 0x7f52f4154c60 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f52e400c520 tx=0x7f52e400c9e0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.771+0000 7f52fba17640 1 -- 172.21.15.88:0/1426805748 shutdown_connections 2023-12-08T08:22:06.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.771+0000 7f52fba17640 1 --2- 172.21.15.88:0/1426805748 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f52d8066470 0x7f52d8068930 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.771+0000 7f52fba17640 1 --2- 172.21.15.88:0/1426805748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52f40c67d0 0x7f52f41ed580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.771+0000 7f52fba17640 1 --2- 172.21.15.88:0/1426805748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52f40af4c0 0x7f52f4154c60 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.771+0000 7f52fba17640 1 --2- 172.21.15.88:0/1426805748 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52f406c100 0x7f52f40bd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.771+0000 7f52fba17640 1 -- 172.21.15.88:0/1426805748 >> 172.21.15.88:0/1426805748 conn(0x7f52f40ab9d0 msgr2=0x7f52f4158320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:06.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.771+0000 7f52fba17640 1 -- 172.21.15.88:0/1426805748 shutdown_connections 2023-12-08T08:22:06.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.771+0000 7f52fba17640 1 -- 172.21.15.88:0/1426805748 wait complete. 2023-12-08T08:22:06.795 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-08T08:22:06.795 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:22:06.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.927+0000 7fc82792a640 1 Processor -- start 2023-12-08T08:22:06.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.927+0000 7fc82792a640 1 -- start start 2023-12-08T08:22:06.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.931+0000 7fc82792a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc820072580 0x7fc8200c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:06.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.931+0000 7fc82792a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc8200c0460 0x7fc820155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:06.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.931+0000 7fc82792a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8200c1a50 con 0x7fc8200c0f30 2023-12-08T08:22:06.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.931+0000 7fc82792a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc820159990 con 0x7fc8200c0460 2023-12-08T08:22:06.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.931+0000 7fc82792a640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8200c0890 con 0x7fc820072580 2023-12-08T08:22:06.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.931+0000 7fc825ec7640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc8200c0460 0x7fc820155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:06.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.931+0000 7fc8256c6640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc8200c0f30 0x7fc820159280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39050/0 (socket says 172.21.15.88:39050) 2023-12-08T08:22:06.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.931+0000 7fc8256c6640 1 -- 172.21.15.88:0/2431067082 learned_addr learned my addr 172.21.15.88:0/2431067082 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:06.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.931+0000 7fc824ec5640 1 --2- 172.21.15.88:0/2431067082 >> v2:172.21.15.148:3300/0 conn(0x7fc820072580 0x7fc8200c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:06.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.931+0000 7fc825ec7640 1 -- 172.21.15.88:0/2431067082 >> v2:172.21.15.148:3300/0 conn(0x7fc820072580 msgr2=0x7fc8200c3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:06.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.931+0000 7fc825ec7640 1 --2- 172.21.15.88:0/2431067082 >> v2:172.21.15.148:3300/0 conn(0x7fc820072580 0x7fc8200c3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.931+0000 7fc825ec7640 1 -- 172.21.15.88:0/2431067082 >> v1:172.21.15.88:6789/0 conn(0x7fc8200c0f30 legacy=0x7fc820159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:06.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.931+0000 7fc825ec7640 1 -- 172.21.15.88:0/2431067082 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8200c1ca0 con 0x7fc8200c0460 2023-12-08T08:22:06.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.931+0000 7fc817fff640 1 -- 172.21.15.88:0/2431067082 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121929659 0 0) 0x7fc8200c1a50 con 0x7fc8200c0f30 2023-12-08T08:22:06.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.931+0000 7fc825ec7640 1 --2- 172.21.15.88:0/2431067082 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8200c0460 0x7fc820155ed0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fc820066ed0 tx=0x7fc81801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4781edf0287bf5b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:06.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.931+0000 7fc817fff640 1 -- 172.21.15.88:0/2431067082 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8180a5850 con 0x7fc8200c0460 2023-12-08T08:22:06.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.931+0000 7fc817fff640 1 -- 172.21.15.88:0/2431067082 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8180a59b0 con 0x7fc8200c0460 2023-12-08T08:22:06.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.931+0000 7fc817fff640 1 -- 172.21.15.88:0/2431067082 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8180a5d40 con 0x7fc8200c0460 2023-12-08T08:22:06.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.935+0000 7fc82792a640 1 -- 172.21.15.88:0/2431067082 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8200c0460 msgr2=0x7fc820155ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:06.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.935+0000 7fc82792a640 1 --2- 172.21.15.88:0/2431067082 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8200c0460 0x7fc820155ed0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fc820066ed0 tx=0x7fc81801c880 comp rx=0 tx=0).stop 2023-12-08T08:22:06.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.935+0000 7fc82792a640 1 -- 172.21.15.88:0/2431067082 shutdown_connections 2023-12-08T08:22:06.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.935+0000 7fc82792a640 1 --2- 172.21.15.88:0/2431067082 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8200c0460 0x7fc820155ed0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.935+0000 7fc82792a640 1 --2- 172.21.15.88:0/2431067082 >> v2:172.21.15.148:3300/0 conn(0x7fc820072580 0x7fc8200c3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.935+0000 7fc82792a640 1 -- 172.21.15.88:0/2431067082 >> 172.21.15.88:0/2431067082 conn(0x7fc8200a7810 msgr2=0x7fc8200a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:06.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.935+0000 7fc82792a640 1 -- 172.21.15.88:0/2431067082 shutdown_connections 2023-12-08T08:22:06.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.935+0000 7fc82792a640 1 -- 172.21.15.88:0/2431067082 wait complete. 2023-12-08T08:22:06.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.935+0000 7fc82792a640 1 Processor -- start 2023-12-08T08:22:06.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.935+0000 7fc82792a640 1 -- start start 2023-12-08T08:22:06.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.935+0000 7fc82792a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc820072580 0x7fc820152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:06.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.935+0000 7fc82792a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8200c0460 0x7fc8201537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:06.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.935+0000 7fc82792a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8200c0f30 0x7fc820153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:06.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.935+0000 7fc82792a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82014a6a0 con 0x7fc8200c0460 2023-12-08T08:22:06.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.935+0000 7fc82792a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8201f17c0 con 0x7fc820072580 2023-12-08T08:22:06.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.935+0000 7fc82792a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8201f1aa0 con 0x7fc8200c0f30 2023-12-08T08:22:06.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.935+0000 7fc824ec5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8200c0460 0x7fc8201537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:06.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.935+0000 7fc824ec5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8200c0460 0x7fc8201537b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53764/0 (socket says 172.21.15.88:53764) 2023-12-08T08:22:06.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.935+0000 7fc824ec5640 1 -- 172.21.15.88:0/2611975860 learned_addr learned my addr 172.21.15.88:0/2611975860 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:06.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.935+0000 7fc8256c6640 1 --2- 172.21.15.88:0/2611975860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc820072580 0x7fc820152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:06.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.935+0000 7fc825ec7640 1 --2- 172.21.15.88:0/2611975860 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8200c0f30 0x7fc820153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:06.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.935+0000 7fc824ec5640 1 -- 172.21.15.88:0/2611975860 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8200c0f30 msgr2=0x7fc820153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:06.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.935+0000 7fc824ec5640 1 --2- 172.21.15.88:0/2611975860 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8200c0f30 0x7fc820153cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.939+0000 7fc824ec5640 1 -- 172.21.15.88:0/2611975860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc820072580 msgr2=0x7fc820152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:06.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.939+0000 7fc824ec5640 1 --2- 172.21.15.88:0/2611975860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc820072580 0x7fc820152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:06.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.939+0000 7fc824ec5640 1 -- 172.21.15.88:0/2611975860 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc818009a70 con 0x7fc8200c0460 2023-12-08T08:22:06.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.939+0000 7fc8256c6640 1 --2- 172.21.15.88:0/2611975860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc820072580 0x7fc820152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:06.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.939+0000 7fc825ec7640 1 --2- 172.21.15.88:0/2611975860 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8200c0f30 0x7fc820153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:06.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.939+0000 7fc824ec5640 1 --2- 172.21.15.88:0/2611975860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8200c0460 0x7fc8201537b0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc81000e870 tx=0x7fc81000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:06.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.939+0000 7fc815ffb640 1 -- 172.21.15.88:0/2611975860 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc810009510 con 0x7fc8200c0460 2023-12-08T08:22:06.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.939+0000 7fc815ffb640 1 -- 172.21.15.88:0/2611975860 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81000eec0 con 0x7fc8200c0460 2023-12-08T08:22:06.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.939+0000 7fc815ffb640 1 -- 172.21.15.88:0/2611975860 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81000cb40 con 0x7fc8200c0460 2023-12-08T08:22:06.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.939+0000 7fc82792a640 1 -- 172.21.15.88:0/2611975860 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc820152cd0 con 0x7fc8200c0460 2023-12-08T08:22:06.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.939+0000 7fc82792a640 1 -- 172.21.15.88:0/2611975860 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc820153290 con 0x7fc8200c0460 2023-12-08T08:22:06.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.939+0000 7fc82792a640 1 -- 172.21.15.88:0/2611975860 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc820067630 con 0x7fc8200c0460 2023-12-08T08:22:06.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.939+0000 7fc815ffb640 1 -- 172.21.15.88:0/2611975860 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc81000cca0 con 0x7fc8200c0460 2023-12-08T08:22:06.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.939+0000 7fc815ffb640 1 --2- 172.21.15.88:0/2611975860 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc804066470 0x7fc804068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:06.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.939+0000 7fc815ffb640 1 -- 172.21.15.88:0/2611975860 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc810083fe0 con 0x7fc8200c0460 2023-12-08T08:22:06.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.939+0000 7fc8256c6640 1 --2- 172.21.15.88:0/2611975860 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc804066470 0x7fc804068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:06.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.943+0000 7fc8256c6640 1 --2- 172.21.15.88:0/2611975860 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc804066470 0x7fc804068930 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc81c000f70 tx=0x7fc81c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:06.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:06.943+0000 7fc815ffb640 1 -- 172.21.15.88:0/2611975860 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc810051450 con 0x7fc8200c0460 2023-12-08T08:22:07.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.095+0000 7fc82792a640 1 -- 172.21.15.88:0/2611975860 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc820152b50 con 0x7fc804066470 2023-12-08T08:22:07.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.099+0000 7fc815ffb640 1 -- 172.21.15.88:0/2611975860 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283477 (secure 0 0 0) 0x7fc81c0013e0 con 0x7fc804066470 2023-12-08T08:22:07.108 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:07.110 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:22:07.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.103+0000 7fc82792a640 1 -- 172.21.15.88:0/2611975860 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc804066470 msgr2=0x7fc804068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:07.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.103+0000 7fc82792a640 1 --2- 172.21.15.88:0/2611975860 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc804066470 0x7fc804068930 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc81c000f70 tx=0x7fc81c009040 comp rx=0 tx=0).stop 2023-12-08T08:22:07.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.103+0000 7fc82792a640 1 -- 172.21.15.88:0/2611975860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8200c0460 msgr2=0x7fc8201537b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:07.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.103+0000 7fc82792a640 1 --2- 172.21.15.88:0/2611975860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8200c0460 0x7fc8201537b0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc81000e870 tx=0x7fc81000ec70 comp rx=0 tx=0).stop 2023-12-08T08:22:07.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.103+0000 7fc82792a640 1 -- 172.21.15.88:0/2611975860 shutdown_connections 2023-12-08T08:22:07.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.103+0000 7fc82792a640 1 --2- 172.21.15.88:0/2611975860 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc804066470 0x7fc804068930 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:07.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.103+0000 7fc82792a640 1 --2- 172.21.15.88:0/2611975860 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc8200c0f30 0x7fc820153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:07.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.103+0000 7fc82792a640 1 --2- 172.21.15.88:0/2611975860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8200c0460 0x7fc8201537b0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:07.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.103+0000 7fc82792a640 1 --2- 172.21.15.88:0/2611975860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc820072580 0x7fc820152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:07.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.103+0000 7fc82792a640 1 -- 172.21.15.88:0/2611975860 >> 172.21.15.88:0/2611975860 conn(0x7fc8200a7810 msgr2=0x7fc820159280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:07.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.103+0000 7fc82792a640 1 -- 172.21.15.88:0/2611975860 shutdown_connections 2023-12-08T08:22:07.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.103+0000 7fc82792a640 1 -- 172.21.15.88:0/2611975860 wait complete. 2023-12-08T08:22:07.128 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2023-12-08T08:22:06.769127+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220784,"kb_used_data":4584,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753936,"statfs":{"total":773094113280,"available":772868030464,"internally_reserved":0,"allocated":4694016,"data_stored":3080330,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.733893"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.059484+0000","last_change":"2023-12-08T08:22:02.059484+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.059484+0000","last_undegraded":"2023-12-08T08:22:02.059484+0000","last_fullsized":"2023-12-08T08:22:02.059484+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.055012+0000","last_change":"2023-12-08T08:22:02.055012+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.055012+0000","last_undegraded":"2023-12-08T08:22:02.055012+0000","last_fullsized":"2023-12-08T08:22:02.055012+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.053803+0000","last_change":"2023-12-08T08:22:02.053803+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.053803+0000","last_undegraded":"2023-12-08T08:22:02.053803+0000","last_fullsized":"2023-12-08T08:22:02.053803+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.060413+0000","last_change":"2023-12-08T08:22:02.060413+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.060413+0000","last_undegraded":"2023-12-08T08:22:02.060413+0000","last_fullsized":"2023-12-08T08:22:02.060413+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.065877+0000","last_change":"2023-12-08T08:22:02.065877+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.065877+0000","last_undegraded":"2023-12-08T08:22:02.065877+0000","last_fullsized":"2023-12-08T08:22:02.065877+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.048960+0000","last_change":"2023-12-08T08:22:02.048960+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.048960+0000","last_undegraded":"2023-12-08T08:22:02.048960+0000","last_fullsized":"2023-12-08T08:22:02.048960+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.046276+0000","last_change":"2023-12-08T08:22:02.046276+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.046276+0000","last_undegraded":"2023-12-08T08:22:02.046276+0000","last_fullsized":"2023-12-08T08:22:02.046276+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051226+0000","last_change":"2023-12-08T08:22:02.051226+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051226+0000","last_undegraded":"2023-12-08T08:22:02.051226+0000","last_fullsized":"2023-12-08T08:22:02.051226+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045291+0000","last_change":"2023-12-08T08:22:02.045291+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045291+0000","last_undegraded":"2023-12-08T08:22:02.045291+0000","last_fullsized":"2023-12-08T08:22:02.045291+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044805+0000","last_change":"2023-12-08T08:22:02.044805+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044805+0000","last_undegraded":"2023-12-08T08:22:02.044805+0000","last_fullsized":"2023-12-08T08:22:02.044805+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044852+0000","last_change":"2023-12-08T08:22:02.044852+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044852+0000","last_undegraded":"2023-12-08T08:22:02.044852+0000","last_fullsized":"2023-12-08T08:22:02.044852+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.059919+0000","last_change":"2023-12-08T08:22:02.059919+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.059919+0000","last_undegraded":"2023-12-08T08:22:02.059919+0000","last_fullsized":"2023-12-08T08:22:02.059919+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049732+0000","last_change":"2023-12-08T08:22:02.049732+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049732+0000","last_undegraded":"2023-12-08T08:22:02.049732+0000","last_fullsized":"2023-12-08T08:22:02.049732+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045770+0000","last_change":"2023-12-08T08:22:02.045770+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045770+0000","last_undegraded":"2023-12-08T08:22:02.045770+0000","last_fullsized":"2023-12-08T08:22:02.045770+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045164+0000","last_change":"2023-12-08T08:22:02.045164+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045164+0000","last_undegraded":"2023-12-08T08:22:02.045164+0000","last_fullsized":"2023-12-08T08:22:02.045164+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.046662+0000","last_change":"2023-12-08T08:22:02.046662+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.046662+0000","last_undegraded":"2023-12-08T08:22:02.046662+0000","last_fullsized":"2023-12-08T08:22:02.046662+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049678+0000","last_change":"2023-12-08T08:22:02.049678+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049678+0000","last_undegraded":"2023-12-08T08:22:02.049678+0000","last_fullsized":"2023-12-08T08:22:02.049678+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051550+0000","last_change":"2023-12-08T08:22:02.051550+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051550+0000","last_undegraded":"2023-12-08T08:22:02.051550+0000","last_fullsized":"2023-12-08T08:22:02.051550+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.064039+0000","last_change":"2023-12-08T08:22:02.064039+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.064039+0000","last_undegraded":"2023-12-08T08:22:02.064039+0000","last_fullsized":"2023-12-08T08:22:02.064039+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045927+0000","last_change":"2023-12-08T08:22:02.045927+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045927+0000","last_undegraded":"2023-12-08T08:22:02.045927+0000","last_fullsized":"2023-12-08T08:22:02.045927+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.052487+0000","last_change":"2023-12-08T08:22:02.052487+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.052487+0000","last_undegraded":"2023-12-08T08:22:02.052487+0000","last_fullsized":"2023-12-08T08:22:02.052487+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.046251+0000","last_change":"2023-12-08T08:22:02.046251+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.046251+0000","last_undegraded":"2023-12-08T08:22:02.046251+0000","last_fullsized":"2023-12-08T08:22:02.046251+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051264+0000","last_change":"2023-12-08T08:22:02.051264+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051264+0000","last_undegraded":"2023-12-08T08:22:02.051264+0000","last_fullsized":"2023-12-08T08:22:02.051264+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.050511+0000","last_change":"2023-12-08T08:22:02.050511+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.050511+0000","last_undegraded":"2023-12-08T08:22:02.050511+0000","last_fullsized":"2023-12-08T08:22:02.050511+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.058924+0000","last_change":"2023-12-08T08:22:02.058924+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.058924+0000","last_undegraded":"2023-12-08T08:22:02.058924+0000","last_fullsized":"2023-12-08T08:22:02.058924+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.060181+0000","last_change":"2023-12-08T08:22:02.060181+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.060181+0000","last_undegraded":"2023-12-08T08:22:02.060181+0000","last_fullsized":"2023-12-08T08:22:02.060181+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.050768+0000","last_change":"2023-12-08T08:22:02.050768+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.050768+0000","last_undegraded":"2023-12-08T08:22:02.050768+0000","last_fullsized":"2023-12-08T08:22:02.050768+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.063344+0000","last_change":"2023-12-08T08:22:02.063344+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.063344+0000","last_undegraded":"2023-12-08T08:22:02.063344+0000","last_fullsized":"2023-12-08T08:22:02.063344+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044610+0000","last_change":"2023-12-08T08:22:02.044610+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044610+0000","last_undegraded":"2023-12-08T08:22:02.044610+0000","last_fullsized":"2023-12-08T08:22:02.044610+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049106+0000","last_change":"2023-12-08T08:22:02.049106+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049106+0000","last_undegraded":"2023-12-08T08:22:02.049106+0000","last_fullsized":"2023-12-08T08:22:02.049106+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.064493+0000","last_change":"2023-12-08T08:22:02.064493+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.064493+0000","last_undegraded":"2023-12-08T08:22:02.064493+0000","last_fullsized":"2023-12-08T08:22:02.064493+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.046147+0000","last_change":"2023-12-08T08:22:02.046147+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.046147+0000","last_undegraded":"2023-12-08T08:22:02.046147+0000","last_fullsized":"2023-12-08T08:22:02.046147+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051096+0000","last_change":"2023-12-08T08:22:02.051096+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051096+0000","last_undegraded":"2023-12-08T08:22:02.051096+0000","last_fullsized":"2023-12-08T08:22:02.051096+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.071534+0000","last_change":"2023-12-08T08:22:02.066070+0000","last_active":"2023-12-08T08:22:02.071534+0000","last_peered":"2023-12-08T08:22:02.071534+0000","last_clean":"2023-12-08T08:22:02.071534+0000","last_became_active":"2023-12-08T08:22:02.065684+0000","last_became_peered":"2023-12-08T08:22:02.065684+0000","last_unstale":"2023-12-08T08:22:02.071534+0000","last_undegraded":"2023-12-08T08:22:02.071534+0000","last_fullsized":"2023-12-08T08:22:02.071534+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:01:23.302095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.043952+0000","last_change":"2023-12-08T08:22:02.043952+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.043952+0000","last_undegraded":"2023-12-08T08:22:02.043952+0000","last_fullsized":"2023-12-08T08:22:02.043952+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.074479+0000","last_change":"2023-12-08T08:22:02.068162+0000","last_active":"2023-12-08T08:22:02.074479+0000","last_peered":"2023-12-08T08:22:02.074479+0000","last_clean":"2023-12-08T08:22:02.074479+0000","last_became_active":"2023-12-08T08:22:02.067918+0000","last_became_peered":"2023-12-08T08:22:02.067918+0000","last_unstale":"2023-12-08T08:22:02.074479+0000","last_undegraded":"2023-12-08T08:22:02.074479+0000","last_fullsized":"2023-12-08T08:22:02.074479+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:09:21.024470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.054028+0000","last_change":"2023-12-08T08:22:02.054028+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.054028+0000","last_undegraded":"2023-12-08T08:22:02.054028+0000","last_fullsized":"2023-12-08T08:22:02.054028+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.068247+0000","last_change":"2023-12-08T08:22:02.061868+0000","last_active":"2023-12-08T08:22:02.068247+0000","last_peered":"2023-12-08T08:22:02.068247+0000","last_clean":"2023-12-08T08:22:02.068247+0000","last_became_active":"2023-12-08T08:22:02.061570+0000","last_became_peered":"2023-12-08T08:22:02.061570+0000","last_unstale":"2023-12-08T08:22:02.068247+0000","last_undegraded":"2023-12-08T08:22:02.068247+0000","last_fullsized":"2023-12-08T08:22:02.068247+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:55:21.616638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.050433+0000","last_change":"2023-12-08T08:22:02.050433+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.050433+0000","last_undegraded":"2023-12-08T08:22:02.050433+0000","last_fullsized":"2023-12-08T08:22:02.050433+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076694+0000","last_change":"2023-12-08T08:22:02.073413+0000","last_active":"2023-12-08T08:22:02.076694+0000","last_peered":"2023-12-08T08:22:02.076694+0000","last_clean":"2023-12-08T08:22:02.076694+0000","last_became_active":"2023-12-08T08:22:02.073043+0000","last_became_peered":"2023-12-08T08:22:02.073043+0000","last_unstale":"2023-12-08T08:22:02.076694+0000","last_undegraded":"2023-12-08T08:22:02.076694+0000","last_fullsized":"2023-12-08T08:22:02.076694+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:13.555049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045725+0000","last_change":"2023-12-08T08:22:02.045725+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045725+0000","last_undegraded":"2023-12-08T08:22:02.045725+0000","last_fullsized":"2023-12-08T08:22:02.045725+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.075910+0000","last_change":"2023-12-08T08:22:02.074443+0000","last_active":"2023-12-08T08:22:02.075910+0000","last_peered":"2023-12-08T08:22:02.075910+0000","last_clean":"2023-12-08T08:22:02.075910+0000","last_became_active":"2023-12-08T08:22:02.074076+0000","last_became_peered":"2023-12-08T08:22:02.074076+0000","last_unstale":"2023-12-08T08:22:02.075910+0000","last_undegraded":"2023-12-08T08:22:02.075910+0000","last_fullsized":"2023-12-08T08:22:02.075910+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:17:41.637207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.047229+0000","last_change":"2023-12-08T08:22:02.047229+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.047229+0000","last_undegraded":"2023-12-08T08:22:02.047229+0000","last_fullsized":"2023-12-08T08:22:02.047229+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.068126+0000","last_change":"2023-12-08T08:22:02.061389+0000","last_active":"2023-12-08T08:22:02.068126+0000","last_peered":"2023-12-08T08:22:02.068126+0000","last_clean":"2023-12-08T08:22:02.068126+0000","last_became_active":"2023-12-08T08:22:02.060880+0000","last_became_peered":"2023-12-08T08:22:02.060880+0000","last_unstale":"2023-12-08T08:22:02.068126+0000","last_undegraded":"2023-12-08T08:22:02.068126+0000","last_fullsized":"2023-12-08T08:22:02.068126+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:48.380978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049585+0000","last_change":"2023-12-08T08:22:02.049585+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049585+0000","last_undegraded":"2023-12-08T08:22:02.049585+0000","last_fullsized":"2023-12-08T08:22:02.049585+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.069309+0000","last_change":"2023-12-08T08:22:02.063925+0000","last_active":"2023-12-08T08:22:02.069309+0000","last_peered":"2023-12-08T08:22:02.069309+0000","last_clean":"2023-12-08T08:22:02.069309+0000","last_became_active":"2023-12-08T08:22:02.063585+0000","last_became_peered":"2023-12-08T08:22:02.063585+0000","last_unstale":"2023-12-08T08:22:02.069309+0000","last_undegraded":"2023-12-08T08:22:02.069309+0000","last_fullsized":"2023-12-08T08:22:02.069309+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:24.830501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044970+0000","last_change":"2023-12-08T08:22:02.044970+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044970+0000","last_undegraded":"2023-12-08T08:22:02.044970+0000","last_fullsized":"2023-12-08T08:22:02.044970+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.072407+0000","last_change":"2023-12-08T08:22:02.066732+0000","last_active":"2023-12-08T08:22:02.072407+0000","last_peered":"2023-12-08T08:22:02.072407+0000","last_clean":"2023-12-08T08:22:02.072407+0000","last_became_active":"2023-12-08T08:22:02.066414+0000","last_became_peered":"2023-12-08T08:22:02.066414+0000","last_unstale":"2023-12-08T08:22:02.072407+0000","last_undegraded":"2023-12-08T08:22:02.072407+0000","last_fullsized":"2023-12-08T08:22:02.072407+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:24.830501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045265+0000","last_change":"2023-12-08T08:22:02.045265+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045265+0000","last_undegraded":"2023-12-08T08:22:02.045265+0000","last_fullsized":"2023-12-08T08:22:02.045265+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.075696+0000","last_change":"2023-12-08T08:22:02.073329+0000","last_active":"2023-12-08T08:22:02.075696+0000","last_peered":"2023-12-08T08:22:02.075696+0000","last_clean":"2023-12-08T08:22:02.075696+0000","last_became_active":"2023-12-08T08:22:02.073052+0000","last_became_peered":"2023-12-08T08:22:02.073052+0000","last_unstale":"2023-12-08T08:22:02.075696+0000","last_undegraded":"2023-12-08T08:22:02.075696+0000","last_fullsized":"2023-12-08T08:22:02.075696+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:50.699270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051547+0000","last_change":"2023-12-08T08:22:02.051547+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051547+0000","last_undegraded":"2023-12-08T08:22:02.051547+0000","last_fullsized":"2023-12-08T08:22:02.051547+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076913+0000","last_change":"2023-12-08T08:22:02.074584+0000","last_active":"2023-12-08T08:22:02.076913+0000","last_peered":"2023-12-08T08:22:02.076913+0000","last_clean":"2023-12-08T08:22:02.076913+0000","last_became_active":"2023-12-08T08:22:02.072443+0000","last_became_peered":"2023-12-08T08:22:02.072443+0000","last_unstale":"2023-12-08T08:22:02.076913+0000","last_undegraded":"2023-12-08T08:22:02.076913+0000","last_fullsized":"2023-12-08T08:22:02.076913+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:22:40.527797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044204+0000","last_change":"2023-12-08T08:22:02.044204+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044204+0000","last_undegraded":"2023-12-08T08:22:02.044204+0000","last_fullsized":"2023-12-08T08:22:02.044204+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.074334+0000","last_change":"2023-12-08T08:22:02.071820+0000","last_active":"2023-12-08T08:22:02.074334+0000","last_peered":"2023-12-08T08:22:02.074334+0000","last_clean":"2023-12-08T08:22:02.074334+0000","last_became_active":"2023-12-08T08:22:02.071513+0000","last_became_peered":"2023-12-08T08:22:02.071513+0000","last_unstale":"2023-12-08T08:22:02.074334+0000","last_undegraded":"2023-12-08T08:22:02.074334+0000","last_fullsized":"2023-12-08T08:22:02.074334+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:13.555049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.053300+0000","last_change":"2023-12-08T08:22:02.053300+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.053300+0000","last_undegraded":"2023-12-08T08:22:02.053300+0000","last_fullsized":"2023-12-08T08:22:02.053300+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.070065+0000","last_change":"2023-12-08T08:22:02.064284+0000","last_active":"2023-12-08T08:22:02.070065+0000","last_peered":"2023-12-08T08:22:02.070065+0000","last_clean":"2023-12-08T08:22:02.070065+0000","last_became_active":"2023-12-08T08:22:02.063986+0000","last_became_peered":"2023-12-08T08:22:02.063986+0000","last_unstale":"2023-12-08T08:22:02.070065+0000","last_undegraded":"2023-12-08T08:22:02.070065+0000","last_fullsized":"2023-12-08T08:22:02.070065+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:45:39.958857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.054130+0000","last_change":"2023-12-08T08:22:02.054130+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.054130+0000","last_undegraded":"2023-12-08T08:22:02.054130+0000","last_fullsized":"2023-12-08T08:22:02.054130+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076414+0000","last_change":"2023-12-08T08:22:02.073150+0000","last_active":"2023-12-08T08:22:02.076414+0000","last_peered":"2023-12-08T08:22:02.076414+0000","last_clean":"2023-12-08T08:22:02.076414+0000","last_became_active":"2023-12-08T08:22:02.071562+0000","last_became_peered":"2023-12-08T08:22:02.071562+0000","last_unstale":"2023-12-08T08:22:02.076414+0000","last_undegraded":"2023-12-08T08:22:02.076414+0000","last_fullsized":"2023-12-08T08:22:02.076414+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:26:10.210451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051948+0000","last_change":"2023-12-08T08:22:02.051948+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051948+0000","last_undegraded":"2023-12-08T08:22:02.051948+0000","last_fullsized":"2023-12-08T08:22:02.051948+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.072108+0000","last_change":"2023-12-08T08:22:02.067718+0000","last_active":"2023-12-08T08:22:02.072108+0000","last_peered":"2023-12-08T08:22:02.072108+0000","last_clean":"2023-12-08T08:22:02.072108+0000","last_became_active":"2023-12-08T08:22:02.067452+0000","last_became_peered":"2023-12-08T08:22:02.067452+0000","last_unstale":"2023-12-08T08:22:02.072108+0000","last_undegraded":"2023-12-08T08:22:02.072108+0000","last_fullsized":"2023-12-08T08:22:02.072108+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:30:31.631850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045450+0000","last_change":"2023-12-08T08:22:02.045450+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045450+0000","last_undegraded":"2023-12-08T08:22:02.045450+0000","last_fullsized":"2023-12-08T08:22:02.045450+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076644+0000","last_change":"2023-12-08T08:22:02.072008+0000","last_active":"2023-12-08T08:22:02.076644+0000","last_peered":"2023-12-08T08:22:02.076644+0000","last_clean":"2023-12-08T08:22:02.076644+0000","last_became_active":"2023-12-08T08:22:02.071711+0000","last_became_peered":"2023-12-08T08:22:02.071711+0000","last_unstale":"2023-12-08T08:22:02.076644+0000","last_undegraded":"2023-12-08T08:22:02.076644+0000","last_fullsized":"2023-12-08T08:22:02.076644+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:49:51.933425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049037+0000","last_change":"2023-12-08T08:22:02.049037+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049037+0000","last_undegraded":"2023-12-08T08:22:02.049037+0000","last_fullsized":"2023-12-08T08:22:02.049037+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.074299+0000","last_change":"2023-12-08T08:22:02.071841+0000","last_active":"2023-12-08T08:22:02.074299+0000","last_peered":"2023-12-08T08:22:02.074299+0000","last_clean":"2023-12-08T08:22:02.074299+0000","last_became_active":"2023-12-08T08:22:02.071531+0000","last_became_peered":"2023-12-08T08:22:02.071531+0000","last_unstale":"2023-12-08T08:22:02.074299+0000","last_undegraded":"2023-12-08T08:22:02.074299+0000","last_fullsized":"2023-12-08T08:22:02.074299+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:13:54.526670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.050946+0000","last_change":"2023-12-08T08:22:02.050946+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.050946+0000","last_undegraded":"2023-12-08T08:22:02.050946+0000","last_fullsized":"2023-12-08T08:22:02.050946+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076370+0000","last_change":"2023-12-08T08:22:02.072612+0000","last_active":"2023-12-08T08:22:02.076370+0000","last_peered":"2023-12-08T08:22:02.076370+0000","last_clean":"2023-12-08T08:22:02.076370+0000","last_became_active":"2023-12-08T08:22:02.071308+0000","last_became_peered":"2023-12-08T08:22:02.071308+0000","last_unstale":"2023-12-08T08:22:02.076370+0000","last_undegraded":"2023-12-08T08:22:02.076370+0000","last_fullsized":"2023-12-08T08:22:02.076370+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:30:30.201779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.055769+0000","last_change":"2023-12-08T08:22:02.055769+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.055769+0000","last_undegraded":"2023-12-08T08:22:02.055769+0000","last_fullsized":"2023-12-08T08:22:02.055769+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076584+0000","last_change":"2023-12-08T08:22:02.074304+0000","last_active":"2023-12-08T08:22:02.076584+0000","last_peered":"2023-12-08T08:22:02.076584+0000","last_clean":"2023-12-08T08:22:02.076584+0000","last_became_active":"2023-12-08T08:22:02.074007+0000","last_became_peered":"2023-12-08T08:22:02.074007+0000","last_unstale":"2023-12-08T08:22:02.076584+0000","last_undegraded":"2023-12-08T08:22:02.076584+0000","last_fullsized":"2023-12-08T08:22:02.076584+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:02.472465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045441+0000","last_change":"2023-12-08T08:22:02.045441+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045441+0000","last_undegraded":"2023-12-08T08:22:02.045441+0000","last_fullsized":"2023-12-08T08:22:02.045441+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076702+0000","last_change":"2023-12-08T08:22:02.073388+0000","last_active":"2023-12-08T08:22:02.076702+0000","last_peered":"2023-12-08T08:22:02.076702+0000","last_clean":"2023-12-08T08:22:02.076702+0000","last_became_active":"2023-12-08T08:22:02.073107+0000","last_became_peered":"2023-12-08T08:22:02.073107+0000","last_unstale":"2023-12-08T08:22:02.076702+0000","last_undegraded":"2023-12-08T08:22:02.076702+0000","last_fullsized":"2023-12-08T08:22:02.076702+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:50.699270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049911+0000","last_change":"2023-12-08T08:22:02.049911+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049911+0000","last_undegraded":"2023-12-08T08:22:02.049911+0000","last_fullsized":"2023-12-08T08:22:02.049911+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.071665+0000","last_change":"2023-12-08T08:22:02.067383+0000","last_active":"2023-12-08T08:22:02.071665+0000","last_peered":"2023-12-08T08:22:02.071665+0000","last_clean":"2023-12-08T08:22:02.071665+0000","last_became_active":"2023-12-08T08:22:02.067094+0000","last_became_peered":"2023-12-08T08:22:02.067094+0000","last_unstale":"2023-12-08T08:22:02.071665+0000","last_undegraded":"2023-12-08T08:22:02.071665+0000","last_fullsized":"2023-12-08T08:22:02.071665+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:14.917716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.053600+0000","last_change":"2023-12-08T08:22:02.053600+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.053600+0000","last_undegraded":"2023-12-08T08:22:02.053600+0000","last_fullsized":"2023-12-08T08:22:02.053600+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.063728+0000","last_change":"2023-12-08T08:22:02.055138+0000","last_active":"2023-12-08T08:22:02.063728+0000","last_peered":"2023-12-08T08:22:02.063728+0000","last_clean":"2023-12-08T08:22:02.063728+0000","last_became_active":"2023-12-08T08:22:02.054797+0000","last_became_peered":"2023-12-08T08:22:02.054797+0000","last_unstale":"2023-12-08T08:22:02.063728+0000","last_undegraded":"2023-12-08T08:22:02.063728+0000","last_fullsized":"2023-12-08T08:22:02.063728+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:02:40.986075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051277+0000","last_change":"2023-12-08T08:22:02.051277+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051277+0000","last_undegraded":"2023-12-08T08:22:02.051277+0000","last_fullsized":"2023-12-08T08:22:02.051277+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.075435+0000","last_change":"2023-12-08T08:22:02.072456+0000","last_active":"2023-12-08T08:22:02.075435+0000","last_peered":"2023-12-08T08:22:02.075435+0000","last_clean":"2023-12-08T08:22:02.075435+0000","last_became_active":"2023-12-08T08:22:02.072146+0000","last_became_peered":"2023-12-08T08:22:02.072146+0000","last_unstale":"2023-12-08T08:22:02.075435+0000","last_undegraded":"2023-12-08T08:22:02.075435+0000","last_fullsized":"2023-12-08T08:22:02.075435+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.752165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.046507+0000","last_change":"2023-12-08T08:22:02.046507+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.046507+0000","last_undegraded":"2023-12-08T08:22:02.046507+0000","last_fullsized":"2023-12-08T08:22:02.046507+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.069555+0000","last_change":"2023-12-08T08:22:02.065223+0000","last_active":"2023-12-08T08:22:02.069555+0000","last_peered":"2023-12-08T08:22:02.069555+0000","last_clean":"2023-12-08T08:22:02.069555+0000","last_became_active":"2023-12-08T08:22:02.064829+0000","last_became_peered":"2023-12-08T08:22:02.064829+0000","last_unstale":"2023-12-08T08:22:02.069555+0000","last_undegraded":"2023-12-08T08:22:02.069555+0000","last_fullsized":"2023-12-08T08:22:02.069555+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:45:39.958857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.059365+0000","last_change":"2023-12-08T08:22:02.059365+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.059365+0000","last_undegraded":"2023-12-08T08:22:02.059365+0000","last_fullsized":"2023-12-08T08:22:02.059365+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.064936+0000","last_change":"2023-12-08T08:22:02.057964+0000","last_active":"2023-12-08T08:22:02.064936+0000","last_peered":"2023-12-08T08:22:02.064936+0000","last_clean":"2023-12-08T08:22:02.064936+0000","last_became_active":"2023-12-08T08:22:02.057677+0000","last_became_peered":"2023-12-08T08:22:02.057677+0000","last_unstale":"2023-12-08T08:22:02.064936+0000","last_undegraded":"2023-12-08T08:22:02.064936+0000","last_fullsized":"2023-12-08T08:22:02.064936+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:46:01.889435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.055314+0000","last_change":"2023-12-08T08:22:02.055314+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.055314+0000","last_undegraded":"2023-12-08T08:22:02.055314+0000","last_fullsized":"2023-12-08T08:22:02.055314+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.068215+0000","last_change":"2023-12-08T08:22:02.061620+0000","last_active":"2023-12-08T08:22:02.068215+0000","last_peered":"2023-12-08T08:22:02.068215+0000","last_clean":"2023-12-08T08:22:02.068215+0000","last_became_active":"2023-12-08T08:22:02.061329+0000","last_became_peered":"2023-12-08T08:22:02.061329+0000","last_unstale":"2023-12-08T08:22:02.068215+0000","last_undegraded":"2023-12-08T08:22:02.068215+0000","last_fullsized":"2023-12-08T08:22:02.068215+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:08:57.419992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.043612+0000","last_change":"2023-12-08T08:22:02.043612+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.043612+0000","last_undegraded":"2023-12-08T08:22:02.043612+0000","last_fullsized":"2023-12-08T08:22:02.043612+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.065571+0000","last_change":"2023-12-08T08:22:02.059762+0000","last_active":"2023-12-08T08:22:02.065571+0000","last_peered":"2023-12-08T08:22:02.065571+0000","last_clean":"2023-12-08T08:22:02.065571+0000","last_became_active":"2023-12-08T08:22:02.059447+0000","last_became_peered":"2023-12-08T08:22:02.059447+0000","last_unstale":"2023-12-08T08:22:02.065571+0000","last_undegraded":"2023-12-08T08:22:02.065571+0000","last_fullsized":"2023-12-08T08:22:02.065571+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.752165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.050041+0000","last_change":"2023-12-08T08:22:02.050041+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.050041+0000","last_undegraded":"2023-12-08T08:22:02.050041+0000","last_fullsized":"2023-12-08T08:22:02.050041+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.072430+0000","last_change":"2023-12-08T08:22:02.069094+0000","last_active":"2023-12-08T08:22:02.072430+0000","last_peered":"2023-12-08T08:22:02.072430+0000","last_clean":"2023-12-08T08:22:02.072430+0000","last_became_active":"2023-12-08T08:22:02.068768+0000","last_became_peered":"2023-12-08T08:22:02.068768+0000","last_unstale":"2023-12-08T08:22:02.072430+0000","last_undegraded":"2023-12-08T08:22:02.072430+0000","last_fullsized":"2023-12-08T08:22:02.072430+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:13:54.526670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044367+0000","last_change":"2023-12-08T08:22:02.044367+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044367+0000","last_undegraded":"2023-12-08T08:22:02.044367+0000","last_fullsized":"2023-12-08T08:22:02.044367+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.069442+0000","last_change":"2023-12-08T08:22:02.064371+0000","last_active":"2023-12-08T08:22:02.069442+0000","last_peered":"2023-12-08T08:22:02.069442+0000","last_clean":"2023-12-08T08:22:02.069442+0000","last_became_active":"2023-12-08T08:22:02.063996+0000","last_became_peered":"2023-12-08T08:22:02.063996+0000","last_unstale":"2023-12-08T08:22:02.069442+0000","last_undegraded":"2023-12-08T08:22:02.069442+0000","last_fullsized":"2023-12-08T08:22:02.069442+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:47:39.746644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049394+0000","last_change":"2023-12-08T08:22:02.049394+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049394+0000","last_undegraded":"2023-12-08T08:22:02.049394+0000","last_fullsized":"2023-12-08T08:22:02.049394+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.066637+0000","last_change":"2023-12-08T08:22:02.063148+0000","last_active":"2023-12-08T08:22:02.066637+0000","last_peered":"2023-12-08T08:22:02.066637+0000","last_clean":"2023-12-08T08:22:02.066637+0000","last_became_active":"2023-12-08T08:22:02.062860+0000","last_became_peered":"2023-12-08T08:22:02.062860+0000","last_unstale":"2023-12-08T08:22:02.066637+0000","last_undegraded":"2023-12-08T08:22:02.066637+0000","last_fullsized":"2023-12-08T08:22:02.066637+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:49:51.933425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.043780+0000","last_change":"2023-12-08T08:22:02.043780+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.043780+0000","last_undegraded":"2023-12-08T08:22:02.043780+0000","last_fullsized":"2023-12-08T08:22:02.043780+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.059779+0000","last_change":"2023-12-08T08:22:02.055697+0000","last_active":"2023-12-08T08:22:02.059779+0000","last_peered":"2023-12-08T08:22:02.059779+0000","last_clean":"2023-12-08T08:22:02.059779+0000","last_became_active":"2023-12-08T08:22:02.055412+0000","last_became_peered":"2023-12-08T08:22:02.055412+0000","last_unstale":"2023-12-08T08:22:02.059779+0000","last_undegraded":"2023-12-08T08:22:02.059779+0000","last_fullsized":"2023-12-08T08:22:02.059779+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:30:31.631850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044376+0000","last_change":"2023-12-08T08:22:02.044376+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044376+0000","last_undegraded":"2023-12-08T08:22:02.044376+0000","last_fullsized":"2023-12-08T08:22:02.044376+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.067526+0000","last_change":"2023-12-08T08:22:02.065076+0000","last_active":"2023-12-08T08:22:02.067526+0000","last_peered":"2023-12-08T08:22:02.067526+0000","last_clean":"2023-12-08T08:22:02.067526+0000","last_became_active":"2023-12-08T08:22:02.064723+0000","last_became_peered":"2023-12-08T08:22:02.064723+0000","last_unstale":"2023-12-08T08:22:02.067526+0000","last_undegraded":"2023-12-08T08:22:02.067526+0000","last_fullsized":"2023-12-08T08:22:02.067526+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:03:17.577934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045170+0000","last_change":"2023-12-08T08:22:02.045170+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045170+0000","last_undegraded":"2023-12-08T08:22:02.045170+0000","last_fullsized":"2023-12-08T08:22:02.045170+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.069302+0000","last_change":"2023-12-08T08:22:02.066497+0000","last_active":"2023-12-08T08:22:02.069302+0000","last_peered":"2023-12-08T08:22:02.069302+0000","last_clean":"2023-12-08T08:22:02.069302+0000","last_became_active":"2023-12-08T08:22:02.065532+0000","last_became_peered":"2023-12-08T08:22:02.065532+0000","last_unstale":"2023-12-08T08:22:02.069302+0000","last_undegraded":"2023-12-08T08:22:02.069302+0000","last_fullsized":"2023-12-08T08:22:02.069302+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:47:39.746644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":186,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-08T08:22:01.039220+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:22:01.039220+0000","last_peered":"2023-12-08T08:22:01.039220+0000","last_clean":"2023-12-08T08:22:01.039220+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:22:01.039220+0000","last_undegraded":"2023-12-08T08:22:01.039220+0000","last_fullsized":"2023-12-08T08:22:01.039220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":626688,"data_stored":823117,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.84599999999999997}]},{"osd":1,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.79900000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.61699999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.82699999999999996}]},{"osd":4,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.67500000000000004}]},{"osd":6,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.71599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":573440,"data_stored":239016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.84799999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.81200000000000006}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.71999999999999997}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.746}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.46500000000000002}]},{"osd":5,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.627},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.60099999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.55400000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":573440,"data_stored":239016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.38700000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.45900000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.438},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.624}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.67200000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.503}]},{"osd":6,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.52600000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.69499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":573440,"data_stored":239016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.79300000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.67900000000000005}]},{"osd":2,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.623}]},{"osd":3,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.74299999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.53000000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.82199999999999995}]},{"osd":7,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.72499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":573440,"data_stored":239016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.249},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.37}]},{"osd":1,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.39200000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.34399999999999997}]},{"osd":4,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.80200000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.83299999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.876},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.77300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":573440,"data_stored":239016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.0270000000000001,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.34399999999999997}]},{"osd":1,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.44500000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.48199999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.78000000000000003}]},{"osd":5,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":3.637,"5min":3.637,"15min":3.637},"last":0.71499999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.90600000000000003}]},{"osd":7,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.94099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":573440,"data_stored":239016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2210000000000001,"5min":5.2210000000000001,"15min":5.2210000000000001},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":8.3200000000000003,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.38700000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":8.2070000000000007,"5min":8.2070000000000007,"15min":8.2070000000000007},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":4.351,"5min":4.351,"15min":4.351},"last":0.34899999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":8.1479999999999997,"5min":8.1479999999999997,"15min":8.1479999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.3150000000000004,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.45900000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":4.8470000000000004,"5min":4.8470000000000004,"15min":4.8470000000000004},"last":0.503},{"interface":"front","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":4.7939999999999996,"5min":4.7939999999999996,"15min":4.7939999999999996},"last":0.47699999999999998}]},{"osd":5,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":4.7240000000000002,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":4.5830000000000002,"5min":4.5830000000000002,"15min":4.5830000000000002},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":4.7699999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":4.6289999999999996,"5min":4.6289999999999996,"15min":4.6289999999999996},"last":0.64900000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":4.665,"5min":4.665,"15min":4.665},"last":0.61599999999999999},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":4.8140000000000001,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.63400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27636,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":626688,"data_stored":823117,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":8.2799999999999994,"5min":8.2799999999999994,"15min":8.2799999999999994},"last":0.39700000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":7.9290000000000003,"5min":7.9290000000000003,"15min":7.9290000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":8.0890000000000004,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.33000000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":4.6550000000000002,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":7.8890000000000002,"5min":7.8890000000000002,"15min":7.8890000000000002},"last":0.47399999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":7.9649999999999999,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.876},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.751}]},{"osd":5,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":8.0579999999999998,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.68400000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":7.835,"5min":7.835,"15min":7.835},"last":0.89300000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":8.0239999999999991,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.78300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:22:07.134 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:22:07.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.299+0000 7f90b26d6640 1 Processor -- start 2023-12-08T08:22:07.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.299+0000 7f90b26d6640 1 -- start start 2023-12-08T08:22:07.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90b26d6640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f90ac14e3f0 0x7f90ac0bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:07.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90b26d6640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f90ac06c5b0 0x7f90ac06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:07.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90b26d6640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90ac151690 con 0x7f90ac06bef0 2023-12-08T08:22:07.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90b26d6640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90ac151bc0 con 0x7f90ac06c5b0 2023-12-08T08:22:07.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90b26d6640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac1518e0 con 0x7f90ac14e3f0 2023-12-08T08:22:07.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90ab7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f90ac06bef0 0x7f90ac0c41f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39056/0 (socket says 172.21.15.88:39056) 2023-12-08T08:22:07.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90ab7fe640 1 -- 172.21.15.88:0/3237017700 learned_addr learned my addr 172.21.15.88:0/3237017700 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:07.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90abfff640 1 --2- 172.21.15.88:0/3237017700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f90ac14e3f0 0x7f90ac0bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:07.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90b0c73640 1 --2- 172.21.15.88:0/3237017700 >> v2:172.21.15.148:3300/0 conn(0x7f90ac06c5b0 0x7f90ac06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:07.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90aaffd640 1 -- 172.21.15.88:0/3237017700 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 356524826 0 0) 0x7f90ac151690 con 0x7f90ac06bef0 2023-12-08T08:22:07.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90aaffd640 1 -- 172.21.15.88:0/3237017700 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9094003530 con 0x7f90ac06bef0 2023-12-08T08:22:07.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90aaffd640 1 -- 172.21.15.88:0/3237017700 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 802570556 0 0) 0x7f9094003530 con 0x7f90ac06bef0 2023-12-08T08:22:07.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90aaffd640 1 -- 172.21.15.88:0/3237017700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f90ac14e3f0 msgr2=0x7f90ac0bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:07.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90aaffd640 1 --2- 172.21.15.88:0/3237017700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f90ac14e3f0 0x7f90ac0bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:07.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90aaffd640 1 -- 172.21.15.88:0/3237017700 >> v2:172.21.15.148:3300/0 conn(0x7f90ac06c5b0 msgr2=0x7f90ac06ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:07.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90aaffd640 1 --2- 172.21.15.88:0/3237017700 >> v2:172.21.15.148:3300/0 conn(0x7f90ac06c5b0 0x7f90ac06ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:07.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90aaffd640 1 -- 172.21.15.88:0/3237017700 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ac0c1de0 con 0x7f90ac06bef0 2023-12-08T08:22:07.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90aaffd640 1 -- 172.21.15.88:0/3237017700 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f90a0001680 con 0x7f90ac06bef0 2023-12-08T08:22:07.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90aaffd640 1 -- 172.21.15.88:0/3237017700 >> v1:172.21.15.88:6789/0 conn(0x7f90ac06bef0 legacy=0x7f90ac0c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:07.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90aaffd640 1 --2- 172.21.15.88:0/3237017700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f90ac14e3f0 0x7f9094003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:07.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90aaffd640 1 --2- 172.21.15.88:0/3237017700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9094003f00 0x7f90940047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:07.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90aaffd640 1 --2- 172.21.15.88:0/3237017700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9094004d10 0x7f9094005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:07.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90aaffd640 1 -- 172.21.15.88:0/3237017700 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac151bc0 con 0x7f9094004d10 2023-12-08T08:22:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90aaffd640 1 -- 172.21.15.88:0/3237017700 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac1518e0 con 0x7f9094003f00 2023-12-08T08:22:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90aaffd640 1 -- 172.21.15.88:0/3237017700 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909400b9e0 con 0x7f90ac14e3f0 2023-12-08T08:22:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90abfff640 1 --2- 172.21.15.88:0/3237017700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f90ac14e3f0 0x7f9094003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90ab7fe640 1 --2- 172.21.15.88:0/3237017700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9094003f00 0x7f90940047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90b0c73640 1 --2- 172.21.15.88:0/3237017700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9094004d10 0x7f9094005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90b0c73640 1 -- 172.21.15.88:0/3237017700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f90ac14e3f0 msgr2=0x7f9094003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90b0c73640 1 --2- 172.21.15.88:0/3237017700 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f90ac14e3f0 0x7f9094003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:07.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90b0c73640 1 -- 172.21.15.88:0/3237017700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9094003f00 msgr2=0x7f90940047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:07.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90b0c73640 1 --2- 172.21.15.88:0/3237017700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9094003f00 0x7f90940047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:07.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.303+0000 7f90b0c73640 1 -- 172.21.15.88:0/3237017700 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9094003530 con 0x7f9094004d10 2023-12-08T08:22:07.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.307+0000 7f90b0c73640 1 --2- 172.21.15.88:0/3237017700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9094004d10 0x7f9094005190 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f90a400e170 tx=0x7f90a401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f8123935091abf server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:07.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.307+0000 7f90aaffd640 1 -- 172.21.15.88:0/3237017700 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a40a5c90 con 0x7f9094004d10 2023-12-08T08:22:07.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.307+0000 7f90aaffd640 1 -- 172.21.15.88:0/3237017700 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a400f040 con 0x7f9094004d10 2023-12-08T08:22:07.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.307+0000 7f90aaffd640 1 -- 172.21.15.88:0/3237017700 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a40ad440 con 0x7f9094004d10 2023-12-08T08:22:07.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.307+0000 7f90b26d6640 1 -- 172.21.15.88:0/3237017700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9094004d10 msgr2=0x7f9094005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:07.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.307+0000 7f90b26d6640 1 --2- 172.21.15.88:0/3237017700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9094004d10 0x7f9094005190 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f90a400e170 tx=0x7f90a401cc80 comp rx=0 tx=0).stop 2023-12-08T08:22:07.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.307+0000 7f90b0c73640 1 -- 172.21.15.88:0/3237017700 reap_dead start 2023-12-08T08:22:07.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.307+0000 7f90b26d6640 1 -- 172.21.15.88:0/3237017700 shutdown_connections 2023-12-08T08:22:07.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.307+0000 7f90b26d6640 1 -- 172.21.15.88:0/3237017700 >> 172.21.15.88:0/3237017700 conn(0x7f90ac0a7810 msgr2=0x7f90ac0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:07.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.307+0000 7f90b26d6640 1 -- 172.21.15.88:0/3237017700 shutdown_connections 2023-12-08T08:22:07.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.307+0000 7f90b26d6640 1 -- 172.21.15.88:0/3237017700 wait complete. 2023-12-08T08:22:07.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.311+0000 7f90b26d6640 1 Processor -- start 2023-12-08T08:22:07.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.311+0000 7f90b26d6640 1 -- start start 2023-12-08T08:22:07.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.311+0000 7f90b26d6640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9094004d10 0x7f90ac14c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:07.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.311+0000 7f90b26d6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90ac0c2c00 0x7f90ac070b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:07.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.311+0000 7f90b26d6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90ac14f6a0 0x7f90ac071090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:07.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.311+0000 7f90b26d6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac071e00 con 0x7f90ac0c2c00 2023-12-08T08:22:07.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.311+0000 7f90b26d6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac0723c0 con 0x7f90ac14f6a0 2023-12-08T08:22:07.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.311+0000 7f90b26d6640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac0c1580 con 0x7f9094004d10 2023-12-08T08:22:07.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.311+0000 7f90ab7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90ac0c2c00 0x7f90ac070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:07.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.311+0000 7f90ab7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90ac0c2c00 0x7f90ac070b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53770/0 (socket says 172.21.15.88:53770) 2023-12-08T08:22:07.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.311+0000 7f90ab7fe640 1 -- 172.21.15.88:0/2550824297 learned_addr learned my addr 172.21.15.88:0/2550824297 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:07.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.311+0000 7f90abfff640 1 --2- 172.21.15.88:0/2550824297 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9094004d10 0x7f90ac14c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:07.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.311+0000 7f90b0c73640 1 --2- 172.21.15.88:0/2550824297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90ac14f6a0 0x7f90ac071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:07.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.311+0000 7f90ab7fe640 1 -- 172.21.15.88:0/2550824297 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9094004d10 msgr2=0x7f90ac14c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:07.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.311+0000 7f90ab7fe640 1 --2- 172.21.15.88:0/2550824297 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9094004d10 0x7f90ac14c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:07.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.311+0000 7f90ab7fe640 1 -- 172.21.15.88:0/2550824297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90ac14f6a0 msgr2=0x7f90ac071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:07.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.311+0000 7f90ab7fe640 1 --2- 172.21.15.88:0/2550824297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90ac14f6a0 0x7f90ac071090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:07.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.311+0000 7f90ab7fe640 1 -- 172.21.15.88:0/2550824297 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ac072050 con 0x7f90ac0c2c00 2023-12-08T08:22:07.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.311+0000 7f90ab7fe640 1 --2- 172.21.15.88:0/2550824297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90ac0c2c00 0x7f90ac070b50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f90a00124f0 tx=0x7f90a00128f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:07.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.311+0000 7f90a8ff9640 1 -- 172.21.15.88:0/2550824297 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a0014810 con 0x7f90ac0c2c00 2023-12-08T08:22:07.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.311+0000 7f90a8ff9640 1 -- 172.21.15.88:0/2550824297 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a0014970 con 0x7f90ac0c2c00 2023-12-08T08:22:07.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.311+0000 7f90b26d6640 1 -- 172.21.15.88:0/2550824297 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ac14c960 con 0x7f90ac0c2c00 2023-12-08T08:22:07.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.311+0000 7f90a8ff9640 1 -- 172.21.15.88:0/2550824297 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a0014d20 con 0x7f90ac0c2c00 2023-12-08T08:22:07.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.311+0000 7f90b26d6640 1 -- 172.21.15.88:0/2550824297 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90ac14b4c0 con 0x7f90ac0c2c00 2023-12-08T08:22:07.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.311+0000 7f90b26d6640 1 -- 172.21.15.88:0/2550824297 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90ac067630 con 0x7f90ac0c2c00 2023-12-08T08:22:07.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.315+0000 7f90a8ff9640 1 -- 172.21.15.88:0/2550824297 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f90a00153e0 con 0x7f90ac0c2c00 2023-12-08T08:22:07.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.315+0000 7f90a8ff9640 1 --2- 172.21.15.88:0/2550824297 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9098066470 0x7f9098068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:07.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.315+0000 7f90a8ff9640 1 -- 172.21.15.88:0/2550824297 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90a0086b10 con 0x7f90ac0c2c00 2023-12-08T08:22:07.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.315+0000 7f90abfff640 1 --2- 172.21.15.88:0/2550824297 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9098066470 0x7f9098068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:07.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.315+0000 7f90abfff640 1 --2- 172.21.15.88:0/2550824297 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9098066470 0x7f9098068930 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f909c009be0 tx=0x7f909c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:07.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.319+0000 7f90a8ff9640 1 -- 172.21.15.88:0/2550824297 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f90a0054030 con 0x7f90ac0c2c00 2023-12-08T08:22:07.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.463+0000 7f90b26d6640 1 -- 172.21.15.88:0/2550824297 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f90ac14e7d0 con 0x7f9098066470 2023-12-08T08:22:07.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.471+0000 7f90a8ff9640 1 -- 172.21.15.88:0/2550824297 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283477 (secure 0 0 0) 0x7f909c019070 con 0x7f9098066470 2023-12-08T08:22:07.480 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:07.481 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:22:07.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.475+0000 7f90b26d6640 1 -- 172.21.15.88:0/2550824297 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9098066470 msgr2=0x7f9098068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:07.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.475+0000 7f90b26d6640 1 --2- 172.21.15.88:0/2550824297 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9098066470 0x7f9098068930 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f909c009be0 tx=0x7f909c009190 comp rx=0 tx=0).stop 2023-12-08T08:22:07.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.475+0000 7f90b26d6640 1 -- 172.21.15.88:0/2550824297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90ac0c2c00 msgr2=0x7f90ac070b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:07.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.475+0000 7f90b26d6640 1 --2- 172.21.15.88:0/2550824297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90ac0c2c00 0x7f90ac070b50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f90a00124f0 tx=0x7f90a00128f0 comp rx=0 tx=0).stop 2023-12-08T08:22:07.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.475+0000 7f90b26d6640 1 -- 172.21.15.88:0/2550824297 shutdown_connections 2023-12-08T08:22:07.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.475+0000 7f90b26d6640 1 --2- 172.21.15.88:0/2550824297 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9098066470 0x7f9098068930 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:07.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.475+0000 7f90b26d6640 1 --2- 172.21.15.88:0/2550824297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90ac14f6a0 0x7f90ac071090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:07.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.475+0000 7f90b26d6640 1 --2- 172.21.15.88:0/2550824297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90ac0c2c00 0x7f90ac070b50 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:07.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.475+0000 7f90b26d6640 1 --2- 172.21.15.88:0/2550824297 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9094004d10 0x7f90ac14c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:07.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.475+0000 7f90b26d6640 1 -- 172.21.15.88:0/2550824297 >> 172.21.15.88:0/2550824297 conn(0x7f90ac0a7810 msgr2=0x7f90ac0c24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:07.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.475+0000 7f90b26d6640 1 -- 172.21.15.88:0/2550824297 shutdown_connections 2023-12-08T08:22:07.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.475+0000 7f90b26d6640 1 -- 172.21.15.88:0/2550824297 wait complete. 2023-12-08T08:22:07.500 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2023-12-08T08:22:06.769127+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220784,"kb_used_data":4584,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753936,"statfs":{"total":773094113280,"available":772868030464,"internally_reserved":0,"allocated":4694016,"data_stored":3080330,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.733893"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.059484+0000","last_change":"2023-12-08T08:22:02.059484+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.059484+0000","last_undegraded":"2023-12-08T08:22:02.059484+0000","last_fullsized":"2023-12-08T08:22:02.059484+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.055012+0000","last_change":"2023-12-08T08:22:02.055012+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.055012+0000","last_undegraded":"2023-12-08T08:22:02.055012+0000","last_fullsized":"2023-12-08T08:22:02.055012+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.053803+0000","last_change":"2023-12-08T08:22:02.053803+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.053803+0000","last_undegraded":"2023-12-08T08:22:02.053803+0000","last_fullsized":"2023-12-08T08:22:02.053803+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.060413+0000","last_change":"2023-12-08T08:22:02.060413+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.060413+0000","last_undegraded":"2023-12-08T08:22:02.060413+0000","last_fullsized":"2023-12-08T08:22:02.060413+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.065877+0000","last_change":"2023-12-08T08:22:02.065877+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.065877+0000","last_undegraded":"2023-12-08T08:22:02.065877+0000","last_fullsized":"2023-12-08T08:22:02.065877+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.048960+0000","last_change":"2023-12-08T08:22:02.048960+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.048960+0000","last_undegraded":"2023-12-08T08:22:02.048960+0000","last_fullsized":"2023-12-08T08:22:02.048960+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.046276+0000","last_change":"2023-12-08T08:22:02.046276+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.046276+0000","last_undegraded":"2023-12-08T08:22:02.046276+0000","last_fullsized":"2023-12-08T08:22:02.046276+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051226+0000","last_change":"2023-12-08T08:22:02.051226+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051226+0000","last_undegraded":"2023-12-08T08:22:02.051226+0000","last_fullsized":"2023-12-08T08:22:02.051226+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045291+0000","last_change":"2023-12-08T08:22:02.045291+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045291+0000","last_undegraded":"2023-12-08T08:22:02.045291+0000","last_fullsized":"2023-12-08T08:22:02.045291+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044805+0000","last_change":"2023-12-08T08:22:02.044805+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044805+0000","last_undegraded":"2023-12-08T08:22:02.044805+0000","last_fullsized":"2023-12-08T08:22:02.044805+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044852+0000","last_change":"2023-12-08T08:22:02.044852+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044852+0000","last_undegraded":"2023-12-08T08:22:02.044852+0000","last_fullsized":"2023-12-08T08:22:02.044852+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.059919+0000","last_change":"2023-12-08T08:22:02.059919+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.059919+0000","last_undegraded":"2023-12-08T08:22:02.059919+0000","last_fullsized":"2023-12-08T08:22:02.059919+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049732+0000","last_change":"2023-12-08T08:22:02.049732+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049732+0000","last_undegraded":"2023-12-08T08:22:02.049732+0000","last_fullsized":"2023-12-08T08:22:02.049732+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045770+0000","last_change":"2023-12-08T08:22:02.045770+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045770+0000","last_undegraded":"2023-12-08T08:22:02.045770+0000","last_fullsized":"2023-12-08T08:22:02.045770+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045164+0000","last_change":"2023-12-08T08:22:02.045164+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045164+0000","last_undegraded":"2023-12-08T08:22:02.045164+0000","last_fullsized":"2023-12-08T08:22:02.045164+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.046662+0000","last_change":"2023-12-08T08:22:02.046662+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.046662+0000","last_undegraded":"2023-12-08T08:22:02.046662+0000","last_fullsized":"2023-12-08T08:22:02.046662+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049678+0000","last_change":"2023-12-08T08:22:02.049678+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049678+0000","last_undegraded":"2023-12-08T08:22:02.049678+0000","last_fullsized":"2023-12-08T08:22:02.049678+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051550+0000","last_change":"2023-12-08T08:22:02.051550+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051550+0000","last_undegraded":"2023-12-08T08:22:02.051550+0000","last_fullsized":"2023-12-08T08:22:02.051550+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.064039+0000","last_change":"2023-12-08T08:22:02.064039+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.064039+0000","last_undegraded":"2023-12-08T08:22:02.064039+0000","last_fullsized":"2023-12-08T08:22:02.064039+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045927+0000","last_change":"2023-12-08T08:22:02.045927+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045927+0000","last_undegraded":"2023-12-08T08:22:02.045927+0000","last_fullsized":"2023-12-08T08:22:02.045927+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.052487+0000","last_change":"2023-12-08T08:22:02.052487+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.052487+0000","last_undegraded":"2023-12-08T08:22:02.052487+0000","last_fullsized":"2023-12-08T08:22:02.052487+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.046251+0000","last_change":"2023-12-08T08:22:02.046251+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.046251+0000","last_undegraded":"2023-12-08T08:22:02.046251+0000","last_fullsized":"2023-12-08T08:22:02.046251+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051264+0000","last_change":"2023-12-08T08:22:02.051264+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051264+0000","last_undegraded":"2023-12-08T08:22:02.051264+0000","last_fullsized":"2023-12-08T08:22:02.051264+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.050511+0000","last_change":"2023-12-08T08:22:02.050511+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.050511+0000","last_undegraded":"2023-12-08T08:22:02.050511+0000","last_fullsized":"2023-12-08T08:22:02.050511+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.058924+0000","last_change":"2023-12-08T08:22:02.058924+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.058924+0000","last_undegraded":"2023-12-08T08:22:02.058924+0000","last_fullsized":"2023-12-08T08:22:02.058924+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.060181+0000","last_change":"2023-12-08T08:22:02.060181+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.060181+0000","last_undegraded":"2023-12-08T08:22:02.060181+0000","last_fullsized":"2023-12-08T08:22:02.060181+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.050768+0000","last_change":"2023-12-08T08:22:02.050768+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.050768+0000","last_undegraded":"2023-12-08T08:22:02.050768+0000","last_fullsized":"2023-12-08T08:22:02.050768+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.063344+0000","last_change":"2023-12-08T08:22:02.063344+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.063344+0000","last_undegraded":"2023-12-08T08:22:02.063344+0000","last_fullsized":"2023-12-08T08:22:02.063344+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044610+0000","last_change":"2023-12-08T08:22:02.044610+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044610+0000","last_undegraded":"2023-12-08T08:22:02.044610+0000","last_fullsized":"2023-12-08T08:22:02.044610+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049106+0000","last_change":"2023-12-08T08:22:02.049106+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049106+0000","last_undegraded":"2023-12-08T08:22:02.049106+0000","last_fullsized":"2023-12-08T08:22:02.049106+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.064493+0000","last_change":"2023-12-08T08:22:02.064493+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.064493+0000","last_undegraded":"2023-12-08T08:22:02.064493+0000","last_fullsized":"2023-12-08T08:22:02.064493+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.046147+0000","last_change":"2023-12-08T08:22:02.046147+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.046147+0000","last_undegraded":"2023-12-08T08:22:02.046147+0000","last_fullsized":"2023-12-08T08:22:02.046147+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051096+0000","last_change":"2023-12-08T08:22:02.051096+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051096+0000","last_undegraded":"2023-12-08T08:22:02.051096+0000","last_fullsized":"2023-12-08T08:22:02.051096+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.071534+0000","last_change":"2023-12-08T08:22:02.066070+0000","last_active":"2023-12-08T08:22:02.071534+0000","last_peered":"2023-12-08T08:22:02.071534+0000","last_clean":"2023-12-08T08:22:02.071534+0000","last_became_active":"2023-12-08T08:22:02.065684+0000","last_became_peered":"2023-12-08T08:22:02.065684+0000","last_unstale":"2023-12-08T08:22:02.071534+0000","last_undegraded":"2023-12-08T08:22:02.071534+0000","last_fullsized":"2023-12-08T08:22:02.071534+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:01:23.302095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.043952+0000","last_change":"2023-12-08T08:22:02.043952+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.043952+0000","last_undegraded":"2023-12-08T08:22:02.043952+0000","last_fullsized":"2023-12-08T08:22:02.043952+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.074479+0000","last_change":"2023-12-08T08:22:02.068162+0000","last_active":"2023-12-08T08:22:02.074479+0000","last_peered":"2023-12-08T08:22:02.074479+0000","last_clean":"2023-12-08T08:22:02.074479+0000","last_became_active":"2023-12-08T08:22:02.067918+0000","last_became_peered":"2023-12-08T08:22:02.067918+0000","last_unstale":"2023-12-08T08:22:02.074479+0000","last_undegraded":"2023-12-08T08:22:02.074479+0000","last_fullsized":"2023-12-08T08:22:02.074479+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:09:21.024470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.054028+0000","last_change":"2023-12-08T08:22:02.054028+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.054028+0000","last_undegraded":"2023-12-08T08:22:02.054028+0000","last_fullsized":"2023-12-08T08:22:02.054028+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.068247+0000","last_change":"2023-12-08T08:22:02.061868+0000","last_active":"2023-12-08T08:22:02.068247+0000","last_peered":"2023-12-08T08:22:02.068247+0000","last_clean":"2023-12-08T08:22:02.068247+0000","last_became_active":"2023-12-08T08:22:02.061570+0000","last_became_peered":"2023-12-08T08:22:02.061570+0000","last_unstale":"2023-12-08T08:22:02.068247+0000","last_undegraded":"2023-12-08T08:22:02.068247+0000","last_fullsized":"2023-12-08T08:22:02.068247+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:55:21.616638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.050433+0000","last_change":"2023-12-08T08:22:02.050433+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.050433+0000","last_undegraded":"2023-12-08T08:22:02.050433+0000","last_fullsized":"2023-12-08T08:22:02.050433+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076694+0000","last_change":"2023-12-08T08:22:02.073413+0000","last_active":"2023-12-08T08:22:02.076694+0000","last_peered":"2023-12-08T08:22:02.076694+0000","last_clean":"2023-12-08T08:22:02.076694+0000","last_became_active":"2023-12-08T08:22:02.073043+0000","last_became_peered":"2023-12-08T08:22:02.073043+0000","last_unstale":"2023-12-08T08:22:02.076694+0000","last_undegraded":"2023-12-08T08:22:02.076694+0000","last_fullsized":"2023-12-08T08:22:02.076694+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:13.555049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045725+0000","last_change":"2023-12-08T08:22:02.045725+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045725+0000","last_undegraded":"2023-12-08T08:22:02.045725+0000","last_fullsized":"2023-12-08T08:22:02.045725+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.075910+0000","last_change":"2023-12-08T08:22:02.074443+0000","last_active":"2023-12-08T08:22:02.075910+0000","last_peered":"2023-12-08T08:22:02.075910+0000","last_clean":"2023-12-08T08:22:02.075910+0000","last_became_active":"2023-12-08T08:22:02.074076+0000","last_became_peered":"2023-12-08T08:22:02.074076+0000","last_unstale":"2023-12-08T08:22:02.075910+0000","last_undegraded":"2023-12-08T08:22:02.075910+0000","last_fullsized":"2023-12-08T08:22:02.075910+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:17:41.637207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.047229+0000","last_change":"2023-12-08T08:22:02.047229+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.047229+0000","last_undegraded":"2023-12-08T08:22:02.047229+0000","last_fullsized":"2023-12-08T08:22:02.047229+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.068126+0000","last_change":"2023-12-08T08:22:02.061389+0000","last_active":"2023-12-08T08:22:02.068126+0000","last_peered":"2023-12-08T08:22:02.068126+0000","last_clean":"2023-12-08T08:22:02.068126+0000","last_became_active":"2023-12-08T08:22:02.060880+0000","last_became_peered":"2023-12-08T08:22:02.060880+0000","last_unstale":"2023-12-08T08:22:02.068126+0000","last_undegraded":"2023-12-08T08:22:02.068126+0000","last_fullsized":"2023-12-08T08:22:02.068126+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:48.380978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049585+0000","last_change":"2023-12-08T08:22:02.049585+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049585+0000","last_undegraded":"2023-12-08T08:22:02.049585+0000","last_fullsized":"2023-12-08T08:22:02.049585+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.069309+0000","last_change":"2023-12-08T08:22:02.063925+0000","last_active":"2023-12-08T08:22:02.069309+0000","last_peered":"2023-12-08T08:22:02.069309+0000","last_clean":"2023-12-08T08:22:02.069309+0000","last_became_active":"2023-12-08T08:22:02.063585+0000","last_became_peered":"2023-12-08T08:22:02.063585+0000","last_unstale":"2023-12-08T08:22:02.069309+0000","last_undegraded":"2023-12-08T08:22:02.069309+0000","last_fullsized":"2023-12-08T08:22:02.069309+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:24.830501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044970+0000","last_change":"2023-12-08T08:22:02.044970+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044970+0000","last_undegraded":"2023-12-08T08:22:02.044970+0000","last_fullsized":"2023-12-08T08:22:02.044970+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.072407+0000","last_change":"2023-12-08T08:22:02.066732+0000","last_active":"2023-12-08T08:22:02.072407+0000","last_peered":"2023-12-08T08:22:02.072407+0000","last_clean":"2023-12-08T08:22:02.072407+0000","last_became_active":"2023-12-08T08:22:02.066414+0000","last_became_peered":"2023-12-08T08:22:02.066414+0000","last_unstale":"2023-12-08T08:22:02.072407+0000","last_undegraded":"2023-12-08T08:22:02.072407+0000","last_fullsized":"2023-12-08T08:22:02.072407+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:24.830501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045265+0000","last_change":"2023-12-08T08:22:02.045265+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045265+0000","last_undegraded":"2023-12-08T08:22:02.045265+0000","last_fullsized":"2023-12-08T08:22:02.045265+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.075696+0000","last_change":"2023-12-08T08:22:02.073329+0000","last_active":"2023-12-08T08:22:02.075696+0000","last_peered":"2023-12-08T08:22:02.075696+0000","last_clean":"2023-12-08T08:22:02.075696+0000","last_became_active":"2023-12-08T08:22:02.073052+0000","last_became_peered":"2023-12-08T08:22:02.073052+0000","last_unstale":"2023-12-08T08:22:02.075696+0000","last_undegraded":"2023-12-08T08:22:02.075696+0000","last_fullsized":"2023-12-08T08:22:02.075696+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:50.699270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051547+0000","last_change":"2023-12-08T08:22:02.051547+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051547+0000","last_undegraded":"2023-12-08T08:22:02.051547+0000","last_fullsized":"2023-12-08T08:22:02.051547+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076913+0000","last_change":"2023-12-08T08:22:02.074584+0000","last_active":"2023-12-08T08:22:02.076913+0000","last_peered":"2023-12-08T08:22:02.076913+0000","last_clean":"2023-12-08T08:22:02.076913+0000","last_became_active":"2023-12-08T08:22:02.072443+0000","last_became_peered":"2023-12-08T08:22:02.072443+0000","last_unstale":"2023-12-08T08:22:02.076913+0000","last_undegraded":"2023-12-08T08:22:02.076913+0000","last_fullsized":"2023-12-08T08:22:02.076913+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:22:40.527797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044204+0000","last_change":"2023-12-08T08:22:02.044204+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044204+0000","last_undegraded":"2023-12-08T08:22:02.044204+0000","last_fullsized":"2023-12-08T08:22:02.044204+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.074334+0000","last_change":"2023-12-08T08:22:02.071820+0000","last_active":"2023-12-08T08:22:02.074334+0000","last_peered":"2023-12-08T08:22:02.074334+0000","last_clean":"2023-12-08T08:22:02.074334+0000","last_became_active":"2023-12-08T08:22:02.071513+0000","last_became_peered":"2023-12-08T08:22:02.071513+0000","last_unstale":"2023-12-08T08:22:02.074334+0000","last_undegraded":"2023-12-08T08:22:02.074334+0000","last_fullsized":"2023-12-08T08:22:02.074334+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:13.555049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.053300+0000","last_change":"2023-12-08T08:22:02.053300+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.053300+0000","last_undegraded":"2023-12-08T08:22:02.053300+0000","last_fullsized":"2023-12-08T08:22:02.053300+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.070065+0000","last_change":"2023-12-08T08:22:02.064284+0000","last_active":"2023-12-08T08:22:02.070065+0000","last_peered":"2023-12-08T08:22:02.070065+0000","last_clean":"2023-12-08T08:22:02.070065+0000","last_became_active":"2023-12-08T08:22:02.063986+0000","last_became_peered":"2023-12-08T08:22:02.063986+0000","last_unstale":"2023-12-08T08:22:02.070065+0000","last_undegraded":"2023-12-08T08:22:02.070065+0000","last_fullsized":"2023-12-08T08:22:02.070065+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:45:39.958857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.054130+0000","last_change":"2023-12-08T08:22:02.054130+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.054130+0000","last_undegraded":"2023-12-08T08:22:02.054130+0000","last_fullsized":"2023-12-08T08:22:02.054130+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076414+0000","last_change":"2023-12-08T08:22:02.073150+0000","last_active":"2023-12-08T08:22:02.076414+0000","last_peered":"2023-12-08T08:22:02.076414+0000","last_clean":"2023-12-08T08:22:02.076414+0000","last_became_active":"2023-12-08T08:22:02.071562+0000","last_became_peered":"2023-12-08T08:22:02.071562+0000","last_unstale":"2023-12-08T08:22:02.076414+0000","last_undegraded":"2023-12-08T08:22:02.076414+0000","last_fullsized":"2023-12-08T08:22:02.076414+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:26:10.210451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051948+0000","last_change":"2023-12-08T08:22:02.051948+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051948+0000","last_undegraded":"2023-12-08T08:22:02.051948+0000","last_fullsized":"2023-12-08T08:22:02.051948+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.072108+0000","last_change":"2023-12-08T08:22:02.067718+0000","last_active":"2023-12-08T08:22:02.072108+0000","last_peered":"2023-12-08T08:22:02.072108+0000","last_clean":"2023-12-08T08:22:02.072108+0000","last_became_active":"2023-12-08T08:22:02.067452+0000","last_became_peered":"2023-12-08T08:22:02.067452+0000","last_unstale":"2023-12-08T08:22:02.072108+0000","last_undegraded":"2023-12-08T08:22:02.072108+0000","last_fullsized":"2023-12-08T08:22:02.072108+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:30:31.631850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045450+0000","last_change":"2023-12-08T08:22:02.045450+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045450+0000","last_undegraded":"2023-12-08T08:22:02.045450+0000","last_fullsized":"2023-12-08T08:22:02.045450+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076644+0000","last_change":"2023-12-08T08:22:02.072008+0000","last_active":"2023-12-08T08:22:02.076644+0000","last_peered":"2023-12-08T08:22:02.076644+0000","last_clean":"2023-12-08T08:22:02.076644+0000","last_became_active":"2023-12-08T08:22:02.071711+0000","last_became_peered":"2023-12-08T08:22:02.071711+0000","last_unstale":"2023-12-08T08:22:02.076644+0000","last_undegraded":"2023-12-08T08:22:02.076644+0000","last_fullsized":"2023-12-08T08:22:02.076644+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:49:51.933425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049037+0000","last_change":"2023-12-08T08:22:02.049037+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049037+0000","last_undegraded":"2023-12-08T08:22:02.049037+0000","last_fullsized":"2023-12-08T08:22:02.049037+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.074299+0000","last_change":"2023-12-08T08:22:02.071841+0000","last_active":"2023-12-08T08:22:02.074299+0000","last_peered":"2023-12-08T08:22:02.074299+0000","last_clean":"2023-12-08T08:22:02.074299+0000","last_became_active":"2023-12-08T08:22:02.071531+0000","last_became_peered":"2023-12-08T08:22:02.071531+0000","last_unstale":"2023-12-08T08:22:02.074299+0000","last_undegraded":"2023-12-08T08:22:02.074299+0000","last_fullsized":"2023-12-08T08:22:02.074299+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:13:54.526670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.050946+0000","last_change":"2023-12-08T08:22:02.050946+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.050946+0000","last_undegraded":"2023-12-08T08:22:02.050946+0000","last_fullsized":"2023-12-08T08:22:02.050946+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076370+0000","last_change":"2023-12-08T08:22:02.072612+0000","last_active":"2023-12-08T08:22:02.076370+0000","last_peered":"2023-12-08T08:22:02.076370+0000","last_clean":"2023-12-08T08:22:02.076370+0000","last_became_active":"2023-12-08T08:22:02.071308+0000","last_became_peered":"2023-12-08T08:22:02.071308+0000","last_unstale":"2023-12-08T08:22:02.076370+0000","last_undegraded":"2023-12-08T08:22:02.076370+0000","last_fullsized":"2023-12-08T08:22:02.076370+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:30:30.201779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.055769+0000","last_change":"2023-12-08T08:22:02.055769+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.055769+0000","last_undegraded":"2023-12-08T08:22:02.055769+0000","last_fullsized":"2023-12-08T08:22:02.055769+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076584+0000","last_change":"2023-12-08T08:22:02.074304+0000","last_active":"2023-12-08T08:22:02.076584+0000","last_peered":"2023-12-08T08:22:02.076584+0000","last_clean":"2023-12-08T08:22:02.076584+0000","last_became_active":"2023-12-08T08:22:02.074007+0000","last_became_peered":"2023-12-08T08:22:02.074007+0000","last_unstale":"2023-12-08T08:22:02.076584+0000","last_undegraded":"2023-12-08T08:22:02.076584+0000","last_fullsized":"2023-12-08T08:22:02.076584+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:02.472465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045441+0000","last_change":"2023-12-08T08:22:02.045441+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045441+0000","last_undegraded":"2023-12-08T08:22:02.045441+0000","last_fullsized":"2023-12-08T08:22:02.045441+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076702+0000","last_change":"2023-12-08T08:22:02.073388+0000","last_active":"2023-12-08T08:22:02.076702+0000","last_peered":"2023-12-08T08:22:02.076702+0000","last_clean":"2023-12-08T08:22:02.076702+0000","last_became_active":"2023-12-08T08:22:02.073107+0000","last_became_peered":"2023-12-08T08:22:02.073107+0000","last_unstale":"2023-12-08T08:22:02.076702+0000","last_undegraded":"2023-12-08T08:22:02.076702+0000","last_fullsized":"2023-12-08T08:22:02.076702+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:50.699270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049911+0000","last_change":"2023-12-08T08:22:02.049911+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049911+0000","last_undegraded":"2023-12-08T08:22:02.049911+0000","last_fullsized":"2023-12-08T08:22:02.049911+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.071665+0000","last_change":"2023-12-08T08:22:02.067383+0000","last_active":"2023-12-08T08:22:02.071665+0000","last_peered":"2023-12-08T08:22:02.071665+0000","last_clean":"2023-12-08T08:22:02.071665+0000","last_became_active":"2023-12-08T08:22:02.067094+0000","last_became_peered":"2023-12-08T08:22:02.067094+0000","last_unstale":"2023-12-08T08:22:02.071665+0000","last_undegraded":"2023-12-08T08:22:02.071665+0000","last_fullsized":"2023-12-08T08:22:02.071665+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:14.917716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.053600+0000","last_change":"2023-12-08T08:22:02.053600+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.053600+0000","last_undegraded":"2023-12-08T08:22:02.053600+0000","last_fullsized":"2023-12-08T08:22:02.053600+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.063728+0000","last_change":"2023-12-08T08:22:02.055138+0000","last_active":"2023-12-08T08:22:02.063728+0000","last_peered":"2023-12-08T08:22:02.063728+0000","last_clean":"2023-12-08T08:22:02.063728+0000","last_became_active":"2023-12-08T08:22:02.054797+0000","last_became_peered":"2023-12-08T08:22:02.054797+0000","last_unstale":"2023-12-08T08:22:02.063728+0000","last_undegraded":"2023-12-08T08:22:02.063728+0000","last_fullsized":"2023-12-08T08:22:02.063728+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:02:40.986075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051277+0000","last_change":"2023-12-08T08:22:02.051277+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051277+0000","last_undegraded":"2023-12-08T08:22:02.051277+0000","last_fullsized":"2023-12-08T08:22:02.051277+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.075435+0000","last_change":"2023-12-08T08:22:02.072456+0000","last_active":"2023-12-08T08:22:02.075435+0000","last_peered":"2023-12-08T08:22:02.075435+0000","last_clean":"2023-12-08T08:22:02.075435+0000","last_became_active":"2023-12-08T08:22:02.072146+0000","last_became_peered":"2023-12-08T08:22:02.072146+0000","last_unstale":"2023-12-08T08:22:02.075435+0000","last_undegraded":"2023-12-08T08:22:02.075435+0000","last_fullsized":"2023-12-08T08:22:02.075435+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.752165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.046507+0000","last_change":"2023-12-08T08:22:02.046507+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.046507+0000","last_undegraded":"2023-12-08T08:22:02.046507+0000","last_fullsized":"2023-12-08T08:22:02.046507+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.069555+0000","last_change":"2023-12-08T08:22:02.065223+0000","last_active":"2023-12-08T08:22:02.069555+0000","last_peered":"2023-12-08T08:22:02.069555+0000","last_clean":"2023-12-08T08:22:02.069555+0000","last_became_active":"2023-12-08T08:22:02.064829+0000","last_became_peered":"2023-12-08T08:22:02.064829+0000","last_unstale":"2023-12-08T08:22:02.069555+0000","last_undegraded":"2023-12-08T08:22:02.069555+0000","last_fullsized":"2023-12-08T08:22:02.069555+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:45:39.958857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.059365+0000","last_change":"2023-12-08T08:22:02.059365+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.059365+0000","last_undegraded":"2023-12-08T08:22:02.059365+0000","last_fullsized":"2023-12-08T08:22:02.059365+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.064936+0000","last_change":"2023-12-08T08:22:02.057964+0000","last_active":"2023-12-08T08:22:02.064936+0000","last_peered":"2023-12-08T08:22:02.064936+0000","last_clean":"2023-12-08T08:22:02.064936+0000","last_became_active":"2023-12-08T08:22:02.057677+0000","last_became_peered":"2023-12-08T08:22:02.057677+0000","last_unstale":"2023-12-08T08:22:02.064936+0000","last_undegraded":"2023-12-08T08:22:02.064936+0000","last_fullsized":"2023-12-08T08:22:02.064936+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:46:01.889435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.055314+0000","last_change":"2023-12-08T08:22:02.055314+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.055314+0000","last_undegraded":"2023-12-08T08:22:02.055314+0000","last_fullsized":"2023-12-08T08:22:02.055314+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.068215+0000","last_change":"2023-12-08T08:22:02.061620+0000","last_active":"2023-12-08T08:22:02.068215+0000","last_peered":"2023-12-08T08:22:02.068215+0000","last_clean":"2023-12-08T08:22:02.068215+0000","last_became_active":"2023-12-08T08:22:02.061329+0000","last_became_peered":"2023-12-08T08:22:02.061329+0000","last_unstale":"2023-12-08T08:22:02.068215+0000","last_undegraded":"2023-12-08T08:22:02.068215+0000","last_fullsized":"2023-12-08T08:22:02.068215+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:08:57.419992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.043612+0000","last_change":"2023-12-08T08:22:02.043612+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.043612+0000","last_undegraded":"2023-12-08T08:22:02.043612+0000","last_fullsized":"2023-12-08T08:22:02.043612+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.065571+0000","last_change":"2023-12-08T08:22:02.059762+0000","last_active":"2023-12-08T08:22:02.065571+0000","last_peered":"2023-12-08T08:22:02.065571+0000","last_clean":"2023-12-08T08:22:02.065571+0000","last_became_active":"2023-12-08T08:22:02.059447+0000","last_became_peered":"2023-12-08T08:22:02.059447+0000","last_unstale":"2023-12-08T08:22:02.065571+0000","last_undegraded":"2023-12-08T08:22:02.065571+0000","last_fullsized":"2023-12-08T08:22:02.065571+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.752165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.050041+0000","last_change":"2023-12-08T08:22:02.050041+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.050041+0000","last_undegraded":"2023-12-08T08:22:02.050041+0000","last_fullsized":"2023-12-08T08:22:02.050041+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.072430+0000","last_change":"2023-12-08T08:22:02.069094+0000","last_active":"2023-12-08T08:22:02.072430+0000","last_peered":"2023-12-08T08:22:02.072430+0000","last_clean":"2023-12-08T08:22:02.072430+0000","last_became_active":"2023-12-08T08:22:02.068768+0000","last_became_peered":"2023-12-08T08:22:02.068768+0000","last_unstale":"2023-12-08T08:22:02.072430+0000","last_undegraded":"2023-12-08T08:22:02.072430+0000","last_fullsized":"2023-12-08T08:22:02.072430+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:13:54.526670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044367+0000","last_change":"2023-12-08T08:22:02.044367+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044367+0000","last_undegraded":"2023-12-08T08:22:02.044367+0000","last_fullsized":"2023-12-08T08:22:02.044367+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.069442+0000","last_change":"2023-12-08T08:22:02.064371+0000","last_active":"2023-12-08T08:22:02.069442+0000","last_peered":"2023-12-08T08:22:02.069442+0000","last_clean":"2023-12-08T08:22:02.069442+0000","last_became_active":"2023-12-08T08:22:02.063996+0000","last_became_peered":"2023-12-08T08:22:02.063996+0000","last_unstale":"2023-12-08T08:22:02.069442+0000","last_undegraded":"2023-12-08T08:22:02.069442+0000","last_fullsized":"2023-12-08T08:22:02.069442+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:47:39.746644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049394+0000","last_change":"2023-12-08T08:22:02.049394+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049394+0000","last_undegraded":"2023-12-08T08:22:02.049394+0000","last_fullsized":"2023-12-08T08:22:02.049394+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.066637+0000","last_change":"2023-12-08T08:22:02.063148+0000","last_active":"2023-12-08T08:22:02.066637+0000","last_peered":"2023-12-08T08:22:02.066637+0000","last_clean":"2023-12-08T08:22:02.066637+0000","last_became_active":"2023-12-08T08:22:02.062860+0000","last_became_peered":"2023-12-08T08:22:02.062860+0000","last_unstale":"2023-12-08T08:22:02.066637+0000","last_undegraded":"2023-12-08T08:22:02.066637+0000","last_fullsized":"2023-12-08T08:22:02.066637+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:49:51.933425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.043780+0000","last_change":"2023-12-08T08:22:02.043780+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.043780+0000","last_undegraded":"2023-12-08T08:22:02.043780+0000","last_fullsized":"2023-12-08T08:22:02.043780+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.059779+0000","last_change":"2023-12-08T08:22:02.055697+0000","last_active":"2023-12-08T08:22:02.059779+0000","last_peered":"2023-12-08T08:22:02.059779+0000","last_clean":"2023-12-08T08:22:02.059779+0000","last_became_active":"2023-12-08T08:22:02.055412+0000","last_became_peered":"2023-12-08T08:22:02.055412+0000","last_unstale":"2023-12-08T08:22:02.059779+0000","last_undegraded":"2023-12-08T08:22:02.059779+0000","last_fullsized":"2023-12-08T08:22:02.059779+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:30:31.631850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044376+0000","last_change":"2023-12-08T08:22:02.044376+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044376+0000","last_undegraded":"2023-12-08T08:22:02.044376+0000","last_fullsized":"2023-12-08T08:22:02.044376+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.067526+0000","last_change":"2023-12-08T08:22:02.065076+0000","last_active":"2023-12-08T08:22:02.067526+0000","last_peered":"2023-12-08T08:22:02.067526+0000","last_clean":"2023-12-08T08:22:02.067526+0000","last_became_active":"2023-12-08T08:22:02.064723+0000","last_became_peered":"2023-12-08T08:22:02.064723+0000","last_unstale":"2023-12-08T08:22:02.067526+0000","last_undegraded":"2023-12-08T08:22:02.067526+0000","last_fullsized":"2023-12-08T08:22:02.067526+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:03:17.577934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045170+0000","last_change":"2023-12-08T08:22:02.045170+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045170+0000","last_undegraded":"2023-12-08T08:22:02.045170+0000","last_fullsized":"2023-12-08T08:22:02.045170+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.069302+0000","last_change":"2023-12-08T08:22:02.066497+0000","last_active":"2023-12-08T08:22:02.069302+0000","last_peered":"2023-12-08T08:22:02.069302+0000","last_clean":"2023-12-08T08:22:02.069302+0000","last_became_active":"2023-12-08T08:22:02.065532+0000","last_became_peered":"2023-12-08T08:22:02.065532+0000","last_unstale":"2023-12-08T08:22:02.069302+0000","last_undegraded":"2023-12-08T08:22:02.069302+0000","last_fullsized":"2023-12-08T08:22:02.069302+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:47:39.746644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":186,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-08T08:22:01.039220+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:22:01.039220+0000","last_peered":"2023-12-08T08:22:01.039220+0000","last_clean":"2023-12-08T08:22:01.039220+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:22:01.039220+0000","last_undegraded":"2023-12-08T08:22:01.039220+0000","last_fullsized":"2023-12-08T08:22:01.039220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":626688,"data_stored":823117,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.84599999999999997}]},{"osd":1,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.79900000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.61699999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.82699999999999996}]},{"osd":4,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.67500000000000004}]},{"osd":6,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.71599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":573440,"data_stored":239016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.84799999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.81200000000000006}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.71999999999999997}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.746}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.46500000000000002}]},{"osd":5,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.627},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.60099999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.55400000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":573440,"data_stored":239016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.38700000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.45900000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.438},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.624}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.67200000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.503}]},{"osd":6,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.52600000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.69499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":573440,"data_stored":239016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.79300000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.67900000000000005}]},{"osd":2,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.623}]},{"osd":3,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.74299999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.53000000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.82199999999999995}]},{"osd":7,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.72499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":573440,"data_stored":239016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.249},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.37}]},{"osd":1,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.39200000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.34399999999999997}]},{"osd":4,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.80200000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.83299999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.876},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.77300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":573440,"data_stored":239016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.0270000000000001,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.34399999999999997}]},{"osd":1,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.44500000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.48199999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.78000000000000003}]},{"osd":5,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":3.637,"5min":3.637,"15min":3.637},"last":0.71499999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.90600000000000003}]},{"osd":7,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.94099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":573440,"data_stored":239016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2210000000000001,"5min":5.2210000000000001,"15min":5.2210000000000001},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":8.3200000000000003,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.38700000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":8.2070000000000007,"5min":8.2070000000000007,"15min":8.2070000000000007},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":4.351,"5min":4.351,"15min":4.351},"last":0.34899999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":8.1479999999999997,"5min":8.1479999999999997,"15min":8.1479999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.3150000000000004,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.45900000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":4.8470000000000004,"5min":4.8470000000000004,"15min":4.8470000000000004},"last":0.503},{"interface":"front","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":4.7939999999999996,"5min":4.7939999999999996,"15min":4.7939999999999996},"last":0.47699999999999998}]},{"osd":5,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":4.7240000000000002,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":4.5830000000000002,"5min":4.5830000000000002,"15min":4.5830000000000002},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":4.7699999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":4.6289999999999996,"5min":4.6289999999999996,"15min":4.6289999999999996},"last":0.64900000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":4.665,"5min":4.665,"15min":4.665},"last":0.61599999999999999},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":4.8140000000000001,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.63400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27636,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":626688,"data_stored":823117,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":8.2799999999999994,"5min":8.2799999999999994,"15min":8.2799999999999994},"last":0.39700000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":7.9290000000000003,"5min":7.9290000000000003,"15min":7.9290000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":8.0890000000000004,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.33000000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":4.6550000000000002,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":7.8890000000000002,"5min":7.8890000000000002,"15min":7.8890000000000002},"last":0.47399999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":7.9649999999999999,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.876},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.751}]},{"osd":5,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":8.0579999999999998,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.68400000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":7.835,"5min":7.835,"15min":7.835},"last":0.89300000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":8.0239999999999991,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.78300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:22:07.504 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:22:07.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.671+0000 7f068a32a640 1 Processor -- start 2023-12-08T08:22:07.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.671+0000 7f068a32a640 1 -- start start 2023-12-08T08:22:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.675+0000 7f068a32a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f068406d890 0x7f0684154610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.675+0000 7f068a32a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0684154b50 0x7f068415ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.675+0000 7f068a32a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0684158a40 con 0x7f0684151bf0 2023-12-08T08:22:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.675+0000 7f068a32a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06841584c0 con 0x7f068406d890 2023-12-08T08:22:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.675+0000 7f068a32a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0684158760 con 0x7f0684154b50 2023-12-08T08:22:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.675+0000 7f06837fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f068406d890 0x7f0684154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.675+0000 7f0683fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0684151bf0 0x7f068406b5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39060/0 (socket says 172.21.15.88:39060) 2023-12-08T08:22:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.675+0000 7f06837fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f068406d890 0x7f0684154610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53778/0 (socket says 172.21.15.88:53778) 2023-12-08T08:22:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.675+0000 7f0683fff640 1 -- 172.21.15.88:0/2330524951 learned_addr learned my addr 172.21.15.88:0/2330524951 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:07.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.675+0000 7f06888c7640 1 --2- 172.21.15.88:0/2330524951 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0684154b50 0x7f068415ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:07.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.675+0000 7f06837fe640 1 -- 172.21.15.88:0/2330524951 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0684154b50 msgr2=0x7f068415ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:07.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.675+0000 7f06837fe640 1 --2- 172.21.15.88:0/2330524951 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0684154b50 0x7f068415ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:07.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.675+0000 7f06837fe640 1 -- 172.21.15.88:0/2330524951 >> v1:172.21.15.88:6789/0 conn(0x7f0684151bf0 legacy=0x7f068406b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:07.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.675+0000 7f06837fe640 1 -- 172.21.15.88:0/2330524951 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06840c0ce0 con 0x7f068406d890 2023-12-08T08:22:07.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.675+0000 7f0682ffd640 1 -- 172.21.15.88:0/2330524951 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1257100406 0 0) 0x7f0684158a40 con 0x7f0684151bf0 2023-12-08T08:22:07.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.679+0000 7f06837fe640 1 --2- 172.21.15.88:0/2330524951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f068406d890 0x7f0684154610 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f06780097c0 tx=0x7f067801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb9a09ccadb30b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:07.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.679+0000 7f0682ffd640 1 -- 172.21.15.88:0/2330524951 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06780ad660 con 0x7f068406d890 2023-12-08T08:22:07.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.679+0000 7f0682ffd640 1 -- 172.21.15.88:0/2330524951 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06780ad7c0 con 0x7f068406d890 2023-12-08T08:22:07.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.679+0000 7f0682ffd640 1 -- 172.21.15.88:0/2330524951 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06780adb50 con 0x7f068406d890 2023-12-08T08:22:07.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.679+0000 7f068a32a640 1 -- 172.21.15.88:0/2330524951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f068406d890 msgr2=0x7f0684154610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:07.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.679+0000 7f068a32a640 1 --2- 172.21.15.88:0/2330524951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f068406d890 0x7f0684154610 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f06780097c0 tx=0x7f067801c450 comp rx=0 tx=0).stop 2023-12-08T08:22:07.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.679+0000 7f068a32a640 1 -- 172.21.15.88:0/2330524951 shutdown_connections 2023-12-08T08:22:07.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.679+0000 7f068a32a640 1 --2- 172.21.15.88:0/2330524951 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0684154b50 0x7f068415ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:07.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.679+0000 7f068a32a640 1 --2- 172.21.15.88:0/2330524951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f068406d890 0x7f0684154610 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:07.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.679+0000 7f068a32a640 1 -- 172.21.15.88:0/2330524951 >> 172.21.15.88:0/2330524951 conn(0x7f06840c61f0 msgr2=0x7f06840c6600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:07.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.679+0000 7f068a32a640 1 -- 172.21.15.88:0/2330524951 shutdown_connections 2023-12-08T08:22:07.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.679+0000 7f068a32a640 1 -- 172.21.15.88:0/2330524951 wait complete. 2023-12-08T08:22:07.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.679+0000 7f068a32a640 1 Processor -- start 2023-12-08T08:22:07.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.679+0000 7f068a32a640 1 -- start start 2023-12-08T08:22:07.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.683+0000 7f068a32a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f068406d890 0x7f06841558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:07.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.683+0000 7f068a32a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0684151bf0 0x7f0684147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:07.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.683+0000 7f068a32a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0684154b50 0x7f06841f00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:07.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.683+0000 7f068a32a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06841530b0 con 0x7f0684154b50 2023-12-08T08:22:07.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.683+0000 7f068a32a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06841539c0 con 0x7f0684151bf0 2023-12-08T08:22:07.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.683+0000 7f068a32a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0684153ca0 con 0x7f068406d890 2023-12-08T08:22:07.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.683+0000 7f06888c7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0684154b50 0x7f06841f00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:07.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.683+0000 7f06888c7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0684154b50 0x7f06841f00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53782/0 (socket says 172.21.15.88:53782) 2023-12-08T08:22:07.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.683+0000 7f06888c7640 1 -- 172.21.15.88:0/369926570 learned_addr learned my addr 172.21.15.88:0/369926570 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:07.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.683+0000 7f0683fff640 1 --2- 172.21.15.88:0/369926570 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f068406d890 0x7f06841558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:07.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.683+0000 7f06837fe640 1 --2- 172.21.15.88:0/369926570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0684151bf0 0x7f0684147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:07.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.683+0000 7f06888c7640 1 -- 172.21.15.88:0/369926570 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f068406d890 msgr2=0x7f06841558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:07.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.683+0000 7f06888c7640 1 --2- 172.21.15.88:0/369926570 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f068406d890 0x7f06841558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:07.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.683+0000 7f06888c7640 1 -- 172.21.15.88:0/369926570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0684151bf0 msgr2=0x7f0684147c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:07.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.683+0000 7f06888c7640 1 --2- 172.21.15.88:0/369926570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0684151bf0 0x7f0684147c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:07.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.683+0000 7f06888c7640 1 -- 172.21.15.88:0/369926570 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0678009420 con 0x7f0684154b50 2023-12-08T08:22:07.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.683+0000 7f0683fff640 1 --2- 172.21.15.88:0/369926570 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f068406d890 0x7f06841558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:07.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.683+0000 7f06837fe640 1 --2- 172.21.15.88:0/369926570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0684151bf0 0x7f0684147c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:07.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.683+0000 7f06888c7640 1 --2- 172.21.15.88:0/369926570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0684154b50 0x7f06841f00e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f067c00cd70 tx=0x7f067c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:07.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.683+0000 7f0680ff9640 1 -- 172.21.15.88:0/369926570 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067c003ba0 con 0x7f0684154b50 2023-12-08T08:22:07.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.683+0000 7f0680ff9640 1 -- 172.21.15.88:0/369926570 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067c003d00 con 0x7f0684154b50 2023-12-08T08:22:07.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.683+0000 7f0680ff9640 1 -- 172.21.15.88:0/369926570 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067c004240 con 0x7f0684154b50 2023-12-08T08:22:07.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.683+0000 7f068a32a640 1 -- 172.21.15.88:0/369926570 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0684153f80 con 0x7f0684154b50 2023-12-08T08:22:07.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.683+0000 7f068a32a640 1 -- 172.21.15.88:0/369926570 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0684152cd0 con 0x7f0684154b50 2023-12-08T08:22:07.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.683+0000 7f068a32a640 1 -- 172.21.15.88:0/369926570 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0684067630 con 0x7f0684154b50 2023-12-08T08:22:07.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.683+0000 7f0680ff9640 1 -- 172.21.15.88:0/369926570 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f067c0043a0 con 0x7f0684154b50 2023-12-08T08:22:07.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.687+0000 7f0680ff9640 1 --2- 172.21.15.88:0/369926570 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0670066470 0x7f0670068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:07.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.687+0000 7f0680ff9640 1 -- 172.21.15.88:0/369926570 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f067c012070 con 0x7f0684154b50 2023-12-08T08:22:07.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.687+0000 7f0683fff640 1 --2- 172.21.15.88:0/369926570 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0670066470 0x7f0670068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:07.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.687+0000 7f0683fff640 1 --2- 172.21.15.88:0/369926570 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0670066470 0x7f0670068930 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0674007fd0 tx=0x7f0674007c20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:07.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.687+0000 7f0680ff9640 1 -- 172.21.15.88:0/369926570 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f067c051c60 con 0x7f0684154b50 2023-12-08T08:22:07.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.839+0000 7f068a32a640 1 -- 172.21.15.88:0/369926570 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f06840c6f50 con 0x7f0670066470 2023-12-08T08:22:07.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.843+0000 7f0680ff9640 1 -- 172.21.15.88:0/369926570 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283477 (secure 0 0 0) 0x7f0674005c90 con 0x7f0670066470 2023-12-08T08:22:07.852 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:07.853 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:22:07.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.847+0000 7f068a32a640 1 -- 172.21.15.88:0/369926570 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0670066470 msgr2=0x7f0670068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:07.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.847+0000 7f068a32a640 1 --2- 172.21.15.88:0/369926570 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0670066470 0x7f0670068930 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0674007fd0 tx=0x7f0674007c20 comp rx=0 tx=0).stop 2023-12-08T08:22:07.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.847+0000 7f068a32a640 1 -- 172.21.15.88:0/369926570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0684154b50 msgr2=0x7f06841f00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:07.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.847+0000 7f068a32a640 1 --2- 172.21.15.88:0/369926570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0684154b50 0x7f06841f00e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f067c00cd70 tx=0x7f067c00a660 comp rx=0 tx=0).stop 2023-12-08T08:22:07.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.847+0000 7f068a32a640 1 -- 172.21.15.88:0/369926570 shutdown_connections 2023-12-08T08:22:07.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.847+0000 7f068a32a640 1 --2- 172.21.15.88:0/369926570 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0670066470 0x7f0670068930 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:07.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.847+0000 7f068a32a640 1 --2- 172.21.15.88:0/369926570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0684154b50 0x7f06841f00e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:07.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.847+0000 7f068a32a640 1 --2- 172.21.15.88:0/369926570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0684151bf0 0x7f0684147c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:07.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.847+0000 7f068a32a640 1 --2- 172.21.15.88:0/369926570 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f068406d890 0x7f06841558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:07.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.847+0000 7f068a32a640 1 -- 172.21.15.88:0/369926570 >> 172.21.15.88:0/369926570 conn(0x7f06840c61f0 msgr2=0x7f06840a9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:07.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.847+0000 7f068a32a640 1 -- 172.21.15.88:0/369926570 shutdown_connections 2023-12-08T08:22:07.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:07.847+0000 7f068a32a640 1 -- 172.21.15.88:0/369926570 wait complete. 2023-12-08T08:22:07.873 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2023-12-08T08:22:06.769127+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220784,"kb_used_data":4584,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753936,"statfs":{"total":773094113280,"available":772868030464,"internally_reserved":0,"allocated":4694016,"data_stored":3080330,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.733893"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.059484+0000","last_change":"2023-12-08T08:22:02.059484+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.059484+0000","last_undegraded":"2023-12-08T08:22:02.059484+0000","last_fullsized":"2023-12-08T08:22:02.059484+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.055012+0000","last_change":"2023-12-08T08:22:02.055012+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.055012+0000","last_undegraded":"2023-12-08T08:22:02.055012+0000","last_fullsized":"2023-12-08T08:22:02.055012+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.053803+0000","last_change":"2023-12-08T08:22:02.053803+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.053803+0000","last_undegraded":"2023-12-08T08:22:02.053803+0000","last_fullsized":"2023-12-08T08:22:02.053803+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.060413+0000","last_change":"2023-12-08T08:22:02.060413+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.060413+0000","last_undegraded":"2023-12-08T08:22:02.060413+0000","last_fullsized":"2023-12-08T08:22:02.060413+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.065877+0000","last_change":"2023-12-08T08:22:02.065877+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.065877+0000","last_undegraded":"2023-12-08T08:22:02.065877+0000","last_fullsized":"2023-12-08T08:22:02.065877+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.048960+0000","last_change":"2023-12-08T08:22:02.048960+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.048960+0000","last_undegraded":"2023-12-08T08:22:02.048960+0000","last_fullsized":"2023-12-08T08:22:02.048960+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.046276+0000","last_change":"2023-12-08T08:22:02.046276+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.046276+0000","last_undegraded":"2023-12-08T08:22:02.046276+0000","last_fullsized":"2023-12-08T08:22:02.046276+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051226+0000","last_change":"2023-12-08T08:22:02.051226+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051226+0000","last_undegraded":"2023-12-08T08:22:02.051226+0000","last_fullsized":"2023-12-08T08:22:02.051226+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045291+0000","last_change":"2023-12-08T08:22:02.045291+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045291+0000","last_undegraded":"2023-12-08T08:22:02.045291+0000","last_fullsized":"2023-12-08T08:22:02.045291+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044805+0000","last_change":"2023-12-08T08:22:02.044805+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044805+0000","last_undegraded":"2023-12-08T08:22:02.044805+0000","last_fullsized":"2023-12-08T08:22:02.044805+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044852+0000","last_change":"2023-12-08T08:22:02.044852+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044852+0000","last_undegraded":"2023-12-08T08:22:02.044852+0000","last_fullsized":"2023-12-08T08:22:02.044852+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.059919+0000","last_change":"2023-12-08T08:22:02.059919+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.059919+0000","last_undegraded":"2023-12-08T08:22:02.059919+0000","last_fullsized":"2023-12-08T08:22:02.059919+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049732+0000","last_change":"2023-12-08T08:22:02.049732+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049732+0000","last_undegraded":"2023-12-08T08:22:02.049732+0000","last_fullsized":"2023-12-08T08:22:02.049732+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045770+0000","last_change":"2023-12-08T08:22:02.045770+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045770+0000","last_undegraded":"2023-12-08T08:22:02.045770+0000","last_fullsized":"2023-12-08T08:22:02.045770+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045164+0000","last_change":"2023-12-08T08:22:02.045164+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045164+0000","last_undegraded":"2023-12-08T08:22:02.045164+0000","last_fullsized":"2023-12-08T08:22:02.045164+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.046662+0000","last_change":"2023-12-08T08:22:02.046662+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.046662+0000","last_undegraded":"2023-12-08T08:22:02.046662+0000","last_fullsized":"2023-12-08T08:22:02.046662+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049678+0000","last_change":"2023-12-08T08:22:02.049678+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049678+0000","last_undegraded":"2023-12-08T08:22:02.049678+0000","last_fullsized":"2023-12-08T08:22:02.049678+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051550+0000","last_change":"2023-12-08T08:22:02.051550+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051550+0000","last_undegraded":"2023-12-08T08:22:02.051550+0000","last_fullsized":"2023-12-08T08:22:02.051550+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.064039+0000","last_change":"2023-12-08T08:22:02.064039+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.064039+0000","last_undegraded":"2023-12-08T08:22:02.064039+0000","last_fullsized":"2023-12-08T08:22:02.064039+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045927+0000","last_change":"2023-12-08T08:22:02.045927+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045927+0000","last_undegraded":"2023-12-08T08:22:02.045927+0000","last_fullsized":"2023-12-08T08:22:02.045927+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.052487+0000","last_change":"2023-12-08T08:22:02.052487+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.052487+0000","last_undegraded":"2023-12-08T08:22:02.052487+0000","last_fullsized":"2023-12-08T08:22:02.052487+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.046251+0000","last_change":"2023-12-08T08:22:02.046251+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.046251+0000","last_undegraded":"2023-12-08T08:22:02.046251+0000","last_fullsized":"2023-12-08T08:22:02.046251+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051264+0000","last_change":"2023-12-08T08:22:02.051264+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051264+0000","last_undegraded":"2023-12-08T08:22:02.051264+0000","last_fullsized":"2023-12-08T08:22:02.051264+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.050511+0000","last_change":"2023-12-08T08:22:02.050511+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.050511+0000","last_undegraded":"2023-12-08T08:22:02.050511+0000","last_fullsized":"2023-12-08T08:22:02.050511+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.058924+0000","last_change":"2023-12-08T08:22:02.058924+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.058924+0000","last_undegraded":"2023-12-08T08:22:02.058924+0000","last_fullsized":"2023-12-08T08:22:02.058924+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.060181+0000","last_change":"2023-12-08T08:22:02.060181+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.060181+0000","last_undegraded":"2023-12-08T08:22:02.060181+0000","last_fullsized":"2023-12-08T08:22:02.060181+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.050768+0000","last_change":"2023-12-08T08:22:02.050768+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.050768+0000","last_undegraded":"2023-12-08T08:22:02.050768+0000","last_fullsized":"2023-12-08T08:22:02.050768+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.063344+0000","last_change":"2023-12-08T08:22:02.063344+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.063344+0000","last_undegraded":"2023-12-08T08:22:02.063344+0000","last_fullsized":"2023-12-08T08:22:02.063344+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044610+0000","last_change":"2023-12-08T08:22:02.044610+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044610+0000","last_undegraded":"2023-12-08T08:22:02.044610+0000","last_fullsized":"2023-12-08T08:22:02.044610+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049106+0000","last_change":"2023-12-08T08:22:02.049106+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049106+0000","last_undegraded":"2023-12-08T08:22:02.049106+0000","last_fullsized":"2023-12-08T08:22:02.049106+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.064493+0000","last_change":"2023-12-08T08:22:02.064493+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.064493+0000","last_undegraded":"2023-12-08T08:22:02.064493+0000","last_fullsized":"2023-12-08T08:22:02.064493+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.046147+0000","last_change":"2023-12-08T08:22:02.046147+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.046147+0000","last_undegraded":"2023-12-08T08:22:02.046147+0000","last_fullsized":"2023-12-08T08:22:02.046147+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051096+0000","last_change":"2023-12-08T08:22:02.051096+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051096+0000","last_undegraded":"2023-12-08T08:22:02.051096+0000","last_fullsized":"2023-12-08T08:22:02.051096+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.071534+0000","last_change":"2023-12-08T08:22:02.066070+0000","last_active":"2023-12-08T08:22:02.071534+0000","last_peered":"2023-12-08T08:22:02.071534+0000","last_clean":"2023-12-08T08:22:02.071534+0000","last_became_active":"2023-12-08T08:22:02.065684+0000","last_became_peered":"2023-12-08T08:22:02.065684+0000","last_unstale":"2023-12-08T08:22:02.071534+0000","last_undegraded":"2023-12-08T08:22:02.071534+0000","last_fullsized":"2023-12-08T08:22:02.071534+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:01:23.302095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.043952+0000","last_change":"2023-12-08T08:22:02.043952+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.043952+0000","last_undegraded":"2023-12-08T08:22:02.043952+0000","last_fullsized":"2023-12-08T08:22:02.043952+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.074479+0000","last_change":"2023-12-08T08:22:02.068162+0000","last_active":"2023-12-08T08:22:02.074479+0000","last_peered":"2023-12-08T08:22:02.074479+0000","last_clean":"2023-12-08T08:22:02.074479+0000","last_became_active":"2023-12-08T08:22:02.067918+0000","last_became_peered":"2023-12-08T08:22:02.067918+0000","last_unstale":"2023-12-08T08:22:02.074479+0000","last_undegraded":"2023-12-08T08:22:02.074479+0000","last_fullsized":"2023-12-08T08:22:02.074479+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:09:21.024470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.054028+0000","last_change":"2023-12-08T08:22:02.054028+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.054028+0000","last_undegraded":"2023-12-08T08:22:02.054028+0000","last_fullsized":"2023-12-08T08:22:02.054028+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.068247+0000","last_change":"2023-12-08T08:22:02.061868+0000","last_active":"2023-12-08T08:22:02.068247+0000","last_peered":"2023-12-08T08:22:02.068247+0000","last_clean":"2023-12-08T08:22:02.068247+0000","last_became_active":"2023-12-08T08:22:02.061570+0000","last_became_peered":"2023-12-08T08:22:02.061570+0000","last_unstale":"2023-12-08T08:22:02.068247+0000","last_undegraded":"2023-12-08T08:22:02.068247+0000","last_fullsized":"2023-12-08T08:22:02.068247+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:55:21.616638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.050433+0000","last_change":"2023-12-08T08:22:02.050433+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.050433+0000","last_undegraded":"2023-12-08T08:22:02.050433+0000","last_fullsized":"2023-12-08T08:22:02.050433+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076694+0000","last_change":"2023-12-08T08:22:02.073413+0000","last_active":"2023-12-08T08:22:02.076694+0000","last_peered":"2023-12-08T08:22:02.076694+0000","last_clean":"2023-12-08T08:22:02.076694+0000","last_became_active":"2023-12-08T08:22:02.073043+0000","last_became_peered":"2023-12-08T08:22:02.073043+0000","last_unstale":"2023-12-08T08:22:02.076694+0000","last_undegraded":"2023-12-08T08:22:02.076694+0000","last_fullsized":"2023-12-08T08:22:02.076694+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:13.555049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045725+0000","last_change":"2023-12-08T08:22:02.045725+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045725+0000","last_undegraded":"2023-12-08T08:22:02.045725+0000","last_fullsized":"2023-12-08T08:22:02.045725+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.075910+0000","last_change":"2023-12-08T08:22:02.074443+0000","last_active":"2023-12-08T08:22:02.075910+0000","last_peered":"2023-12-08T08:22:02.075910+0000","last_clean":"2023-12-08T08:22:02.075910+0000","last_became_active":"2023-12-08T08:22:02.074076+0000","last_became_peered":"2023-12-08T08:22:02.074076+0000","last_unstale":"2023-12-08T08:22:02.075910+0000","last_undegraded":"2023-12-08T08:22:02.075910+0000","last_fullsized":"2023-12-08T08:22:02.075910+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:17:41.637207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.047229+0000","last_change":"2023-12-08T08:22:02.047229+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.047229+0000","last_undegraded":"2023-12-08T08:22:02.047229+0000","last_fullsized":"2023-12-08T08:22:02.047229+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.068126+0000","last_change":"2023-12-08T08:22:02.061389+0000","last_active":"2023-12-08T08:22:02.068126+0000","last_peered":"2023-12-08T08:22:02.068126+0000","last_clean":"2023-12-08T08:22:02.068126+0000","last_became_active":"2023-12-08T08:22:02.060880+0000","last_became_peered":"2023-12-08T08:22:02.060880+0000","last_unstale":"2023-12-08T08:22:02.068126+0000","last_undegraded":"2023-12-08T08:22:02.068126+0000","last_fullsized":"2023-12-08T08:22:02.068126+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:48.380978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049585+0000","last_change":"2023-12-08T08:22:02.049585+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049585+0000","last_undegraded":"2023-12-08T08:22:02.049585+0000","last_fullsized":"2023-12-08T08:22:02.049585+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.069309+0000","last_change":"2023-12-08T08:22:02.063925+0000","last_active":"2023-12-08T08:22:02.069309+0000","last_peered":"2023-12-08T08:22:02.069309+0000","last_clean":"2023-12-08T08:22:02.069309+0000","last_became_active":"2023-12-08T08:22:02.063585+0000","last_became_peered":"2023-12-08T08:22:02.063585+0000","last_unstale":"2023-12-08T08:22:02.069309+0000","last_undegraded":"2023-12-08T08:22:02.069309+0000","last_fullsized":"2023-12-08T08:22:02.069309+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:24.830501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044970+0000","last_change":"2023-12-08T08:22:02.044970+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044970+0000","last_undegraded":"2023-12-08T08:22:02.044970+0000","last_fullsized":"2023-12-08T08:22:02.044970+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.072407+0000","last_change":"2023-12-08T08:22:02.066732+0000","last_active":"2023-12-08T08:22:02.072407+0000","last_peered":"2023-12-08T08:22:02.072407+0000","last_clean":"2023-12-08T08:22:02.072407+0000","last_became_active":"2023-12-08T08:22:02.066414+0000","last_became_peered":"2023-12-08T08:22:02.066414+0000","last_unstale":"2023-12-08T08:22:02.072407+0000","last_undegraded":"2023-12-08T08:22:02.072407+0000","last_fullsized":"2023-12-08T08:22:02.072407+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:24.830501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045265+0000","last_change":"2023-12-08T08:22:02.045265+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045265+0000","last_undegraded":"2023-12-08T08:22:02.045265+0000","last_fullsized":"2023-12-08T08:22:02.045265+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.075696+0000","last_change":"2023-12-08T08:22:02.073329+0000","last_active":"2023-12-08T08:22:02.075696+0000","last_peered":"2023-12-08T08:22:02.075696+0000","last_clean":"2023-12-08T08:22:02.075696+0000","last_became_active":"2023-12-08T08:22:02.073052+0000","last_became_peered":"2023-12-08T08:22:02.073052+0000","last_unstale":"2023-12-08T08:22:02.075696+0000","last_undegraded":"2023-12-08T08:22:02.075696+0000","last_fullsized":"2023-12-08T08:22:02.075696+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:50.699270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051547+0000","last_change":"2023-12-08T08:22:02.051547+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051547+0000","last_undegraded":"2023-12-08T08:22:02.051547+0000","last_fullsized":"2023-12-08T08:22:02.051547+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076913+0000","last_change":"2023-12-08T08:22:02.074584+0000","last_active":"2023-12-08T08:22:02.076913+0000","last_peered":"2023-12-08T08:22:02.076913+0000","last_clean":"2023-12-08T08:22:02.076913+0000","last_became_active":"2023-12-08T08:22:02.072443+0000","last_became_peered":"2023-12-08T08:22:02.072443+0000","last_unstale":"2023-12-08T08:22:02.076913+0000","last_undegraded":"2023-12-08T08:22:02.076913+0000","last_fullsized":"2023-12-08T08:22:02.076913+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:22:40.527797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044204+0000","last_change":"2023-12-08T08:22:02.044204+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044204+0000","last_undegraded":"2023-12-08T08:22:02.044204+0000","last_fullsized":"2023-12-08T08:22:02.044204+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.074334+0000","last_change":"2023-12-08T08:22:02.071820+0000","last_active":"2023-12-08T08:22:02.074334+0000","last_peered":"2023-12-08T08:22:02.074334+0000","last_clean":"2023-12-08T08:22:02.074334+0000","last_became_active":"2023-12-08T08:22:02.071513+0000","last_became_peered":"2023-12-08T08:22:02.071513+0000","last_unstale":"2023-12-08T08:22:02.074334+0000","last_undegraded":"2023-12-08T08:22:02.074334+0000","last_fullsized":"2023-12-08T08:22:02.074334+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:13.555049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.053300+0000","last_change":"2023-12-08T08:22:02.053300+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.053300+0000","last_undegraded":"2023-12-08T08:22:02.053300+0000","last_fullsized":"2023-12-08T08:22:02.053300+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.070065+0000","last_change":"2023-12-08T08:22:02.064284+0000","last_active":"2023-12-08T08:22:02.070065+0000","last_peered":"2023-12-08T08:22:02.070065+0000","last_clean":"2023-12-08T08:22:02.070065+0000","last_became_active":"2023-12-08T08:22:02.063986+0000","last_became_peered":"2023-12-08T08:22:02.063986+0000","last_unstale":"2023-12-08T08:22:02.070065+0000","last_undegraded":"2023-12-08T08:22:02.070065+0000","last_fullsized":"2023-12-08T08:22:02.070065+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:45:39.958857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.054130+0000","last_change":"2023-12-08T08:22:02.054130+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.054130+0000","last_undegraded":"2023-12-08T08:22:02.054130+0000","last_fullsized":"2023-12-08T08:22:02.054130+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076414+0000","last_change":"2023-12-08T08:22:02.073150+0000","last_active":"2023-12-08T08:22:02.076414+0000","last_peered":"2023-12-08T08:22:02.076414+0000","last_clean":"2023-12-08T08:22:02.076414+0000","last_became_active":"2023-12-08T08:22:02.071562+0000","last_became_peered":"2023-12-08T08:22:02.071562+0000","last_unstale":"2023-12-08T08:22:02.076414+0000","last_undegraded":"2023-12-08T08:22:02.076414+0000","last_fullsized":"2023-12-08T08:22:02.076414+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:26:10.210451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051948+0000","last_change":"2023-12-08T08:22:02.051948+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051948+0000","last_undegraded":"2023-12-08T08:22:02.051948+0000","last_fullsized":"2023-12-08T08:22:02.051948+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.072108+0000","last_change":"2023-12-08T08:22:02.067718+0000","last_active":"2023-12-08T08:22:02.072108+0000","last_peered":"2023-12-08T08:22:02.072108+0000","last_clean":"2023-12-08T08:22:02.072108+0000","last_became_active":"2023-12-08T08:22:02.067452+0000","last_became_peered":"2023-12-08T08:22:02.067452+0000","last_unstale":"2023-12-08T08:22:02.072108+0000","last_undegraded":"2023-12-08T08:22:02.072108+0000","last_fullsized":"2023-12-08T08:22:02.072108+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:30:31.631850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045450+0000","last_change":"2023-12-08T08:22:02.045450+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045450+0000","last_undegraded":"2023-12-08T08:22:02.045450+0000","last_fullsized":"2023-12-08T08:22:02.045450+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076644+0000","last_change":"2023-12-08T08:22:02.072008+0000","last_active":"2023-12-08T08:22:02.076644+0000","last_peered":"2023-12-08T08:22:02.076644+0000","last_clean":"2023-12-08T08:22:02.076644+0000","last_became_active":"2023-12-08T08:22:02.071711+0000","last_became_peered":"2023-12-08T08:22:02.071711+0000","last_unstale":"2023-12-08T08:22:02.076644+0000","last_undegraded":"2023-12-08T08:22:02.076644+0000","last_fullsized":"2023-12-08T08:22:02.076644+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:49:51.933425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049037+0000","last_change":"2023-12-08T08:22:02.049037+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049037+0000","last_undegraded":"2023-12-08T08:22:02.049037+0000","last_fullsized":"2023-12-08T08:22:02.049037+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.074299+0000","last_change":"2023-12-08T08:22:02.071841+0000","last_active":"2023-12-08T08:22:02.074299+0000","last_peered":"2023-12-08T08:22:02.074299+0000","last_clean":"2023-12-08T08:22:02.074299+0000","last_became_active":"2023-12-08T08:22:02.071531+0000","last_became_peered":"2023-12-08T08:22:02.071531+0000","last_unstale":"2023-12-08T08:22:02.074299+0000","last_undegraded":"2023-12-08T08:22:02.074299+0000","last_fullsized":"2023-12-08T08:22:02.074299+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:13:54.526670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.050946+0000","last_change":"2023-12-08T08:22:02.050946+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.050946+0000","last_undegraded":"2023-12-08T08:22:02.050946+0000","last_fullsized":"2023-12-08T08:22:02.050946+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076370+0000","last_change":"2023-12-08T08:22:02.072612+0000","last_active":"2023-12-08T08:22:02.076370+0000","last_peered":"2023-12-08T08:22:02.076370+0000","last_clean":"2023-12-08T08:22:02.076370+0000","last_became_active":"2023-12-08T08:22:02.071308+0000","last_became_peered":"2023-12-08T08:22:02.071308+0000","last_unstale":"2023-12-08T08:22:02.076370+0000","last_undegraded":"2023-12-08T08:22:02.076370+0000","last_fullsized":"2023-12-08T08:22:02.076370+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:30:30.201779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.055769+0000","last_change":"2023-12-08T08:22:02.055769+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.055769+0000","last_undegraded":"2023-12-08T08:22:02.055769+0000","last_fullsized":"2023-12-08T08:22:02.055769+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076584+0000","last_change":"2023-12-08T08:22:02.074304+0000","last_active":"2023-12-08T08:22:02.076584+0000","last_peered":"2023-12-08T08:22:02.076584+0000","last_clean":"2023-12-08T08:22:02.076584+0000","last_became_active":"2023-12-08T08:22:02.074007+0000","last_became_peered":"2023-12-08T08:22:02.074007+0000","last_unstale":"2023-12-08T08:22:02.076584+0000","last_undegraded":"2023-12-08T08:22:02.076584+0000","last_fullsized":"2023-12-08T08:22:02.076584+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:02.472465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045441+0000","last_change":"2023-12-08T08:22:02.045441+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045441+0000","last_undegraded":"2023-12-08T08:22:02.045441+0000","last_fullsized":"2023-12-08T08:22:02.045441+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076702+0000","last_change":"2023-12-08T08:22:02.073388+0000","last_active":"2023-12-08T08:22:02.076702+0000","last_peered":"2023-12-08T08:22:02.076702+0000","last_clean":"2023-12-08T08:22:02.076702+0000","last_became_active":"2023-12-08T08:22:02.073107+0000","last_became_peered":"2023-12-08T08:22:02.073107+0000","last_unstale":"2023-12-08T08:22:02.076702+0000","last_undegraded":"2023-12-08T08:22:02.076702+0000","last_fullsized":"2023-12-08T08:22:02.076702+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:50.699270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049911+0000","last_change":"2023-12-08T08:22:02.049911+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049911+0000","last_undegraded":"2023-12-08T08:22:02.049911+0000","last_fullsized":"2023-12-08T08:22:02.049911+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.071665+0000","last_change":"2023-12-08T08:22:02.067383+0000","last_active":"2023-12-08T08:22:02.071665+0000","last_peered":"2023-12-08T08:22:02.071665+0000","last_clean":"2023-12-08T08:22:02.071665+0000","last_became_active":"2023-12-08T08:22:02.067094+0000","last_became_peered":"2023-12-08T08:22:02.067094+0000","last_unstale":"2023-12-08T08:22:02.071665+0000","last_undegraded":"2023-12-08T08:22:02.071665+0000","last_fullsized":"2023-12-08T08:22:02.071665+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:14.917716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.053600+0000","last_change":"2023-12-08T08:22:02.053600+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.053600+0000","last_undegraded":"2023-12-08T08:22:02.053600+0000","last_fullsized":"2023-12-08T08:22:02.053600+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.063728+0000","last_change":"2023-12-08T08:22:02.055138+0000","last_active":"2023-12-08T08:22:02.063728+0000","last_peered":"2023-12-08T08:22:02.063728+0000","last_clean":"2023-12-08T08:22:02.063728+0000","last_became_active":"2023-12-08T08:22:02.054797+0000","last_became_peered":"2023-12-08T08:22:02.054797+0000","last_unstale":"2023-12-08T08:22:02.063728+0000","last_undegraded":"2023-12-08T08:22:02.063728+0000","last_fullsized":"2023-12-08T08:22:02.063728+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:02:40.986075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051277+0000","last_change":"2023-12-08T08:22:02.051277+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051277+0000","last_undegraded":"2023-12-08T08:22:02.051277+0000","last_fullsized":"2023-12-08T08:22:02.051277+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.075435+0000","last_change":"2023-12-08T08:22:02.072456+0000","last_active":"2023-12-08T08:22:02.075435+0000","last_peered":"2023-12-08T08:22:02.075435+0000","last_clean":"2023-12-08T08:22:02.075435+0000","last_became_active":"2023-12-08T08:22:02.072146+0000","last_became_peered":"2023-12-08T08:22:02.072146+0000","last_unstale":"2023-12-08T08:22:02.075435+0000","last_undegraded":"2023-12-08T08:22:02.075435+0000","last_fullsized":"2023-12-08T08:22:02.075435+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.752165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.046507+0000","last_change":"2023-12-08T08:22:02.046507+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.046507+0000","last_undegraded":"2023-12-08T08:22:02.046507+0000","last_fullsized":"2023-12-08T08:22:02.046507+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.069555+0000","last_change":"2023-12-08T08:22:02.065223+0000","last_active":"2023-12-08T08:22:02.069555+0000","last_peered":"2023-12-08T08:22:02.069555+0000","last_clean":"2023-12-08T08:22:02.069555+0000","last_became_active":"2023-12-08T08:22:02.064829+0000","last_became_peered":"2023-12-08T08:22:02.064829+0000","last_unstale":"2023-12-08T08:22:02.069555+0000","last_undegraded":"2023-12-08T08:22:02.069555+0000","last_fullsized":"2023-12-08T08:22:02.069555+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:45:39.958857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.059365+0000","last_change":"2023-12-08T08:22:02.059365+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.059365+0000","last_undegraded":"2023-12-08T08:22:02.059365+0000","last_fullsized":"2023-12-08T08:22:02.059365+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.064936+0000","last_change":"2023-12-08T08:22:02.057964+0000","last_active":"2023-12-08T08:22:02.064936+0000","last_peered":"2023-12-08T08:22:02.064936+0000","last_clean":"2023-12-08T08:22:02.064936+0000","last_became_active":"2023-12-08T08:22:02.057677+0000","last_became_peered":"2023-12-08T08:22:02.057677+0000","last_unstale":"2023-12-08T08:22:02.064936+0000","last_undegraded":"2023-12-08T08:22:02.064936+0000","last_fullsized":"2023-12-08T08:22:02.064936+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:46:01.889435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.055314+0000","last_change":"2023-12-08T08:22:02.055314+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.055314+0000","last_undegraded":"2023-12-08T08:22:02.055314+0000","last_fullsized":"2023-12-08T08:22:02.055314+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.068215+0000","last_change":"2023-12-08T08:22:02.061620+0000","last_active":"2023-12-08T08:22:02.068215+0000","last_peered":"2023-12-08T08:22:02.068215+0000","last_clean":"2023-12-08T08:22:02.068215+0000","last_became_active":"2023-12-08T08:22:02.061329+0000","last_became_peered":"2023-12-08T08:22:02.061329+0000","last_unstale":"2023-12-08T08:22:02.068215+0000","last_undegraded":"2023-12-08T08:22:02.068215+0000","last_fullsized":"2023-12-08T08:22:02.068215+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:08:57.419992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.043612+0000","last_change":"2023-12-08T08:22:02.043612+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.043612+0000","last_undegraded":"2023-12-08T08:22:02.043612+0000","last_fullsized":"2023-12-08T08:22:02.043612+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.065571+0000","last_change":"2023-12-08T08:22:02.059762+0000","last_active":"2023-12-08T08:22:02.065571+0000","last_peered":"2023-12-08T08:22:02.065571+0000","last_clean":"2023-12-08T08:22:02.065571+0000","last_became_active":"2023-12-08T08:22:02.059447+0000","last_became_peered":"2023-12-08T08:22:02.059447+0000","last_unstale":"2023-12-08T08:22:02.065571+0000","last_undegraded":"2023-12-08T08:22:02.065571+0000","last_fullsized":"2023-12-08T08:22:02.065571+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.752165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.050041+0000","last_change":"2023-12-08T08:22:02.050041+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.050041+0000","last_undegraded":"2023-12-08T08:22:02.050041+0000","last_fullsized":"2023-12-08T08:22:02.050041+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.072430+0000","last_change":"2023-12-08T08:22:02.069094+0000","last_active":"2023-12-08T08:22:02.072430+0000","last_peered":"2023-12-08T08:22:02.072430+0000","last_clean":"2023-12-08T08:22:02.072430+0000","last_became_active":"2023-12-08T08:22:02.068768+0000","last_became_peered":"2023-12-08T08:22:02.068768+0000","last_unstale":"2023-12-08T08:22:02.072430+0000","last_undegraded":"2023-12-08T08:22:02.072430+0000","last_fullsized":"2023-12-08T08:22:02.072430+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:13:54.526670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044367+0000","last_change":"2023-12-08T08:22:02.044367+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044367+0000","last_undegraded":"2023-12-08T08:22:02.044367+0000","last_fullsized":"2023-12-08T08:22:02.044367+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.069442+0000","last_change":"2023-12-08T08:22:02.064371+0000","last_active":"2023-12-08T08:22:02.069442+0000","last_peered":"2023-12-08T08:22:02.069442+0000","last_clean":"2023-12-08T08:22:02.069442+0000","last_became_active":"2023-12-08T08:22:02.063996+0000","last_became_peered":"2023-12-08T08:22:02.063996+0000","last_unstale":"2023-12-08T08:22:02.069442+0000","last_undegraded":"2023-12-08T08:22:02.069442+0000","last_fullsized":"2023-12-08T08:22:02.069442+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:47:39.746644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049394+0000","last_change":"2023-12-08T08:22:02.049394+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049394+0000","last_undegraded":"2023-12-08T08:22:02.049394+0000","last_fullsized":"2023-12-08T08:22:02.049394+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.066637+0000","last_change":"2023-12-08T08:22:02.063148+0000","last_active":"2023-12-08T08:22:02.066637+0000","last_peered":"2023-12-08T08:22:02.066637+0000","last_clean":"2023-12-08T08:22:02.066637+0000","last_became_active":"2023-12-08T08:22:02.062860+0000","last_became_peered":"2023-12-08T08:22:02.062860+0000","last_unstale":"2023-12-08T08:22:02.066637+0000","last_undegraded":"2023-12-08T08:22:02.066637+0000","last_fullsized":"2023-12-08T08:22:02.066637+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:49:51.933425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.043780+0000","last_change":"2023-12-08T08:22:02.043780+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.043780+0000","last_undegraded":"2023-12-08T08:22:02.043780+0000","last_fullsized":"2023-12-08T08:22:02.043780+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.059779+0000","last_change":"2023-12-08T08:22:02.055697+0000","last_active":"2023-12-08T08:22:02.059779+0000","last_peered":"2023-12-08T08:22:02.059779+0000","last_clean":"2023-12-08T08:22:02.059779+0000","last_became_active":"2023-12-08T08:22:02.055412+0000","last_became_peered":"2023-12-08T08:22:02.055412+0000","last_unstale":"2023-12-08T08:22:02.059779+0000","last_undegraded":"2023-12-08T08:22:02.059779+0000","last_fullsized":"2023-12-08T08:22:02.059779+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:30:31.631850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044376+0000","last_change":"2023-12-08T08:22:02.044376+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044376+0000","last_undegraded":"2023-12-08T08:22:02.044376+0000","last_fullsized":"2023-12-08T08:22:02.044376+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.067526+0000","last_change":"2023-12-08T08:22:02.065076+0000","last_active":"2023-12-08T08:22:02.067526+0000","last_peered":"2023-12-08T08:22:02.067526+0000","last_clean":"2023-12-08T08:22:02.067526+0000","last_became_active":"2023-12-08T08:22:02.064723+0000","last_became_peered":"2023-12-08T08:22:02.064723+0000","last_unstale":"2023-12-08T08:22:02.067526+0000","last_undegraded":"2023-12-08T08:22:02.067526+0000","last_fullsized":"2023-12-08T08:22:02.067526+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:03:17.577934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045170+0000","last_change":"2023-12-08T08:22:02.045170+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045170+0000","last_undegraded":"2023-12-08T08:22:02.045170+0000","last_fullsized":"2023-12-08T08:22:02.045170+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.069302+0000","last_change":"2023-12-08T08:22:02.066497+0000","last_active":"2023-12-08T08:22:02.069302+0000","last_peered":"2023-12-08T08:22:02.069302+0000","last_clean":"2023-12-08T08:22:02.069302+0000","last_became_active":"2023-12-08T08:22:02.065532+0000","last_became_peered":"2023-12-08T08:22:02.065532+0000","last_unstale":"2023-12-08T08:22:02.069302+0000","last_undegraded":"2023-12-08T08:22:02.069302+0000","last_fullsized":"2023-12-08T08:22:02.069302+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:47:39.746644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":186,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-08T08:22:01.039220+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:22:01.039220+0000","last_peered":"2023-12-08T08:22:01.039220+0000","last_clean":"2023-12-08T08:22:01.039220+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:22:01.039220+0000","last_undegraded":"2023-12-08T08:22:01.039220+0000","last_fullsized":"2023-12-08T08:22:01.039220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":626688,"data_stored":823117,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.84599999999999997}]},{"osd":1,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.79900000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.61699999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.82699999999999996}]},{"osd":4,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.67500000000000004}]},{"osd":6,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.71599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":573440,"data_stored":239016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.84799999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.81200000000000006}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.71999999999999997}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.746}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.46500000000000002}]},{"osd":5,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.627},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.60099999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.55400000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":573440,"data_stored":239016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.38700000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.45900000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.438},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.624}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.67200000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.503}]},{"osd":6,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.52600000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.69499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":573440,"data_stored":239016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.79300000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.67900000000000005}]},{"osd":2,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.623}]},{"osd":3,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.74299999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.53000000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.82199999999999995}]},{"osd":7,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.72499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":573440,"data_stored":239016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.249},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.37}]},{"osd":1,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.39200000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.34399999999999997}]},{"osd":4,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.80200000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.83299999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.876},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.77300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":573440,"data_stored":239016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.0270000000000001,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.34399999999999997}]},{"osd":1,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.44500000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.48199999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.78000000000000003}]},{"osd":5,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":3.637,"5min":3.637,"15min":3.637},"last":0.71499999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.90600000000000003}]},{"osd":7,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.94099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":573440,"data_stored":239016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2210000000000001,"5min":5.2210000000000001,"15min":5.2210000000000001},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":8.3200000000000003,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.38700000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":8.2070000000000007,"5min":8.2070000000000007,"15min":8.2070000000000007},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":4.351,"5min":4.351,"15min":4.351},"last":0.34899999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":8.1479999999999997,"5min":8.1479999999999997,"15min":8.1479999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.3150000000000004,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.45900000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":4.8470000000000004,"5min":4.8470000000000004,"15min":4.8470000000000004},"last":0.503},{"interface":"front","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":4.7939999999999996,"5min":4.7939999999999996,"15min":4.7939999999999996},"last":0.47699999999999998}]},{"osd":5,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":4.7240000000000002,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":4.5830000000000002,"5min":4.5830000000000002,"15min":4.5830000000000002},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":4.7699999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":4.6289999999999996,"5min":4.6289999999999996,"15min":4.6289999999999996},"last":0.64900000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":4.665,"5min":4.665,"15min":4.665},"last":0.61599999999999999},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":4.8140000000000001,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.63400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27636,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":626688,"data_stored":823117,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":8.2799999999999994,"5min":8.2799999999999994,"15min":8.2799999999999994},"last":0.39700000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":7.9290000000000003,"5min":7.9290000000000003,"15min":7.9290000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":8.0890000000000004,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.33000000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":4.6550000000000002,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":7.8890000000000002,"5min":7.8890000000000002,"15min":7.8890000000000002},"last":0.47399999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":7.9649999999999999,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.876},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.751}]},{"osd":5,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":8.0579999999999998,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.68400000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":7.835,"5min":7.835,"15min":7.835},"last":0.89300000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":8.0239999999999991,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.78300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:22:07.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2023-12-08T08:22:07.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.059484+0000', 'last_change': '2023-12-08T08:22:02.059484+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.059484+0000', 'last_undegraded': '2023-12-08T08:22:02.059484+0000', 'last_fullsized': '2023-12-08T08:22:02.059484+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:22:07.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2023-12-08T08:22:07.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.055012+0000', 'last_change': '2023-12-08T08:22:02.055012+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.055012+0000', 'last_undegraded': '2023-12-08T08:22:02.055012+0000', 'last_fullsized': '2023-12-08T08:22:02.055012+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:22:07.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2023-12-08T08:22:07.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.053803+0000', 'last_change': '2023-12-08T08:22:02.053803+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.053803+0000', 'last_undegraded': '2023-12-08T08:22:02.053803+0000', 'last_fullsized': '2023-12-08T08:22:02.053803+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:22:07.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2023-12-08T08:22:07.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.060413+0000', 'last_change': '2023-12-08T08:22:02.060413+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.060413+0000', 'last_undegraded': '2023-12-08T08:22:02.060413+0000', 'last_fullsized': '2023-12-08T08:22:02.060413+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:22:07.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2023-12-08T08:22:07.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.065877+0000', 'last_change': '2023-12-08T08:22:02.065877+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.065877+0000', 'last_undegraded': '2023-12-08T08:22:02.065877+0000', 'last_fullsized': '2023-12-08T08:22:02.065877+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:22:07.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2023-12-08T08:22:07.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.048960+0000', 'last_change': '2023-12-08T08:22:02.048960+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.048960+0000', 'last_undegraded': '2023-12-08T08:22:02.048960+0000', 'last_fullsized': '2023-12-08T08:22:02.048960+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:22:07.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2023-12-08T08:22:07.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.046276+0000', 'last_change': '2023-12-08T08:22:02.046276+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.046276+0000', 'last_undegraded': '2023-12-08T08:22:02.046276+0000', 'last_fullsized': '2023-12-08T08:22:02.046276+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:22:07.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2023-12-08T08:22:07.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.051226+0000', 'last_change': '2023-12-08T08:22:02.051226+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.051226+0000', 'last_undegraded': '2023-12-08T08:22:02.051226+0000', 'last_fullsized': '2023-12-08T08:22:02.051226+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:22:07.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2023-12-08T08:22:07.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.045291+0000', 'last_change': '2023-12-08T08:22:02.045291+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.045291+0000', 'last_undegraded': '2023-12-08T08:22:02.045291+0000', 'last_fullsized': '2023-12-08T08:22:02.045291+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:22:07.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2023-12-08T08:22:07.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.044805+0000', 'last_change': '2023-12-08T08:22:02.044805+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.044805+0000', 'last_undegraded': '2023-12-08T08:22:02.044805+0000', 'last_fullsized': '2023-12-08T08:22:02.044805+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:22:07.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2023-12-08T08:22:07.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.044852+0000', 'last_change': '2023-12-08T08:22:02.044852+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.044852+0000', 'last_undegraded': '2023-12-08T08:22:02.044852+0000', 'last_fullsized': '2023-12-08T08:22:02.044852+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:22:07.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2023-12-08T08:22:07.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.059919+0000', 'last_change': '2023-12-08T08:22:02.059919+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.059919+0000', 'last_undegraded': '2023-12-08T08:22:02.059919+0000', 'last_fullsized': '2023-12-08T08:22:02.059919+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:22:07.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2023-12-08T08:22:07.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.049732+0000', 'last_change': '2023-12-08T08:22:02.049732+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.049732+0000', 'last_undegraded': '2023-12-08T08:22:02.049732+0000', 'last_fullsized': '2023-12-08T08:22:02.049732+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:22:07.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2023-12-08T08:22:07.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.045770+0000', 'last_change': '2023-12-08T08:22:02.045770+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.045770+0000', 'last_undegraded': '2023-12-08T08:22:02.045770+0000', 'last_fullsized': '2023-12-08T08:22:02.045770+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:22:07.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2023-12-08T08:22:07.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.045164+0000', 'last_change': '2023-12-08T08:22:02.045164+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.045164+0000', 'last_undegraded': '2023-12-08T08:22:02.045164+0000', 'last_fullsized': '2023-12-08T08:22:02.045164+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:22:07.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2023-12-08T08:22:07.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.046662+0000', 'last_change': '2023-12-08T08:22:02.046662+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.046662+0000', 'last_undegraded': '2023-12-08T08:22:02.046662+0000', 'last_fullsized': '2023-12-08T08:22:02.046662+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:22:07.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2023-12-08T08:22:07.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.049678+0000', 'last_change': '2023-12-08T08:22:02.049678+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.049678+0000', 'last_undegraded': '2023-12-08T08:22:02.049678+0000', 'last_fullsized': '2023-12-08T08:22:02.049678+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:22:07.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2023-12-08T08:22:07.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.051550+0000', 'last_change': '2023-12-08T08:22:02.051550+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.051550+0000', 'last_undegraded': '2023-12-08T08:22:02.051550+0000', 'last_fullsized': '2023-12-08T08:22:02.051550+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:22:07.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2023-12-08T08:22:07.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.064039+0000', 'last_change': '2023-12-08T08:22:02.064039+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.064039+0000', 'last_undegraded': '2023-12-08T08:22:02.064039+0000', 'last_fullsized': '2023-12-08T08:22:02.064039+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:22:07.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2023-12-08T08:22:07.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.045927+0000', 'last_change': '2023-12-08T08:22:02.045927+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.045927+0000', 'last_undegraded': '2023-12-08T08:22:02.045927+0000', 'last_fullsized': '2023-12-08T08:22:02.045927+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:22:07.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2023-12-08T08:22:07.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.052487+0000', 'last_change': '2023-12-08T08:22:02.052487+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.052487+0000', 'last_undegraded': '2023-12-08T08:22:02.052487+0000', 'last_fullsized': '2023-12-08T08:22:02.052487+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:22:07.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2023-12-08T08:22:07.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.046251+0000', 'last_change': '2023-12-08T08:22:02.046251+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.046251+0000', 'last_undegraded': '2023-12-08T08:22:02.046251+0000', 'last_fullsized': '2023-12-08T08:22:02.046251+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:22:07.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2023-12-08T08:22:07.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.051264+0000', 'last_change': '2023-12-08T08:22:02.051264+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.051264+0000', 'last_undegraded': '2023-12-08T08:22:02.051264+0000', 'last_fullsized': '2023-12-08T08:22:02.051264+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:22:07.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2023-12-08T08:22:07.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.050511+0000', 'last_change': '2023-12-08T08:22:02.050511+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.050511+0000', 'last_undegraded': '2023-12-08T08:22:02.050511+0000', 'last_fullsized': '2023-12-08T08:22:02.050511+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:22:07.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2023-12-08T08:22:07.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.058924+0000', 'last_change': '2023-12-08T08:22:02.058924+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.058924+0000', 'last_undegraded': '2023-12-08T08:22:02.058924+0000', 'last_fullsized': '2023-12-08T08:22:02.058924+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:22:07.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2023-12-08T08:22:07.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.060181+0000', 'last_change': '2023-12-08T08:22:02.060181+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.060181+0000', 'last_undegraded': '2023-12-08T08:22:02.060181+0000', 'last_fullsized': '2023-12-08T08:22:02.060181+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:22:07.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2023-12-08T08:22:07.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.050768+0000', 'last_change': '2023-12-08T08:22:02.050768+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.050768+0000', 'last_undegraded': '2023-12-08T08:22:02.050768+0000', 'last_fullsized': '2023-12-08T08:22:02.050768+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:22:07.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2023-12-08T08:22:07.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.063344+0000', 'last_change': '2023-12-08T08:22:02.063344+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.063344+0000', 'last_undegraded': '2023-12-08T08:22:02.063344+0000', 'last_fullsized': '2023-12-08T08:22:02.063344+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:22:07.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2023-12-08T08:22:07.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.044610+0000', 'last_change': '2023-12-08T08:22:02.044610+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.044610+0000', 'last_undegraded': '2023-12-08T08:22:02.044610+0000', 'last_fullsized': '2023-12-08T08:22:02.044610+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:22:07.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2023-12-08T08:22:07.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.049106+0000', 'last_change': '2023-12-08T08:22:02.049106+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.049106+0000', 'last_undegraded': '2023-12-08T08:22:02.049106+0000', 'last_fullsized': '2023-12-08T08:22:02.049106+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:22:07.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2023-12-08T08:22:07.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.064493+0000', 'last_change': '2023-12-08T08:22:02.064493+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.064493+0000', 'last_undegraded': '2023-12-08T08:22:02.064493+0000', 'last_fullsized': '2023-12-08T08:22:02.064493+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:22:07.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.20 is not active+clean 2023-12-08T08:22:07.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.046147+0000', 'last_change': '2023-12-08T08:22:02.046147+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.046147+0000', 'last_undegraded': '2023-12-08T08:22:02.046147+0000', 'last_fullsized': '2023-12-08T08:22:02.046147+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:22:07.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2023-12-08T08:22:07.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.051096+0000', 'last_change': '2023-12-08T08:22:02.051096+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.051096+0000', 'last_undegraded': '2023-12-08T08:22:02.051096+0000', 'last_fullsized': '2023-12-08T08:22:02.051096+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:22:07.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2023-12-08T08:22:07.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.043952+0000', 'last_change': '2023-12-08T08:22:02.043952+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.043952+0000', 'last_undegraded': '2023-12-08T08:22:02.043952+0000', 'last_fullsized': '2023-12-08T08:22:02.043952+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:22:07.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2023-12-08T08:22:07.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.054028+0000', 'last_change': '2023-12-08T08:22:02.054028+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.054028+0000', 'last_undegraded': '2023-12-08T08:22:02.054028+0000', 'last_fullsized': '2023-12-08T08:22:02.054028+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:22:07.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2023-12-08T08:22:07.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.050433+0000', 'last_change': '2023-12-08T08:22:02.050433+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.050433+0000', 'last_undegraded': '2023-12-08T08:22:02.050433+0000', 'last_fullsized': '2023-12-08T08:22:02.050433+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:22:07.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2023-12-08T08:22:07.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.045725+0000', 'last_change': '2023-12-08T08:22:02.045725+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.045725+0000', 'last_undegraded': '2023-12-08T08:22:02.045725+0000', 'last_fullsized': '2023-12-08T08:22:02.045725+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:22:07.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2023-12-08T08:22:07.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.047229+0000', 'last_change': '2023-12-08T08:22:02.047229+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.047229+0000', 'last_undegraded': '2023-12-08T08:22:02.047229+0000', 'last_fullsized': '2023-12-08T08:22:02.047229+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:22:07.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2023-12-08T08:22:07.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.049585+0000', 'last_change': '2023-12-08T08:22:02.049585+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.049585+0000', 'last_undegraded': '2023-12-08T08:22:02.049585+0000', 'last_fullsized': '2023-12-08T08:22:02.049585+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:22:07.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2023-12-08T08:22:07.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.044970+0000', 'last_change': '2023-12-08T08:22:02.044970+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.044970+0000', 'last_undegraded': '2023-12-08T08:22:02.044970+0000', 'last_fullsized': '2023-12-08T08:22:02.044970+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:22:07.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2023-12-08T08:22:07.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.045265+0000', 'last_change': '2023-12-08T08:22:02.045265+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.045265+0000', 'last_undegraded': '2023-12-08T08:22:02.045265+0000', 'last_fullsized': '2023-12-08T08:22:02.045265+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:22:07.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2023-12-08T08:22:07.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.051547+0000', 'last_change': '2023-12-08T08:22:02.051547+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.051547+0000', 'last_undegraded': '2023-12-08T08:22:02.051547+0000', 'last_fullsized': '2023-12-08T08:22:02.051547+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:22:07.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2023-12-08T08:22:07.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.044204+0000', 'last_change': '2023-12-08T08:22:02.044204+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.044204+0000', 'last_undegraded': '2023-12-08T08:22:02.044204+0000', 'last_fullsized': '2023-12-08T08:22:02.044204+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:22:07.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2023-12-08T08:22:07.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.053300+0000', 'last_change': '2023-12-08T08:22:02.053300+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.053300+0000', 'last_undegraded': '2023-12-08T08:22:02.053300+0000', 'last_fullsized': '2023-12-08T08:22:02.053300+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:22:07.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2023-12-08T08:22:07.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.054130+0000', 'last_change': '2023-12-08T08:22:02.054130+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.054130+0000', 'last_undegraded': '2023-12-08T08:22:02.054130+0000', 'last_fullsized': '2023-12-08T08:22:02.054130+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:22:07.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2023-12-08T08:22:07.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.051948+0000', 'last_change': '2023-12-08T08:22:02.051948+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.051948+0000', 'last_undegraded': '2023-12-08T08:22:02.051948+0000', 'last_fullsized': '2023-12-08T08:22:02.051948+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:22:07.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2023-12-08T08:22:07.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.045450+0000', 'last_change': '2023-12-08T08:22:02.045450+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.045450+0000', 'last_undegraded': '2023-12-08T08:22:02.045450+0000', 'last_fullsized': '2023-12-08T08:22:02.045450+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:22:07.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2023-12-08T08:22:07.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.049037+0000', 'last_change': '2023-12-08T08:22:02.049037+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.049037+0000', 'last_undegraded': '2023-12-08T08:22:02.049037+0000', 'last_fullsized': '2023-12-08T08:22:02.049037+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:22:07.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2023-12-08T08:22:07.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.050946+0000', 'last_change': '2023-12-08T08:22:02.050946+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.050946+0000', 'last_undegraded': '2023-12-08T08:22:02.050946+0000', 'last_fullsized': '2023-12-08T08:22:02.050946+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:22:07.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-12-08T08:22:07.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.055769+0000', 'last_change': '2023-12-08T08:22:02.055769+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.055769+0000', 'last_undegraded': '2023-12-08T08:22:02.055769+0000', 'last_fullsized': '2023-12-08T08:22:02.055769+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:22:07.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2023-12-08T08:22:07.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.045441+0000', 'last_change': '2023-12-08T08:22:02.045441+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.045441+0000', 'last_undegraded': '2023-12-08T08:22:02.045441+0000', 'last_fullsized': '2023-12-08T08:22:02.045441+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:22:07.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2023-12-08T08:22:07.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.049911+0000', 'last_change': '2023-12-08T08:22:02.049911+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.049911+0000', 'last_undegraded': '2023-12-08T08:22:02.049911+0000', 'last_fullsized': '2023-12-08T08:22:02.049911+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:22:07.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2023-12-08T08:22:07.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.053600+0000', 'last_change': '2023-12-08T08:22:02.053600+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.053600+0000', 'last_undegraded': '2023-12-08T08:22:02.053600+0000', 'last_fullsized': '2023-12-08T08:22:02.053600+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:22:07.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2023-12-08T08:22:07.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.051277+0000', 'last_change': '2023-12-08T08:22:02.051277+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.051277+0000', 'last_undegraded': '2023-12-08T08:22:02.051277+0000', 'last_fullsized': '2023-12-08T08:22:02.051277+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:22:07.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2023-12-08T08:22:07.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.046507+0000', 'last_change': '2023-12-08T08:22:02.046507+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.046507+0000', 'last_undegraded': '2023-12-08T08:22:02.046507+0000', 'last_fullsized': '2023-12-08T08:22:02.046507+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:22:07.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-12-08T08:22:07.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.059365+0000', 'last_change': '2023-12-08T08:22:02.059365+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.059365+0000', 'last_undegraded': '2023-12-08T08:22:02.059365+0000', 'last_fullsized': '2023-12-08T08:22:02.059365+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:22:07.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-12-08T08:22:07.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.055314+0000', 'last_change': '2023-12-08T08:22:02.055314+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.055314+0000', 'last_undegraded': '2023-12-08T08:22:02.055314+0000', 'last_fullsized': '2023-12-08T08:22:02.055314+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:22:07.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2023-12-08T08:22:07.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.043612+0000', 'last_change': '2023-12-08T08:22:02.043612+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.043612+0000', 'last_undegraded': '2023-12-08T08:22:02.043612+0000', 'last_fullsized': '2023-12-08T08:22:02.043612+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:22:07.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2023-12-08T08:22:07.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.050041+0000', 'last_change': '2023-12-08T08:22:02.050041+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.050041+0000', 'last_undegraded': '2023-12-08T08:22:02.050041+0000', 'last_fullsized': '2023-12-08T08:22:02.050041+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:22:07.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2023-12-08T08:22:07.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.044367+0000', 'last_change': '2023-12-08T08:22:02.044367+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.044367+0000', 'last_undegraded': '2023-12-08T08:22:02.044367+0000', 'last_fullsized': '2023-12-08T08:22:02.044367+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:22:07.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2023-12-08T08:22:07.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.049394+0000', 'last_change': '2023-12-08T08:22:02.049394+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.049394+0000', 'last_undegraded': '2023-12-08T08:22:02.049394+0000', 'last_fullsized': '2023-12-08T08:22:02.049394+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:22:07.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2023-12-08T08:22:07.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.043780+0000', 'last_change': '2023-12-08T08:22:02.043780+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.043780+0000', 'last_undegraded': '2023-12-08T08:22:02.043780+0000', 'last_fullsized': '2023-12-08T08:22:02.043780+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:22:07.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2023-12-08T08:22:07.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.044376+0000', 'last_change': '2023-12-08T08:22:02.044376+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.044376+0000', 'last_undegraded': '2023-12-08T08:22:02.044376+0000', 'last_fullsized': '2023-12-08T08:22:02.044376+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:22:07.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2023-12-08T08:22:07.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:22:02.045170+0000', 'last_change': '2023-12-08T08:22:02.045170+0000', 'last_active': '2023-12-08T08:22:02.034347+0000', 'last_peered': '2023-12-08T08:22:02.034347+0000', 'last_clean': '2023-12-08T08:22:02.034347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:22:02.045170+0000', 'last_undegraded': '2023-12-08T08:22:02.045170+0000', 'last_fullsized': '2023-12-08T08:22:02.045170+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'last_clean_scrub_stamp': '2023-12-08T08:22:02.034347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:22:07.892 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-08T08:22:08.036 INFO:tasks.ceph.mds.c.smithi088.stderr:2023-12-08T08:22:08.031+0000 7fdc2dcbf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:22:08.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.043+0000 7fecd903a640 1 Processor -- start 2023-12-08T08:22:08.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.043+0000 7fecd903a640 1 -- start start 2023-12-08T08:22:08.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.047+0000 7fecd903a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fecd41552e0 0x7fecd40c23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:08.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.047+0000 7fecd903a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fecd40c2920 0x7fecd40c4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:08.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.047+0000 7fecd903a640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd40c5fb0 con 0x7fecd40c67d0 2023-12-08T08:22:08.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.047+0000 7fecd903a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd41556c0 con 0x7fecd41552e0 2023-12-08T08:22:08.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.047+0000 7fecd903a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd40c2db0 con 0x7fecd40c2920 2023-12-08T08:22:08.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.047+0000 7fecd3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fecd41552e0 0x7fecd40c23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:08.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.047+0000 7fecd3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fecd41552e0 0x7fecd40c23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53786/0 (socket says 172.21.15.88:53786) 2023-12-08T08:22:08.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.047+0000 7fecd3fff640 1 -- 172.21.15.88:0/2272374721 learned_addr learned my addr 172.21.15.88:0/2272374721 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:08.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.047+0000 7fecd3fff640 1 -- 172.21.15.88:0/2272374721 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fecd40c2920 msgr2=0x7fecd40c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:08.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.047+0000 7fecd3fff640 1 --2- 172.21.15.88:0/2272374721 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fecd40c2920 0x7fecd40c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:08.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.047+0000 7fecd3fff640 1 -- 172.21.15.88:0/2272374721 >> v1:172.21.15.148:6789/0 conn(0x7fecd40c67d0 legacy=0x7fecd40c4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:08.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.047+0000 7fecd3fff640 1 -- 172.21.15.88:0/2272374721 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd40700b0 con 0x7fecd41552e0 2023-12-08T08:22:08.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.051+0000 7fecd3fff640 1 --2- 172.21.15.88:0/2272374721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd41552e0 0x7fecd40c23e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fecc4009870 tx=0x7fecc401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3503fb6a5ccee5f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:08.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.051+0000 7fecd2ffd640 1 -- 172.21.15.88:0/2272374721 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc40aa5f0 con 0x7fecd41552e0 2023-12-08T08:22:08.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.051+0000 7fecd2ffd640 1 -- 172.21.15.88:0/2272374721 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc40aa750 con 0x7fecd41552e0 2023-12-08T08:22:08.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.051+0000 7fecd2ffd640 1 -- 172.21.15.88:0/2272374721 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc40aaae0 con 0x7fecd41552e0 2023-12-08T08:22:08.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.051+0000 7fecd903a640 1 -- 172.21.15.88:0/2272374721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd41552e0 msgr2=0x7fecd40c23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:08.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.051+0000 7fecd903a640 1 --2- 172.21.15.88:0/2272374721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd41552e0 0x7fecd40c23e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fecc4009870 tx=0x7fecc401c4d0 comp rx=0 tx=0).stop 2023-12-08T08:22:08.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.051+0000 7fecd903a640 1 -- 172.21.15.88:0/2272374721 shutdown_connections 2023-12-08T08:22:08.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.051+0000 7fecd903a640 1 --2- 172.21.15.88:0/2272374721 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fecd40c2920 0x7fecd40c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:08.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.051+0000 7fecd903a640 1 --2- 172.21.15.88:0/2272374721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd41552e0 0x7fecd40c23e0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:08.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.051+0000 7fecd903a640 1 -- 172.21.15.88:0/2272374721 >> 172.21.15.88:0/2272374721 conn(0x7fecd40c79e0 msgr2=0x7fecd40c7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:08.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.051+0000 7fecd903a640 1 -- 172.21.15.88:0/2272374721 shutdown_connections 2023-12-08T08:22:08.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.051+0000 7fecd903a640 1 -- 172.21.15.88:0/2272374721 wait complete. 2023-12-08T08:22:08.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.051+0000 7fecd903a640 1 Processor -- start 2023-12-08T08:22:08.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.051+0000 7fecd903a640 1 -- start start 2023-12-08T08:22:08.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.055+0000 7fecd903a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fecd40c2920 0x7fecd41513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:08.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.055+0000 7fecd903a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fecd40c67d0 0x7fecd4151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:08.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.055+0000 7fecd903a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd41552e0 0x7fecd414f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:08.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.055+0000 7fecd903a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd414ddc0 con 0x7fecd41552e0 2023-12-08T08:22:08.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.055+0000 7fecd903a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd414e010 con 0x7fecd40c67d0 2023-12-08T08:22:08.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.055+0000 7fecd903a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd414e2f0 con 0x7fecd40c2920 2023-12-08T08:22:08.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.055+0000 7fecd8839640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd41552e0 0x7fecd414f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:08.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.055+0000 7fecd8839640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd41552e0 0x7fecd414f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53794/0 (socket says 172.21.15.88:53794) 2023-12-08T08:22:08.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.055+0000 7fecd8839640 1 -- 172.21.15.88:0/4026475802 learned_addr learned my addr 172.21.15.88:0/4026475802 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:08.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.055+0000 7fecd3fff640 1 --2- 172.21.15.88:0/4026475802 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fecd40c2920 0x7fecd41513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:08.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.055+0000 7fecd37fe640 1 --2- 172.21.15.88:0/4026475802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fecd40c67d0 0x7fecd4151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:08.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.055+0000 7fecd8839640 1 -- 172.21.15.88:0/4026475802 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fecd40c2920 msgr2=0x7fecd41513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:08.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.055+0000 7fecd8839640 1 --2- 172.21.15.88:0/4026475802 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fecd40c2920 0x7fecd41513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:08.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.055+0000 7fecd8839640 1 -- 172.21.15.88:0/4026475802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fecd40c67d0 msgr2=0x7fecd4151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:08.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.055+0000 7fecd8839640 1 --2- 172.21.15.88:0/4026475802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fecd40c67d0 0x7fecd4151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:08.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.055+0000 7fecd8839640 1 -- 172.21.15.88:0/4026475802 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc40094d0 con 0x7fecd41552e0 2023-12-08T08:22:08.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.055+0000 7fecd37fe640 1 --2- 172.21.15.88:0/4026475802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fecd40c67d0 0x7fecd4151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:08.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.055+0000 7fecd8839640 1 --2- 172.21.15.88:0/4026475802 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd41552e0 0x7fecd414f0b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7feccc00b970 tx=0x7feccc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:08.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.055+0000 7fecd0ff9640 1 -- 172.21.15.88:0/4026475802 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc00cb40 con 0x7fecd41552e0 2023-12-08T08:22:08.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.055+0000 7fecd0ff9640 1 -- 172.21.15.88:0/4026475802 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feccc00ccc0 con 0x7fecd41552e0 2023-12-08T08:22:08.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.055+0000 7fecd0ff9640 1 -- 172.21.15.88:0/4026475802 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc014680 con 0x7fecd41552e0 2023-12-08T08:22:08.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.055+0000 7fecd903a640 1 -- 172.21.15.88:0/4026475802 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd414e5d0 con 0x7fecd41552e0 2023-12-08T08:22:08.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.055+0000 7fecd903a640 1 -- 172.21.15.88:0/4026475802 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd414eb90 con 0x7fecd41552e0 2023-12-08T08:22:08.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.055+0000 7fecd903a640 1 -- 172.21.15.88:0/4026475802 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd40674b0 con 0x7fecd41552e0 2023-12-08T08:22:08.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.055+0000 7fecd0ff9640 1 -- 172.21.15.88:0/4026475802 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feccc01d3b0 con 0x7fecd41552e0 2023-12-08T08:22:08.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.059+0000 7fecd0ff9640 1 --2- 172.21.15.88:0/4026475802 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fecc0066470 0x7fecc0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:08.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.059+0000 7fecd0ff9640 1 -- 172.21.15.88:0/4026475802 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feccc083dc0 con 0x7fecd41552e0 2023-12-08T08:22:08.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.059+0000 7fecd3fff640 1 --2- 172.21.15.88:0/4026475802 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fecc0066470 0x7fecc0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:08.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.059+0000 7fecd3fff640 1 --2- 172.21.15.88:0/4026475802 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fecc0066470 0x7fecc0068930 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fecc40ae000 tx=0x7fecc40b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:08.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.063+0000 7fecd0ff9640 1 -- 172.21.15.88:0/4026475802 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feccc051250 con 0x7fecd41552e0 2023-12-08T08:22:08.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.267+0000 7fecd903a640 1 -- 172.21.15.88:0/4026475802 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fecd40a73e0 con 0x7fecd41552e0 2023-12-08T08:22:08.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.267+0000 7fecd0ff9640 1 -- 172.21.15.88:0/4026475802 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1581 (secure 0 0 0) 0x7feccc019640 con 0x7fecd41552e0 2023-12-08T08:22:08.270 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:08.270 INFO:teuthology.orchestra.run.smithi088.stdout:{"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":132,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":50,"num_osds":8,"num_up_osds":8,"osd_up_since":1702023607,"num_in_osds":8,"osd_in_since":1702023598,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":226082816,"bytes_avail":772868030464,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":32,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":5793}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2023-12-08T08:21:08.757430+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-08T08:22:08.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.267+0000 7fecd903a640 1 -- 172.21.15.88:0/4026475802 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fecc0066470 msgr2=0x7fecc0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:08.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.267+0000 7fecd903a640 1 --2- 172.21.15.88:0/4026475802 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fecc0066470 0x7fecc0068930 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fecc40ae000 tx=0x7fecc40b5040 comp rx=0 tx=0).stop 2023-12-08T08:22:08.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.267+0000 7fecd903a640 1 -- 172.21.15.88:0/4026475802 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd41552e0 msgr2=0x7fecd414f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:08.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.267+0000 7fecd903a640 1 --2- 172.21.15.88:0/4026475802 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd41552e0 0x7fecd414f0b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7feccc00b970 tx=0x7feccc00be30 comp rx=0 tx=0).stop 2023-12-08T08:22:08.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.267+0000 7fecd903a640 1 -- 172.21.15.88:0/4026475802 shutdown_connections 2023-12-08T08:22:08.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.267+0000 7fecd903a640 1 --2- 172.21.15.88:0/4026475802 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fecc0066470 0x7fecc0068930 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:08.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.267+0000 7fecd903a640 1 --2- 172.21.15.88:0/4026475802 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd41552e0 0x7fecd414f0b0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:08.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.267+0000 7fecd903a640 1 --2- 172.21.15.88:0/4026475802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fecd40c67d0 0x7fecd4151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:08.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.267+0000 7fecd903a640 1 --2- 172.21.15.88:0/4026475802 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fecd40c2920 0x7fecd41513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:08.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.267+0000 7fecd903a640 1 -- 172.21.15.88:0/4026475802 >> 172.21.15.88:0/4026475802 conn(0x7fecd40c79e0 msgr2=0x7fecd40a7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:08.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.267+0000 7fecd903a640 1 -- 172.21.15.88:0/4026475802 shutdown_connections 2023-12-08T08:22:08.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.267+0000 7fecd903a640 1 -- 172.21.15.88:0/4026475802 wait complete. 2023-12-08T08:22:08.292 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-08T08:22:08.292 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:22:08.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.423+0000 7f080169c640 1 Processor -- start 2023-12-08T08:22:08.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.423+0000 7f080169c640 1 -- start start 2023-12-08T08:22:08.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f080169c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07fc151ec0 0x7f07fc155100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:08.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f080169c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07fc155640 con 0x7f07fc0c47c0 2023-12-08T08:22:08.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f080169c640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07fc0c8aa0 con 0x7f07fc06b320 2023-12-08T08:22:08.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f080169c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc0c9060 con 0x7f07fc151ec0 2023-12-08T08:22:08.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f07f27fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f07fc0c47c0 0x7f07fc0c94f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39066/0 (socket says 172.21.15.88:39066) 2023-12-08T08:22:08.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f07f27fc640 1 -- 172.21.15.88:0/150076024 learned_addr learned my addr 172.21.15.88:0/150076024 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:08.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f07faffd640 1 --2- 172.21.15.88:0/150076024 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07fc151ec0 0x7f07fc155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:08.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f07fa7fc640 1 -- 172.21.15.88:0/150076024 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2411262031 0 0) 0x7f07e4001120 con 0x7f07fc0c47c0 2023-12-08T08:22:08.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f07fa7fc640 1 -- 172.21.15.88:0/150076024 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07e8003530 con 0x7f07fc0c47c0 2023-12-08T08:22:08.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f07fa7fc640 1 -- 172.21.15.88:0/150076024 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2135618046 0 0) 0x7f07e8003530 con 0x7f07fc0c47c0 2023-12-08T08:22:08.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f07fa7fc640 1 -- 172.21.15.88:0/150076024 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07fc151ec0 msgr2=0x7f07fc155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:08.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f07fa7fc640 1 --2- 172.21.15.88:0/150076024 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07fc151ec0 0x7f07fc155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:08.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f07fa7fc640 1 -- 172.21.15.88:0/150076024 >> v1:172.21.15.148:6789/0 conn(0x7f07fc06b320 legacy=0x7f07fc0c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:08.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f07fa7fc640 1 -- 172.21.15.88:0/150076024 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07fc0c4d30 con 0x7f07fc0c47c0 2023-12-08T08:22:08.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f07fa7fc640 1 -- 172.21.15.88:0/150076024 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f07e4001810 con 0x7f07fc0c47c0 2023-12-08T08:22:08.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f07fa7fc640 1 -- 172.21.15.88:0/150076024 >> v1:172.21.15.88:6789/0 conn(0x7f07fc0c47c0 legacy=0x7f07fc0c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:08.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f07fa7fc640 1 --2- 172.21.15.88:0/150076024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07e80039b0 0x7f07e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:08.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f07fa7fc640 1 --2- 172.21.15.88:0/150076024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07e80047d0 0x7f07e8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:08.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f07fa7fc640 1 --2- 172.21.15.88:0/150076024 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07fc151ec0 0x7f07e80051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:08.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f07fa7fc640 1 -- 172.21.15.88:0/150076024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc0c9060 con 0x7f07e80039b0 2023-12-08T08:22:08.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f07fa7fc640 1 -- 172.21.15.88:0/150076024 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e800baa0 con 0x7f07e80047d0 2023-12-08T08:22:08.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f07fa7fc640 1 -- 172.21.15.88:0/150076024 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e800bc60 con 0x7f07fc151ec0 2023-12-08T08:22:08.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f07faffd640 1 --2- 172.21.15.88:0/150076024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07e80039b0 0x7f07e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:08.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f07fb7fe640 1 --2- 172.21.15.88:0/150076024 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07fc151ec0 0x7f07e80051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:08.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f07f27fc640 1 --2- 172.21.15.88:0/150076024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07e80047d0 0x7f07e8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:08.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f07faffd640 1 -- 172.21.15.88:0/150076024 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07fc151ec0 msgr2=0x7f07e80051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:08.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f07faffd640 1 --2- 172.21.15.88:0/150076024 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07fc151ec0 0x7f07e80051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:08.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f07faffd640 1 -- 172.21.15.88:0/150076024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07e80047d0 msgr2=0x7f07e8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:08.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f07faffd640 1 --2- 172.21.15.88:0/150076024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07e80047d0 0x7f07e8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:08.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.427+0000 7f07faffd640 1 -- 172.21.15.88:0/150076024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e8003530 con 0x7f07e80039b0 2023-12-08T08:22:08.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.431+0000 7f07faffd640 1 --2- 172.21.15.88:0/150076024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07e80039b0 0x7f07e8003dd0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009ae0 tx=0x7f07ec01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b813e18d6248528 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:08.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.431+0000 7f07fa7fc640 1 -- 172.21.15.88:0/150076024 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec0a5530 con 0x7f07e80039b0 2023-12-08T08:22:08.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.431+0000 7f07fa7fc640 1 -- 172.21.15.88:0/150076024 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec0a5690 con 0x7f07e80039b0 2023-12-08T08:22:08.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.431+0000 7f07fa7fc640 1 -- 172.21.15.88:0/150076024 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec0a5a40 con 0x7f07e80039b0 2023-12-08T08:22:08.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.431+0000 7f080169c640 1 -- 172.21.15.88:0/150076024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07e80039b0 msgr2=0x7f07e8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:08.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.431+0000 7f080169c640 1 --2- 172.21.15.88:0/150076024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07e80039b0 0x7f07e8003dd0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009ae0 tx=0x7f07ec01ca50 comp rx=0 tx=0).stop 2023-12-08T08:22:08.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.431+0000 7f07fb7fe640 1 -- 172.21.15.88:0/150076024 reap_dead start 2023-12-08T08:22:08.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.431+0000 7f080169c640 1 -- 172.21.15.88:0/150076024 shutdown_connections 2023-12-08T08:22:08.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.431+0000 7f080169c640 1 -- 172.21.15.88:0/150076024 >> 172.21.15.88:0/150076024 conn(0x7f07fc0c9e40 msgr2=0x7f07fc0ca250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:08.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.431+0000 7f080169c640 1 -- 172.21.15.88:0/150076024 shutdown_connections 2023-12-08T08:22:08.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.431+0000 7f080169c640 1 -- 172.21.15.88:0/150076024 wait complete. 2023-12-08T08:22:08.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.431+0000 7f080169c640 1 Processor -- start 2023-12-08T08:22:08.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.431+0000 7f080169c640 1 -- start start 2023-12-08T08:22:08.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.435+0000 7f080169c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07e80039b0 0x7f07fc147a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:08.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.435+0000 7f080169c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07fc1f0260 0x7f07fc0c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:08.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.435+0000 7f080169c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07fc0c38f0 0x7f07fc1546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:08.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.435+0000 7f080169c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc14cc20 con 0x7f07fc0c38f0 2023-12-08T08:22:08.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.435+0000 7f080169c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc14c2f0 con 0x7f07e80039b0 2023-12-08T08:22:08.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.435+0000 7f080169c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc14c5d0 con 0x7f07fc1f0260 2023-12-08T08:22:08.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.435+0000 7f07fb7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07fc0c38f0 0x7f07fc1546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:08.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.435+0000 7f07fb7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07fc0c38f0 0x7f07fc1546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53816/0 (socket says 172.21.15.88:53816) 2023-12-08T08:22:08.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.435+0000 7f07fb7fe640 1 -- 172.21.15.88:0/1958969635 learned_addr learned my addr 172.21.15.88:0/1958969635 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:08.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.435+0000 7f07faffd640 1 --2- 172.21.15.88:0/1958969635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07e80039b0 0x7f07fc147a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:08.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.435+0000 7f07f27fc640 1 --2- 172.21.15.88:0/1958969635 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07fc1f0260 0x7f07fc0c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:08.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.435+0000 7f07fb7fe640 1 -- 172.21.15.88:0/1958969635 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07fc1f0260 msgr2=0x7f07fc0c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:08.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.435+0000 7f07fb7fe640 1 --2- 172.21.15.88:0/1958969635 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07fc1f0260 0x7f07fc0c33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:08.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.435+0000 7f07fb7fe640 1 -- 172.21.15.88:0/1958969635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07e80039b0 msgr2=0x7f07fc147a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:08.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.435+0000 7f07fb7fe640 1 --2- 172.21.15.88:0/1958969635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07e80039b0 0x7f07fc147a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:08.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.435+0000 7f07fb7fe640 1 -- 172.21.15.88:0/1958969635 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07fc14c8b0 con 0x7f07fc0c38f0 2023-12-08T08:22:08.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.435+0000 7f07faffd640 1 --2- 172.21.15.88:0/1958969635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07e80039b0 0x7f07fc147a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:08.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.435+0000 7f07fb7fe640 1 --2- 172.21.15.88:0/1958969635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07fc0c38f0 0x7f07fc1546a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f07fc06a8a0 tx=0x7f07f400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:08.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.435+0000 7f07f3fff640 1 -- 172.21.15.88:0/1958969635 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f4003980 con 0x7f07fc0c38f0 2023-12-08T08:22:08.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.435+0000 7f07f3fff640 1 -- 172.21.15.88:0/1958969635 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f4003ae0 con 0x7f07fc0c38f0 2023-12-08T08:22:08.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.435+0000 7f07f3fff640 1 -- 172.21.15.88:0/1958969635 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f4003e90 con 0x7f07fc0c38f0 2023-12-08T08:22:08.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.435+0000 7f080169c640 1 -- 172.21.15.88:0/1958969635 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07fc147f60 con 0x7f07fc0c38f0 2023-12-08T08:22:08.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.435+0000 7f080169c640 1 -- 172.21.15.88:0/1958969635 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07fc147090 con 0x7f07fc0c38f0 2023-12-08T08:22:08.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.435+0000 7f080169c640 1 -- 172.21.15.88:0/1958969635 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07fc06cd40 con 0x7f07fc0c38f0 2023-12-08T08:22:08.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.435+0000 7f07f3fff640 1 -- 172.21.15.88:0/1958969635 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f07f40050d0 con 0x7f07fc0c38f0 2023-12-08T08:22:08.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.439+0000 7f07f3fff640 1 --2- 172.21.15.88:0/1958969635 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f07dc0664a0 0x7f07dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:08.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.439+0000 7f07f3fff640 1 -- 172.21.15.88:0/1958969635 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07f4083c30 con 0x7f07fc0c38f0 2023-12-08T08:22:08.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.439+0000 7f07faffd640 1 --2- 172.21.15.88:0/1958969635 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f07dc0664a0 0x7f07dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:08.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.439+0000 7f07faffd640 1 --2- 172.21.15.88:0/1958969635 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f07dc0664a0 0x7f07dc068960 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0af000 tx=0x7f07ec0046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:08.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.443+0000 7f07f3fff640 1 -- 172.21.15.88:0/1958969635 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f07f40510a0 con 0x7f07fc0c38f0 2023-12-08T08:22:08.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.587+0000 7f080169c640 1 -- 172.21.15.88:0/1958969635 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f07fc153570 con 0x7f07dc0664a0 2023-12-08T08:22:08.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.595+0000 7f07f3fff640 1 -- 172.21.15.88:0/1958969635 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283477 (secure 0 0 0) 0x7f07fc153570 con 0x7f07dc0664a0 2023-12-08T08:22:08.602 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:08.604 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:22:08.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.599+0000 7f080169c640 1 -- 172.21.15.88:0/1958969635 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f07dc0664a0 msgr2=0x7f07dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:08.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.599+0000 7f080169c640 1 --2- 172.21.15.88:0/1958969635 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f07dc0664a0 0x7f07dc068960 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0af000 tx=0x7f07ec0046d0 comp rx=0 tx=0).stop 2023-12-08T08:22:08.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.599+0000 7f080169c640 1 -- 172.21.15.88:0/1958969635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07fc0c38f0 msgr2=0x7f07fc1546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:08.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.599+0000 7f080169c640 1 --2- 172.21.15.88:0/1958969635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07fc0c38f0 0x7f07fc1546a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f07fc06a8a0 tx=0x7f07f400ec10 comp rx=0 tx=0).stop 2023-12-08T08:22:08.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.599+0000 7f080169c640 1 -- 172.21.15.88:0/1958969635 shutdown_connections 2023-12-08T08:22:08.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.599+0000 7f080169c640 1 --2- 172.21.15.88:0/1958969635 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f07dc0664a0 0x7f07dc068960 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:08.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.599+0000 7f080169c640 1 --2- 172.21.15.88:0/1958969635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07fc0c38f0 0x7f07fc1546a0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:08.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.599+0000 7f080169c640 1 --2- 172.21.15.88:0/1958969635 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07fc1f0260 0x7f07fc0c33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:08.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.599+0000 7f080169c640 1 --2- 172.21.15.88:0/1958969635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07e80039b0 0x7f07fc147a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:08.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.599+0000 7f080169c640 1 -- 172.21.15.88:0/1958969635 >> 172.21.15.88:0/1958969635 conn(0x7f07fc0c9e40 msgr2=0x7f07fc0aa8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:08.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.599+0000 7f080169c640 1 -- 172.21.15.88:0/1958969635 shutdown_connections 2023-12-08T08:22:08.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:08.599+0000 7f080169c640 1 -- 172.21.15.88:0/1958969635 wait complete. 2023-12-08T08:22:08.622 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2023-12-08T08:22:06.769127+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220784,"kb_used_data":4584,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753936,"statfs":{"total":773094113280,"available":772868030464,"internally_reserved":0,"allocated":4694016,"data_stored":3080330,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.733893"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.059484+0000","last_change":"2023-12-08T08:22:02.059484+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.059484+0000","last_undegraded":"2023-12-08T08:22:02.059484+0000","last_fullsized":"2023-12-08T08:22:02.059484+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.055012+0000","last_change":"2023-12-08T08:22:02.055012+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.055012+0000","last_undegraded":"2023-12-08T08:22:02.055012+0000","last_fullsized":"2023-12-08T08:22:02.055012+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.053803+0000","last_change":"2023-12-08T08:22:02.053803+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.053803+0000","last_undegraded":"2023-12-08T08:22:02.053803+0000","last_fullsized":"2023-12-08T08:22:02.053803+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.060413+0000","last_change":"2023-12-08T08:22:02.060413+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.060413+0000","last_undegraded":"2023-12-08T08:22:02.060413+0000","last_fullsized":"2023-12-08T08:22:02.060413+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.065877+0000","last_change":"2023-12-08T08:22:02.065877+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.065877+0000","last_undegraded":"2023-12-08T08:22:02.065877+0000","last_fullsized":"2023-12-08T08:22:02.065877+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.048960+0000","last_change":"2023-12-08T08:22:02.048960+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.048960+0000","last_undegraded":"2023-12-08T08:22:02.048960+0000","last_fullsized":"2023-12-08T08:22:02.048960+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.046276+0000","last_change":"2023-12-08T08:22:02.046276+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.046276+0000","last_undegraded":"2023-12-08T08:22:02.046276+0000","last_fullsized":"2023-12-08T08:22:02.046276+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051226+0000","last_change":"2023-12-08T08:22:02.051226+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051226+0000","last_undegraded":"2023-12-08T08:22:02.051226+0000","last_fullsized":"2023-12-08T08:22:02.051226+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045291+0000","last_change":"2023-12-08T08:22:02.045291+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045291+0000","last_undegraded":"2023-12-08T08:22:02.045291+0000","last_fullsized":"2023-12-08T08:22:02.045291+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044805+0000","last_change":"2023-12-08T08:22:02.044805+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044805+0000","last_undegraded":"2023-12-08T08:22:02.044805+0000","last_fullsized":"2023-12-08T08:22:02.044805+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044852+0000","last_change":"2023-12-08T08:22:02.044852+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044852+0000","last_undegraded":"2023-12-08T08:22:02.044852+0000","last_fullsized":"2023-12-08T08:22:02.044852+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.059919+0000","last_change":"2023-12-08T08:22:02.059919+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.059919+0000","last_undegraded":"2023-12-08T08:22:02.059919+0000","last_fullsized":"2023-12-08T08:22:02.059919+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049732+0000","last_change":"2023-12-08T08:22:02.049732+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049732+0000","last_undegraded":"2023-12-08T08:22:02.049732+0000","last_fullsized":"2023-12-08T08:22:02.049732+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045770+0000","last_change":"2023-12-08T08:22:02.045770+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045770+0000","last_undegraded":"2023-12-08T08:22:02.045770+0000","last_fullsized":"2023-12-08T08:22:02.045770+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045164+0000","last_change":"2023-12-08T08:22:02.045164+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045164+0000","last_undegraded":"2023-12-08T08:22:02.045164+0000","last_fullsized":"2023-12-08T08:22:02.045164+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.046662+0000","last_change":"2023-12-08T08:22:02.046662+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.046662+0000","last_undegraded":"2023-12-08T08:22:02.046662+0000","last_fullsized":"2023-12-08T08:22:02.046662+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049678+0000","last_change":"2023-12-08T08:22:02.049678+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049678+0000","last_undegraded":"2023-12-08T08:22:02.049678+0000","last_fullsized":"2023-12-08T08:22:02.049678+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051550+0000","last_change":"2023-12-08T08:22:02.051550+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051550+0000","last_undegraded":"2023-12-08T08:22:02.051550+0000","last_fullsized":"2023-12-08T08:22:02.051550+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.064039+0000","last_change":"2023-12-08T08:22:02.064039+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.064039+0000","last_undegraded":"2023-12-08T08:22:02.064039+0000","last_fullsized":"2023-12-08T08:22:02.064039+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045927+0000","last_change":"2023-12-08T08:22:02.045927+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045927+0000","last_undegraded":"2023-12-08T08:22:02.045927+0000","last_fullsized":"2023-12-08T08:22:02.045927+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.052487+0000","last_change":"2023-12-08T08:22:02.052487+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.052487+0000","last_undegraded":"2023-12-08T08:22:02.052487+0000","last_fullsized":"2023-12-08T08:22:02.052487+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.046251+0000","last_change":"2023-12-08T08:22:02.046251+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.046251+0000","last_undegraded":"2023-12-08T08:22:02.046251+0000","last_fullsized":"2023-12-08T08:22:02.046251+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051264+0000","last_change":"2023-12-08T08:22:02.051264+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051264+0000","last_undegraded":"2023-12-08T08:22:02.051264+0000","last_fullsized":"2023-12-08T08:22:02.051264+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.050511+0000","last_change":"2023-12-08T08:22:02.050511+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.050511+0000","last_undegraded":"2023-12-08T08:22:02.050511+0000","last_fullsized":"2023-12-08T08:22:02.050511+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.058924+0000","last_change":"2023-12-08T08:22:02.058924+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.058924+0000","last_undegraded":"2023-12-08T08:22:02.058924+0000","last_fullsized":"2023-12-08T08:22:02.058924+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.060181+0000","last_change":"2023-12-08T08:22:02.060181+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.060181+0000","last_undegraded":"2023-12-08T08:22:02.060181+0000","last_fullsized":"2023-12-08T08:22:02.060181+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.050768+0000","last_change":"2023-12-08T08:22:02.050768+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.050768+0000","last_undegraded":"2023-12-08T08:22:02.050768+0000","last_fullsized":"2023-12-08T08:22:02.050768+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.063344+0000","last_change":"2023-12-08T08:22:02.063344+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.063344+0000","last_undegraded":"2023-12-08T08:22:02.063344+0000","last_fullsized":"2023-12-08T08:22:02.063344+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044610+0000","last_change":"2023-12-08T08:22:02.044610+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044610+0000","last_undegraded":"2023-12-08T08:22:02.044610+0000","last_fullsized":"2023-12-08T08:22:02.044610+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049106+0000","last_change":"2023-12-08T08:22:02.049106+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049106+0000","last_undegraded":"2023-12-08T08:22:02.049106+0000","last_fullsized":"2023-12-08T08:22:02.049106+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.064493+0000","last_change":"2023-12-08T08:22:02.064493+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.064493+0000","last_undegraded":"2023-12-08T08:22:02.064493+0000","last_fullsized":"2023-12-08T08:22:02.064493+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.046147+0000","last_change":"2023-12-08T08:22:02.046147+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.046147+0000","last_undegraded":"2023-12-08T08:22:02.046147+0000","last_fullsized":"2023-12-08T08:22:02.046147+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051096+0000","last_change":"2023-12-08T08:22:02.051096+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051096+0000","last_undegraded":"2023-12-08T08:22:02.051096+0000","last_fullsized":"2023-12-08T08:22:02.051096+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.071534+0000","last_change":"2023-12-08T08:22:02.066070+0000","last_active":"2023-12-08T08:22:02.071534+0000","last_peered":"2023-12-08T08:22:02.071534+0000","last_clean":"2023-12-08T08:22:02.071534+0000","last_became_active":"2023-12-08T08:22:02.065684+0000","last_became_peered":"2023-12-08T08:22:02.065684+0000","last_unstale":"2023-12-08T08:22:02.071534+0000","last_undegraded":"2023-12-08T08:22:02.071534+0000","last_fullsized":"2023-12-08T08:22:02.071534+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:01:23.302095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.043952+0000","last_change":"2023-12-08T08:22:02.043952+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.043952+0000","last_undegraded":"2023-12-08T08:22:02.043952+0000","last_fullsized":"2023-12-08T08:22:02.043952+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.074479+0000","last_change":"2023-12-08T08:22:02.068162+0000","last_active":"2023-12-08T08:22:02.074479+0000","last_peered":"2023-12-08T08:22:02.074479+0000","last_clean":"2023-12-08T08:22:02.074479+0000","last_became_active":"2023-12-08T08:22:02.067918+0000","last_became_peered":"2023-12-08T08:22:02.067918+0000","last_unstale":"2023-12-08T08:22:02.074479+0000","last_undegraded":"2023-12-08T08:22:02.074479+0000","last_fullsized":"2023-12-08T08:22:02.074479+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:09:21.024470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.054028+0000","last_change":"2023-12-08T08:22:02.054028+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.054028+0000","last_undegraded":"2023-12-08T08:22:02.054028+0000","last_fullsized":"2023-12-08T08:22:02.054028+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.068247+0000","last_change":"2023-12-08T08:22:02.061868+0000","last_active":"2023-12-08T08:22:02.068247+0000","last_peered":"2023-12-08T08:22:02.068247+0000","last_clean":"2023-12-08T08:22:02.068247+0000","last_became_active":"2023-12-08T08:22:02.061570+0000","last_became_peered":"2023-12-08T08:22:02.061570+0000","last_unstale":"2023-12-08T08:22:02.068247+0000","last_undegraded":"2023-12-08T08:22:02.068247+0000","last_fullsized":"2023-12-08T08:22:02.068247+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:55:21.616638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.050433+0000","last_change":"2023-12-08T08:22:02.050433+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.050433+0000","last_undegraded":"2023-12-08T08:22:02.050433+0000","last_fullsized":"2023-12-08T08:22:02.050433+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076694+0000","last_change":"2023-12-08T08:22:02.073413+0000","last_active":"2023-12-08T08:22:02.076694+0000","last_peered":"2023-12-08T08:22:02.076694+0000","last_clean":"2023-12-08T08:22:02.076694+0000","last_became_active":"2023-12-08T08:22:02.073043+0000","last_became_peered":"2023-12-08T08:22:02.073043+0000","last_unstale":"2023-12-08T08:22:02.076694+0000","last_undegraded":"2023-12-08T08:22:02.076694+0000","last_fullsized":"2023-12-08T08:22:02.076694+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:13.555049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045725+0000","last_change":"2023-12-08T08:22:02.045725+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045725+0000","last_undegraded":"2023-12-08T08:22:02.045725+0000","last_fullsized":"2023-12-08T08:22:02.045725+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.075910+0000","last_change":"2023-12-08T08:22:02.074443+0000","last_active":"2023-12-08T08:22:02.075910+0000","last_peered":"2023-12-08T08:22:02.075910+0000","last_clean":"2023-12-08T08:22:02.075910+0000","last_became_active":"2023-12-08T08:22:02.074076+0000","last_became_peered":"2023-12-08T08:22:02.074076+0000","last_unstale":"2023-12-08T08:22:02.075910+0000","last_undegraded":"2023-12-08T08:22:02.075910+0000","last_fullsized":"2023-12-08T08:22:02.075910+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:17:41.637207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.047229+0000","last_change":"2023-12-08T08:22:02.047229+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.047229+0000","last_undegraded":"2023-12-08T08:22:02.047229+0000","last_fullsized":"2023-12-08T08:22:02.047229+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.068126+0000","last_change":"2023-12-08T08:22:02.061389+0000","last_active":"2023-12-08T08:22:02.068126+0000","last_peered":"2023-12-08T08:22:02.068126+0000","last_clean":"2023-12-08T08:22:02.068126+0000","last_became_active":"2023-12-08T08:22:02.060880+0000","last_became_peered":"2023-12-08T08:22:02.060880+0000","last_unstale":"2023-12-08T08:22:02.068126+0000","last_undegraded":"2023-12-08T08:22:02.068126+0000","last_fullsized":"2023-12-08T08:22:02.068126+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:48.380978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049585+0000","last_change":"2023-12-08T08:22:02.049585+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049585+0000","last_undegraded":"2023-12-08T08:22:02.049585+0000","last_fullsized":"2023-12-08T08:22:02.049585+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.069309+0000","last_change":"2023-12-08T08:22:02.063925+0000","last_active":"2023-12-08T08:22:02.069309+0000","last_peered":"2023-12-08T08:22:02.069309+0000","last_clean":"2023-12-08T08:22:02.069309+0000","last_became_active":"2023-12-08T08:22:02.063585+0000","last_became_peered":"2023-12-08T08:22:02.063585+0000","last_unstale":"2023-12-08T08:22:02.069309+0000","last_undegraded":"2023-12-08T08:22:02.069309+0000","last_fullsized":"2023-12-08T08:22:02.069309+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:24.830501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044970+0000","last_change":"2023-12-08T08:22:02.044970+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044970+0000","last_undegraded":"2023-12-08T08:22:02.044970+0000","last_fullsized":"2023-12-08T08:22:02.044970+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.072407+0000","last_change":"2023-12-08T08:22:02.066732+0000","last_active":"2023-12-08T08:22:02.072407+0000","last_peered":"2023-12-08T08:22:02.072407+0000","last_clean":"2023-12-08T08:22:02.072407+0000","last_became_active":"2023-12-08T08:22:02.066414+0000","last_became_peered":"2023-12-08T08:22:02.066414+0000","last_unstale":"2023-12-08T08:22:02.072407+0000","last_undegraded":"2023-12-08T08:22:02.072407+0000","last_fullsized":"2023-12-08T08:22:02.072407+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:24.830501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045265+0000","last_change":"2023-12-08T08:22:02.045265+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045265+0000","last_undegraded":"2023-12-08T08:22:02.045265+0000","last_fullsized":"2023-12-08T08:22:02.045265+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.075696+0000","last_change":"2023-12-08T08:22:02.073329+0000","last_active":"2023-12-08T08:22:02.075696+0000","last_peered":"2023-12-08T08:22:02.075696+0000","last_clean":"2023-12-08T08:22:02.075696+0000","last_became_active":"2023-12-08T08:22:02.073052+0000","last_became_peered":"2023-12-08T08:22:02.073052+0000","last_unstale":"2023-12-08T08:22:02.075696+0000","last_undegraded":"2023-12-08T08:22:02.075696+0000","last_fullsized":"2023-12-08T08:22:02.075696+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:50.699270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051547+0000","last_change":"2023-12-08T08:22:02.051547+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051547+0000","last_undegraded":"2023-12-08T08:22:02.051547+0000","last_fullsized":"2023-12-08T08:22:02.051547+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076913+0000","last_change":"2023-12-08T08:22:02.074584+0000","last_active":"2023-12-08T08:22:02.076913+0000","last_peered":"2023-12-08T08:22:02.076913+0000","last_clean":"2023-12-08T08:22:02.076913+0000","last_became_active":"2023-12-08T08:22:02.072443+0000","last_became_peered":"2023-12-08T08:22:02.072443+0000","last_unstale":"2023-12-08T08:22:02.076913+0000","last_undegraded":"2023-12-08T08:22:02.076913+0000","last_fullsized":"2023-12-08T08:22:02.076913+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:22:40.527797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044204+0000","last_change":"2023-12-08T08:22:02.044204+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044204+0000","last_undegraded":"2023-12-08T08:22:02.044204+0000","last_fullsized":"2023-12-08T08:22:02.044204+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.074334+0000","last_change":"2023-12-08T08:22:02.071820+0000","last_active":"2023-12-08T08:22:02.074334+0000","last_peered":"2023-12-08T08:22:02.074334+0000","last_clean":"2023-12-08T08:22:02.074334+0000","last_became_active":"2023-12-08T08:22:02.071513+0000","last_became_peered":"2023-12-08T08:22:02.071513+0000","last_unstale":"2023-12-08T08:22:02.074334+0000","last_undegraded":"2023-12-08T08:22:02.074334+0000","last_fullsized":"2023-12-08T08:22:02.074334+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:13.555049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.053300+0000","last_change":"2023-12-08T08:22:02.053300+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.053300+0000","last_undegraded":"2023-12-08T08:22:02.053300+0000","last_fullsized":"2023-12-08T08:22:02.053300+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.070065+0000","last_change":"2023-12-08T08:22:02.064284+0000","last_active":"2023-12-08T08:22:02.070065+0000","last_peered":"2023-12-08T08:22:02.070065+0000","last_clean":"2023-12-08T08:22:02.070065+0000","last_became_active":"2023-12-08T08:22:02.063986+0000","last_became_peered":"2023-12-08T08:22:02.063986+0000","last_unstale":"2023-12-08T08:22:02.070065+0000","last_undegraded":"2023-12-08T08:22:02.070065+0000","last_fullsized":"2023-12-08T08:22:02.070065+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:45:39.958857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.054130+0000","last_change":"2023-12-08T08:22:02.054130+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.054130+0000","last_undegraded":"2023-12-08T08:22:02.054130+0000","last_fullsized":"2023-12-08T08:22:02.054130+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076414+0000","last_change":"2023-12-08T08:22:02.073150+0000","last_active":"2023-12-08T08:22:02.076414+0000","last_peered":"2023-12-08T08:22:02.076414+0000","last_clean":"2023-12-08T08:22:02.076414+0000","last_became_active":"2023-12-08T08:22:02.071562+0000","last_became_peered":"2023-12-08T08:22:02.071562+0000","last_unstale":"2023-12-08T08:22:02.076414+0000","last_undegraded":"2023-12-08T08:22:02.076414+0000","last_fullsized":"2023-12-08T08:22:02.076414+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:26:10.210451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051948+0000","last_change":"2023-12-08T08:22:02.051948+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051948+0000","last_undegraded":"2023-12-08T08:22:02.051948+0000","last_fullsized":"2023-12-08T08:22:02.051948+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.072108+0000","last_change":"2023-12-08T08:22:02.067718+0000","last_active":"2023-12-08T08:22:02.072108+0000","last_peered":"2023-12-08T08:22:02.072108+0000","last_clean":"2023-12-08T08:22:02.072108+0000","last_became_active":"2023-12-08T08:22:02.067452+0000","last_became_peered":"2023-12-08T08:22:02.067452+0000","last_unstale":"2023-12-08T08:22:02.072108+0000","last_undegraded":"2023-12-08T08:22:02.072108+0000","last_fullsized":"2023-12-08T08:22:02.072108+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:30:31.631850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045450+0000","last_change":"2023-12-08T08:22:02.045450+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045450+0000","last_undegraded":"2023-12-08T08:22:02.045450+0000","last_fullsized":"2023-12-08T08:22:02.045450+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076644+0000","last_change":"2023-12-08T08:22:02.072008+0000","last_active":"2023-12-08T08:22:02.076644+0000","last_peered":"2023-12-08T08:22:02.076644+0000","last_clean":"2023-12-08T08:22:02.076644+0000","last_became_active":"2023-12-08T08:22:02.071711+0000","last_became_peered":"2023-12-08T08:22:02.071711+0000","last_unstale":"2023-12-08T08:22:02.076644+0000","last_undegraded":"2023-12-08T08:22:02.076644+0000","last_fullsized":"2023-12-08T08:22:02.076644+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:49:51.933425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049037+0000","last_change":"2023-12-08T08:22:02.049037+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049037+0000","last_undegraded":"2023-12-08T08:22:02.049037+0000","last_fullsized":"2023-12-08T08:22:02.049037+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.074299+0000","last_change":"2023-12-08T08:22:02.071841+0000","last_active":"2023-12-08T08:22:02.074299+0000","last_peered":"2023-12-08T08:22:02.074299+0000","last_clean":"2023-12-08T08:22:02.074299+0000","last_became_active":"2023-12-08T08:22:02.071531+0000","last_became_peered":"2023-12-08T08:22:02.071531+0000","last_unstale":"2023-12-08T08:22:02.074299+0000","last_undegraded":"2023-12-08T08:22:02.074299+0000","last_fullsized":"2023-12-08T08:22:02.074299+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:13:54.526670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.050946+0000","last_change":"2023-12-08T08:22:02.050946+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.050946+0000","last_undegraded":"2023-12-08T08:22:02.050946+0000","last_fullsized":"2023-12-08T08:22:02.050946+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076370+0000","last_change":"2023-12-08T08:22:02.072612+0000","last_active":"2023-12-08T08:22:02.076370+0000","last_peered":"2023-12-08T08:22:02.076370+0000","last_clean":"2023-12-08T08:22:02.076370+0000","last_became_active":"2023-12-08T08:22:02.071308+0000","last_became_peered":"2023-12-08T08:22:02.071308+0000","last_unstale":"2023-12-08T08:22:02.076370+0000","last_undegraded":"2023-12-08T08:22:02.076370+0000","last_fullsized":"2023-12-08T08:22:02.076370+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:30:30.201779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.055769+0000","last_change":"2023-12-08T08:22:02.055769+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.055769+0000","last_undegraded":"2023-12-08T08:22:02.055769+0000","last_fullsized":"2023-12-08T08:22:02.055769+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076584+0000","last_change":"2023-12-08T08:22:02.074304+0000","last_active":"2023-12-08T08:22:02.076584+0000","last_peered":"2023-12-08T08:22:02.076584+0000","last_clean":"2023-12-08T08:22:02.076584+0000","last_became_active":"2023-12-08T08:22:02.074007+0000","last_became_peered":"2023-12-08T08:22:02.074007+0000","last_unstale":"2023-12-08T08:22:02.076584+0000","last_undegraded":"2023-12-08T08:22:02.076584+0000","last_fullsized":"2023-12-08T08:22:02.076584+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:02.472465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045441+0000","last_change":"2023-12-08T08:22:02.045441+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045441+0000","last_undegraded":"2023-12-08T08:22:02.045441+0000","last_fullsized":"2023-12-08T08:22:02.045441+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.076702+0000","last_change":"2023-12-08T08:22:02.073388+0000","last_active":"2023-12-08T08:22:02.076702+0000","last_peered":"2023-12-08T08:22:02.076702+0000","last_clean":"2023-12-08T08:22:02.076702+0000","last_became_active":"2023-12-08T08:22:02.073107+0000","last_became_peered":"2023-12-08T08:22:02.073107+0000","last_unstale":"2023-12-08T08:22:02.076702+0000","last_undegraded":"2023-12-08T08:22:02.076702+0000","last_fullsized":"2023-12-08T08:22:02.076702+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:50.699270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049911+0000","last_change":"2023-12-08T08:22:02.049911+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049911+0000","last_undegraded":"2023-12-08T08:22:02.049911+0000","last_fullsized":"2023-12-08T08:22:02.049911+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.071665+0000","last_change":"2023-12-08T08:22:02.067383+0000","last_active":"2023-12-08T08:22:02.071665+0000","last_peered":"2023-12-08T08:22:02.071665+0000","last_clean":"2023-12-08T08:22:02.071665+0000","last_became_active":"2023-12-08T08:22:02.067094+0000","last_became_peered":"2023-12-08T08:22:02.067094+0000","last_unstale":"2023-12-08T08:22:02.071665+0000","last_undegraded":"2023-12-08T08:22:02.071665+0000","last_fullsized":"2023-12-08T08:22:02.071665+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:14.917716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.053600+0000","last_change":"2023-12-08T08:22:02.053600+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.053600+0000","last_undegraded":"2023-12-08T08:22:02.053600+0000","last_fullsized":"2023-12-08T08:22:02.053600+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.063728+0000","last_change":"2023-12-08T08:22:02.055138+0000","last_active":"2023-12-08T08:22:02.063728+0000","last_peered":"2023-12-08T08:22:02.063728+0000","last_clean":"2023-12-08T08:22:02.063728+0000","last_became_active":"2023-12-08T08:22:02.054797+0000","last_became_peered":"2023-12-08T08:22:02.054797+0000","last_unstale":"2023-12-08T08:22:02.063728+0000","last_undegraded":"2023-12-08T08:22:02.063728+0000","last_fullsized":"2023-12-08T08:22:02.063728+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:02:40.986075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.051277+0000","last_change":"2023-12-08T08:22:02.051277+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.051277+0000","last_undegraded":"2023-12-08T08:22:02.051277+0000","last_fullsized":"2023-12-08T08:22:02.051277+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.075435+0000","last_change":"2023-12-08T08:22:02.072456+0000","last_active":"2023-12-08T08:22:02.075435+0000","last_peered":"2023-12-08T08:22:02.075435+0000","last_clean":"2023-12-08T08:22:02.075435+0000","last_became_active":"2023-12-08T08:22:02.072146+0000","last_became_peered":"2023-12-08T08:22:02.072146+0000","last_unstale":"2023-12-08T08:22:02.075435+0000","last_undegraded":"2023-12-08T08:22:02.075435+0000","last_fullsized":"2023-12-08T08:22:02.075435+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.752165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.046507+0000","last_change":"2023-12-08T08:22:02.046507+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.046507+0000","last_undegraded":"2023-12-08T08:22:02.046507+0000","last_fullsized":"2023-12-08T08:22:02.046507+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.069555+0000","last_change":"2023-12-08T08:22:02.065223+0000","last_active":"2023-12-08T08:22:02.069555+0000","last_peered":"2023-12-08T08:22:02.069555+0000","last_clean":"2023-12-08T08:22:02.069555+0000","last_became_active":"2023-12-08T08:22:02.064829+0000","last_became_peered":"2023-12-08T08:22:02.064829+0000","last_unstale":"2023-12-08T08:22:02.069555+0000","last_undegraded":"2023-12-08T08:22:02.069555+0000","last_fullsized":"2023-12-08T08:22:02.069555+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:45:39.958857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.059365+0000","last_change":"2023-12-08T08:22:02.059365+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.059365+0000","last_undegraded":"2023-12-08T08:22:02.059365+0000","last_fullsized":"2023-12-08T08:22:02.059365+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.064936+0000","last_change":"2023-12-08T08:22:02.057964+0000","last_active":"2023-12-08T08:22:02.064936+0000","last_peered":"2023-12-08T08:22:02.064936+0000","last_clean":"2023-12-08T08:22:02.064936+0000","last_became_active":"2023-12-08T08:22:02.057677+0000","last_became_peered":"2023-12-08T08:22:02.057677+0000","last_unstale":"2023-12-08T08:22:02.064936+0000","last_undegraded":"2023-12-08T08:22:02.064936+0000","last_fullsized":"2023-12-08T08:22:02.064936+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:46:01.889435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.055314+0000","last_change":"2023-12-08T08:22:02.055314+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.055314+0000","last_undegraded":"2023-12-08T08:22:02.055314+0000","last_fullsized":"2023-12-08T08:22:02.055314+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.068215+0000","last_change":"2023-12-08T08:22:02.061620+0000","last_active":"2023-12-08T08:22:02.068215+0000","last_peered":"2023-12-08T08:22:02.068215+0000","last_clean":"2023-12-08T08:22:02.068215+0000","last_became_active":"2023-12-08T08:22:02.061329+0000","last_became_peered":"2023-12-08T08:22:02.061329+0000","last_unstale":"2023-12-08T08:22:02.068215+0000","last_undegraded":"2023-12-08T08:22:02.068215+0000","last_fullsized":"2023-12-08T08:22:02.068215+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:08:57.419992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.043612+0000","last_change":"2023-12-08T08:22:02.043612+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.043612+0000","last_undegraded":"2023-12-08T08:22:02.043612+0000","last_fullsized":"2023-12-08T08:22:02.043612+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.065571+0000","last_change":"2023-12-08T08:22:02.059762+0000","last_active":"2023-12-08T08:22:02.065571+0000","last_peered":"2023-12-08T08:22:02.065571+0000","last_clean":"2023-12-08T08:22:02.065571+0000","last_became_active":"2023-12-08T08:22:02.059447+0000","last_became_peered":"2023-12-08T08:22:02.059447+0000","last_unstale":"2023-12-08T08:22:02.065571+0000","last_undegraded":"2023-12-08T08:22:02.065571+0000","last_fullsized":"2023-12-08T08:22:02.065571+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.752165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.050041+0000","last_change":"2023-12-08T08:22:02.050041+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.050041+0000","last_undegraded":"2023-12-08T08:22:02.050041+0000","last_fullsized":"2023-12-08T08:22:02.050041+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.072430+0000","last_change":"2023-12-08T08:22:02.069094+0000","last_active":"2023-12-08T08:22:02.072430+0000","last_peered":"2023-12-08T08:22:02.072430+0000","last_clean":"2023-12-08T08:22:02.072430+0000","last_became_active":"2023-12-08T08:22:02.068768+0000","last_became_peered":"2023-12-08T08:22:02.068768+0000","last_unstale":"2023-12-08T08:22:02.072430+0000","last_undegraded":"2023-12-08T08:22:02.072430+0000","last_fullsized":"2023-12-08T08:22:02.072430+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:13:54.526670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044367+0000","last_change":"2023-12-08T08:22:02.044367+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044367+0000","last_undegraded":"2023-12-08T08:22:02.044367+0000","last_fullsized":"2023-12-08T08:22:02.044367+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.069442+0000","last_change":"2023-12-08T08:22:02.064371+0000","last_active":"2023-12-08T08:22:02.069442+0000","last_peered":"2023-12-08T08:22:02.069442+0000","last_clean":"2023-12-08T08:22:02.069442+0000","last_became_active":"2023-12-08T08:22:02.063996+0000","last_became_peered":"2023-12-08T08:22:02.063996+0000","last_unstale":"2023-12-08T08:22:02.069442+0000","last_undegraded":"2023-12-08T08:22:02.069442+0000","last_fullsized":"2023-12-08T08:22:02.069442+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:47:39.746644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.049394+0000","last_change":"2023-12-08T08:22:02.049394+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.049394+0000","last_undegraded":"2023-12-08T08:22:02.049394+0000","last_fullsized":"2023-12-08T08:22:02.049394+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.066637+0000","last_change":"2023-12-08T08:22:02.063148+0000","last_active":"2023-12-08T08:22:02.066637+0000","last_peered":"2023-12-08T08:22:02.066637+0000","last_clean":"2023-12-08T08:22:02.066637+0000","last_became_active":"2023-12-08T08:22:02.062860+0000","last_became_peered":"2023-12-08T08:22:02.062860+0000","last_unstale":"2023-12-08T08:22:02.066637+0000","last_undegraded":"2023-12-08T08:22:02.066637+0000","last_fullsized":"2023-12-08T08:22:02.066637+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:49:51.933425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.043780+0000","last_change":"2023-12-08T08:22:02.043780+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.043780+0000","last_undegraded":"2023-12-08T08:22:02.043780+0000","last_fullsized":"2023-12-08T08:22:02.043780+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.059779+0000","last_change":"2023-12-08T08:22:02.055697+0000","last_active":"2023-12-08T08:22:02.059779+0000","last_peered":"2023-12-08T08:22:02.059779+0000","last_clean":"2023-12-08T08:22:02.059779+0000","last_became_active":"2023-12-08T08:22:02.055412+0000","last_became_peered":"2023-12-08T08:22:02.055412+0000","last_unstale":"2023-12-08T08:22:02.059779+0000","last_undegraded":"2023-12-08T08:22:02.059779+0000","last_fullsized":"2023-12-08T08:22:02.059779+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:30:31.631850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.044376+0000","last_change":"2023-12-08T08:22:02.044376+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.044376+0000","last_undegraded":"2023-12-08T08:22:02.044376+0000","last_fullsized":"2023-12-08T08:22:02.044376+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.067526+0000","last_change":"2023-12-08T08:22:02.065076+0000","last_active":"2023-12-08T08:22:02.067526+0000","last_peered":"2023-12-08T08:22:02.067526+0000","last_clean":"2023-12-08T08:22:02.067526+0000","last_became_active":"2023-12-08T08:22:02.064723+0000","last_became_peered":"2023-12-08T08:22:02.064723+0000","last_unstale":"2023-12-08T08:22:02.067526+0000","last_undegraded":"2023-12-08T08:22:02.067526+0000","last_fullsized":"2023-12-08T08:22:02.067526+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:03:17.577934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-12-08T08:22:02.045170+0000","last_change":"2023-12-08T08:22:02.045170+0000","last_active":"2023-12-08T08:22:02.034347+0000","last_peered":"2023-12-08T08:22:02.034347+0000","last_clean":"2023-12-08T08:22:02.034347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:02.045170+0000","last_undegraded":"2023-12-08T08:22:02.045170+0000","last_fullsized":"2023-12-08T08:22:02.045170+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-08T08:22:02.069302+0000","last_change":"2023-12-08T08:22:02.066497+0000","last_active":"2023-12-08T08:22:02.069302+0000","last_peered":"2023-12-08T08:22:02.069302+0000","last_clean":"2023-12-08T08:22:02.069302+0000","last_became_active":"2023-12-08T08:22:02.065532+0000","last_became_peered":"2023-12-08T08:22:02.065532+0000","last_unstale":"2023-12-08T08:22:02.069302+0000","last_undegraded":"2023-12-08T08:22:02.069302+0000","last_fullsized":"2023-12-08T08:22:02.069302+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:47:39.746644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":186,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-08T08:22:01.039220+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:22:01.039220+0000","last_peered":"2023-12-08T08:22:01.039220+0000","last_clean":"2023-12-08T08:22:01.039220+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:22:01.039220+0000","last_undegraded":"2023-12-08T08:22:01.039220+0000","last_fullsized":"2023-12-08T08:22:01.039220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":626688,"data_stored":823117,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.84599999999999997}]},{"osd":1,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.79900000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.61699999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.82699999999999996}]},{"osd":4,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.67500000000000004}]},{"osd":6,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.71599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":573440,"data_stored":239016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.84799999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.81200000000000006}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.71999999999999997}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.746}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.46500000000000002}]},{"osd":5,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.627},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.60099999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.55400000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":573440,"data_stored":239016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.38700000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.45900000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.438},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.624}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.67200000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.503}]},{"osd":6,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.52600000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.69499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":573440,"data_stored":239016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.79300000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.67900000000000005}]},{"osd":2,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.623}]},{"osd":3,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.74299999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.53000000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.82199999999999995}]},{"osd":7,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.72499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":573440,"data_stored":239016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.249},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.37}]},{"osd":1,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.39200000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.34399999999999997}]},{"osd":4,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.80200000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.83299999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.876},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.77300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":573440,"data_stored":239016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.0270000000000001,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.34399999999999997}]},{"osd":1,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.44500000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.48199999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.78000000000000003}]},{"osd":5,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":3.637,"5min":3.637,"15min":3.637},"last":0.71499999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.90600000000000003}]},{"osd":7,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.94099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":573440,"data_stored":239016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2210000000000001,"5min":5.2210000000000001,"15min":5.2210000000000001},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":8.3200000000000003,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.38700000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":8.2070000000000007,"5min":8.2070000000000007,"15min":8.2070000000000007},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":4.351,"5min":4.351,"15min":4.351},"last":0.34899999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":8.1479999999999997,"5min":8.1479999999999997,"15min":8.1479999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.3150000000000004,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.45900000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":4.8470000000000004,"5min":4.8470000000000004,"15min":4.8470000000000004},"last":0.503},{"interface":"front","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":4.7939999999999996,"5min":4.7939999999999996,"15min":4.7939999999999996},"last":0.47699999999999998}]},{"osd":5,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":4.7240000000000002,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":4.5830000000000002,"5min":4.5830000000000002,"15min":4.5830000000000002},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":4.7699999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":4.6289999999999996,"5min":4.6289999999999996,"15min":4.6289999999999996},"last":0.64900000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":4.665,"5min":4.665,"15min":4.665},"last":0.61599999999999999},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":4.8140000000000001,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.63400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27636,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":626688,"data_stored":823117,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":8.2799999999999994,"5min":8.2799999999999994,"15min":8.2799999999999994},"last":0.39700000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":7.9290000000000003,"5min":7.9290000000000003,"15min":7.9290000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":8.0890000000000004,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.33000000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":4.6550000000000002,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":7.8890000000000002,"5min":7.8890000000000002,"15min":7.8890000000000002},"last":0.47399999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":7.9649999999999999,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.876},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.751}]},{"osd":5,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":8.0579999999999998,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.68400000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":7.835,"5min":7.835,"15min":7.835},"last":0.89300000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":8.0239999999999991,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.78300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:22:11.628 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:22:11.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.771+0000 7f357d49c640 1 Processor -- start 2023-12-08T08:22:11.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.771+0000 7f357d49c640 1 -- start start 2023-12-08T08:22:11.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.771+0000 7f357d49c640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3578154f20 0x7f357806b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:11.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.771+0000 7f357d49c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35780c4890 con 0x7f35780af4c0 2023-12-08T08:22:11.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.771+0000 7f357d49c640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35781553d0 con 0x7f357806bf30 2023-12-08T08:22:11.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.771+0000 7f357d49c640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357806c340 con 0x7f3578154f20 2023-12-08T08:22:11.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.771+0000 7f3576ffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f35780af4c0 0x7f35780c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49282/0 (socket says 172.21.15.88:49282) 2023-12-08T08:22:11.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.771+0000 7f3576ffd640 1 -- 172.21.15.88:0/577778455 learned_addr learned my addr 172.21.15.88:0/577778455 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:11.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.771+0000 7f35767fc640 1 -- 172.21.15.88:0/577778455 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 757987278 0 0) 0x7f35780c4890 con 0x7f35780af4c0 2023-12-08T08:22:11.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.771+0000 7f35767fc640 1 -- 172.21.15.88:0/577778455 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3564003530 con 0x7f35780af4c0 2023-12-08T08:22:11.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.771+0000 7f356e7fc640 1 --2- 172.21.15.88:0/577778455 >> v2:172.21.15.148:3300/0 conn(0x7f3578154f20 0x7f357806b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:11.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.771+0000 7f35767fc640 1 -- 172.21.15.88:0/577778455 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3696255556 0 0) 0x7f3564003530 con 0x7f35780af4c0 2023-12-08T08:22:11.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.771+0000 7f35767fc640 1 -- 172.21.15.88:0/577778455 >> v2:172.21.15.148:3300/0 conn(0x7f3578154f20 msgr2=0x7f357806b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:11.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.771+0000 7f35767fc640 1 --2- 172.21.15.88:0/577778455 >> v2:172.21.15.148:3300/0 conn(0x7f3578154f20 0x7f357806b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:11.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.771+0000 7f35767fc640 1 -- 172.21.15.88:0/577778455 >> v1:172.21.15.148:6789/0 conn(0x7f357806bf30 legacy=0x7f357815ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:11.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.771+0000 7f35767fc640 1 -- 172.21.15.88:0/577778455 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35780af8a0 con 0x7f35780af4c0 2023-12-08T08:22:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.771+0000 7f35767fc640 1 -- 172.21.15.88:0/577778455 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f3568001680 con 0x7f35780af4c0 2023-12-08T08:22:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.771+0000 7f35767fc640 1 -- 172.21.15.88:0/577778455 >> v1:172.21.15.88:6789/0 conn(0x7f35780af4c0 legacy=0x7f35780c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.771+0000 7f35767fc640 1 --2- 172.21.15.88:0/577778455 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3564003980 0x7f3564003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.771+0000 7f35767fc640 1 --2- 172.21.15.88:0/577778455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35640047d0 0x7f3564004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.771+0000 7f35767fc640 1 --2- 172.21.15.88:0/577778455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3564005190 0x7f356400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.771+0000 7f35767fc640 1 -- 172.21.15.88:0/577778455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357806c340 con 0x7f35640047d0 2023-12-08T08:22:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.771+0000 7f35767fc640 1 -- 172.21.15.88:0/577778455 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356400c130 con 0x7f3564005190 2023-12-08T08:22:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.771+0000 7f35767fc640 1 -- 172.21.15.88:0/577778455 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356400c2f0 con 0x7f3564003980 2023-12-08T08:22:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.771+0000 7f356e7fc640 1 --2- 172.21.15.88:0/577778455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35640047d0 0x7f3564004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.771+0000 7f3576ffd640 1 --2- 172.21.15.88:0/577778455 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3564003980 0x7f3564003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.771+0000 7f35777fe640 1 --2- 172.21.15.88:0/577778455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3564005190 0x7f356400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.775+0000 7f356e7fc640 1 -- 172.21.15.88:0/577778455 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3564003980 msgr2=0x7f3564003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.775+0000 7f356e7fc640 1 --2- 172.21.15.88:0/577778455 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3564003980 0x7f3564003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.775+0000 7f356e7fc640 1 -- 172.21.15.88:0/577778455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3564005190 msgr2=0x7f356400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.775+0000 7f356e7fc640 1 --2- 172.21.15.88:0/577778455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3564005190 0x7f356400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:11.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.775+0000 7f356e7fc640 1 -- 172.21.15.88:0/577778455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3564003530 con 0x7f35640047d0 2023-12-08T08:22:11.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.775+0000 7f35777fe640 1 -- 172.21.15.88:0/577778455 reap_dead start 2023-12-08T08:22:11.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.775+0000 7f356e7fc640 1 --2- 172.21.15.88:0/577778455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35640047d0 0x7f3564004c50 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3560009ae0 tx=0x7f356001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e307e0d6aadeb7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:11.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.775+0000 7f35767fc640 1 -- 172.21.15.88:0/577778455 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35600a6510 con 0x7f35640047d0 2023-12-08T08:22:11.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.775+0000 7f35767fc640 1 -- 172.21.15.88:0/577778455 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35600a6670 con 0x7f35640047d0 2023-12-08T08:22:11.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.775+0000 7f35767fc640 1 -- 172.21.15.88:0/577778455 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35600a6a20 con 0x7f35640047d0 2023-12-08T08:22:11.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.775+0000 7f357d49c640 1 -- 172.21.15.88:0/577778455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35640047d0 msgr2=0x7f3564004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:11.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.775+0000 7f357d49c640 1 --2- 172.21.15.88:0/577778455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35640047d0 0x7f3564004c50 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3560009ae0 tx=0x7f356001ca20 comp rx=0 tx=0).stop 2023-12-08T08:22:11.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.775+0000 7f357d49c640 1 -- 172.21.15.88:0/577778455 shutdown_connections 2023-12-08T08:22:11.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.775+0000 7f357d49c640 1 --2- 172.21.15.88:0/577778455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35640047d0 0x7f3564004c50 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:11.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.775+0000 7f357d49c640 1 -- 172.21.15.88:0/577778455 >> 172.21.15.88:0/577778455 conn(0x7f35780ab9d0 msgr2=0x7f35780abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:11.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.775+0000 7f357d49c640 1 -- 172.21.15.88:0/577778455 shutdown_connections 2023-12-08T08:22:11.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.775+0000 7f357d49c640 1 -- 172.21.15.88:0/577778455 wait complete. 2023-12-08T08:22:11.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.779+0000 7f357d49c640 1 Processor -- start 2023-12-08T08:22:11.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.779+0000 7f357d49c640 1 -- start start 2023-12-08T08:22:11.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.779+0000 7f357d49c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f35640047d0 0x7f357814dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:11.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.779+0000 7f357d49c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f357814ce80 0x7f357814be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:11.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.779+0000 7f357d49c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3578150c40 0x7f35781510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:11.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.779+0000 7f357d49c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35780c8750 con 0x7f3578150c40 2023-12-08T08:22:11.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.779+0000 7f357d49c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35780cab70 con 0x7f357814ce80 2023-12-08T08:22:11.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.779+0000 7f357d49c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35780c8120 con 0x7f35640047d0 2023-12-08T08:22:11.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.779+0000 7f35777fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3578150c40 0x7f35781510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:11.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.779+0000 7f35777fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3578150c40 0x7f35781510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43402/0 (socket says 172.21.15.88:43402) 2023-12-08T08:22:11.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.779+0000 7f35777fe640 1 -- 172.21.15.88:0/2295979992 learned_addr learned my addr 172.21.15.88:0/2295979992 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:11.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.779+0000 7f3576ffd640 1 --2- 172.21.15.88:0/2295979992 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f35640047d0 0x7f357814dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:11.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.779+0000 7f356e7fc640 1 --2- 172.21.15.88:0/2295979992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f357814ce80 0x7f357814be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:11.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.779+0000 7f35777fe640 1 -- 172.21.15.88:0/2295979992 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f35640047d0 msgr2=0x7f357814dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:11.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.779+0000 7f35777fe640 1 --2- 172.21.15.88:0/2295979992 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f35640047d0 0x7f357814dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:11.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.779+0000 7f35777fe640 1 -- 172.21.15.88:0/2295979992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f357814ce80 msgr2=0x7f357814be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:11.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.779+0000 7f35777fe640 1 --2- 172.21.15.88:0/2295979992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f357814ce80 0x7f357814be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:11.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.779+0000 7f35777fe640 1 -- 172.21.15.88:0/2295979992 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357814e1f0 con 0x7f3578150c40 2023-12-08T08:22:11.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.779+0000 7f3576ffd640 1 --2- 172.21.15.88:0/2295979992 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f35640047d0 0x7f357814dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:11.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.779+0000 7f356e7fc640 1 --2- 172.21.15.88:0/2295979992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f357814ce80 0x7f357814be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:11.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.779+0000 7f35777fe640 1 --2- 172.21.15.88:0/2295979992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3578150c40 0x7f35781510c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f35780ac810 tx=0x7f357000fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:11.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.779+0000 7f356ffff640 1 -- 172.21.15.88:0/2295979992 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3570006d70 con 0x7f3578150c40 2023-12-08T08:22:11.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.779+0000 7f356ffff640 1 -- 172.21.15.88:0/2295979992 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3570003980 con 0x7f3578150c40 2023-12-08T08:22:11.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.779+0000 7f356ffff640 1 -- 172.21.15.88:0/2295979992 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3570003d30 con 0x7f3578150c40 2023-12-08T08:22:11.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.779+0000 7f357d49c640 1 -- 172.21.15.88:0/2295979992 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35781f1040 con 0x7f3578150c40 2023-12-08T08:22:11.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.779+0000 7f357d49c640 1 -- 172.21.15.88:0/2295979992 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35780c8370 con 0x7f3578150c40 2023-12-08T08:22:11.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.783+0000 7f357d49c640 1 -- 172.21.15.88:0/2295979992 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3578067630 con 0x7f3578150c40 2023-12-08T08:22:11.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.783+0000 7f356ffff640 1 -- 172.21.15.88:0/2295979992 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3570005070 con 0x7f3578150c40 2023-12-08T08:22:11.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.783+0000 7f356ffff640 1 --2- 172.21.15.88:0/2295979992 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f35580664a0 0x7f3558068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:11.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.783+0000 7f356ffff640 1 -- 172.21.15.88:0/2295979992 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35700832e0 con 0x7f3578150c40 2023-12-08T08:22:11.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.783+0000 7f3576ffd640 1 --2- 172.21.15.88:0/2295979992 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f35580664a0 0x7f3558068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:11.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.783+0000 7f3576ffd640 1 --2- 172.21.15.88:0/2295979992 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f35580664a0 0x7f3558068960 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f35680017b0 tx=0x7f3568009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:11.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.787+0000 7f356ffff640 1 -- 172.21.15.88:0/2295979992 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f35700506c0 con 0x7f3578150c40 2023-12-08T08:22:11.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.935+0000 7f357d49c640 1 -- 172.21.15.88:0/2295979992 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f357806cae0 con 0x7f35580664a0 2023-12-08T08:22:11.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.943+0000 7f356ffff640 1 -- 172.21.15.88:0/2295979992 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288795 (secure 0 0 0) 0x7f3568001610 con 0x7f35580664a0 2023-12-08T08:22:11.950 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:11.951 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:22:11.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.947+0000 7f357d49c640 1 -- 172.21.15.88:0/2295979992 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f35580664a0 msgr2=0x7f3558068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:11.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.947+0000 7f357d49c640 1 --2- 172.21.15.88:0/2295979992 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f35580664a0 0x7f3558068960 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f35680017b0 tx=0x7f3568009040 comp rx=0 tx=0).stop 2023-12-08T08:22:11.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.947+0000 7f357d49c640 1 -- 172.21.15.88:0/2295979992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3578150c40 msgr2=0x7f35781510c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:11.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.947+0000 7f357d49c640 1 --2- 172.21.15.88:0/2295979992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3578150c40 0x7f35781510c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f35780ac810 tx=0x7f357000fc00 comp rx=0 tx=0).stop 2023-12-08T08:22:11.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.947+0000 7f357d49c640 1 -- 172.21.15.88:0/2295979992 shutdown_connections 2023-12-08T08:22:11.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.947+0000 7f357d49c640 1 --2- 172.21.15.88:0/2295979992 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f35580664a0 0x7f3558068960 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:11.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.947+0000 7f357d49c640 1 --2- 172.21.15.88:0/2295979992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3578150c40 0x7f35781510c0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:11.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.947+0000 7f357d49c640 1 --2- 172.21.15.88:0/2295979992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f357814ce80 0x7f357814be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:11.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.947+0000 7f357d49c640 1 --2- 172.21.15.88:0/2295979992 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f35640047d0 0x7f357814dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:11.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.947+0000 7f357d49c640 1 -- 172.21.15.88:0/2295979992 >> 172.21.15.88:0/2295979992 conn(0x7f35780ab9d0 msgr2=0x7f35780aa1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:11.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.947+0000 7f357d49c640 1 -- 172.21.15.88:0/2295979992 shutdown_connections 2023-12-08T08:22:11.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:11.947+0000 7f357d49c640 1 -- 172.21.15.88:0/2295979992 wait complete. 2023-12-08T08:22:11.970 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2023-12-08T08:22:10.769975+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225208,"kb_used_data":4864,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749512,"statfs":{"total":773094113280,"available":772863500288,"internally_reserved":0,"allocated":4980736,"data_stored":3202284,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001554"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.084419+0000","last_change":"2023-12-08T08:22:03.089336+0000","last_active":"2023-12-08T08:22:04.084419+0000","last_peered":"2023-12-08T08:22:04.084419+0000","last_clean":"2023-12-08T08:22:04.084419+0000","last_became_active":"2023-12-08T08:22:03.089054+0000","last_became_peered":"2023-12-08T08:22:03.089054+0000","last_unstale":"2023-12-08T08:22:04.084419+0000","last_undegraded":"2023-12-08T08:22:04.084419+0000","last_fullsized":"2023-12-08T08:22:04.084419+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:51:34.637192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.074086+0000","last_change":"2023-12-08T08:22:03.091602+0000","last_active":"2023-12-08T08:22:04.074086+0000","last_peered":"2023-12-08T08:22:04.074086+0000","last_clean":"2023-12-08T08:22:04.074086+0000","last_became_active":"2023-12-08T08:22:03.090269+0000","last_became_peered":"2023-12-08T08:22:03.090269+0000","last_unstale":"2023-12-08T08:22:04.074086+0000","last_undegraded":"2023-12-08T08:22:04.074086+0000","last_fullsized":"2023-12-08T08:22:04.074086+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:59.549481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587537+0000","last_change":"2023-12-08T08:22:03.093966+0000","last_active":"2023-12-08T08:22:04.587537+0000","last_peered":"2023-12-08T08:22:04.587537+0000","last_clean":"2023-12-08T08:22:04.587537+0000","last_became_active":"2023-12-08T08:22:03.092321+0000","last_became_peered":"2023-12-08T08:22:03.092321+0000","last_unstale":"2023-12-08T08:22:04.587537+0000","last_undegraded":"2023-12-08T08:22:04.587537+0000","last_fullsized":"2023-12-08T08:22:04.587537+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:53.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587654+0000","last_change":"2023-12-08T08:22:03.079738+0000","last_active":"2023-12-08T08:22:04.587654+0000","last_peered":"2023-12-08T08:22:04.587654+0000","last_clean":"2023-12-08T08:22:04.587654+0000","last_became_active":"2023-12-08T08:22:03.079467+0000","last_became_peered":"2023-12-08T08:22:03.079467+0000","last_unstale":"2023-12-08T08:22:04.587654+0000","last_undegraded":"2023-12-08T08:22:04.587654+0000","last_fullsized":"2023-12-08T08:22:04.587654+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:33:05.704375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.084279+0000","last_change":"2023-12-08T08:22:03.083276+0000","last_active":"2023-12-08T08:22:04.084279+0000","last_peered":"2023-12-08T08:22:04.084279+0000","last_clean":"2023-12-08T08:22:04.084279+0000","last_became_active":"2023-12-08T08:22:03.082978+0000","last_became_peered":"2023-12-08T08:22:03.082978+0000","last_unstale":"2023-12-08T08:22:04.084279+0000","last_undegraded":"2023-12-08T08:22:04.084279+0000","last_fullsized":"2023-12-08T08:22:04.084279+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:46:10.095936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585219+0000","last_change":"2023-12-08T08:22:03.076518+0000","last_active":"2023-12-08T08:22:04.585219+0000","last_peered":"2023-12-08T08:22:04.585219+0000","last_clean":"2023-12-08T08:22:04.585219+0000","last_became_active":"2023-12-08T08:22:03.076229+0000","last_became_peered":"2023-12-08T08:22:03.076229+0000","last_unstale":"2023-12-08T08:22:04.585219+0000","last_undegraded":"2023-12-08T08:22:04.585219+0000","last_fullsized":"2023-12-08T08:22:04.585219+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:53.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.074645+0000","last_change":"2023-12-08T08:22:03.089142+0000","last_active":"2023-12-08T08:22:04.074645+0000","last_peered":"2023-12-08T08:22:04.074645+0000","last_clean":"2023-12-08T08:22:04.074645+0000","last_became_active":"2023-12-08T08:22:03.088859+0000","last_became_peered":"2023-12-08T08:22:03.088859+0000","last_unstale":"2023-12-08T08:22:04.074645+0000","last_undegraded":"2023-12-08T08:22:04.074645+0000","last_fullsized":"2023-12-08T08:22:04.074645+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:14:53.279099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.073513+0000","last_change":"2023-12-08T08:22:03.073700+0000","last_active":"2023-12-08T08:22:04.073513+0000","last_peered":"2023-12-08T08:22:04.073513+0000","last_clean":"2023-12-08T08:22:04.073513+0000","last_became_active":"2023-12-08T08:22:03.073381+0000","last_became_peered":"2023-12-08T08:22:03.073381+0000","last_unstale":"2023-12-08T08:22:04.073513+0000","last_undegraded":"2023-12-08T08:22:04.073513+0000","last_fullsized":"2023-12-08T08:22:04.073513+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:34:37.929708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.075082+0000","last_change":"2023-12-08T08:22:03.074496+0000","last_active":"2023-12-08T08:22:04.075082+0000","last_peered":"2023-12-08T08:22:04.075082+0000","last_clean":"2023-12-08T08:22:04.075082+0000","last_became_active":"2023-12-08T08:22:03.074162+0000","last_became_peered":"2023-12-08T08:22:03.074162+0000","last_unstale":"2023-12-08T08:22:04.075082+0000","last_undegraded":"2023-12-08T08:22:04.075082+0000","last_fullsized":"2023-12-08T08:22:04.075082+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:40:31.993943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585623+0000","last_change":"2023-12-08T08:22:03.080819+0000","last_active":"2023-12-08T08:22:04.585623+0000","last_peered":"2023-12-08T08:22:04.585623+0000","last_clean":"2023-12-08T08:22:04.585623+0000","last_became_active":"2023-12-08T08:22:03.080496+0000","last_became_peered":"2023-12-08T08:22:03.080496+0000","last_unstale":"2023-12-08T08:22:04.585623+0000","last_undegraded":"2023-12-08T08:22:04.585623+0000","last_fullsized":"2023-12-08T08:22:04.585623+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:49:52.935992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585830+0000","last_change":"2023-12-08T08:22:03.098039+0000","last_active":"2023-12-08T08:22:04.585830+0000","last_peered":"2023-12-08T08:22:04.585830+0000","last_clean":"2023-12-08T08:22:04.585830+0000","last_became_active":"2023-12-08T08:22:03.097811+0000","last_became_peered":"2023-12-08T08:22:03.097811+0000","last_unstale":"2023-12-08T08:22:04.585830+0000","last_undegraded":"2023-12-08T08:22:04.585830+0000","last_fullsized":"2023-12-08T08:22:04.585830+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:13:55.529237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587798+0000","last_change":"2023-12-08T08:22:03.086333+0000","last_active":"2023-12-08T08:22:04.587798+0000","last_peered":"2023-12-08T08:22:04.587798+0000","last_clean":"2023-12-08T08:22:04.587798+0000","last_became_active":"2023-12-08T08:22:03.086060+0000","last_became_peered":"2023-12-08T08:22:03.086060+0000","last_unstale":"2023-12-08T08:22:04.587798+0000","last_undegraded":"2023-12-08T08:22:04.587798+0000","last_fullsized":"2023-12-08T08:22:04.587798+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:07.393106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.588359+0000","last_change":"2023-12-08T08:22:03.093183+0000","last_active":"2023-12-08T08:22:04.588359+0000","last_peered":"2023-12-08T08:22:04.588359+0000","last_clean":"2023-12-08T08:22:04.588359+0000","last_became_active":"2023-12-08T08:22:03.092909+0000","last_became_peered":"2023-12-08T08:22:03.092909+0000","last_unstale":"2023-12-08T08:22:04.588359+0000","last_undegraded":"2023-12-08T08:22:04.588359+0000","last_fullsized":"2023-12-08T08:22:04.588359+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:45.537687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.074783+0000","last_change":"2023-12-08T08:22:03.081624+0000","last_active":"2023-12-08T08:22:04.074783+0000","last_peered":"2023-12-08T08:22:04.074783+0000","last_clean":"2023-12-08T08:22:04.074783+0000","last_became_active":"2023-12-08T08:22:03.079794+0000","last_became_peered":"2023-12-08T08:22:03.079794+0000","last_unstale":"2023-12-08T08:22:04.074783+0000","last_undegraded":"2023-12-08T08:22:04.074783+0000","last_fullsized":"2023-12-08T08:22:04.074783+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:01:21.860136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.074782+0000","last_change":"2023-12-08T08:22:03.083031+0000","last_active":"2023-12-08T08:22:04.074782+0000","last_peered":"2023-12-08T08:22:04.074782+0000","last_clean":"2023-12-08T08:22:04.074782+0000","last_became_active":"2023-12-08T08:22:03.082748+0000","last_became_peered":"2023-12-08T08:22:03.082748+0000","last_unstale":"2023-12-08T08:22:04.074782+0000","last_undegraded":"2023-12-08T08:22:04.074782+0000","last_fullsized":"2023-12-08T08:22:04.074782+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:11.388572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585132+0000","last_change":"2023-12-08T08:22:03.084741+0000","last_active":"2023-12-08T08:22:04.585132+0000","last_peered":"2023-12-08T08:22:04.585132+0000","last_clean":"2023-12-08T08:22:04.585132+0000","last_became_active":"2023-12-08T08:22:03.081369+0000","last_became_peered":"2023-12-08T08:22:03.081369+0000","last_unstale":"2023-12-08T08:22:04.585132+0000","last_undegraded":"2023-12-08T08:22:04.585132+0000","last_fullsized":"2023-12-08T08:22:04.585132+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:49:47.998533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.074148+0000","last_change":"2023-12-08T08:22:03.087864+0000","last_active":"2023-12-08T08:22:04.074148+0000","last_peered":"2023-12-08T08:22:04.074148+0000","last_clean":"2023-12-08T08:22:04.074148+0000","last_became_active":"2023-12-08T08:22:03.087490+0000","last_became_peered":"2023-12-08T08:22:03.087490+0000","last_unstale":"2023-12-08T08:22:04.074148+0000","last_undegraded":"2023-12-08T08:22:04.074148+0000","last_fullsized":"2023-12-08T08:22:04.074148+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:06:57.467675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587245+0000","last_change":"2023-12-08T08:22:03.087242+0000","last_active":"2023-12-08T08:22:04.587245+0000","last_peered":"2023-12-08T08:22:04.587245+0000","last_clean":"2023-12-08T08:22:04.587245+0000","last_became_active":"2023-12-08T08:22:03.086955+0000","last_became_peered":"2023-12-08T08:22:03.086955+0000","last_unstale":"2023-12-08T08:22:04.587245+0000","last_undegraded":"2023-12-08T08:22:04.587245+0000","last_fullsized":"2023-12-08T08:22:04.587245+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:05:02.802237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.084465+0000","last_change":"2023-12-08T08:22:03.099171+0000","last_active":"2023-12-08T08:22:04.084465+0000","last_peered":"2023-12-08T08:22:04.084465+0000","last_clean":"2023-12-08T08:22:04.084465+0000","last_became_active":"2023-12-08T08:22:03.098908+0000","last_became_peered":"2023-12-08T08:22:03.098908+0000","last_unstale":"2023-12-08T08:22:04.084465+0000","last_undegraded":"2023-12-08T08:22:04.084465+0000","last_fullsized":"2023-12-08T08:22:04.084465+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:45:42.890154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.073900+0000","last_change":"2023-12-08T08:22:03.090002+0000","last_active":"2023-12-08T08:22:04.073900+0000","last_peered":"2023-12-08T08:22:04.073900+0000","last_clean":"2023-12-08T08:22:04.073900+0000","last_became_active":"2023-12-08T08:22:03.089710+0000","last_became_peered":"2023-12-08T08:22:03.089710+0000","last_unstale":"2023-12-08T08:22:04.073900+0000","last_undegraded":"2023-12-08T08:22:04.073900+0000","last_fullsized":"2023-12-08T08:22:04.073900+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:55:53.797647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.586344+0000","last_change":"2023-12-08T08:22:03.082971+0000","last_active":"2023-12-08T08:22:04.586344+0000","last_peered":"2023-12-08T08:22:04.586344+0000","last_clean":"2023-12-08T08:22:04.586344+0000","last_became_active":"2023-12-08T08:22:03.082640+0000","last_became_peered":"2023-12-08T08:22:03.082640+0000","last_unstale":"2023-12-08T08:22:04.586344+0000","last_undegraded":"2023-12-08T08:22:04.586344+0000","last_fullsized":"2023-12-08T08:22:04.586344+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:14:25.475662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.073551+0000","last_change":"2023-12-08T08:22:03.087999+0000","last_active":"2023-12-08T08:22:04.073551+0000","last_peered":"2023-12-08T08:22:04.073551+0000","last_clean":"2023-12-08T08:22:04.073551+0000","last_became_active":"2023-12-08T08:22:03.087717+0000","last_became_peered":"2023-12-08T08:22:03.087717+0000","last_unstale":"2023-12-08T08:22:04.073551+0000","last_undegraded":"2023-12-08T08:22:04.073551+0000","last_fullsized":"2023-12-08T08:22:04.073551+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:14:46.975220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.586354+0000","last_change":"2023-12-08T08:22:03.092664+0000","last_active":"2023-12-08T08:22:04.586354+0000","last_peered":"2023-12-08T08:22:04.586354+0000","last_clean":"2023-12-08T08:22:04.586354+0000","last_became_active":"2023-12-08T08:22:03.092355+0000","last_became_peered":"2023-12-08T08:22:03.092355+0000","last_unstale":"2023-12-08T08:22:04.586354+0000","last_undegraded":"2023-12-08T08:22:04.586354+0000","last_fullsized":"2023-12-08T08:22:04.586354+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:09:22.027038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.586972+0000","last_change":"2023-12-08T08:22:03.093118+0000","last_active":"2023-12-08T08:22:04.586972+0000","last_peered":"2023-12-08T08:22:04.586972+0000","last_clean":"2023-12-08T08:22:04.586972+0000","last_became_active":"2023-12-08T08:22:03.092824+0000","last_became_peered":"2023-12-08T08:22:03.092824+0000","last_unstale":"2023-12-08T08:22:04.586972+0000","last_undegraded":"2023-12-08T08:22:04.586972+0000","last_fullsized":"2023-12-08T08:22:04.586972+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:39:10.600711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.084504+0000","last_change":"2023-12-08T08:22:03.082818+0000","last_active":"2023-12-08T08:22:04.084504+0000","last_peered":"2023-12-08T08:22:04.084504+0000","last_clean":"2023-12-08T08:22:04.084504+0000","last_became_active":"2023-12-08T08:22:03.082478+0000","last_became_peered":"2023-12-08T08:22:03.082478+0000","last_unstale":"2023-12-08T08:22:04.084504+0000","last_undegraded":"2023-12-08T08:22:04.084504+0000","last_fullsized":"2023-12-08T08:22:04.084504+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:05:53.649968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587265+0000","last_change":"2023-12-08T08:22:03.085515+0000","last_active":"2023-12-08T08:22:04.587265+0000","last_peered":"2023-12-08T08:22:04.587265+0000","last_clean":"2023-12-08T08:22:04.587265+0000","last_became_active":"2023-12-08T08:22:03.085246+0000","last_became_peered":"2023-12-08T08:22:03.085246+0000","last_unstale":"2023-12-08T08:22:04.587265+0000","last_undegraded":"2023-12-08T08:22:04.587265+0000","last_fullsized":"2023-12-08T08:22:04.587265+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:26:11.213018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585603+0000","last_change":"2023-12-08T08:22:03.083991+0000","last_active":"2023-12-08T08:22:04.585603+0000","last_peered":"2023-12-08T08:22:04.585603+0000","last_clean":"2023-12-08T08:22:04.585603+0000","last_became_active":"2023-12-08T08:22:03.083738+0000","last_became_peered":"2023-12-08T08:22:03.083738+0000","last_unstale":"2023-12-08T08:22:04.585603+0000","last_undegraded":"2023-12-08T08:22:04.585603+0000","last_fullsized":"2023-12-08T08:22:04.585603+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:20:35.224185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.084441+0000","last_change":"2023-12-08T08:22:03.080094+0000","last_active":"2023-12-08T08:22:04.084441+0000","last_peered":"2023-12-08T08:22:04.084441+0000","last_clean":"2023-12-08T08:22:04.084441+0000","last_became_active":"2023-12-08T08:22:03.079795+0000","last_became_peered":"2023-12-08T08:22:03.079795+0000","last_unstale":"2023-12-08T08:22:04.084441+0000","last_undegraded":"2023-12-08T08:22:04.084441+0000","last_fullsized":"2023-12-08T08:22:04.084441+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:57:11.073341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.073874+0000","last_change":"2023-12-08T08:22:03.094432+0000","last_active":"2023-12-08T08:22:04.073874+0000","last_peered":"2023-12-08T08:22:04.073874+0000","last_clean":"2023-12-08T08:22:04.073874+0000","last_became_active":"2023-12-08T08:22:03.087374+0000","last_became_peered":"2023-12-08T08:22:03.087374+0000","last_unstale":"2023-12-08T08:22:04.073874+0000","last_undegraded":"2023-12-08T08:22:04.073874+0000","last_fullsized":"2023-12-08T08:22:04.073874+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:59:36.108166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587375+0000","last_change":"2023-12-08T08:22:03.089625+0000","last_active":"2023-12-08T08:22:04.587375+0000","last_peered":"2023-12-08T08:22:04.587375+0000","last_clean":"2023-12-08T08:22:04.587375+0000","last_became_active":"2023-12-08T08:22:03.089301+0000","last_became_peered":"2023-12-08T08:22:03.089301+0000","last_unstale":"2023-12-08T08:22:04.587375+0000","last_undegraded":"2023-12-08T08:22:04.587375+0000","last_fullsized":"2023-12-08T08:22:04.587375+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:09:02.981325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.084188+0000","last_change":"2023-12-08T08:22:03.080674+0000","last_active":"2023-12-08T08:22:04.084188+0000","last_peered":"2023-12-08T08:22:04.084188+0000","last_clean":"2023-12-08T08:22:04.084188+0000","last_became_active":"2023-12-08T08:22:03.080208+0000","last_became_peered":"2023-12-08T08:22:03.080208+0000","last_unstale":"2023-12-08T08:22:04.084188+0000","last_undegraded":"2023-12-08T08:22:04.084188+0000","last_fullsized":"2023-12-08T08:22:04.084188+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:41:55.888655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585174+0000","last_change":"2023-12-08T08:22:03.092105+0000","last_active":"2023-12-08T08:22:04.585174+0000","last_peered":"2023-12-08T08:22:04.585174+0000","last_clean":"2023-12-08T08:22:04.585174+0000","last_became_active":"2023-12-08T08:22:03.091851+0000","last_became_peered":"2023-12-08T08:22:03.091851+0000","last_unstale":"2023-12-08T08:22:04.585174+0000","last_undegraded":"2023-12-08T08:22:04.585174+0000","last_fullsized":"2023-12-08T08:22:04.585174+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:28:41.729314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585778+0000","last_change":"2023-12-08T08:22:03.081847+0000","last_active":"2023-12-08T08:22:04.585778+0000","last_peered":"2023-12-08T08:22:04.585778+0000","last_clean":"2023-12-08T08:22:04.585778+0000","last_became_active":"2023-12-08T08:22:03.081484+0000","last_became_peered":"2023-12-08T08:22:03.081484+0000","last_unstale":"2023-12-08T08:22:04.585778+0000","last_undegraded":"2023-12-08T08:22:04.585778+0000","last_fullsized":"2023-12-08T08:22:04.585778+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:19:26.991097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.102980+0000","last_change":"2023-12-08T08:22:02.066070+0000","last_active":"2023-12-08T08:22:03.102980+0000","last_peered":"2023-12-08T08:22:03.102980+0000","last_clean":"2023-12-08T08:22:03.102980+0000","last_became_active":"2023-12-08T08:22:02.065684+0000","last_became_peered":"2023-12-08T08:22:02.065684+0000","last_unstale":"2023-12-08T08:22:03.102980+0000","last_undegraded":"2023-12-08T08:22:03.102980+0000","last_fullsized":"2023-12-08T08:22:03.102980+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:26:10.210451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.586057+0000","last_change":"2023-12-08T08:22:03.079744+0000","last_active":"2023-12-08T08:22:04.586057+0000","last_peered":"2023-12-08T08:22:04.586057+0000","last_clean":"2023-12-08T08:22:04.586057+0000","last_became_active":"2023-12-08T08:22:03.079466+0000","last_became_peered":"2023-12-08T08:22:03.079466+0000","last_unstale":"2023-12-08T08:22:04.586057+0000","last_undegraded":"2023-12-08T08:22:04.586057+0000","last_fullsized":"2023-12-08T08:22:04.586057+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:14.557616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.105540+0000","last_change":"2023-12-08T08:22:02.068162+0000","last_active":"2023-12-08T08:22:03.105540+0000","last_peered":"2023-12-08T08:22:03.105540+0000","last_clean":"2023-12-08T08:22:03.105540+0000","last_became_active":"2023-12-08T08:22:02.067918+0000","last_became_peered":"2023-12-08T08:22:02.067918+0000","last_unstale":"2023-12-08T08:22:03.105540+0000","last_undegraded":"2023-12-08T08:22:03.105540+0000","last_fullsized":"2023-12-08T08:22:03.105540+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:19:22.732492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585687+0000","last_change":"2023-12-08T08:22:03.074660+0000","last_active":"2023-12-08T08:22:04.585687+0000","last_peered":"2023-12-08T08:22:04.585687+0000","last_clean":"2023-12-08T08:22:04.585687+0000","last_became_active":"2023-12-08T08:22:03.073168+0000","last_became_peered":"2023-12-08T08:22:03.073168+0000","last_unstale":"2023-12-08T08:22:04.585687+0000","last_undegraded":"2023-12-08T08:22:04.585687+0000","last_fullsized":"2023-12-08T08:22:04.585687+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:46:06.406259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.103717+0000","last_change":"2023-12-08T08:22:02.061868+0000","last_active":"2023-12-08T08:22:03.103717+0000","last_peered":"2023-12-08T08:22:03.103717+0000","last_clean":"2023-12-08T08:22:03.103717+0000","last_became_active":"2023-12-08T08:22:02.061570+0000","last_became_peered":"2023-12-08T08:22:02.061570+0000","last_unstale":"2023-12-08T08:22:03.103717+0000","last_undegraded":"2023-12-08T08:22:03.103717+0000","last_fullsized":"2023-12-08T08:22:03.103717+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:33.039458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585692+0000","last_change":"2023-12-08T08:22:03.080628+0000","last_active":"2023-12-08T08:22:04.585692+0000","last_peered":"2023-12-08T08:22:04.585692+0000","last_clean":"2023-12-08T08:22:04.585692+0000","last_became_active":"2023-12-08T08:22:03.079475+0000","last_became_peered":"2023-12-08T08:22:03.079475+0000","last_unstale":"2023-12-08T08:22:04.585692+0000","last_undegraded":"2023-12-08T08:22:04.585692+0000","last_fullsized":"2023-12-08T08:22:04.585692+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:40:01.464725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.100776+0000","last_change":"2023-12-08T08:22:02.073413+0000","last_active":"2023-12-08T08:22:03.100776+0000","last_peered":"2023-12-08T08:22:03.100776+0000","last_clean":"2023-12-08T08:22:03.100776+0000","last_became_active":"2023-12-08T08:22:02.073043+0000","last_became_peered":"2023-12-08T08:22:02.073043+0000","last_unstale":"2023-12-08T08:22:03.100776+0000","last_undegraded":"2023-12-08T08:22:03.100776+0000","last_fullsized":"2023-12-08T08:22:03.100776+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:10.386004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.073774+0000","last_change":"2023-12-08T08:22:03.087625+0000","last_active":"2023-12-08T08:22:04.073774+0000","last_peered":"2023-12-08T08:22:04.073774+0000","last_clean":"2023-12-08T08:22:04.073774+0000","last_became_active":"2023-12-08T08:22:03.087331+0000","last_became_peered":"2023-12-08T08:22:03.087331+0000","last_unstale":"2023-12-08T08:22:04.073774+0000","last_undegraded":"2023-12-08T08:22:04.073774+0000","last_fullsized":"2023-12-08T08:22:04.073774+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:36:18.806109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.103838+0000","last_change":"2023-12-08T08:22:02.074443+0000","last_active":"2023-12-08T08:22:03.103838+0000","last_peered":"2023-12-08T08:22:03.103838+0000","last_clean":"2023-12-08T08:22:03.103838+0000","last_became_active":"2023-12-08T08:22:02.074076+0000","last_became_peered":"2023-12-08T08:22:02.074076+0000","last_unstale":"2023-12-08T08:22:03.103838+0000","last_undegraded":"2023-12-08T08:22:03.103838+0000","last_fullsized":"2023-12-08T08:22:03.103838+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:14.917716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.073753+0000","last_change":"2023-12-08T08:22:03.087737+0000","last_active":"2023-12-08T08:22:04.073753+0000","last_peered":"2023-12-08T08:22:04.073753+0000","last_clean":"2023-12-08T08:22:04.073753+0000","last_became_active":"2023-12-08T08:22:03.087444+0000","last_became_peered":"2023-12-08T08:22:03.087444+0000","last_unstale":"2023-12-08T08:22:04.073753+0000","last_undegraded":"2023-12-08T08:22:04.073753+0000","last_fullsized":"2023-12-08T08:22:04.073753+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:55:14.301650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.099508+0000","last_change":"2023-12-08T08:22:02.061389+0000","last_active":"2023-12-08T08:22:03.099508+0000","last_peered":"2023-12-08T08:22:03.099508+0000","last_clean":"2023-12-08T08:22:03.099508+0000","last_became_active":"2023-12-08T08:22:02.060880+0000","last_became_peered":"2023-12-08T08:22:02.060880+0000","last_unstale":"2023-12-08T08:22:03.099508+0000","last_undegraded":"2023-12-08T08:22:03.099508+0000","last_fullsized":"2023-12-08T08:22:03.099508+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:40:30.991375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587109+0000","last_change":"2023-12-08T08:22:03.081163+0000","last_active":"2023-12-08T08:22:04.587109+0000","last_peered":"2023-12-08T08:22:04.587109+0000","last_clean":"2023-12-08T08:22:04.587109+0000","last_became_active":"2023-12-08T08:22:03.080865+0000","last_became_peered":"2023-12-08T08:22:03.080865+0000","last_unstale":"2023-12-08T08:22:04.587109+0000","last_undegraded":"2023-12-08T08:22:04.587109+0000","last_fullsized":"2023-12-08T08:22:04.587109+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:43:03.723079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.067907+0000","last_change":"2023-12-08T08:22:02.063925+0000","last_active":"2023-12-08T08:22:03.067907+0000","last_peered":"2023-12-08T08:22:03.067907+0000","last_clean":"2023-12-08T08:22:03.067907+0000","last_became_active":"2023-12-08T08:22:02.063585+0000","last_became_peered":"2023-12-08T08:22:02.063585+0000","last_unstale":"2023-12-08T08:22:03.067907+0000","last_undegraded":"2023-12-08T08:22:03.067907+0000","last_fullsized":"2023-12-08T08:22:03.067907+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:08:57.419992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.073594+0000","last_change":"2023-12-08T08:22:03.083889+0000","last_active":"2023-12-08T08:22:04.073594+0000","last_peered":"2023-12-08T08:22:04.073594+0000","last_clean":"2023-12-08T08:22:04.073594+0000","last_became_active":"2023-12-08T08:22:03.083388+0000","last_became_peered":"2023-12-08T08:22:03.083388+0000","last_unstale":"2023-12-08T08:22:04.073594+0000","last_undegraded":"2023-12-08T08:22:04.073594+0000","last_fullsized":"2023-12-08T08:22:04.073594+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:27:49.636110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.063273+0000","last_change":"2023-12-08T08:22:02.066732+0000","last_active":"2023-12-08T08:22:03.063273+0000","last_peered":"2023-12-08T08:22:03.063273+0000","last_clean":"2023-12-08T08:22:03.063273+0000","last_became_active":"2023-12-08T08:22:02.066414+0000","last_became_peered":"2023-12-08T08:22:02.066414+0000","last_unstale":"2023-12-08T08:22:03.063273+0000","last_undegraded":"2023-12-08T08:22:03.063273+0000","last_fullsized":"2023-12-08T08:22:03.063273+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:08:57.419992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.075180+0000","last_change":"2023-12-08T08:22:03.072301+0000","last_active":"2023-12-08T08:22:04.075180+0000","last_peered":"2023-12-08T08:22:04.075180+0000","last_clean":"2023-12-08T08:22:04.075180+0000","last_became_active":"2023-12-08T08:22:03.071376+0000","last_became_peered":"2023-12-08T08:22:03.071376+0000","last_unstale":"2023-12-08T08:22:04.075180+0000","last_undegraded":"2023-12-08T08:22:04.075180+0000","last_fullsized":"2023-12-08T08:22:04.075180+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:02:41.988642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.079499+0000","last_change":"2023-12-08T08:22:02.073329+0000","last_active":"2023-12-08T08:22:03.079499+0000","last_peered":"2023-12-08T08:22:03.079499+0000","last_clean":"2023-12-08T08:22:03.079499+0000","last_became_active":"2023-12-08T08:22:02.073052+0000","last_became_peered":"2023-12-08T08:22:02.073052+0000","last_unstale":"2023-12-08T08:22:03.079499+0000","last_undegraded":"2023-12-08T08:22:03.079499+0000","last_fullsized":"2023-12-08T08:22:03.079499+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:22:40.527797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587080+0000","last_change":"2023-12-08T08:22:03.084451+0000","last_active":"2023-12-08T08:22:04.587080+0000","last_peered":"2023-12-08T08:22:04.587080+0000","last_clean":"2023-12-08T08:22:04.587080+0000","last_became_active":"2023-12-08T08:22:03.084098+0000","last_became_peered":"2023-12-08T08:22:03.084098+0000","last_unstale":"2023-12-08T08:22:04.587080+0000","last_undegraded":"2023-12-08T08:22:04.587080+0000","last_fullsized":"2023-12-08T08:22:04.587080+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:07.393106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.069089+0000","last_change":"2023-12-08T08:22:02.074584+0000","last_active":"2023-12-08T08:22:03.069089+0000","last_peered":"2023-12-08T08:22:03.069089+0000","last_clean":"2023-12-08T08:22:03.069089+0000","last_became_active":"2023-12-08T08:22:02.072443+0000","last_became_peered":"2023-12-08T08:22:02.072443+0000","last_unstale":"2023-12-08T08:22:03.069089+0000","last_undegraded":"2023-12-08T08:22:03.069089+0000","last_fullsized":"2023-12-08T08:22:03.069089+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:19:17.959027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585532+0000","last_change":"2023-12-08T08:22:03.085967+0000","last_active":"2023-12-08T08:22:04.585532+0000","last_peered":"2023-12-08T08:22:04.585532+0000","last_clean":"2023-12-08T08:22:04.585532+0000","last_became_active":"2023-12-08T08:22:03.085151+0000","last_became_peered":"2023-12-08T08:22:03.085151+0000","last_unstale":"2023-12-08T08:22:04.585532+0000","last_undegraded":"2023-12-08T08:22:04.585532+0000","last_fullsized":"2023-12-08T08:22:04.585532+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:45:40.961425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.107847+0000","last_change":"2023-12-08T08:22:02.071820+0000","last_active":"2023-12-08T08:22:03.107847+0000","last_peered":"2023-12-08T08:22:03.107847+0000","last_clean":"2023-12-08T08:22:03.107847+0000","last_became_active":"2023-12-08T08:22:02.071513+0000","last_became_peered":"2023-12-08T08:22:02.071513+0000","last_unstale":"2023-12-08T08:22:03.107847+0000","last_undegraded":"2023-12-08T08:22:03.107847+0000","last_fullsized":"2023-12-08T08:22:03.107847+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:10.386004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587458+0000","last_change":"2023-12-08T08:22:03.082875+0000","last_active":"2023-12-08T08:22:04.587458+0000","last_peered":"2023-12-08T08:22:04.587458+0000","last_clean":"2023-12-08T08:22:04.587458+0000","last_became_active":"2023-12-08T08:22:03.082546+0000","last_became_peered":"2023-12-08T08:22:03.082546+0000","last_unstale":"2023-12-08T08:22:04.587458+0000","last_undegraded":"2023-12-08T08:22:04.587458+0000","last_fullsized":"2023-12-08T08:22:04.587458+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:28:41.729314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"49'6","reported_seq":18,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.107379+0000","last_change":"2023-12-08T08:22:02.064284+0000","last_active":"2023-12-08T08:22:03.107379+0000","last_peered":"2023-12-08T08:22:03.107379+0000","last_clean":"2023-12-08T08:22:03.107379+0000","last_became_active":"2023-12-08T08:22:02.063986+0000","last_became_peered":"2023-12-08T08:22:02.063986+0000","last_unstale":"2023-12-08T08:22:03.107379+0000","last_undegraded":"2023-12-08T08:22:03.107379+0000","last_fullsized":"2023-12-08T08:22:03.107379+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:37:19.999893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587668+0000","last_change":"2023-12-08T08:22:03.081953+0000","last_active":"2023-12-08T08:22:04.587668+0000","last_peered":"2023-12-08T08:22:04.587668+0000","last_clean":"2023-12-08T08:22:04.587668+0000","last_became_active":"2023-12-08T08:22:03.081662+0000","last_became_peered":"2023-12-08T08:22:03.081662+0000","last_unstale":"2023-12-08T08:22:04.587668+0000","last_undegraded":"2023-12-08T08:22:04.587668+0000","last_fullsized":"2023-12-08T08:22:04.587668+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:32:19.298896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.105591+0000","last_change":"2023-12-08T08:22:02.073150+0000","last_active":"2023-12-08T08:22:03.105591+0000","last_peered":"2023-12-08T08:22:03.105591+0000","last_clean":"2023-12-08T08:22:03.105591+0000","last_became_active":"2023-12-08T08:22:02.071562+0000","last_became_peered":"2023-12-08T08:22:02.071562+0000","last_unstale":"2023-12-08T08:22:03.105591+0000","last_undegraded":"2023-12-08T08:22:03.105591+0000","last_fullsized":"2023-12-08T08:22:03.105591+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:52.880423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.586547+0000","last_change":"2023-12-08T08:22:03.085696+0000","last_active":"2023-12-08T08:22:04.586547+0000","last_peered":"2023-12-08T08:22:04.586547+0000","last_clean":"2023-12-08T08:22:04.586547+0000","last_became_active":"2023-12-08T08:22:03.085451+0000","last_became_peered":"2023-12-08T08:22:03.085451+0000","last_unstale":"2023-12-08T08:22:04.586547+0000","last_undegraded":"2023-12-08T08:22:04.586547+0000","last_fullsized":"2023-12-08T08:22:04.586547+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:33:05.704375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.075968+0000","last_change":"2023-12-08T08:22:02.067718+0000","last_active":"2023-12-08T08:22:03.075968+0000","last_peered":"2023-12-08T08:22:03.075968+0000","last_clean":"2023-12-08T08:22:03.075968+0000","last_became_active":"2023-12-08T08:22:02.067452+0000","last_became_peered":"2023-12-08T08:22:02.067452+0000","last_unstale":"2023-12-08T08:22:03.075968+0000","last_undegraded":"2023-12-08T08:22:03.075968+0000","last_fullsized":"2023-12-08T08:22:03.075968+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:15.294424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.075300+0000","last_change":"2023-12-08T08:22:03.083625+0000","last_active":"2023-12-08T08:22:04.075300+0000","last_peered":"2023-12-08T08:22:04.075300+0000","last_clean":"2023-12-08T08:22:04.075300+0000","last_became_active":"2023-12-08T08:22:03.081132+0000","last_became_peered":"2023-12-08T08:22:03.081132+0000","last_unstale":"2023-12-08T08:22:04.075300+0000","last_undegraded":"2023-12-08T08:22:04.075300+0000","last_fullsized":"2023-12-08T08:22:04.075300+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:03:18.580501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.068046+0000","last_change":"2023-12-08T08:22:02.072008+0000","last_active":"2023-12-08T08:22:03.068046+0000","last_peered":"2023-12-08T08:22:03.068046+0000","last_clean":"2023-12-08T08:22:03.068046+0000","last_became_active":"2023-12-08T08:22:02.071711+0000","last_became_peered":"2023-12-08T08:22:02.071711+0000","last_unstale":"2023-12-08T08:22:03.068046+0000","last_undegraded":"2023-12-08T08:22:03.068046+0000","last_fullsized":"2023-12-08T08:22:03.068046+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:02.472465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.586721+0000","last_change":"2023-12-08T08:22:03.092670+0000","last_active":"2023-12-08T08:22:04.586721+0000","last_peered":"2023-12-08T08:22:04.586721+0000","last_clean":"2023-12-08T08:22:04.586721+0000","last_became_active":"2023-12-08T08:22:03.092387+0000","last_became_peered":"2023-12-08T08:22:03.092387+0000","last_unstale":"2023-12-08T08:22:04.586721+0000","last_undegraded":"2023-12-08T08:22:04.586721+0000","last_fullsized":"2023-12-08T08:22:04.586721+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:34.042026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.110252+0000","last_change":"2023-12-08T08:22:02.071841+0000","last_active":"2023-12-08T08:22:03.110252+0000","last_peered":"2023-12-08T08:22:03.110252+0000","last_clean":"2023-12-08T08:22:03.110252+0000","last_became_active":"2023-12-08T08:22:02.071531+0000","last_became_peered":"2023-12-08T08:22:02.071531+0000","last_unstale":"2023-12-08T08:22:03.110252+0000","last_undegraded":"2023-12-08T08:22:03.110252+0000","last_fullsized":"2023-12-08T08:22:03.110252+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:55:21.616638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587396+0000","last_change":"2023-12-08T08:22:03.090890+0000","last_active":"2023-12-08T08:22:04.587396+0000","last_peered":"2023-12-08T08:22:04.587396+0000","last_clean":"2023-12-08T08:22:04.587396+0000","last_became_active":"2023-12-08T08:22:03.090648+0000","last_became_peered":"2023-12-08T08:22:03.090648+0000","last_unstale":"2023-12-08T08:22:04.587396+0000","last_undegraded":"2023-12-08T08:22:04.587396+0000","last_fullsized":"2023-12-08T08:22:04.587396+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:49:47.998533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.099606+0000","last_change":"2023-12-08T08:22:02.072612+0000","last_active":"2023-12-08T08:22:03.099606+0000","last_peered":"2023-12-08T08:22:03.099606+0000","last_clean":"2023-12-08T08:22:03.099606+0000","last_became_active":"2023-12-08T08:22:02.071308+0000","last_became_peered":"2023-12-08T08:22:02.071308+0000","last_unstale":"2023-12-08T08:22:03.099606+0000","last_undegraded":"2023-12-08T08:22:03.099606+0000","last_fullsized":"2023-12-08T08:22:03.099606+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:19:25.988530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587315+0000","last_change":"2023-12-08T08:22:03.085089+0000","last_active":"2023-12-08T08:22:04.587315+0000","last_peered":"2023-12-08T08:22:04.587315+0000","last_clean":"2023-12-08T08:22:04.587315+0000","last_became_active":"2023-12-08T08:22:03.084765+0000","last_became_peered":"2023-12-08T08:22:03.084765+0000","last_unstale":"2023-12-08T08:22:04.587315+0000","last_undegraded":"2023-12-08T08:22:04.587315+0000","last_fullsized":"2023-12-08T08:22:04.587315+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:22:41.530364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.102680+0000","last_change":"2023-12-08T08:22:02.074304+0000","last_active":"2023-12-08T08:22:03.102680+0000","last_peered":"2023-12-08T08:22:03.102680+0000","last_clean":"2023-12-08T08:22:03.102680+0000","last_became_active":"2023-12-08T08:22:02.074007+0000","last_became_peered":"2023-12-08T08:22:02.074007+0000","last_unstale":"2023-12-08T08:22:03.102680+0000","last_undegraded":"2023-12-08T08:22:03.102680+0000","last_fullsized":"2023-12-08T08:22:03.102680+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:03:17.577934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.073911+0000","last_change":"2023-12-08T08:22:03.089470+0000","last_active":"2023-12-08T08:22:04.073911+0000","last_peered":"2023-12-08T08:22:04.073911+0000","last_clean":"2023-12-08T08:22:04.073911+0000","last_became_active":"2023-12-08T08:22:03.089134+0000","last_became_peered":"2023-12-08T08:22:03.089134+0000","last_unstale":"2023-12-08T08:22:04.073911+0000","last_undegraded":"2023-12-08T08:22:04.073911+0000","last_fullsized":"2023-12-08T08:22:04.073911+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:23:38.798779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.100742+0000","last_change":"2023-12-08T08:22:02.073388+0000","last_active":"2023-12-08T08:22:03.100742+0000","last_peered":"2023-12-08T08:22:03.100742+0000","last_clean":"2023-12-08T08:22:03.100742+0000","last_became_active":"2023-12-08T08:22:02.073107+0000","last_became_peered":"2023-12-08T08:22:02.073107+0000","last_unstale":"2023-12-08T08:22:03.100742+0000","last_undegraded":"2023-12-08T08:22:03.100742+0000","last_fullsized":"2023-12-08T08:22:03.100742+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:02:40.986075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587540+0000","last_change":"2023-12-08T08:22:03.082904+0000","last_active":"2023-12-08T08:22:04.587540+0000","last_peered":"2023-12-08T08:22:04.587540+0000","last_clean":"2023-12-08T08:22:04.587540+0000","last_became_active":"2023-12-08T08:22:03.082553+0000","last_became_peered":"2023-12-08T08:22:03.082553+0000","last_unstale":"2023-12-08T08:22:04.587540+0000","last_undegraded":"2023-12-08T08:22:04.587540+0000","last_fullsized":"2023-12-08T08:22:04.587540+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:30:11.797254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.059892+0000","last_change":"2023-12-08T08:22:02.067383+0000","last_active":"2023-12-08T08:22:03.059892+0000","last_peered":"2023-12-08T08:22:03.059892+0000","last_clean":"2023-12-08T08:22:03.059892+0000","last_became_active":"2023-12-08T08:22:02.067094+0000","last_became_peered":"2023-12-08T08:22:02.067094+0000","last_unstale":"2023-12-08T08:22:03.059892+0000","last_undegraded":"2023-12-08T08:22:03.059892+0000","last_fullsized":"2023-12-08T08:22:03.059892+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:22:40.527797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587797+0000","last_change":"2023-12-08T08:22:03.080977+0000","last_active":"2023-12-08T08:22:04.587797+0000","last_peered":"2023-12-08T08:22:04.587797+0000","last_clean":"2023-12-08T08:22:04.587797+0000","last_became_active":"2023-12-08T08:22:03.080612+0000","last_became_peered":"2023-12-08T08:22:03.080612+0000","last_unstale":"2023-12-08T08:22:04.587797+0000","last_undegraded":"2023-12-08T08:22:04.587797+0000","last_fullsized":"2023-12-08T08:22:04.587797+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:34.042026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.105511+0000","last_change":"2023-12-08T08:22:02.055138+0000","last_active":"2023-12-08T08:22:03.105511+0000","last_peered":"2023-12-08T08:22:03.105511+0000","last_clean":"2023-12-08T08:22:03.105511+0000","last_became_active":"2023-12-08T08:22:02.054797+0000","last_became_peered":"2023-12-08T08:22:02.054797+0000","last_unstale":"2023-12-08T08:22:03.105511+0000","last_undegraded":"2023-12-08T08:22:03.105511+0000","last_fullsized":"2023-12-08T08:22:03.105511+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:20:34.221617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585590+0000","last_change":"2023-12-08T08:22:03.084160+0000","last_active":"2023-12-08T08:22:04.585590+0000","last_peered":"2023-12-08T08:22:04.585590+0000","last_clean":"2023-12-08T08:22:04.585590+0000","last_became_active":"2023-12-08T08:22:03.083881+0000","last_became_peered":"2023-12-08T08:22:03.083881+0000","last_unstale":"2023-12-08T08:22:04.585590+0000","last_undegraded":"2023-12-08T08:22:04.585590+0000","last_fullsized":"2023-12-08T08:22:04.585590+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:30:11.797254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.066052+0000","last_change":"2023-12-08T08:22:02.072456+0000","last_active":"2023-12-08T08:22:03.066052+0000","last_peered":"2023-12-08T08:22:03.066052+0000","last_clean":"2023-12-08T08:22:03.066052+0000","last_became_active":"2023-12-08T08:22:02.072146+0000","last_became_peered":"2023-12-08T08:22:02.072146+0000","last_unstale":"2023-12-08T08:22:03.066052+0000","last_undegraded":"2023-12-08T08:22:03.066052+0000","last_fullsized":"2023-12-08T08:22:03.066052+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:39:09.598144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585125+0000","last_change":"2023-12-08T08:22:03.082233+0000","last_active":"2023-12-08T08:22:04.585125+0000","last_peered":"2023-12-08T08:22:04.585125+0000","last_clean":"2023-12-08T08:22:04.585125+0000","last_became_active":"2023-12-08T08:22:03.082064+0000","last_became_peered":"2023-12-08T08:22:03.082064+0000","last_unstale":"2023-12-08T08:22:04.585125+0000","last_undegraded":"2023-12-08T08:22:04.585125+0000","last_fullsized":"2023-12-08T08:22:04.585125+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:09:02.981325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.068373+0000","last_change":"2023-12-08T08:22:02.065223+0000","last_active":"2023-12-08T08:22:03.068373+0000","last_peered":"2023-12-08T08:22:03.068373+0000","last_clean":"2023-12-08T08:22:03.068373+0000","last_became_active":"2023-12-08T08:22:02.064829+0000","last_became_peered":"2023-12-08T08:22:02.064829+0000","last_unstale":"2023-12-08T08:22:03.068373+0000","last_undegraded":"2023-12-08T08:22:03.068373+0000","last_fullsized":"2023-12-08T08:22:03.068373+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:37:19.999893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587372+0000","last_change":"2023-12-08T08:22:03.078777+0000","last_active":"2023-12-08T08:22:04.587372+0000","last_peered":"2023-12-08T08:22:04.587372+0000","last_clean":"2023-12-08T08:22:04.587372+0000","last_became_active":"2023-12-08T08:22:03.078459+0000","last_became_peered":"2023-12-08T08:22:03.078459+0000","last_unstale":"2023-12-08T08:22:04.587372+0000","last_undegraded":"2023-12-08T08:22:04.587372+0000","last_fullsized":"2023-12-08T08:22:04.587372+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:09:22.027038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.103249+0000","last_change":"2023-12-08T08:22:02.057964+0000","last_active":"2023-12-08T08:22:03.103249+0000","last_peered":"2023-12-08T08:22:03.103249+0000","last_clean":"2023-12-08T08:22:03.103249+0000","last_became_active":"2023-12-08T08:22:02.057677+0000","last_became_peered":"2023-12-08T08:22:02.057677+0000","last_unstale":"2023-12-08T08:22:03.103249+0000","last_undegraded":"2023-12-08T08:22:03.103249+0000","last_fullsized":"2023-12-08T08:22:03.103249+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:59:29.971100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587464+0000","last_change":"2023-12-08T08:22:03.087590+0000","last_active":"2023-12-08T08:22:04.587464+0000","last_peered":"2023-12-08T08:22:04.587464+0000","last_clean":"2023-12-08T08:22:04.587464+0000","last_became_active":"2023-12-08T08:22:03.087219+0000","last_became_peered":"2023-12-08T08:22:03.087219+0000","last_unstale":"2023-12-08T08:22:04.587464+0000","last_undegraded":"2023-12-08T08:22:04.587464+0000","last_fullsized":"2023-12-08T08:22:04.587464+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:14:25.475662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585982+0000","last_change":"2023-12-08T08:22:02.061620+0000","last_active":"2023-12-08T08:22:04.585982+0000","last_peered":"2023-12-08T08:22:04.585982+0000","last_clean":"2023-12-08T08:22:04.585982+0000","last_became_active":"2023-12-08T08:22:02.061329+0000","last_became_peered":"2023-12-08T08:22:02.061329+0000","last_unstale":"2023-12-08T08:22:04.585982+0000","last_undegraded":"2023-12-08T08:22:04.585982+0000","last_fullsized":"2023-12-08T08:22:04.585982+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:14:24.473095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585638+0000","last_change":"2023-12-08T08:22:03.080218+0000","last_active":"2023-12-08T08:22:04.585638+0000","last_peered":"2023-12-08T08:22:04.585638+0000","last_clean":"2023-12-08T08:22:04.585638+0000","last_became_active":"2023-12-08T08:22:03.079973+0000","last_became_peered":"2023-12-08T08:22:03.079973+0000","last_unstale":"2023-12-08T08:22:04.585638+0000","last_undegraded":"2023-12-08T08:22:04.585638+0000","last_fullsized":"2023-12-08T08:22:04.585638+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:25.833069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.076191+0000","last_change":"2023-12-08T08:22:02.059762+0000","last_active":"2023-12-08T08:22:03.076191+0000","last_peered":"2023-12-08T08:22:03.076191+0000","last_clean":"2023-12-08T08:22:03.076191+0000","last_became_active":"2023-12-08T08:22:02.059447+0000","last_became_peered":"2023-12-08T08:22:02.059447+0000","last_unstale":"2023-12-08T08:22:03.076191+0000","last_undegraded":"2023-12-08T08:22:03.076191+0000","last_fullsized":"2023-12-08T08:22:03.076191+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:32:25.205810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585750+0000","last_change":"2023-12-08T08:22:03.081034+0000","last_active":"2023-12-08T08:22:04.585750+0000","last_peered":"2023-12-08T08:22:04.585750+0000","last_clean":"2023-12-08T08:22:04.585750+0000","last_became_active":"2023-12-08T08:22:03.078866+0000","last_became_peered":"2023-12-08T08:22:03.078866+0000","last_unstale":"2023-12-08T08:22:04.585750+0000","last_undegraded":"2023-12-08T08:22:04.585750+0000","last_fullsized":"2023-12-08T08:22:04.585750+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:32:22.573403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.068734+0000","last_change":"2023-12-08T08:22:02.069094+0000","last_active":"2023-12-08T08:22:03.068734+0000","last_peered":"2023-12-08T08:22:03.068734+0000","last_clean":"2023-12-08T08:22:03.068734+0000","last_became_active":"2023-12-08T08:22:02.068768+0000","last_became_peered":"2023-12-08T08:22:02.068768+0000","last_unstale":"2023-12-08T08:22:03.068734+0000","last_undegraded":"2023-12-08T08:22:03.068734+0000","last_fullsized":"2023-12-08T08:22:03.068734+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:01:20.857568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.073747+0000","last_change":"2023-12-08T08:22:03.088146+0000","last_active":"2023-12-08T08:22:04.073747+0000","last_peered":"2023-12-08T08:22:04.073747+0000","last_clean":"2023-12-08T08:22:04.073747+0000","last_became_active":"2023-12-08T08:22:03.087857+0000","last_became_peered":"2023-12-08T08:22:03.087857+0000","last_unstale":"2023-12-08T08:22:04.073747+0000","last_undegraded":"2023-12-08T08:22:04.073747+0000","last_fullsized":"2023-12-08T08:22:04.073747+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:55:26.929515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.066923+0000","last_change":"2023-12-08T08:22:02.064371+0000","last_active":"2023-12-08T08:22:03.066923+0000","last_peered":"2023-12-08T08:22:03.066923+0000","last_clean":"2023-12-08T08:22:03.066923+0000","last_became_active":"2023-12-08T08:22:02.063996+0000","last_became_peered":"2023-12-08T08:22:02.063996+0000","last_unstale":"2023-12-08T08:22:03.066923+0000","last_undegraded":"2023-12-08T08:22:03.066923+0000","last_fullsized":"2023-12-08T08:22:03.066923+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:44.535120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.586651+0000","last_change":"2023-12-08T08:22:03.096910+0000","last_active":"2023-12-08T08:22:04.586651+0000","last_peered":"2023-12-08T08:22:04.586651+0000","last_clean":"2023-12-08T08:22:04.586651+0000","last_became_active":"2023-12-08T08:22:03.096724+0000","last_became_peered":"2023-12-08T08:22:03.096724+0000","last_unstale":"2023-12-08T08:22:04.586651+0000","last_undegraded":"2023-12-08T08:22:04.586651+0000","last_fullsized":"2023-12-08T08:22:04.586651+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:32:19.298896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.063415+0000","last_change":"2023-12-08T08:22:02.063148+0000","last_active":"2023-12-08T08:22:03.063415+0000","last_peered":"2023-12-08T08:22:03.063415+0000","last_clean":"2023-12-08T08:22:03.063415+0000","last_became_active":"2023-12-08T08:22:02.062860+0000","last_became_peered":"2023-12-08T08:22:02.062860+0000","last_unstale":"2023-12-08T08:22:03.063415+0000","last_undegraded":"2023-12-08T08:22:03.063415+0000","last_fullsized":"2023-12-08T08:22:03.063415+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:02.472465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585024+0000","last_change":"2023-12-08T08:22:03.078867+0000","last_active":"2023-12-08T08:22:04.585024+0000","last_peered":"2023-12-08T08:22:04.585024+0000","last_clean":"2023-12-08T08:22:04.585024+0000","last_became_active":"2023-12-08T08:22:03.078535+0000","last_became_peered":"2023-12-08T08:22:03.078535+0000","last_unstale":"2023-12-08T08:22:04.585024+0000","last_undegraded":"2023-12-08T08:22:04.585024+0000","last_fullsized":"2023-12-08T08:22:04.585024+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:17:42.639774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.065289+0000","last_change":"2023-12-08T08:22:02.055697+0000","last_active":"2023-12-08T08:22:03.065289+0000","last_peered":"2023-12-08T08:22:03.065289+0000","last_clean":"2023-12-08T08:22:03.065289+0000","last_became_active":"2023-12-08T08:22:02.055412+0000","last_became_peered":"2023-12-08T08:22:02.055412+0000","last_unstale":"2023-12-08T08:22:03.065289+0000","last_undegraded":"2023-12-08T08:22:03.065289+0000","last_fullsized":"2023-12-08T08:22:03.065289+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:32:25.205810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.073594+0000","last_change":"2023-12-08T08:22:03.083678+0000","last_active":"2023-12-08T08:22:04.073594+0000","last_peered":"2023-12-08T08:22:04.073594+0000","last_clean":"2023-12-08T08:22:04.073594+0000","last_became_active":"2023-12-08T08:22:03.079108+0000","last_became_peered":"2023-12-08T08:22:03.079108+0000","last_unstale":"2023-12-08T08:22:04.073594+0000","last_undegraded":"2023-12-08T08:22:04.073594+0000","last_fullsized":"2023-12-08T08:22:04.073594+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:13:57.755476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.069342+0000","last_change":"2023-12-08T08:22:02.065076+0000","last_active":"2023-12-08T08:22:03.069342+0000","last_peered":"2023-12-08T08:22:03.069342+0000","last_clean":"2023-12-08T08:22:03.069342+0000","last_became_active":"2023-12-08T08:22:02.064723+0000","last_became_peered":"2023-12-08T08:22:02.064723+0000","last_unstale":"2023-12-08T08:22:03.069342+0000","last_undegraded":"2023-12-08T08:22:03.069342+0000","last_fullsized":"2023-12-08T08:22:03.069342+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:27.429215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.073532+0000","last_change":"2023-12-08T08:22:03.074226+0000","last_active":"2023-12-08T08:22:04.073532+0000","last_peered":"2023-12-08T08:22:04.073532+0000","last_clean":"2023-12-08T08:22:04.073532+0000","last_became_active":"2023-12-08T08:22:03.073967+0000","last_became_peered":"2023-12-08T08:22:03.073967+0000","last_unstale":"2023-12-08T08:22:04.073532+0000","last_undegraded":"2023-12-08T08:22:04.073532+0000","last_fullsized":"2023-12-08T08:22:04.073532+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:09:19.676534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.076578+0000","last_change":"2023-12-08T08:22:02.066497+0000","last_active":"2023-12-08T08:22:03.076578+0000","last_peered":"2023-12-08T08:22:03.076578+0000","last_clean":"2023-12-08T08:22:03.076578+0000","last_became_active":"2023-12-08T08:22:02.065532+0000","last_became_peered":"2023-12-08T08:22:02.065532+0000","last_unstale":"2023-12-08T08:22:03.076578+0000","last_undegraded":"2023-12-08T08:22:03.076578+0000","last_fullsized":"2023-12-08T08:22:03.076578+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:44:58.303638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.069919+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:22:03.069919+0000","last_peered":"2023-12-08T08:22:03.069919+0000","last_clean":"2023-12-08T08:22:03.069919+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:22:03.069919+0000","last_undegraded":"2023-12-08T08:22:03.069919+0000","last_fullsized":"2023-12-08T08:22:03.069919+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":671744,"data_stored":842619,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.74099999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.85799999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.64300000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.71199999999999997}]},{"osd":4,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.83999999999999997}]},{"osd":5,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.93300000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:21:11 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.91100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":598016,"data_stored":252091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.747}]},{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.91400000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.65400000000000003}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.83799999999999997}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.94499999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.88}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.90000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":252743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.74399999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.66500000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.72699999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.79200000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.60899999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.48199999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.54400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":253703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.66300000000000003}]},{"osd":1,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.78600000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.749}]},{"osd":3,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.621}]},{"osd":5,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.63800000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.57299999999999995}]},{"osd":7,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.59699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":252147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.317},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.496}]},{"osd":1,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.39600000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.84599999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.754},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.86699999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.83399999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":252147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.315},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.0270000000000001,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.48299999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.42499999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.501}]},{"osd":4,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.626}]},{"osd":5,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":3.637,"5min":3.637,"15min":3.637},"last":0.54000000000000004}]},{"osd":6,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.55500000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.60299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":602112,"data_stored":252181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2210000000000001,"5min":5.2210000000000001,"15min":5.2210000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":8.3200000000000003,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.54800000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":8.2070000000000007,"5min":8.2070000000000007,"15min":8.2070000000000007},"last":0.434},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":4.351,"5min":4.351,"15min":4.351},"last":0.70899999999999996}]},{"osd":3,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":8.1479999999999997,"5min":8.1479999999999997,"15min":8.1479999999999997},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.3150000000000004,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.47499999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":4.8470000000000004,"5min":4.8470000000000004,"15min":4.8470000000000004},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":4.7939999999999996,"5min":4.7939999999999996,"15min":4.7939999999999996},"last":0.97599999999999998}]},{"osd":5,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":4.7240000000000002,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":4.5830000000000002,"5min":4.5830000000000002,"15min":4.5830000000000002},"last":0.89400000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":4.7699999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":4.6289999999999996,"5min":4.6289999999999996,"15min":4.6289999999999996},"last":1.012}]},{"osd":7,"last update":"Fri Dec 8 08:21:12 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":4.665,"5min":4.665,"15min":4.665},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":4.8140000000000001,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":1.0720000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":679936,"data_stored":844653,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":8.2799999999999994,"5min":8.2799999999999994,"15min":8.2799999999999994},"last":0.40699999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":7.9290000000000003,"5min":7.9290000000000003,"15min":7.9290000000000003},"last":0.35099999999999998},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":8.0890000000000004,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.45000000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":4.6550000000000002,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":7.8890000000000002,"5min":7.8890000000000002,"15min":7.8890000000000002},"last":0.43099999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":7.9649999999999999,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.72699999999999998}]},{"osd":5,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":8.0579999999999998,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.70399999999999996}]},{"osd":6,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":7.835,"5min":7.835,"15min":7.835},"last":0.71499999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:21:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":8.0239999999999991,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.80800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:22:11.975 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-08T08:22:11.975 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-08T08:22:12.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.151+0000 7ff3a9385640 1 Processor -- start 2023-12-08T08:22:12.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.151+0000 7ff3a9385640 1 -- start start 2023-12-08T08:22:12.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.155+0000 7ff3a9385640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3a41547a0 0x7ff3a41517c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:12.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.155+0000 7ff3a9385640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a4151330 con 0x7ff3a40c22e0 2023-12-08T08:22:12.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.155+0000 7ff3a9385640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a4154d10 con 0x7ff3a414e700 2023-12-08T08:22:12.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.155+0000 7ff3a9385640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a4154ff0 con 0x7ff3a41547a0 2023-12-08T08:22:12.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.155+0000 7ff3a8b84640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff3a40c22e0 0x7ff3a415bad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49294/0 (socket says 172.21.15.88:49294) 2023-12-08T08:22:12.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.155+0000 7ff3a8b84640 1 -- 172.21.15.88:0/1799308523 learned_addr learned my addr 172.21.15.88:0/1799308523 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:12.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.155+0000 7ff3a37fe640 1 --2- 172.21.15.88:0/1799308523 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3a41547a0 0x7ff3a41517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:12.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.155+0000 7ff3a2ffd640 1 -- 172.21.15.88:0/1799308523 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2305847761 0 0) 0x7ff3a4151330 con 0x7ff3a40c22e0 2023-12-08T08:22:12.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.155+0000 7ff3a2ffd640 1 -- 172.21.15.88:0/1799308523 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff38c003530 con 0x7ff3a40c22e0 2023-12-08T08:22:12.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.155+0000 7ff3a2ffd640 1 -- 172.21.15.88:0/1799308523 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524694066 0 0) 0x7ff3a4154d10 con 0x7ff3a414e700 2023-12-08T08:22:12.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.155+0000 7ff3a2ffd640 1 -- 172.21.15.88:0/1799308523 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3a4151330 con 0x7ff3a414e700 2023-12-08T08:22:12.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.155+0000 7ff3a2ffd640 1 -- 172.21.15.88:0/1799308523 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2052031421 0 0) 0x7ff38c003530 con 0x7ff3a40c22e0 2023-12-08T08:22:12.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.155+0000 7ff3a37fe640 1 -- 172.21.15.88:0/1799308523 >> v1:172.21.15.148:6789/0 conn(0x7ff3a414e700 legacy=0x7ff3a40c1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:12.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.155+0000 7ff3a37fe640 1 -- 172.21.15.88:0/1799308523 >> v1:172.21.15.88:6789/0 conn(0x7ff3a40c22e0 legacy=0x7ff3a415bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:12.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.155+0000 7ff3a37fe640 1 -- 172.21.15.88:0/1799308523 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a41552d0 con 0x7ff3a41547a0 2023-12-08T08:22:12.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.159+0000 7ff3a37fe640 1 --2- 172.21.15.88:0/1799308523 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3a41547a0 0x7ff3a41517c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff3980097f0 tx=0x7ff39801c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf2886267e5f4be6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:12.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.159+0000 7ff3a2ffd640 1 -- 172.21.15.88:0/1799308523 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c001a00 con 0x7ff3a41547a0 2023-12-08T08:22:12.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.159+0000 7ff3a2ffd640 1 -- 172.21.15.88:0/1799308523 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3980a7050 con 0x7ff3a41547a0 2023-12-08T08:22:12.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.159+0000 7ff3a2ffd640 1 -- 172.21.15.88:0/1799308523 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3980ab620 con 0x7ff3a41547a0 2023-12-08T08:22:12.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.159+0000 7ff3a9385640 1 -- 172.21.15.88:0/1799308523 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3a41547a0 msgr2=0x7ff3a41517c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:12.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.159+0000 7ff3a9385640 1 --2- 172.21.15.88:0/1799308523 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3a41547a0 0x7ff3a41517c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff3980097f0 tx=0x7ff39801c320 comp rx=0 tx=0).stop 2023-12-08T08:22:12.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.159+0000 7ff3a9385640 1 -- 172.21.15.88:0/1799308523 shutdown_connections 2023-12-08T08:22:12.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.159+0000 7ff3a9385640 1 --2- 172.21.15.88:0/1799308523 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3a41547a0 0x7ff3a41517c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:12.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.159+0000 7ff3a9385640 1 -- 172.21.15.88:0/1799308523 >> 172.21.15.88:0/1799308523 conn(0x7ff3a406b0d0 msgr2=0x7ff3a40a7600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:12.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.159+0000 7ff3a9385640 1 -- 172.21.15.88:0/1799308523 shutdown_connections 2023-12-08T08:22:12.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.159+0000 7ff3a9385640 1 -- 172.21.15.88:0/1799308523 wait complete. 2023-12-08T08:22:12.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.159+0000 7ff3a9385640 1 Processor -- start 2023-12-08T08:22:12.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.159+0000 7ff3a9385640 1 -- start start 2023-12-08T08:22:12.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.159+0000 7ff3a9385640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3a40c22e0 0x7ff3a414f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:12.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.159+0000 7ff3a9385640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3a414e700 0x7ff3a414a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:12.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.159+0000 7ff3a9385640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3a41547a0 0x7ff3a414aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:12.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.159+0000 7ff3a9385640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a414afc0 con 0x7ff3a41547a0 2023-12-08T08:22:12.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.159+0000 7ff3a9385640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a4148a80 con 0x7ff3a414e700 2023-12-08T08:22:12.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.159+0000 7ff3a9385640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a4149a60 con 0x7ff3a40c22e0 2023-12-08T08:22:12.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.163+0000 7ff3a8b84640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3a41547a0 0x7ff3a414aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:12.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.163+0000 7ff3a8b84640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3a41547a0 0x7ff3a414aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43406/0 (socket says 172.21.15.88:43406) 2023-12-08T08:22:12.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.163+0000 7ff3a8b84640 1 -- 172.21.15.88:0/3700561369 learned_addr learned my addr 172.21.15.88:0/3700561369 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:12.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.163+0000 7ff3a37fe640 1 --2- 172.21.15.88:0/3700561369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3a414e700 0x7ff3a414a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:12.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.163+0000 7ff3a3fff640 1 --2- 172.21.15.88:0/3700561369 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3a40c22e0 0x7ff3a414f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:12.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.163+0000 7ff3a8b84640 1 -- 172.21.15.88:0/3700561369 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3a40c22e0 msgr2=0x7ff3a414f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:12.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.163+0000 7ff3a8b84640 1 --2- 172.21.15.88:0/3700561369 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3a40c22e0 0x7ff3a414f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:12.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.163+0000 7ff3a8b84640 1 -- 172.21.15.88:0/3700561369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3a414e700 msgr2=0x7ff3a414a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:12.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.163+0000 7ff3a8b84640 1 --2- 172.21.15.88:0/3700561369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3a414e700 0x7ff3a414a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:12.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.163+0000 7ff3a8b84640 1 -- 172.21.15.88:0/3700561369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff398009420 con 0x7ff3a41547a0 2023-12-08T08:22:12.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.163+0000 7ff3a8b84640 1 --2- 172.21.15.88:0/3700561369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3a41547a0 0x7ff3a414aa80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff39c002010 tx=0x7ff39c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:12.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.163+0000 7ff3a0ff9640 1 -- 172.21.15.88:0/3700561369 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c012400 con 0x7ff3a41547a0 2023-12-08T08:22:12.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.163+0000 7ff3a0ff9640 1 -- 172.21.15.88:0/3700561369 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39c012580 con 0x7ff3a41547a0 2023-12-08T08:22:12.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.163+0000 7ff3a9385640 1 -- 172.21.15.88:0/3700561369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a4149d40 con 0x7ff3a41547a0 2023-12-08T08:22:12.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.163+0000 7ff3a0ff9640 1 -- 172.21.15.88:0/3700561369 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c012970 con 0x7ff3a41547a0 2023-12-08T08:22:12.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.163+0000 7ff3a9385640 1 -- 172.21.15.88:0/3700561369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a415cf20 con 0x7ff3a41547a0 2023-12-08T08:22:12.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.163+0000 7ff3a9385640 1 -- 172.21.15.88:0/3700561369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a41498c0 con 0x7ff3a41547a0 2023-12-08T08:22:12.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.163+0000 7ff3a0ff9640 1 -- 172.21.15.88:0/3700561369 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff39c012ad0 con 0x7ff3a41547a0 2023-12-08T08:22:12.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.163+0000 7ff3a0ff9640 1 --2- 172.21.15.88:0/3700561369 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff390066470 0x7ff390068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:12.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.167+0000 7ff3a0ff9640 1 -- 172.21.15.88:0/3700561369 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff39c084580 con 0x7ff3a41547a0 2023-12-08T08:22:12.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.167+0000 7ff3a3fff640 1 --2- 172.21.15.88:0/3700561369 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff390066470 0x7ff390068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:12.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.167+0000 7ff3a3fff640 1 --2- 172.21.15.88:0/3700561369 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff390066470 0x7ff390068930 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff3940011f0 tx=0x7ff394009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:12.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.167+0000 7ff3a0ff9640 1 -- 172.21.15.88:0/3700561369 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff3a41498c0 con 0x7ff3a41547a0 2023-12-08T08:22:12.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.375+0000 7ff3a9385640 1 -- 172.21.15.88:0/3700561369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff3a41498c0 con 0x7ff3a41547a0 2023-12-08T08:22:12.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.375+0000 7ff3a0ff9640 1 -- 172.21.15.88:0/3700561369 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7ff3a41498c0 con 0x7ff3a41547a0 2023-12-08T08:22:12.381 INFO:teuthology.orchestra.run.smithi088.stdout:[client.0] 2023-12-08T08:22:12.381 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCJ0XJlCC1UNRAARGaNCoJFAvsCcXsQY6BjFg== 2023-12-08T08:22:12.381 INFO:teuthology.orchestra.run.smithi088.stdout: caps mds = "allow" 2023-12-08T08:22:12.381 INFO:teuthology.orchestra.run.smithi088.stdout: caps mon = "allow r" 2023-12-08T08:22:12.381 INFO:teuthology.orchestra.run.smithi088.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-08T08:22:12.381 INFO:teuthology.orchestra.run.smithi088.stderr:updated caps for client.0 2023-12-08T08:22:12.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.379+0000 7ff3a9385640 1 -- 172.21.15.88:0/3700561369 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff390066470 msgr2=0x7ff390068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:12.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.379+0000 7ff3a9385640 1 --2- 172.21.15.88:0/3700561369 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff390066470 0x7ff390068930 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff3940011f0 tx=0x7ff394009040 comp rx=0 tx=0).stop 2023-12-08T08:22:12.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.379+0000 7ff3a9385640 1 -- 172.21.15.88:0/3700561369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3a41547a0 msgr2=0x7ff3a414aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:12.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.379+0000 7ff3a9385640 1 --2- 172.21.15.88:0/3700561369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3a41547a0 0x7ff3a414aa80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff39c002010 tx=0x7ff39c00a430 comp rx=0 tx=0).stop 2023-12-08T08:22:12.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.379+0000 7ff3a9385640 1 -- 172.21.15.88:0/3700561369 shutdown_connections 2023-12-08T08:22:12.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.379+0000 7ff3a9385640 1 --2- 172.21.15.88:0/3700561369 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff390066470 0x7ff390068930 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:12.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.379+0000 7ff3a9385640 1 --2- 172.21.15.88:0/3700561369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3a41547a0 0x7ff3a414aa80 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:12.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.379+0000 7ff3a9385640 1 --2- 172.21.15.88:0/3700561369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3a414e700 0x7ff3a414a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:12.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.379+0000 7ff3a9385640 1 --2- 172.21.15.88:0/3700561369 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff3a40c22e0 0x7ff3a414f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:12.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.379+0000 7ff3a9385640 1 -- 172.21.15.88:0/3700561369 >> 172.21.15.88:0/3700561369 conn(0x7ff3a406b0d0 msgr2=0x7ff3a414f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:12.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.379+0000 7ff3a9385640 1 -- 172.21.15.88:0/3700561369 shutdown_connections 2023-12-08T08:22:12.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.379+0000 7ff3a9385640 1 -- 172.21.15.88:0/3700561369 wait complete. 2023-12-08T08:22:12.402 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:22:12.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.535+0000 7f226bc17640 1 Processor -- start 2023-12-08T08:22:12.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.535+0000 7f226bc17640 1 -- start start 2023-12-08T08:22:12.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.535+0000 7f226bc17640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2264154f20 0x7f226406b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:12.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.535+0000 7f226bc17640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22640c4890 con 0x7f22640af4c0 2023-12-08T08:22:12.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.535+0000 7f226bc17640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22641553d0 con 0x7f226406bf30 2023-12-08T08:22:12.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.535+0000 7f226bc17640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f226406c340 con 0x7f2264154f20 2023-12-08T08:22:12.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.535+0000 7f22699b3640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f22640af4c0 0x7f22640c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49298/0 (socket says 172.21.15.88:49298) 2023-12-08T08:22:12.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.535+0000 7f22691b2640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2264154f20 0x7f226406b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:12.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.535+0000 7f22699b3640 1 -- 172.21.15.88:0/3895664571 learned_addr learned my addr 172.21.15.88:0/3895664571 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:12.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.535+0000 7f22691b2640 1 -- 172.21.15.88:0/3895664571 >> v1:172.21.15.148:6789/0 conn(0x7f226406bf30 legacy=0x7f226415ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:12.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.535+0000 7f22689b1640 1 -- 172.21.15.88:0/3895664571 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 537448211 0 0) 0x7f22640c4890 con 0x7f22640af4c0 2023-12-08T08:22:12.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.535+0000 7f22691b2640 1 -- 172.21.15.88:0/3895664571 >> v1:172.21.15.88:6789/0 conn(0x7f22640af4c0 legacy=0x7f22640c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:12.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.535+0000 7f22691b2640 1 -- 172.21.15.88:0/3895664571 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22640af8a0 con 0x7f2264154f20 2023-12-08T08:22:12.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.539+0000 7f22691b2640 1 --2- 172.21.15.88:0/3895664571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2264154f20 0x7f226406b9f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f22540097c0 tx=0x7f225401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6f655eaf15b7ea server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:12.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.539+0000 7f22689b1640 1 -- 172.21.15.88:0/3895664571 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22540ac620 con 0x7f2264154f20 2023-12-08T08:22:12.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.539+0000 7f22689b1640 1 -- 172.21.15.88:0/3895664571 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22540ac780 con 0x7f2264154f20 2023-12-08T08:22:12.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.539+0000 7f22689b1640 1 -- 172.21.15.88:0/3895664571 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22540acb10 con 0x7f2264154f20 2023-12-08T08:22:12.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.539+0000 7f226bc17640 1 -- 172.21.15.88:0/3895664571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2264154f20 msgr2=0x7f226406b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:12.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.539+0000 7f226bc17640 1 --2- 172.21.15.88:0/3895664571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2264154f20 0x7f226406b9f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f22540097c0 tx=0x7f225401c3c0 comp rx=0 tx=0).stop 2023-12-08T08:22:12.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.539+0000 7f226bc17640 1 -- 172.21.15.88:0/3895664571 shutdown_connections 2023-12-08T08:22:12.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.539+0000 7f226bc17640 1 --2- 172.21.15.88:0/3895664571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2264154f20 0x7f226406b9f0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:12.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.539+0000 7f226bc17640 1 -- 172.21.15.88:0/3895664571 >> 172.21.15.88:0/3895664571 conn(0x7f22640ab9d0 msgr2=0x7f22640abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:12.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.539+0000 7f226bc17640 1 -- 172.21.15.88:0/3895664571 shutdown_connections 2023-12-08T08:22:12.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.539+0000 7f226bc17640 1 -- 172.21.15.88:0/3895664571 wait complete. 2023-12-08T08:22:12.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.543+0000 7f226bc17640 1 Processor -- start 2023-12-08T08:22:12.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.543+0000 7f226bc17640 1 -- start start 2023-12-08T08:22:12.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.543+0000 7f226bc17640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f226406bf30 0x7f2264146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:12.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.543+0000 7f226bc17640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22640af4c0 0x7f22640c1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:12.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.543+0000 7f226bc17640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2264154f20 0x7f22640c2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:12.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.543+0000 7f226bc17640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22640c3920 con 0x7f226406bf30 2023-12-08T08:22:12.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.543+0000 7f226bc17640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2264142f80 con 0x7f22640af4c0 2023-12-08T08:22:12.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.543+0000 7f226bc17640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22641ed290 con 0x7f2264154f20 2023-12-08T08:22:12.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.543+0000 7f22699b3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f226406bf30 0x7f2264146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:12.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.543+0000 7f22699b3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f226406bf30 0x7f2264146620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43424/0 (socket says 172.21.15.88:43424) 2023-12-08T08:22:12.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.543+0000 7f22699b3640 1 -- 172.21.15.88:0/2013043646 learned_addr learned my addr 172.21.15.88:0/2013043646 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:12.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.543+0000 7f22691b2640 1 --2- 172.21.15.88:0/2013043646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22640af4c0 0x7f22640c1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:12.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.543+0000 7f226a1b4640 1 --2- 172.21.15.88:0/2013043646 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2264154f20 0x7f22640c2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:12.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.543+0000 7f22699b3640 1 -- 172.21.15.88:0/2013043646 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2264154f20 msgr2=0x7f22640c2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:12.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.543+0000 7f22699b3640 1 --2- 172.21.15.88:0/2013043646 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2264154f20 0x7f22640c2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:12.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.543+0000 7f22699b3640 1 -- 172.21.15.88:0/2013043646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22640af4c0 msgr2=0x7f22640c1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:12.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.543+0000 7f22699b3640 1 --2- 172.21.15.88:0/2013043646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22640af4c0 0x7f22640c1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:12.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.543+0000 7f22699b3640 1 -- 172.21.15.88:0/2013043646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2254009420 con 0x7f226406bf30 2023-12-08T08:22:12.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.543+0000 7f226a1b4640 1 --2- 172.21.15.88:0/2013043646 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2264154f20 0x7f22640c2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:12.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.543+0000 7f22699b3640 1 --2- 172.21.15.88:0/2013043646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f226406bf30 0x7f2264146620 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f226000c4a0 tx=0x7f226000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:12.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.543+0000 7f225a7fc640 1 -- 172.21.15.88:0/2013043646 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22600074e0 con 0x7f226406bf30 2023-12-08T08:22:12.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.543+0000 7f225a7fc640 1 -- 172.21.15.88:0/2013043646 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2260007640 con 0x7f226406bf30 2023-12-08T08:22:12.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.543+0000 7f225a7fc640 1 -- 172.21.15.88:0/2013043646 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2260004a30 con 0x7f226406bf30 2023-12-08T08:22:12.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.543+0000 7f226bc17640 1 -- 172.21.15.88:0/2013043646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22641ed570 con 0x7f226406bf30 2023-12-08T08:22:12.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.543+0000 7f226bc17640 1 -- 172.21.15.88:0/2013043646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22641edb30 con 0x7f226406bf30 2023-12-08T08:22:12.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.547+0000 7f226bc17640 1 -- 172.21.15.88:0/2013043646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2264067630 con 0x7f226406bf30 2023-12-08T08:22:12.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.547+0000 7f225a7fc640 1 -- 172.21.15.88:0/2013043646 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2260004b90 con 0x7f226406bf30 2023-12-08T08:22:12.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.547+0000 7f225a7fc640 1 --2- 172.21.15.88:0/2013043646 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2248066470 0x7f2248068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:12.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.547+0000 7f225a7fc640 1 -- 172.21.15.88:0/2013043646 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2260082f40 con 0x7f226406bf30 2023-12-08T08:22:12.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.547+0000 7f22691b2640 1 --2- 172.21.15.88:0/2013043646 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2248066470 0x7f2248068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:12.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.547+0000 7f22691b2640 1 --2- 172.21.15.88:0/2013043646 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2248066470 0x7f2248068930 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f22540ae000 tx=0x7f2254008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:12.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.551+0000 7f225a7fc640 1 -- 172.21.15.88:0/2013043646 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2260050500 con 0x7f226406bf30 2023-12-08T08:22:12.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.731+0000 7f226bc17640 1 -- 172.21.15.88:0/2013043646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2264151a70 con 0x7f226406bf30 2023-12-08T08:22:12.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.731+0000 7f225a7fc640 1 -- 172.21.15.88:0/2013043646 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f2260018020 con 0x7f226406bf30 2023-12-08T08:22:12.735 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:12.735 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5240,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/2576328340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2576328340},{"type":"v1","addr":"172.21.15.148:6834","nonce":2576328340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5626,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/1685449423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1685449423},{"type":"v1","addr":"172.21.15.88:6836","nonce":1685449423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/604820378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":604820378},{"type":"v1","addr":"172.21.15.148:6835","nonce":604820378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:22:02.420431+0000","modified":"2023-12-08T08:22:05.454472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5793},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5793":{"gid":5793,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/4167133153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":4167133153},{"type":"v1","addr":"172.21.15.88:6837","nonce":4167133153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-08T08:22:12.735 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 32 2023-12-08T08:22:12.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.731+0000 7f226bc17640 1 -- 172.21.15.88:0/2013043646 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2248066470 msgr2=0x7f2248068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:12.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.731+0000 7f226bc17640 1 --2- 172.21.15.88:0/2013043646 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2248066470 0x7f2248068930 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f22540ae000 tx=0x7f2254008040 comp rx=0 tx=0).stop 2023-12-08T08:22:12.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.731+0000 7f226bc17640 1 -- 172.21.15.88:0/2013043646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f226406bf30 msgr2=0x7f2264146620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:12.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.731+0000 7f226bc17640 1 --2- 172.21.15.88:0/2013043646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f226406bf30 0x7f2264146620 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f226000c4a0 tx=0x7f226000c960 comp rx=0 tx=0).stop 2023-12-08T08:22:12.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.731+0000 7f226bc17640 1 -- 172.21.15.88:0/2013043646 shutdown_connections 2023-12-08T08:22:12.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.731+0000 7f226bc17640 1 --2- 172.21.15.88:0/2013043646 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2248066470 0x7f2248068930 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:12.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.731+0000 7f226bc17640 1 --2- 172.21.15.88:0/2013043646 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2264154f20 0x7f22640c2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:12.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.731+0000 7f226bc17640 1 --2- 172.21.15.88:0/2013043646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22640af4c0 0x7f22640c1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:12.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.731+0000 7f226bc17640 1 --2- 172.21.15.88:0/2013043646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f226406bf30 0x7f2264146620 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:12.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.731+0000 7f226bc17640 1 -- 172.21.15.88:0/2013043646 >> 172.21.15.88:0/2013043646 conn(0x7f22640ab9d0 msgr2=0x7f22640abdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:12.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.731+0000 7f226bc17640 1 -- 172.21.15.88:0/2013043646 shutdown_connections 2023-12-08T08:22:12.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:12.731+0000 7f226bc17640 1 -- 172.21.15.88:0/2013043646 wait complete. 2023-12-08T08:22:13.158 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-08T08:22:02.420431+0000', 'modified': '2023-12-08T08:22:05.454472+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5793}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5793': {'gid': 5793, 'name': 'c', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.88:6837/4167133153', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6835', 'nonce': 4167133153}, {'type': 'v1', 'addr': '172.21.15.88:6837', 'nonce': 4167133153}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-08T08:22:13.158 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-08T08:22:13.158 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-08T08:22:13.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.291+0000 7f3872ad6640 1 Processor -- start 2023-12-08T08:22:13.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.291+0000 7f3872ad6640 1 -- start start 2023-12-08T08:22:13.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.295+0000 7f3872ad6640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f386c0a4f90 0x7f386c0c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:13.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.295+0000 7f3872ad6640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f386c0a5370 0x7f386c14f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:13.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.295+0000 7f3872ad6640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f386c1524b0 con 0x7f386c072810 2023-12-08T08:22:13.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.295+0000 7f3872ad6640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f386c0c62f0 con 0x7f386c0a4f90 2023-12-08T08:22:13.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.295+0000 7f3872ad6640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386c152770 con 0x7f386c0a5370 2023-12-08T08:22:13.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.295+0000 7f3863fff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f386c0a5370 0x7f386c14f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:13.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.295+0000 7f3870872640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f386c0a4f90 0x7f386c0c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:13.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.295+0000 7f3871073640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f386c072810 0x7f386c0c0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:50024/0 (socket says 172.21.15.88:50024) 2023-12-08T08:22:13.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.295+0000 7f3870872640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f386c0a4f90 0x7f386c0c59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:49936/0 (socket says 172.21.15.88:49936) 2023-12-08T08:22:13.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.295+0000 7f3871073640 1 -- 172.21.15.88:0/2846217307 learned_addr learned my addr 172.21.15.88:0/2846217307 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:13.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.295+0000 7f3863fff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f386c0a5370 0x7f386c14f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:46348/0 (socket says 172.21.15.88:46348) 2023-12-08T08:22:13.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.295+0000 7f3863fff640 1 -- 172.21.15.88:0/2846217307 >> v2:172.21.15.148:3300/0 conn(0x7f386c0a4f90 msgr2=0x7f386c0c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:13.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.295+0000 7f3863fff640 1 --2- 172.21.15.88:0/2846217307 >> v2:172.21.15.148:3300/0 conn(0x7f386c0a4f90 0x7f386c0c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.295+0000 7f3863fff640 1 -- 172.21.15.88:0/2846217307 >> v1:172.21.15.148:6789/0 conn(0x7f386c072810 legacy=0x7f386c0c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:13.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.295+0000 7f38637fe640 1 -- 172.21.15.88:0/2846217307 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1218591027 0 0) 0x7f386c1524b0 con 0x7f386c072810 2023-12-08T08:22:13.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.295+0000 7f3863fff640 1 -- 172.21.15.88:0/2846217307 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386c152a50 con 0x7f386c0a5370 2023-12-08T08:22:13.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.299+0000 7f3863fff640 1 --2- 172.21.15.88:0/2846217307 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f386c0a5370 0x7f386c14f870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f385c0097c0 tx=0x7f385c01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a29f6ca696d4f4d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:13.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.299+0000 7f38637fe640 1 -- 172.21.15.88:0/2846217307 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c0ab600 con 0x7f386c0a5370 2023-12-08T08:22:13.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.299+0000 7f38637fe640 1 -- 172.21.15.88:0/2846217307 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385c0a7050 con 0x7f386c0a5370 2023-12-08T08:22:13.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.299+0000 7f38637fe640 1 -- 172.21.15.88:0/2846217307 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c0ab980 con 0x7f386c0a5370 2023-12-08T08:22:13.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.299+0000 7f3872ad6640 1 -- 172.21.15.88:0/2846217307 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f386c0a5370 msgr2=0x7f386c14f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:13.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.299+0000 7f3872ad6640 1 --2- 172.21.15.88:0/2846217307 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f386c0a5370 0x7f386c14f870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f385c0097c0 tx=0x7f385c01c3f0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.299+0000 7f3872ad6640 1 -- 172.21.15.88:0/2846217307 shutdown_connections 2023-12-08T08:22:13.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.299+0000 7f3872ad6640 1 --2- 172.21.15.88:0/2846217307 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f386c0a5370 0x7f386c14f870 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.299+0000 7f3872ad6640 1 --2- 172.21.15.88:0/2846217307 >> v2:172.21.15.148:3300/0 conn(0x7f386c0a4f90 0x7f386c0c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.299+0000 7f3872ad6640 1 -- 172.21.15.88:0/2846217307 >> 172.21.15.88:0/2846217307 conn(0x7f386c06b220 msgr2=0x7f386c0a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:13.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.299+0000 7f3872ad6640 1 -- 172.21.15.88:0/2846217307 shutdown_connections 2023-12-08T08:22:13.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.299+0000 7f3872ad6640 1 -- 172.21.15.88:0/2846217307 wait complete. 2023-12-08T08:22:13.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.299+0000 7f3872ad6640 1 Processor -- start 2023-12-08T08:22:13.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.299+0000 7f3872ad6640 1 -- start start 2023-12-08T08:22:13.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.303+0000 7f3872ad6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f386c072810 0x7f386c15b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:13.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.303+0000 7f3872ad6640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f386c0a4f90 0x7f386c1ee5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:13.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.303+0000 7f3872ad6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f386c0a5370 0x7f386c1eeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:13.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.303+0000 7f3872ad6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c1ec500 con 0x7f386c072810 2023-12-08T08:22:13.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.303+0000 7f3872ad6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c1ef040 con 0x7f386c0a5370 2023-12-08T08:22:13.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.303+0000 7f3872ad6640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386c15a3d0 con 0x7f386c0a4f90 2023-12-08T08:22:13.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.303+0000 7f3870872640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f386c072810 0x7f386c15b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:13.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.303+0000 7f3870872640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f386c072810 0x7f386c15b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43432/0 (socket says 172.21.15.88:43432) 2023-12-08T08:22:13.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.303+0000 7f3870872640 1 -- 172.21.15.88:0/2058867679 learned_addr learned my addr 172.21.15.88:0/2058867679 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:13.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.303+0000 7f3863fff640 1 --2- 172.21.15.88:0/2058867679 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f386c0a4f90 0x7f386c1ee5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:13.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.303+0000 7f3871073640 1 --2- 172.21.15.88:0/2058867679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f386c0a5370 0x7f386c1eeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:13.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.303+0000 7f3870872640 1 -- 172.21.15.88:0/2058867679 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f386c0a4f90 msgr2=0x7f386c1ee5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:13.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.303+0000 7f3870872640 1 --2- 172.21.15.88:0/2058867679 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f386c0a4f90 0x7f386c1ee5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.303+0000 7f3870872640 1 -- 172.21.15.88:0/2058867679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f386c0a5370 msgr2=0x7f386c1eeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:13.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.303+0000 7f3870872640 1 --2- 172.21.15.88:0/2058867679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f386c0a5370 0x7f386c1eeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.303+0000 7f3870872640 1 -- 172.21.15.88:0/2058867679 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385c009420 con 0x7f386c072810 2023-12-08T08:22:13.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.303+0000 7f3870872640 1 --2- 172.21.15.88:0/2058867679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f386c072810 0x7f386c15b850 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f386800e930 tx=0x7f386800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:13.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.303+0000 7f38617fa640 1 -- 172.21.15.88:0/2058867679 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3868009690 con 0x7f386c072810 2023-12-08T08:22:13.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.303+0000 7f38617fa640 1 -- 172.21.15.88:0/2058867679 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386800ca00 con 0x7f386c072810 2023-12-08T08:22:13.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.303+0000 7f3872ad6640 1 -- 172.21.15.88:0/2058867679 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f386c157ad0 con 0x7f386c072810 2023-12-08T08:22:13.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.303+0000 7f38617fa640 1 -- 172.21.15.88:0/2058867679 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386800cd70 con 0x7f386c072810 2023-12-08T08:22:13.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.303+0000 7f3872ad6640 1 -- 172.21.15.88:0/2058867679 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386c1577f0 con 0x7f386c072810 2023-12-08T08:22:13.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.303+0000 7f38617fa640 1 -- 172.21.15.88:0/2058867679 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3868013470 con 0x7f386c072810 2023-12-08T08:22:13.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f38617fa640 1 --2- 172.21.15.88:0/2058867679 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3858066470 0x7f3858068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:13.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f38617fa640 1 -- 172.21.15.88:0/2058867679 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3868083eb0 con 0x7f386c072810 2023-12-08T08:22:13.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3863fff640 1 --2- 172.21.15.88:0/2058867679 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3858066470 0x7f3858068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:13.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3875e35000 1 Processor -- start 2023-12-08T08:22:13.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3875e35000 1 -- start start 2023-12-08T08:22:13.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3863fff640 1 --2- 172.21.15.88:0/2058867679 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3858066470 0x7f3858068930 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f385c0ad000 tx=0x7f385c0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:13.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3875e35000 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56322304c2e0 0x56322304c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:13.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3875e35000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56322304cc00 0x56322304cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:13.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3875e35000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304d520 0x563223096a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:13.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3875e35000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x563222eb9130 con 0x56322304d520 2023-12-08T08:22:13.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3875e35000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x563222ea69a0 con 0x56322304cc00 2023-12-08T08:22:13.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3875e35000 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x563222ea3ed0 con 0x56322304c2e0 2023-12-08T08:22:13.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3871073640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304d520 0x563223096a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:13.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3871073640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304d520 0x563223096a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43442/0 (socket says 172.21.15.88:43442) 2023-12-08T08:22:13.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3871073640 1 -- 172.21.15.88:0/2514531953 learned_addr learned my addr 172.21.15.88:0/2514531953 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:13.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3871073640 1 -- 172.21.15.88:0/2514531953 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56322304c2e0 msgr2=0x56322304c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:13.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3871073640 1 --2- 172.21.15.88:0/2514531953 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56322304c2e0 0x56322304c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3871073640 1 -- 172.21.15.88:0/2514531953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56322304cc00 msgr2=0x56322304cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:13.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3871073640 1 --2- 172.21.15.88:0/2514531953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56322304cc00 0x56322304cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3871073640 1 -- 172.21.15.88:0/2514531953 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563222b97890 con 0x56322304d520 2023-12-08T08:22:13.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3871073640 1 --2- 172.21.15.88:0/2514531953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304d520 0x563223096a30 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3864001af0 tx=0x7f3864001fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae112cc21ae0f5d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:13.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f38527fc640 1 -- 172.21.15.88:0/2514531953 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3864007850 con 0x56322304d520 2023-12-08T08:22:13.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f38527fc640 1 -- 172.21.15.88:0/2514531953 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38640079b0 con 0x56322304d520 2023-12-08T08:22:13.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f38527fc640 1 -- 172.21.15.88:0/2514531953 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3864013630 con 0x56322304d520 2023-12-08T08:22:13.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3875e35000 1 -- 172.21.15.88:0/2514531953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304d520 msgr2=0x563223096a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:13.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3875e35000 1 --2- 172.21.15.88:0/2514531953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304d520 0x563223096a30 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3864001af0 tx=0x7f3864001fb0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3875e35000 1 -- 172.21.15.88:0/2514531953 shutdown_connections 2023-12-08T08:22:13.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3875e35000 1 --2- 172.21.15.88:0/2514531953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304d520 0x563223096a30 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3875e35000 1 --2- 172.21.15.88:0/2514531953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56322304cc00 0x56322304cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3875e35000 1 --2- 172.21.15.88:0/2514531953 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56322304c2e0 0x56322304c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3875e35000 1 -- 172.21.15.88:0/2514531953 >> 172.21.15.88:0/2514531953 conn(0x563223055190 msgr2=0x56322308c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:13.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3875e35000 1 -- 172.21.15.88:0/2514531953 shutdown_connections 2023-12-08T08:22:13.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.307+0000 7f3875e35000 1 -- 172.21.15.88:0/2514531953 wait complete. 2023-12-08T08:22:13.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3875e35000 1 -- start start 2023-12-08T08:22:13.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3875e35000 1 Processor -- start 2023-12-08T08:22:13.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3875e35000 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56322304c2e0 0x563223088b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:13.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3875e35000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56322304cc00 0x563223089050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:13.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3875e35000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304d520 0x56322309a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:13.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3875e35000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x563222e9f7c0 con 0x56322304d520 2023-12-08T08:22:13.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3875e35000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x563222e57bf0 con 0x56322304cc00 2023-12-08T08:22:13.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3875e35000 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x563222e5da90 con 0x56322304c2e0 2023-12-08T08:22:13.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3875e35000 10 client.0 _ll_register_callbacks cb 0x56322303a3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T08:22:13.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3871073640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304d520 0x56322309a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:13.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3871073640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304d520 0x56322309a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43448/0 (socket says 172.21.15.88:43448) 2023-12-08T08:22:13.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3871073640 1 -- 172.21.15.88:0/2635035226 learned_addr learned my addr 172.21.15.88:0/2635035226 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:13.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3870872640 1 --2- 172.21.15.88:0/2635035226 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56322304c2e0 0x563223088b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:13.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3863fff640 1 --2- 172.21.15.88:0/2635035226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56322304cc00 0x563223089050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:13.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3871073640 1 -- 172.21.15.88:0/2635035226 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56322304c2e0 msgr2=0x563223088b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:13.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3871073640 1 --2- 172.21.15.88:0/2635035226 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56322304c2e0 0x563223088b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3871073640 1 -- 172.21.15.88:0/2635035226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56322304cc00 msgr2=0x563223089050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:13.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3871073640 1 --2- 172.21.15.88:0/2635035226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56322304cc00 0x563223089050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3871073640 1 -- 172.21.15.88:0/2635035226 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3864004e70 con 0x56322304d520 2023-12-08T08:22:13.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3863fff640 1 --2- 172.21.15.88:0/2635035226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56322304cc00 0x563223089050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:13.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3871073640 1 --2- 172.21.15.88:0/2635035226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304d520 0x56322309a2d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3864004c70 tx=0x7f38640016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84caac7819144ff server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:13.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f384b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-12-08T08:22:13.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f384b7fe640 1 -- 172.21.15.88:0/2635035226 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386401edb0 con 0x56322304d520 2023-12-08T08:22:13.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3875e35000 1 -- 172.21.15.88:0/2635035226 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563222e61470 con 0x56322304d520 2023-12-08T08:22:13.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f384b7fe640 1 -- 172.21.15.88:0/2635035226 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3864027440 con 0x56322304d520 2023-12-08T08:22:13.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f384b7fe640 1 -- 172.21.15.88:0/2635035226 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3864027600 con 0x56322304d520 2023-12-08T08:22:13.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3875e35000 10 client.5964 fetch_fsmap learned FSMap version 32 2023-12-08T08:22:13.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3875e35000 1 -- 172.21.15.88:0/2635035226 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x563222e60190 con 0x56322304d520 2023-12-08T08:22:13.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f384b7fe640 1 -- 172.21.15.88:0/2635035226 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563222e61470 con 0x56322304d520 2023-12-08T08:22:13.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f384b7fe640 1 -- 172.21.15.88:0/2635035226 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 32) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3864012070 con 0x56322304d520 2023-12-08T08:22:13.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3875e35000 10 client.5964 fetch_fsmap finished waiting for FSMap version 32 2023-12-08T08:22:13.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3875e35000 10 client.5964 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-08T08:22:13.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3875e35000 20 client.5964 populate_metadata read hostname 'smithi088' 2023-12-08T08:22:13.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3875e35000 1 --2- 172.21.15.88:0/2635035226 >> [v2:172.21.15.88:6835/4167133153,v1:172.21.15.88:6837/4167133153] conn(0x56322309ace0 0x56322309b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:13.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3875e35000 4 client.5964 mds_command: new command op to 5793 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-08T08:22:13.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3875e35000 1 -- 172.21.15.88:0/2635035226 --> [v2:172.21.15.88:6835/4167133153,v1:172.21.15.88:6837/4167133153] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563222e64b50 con 0x56322309ace0 2023-12-08T08:22:13.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.311+0000 7f3870872640 1 --2- 172.21.15.88:0/2635035226 >> [v2:172.21.15.88:6835/4167133153,v1:172.21.15.88:6837/4167133153] conn(0x56322309ace0 0x56322309b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:13.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.315+0000 7f3870872640 1 --2- 172.21.15.88:0/2635035226 >> [v2:172.21.15.88:6835/4167133153,v1:172.21.15.88:6837/4167133153] conn(0x56322309ace0 0x56322309b0c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30ee679a23ee7601 server_cookie=1dbfb0ef30f413e6 in_seq=0 out_seq=0 2023-12-08T08:22:13.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.315+0000 7f384b7fe640 10 client.5964 ms_handle_connect on v2:172.21.15.88:6835/4167133153 2023-12-08T08:22:13.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.315+0000 7f384b7fe640 1 -- 172.21.15.88:0/2635035226 <== mds.0 v2:172.21.15.88:6835/4167133153 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x563222e64b50 con 0x56322309ace0 2023-12-08T08:22:13.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.315+0000 7f384b7fe640 10 client.5964 handle_command_reply: tid=0 2023-12-08T08:22:13.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.315+0000 7f3875e35000 1 client.5964 shutdown 2023-12-08T08:22:13.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.315+0000 7f3875e35000 1 -- 172.21.15.88:0/2635035226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304d520 msgr2=0x56322309a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:13.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.315+0000 7f3875e35000 1 --2- 172.21.15.88:0/2635035226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304d520 0x56322309a2d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3864004c70 tx=0x7f38640016c0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.315+0000 7f3875e35000 1 -- 172.21.15.88:0/2635035226 shutdown_connections 2023-12-08T08:22:13.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.315+0000 7f3875e35000 1 --2- 172.21.15.88:0/2635035226 >> [v2:172.21.15.88:6835/4167133153,v1:172.21.15.88:6837/4167133153] conn(0x56322309ace0 0x56322309b0c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.315+0000 7f3875e35000 1 --2- 172.21.15.88:0/2635035226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304d520 0x56322309a2d0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.315+0000 7f3875e35000 1 --2- 172.21.15.88:0/2635035226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56322304cc00 0x563223089050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.315+0000 7f3875e35000 1 --2- 172.21.15.88:0/2635035226 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56322304c2e0 0x563223088b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.315+0000 7f3875e35000 1 -- 172.21.15.88:0/2635035226 >> 172.21.15.88:0/2635035226 conn(0x563223055190 msgr2=0x56322304b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:13.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.315+0000 7f384b7fe640 0 client.5964 ms_handle_reset on v2:172.21.15.88:6835/4167133153 2023-12-08T08:22:13.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.315+0000 7f3875e35000 1 -- 172.21.15.88:0/2635035226 shutdown_connections 2023-12-08T08:22:13.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.315+0000 7f3875e35000 1 -- 172.21.15.88:0/2635035226 wait complete. 2023-12-08T08:22:13.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.315+0000 7f3875e35000 20 client.5964 trim_cache size 0 max 16384 2023-12-08T08:22:13.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.331+0000 7f3875e35000 1 Processor -- start 2023-12-08T08:22:13.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.331+0000 7f3875e35000 1 -- start start 2023-12-08T08:22:13.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.331+0000 7f3875e35000 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56322304c2e0 0x563223051d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:13.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.331+0000 7f3875e35000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304cc00 0x563223052b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:13.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.331+0000 7f3875e35000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56322304d520 0x5632230a7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:13.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.331+0000 7f3875e35000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x563222b58940 con 0x56322304cc00 2023-12-08T08:22:13.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.331+0000 7f3875e35000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x563223056890 con 0x56322304d520 2023-12-08T08:22:13.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.331+0000 7f3875e35000 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x563222ea0070 con 0x56322304c2e0 2023-12-08T08:22:13.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.331+0000 7f3863fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304cc00 0x563223052b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:13.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.331+0000 7f3863fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304cc00 0x563223052b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43450/0 (socket says 172.21.15.88:43450) 2023-12-08T08:22:13.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.331+0000 7f3863fff640 1 -- 172.21.15.88:0/1915876731 learned_addr learned my addr 172.21.15.88:0/1915876731 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:13.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.331+0000 7f3870872640 1 --2- 172.21.15.88:0/1915876731 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56322304c2e0 0x563223051d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:13.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.331+0000 7f3871073640 1 --2- 172.21.15.88:0/1915876731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56322304d520 0x5632230a7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:13.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.331+0000 7f3863fff640 1 -- 172.21.15.88:0/1915876731 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56322304c2e0 msgr2=0x563223051d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:13.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.331+0000 7f3863fff640 1 --2- 172.21.15.88:0/1915876731 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56322304c2e0 0x563223051d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.331+0000 7f3863fff640 1 -- 172.21.15.88:0/1915876731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56322304d520 msgr2=0x5632230a7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:13.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.331+0000 7f3863fff640 1 --2- 172.21.15.88:0/1915876731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56322304d520 0x5632230a7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.331+0000 7f3863fff640 1 -- 172.21.15.88:0/1915876731 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563222e46490 con 0x56322304cc00 2023-12-08T08:22:13.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.331+0000 7f3871073640 1 --2- 172.21.15.88:0/1915876731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56322304d520 0x5632230a7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:13.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.331+0000 7f3863fff640 1 --2- 172.21.15.88:0/1915876731 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304cc00 0x563223052b40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f385c01c430 tx=0x7f385c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b01a63d86c9a08 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:13.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.331+0000 7f3852ffd640 1 -- 172.21.15.88:0/1915876731 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c0b6650 con 0x56322304cc00 2023-12-08T08:22:13.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.331+0000 7f3852ffd640 1 -- 172.21.15.88:0/1915876731 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385c0b67b0 con 0x56322304cc00 2023-12-08T08:22:13.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.331+0000 7f3852ffd640 1 -- 172.21.15.88:0/1915876731 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c0b6b20 con 0x56322304cc00 2023-12-08T08:22:13.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.331+0000 7f3875e35000 1 -- 172.21.15.88:0/1915876731 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304cc00 msgr2=0x563223052b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:13.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.331+0000 7f3875e35000 1 --2- 172.21.15.88:0/1915876731 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304cc00 0x563223052b40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f385c01c430 tx=0x7f385c004740 comp rx=0 tx=0).stop 2023-12-08T08:22:13.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3875e35000 1 -- 172.21.15.88:0/1915876731 shutdown_connections 2023-12-08T08:22:13.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3875e35000 1 --2- 172.21.15.88:0/1915876731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56322304d520 0x5632230a7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3875e35000 1 --2- 172.21.15.88:0/1915876731 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304cc00 0x563223052b40 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3875e35000 1 --2- 172.21.15.88:0/1915876731 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56322304c2e0 0x563223051d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3875e35000 1 -- 172.21.15.88:0/1915876731 >> 172.21.15.88:0/1915876731 conn(0x563223055190 msgr2=0x56322308ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:13.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3875e35000 1 -- 172.21.15.88:0/1915876731 shutdown_connections 2023-12-08T08:22:13.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3875e35000 1 -- 172.21.15.88:0/1915876731 wait complete. 2023-12-08T08:22:13.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3875e35000 1 -- start start 2023-12-08T08:22:13.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3875e35000 1 Processor -- start 2023-12-08T08:22:13.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3875e35000 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56322304c2e0 0x5632230f5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:13.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3875e35000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304cc00 0x5632230f5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:13.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3875e35000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56322304d520 0x5632230a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:13.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3875e35000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x563222ea7b20 con 0x56322304cc00 2023-12-08T08:22:13.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3875e35000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x563222e9b5c0 con 0x56322304d520 2023-12-08T08:22:13.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3875e35000 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x563222e692e0 con 0x56322304c2e0 2023-12-08T08:22:13.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3875e35000 10 client.0 _ll_register_callbacks cb 0x56322301abd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T08:22:13.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3863fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304cc00 0x5632230f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:13.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3863fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304cc00 0x5632230f5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43454/0 (socket says 172.21.15.88:43454) 2023-12-08T08:22:13.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3863fff640 1 -- 172.21.15.88:0/599453257 learned_addr learned my addr 172.21.15.88:0/599453257 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:13.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3870872640 1 --2- 172.21.15.88:0/599453257 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56322304c2e0 0x5632230f5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:13.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3871073640 1 --2- 172.21.15.88:0/599453257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56322304d520 0x5632230a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:13.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3863fff640 1 -- 172.21.15.88:0/599453257 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56322304c2e0 msgr2=0x5632230f5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:13.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3863fff640 1 --2- 172.21.15.88:0/599453257 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56322304c2e0 0x5632230f5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3863fff640 1 -- 172.21.15.88:0/599453257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56322304d520 msgr2=0x5632230a99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:13.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3863fff640 1 --2- 172.21.15.88:0/599453257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56322304d520 0x5632230a99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3863fff640 1 -- 172.21.15.88:0/599453257 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386c152a50 con 0x56322304cc00 2023-12-08T08:22:13.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3863fff640 1 --2- 172.21.15.88:0/599453257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304cc00 0x5632230f5cc0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f385c01aaa0 tx=0x7f385c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef23920ed409acc5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:13.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f384b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-12-08T08:22:13.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f384b7fe640 1 -- 172.21.15.88:0/599453257 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c0b6ba0 con 0x56322304cc00 2023-12-08T08:22:13.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f384b7fe640 1 -- 172.21.15.88:0/599453257 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f385c0bc070 con 0x56322304cc00 2023-12-08T08:22:13.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3875e35000 1 -- 172.21.15.88:0/599453257 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563223059910 con 0x56322304cc00 2023-12-08T08:22:13.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f384b7fe640 1 -- 172.21.15.88:0/599453257 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f385c0b6d00 con 0x56322304cc00 2023-12-08T08:22:13.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3875e35000 10 client.5970 fetch_fsmap learned FSMap version 32 2023-12-08T08:22:13.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3875e35000 1 -- 172.21.15.88:0/599453257 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x563222b97cc0 con 0x56322304cc00 2023-12-08T08:22:13.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f384b7fe640 1 -- 172.21.15.88:0/599453257 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563223059910 con 0x56322304cc00 2023-12-08T08:22:13.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f384b7fe640 1 -- 172.21.15.88:0/599453257 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 32) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f385c0d3410 con 0x56322304cc00 2023-12-08T08:22:13.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3875e35000 10 client.5970 fetch_fsmap finished waiting for FSMap version 32 2023-12-08T08:22:13.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3875e35000 10 client.5970 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-08T08:22:13.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3875e35000 20 client.5970 populate_metadata read hostname 'smithi088' 2023-12-08T08:22:13.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3875e35000 1 --2- 172.21.15.88:0/599453257 >> [v2:172.21.15.88:6835/4167133153,v1:172.21.15.88:6837/4167133153] conn(0x5632230fc5e0 0x5632230fe9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:13.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3875e35000 4 client.5970 mds_command: new command op to 5793 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-08T08:22:13.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3875e35000 1 -- 172.21.15.88:0/599453257 --> [v2:172.21.15.88:6835/4167133153,v1:172.21.15.88:6837/4167133153] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563222e9e110 con 0x5632230fc5e0 2023-12-08T08:22:13.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.335+0000 7f3870872640 1 --2- 172.21.15.88:0/599453257 >> [v2:172.21.15.88:6835/4167133153,v1:172.21.15.88:6837/4167133153] conn(0x5632230fc5e0 0x5632230fe9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:13.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f384b7fe640 10 client.5970 ms_handle_connect on v2:172.21.15.88:6835/4167133153 2023-12-08T08:22:13.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f3870872640 1 --2- 172.21.15.88:0/599453257 >> [v2:172.21.15.88:6835/4167133153,v1:172.21.15.88:6837/4167133153] conn(0x5632230fc5e0 0x5632230fe9d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aad3b48c369890e2 server_cookie=9468b05a7883ad6f in_seq=0 out_seq=0 2023-12-08T08:22:13.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f384b7fe640 1 -- 172.21.15.88:0/599453257 <== mds.0 v2:172.21.15.88:6835/4167133153 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x563222e9e110 con 0x5632230fc5e0 2023-12-08T08:22:13.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f384b7fe640 10 client.5970 handle_command_reply: tid=0 2023-12-08T08:22:13.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f3875e35000 1 client.5970 shutdown 2023-12-08T08:22:13.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f3875e35000 1 -- 172.21.15.88:0/599453257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304cc00 msgr2=0x5632230f5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:13.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f3875e35000 1 --2- 172.21.15.88:0/599453257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304cc00 0x5632230f5cc0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f385c01aaa0 tx=0x7f385c0046d0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f3875e35000 1 -- 172.21.15.88:0/599453257 shutdown_connections 2023-12-08T08:22:13.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f3875e35000 1 --2- 172.21.15.88:0/599453257 >> [v2:172.21.15.88:6835/4167133153,v1:172.21.15.88:6837/4167133153] conn(0x5632230fc5e0 0x5632230fe9d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f3875e35000 1 --2- 172.21.15.88:0/599453257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56322304d520 0x5632230a99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f3875e35000 1 --2- 172.21.15.88:0/599453257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56322304cc00 0x5632230f5cc0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f3875e35000 1 --2- 172.21.15.88:0/599453257 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x56322304c2e0 0x5632230f5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f384b7fe640 0 client.5970 ms_handle_reset on v2:172.21.15.88:6835/4167133153 2023-12-08T08:22:13.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f3875e35000 1 -- 172.21.15.88:0/599453257 >> 172.21.15.88:0/599453257 conn(0x563223055190 msgr2=0x56322308ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:13.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f3875e35000 1 -- 172.21.15.88:0/599453257 shutdown_connections 2023-12-08T08:22:13.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f3875e35000 1 -- 172.21.15.88:0/599453257 wait complete. 2023-12-08T08:22:13.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f3875e35000 20 client.5970 trim_cache size 0 max 16384 2023-12-08T08:22:13.352 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-08T08:22:13.352 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_fsid": "681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3", 2023-12-08T08:22:13.353 INFO:teuthology.orchestra.run.smithi088.stdout: "whoami": 0, 2023-12-08T08:22:13.353 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 5793, 2023-12-08T08:22:13.353 INFO:teuthology.orchestra.run.smithi088.stdout: "want_state": "up:active", 2023-12-08T08:22:13.353 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "up:active", 2023-12-08T08:22:13.353 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs", 2023-12-08T08:22:13.353 INFO:teuthology.orchestra.run.smithi088.stdout: "rank_uptime": 10.269720967, 2023-12-08T08:22:13.353 INFO:teuthology.orchestra.run.smithi088.stdout: "mdsmap_epoch": 32, 2023-12-08T08:22:13.353 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch": 50, 2023-12-08T08:22:13.353 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch_barrier": 50, 2023-12-08T08:22:13.353 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 16.225461312 2023-12-08T08:22:13.354 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-08T08:22:13.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f3872ad6640 1 -- 172.21.15.88:0/2058867679 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3858066470 msgr2=0x7f3858068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:13.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f3872ad6640 1 --2- 172.21.15.88:0/2058867679 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3858066470 0x7f3858068930 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f385c0ad000 tx=0x7f385c0a6000 comp rx=0 tx=0).stop 2023-12-08T08:22:13.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f3872ad6640 1 -- 172.21.15.88:0/2058867679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f386c072810 msgr2=0x7f386c15b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:13.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f3872ad6640 1 --2- 172.21.15.88:0/2058867679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f386c072810 0x7f386c15b850 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f386800e930 tx=0x7f386800edf0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f3872ad6640 1 -- 172.21.15.88:0/2058867679 shutdown_connections 2023-12-08T08:22:13.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f3872ad6640 1 --2- 172.21.15.88:0/2058867679 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3858066470 0x7f3858068930 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f3872ad6640 1 --2- 172.21.15.88:0/2058867679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f386c0a5370 0x7f386c1eeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f3872ad6640 1 --2- 172.21.15.88:0/2058867679 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f386c0a4f90 0x7f386c1ee5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f3872ad6640 1 --2- 172.21.15.88:0/2058867679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f386c072810 0x7f386c15b850 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f3872ad6640 1 -- 172.21.15.88:0/2058867679 >> 172.21.15.88:0/2058867679 conn(0x7f386c06b220 msgr2=0x7f386c0a77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:13.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f3872ad6640 1 -- 172.21.15.88:0/2058867679 shutdown_connections 2023-12-08T08:22:13.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.339+0000 7f3872ad6640 1 -- 172.21.15.88:0/2058867679 wait complete. 2023-12-08T08:22:13.362 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:22:13.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.495+0000 7f9908cd6640 1 Processor -- start 2023-12-08T08:22:13.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.495+0000 7f9908cd6640 1 -- start start 2023-12-08T08:22:13.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.495+0000 7f9908cd6640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f990414e3f0 0x7f99040bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:13.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.495+0000 7f9908cd6640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f990406bef0 0x7f99040c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:13.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.495+0000 7f9908cd6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f99040c4730 0x7f990406c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:13.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.495+0000 7f9908cd6640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9904151690 con 0x7f99040c4730 2023-12-08T08:22:13.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.495+0000 7f9908cd6640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9904151bc0 con 0x7f990406bef0 2023-12-08T08:22:13.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.495+0000 7f9908cd6640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99041518e0 con 0x7f990414e3f0 2023-12-08T08:22:13.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.495+0000 7f9902d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f99040c4730 0x7f990406c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:13.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.495+0000 7f9902d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f99040c4730 0x7f990406c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43462/0 (socket says 172.21.15.88:43462) 2023-12-08T08:22:13.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.495+0000 7f9902d9d640 1 -- 172.21.15.88:0/3781986901 learned_addr learned my addr 172.21.15.88:0/3781986901 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:13.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.495+0000 7f98f9d9b640 1 --2- 172.21.15.88:0/3781986901 >> v2:172.21.15.148:3300/0 conn(0x7f990406bef0 0x7f99040c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:13.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.495+0000 7f990259c640 1 --2- 172.21.15.88:0/3781986901 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f990414e3f0 0x7f99040bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:13.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.495+0000 7f9902d9d640 1 -- 172.21.15.88:0/3781986901 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f990414e3f0 msgr2=0x7f99040bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:13.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.495+0000 7f9902d9d640 1 --2- 172.21.15.88:0/3781986901 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f990414e3f0 0x7f99040bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.495+0000 7f9902d9d640 1 -- 172.21.15.88:0/3781986901 >> v2:172.21.15.148:3300/0 conn(0x7f990406bef0 msgr2=0x7f99040c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:13.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.495+0000 7f9902d9d640 1 --2- 172.21.15.88:0/3781986901 >> v2:172.21.15.148:3300/0 conn(0x7f990406bef0 0x7f99040c41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.495+0000 7f9902d9d640 1 -- 172.21.15.88:0/3781986901 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99040c1de0 con 0x7f99040c4730 2023-12-08T08:22:13.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.499+0000 7f9902d9d640 1 --2- 172.21.15.88:0/3781986901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99040c4730 0x7f990406c5b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9904066de0 tx=0x7f98fc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896f32c3a1210f87 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:13.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.499+0000 7f9901d9b640 1 -- 172.21.15.88:0/3781986901 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc0ab600 con 0x7f99040c4730 2023-12-08T08:22:13.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.499+0000 7f9901d9b640 1 -- 172.21.15.88:0/3781986901 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98fc0a7050 con 0x7f99040c4730 2023-12-08T08:22:13.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.499+0000 7f9901d9b640 1 -- 172.21.15.88:0/3781986901 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc0ab980 con 0x7f99040c4730 2023-12-08T08:22:13.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.499+0000 7f9908cd6640 1 -- 172.21.15.88:0/3781986901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99040c4730 msgr2=0x7f990406c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:13.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.499+0000 7f9908cd6640 1 --2- 172.21.15.88:0/3781986901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99040c4730 0x7f990406c5b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9904066de0 tx=0x7f98fc01c440 comp rx=0 tx=0).stop 2023-12-08T08:22:13.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.499+0000 7f9908cd6640 1 -- 172.21.15.88:0/3781986901 shutdown_connections 2023-12-08T08:22:13.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.499+0000 7f9908cd6640 1 --2- 172.21.15.88:0/3781986901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99040c4730 0x7f990406c5b0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.499+0000 7f9908cd6640 1 --2- 172.21.15.88:0/3781986901 >> v2:172.21.15.148:3300/0 conn(0x7f990406bef0 0x7f99040c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.499+0000 7f9908cd6640 1 --2- 172.21.15.88:0/3781986901 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f990414e3f0 0x7f99040bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.499+0000 7f9908cd6640 1 -- 172.21.15.88:0/3781986901 >> 172.21.15.88:0/3781986901 conn(0x7f99040a7810 msgr2=0x7f99040a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:13.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.499+0000 7f9908cd6640 1 -- 172.21.15.88:0/3781986901 shutdown_connections 2023-12-08T08:22:13.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.499+0000 7f9908cd6640 1 -- 172.21.15.88:0/3781986901 wait complete. 2023-12-08T08:22:13.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.503+0000 7f9908cd6640 1 Processor -- start 2023-12-08T08:22:13.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.503+0000 7f9908cd6640 1 -- start start 2023-12-08T08:22:13.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.503+0000 7f9908cd6640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f990406bef0 0x7f99041ecb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:13.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.503+0000 7f9908cd6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99040c4730 0x7f99040a6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:13.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.503+0000 7f9908cd6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f990414e3f0 0x7f9904152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:13.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.503+0000 7f9908cd6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9904154d30 con 0x7f99040c4730 2023-12-08T08:22:13.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.503+0000 7f9908cd6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99041ed070 con 0x7f990414e3f0 2023-12-08T08:22:13.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.503+0000 7f9908cd6640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99041f0b50 con 0x7f990406bef0 2023-12-08T08:22:13.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.503+0000 7f98f9d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99040c4730 0x7f99040a6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:13.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.503+0000 7f98f9d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99040c4730 0x7f99040a6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43468/0 (socket says 172.21.15.88:43468) 2023-12-08T08:22:13.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.503+0000 7f98f9d9b640 1 -- 172.21.15.88:0/1241810301 learned_addr learned my addr 172.21.15.88:0/1241810301 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:13.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.503+0000 7f990259c640 1 --2- 172.21.15.88:0/1241810301 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f990406bef0 0x7f99041ecb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:13.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.503+0000 7f98f9d9b640 1 -- 172.21.15.88:0/1241810301 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f990406bef0 msgr2=0x7f99041ecb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:13.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.503+0000 7f9902d9d640 1 --2- 172.21.15.88:0/1241810301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f990414e3f0 0x7f9904152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:13.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.503+0000 7f98f9d9b640 1 --2- 172.21.15.88:0/1241810301 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f990406bef0 0x7f99041ecb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.503+0000 7f98f9d9b640 1 -- 172.21.15.88:0/1241810301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f990414e3f0 msgr2=0x7f9904152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:13.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.503+0000 7f98f9d9b640 1 --2- 172.21.15.88:0/1241810301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f990414e3f0 0x7f9904152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.503+0000 7f98f9d9b640 1 -- 172.21.15.88:0/1241810301 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc0094d0 con 0x7f99040c4730 2023-12-08T08:22:13.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.503+0000 7f990259c640 1 --2- 172.21.15.88:0/1241810301 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f990406bef0 0x7f99041ecb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:13.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.503+0000 7f9902d9d640 1 --2- 172.21.15.88:0/1241810301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f990414e3f0 0x7f9904152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:13.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.503+0000 7f98f9d9b640 1 --2- 172.21.15.88:0/1241810301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99040c4730 0x7f99040a6d00 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f98ec00efc0 tx=0x7f98ec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:13.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.503+0000 7f98fb7fe640 1 -- 172.21.15.88:0/1241810301 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec014480 con 0x7f99040c4730 2023-12-08T08:22:13.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.503+0000 7f98fb7fe640 1 -- 172.21.15.88:0/1241810301 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ec00f040 con 0x7f99040c4730 2023-12-08T08:22:13.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.503+0000 7f98fb7fe640 1 -- 172.21.15.88:0/1241810301 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec014800 con 0x7f99040c4730 2023-12-08T08:22:13.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.503+0000 7f9908cd6640 1 -- 172.21.15.88:0/1241810301 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99041f0df0 con 0x7f99040c4730 2023-12-08T08:22:13.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.503+0000 7f9908cd6640 1 -- 172.21.15.88:0/1241810301 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9904154950 con 0x7f99040c4730 2023-12-08T08:22:13.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.507+0000 7f9908cd6640 1 -- 172.21.15.88:0/1241810301 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9904067630 con 0x7f99040c4730 2023-12-08T08:22:13.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.507+0000 7f98fb7fe640 1 -- 172.21.15.88:0/1241810301 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f98ec014960 con 0x7f99040c4730 2023-12-08T08:22:13.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.507+0000 7f98fb7fe640 1 --2- 172.21.15.88:0/1241810301 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f98e4066470 0x7f98e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:13.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.507+0000 7f98fb7fe640 1 -- 172.21.15.88:0/1241810301 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98ec084ca0 con 0x7f99040c4730 2023-12-08T08:22:13.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.507+0000 7f990259c640 1 --2- 172.21.15.88:0/1241810301 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f98e4066470 0x7f98e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:13.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.507+0000 7f990259c640 1 --2- 172.21.15.88:0/1241810301 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f98e4066470 0x7f98e4068930 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9904152920 tx=0x7f98f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:13.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.511+0000 7f98fb7fe640 1 -- 172.21.15.88:0/1241810301 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f98ec0521b0 con 0x7f99040c4730 2023-12-08T08:22:13.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.695+0000 7f9908cd6640 1 -- 172.21.15.88:0/1241810301 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f99040c5370 con 0x7f99040c4730 2023-12-08T08:22:13.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.695+0000 7f98fb7fe640 1 -- 172.21.15.88:0/1241810301 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f98ec0557d0 con 0x7f99040c4730 2023-12-08T08:22:13.701 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:22:13.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.699+0000 7f9908cd6640 1 -- 172.21.15.88:0/1241810301 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f98e4066470 msgr2=0x7f98e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:13.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.699+0000 7f9908cd6640 1 --2- 172.21.15.88:0/1241810301 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f98e4066470 0x7f98e4068930 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9904152920 tx=0x7f98f4008040 comp rx=0 tx=0).stop 2023-12-08T08:22:13.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.699+0000 7f9908cd6640 1 -- 172.21.15.88:0/1241810301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99040c4730 msgr2=0x7f99040a6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:13.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.699+0000 7f9908cd6640 1 --2- 172.21.15.88:0/1241810301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99040c4730 0x7f99040a6d00 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f98ec00efc0 tx=0x7f98ec00c490 comp rx=0 tx=0).stop 2023-12-08T08:22:13.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.699+0000 7f9908cd6640 1 -- 172.21.15.88:0/1241810301 shutdown_connections 2023-12-08T08:22:13.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.699+0000 7f9908cd6640 1 --2- 172.21.15.88:0/1241810301 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f98e4066470 0x7f98e4068930 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.699+0000 7f9908cd6640 1 --2- 172.21.15.88:0/1241810301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f990414e3f0 0x7f9904152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.699+0000 7f9908cd6640 1 --2- 172.21.15.88:0/1241810301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99040c4730 0x7f99040a6d00 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.699+0000 7f9908cd6640 1 --2- 172.21.15.88:0/1241810301 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f990406bef0 0x7f99041ecb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:13.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.699+0000 7f9908cd6640 1 -- 172.21.15.88:0/1241810301 >> 172.21.15.88:0/1241810301 conn(0x7f99040a7810 msgr2=0x7f99040a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:13.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.699+0000 7f9908cd6640 1 -- 172.21.15.88:0/1241810301 shutdown_connections 2023-12-08T08:22:13.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:13.699+0000 7f9908cd6640 1 -- 172.21.15.88:0/1241810301 wait complete. 2023-12-08T08:22:13.722 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-08T08:22:13.722 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:22:13.723 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2023-12-08T08:22:13.723 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-08T08:22:13.723 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T08:22:13.723 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-08T08:22:13.723 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-08T08:22:13.723 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:22:13.723 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:22:13.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:13.723 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2023-12-08T08:22:13.733 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:22:13.733 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:22:13.733 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:22:13.733 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:13.733 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-12-08T08:22:13.733 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:13.733 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:22:13.733 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:22:13.733 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2023-12-08T08:22:13.733 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:22:13.733 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:22:13.733 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2023-12-08T08:22:13.733 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:22:13.734 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2023-12-08T08:22:13.734 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:22:13.734 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2023-12-08T08:22:13.734 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-08T08:22:13.734 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42325sec preferred_lft 42325sec 2023-12-08T08:22:13.734 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2023-12-08T08:22:13.734 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:13.734 INFO:teuthology.orchestra.run.smithi088.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-08T08:22:13.734 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 02:42:cd:51:97:e3 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:22:13.734 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-08T08:22:13.734 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:13.734 INFO:teuthology.orchestra.run.smithi088.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:22:13.734 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-08T08:22:13.735 INFO:teuthology.orchestra.run.smithi088.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:22:13.735 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:13.735 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-08T08:22:13.735 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:13.735 INFO:teuthology.orchestra.run.smithi088.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:22:13.735 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:22:13.735 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-08T08:22:13.735 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:13.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:13.736 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:22:13.796 INFO:teuthology.orchestra.run.smithi088.stdout:1 2023-12-08T08:22:13.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:13.798 DEBUG:teuthology.orchestra.run.smithi088:> route 2023-12-08T08:22:13.852 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2023-12-08T08:22:13.852 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:22:13.852 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-08T08:22:13.852 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-08T08:22:13.852 INFO:teuthology.orchestra.run.smithi088.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-08T08:22:13.852 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-08T08:22:13.853 INFO:teuthology.orchestra.run.smithi088.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:22:13.853 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:22:13.853 INFO:teuthology.orchestra.run.smithi088.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:22:13.853 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:22:13.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:13.853 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-12-08T08:22:13.853 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-12-08T08:22:13.853 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-08T08:22:13.853 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-08T08:22:13.853 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-08T08:22:13.853 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-12-08T08:22:13.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:13.944 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-12-08T08:22:13.952 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-08T08:22:13.953 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:22:13.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:13.954 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2023-12-08T08:22:14.017 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:22:14.017 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-08T08:22:14.069 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:22:14.069 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:22:14.120 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-08T08:22:14.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:14.121 DEBUG:teuthology.orchestra.run.smithi088:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:22:14.210 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:22:14.210 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:22:14.224 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:22:14.224 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:22:14.224 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-12-08T08:22:14.224 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: trying mount with new device syntax: 0@681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3.cephfs=/ 2023-12-08T08:22:14.224 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.88:3300/172.21.15.148:3300/172.21.15.148:3301" will pass to kernel 2023-12-08T08:22:14.227 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T08:22:14.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:14.228 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:22:14.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:14.248 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:22:14.310 INFO:teuthology.orchestra.run.smithi088.stdout:client5979 2023-12-08T08:22:14.310 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:22:14.310 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:22:14.362 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:22:14.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.543+0000 7fbb6b432640 1 Processor -- start 2023-12-08T08:22:14.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.543+0000 7fbb6b432640 1 -- start start 2023-12-08T08:22:14.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.543+0000 7fbb6b432640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbb64154f20 0x7fbb6406b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:14.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.543+0000 7fbb6b432640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb6406bf30 0x7fbb6415ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:14.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.543+0000 7fbb6b432640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb6406c360 con 0x7fbb640af4c0 2023-12-08T08:22:14.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.543+0000 7fbb6b432640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb640c4890 con 0x7fbb64154f20 2023-12-08T08:22:14.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.543+0000 7fbb6b432640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb641553d0 con 0x7fbb6406bf30 2023-12-08T08:22:14.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.543+0000 7fbb691ce640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbb640af4c0 0x7fbb640c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49314/0 (socket says 172.21.15.88:49314) 2023-12-08T08:22:14.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.543+0000 7fbb691ce640 1 -- 172.21.15.88:0/746994265 learned_addr learned my addr 172.21.15.88:0/746994265 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:14.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.543+0000 7fbb699cf640 1 --2- 172.21.15.88:0/746994265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb6406bf30 0x7fbb6415ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:14.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.543+0000 7fbb689cd640 1 --2- 172.21.15.88:0/746994265 >> v2:172.21.15.148:3300/0 conn(0x7fbb64154f20 0x7fbb6406b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:14.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.543+0000 7fbb699cf640 1 -- 172.21.15.88:0/746994265 >> v2:172.21.15.148:3300/0 conn(0x7fbb64154f20 msgr2=0x7fbb6406b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:14.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.543+0000 7fbb699cf640 1 --2- 172.21.15.88:0/746994265 >> v2:172.21.15.148:3300/0 conn(0x7fbb64154f20 0x7fbb6406b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:14.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.543+0000 7fbb699cf640 1 -- 172.21.15.88:0/746994265 >> v1:172.21.15.88:6789/0 conn(0x7fbb640af4c0 legacy=0x7fbb640c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:14.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.543+0000 7fbb699cf640 1 -- 172.21.15.88:0/746994265 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb640af8a0 con 0x7fbb6406bf30 2023-12-08T08:22:14.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.543+0000 7fbb689cd640 1 --2- 172.21.15.88:0/746994265 >> v2:172.21.15.148:3300/0 conn(0x7fbb64154f20 0x7fbb6406b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:22:14.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.547+0000 7fbb699cf640 1 --2- 172.21.15.88:0/746994265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb6406bf30 0x7fbb6415ee20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c009d90 tx=0x7fbb5c01c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce10a9609780bb41 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:14.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.547+0000 7fbb5bfff640 1 -- 172.21.15.88:0/746994265 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c0a5950 con 0x7fbb6406bf30 2023-12-08T08:22:14.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.547+0000 7fbb5bfff640 1 -- 172.21.15.88:0/746994265 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5c0a5ab0 con 0x7fbb6406bf30 2023-12-08T08:22:14.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.547+0000 7fbb5bfff640 1 -- 172.21.15.88:0/746994265 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c0a5e40 con 0x7fbb6406bf30 2023-12-08T08:22:14.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.547+0000 7fbb6b432640 1 -- 172.21.15.88:0/746994265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb6406bf30 msgr2=0x7fbb6415ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:14.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.547+0000 7fbb6b432640 1 --2- 172.21.15.88:0/746994265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb6406bf30 0x7fbb6415ee20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c009d90 tx=0x7fbb5c01c890 comp rx=0 tx=0).stop 2023-12-08T08:22:14.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.547+0000 7fbb6b432640 1 -- 172.21.15.88:0/746994265 shutdown_connections 2023-12-08T08:22:14.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.547+0000 7fbb6b432640 1 --2- 172.21.15.88:0/746994265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb6406bf30 0x7fbb6415ee20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:14.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.547+0000 7fbb6b432640 1 --2- 172.21.15.88:0/746994265 >> v2:172.21.15.148:3300/0 conn(0x7fbb64154f20 0x7fbb6406b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:14.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.547+0000 7fbb6b432640 1 -- 172.21.15.88:0/746994265 >> 172.21.15.88:0/746994265 conn(0x7fbb640ab9d0 msgr2=0x7fbb640abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:14.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.547+0000 7fbb6b432640 1 -- 172.21.15.88:0/746994265 shutdown_connections 2023-12-08T08:22:14.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.547+0000 7fbb6b432640 1 -- 172.21.15.88:0/746994265 wait complete. 2023-12-08T08:22:14.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.551+0000 7fbb6b432640 1 Processor -- start 2023-12-08T08:22:14.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.551+0000 7fbb6b432640 1 -- start start 2023-12-08T08:22:14.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.551+0000 7fbb6b432640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb6406bf30 0x7fbb640acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:14.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.551+0000 7fbb6b432640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb640af4c0 0x7fbb640ad780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:14.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.551+0000 7fbb6b432640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb64154f20 0x7fbb64149370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:14.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.551+0000 7fbb6b432640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb64151420 con 0x7fbb6406bf30 2023-12-08T08:22:14.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.551+0000 7fbb6b432640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6414bba0 con 0x7fbb640af4c0 2023-12-08T08:22:14.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.551+0000 7fbb6b432640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb64150a80 con 0x7fbb64154f20 2023-12-08T08:22:14.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.551+0000 7fbb691ce640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb6406bf30 0x7fbb640acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:14.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.551+0000 7fbb691ce640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb6406bf30 0x7fbb640acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43480/0 (socket says 172.21.15.88:43480) 2023-12-08T08:22:14.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.551+0000 7fbb691ce640 1 -- 172.21.15.88:0/3232264455 learned_addr learned my addr 172.21.15.88:0/3232264455 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:14.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.551+0000 7fbb689cd640 1 --2- 172.21.15.88:0/3232264455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb640af4c0 0x7fbb640ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:14.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.551+0000 7fbb699cf640 1 --2- 172.21.15.88:0/3232264455 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb64154f20 0x7fbb64149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:14.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.551+0000 7fbb691ce640 1 -- 172.21.15.88:0/3232264455 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb64154f20 msgr2=0x7fbb64149370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:14.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.551+0000 7fbb691ce640 1 --2- 172.21.15.88:0/3232264455 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb64154f20 0x7fbb64149370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:14.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.551+0000 7fbb691ce640 1 -- 172.21.15.88:0/3232264455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb640af4c0 msgr2=0x7fbb640ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:14.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.551+0000 7fbb691ce640 1 --2- 172.21.15.88:0/3232264455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb640af4c0 0x7fbb640ad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:14.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.551+0000 7fbb691ce640 1 -- 172.21.15.88:0/3232264455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb54009420 con 0x7fbb6406bf30 2023-12-08T08:22:14.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.551+0000 7fbb691ce640 1 --2- 172.21.15.88:0/3232264455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb6406bf30 0x7fbb640acd40 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fbb6000c400 tx=0x7fbb6000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:14.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.551+0000 7fbb59ffb640 1 -- 172.21.15.88:0/3232264455 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb60005cf0 con 0x7fbb6406bf30 2023-12-08T08:22:14.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.551+0000 7fbb59ffb640 1 -- 172.21.15.88:0/3232264455 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb60005e50 con 0x7fbb6406bf30 2023-12-08T08:22:14.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.551+0000 7fbb59ffb640 1 -- 172.21.15.88:0/3232264455 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb600072d0 con 0x7fbb6406bf30 2023-12-08T08:22:14.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.551+0000 7fbb6b432640 1 -- 172.21.15.88:0/3232264455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb5c009a70 con 0x7fbb6406bf30 2023-12-08T08:22:14.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.551+0000 7fbb6b432640 1 -- 172.21.15.88:0/3232264455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb64151040 con 0x7fbb6406bf30 2023-12-08T08:22:14.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.555+0000 7fbb6b432640 1 -- 172.21.15.88:0/3232264455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb64149170 con 0x7fbb6406bf30 2023-12-08T08:22:14.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.555+0000 7fbb59ffb640 1 -- 172.21.15.88:0/3232264455 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbb60007430 con 0x7fbb6406bf30 2023-12-08T08:22:14.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.555+0000 7fbb59ffb640 1 --2- 172.21.15.88:0/3232264455 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbb48066470 0x7fbb48068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:14.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.555+0000 7fbb59ffb640 1 -- 172.21.15.88:0/3232264455 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb600833e0 con 0x7fbb6406bf30 2023-12-08T08:22:14.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.555+0000 7fbb689cd640 1 --2- 172.21.15.88:0/3232264455 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbb48066470 0x7fbb48068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:14.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.555+0000 7fbb689cd640 1 --2- 172.21.15.88:0/3232264455 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbb48066470 0x7fbb48068930 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbb640c9450 tx=0x7fbb54009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:14.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.559+0000 7fbb59ffb640 1 -- 172.21.15.88:0/3232264455 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbb60050870 con 0x7fbb6406bf30 2023-12-08T08:22:14.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.739+0000 7fbb6b432640 1 -- 172.21.15.88:0/3232264455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbb64067630 con 0x7fbb6406bf30 2023-12-08T08:22:14.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.739+0000 7fbb59ffb640 1 -- 172.21.15.88:0/3232264455 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbb60053e90 con 0x7fbb6406bf30 2023-12-08T08:22:14.744 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:22:14.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.743+0000 7fbb6b432640 1 -- 172.21.15.88:0/3232264455 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbb48066470 msgr2=0x7fbb48068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:14.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.743+0000 7fbb6b432640 1 --2- 172.21.15.88:0/3232264455 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbb48066470 0x7fbb48068930 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbb640c9450 tx=0x7fbb54009190 comp rx=0 tx=0).stop 2023-12-08T08:22:14.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.743+0000 7fbb6b432640 1 -- 172.21.15.88:0/3232264455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb6406bf30 msgr2=0x7fbb640acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:14.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.743+0000 7fbb6b432640 1 --2- 172.21.15.88:0/3232264455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb6406bf30 0x7fbb640acd40 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fbb6000c400 tx=0x7fbb6000c8c0 comp rx=0 tx=0).stop 2023-12-08T08:22:14.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.743+0000 7fbb6b432640 1 -- 172.21.15.88:0/3232264455 shutdown_connections 2023-12-08T08:22:14.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.743+0000 7fbb6b432640 1 --2- 172.21.15.88:0/3232264455 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbb48066470 0x7fbb48068930 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:14.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.743+0000 7fbb6b432640 1 --2- 172.21.15.88:0/3232264455 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbb64154f20 0x7fbb64149370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:14.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.743+0000 7fbb6b432640 1 --2- 172.21.15.88:0/3232264455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb640af4c0 0x7fbb640ad780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:14.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.743+0000 7fbb6b432640 1 --2- 172.21.15.88:0/3232264455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb6406bf30 0x7fbb640acd40 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:14.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.743+0000 7fbb6b432640 1 -- 172.21.15.88:0/3232264455 >> 172.21.15.88:0/3232264455 conn(0x7fbb640ab9d0 msgr2=0x7fbb640c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:14.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.743+0000 7fbb6b432640 1 -- 172.21.15.88:0/3232264455 shutdown_connections 2023-12-08T08:22:14.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:14.743+0000 7fbb6b432640 1 -- 172.21.15.88:0/3232264455 wait complete. 2023-12-08T08:22:14.765 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-08T08:22:14.766 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:22:14.766 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-12-08T08:22:14.766 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-08T08:22:14.766 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-08T08:22:14.766 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-08T08:22:14.766 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-08T08:22:14.766 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:22:14.766 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:22:14.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:14.766 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-12-08T08:22:14.777 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:22:14.777 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:22:14.777 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:22:14.777 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:14.778 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-12-08T08:22:14.778 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:14.778 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:22:14.778 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:22:14.778 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-12-08T08:22:14.778 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:22:14.778 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:22:14.778 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-12-08T08:22:14.778 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:22:14.778 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:22:14.778 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:22:14.779 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:22:14.779 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-08T08:22:14.779 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42304sec preferred_lft 42304sec 2023-12-08T08:22:14.779 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-12-08T08:22:14.779 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:14.779 INFO:teuthology.orchestra.run.smithi148.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-08T08:22:14.779 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 02:42:93:b7:1f:fa brd ff:ff:ff:ff:ff:ff 2023-12-08T08:22:14.779 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-08T08:22:14.779 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:14.779 INFO:teuthology.orchestra.run.smithi148.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:22:14.779 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-08T08:22:14.779 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:22:14.779 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:14.780 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-08T08:22:14.780 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:14.780 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:22:14.780 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:22:14.780 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-08T08:22:14.780 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:14.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:14.781 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:22:14.843 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-12-08T08:22:14.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:14.845 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-12-08T08:22:14.897 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-12-08T08:22:14.897 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:22:14.897 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-08T08:22:14.897 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-08T08:22:14.897 INFO:teuthology.orchestra.run.smithi148.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-08T08:22:14.897 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-08T08:22:14.898 INFO:teuthology.orchestra.run.smithi148.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:22:14.898 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:22:14.898 INFO:teuthology.orchestra.run.smithi148.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:22:14.898 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:22:14.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:14.898 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-12-08T08:22:14.898 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-12-08T08:22:14.898 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-08T08:22:14.898 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-08T08:22:14.899 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-08T08:22:14.899 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-12-08T08:22:14.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:14.991 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-12-08T08:22:15.000 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-08T08:22:15.001 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:22:15.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:15.001 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-12-08T08:22:15.066 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:22:15.066 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-08T08:22:15.122 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:22:15.122 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:22:15.122 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:22:15.177 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-08T08:22:15.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:15.178 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:22:15.271 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:22:15.271 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:22:15.284 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:22:15.284 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:22:15.284 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-12-08T08:22:15.284 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with new device syntax: 1@681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3.cephfs=/ 2023-12-08T08:22:15.284 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.88:3300/172.21.15.148:3300/172.21.15.148:3301" will pass to kernel 2023-12-08T08:22:15.287 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T08:22:15.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:15.288 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:22:15.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:15.308 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:22:15.361 INFO:teuthology.orchestra.run.smithi148.stdout:client5985 2023-12-08T08:22:15.361 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:22:15.361 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:22:15.410 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-12-08T08:22:15.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.551+0000 7f592d6c9640 1 Processor -- start 2023-12-08T08:22:15.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.551+0000 7f592d6c9640 1 -- start start 2023-12-08T08:22:15.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.551+0000 7f592d6c9640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f59281519f0 0x7f59280c0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:15.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.551+0000 7f592d6c9640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f59281582a0 0x7f592806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:15.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.551+0000 7f592d6c9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59280c1500 con 0x7f5928155030 2023-12-08T08:22:15.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.551+0000 7f592d6c9640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592806e000 con 0x7f59281519f0 2023-12-08T08:22:15.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.551+0000 7f592d6c9640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592806da80 con 0x7f59281582a0 2023-12-08T08:22:15.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.551+0000 7f59267fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5928155030 0x7f592806e8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49324/0 (socket says 172.21.15.88:49324) 2023-12-08T08:22:15.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.551+0000 7f59267fc640 1 -- 172.21.15.88:0/4159198690 learned_addr learned my addr 172.21.15.88:0/4159198690 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:15.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.551+0000 7f59277fe640 1 --2- 172.21.15.88:0/4159198690 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f59281582a0 0x7f592806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:15.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.551+0000 7f5926ffd640 1 --2- 172.21.15.88:0/4159198690 >> v2:172.21.15.148:3300/0 conn(0x7f59281519f0 0x7f59280c0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:15.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.551+0000 7f5926ffd640 1 -- 172.21.15.88:0/4159198690 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f59281582a0 msgr2=0x7f592806b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:15.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.551+0000 7f5926ffd640 1 --2- 172.21.15.88:0/4159198690 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f59281582a0 0x7f592806b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:15.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.551+0000 7f5926ffd640 1 -- 172.21.15.88:0/4159198690 >> v1:172.21.15.88:6789/0 conn(0x7f5928155030 legacy=0x7f592806e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:15.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.551+0000 7f5926ffd640 1 -- 172.21.15.88:0/4159198690 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5928157ae0 con 0x7f59281519f0 2023-12-08T08:22:15.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.551+0000 7f59277fe640 1 --2- 172.21.15.88:0/4159198690 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f59281582a0 0x7f592806b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:22:15.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.555+0000 7f5926ffd640 1 --2- 172.21.15.88:0/4159198690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59281519f0 0x7f59280c0fc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f59180097c0 tx=0x7f591801c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78232544b63cd86c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:15.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.555+0000 7f5925ffb640 1 -- 172.21.15.88:0/4159198690 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59180ab600 con 0x7f59281519f0 2023-12-08T08:22:15.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.555+0000 7f5925ffb640 1 -- 172.21.15.88:0/4159198690 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59180a7050 con 0x7f59281519f0 2023-12-08T08:22:15.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.555+0000 7f5925ffb640 1 -- 172.21.15.88:0/4159198690 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59180ab980 con 0x7f59281519f0 2023-12-08T08:22:15.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.555+0000 7f592d6c9640 1 -- 172.21.15.88:0/4159198690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59281519f0 msgr2=0x7f59280c0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:15.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.555+0000 7f592d6c9640 1 --2- 172.21.15.88:0/4159198690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59281519f0 0x7f59280c0fc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f59180097c0 tx=0x7f591801c360 comp rx=0 tx=0).stop 2023-12-08T08:22:15.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.555+0000 7f592d6c9640 1 -- 172.21.15.88:0/4159198690 shutdown_connections 2023-12-08T08:22:15.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.555+0000 7f592d6c9640 1 --2- 172.21.15.88:0/4159198690 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f59281582a0 0x7f592806b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:15.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.555+0000 7f592d6c9640 1 --2- 172.21.15.88:0/4159198690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59281519f0 0x7f59280c0fc0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:15.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.555+0000 7f592d6c9640 1 -- 172.21.15.88:0/4159198690 >> 172.21.15.88:0/4159198690 conn(0x7f59280c2e20 msgr2=0x7f59280c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:15.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.555+0000 7f592d6c9640 1 -- 172.21.15.88:0/4159198690 shutdown_connections 2023-12-08T08:22:15.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.555+0000 7f592d6c9640 1 -- 172.21.15.88:0/4159198690 wait complete. 2023-12-08T08:22:15.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.559+0000 7f592d6c9640 1 Processor -- start 2023-12-08T08:22:15.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.559+0000 7f592d6c9640 1 -- start start 2023-12-08T08:22:15.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.559+0000 7f592d6c9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59281519f0 0x7f592814bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:15.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.559+0000 7f592d6c9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5928155030 0x7f592814f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:15.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.559+0000 7f592d6c9640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f59281582a0 0x7f592814fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:15.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.559+0000 7f592d6c9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59280a9820 con 0x7f59281519f0 2023-12-08T08:22:15.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.559+0000 7f592d6c9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592814add0 con 0x7f5928155030 2023-12-08T08:22:15.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.559+0000 7f592d6c9640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59280a9260 con 0x7f59281582a0 2023-12-08T08:22:15.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.559+0000 7f5926ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59281519f0 0x7f592814bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:15.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.559+0000 7f5926ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59281519f0 0x7f592814bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43490/0 (socket says 172.21.15.88:43490) 2023-12-08T08:22:15.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.559+0000 7f5926ffd640 1 -- 172.21.15.88:0/2069732201 learned_addr learned my addr 172.21.15.88:0/2069732201 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:15.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.559+0000 7f59267fc640 1 --2- 172.21.15.88:0/2069732201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5928155030 0x7f592814f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:15.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.559+0000 7f59277fe640 1 --2- 172.21.15.88:0/2069732201 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f59281582a0 0x7f592814fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:15.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.559+0000 7f5926ffd640 1 -- 172.21.15.88:0/2069732201 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f59281582a0 msgr2=0x7f592814fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:15.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.559+0000 7f5926ffd640 1 --2- 172.21.15.88:0/2069732201 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f59281582a0 0x7f592814fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:15.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.559+0000 7f5926ffd640 1 -- 172.21.15.88:0/2069732201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5928155030 msgr2=0x7f592814f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:15.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.559+0000 7f5926ffd640 1 --2- 172.21.15.88:0/2069732201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5928155030 0x7f592814f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:15.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.559+0000 7f5926ffd640 1 -- 172.21.15.88:0/2069732201 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5920009a70 con 0x7f59281519f0 2023-12-08T08:22:15.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.559+0000 7f5926ffd640 1 --2- 172.21.15.88:0/2069732201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59281519f0 0x7f592814bee0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f5918019f90 tx=0x7f5918019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:15.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.559+0000 7f590f7fe640 1 -- 172.21.15.88:0/2069732201 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59180b4610 con 0x7f59281519f0 2023-12-08T08:22:15.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.559+0000 7f590f7fe640 1 -- 172.21.15.88:0/2069732201 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59180b4790 con 0x7f59281519f0 2023-12-08T08:22:15.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.559+0000 7f590f7fe640 1 -- 172.21.15.88:0/2069732201 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59180b4b40 con 0x7f59281519f0 2023-12-08T08:22:15.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.559+0000 7f592d6c9640 1 -- 172.21.15.88:0/2069732201 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5918009420 con 0x7f59281519f0 2023-12-08T08:22:15.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.559+0000 7f592d6c9640 1 -- 172.21.15.88:0/2069732201 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592814f020 con 0x7f59281519f0 2023-12-08T08:22:15.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.559+0000 7f592d6c9640 1 -- 172.21.15.88:0/2069732201 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f592814ee80 con 0x7f59281519f0 2023-12-08T08:22:15.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.563+0000 7f590f7fe640 1 -- 172.21.15.88:0/2069732201 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f59180b2040 con 0x7f59281519f0 2023-12-08T08:22:15.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.563+0000 7f590f7fe640 1 --2- 172.21.15.88:0/2069732201 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5914066470 0x7f5914068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:15.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.563+0000 7f590f7fe640 1 -- 172.21.15.88:0/2069732201 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f591811e0c0 con 0x7f59281519f0 2023-12-08T08:22:15.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.563+0000 7f59267fc640 1 --2- 172.21.15.88:0/2069732201 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5914066470 0x7f5914068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:15.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.563+0000 7f59267fc640 1 --2- 172.21.15.88:0/2069732201 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5914066470 0x7f5914068930 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f592814b240 tx=0x7f591c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:15.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.567+0000 7f590f7fe640 1 -- 172.21.15.88:0/2069732201 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f592814ee80 con 0x7f59281519f0 2023-12-08T08:22:15.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.771+0000 7f592d6c9640 1 -- 172.21.15.88:0/2069732201 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f592814ee80 con 0x7f59281519f0 2023-12-08T08:22:15.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.771+0000 7f590f7fe640 1 -- 172.21.15.88:0/2069732201 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v15) v1 ==== 84+0+0 (secure 0 0 0) 0x7f592814ee80 con 0x7f59281519f0 2023-12-08T08:22:15.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.771+0000 7f592d6c9640 1 -- 172.21.15.88:0/2069732201 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5914066470 msgr2=0x7f5914068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:15.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.771+0000 7f592d6c9640 1 --2- 172.21.15.88:0/2069732201 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5914066470 0x7f5914068930 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f592814b240 tx=0x7f591c009040 comp rx=0 tx=0).stop 2023-12-08T08:22:15.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.771+0000 7f592d6c9640 1 -- 172.21.15.88:0/2069732201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59281519f0 msgr2=0x7f592814bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:15.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.771+0000 7f592d6c9640 1 --2- 172.21.15.88:0/2069732201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59281519f0 0x7f592814bee0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f5918019f90 tx=0x7f5918019100 comp rx=0 tx=0).stop 2023-12-08T08:22:15.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.771+0000 7f592d6c9640 1 -- 172.21.15.88:0/2069732201 shutdown_connections 2023-12-08T08:22:15.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.771+0000 7f592d6c9640 1 --2- 172.21.15.88:0/2069732201 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5914066470 0x7f5914068930 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:15.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.771+0000 7f592d6c9640 1 --2- 172.21.15.88:0/2069732201 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f59281582a0 0x7f592814fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:15.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.771+0000 7f592d6c9640 1 --2- 172.21.15.88:0/2069732201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5928155030 0x7f592814f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:15.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.771+0000 7f592d6c9640 1 --2- 172.21.15.88:0/2069732201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59281519f0 0x7f592814bee0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:15.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.771+0000 7f592d6c9640 1 -- 172.21.15.88:0/2069732201 >> 172.21.15.88:0/2069732201 conn(0x7f59280c2e20 msgr2=0x7f59280c3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:15.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.771+0000 7f592d6c9640 1 -- 172.21.15.88:0/2069732201 shutdown_connections 2023-12-08T08:22:15.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.771+0000 7f592d6c9640 1 -- 172.21.15.88:0/2069732201 wait complete. 2023-12-08T08:22:15.795 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:22:15.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.927+0000 7fa80b7f5640 1 Processor -- start 2023-12-08T08:22:15.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.927+0000 7fa80b7f5640 1 -- start start 2023-12-08T08:22:15.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.931+0000 7fa80b7f5640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8040c3b80 0x7fa80406d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:15.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.931+0000 7fa80b7f5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa80406bb80 con 0x7fa8040c5300 2023-12-08T08:22:15.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.931+0000 7fa80b7f5640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8040c5790 con 0x7fa80406d2b0 2023-12-08T08:22:15.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.931+0000 7fa80b7f5640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8041515c0 con 0x7fa8040c3b80 2023-12-08T08:22:15.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.931+0000 7fa809d92640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa8040c5300 0x7fa80406c730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49328/0 (socket says 172.21.15.88:49328) 2023-12-08T08:22:15.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.931+0000 7fa809d92640 1 -- 172.21.15.88:0/3636586165 learned_addr learned my addr 172.21.15.88:0/3636586165 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:15.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.931+0000 7fa808d90640 1 --2- 172.21.15.88:0/3636586165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8040c3b80 0x7fa80406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:15.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.931+0000 7fa7fbfff640 1 -- 172.21.15.88:0/3636586165 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1578263403 0 0) 0x7fa80406bb80 con 0x7fa8040c5300 2023-12-08T08:22:15.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.931+0000 7fa7fbfff640 1 -- 172.21.15.88:0/3636586165 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7f0005740 con 0x7fa8040c5300 2023-12-08T08:22:15.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.931+0000 7fa7fbfff640 1 -- 172.21.15.88:0/3636586165 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3224521756 0 0) 0x7fa8040c5790 con 0x7fa80406d2b0 2023-12-08T08:22:15.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.931+0000 7fa7fbfff640 1 -- 172.21.15.88:0/3636586165 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa80406bb80 con 0x7fa80406d2b0 2023-12-08T08:22:15.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.931+0000 7fa808d90640 1 -- 172.21.15.88:0/3636586165 >> v1:172.21.15.148:6789/0 conn(0x7fa80406d2b0 legacy=0x7fa80406c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:15.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.931+0000 7fa808d90640 1 -- 172.21.15.88:0/3636586165 >> v1:172.21.15.88:6789/0 conn(0x7fa8040c5300 legacy=0x7fa80406c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:15.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.931+0000 7fa7fbfff640 1 -- 172.21.15.88:0/3636586165 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2037235711 0 0) 0x7fa7f0005740 con 0x7fa8040c5300 2023-12-08T08:22:15.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.931+0000 7fa808d90640 1 -- 172.21.15.88:0/3636586165 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8041518a0 con 0x7fa8040c3b80 2023-12-08T08:22:15.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.935+0000 7fa808d90640 1 --2- 172.21.15.88:0/3636586165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8040c3b80 0x7fa80406d690 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40097f0 tx=0x7fa7f401c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=441fe7d004d9be9a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:15.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.935+0000 7fa7fbfff640 1 -- 172.21.15.88:0/3636586165 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc001a00 con 0x7fa8040c3b80 2023-12-08T08:22:15.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.935+0000 7fa7fbfff640 1 -- 172.21.15.88:0/3636586165 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f40a7050 con 0x7fa8040c3b80 2023-12-08T08:22:15.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.935+0000 7fa7fbfff640 1 -- 172.21.15.88:0/3636586165 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f40ab600 con 0x7fa8040c3b80 2023-12-08T08:22:15.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.935+0000 7fa80b7f5640 1 -- 172.21.15.88:0/3636586165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8040c3b80 msgr2=0x7fa80406d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:15.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.935+0000 7fa80b7f5640 1 --2- 172.21.15.88:0/3636586165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8040c3b80 0x7fa80406d690 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40097f0 tx=0x7fa7f401c3b0 comp rx=0 tx=0).stop 2023-12-08T08:22:15.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.935+0000 7fa80b7f5640 1 -- 172.21.15.88:0/3636586165 shutdown_connections 2023-12-08T08:22:15.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.935+0000 7fa80b7f5640 1 --2- 172.21.15.88:0/3636586165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa8040c3b80 0x7fa80406d690 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:15.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.935+0000 7fa80b7f5640 1 -- 172.21.15.88:0/3636586165 >> 172.21.15.88:0/3636586165 conn(0x7fa8040a7810 msgr2=0x7fa8040a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:15.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.935+0000 7fa80b7f5640 1 -- 172.21.15.88:0/3636586165 shutdown_connections 2023-12-08T08:22:15.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.935+0000 7fa80b7f5640 1 -- 172.21.15.88:0/3636586165 wait complete. 2023-12-08T08:22:15.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.935+0000 7fa80b7f5640 1 Processor -- start 2023-12-08T08:22:15.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.935+0000 7fa80b7f5640 1 -- start start 2023-12-08T08:22:15.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.939+0000 7fa80b7f5640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa80406d2b0 0x7fa8041481e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:15.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.939+0000 7fa80b7f5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8040c3b80 0x7fa8041f04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:15.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.939+0000 7fa80b7f5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8040c5300 0x7fa8041f09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:15.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.939+0000 7fa80b7f5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8041f0f20 con 0x7fa8040c5300 2023-12-08T08:22:15.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.939+0000 7fa80b7f5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa804152f90 con 0x7fa8040c3b80 2023-12-08T08:22:15.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.939+0000 7fa80b7f5640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa804148a20 con 0x7fa80406d2b0 2023-12-08T08:22:15.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.939+0000 7fa809d92640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8040c5300 0x7fa8041f09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:15.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.939+0000 7fa808d90640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8040c3b80 0x7fa8041f04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:15.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.939+0000 7fa809591640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa80406d2b0 0x7fa8041481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:15.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.939+0000 7fa808d90640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8040c3b80 0x7fa8041f04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:50022/0 (socket says 172.21.15.88:50022) 2023-12-08T08:22:15.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.939+0000 7fa808d90640 1 -- 172.21.15.88:0/4020956928 learned_addr learned my addr 172.21.15.88:0/4020956928 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:15.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.939+0000 7fa809d92640 1 -- 172.21.15.88:0/4020956928 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa80406d2b0 msgr2=0x7fa8041481e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:15.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.939+0000 7fa809d92640 1 --2- 172.21.15.88:0/4020956928 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa80406d2b0 0x7fa8041481e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:15.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.939+0000 7fa809d92640 1 -- 172.21.15.88:0/4020956928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8040c3b80 msgr2=0x7fa8041f04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:15.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.939+0000 7fa809d92640 1 --2- 172.21.15.88:0/4020956928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8040c3b80 0x7fa8041f04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:15.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.939+0000 7fa809d92640 1 -- 172.21.15.88:0/4020956928 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f4009420 con 0x7fa8040c5300 2023-12-08T08:22:15.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.939+0000 7fa809d92640 1 --2- 172.21.15.88:0/4020956928 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8040c5300 0x7fa8041f09e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00cac0 tx=0x7fa7fc00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:15.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.939+0000 7fa7f9ffb640 1 -- 172.21.15.88:0/4020956928 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc00ac30 con 0x7fa8040c5300 2023-12-08T08:22:15.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.939+0000 7fa7f9ffb640 1 -- 172.21.15.88:0/4020956928 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7fc00adb0 con 0x7fa8040c5300 2023-12-08T08:22:15.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.939+0000 7fa7f9ffb640 1 -- 172.21.15.88:0/4020956928 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc012640 con 0x7fa8040c5300 2023-12-08T08:22:15.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.939+0000 7fa80b7f5640 1 -- 172.21.15.88:0/4020956928 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa80414ef80 con 0x7fa8040c5300 2023-12-08T08:22:15.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.939+0000 7fa80b7f5640 1 -- 172.21.15.88:0/4020956928 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa804148720 con 0x7fa8040c5300 2023-12-08T08:22:15.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.939+0000 7fa80b7f5640 1 -- 172.21.15.88:0/4020956928 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa804149b30 con 0x7fa8040c5300 2023-12-08T08:22:15.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.943+0000 7fa7f9ffb640 1 -- 172.21.15.88:0/4020956928 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa7fc0127a0 con 0x7fa8040c5300 2023-12-08T08:22:15.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.943+0000 7fa7f9ffb640 1 --2- 172.21.15.88:0/4020956928 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa7e8066470 0x7fa7e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:15.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.943+0000 7fa7f9ffb640 1 -- 172.21.15.88:0/4020956928 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7fc084370 con 0x7fa8040c5300 2023-12-08T08:22:15.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.943+0000 7fa809591640 1 --2- 172.21.15.88:0/4020956928 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa7e8066470 0x7fa7e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:15.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.943+0000 7fa809591640 1 --2- 172.21.15.88:0/4020956928 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa7e8066470 0x7fa7e8068930 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa8000011f0 tx=0x7fa800009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:15.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:15.947+0000 7fa7f9ffb640 1 -- 172.21.15.88:0/4020956928 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa804149b30 con 0x7fa8040c5300 2023-12-08T08:22:16.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.095+0000 7fa80b7f5640 1 -- 172.21.15.88:0/4020956928 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa804149b30 con 0x7fa8040c5300 2023-12-08T08:22:16.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.095+0000 7fa7f9ffb640 1 -- 172.21.15.88:0/4020956928 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16541 (secure 0 0 0) 0x7fa804149b30 con 0x7fa8040c5300 2023-12-08T08:22:16.101 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:16.101 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":50,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:22:04.068463+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:00.520254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:01.423493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:22:16.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.099+0000 7fa80b7f5640 1 -- 172.21.15.88:0/4020956928 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa7e8066470 msgr2=0x7fa7e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:16.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.099+0000 7fa80b7f5640 1 --2- 172.21.15.88:0/4020956928 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa7e8066470 0x7fa7e8068930 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa8000011f0 tx=0x7fa800009040 comp rx=0 tx=0).stop 2023-12-08T08:22:16.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.099+0000 7fa80b7f5640 1 -- 172.21.15.88:0/4020956928 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8040c5300 msgr2=0x7fa8041f09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:16.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.099+0000 7fa80b7f5640 1 --2- 172.21.15.88:0/4020956928 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8040c5300 0x7fa8041f09e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00cac0 tx=0x7fa7fc00cf80 comp rx=0 tx=0).stop 2023-12-08T08:22:16.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.099+0000 7fa80b7f5640 1 -- 172.21.15.88:0/4020956928 shutdown_connections 2023-12-08T08:22:16.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.099+0000 7fa80b7f5640 1 --2- 172.21.15.88:0/4020956928 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa7e8066470 0x7fa7e8068930 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.099+0000 7fa80b7f5640 1 --2- 172.21.15.88:0/4020956928 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8040c5300 0x7fa8041f09e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.099+0000 7fa80b7f5640 1 --2- 172.21.15.88:0/4020956928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8040c3b80 0x7fa8041f04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.099+0000 7fa80b7f5640 1 --2- 172.21.15.88:0/4020956928 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa80406d2b0 0x7fa8041481e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.099+0000 7fa80b7f5640 1 -- 172.21.15.88:0/4020956928 >> 172.21.15.88:0/4020956928 conn(0x7fa8040a7810 msgr2=0x7fa8040bee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:16.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.099+0000 7fa80b7f5640 1 -- 172.21.15.88:0/4020956928 shutdown_connections 2023-12-08T08:22:16.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.099+0000 7fa80b7f5640 1 -- 172.21.15.88:0/4020956928 wait complete. 2023-12-08T08:22:16.122 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:22:00.520254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:22:01.423493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:22:16.122 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:22:16.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd89b032640 1 Processor -- start 2023-12-08T08:22:16.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd89b032640 1 -- start start 2023-12-08T08:22:16.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd89b032640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd89406d840 0x7fd8940c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:16.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd89b032640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd894152910 con 0x7fd89414f850 2023-12-08T08:22:16.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd89b032640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd894152bf0 con 0x7fd89414fc30 2023-12-08T08:22:16.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd89b032640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8940c2240 con 0x7fd89406d840 2023-12-08T08:22:16.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd898dce640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd89414f850 0x7fd8940aacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49336/0 (socket says 172.21.15.88:49336) 2023-12-08T08:22:16.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd898dce640 1 -- 172.21.15.88:0/767302339 learned_addr learned my addr 172.21.15.88:0/767302339 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:16.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd8995cf640 1 --2- 172.21.15.88:0/767302339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd89406d840 0x7fd8940c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:16.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd8937fe640 1 -- 172.21.15.88:0/767302339 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331708693 0 0) 0x7fd894152910 con 0x7fd89414f850 2023-12-08T08:22:16.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd8937fe640 1 -- 172.21.15.88:0/767302339 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd884003530 con 0x7fd89414f850 2023-12-08T08:22:16.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd8937fe640 1 -- 172.21.15.88:0/767302339 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 733147939 0 0) 0x7fd894152bf0 con 0x7fd89414fc30 2023-12-08T08:22:16.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd8937fe640 1 -- 172.21.15.88:0/767302339 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd894152910 con 0x7fd89414fc30 2023-12-08T08:22:16.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd8937fe640 1 -- 172.21.15.88:0/767302339 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2689140737 0 0) 0x7fd884003530 con 0x7fd89414f850 2023-12-08T08:22:16.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd8937fe640 1 -- 172.21.15.88:0/767302339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd89406d840 msgr2=0x7fd8940c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:16.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd8937fe640 1 --2- 172.21.15.88:0/767302339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd89406d840 0x7fd8940c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd8937fe640 1 -- 172.21.15.88:0/767302339 >> v1:172.21.15.148:6789/0 conn(0x7fd89414fc30 legacy=0x7fd8940c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:16.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd8937fe640 1 -- 172.21.15.88:0/767302339 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd894152ed0 con 0x7fd89414f850 2023-12-08T08:22:16.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd8937fe640 1 -- 172.21.15.88:0/767302339 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7fd8880016a0 con 0x7fd89414f850 2023-12-08T08:22:16.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd8995cf640 1 --2- 172.21.15.88:0/767302339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd89406d840 0x7fd8940c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:22:16.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd8937fe640 1 -- 172.21.15.88:0/767302339 >> v1:172.21.15.88:6789/0 conn(0x7fd89414f850 legacy=0x7fd8940aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:16.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd8937fe640 1 --2- 172.21.15.88:0/767302339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd884003b40 0x7fd884003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:16.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd8937fe640 1 --2- 172.21.15.88:0/767302339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8840047d0 0x7fd884004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:16.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd8937fe640 1 --2- 172.21.15.88:0/767302339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd89406d840 0x7fd884005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:16.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd8937fe640 1 -- 172.21.15.88:0/767302339 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8940c2240 con 0x7fd884003b40 2023-12-08T08:22:16.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd8937fe640 1 -- 172.21.15.88:0/767302339 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88400b9c0 con 0x7fd8840047d0 2023-12-08T08:22:16.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd8937fe640 1 -- 172.21.15.88:0/767302339 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd88400bb80 con 0x7fd89406d840 2023-12-08T08:22:16.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd898dce640 1 --2- 172.21.15.88:0/767302339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd884003b40 0x7fd884003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:16.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd893fff640 1 --2- 172.21.15.88:0/767302339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8840047d0 0x7fd884004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:16.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.259+0000 7fd8995cf640 1 --2- 172.21.15.88:0/767302339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd89406d840 0x7fd884005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:16.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.263+0000 7fd898dce640 1 -- 172.21.15.88:0/767302339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd89406d840 msgr2=0x7fd884005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:16.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.263+0000 7fd898dce640 1 --2- 172.21.15.88:0/767302339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd89406d840 0x7fd884005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.263+0000 7fd898dce640 1 -- 172.21.15.88:0/767302339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8840047d0 msgr2=0x7fd884004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:16.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.263+0000 7fd898dce640 1 --2- 172.21.15.88:0/767302339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8840047d0 0x7fd884004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.263+0000 7fd898dce640 1 -- 172.21.15.88:0/767302339 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd88c009a70 con 0x7fd884003b40 2023-12-08T08:22:16.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.263+0000 7fd893fff640 1 --2- 172.21.15.88:0/767302339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8840047d0 0x7fd884004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:16.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.263+0000 7fd8995cf640 1 --2- 172.21.15.88:0/767302339 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd89406d840 0x7fd884005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:16.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.263+0000 7fd898dce640 1 --2- 172.21.15.88:0/767302339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd884003b40 0x7fd884003f40 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd888001ec0 tx=0x7fd88801cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b55da1df5701d04 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:16.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.263+0000 7fd8937fe640 1 -- 172.21.15.88:0/767302339 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8880058e0 con 0x7fd884003b40 2023-12-08T08:22:16.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.263+0000 7fd8937fe640 1 -- 172.21.15.88:0/767302339 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd888005a60 con 0x7fd884003b40 2023-12-08T08:22:16.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.263+0000 7fd8937fe640 1 -- 172.21.15.88:0/767302339 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd888005e10 con 0x7fd884003b40 2023-12-08T08:22:16.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.267+0000 7fd89b032640 1 -- 172.21.15.88:0/767302339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd884003b40 msgr2=0x7fd884003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:16.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.267+0000 7fd89b032640 1 --2- 172.21.15.88:0/767302339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd884003b40 0x7fd884003f40 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd888001ec0 tx=0x7fd88801cb80 comp rx=0 tx=0).stop 2023-12-08T08:22:16.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.267+0000 7fd8995cf640 1 -- 172.21.15.88:0/767302339 reap_dead start 2023-12-08T08:22:16.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.267+0000 7fd89b032640 1 -- 172.21.15.88:0/767302339 shutdown_connections 2023-12-08T08:22:16.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.267+0000 7fd89b032640 1 -- 172.21.15.88:0/767302339 >> 172.21.15.88:0/767302339 conn(0x7fd8940c59f0 msgr2=0x7fd8940c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:16.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.267+0000 7fd89b032640 1 -- 172.21.15.88:0/767302339 shutdown_connections 2023-12-08T08:22:16.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.267+0000 7fd89b032640 1 -- 172.21.15.88:0/767302339 wait complete. 2023-12-08T08:22:16.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.267+0000 7fd89b032640 1 Processor -- start 2023-12-08T08:22:16.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.267+0000 7fd89b032640 1 -- start start 2023-12-08T08:22:16.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.267+0000 7fd89b032640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd884003b40 0x7fd89414a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:16.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.267+0000 7fd89b032640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd894151470 0x7fd894147240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:16.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.267+0000 7fd89b032640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd89414a5c0 0x7fd894147780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:16.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.267+0000 7fd89b032640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89414b520 con 0x7fd894151470 2023-12-08T08:22:16.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.267+0000 7fd89b032640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8941ec780 con 0x7fd89414a5c0 2023-12-08T08:22:16.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.267+0000 7fd89b032640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89406fc60 con 0x7fd884003b40 2023-12-08T08:22:16.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.267+0000 7fd893fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd894151470 0x7fd894147240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:16.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.267+0000 7fd893fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd894151470 0x7fd894147240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43524/0 (socket says 172.21.15.88:43524) 2023-12-08T08:22:16.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.267+0000 7fd893fff640 1 -- 172.21.15.88:0/1263335365 learned_addr learned my addr 172.21.15.88:0/1263335365 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:16.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.267+0000 7fd8995cf640 1 --2- 172.21.15.88:0/1263335365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd89414a5c0 0x7fd894147780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:16.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.267+0000 7fd898dce640 1 --2- 172.21.15.88:0/1263335365 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd884003b40 0x7fd89414a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:16.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.267+0000 7fd893fff640 1 -- 172.21.15.88:0/1263335365 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd884003b40 msgr2=0x7fd89414a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:16.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.267+0000 7fd893fff640 1 --2- 172.21.15.88:0/1263335365 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd884003b40 0x7fd89414a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.267+0000 7fd893fff640 1 -- 172.21.15.88:0/1263335365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd89414a5c0 msgr2=0x7fd894147780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:16.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.267+0000 7fd893fff640 1 --2- 172.21.15.88:0/1263335365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd89414a5c0 0x7fd894147780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.267+0000 7fd893fff640 1 -- 172.21.15.88:0/1263335365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89414b770 con 0x7fd894151470 2023-12-08T08:22:16.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.267+0000 7fd8995cf640 1 --2- 172.21.15.88:0/1263335365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd89414a5c0 0x7fd894147780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:16.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.271+0000 7fd893fff640 1 --2- 172.21.15.88:0/1263335365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd894151470 0x7fd894147240 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd88000e7b0 tx=0x7fd88000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:16.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.271+0000 7fd8917fa640 1 -- 172.21.15.88:0/1263335365 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd880017070 con 0x7fd894151470 2023-12-08T08:22:16.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.271+0000 7fd8917fa640 1 -- 172.21.15.88:0/1263335365 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8800050d0 con 0x7fd894151470 2023-12-08T08:22:16.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.271+0000 7fd8917fa640 1 -- 172.21.15.88:0/1263335365 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd880005240 con 0x7fd894151470 2023-12-08T08:22:16.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.271+0000 7fd89b032640 1 -- 172.21.15.88:0/1263335365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89414ba50 con 0x7fd894151470 2023-12-08T08:22:16.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.271+0000 7fd89b032640 1 -- 172.21.15.88:0/1263335365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8940a6700 con 0x7fd894151470 2023-12-08T08:22:16.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.271+0000 7fd89b032640 1 -- 172.21.15.88:0/1263335365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd89414bbe0 con 0x7fd894151470 2023-12-08T08:22:16.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.271+0000 7fd8917fa640 1 -- 172.21.15.88:0/1263335365 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd880007020 con 0x7fd894151470 2023-12-08T08:22:16.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.271+0000 7fd8917fa640 1 --2- 172.21.15.88:0/1263335365 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd878066470 0x7fd878068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:16.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.271+0000 7fd8917fa640 1 -- 172.21.15.88:0/1263335365 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd880083610 con 0x7fd894151470 2023-12-08T08:22:16.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.271+0000 7fd898dce640 1 --2- 172.21.15.88:0/1263335365 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd878066470 0x7fd878068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:16.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.271+0000 7fd898dce640 1 --2- 172.21.15.88:0/1263335365 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd878066470 0x7fd878068930 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd8880aa000 tx=0x7fd888001a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:16.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.275+0000 7fd8917fa640 1 -- 172.21.15.88:0/1263335365 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd880050a80 con 0x7fd894151470 2023-12-08T08:22:16.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.426+0000 7fd89b032640 1 -- 172.21.15.88:0/1263335365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd894067630 con 0x7fd894151470 2023-12-08T08:22:16.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.426+0000 7fd8917fa640 1 -- 172.21.15.88:0/1263335365 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd8800540a0 con 0x7fd894151470 2023-12-08T08:22:16.430 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:22:16.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.426+0000 7fd89b032640 1 -- 172.21.15.88:0/1263335365 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd878066470 msgr2=0x7fd878068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:16.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.426+0000 7fd89b032640 1 --2- 172.21.15.88:0/1263335365 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd878066470 0x7fd878068930 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd8880aa000 tx=0x7fd888001a20 comp rx=0 tx=0).stop 2023-12-08T08:22:16.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.426+0000 7fd89b032640 1 -- 172.21.15.88:0/1263335365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd894151470 msgr2=0x7fd894147240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:16.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.426+0000 7fd89b032640 1 --2- 172.21.15.88:0/1263335365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd894151470 0x7fd894147240 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd88000e7b0 tx=0x7fd88000ec70 comp rx=0 tx=0).stop 2023-12-08T08:22:16.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.426+0000 7fd89b032640 1 -- 172.21.15.88:0/1263335365 shutdown_connections 2023-12-08T08:22:16.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.426+0000 7fd89b032640 1 --2- 172.21.15.88:0/1263335365 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd878066470 0x7fd878068930 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.426+0000 7fd89b032640 1 --2- 172.21.15.88:0/1263335365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd89414a5c0 0x7fd894147780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.426+0000 7fd89b032640 1 --2- 172.21.15.88:0/1263335365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd894151470 0x7fd894147240 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.426+0000 7fd89b032640 1 --2- 172.21.15.88:0/1263335365 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd884003b40 0x7fd89414a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.426+0000 7fd89b032640 1 -- 172.21.15.88:0/1263335365 >> 172.21.15.88:0/1263335365 conn(0x7fd8940c59f0 msgr2=0x7fd8940a5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:16.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.426+0000 7fd89b032640 1 -- 172.21.15.88:0/1263335365 shutdown_connections 2023-12-08T08:22:16.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.426+0000 7fd89b032640 1 -- 172.21.15.88:0/1263335365 wait complete. 2023-12-08T08:22:16.451 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:22:16.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.586+0000 7fd6ad609640 1 Processor -- start 2023-12-08T08:22:16.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.586+0000 7fd6ad609640 1 -- start start 2023-12-08T08:22:16.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.586+0000 7fd6ad609640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd6a806bc80 0x7fd6a806c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:16.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.586+0000 7fd6ad609640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a8151210 con 0x7fd6a81516a0 2023-12-08T08:22:16.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.586+0000 7fd6ad609640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a814e680 con 0x7fd6a814e2a0 2023-12-08T08:22:16.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.586+0000 7fd6ad609640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a8151b50 con 0x7fd6a806bc80 2023-12-08T08:22:16.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.586+0000 7fd6a77fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd6a806bc80 0x7fd6a806c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:16.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.586+0000 7fd69e7fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd6a81516a0 0x7fd6a80c4180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49352/0 (socket says 172.21.15.88:49352) 2023-12-08T08:22:16.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.590+0000 7fd69e7fc640 1 -- 172.21.15.88:0/3687175095 learned_addr learned my addr 172.21.15.88:0/3687175095 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:16.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.590+0000 7fd6a77fe640 1 -- 172.21.15.88:0/3687175095 >> v1:172.21.15.148:6789/0 conn(0x7fd6a814e2a0 legacy=0x7fd6a80a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:16.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.590+0000 7fd6a77fe640 1 -- 172.21.15.88:0/3687175095 >> v1:172.21.15.88:6789/0 conn(0x7fd6a81516a0 legacy=0x7fd6a80c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:16.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.590+0000 7fd6a77fe640 1 -- 172.21.15.88:0/3687175095 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a80a9b70 con 0x7fd6a806bc80 2023-12-08T08:22:16.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.590+0000 7fd6a67fc640 1 -- 172.21.15.88:0/3687175095 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171779702 0 0) 0x7fd6a8151210 con 0x7fd6a81516a0 2023-12-08T08:22:16.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.590+0000 7fd6a77fe640 1 --2- 172.21.15.88:0/3687175095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6a806bc80 0x7fd6a806c110 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd6a00097c0 tx=0x7fd6a001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8718b39c310f1536 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:16.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.590+0000 7fd6a67fc640 1 -- 172.21.15.88:0/3687175095 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a00ab600 con 0x7fd6a806bc80 2023-12-08T08:22:16.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.590+0000 7fd6a67fc640 1 -- 172.21.15.88:0/3687175095 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a00a7050 con 0x7fd6a806bc80 2023-12-08T08:22:16.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.590+0000 7fd6a67fc640 1 -- 172.21.15.88:0/3687175095 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a00ab980 con 0x7fd6a806bc80 2023-12-08T08:22:16.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.590+0000 7fd6ad609640 1 -- 172.21.15.88:0/3687175095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6a806bc80 msgr2=0x7fd6a806c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:16.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.590+0000 7fd6ad609640 1 --2- 172.21.15.88:0/3687175095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6a806bc80 0x7fd6a806c110 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd6a00097c0 tx=0x7fd6a001c3f0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.594+0000 7fd6ad609640 1 -- 172.21.15.88:0/3687175095 shutdown_connections 2023-12-08T08:22:16.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.594+0000 7fd6ad609640 1 --2- 172.21.15.88:0/3687175095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6a806bc80 0x7fd6a806c110 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.594+0000 7fd6ad609640 1 -- 172.21.15.88:0/3687175095 >> 172.21.15.88:0/3687175095 conn(0x7fd6a80c59f0 msgr2=0x7fd6a80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:16.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.594+0000 7fd6ad609640 1 -- 172.21.15.88:0/3687175095 shutdown_connections 2023-12-08T08:22:16.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.594+0000 7fd6ad609640 1 -- 172.21.15.88:0/3687175095 wait complete. 2023-12-08T08:22:16.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.594+0000 7fd6ad609640 1 Processor -- start 2023-12-08T08:22:16.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.594+0000 7fd6ad609640 1 -- start start 2023-12-08T08:22:16.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.594+0000 7fd6ad609640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6a806bc80 0x7fd6a8143790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:16.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.594+0000 7fd6ad609640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6a814e2a0 0x7fd6a8070f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:16.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.594+0000 7fd6ad609640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6a81516a0 0x7fd6a8071460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:16.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.594+0000 7fd6ad609640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a8152760 con 0x7fd6a81516a0 2023-12-08T08:22:16.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.594+0000 7fd6ad609640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a8151f50 con 0x7fd6a814e2a0 2023-12-08T08:22:16.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.594+0000 7fd6ad609640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a8153710 con 0x7fd6a806bc80 2023-12-08T08:22:16.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.594+0000 7fd6a77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6a81516a0 0x7fd6a8071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:16.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.594+0000 7fd6a77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6a81516a0 0x7fd6a8071460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43534/0 (socket says 172.21.15.88:43534) 2023-12-08T08:22:16.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.594+0000 7fd6a77fe640 1 -- 172.21.15.88:0/3392408656 learned_addr learned my addr 172.21.15.88:0/3392408656 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:16.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.594+0000 7fd69e7fc640 1 --2- 172.21.15.88:0/3392408656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6a814e2a0 0x7fd6a8070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:16.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.594+0000 7fd6a6ffd640 1 --2- 172.21.15.88:0/3392408656 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6a806bc80 0x7fd6a8143790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:16.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.594+0000 7fd6a77fe640 1 -- 172.21.15.88:0/3392408656 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6a806bc80 msgr2=0x7fd6a8143790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:16.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.594+0000 7fd6a77fe640 1 --2- 172.21.15.88:0/3392408656 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6a806bc80 0x7fd6a8143790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.594+0000 7fd6a77fe640 1 -- 172.21.15.88:0/3392408656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6a814e2a0 msgr2=0x7fd6a8070f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:16.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.594+0000 7fd6a77fe640 1 --2- 172.21.15.88:0/3392408656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6a814e2a0 0x7fd6a8070f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.594+0000 7fd6a77fe640 1 -- 172.21.15.88:0/3392408656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a0009420 con 0x7fd6a81516a0 2023-12-08T08:22:16.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.594+0000 7fd6a6ffd640 1 --2- 172.21.15.88:0/3392408656 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6a806bc80 0x7fd6a8143790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:16.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.594+0000 7fd69e7fc640 1 --2- 172.21.15.88:0/3392408656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6a814e2a0 0x7fd6a8070f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:16.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.594+0000 7fd6a77fe640 1 --2- 172.21.15.88:0/3392408656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6a81516a0 0x7fd6a8071460 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0019000 tx=0x7fd6a0019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:16.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.594+0000 7fd69ffff640 1 -- 172.21.15.88:0/3392408656 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a00b4630 con 0x7fd6a81516a0 2023-12-08T08:22:16.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.598+0000 7fd69ffff640 1 -- 172.21.15.88:0/3392408656 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a00b4790 con 0x7fd6a81516a0 2023-12-08T08:22:16.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.598+0000 7fd69ffff640 1 -- 172.21.15.88:0/3392408656 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a00b4b20 con 0x7fd6a81516a0 2023-12-08T08:22:16.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.598+0000 7fd6ad609640 1 -- 172.21.15.88:0/3392408656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a81eb260 con 0x7fd6a81516a0 2023-12-08T08:22:16.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.598+0000 7fd6ad609640 1 -- 172.21.15.88:0/3392408656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a81eb810 con 0x7fd6a81516a0 2023-12-08T08:22:16.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.598+0000 7fd6ad609640 1 -- 172.21.15.88:0/3392408656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a806b950 con 0x7fd6a81516a0 2023-12-08T08:22:16.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.598+0000 7fd69ffff640 1 -- 172.21.15.88:0/3392408656 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd6a00b2040 con 0x7fd6a81516a0 2023-12-08T08:22:16.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.598+0000 7fd69ffff640 1 --2- 172.21.15.88:0/3392408656 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd688066470 0x7fd688068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:16.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.598+0000 7fd69ffff640 1 -- 172.21.15.88:0/3392408656 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6a011df10 con 0x7fd6a81516a0 2023-12-08T08:22:16.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.598+0000 7fd6a6ffd640 1 --2- 172.21.15.88:0/3392408656 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd688066470 0x7fd688068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:16.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.598+0000 7fd6a6ffd640 1 --2- 172.21.15.88:0/3392408656 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd688066470 0x7fd688068930 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd6980012f0 tx=0x7fd698009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:16.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.602+0000 7fd69ffff640 1 -- 172.21.15.88:0/3392408656 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd6a806b950 con 0x7fd6a81516a0 2023-12-08T08:22:16.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.754+0000 7fd6ad609640 1 -- 172.21.15.88:0/3392408656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd6a806b950 con 0x7fd6a81516a0 2023-12-08T08:22:16.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.754+0000 7fd69ffff640 1 -- 172.21.15.88:0/3392408656 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd6a806b950 con 0x7fd6a81516a0 2023-12-08T08:22:16.758 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:22:16.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.754+0000 7fd6ad609640 1 -- 172.21.15.88:0/3392408656 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd688066470 msgr2=0x7fd688068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:16.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.754+0000 7fd6ad609640 1 --2- 172.21.15.88:0/3392408656 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd688066470 0x7fd688068930 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd6980012f0 tx=0x7fd698009040 comp rx=0 tx=0).stop 2023-12-08T08:22:16.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.754+0000 7fd6ad609640 1 -- 172.21.15.88:0/3392408656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6a81516a0 msgr2=0x7fd6a8071460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:16.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.754+0000 7fd6ad609640 1 --2- 172.21.15.88:0/3392408656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6a81516a0 0x7fd6a8071460 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0019000 tx=0x7fd6a0019190 comp rx=0 tx=0).stop 2023-12-08T08:22:16.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.754+0000 7fd6ad609640 1 -- 172.21.15.88:0/3392408656 shutdown_connections 2023-12-08T08:22:16.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.754+0000 7fd6ad609640 1 --2- 172.21.15.88:0/3392408656 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd688066470 0x7fd688068930 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.754+0000 7fd6ad609640 1 --2- 172.21.15.88:0/3392408656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6a81516a0 0x7fd6a8071460 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.754+0000 7fd6ad609640 1 --2- 172.21.15.88:0/3392408656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6a814e2a0 0x7fd6a8070f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.754+0000 7fd6ad609640 1 --2- 172.21.15.88:0/3392408656 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6a806bc80 0x7fd6a8143790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.754+0000 7fd6ad609640 1 -- 172.21.15.88:0/3392408656 >> 172.21.15.88:0/3392408656 conn(0x7fd6a80c59f0 msgr2=0x7fd6a806c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:16.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.754+0000 7fd6ad609640 1 -- 172.21.15.88:0/3392408656 shutdown_connections 2023-12-08T08:22:16.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.754+0000 7fd6ad609640 1 -- 172.21.15.88:0/3392408656 wait complete. 2023-12-08T08:22:16.779 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:22:16.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.914+0000 7faf48279640 1 Processor -- start 2023-12-08T08:22:16.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.914+0000 7faf48279640 1 -- start start 2023-12-08T08:22:16.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.918+0000 7faf48279640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf4014b1e0 0x7faf400c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:16.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.918+0000 7faf48279640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faf400c5300 0x7faf400a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:16.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.918+0000 7faf48279640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faf40151280 0x7faf40151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:16.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.918+0000 7faf48279640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf400a4e20 con 0x7faf400c5300 2023-12-08T08:22:16.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.918+0000 7faf48279640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf400a50e0 con 0x7faf40151280 2023-12-08T08:22:16.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.918+0000 7faf48279640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf400c0f00 con 0x7faf4014b1e0 2023-12-08T08:22:16.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.918+0000 7faf45814640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faf400c5300 0x7faf400a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:16.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.918+0000 7faf45814640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faf400c5300 0x7faf400a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43544/0 (socket says 172.21.15.88:43544) 2023-12-08T08:22:16.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.918+0000 7faf45814640 1 -- 172.21.15.88:0/2539622780 learned_addr learned my addr 172.21.15.88:0/2539622780 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:16.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.918+0000 7faf46015640 1 --2- 172.21.15.88:0/2539622780 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf4014b1e0 0x7faf400c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:16.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.918+0000 7faf46816640 1 --2- 172.21.15.88:0/2539622780 >> v2:172.21.15.148:3300/0 conn(0x7faf40151280 0x7faf40151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:16.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.918+0000 7faf45814640 1 -- 172.21.15.88:0/2539622780 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf4014b1e0 msgr2=0x7faf400c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:16.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.918+0000 7faf45814640 1 --2- 172.21.15.88:0/2539622780 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf4014b1e0 0x7faf400c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.918+0000 7faf45814640 1 -- 172.21.15.88:0/2539622780 >> v2:172.21.15.148:3300/0 conn(0x7faf40151280 msgr2=0x7faf40151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:16.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.918+0000 7faf45814640 1 --2- 172.21.15.88:0/2539622780 >> v2:172.21.15.148:3300/0 conn(0x7faf40151280 0x7faf40151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.918+0000 7faf45814640 1 -- 172.21.15.88:0/2539622780 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf400c11e0 con 0x7faf400c5300 2023-12-08T08:22:16.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.918+0000 7faf46015640 1 --2- 172.21.15.88:0/2539622780 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf4014b1e0 0x7faf400c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:16.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.918+0000 7faf46816640 1 --2- 172.21.15.88:0/2539622780 >> v2:172.21.15.148:3300/0 conn(0x7faf40151280 0x7faf40151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:16.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.918+0000 7faf45814640 1 --2- 172.21.15.88:0/2539622780 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf400c5300 0x7faf400a9c30 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7faf400c3b30 tx=0x7faf3001e710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f073c10f3d44441d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:16.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.922+0000 7faf45013640 1 -- 172.21.15.88:0/2539622780 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf300ad670 con 0x7faf400c5300 2023-12-08T08:22:16.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.922+0000 7faf45013640 1 -- 172.21.15.88:0/2539622780 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf300ad7d0 con 0x7faf400c5300 2023-12-08T08:22:16.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.922+0000 7faf45013640 1 -- 172.21.15.88:0/2539622780 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf300adb60 con 0x7faf400c5300 2023-12-08T08:22:16.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.922+0000 7faf48279640 1 -- 172.21.15.88:0/2539622780 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf400c5300 msgr2=0x7faf400a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:16.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.922+0000 7faf48279640 1 --2- 172.21.15.88:0/2539622780 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf400c5300 0x7faf400a9c30 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7faf400c3b30 tx=0x7faf3001e710 comp rx=0 tx=0).stop 2023-12-08T08:22:16.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.922+0000 7faf48279640 1 -- 172.21.15.88:0/2539622780 shutdown_connections 2023-12-08T08:22:16.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.922+0000 7faf48279640 1 --2- 172.21.15.88:0/2539622780 >> v2:172.21.15.148:3300/0 conn(0x7faf40151280 0x7faf40151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.922+0000 7faf48279640 1 --2- 172.21.15.88:0/2539622780 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf400c5300 0x7faf400a9c30 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.922+0000 7faf48279640 1 --2- 172.21.15.88:0/2539622780 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf4014b1e0 0x7faf400c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.922+0000 7faf48279640 1 -- 172.21.15.88:0/2539622780 >> 172.21.15.88:0/2539622780 conn(0x7faf400c59f0 msgr2=0x7faf400c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:16.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.922+0000 7faf48279640 1 -- 172.21.15.88:0/2539622780 shutdown_connections 2023-12-08T08:22:16.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.922+0000 7faf48279640 1 -- 172.21.15.88:0/2539622780 wait complete. 2023-12-08T08:22:16.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.922+0000 7faf48279640 1 Processor -- start 2023-12-08T08:22:16.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.922+0000 7faf48279640 1 -- start start 2023-12-08T08:22:16.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.922+0000 7faf48279640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf400c5300 0x7faf400711c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:16.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.922+0000 7faf48279640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf4014b1e0 0x7faf401f0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:16.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.922+0000 7faf48279640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf40151280 0x7faf400bef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:16.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.922+0000 7faf48279640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf401f1410 con 0x7faf40151280 2023-12-08T08:22:16.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.922+0000 7faf48279640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf401ecf50 con 0x7faf4014b1e0 2023-12-08T08:22:16.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.922+0000 7faf48279640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4006ffa0 con 0x7faf400c5300 2023-12-08T08:22:16.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.926+0000 7faf46816640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf40151280 0x7faf400bef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:16.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.926+0000 7faf46015640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf400c5300 0x7faf400711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:16.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.926+0000 7faf46816640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf40151280 0x7faf400bef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43550/0 (socket says 172.21.15.88:43550) 2023-12-08T08:22:16.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.926+0000 7faf46816640 1 -- 172.21.15.88:0/3439551881 learned_addr learned my addr 172.21.15.88:0/3439551881 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:16.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.926+0000 7faf45814640 1 --2- 172.21.15.88:0/3439551881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf4014b1e0 0x7faf401f0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:16.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.926+0000 7faf46816640 1 -- 172.21.15.88:0/3439551881 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf400c5300 msgr2=0x7faf400711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:16.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.926+0000 7faf46816640 1 --2- 172.21.15.88:0/3439551881 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf400c5300 0x7faf400711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.926+0000 7faf46816640 1 -- 172.21.15.88:0/3439551881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf4014b1e0 msgr2=0x7faf401f0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:16.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.926+0000 7faf46816640 1 --2- 172.21.15.88:0/3439551881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf4014b1e0 0x7faf401f0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:16.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.926+0000 7faf46816640 1 -- 172.21.15.88:0/3439551881 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf300094d0 con 0x7faf40151280 2023-12-08T08:22:16.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.926+0000 7faf46816640 1 --2- 172.21.15.88:0/3439551881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf40151280 0x7faf400bef30 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7faf38007df0 tx=0x7faf3800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:16.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.926+0000 7faf36ffd640 1 -- 172.21.15.88:0/3439551881 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf380039a0 con 0x7faf40151280 2023-12-08T08:22:16.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.926+0000 7faf36ffd640 1 -- 172.21.15.88:0/3439551881 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3800f040 con 0x7faf40151280 2023-12-08T08:22:16.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.926+0000 7faf48279640 1 -- 172.21.15.88:0/3439551881 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf40070280 con 0x7faf40151280 2023-12-08T08:22:16.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.926+0000 7faf36ffd640 1 -- 172.21.15.88:0/3439551881 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf38003d40 con 0x7faf40151280 2023-12-08T08:22:16.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.926+0000 7faf48279640 1 -- 172.21.15.88:0/3439551881 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf401ed210 con 0x7faf40151280 2023-12-08T08:22:16.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.926+0000 7faf48279640 1 -- 172.21.15.88:0/3439551881 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf401ed400 con 0x7faf40151280 2023-12-08T08:22:16.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.926+0000 7faf36ffd640 1 -- 172.21.15.88:0/3439551881 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faf38004030 con 0x7faf40151280 2023-12-08T08:22:16.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.930+0000 7faf36ffd640 1 --2- 172.21.15.88:0/3439551881 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faf24066470 0x7faf24068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:16.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.930+0000 7faf36ffd640 1 -- 172.21.15.88:0/3439551881 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf38084030 con 0x7faf40151280 2023-12-08T08:22:16.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.930+0000 7faf46015640 1 --2- 172.21.15.88:0/3439551881 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faf24066470 0x7faf24068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:16.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.930+0000 7faf46015640 1 --2- 172.21.15.88:0/3439551881 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faf24066470 0x7faf24068930 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0098d0 tx=0x7faf3c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:16.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:16.934+0000 7faf36ffd640 1 -- 172.21.15.88:0/3439551881 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faf380515f0 con 0x7faf40151280 2023-12-08T08:22:17.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.082+0000 7faf48279640 1 -- 172.21.15.88:0/3439551881 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faf40067630 con 0x7faf40151280 2023-12-08T08:22:17.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.082+0000 7faf36ffd640 1 -- 172.21.15.88:0/3439551881 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+11 (secure 0 0 0) 0x7faf3801a020 con 0x7faf40151280 2023-12-08T08:22:17.087 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:22:17.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.082+0000 7faf48279640 1 -- 172.21.15.88:0/3439551881 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faf24066470 msgr2=0x7faf24068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:17.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.082+0000 7faf48279640 1 --2- 172.21.15.88:0/3439551881 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faf24066470 0x7faf24068930 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0098d0 tx=0x7faf3c008040 comp rx=0 tx=0).stop 2023-12-08T08:22:17.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.082+0000 7faf48279640 1 -- 172.21.15.88:0/3439551881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf40151280 msgr2=0x7faf400bef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:17.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.082+0000 7faf48279640 1 --2- 172.21.15.88:0/3439551881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf40151280 0x7faf400bef30 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7faf38007df0 tx=0x7faf3800d4a0 comp rx=0 tx=0).stop 2023-12-08T08:22:17.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.082+0000 7faf48279640 1 -- 172.21.15.88:0/3439551881 shutdown_connections 2023-12-08T08:22:17.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.082+0000 7faf48279640 1 --2- 172.21.15.88:0/3439551881 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faf24066470 0x7faf24068930 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:17.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.082+0000 7faf48279640 1 --2- 172.21.15.88:0/3439551881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf40151280 0x7faf400bef30 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:17.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.082+0000 7faf48279640 1 --2- 172.21.15.88:0/3439551881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf4014b1e0 0x7faf401f0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:17.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.082+0000 7faf48279640 1 --2- 172.21.15.88:0/3439551881 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf400c5300 0x7faf400711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:17.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.082+0000 7faf48279640 1 -- 172.21.15.88:0/3439551881 >> 172.21.15.88:0/3439551881 conn(0x7faf400c59f0 msgr2=0x7faf40150a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:17.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.082+0000 7faf48279640 1 -- 172.21.15.88:0/3439551881 shutdown_connections 2023-12-08T08:22:17.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.082+0000 7faf48279640 1 -- 172.21.15.88:0/3439551881 wait complete. 2023-12-08T08:22:17.108 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-08T08:22:17.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.238+0000 7f7b40294640 1 Processor -- start 2023-12-08T08:22:17.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.238+0000 7f7b40294640 1 -- start start 2023-12-08T08:22:17.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.242+0000 7f7b40294640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b38071e30 0x7f7b38072290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:17.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.242+0000 7f7b40294640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7b38156110 0x7f7b381565a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:17.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.242+0000 7f7b40294640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b380c5710 con 0x7f7b3814fd10 2023-12-08T08:22:17.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.242+0000 7f7b40294640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b3806c5e0 con 0x7f7b38156110 2023-12-08T08:22:17.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.242+0000 7f7b40294640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b38155c80 con 0x7f7b38071e30 2023-12-08T08:22:17.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.242+0000 7f7b3e030640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7b3814fd10 0x7f7b380a4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49364/0 (socket says 172.21.15.88:49364) 2023-12-08T08:22:17.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.242+0000 7f7b3e030640 1 -- 172.21.15.88:0/1927284980 learned_addr learned my addr 172.21.15.88:0/1927284980 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:17.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.242+0000 7f7b3d82f640 1 --2- 172.21.15.88:0/1927284980 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b38071e30 0x7f7b38072290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:17.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.242+0000 7f7b3e831640 1 --2- 172.21.15.88:0/1927284980 >> v2:172.21.15.148:3300/0 conn(0x7f7b38156110 0x7f7b381565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:17.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.242+0000 7f7b3d02e640 1 -- 172.21.15.88:0/1927284980 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2554091226 0 0) 0x7f7b380c5710 con 0x7f7b3814fd10 2023-12-08T08:22:17.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.242+0000 7f7b3d02e640 1 -- 172.21.15.88:0/1927284980 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b24003530 con 0x7f7b3814fd10 2023-12-08T08:22:17.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.242+0000 7f7b3d82f640 1 -- 172.21.15.88:0/1927284980 >> v2:172.21.15.148:3300/0 conn(0x7f7b38156110 msgr2=0x7f7b381565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:17.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.242+0000 7f7b3d82f640 1 --2- 172.21.15.88:0/1927284980 >> v2:172.21.15.148:3300/0 conn(0x7f7b38156110 0x7f7b381565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:17.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.242+0000 7f7b3d82f640 1 -- 172.21.15.88:0/1927284980 >> v1:172.21.15.88:6789/0 conn(0x7f7b3814fd10 legacy=0x7f7b380a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:17.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.242+0000 7f7b3d82f640 1 -- 172.21.15.88:0/1927284980 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b380c4e70 con 0x7f7b38071e30 2023-12-08T08:22:17.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.242+0000 7f7b3e831640 1 --2- 172.21.15.88:0/1927284980 >> v2:172.21.15.148:3300/0 conn(0x7f7b38156110 0x7f7b381565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:22:17.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.246+0000 7f7b3d82f640 1 --2- 172.21.15.88:0/1927284980 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b38071e30 0x7f7b38072290 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7b280097c0 tx=0x7f7b2801c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c82b17ede9c0d14 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:17.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.246+0000 7f7b3d02e640 1 -- 172.21.15.88:0/1927284980 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b280ab600 con 0x7f7b38071e30 2023-12-08T08:22:17.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.246+0000 7f7b3d02e640 1 -- 172.21.15.88:0/1927284980 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b280a7050 con 0x7f7b38071e30 2023-12-08T08:22:17.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.246+0000 7f7b3d02e640 1 -- 172.21.15.88:0/1927284980 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b280ab980 con 0x7f7b38071e30 2023-12-08T08:22:17.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.246+0000 7f7b40294640 1 -- 172.21.15.88:0/1927284980 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b38071e30 msgr2=0x7f7b38072290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:17.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.246+0000 7f7b40294640 1 --2- 172.21.15.88:0/1927284980 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b38071e30 0x7f7b38072290 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7b280097c0 tx=0x7f7b2801c330 comp rx=0 tx=0).stop 2023-12-08T08:22:17.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.246+0000 7f7b40294640 1 -- 172.21.15.88:0/1927284980 shutdown_connections 2023-12-08T08:22:17.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.246+0000 7f7b40294640 1 --2- 172.21.15.88:0/1927284980 >> v2:172.21.15.148:3300/0 conn(0x7f7b38156110 0x7f7b381565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:17.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.246+0000 7f7b40294640 1 --2- 172.21.15.88:0/1927284980 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b38071e30 0x7f7b38072290 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:17.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.246+0000 7f7b40294640 1 -- 172.21.15.88:0/1927284980 >> 172.21.15.88:0/1927284980 conn(0x7f7b380a7810 msgr2=0x7f7b380a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:17.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.246+0000 7f7b40294640 1 -- 172.21.15.88:0/1927284980 shutdown_connections 2023-12-08T08:22:17.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.246+0000 7f7b40294640 1 -- 172.21.15.88:0/1927284980 wait complete. 2023-12-08T08:22:17.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.246+0000 7f7b40294640 1 Processor -- start 2023-12-08T08:22:17.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.250+0000 7f7b40294640 1 -- start start 2023-12-08T08:22:17.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.250+0000 7f7b40294640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b38071e30 0x7f7b381f02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:17.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.250+0000 7f7b40294640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b3814fd10 0x7f7b380aa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:17.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.250+0000 7f7b40294640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b38156110 0x7f7b380bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:17.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.250+0000 7f7b40294640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b380aa910 con 0x7f7b3814fd10 2023-12-08T08:22:17.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.250+0000 7f7b40294640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b381efe50 con 0x7f7b38071e30 2023-12-08T08:22:17.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.250+0000 7f7b40294640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b381ef890 con 0x7f7b38156110 2023-12-08T08:22:17.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.250+0000 7f7b3d82f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b3814fd10 0x7f7b380aa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:17.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.250+0000 7f7b3d82f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b3814fd10 0x7f7b380aa3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43556/0 (socket says 172.21.15.88:43556) 2023-12-08T08:22:17.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.250+0000 7f7b3d82f640 1 -- 172.21.15.88:0/934226979 learned_addr learned my addr 172.21.15.88:0/934226979 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:17.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.250+0000 7f7b3e030640 1 --2- 172.21.15.88:0/934226979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b38071e30 0x7f7b381f02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:17.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.250+0000 7f7b3e831640 1 --2- 172.21.15.88:0/934226979 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b38156110 0x7f7b380bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:17.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.250+0000 7f7b3d82f640 1 -- 172.21.15.88:0/934226979 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b38156110 msgr2=0x7f7b380bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:17.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.250+0000 7f7b3d82f640 1 --2- 172.21.15.88:0/934226979 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b38156110 0x7f7b380bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:17.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.250+0000 7f7b3d82f640 1 -- 172.21.15.88:0/934226979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b38071e30 msgr2=0x7f7b381f02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:17.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.250+0000 7f7b3d82f640 1 --2- 172.21.15.88:0/934226979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b38071e30 0x7f7b381f02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:17.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.250+0000 7f7b3d82f640 1 -- 172.21.15.88:0/934226979 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b30009a70 con 0x7f7b3814fd10 2023-12-08T08:22:17.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.250+0000 7f7b3d82f640 1 --2- 172.21.15.88:0/934226979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b3814fd10 0x7f7b380aa3d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f7b280ae040 tx=0x7f7b2801ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:17.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.250+0000 7f7b2effd640 1 -- 172.21.15.88:0/934226979 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b280b7450 con 0x7f7b3814fd10 2023-12-08T08:22:17.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.250+0000 7f7b2effd640 1 -- 172.21.15.88:0/934226979 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b280b75d0 con 0x7f7b3814fd10 2023-12-08T08:22:17.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.250+0000 7f7b2effd640 1 -- 172.21.15.88:0/934226979 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b280b7980 con 0x7f7b3814fd10 2023-12-08T08:22:17.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.250+0000 7f7b40294640 1 -- 172.21.15.88:0/934226979 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b28009420 con 0x7f7b3814fd10 2023-12-08T08:22:17.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.250+0000 7f7b40294640 1 -- 172.21.15.88:0/934226979 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b380a9600 con 0x7f7b3814fd10 2023-12-08T08:22:17.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.250+0000 7f7b40294640 1 -- 172.21.15.88:0/934226979 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b381f0000 con 0x7f7b3814fd10 2023-12-08T08:22:17.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.254+0000 7f7b2effd640 1 -- 172.21.15.88:0/934226979 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7b280b7ae0 con 0x7f7b3814fd10 2023-12-08T08:22:17.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.254+0000 7f7b2effd640 1 --2- 172.21.15.88:0/934226979 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7b1c066470 0x7f7b1c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:17.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.254+0000 7f7b2effd640 1 -- 172.21.15.88:0/934226979 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b2811e420 con 0x7f7b3814fd10 2023-12-08T08:22:17.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.254+0000 7f7b3e030640 1 --2- 172.21.15.88:0/934226979 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7b1c066470 0x7f7b1c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:17.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.254+0000 7f7b3e030640 1 --2- 172.21.15.88:0/934226979 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7b1c066470 0x7f7b1c068930 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7b340011f0 tx=0x7f7b34007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:17.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.258+0000 7f7b2effd640 1 -- 172.21.15.88:0/934226979 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7b381f0000 con 0x7f7b3814fd10 2023-12-08T08:22:17.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.406+0000 7f7b40294640 1 -- 172.21.15.88:0/934226979 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7b381f0000 con 0x7f7b3814fd10 2023-12-08T08:22:17.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.406+0000 7f7b2effd640 1 -- 172.21.15.88:0/934226979 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v50) v1 ==== 84+0+207 (secure 0 0 0) 0x7f7b280bb0e0 con 0x7f7b3814fd10 2023-12-08T08:22:17.413 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:17.414 INFO:teuthology.orchestra.run.smithi088.stdout:[ 2023-12-08T08:22:17.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:22:17.414 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 1, 2023-12-08T08:22:17.414 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": ".mgr" 2023-12-08T08:22:17.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:22:17.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:22:17.414 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 8, 2023-12-08T08:22:17.414 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": "cephfs_metadata" 2023-12-08T08:22:17.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:22:17.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:22:17.414 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 9, 2023-12-08T08:22:17.414 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": "cephfs_data" 2023-12-08T08:22:17.414 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:22:17.414 INFO:teuthology.orchestra.run.smithi088.stdout:] 2023-12-08T08:22:17.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.410+0000 7f7b40294640 1 -- 172.21.15.88:0/934226979 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7b1c066470 msgr2=0x7f7b1c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:17.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.410+0000 7f7b40294640 1 --2- 172.21.15.88:0/934226979 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7b1c066470 0x7f7b1c068930 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7b340011f0 tx=0x7f7b34007d40 comp rx=0 tx=0).stop 2023-12-08T08:22:17.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.410+0000 7f7b40294640 1 -- 172.21.15.88:0/934226979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b3814fd10 msgr2=0x7f7b380aa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:17.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.410+0000 7f7b40294640 1 --2- 172.21.15.88:0/934226979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b3814fd10 0x7f7b380aa3d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f7b280ae040 tx=0x7f7b2801ab70 comp rx=0 tx=0).stop 2023-12-08T08:22:17.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.410+0000 7f7b40294640 1 -- 172.21.15.88:0/934226979 shutdown_connections 2023-12-08T08:22:17.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.410+0000 7f7b40294640 1 --2- 172.21.15.88:0/934226979 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7b1c066470 0x7f7b1c068930 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:17.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.410+0000 7f7b40294640 1 --2- 172.21.15.88:0/934226979 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7b38156110 0x7f7b380bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:17.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.410+0000 7f7b40294640 1 --2- 172.21.15.88:0/934226979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b3814fd10 0x7f7b380aa3d0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:17.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.410+0000 7f7b40294640 1 --2- 172.21.15.88:0/934226979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b38071e30 0x7f7b381f02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:17.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.410+0000 7f7b40294640 1 -- 172.21.15.88:0/934226979 >> 172.21.15.88:0/934226979 conn(0x7f7b380a7810 msgr2=0x7f7b38154f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:17.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.410+0000 7f7b40294640 1 -- 172.21.15.88:0/934226979 shutdown_connections 2023-12-08T08:22:17.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.410+0000 7f7b40294640 1 -- 172.21.15.88:0/934226979 wait complete. 2023-12-08T08:22:17.434 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-12-08T08:22:17.435 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-12-08T08:22:17.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.570+0000 7f195de25640 1 Processor -- start 2023-12-08T08:22:17.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.570+0000 7f195de25640 1 -- start start 2023-12-08T08:22:17.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.570+0000 7f195de25640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f195814f850 0x7f19580aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:17.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.574+0000 7f195de25640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f195806d840 0x7f19580c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:17.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.574+0000 7f195de25640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1958152910 con 0x7f195814fc30 2023-12-08T08:22:17.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.574+0000 7f195de25640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19580c2240 con 0x7f195814f850 2023-12-08T08:22:17.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.574+0000 7f195de25640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1958152bf0 con 0x7f195806d840 2023-12-08T08:22:17.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.574+0000 7f19577fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f195814f850 0x7f19580aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:17.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.574+0000 7f19577fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f195814f850 0x7f19580aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43560/0 (socket says 172.21.15.88:43560) 2023-12-08T08:22:17.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.574+0000 7f19577fe640 1 -- 172.21.15.88:0/994884530 learned_addr learned my addr 172.21.15.88:0/994884530 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:17.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.574+0000 7f1957fff640 1 --2- 172.21.15.88:0/994884530 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f195806d840 0x7f19580c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:17.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.574+0000 7f19577fe640 1 -- 172.21.15.88:0/994884530 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f195806d840 msgr2=0x7f19580c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:17.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.574+0000 7f19577fe640 1 --2- 172.21.15.88:0/994884530 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f195806d840 0x7f19580c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:17.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.574+0000 7f19577fe640 1 -- 172.21.15.88:0/994884530 >> v1:172.21.15.148:6789/0 conn(0x7f195814fc30 legacy=0x7f19580c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:17.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.574+0000 7f19577fe640 1 -- 172.21.15.88:0/994884530 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1958152ed0 con 0x7f195814f850 2023-12-08T08:22:17.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.574+0000 7f19577fe640 1 --2- 172.21.15.88:0/994884530 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f195814f850 0x7f19580aacf0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f1948009870 tx=0x7f194801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f9b358f8f5bd69 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:17.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.578+0000 7f19567fc640 1 -- 172.21.15.88:0/994884530 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19480a9620 con 0x7f195814f850 2023-12-08T08:22:17.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.578+0000 7f19567fc640 1 -- 172.21.15.88:0/994884530 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19480a9780 con 0x7f195814f850 2023-12-08T08:22:17.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.578+0000 7f19567fc640 1 -- 172.21.15.88:0/994884530 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19480a9b10 con 0x7f195814f850 2023-12-08T08:22:17.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.578+0000 7f195de25640 1 -- 172.21.15.88:0/994884530 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f195814f850 msgr2=0x7f19580aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:17.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.578+0000 7f195de25640 1 --2- 172.21.15.88:0/994884530 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f195814f850 0x7f19580aacf0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f1948009870 tx=0x7f194801c540 comp rx=0 tx=0).stop 2023-12-08T08:22:17.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.578+0000 7f195de25640 1 -- 172.21.15.88:0/994884530 shutdown_connections 2023-12-08T08:22:17.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.578+0000 7f195de25640 1 --2- 172.21.15.88:0/994884530 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f195806d840 0x7f19580c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:17.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.578+0000 7f195de25640 1 --2- 172.21.15.88:0/994884530 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f195814f850 0x7f19580aacf0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:17.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.578+0000 7f195de25640 1 -- 172.21.15.88:0/994884530 >> 172.21.15.88:0/994884530 conn(0x7f19580c59f0 msgr2=0x7f19580c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:17.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.578+0000 7f195de25640 1 -- 172.21.15.88:0/994884530 shutdown_connections 2023-12-08T08:22:17.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.578+0000 7f195de25640 1 -- 172.21.15.88:0/994884530 wait complete. 2023-12-08T08:22:17.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.578+0000 7f195de25640 1 Processor -- start 2023-12-08T08:22:17.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.578+0000 7f195de25640 1 -- start start 2023-12-08T08:22:17.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.578+0000 7f195de25640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f195806d840 0x7f1958156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:17.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.578+0000 7f195de25640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f195814f850 0x7f19580bf540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:17.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.578+0000 7f195de25640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f195814fc30 0x7f1958155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:17.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.578+0000 7f195de25640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195814df70 con 0x7f195814f850 2023-12-08T08:22:17.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.578+0000 7f195de25640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195814da40 con 0x7f195806d840 2023-12-08T08:22:17.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.578+0000 7f195de25640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195814dc90 con 0x7f195814fc30 2023-12-08T08:22:17.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.578+0000 7f1956ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f195814f850 0x7f19580bf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:17.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.578+0000 7f1956ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f195814f850 0x7f19580bf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43568/0 (socket says 172.21.15.88:43568) 2023-12-08T08:22:17.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.582+0000 7f1956ffd640 1 -- 172.21.15.88:0/556262025 learned_addr learned my addr 172.21.15.88:0/556262025 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:17.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.582+0000 7f19577fe640 1 --2- 172.21.15.88:0/556262025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f195806d840 0x7f1958156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:17.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.582+0000 7f1957fff640 1 --2- 172.21.15.88:0/556262025 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f195814fc30 0x7f1958155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:17.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.582+0000 7f1956ffd640 1 -- 172.21.15.88:0/556262025 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f195814fc30 msgr2=0x7f1958155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:17.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.582+0000 7f1956ffd640 1 --2- 172.21.15.88:0/556262025 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f195814fc30 0x7f1958155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:17.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.582+0000 7f1956ffd640 1 -- 172.21.15.88:0/556262025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f195806d840 msgr2=0x7f1958156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:17.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.582+0000 7f1956ffd640 1 --2- 172.21.15.88:0/556262025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f195806d840 0x7f1958156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:17.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.582+0000 7f1956ffd640 1 -- 172.21.15.88:0/556262025 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19480094d0 con 0x7f195814f850 2023-12-08T08:22:17.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.582+0000 7f1956ffd640 1 --2- 172.21.15.88:0/556262025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f195814f850 0x7f19580bf540 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f194c00c3a0 tx=0x7f194c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:17.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.582+0000 7f193ffff640 1 -- 172.21.15.88:0/556262025 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c0052d0 con 0x7f195814f850 2023-12-08T08:22:17.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.582+0000 7f193ffff640 1 -- 172.21.15.88:0/556262025 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194c005450 con 0x7f195814f850 2023-12-08T08:22:17.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.582+0000 7f193ffff640 1 -- 172.21.15.88:0/556262025 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c003860 con 0x7f195814f850 2023-12-08T08:22:17.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.582+0000 7f195de25640 1 -- 172.21.15.88:0/556262025 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19581ee030 con 0x7f195814f850 2023-12-08T08:22:17.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.582+0000 7f195de25640 1 -- 172.21.15.88:0/556262025 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19580bfa80 con 0x7f195814f850 2023-12-08T08:22:17.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.582+0000 7f195de25640 1 -- 172.21.15.88:0/556262025 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19581ede90 con 0x7f195814f850 2023-12-08T08:22:17.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.582+0000 7f193ffff640 1 -- 172.21.15.88:0/556262025 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f194c0039c0 con 0x7f195814f850 2023-12-08T08:22:17.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.582+0000 7f193ffff640 1 --2- 172.21.15.88:0/556262025 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1944066470 0x7f1944068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:17.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.586+0000 7f193ffff640 1 -- 172.21.15.88:0/556262025 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f194c083310 con 0x7f195814f850 2023-12-08T08:22:17.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.586+0000 7f19577fe640 1 --2- 172.21.15.88:0/556262025 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1944066470 0x7f1944068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:17.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.586+0000 7f19577fe640 1 --2- 172.21.15.88:0/556262025 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1944066470 0x7f1944068930 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f19480ae000 tx=0x7f19480b3040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:17.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.586+0000 7f193ffff640 1 -- 172.21.15.88:0/556262025 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f19581ede90 con 0x7f195814f850 2023-12-08T08:22:17.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:17.738+0000 7f195de25640 1 -- 172.21.15.88:0/556262025 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f19581ede90 con 0x7f195814f850 2023-12-08T08:22:18.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.566+0000 7f193ffff640 1 -- 172.21.15.88:0/556262025 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v51) v1 ==== 140+0+0 (secure 0 0 0) 0x7f19581ede90 con 0x7f195814f850 2023-12-08T08:22:18.572 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs2_metadata' created 2023-12-08T08:22:18.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.570+0000 7f195de25640 1 -- 172.21.15.88:0/556262025 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1944066470 msgr2=0x7f1944068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:18.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.570+0000 7f195de25640 1 --2- 172.21.15.88:0/556262025 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1944066470 0x7f1944068930 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f19480ae000 tx=0x7f19480b3040 comp rx=0 tx=0).stop 2023-12-08T08:22:18.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.570+0000 7f195de25640 1 -- 172.21.15.88:0/556262025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f195814f850 msgr2=0x7f19580bf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:18.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.570+0000 7f195de25640 1 --2- 172.21.15.88:0/556262025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f195814f850 0x7f19580bf540 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f194c00c3a0 tx=0x7f194c00c860 comp rx=0 tx=0).stop 2023-12-08T08:22:18.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.570+0000 7f195de25640 1 -- 172.21.15.88:0/556262025 shutdown_connections 2023-12-08T08:22:18.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.570+0000 7f195de25640 1 --2- 172.21.15.88:0/556262025 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1944066470 0x7f1944068930 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:18.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.570+0000 7f195de25640 1 --2- 172.21.15.88:0/556262025 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f195814fc30 0x7f1958155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:18.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.570+0000 7f195de25640 1 --2- 172.21.15.88:0/556262025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f195814f850 0x7f19580bf540 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:18.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.570+0000 7f195de25640 1 --2- 172.21.15.88:0/556262025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f195806d840 0x7f1958156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:18.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.570+0000 7f195de25640 1 -- 172.21.15.88:0/556262025 >> 172.21.15.88:0/556262025 conn(0x7f19580c59f0 msgr2=0x7f19580c3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:18.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.570+0000 7f195de25640 1 -- 172.21.15.88:0/556262025 shutdown_connections 2023-12-08T08:22:18.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.570+0000 7f195de25640 1 -- 172.21.15.88:0/556262025 wait complete. 2023-12-08T08:22:18.601 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-08T08:22:18.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.738+0000 7fdb6d3a1640 1 Processor -- start 2023-12-08T08:22:18.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.738+0000 7fdb6d3a1640 1 -- start start 2023-12-08T08:22:18.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.742+0000 7fdb6d3a1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdb681516a0 0x7fdb6806bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:18.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.742+0000 7fdb6d3a1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdb6806c1c0 0x7fdb680c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:18.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.742+0000 7fdb6d3a1640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb68151210 con 0x7fdb6814e2a0 2023-12-08T08:22:18.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.742+0000 7fdb6d3a1640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb68151b50 con 0x7fdb681516a0 2023-12-08T08:22:18.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.742+0000 7fdb6d3a1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6814e680 con 0x7fdb6806c1c0 2023-12-08T08:22:18.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.742+0000 7fdb5e7fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdb681516a0 0x7fdb6806bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:18.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.742+0000 7fdb5e7fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdb681516a0 0x7fdb6806bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43584/0 (socket says 172.21.15.88:43584) 2023-12-08T08:22:18.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.742+0000 7fdb5e7fc640 1 -- 172.21.15.88:0/3766521541 learned_addr learned my addr 172.21.15.88:0/3766521541 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:18.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.742+0000 7fdb677fe640 1 --2- 172.21.15.88:0/3766521541 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdb6806c1c0 0x7fdb680c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:18.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.742+0000 7fdb5e7fc640 1 -- 172.21.15.88:0/3766521541 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdb6806c1c0 msgr2=0x7fdb680c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:18.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.742+0000 7fdb5e7fc640 1 --2- 172.21.15.88:0/3766521541 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdb6806c1c0 0x7fdb680c38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:18.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.742+0000 7fdb5e7fc640 1 -- 172.21.15.88:0/3766521541 >> v1:172.21.15.148:6789/0 conn(0x7fdb6814e2a0 legacy=0x7fdb680a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:18.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.742+0000 7fdb5e7fc640 1 -- 172.21.15.88:0/3766521541 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb680a9b70 con 0x7fdb681516a0 2023-12-08T08:22:18.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.746+0000 7fdb5e7fc640 1 --2- 172.21.15.88:0/3766521541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb681516a0 0x7fdb6806bc80 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fdb5800bb10 tx=0x7fdb5801eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3938378f4eaf3bf9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:18.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.746+0000 7fdb667fc640 1 -- 172.21.15.88:0/3766521541 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb580a7b60 con 0x7fdb681516a0 2023-12-08T08:22:18.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.746+0000 7fdb667fc640 1 -- 172.21.15.88:0/3766521541 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb580a7cc0 con 0x7fdb681516a0 2023-12-08T08:22:18.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.746+0000 7fdb667fc640 1 -- 172.21.15.88:0/3766521541 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb580af660 con 0x7fdb681516a0 2023-12-08T08:22:18.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.746+0000 7fdb6d3a1640 1 -- 172.21.15.88:0/3766521541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb681516a0 msgr2=0x7fdb6806bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:18.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.746+0000 7fdb6d3a1640 1 --2- 172.21.15.88:0/3766521541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb681516a0 0x7fdb6806bc80 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fdb5800bb10 tx=0x7fdb5801eb80 comp rx=0 tx=0).stop 2023-12-08T08:22:18.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.746+0000 7fdb6d3a1640 1 -- 172.21.15.88:0/3766521541 shutdown_connections 2023-12-08T08:22:18.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.746+0000 7fdb6d3a1640 1 --2- 172.21.15.88:0/3766521541 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdb6806c1c0 0x7fdb680c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:18.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.746+0000 7fdb6d3a1640 1 --2- 172.21.15.88:0/3766521541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb681516a0 0x7fdb6806bc80 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:18.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.746+0000 7fdb6d3a1640 1 -- 172.21.15.88:0/3766521541 >> 172.21.15.88:0/3766521541 conn(0x7fdb680c59f0 msgr2=0x7fdb680c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:18.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.746+0000 7fdb6d3a1640 1 -- 172.21.15.88:0/3766521541 shutdown_connections 2023-12-08T08:22:18.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.746+0000 7fdb6d3a1640 1 -- 172.21.15.88:0/3766521541 wait complete. 2023-12-08T08:22:18.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.746+0000 7fdb6d3a1640 1 Processor -- start 2023-12-08T08:22:18.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.746+0000 7fdb6d3a1640 1 -- start start 2023-12-08T08:22:18.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.750+0000 7fdb6d3a1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb6806c1c0 0x7fdb681f0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:18.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.750+0000 7fdb6d3a1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdb6814e2a0 0x7fdb680c1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:18.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.750+0000 7fdb6d3a1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb681516a0 0x7fdb6813f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:18.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.750+0000 7fdb6d3a1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb680c14f0 con 0x7fdb6806c1c0 2023-12-08T08:22:18.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.750+0000 7fdb6d3a1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb681f0560 con 0x7fdb681516a0 2023-12-08T08:22:18.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.750+0000 7fdb6d3a1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6814bcf0 con 0x7fdb6814e2a0 2023-12-08T08:22:18.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.750+0000 7fdb66ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb6806c1c0 0x7fdb681f0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:18.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.750+0000 7fdb66ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb6806c1c0 0x7fdb681f0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43600/0 (socket says 172.21.15.88:43600) 2023-12-08T08:22:18.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.750+0000 7fdb66ffd640 1 -- 172.21.15.88:0/2840317291 learned_addr learned my addr 172.21.15.88:0/2840317291 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:18.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.750+0000 7fdb5e7fc640 1 --2- 172.21.15.88:0/2840317291 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdb6814e2a0 0x7fdb680c1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:18.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.750+0000 7fdb677fe640 1 --2- 172.21.15.88:0/2840317291 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb681516a0 0x7fdb6813f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:18.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.750+0000 7fdb66ffd640 1 -- 172.21.15.88:0/2840317291 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdb6814e2a0 msgr2=0x7fdb680c1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:18.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.750+0000 7fdb66ffd640 1 --2- 172.21.15.88:0/2840317291 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdb6814e2a0 0x7fdb680c1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:18.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.750+0000 7fdb66ffd640 1 -- 172.21.15.88:0/2840317291 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb681516a0 msgr2=0x7fdb6813f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:18.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.750+0000 7fdb66ffd640 1 --2- 172.21.15.88:0/2840317291 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb681516a0 0x7fdb6813f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:18.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.750+0000 7fdb66ffd640 1 -- 172.21.15.88:0/2840317291 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5800b770 con 0x7fdb6806c1c0 2023-12-08T08:22:18.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.750+0000 7fdb66ffd640 1 --2- 172.21.15.88:0/2840317291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb6806c1c0 0x7fdb681f0020 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000c500 tx=0x7fdb5000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:18.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.750+0000 7fdb5ffff640 1 -- 172.21.15.88:0/2840317291 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50005220 con 0x7fdb6806c1c0 2023-12-08T08:22:18.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.750+0000 7fdb5ffff640 1 -- 172.21.15.88:0/2840317291 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb50005380 con 0x7fdb6806c1c0 2023-12-08T08:22:18.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.750+0000 7fdb6d3a1640 1 -- 172.21.15.88:0/2840317291 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb6814bfd0 con 0x7fdb6806c1c0 2023-12-08T08:22:18.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.750+0000 7fdb5ffff640 1 -- 172.21.15.88:0/2840317291 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50007270 con 0x7fdb6806c1c0 2023-12-08T08:22:18.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.750+0000 7fdb6d3a1640 1 -- 172.21.15.88:0/2840317291 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb680c21c0 con 0x7fdb6806c1c0 2023-12-08T08:22:18.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.750+0000 7fdb6d3a1640 1 -- 172.21.15.88:0/2840317291 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb680c19a0 con 0x7fdb6806c1c0 2023-12-08T08:22:18.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.754+0000 7fdb5ffff640 1 -- 172.21.15.88:0/2840317291 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdb500073d0 con 0x7fdb6806c1c0 2023-12-08T08:22:18.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.754+0000 7fdb5ffff640 1 --2- 172.21.15.88:0/2840317291 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdb48066470 0x7fdb48068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:18.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.754+0000 7fdb5ffff640 1 -- 172.21.15.88:0/2840317291 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6080+0+0 (secure 0 0 0) 0x7fdb50083910 con 0x7fdb6806c1c0 2023-12-08T08:22:18.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.754+0000 7fdb5e7fc640 1 --2- 172.21.15.88:0/2840317291 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdb48066470 0x7fdb48068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:18.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.754+0000 7fdb5e7fc640 1 --2- 172.21.15.88:0/2840317291 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdb48066470 0x7fdb48068930 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdb580b1000 tx=0x7fdb58008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:18.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.758+0000 7fdb5ffff640 1 -- 172.21.15.88:0/2840317291 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdb50050d60 con 0x7fdb6806c1c0 2023-12-08T08:22:18.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:18.906+0000 7fdb6d3a1640 1 -- 172.21.15.88:0/2840317291 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdb680c19a0 con 0x7fdb6806c1c0 2023-12-08T08:22:19.280 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:22:19.284 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:22:19.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.574+0000 7fdb5ffff640 1 -- 172.21.15.88:0/2840317291 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v52) v1 ==== 172+0+0 (secure 0 0 0) 0x7fdb680c19a0 con 0x7fdb6806c1c0 2023-12-08T08:22:19.579 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs2_data' created 2023-12-08T08:22:19.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.574+0000 7fdb6d3a1640 1 -- 172.21.15.88:0/2840317291 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdb48066470 msgr2=0x7fdb48068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:19.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.574+0000 7fdb6d3a1640 1 --2- 172.21.15.88:0/2840317291 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdb48066470 0x7fdb48068930 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdb580b1000 tx=0x7fdb58008040 comp rx=0 tx=0).stop 2023-12-08T08:22:19.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.574+0000 7fdb6d3a1640 1 -- 172.21.15.88:0/2840317291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb6806c1c0 msgr2=0x7fdb681f0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:19.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.574+0000 7fdb6d3a1640 1 --2- 172.21.15.88:0/2840317291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb6806c1c0 0x7fdb681f0020 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000c500 tx=0x7fdb5000c9c0 comp rx=0 tx=0).stop 2023-12-08T08:22:19.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.574+0000 7fdb6d3a1640 1 -- 172.21.15.88:0/2840317291 shutdown_connections 2023-12-08T08:22:19.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.574+0000 7fdb6d3a1640 1 --2- 172.21.15.88:0/2840317291 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdb48066470 0x7fdb48068930 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:19.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.574+0000 7fdb6d3a1640 1 --2- 172.21.15.88:0/2840317291 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb681516a0 0x7fdb6813f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:19.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.574+0000 7fdb6d3a1640 1 --2- 172.21.15.88:0/2840317291 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdb6814e2a0 0x7fdb680c1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:19.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.574+0000 7fdb6d3a1640 1 --2- 172.21.15.88:0/2840317291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb6806c1c0 0x7fdb681f0020 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:19.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.574+0000 7fdb6d3a1640 1 -- 172.21.15.88:0/2840317291 >> 172.21.15.88:0/2840317291 conn(0x7fdb680c59f0 msgr2=0x7fdb68147e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:19.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.578+0000 7fdb6d3a1640 1 -- 172.21.15.88:0/2840317291 shutdown_connections 2023-12-08T08:22:19.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.578+0000 7fdb6d3a1640 1 -- 172.21.15.88:0/2840317291 wait complete. 2023-12-08T08:22:19.622 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-12-08T08:22:19.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.758+0000 7fa5ba0bb640 1 Processor -- start 2023-12-08T08:22:19.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.758+0000 7fa5ba0bb640 1 -- start start 2023-12-08T08:22:19.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.758+0000 7fa5ba0bb640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa5b414f850 0x7fa5b40aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:19.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.758+0000 7fa5ba0bb640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa5b414fc30 0x7fa5b40c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:19.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.758+0000 7fa5ba0bb640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b4152910 con 0x7fa5b406d840 2023-12-08T08:22:19.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.758+0000 7fa5ba0bb640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b40c2240 con 0x7fa5b414fc30 2023-12-08T08:22:19.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.758+0000 7fa5ba0bb640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b4152bf0 con 0x7fa5b414f850 2023-12-08T08:22:19.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.758+0000 7fa5b2ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa5b414fc30 0x7fa5b40c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:19.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.758+0000 7fa5b3fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa5b406d840 0x7fa5b40c4210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49374/0 (socket says 172.21.15.88:49374) 2023-12-08T08:22:19.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.758+0000 7fa5b3fff640 1 -- 172.21.15.88:0/1286117717 learned_addr learned my addr 172.21.15.88:0/1286117717 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:19.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.758+0000 7fa5b37fe640 1 --2- 172.21.15.88:0/1286117717 >> v2:172.21.15.148:3300/0 conn(0x7fa5b414f850 0x7fa5b40aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:19.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.758+0000 7fa5b2ffd640 1 -- 172.21.15.88:0/1286117717 >> v2:172.21.15.148:3300/0 conn(0x7fa5b414f850 msgr2=0x7fa5b40aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:19.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.758+0000 7fa5b2ffd640 1 --2- 172.21.15.88:0/1286117717 >> v2:172.21.15.148:3300/0 conn(0x7fa5b414f850 0x7fa5b40aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:19.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.758+0000 7fa5b2ffd640 1 -- 172.21.15.88:0/1286117717 >> v1:172.21.15.88:6789/0 conn(0x7fa5b406d840 legacy=0x7fa5b40c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:19.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.758+0000 7fa5b2ffd640 1 -- 172.21.15.88:0/1286117717 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b4152ed0 con 0x7fa5b414fc30 2023-12-08T08:22:19.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.762+0000 7fa5b2ffd640 1 --2- 172.21.15.88:0/1286117717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5b414fc30 0x7fa5b40c3cd0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4066f50 tx=0x7fa5a801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5980055e63271 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:19.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.762+0000 7fa5b27fc640 1 -- 172.21.15.88:0/1286117717 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a80ab680 con 0x7fa5b414fc30 2023-12-08T08:22:19.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.762+0000 7fa5b27fc640 1 -- 172.21.15.88:0/1286117717 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a80ab7e0 con 0x7fa5b414fc30 2023-12-08T08:22:19.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.762+0000 7fa5b27fc640 1 -- 172.21.15.88:0/1286117717 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a80abb70 con 0x7fa5b414fc30 2023-12-08T08:22:19.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.762+0000 7fa5ba0bb640 1 -- 172.21.15.88:0/1286117717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5b414fc30 msgr2=0x7fa5b40c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:19.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.762+0000 7fa5ba0bb640 1 --2- 172.21.15.88:0/1286117717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5b414fc30 0x7fa5b40c3cd0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4066f50 tx=0x7fa5a801c460 comp rx=0 tx=0).stop 2023-12-08T08:22:19.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.762+0000 7fa5ba0bb640 1 -- 172.21.15.88:0/1286117717 shutdown_connections 2023-12-08T08:22:19.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.762+0000 7fa5ba0bb640 1 --2- 172.21.15.88:0/1286117717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5b414fc30 0x7fa5b40c3cd0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:19.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.762+0000 7fa5ba0bb640 1 --2- 172.21.15.88:0/1286117717 >> v2:172.21.15.148:3300/0 conn(0x7fa5b414f850 0x7fa5b40aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:19.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.762+0000 7fa5ba0bb640 1 -- 172.21.15.88:0/1286117717 >> 172.21.15.88:0/1286117717 conn(0x7fa5b40c59f0 msgr2=0x7fa5b40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:19.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.762+0000 7fa5ba0bb640 1 -- 172.21.15.88:0/1286117717 shutdown_connections 2023-12-08T08:22:19.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.762+0000 7fa5ba0bb640 1 -- 172.21.15.88:0/1286117717 wait complete. 2023-12-08T08:22:19.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.762+0000 7fa5ba0bb640 1 Processor -- start 2023-12-08T08:22:19.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.762+0000 7fa5ba0bb640 1 -- start start 2023-12-08T08:22:19.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.766+0000 7fa5ba0bb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5b406d840 0x7fa5b4071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:19.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.766+0000 7fa5ba0bb640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5b414f850 0x7fa5b415b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:19.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.766+0000 7fa5ba0bb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5b414fc30 0x7fa5b406fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:19.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.766+0000 7fa5ba0bb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b40704e0 con 0x7fa5b406d840 2023-12-08T08:22:19.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.766+0000 7fa5ba0bb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b4071a40 con 0x7fa5b414fc30 2023-12-08T08:22:19.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.766+0000 7fa5ba0bb640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b40a7410 con 0x7fa5b414f850 2023-12-08T08:22:19.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.766+0000 7fa5b37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5b406d840 0x7fa5b4071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:19.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.766+0000 7fa5b37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5b406d840 0x7fa5b4071ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43618/0 (socket says 172.21.15.88:43618) 2023-12-08T08:22:19.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.766+0000 7fa5b37fe640 1 -- 172.21.15.88:0/3056545520 learned_addr learned my addr 172.21.15.88:0/3056545520 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:19.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.766+0000 7fa5b3fff640 1 --2- 172.21.15.88:0/3056545520 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5b414fc30 0x7fa5b406fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:19.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.766+0000 7fa5b2ffd640 1 --2- 172.21.15.88:0/3056545520 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5b414f850 0x7fa5b415b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:19.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.766+0000 7fa5b37fe640 1 -- 172.21.15.88:0/3056545520 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5b414f850 msgr2=0x7fa5b415b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:19.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.766+0000 7fa5b37fe640 1 --2- 172.21.15.88:0/3056545520 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5b414f850 0x7fa5b415b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:19.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.766+0000 7fa5b37fe640 1 -- 172.21.15.88:0/3056545520 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5b414fc30 msgr2=0x7fa5b406fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:19.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.766+0000 7fa5b37fe640 1 --2- 172.21.15.88:0/3056545520 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5b414fc30 0x7fa5b406fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:19.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.766+0000 7fa5b37fe640 1 -- 172.21.15.88:0/3056545520 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a8009420 con 0x7fa5b406d840 2023-12-08T08:22:19.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.766+0000 7fa5b37fe640 1 --2- 172.21.15.88:0/3056545520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5b406d840 0x7fa5b4071ed0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fa5a400d800 tx=0x7fa5a400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:19.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.766+0000 7fa59bfff640 1 -- 172.21.15.88:0/3056545520 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a400b6c0 con 0x7fa5b406d840 2023-12-08T08:22:19.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.766+0000 7fa59bfff640 1 -- 172.21.15.88:0/3056545520 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a400b820 con 0x7fa5b406d840 2023-12-08T08:22:19.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.766+0000 7fa59bfff640 1 -- 172.21.15.88:0/3056545520 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a400bb90 con 0x7fa5b406d840 2023-12-08T08:22:19.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.766+0000 7fa5ba0bb640 1 -- 172.21.15.88:0/3056545520 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b4156280 con 0x7fa5b406d840 2023-12-08T08:22:19.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.766+0000 7fa5ba0bb640 1 -- 172.21.15.88:0/3056545520 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b4156840 con 0x7fa5b406d840 2023-12-08T08:22:19.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.766+0000 7fa5ba0bb640 1 -- 172.21.15.88:0/3056545520 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b4067630 con 0x7fa5b406d840 2023-12-08T08:22:19.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.770+0000 7fa59bfff640 1 -- 172.21.15.88:0/3056545520 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa5a400bcf0 con 0x7fa5b406d840 2023-12-08T08:22:19.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.770+0000 7fa59bfff640 1 --2- 172.21.15.88:0/3056545520 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa5a0066470 0x7fa5a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:19.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.770+0000 7fa59bfff640 1 -- 172.21.15.88:0/3056545520 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6463+0+0 (secure 0 0 0) 0x7fa5a4084610 con 0x7fa5b406d840 2023-12-08T08:22:19.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.770+0000 7fa5b2ffd640 1 --2- 172.21.15.88:0/3056545520 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa5a0066470 0x7fa5a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:19.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.770+0000 7fa5b2ffd640 1 --2- 172.21.15.88:0/3056545520 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa5a0066470 0x7fa5a0068930 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80af000 tx=0x7fa5a80a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:19.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.774+0000 7fa59bfff640 1 -- 172.21.15.88:0/3056545520 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa5a40517b0 con 0x7fa5b406d840 2023-12-08T08:22:19.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:19.954+0000 7fa5ba0bb640 1 -- 172.21.15.88:0/3056545520 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7fa5b40a4a90 con 0x7fa5b406d840 2023-12-08T08:22:20.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.574+0000 7fa59bfff640 1 -- 172.21.15.88:0/3056545520 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 10 and data pool 11 v33) v1 ==== 177+0+0 (secure 0 0 0) 0x7fa5a4054dd0 con 0x7fa5b406d840 2023-12-08T08:22:20.581 INFO:teuthology.orchestra.run.smithi088.stderr:new fs with metadata pool 10 and data pool 11 2023-12-08T08:22:20.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.578+0000 7fa5ba0bb640 1 -- 172.21.15.88:0/3056545520 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa5a0066470 msgr2=0x7fa5a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:20.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.578+0000 7fa5ba0bb640 1 --2- 172.21.15.88:0/3056545520 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa5a0066470 0x7fa5a0068930 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80af000 tx=0x7fa5a80a7000 comp rx=0 tx=0).stop 2023-12-08T08:22:20.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.578+0000 7fa5ba0bb640 1 -- 172.21.15.88:0/3056545520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5b406d840 msgr2=0x7fa5b4071ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:20.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.578+0000 7fa5ba0bb640 1 --2- 172.21.15.88:0/3056545520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5b406d840 0x7fa5b4071ed0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fa5a400d800 tx=0x7fa5a400dcc0 comp rx=0 tx=0).stop 2023-12-08T08:22:20.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.578+0000 7fa5ba0bb640 1 -- 172.21.15.88:0/3056545520 shutdown_connections 2023-12-08T08:22:20.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.578+0000 7fa5ba0bb640 1 --2- 172.21.15.88:0/3056545520 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa5a0066470 0x7fa5a0068930 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:20.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.578+0000 7fa5ba0bb640 1 --2- 172.21.15.88:0/3056545520 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5b414fc30 0x7fa5b406fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:20.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.578+0000 7fa5ba0bb640 1 --2- 172.21.15.88:0/3056545520 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5b414f850 0x7fa5b415b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:20.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.578+0000 7fa5ba0bb640 1 --2- 172.21.15.88:0/3056545520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5b406d840 0x7fa5b4071ed0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:20.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.578+0000 7fa5ba0bb640 1 -- 172.21.15.88:0/3056545520 >> 172.21.15.88:0/3056545520 conn(0x7fa5b40c59f0 msgr2=0x7fa5b414eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:20.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.578+0000 7fa5ba0bb640 1 -- 172.21.15.88:0/3056545520 shutdown_connections 2023-12-08T08:22:20.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.578+0000 7fa5ba0bb640 1 -- 172.21.15.88:0/3056545520 wait complete. 2023-12-08T08:22:20.609 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:22:20.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.742+0000 7fa55451d640 1 Processor -- start 2023-12-08T08:22:20.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.742+0000 7fa55451d640 1 -- start start 2023-12-08T08:22:20.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.742+0000 7fa55451d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa54c0c0f30 0x7fa54c072580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:20.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.742+0000 7fa55451d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa54c0c1a50 con 0x7fa54c0c3960 2023-12-08T08:22:20.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.742+0000 7fa55451d640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa54c0c08f0 con 0x7fa54c0c0460 2023-12-08T08:22:20.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.742+0000 7fa55451d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c0c3de0 con 0x7fa54c0c0f30 2023-12-08T08:22:20.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.742+0000 7fa551ab8640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa54c0c3960 0x7fa54c159280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46734/0 (socket says 172.21.15.88:46734) 2023-12-08T08:22:20.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.742+0000 7fa551ab8640 1 -- 172.21.15.88:0/51068789 learned_addr learned my addr 172.21.15.88:0/51068789 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:20.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.742+0000 7fa5522b9640 1 --2- 172.21.15.88:0/51068789 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa54c0c0f30 0x7fa54c072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:20.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.746+0000 7fa5512b7640 1 -- 172.21.15.88:0/51068789 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1686018434 0 0) 0x7fa54c0c1a50 con 0x7fa54c0c3960 2023-12-08T08:22:20.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.746+0000 7fa5512b7640 1 -- 172.21.15.88:0/51068789 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa538003530 con 0x7fa54c0c3960 2023-12-08T08:22:20.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.746+0000 7fa5512b7640 1 -- 172.21.15.88:0/51068789 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4048624864 0 0) 0x7fa54c0c08f0 con 0x7fa54c0c0460 2023-12-08T08:22:20.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.746+0000 7fa5512b7640 1 -- 172.21.15.88:0/51068789 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa54c0c1a50 con 0x7fa54c0c0460 2023-12-08T08:22:20.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.746+0000 7fa5512b7640 1 -- 172.21.15.88:0/51068789 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 362700790 0 0) 0x7fa538003530 con 0x7fa54c0c3960 2023-12-08T08:22:20.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.746+0000 7fa5512b7640 1 -- 172.21.15.88:0/51068789 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa54c0c0f30 msgr2=0x7fa54c072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:20.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.746+0000 7fa5512b7640 1 --2- 172.21.15.88:0/51068789 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa54c0c0f30 0x7fa54c072580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:20.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.746+0000 7fa5512b7640 1 -- 172.21.15.88:0/51068789 >> v1:172.21.15.148:6789/0 conn(0x7fa54c0c0460 legacy=0x7fa54c155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:20.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.746+0000 7fa5512b7640 1 -- 172.21.15.88:0/51068789 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c159990 con 0x7fa54c0c3960 2023-12-08T08:22:20.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.746+0000 7fa5512b7640 1 -- 172.21.15.88:0/51068789 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7fa53c001680 con 0x7fa54c0c3960 2023-12-08T08:22:20.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.746+0000 7fa5522b9640 1 --2- 172.21.15.88:0/51068789 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa54c0c0f30 0x7fa54c072580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:22:20.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.746+0000 7fa5512b7640 1 -- 172.21.15.88:0/51068789 >> v1:172.21.15.88:6789/0 conn(0x7fa54c0c3960 legacy=0x7fa54c159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:20.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.746+0000 7fa5512b7640 1 --2- 172.21.15.88:0/51068789 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa54c0c0f30 0x7fa538003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:20.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.746+0000 7fa5512b7640 1 --2- 172.21.15.88:0/51068789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa538004080 0x7fa5380047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:20.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.746+0000 7fa5512b7640 1 --2- 172.21.15.88:0/51068789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa538004d10 0x7fa538005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:20.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.746+0000 7fa5512b7640 1 -- 172.21.15.88:0/51068789 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c0c3de0 con 0x7fa538004080 2023-12-08T08:22:20.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.746+0000 7fa5512b7640 1 -- 172.21.15.88:0/51068789 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53800bad0 con 0x7fa538004d10 2023-12-08T08:22:20.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.746+0000 7fa5512b7640 1 -- 172.21.15.88:0/51068789 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53800bc90 con 0x7fa54c0c0f30 2023-12-08T08:22:20.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.746+0000 7fa551ab8640 1 --2- 172.21.15.88:0/51068789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa538004080 0x7fa5380047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:20.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.746+0000 7fa5522b9640 1 --2- 172.21.15.88:0/51068789 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa54c0c0f30 0x7fa538003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:20.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.746+0000 7fa552aba640 1 --2- 172.21.15.88:0/51068789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa538004d10 0x7fa538005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:20.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.746+0000 7fa551ab8640 1 -- 172.21.15.88:0/51068789 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa54c0c0f30 msgr2=0x7fa538003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:20.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.746+0000 7fa551ab8640 1 --2- 172.21.15.88:0/51068789 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa54c0c0f30 0x7fa538003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:20.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.746+0000 7fa551ab8640 1 -- 172.21.15.88:0/51068789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa538004d10 msgr2=0x7fa538005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:20.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.746+0000 7fa551ab8640 1 --2- 172.21.15.88:0/51068789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa538004d10 0x7fa538005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:20.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.746+0000 7fa551ab8640 1 -- 172.21.15.88:0/51068789 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa548009420 con 0x7fa538004080 2023-12-08T08:22:20.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.750+0000 7fa551ab8640 1 --2- 172.21.15.88:0/51068789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa538004080 0x7fa5380047d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa53c00c160 tx=0x7fa53c01cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49322084cf22857a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:20.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.750+0000 7fa5512b7640 1 -- 172.21.15.88:0/51068789 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c0058e0 con 0x7fa538004080 2023-12-08T08:22:20.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.750+0000 7fa5512b7640 1 -- 172.21.15.88:0/51068789 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53c005a60 con 0x7fa538004080 2023-12-08T08:22:20.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.750+0000 7fa5512b7640 1 -- 172.21.15.88:0/51068789 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c005e50 con 0x7fa538004080 2023-12-08T08:22:20.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.750+0000 7fa55451d640 1 -- 172.21.15.88:0/51068789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa538004080 msgr2=0x7fa5380047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:20.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.750+0000 7fa55451d640 1 --2- 172.21.15.88:0/51068789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa538004080 0x7fa5380047d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa53c00c160 tx=0x7fa53c01cba0 comp rx=0 tx=0).stop 2023-12-08T08:22:20.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.750+0000 7fa552aba640 1 -- 172.21.15.88:0/51068789 reap_dead start 2023-12-08T08:22:20.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.750+0000 7fa55451d640 1 -- 172.21.15.88:0/51068789 shutdown_connections 2023-12-08T08:22:20.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.750+0000 7fa55451d640 1 -- 172.21.15.88:0/51068789 >> 172.21.15.88:0/51068789 conn(0x7fa54c0a7810 msgr2=0x7fa54c0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:20.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.750+0000 7fa55451d640 1 -- 172.21.15.88:0/51068789 shutdown_connections 2023-12-08T08:22:20.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.750+0000 7fa55451d640 1 -- 172.21.15.88:0/51068789 wait complete. 2023-12-08T08:22:20.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.750+0000 7fa55451d640 1 Processor -- start 2023-12-08T08:22:20.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.750+0000 7fa55451d640 1 -- start start 2023-12-08T08:22:20.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.750+0000 7fa55451d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa538004080 0x7fa54c071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:20.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.750+0000 7fa55451d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa54c070e80 0x7fa54c154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:20.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.750+0000 7fa55451d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa54c1559b0 0x7fa54c14da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:20.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.750+0000 7fa55451d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c0709d0 con 0x7fa538004080 2023-12-08T08:22:20.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.750+0000 7fa55451d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c072000 con 0x7fa54c070e80 2023-12-08T08:22:20.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.750+0000 7fa55451d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c155f00 con 0x7fa54c1559b0 2023-12-08T08:22:20.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.754+0000 7fa5522b9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa538004080 0x7fa54c071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:20.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.754+0000 7fa5522b9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa538004080 0x7fa54c071ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48662/0 (socket says 172.21.15.88:48662) 2023-12-08T08:22:20.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.754+0000 7fa5522b9640 1 -- 172.21.15.88:0/4229852996 learned_addr learned my addr 172.21.15.88:0/4229852996 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:20.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.754+0000 7fa551ab8640 1 --2- 172.21.15.88:0/4229852996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa54c070e80 0x7fa54c154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:20.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.754+0000 7fa552aba640 1 --2- 172.21.15.88:0/4229852996 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa54c1559b0 0x7fa54c14da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:20.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.754+0000 7fa5522b9640 1 -- 172.21.15.88:0/4229852996 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa54c1559b0 msgr2=0x7fa54c14da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:20.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.754+0000 7fa5522b9640 1 --2- 172.21.15.88:0/4229852996 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa54c1559b0 0x7fa54c14da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:20.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.754+0000 7fa5522b9640 1 -- 172.21.15.88:0/4229852996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa54c070e80 msgr2=0x7fa54c154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:20.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.754+0000 7fa5522b9640 1 --2- 172.21.15.88:0/4229852996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa54c070e80 0x7fa54c154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:20.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.754+0000 7fa5522b9640 1 -- 172.21.15.88:0/4229852996 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c156760 con 0x7fa538004080 2023-12-08T08:22:20.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.754+0000 7fa5522b9640 1 --2- 172.21.15.88:0/4229852996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa538004080 0x7fa54c071ac0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa548011cd0 tx=0x7fa54800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:20.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.754+0000 7fa542ffd640 1 -- 172.21.15.88:0/4229852996 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54800fd20 con 0x7fa538004080 2023-12-08T08:22:20.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.754+0000 7fa542ffd640 1 -- 172.21.15.88:0/4229852996 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54800fe80 con 0x7fa538004080 2023-12-08T08:22:20.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.754+0000 7fa55451d640 1 -- 172.21.15.88:0/4229852996 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa54c0700a0 con 0x7fa538004080 2023-12-08T08:22:20.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.754+0000 7fa542ffd640 1 -- 172.21.15.88:0/4229852996 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa548014680 con 0x7fa538004080 2023-12-08T08:22:20.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.754+0000 7fa55451d640 1 -- 172.21.15.88:0/4229852996 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa54c154cb0 con 0x7fa538004080 2023-12-08T08:22:20.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.754+0000 7fa55451d640 1 -- 172.21.15.88:0/4229852996 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa54c067630 con 0x7fa538004080 2023-12-08T08:22:20.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.754+0000 7fa542ffd640 1 -- 172.21.15.88:0/4229852996 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa5480147e0 con 0x7fa538004080 2023-12-08T08:22:20.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.758+0000 7fa542ffd640 1 --2- 172.21.15.88:0/4229852996 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa5300664a0 0x7fa530068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:20.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.758+0000 7fa542ffd640 1 -- 172.21.15.88:0/4229852996 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa548084ac0 con 0x7fa538004080 2023-12-08T08:22:20.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.758+0000 7fa551ab8640 1 --2- 172.21.15.88:0/4229852996 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa5300664a0 0x7fa530068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:20.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.758+0000 7fa551ab8640 1 --2- 172.21.15.88:0/4229852996 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa5300664a0 0x7fa530068960 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0aa000 tx=0x7fa53c001a00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:20.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.762+0000 7fa542ffd640 1 -- 172.21.15.88:0/4229852996 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa548051bf0 con 0x7fa538004080 2023-12-08T08:22:20.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.914+0000 7fa55451d640 1 -- 172.21.15.88:0/4229852996 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa54c070b10 con 0x7fa538004080 2023-12-08T08:22:20.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.914+0000 7fa542ffd640 1 -- 172.21.15.88:0/4229852996 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+20269 (secure 0 0 0) 0x7fa54c070b10 con 0x7fa538004080 2023-12-08T08:22:20.919 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:20.920 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":53,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:22:19.959090+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:00.520254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:01.423493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:22:17.787562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:22:18.955273+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:22:20.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.914+0000 7fa55451d640 1 -- 172.21.15.88:0/4229852996 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa5300664a0 msgr2=0x7fa530068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:20.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.914+0000 7fa55451d640 1 --2- 172.21.15.88:0/4229852996 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa5300664a0 0x7fa530068960 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0aa000 tx=0x7fa53c001a00 comp rx=0 tx=0).stop 2023-12-08T08:22:20.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.914+0000 7fa55451d640 1 -- 172.21.15.88:0/4229852996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa538004080 msgr2=0x7fa54c071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:20.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.914+0000 7fa55451d640 1 --2- 172.21.15.88:0/4229852996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa538004080 0x7fa54c071ac0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa548011cd0 tx=0x7fa54800f610 comp rx=0 tx=0).stop 2023-12-08T08:22:20.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.914+0000 7fa55451d640 1 -- 172.21.15.88:0/4229852996 shutdown_connections 2023-12-08T08:22:20.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.914+0000 7fa55451d640 1 --2- 172.21.15.88:0/4229852996 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa5300664a0 0x7fa530068960 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:20.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.914+0000 7fa55451d640 1 --2- 172.21.15.88:0/4229852996 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa54c1559b0 0x7fa54c14da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:20.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.914+0000 7fa55451d640 1 --2- 172.21.15.88:0/4229852996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa54c070e80 0x7fa54c154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:20.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.914+0000 7fa55451d640 1 --2- 172.21.15.88:0/4229852996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa538004080 0x7fa54c071ac0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:20.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.914+0000 7fa55451d640 1 -- 172.21.15.88:0/4229852996 >> 172.21.15.88:0/4229852996 conn(0x7fa54c0a7810 msgr2=0x7fa54c157280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:20.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.914+0000 7fa55451d640 1 -- 172.21.15.88:0/4229852996 shutdown_connections 2023-12-08T08:22:20.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:20.914+0000 7fa55451d640 1 -- 172.21.15.88:0/4229852996 wait complete. 2023-12-08T08:22:20.941 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:22:21.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.074+0000 7f4e4671e640 1 Processor -- start 2023-12-08T08:22:21.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.074+0000 7f4e4671e640 1 -- start start 2023-12-08T08:22:21.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.074+0000 7f4e4671e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4e40151b40 0x7f4e400c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:21.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.074+0000 7f4e4671e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e400ca410 0x7f4e40158020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:21.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.074+0000 7f4e4671e640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e40154530 con 0x7f4e400c9f80 2023-12-08T08:22:21.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.074+0000 7f4e4671e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e40154320 con 0x7f4e40151b40 2023-12-08T08:22:21.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.074+0000 7f4e4671e640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e401552f0 con 0x7f4e400ca410 2023-12-08T08:22:21.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.074+0000 7f4e4571c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4e40151b40 0x7f4e400c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:21.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.074+0000 7f4e4571c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4e40151b40 0x7f4e400c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48678/0 (socket says 172.21.15.88:48678) 2023-12-08T08:22:21.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.074+0000 7f4e4571c640 1 -- 172.21.15.88:0/1390187562 learned_addr learned my addr 172.21.15.88:0/1390187562 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:21.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.074+0000 7f4e4571c640 1 -- 172.21.15.88:0/1390187562 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e400ca410 msgr2=0x7f4e40158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:21.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.074+0000 7f4e45f1d640 1 --2- 172.21.15.88:0/1390187562 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e400ca410 0x7f4e40158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:21.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.074+0000 7f4e4571c640 1 --2- 172.21.15.88:0/1390187562 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e400ca410 0x7f4e40158020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:21.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.074+0000 7f4e4571c640 1 -- 172.21.15.88:0/1390187562 >> v1:172.21.15.148:6789/0 conn(0x7f4e400c9f80 legacy=0x7f4e40157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:21.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.074+0000 7f4e4571c640 1 -- 172.21.15.88:0/1390187562 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e40154810 con 0x7f4e40151b40 2023-12-08T08:22:21.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.074+0000 7f4e45f1d640 1 --2- 172.21.15.88:0/1390187562 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e400ca410 0x7f4e40158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:21.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.078+0000 7f4e4571c640 1 --2- 172.21.15.88:0/1390187562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e40151b40 0x7f4e400c7fd0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c009870 tx=0x7f4e3c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e36cb4145fdce9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:21.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.078+0000 7f4e37fff640 1 -- 172.21.15.88:0/1390187562 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c0ab600 con 0x7f4e40151b40 2023-12-08T08:22:21.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.078+0000 7f4e37fff640 1 -- 172.21.15.88:0/1390187562 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3c0a7050 con 0x7f4e40151b40 2023-12-08T08:22:21.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.078+0000 7f4e37fff640 1 -- 172.21.15.88:0/1390187562 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c0ab980 con 0x7f4e40151b40 2023-12-08T08:22:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.078+0000 7f4e4671e640 1 -- 172.21.15.88:0/1390187562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e40151b40 msgr2=0x7f4e400c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.078+0000 7f4e4671e640 1 --2- 172.21.15.88:0/1390187562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e40151b40 0x7f4e400c7fd0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c009870 tx=0x7f4e3c01c470 comp rx=0 tx=0).stop 2023-12-08T08:22:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.078+0000 7f4e4671e640 1 -- 172.21.15.88:0/1390187562 shutdown_connections 2023-12-08T08:22:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.078+0000 7f4e4671e640 1 --2- 172.21.15.88:0/1390187562 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e400ca410 0x7f4e40158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.078+0000 7f4e4671e640 1 --2- 172.21.15.88:0/1390187562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e40151b40 0x7f4e400c7fd0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.078+0000 7f4e4671e640 1 -- 172.21.15.88:0/1390187562 >> 172.21.15.88:0/1390187562 conn(0x7f4e40066470 msgr2=0x7f4e40066880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.078+0000 7f4e4671e640 1 -- 172.21.15.88:0/1390187562 shutdown_connections 2023-12-08T08:22:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.078+0000 7f4e4671e640 1 -- 172.21.15.88:0/1390187562 wait complete. 2023-12-08T08:22:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.078+0000 7f4e4671e640 1 Processor -- start 2023-12-08T08:22:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.082+0000 7f4e4671e640 1 -- start start 2023-12-08T08:22:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.082+0000 7f4e4671e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e400c9f80 0x7f4e40147530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.082+0000 7f4e4671e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e400ca410 0x7f4e4014b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.082+0000 7f4e4671e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e40151b40 0x7f4e401ece80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.082+0000 7f4e4671e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e40151400 con 0x7f4e400c9f80 2023-12-08T08:22:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.082+0000 7f4e4671e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e401f0da0 con 0x7f4e400ca410 2023-12-08T08:22:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.082+0000 7f4e4671e640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e40149890 con 0x7f4e40151b40 2023-12-08T08:22:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.082+0000 7f4e4571c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e400c9f80 0x7f4e40147530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.082+0000 7f4e4571c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e400c9f80 0x7f4e40147530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48690/0 (socket says 172.21.15.88:48690) 2023-12-08T08:22:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.082+0000 7f4e4571c640 1 -- 172.21.15.88:0/826521764 learned_addr learned my addr 172.21.15.88:0/826521764 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.082+0000 7f4e45f1d640 1 --2- 172.21.15.88:0/826521764 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e40151b40 0x7f4e401ece80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.082+0000 7f4e44f1b640 1 --2- 172.21.15.88:0/826521764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e400ca410 0x7f4e4014b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.082+0000 7f4e4571c640 1 -- 172.21.15.88:0/826521764 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e40151b40 msgr2=0x7f4e401ece80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.082+0000 7f4e4571c640 1 --2- 172.21.15.88:0/826521764 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e40151b40 0x7f4e401ece80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.082+0000 7f4e4571c640 1 -- 172.21.15.88:0/826521764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e400ca410 msgr2=0x7f4e4014b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.082+0000 7f4e4571c640 1 --2- 172.21.15.88:0/826521764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e400ca410 0x7f4e4014b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.082+0000 7f4e4571c640 1 -- 172.21.15.88:0/826521764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3c0094d0 con 0x7f4e400c9f80 2023-12-08T08:22:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.082+0000 7f4e4571c640 1 --2- 172.21.15.88:0/826521764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e400c9f80 0x7f4e40147530 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c01cd10 tx=0x7f4e3c019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:21.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.082+0000 7f4e35ffb640 1 -- 172.21.15.88:0/826521764 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c0b6640 con 0x7f4e400c9f80 2023-12-08T08:22:21.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.082+0000 7f4e35ffb640 1 -- 172.21.15.88:0/826521764 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3c0b67c0 con 0x7f4e400c9f80 2023-12-08T08:22:21.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.082+0000 7f4e4671e640 1 -- 172.21.15.88:0/826521764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e40150e40 con 0x7f4e400c9f80 2023-12-08T08:22:21.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.082+0000 7f4e35ffb640 1 -- 172.21.15.88:0/826521764 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c0b6b70 con 0x7f4e400c9f80 2023-12-08T08:22:21.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.082+0000 7f4e4671e640 1 -- 172.21.15.88:0/826521764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e40147a70 con 0x7f4e400c9f80 2023-12-08T08:22:21.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.082+0000 7f4e4671e640 1 -- 172.21.15.88:0/826521764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e40149660 con 0x7f4e400c9f80 2023-12-08T08:22:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.086+0000 7f4e35ffb640 1 -- 172.21.15.88:0/826521764 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4e3c0b2040 con 0x7f4e400c9f80 2023-12-08T08:22:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.086+0000 7f4e35ffb640 1 --2- 172.21.15.88:0/826521764 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4e24066470 0x7f4e24068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.086+0000 7f4e35ffb640 1 -- 172.21.15.88:0/826521764 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4e3c11e220 con 0x7f4e400c9f80 2023-12-08T08:22:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.086+0000 7f4e44f1b640 1 --2- 172.21.15.88:0/826521764 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4e24066470 0x7f4e24068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.086+0000 7f4e44f1b640 1 --2- 172.21.15.88:0/826521764 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4e24066470 0x7f4e24068930 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4e4015ebd0 tx=0x7f4e30009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:21.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.090+0000 7f4e35ffb640 1 -- 172.21.15.88:0/826521764 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4e40149660 con 0x7f4e400c9f80 2023-12-08T08:22:21.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.242+0000 7f4e4671e640 1 -- 172.21.15.88:0/826521764 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e40149660 con 0x7f4e400c9f80 2023-12-08T08:22:21.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.242+0000 7f4e35ffb640 1 -- 172.21.15.88:0/826521764 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+20269 (secure 0 0 0) 0x7f4e40149660 con 0x7f4e400c9f80 2023-12-08T08:22:21.248 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:21.249 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":53,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:22:19.959090+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:00.520254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:01.423493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:22:17.787562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:22:18.955273+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:22:21.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.246+0000 7f4e4671e640 1 -- 172.21.15.88:0/826521764 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4e24066470 msgr2=0x7f4e24068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:21.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.246+0000 7f4e4671e640 1 --2- 172.21.15.88:0/826521764 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4e24066470 0x7f4e24068930 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4e4015ebd0 tx=0x7f4e30009040 comp rx=0 tx=0).stop 2023-12-08T08:22:21.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.246+0000 7f4e4671e640 1 -- 172.21.15.88:0/826521764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e400c9f80 msgr2=0x7f4e40147530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:21.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.246+0000 7f4e4671e640 1 --2- 172.21.15.88:0/826521764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e400c9f80 0x7f4e40147530 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c01cd10 tx=0x7f4e3c019210 comp rx=0 tx=0).stop 2023-12-08T08:22:21.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.246+0000 7f4e4671e640 1 -- 172.21.15.88:0/826521764 shutdown_connections 2023-12-08T08:22:21.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.246+0000 7f4e4671e640 1 --2- 172.21.15.88:0/826521764 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4e24066470 0x7f4e24068930 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:21.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.246+0000 7f4e4671e640 1 --2- 172.21.15.88:0/826521764 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e40151b40 0x7f4e401ece80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:21.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.246+0000 7f4e4671e640 1 --2- 172.21.15.88:0/826521764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e400ca410 0x7f4e4014b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:21.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.246+0000 7f4e4671e640 1 --2- 172.21.15.88:0/826521764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e400c9f80 0x7f4e40147530 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:21.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.246+0000 7f4e4671e640 1 -- 172.21.15.88:0/826521764 >> 172.21.15.88:0/826521764 conn(0x7f4e40066470 msgr2=0x7f4e400c6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:21.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.246+0000 7f4e4671e640 1 -- 172.21.15.88:0/826521764 shutdown_connections 2023-12-08T08:22:21.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.246+0000 7f4e4671e640 1 -- 172.21.15.88:0/826521764 wait complete. 2023-12-08T08:22:21.270 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-12-08T08:22:21.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7f1d01640 1 Processor -- start 2023-12-08T08:22:21.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7f1d01640 1 -- start start 2023-12-08T08:22:21.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7f1d01640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7ec151a20 0x7fe7ec06e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:21.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7f1d01640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe7ec154bd0 0x7fe7ec155010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:21.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7f1d01640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7ec0c1810 con 0x7fe7ec157a90 2023-12-08T08:22:21.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7f1d01640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7ec0c2720 con 0x7fe7ec154bd0 2023-12-08T08:22:21.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7f1d01640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ec072c50 con 0x7fe7ec151a20 2023-12-08T08:22:21.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7eaffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe7ec157a90 0x7fe7ec06b5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46750/0 (socket says 172.21.15.88:46750) 2023-12-08T08:22:21.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7eaffd640 1 -- 172.21.15.88:0/1809731210 learned_addr learned my addr 172.21.15.88:0/1809731210 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:21.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7ebfff640 1 --2- 172.21.15.88:0/1809731210 >> v2:172.21.15.148:3300/0 conn(0x7fe7ec154bd0 0x7fe7ec155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:21.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7eb7fe640 1 --2- 172.21.15.88:0/1809731210 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7ec151a20 0x7fe7ec06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:21.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7ea7fc640 1 -- 172.21.15.88:0/1809731210 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 74387594 0 0) 0x7fe7ec0c1810 con 0x7fe7ec157a90 2023-12-08T08:22:21.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7ea7fc640 1 -- 172.21.15.88:0/1809731210 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7d4003530 con 0x7fe7ec157a90 2023-12-08T08:22:21.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7ea7fc640 1 -- 172.21.15.88:0/1809731210 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1184786456 0 0) 0x7fe7d4003530 con 0x7fe7ec157a90 2023-12-08T08:22:21.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7ea7fc640 1 -- 172.21.15.88:0/1809731210 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7ec151a20 msgr2=0x7fe7ec06e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:21.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7ea7fc640 1 --2- 172.21.15.88:0/1809731210 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7ec151a20 0x7fe7ec06e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:21.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7ea7fc640 1 -- 172.21.15.88:0/1809731210 >> v2:172.21.15.148:3300/0 conn(0x7fe7ec154bd0 msgr2=0x7fe7ec155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:21.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7ea7fc640 1 --2- 172.21.15.88:0/1809731210 >> v2:172.21.15.148:3300/0 conn(0x7fe7ec154bd0 0x7fe7ec155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:21.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7ea7fc640 1 -- 172.21.15.88:0/1809731210 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ec0c2320 con 0x7fe7ec157a90 2023-12-08T08:22:21.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7ea7fc640 1 -- 172.21.15.88:0/1809731210 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7fe7e0001680 con 0x7fe7ec157a90 2023-12-08T08:22:21.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7ea7fc640 1 -- 172.21.15.88:0/1809731210 >> v1:172.21.15.88:6789/0 conn(0x7fe7ec157a90 legacy=0x7fe7ec06b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:21.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7ea7fc640 1 --2- 172.21.15.88:0/1809731210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7d4003980 0x7fe7d4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:21.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7ea7fc640 1 --2- 172.21.15.88:0/1809731210 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7ec151a20 0x7fe7d40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:21.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7ea7fc640 1 --2- 172.21.15.88:0/1809731210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7d4004d10 0x7fe7d4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:21.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7ea7fc640 1 -- 172.21.15.88:0/1809731210 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ec0c2720 con 0x7fe7d4003980 2023-12-08T08:22:21.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7ea7fc640 1 -- 172.21.15.88:0/1809731210 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ec072c50 con 0x7fe7d4004d10 2023-12-08T08:22:21.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7ea7fc640 1 -- 172.21.15.88:0/1809731210 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d400b990 con 0x7fe7ec151a20 2023-12-08T08:22:21.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7eb7fe640 1 --2- 172.21.15.88:0/1809731210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7d4003980 0x7fe7d4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:21.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7eaffd640 1 --2- 172.21.15.88:0/1809731210 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7ec151a20 0x7fe7d40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:21.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7ebfff640 1 --2- 172.21.15.88:0/1809731210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7d4004d10 0x7fe7d4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:21.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7eb7fe640 1 -- 172.21.15.88:0/1809731210 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7ec151a20 msgr2=0x7fe7d40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:21.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7eb7fe640 1 --2- 172.21.15.88:0/1809731210 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7ec151a20 0x7fe7d40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:21.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7eb7fe640 1 -- 172.21.15.88:0/1809731210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7d4004d10 msgr2=0x7fe7d4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:21.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7eb7fe640 1 --2- 172.21.15.88:0/1809731210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7d4004d10 0x7fe7d4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:21.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.406+0000 7fe7eb7fe640 1 -- 172.21.15.88:0/1809731210 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d4003530 con 0x7fe7d4003980 2023-12-08T08:22:21.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.410+0000 7fe7eb7fe640 1 --2- 172.21.15.88:0/1809731210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7d4003980 0x7fe7d4003da0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc009ae0 tx=0x7fe7dc01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbcd5814fd74aa7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:21.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.410+0000 7fe7ea7fc640 1 -- 172.21.15.88:0/1809731210 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc0a5510 con 0x7fe7d4003980 2023-12-08T08:22:21.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.410+0000 7fe7ea7fc640 1 -- 172.21.15.88:0/1809731210 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7dc0a5670 con 0x7fe7d4003980 2023-12-08T08:22:21.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.410+0000 7fe7ea7fc640 1 -- 172.21.15.88:0/1809731210 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc0a5a20 con 0x7fe7d4003980 2023-12-08T08:22:21.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.410+0000 7fe7f1d01640 1 -- 172.21.15.88:0/1809731210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7d4003980 msgr2=0x7fe7d4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:21.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.410+0000 7fe7f1d01640 1 --2- 172.21.15.88:0/1809731210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7d4003980 0x7fe7d4003da0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc009ae0 tx=0x7fe7dc01ca50 comp rx=0 tx=0).stop 2023-12-08T08:22:21.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.410+0000 7fe7ebfff640 1 -- 172.21.15.88:0/1809731210 reap_dead start 2023-12-08T08:22:21.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.410+0000 7fe7f1d01640 1 -- 172.21.15.88:0/1809731210 shutdown_connections 2023-12-08T08:22:21.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.410+0000 7fe7f1d01640 1 -- 172.21.15.88:0/1809731210 >> 172.21.15.88:0/1809731210 conn(0x7fe7ec0c2e20 msgr2=0x7fe7ec0c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:21.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.410+0000 7fe7f1d01640 1 -- 172.21.15.88:0/1809731210 shutdown_connections 2023-12-08T08:22:21.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.410+0000 7fe7f1d01640 1 -- 172.21.15.88:0/1809731210 wait complete. 2023-12-08T08:22:21.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.414+0000 7fe7f1d01640 1 Processor -- start 2023-12-08T08:22:21.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.414+0000 7fe7f1d01640 1 -- start start 2023-12-08T08:22:21.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.414+0000 7fe7f1d01640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7d4003980 0x7fe7ec0c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:21.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.414+0000 7fe7f1d01640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7ec0c3f80 0x7fe7ec156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:21.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.414+0000 7fe7f1d01640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7ec0c44b0 0x7fe7ec156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:21.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.414+0000 7fe7f1d01640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ec1f0de0 con 0x7fe7ec0c3f80 2023-12-08T08:22:21.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.414+0000 7fe7f1d01640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ec156300 con 0x7fe7d4003980 2023-12-08T08:22:21.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.414+0000 7fe7f1d01640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ec1f1310 con 0x7fe7ec0c44b0 2023-12-08T08:22:21.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.414+0000 7fe7eaffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7ec0c3f80 0x7fe7ec156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:21.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.414+0000 7fe7eaffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7ec0c3f80 0x7fe7ec156790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48708/0 (socket says 172.21.15.88:48708) 2023-12-08T08:22:21.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.414+0000 7fe7eaffd640 1 -- 172.21.15.88:0/944855932 learned_addr learned my addr 172.21.15.88:0/944855932 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:21.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.414+0000 7fe7eb7fe640 1 --2- 172.21.15.88:0/944855932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7d4003980 0x7fe7ec0c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:21.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.414+0000 7fe7ebfff640 1 --2- 172.21.15.88:0/944855932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7ec0c44b0 0x7fe7ec156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:21.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.414+0000 7fe7eaffd640 1 -- 172.21.15.88:0/944855932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7ec0c44b0 msgr2=0x7fe7ec156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:21.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.414+0000 7fe7eaffd640 1 --2- 172.21.15.88:0/944855932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7ec0c44b0 0x7fe7ec156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:21.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.414+0000 7fe7eaffd640 1 -- 172.21.15.88:0/944855932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7d4003980 msgr2=0x7fe7ec0c4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:21.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.414+0000 7fe7eaffd640 1 --2- 172.21.15.88:0/944855932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7d4003980 0x7fe7ec0c4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:21.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.414+0000 7fe7eaffd640 1 -- 172.21.15.88:0/944855932 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ec0c5f60 con 0x7fe7ec0c3f80 2023-12-08T08:22:21.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.414+0000 7fe7eb7fe640 1 --2- 172.21.15.88:0/944855932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7d4003980 0x7fe7ec0c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:21.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.414+0000 7fe7eaffd640 1 --2- 172.21.15.88:0/944855932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7ec0c3f80 0x7fe7ec156790 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe7e000e7e0 tx=0x7fe7e000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:21.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.414+0000 7fe7d3fff640 1 -- 172.21.15.88:0/944855932 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e000c870 con 0x7fe7ec0c3f80 2023-12-08T08:22:21.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.414+0000 7fe7d3fff640 1 -- 172.21.15.88:0/944855932 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e000c9f0 con 0x7fe7ec0c3f80 2023-12-08T08:22:21.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.414+0000 7fe7d3fff640 1 -- 172.21.15.88:0/944855932 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e000cda0 con 0x7fe7ec0c3f80 2023-12-08T08:22:21.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.414+0000 7fe7f1d01640 1 -- 172.21.15.88:0/944855932 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7ec1f1030 con 0x7fe7ec0c3f80 2023-12-08T08:22:21.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.414+0000 7fe7f1d01640 1 -- 172.21.15.88:0/944855932 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7ec0c51c0 con 0x7fe7ec0c3f80 2023-12-08T08:22:21.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.418+0000 7fe7f1d01640 1 -- 172.21.15.88:0/944855932 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7ec066660 con 0x7fe7ec0c3f80 2023-12-08T08:22:21.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.418+0000 7fe7d3fff640 1 -- 172.21.15.88:0/944855932 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe7e001d460 con 0x7fe7ec0c3f80 2023-12-08T08:22:21.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.418+0000 7fe7d3fff640 1 --2- 172.21.15.88:0/944855932 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe7d8066470 0x7fe7d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:21.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.418+0000 7fe7d3fff640 1 -- 172.21.15.88:0/944855932 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe7e00841a0 con 0x7fe7ec0c3f80 2023-12-08T08:22:21.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.418+0000 7fe7eb7fe640 1 --2- 172.21.15.88:0/944855932 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe7d8066470 0x7fe7d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:21.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.418+0000 7fe7eb7fe640 1 --2- 172.21.15.88:0/944855932 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe7d8066470 0x7fe7d8068930 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc0af000 tx=0x7fe7dc0046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:21.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.422+0000 7fe7d3fff640 1 -- 172.21.15.88:0/944855932 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe7e00512b0 con 0x7fe7ec0c3f80 2023-12-08T08:22:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:21.614+0000 7fe7f1d01640 1 -- 172.21.15.88:0/944855932 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe7ec156470 con 0x7fe7ec0c3f80 2023-12-08T08:22:22.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.594+0000 7fe7d3fff640 1 -- 172.21.15.88:0/944855932 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v36) v1 ==== 119+0+0 (secure 0 0 0) 0x7fe7e00548d0 con 0x7fe7ec0c3f80 2023-12-08T08:22:22.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.598+0000 7fe7f1d01640 1 -- 172.21.15.88:0/944855932 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe7d8066470 msgr2=0x7fe7d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:22.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.598+0000 7fe7f1d01640 1 --2- 172.21.15.88:0/944855932 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe7d8066470 0x7fe7d8068930 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc0af000 tx=0x7fe7dc0046d0 comp rx=0 tx=0).stop 2023-12-08T08:22:22.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.598+0000 7fe7f1d01640 1 -- 172.21.15.88:0/944855932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7ec0c3f80 msgr2=0x7fe7ec156790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:22.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.598+0000 7fe7f1d01640 1 --2- 172.21.15.88:0/944855932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7ec0c3f80 0x7fe7ec156790 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe7e000e7e0 tx=0x7fe7e000eca0 comp rx=0 tx=0).stop 2023-12-08T08:22:22.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.598+0000 7fe7f1d01640 1 -- 172.21.15.88:0/944855932 shutdown_connections 2023-12-08T08:22:22.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.598+0000 7fe7f1d01640 1 --2- 172.21.15.88:0/944855932 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe7d8066470 0x7fe7d8068930 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:22.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.598+0000 7fe7f1d01640 1 --2- 172.21.15.88:0/944855932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7ec0c44b0 0x7fe7ec156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:22.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.598+0000 7fe7f1d01640 1 --2- 172.21.15.88:0/944855932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7ec0c3f80 0x7fe7ec156790 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:22.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.598+0000 7fe7f1d01640 1 --2- 172.21.15.88:0/944855932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7d4003980 0x7fe7ec0c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:22.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.598+0000 7fe7f1d01640 1 -- 172.21.15.88:0/944855932 >> 172.21.15.88:0/944855932 conn(0x7fe7ec0c2e20 msgr2=0x7fe7ec150da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:22.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.602+0000 7fe7f1d01640 1 -- 172.21.15.88:0/944855932 shutdown_connections 2023-12-08T08:22:22.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.602+0000 7fe7f1d01640 1 -- 172.21.15.88:0/944855932 wait complete. 2023-12-08T08:22:22.630 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-08T08:22:22.630 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-12-08T08:22:22.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe360c79640 1 Processor -- start 2023-12-08T08:22:22.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe360c79640 1 -- start start 2023-12-08T08:22:22.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe360c79640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe35c0c1ca0 0x7fe35c072200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:22.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe360c79640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe35c154ce0 con 0x7fe35c0bfdb0 2023-12-08T08:22:22.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe360c79640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe35c0c0240 con 0x7fe35c155170 2023-12-08T08:22:22.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe360c79640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe35c0c0520 con 0x7fe35c0c1ca0 2023-12-08T08:22:22.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe359d9b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe35c0bfdb0 0x7fe35c0c5ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46760/0 (socket says 172.21.15.88:46760) 2023-12-08T08:22:22.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe359d9b640 1 -- 172.21.15.88:0/564011777 learned_addr learned my addr 172.21.15.88:0/564011777 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:22.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe35a59c640 1 --2- 172.21.15.88:0/564011777 >> v2:172.21.15.148:3300/0 conn(0x7fe35c0c1ca0 0x7fe35c072200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:22.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe35959a640 1 -- 172.21.15.88:0/564011777 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1948171947 0 0) 0x7fe35c154ce0 con 0x7fe35c0bfdb0 2023-12-08T08:22:22.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe35959a640 1 -- 172.21.15.88:0/564011777 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe344003530 con 0x7fe35c0bfdb0 2023-12-08T08:22:22.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe35959a640 1 -- 172.21.15.88:0/564011777 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2211978475 0 0) 0x7fe344003530 con 0x7fe35c0bfdb0 2023-12-08T08:22:22.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe35959a640 1 -- 172.21.15.88:0/564011777 >> v2:172.21.15.148:3300/0 conn(0x7fe35c0c1ca0 msgr2=0x7fe35c072200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:22.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe35959a640 1 --2- 172.21.15.88:0/564011777 >> v2:172.21.15.148:3300/0 conn(0x7fe35c0c1ca0 0x7fe35c072200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:22.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe35959a640 1 -- 172.21.15.88:0/564011777 >> v1:172.21.15.148:6789/0 conn(0x7fe35c155170 legacy=0x7fe35c0c0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:22.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe35959a640 1 -- 172.21.15.88:0/564011777 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe35c154690 con 0x7fe35c0bfdb0 2023-12-08T08:22:22.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe35959a640 1 -- 172.21.15.88:0/564011777 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7fe350001680 con 0x7fe35c0bfdb0 2023-12-08T08:22:22.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe35959a640 1 -- 172.21.15.88:0/564011777 >> v1:172.21.15.88:6789/0 conn(0x7fe35c0bfdb0 legacy=0x7fe35c0c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:22.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe35959a640 1 --2- 172.21.15.88:0/564011777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe344003980 0x7fe344003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:22.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe35959a640 1 --2- 172.21.15.88:0/564011777 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe3440047d0 0x7fe344004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:22.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe35959a640 1 --2- 172.21.15.88:0/564011777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe344005190 0x7fe34400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:22.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe35959a640 1 -- 172.21.15.88:0/564011777 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c0c0520 con 0x7fe344005190 2023-12-08T08:22:22.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe35959a640 1 -- 172.21.15.88:0/564011777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34400c030 con 0x7fe344003980 2023-12-08T08:22:22.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe35959a640 1 -- 172.21.15.88:0/564011777 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe34400c1f0 con 0x7fe3440047d0 2023-12-08T08:22:22.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe35ad9d640 1 --2- 172.21.15.88:0/564011777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe344005190 0x7fe34400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:22.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe35a59c640 1 --2- 172.21.15.88:0/564011777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe344003980 0x7fe344003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:22.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe359d9b640 1 --2- 172.21.15.88:0/564011777 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe3440047d0 0x7fe344004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:22.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe35ad9d640 1 -- 172.21.15.88:0/564011777 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe3440047d0 msgr2=0x7fe344004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:22.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe35ad9d640 1 --2- 172.21.15.88:0/564011777 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe3440047d0 0x7fe344004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:22.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe35ad9d640 1 -- 172.21.15.88:0/564011777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe344003980 msgr2=0x7fe344003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:22.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe35ad9d640 1 --2- 172.21.15.88:0/564011777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe344003980 0x7fe344003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:22.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.770+0000 7fe35ad9d640 1 -- 172.21.15.88:0/564011777 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe344003530 con 0x7fe344005190 2023-12-08T08:22:22.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.774+0000 7fe35ad9d640 1 -- 172.21.15.88:0/564011777 reap_dead start 2023-12-08T08:22:22.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.774+0000 7fe35ad9d640 1 --2- 172.21.15.88:0/564011777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe344005190 0x7fe34400b990 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe354001e70 tx=0x7fe35401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb5ebf2a4539213c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:22.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.774+0000 7fe35959a640 1 -- 172.21.15.88:0/564011777 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354003b80 con 0x7fe344005190 2023-12-08T08:22:22.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.774+0000 7fe35959a640 1 -- 172.21.15.88:0/564011777 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe354003d00 con 0x7fe344005190 2023-12-08T08:22:22.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.774+0000 7fe35959a640 1 -- 172.21.15.88:0/564011777 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354005260 con 0x7fe344005190 2023-12-08T08:22:22.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.774+0000 7fe360c79640 1 -- 172.21.15.88:0/564011777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe344005190 msgr2=0x7fe34400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:22.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.774+0000 7fe360c79640 1 --2- 172.21.15.88:0/564011777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe344005190 0x7fe34400b990 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe354001e70 tx=0x7fe35401c760 comp rx=0 tx=0).stop 2023-12-08T08:22:22.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.774+0000 7fe360c79640 1 -- 172.21.15.88:0/564011777 shutdown_connections 2023-12-08T08:22:22.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.774+0000 7fe360c79640 1 --2- 172.21.15.88:0/564011777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe344005190 0x7fe34400b990 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:22.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.774+0000 7fe360c79640 1 -- 172.21.15.88:0/564011777 >> 172.21.15.88:0/564011777 conn(0x7fe35c06d2a0 msgr2=0x7fe35c06d680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:22.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.774+0000 7fe360c79640 1 -- 172.21.15.88:0/564011777 shutdown_connections 2023-12-08T08:22:22.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.774+0000 7fe360c79640 1 -- 172.21.15.88:0/564011777 wait complete. 2023-12-08T08:22:22.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.778+0000 7fe360c79640 1 Processor -- start 2023-12-08T08:22:22.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.778+0000 7fe360c79640 1 -- start start 2023-12-08T08:22:22.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.778+0000 7fe360c79640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe344005190 0x7fe35c1e6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:22.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.778+0000 7fe360c79640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe35c1e7470 0x7fe35c157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:22.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.778+0000 7fe360c79640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe35c14cbb0 0x7fe35c1ed080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:22.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.778+0000 7fe360c79640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c1439a0 con 0x7fe35c1e7470 2023-12-08T08:22:22.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.778+0000 7fe360c79640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c157400 con 0x7fe344005190 2023-12-08T08:22:22.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.778+0000 7fe360c79640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c14c520 con 0x7fe35c14cbb0 2023-12-08T08:22:22.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.778+0000 7fe359d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe35c1e7470 0x7fe35c157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:22.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.778+0000 7fe359d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe35c1e7470 0x7fe35c157890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48720/0 (socket says 172.21.15.88:48720) 2023-12-08T08:22:22.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.778+0000 7fe359d9b640 1 -- 172.21.15.88:0/413693346 learned_addr learned my addr 172.21.15.88:0/413693346 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:22.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.778+0000 7fe35a59c640 1 --2- 172.21.15.88:0/413693346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe344005190 0x7fe35c1e6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:22.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.778+0000 7fe35ad9d640 1 --2- 172.21.15.88:0/413693346 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe35c14cbb0 0x7fe35c1ed080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:22.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.778+0000 7fe359d9b640 1 -- 172.21.15.88:0/413693346 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe35c14cbb0 msgr2=0x7fe35c1ed080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:22.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.778+0000 7fe359d9b640 1 --2- 172.21.15.88:0/413693346 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe35c14cbb0 0x7fe35c1ed080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:22.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.778+0000 7fe359d9b640 1 -- 172.21.15.88:0/413693346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe344005190 msgr2=0x7fe35c1e6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:22.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.778+0000 7fe359d9b640 1 --2- 172.21.15.88:0/413693346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe344005190 0x7fe35c1e6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:22.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.778+0000 7fe359d9b640 1 -- 172.21.15.88:0/413693346 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe35c14f7b0 con 0x7fe35c1e7470 2023-12-08T08:22:22.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.778+0000 7fe359d9b640 1 --2- 172.21.15.88:0/413693346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe35c1e7470 0x7fe35c157890 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe35000e780 tx=0x7fe35000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:22.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.778+0000 7fe34affd640 1 -- 172.21.15.88:0/413693346 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35000c660 con 0x7fe35c1e7470 2023-12-08T08:22:22.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.778+0000 7fe34affd640 1 -- 172.21.15.88:0/413693346 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35000c7c0 con 0x7fe35c1e7470 2023-12-08T08:22:22.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.778+0000 7fe360c79640 1 -- 172.21.15.88:0/413693346 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe35c14f1f0 con 0x7fe35c1e7470 2023-12-08T08:22:22.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.778+0000 7fe34affd640 1 -- 172.21.15.88:0/413693346 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35000cbb0 con 0x7fe35c1e7470 2023-12-08T08:22:22.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.778+0000 7fe360c79640 1 -- 172.21.15.88:0/413693346 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe35c1583b0 con 0x7fe35c1e7470 2023-12-08T08:22:22.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.782+0000 7fe360c79640 1 -- 172.21.15.88:0/413693346 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe35c067630 con 0x7fe35c1e7470 2023-12-08T08:22:22.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.782+0000 7fe34affd640 1 -- 172.21.15.88:0/413693346 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe35000cd10 con 0x7fe35c1e7470 2023-12-08T08:22:22.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.782+0000 7fe34affd640 1 --2- 172.21.15.88:0/413693346 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe33c066470 0x7fe33c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:22.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.782+0000 7fe34affd640 1 -- 172.21.15.88:0/413693346 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe350083fc0 con 0x7fe35c1e7470 2023-12-08T08:22:22.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.782+0000 7fe35a59c640 1 --2- 172.21.15.88:0/413693346 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe33c066470 0x7fe33c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:22.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.782+0000 7fe35a59c640 1 --2- 172.21.15.88:0/413693346 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe33c066470 0x7fe33c068930 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe34c009b60 tx=0x7fe34c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:22.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.786+0000 7fe34affd640 1 -- 172.21.15.88:0/413693346 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe350051040 con 0x7fe35c1e7470 2023-12-08T08:22:22.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:22.970+0000 7fe360c79640 1 -- 172.21.15.88:0/413693346 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe35c0c6750 con 0x7fe35c1e7470 2023-12-08T08:22:23.038 INFO:tasks.ceph.mds.d.smithi148.stderr:2023-12-08T08:22:23.037+0000 7f5c8bbda640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:22:23.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.610+0000 7fe34affd640 1 -- 172.21.15.88:0/413693346 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v37) v1 ==== 123+0+0 (secure 0 0 0) 0x7fe350054660 con 0x7fe35c1e7470 2023-12-08T08:22:23.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.610+0000 7fe360c79640 1 -- 172.21.15.88:0/413693346 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe33c066470 msgr2=0x7fe33c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:23.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.610+0000 7fe360c79640 1 --2- 172.21.15.88:0/413693346 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe33c066470 0x7fe33c068930 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe34c009b60 tx=0x7fe34c009190 comp rx=0 tx=0).stop 2023-12-08T08:22:23.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.610+0000 7fe360c79640 1 -- 172.21.15.88:0/413693346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe35c1e7470 msgr2=0x7fe35c157890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:23.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.610+0000 7fe360c79640 1 --2- 172.21.15.88:0/413693346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe35c1e7470 0x7fe35c157890 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe35000e780 tx=0x7fe35000eb80 comp rx=0 tx=0).stop 2023-12-08T08:22:23.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.610+0000 7fe360c79640 1 -- 172.21.15.88:0/413693346 shutdown_connections 2023-12-08T08:22:23.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.610+0000 7fe360c79640 1 --2- 172.21.15.88:0/413693346 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe33c066470 0x7fe33c068930 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:23.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.610+0000 7fe360c79640 1 --2- 172.21.15.88:0/413693346 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe35c14cbb0 0x7fe35c1ed080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:23.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.610+0000 7fe360c79640 1 --2- 172.21.15.88:0/413693346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe35c1e7470 0x7fe35c157890 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:23.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.610+0000 7fe360c79640 1 --2- 172.21.15.88:0/413693346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe344005190 0x7fe35c1e6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:23.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.610+0000 7fe360c79640 1 -- 172.21.15.88:0/413693346 >> 172.21.15.88:0/413693346 conn(0x7fe35c06d2a0 msgr2=0x7fe35c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:23.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.610+0000 7fe360c79640 1 -- 172.21.15.88:0/413693346 shutdown_connections 2023-12-08T08:22:23.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.610+0000 7fe360c79640 1 -- 172.21.15.88:0/413693346 wait complete. 2023-12-08T08:22:23.635 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-12-08T08:22:23.636 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:22:23.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.766+0000 7fa5de446640 1 Processor -- start 2023-12-08T08:22:23.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.766+0000 7fa5de446640 1 -- start start 2023-12-08T08:22:23.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.770+0000 7fa5de446640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa5d814fd10 0x7fa5d80a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:23.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.770+0000 7fa5de446640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5d8156110 0x7fa5d81565c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:23.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.770+0000 7fa5de446640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d80c5710 con 0x7fa5d80a5300 2023-12-08T08:22:23.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.770+0000 7fa5de446640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d806c5e0 con 0x7fa5d814fd10 2023-12-08T08:22:23.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.770+0000 7fa5de446640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d8155c80 con 0x7fa5d8156110 2023-12-08T08:22:23.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.770+0000 7fa5dc9e3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5d8156110 0x7fa5d81565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:23.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.770+0000 7fa5d7fff640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa5d814fd10 0x7fa5d80a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:23.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.770+0000 7fa5d7fff640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa5d814fd10 0x7fa5d80a4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:45874/0 (socket says 172.21.15.88:45874) 2023-12-08T08:22:23.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.770+0000 7fa5d7fff640 1 -- 172.21.15.88:0/2942274069 learned_addr learned my addr 172.21.15.88:0/2942274069 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:23.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.770+0000 7fa5d7fff640 1 -- 172.21.15.88:0/2942274069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5d8156110 msgr2=0x7fa5d81565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:23.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.770+0000 7fa5d7fff640 1 --2- 172.21.15.88:0/2942274069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5d8156110 0x7fa5d81565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:23.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.770+0000 7fa5d7fff640 1 -- 172.21.15.88:0/2942274069 >> v1:172.21.15.148:6789/0 conn(0x7fa5d80a5300 legacy=0x7fa5d8071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:23.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.770+0000 7fa5d7fff640 1 -- 172.21.15.88:0/2942274069 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d80c4e70 con 0x7fa5d814fd10 2023-12-08T08:22:23.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.770+0000 7fa5d6ffd640 1 -- 172.21.15.88:0/2942274069 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895709704 0 0) 0x7fa5d80c5710 con 0x7fa5d80a5300 2023-12-08T08:22:23.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.774+0000 7fa5d7fff640 1 --2- 172.21.15.88:0/2942274069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5d814fd10 0x7fa5d80a4dc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8009870 tx=0x7fa5c801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a529c2e21ceb6a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:23.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.774+0000 7fa5d6ffd640 1 -- 172.21.15.88:0/2942274069 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c80ab5f0 con 0x7fa5d814fd10 2023-12-08T08:22:23.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.774+0000 7fa5d6ffd640 1 -- 172.21.15.88:0/2942274069 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c80ab750 con 0x7fa5d814fd10 2023-12-08T08:22:23.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.774+0000 7fa5d6ffd640 1 -- 172.21.15.88:0/2942274069 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c80abae0 con 0x7fa5d814fd10 2023-12-08T08:22:23.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.774+0000 7fa5de446640 1 -- 172.21.15.88:0/2942274069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5d814fd10 msgr2=0x7fa5d80a4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:23.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.774+0000 7fa5de446640 1 --2- 172.21.15.88:0/2942274069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5d814fd10 0x7fa5d80a4dc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8009870 tx=0x7fa5c801c3f0 comp rx=0 tx=0).stop 2023-12-08T08:22:23.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.774+0000 7fa5de446640 1 -- 172.21.15.88:0/2942274069 shutdown_connections 2023-12-08T08:22:23.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.774+0000 7fa5de446640 1 --2- 172.21.15.88:0/2942274069 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5d8156110 0x7fa5d81565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:23.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.774+0000 7fa5de446640 1 --2- 172.21.15.88:0/2942274069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5d814fd10 0x7fa5d80a4dc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:23.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.774+0000 7fa5de446640 1 -- 172.21.15.88:0/2942274069 >> 172.21.15.88:0/2942274069 conn(0x7fa5d80a7810 msgr2=0x7fa5d80a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:23.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.774+0000 7fa5de446640 1 -- 172.21.15.88:0/2942274069 shutdown_connections 2023-12-08T08:22:23.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.774+0000 7fa5de446640 1 -- 172.21.15.88:0/2942274069 wait complete. 2023-12-08T08:22:23.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.774+0000 7fa5de446640 1 Processor -- start 2023-12-08T08:22:23.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.774+0000 7fa5de446640 1 -- start start 2023-12-08T08:22:23.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.774+0000 7fa5de446640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5d80a5300 0x7fa5d8146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:23.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.778+0000 7fa5de446640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5d814fd10 0x7fa5d80bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:23.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.778+0000 7fa5de446640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5d8156110 0x7fa5d813dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:23.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.778+0000 7fa5de446640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d8147070 con 0x7fa5d814fd10 2023-12-08T08:22:23.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.778+0000 7fa5de446640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d813d8a0 con 0x7fa5d80a5300 2023-12-08T08:22:23.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.778+0000 7fa5de446640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d81477b0 con 0x7fa5d8156110 2023-12-08T08:22:23.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.778+0000 7fa5d77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5d814fd10 0x7fa5d80bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:23.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.778+0000 7fa5d77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5d814fd10 0x7fa5d80bf0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48726/0 (socket says 172.21.15.88:48726) 2023-12-08T08:22:23.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.778+0000 7fa5d77fe640 1 -- 172.21.15.88:0/3443703008 learned_addr learned my addr 172.21.15.88:0/3443703008 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:23.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.778+0000 7fa5d7fff640 1 --2- 172.21.15.88:0/3443703008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5d80a5300 0x7fa5d8146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:23.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.778+0000 7fa5dc9e3640 1 --2- 172.21.15.88:0/3443703008 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5d8156110 0x7fa5d813dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:23.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.778+0000 7fa5d77fe640 1 -- 172.21.15.88:0/3443703008 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5d8156110 msgr2=0x7fa5d813dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:23.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.778+0000 7fa5d77fe640 1 --2- 172.21.15.88:0/3443703008 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5d8156110 0x7fa5d813dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:23.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.778+0000 7fa5d77fe640 1 -- 172.21.15.88:0/3443703008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5d80a5300 msgr2=0x7fa5d8146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:23.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.778+0000 7fa5d77fe640 1 --2- 172.21.15.88:0/3443703008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5d80a5300 0x7fa5d8146b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:23.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.778+0000 7fa5d77fe640 1 -- 172.21.15.88:0/3443703008 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c80094d0 con 0x7fa5d814fd10 2023-12-08T08:22:23.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.778+0000 7fa5d77fe640 1 --2- 172.21.15.88:0/3443703008 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5d814fd10 0x7fa5d80bf0f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc00c520 tx=0x7fa5cc00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:23.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.778+0000 7fa5d4ff9640 1 -- 172.21.15.88:0/3443703008 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc003600 con 0x7fa5d814fd10 2023-12-08T08:22:23.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.778+0000 7fa5d4ff9640 1 -- 172.21.15.88:0/3443703008 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5cc003780 con 0x7fa5d814fd10 2023-12-08T08:22:23.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.778+0000 7fa5de446640 1 -- 172.21.15.88:0/3443703008 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d8147a90 con 0x7fa5d814fd10 2023-12-08T08:22:23.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.778+0000 7fa5d4ff9640 1 -- 172.21.15.88:0/3443703008 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc003b30 con 0x7fa5d814fd10 2023-12-08T08:22:23.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.778+0000 7fa5de446640 1 -- 172.21.15.88:0/3443703008 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d814c290 con 0x7fa5d814fd10 2023-12-08T08:22:23.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.778+0000 7fa5de446640 1 -- 172.21.15.88:0/3443703008 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d8147cd0 con 0x7fa5d814fd10 2023-12-08T08:22:23.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.778+0000 7fa5d4ff9640 1 -- 172.21.15.88:0/3443703008 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa5cc003c90 con 0x7fa5d814fd10 2023-12-08T08:22:23.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.782+0000 7fa5d4ff9640 1 --2- 172.21.15.88:0/3443703008 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa5c40664a0 0x7fa5c4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:23.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.782+0000 7fa5d4ff9640 1 -- 172.21.15.88:0/3443703008 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa5cc083690 con 0x7fa5d814fd10 2023-12-08T08:22:23.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.782+0000 7fa5d7fff640 1 --2- 172.21.15.88:0/3443703008 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa5c40664a0 0x7fa5c4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:23.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.782+0000 7fa5d7fff640 1 --2- 172.21.15.88:0/3443703008 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa5c40664a0 0x7fa5c4068960 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa5c80af000 tx=0x7fa5c80b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:23.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.786+0000 7fa5d4ff9640 1 -- 172.21.15.88:0/3443703008 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa5d8147cd0 con 0x7fa5d814fd10 2023-12-08T08:22:23.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.962+0000 7fa5de446640 1 -- 172.21.15.88:0/3443703008 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5d813d390 con 0x7fa5d814fd10 2023-12-08T08:22:23.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.962+0000 7fa5d4ff9640 1 -- 172.21.15.88:0/3443703008 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6135 (secure 0 0 0) 0x7fa5d813d390 con 0x7fa5d814fd10 2023-12-08T08:22:23.969 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:23.969 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5240,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/2576328340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2576328340},{"type":"v1","addr":"172.21.15.148:6834","nonce":2576328340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5626,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/1685449423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1685449423},{"type":"v1","addr":"172.21.15.88:6836","nonce":1685449423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:22:02.420431+0000","modified":"2023-12-08T08:22:05.454472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5793},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5793":{"gid":5793,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/4167133153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":4167133153},{"type":"v1","addr":"172.21.15.88:6837","nonce":4167133153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:22:19.959416+0000","modified":"2023-12-08T08:22:22.972913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5635},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5635":{"gid":5635,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":7,"addr":"172.21.15.148:6835/604820378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":604820378},{"type":"v1","addr":"172.21.15.148:6835","nonce":604820378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-08T08:22:23.969 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 37 2023-12-08T08:22:23.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.966+0000 7fa5de446640 1 -- 172.21.15.88:0/3443703008 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa5c40664a0 msgr2=0x7fa5c4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:23.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.966+0000 7fa5de446640 1 --2- 172.21.15.88:0/3443703008 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa5c40664a0 0x7fa5c4068960 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa5c80af000 tx=0x7fa5c80b6040 comp rx=0 tx=0).stop 2023-12-08T08:22:23.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.966+0000 7fa5de446640 1 -- 172.21.15.88:0/3443703008 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5d814fd10 msgr2=0x7fa5d80bf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:23.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.966+0000 7fa5de446640 1 --2- 172.21.15.88:0/3443703008 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5d814fd10 0x7fa5d80bf0f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc00c520 tx=0x7fa5cc00c9e0 comp rx=0 tx=0).stop 2023-12-08T08:22:23.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.966+0000 7fa5de446640 1 -- 172.21.15.88:0/3443703008 shutdown_connections 2023-12-08T08:22:23.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.966+0000 7fa5de446640 1 --2- 172.21.15.88:0/3443703008 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa5c40664a0 0x7fa5c4068960 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:23.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.966+0000 7fa5de446640 1 --2- 172.21.15.88:0/3443703008 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa5d8156110 0x7fa5d813dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:23.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.966+0000 7fa5de446640 1 --2- 172.21.15.88:0/3443703008 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5d814fd10 0x7fa5d80bf0f0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:23.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.966+0000 7fa5de446640 1 --2- 172.21.15.88:0/3443703008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5d80a5300 0x7fa5d8146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:23.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.966+0000 7fa5de446640 1 -- 172.21.15.88:0/3443703008 >> 172.21.15.88:0/3443703008 conn(0x7fa5d80a7810 msgr2=0x7fa5d80c0540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:23.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.966+0000 7fa5de446640 1 -- 172.21.15.88:0/3443703008 shutdown_connections 2023-12-08T08:22:23.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:23.966+0000 7fa5de446640 1 -- 172.21.15.88:0/3443703008 wait complete. 2023-12-08T08:22:23.990 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:22:24.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.122+0000 7f576f45a640 1 Processor -- start 2023-12-08T08:22:24.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.122+0000 7f576f45a640 1 -- start start 2023-12-08T08:22:24.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.122+0000 7f576f45a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f57680af4c0 0x7f5768154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:24.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.122+0000 7f576f45a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f576806c100 0x7f57680c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:24.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.122+0000 7f576f45a640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57680c4890 con 0x7f57680c67d0 2023-12-08T08:22:24.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.122+0000 7f576f45a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5768155460 con 0x7f57680af4c0 2023-12-08T08:22:24.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.122+0000 7f576f45a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57680af8a0 con 0x7f576806c100 2023-12-08T08:22:24.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.122+0000 7f576d1f6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f57680af4c0 0x7f5768154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:24.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.122+0000 7f576d1f6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f57680af4c0 0x7f5768154f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48736/0 (socket says 172.21.15.88:48736) 2023-12-08T08:22:24.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.122+0000 7f576d1f6640 1 -- 172.21.15.88:0/2201856526 learned_addr learned my addr 172.21.15.88:0/2201856526 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:24.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.122+0000 7f576d1f6640 1 -- 172.21.15.88:0/2201856526 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f576806c100 msgr2=0x7f57680c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:24.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.122+0000 7f576d9f7640 1 --2- 172.21.15.88:0/2201856526 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f576806c100 0x7f57680c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:24.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.122+0000 7f576d1f6640 1 --2- 172.21.15.88:0/2201856526 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f576806c100 0x7f57680c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:24.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.122+0000 7f576d1f6640 1 -- 172.21.15.88:0/2201856526 >> v1:172.21.15.148:6789/0 conn(0x7f57680c67d0 legacy=0x7f576806b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:24.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.122+0000 7f576d1f6640 1 -- 172.21.15.88:0/2201856526 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57680c4b30 con 0x7f57680af4c0 2023-12-08T08:22:24.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.122+0000 7f576d9f7640 1 --2- 172.21.15.88:0/2201856526 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f576806c100 0x7f57680c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:24.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.126+0000 7f576d1f6640 1 --2- 172.21.15.88:0/2201856526 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57680af4c0 0x7f5768154f20 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f5764009870 tx=0x7f576401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e57f75d31026c589 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:24.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.126+0000 7f575ffff640 1 -- 172.21.15.88:0/2201856526 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57640ab600 con 0x7f57680af4c0 2023-12-08T08:22:24.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.126+0000 7f575ffff640 1 -- 172.21.15.88:0/2201856526 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57640ab760 con 0x7f57680af4c0 2023-12-08T08:22:24.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.126+0000 7f575ffff640 1 -- 172.21.15.88:0/2201856526 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57640abaf0 con 0x7f57680af4c0 2023-12-08T08:22:24.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.126+0000 7f576f45a640 1 -- 172.21.15.88:0/2201856526 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57680af4c0 msgr2=0x7f5768154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:24.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.126+0000 7f576f45a640 1 --2- 172.21.15.88:0/2201856526 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57680af4c0 0x7f5768154f20 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f5764009870 tx=0x7f576401c440 comp rx=0 tx=0).stop 2023-12-08T08:22:24.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.126+0000 7f576f45a640 1 -- 172.21.15.88:0/2201856526 shutdown_connections 2023-12-08T08:22:24.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.126+0000 7f576f45a640 1 --2- 172.21.15.88:0/2201856526 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f576806c100 0x7f57680c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:24.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.126+0000 7f576f45a640 1 --2- 172.21.15.88:0/2201856526 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57680af4c0 0x7f5768154f20 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:24.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.126+0000 7f576f45a640 1 -- 172.21.15.88:0/2201856526 >> 172.21.15.88:0/2201856526 conn(0x7f57680ab9d0 msgr2=0x7f57680abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:24.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.126+0000 7f576f45a640 1 -- 172.21.15.88:0/2201856526 shutdown_connections 2023-12-08T08:22:24.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.126+0000 7f576f45a640 1 -- 172.21.15.88:0/2201856526 wait complete. 2023-12-08T08:22:24.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.130+0000 7f576f45a640 1 Processor -- start 2023-12-08T08:22:24.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.130+0000 7f576f45a640 1 -- start start 2023-12-08T08:22:24.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.130+0000 7f576f45a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f576806c100 0x7f5768153fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:24.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.130+0000 7f576f45a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57680af4c0 0x7f5768152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:24.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.130+0000 7f576f45a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57680c67d0 0x7f57680c3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:24.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.130+0000 7f576f45a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5768159570 con 0x7f576806c100 2023-12-08T08:22:24.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.130+0000 7f576f45a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5768154870 con 0x7f57680c67d0 2023-12-08T08:22:24.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.130+0000 7f576f45a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5768154590 con 0x7f57680af4c0 2023-12-08T08:22:24.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.130+0000 7f576d1f6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f576806c100 0x7f5768153fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:24.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.130+0000 7f576d1f6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f576806c100 0x7f5768153fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48746/0 (socket says 172.21.15.88:48746) 2023-12-08T08:22:24.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.130+0000 7f576d1f6640 1 -- 172.21.15.88:0/428236887 learned_addr learned my addr 172.21.15.88:0/428236887 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:24.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.130+0000 7f576d9f7640 1 --2- 172.21.15.88:0/428236887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57680c67d0 0x7f57680c3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:24.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.130+0000 7f576c9f5640 1 --2- 172.21.15.88:0/428236887 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57680af4c0 0x7f5768152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:24.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.130+0000 7f576d1f6640 1 -- 172.21.15.88:0/428236887 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57680af4c0 msgr2=0x7f5768152db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:24.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.130+0000 7f576d1f6640 1 --2- 172.21.15.88:0/428236887 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57680af4c0 0x7f5768152db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:24.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.130+0000 7f576d1f6640 1 -- 172.21.15.88:0/428236887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57680c67d0 msgr2=0x7f57680c3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:24.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.130+0000 7f576d1f6640 1 --2- 172.21.15.88:0/428236887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57680c67d0 0x7f57680c3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:24.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.130+0000 7f576d1f6640 1 -- 172.21.15.88:0/428236887 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57640094d0 con 0x7f576806c100 2023-12-08T08:22:24.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.130+0000 7f576d9f7640 1 --2- 172.21.15.88:0/428236887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57680c67d0 0x7f57680c3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:24.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.130+0000 7f576c9f5640 1 --2- 172.21.15.88:0/428236887 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57680af4c0 0x7f5768152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:24.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.130+0000 7f576d1f6640 1 --2- 172.21.15.88:0/428236887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f576806c100 0x7f5768153fb0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f57640ad040 tx=0x7f576401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:24.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.130+0000 7f575dffb640 1 -- 172.21.15.88:0/428236887 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57640b4800 con 0x7f576806c100 2023-12-08T08:22:24.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.130+0000 7f575dffb640 1 -- 172.21.15.88:0/428236887 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57640b4980 con 0x7f576806c100 2023-12-08T08:22:24.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.130+0000 7f575dffb640 1 -- 172.21.15.88:0/428236887 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57640b4d30 con 0x7f576806c100 2023-12-08T08:22:24.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.130+0000 7f576f45a640 1 -- 172.21.15.88:0/428236887 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5768158f20 con 0x7f576806c100 2023-12-08T08:22:24.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.130+0000 7f576f45a640 1 -- 172.21.15.88:0/428236887 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57681532f0 con 0x7f576806c100 2023-12-08T08:22:24.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.134+0000 7f576f45a640 1 -- 172.21.15.88:0/428236887 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5768067630 con 0x7f576806c100 2023-12-08T08:22:24.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.134+0000 7f575dffb640 1 -- 172.21.15.88:0/428236887 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f57640c7440 con 0x7f576806c100 2023-12-08T08:22:24.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.134+0000 7f575dffb640 1 --2- 172.21.15.88:0/428236887 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f574c066470 0x7f574c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:24.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.134+0000 7f575dffb640 1 -- 172.21.15.88:0/428236887 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f576411edb0 con 0x7f576806c100 2023-12-08T08:22:24.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.134+0000 7f576c9f5640 1 --2- 172.21.15.88:0/428236887 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f574c066470 0x7f574c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:24.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.134+0000 7f576c9f5640 1 --2- 172.21.15.88:0/428236887 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f574c066470 0x7f574c068930 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f57680c42a0 tx=0x7f5758009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:24.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.138+0000 7f575dffb640 1 -- 172.21.15.88:0/428236887 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5764123070 con 0x7f576806c100 2023-12-08T08:22:24.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.286+0000 7f576f45a640 1 -- 172.21.15.88:0/428236887 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f576806c7a0 con 0x7f576806c100 2023-12-08T08:22:24.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.290+0000 7f575dffb640 1 -- 172.21.15.88:0/428236887 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20256 (secure 0 0 0) 0x7f57640ef950 con 0x7f576806c100 2023-12-08T08:22:24.295 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:24.295 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":54,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:22:21.530364+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:00.520254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:01.423493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:22:17.787562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:22:18.955273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:22:24.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.290+0000 7f576f45a640 1 -- 172.21.15.88:0/428236887 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f574c066470 msgr2=0x7f574c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:24.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.290+0000 7f576f45a640 1 --2- 172.21.15.88:0/428236887 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f574c066470 0x7f574c068930 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f57680c42a0 tx=0x7f5758009040 comp rx=0 tx=0).stop 2023-12-08T08:22:24.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.290+0000 7f576f45a640 1 -- 172.21.15.88:0/428236887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f576806c100 msgr2=0x7f5768153fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:24.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.290+0000 7f576f45a640 1 --2- 172.21.15.88:0/428236887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f576806c100 0x7f5768153fb0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f57640ad040 tx=0x7f576401ac80 comp rx=0 tx=0).stop 2023-12-08T08:22:24.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.290+0000 7f576f45a640 1 -- 172.21.15.88:0/428236887 shutdown_connections 2023-12-08T08:22:24.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.290+0000 7f576f45a640 1 --2- 172.21.15.88:0/428236887 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f574c066470 0x7f574c068930 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:24.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.290+0000 7f576f45a640 1 --2- 172.21.15.88:0/428236887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57680c67d0 0x7f57680c3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:24.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.290+0000 7f576f45a640 1 --2- 172.21.15.88:0/428236887 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f57680af4c0 0x7f5768152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:24.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.290+0000 7f576f45a640 1 --2- 172.21.15.88:0/428236887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f576806c100 0x7f5768153fb0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:24.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.290+0000 7f576f45a640 1 -- 172.21.15.88:0/428236887 >> 172.21.15.88:0/428236887 conn(0x7f57680ab9d0 msgr2=0x7f57680c9570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:24.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.290+0000 7f576f45a640 1 -- 172.21.15.88:0/428236887 shutdown_connections 2023-12-08T08:22:24.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.290+0000 7f576f45a640 1 -- 172.21.15.88:0/428236887 wait complete. 2023-12-08T08:22:24.316 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-08T08:22:24.316 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:22:24.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.450+0000 7fe310357640 1 Processor -- start 2023-12-08T08:22:24.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.450+0000 7fe310357640 1 -- start start 2023-12-08T08:22:24.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.450+0000 7fe310357640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe308071e30 0x7fe3080722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:24.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.450+0000 7fe310357640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe308156110 0x7fe3081565a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:24.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.450+0000 7fe310357640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3080c5710 con 0x7fe30814fd10 2023-12-08T08:22:24.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.450+0000 7fe310357640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe30806c5e0 con 0x7fe308071e30 2023-12-08T08:22:24.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.450+0000 7fe310357640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe308155c80 con 0x7fe308156110 2023-12-08T08:22:24.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.450+0000 7fe30d8f2640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe308071e30 0x7fe3080722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:24.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.450+0000 7fe30e8f4640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe308156110 0x7fe3081565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:24.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.450+0000 7fe30d8f2640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe308071e30 0x7fe3080722c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:45898/0 (socket says 172.21.15.88:45898) 2023-12-08T08:22:24.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.450+0000 7fe30d8f2640 1 -- 172.21.15.88:0/4081010122 learned_addr learned my addr 172.21.15.88:0/4081010122 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:24.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.450+0000 7fe30e0f3640 1 --1- 172.21.15.88:0/4081010122 >> v1:172.21.15.148:6789/0 conn(0x7fe30814fd10 0x7fe3080a4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:42130/0 (socket says 172.21.15.88:42130) 2023-12-08T08:22:24.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.450+0000 7fe30d8f2640 1 -- 172.21.15.88:0/4081010122 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe308156110 msgr2=0x7fe3081565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:24.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.450+0000 7fe30d8f2640 1 --2- 172.21.15.88:0/4081010122 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe308156110 0x7fe3081565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:24.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.450+0000 7fe30d8f2640 1 -- 172.21.15.88:0/4081010122 >> v1:172.21.15.148:6789/0 conn(0x7fe30814fd10 legacy=0x7fe3080a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:24.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.450+0000 7fe30d8f2640 1 -- 172.21.15.88:0/4081010122 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3080c4e70 con 0x7fe308071e30 2023-12-08T08:22:24.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.454+0000 7fe30d8f2640 1 --2- 172.21.15.88:0/4081010122 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe308071e30 0x7fe3080722c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8009870 tx=0x7fe2f801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b096cd0fb688f74e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:24.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.454+0000 7fe30d0f1640 1 -- 172.21.15.88:0/4081010122 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f80ab5f0 con 0x7fe308071e30 2023-12-08T08:22:24.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.454+0000 7fe30d0f1640 1 -- 172.21.15.88:0/4081010122 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f80ab750 con 0x7fe308071e30 2023-12-08T08:22:24.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.454+0000 7fe30d0f1640 1 -- 172.21.15.88:0/4081010122 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f80abae0 con 0x7fe308071e30 2023-12-08T08:22:24.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.454+0000 7fe310357640 1 -- 172.21.15.88:0/4081010122 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe308071e30 msgr2=0x7fe3080722c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:24.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.454+0000 7fe310357640 1 --2- 172.21.15.88:0/4081010122 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe308071e30 0x7fe3080722c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8009870 tx=0x7fe2f801c3f0 comp rx=0 tx=0).stop 2023-12-08T08:22:24.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.454+0000 7fe310357640 1 -- 172.21.15.88:0/4081010122 shutdown_connections 2023-12-08T08:22:24.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.454+0000 7fe310357640 1 --2- 172.21.15.88:0/4081010122 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe308156110 0x7fe3081565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:24.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.454+0000 7fe310357640 1 --2- 172.21.15.88:0/4081010122 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe308071e30 0x7fe3080722c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:24.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.454+0000 7fe310357640 1 -- 172.21.15.88:0/4081010122 >> 172.21.15.88:0/4081010122 conn(0x7fe3080a7810 msgr2=0x7fe3080a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:24.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.454+0000 7fe310357640 1 -- 172.21.15.88:0/4081010122 shutdown_connections 2023-12-08T08:22:24.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.454+0000 7fe310357640 1 -- 172.21.15.88:0/4081010122 wait complete. 2023-12-08T08:22:24.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.458+0000 7fe310357640 1 Processor -- start 2023-12-08T08:22:24.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.458+0000 7fe310357640 1 -- start start 2023-12-08T08:22:24.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.458+0000 7fe310357640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe308071e30 0x7fe3080ab360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:24.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.458+0000 7fe310357640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe30814fd10 0x7fe30814b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:24.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.458+0000 7fe310357640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe308156110 0x7fe3080704c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:24.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.458+0000 7fe310357640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3081511e0 con 0x7fe308156110 2023-12-08T08:22:24.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.458+0000 7fe310357640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe308152fc0 con 0x7fe308071e30 2023-12-08T08:22:24.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.458+0000 7fe310357640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe308152ce0 con 0x7fe30814fd10 2023-12-08T08:22:24.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.458+0000 7fe30e8f4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe308156110 0x7fe3080704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:24.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.458+0000 7fe30e8f4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe308156110 0x7fe3080704c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48752/0 (socket says 172.21.15.88:48752) 2023-12-08T08:22:24.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.458+0000 7fe30e8f4640 1 -- 172.21.15.88:0/3872650288 learned_addr learned my addr 172.21.15.88:0/3872650288 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:24.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.458+0000 7fe30e0f3640 1 --2- 172.21.15.88:0/3872650288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe308071e30 0x7fe3080ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:24.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.458+0000 7fe30d8f2640 1 --2- 172.21.15.88:0/3872650288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe30814fd10 0x7fe30814b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:24.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.458+0000 7fe30e8f4640 1 -- 172.21.15.88:0/3872650288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe30814fd10 msgr2=0x7fe30814b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:24.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.458+0000 7fe30e8f4640 1 --2- 172.21.15.88:0/3872650288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe30814fd10 0x7fe30814b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:24.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.458+0000 7fe30e8f4640 1 -- 172.21.15.88:0/3872650288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe308071e30 msgr2=0x7fe3080ab360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:24.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.458+0000 7fe30e8f4640 1 --2- 172.21.15.88:0/3872650288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe308071e30 0x7fe3080ab360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:24.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.458+0000 7fe30e8f4640 1 -- 172.21.15.88:0/3872650288 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f80094d0 con 0x7fe308156110 2023-12-08T08:22:24.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.458+0000 7fe30e8f4640 1 --2- 172.21.15.88:0/3872650288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe308156110 0x7fe3080704c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe300009d20 tx=0x7fe30000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:24.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.458+0000 7fe2feffd640 1 -- 172.21.15.88:0/3872650288 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30000ced0 con 0x7fe308156110 2023-12-08T08:22:24.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.458+0000 7fe2feffd640 1 -- 172.21.15.88:0/3872650288 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30000f040 con 0x7fe308156110 2023-12-08T08:22:24.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.458+0000 7fe2feffd640 1 -- 172.21.15.88:0/3872650288 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3000146c0 con 0x7fe308156110 2023-12-08T08:22:24.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.458+0000 7fe310357640 1 -- 172.21.15.88:0/3872650288 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe308150560 con 0x7fe308156110 2023-12-08T08:22:24.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.458+0000 7fe310357640 1 -- 172.21.15.88:0/3872650288 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe308071010 con 0x7fe308156110 2023-12-08T08:22:24.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.458+0000 7fe310357640 1 -- 172.21.15.88:0/3872650288 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3081503c0 con 0x7fe308156110 2023-12-08T08:22:24.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.462+0000 7fe2feffd640 1 -- 172.21.15.88:0/3872650288 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe300014820 con 0x7fe308156110 2023-12-08T08:22:24.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.462+0000 7fe2feffd640 1 --2- 172.21.15.88:0/3872650288 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe2ec0664a0 0x7fe2ec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:24.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.462+0000 7fe2feffd640 1 -- 172.21.15.88:0/3872650288 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe300084b40 con 0x7fe308156110 2023-12-08T08:22:24.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.462+0000 7fe30e0f3640 1 --2- 172.21.15.88:0/3872650288 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe2ec0664a0 0x7fe2ec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:24.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.462+0000 7fe30e0f3640 1 --2- 172.21.15.88:0/3872650288 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe2ec0664a0 0x7fe2ec068960 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe304000f70 tx=0x7fe304007e50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:24.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.466+0000 7fe2feffd640 1 -- 172.21.15.88:0/3872650288 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe3081503c0 con 0x7fe308156110 2023-12-08T08:22:24.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.610+0000 7fe310357640 1 -- 172.21.15.88:0/3872650288 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe308072820 con 0x7fe2ec0664a0 2023-12-08T08:22:24.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.622+0000 7fe2feffd640 1 -- 172.21.15.88:0/3872650288 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+512978 (secure 0 0 0) 0x7fe308072820 con 0x7fe2ec0664a0 2023-12-08T08:22:24.634 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:24.638 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:22:24.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.630+0000 7fe310357640 1 -- 172.21.15.88:0/3872650288 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe2ec0664a0 msgr2=0x7fe2ec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:24.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.630+0000 7fe310357640 1 --2- 172.21.15.88:0/3872650288 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe2ec0664a0 0x7fe2ec068960 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe304000f70 tx=0x7fe304007e50 comp rx=0 tx=0).stop 2023-12-08T08:22:24.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.630+0000 7fe310357640 1 -- 172.21.15.88:0/3872650288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe308156110 msgr2=0x7fe3080704c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:24.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.630+0000 7fe310357640 1 --2- 172.21.15.88:0/3872650288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe308156110 0x7fe3080704c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe300009d20 tx=0x7fe30000c490 comp rx=0 tx=0).stop 2023-12-08T08:22:24.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.630+0000 7fe310357640 1 -- 172.21.15.88:0/3872650288 shutdown_connections 2023-12-08T08:22:24.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.630+0000 7fe310357640 1 --2- 172.21.15.88:0/3872650288 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe2ec0664a0 0x7fe2ec068960 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:24.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.630+0000 7fe310357640 1 --2- 172.21.15.88:0/3872650288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe308156110 0x7fe3080704c0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:24.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.630+0000 7fe310357640 1 --2- 172.21.15.88:0/3872650288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe30814fd10 0x7fe30814b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:24.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.630+0000 7fe310357640 1 --2- 172.21.15.88:0/3872650288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe308071e30 0x7fe3080ab360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:24.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.630+0000 7fe310357640 1 -- 172.21.15.88:0/3872650288 >> 172.21.15.88:0/3872650288 conn(0x7fe3080a7810 msgr2=0x7fe30806d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:24.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.630+0000 7fe310357640 1 -- 172.21.15.88:0/3872650288 shutdown_connections 2023-12-08T08:22:24.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.630+0000 7fe310357640 1 -- 172.21.15.88:0/3872650288 wait complete. 2023-12-08T08:22:24.653 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2023-12-08T08:22:22.772436+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225192,"kb_used_data":4864,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749528,"statfs":{"total":773094113280,"available":772863516672,"internally_reserved":0,"allocated":4980736,"data_stored":3205274,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.201162"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.084419+0000","last_change":"2023-12-08T08:22:03.089336+0000","last_active":"2023-12-08T08:22:04.084419+0000","last_peered":"2023-12-08T08:22:04.084419+0000","last_clean":"2023-12-08T08:22:04.084419+0000","last_became_active":"2023-12-08T08:22:03.089054+0000","last_became_peered":"2023-12-08T08:22:03.089054+0000","last_unstale":"2023-12-08T08:22:04.084419+0000","last_undegraded":"2023-12-08T08:22:04.084419+0000","last_fullsized":"2023-12-08T08:22:04.084419+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:51:34.637192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.074086+0000","last_change":"2023-12-08T08:22:03.091602+0000","last_active":"2023-12-08T08:22:04.074086+0000","last_peered":"2023-12-08T08:22:04.074086+0000","last_clean":"2023-12-08T08:22:04.074086+0000","last_became_active":"2023-12-08T08:22:03.090269+0000","last_became_peered":"2023-12-08T08:22:03.090269+0000","last_unstale":"2023-12-08T08:22:04.074086+0000","last_undegraded":"2023-12-08T08:22:04.074086+0000","last_fullsized":"2023-12-08T08:22:04.074086+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:59.549481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587537+0000","last_change":"2023-12-08T08:22:03.093966+0000","last_active":"2023-12-08T08:22:04.587537+0000","last_peered":"2023-12-08T08:22:04.587537+0000","last_clean":"2023-12-08T08:22:04.587537+0000","last_became_active":"2023-12-08T08:22:03.092321+0000","last_became_peered":"2023-12-08T08:22:03.092321+0000","last_unstale":"2023-12-08T08:22:04.587537+0000","last_undegraded":"2023-12-08T08:22:04.587537+0000","last_fullsized":"2023-12-08T08:22:04.587537+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:53.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587654+0000","last_change":"2023-12-08T08:22:03.079738+0000","last_active":"2023-12-08T08:22:04.587654+0000","last_peered":"2023-12-08T08:22:04.587654+0000","last_clean":"2023-12-08T08:22:04.587654+0000","last_became_active":"2023-12-08T08:22:03.079467+0000","last_became_peered":"2023-12-08T08:22:03.079467+0000","last_unstale":"2023-12-08T08:22:04.587654+0000","last_undegraded":"2023-12-08T08:22:04.587654+0000","last_fullsized":"2023-12-08T08:22:04.587654+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:33:05.704375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.084279+0000","last_change":"2023-12-08T08:22:03.083276+0000","last_active":"2023-12-08T08:22:04.084279+0000","last_peered":"2023-12-08T08:22:04.084279+0000","last_clean":"2023-12-08T08:22:04.084279+0000","last_became_active":"2023-12-08T08:22:03.082978+0000","last_became_peered":"2023-12-08T08:22:03.082978+0000","last_unstale":"2023-12-08T08:22:04.084279+0000","last_undegraded":"2023-12-08T08:22:04.084279+0000","last_fullsized":"2023-12-08T08:22:04.084279+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:46:10.095936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585219+0000","last_change":"2023-12-08T08:22:03.076518+0000","last_active":"2023-12-08T08:22:04.585219+0000","last_peered":"2023-12-08T08:22:04.585219+0000","last_clean":"2023-12-08T08:22:04.585219+0000","last_became_active":"2023-12-08T08:22:03.076229+0000","last_became_peered":"2023-12-08T08:22:03.076229+0000","last_unstale":"2023-12-08T08:22:04.585219+0000","last_undegraded":"2023-12-08T08:22:04.585219+0000","last_fullsized":"2023-12-08T08:22:04.585219+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:53.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.074645+0000","last_change":"2023-12-08T08:22:03.089142+0000","last_active":"2023-12-08T08:22:04.074645+0000","last_peered":"2023-12-08T08:22:04.074645+0000","last_clean":"2023-12-08T08:22:04.074645+0000","last_became_active":"2023-12-08T08:22:03.088859+0000","last_became_peered":"2023-12-08T08:22:03.088859+0000","last_unstale":"2023-12-08T08:22:04.074645+0000","last_undegraded":"2023-12-08T08:22:04.074645+0000","last_fullsized":"2023-12-08T08:22:04.074645+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:14:53.279099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.073513+0000","last_change":"2023-12-08T08:22:03.073700+0000","last_active":"2023-12-08T08:22:04.073513+0000","last_peered":"2023-12-08T08:22:04.073513+0000","last_clean":"2023-12-08T08:22:04.073513+0000","last_became_active":"2023-12-08T08:22:03.073381+0000","last_became_peered":"2023-12-08T08:22:03.073381+0000","last_unstale":"2023-12-08T08:22:04.073513+0000","last_undegraded":"2023-12-08T08:22:04.073513+0000","last_fullsized":"2023-12-08T08:22:04.073513+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:34:37.929708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.075082+0000","last_change":"2023-12-08T08:22:03.074496+0000","last_active":"2023-12-08T08:22:04.075082+0000","last_peered":"2023-12-08T08:22:04.075082+0000","last_clean":"2023-12-08T08:22:04.075082+0000","last_became_active":"2023-12-08T08:22:03.074162+0000","last_became_peered":"2023-12-08T08:22:03.074162+0000","last_unstale":"2023-12-08T08:22:04.075082+0000","last_undegraded":"2023-12-08T08:22:04.075082+0000","last_fullsized":"2023-12-08T08:22:04.075082+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:40:31.993943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585623+0000","last_change":"2023-12-08T08:22:03.080819+0000","last_active":"2023-12-08T08:22:04.585623+0000","last_peered":"2023-12-08T08:22:04.585623+0000","last_clean":"2023-12-08T08:22:04.585623+0000","last_became_active":"2023-12-08T08:22:03.080496+0000","last_became_peered":"2023-12-08T08:22:03.080496+0000","last_unstale":"2023-12-08T08:22:04.585623+0000","last_undegraded":"2023-12-08T08:22:04.585623+0000","last_fullsized":"2023-12-08T08:22:04.585623+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:49:52.935992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585830+0000","last_change":"2023-12-08T08:22:03.098039+0000","last_active":"2023-12-08T08:22:04.585830+0000","last_peered":"2023-12-08T08:22:04.585830+0000","last_clean":"2023-12-08T08:22:04.585830+0000","last_became_active":"2023-12-08T08:22:03.097811+0000","last_became_peered":"2023-12-08T08:22:03.097811+0000","last_unstale":"2023-12-08T08:22:04.585830+0000","last_undegraded":"2023-12-08T08:22:04.585830+0000","last_fullsized":"2023-12-08T08:22:04.585830+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:13:55.529237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587798+0000","last_change":"2023-12-08T08:22:03.086333+0000","last_active":"2023-12-08T08:22:04.587798+0000","last_peered":"2023-12-08T08:22:04.587798+0000","last_clean":"2023-12-08T08:22:04.587798+0000","last_became_active":"2023-12-08T08:22:03.086060+0000","last_became_peered":"2023-12-08T08:22:03.086060+0000","last_unstale":"2023-12-08T08:22:04.587798+0000","last_undegraded":"2023-12-08T08:22:04.587798+0000","last_fullsized":"2023-12-08T08:22:04.587798+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:07.393106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.588359+0000","last_change":"2023-12-08T08:22:03.093183+0000","last_active":"2023-12-08T08:22:04.588359+0000","last_peered":"2023-12-08T08:22:04.588359+0000","last_clean":"2023-12-08T08:22:04.588359+0000","last_became_active":"2023-12-08T08:22:03.092909+0000","last_became_peered":"2023-12-08T08:22:03.092909+0000","last_unstale":"2023-12-08T08:22:04.588359+0000","last_undegraded":"2023-12-08T08:22:04.588359+0000","last_fullsized":"2023-12-08T08:22:04.588359+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:45.537687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.074783+0000","last_change":"2023-12-08T08:22:03.081624+0000","last_active":"2023-12-08T08:22:04.074783+0000","last_peered":"2023-12-08T08:22:04.074783+0000","last_clean":"2023-12-08T08:22:04.074783+0000","last_became_active":"2023-12-08T08:22:03.079794+0000","last_became_peered":"2023-12-08T08:22:03.079794+0000","last_unstale":"2023-12-08T08:22:04.074783+0000","last_undegraded":"2023-12-08T08:22:04.074783+0000","last_fullsized":"2023-12-08T08:22:04.074783+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:01:21.860136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.074782+0000","last_change":"2023-12-08T08:22:03.083031+0000","last_active":"2023-12-08T08:22:04.074782+0000","last_peered":"2023-12-08T08:22:04.074782+0000","last_clean":"2023-12-08T08:22:04.074782+0000","last_became_active":"2023-12-08T08:22:03.082748+0000","last_became_peered":"2023-12-08T08:22:03.082748+0000","last_unstale":"2023-12-08T08:22:04.074782+0000","last_undegraded":"2023-12-08T08:22:04.074782+0000","last_fullsized":"2023-12-08T08:22:04.074782+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:11.388572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585132+0000","last_change":"2023-12-08T08:22:03.084741+0000","last_active":"2023-12-08T08:22:04.585132+0000","last_peered":"2023-12-08T08:22:04.585132+0000","last_clean":"2023-12-08T08:22:04.585132+0000","last_became_active":"2023-12-08T08:22:03.081369+0000","last_became_peered":"2023-12-08T08:22:03.081369+0000","last_unstale":"2023-12-08T08:22:04.585132+0000","last_undegraded":"2023-12-08T08:22:04.585132+0000","last_fullsized":"2023-12-08T08:22:04.585132+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:49:47.998533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.074148+0000","last_change":"2023-12-08T08:22:03.087864+0000","last_active":"2023-12-08T08:22:04.074148+0000","last_peered":"2023-12-08T08:22:04.074148+0000","last_clean":"2023-12-08T08:22:04.074148+0000","last_became_active":"2023-12-08T08:22:03.087490+0000","last_became_peered":"2023-12-08T08:22:03.087490+0000","last_unstale":"2023-12-08T08:22:04.074148+0000","last_undegraded":"2023-12-08T08:22:04.074148+0000","last_fullsized":"2023-12-08T08:22:04.074148+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:06:57.467675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587245+0000","last_change":"2023-12-08T08:22:03.087242+0000","last_active":"2023-12-08T08:22:04.587245+0000","last_peered":"2023-12-08T08:22:04.587245+0000","last_clean":"2023-12-08T08:22:04.587245+0000","last_became_active":"2023-12-08T08:22:03.086955+0000","last_became_peered":"2023-12-08T08:22:03.086955+0000","last_unstale":"2023-12-08T08:22:04.587245+0000","last_undegraded":"2023-12-08T08:22:04.587245+0000","last_fullsized":"2023-12-08T08:22:04.587245+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:05:02.802237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.084465+0000","last_change":"2023-12-08T08:22:03.099171+0000","last_active":"2023-12-08T08:22:04.084465+0000","last_peered":"2023-12-08T08:22:04.084465+0000","last_clean":"2023-12-08T08:22:04.084465+0000","last_became_active":"2023-12-08T08:22:03.098908+0000","last_became_peered":"2023-12-08T08:22:03.098908+0000","last_unstale":"2023-12-08T08:22:04.084465+0000","last_undegraded":"2023-12-08T08:22:04.084465+0000","last_fullsized":"2023-12-08T08:22:04.084465+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:45:42.890154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.073900+0000","last_change":"2023-12-08T08:22:03.090002+0000","last_active":"2023-12-08T08:22:04.073900+0000","last_peered":"2023-12-08T08:22:04.073900+0000","last_clean":"2023-12-08T08:22:04.073900+0000","last_became_active":"2023-12-08T08:22:03.089710+0000","last_became_peered":"2023-12-08T08:22:03.089710+0000","last_unstale":"2023-12-08T08:22:04.073900+0000","last_undegraded":"2023-12-08T08:22:04.073900+0000","last_fullsized":"2023-12-08T08:22:04.073900+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:55:53.797647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.586344+0000","last_change":"2023-12-08T08:22:03.082971+0000","last_active":"2023-12-08T08:22:04.586344+0000","last_peered":"2023-12-08T08:22:04.586344+0000","last_clean":"2023-12-08T08:22:04.586344+0000","last_became_active":"2023-12-08T08:22:03.082640+0000","last_became_peered":"2023-12-08T08:22:03.082640+0000","last_unstale":"2023-12-08T08:22:04.586344+0000","last_undegraded":"2023-12-08T08:22:04.586344+0000","last_fullsized":"2023-12-08T08:22:04.586344+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:14:25.475662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.073551+0000","last_change":"2023-12-08T08:22:03.087999+0000","last_active":"2023-12-08T08:22:04.073551+0000","last_peered":"2023-12-08T08:22:04.073551+0000","last_clean":"2023-12-08T08:22:04.073551+0000","last_became_active":"2023-12-08T08:22:03.087717+0000","last_became_peered":"2023-12-08T08:22:03.087717+0000","last_unstale":"2023-12-08T08:22:04.073551+0000","last_undegraded":"2023-12-08T08:22:04.073551+0000","last_fullsized":"2023-12-08T08:22:04.073551+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:14:46.975220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.586354+0000","last_change":"2023-12-08T08:22:03.092664+0000","last_active":"2023-12-08T08:22:04.586354+0000","last_peered":"2023-12-08T08:22:04.586354+0000","last_clean":"2023-12-08T08:22:04.586354+0000","last_became_active":"2023-12-08T08:22:03.092355+0000","last_became_peered":"2023-12-08T08:22:03.092355+0000","last_unstale":"2023-12-08T08:22:04.586354+0000","last_undegraded":"2023-12-08T08:22:04.586354+0000","last_fullsized":"2023-12-08T08:22:04.586354+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:09:22.027038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.586972+0000","last_change":"2023-12-08T08:22:03.093118+0000","last_active":"2023-12-08T08:22:04.586972+0000","last_peered":"2023-12-08T08:22:04.586972+0000","last_clean":"2023-12-08T08:22:04.586972+0000","last_became_active":"2023-12-08T08:22:03.092824+0000","last_became_peered":"2023-12-08T08:22:03.092824+0000","last_unstale":"2023-12-08T08:22:04.586972+0000","last_undegraded":"2023-12-08T08:22:04.586972+0000","last_fullsized":"2023-12-08T08:22:04.586972+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:39:10.600711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.084504+0000","last_change":"2023-12-08T08:22:03.082818+0000","last_active":"2023-12-08T08:22:04.084504+0000","last_peered":"2023-12-08T08:22:04.084504+0000","last_clean":"2023-12-08T08:22:04.084504+0000","last_became_active":"2023-12-08T08:22:03.082478+0000","last_became_peered":"2023-12-08T08:22:03.082478+0000","last_unstale":"2023-12-08T08:22:04.084504+0000","last_undegraded":"2023-12-08T08:22:04.084504+0000","last_fullsized":"2023-12-08T08:22:04.084504+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:05:53.649968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587265+0000","last_change":"2023-12-08T08:22:03.085515+0000","last_active":"2023-12-08T08:22:04.587265+0000","last_peered":"2023-12-08T08:22:04.587265+0000","last_clean":"2023-12-08T08:22:04.587265+0000","last_became_active":"2023-12-08T08:22:03.085246+0000","last_became_peered":"2023-12-08T08:22:03.085246+0000","last_unstale":"2023-12-08T08:22:04.587265+0000","last_undegraded":"2023-12-08T08:22:04.587265+0000","last_fullsized":"2023-12-08T08:22:04.587265+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:26:11.213018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585603+0000","last_change":"2023-12-08T08:22:03.083991+0000","last_active":"2023-12-08T08:22:04.585603+0000","last_peered":"2023-12-08T08:22:04.585603+0000","last_clean":"2023-12-08T08:22:04.585603+0000","last_became_active":"2023-12-08T08:22:03.083738+0000","last_became_peered":"2023-12-08T08:22:03.083738+0000","last_unstale":"2023-12-08T08:22:04.585603+0000","last_undegraded":"2023-12-08T08:22:04.585603+0000","last_fullsized":"2023-12-08T08:22:04.585603+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:20:35.224185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.084441+0000","last_change":"2023-12-08T08:22:03.080094+0000","last_active":"2023-12-08T08:22:04.084441+0000","last_peered":"2023-12-08T08:22:04.084441+0000","last_clean":"2023-12-08T08:22:04.084441+0000","last_became_active":"2023-12-08T08:22:03.079795+0000","last_became_peered":"2023-12-08T08:22:03.079795+0000","last_unstale":"2023-12-08T08:22:04.084441+0000","last_undegraded":"2023-12-08T08:22:04.084441+0000","last_fullsized":"2023-12-08T08:22:04.084441+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:57:11.073341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.073874+0000","last_change":"2023-12-08T08:22:03.094432+0000","last_active":"2023-12-08T08:22:04.073874+0000","last_peered":"2023-12-08T08:22:04.073874+0000","last_clean":"2023-12-08T08:22:04.073874+0000","last_became_active":"2023-12-08T08:22:03.087374+0000","last_became_peered":"2023-12-08T08:22:03.087374+0000","last_unstale":"2023-12-08T08:22:04.073874+0000","last_undegraded":"2023-12-08T08:22:04.073874+0000","last_fullsized":"2023-12-08T08:22:04.073874+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:59:36.108166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587375+0000","last_change":"2023-12-08T08:22:03.089625+0000","last_active":"2023-12-08T08:22:04.587375+0000","last_peered":"2023-12-08T08:22:04.587375+0000","last_clean":"2023-12-08T08:22:04.587375+0000","last_became_active":"2023-12-08T08:22:03.089301+0000","last_became_peered":"2023-12-08T08:22:03.089301+0000","last_unstale":"2023-12-08T08:22:04.587375+0000","last_undegraded":"2023-12-08T08:22:04.587375+0000","last_fullsized":"2023-12-08T08:22:04.587375+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:09:02.981325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.084188+0000","last_change":"2023-12-08T08:22:03.080674+0000","last_active":"2023-12-08T08:22:04.084188+0000","last_peered":"2023-12-08T08:22:04.084188+0000","last_clean":"2023-12-08T08:22:04.084188+0000","last_became_active":"2023-12-08T08:22:03.080208+0000","last_became_peered":"2023-12-08T08:22:03.080208+0000","last_unstale":"2023-12-08T08:22:04.084188+0000","last_undegraded":"2023-12-08T08:22:04.084188+0000","last_fullsized":"2023-12-08T08:22:04.084188+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:41:55.888655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585174+0000","last_change":"2023-12-08T08:22:03.092105+0000","last_active":"2023-12-08T08:22:04.585174+0000","last_peered":"2023-12-08T08:22:04.585174+0000","last_clean":"2023-12-08T08:22:04.585174+0000","last_became_active":"2023-12-08T08:22:03.091851+0000","last_became_peered":"2023-12-08T08:22:03.091851+0000","last_unstale":"2023-12-08T08:22:04.585174+0000","last_undegraded":"2023-12-08T08:22:04.585174+0000","last_fullsized":"2023-12-08T08:22:04.585174+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:28:41.729314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585778+0000","last_change":"2023-12-08T08:22:03.081847+0000","last_active":"2023-12-08T08:22:04.585778+0000","last_peered":"2023-12-08T08:22:04.585778+0000","last_clean":"2023-12-08T08:22:04.585778+0000","last_became_active":"2023-12-08T08:22:03.081484+0000","last_became_peered":"2023-12-08T08:22:03.081484+0000","last_unstale":"2023-12-08T08:22:04.585778+0000","last_undegraded":"2023-12-08T08:22:04.585778+0000","last_fullsized":"2023-12-08T08:22:04.585778+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:19:26.991097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.102980+0000","last_change":"2023-12-08T08:22:02.066070+0000","last_active":"2023-12-08T08:22:03.102980+0000","last_peered":"2023-12-08T08:22:03.102980+0000","last_clean":"2023-12-08T08:22:03.102980+0000","last_became_active":"2023-12-08T08:22:02.065684+0000","last_became_peered":"2023-12-08T08:22:02.065684+0000","last_unstale":"2023-12-08T08:22:03.102980+0000","last_undegraded":"2023-12-08T08:22:03.102980+0000","last_fullsized":"2023-12-08T08:22:03.102980+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:26:10.210451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.586057+0000","last_change":"2023-12-08T08:22:03.079744+0000","last_active":"2023-12-08T08:22:04.586057+0000","last_peered":"2023-12-08T08:22:04.586057+0000","last_clean":"2023-12-08T08:22:04.586057+0000","last_became_active":"2023-12-08T08:22:03.079466+0000","last_became_peered":"2023-12-08T08:22:03.079466+0000","last_unstale":"2023-12-08T08:22:04.586057+0000","last_undegraded":"2023-12-08T08:22:04.586057+0000","last_fullsized":"2023-12-08T08:22:04.586057+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:14.557616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.105540+0000","last_change":"2023-12-08T08:22:02.068162+0000","last_active":"2023-12-08T08:22:03.105540+0000","last_peered":"2023-12-08T08:22:03.105540+0000","last_clean":"2023-12-08T08:22:03.105540+0000","last_became_active":"2023-12-08T08:22:02.067918+0000","last_became_peered":"2023-12-08T08:22:02.067918+0000","last_unstale":"2023-12-08T08:22:03.105540+0000","last_undegraded":"2023-12-08T08:22:03.105540+0000","last_fullsized":"2023-12-08T08:22:03.105540+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:19:22.732492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585687+0000","last_change":"2023-12-08T08:22:03.074660+0000","last_active":"2023-12-08T08:22:04.585687+0000","last_peered":"2023-12-08T08:22:04.585687+0000","last_clean":"2023-12-08T08:22:04.585687+0000","last_became_active":"2023-12-08T08:22:03.073168+0000","last_became_peered":"2023-12-08T08:22:03.073168+0000","last_unstale":"2023-12-08T08:22:04.585687+0000","last_undegraded":"2023-12-08T08:22:04.585687+0000","last_fullsized":"2023-12-08T08:22:04.585687+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:46:06.406259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.103717+0000","last_change":"2023-12-08T08:22:02.061868+0000","last_active":"2023-12-08T08:22:03.103717+0000","last_peered":"2023-12-08T08:22:03.103717+0000","last_clean":"2023-12-08T08:22:03.103717+0000","last_became_active":"2023-12-08T08:22:02.061570+0000","last_became_peered":"2023-12-08T08:22:02.061570+0000","last_unstale":"2023-12-08T08:22:03.103717+0000","last_undegraded":"2023-12-08T08:22:03.103717+0000","last_fullsized":"2023-12-08T08:22:03.103717+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:33.039458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585692+0000","last_change":"2023-12-08T08:22:03.080628+0000","last_active":"2023-12-08T08:22:04.585692+0000","last_peered":"2023-12-08T08:22:04.585692+0000","last_clean":"2023-12-08T08:22:04.585692+0000","last_became_active":"2023-12-08T08:22:03.079475+0000","last_became_peered":"2023-12-08T08:22:03.079475+0000","last_unstale":"2023-12-08T08:22:04.585692+0000","last_undegraded":"2023-12-08T08:22:04.585692+0000","last_fullsized":"2023-12-08T08:22:04.585692+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:40:01.464725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.100776+0000","last_change":"2023-12-08T08:22:02.073413+0000","last_active":"2023-12-08T08:22:03.100776+0000","last_peered":"2023-12-08T08:22:03.100776+0000","last_clean":"2023-12-08T08:22:03.100776+0000","last_became_active":"2023-12-08T08:22:02.073043+0000","last_became_peered":"2023-12-08T08:22:02.073043+0000","last_unstale":"2023-12-08T08:22:03.100776+0000","last_undegraded":"2023-12-08T08:22:03.100776+0000","last_fullsized":"2023-12-08T08:22:03.100776+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:10.386004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.073774+0000","last_change":"2023-12-08T08:22:03.087625+0000","last_active":"2023-12-08T08:22:04.073774+0000","last_peered":"2023-12-08T08:22:04.073774+0000","last_clean":"2023-12-08T08:22:04.073774+0000","last_became_active":"2023-12-08T08:22:03.087331+0000","last_became_peered":"2023-12-08T08:22:03.087331+0000","last_unstale":"2023-12-08T08:22:04.073774+0000","last_undegraded":"2023-12-08T08:22:04.073774+0000","last_fullsized":"2023-12-08T08:22:04.073774+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:36:18.806109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.103838+0000","last_change":"2023-12-08T08:22:02.074443+0000","last_active":"2023-12-08T08:22:03.103838+0000","last_peered":"2023-12-08T08:22:03.103838+0000","last_clean":"2023-12-08T08:22:03.103838+0000","last_became_active":"2023-12-08T08:22:02.074076+0000","last_became_peered":"2023-12-08T08:22:02.074076+0000","last_unstale":"2023-12-08T08:22:03.103838+0000","last_undegraded":"2023-12-08T08:22:03.103838+0000","last_fullsized":"2023-12-08T08:22:03.103838+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:14.917716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.073753+0000","last_change":"2023-12-08T08:22:03.087737+0000","last_active":"2023-12-08T08:22:04.073753+0000","last_peered":"2023-12-08T08:22:04.073753+0000","last_clean":"2023-12-08T08:22:04.073753+0000","last_became_active":"2023-12-08T08:22:03.087444+0000","last_became_peered":"2023-12-08T08:22:03.087444+0000","last_unstale":"2023-12-08T08:22:04.073753+0000","last_undegraded":"2023-12-08T08:22:04.073753+0000","last_fullsized":"2023-12-08T08:22:04.073753+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:55:14.301650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.099508+0000","last_change":"2023-12-08T08:22:02.061389+0000","last_active":"2023-12-08T08:22:03.099508+0000","last_peered":"2023-12-08T08:22:03.099508+0000","last_clean":"2023-12-08T08:22:03.099508+0000","last_became_active":"2023-12-08T08:22:02.060880+0000","last_became_peered":"2023-12-08T08:22:02.060880+0000","last_unstale":"2023-12-08T08:22:03.099508+0000","last_undegraded":"2023-12-08T08:22:03.099508+0000","last_fullsized":"2023-12-08T08:22:03.099508+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:40:30.991375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587109+0000","last_change":"2023-12-08T08:22:03.081163+0000","last_active":"2023-12-08T08:22:04.587109+0000","last_peered":"2023-12-08T08:22:04.587109+0000","last_clean":"2023-12-08T08:22:04.587109+0000","last_became_active":"2023-12-08T08:22:03.080865+0000","last_became_peered":"2023-12-08T08:22:03.080865+0000","last_unstale":"2023-12-08T08:22:04.587109+0000","last_undegraded":"2023-12-08T08:22:04.587109+0000","last_fullsized":"2023-12-08T08:22:04.587109+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:43:03.723079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.067907+0000","last_change":"2023-12-08T08:22:02.063925+0000","last_active":"2023-12-08T08:22:03.067907+0000","last_peered":"2023-12-08T08:22:03.067907+0000","last_clean":"2023-12-08T08:22:03.067907+0000","last_became_active":"2023-12-08T08:22:02.063585+0000","last_became_peered":"2023-12-08T08:22:02.063585+0000","last_unstale":"2023-12-08T08:22:03.067907+0000","last_undegraded":"2023-12-08T08:22:03.067907+0000","last_fullsized":"2023-12-08T08:22:03.067907+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:08:57.419992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.073594+0000","last_change":"2023-12-08T08:22:03.083889+0000","last_active":"2023-12-08T08:22:04.073594+0000","last_peered":"2023-12-08T08:22:04.073594+0000","last_clean":"2023-12-08T08:22:04.073594+0000","last_became_active":"2023-12-08T08:22:03.083388+0000","last_became_peered":"2023-12-08T08:22:03.083388+0000","last_unstale":"2023-12-08T08:22:04.073594+0000","last_undegraded":"2023-12-08T08:22:04.073594+0000","last_fullsized":"2023-12-08T08:22:04.073594+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:27:49.636110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.063273+0000","last_change":"2023-12-08T08:22:02.066732+0000","last_active":"2023-12-08T08:22:03.063273+0000","last_peered":"2023-12-08T08:22:03.063273+0000","last_clean":"2023-12-08T08:22:03.063273+0000","last_became_active":"2023-12-08T08:22:02.066414+0000","last_became_peered":"2023-12-08T08:22:02.066414+0000","last_unstale":"2023-12-08T08:22:03.063273+0000","last_undegraded":"2023-12-08T08:22:03.063273+0000","last_fullsized":"2023-12-08T08:22:03.063273+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:08:57.419992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.075180+0000","last_change":"2023-12-08T08:22:03.072301+0000","last_active":"2023-12-08T08:22:04.075180+0000","last_peered":"2023-12-08T08:22:04.075180+0000","last_clean":"2023-12-08T08:22:04.075180+0000","last_became_active":"2023-12-08T08:22:03.071376+0000","last_became_peered":"2023-12-08T08:22:03.071376+0000","last_unstale":"2023-12-08T08:22:04.075180+0000","last_undegraded":"2023-12-08T08:22:04.075180+0000","last_fullsized":"2023-12-08T08:22:04.075180+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:02:41.988642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.079499+0000","last_change":"2023-12-08T08:22:02.073329+0000","last_active":"2023-12-08T08:22:03.079499+0000","last_peered":"2023-12-08T08:22:03.079499+0000","last_clean":"2023-12-08T08:22:03.079499+0000","last_became_active":"2023-12-08T08:22:02.073052+0000","last_became_peered":"2023-12-08T08:22:02.073052+0000","last_unstale":"2023-12-08T08:22:03.079499+0000","last_undegraded":"2023-12-08T08:22:03.079499+0000","last_fullsized":"2023-12-08T08:22:03.079499+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:22:40.527797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587080+0000","last_change":"2023-12-08T08:22:03.084451+0000","last_active":"2023-12-08T08:22:04.587080+0000","last_peered":"2023-12-08T08:22:04.587080+0000","last_clean":"2023-12-08T08:22:04.587080+0000","last_became_active":"2023-12-08T08:22:03.084098+0000","last_became_peered":"2023-12-08T08:22:03.084098+0000","last_unstale":"2023-12-08T08:22:04.587080+0000","last_undegraded":"2023-12-08T08:22:04.587080+0000","last_fullsized":"2023-12-08T08:22:04.587080+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:07.393106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.069089+0000","last_change":"2023-12-08T08:22:02.074584+0000","last_active":"2023-12-08T08:22:03.069089+0000","last_peered":"2023-12-08T08:22:03.069089+0000","last_clean":"2023-12-08T08:22:03.069089+0000","last_became_active":"2023-12-08T08:22:02.072443+0000","last_became_peered":"2023-12-08T08:22:02.072443+0000","last_unstale":"2023-12-08T08:22:03.069089+0000","last_undegraded":"2023-12-08T08:22:03.069089+0000","last_fullsized":"2023-12-08T08:22:03.069089+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:19:17.959027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585532+0000","last_change":"2023-12-08T08:22:03.085967+0000","last_active":"2023-12-08T08:22:04.585532+0000","last_peered":"2023-12-08T08:22:04.585532+0000","last_clean":"2023-12-08T08:22:04.585532+0000","last_became_active":"2023-12-08T08:22:03.085151+0000","last_became_peered":"2023-12-08T08:22:03.085151+0000","last_unstale":"2023-12-08T08:22:04.585532+0000","last_undegraded":"2023-12-08T08:22:04.585532+0000","last_fullsized":"2023-12-08T08:22:04.585532+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:45:40.961425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.107847+0000","last_change":"2023-12-08T08:22:02.071820+0000","last_active":"2023-12-08T08:22:03.107847+0000","last_peered":"2023-12-08T08:22:03.107847+0000","last_clean":"2023-12-08T08:22:03.107847+0000","last_became_active":"2023-12-08T08:22:02.071513+0000","last_became_peered":"2023-12-08T08:22:02.071513+0000","last_unstale":"2023-12-08T08:22:03.107847+0000","last_undegraded":"2023-12-08T08:22:03.107847+0000","last_fullsized":"2023-12-08T08:22:03.107847+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:10.386004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587458+0000","last_change":"2023-12-08T08:22:03.082875+0000","last_active":"2023-12-08T08:22:04.587458+0000","last_peered":"2023-12-08T08:22:04.587458+0000","last_clean":"2023-12-08T08:22:04.587458+0000","last_became_active":"2023-12-08T08:22:03.082546+0000","last_became_peered":"2023-12-08T08:22:03.082546+0000","last_unstale":"2023-12-08T08:22:04.587458+0000","last_undegraded":"2023-12-08T08:22:04.587458+0000","last_fullsized":"2023-12-08T08:22:04.587458+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:28:41.729314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"50'8","reported_seq":20,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:14.221785+0000","last_change":"2023-12-08T08:22:02.064284+0000","last_active":"2023-12-08T08:22:14.221785+0000","last_peered":"2023-12-08T08:22:14.221785+0000","last_clean":"2023-12-08T08:22:14.221785+0000","last_became_active":"2023-12-08T08:22:02.063986+0000","last_became_peered":"2023-12-08T08:22:02.063986+0000","last_unstale":"2023-12-08T08:22:14.221785+0000","last_undegraded":"2023-12-08T08:22:14.221785+0000","last_fullsized":"2023-12-08T08:22:14.221785+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:37:19.999893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587668+0000","last_change":"2023-12-08T08:22:03.081953+0000","last_active":"2023-12-08T08:22:04.587668+0000","last_peered":"2023-12-08T08:22:04.587668+0000","last_clean":"2023-12-08T08:22:04.587668+0000","last_became_active":"2023-12-08T08:22:03.081662+0000","last_became_peered":"2023-12-08T08:22:03.081662+0000","last_unstale":"2023-12-08T08:22:04.587668+0000","last_undegraded":"2023-12-08T08:22:04.587668+0000","last_fullsized":"2023-12-08T08:22:04.587668+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:32:19.298896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.105591+0000","last_change":"2023-12-08T08:22:02.073150+0000","last_active":"2023-12-08T08:22:03.105591+0000","last_peered":"2023-12-08T08:22:03.105591+0000","last_clean":"2023-12-08T08:22:03.105591+0000","last_became_active":"2023-12-08T08:22:02.071562+0000","last_became_peered":"2023-12-08T08:22:02.071562+0000","last_unstale":"2023-12-08T08:22:03.105591+0000","last_undegraded":"2023-12-08T08:22:03.105591+0000","last_fullsized":"2023-12-08T08:22:03.105591+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:52.880423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.586547+0000","last_change":"2023-12-08T08:22:03.085696+0000","last_active":"2023-12-08T08:22:04.586547+0000","last_peered":"2023-12-08T08:22:04.586547+0000","last_clean":"2023-12-08T08:22:04.586547+0000","last_became_active":"2023-12-08T08:22:03.085451+0000","last_became_peered":"2023-12-08T08:22:03.085451+0000","last_unstale":"2023-12-08T08:22:04.586547+0000","last_undegraded":"2023-12-08T08:22:04.586547+0000","last_fullsized":"2023-12-08T08:22:04.586547+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:33:05.704375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.075968+0000","last_change":"2023-12-08T08:22:02.067718+0000","last_active":"2023-12-08T08:22:03.075968+0000","last_peered":"2023-12-08T08:22:03.075968+0000","last_clean":"2023-12-08T08:22:03.075968+0000","last_became_active":"2023-12-08T08:22:02.067452+0000","last_became_peered":"2023-12-08T08:22:02.067452+0000","last_unstale":"2023-12-08T08:22:03.075968+0000","last_undegraded":"2023-12-08T08:22:03.075968+0000","last_fullsized":"2023-12-08T08:22:03.075968+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:15.294424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.075300+0000","last_change":"2023-12-08T08:22:03.083625+0000","last_active":"2023-12-08T08:22:04.075300+0000","last_peered":"2023-12-08T08:22:04.075300+0000","last_clean":"2023-12-08T08:22:04.075300+0000","last_became_active":"2023-12-08T08:22:03.081132+0000","last_became_peered":"2023-12-08T08:22:03.081132+0000","last_unstale":"2023-12-08T08:22:04.075300+0000","last_undegraded":"2023-12-08T08:22:04.075300+0000","last_fullsized":"2023-12-08T08:22:04.075300+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:03:18.580501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.068046+0000","last_change":"2023-12-08T08:22:02.072008+0000","last_active":"2023-12-08T08:22:03.068046+0000","last_peered":"2023-12-08T08:22:03.068046+0000","last_clean":"2023-12-08T08:22:03.068046+0000","last_became_active":"2023-12-08T08:22:02.071711+0000","last_became_peered":"2023-12-08T08:22:02.071711+0000","last_unstale":"2023-12-08T08:22:03.068046+0000","last_undegraded":"2023-12-08T08:22:03.068046+0000","last_fullsized":"2023-12-08T08:22:03.068046+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:02.472465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.586721+0000","last_change":"2023-12-08T08:22:03.092670+0000","last_active":"2023-12-08T08:22:04.586721+0000","last_peered":"2023-12-08T08:22:04.586721+0000","last_clean":"2023-12-08T08:22:04.586721+0000","last_became_active":"2023-12-08T08:22:03.092387+0000","last_became_peered":"2023-12-08T08:22:03.092387+0000","last_unstale":"2023-12-08T08:22:04.586721+0000","last_undegraded":"2023-12-08T08:22:04.586721+0000","last_fullsized":"2023-12-08T08:22:04.586721+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:34.042026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.110252+0000","last_change":"2023-12-08T08:22:02.071841+0000","last_active":"2023-12-08T08:22:03.110252+0000","last_peered":"2023-12-08T08:22:03.110252+0000","last_clean":"2023-12-08T08:22:03.110252+0000","last_became_active":"2023-12-08T08:22:02.071531+0000","last_became_peered":"2023-12-08T08:22:02.071531+0000","last_unstale":"2023-12-08T08:22:03.110252+0000","last_undegraded":"2023-12-08T08:22:03.110252+0000","last_fullsized":"2023-12-08T08:22:03.110252+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:55:21.616638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587396+0000","last_change":"2023-12-08T08:22:03.090890+0000","last_active":"2023-12-08T08:22:04.587396+0000","last_peered":"2023-12-08T08:22:04.587396+0000","last_clean":"2023-12-08T08:22:04.587396+0000","last_became_active":"2023-12-08T08:22:03.090648+0000","last_became_peered":"2023-12-08T08:22:03.090648+0000","last_unstale":"2023-12-08T08:22:04.587396+0000","last_undegraded":"2023-12-08T08:22:04.587396+0000","last_fullsized":"2023-12-08T08:22:04.587396+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:49:47.998533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.099606+0000","last_change":"2023-12-08T08:22:02.072612+0000","last_active":"2023-12-08T08:22:03.099606+0000","last_peered":"2023-12-08T08:22:03.099606+0000","last_clean":"2023-12-08T08:22:03.099606+0000","last_became_active":"2023-12-08T08:22:02.071308+0000","last_became_peered":"2023-12-08T08:22:02.071308+0000","last_unstale":"2023-12-08T08:22:03.099606+0000","last_undegraded":"2023-12-08T08:22:03.099606+0000","last_fullsized":"2023-12-08T08:22:03.099606+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:19:25.988530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587315+0000","last_change":"2023-12-08T08:22:03.085089+0000","last_active":"2023-12-08T08:22:04.587315+0000","last_peered":"2023-12-08T08:22:04.587315+0000","last_clean":"2023-12-08T08:22:04.587315+0000","last_became_active":"2023-12-08T08:22:03.084765+0000","last_became_peered":"2023-12-08T08:22:03.084765+0000","last_unstale":"2023-12-08T08:22:04.587315+0000","last_undegraded":"2023-12-08T08:22:04.587315+0000","last_fullsized":"2023-12-08T08:22:04.587315+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:22:41.530364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.102680+0000","last_change":"2023-12-08T08:22:02.074304+0000","last_active":"2023-12-08T08:22:03.102680+0000","last_peered":"2023-12-08T08:22:03.102680+0000","last_clean":"2023-12-08T08:22:03.102680+0000","last_became_active":"2023-12-08T08:22:02.074007+0000","last_became_peered":"2023-12-08T08:22:02.074007+0000","last_unstale":"2023-12-08T08:22:03.102680+0000","last_undegraded":"2023-12-08T08:22:03.102680+0000","last_fullsized":"2023-12-08T08:22:03.102680+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:03:17.577934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.073911+0000","last_change":"2023-12-08T08:22:03.089470+0000","last_active":"2023-12-08T08:22:04.073911+0000","last_peered":"2023-12-08T08:22:04.073911+0000","last_clean":"2023-12-08T08:22:04.073911+0000","last_became_active":"2023-12-08T08:22:03.089134+0000","last_became_peered":"2023-12-08T08:22:03.089134+0000","last_unstale":"2023-12-08T08:22:04.073911+0000","last_undegraded":"2023-12-08T08:22:04.073911+0000","last_fullsized":"2023-12-08T08:22:04.073911+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:23:38.798779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.100742+0000","last_change":"2023-12-08T08:22:02.073388+0000","last_active":"2023-12-08T08:22:03.100742+0000","last_peered":"2023-12-08T08:22:03.100742+0000","last_clean":"2023-12-08T08:22:03.100742+0000","last_became_active":"2023-12-08T08:22:02.073107+0000","last_became_peered":"2023-12-08T08:22:02.073107+0000","last_unstale":"2023-12-08T08:22:03.100742+0000","last_undegraded":"2023-12-08T08:22:03.100742+0000","last_fullsized":"2023-12-08T08:22:03.100742+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:02:40.986075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587540+0000","last_change":"2023-12-08T08:22:03.082904+0000","last_active":"2023-12-08T08:22:04.587540+0000","last_peered":"2023-12-08T08:22:04.587540+0000","last_clean":"2023-12-08T08:22:04.587540+0000","last_became_active":"2023-12-08T08:22:03.082553+0000","last_became_peered":"2023-12-08T08:22:03.082553+0000","last_unstale":"2023-12-08T08:22:04.587540+0000","last_undegraded":"2023-12-08T08:22:04.587540+0000","last_fullsized":"2023-12-08T08:22:04.587540+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:30:11.797254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.059892+0000","last_change":"2023-12-08T08:22:02.067383+0000","last_active":"2023-12-08T08:22:03.059892+0000","last_peered":"2023-12-08T08:22:03.059892+0000","last_clean":"2023-12-08T08:22:03.059892+0000","last_became_active":"2023-12-08T08:22:02.067094+0000","last_became_peered":"2023-12-08T08:22:02.067094+0000","last_unstale":"2023-12-08T08:22:03.059892+0000","last_undegraded":"2023-12-08T08:22:03.059892+0000","last_fullsized":"2023-12-08T08:22:03.059892+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:22:40.527797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587797+0000","last_change":"2023-12-08T08:22:03.080977+0000","last_active":"2023-12-08T08:22:04.587797+0000","last_peered":"2023-12-08T08:22:04.587797+0000","last_clean":"2023-12-08T08:22:04.587797+0000","last_became_active":"2023-12-08T08:22:03.080612+0000","last_became_peered":"2023-12-08T08:22:03.080612+0000","last_unstale":"2023-12-08T08:22:04.587797+0000","last_undegraded":"2023-12-08T08:22:04.587797+0000","last_fullsized":"2023-12-08T08:22:04.587797+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:34.042026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.105511+0000","last_change":"2023-12-08T08:22:02.055138+0000","last_active":"2023-12-08T08:22:03.105511+0000","last_peered":"2023-12-08T08:22:03.105511+0000","last_clean":"2023-12-08T08:22:03.105511+0000","last_became_active":"2023-12-08T08:22:02.054797+0000","last_became_peered":"2023-12-08T08:22:02.054797+0000","last_unstale":"2023-12-08T08:22:03.105511+0000","last_undegraded":"2023-12-08T08:22:03.105511+0000","last_fullsized":"2023-12-08T08:22:03.105511+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:20:34.221617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585590+0000","last_change":"2023-12-08T08:22:03.084160+0000","last_active":"2023-12-08T08:22:04.585590+0000","last_peered":"2023-12-08T08:22:04.585590+0000","last_clean":"2023-12-08T08:22:04.585590+0000","last_became_active":"2023-12-08T08:22:03.083881+0000","last_became_peered":"2023-12-08T08:22:03.083881+0000","last_unstale":"2023-12-08T08:22:04.585590+0000","last_undegraded":"2023-12-08T08:22:04.585590+0000","last_fullsized":"2023-12-08T08:22:04.585590+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:30:11.797254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.066052+0000","last_change":"2023-12-08T08:22:02.072456+0000","last_active":"2023-12-08T08:22:03.066052+0000","last_peered":"2023-12-08T08:22:03.066052+0000","last_clean":"2023-12-08T08:22:03.066052+0000","last_became_active":"2023-12-08T08:22:02.072146+0000","last_became_peered":"2023-12-08T08:22:02.072146+0000","last_unstale":"2023-12-08T08:22:03.066052+0000","last_undegraded":"2023-12-08T08:22:03.066052+0000","last_fullsized":"2023-12-08T08:22:03.066052+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:39:09.598144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585125+0000","last_change":"2023-12-08T08:22:03.082233+0000","last_active":"2023-12-08T08:22:04.585125+0000","last_peered":"2023-12-08T08:22:04.585125+0000","last_clean":"2023-12-08T08:22:04.585125+0000","last_became_active":"2023-12-08T08:22:03.082064+0000","last_became_peered":"2023-12-08T08:22:03.082064+0000","last_unstale":"2023-12-08T08:22:04.585125+0000","last_undegraded":"2023-12-08T08:22:04.585125+0000","last_fullsized":"2023-12-08T08:22:04.585125+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:09:02.981325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.068373+0000","last_change":"2023-12-08T08:22:02.065223+0000","last_active":"2023-12-08T08:22:03.068373+0000","last_peered":"2023-12-08T08:22:03.068373+0000","last_clean":"2023-12-08T08:22:03.068373+0000","last_became_active":"2023-12-08T08:22:02.064829+0000","last_became_peered":"2023-12-08T08:22:02.064829+0000","last_unstale":"2023-12-08T08:22:03.068373+0000","last_undegraded":"2023-12-08T08:22:03.068373+0000","last_fullsized":"2023-12-08T08:22:03.068373+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:37:19.999893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587372+0000","last_change":"2023-12-08T08:22:03.078777+0000","last_active":"2023-12-08T08:22:04.587372+0000","last_peered":"2023-12-08T08:22:04.587372+0000","last_clean":"2023-12-08T08:22:04.587372+0000","last_became_active":"2023-12-08T08:22:03.078459+0000","last_became_peered":"2023-12-08T08:22:03.078459+0000","last_unstale":"2023-12-08T08:22:04.587372+0000","last_undegraded":"2023-12-08T08:22:04.587372+0000","last_fullsized":"2023-12-08T08:22:04.587372+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:09:22.027038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.103249+0000","last_change":"2023-12-08T08:22:02.057964+0000","last_active":"2023-12-08T08:22:03.103249+0000","last_peered":"2023-12-08T08:22:03.103249+0000","last_clean":"2023-12-08T08:22:03.103249+0000","last_became_active":"2023-12-08T08:22:02.057677+0000","last_became_peered":"2023-12-08T08:22:02.057677+0000","last_unstale":"2023-12-08T08:22:03.103249+0000","last_undegraded":"2023-12-08T08:22:03.103249+0000","last_fullsized":"2023-12-08T08:22:03.103249+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:59:29.971100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587464+0000","last_change":"2023-12-08T08:22:03.087590+0000","last_active":"2023-12-08T08:22:04.587464+0000","last_peered":"2023-12-08T08:22:04.587464+0000","last_clean":"2023-12-08T08:22:04.587464+0000","last_became_active":"2023-12-08T08:22:03.087219+0000","last_became_peered":"2023-12-08T08:22:03.087219+0000","last_unstale":"2023-12-08T08:22:04.587464+0000","last_undegraded":"2023-12-08T08:22:04.587464+0000","last_fullsized":"2023-12-08T08:22:04.587464+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:14:25.475662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585982+0000","last_change":"2023-12-08T08:22:02.061620+0000","last_active":"2023-12-08T08:22:04.585982+0000","last_peered":"2023-12-08T08:22:04.585982+0000","last_clean":"2023-12-08T08:22:04.585982+0000","last_became_active":"2023-12-08T08:22:02.061329+0000","last_became_peered":"2023-12-08T08:22:02.061329+0000","last_unstale":"2023-12-08T08:22:04.585982+0000","last_undegraded":"2023-12-08T08:22:04.585982+0000","last_fullsized":"2023-12-08T08:22:04.585982+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:14:24.473095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585638+0000","last_change":"2023-12-08T08:22:03.080218+0000","last_active":"2023-12-08T08:22:04.585638+0000","last_peered":"2023-12-08T08:22:04.585638+0000","last_clean":"2023-12-08T08:22:04.585638+0000","last_became_active":"2023-12-08T08:22:03.079973+0000","last_became_peered":"2023-12-08T08:22:03.079973+0000","last_unstale":"2023-12-08T08:22:04.585638+0000","last_undegraded":"2023-12-08T08:22:04.585638+0000","last_fullsized":"2023-12-08T08:22:04.585638+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:25.833069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.076191+0000","last_change":"2023-12-08T08:22:02.059762+0000","last_active":"2023-12-08T08:22:03.076191+0000","last_peered":"2023-12-08T08:22:03.076191+0000","last_clean":"2023-12-08T08:22:03.076191+0000","last_became_active":"2023-12-08T08:22:02.059447+0000","last_became_peered":"2023-12-08T08:22:02.059447+0000","last_unstale":"2023-12-08T08:22:03.076191+0000","last_undegraded":"2023-12-08T08:22:03.076191+0000","last_fullsized":"2023-12-08T08:22:03.076191+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:32:25.205810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585750+0000","last_change":"2023-12-08T08:22:03.081034+0000","last_active":"2023-12-08T08:22:04.585750+0000","last_peered":"2023-12-08T08:22:04.585750+0000","last_clean":"2023-12-08T08:22:04.585750+0000","last_became_active":"2023-12-08T08:22:03.078866+0000","last_became_peered":"2023-12-08T08:22:03.078866+0000","last_unstale":"2023-12-08T08:22:04.585750+0000","last_undegraded":"2023-12-08T08:22:04.585750+0000","last_fullsized":"2023-12-08T08:22:04.585750+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:32:22.573403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.068734+0000","last_change":"2023-12-08T08:22:02.069094+0000","last_active":"2023-12-08T08:22:03.068734+0000","last_peered":"2023-12-08T08:22:03.068734+0000","last_clean":"2023-12-08T08:22:03.068734+0000","last_became_active":"2023-12-08T08:22:02.068768+0000","last_became_peered":"2023-12-08T08:22:02.068768+0000","last_unstale":"2023-12-08T08:22:03.068734+0000","last_undegraded":"2023-12-08T08:22:03.068734+0000","last_fullsized":"2023-12-08T08:22:03.068734+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:01:20.857568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.073747+0000","last_change":"2023-12-08T08:22:03.088146+0000","last_active":"2023-12-08T08:22:04.073747+0000","last_peered":"2023-12-08T08:22:04.073747+0000","last_clean":"2023-12-08T08:22:04.073747+0000","last_became_active":"2023-12-08T08:22:03.087857+0000","last_became_peered":"2023-12-08T08:22:03.087857+0000","last_unstale":"2023-12-08T08:22:04.073747+0000","last_undegraded":"2023-12-08T08:22:04.073747+0000","last_fullsized":"2023-12-08T08:22:04.073747+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:55:26.929515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.066923+0000","last_change":"2023-12-08T08:22:02.064371+0000","last_active":"2023-12-08T08:22:03.066923+0000","last_peered":"2023-12-08T08:22:03.066923+0000","last_clean":"2023-12-08T08:22:03.066923+0000","last_became_active":"2023-12-08T08:22:02.063996+0000","last_became_peered":"2023-12-08T08:22:02.063996+0000","last_unstale":"2023-12-08T08:22:03.066923+0000","last_undegraded":"2023-12-08T08:22:03.066923+0000","last_fullsized":"2023-12-08T08:22:03.066923+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:44.535120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.586651+0000","last_change":"2023-12-08T08:22:03.096910+0000","last_active":"2023-12-08T08:22:04.586651+0000","last_peered":"2023-12-08T08:22:04.586651+0000","last_clean":"2023-12-08T08:22:04.586651+0000","last_became_active":"2023-12-08T08:22:03.096724+0000","last_became_peered":"2023-12-08T08:22:03.096724+0000","last_unstale":"2023-12-08T08:22:04.586651+0000","last_undegraded":"2023-12-08T08:22:04.586651+0000","last_fullsized":"2023-12-08T08:22:04.586651+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:32:19.298896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.063415+0000","last_change":"2023-12-08T08:22:02.063148+0000","last_active":"2023-12-08T08:22:03.063415+0000","last_peered":"2023-12-08T08:22:03.063415+0000","last_clean":"2023-12-08T08:22:03.063415+0000","last_became_active":"2023-12-08T08:22:02.062860+0000","last_became_peered":"2023-12-08T08:22:02.062860+0000","last_unstale":"2023-12-08T08:22:03.063415+0000","last_undegraded":"2023-12-08T08:22:03.063415+0000","last_fullsized":"2023-12-08T08:22:03.063415+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:02.472465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.585024+0000","last_change":"2023-12-08T08:22:03.078867+0000","last_active":"2023-12-08T08:22:04.585024+0000","last_peered":"2023-12-08T08:22:04.585024+0000","last_clean":"2023-12-08T08:22:04.585024+0000","last_became_active":"2023-12-08T08:22:03.078535+0000","last_became_peered":"2023-12-08T08:22:03.078535+0000","last_unstale":"2023-12-08T08:22:04.585024+0000","last_undegraded":"2023-12-08T08:22:04.585024+0000","last_fullsized":"2023-12-08T08:22:04.585024+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:17:42.639774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.065289+0000","last_change":"2023-12-08T08:22:02.055697+0000","last_active":"2023-12-08T08:22:03.065289+0000","last_peered":"2023-12-08T08:22:03.065289+0000","last_clean":"2023-12-08T08:22:03.065289+0000","last_became_active":"2023-12-08T08:22:02.055412+0000","last_became_peered":"2023-12-08T08:22:02.055412+0000","last_unstale":"2023-12-08T08:22:03.065289+0000","last_undegraded":"2023-12-08T08:22:03.065289+0000","last_fullsized":"2023-12-08T08:22:03.065289+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:32:25.205810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.073594+0000","last_change":"2023-12-08T08:22:03.083678+0000","last_active":"2023-12-08T08:22:04.073594+0000","last_peered":"2023-12-08T08:22:04.073594+0000","last_clean":"2023-12-08T08:22:04.073594+0000","last_became_active":"2023-12-08T08:22:03.079108+0000","last_became_peered":"2023-12-08T08:22:03.079108+0000","last_unstale":"2023-12-08T08:22:04.073594+0000","last_undegraded":"2023-12-08T08:22:04.073594+0000","last_fullsized":"2023-12-08T08:22:04.073594+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:13:57.755476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.069342+0000","last_change":"2023-12-08T08:22:02.065076+0000","last_active":"2023-12-08T08:22:03.069342+0000","last_peered":"2023-12-08T08:22:03.069342+0000","last_clean":"2023-12-08T08:22:03.069342+0000","last_became_active":"2023-12-08T08:22:02.064723+0000","last_became_peered":"2023-12-08T08:22:02.064723+0000","last_unstale":"2023-12-08T08:22:03.069342+0000","last_undegraded":"2023-12-08T08:22:03.069342+0000","last_fullsized":"2023-12-08T08:22:03.069342+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:27.429215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:19.571185+0000","last_change":"2023-12-08T08:22:19.571185+0000","last_active":"2023-12-08T08:22:19.571185+0000","last_peered":"2023-12-08T08:22:19.571185+0000","last_clean":"2023-12-08T08:22:19.571185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:19.571185+0000","last_undegraded":"2023-12-08T08:22:19.571185+0000","last_fullsized":"2023-12-08T08:22:19.571185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:18.561460+0000","last_change":"2023-12-08T08:22:18.561460+0000","last_active":"2023-12-08T08:22:18.561460+0000","last_peered":"2023-12-08T08:22:18.561460+0000","last_clean":"2023-12-08T08:22:18.561460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:18.561460+0000","last_undegraded":"2023-12-08T08:22:18.561460+0000","last_fullsized":"2023-12-08T08:22:18.561460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.073532+0000","last_change":"2023-12-08T08:22:03.074226+0000","last_active":"2023-12-08T08:22:04.073532+0000","last_peered":"2023-12-08T08:22:04.073532+0000","last_clean":"2023-12-08T08:22:04.073532+0000","last_became_active":"2023-12-08T08:22:03.073967+0000","last_became_peered":"2023-12-08T08:22:03.073967+0000","last_unstale":"2023-12-08T08:22:04.073532+0000","last_undegraded":"2023-12-08T08:22:04.073532+0000","last_fullsized":"2023-12-08T08:22:04.073532+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:09:19.676534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-08T08:22:03.076578+0000","last_change":"2023-12-08T08:22:02.066497+0000","last_active":"2023-12-08T08:22:03.076578+0000","last_peered":"2023-12-08T08:22:03.076578+0000","last_clean":"2023-12-08T08:22:03.076578+0000","last_became_active":"2023-12-08T08:22:02.065532+0000","last_became_peered":"2023-12-08T08:22:02.065532+0000","last_unstale":"2023-12-08T08:22:03.076578+0000","last_undegraded":"2023-12-08T08:22:03.076578+0000","last_fullsized":"2023-12-08T08:22:03.076578+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:44:58.303638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-08T08:22:04.587269+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:22:04.587269+0000","last_peered":"2023-12-08T08:22:04.587269+0000","last_clean":"2023-12-08T08:22:04.587269+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:22:04.587269+0000","last_undegraded":"2023-12-08T08:22:04.587269+0000","last_fullsized":"2023-12-08T08:22:04.587269+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":671744,"data_stored":842619,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89900000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.85299999999999998,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.61599999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85999999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89600000000000002,"5min":1.446,"15min":1.446},"last":0.70499999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.71999999999999997,"15min":0.72899999999999998},"min":{"1min":0.52100000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.871,"5min":1.379,"15min":1.379},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.47599999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.84599999999999997,"5min":1.706,"15min":1.706},"last":0.68300000000000005}]},{"osd":3,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.751,"15min":0.76300000000000001},"min":{"1min":0.54500000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.88700000000000001,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.56699999999999995,"5min":0.496,"15min":0.496},"max":{"1min":0.83099999999999996,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.747}]},{"osd":4,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.46899999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.90000000000000002,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.72599999999999998,"15min":0.74199999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83999999999999997,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.72299999999999998}]},{"osd":5,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.77500000000000002,"15min":0.79500000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81399999999999995,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.78500000000000003,"15min":0.80200000000000005},"min":{"1min":0.499,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93300000000000005,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.84799999999999998,"15min":0.86499999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.95899999999999996,"5min":1.573,"15min":1.573},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.80000000000000004,"15min":0.81499999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91100000000000003,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.80100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":598016,"data_stored":252091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66800000000000004,"15min":0.66500000000000004},"min":{"1min":0.41399999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86699999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.58199999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.90700000000000003,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.73099999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.72099999999999997,"15min":0.71799999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.74099999999999999,"15min":0.73599999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.79000000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.82999999999999996,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.745,"15min":0.749},"min":{"1min":0.51500000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91300000000000003,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.55900000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.85299999999999998,"5min":0.998,"15min":0.998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75,"15min":0.753},"min":{"1min":0.497,"5min":0.434,"15min":0.434},"max":{"1min":0.878,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.61199999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.71599999999999997,"15min":0.73099999999999998},"min":{"1min":0.46400000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.98799999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.748,"15min":0.76500000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.95199999999999996,"5min":1.014,"15min":1.014},"last":0.59599999999999997}]},{"osd":5,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.78100000000000003,"15min":0.80100000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.006,"5min":1.091,"15min":1.091},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.83299999999999996,"15min":0.84799999999999998},"min":{"1min":0.54800000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1419999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.81100000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.80300000000000005,"15min":0.82199999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.03,"5min":1.04,"15min":1.04},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.877,"15min":0.90300000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0740000000000001,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.755}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":252743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.747,"5min":1.081,"15min":1.081},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.90300000000000002,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.48299999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.68999999999999995,"15min":0.68000000000000005},"min":{"1min":0.49399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.002,"5min":1.194,"15min":1.194},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70599999999999996,"15min":0.71499999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.879,"5min":1.143,"15min":1.143},"last":0.42099999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.69799999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.98099999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72899999999999998,"15min":0.73299999999999998},"min":{"1min":0.52400000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.92200000000000004,"5min":1.101,"15min":1.101},"last":0.81699999999999995}]},{"osd":3,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.74099999999999999,"15min":0.746},"min":{"1min":0.47399999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0189999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.76300000000000001,"15min":0.753},"min":{"1min":0.61599999999999999,"5min":0.5,"15min":0.5},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.85899999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82099999999999995,"5min":1.01,"15min":1.01},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94099999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.67400000000000004}]},{"osd":6,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77900000000000003,"15min":0.78600000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93999999999999995,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84899999999999998,"5min":1.073,"15min":1.073},"last":0.61299999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78800000000000003,"15min":0.79400000000000004},"min":{"1min":0.51000000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.995,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.85299999999999998,"15min":0.86099999999999999},"min":{"1min":0.54400000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.97699999999999998,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.93899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":610304,"data_stored":255198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69099999999999995,"15min":0.69699999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.95599999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66400000000000003,"15min":0.66200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.66900000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.45400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.018,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51000000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90100000000000002,"5min":1.002,"15min":1.002},"last":0.78100000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.68500000000000005,"15min":0.69099999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88100000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.72499999999999998,"15min":0.71999999999999997},"min":{"1min":0.55700000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.81200000000000006}]},{"osd":3,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.751,"15min":0.755},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.92200000000000004,"5min":1.359,"15min":1.359},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.77700000000000002,"15min":0.79300000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93700000000000006,"5min":1.232,"15min":1.232},"last":0.70699999999999996}]},{"osd":5,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.66500000000000004,"15min":0.67500000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85599999999999998,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.77000000000000002,"15min":0.78900000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.995,"5min":1.091,"15min":1.091},"last":0.60299999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.70699999999999996,"15min":0.72199999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78400000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78800000000000003,"15min":0.79800000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93400000000000005,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.55100000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.81999999999999995,"15min":0.83199999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.96699999999999997,"5min":1.246,"15min":1.246},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.79200000000000004,"15min":0.80900000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97599999999999998,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.68799999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":252147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.42299999999999999,"15min":0.433},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.46500000000000002,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.45900000000000002,"15min":0.46400000000000002},"min":{"1min":0.33500000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.54900000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.33500000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.435,"15min":0.436},"min":{"1min":0.308,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.49299999999999999,"15min":0.497},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.66200000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.51600000000000001,"15min":0.52400000000000002},"min":{"1min":0.39600000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.64000000000000001,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.435},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.53600000000000003,"15min":0.54300000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.77100000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.77100000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.56599999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94099999999999995,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.747,"15min":0.76100000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0349999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.72799999999999998,"15min":0.73799999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.87,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.75800000000000001,"15min":0.77000000000000002},"min":{"1min":0.53000000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91600000000000004,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.73099999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.79300000000000004,"15min":0.80700000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.026,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.79000000000000004,"15min":0.80200000000000005},"min":{"1min":0.58699999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.89400000000000002,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.71299999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.755},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90400000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.751},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.77200000000000002,"15min":0.78300000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.86799999999999999,"5min":1.121,"15min":1.121},"last":0.68400000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":252147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.39400000000000002,"15min":0.40200000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52500000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.52200000000000002,"15min":0.54000000000000004},"min":{"1min":0.32300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.63300000000000001,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.442}]},{"osd":1,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.47099999999999997,"15min":0.47399999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.67900000000000005,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.53300000000000003}]},{"osd":3,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.56899999999999995,"15min":0.58599999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70399999999999996,"5min":3.008,"15min":3.008},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48499999999999999,"15min":0.48699999999999999},"min":{"1min":0.39200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.59499999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.46800000000000003}]},{"osd":4,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.80300000000000005,"15min":0.82299999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92500000000000004,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.626},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.75800000000000001,"15min":0.76500000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93000000000000005,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.66000000000000003}]},{"osd":5,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76500000000000001,"15min":0.77100000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.05,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.81299999999999994,"15min":0.83699999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0129999999999999,"5min":3.637,"15min":3.637},"last":0.59299999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.78500000000000003,"15min":0.79600000000000004},"min":{"1min":0.55800000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.96899999999999997,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.78500000000000003,"15min":0.79700000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.002,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.57599999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.876,"15min":0.90900000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.83999999999999997,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.83199999999999996,"15min":0.84099999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.997,"5min":1.766,"15min":1.766},"last":0.73099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":602112,"data_stored":252181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.65000000000000002,"15min":0.69299999999999995},"min":{"1min":0.29699999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.69899999999999995,"5min":5.2210000000000001,"15min":5.2210000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.83099999999999996,"15min":0.89100000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69499999999999995,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.48299999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.80600000000000005,"15min":0.87},"min":{"1min":0.309,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.52900000000000003,"5min":8.2070000000000007,"15min":8.2070000000000007},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.68200000000000005,"15min":0.71999999999999997},"min":{"1min":0.34200000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.70899999999999996,"5min":4.351,"15min":4.351},"last":0.434}]},{"osd":3,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.91000000000000003,"15min":0.97599999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.74199999999999999,"5min":8.1479999999999997,"15min":8.1479999999999997},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.746,"15min":0.79300000000000004},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63900000000000001,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.98399999999999999,"15min":1.036},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.95499999999999996,"5min":4.8470000000000004,"15min":4.8470000000000004},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":1.0549999999999999,"15min":1.1080000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.97599999999999998,"5min":4.7939999999999996,"15min":4.7939999999999996},"last":0.89000000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.97099999999999997,"15min":1.0089999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0329999999999999,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.96399999999999997,"15min":1.0009999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92900000000000005,"5min":4.5830000000000002,"15min":4.5830000000000002},"last":0.85799999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":1.0700000000000001,"15min":1.127},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.95599999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":1.0489999999999999,"15min":1.101},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0149999999999999,"5min":4.6289999999999996,"15min":4.6289999999999996},"last":0.80800000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.98199999999999998,"15min":1.024},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0169999999999999,"5min":4.665,"15min":4.665},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":1.0620000000000001,"15min":1.1120000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0720000000000001,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.85099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31840,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340000,"statfs":{"total":96636764160,"available":96604160000,"internally_reserved":0,"allocated":679936,"data_stored":846148,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.48499999999999999,"15min":0.501},"min":{"1min":0.27300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61599999999999999,"5min":1.863,"15min":1.863},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.85499999999999998,"15min":0.91900000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.63200000000000001,"5min":8.2799999999999994,"15min":8.2799999999999994},"last":0.50600000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.89400000000000002,"15min":0.96999999999999997},"min":{"1min":0.314,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71299999999999997,"5min":7.9290000000000003,"15min":7.9290000000000003},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.89800000000000002,"15min":0.97599999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.57299999999999995,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.38900000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.65200000000000002,"15min":0.68999999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.73199999999999998,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.434},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.84199999999999997,"15min":0.90000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.745,"5min":7.8890000000000002,"15min":7.8890000000000002},"last":0.52400000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":1.0309999999999999,"15min":1.0800000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77400000000000002,"15min":0.78500000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.101,"5min":1.607,"15min":1.607},"last":0.70499999999999996}]},{"osd":5,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.83199999999999996,"15min":0.83799999999999997},"min":{"1min":0.53000000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.133,"5min":1.514,"15min":1.514},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":1.0800000000000001,"15min":1.1399999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98899999999999999,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.85499999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.81699999999999995,"15min":0.83499999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.042,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":1.032,"15min":1.081},"min":{"1min":0.55700000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0800000000000001,"5min":7.835,"15min":7.835},"last":0.89900000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":1.0580000000000001,"15min":1.1080000000000001},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1719999999999999,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.84299999999999997,"15min":0.86499999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1539999999999999,"5min":1.794,"15min":1.794},"last":0.78800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:22:24.663 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:22:24.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.830+0000 7fcf7b3df640 1 Processor -- start 2023-12-08T08:22:24.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.830+0000 7fcf7b3df640 1 -- start start 2023-12-08T08:22:24.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.830+0000 7fcf7b3df640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcf740c3b80 0x7fcf7406d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:24.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.830+0000 7fcf7b3df640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcf740c5300 0x7fcf7406c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:24.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.830+0000 7fcf7b3df640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf7406bb80 con 0x7fcf7406d2b0 2023-12-08T08:22:24.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.830+0000 7fcf7b3df640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf7406cc70 con 0x7fcf740c5300 2023-12-08T08:22:24.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.830+0000 7fcf7b3df640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf740c5790 con 0x7fcf740c3b80 2023-12-08T08:22:24.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.830+0000 7fcf7997c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcf740c5300 0x7fcf7406c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:24.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.830+0000 7fcf7997c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcf740c5300 0x7fcf7406c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48768/0 (socket says 172.21.15.88:48768) 2023-12-08T08:22:24.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.830+0000 7fcf7997c640 1 -- 172.21.15.88:0/3532026628 learned_addr learned my addr 172.21.15.88:0/3532026628 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:24.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.830+0000 7fcf7897a640 1 --2- 172.21.15.88:0/3532026628 >> v2:172.21.15.148:3300/0 conn(0x7fcf740c3b80 0x7fcf7406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:24.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.830+0000 7fcf7997c640 1 -- 172.21.15.88:0/3532026628 >> v2:172.21.15.148:3300/0 conn(0x7fcf740c3b80 msgr2=0x7fcf7406d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:24.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.830+0000 7fcf7997c640 1 --2- 172.21.15.88:0/3532026628 >> v2:172.21.15.148:3300/0 conn(0x7fcf740c3b80 0x7fcf7406d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:24.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.830+0000 7fcf7997c640 1 -- 172.21.15.88:0/3532026628 >> v1:172.21.15.148:6789/0 conn(0x7fcf7406d2b0 legacy=0x7fcf7406c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:24.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.830+0000 7fcf7997c640 1 -- 172.21.15.88:0/3532026628 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf741515c0 con 0x7fcf740c5300 2023-12-08T08:22:24.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.830+0000 7fcf7897a640 1 --2- 172.21.15.88:0/3532026628 >> v2:172.21.15.148:3300/0 conn(0x7fcf740c3b80 0x7fcf7406d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:24.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.834+0000 7fcf7997c640 1 --2- 172.21.15.88:0/3532026628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf740c5300 0x7fcf7406c730 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fcf7406b5a0 tx=0x7fcf6c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78508620fbeb6c32 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:24.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.834+0000 7fcf6bfff640 1 -- 172.21.15.88:0/3532026628 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c0a5770 con 0x7fcf740c5300 2023-12-08T08:22:24.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.834+0000 7fcf6bfff640 1 -- 172.21.15.88:0/3532026628 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6c0a58d0 con 0x7fcf740c5300 2023-12-08T08:22:24.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.834+0000 7fcf6bfff640 1 -- 172.21.15.88:0/3532026628 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c0a5c60 con 0x7fcf740c5300 2023-12-08T08:22:24.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.834+0000 7fcf7b3df640 1 -- 172.21.15.88:0/3532026628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf740c5300 msgr2=0x7fcf7406c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:24.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.834+0000 7fcf7b3df640 1 --2- 172.21.15.88:0/3532026628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf740c5300 0x7fcf7406c730 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fcf7406b5a0 tx=0x7fcf6c01c9a0 comp rx=0 tx=0).stop 2023-12-08T08:22:24.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.834+0000 7fcf7b3df640 1 -- 172.21.15.88:0/3532026628 shutdown_connections 2023-12-08T08:22:24.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.834+0000 7fcf7b3df640 1 --2- 172.21.15.88:0/3532026628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf740c5300 0x7fcf7406c730 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:24.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.834+0000 7fcf7b3df640 1 --2- 172.21.15.88:0/3532026628 >> v2:172.21.15.148:3300/0 conn(0x7fcf740c3b80 0x7fcf7406d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:24.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.834+0000 7fcf7b3df640 1 -- 172.21.15.88:0/3532026628 >> 172.21.15.88:0/3532026628 conn(0x7fcf740a7810 msgr2=0x7fcf740a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:24.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.834+0000 7fcf7b3df640 1 -- 172.21.15.88:0/3532026628 shutdown_connections 2023-12-08T08:22:24.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.834+0000 7fcf7b3df640 1 -- 172.21.15.88:0/3532026628 wait complete. 2023-12-08T08:22:24.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.838+0000 7fcf7b3df640 1 Processor -- start 2023-12-08T08:22:24.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.838+0000 7fcf7b3df640 1 -- start start 2023-12-08T08:22:24.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.838+0000 7fcf7b3df640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf7406d2b0 0x7fcf7414d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:24.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.838+0000 7fcf7b3df640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf740c3b80 0x7fcf74154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:24.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.838+0000 7fcf7b3df640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf740c5300 0x7fcf74154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:24.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.838+0000 7fcf7b3df640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf741540f0 con 0x7fcf7406d2b0 2023-12-08T08:22:24.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.838+0000 7fcf7b3df640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf740ab980 con 0x7fcf740c5300 2023-12-08T08:22:24.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.838+0000 7fcf7b3df640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf740aa830 con 0x7fcf740c3b80 2023-12-08T08:22:24.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.838+0000 7fcf7917b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf7406d2b0 0x7fcf7414d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:24.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.838+0000 7fcf7917b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf7406d2b0 0x7fcf7414d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48776/0 (socket says 172.21.15.88:48776) 2023-12-08T08:22:24.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.838+0000 7fcf7917b640 1 -- 172.21.15.88:0/4213662520 learned_addr learned my addr 172.21.15.88:0/4213662520 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:24.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.838+0000 7fcf7897a640 1 --2- 172.21.15.88:0/4213662520 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf740c3b80 0x7fcf74154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:24.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.838+0000 7fcf7997c640 1 --2- 172.21.15.88:0/4213662520 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf740c5300 0x7fcf74154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:24.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.838+0000 7fcf7917b640 1 -- 172.21.15.88:0/4213662520 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf740c3b80 msgr2=0x7fcf74154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:24.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.838+0000 7fcf7917b640 1 --2- 172.21.15.88:0/4213662520 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf740c3b80 0x7fcf74154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:24.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.838+0000 7fcf7917b640 1 -- 172.21.15.88:0/4213662520 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf740c5300 msgr2=0x7fcf74154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:24.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.838+0000 7fcf7917b640 1 --2- 172.21.15.88:0/4213662520 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf740c5300 0x7fcf74154ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:24.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.838+0000 7fcf7917b640 1 -- 172.21.15.88:0/4213662520 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6c009b30 con 0x7fcf7406d2b0 2023-12-08T08:22:24.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.838+0000 7fcf7897a640 1 --2- 172.21.15.88:0/4213662520 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf740c3b80 0x7fcf74154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:24.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.838+0000 7fcf7917b640 1 --2- 172.21.15.88:0/4213662520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf7406d2b0 0x7fcf7414d350 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fcf7000c530 tx=0x7fcf7000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:24.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.838+0000 7fcf69ffb640 1 -- 172.21.15.88:0/4213662520 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf70005220 con 0x7fcf7406d2b0 2023-12-08T08:22:24.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.838+0000 7fcf69ffb640 1 -- 172.21.15.88:0/4213662520 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf70005380 con 0x7fcf7406d2b0 2023-12-08T08:22:24.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.838+0000 7fcf7b3df640 1 -- 172.21.15.88:0/4213662520 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf7414ef80 con 0x7fcf7406d2b0 2023-12-08T08:22:24.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.838+0000 7fcf69ffb640 1 -- 172.21.15.88:0/4213662520 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf70007270 con 0x7fcf7406d2b0 2023-12-08T08:22:24.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.838+0000 7fcf7b3df640 1 -- 172.21.15.88:0/4213662520 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf740ab6a0 con 0x7fcf7406d2b0 2023-12-08T08:22:24.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.838+0000 7fcf7b3df640 1 -- 172.21.15.88:0/4213662520 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf74067630 con 0x7fcf7406d2b0 2023-12-08T08:22:24.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.842+0000 7fcf69ffb640 1 -- 172.21.15.88:0/4213662520 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcf700073d0 con 0x7fcf7406d2b0 2023-12-08T08:22:24.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.842+0000 7fcf69ffb640 1 --2- 172.21.15.88:0/4213662520 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcf58066470 0x7fcf58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:24.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.842+0000 7fcf69ffb640 1 -- 172.21.15.88:0/4213662520 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcf70083a50 con 0x7fcf7406d2b0 2023-12-08T08:22:24.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.842+0000 7fcf7897a640 1 --2- 172.21.15.88:0/4213662520 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcf58066470 0x7fcf58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:24.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.842+0000 7fcf7897a640 1 --2- 172.21.15.88:0/4213662520 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcf58066470 0x7fcf58068930 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcf74071d90 tx=0x7fcf64008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:24.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.846+0000 7fcf69ffb640 1 -- 172.21.15.88:0/4213662520 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcf70050b60 con 0x7fcf7406d2b0 2023-12-08T08:22:25.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:24.994+0000 7fcf7b3df640 1 -- 172.21.15.88:0/4213662520 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcf7414ee00 con 0x7fcf58066470 2023-12-08T08:22:25.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.006+0000 7fcf69ffb640 1 -- 172.21.15.88:0/4213662520 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527689 (secure 0 0 0) 0x7fcf64009600 con 0x7fcf58066470 2023-12-08T08:22:25.018 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:25.022 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:22:25.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.014+0000 7fcf7b3df640 1 -- 172.21.15.88:0/4213662520 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcf58066470 msgr2=0x7fcf58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:25.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.014+0000 7fcf7b3df640 1 --2- 172.21.15.88:0/4213662520 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcf58066470 0x7fcf58068930 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcf74071d90 tx=0x7fcf64008040 comp rx=0 tx=0).stop 2023-12-08T08:22:25.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.014+0000 7fcf7b3df640 1 -- 172.21.15.88:0/4213662520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf7406d2b0 msgr2=0x7fcf7414d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:25.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.014+0000 7fcf7b3df640 1 --2- 172.21.15.88:0/4213662520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf7406d2b0 0x7fcf7414d350 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fcf7000c530 tx=0x7fcf7000c9f0 comp rx=0 tx=0).stop 2023-12-08T08:22:25.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.014+0000 7fcf7b3df640 1 -- 172.21.15.88:0/4213662520 shutdown_connections 2023-12-08T08:22:25.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.014+0000 7fcf7b3df640 1 --2- 172.21.15.88:0/4213662520 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcf58066470 0x7fcf58068930 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:25.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.014+0000 7fcf7b3df640 1 --2- 172.21.15.88:0/4213662520 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf740c5300 0x7fcf74154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:25.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.014+0000 7fcf7b3df640 1 --2- 172.21.15.88:0/4213662520 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcf740c3b80 0x7fcf74154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:25.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.014+0000 7fcf7b3df640 1 --2- 172.21.15.88:0/4213662520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf7406d2b0 0x7fcf7414d350 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:25.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.014+0000 7fcf7b3df640 1 -- 172.21.15.88:0/4213662520 >> 172.21.15.88:0/4213662520 conn(0x7fcf740a7810 msgr2=0x7fcf740a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:25.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.014+0000 7fcf7b3df640 1 -- 172.21.15.88:0/4213662520 shutdown_connections 2023-12-08T08:22:25.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.014+0000 7fcf7b3df640 1 -- 172.21.15.88:0/4213662520 wait complete. 2023-12-08T08:22:25.037 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":116,"stamp":"2023-12-08T08:22:24.772829+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":345,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229812,"kb_used_data":5312,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744908,"statfs":{"total":773094113280,"available":772858785792,"internally_reserved":0,"allocated":5439488,"data_stored":3438822,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001074"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.760756+0000","last_change":"2023-12-08T08:22:20.555890+0000","last_active":"2023-12-08T08:22:21.760756+0000","last_peered":"2023-12-08T08:22:21.760756+0000","last_clean":"2023-12-08T08:22:21.760756+0000","last_became_active":"2023-12-08T08:22:20.555587+0000","last_became_peered":"2023-12-08T08:22:20.555587+0000","last_unstale":"2023-12-08T08:22:21.760756+0000","last_undegraded":"2023-12-08T08:22:21.760756+0000","last_fullsized":"2023-12-08T08:22:21.760756+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:43:57.748936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.542586+0000","last_change":"2023-12-08T08:22:03.089336+0000","last_active":"2023-12-08T08:22:20.542586+0000","last_peered":"2023-12-08T08:22:20.542586+0000","last_clean":"2023-12-08T08:22:20.542586+0000","last_became_active":"2023-12-08T08:22:03.089054+0000","last_became_peered":"2023-12-08T08:22:03.089054+0000","last_unstale":"2023-12-08T08:22:20.542586+0000","last_undegraded":"2023-12-08T08:22:20.542586+0000","last_fullsized":"2023-12-08T08:22:20.542586+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:51:34.637192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.536299+0000","last_change":"2023-12-08T08:22:20.551763+0000","last_active":"2023-12-08T08:22:21.536299+0000","last_peered":"2023-12-08T08:22:21.536299+0000","last_clean":"2023-12-08T08:22:21.536299+0000","last_became_active":"2023-12-08T08:22:20.551495+0000","last_became_peered":"2023-12-08T08:22:20.551495+0000","last_unstale":"2023-12-08T08:22:21.536299+0000","last_undegraded":"2023-12-08T08:22:21.536299+0000","last_fullsized":"2023-12-08T08:22:21.536299+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:05:20.339075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.546652+0000","last_change":"2023-12-08T08:22:03.091602+0000","last_active":"2023-12-08T08:22:20.546652+0000","last_peered":"2023-12-08T08:22:20.546652+0000","last_clean":"2023-12-08T08:22:20.546652+0000","last_became_active":"2023-12-08T08:22:03.090269+0000","last_became_peered":"2023-12-08T08:22:03.090269+0000","last_unstale":"2023-12-08T08:22:20.546652+0000","last_undegraded":"2023-12-08T08:22:20.546652+0000","last_fullsized":"2023-12-08T08:22:20.546652+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:59.549481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.763116+0000","last_change":"2023-12-08T08:22:20.565541+0000","last_active":"2023-12-08T08:22:21.763116+0000","last_peered":"2023-12-08T08:22:21.763116+0000","last_clean":"2023-12-08T08:22:21.763116+0000","last_became_active":"2023-12-08T08:22:20.565270+0000","last_became_peered":"2023-12-08T08:22:20.565270+0000","last_unstale":"2023-12-08T08:22:21.763116+0000","last_undegraded":"2023-12-08T08:22:21.763116+0000","last_fullsized":"2023-12-08T08:22:21.763116+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:07:06.327457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.553407+0000","last_change":"2023-12-08T08:22:03.093966+0000","last_active":"2023-12-08T08:22:20.553407+0000","last_peered":"2023-12-08T08:22:20.553407+0000","last_clean":"2023-12-08T08:22:20.553407+0000","last_became_active":"2023-12-08T08:22:03.092321+0000","last_became_peered":"2023-12-08T08:22:03.092321+0000","last_unstale":"2023-12-08T08:22:20.553407+0000","last_undegraded":"2023-12-08T08:22:20.553407+0000","last_fullsized":"2023-12-08T08:22:20.553407+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:53.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.764033+0000","last_change":"2023-12-08T08:22:20.562289+0000","last_active":"2023-12-08T08:22:21.764033+0000","last_peered":"2023-12-08T08:22:21.764033+0000","last_clean":"2023-12-08T08:22:21.764033+0000","last_became_active":"2023-12-08T08:22:20.557623+0000","last_became_peered":"2023-12-08T08:22:20.557623+0000","last_unstale":"2023-12-08T08:22:21.764033+0000","last_undegraded":"2023-12-08T08:22:21.764033+0000","last_fullsized":"2023-12-08T08:22:21.764033+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:45.968621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.537304+0000","last_change":"2023-12-08T08:22:03.079738+0000","last_active":"2023-12-08T08:22:20.537304+0000","last_peered":"2023-12-08T08:22:20.537304+0000","last_clean":"2023-12-08T08:22:20.537304+0000","last_became_active":"2023-12-08T08:22:03.079467+0000","last_became_peered":"2023-12-08T08:22:03.079467+0000","last_unstale":"2023-12-08T08:22:20.537304+0000","last_undegraded":"2023-12-08T08:22:20.537304+0000","last_fullsized":"2023-12-08T08:22:20.537304+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:33:05.704375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.540438+0000","last_change":"2023-12-08T08:22:20.540351+0000","last_active":"2023-12-08T08:22:21.540438+0000","last_peered":"2023-12-08T08:22:21.540438+0000","last_clean":"2023-12-08T08:22:21.540438+0000","last_became_active":"2023-12-08T08:22:20.540041+0000","last_became_peered":"2023-12-08T08:22:20.540041+0000","last_unstale":"2023-12-08T08:22:21.540438+0000","last_undegraded":"2023-12-08T08:22:21.540438+0000","last_fullsized":"2023-12-08T08:22:21.540438+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:07:15.004512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.545131+0000","last_change":"2023-12-08T08:22:03.083276+0000","last_active":"2023-12-08T08:22:20.545131+0000","last_peered":"2023-12-08T08:22:20.545131+0000","last_clean":"2023-12-08T08:22:20.545131+0000","last_became_active":"2023-12-08T08:22:03.082978+0000","last_became_peered":"2023-12-08T08:22:03.082978+0000","last_unstale":"2023-12-08T08:22:20.545131+0000","last_undegraded":"2023-12-08T08:22:20.545131+0000","last_fullsized":"2023-12-08T08:22:20.545131+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:46:10.095936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.761204+0000","last_change":"2023-12-08T08:22:20.552597+0000","last_active":"2023-12-08T08:22:21.761204+0000","last_peered":"2023-12-08T08:22:21.761204+0000","last_clean":"2023-12-08T08:22:21.761204+0000","last_became_active":"2023-12-08T08:22:20.551793+0000","last_became_peered":"2023-12-08T08:22:20.551793+0000","last_unstale":"2023-12-08T08:22:21.761204+0000","last_undegraded":"2023-12-08T08:22:21.761204+0000","last_fullsized":"2023-12-08T08:22:21.761204+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:30:29.334092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.541038+0000","last_change":"2023-12-08T08:22:03.076518+0000","last_active":"2023-12-08T08:22:20.541038+0000","last_peered":"2023-12-08T08:22:20.541038+0000","last_clean":"2023-12-08T08:22:20.541038+0000","last_became_active":"2023-12-08T08:22:03.076229+0000","last_became_peered":"2023-12-08T08:22:03.076229+0000","last_unstale":"2023-12-08T08:22:20.541038+0000","last_undegraded":"2023-12-08T08:22:20.541038+0000","last_fullsized":"2023-12-08T08:22:20.541038+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:53.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.761636+0000","last_change":"2023-12-08T08:22:20.563754+0000","last_active":"2023-12-08T08:22:21.761636+0000","last_peered":"2023-12-08T08:22:21.761636+0000","last_clean":"2023-12-08T08:22:21.761636+0000","last_became_active":"2023-12-08T08:22:20.563511+0000","last_became_peered":"2023-12-08T08:22:20.563511+0000","last_unstale":"2023-12-08T08:22:21.761636+0000","last_undegraded":"2023-12-08T08:22:21.761636+0000","last_fullsized":"2023-12-08T08:22:21.761636+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:55:40.156043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.544481+0000","last_change":"2023-12-08T08:22:03.089142+0000","last_active":"2023-12-08T08:22:20.544481+0000","last_peered":"2023-12-08T08:22:20.544481+0000","last_clean":"2023-12-08T08:22:20.544481+0000","last_became_active":"2023-12-08T08:22:03.088859+0000","last_became_peered":"2023-12-08T08:22:03.088859+0000","last_unstale":"2023-12-08T08:22:20.544481+0000","last_undegraded":"2023-12-08T08:22:20.544481+0000","last_fullsized":"2023-12-08T08:22:20.544481+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:14:53.279099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.762192+0000","last_change":"2023-12-08T08:22:20.561576+0000","last_active":"2023-12-08T08:22:21.762192+0000","last_peered":"2023-12-08T08:22:21.762192+0000","last_clean":"2023-12-08T08:22:21.762192+0000","last_became_active":"2023-12-08T08:22:20.561185+0000","last_became_peered":"2023-12-08T08:22:20.561185+0000","last_unstale":"2023-12-08T08:22:21.762192+0000","last_undegraded":"2023-12-08T08:22:21.762192+0000","last_fullsized":"2023-12-08T08:22:21.762192+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:40:19.001562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.544567+0000","last_change":"2023-12-08T08:22:03.073700+0000","last_active":"2023-12-08T08:22:20.544567+0000","last_peered":"2023-12-08T08:22:20.544567+0000","last_clean":"2023-12-08T08:22:20.544567+0000","last_became_active":"2023-12-08T08:22:03.073381+0000","last_became_peered":"2023-12-08T08:22:03.073381+0000","last_unstale":"2023-12-08T08:22:20.544567+0000","last_undegraded":"2023-12-08T08:22:20.544567+0000","last_fullsized":"2023-12-08T08:22:20.544567+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:34:37.929708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.763411+0000","last_change":"2023-12-08T08:22:20.564854+0000","last_active":"2023-12-08T08:22:21.763411+0000","last_peered":"2023-12-08T08:22:21.763411+0000","last_clean":"2023-12-08T08:22:21.763411+0000","last_became_active":"2023-12-08T08:22:20.564487+0000","last_became_peered":"2023-12-08T08:22:20.564487+0000","last_unstale":"2023-12-08T08:22:21.763411+0000","last_undegraded":"2023-12-08T08:22:21.763411+0000","last_fullsized":"2023-12-08T08:22:21.763411+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:23:54.062983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.547810+0000","last_change":"2023-12-08T08:22:03.074496+0000","last_active":"2023-12-08T08:22:20.547810+0000","last_peered":"2023-12-08T08:22:20.547810+0000","last_clean":"2023-12-08T08:22:20.547810+0000","last_became_active":"2023-12-08T08:22:03.074162+0000","last_became_peered":"2023-12-08T08:22:03.074162+0000","last_unstale":"2023-12-08T08:22:20.547810+0000","last_undegraded":"2023-12-08T08:22:20.547810+0000","last_fullsized":"2023-12-08T08:22:20.547810+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:40:31.993943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.536073+0000","last_change":"2023-12-08T08:22:20.555960+0000","last_active":"2023-12-08T08:22:21.536073+0000","last_peered":"2023-12-08T08:22:21.536073+0000","last_clean":"2023-12-08T08:22:21.536073+0000","last_became_active":"2023-12-08T08:22:20.555653+0000","last_became_peered":"2023-12-08T08:22:20.555653+0000","last_unstale":"2023-12-08T08:22:21.536073+0000","last_undegraded":"2023-12-08T08:22:21.536073+0000","last_fullsized":"2023-12-08T08:22:21.536073+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:51.578864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.537701+0000","last_change":"2023-12-08T08:22:03.080819+0000","last_active":"2023-12-08T08:22:20.537701+0000","last_peered":"2023-12-08T08:22:20.537701+0000","last_clean":"2023-12-08T08:22:20.537701+0000","last_became_active":"2023-12-08T08:22:03.080496+0000","last_became_peered":"2023-12-08T08:22:03.080496+0000","last_unstale":"2023-12-08T08:22:20.537701+0000","last_undegraded":"2023-12-08T08:22:20.537701+0000","last_fullsized":"2023-12-08T08:22:20.537701+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:49:52.935992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.762164+0000","last_change":"2023-12-08T08:22:20.560195+0000","last_active":"2023-12-08T08:22:21.762164+0000","last_peered":"2023-12-08T08:22:21.762164+0000","last_clean":"2023-12-08T08:22:21.762164+0000","last_became_active":"2023-12-08T08:22:20.559744+0000","last_became_peered":"2023-12-08T08:22:20.559744+0000","last_unstale":"2023-12-08T08:22:21.762164+0000","last_undegraded":"2023-12-08T08:22:21.762164+0000","last_fullsized":"2023-12-08T08:22:21.762164+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:01:41.841500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.537067+0000","last_change":"2023-12-08T08:22:03.098039+0000","last_active":"2023-12-08T08:22:20.537067+0000","last_peered":"2023-12-08T08:22:20.537067+0000","last_clean":"2023-12-08T08:22:20.537067+0000","last_became_active":"2023-12-08T08:22:03.097811+0000","last_became_peered":"2023-12-08T08:22:03.097811+0000","last_unstale":"2023-12-08T08:22:20.537067+0000","last_undegraded":"2023-12-08T08:22:20.537067+0000","last_fullsized":"2023-12-08T08:22:20.537067+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:13:55.529237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.762247+0000","last_change":"2023-12-08T08:22:20.560599+0000","last_active":"2023-12-08T08:22:21.762247+0000","last_peered":"2023-12-08T08:22:21.762247+0000","last_clean":"2023-12-08T08:22:21.762247+0000","last_became_active":"2023-12-08T08:22:20.560311+0000","last_became_peered":"2023-12-08T08:22:20.560311+0000","last_unstale":"2023-12-08T08:22:21.762247+0000","last_undegraded":"2023-12-08T08:22:21.762247+0000","last_fullsized":"2023-12-08T08:22:21.762247+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:28:07.172948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.537323+0000","last_change":"2023-12-08T08:22:03.086333+0000","last_active":"2023-12-08T08:22:20.537323+0000","last_peered":"2023-12-08T08:22:20.537323+0000","last_clean":"2023-12-08T08:22:20.537323+0000","last_became_active":"2023-12-08T08:22:03.086060+0000","last_became_peered":"2023-12-08T08:22:03.086060+0000","last_unstale":"2023-12-08T08:22:20.537323+0000","last_undegraded":"2023-12-08T08:22:20.537323+0000","last_fullsized":"2023-12-08T08:22:20.537323+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:07.393106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.759904+0000","last_change":"2023-12-08T08:22:20.555822+0000","last_active":"2023-12-08T08:22:21.759904+0000","last_peered":"2023-12-08T08:22:21.759904+0000","last_clean":"2023-12-08T08:22:21.759904+0000","last_became_active":"2023-12-08T08:22:20.555523+0000","last_became_peered":"2023-12-08T08:22:20.555523+0000","last_unstale":"2023-12-08T08:22:21.759904+0000","last_undegraded":"2023-12-08T08:22:21.759904+0000","last_fullsized":"2023-12-08T08:22:21.759904+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:34:13.600166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.548995+0000","last_change":"2023-12-08T08:22:03.093183+0000","last_active":"2023-12-08T08:22:20.548995+0000","last_peered":"2023-12-08T08:22:20.548995+0000","last_clean":"2023-12-08T08:22:20.548995+0000","last_became_active":"2023-12-08T08:22:03.092909+0000","last_became_peered":"2023-12-08T08:22:03.092909+0000","last_unstale":"2023-12-08T08:22:20.548995+0000","last_undegraded":"2023-12-08T08:22:20.548995+0000","last_fullsized":"2023-12-08T08:22:20.548995+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:45.537687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.760861+0000","last_change":"2023-12-08T08:22:20.553122+0000","last_active":"2023-12-08T08:22:21.760861+0000","last_peered":"2023-12-08T08:22:21.760861+0000","last_clean":"2023-12-08T08:22:21.760861+0000","last_became_active":"2023-12-08T08:22:20.552668+0000","last_became_peered":"2023-12-08T08:22:20.552668+0000","last_unstale":"2023-12-08T08:22:21.760861+0000","last_undegraded":"2023-12-08T08:22:21.760861+0000","last_fullsized":"2023-12-08T08:22:21.760861+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:34:55.466546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.545540+0000","last_change":"2023-12-08T08:22:03.081624+0000","last_active":"2023-12-08T08:22:20.545540+0000","last_peered":"2023-12-08T08:22:20.545540+0000","last_clean":"2023-12-08T08:22:20.545540+0000","last_became_active":"2023-12-08T08:22:03.079794+0000","last_became_peered":"2023-12-08T08:22:03.079794+0000","last_unstale":"2023-12-08T08:22:20.545540+0000","last_undegraded":"2023-12-08T08:22:20.545540+0000","last_fullsized":"2023-12-08T08:22:20.545540+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:01:21.860136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.760480+0000","last_change":"2023-12-08T08:22:20.557846+0000","last_active":"2023-12-08T08:22:21.760480+0000","last_peered":"2023-12-08T08:22:21.760480+0000","last_clean":"2023-12-08T08:22:21.760480+0000","last_became_active":"2023-12-08T08:22:20.557567+0000","last_became_peered":"2023-12-08T08:22:20.557567+0000","last_unstale":"2023-12-08T08:22:21.760480+0000","last_undegraded":"2023-12-08T08:22:21.760480+0000","last_fullsized":"2023-12-08T08:22:21.760480+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:48:50.040975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.544853+0000","last_change":"2023-12-08T08:22:03.083031+0000","last_active":"2023-12-08T08:22:20.544853+0000","last_peered":"2023-12-08T08:22:20.544853+0000","last_clean":"2023-12-08T08:22:20.544853+0000","last_became_active":"2023-12-08T08:22:03.082748+0000","last_became_peered":"2023-12-08T08:22:03.082748+0000","last_unstale":"2023-12-08T08:22:20.544853+0000","last_undegraded":"2023-12-08T08:22:20.544853+0000","last_fullsized":"2023-12-08T08:22:20.544853+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:11.388572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.761432+0000","last_change":"2023-12-08T08:22:20.556669+0000","last_active":"2023-12-08T08:22:21.761432+0000","last_peered":"2023-12-08T08:22:21.761432+0000","last_clean":"2023-12-08T08:22:21.761432+0000","last_became_active":"2023-12-08T08:22:20.556350+0000","last_became_peered":"2023-12-08T08:22:20.556350+0000","last_unstale":"2023-12-08T08:22:21.761432+0000","last_undegraded":"2023-12-08T08:22:21.761432+0000","last_fullsized":"2023-12-08T08:22:21.761432+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:32:09.238675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.541015+0000","last_change":"2023-12-08T08:22:03.084741+0000","last_active":"2023-12-08T08:22:20.541015+0000","last_peered":"2023-12-08T08:22:20.541015+0000","last_clean":"2023-12-08T08:22:20.541015+0000","last_became_active":"2023-12-08T08:22:03.081369+0000","last_became_peered":"2023-12-08T08:22:03.081369+0000","last_unstale":"2023-12-08T08:22:20.541015+0000","last_undegraded":"2023-12-08T08:22:20.541015+0000","last_fullsized":"2023-12-08T08:22:20.541015+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:49:47.998533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.763556+0000","last_change":"2023-12-08T08:22:20.554270+0000","last_active":"2023-12-08T08:22:21.763556+0000","last_peered":"2023-12-08T08:22:21.763556+0000","last_clean":"2023-12-08T08:22:21.763556+0000","last_became_active":"2023-12-08T08:22:20.553996+0000","last_became_peered":"2023-12-08T08:22:20.553996+0000","last_unstale":"2023-12-08T08:22:21.763556+0000","last_undegraded":"2023-12-08T08:22:21.763556+0000","last_fullsized":"2023-12-08T08:22:21.763556+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:19:36.498432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.548349+0000","last_change":"2023-12-08T08:22:03.087864+0000","last_active":"2023-12-08T08:22:20.548349+0000","last_peered":"2023-12-08T08:22:20.548349+0000","last_clean":"2023-12-08T08:22:20.548349+0000","last_became_active":"2023-12-08T08:22:03.087490+0000","last_became_peered":"2023-12-08T08:22:03.087490+0000","last_unstale":"2023-12-08T08:22:20.548349+0000","last_undegraded":"2023-12-08T08:22:20.548349+0000","last_fullsized":"2023-12-08T08:22:20.548349+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:06:57.467675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.760170+0000","last_change":"2023-12-08T08:22:20.558110+0000","last_active":"2023-12-08T08:22:21.760170+0000","last_peered":"2023-12-08T08:22:21.760170+0000","last_clean":"2023-12-08T08:22:21.760170+0000","last_became_active":"2023-12-08T08:22:20.557728+0000","last_became_peered":"2023-12-08T08:22:20.557728+0000","last_unstale":"2023-12-08T08:22:21.760170+0000","last_undegraded":"2023-12-08T08:22:21.760170+0000","last_fullsized":"2023-12-08T08:22:21.760170+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:17:14.368036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.552600+0000","last_change":"2023-12-08T08:22:03.087242+0000","last_active":"2023-12-08T08:22:20.552600+0000","last_peered":"2023-12-08T08:22:20.552600+0000","last_clean":"2023-12-08T08:22:20.552600+0000","last_became_active":"2023-12-08T08:22:03.086955+0000","last_became_peered":"2023-12-08T08:22:03.086955+0000","last_unstale":"2023-12-08T08:22:20.552600+0000","last_undegraded":"2023-12-08T08:22:20.552600+0000","last_fullsized":"2023-12-08T08:22:20.552600+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:05:02.802237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.762284+0000","last_change":"2023-12-08T08:22:20.560009+0000","last_active":"2023-12-08T08:22:21.762284+0000","last_peered":"2023-12-08T08:22:21.762284+0000","last_clean":"2023-12-08T08:22:21.762284+0000","last_became_active":"2023-12-08T08:22:20.559372+0000","last_became_peered":"2023-12-08T08:22:20.559372+0000","last_unstale":"2023-12-08T08:22:21.762284+0000","last_undegraded":"2023-12-08T08:22:21.762284+0000","last_fullsized":"2023-12-08T08:22:21.762284+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:09:15.959397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.542276+0000","last_change":"2023-12-08T08:22:03.099171+0000","last_active":"2023-12-08T08:22:20.542276+0000","last_peered":"2023-12-08T08:22:20.542276+0000","last_clean":"2023-12-08T08:22:20.542276+0000","last_became_active":"2023-12-08T08:22:03.098908+0000","last_became_peered":"2023-12-08T08:22:03.098908+0000","last_unstale":"2023-12-08T08:22:20.542276+0000","last_undegraded":"2023-12-08T08:22:20.542276+0000","last_fullsized":"2023-12-08T08:22:20.542276+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:45:42.890154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.536363+0000","last_change":"2023-12-08T08:22:20.552027+0000","last_active":"2023-12-08T08:22:21.536363+0000","last_peered":"2023-12-08T08:22:21.536363+0000","last_clean":"2023-12-08T08:22:21.536363+0000","last_became_active":"2023-12-08T08:22:20.551744+0000","last_became_peered":"2023-12-08T08:22:20.551744+0000","last_unstale":"2023-12-08T08:22:21.536363+0000","last_undegraded":"2023-12-08T08:22:21.536363+0000","last_fullsized":"2023-12-08T08:22:21.536363+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:09:20.518163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.546221+0000","last_change":"2023-12-08T08:22:03.090002+0000","last_active":"2023-12-08T08:22:20.546221+0000","last_peered":"2023-12-08T08:22:20.546221+0000","last_clean":"2023-12-08T08:22:20.546221+0000","last_became_active":"2023-12-08T08:22:03.089710+0000","last_became_peered":"2023-12-08T08:22:03.089710+0000","last_unstale":"2023-12-08T08:22:20.546221+0000","last_undegraded":"2023-12-08T08:22:20.546221+0000","last_fullsized":"2023-12-08T08:22:20.546221+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:55:53.797647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.761140+0000","last_change":"2023-12-08T08:22:20.563732+0000","last_active":"2023-12-08T08:22:21.761140+0000","last_peered":"2023-12-08T08:22:21.761140+0000","last_clean":"2023-12-08T08:22:21.761140+0000","last_became_active":"2023-12-08T08:22:20.563388+0000","last_became_peered":"2023-12-08T08:22:20.563388+0000","last_unstale":"2023-12-08T08:22:21.761140+0000","last_undegraded":"2023-12-08T08:22:21.761140+0000","last_fullsized":"2023-12-08T08:22:21.761140+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:52:17.086319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.550314+0000","last_change":"2023-12-08T08:22:03.082971+0000","last_active":"2023-12-08T08:22:20.550314+0000","last_peered":"2023-12-08T08:22:20.550314+0000","last_clean":"2023-12-08T08:22:20.550314+0000","last_became_active":"2023-12-08T08:22:03.082640+0000","last_became_peered":"2023-12-08T08:22:03.082640+0000","last_unstale":"2023-12-08T08:22:20.550314+0000","last_undegraded":"2023-12-08T08:22:20.550314+0000","last_fullsized":"2023-12-08T08:22:20.550314+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:14:25.475662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.760675+0000","last_change":"2023-12-08T08:22:20.560599+0000","last_active":"2023-12-08T08:22:21.760675+0000","last_peered":"2023-12-08T08:22:21.760675+0000","last_clean":"2023-12-08T08:22:21.760675+0000","last_became_active":"2023-12-08T08:22:20.560324+0000","last_became_peered":"2023-12-08T08:22:20.560324+0000","last_unstale":"2023-12-08T08:22:21.760675+0000","last_undegraded":"2023-12-08T08:22:21.760675+0000","last_fullsized":"2023-12-08T08:22:21.760675+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:23:56.335617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.545277+0000","last_change":"2023-12-08T08:22:03.087999+0000","last_active":"2023-12-08T08:22:20.545277+0000","last_peered":"2023-12-08T08:22:20.545277+0000","last_clean":"2023-12-08T08:22:20.545277+0000","last_became_active":"2023-12-08T08:22:03.087717+0000","last_became_peered":"2023-12-08T08:22:03.087717+0000","last_unstale":"2023-12-08T08:22:20.545277+0000","last_undegraded":"2023-12-08T08:22:20.545277+0000","last_fullsized":"2023-12-08T08:22:20.545277+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:14:46.975220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.762031+0000","last_change":"2023-12-08T08:22:20.559122+0000","last_active":"2023-12-08T08:22:21.762031+0000","last_peered":"2023-12-08T08:22:21.762031+0000","last_clean":"2023-12-08T08:22:21.762031+0000","last_became_active":"2023-12-08T08:22:20.558566+0000","last_became_peered":"2023-12-08T08:22:20.558566+0000","last_unstale":"2023-12-08T08:22:21.762031+0000","last_undegraded":"2023-12-08T08:22:21.762031+0000","last_fullsized":"2023-12-08T08:22:21.762031+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:14:15.292314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.550131+0000","last_change":"2023-12-08T08:22:03.092664+0000","last_active":"2023-12-08T08:22:20.550131+0000","last_peered":"2023-12-08T08:22:20.550131+0000","last_clean":"2023-12-08T08:22:20.550131+0000","last_became_active":"2023-12-08T08:22:03.092355+0000","last_became_peered":"2023-12-08T08:22:03.092355+0000","last_unstale":"2023-12-08T08:22:20.550131+0000","last_undegraded":"2023-12-08T08:22:20.550131+0000","last_fullsized":"2023-12-08T08:22:20.550131+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:09:22.027038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.761803+0000","last_change":"2023-12-08T08:22:20.556208+0000","last_active":"2023-12-08T08:22:21.761803+0000","last_peered":"2023-12-08T08:22:21.761803+0000","last_clean":"2023-12-08T08:22:21.761803+0000","last_became_active":"2023-12-08T08:22:20.555958+0000","last_became_peered":"2023-12-08T08:22:20.555958+0000","last_unstale":"2023-12-08T08:22:21.761803+0000","last_undegraded":"2023-12-08T08:22:21.761803+0000","last_fullsized":"2023-12-08T08:22:21.761803+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:09:37.213372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.547270+0000","last_change":"2023-12-08T08:22:03.093118+0000","last_active":"2023-12-08T08:22:20.547270+0000","last_peered":"2023-12-08T08:22:20.547270+0000","last_clean":"2023-12-08T08:22:20.547270+0000","last_became_active":"2023-12-08T08:22:03.092824+0000","last_became_peered":"2023-12-08T08:22:03.092824+0000","last_unstale":"2023-12-08T08:22:20.547270+0000","last_undegraded":"2023-12-08T08:22:20.547270+0000","last_fullsized":"2023-12-08T08:22:20.547270+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:39:10.600711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.760866+0000","last_change":"2023-12-08T08:22:20.564447+0000","last_active":"2023-12-08T08:22:21.760866+0000","last_peered":"2023-12-08T08:22:21.760866+0000","last_clean":"2023-12-08T08:22:21.760866+0000","last_became_active":"2023-12-08T08:22:20.564125+0000","last_became_peered":"2023-12-08T08:22:20.564125+0000","last_unstale":"2023-12-08T08:22:21.760866+0000","last_undegraded":"2023-12-08T08:22:21.760866+0000","last_fullsized":"2023-12-08T08:22:21.760866+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:34:36.335592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.542672+0000","last_change":"2023-12-08T08:22:03.082818+0000","last_active":"2023-12-08T08:22:20.542672+0000","last_peered":"2023-12-08T08:22:20.542672+0000","last_clean":"2023-12-08T08:22:20.542672+0000","last_became_active":"2023-12-08T08:22:03.082478+0000","last_became_peered":"2023-12-08T08:22:03.082478+0000","last_unstale":"2023-12-08T08:22:20.542672+0000","last_undegraded":"2023-12-08T08:22:20.542672+0000","last_fullsized":"2023-12-08T08:22:20.542672+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:05:53.649968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.762380+0000","last_change":"2023-12-08T08:22:20.555674+0000","last_active":"2023-12-08T08:22:21.762380+0000","last_peered":"2023-12-08T08:22:21.762380+0000","last_clean":"2023-12-08T08:22:21.762380+0000","last_became_active":"2023-12-08T08:22:20.555398+0000","last_became_peered":"2023-12-08T08:22:20.555398+0000","last_unstale":"2023-12-08T08:22:21.762380+0000","last_undegraded":"2023-12-08T08:22:21.762380+0000","last_fullsized":"2023-12-08T08:22:21.762380+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:55:31.838488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.536949+0000","last_change":"2023-12-08T08:22:03.085515+0000","last_active":"2023-12-08T08:22:20.536949+0000","last_peered":"2023-12-08T08:22:20.536949+0000","last_clean":"2023-12-08T08:22:20.536949+0000","last_became_active":"2023-12-08T08:22:03.085246+0000","last_became_peered":"2023-12-08T08:22:03.085246+0000","last_unstale":"2023-12-08T08:22:20.536949+0000","last_undegraded":"2023-12-08T08:22:20.536949+0000","last_fullsized":"2023-12-08T08:22:20.536949+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:26:11.213018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.762317+0000","last_change":"2023-12-08T08:22:20.566410+0000","last_active":"2023-12-08T08:22:21.762317+0000","last_peered":"2023-12-08T08:22:21.762317+0000","last_clean":"2023-12-08T08:22:21.762317+0000","last_became_active":"2023-12-08T08:22:20.565921+0000","last_became_peered":"2023-12-08T08:22:20.565921+0000","last_unstale":"2023-12-08T08:22:21.762317+0000","last_undegraded":"2023-12-08T08:22:21.762317+0000","last_fullsized":"2023-12-08T08:22:21.762317+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:55:44.466353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.542649+0000","last_change":"2023-12-08T08:22:03.083991+0000","last_active":"2023-12-08T08:22:20.542649+0000","last_peered":"2023-12-08T08:22:20.542649+0000","last_clean":"2023-12-08T08:22:20.542649+0000","last_became_active":"2023-12-08T08:22:03.083738+0000","last_became_peered":"2023-12-08T08:22:03.083738+0000","last_unstale":"2023-12-08T08:22:20.542649+0000","last_undegraded":"2023-12-08T08:22:20.542649+0000","last_fullsized":"2023-12-08T08:22:20.542649+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:20:35.224185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.540389+0000","last_change":"2023-12-08T08:22:20.555649+0000","last_active":"2023-12-08T08:22:21.540389+0000","last_peered":"2023-12-08T08:22:21.540389+0000","last_clean":"2023-12-08T08:22:21.540389+0000","last_became_active":"2023-12-08T08:22:20.555313+0000","last_became_peered":"2023-12-08T08:22:20.555313+0000","last_unstale":"2023-12-08T08:22:21.540389+0000","last_undegraded":"2023-12-08T08:22:21.540389+0000","last_fullsized":"2023-12-08T08:22:21.540389+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:52:17.086319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.545888+0000","last_change":"2023-12-08T08:22:03.080094+0000","last_active":"2023-12-08T08:22:20.545888+0000","last_peered":"2023-12-08T08:22:20.545888+0000","last_clean":"2023-12-08T08:22:20.545888+0000","last_became_active":"2023-12-08T08:22:03.079795+0000","last_became_peered":"2023-12-08T08:22:03.079795+0000","last_unstale":"2023-12-08T08:22:20.545888+0000","last_undegraded":"2023-12-08T08:22:20.545888+0000","last_fullsized":"2023-12-08T08:22:20.545888+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:57:11.073341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.539780+0000","last_change":"2023-12-08T08:22:20.555305+0000","last_active":"2023-12-08T08:22:21.539780+0000","last_peered":"2023-12-08T08:22:21.539780+0000","last_clean":"2023-12-08T08:22:21.539780+0000","last_became_active":"2023-12-08T08:22:20.554956+0000","last_became_peered":"2023-12-08T08:22:20.554956+0000","last_unstale":"2023-12-08T08:22:21.539780+0000","last_undegraded":"2023-12-08T08:22:21.539780+0000","last_fullsized":"2023-12-08T08:22:21.539780+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:36:36.342946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.545973+0000","last_change":"2023-12-08T08:22:03.094432+0000","last_active":"2023-12-08T08:22:20.545973+0000","last_peered":"2023-12-08T08:22:20.545973+0000","last_clean":"2023-12-08T08:22:20.545973+0000","last_became_active":"2023-12-08T08:22:03.087374+0000","last_became_peered":"2023-12-08T08:22:03.087374+0000","last_unstale":"2023-12-08T08:22:20.545973+0000","last_undegraded":"2023-12-08T08:22:20.545973+0000","last_fullsized":"2023-12-08T08:22:20.545973+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:59:36.108166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.761654+0000","last_change":"2023-12-08T08:22:20.555026+0000","last_active":"2023-12-08T08:22:21.761654+0000","last_peered":"2023-12-08T08:22:21.761654+0000","last_clean":"2023-12-08T08:22:21.761654+0000","last_became_active":"2023-12-08T08:22:20.554693+0000","last_became_peered":"2023-12-08T08:22:20.554693+0000","last_unstale":"2023-12-08T08:22:21.761654+0000","last_undegraded":"2023-12-08T08:22:21.761654+0000","last_fullsized":"2023-12-08T08:22:21.761654+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:46:23.943097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.550357+0000","last_change":"2023-12-08T08:22:03.089625+0000","last_active":"2023-12-08T08:22:20.550357+0000","last_peered":"2023-12-08T08:22:20.550357+0000","last_clean":"2023-12-08T08:22:20.550357+0000","last_became_active":"2023-12-08T08:22:03.089301+0000","last_became_peered":"2023-12-08T08:22:03.089301+0000","last_unstale":"2023-12-08T08:22:20.550357+0000","last_undegraded":"2023-12-08T08:22:20.550357+0000","last_fullsized":"2023-12-08T08:22:20.550357+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:09:02.981325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.760938+0000","last_change":"2023-12-08T08:22:20.558424+0000","last_active":"2023-12-08T08:22:21.760938+0000","last_peered":"2023-12-08T08:22:21.760938+0000","last_clean":"2023-12-08T08:22:21.760938+0000","last_became_active":"2023-12-08T08:22:20.558067+0000","last_became_peered":"2023-12-08T08:22:20.558067+0000","last_unstale":"2023-12-08T08:22:21.760938+0000","last_undegraded":"2023-12-08T08:22:21.760938+0000","last_fullsized":"2023-12-08T08:22:21.760938+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:12:42.859606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.547028+0000","last_change":"2023-12-08T08:22:03.080674+0000","last_active":"2023-12-08T08:22:20.547028+0000","last_peered":"2023-12-08T08:22:20.547028+0000","last_clean":"2023-12-08T08:22:20.547028+0000","last_became_active":"2023-12-08T08:22:03.080208+0000","last_became_peered":"2023-12-08T08:22:03.080208+0000","last_unstale":"2023-12-08T08:22:20.547028+0000","last_undegraded":"2023-12-08T08:22:20.547028+0000","last_fullsized":"2023-12-08T08:22:20.547028+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:41:55.888655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.539777+0000","last_change":"2023-12-08T08:22:20.556390+0000","last_active":"2023-12-08T08:22:21.539777+0000","last_peered":"2023-12-08T08:22:21.539777+0000","last_clean":"2023-12-08T08:22:21.539777+0000","last_became_active":"2023-12-08T08:22:20.556070+0000","last_became_peered":"2023-12-08T08:22:20.556070+0000","last_unstale":"2023-12-08T08:22:21.539777+0000","last_undegraded":"2023-12-08T08:22:21.539777+0000","last_fullsized":"2023-12-08T08:22:21.539777+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:59:53.645004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.541219+0000","last_change":"2023-12-08T08:22:03.092105+0000","last_active":"2023-12-08T08:22:20.541219+0000","last_peered":"2023-12-08T08:22:20.541219+0000","last_clean":"2023-12-08T08:22:20.541219+0000","last_became_active":"2023-12-08T08:22:03.091851+0000","last_became_peered":"2023-12-08T08:22:03.091851+0000","last_unstale":"2023-12-08T08:22:20.541219+0000","last_undegraded":"2023-12-08T08:22:20.541219+0000","last_fullsized":"2023-12-08T08:22:20.541219+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:28:41.729314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.763451+0000","last_change":"2023-12-08T08:22:20.567413+0000","last_active":"2023-12-08T08:22:21.763451+0000","last_peered":"2023-12-08T08:22:21.763451+0000","last_clean":"2023-12-08T08:22:21.763451+0000","last_became_active":"2023-12-08T08:22:20.565323+0000","last_became_peered":"2023-12-08T08:22:20.565323+0000","last_unstale":"2023-12-08T08:22:21.763451+0000","last_undegraded":"2023-12-08T08:22:21.763451+0000","last_fullsized":"2023-12-08T08:22:21.763451+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:19:44.527935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.762353+0000","last_change":"2023-12-08T08:22:19.604004+0000","last_active":"2023-12-08T08:22:21.762353+0000","last_peered":"2023-12-08T08:22:21.762353+0000","last_clean":"2023-12-08T08:22:21.762353+0000","last_became_active":"2023-12-08T08:22:19.603717+0000","last_became_peered":"2023-12-08T08:22:19.603717+0000","last_unstale":"2023-12-08T08:22:21.762353+0000","last_undegraded":"2023-12-08T08:22:21.762353+0000","last_fullsized":"2023-12-08T08:22:21.762353+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:19:35.488707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.542325+0000","last_change":"2023-12-08T08:22:03.081847+0000","last_active":"2023-12-08T08:22:20.542325+0000","last_peered":"2023-12-08T08:22:20.542325+0000","last_clean":"2023-12-08T08:22:20.542325+0000","last_became_active":"2023-12-08T08:22:03.081484+0000","last_became_peered":"2023-12-08T08:22:03.081484+0000","last_unstale":"2023-12-08T08:22:20.542325+0000","last_undegraded":"2023-12-08T08:22:20.542325+0000","last_fullsized":"2023-12-08T08:22:20.542325+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:19:26.991097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":20,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.543366+0000","last_change":"2023-12-08T08:22:02.066070+0000","last_active":"2023-12-08T08:22:20.543366+0000","last_peered":"2023-12-08T08:22:20.543366+0000","last_clean":"2023-12-08T08:22:20.543366+0000","last_became_active":"2023-12-08T08:22:02.065684+0000","last_became_peered":"2023-12-08T08:22:02.065684+0000","last_unstale":"2023-12-08T08:22:20.543366+0000","last_undegraded":"2023-12-08T08:22:20.543366+0000","last_fullsized":"2023-12-08T08:22:20.543366+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:26:10.210451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.762652+0000","last_change":"2023-12-08T08:22:20.564166+0000","last_active":"2023-12-08T08:22:21.762652+0000","last_peered":"2023-12-08T08:22:21.762652+0000","last_clean":"2023-12-08T08:22:21.762652+0000","last_became_active":"2023-12-08T08:22:20.563812+0000","last_became_peered":"2023-12-08T08:22:20.563812+0000","last_unstale":"2023-12-08T08:22:21.762652+0000","last_undegraded":"2023-12-08T08:22:21.762652+0000","last_fullsized":"2023-12-08T08:22:21.762652+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:01:49.093977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.763554+0000","last_change":"2023-12-08T08:22:19.607666+0000","last_active":"2023-12-08T08:22:21.763554+0000","last_peered":"2023-12-08T08:22:21.763554+0000","last_clean":"2023-12-08T08:22:21.763554+0000","last_became_active":"2023-12-08T08:22:19.607374+0000","last_became_peered":"2023-12-08T08:22:19.607374+0000","last_unstale":"2023-12-08T08:22:21.763554+0000","last_undegraded":"2023-12-08T08:22:21.763554+0000","last_fullsized":"2023-12-08T08:22:21.763554+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:33:22.231488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.538518+0000","last_change":"2023-12-08T08:22:03.079744+0000","last_active":"2023-12-08T08:22:20.538518+0000","last_peered":"2023-12-08T08:22:20.538518+0000","last_clean":"2023-12-08T08:22:20.538518+0000","last_became_active":"2023-12-08T08:22:03.079466+0000","last_became_peered":"2023-12-08T08:22:03.079466+0000","last_unstale":"2023-12-08T08:22:20.538518+0000","last_undegraded":"2023-12-08T08:22:20.538518+0000","last_fullsized":"2023-12-08T08:22:20.538518+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:14.557616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.546748+0000","last_change":"2023-12-08T08:22:02.068162+0000","last_active":"2023-12-08T08:22:20.546748+0000","last_peered":"2023-12-08T08:22:20.546748+0000","last_clean":"2023-12-08T08:22:20.546748+0000","last_became_active":"2023-12-08T08:22:02.067918+0000","last_became_peered":"2023-12-08T08:22:02.067918+0000","last_unstale":"2023-12-08T08:22:20.546748+0000","last_undegraded":"2023-12-08T08:22:20.546748+0000","last_fullsized":"2023-12-08T08:22:20.546748+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:19:22.732492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.762682+0000","last_change":"2023-12-08T08:22:20.566555+0000","last_active":"2023-12-08T08:22:21.762682+0000","last_peered":"2023-12-08T08:22:21.762682+0000","last_clean":"2023-12-08T08:22:21.762682+0000","last_became_active":"2023-12-08T08:22:20.564293+0000","last_became_peered":"2023-12-08T08:22:20.564293+0000","last_unstale":"2023-12-08T08:22:21.762682+0000","last_undegraded":"2023-12-08T08:22:21.762682+0000","last_fullsized":"2023-12-08T08:22:21.762682+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:39:20.363272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"53'4","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.763249+0000","last_change":"2023-12-08T08:22:19.617396+0000","last_active":"2023-12-08T08:22:21.763249+0000","last_peered":"2023-12-08T08:22:21.763249+0000","last_clean":"2023-12-08T08:22:21.763249+0000","last_became_active":"2023-12-08T08:22:19.617115+0000","last_became_peered":"2023-12-08T08:22:19.617115+0000","last_unstale":"2023-12-08T08:22:21.763249+0000","last_undegraded":"2023-12-08T08:22:21.763249+0000","last_fullsized":"2023-12-08T08:22:21.763249+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:59:52.635279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.546429+0000","last_change":"2023-12-08T08:22:03.074660+0000","last_active":"2023-12-08T08:22:20.546429+0000","last_peered":"2023-12-08T08:22:20.546429+0000","last_clean":"2023-12-08T08:22:20.546429+0000","last_became_active":"2023-12-08T08:22:03.073168+0000","last_became_peered":"2023-12-08T08:22:03.073168+0000","last_unstale":"2023-12-08T08:22:20.546429+0000","last_undegraded":"2023-12-08T08:22:20.546429+0000","last_fullsized":"2023-12-08T08:22:20.546429+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:46:06.406259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.542866+0000","last_change":"2023-12-08T08:22:02.061868+0000","last_active":"2023-12-08T08:22:20.542866+0000","last_peered":"2023-12-08T08:22:20.542866+0000","last_clean":"2023-12-08T08:22:20.542866+0000","last_became_active":"2023-12-08T08:22:02.061570+0000","last_became_peered":"2023-12-08T08:22:02.061570+0000","last_unstale":"2023-12-08T08:22:20.542866+0000","last_undegraded":"2023-12-08T08:22:20.542866+0000","last_fullsized":"2023-12-08T08:22:20.542866+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:33.039458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.762353+0000","last_change":"2023-12-08T08:22:20.552839+0000","last_active":"2023-12-08T08:22:21.762353+0000","last_peered":"2023-12-08T08:22:21.762353+0000","last_clean":"2023-12-08T08:22:21.762353+0000","last_became_active":"2023-12-08T08:22:20.552502+0000","last_became_peered":"2023-12-08T08:22:20.552502+0000","last_unstale":"2023-12-08T08:22:21.762353+0000","last_undegraded":"2023-12-08T08:22:21.762353+0000","last_fullsized":"2023-12-08T08:22:21.762353+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:21.011870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.761612+0000","last_change":"2023-12-08T08:22:19.608097+0000","last_active":"2023-12-08T08:22:21.761612+0000","last_peered":"2023-12-08T08:22:21.761612+0000","last_clean":"2023-12-08T08:22:21.761612+0000","last_became_active":"2023-12-08T08:22:19.607756+0000","last_became_peered":"2023-12-08T08:22:19.607756+0000","last_unstale":"2023-12-08T08:22:21.761612+0000","last_undegraded":"2023-12-08T08:22:21.761612+0000","last_fullsized":"2023-12-08T08:22:21.761612+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:36:35.333221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.542718+0000","last_change":"2023-12-08T08:22:03.080628+0000","last_active":"2023-12-08T08:22:20.542718+0000","last_peered":"2023-12-08T08:22:20.542718+0000","last_clean":"2023-12-08T08:22:20.542718+0000","last_became_active":"2023-12-08T08:22:03.079475+0000","last_became_peered":"2023-12-08T08:22:03.079475+0000","last_unstale":"2023-12-08T08:22:20.542718+0000","last_undegraded":"2023-12-08T08:22:20.542718+0000","last_fullsized":"2023-12-08T08:22:20.542718+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:40:01.464725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.537413+0000","last_change":"2023-12-08T08:22:02.073413+0000","last_active":"2023-12-08T08:22:20.537413+0000","last_peered":"2023-12-08T08:22:20.537413+0000","last_clean":"2023-12-08T08:22:20.537413+0000","last_became_active":"2023-12-08T08:22:02.073043+0000","last_became_peered":"2023-12-08T08:22:02.073043+0000","last_unstale":"2023-12-08T08:22:20.537413+0000","last_undegraded":"2023-12-08T08:22:20.537413+0000","last_fullsized":"2023-12-08T08:22:20.537413+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:10.386004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.761204+0000","last_change":"2023-12-08T08:22:20.552671+0000","last_active":"2023-12-08T08:22:21.761204+0000","last_peered":"2023-12-08T08:22:21.761204+0000","last_clean":"2023-12-08T08:22:21.761204+0000","last_became_active":"2023-12-08T08:22:20.552431+0000","last_became_peered":"2023-12-08T08:22:20.552431+0000","last_unstale":"2023-12-08T08:22:21.761204+0000","last_undegraded":"2023-12-08T08:22:21.761204+0000","last_fullsized":"2023-12-08T08:22:21.761204+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:14:13.066075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.535807+0000","last_change":"2023-12-08T08:22:19.602601+0000","last_active":"2023-12-08T08:22:21.535807+0000","last_peered":"2023-12-08T08:22:21.535807+0000","last_clean":"2023-12-08T08:22:21.535807+0000","last_became_active":"2023-12-08T08:22:19.602314+0000","last_became_peered":"2023-12-08T08:22:19.602314+0000","last_unstale":"2023-12-08T08:22:21.535807+0000","last_undegraded":"2023-12-08T08:22:21.535807+0000","last_fullsized":"2023-12-08T08:22:21.535807+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:01:38.387248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.545322+0000","last_change":"2023-12-08T08:22:03.087625+0000","last_active":"2023-12-08T08:22:20.545322+0000","last_peered":"2023-12-08T08:22:20.545322+0000","last_clean":"2023-12-08T08:22:20.545322+0000","last_became_active":"2023-12-08T08:22:03.087331+0000","last_became_peered":"2023-12-08T08:22:03.087331+0000","last_unstale":"2023-12-08T08:22:20.545322+0000","last_undegraded":"2023-12-08T08:22:20.545322+0000","last_fullsized":"2023-12-08T08:22:20.545322+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:36:18.806109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.545262+0000","last_change":"2023-12-08T08:22:02.074443+0000","last_active":"2023-12-08T08:22:20.545262+0000","last_peered":"2023-12-08T08:22:20.545262+0000","last_clean":"2023-12-08T08:22:20.545262+0000","last_became_active":"2023-12-08T08:22:02.074076+0000","last_became_peered":"2023-12-08T08:22:02.074076+0000","last_unstale":"2023-12-08T08:22:20.545262+0000","last_undegraded":"2023-12-08T08:22:20.545262+0000","last_fullsized":"2023-12-08T08:22:20.545262+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:14.917716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.760024+0000","last_change":"2023-12-08T08:22:20.565416+0000","last_active":"2023-12-08T08:22:21.760024+0000","last_peered":"2023-12-08T08:22:21.760024+0000","last_clean":"2023-12-08T08:22:21.760024+0000","last_became_active":"2023-12-08T08:22:20.565157+0000","last_became_peered":"2023-12-08T08:22:20.565157+0000","last_unstale":"2023-12-08T08:22:21.760024+0000","last_undegraded":"2023-12-08T08:22:21.760024+0000","last_fullsized":"2023-12-08T08:22:21.760024+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:39:20.363272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.761177+0000","last_change":"2023-12-08T08:22:19.600035+0000","last_active":"2023-12-08T08:22:21.761177+0000","last_peered":"2023-12-08T08:22:21.761177+0000","last_clean":"2023-12-08T08:22:21.761177+0000","last_became_active":"2023-12-08T08:22:19.599745+0000","last_became_peered":"2023-12-08T08:22:19.599745+0000","last_unstale":"2023-12-08T08:22:21.761177+0000","last_undegraded":"2023-12-08T08:22:21.761177+0000","last_fullsized":"2023-12-08T08:22:21.761177+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:39:27.127824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.545777+0000","last_change":"2023-12-08T08:22:03.087737+0000","last_active":"2023-12-08T08:22:20.545777+0000","last_peered":"2023-12-08T08:22:20.545777+0000","last_clean":"2023-12-08T08:22:20.545777+0000","last_became_active":"2023-12-08T08:22:03.087444+0000","last_became_peered":"2023-12-08T08:22:03.087444+0000","last_unstale":"2023-12-08T08:22:20.545777+0000","last_undegraded":"2023-12-08T08:22:20.545777+0000","last_fullsized":"2023-12-08T08:22:20.545777+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:55:14.301650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.541148+0000","last_change":"2023-12-08T08:22:02.061389+0000","last_active":"2023-12-08T08:22:20.541148+0000","last_peered":"2023-12-08T08:22:20.541148+0000","last_clean":"2023-12-08T08:22:20.541148+0000","last_became_active":"2023-12-08T08:22:02.060880+0000","last_became_peered":"2023-12-08T08:22:02.060880+0000","last_unstale":"2023-12-08T08:22:20.541148+0000","last_undegraded":"2023-12-08T08:22:20.541148+0000","last_fullsized":"2023-12-08T08:22:20.541148+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:40:30.991375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.539840+0000","last_change":"2023-12-08T08:22:20.551925+0000","last_active":"2023-12-08T08:22:21.539840+0000","last_peered":"2023-12-08T08:22:21.539840+0000","last_clean":"2023-12-08T08:22:21.539840+0000","last_became_active":"2023-12-08T08:22:20.551583+0000","last_became_peered":"2023-12-08T08:22:20.551583+0000","last_unstale":"2023-12-08T08:22:21.539840+0000","last_undegraded":"2023-12-08T08:22:21.539840+0000","last_fullsized":"2023-12-08T08:22:21.539840+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:56:11.334485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.760696+0000","last_change":"2023-12-08T08:22:19.602311+0000","last_active":"2023-12-08T08:22:21.760696+0000","last_peered":"2023-12-08T08:22:21.760696+0000","last_clean":"2023-12-08T08:22:21.760696+0000","last_became_active":"2023-12-08T08:22:19.602019+0000","last_became_peered":"2023-12-08T08:22:19.602019+0000","last_unstale":"2023-12-08T08:22:21.760696+0000","last_undegraded":"2023-12-08T08:22:21.760696+0000","last_fullsized":"2023-12-08T08:22:21.760696+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:10.208516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.547389+0000","last_change":"2023-12-08T08:22:03.081163+0000","last_active":"2023-12-08T08:22:20.547389+0000","last_peered":"2023-12-08T08:22:20.547389+0000","last_clean":"2023-12-08T08:22:20.547389+0000","last_became_active":"2023-12-08T08:22:03.080865+0000","last_became_peered":"2023-12-08T08:22:03.080865+0000","last_unstale":"2023-12-08T08:22:20.547389+0000","last_undegraded":"2023-12-08T08:22:20.547389+0000","last_fullsized":"2023-12-08T08:22:20.547389+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:43:03.723079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.537119+0000","last_change":"2023-12-08T08:22:02.063925+0000","last_active":"2023-12-08T08:22:20.537119+0000","last_peered":"2023-12-08T08:22:20.537119+0000","last_clean":"2023-12-08T08:22:20.537119+0000","last_became_active":"2023-12-08T08:22:02.063585+0000","last_became_peered":"2023-12-08T08:22:02.063585+0000","last_unstale":"2023-12-08T08:22:20.537119+0000","last_undegraded":"2023-12-08T08:22:20.537119+0000","last_fullsized":"2023-12-08T08:22:20.537119+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:08:57.419992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.761917+0000","last_change":"2023-12-08T08:22:20.570248+0000","last_active":"2023-12-08T08:22:21.761917+0000","last_peered":"2023-12-08T08:22:21.761917+0000","last_clean":"2023-12-08T08:22:21.761917+0000","last_became_active":"2023-12-08T08:22:20.567156+0000","last_became_peered":"2023-12-08T08:22:20.567156+0000","last_unstale":"2023-12-08T08:22:21.761917+0000","last_undegraded":"2023-12-08T08:22:21.761917+0000","last_fullsized":"2023-12-08T08:22:21.761917+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:15:04.512058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.762296+0000","last_change":"2023-12-08T08:22:19.610859+0000","last_active":"2023-12-08T08:22:21.762296+0000","last_peered":"2023-12-08T08:22:21.762296+0000","last_clean":"2023-12-08T08:22:21.762296+0000","last_became_active":"2023-12-08T08:22:19.610550+0000","last_became_peered":"2023-12-08T08:22:19.610550+0000","last_unstale":"2023-12-08T08:22:21.762296+0000","last_undegraded":"2023-12-08T08:22:21.762296+0000","last_fullsized":"2023-12-08T08:22:21.762296+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:05:19.329350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.544999+0000","last_change":"2023-12-08T08:22:03.083889+0000","last_active":"2023-12-08T08:22:20.544999+0000","last_peered":"2023-12-08T08:22:20.544999+0000","last_clean":"2023-12-08T08:22:20.544999+0000","last_became_active":"2023-12-08T08:22:03.083388+0000","last_became_peered":"2023-12-08T08:22:03.083388+0000","last_unstale":"2023-12-08T08:22:20.544999+0000","last_undegraded":"2023-12-08T08:22:20.544999+0000","last_fullsized":"2023-12-08T08:22:20.544999+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:27:49.636110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.545497+0000","last_change":"2023-12-08T08:22:02.066732+0000","last_active":"2023-12-08T08:22:20.545497+0000","last_peered":"2023-12-08T08:22:20.545497+0000","last_clean":"2023-12-08T08:22:20.545497+0000","last_became_active":"2023-12-08T08:22:02.066414+0000","last_became_peered":"2023-12-08T08:22:02.066414+0000","last_unstale":"2023-12-08T08:22:20.545497+0000","last_undegraded":"2023-12-08T08:22:20.545497+0000","last_fullsized":"2023-12-08T08:22:20.545497+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:08:57.419992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.763488+0000","last_change":"2023-12-08T08:22:20.568033+0000","last_active":"2023-12-08T08:22:21.763488+0000","last_peered":"2023-12-08T08:22:21.763488+0000","last_clean":"2023-12-08T08:22:21.763488+0000","last_became_active":"2023-12-08T08:22:20.567752+0000","last_became_peered":"2023-12-08T08:22:20.567752+0000","last_unstale":"2023-12-08T08:22:21.763488+0000","last_undegraded":"2023-12-08T08:22:21.763488+0000","last_fullsized":"2023-12-08T08:22:21.763488+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:19:41.271898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"53'3","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.760929+0000","last_change":"2023-12-08T08:22:19.600632+0000","last_active":"2023-12-08T08:22:21.760929+0000","last_peered":"2023-12-08T08:22:21.760929+0000","last_clean":"2023-12-08T08:22:21.760929+0000","last_became_active":"2023-12-08T08:22:19.600354+0000","last_became_peered":"2023-12-08T08:22:19.600354+0000","last_unstale":"2023-12-08T08:22:21.760929+0000","last_undegraded":"2023-12-08T08:22:21.760929+0000","last_fullsized":"2023-12-08T08:22:21.760929+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:30:36.211710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.545263+0000","last_change":"2023-12-08T08:22:03.072301+0000","last_active":"2023-12-08T08:22:20.545263+0000","last_peered":"2023-12-08T08:22:20.545263+0000","last_clean":"2023-12-08T08:22:20.545263+0000","last_became_active":"2023-12-08T08:22:03.071376+0000","last_became_peered":"2023-12-08T08:22:03.071376+0000","last_unstale":"2023-12-08T08:22:20.545263+0000","last_undegraded":"2023-12-08T08:22:20.545263+0000","last_fullsized":"2023-12-08T08:22:20.545263+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:02:41.988642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.557080+0000","last_change":"2023-12-08T08:22:02.073329+0000","last_active":"2023-12-08T08:22:20.557080+0000","last_peered":"2023-12-08T08:22:20.557080+0000","last_clean":"2023-12-08T08:22:20.557080+0000","last_became_active":"2023-12-08T08:22:02.073052+0000","last_became_peered":"2023-12-08T08:22:02.073052+0000","last_unstale":"2023-12-08T08:22:20.557080+0000","last_undegraded":"2023-12-08T08:22:20.557080+0000","last_fullsized":"2023-12-08T08:22:20.557080+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:22:40.527797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.762537+0000","last_change":"2023-12-08T08:22:20.550329+0000","last_active":"2023-12-08T08:22:21.762537+0000","last_peered":"2023-12-08T08:22:21.762537+0000","last_clean":"2023-12-08T08:22:21.762537+0000","last_became_active":"2023-12-08T08:22:20.549686+0000","last_became_peered":"2023-12-08T08:22:20.549686+0000","last_unstale":"2023-12-08T08:22:21.762537+0000","last_undegraded":"2023-12-08T08:22:21.762537+0000","last_fullsized":"2023-12-08T08:22:21.762537+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:33.457121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"53'6","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.536477+0000","last_change":"2023-12-08T08:22:19.599200+0000","last_active":"2023-12-08T08:22:21.536477+0000","last_peered":"2023-12-08T08:22:21.536477+0000","last_clean":"2023-12-08T08:22:21.536477+0000","last_became_active":"2023-12-08T08:22:19.598806+0000","last_became_peered":"2023-12-08T08:22:19.598806+0000","last_unstale":"2023-12-08T08:22:21.536477+0000","last_undegraded":"2023-12-08T08:22:21.536477+0000","last_fullsized":"2023-12-08T08:22:21.536477+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:22:58.057477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.556995+0000","last_change":"2023-12-08T08:22:03.084451+0000","last_active":"2023-12-08T08:22:20.556995+0000","last_peered":"2023-12-08T08:22:20.556995+0000","last_clean":"2023-12-08T08:22:20.556995+0000","last_became_active":"2023-12-08T08:22:03.084098+0000","last_became_peered":"2023-12-08T08:22:03.084098+0000","last_unstale":"2023-12-08T08:22:20.556995+0000","last_undegraded":"2023-12-08T08:22:20.556995+0000","last_fullsized":"2023-12-08T08:22:20.556995+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:07.393106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.546842+0000","last_change":"2023-12-08T08:22:02.074584+0000","last_active":"2023-12-08T08:22:20.546842+0000","last_peered":"2023-12-08T08:22:20.546842+0000","last_clean":"2023-12-08T08:22:20.546842+0000","last_became_active":"2023-12-08T08:22:02.072443+0000","last_became_peered":"2023-12-08T08:22:02.072443+0000","last_unstale":"2023-12-08T08:22:20.546842+0000","last_undegraded":"2023-12-08T08:22:20.546842+0000","last_fullsized":"2023-12-08T08:22:20.546842+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:19:17.959027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.540542+0000","last_change":"2023-12-08T08:22:20.568493+0000","last_active":"2023-12-08T08:22:21.540542+0000","last_peered":"2023-12-08T08:22:21.540542+0000","last_clean":"2023-12-08T08:22:21.540542+0000","last_became_active":"2023-12-08T08:22:20.566543+0000","last_became_peered":"2023-12-08T08:22:20.566543+0000","last_unstale":"2023-12-08T08:22:21.540542+0000","last_undegraded":"2023-12-08T08:22:21.540542+0000","last_fullsized":"2023-12-08T08:22:21.540542+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:34:13.600166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.762839+0000","last_change":"2023-12-08T08:22:19.603319+0000","last_active":"2023-12-08T08:22:21.762839+0000","last_peered":"2023-12-08T08:22:21.762839+0000","last_clean":"2023-12-08T08:22:21.762839+0000","last_became_active":"2023-12-08T08:22:19.603039+0000","last_became_peered":"2023-12-08T08:22:19.603039+0000","last_unstale":"2023-12-08T08:22:21.762839+0000","last_undegraded":"2023-12-08T08:22:21.762839+0000","last_fullsized":"2023-12-08T08:22:21.762839+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:42:54.148088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.537230+0000","last_change":"2023-12-08T08:22:03.085967+0000","last_active":"2023-12-08T08:22:20.537230+0000","last_peered":"2023-12-08T08:22:20.537230+0000","last_clean":"2023-12-08T08:22:20.537230+0000","last_became_active":"2023-12-08T08:22:03.085151+0000","last_became_peered":"2023-12-08T08:22:03.085151+0000","last_unstale":"2023-12-08T08:22:20.537230+0000","last_undegraded":"2023-12-08T08:22:20.537230+0000","last_fullsized":"2023-12-08T08:22:20.537230+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:45:40.961425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":19,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.553528+0000","last_change":"2023-12-08T08:22:02.071820+0000","last_active":"2023-12-08T08:22:20.553528+0000","last_peered":"2023-12-08T08:22:20.553528+0000","last_clean":"2023-12-08T08:22:20.553528+0000","last_became_active":"2023-12-08T08:22:02.071513+0000","last_became_peered":"2023-12-08T08:22:02.071513+0000","last_unstale":"2023-12-08T08:22:20.553528+0000","last_undegraded":"2023-12-08T08:22:20.553528+0000","last_fullsized":"2023-12-08T08:22:20.553528+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:10.386004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.763106+0000","last_change":"2023-12-08T08:22:20.567727+0000","last_active":"2023-12-08T08:22:21.763106+0000","last_peered":"2023-12-08T08:22:21.763106+0000","last_clean":"2023-12-08T08:22:21.763106+0000","last_became_active":"2023-12-08T08:22:20.567559+0000","last_became_peered":"2023-12-08T08:22:20.567559+0000","last_unstale":"2023-12-08T08:22:21.763106+0000","last_undegraded":"2023-12-08T08:22:21.763106+0000","last_fullsized":"2023-12-08T08:22:21.763106+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:48:50.040975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.763903+0000","last_change":"2023-12-08T08:22:19.600310+0000","last_active":"2023-12-08T08:22:21.763903+0000","last_peered":"2023-12-08T08:22:21.763903+0000","last_clean":"2023-12-08T08:22:21.763903+0000","last_became_active":"2023-12-08T08:22:19.599992+0000","last_became_peered":"2023-12-08T08:22:19.599992+0000","last_unstale":"2023-12-08T08:22:21.763903+0000","last_undegraded":"2023-12-08T08:22:21.763903+0000","last_fullsized":"2023-12-08T08:22:21.763903+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:37:10.410103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.553459+0000","last_change":"2023-12-08T08:22:03.082875+0000","last_active":"2023-12-08T08:22:20.553459+0000","last_peered":"2023-12-08T08:22:20.553459+0000","last_clean":"2023-12-08T08:22:20.553459+0000","last_became_active":"2023-12-08T08:22:03.082546+0000","last_became_peered":"2023-12-08T08:22:03.082546+0000","last_unstale":"2023-12-08T08:22:20.553459+0000","last_undegraded":"2023-12-08T08:22:20.553459+0000","last_fullsized":"2023-12-08T08:22:20.553459+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:28:41.729314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"50'8","reported_seq":24,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.544930+0000","last_change":"2023-12-08T08:22:02.064284+0000","last_active":"2023-12-08T08:22:20.544930+0000","last_peered":"2023-12-08T08:22:20.544930+0000","last_clean":"2023-12-08T08:22:20.544930+0000","last_became_active":"2023-12-08T08:22:02.063986+0000","last_became_peered":"2023-12-08T08:22:02.063986+0000","last_unstale":"2023-12-08T08:22:20.544930+0000","last_undegraded":"2023-12-08T08:22:20.544930+0000","last_fullsized":"2023-12-08T08:22:20.544930+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:37:19.999893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.759923+0000","last_change":"2023-12-08T08:22:20.558767+0000","last_active":"2023-12-08T08:22:21.759923+0000","last_peered":"2023-12-08T08:22:21.759923+0000","last_clean":"2023-12-08T08:22:21.759923+0000","last_became_active":"2023-12-08T08:22:20.558249+0000","last_became_peered":"2023-12-08T08:22:20.558249+0000","last_unstale":"2023-12-08T08:22:21.759923+0000","last_undegraded":"2023-12-08T08:22:21.759923+0000","last_fullsized":"2023-12-08T08:22:21.759923+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:01:49.093977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.539980+0000","last_change":"2023-12-08T08:22:19.607257+0000","last_active":"2023-12-08T08:22:21.539980+0000","last_peered":"2023-12-08T08:22:21.539980+0000","last_clean":"2023-12-08T08:22:21.539980+0000","last_became_active":"2023-12-08T08:22:19.606984+0000","last_became_peered":"2023-12-08T08:22:19.606984+0000","last_unstale":"2023-12-08T08:22:21.539980+0000","last_undegraded":"2023-12-08T08:22:21.539980+0000","last_fullsized":"2023-12-08T08:22:21.539980+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:55:30.828763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.537094+0000","last_change":"2023-12-08T08:22:03.081953+0000","last_active":"2023-12-08T08:22:20.537094+0000","last_peered":"2023-12-08T08:22:20.537094+0000","last_clean":"2023-12-08T08:22:20.537094+0000","last_became_active":"2023-12-08T08:22:03.081662+0000","last_became_peered":"2023-12-08T08:22:03.081662+0000","last_unstale":"2023-12-08T08:22:20.537094+0000","last_undegraded":"2023-12-08T08:22:20.537094+0000","last_fullsized":"2023-12-08T08:22:20.537094+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:32:19.298896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.545893+0000","last_change":"2023-12-08T08:22:02.073150+0000","last_active":"2023-12-08T08:22:20.545893+0000","last_peered":"2023-12-08T08:22:20.545893+0000","last_clean":"2023-12-08T08:22:20.545893+0000","last_became_active":"2023-12-08T08:22:02.071562+0000","last_became_peered":"2023-12-08T08:22:02.071562+0000","last_unstale":"2023-12-08T08:22:20.545893+0000","last_undegraded":"2023-12-08T08:22:20.545893+0000","last_fullsized":"2023-12-08T08:22:20.545893+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:52.880423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.761286+0000","last_change":"2023-12-08T08:22:20.560559+0000","last_active":"2023-12-08T08:22:21.761286+0000","last_peered":"2023-12-08T08:22:21.761286+0000","last_clean":"2023-12-08T08:22:21.761286+0000","last_became_active":"2023-12-08T08:22:20.560281+0000","last_became_peered":"2023-12-08T08:22:20.560281+0000","last_unstale":"2023-12-08T08:22:21.761286+0000","last_undegraded":"2023-12-08T08:22:21.761286+0000","last_fullsized":"2023-12-08T08:22:21.761286+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:32.094454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"53'8","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.761439+0000","last_change":"2023-12-08T08:22:19.604263+0000","last_active":"2023-12-08T08:22:21.761439+0000","last_peered":"2023-12-08T08:22:21.761439+0000","last_clean":"2023-12-08T08:22:21.761439+0000","last_became_active":"2023-12-08T08:22:19.603753+0000","last_became_peered":"2023-12-08T08:22:19.603753+0000","last_unstale":"2023-12-08T08:22:21.761439+0000","last_undegraded":"2023-12-08T08:22:21.761439+0000","last_fullsized":"2023-12-08T08:22:21.761439+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:32:39.100515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.550418+0000","last_change":"2023-12-08T08:22:03.085696+0000","last_active":"2023-12-08T08:22:20.550418+0000","last_peered":"2023-12-08T08:22:20.550418+0000","last_clean":"2023-12-08T08:22:20.550418+0000","last_became_active":"2023-12-08T08:22:03.085451+0000","last_became_peered":"2023-12-08T08:22:03.085451+0000","last_unstale":"2023-12-08T08:22:20.550418+0000","last_undegraded":"2023-12-08T08:22:20.550418+0000","last_fullsized":"2023-12-08T08:22:20.550418+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:33:05.704375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.548353+0000","last_change":"2023-12-08T08:22:02.067718+0000","last_active":"2023-12-08T08:22:20.548353+0000","last_peered":"2023-12-08T08:22:20.548353+0000","last_clean":"2023-12-08T08:22:20.548353+0000","last_became_active":"2023-12-08T08:22:02.067452+0000","last_became_peered":"2023-12-08T08:22:02.067452+0000","last_unstale":"2023-12-08T08:22:20.548353+0000","last_undegraded":"2023-12-08T08:22:20.548353+0000","last_fullsized":"2023-12-08T08:22:20.548353+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:15.294424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.761179+0000","last_change":"2023-12-08T08:22:20.562187+0000","last_active":"2023-12-08T08:22:21.761179+0000","last_peered":"2023-12-08T08:22:21.761179+0000","last_clean":"2023-12-08T08:22:21.761179+0000","last_became_active":"2023-12-08T08:22:20.561860+0000","last_became_peered":"2023-12-08T08:22:20.561860+0000","last_unstale":"2023-12-08T08:22:21.761179+0000","last_undegraded":"2023-12-08T08:22:21.761179+0000","last_fullsized":"2023-12-08T08:22:21.761179+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:07:15.004512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.536100+0000","last_change":"2023-12-08T08:22:19.608762+0000","last_active":"2023-12-08T08:22:21.536100+0000","last_peered":"2023-12-08T08:22:21.536100+0000","last_clean":"2023-12-08T08:22:21.536100+0000","last_became_active":"2023-12-08T08:22:19.608402+0000","last_became_peered":"2023-12-08T08:22:19.608402+0000","last_unstale":"2023-12-08T08:22:21.536100+0000","last_undegraded":"2023-12-08T08:22:21.536100+0000","last_fullsized":"2023-12-08T08:22:21.536100+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:03:35.107614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.545392+0000","last_change":"2023-12-08T08:22:03.083625+0000","last_active":"2023-12-08T08:22:20.545392+0000","last_peered":"2023-12-08T08:22:20.545392+0000","last_clean":"2023-12-08T08:22:20.545392+0000","last_became_active":"2023-12-08T08:22:03.081132+0000","last_became_peered":"2023-12-08T08:22:03.081132+0000","last_unstale":"2023-12-08T08:22:20.545392+0000","last_undegraded":"2023-12-08T08:22:20.545392+0000","last_fullsized":"2023-12-08T08:22:20.545392+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:03:18.580501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.537207+0000","last_change":"2023-12-08T08:22:02.072008+0000","last_active":"2023-12-08T08:22:20.537207+0000","last_peered":"2023-12-08T08:22:20.537207+0000","last_clean":"2023-12-08T08:22:20.537207+0000","last_became_active":"2023-12-08T08:22:02.071711+0000","last_became_peered":"2023-12-08T08:22:02.071711+0000","last_unstale":"2023-12-08T08:22:20.537207+0000","last_undegraded":"2023-12-08T08:22:20.537207+0000","last_fullsized":"2023-12-08T08:22:20.537207+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:02.472465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.540197+0000","last_change":"2023-12-08T08:22:20.553502+0000","last_active":"2023-12-08T08:22:21.540197+0000","last_peered":"2023-12-08T08:22:21.540197+0000","last_clean":"2023-12-08T08:22:21.540197+0000","last_became_active":"2023-12-08T08:22:20.553177+0000","last_became_peered":"2023-12-08T08:22:20.553177+0000","last_unstale":"2023-12-08T08:22:21.540197+0000","last_undegraded":"2023-12-08T08:22:21.540197+0000","last_fullsized":"2023-12-08T08:22:21.540197+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:23:56.335617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.762394+0000","last_change":"2023-12-08T08:22:19.601893+0000","last_active":"2023-12-08T08:22:21.762394+0000","last_peered":"2023-12-08T08:22:21.762394+0000","last_clean":"2023-12-08T08:22:21.762394+0000","last_became_active":"2023-12-08T08:22:19.600064+0000","last_became_peered":"2023-12-08T08:22:19.600064+0000","last_unstale":"2023-12-08T08:22:21.762394+0000","last_undegraded":"2023-12-08T08:22:21.762394+0000","last_fullsized":"2023-12-08T08:22:21.762394+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:09:19.508438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.544791+0000","last_change":"2023-12-08T08:22:03.092670+0000","last_active":"2023-12-08T08:22:20.544791+0000","last_peered":"2023-12-08T08:22:20.544791+0000","last_clean":"2023-12-08T08:22:20.544791+0000","last_became_active":"2023-12-08T08:22:03.092387+0000","last_became_peered":"2023-12-08T08:22:03.092387+0000","last_unstale":"2023-12-08T08:22:20.544791+0000","last_undegraded":"2023-12-08T08:22:20.544791+0000","last_fullsized":"2023-12-08T08:22:20.544791+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:34.042026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":24,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.544256+0000","last_change":"2023-12-08T08:22:02.071841+0000","last_active":"2023-12-08T08:22:20.544256+0000","last_peered":"2023-12-08T08:22:20.544256+0000","last_clean":"2023-12-08T08:22:20.544256+0000","last_became_active":"2023-12-08T08:22:02.071531+0000","last_became_peered":"2023-12-08T08:22:02.071531+0000","last_unstale":"2023-12-08T08:22:20.544256+0000","last_undegraded":"2023-12-08T08:22:20.544256+0000","last_fullsized":"2023-12-08T08:22:20.544256+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:55:21.616638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.536082+0000","last_change":"2023-12-08T08:22:20.555398+0000","last_active":"2023-12-08T08:22:21.536082+0000","last_peered":"2023-12-08T08:22:21.536082+0000","last_clean":"2023-12-08T08:22:21.536082+0000","last_became_active":"2023-12-08T08:22:20.554707+0000","last_became_peered":"2023-12-08T08:22:20.554707+0000","last_unstale":"2023-12-08T08:22:21.536082+0000","last_undegraded":"2023-12-08T08:22:21.536082+0000","last_fullsized":"2023-12-08T08:22:21.536082+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:24.929944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.763721+0000","last_change":"2023-12-08T08:22:19.608599+0000","last_active":"2023-12-08T08:22:21.763721+0000","last_peered":"2023-12-08T08:22:21.763721+0000","last_clean":"2023-12-08T08:22:21.763721+0000","last_became_active":"2023-12-08T08:22:19.608165+0000","last_became_peered":"2023-12-08T08:22:19.608165+0000","last_unstale":"2023-12-08T08:22:21.763721+0000","last_undegraded":"2023-12-08T08:22:21.763721+0000","last_fullsized":"2023-12-08T08:22:21.763721+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:32:35.826009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.552678+0000","last_change":"2023-12-08T08:22:03.090890+0000","last_active":"2023-12-08T08:22:20.552678+0000","last_peered":"2023-12-08T08:22:20.552678+0000","last_clean":"2023-12-08T08:22:20.552678+0000","last_became_active":"2023-12-08T08:22:03.090648+0000","last_became_peered":"2023-12-08T08:22:03.090648+0000","last_unstale":"2023-12-08T08:22:20.552678+0000","last_undegraded":"2023-12-08T08:22:20.552678+0000","last_fullsized":"2023-12-08T08:22:20.552678+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:49:47.998533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.548522+0000","last_change":"2023-12-08T08:22:02.072612+0000","last_active":"2023-12-08T08:22:20.548522+0000","last_peered":"2023-12-08T08:22:20.548522+0000","last_clean":"2023-12-08T08:22:20.548522+0000","last_became_active":"2023-12-08T08:22:02.071308+0000","last_became_peered":"2023-12-08T08:22:02.071308+0000","last_unstale":"2023-12-08T08:22:20.548522+0000","last_undegraded":"2023-12-08T08:22:20.548522+0000","last_fullsized":"2023-12-08T08:22:20.548522+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:19:25.988530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.762558+0000","last_change":"2023-12-08T08:22:20.552027+0000","last_active":"2023-12-08T08:22:21.762558+0000","last_peered":"2023-12-08T08:22:21.762558+0000","last_clean":"2023-12-08T08:22:21.762558+0000","last_became_active":"2023-12-08T08:22:20.551767+0000","last_became_peered":"2023-12-08T08:22:20.551767+0000","last_unstale":"2023-12-08T08:22:21.762558+0000","last_undegraded":"2023-12-08T08:22:21.762558+0000","last_fullsized":"2023-12-08T08:22:21.762558+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:37:38.539298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.762315+0000","last_change":"2023-12-08T08:22:19.611951+0000","last_active":"2023-12-08T08:22:21.762315+0000","last_peered":"2023-12-08T08:22:21.762315+0000","last_clean":"2023-12-08T08:22:21.762315+0000","last_became_active":"2023-12-08T08:22:19.611645+0000","last_became_peered":"2023-12-08T08:22:19.611645+0000","last_unstale":"2023-12-08T08:22:21.762315+0000","last_undegraded":"2023-12-08T08:22:21.762315+0000","last_fullsized":"2023-12-08T08:22:21.762315+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:09:36.203647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.536969+0000","last_change":"2023-12-08T08:22:03.085089+0000","last_active":"2023-12-08T08:22:20.536969+0000","last_peered":"2023-12-08T08:22:20.536969+0000","last_clean":"2023-12-08T08:22:20.536969+0000","last_became_active":"2023-12-08T08:22:03.084765+0000","last_became_peered":"2023-12-08T08:22:03.084765+0000","last_unstale":"2023-12-08T08:22:20.536969+0000","last_undegraded":"2023-12-08T08:22:20.536969+0000","last_fullsized":"2023-12-08T08:22:20.536969+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:22:41.530364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.542407+0000","last_change":"2023-12-08T08:22:02.074304+0000","last_active":"2023-12-08T08:22:20.542407+0000","last_peered":"2023-12-08T08:22:20.542407+0000","last_clean":"2023-12-08T08:22:20.542407+0000","last_became_active":"2023-12-08T08:22:02.074007+0000","last_became_peered":"2023-12-08T08:22:02.074007+0000","last_unstale":"2023-12-08T08:22:20.542407+0000","last_undegraded":"2023-12-08T08:22:20.542407+0000","last_fullsized":"2023-12-08T08:22:20.542407+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:03:17.577934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.762616+0000","last_change":"2023-12-08T08:22:20.558985+0000","last_active":"2023-12-08T08:22:21.762616+0000","last_peered":"2023-12-08T08:22:21.762616+0000","last_clean":"2023-12-08T08:22:21.762616+0000","last_became_active":"2023-12-08T08:22:20.558407+0000","last_became_peered":"2023-12-08T08:22:20.558407+0000","last_unstale":"2023-12-08T08:22:21.762616+0000","last_undegraded":"2023-12-08T08:22:21.762616+0000","last_fullsized":"2023-12-08T08:22:21.762616+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:36:36.342946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.763950+0000","last_change":"2023-12-08T08:22:19.605936+0000","last_active":"2023-12-08T08:22:21.763950+0000","last_peered":"2023-12-08T08:22:21.763950+0000","last_clean":"2023-12-08T08:22:21.763950+0000","last_became_active":"2023-12-08T08:22:19.605578+0000","last_became_peered":"2023-12-08T08:22:19.605578+0000","last_unstale":"2023-12-08T08:22:21.763950+0000","last_undegraded":"2023-12-08T08:22:21.763950+0000","last_fullsized":"2023-12-08T08:22:21.763950+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:50.569139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.546430+0000","last_change":"2023-12-08T08:22:03.089470+0000","last_active":"2023-12-08T08:22:20.546430+0000","last_peered":"2023-12-08T08:22:20.546430+0000","last_clean":"2023-12-08T08:22:20.546430+0000","last_became_active":"2023-12-08T08:22:03.089134+0000","last_became_peered":"2023-12-08T08:22:03.089134+0000","last_unstale":"2023-12-08T08:22:20.546430+0000","last_undegraded":"2023-12-08T08:22:20.546430+0000","last_fullsized":"2023-12-08T08:22:20.546430+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:23:38.798779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.536791+0000","last_change":"2023-12-08T08:22:02.073388+0000","last_active":"2023-12-08T08:22:20.536791+0000","last_peered":"2023-12-08T08:22:20.536791+0000","last_clean":"2023-12-08T08:22:20.536791+0000","last_became_active":"2023-12-08T08:22:02.073107+0000","last_became_peered":"2023-12-08T08:22:02.073107+0000","last_unstale":"2023-12-08T08:22:20.536791+0000","last_undegraded":"2023-12-08T08:22:20.536791+0000","last_fullsized":"2023-12-08T08:22:20.536791+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:02:40.986075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.763465+0000","last_change":"2023-12-08T08:22:20.566126+0000","last_active":"2023-12-08T08:22:21.763465+0000","last_peered":"2023-12-08T08:22:21.763465+0000","last_clean":"2023-12-08T08:22:21.763465+0000","last_became_active":"2023-12-08T08:22:20.565805+0000","last_became_peered":"2023-12-08T08:22:20.565805+0000","last_unstale":"2023-12-08T08:22:21.763465+0000","last_undegraded":"2023-12-08T08:22:21.763465+0000","last_fullsized":"2023-12-08T08:22:21.763465+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:41.889619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.762366+0000","last_change":"2023-12-08T08:22:19.604544+0000","last_active":"2023-12-08T08:22:21.762366+0000","last_peered":"2023-12-08T08:22:21.762366+0000","last_clean":"2023-12-08T08:22:21.762366+0000","last_became_active":"2023-12-08T08:22:19.604275+0000","last_became_peered":"2023-12-08T08:22:19.604275+0000","last_unstale":"2023-12-08T08:22:21.762366+0000","last_undegraded":"2023-12-08T08:22:21.762366+0000","last_fullsized":"2023-12-08T08:22:21.762366+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:19:40.262173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.553500+0000","last_change":"2023-12-08T08:22:03.082904+0000","last_active":"2023-12-08T08:22:20.553500+0000","last_peered":"2023-12-08T08:22:20.553500+0000","last_clean":"2023-12-08T08:22:20.553500+0000","last_became_active":"2023-12-08T08:22:03.082553+0000","last_became_peered":"2023-12-08T08:22:03.082553+0000","last_unstale":"2023-12-08T08:22:20.553500+0000","last_undegraded":"2023-12-08T08:22:20.553500+0000","last_fullsized":"2023-12-08T08:22:20.553500+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:30:11.797254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.546512+0000","last_change":"2023-12-08T08:22:02.067383+0000","last_active":"2023-12-08T08:22:20.546512+0000","last_peered":"2023-12-08T08:22:20.546512+0000","last_clean":"2023-12-08T08:22:20.546512+0000","last_became_active":"2023-12-08T08:22:02.067094+0000","last_became_peered":"2023-12-08T08:22:02.067094+0000","last_unstale":"2023-12-08T08:22:20.546512+0000","last_undegraded":"2023-12-08T08:22:20.546512+0000","last_fullsized":"2023-12-08T08:22:20.546512+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:22:40.527797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.760372+0000","last_change":"2023-12-08T08:22:20.557745+0000","last_active":"2023-12-08T08:22:21.760372+0000","last_peered":"2023-12-08T08:22:21.760372+0000","last_clean":"2023-12-08T08:22:21.760372+0000","last_became_active":"2023-12-08T08:22:20.557279+0000","last_became_peered":"2023-12-08T08:22:20.557279+0000","last_unstale":"2023-12-08T08:22:21.760372+0000","last_undegraded":"2023-12-08T08:22:21.760372+0000","last_fullsized":"2023-12-08T08:22:21.760372+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:51:12.808083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.539887+0000","last_change":"2023-12-08T08:22:19.604102+0000","last_active":"2023-12-08T08:22:21.539887+0000","last_peered":"2023-12-08T08:22:21.539887+0000","last_clean":"2023-12-08T08:22:21.539887+0000","last_became_active":"2023-12-08T08:22:19.603832+0000","last_became_peered":"2023-12-08T08:22:19.603832+0000","last_unstale":"2023-12-08T08:22:21.539887+0000","last_undegraded":"2023-12-08T08:22:21.539887+0000","last_fullsized":"2023-12-08T08:22:21.539887+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:28:06.163223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.537538+0000","last_change":"2023-12-08T08:22:03.080977+0000","last_active":"2023-12-08T08:22:20.537538+0000","last_peered":"2023-12-08T08:22:20.537538+0000","last_clean":"2023-12-08T08:22:20.537538+0000","last_became_active":"2023-12-08T08:22:03.080612+0000","last_became_peered":"2023-12-08T08:22:03.080612+0000","last_unstale":"2023-12-08T08:22:20.537538+0000","last_undegraded":"2023-12-08T08:22:20.537538+0000","last_fullsized":"2023-12-08T08:22:20.537538+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:34.042026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.546052+0000","last_change":"2023-12-08T08:22:02.055138+0000","last_active":"2023-12-08T08:22:20.546052+0000","last_peered":"2023-12-08T08:22:20.546052+0000","last_clean":"2023-12-08T08:22:20.546052+0000","last_became_active":"2023-12-08T08:22:02.054797+0000","last_became_peered":"2023-12-08T08:22:02.054797+0000","last_unstale":"2023-12-08T08:22:20.546052+0000","last_undegraded":"2023-12-08T08:22:20.546052+0000","last_fullsized":"2023-12-08T08:22:20.546052+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:20:34.221617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.760572+0000","last_change":"2023-12-08T08:22:20.558951+0000","last_active":"2023-12-08T08:22:21.760572+0000","last_peered":"2023-12-08T08:22:21.760572+0000","last_clean":"2023-12-08T08:22:21.760572+0000","last_became_active":"2023-12-08T08:22:20.558677+0000","last_became_peered":"2023-12-08T08:22:20.558677+0000","last_unstale":"2023-12-08T08:22:21.760572+0000","last_undegraded":"2023-12-08T08:22:21.760572+0000","last_fullsized":"2023-12-08T08:22:21.760572+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:42:40.614464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.759788+0000","last_change":"2023-12-08T08:22:19.609197+0000","last_active":"2023-12-08T08:22:21.759788+0000","last_peered":"2023-12-08T08:22:21.759788+0000","last_clean":"2023-12-08T08:22:21.759788+0000","last_became_active":"2023-12-08T08:22:19.608932+0000","last_became_peered":"2023-12-08T08:22:19.608932+0000","last_unstale":"2023-12-08T08:22:21.759788+0000","last_undegraded":"2023-12-08T08:22:21.759788+0000","last_fullsized":"2023-12-08T08:22:21.759788+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:59:52.635279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.547885+0000","last_change":"2023-12-08T08:22:03.084160+0000","last_active":"2023-12-08T08:22:20.547885+0000","last_peered":"2023-12-08T08:22:20.547885+0000","last_clean":"2023-12-08T08:22:20.547885+0000","last_became_active":"2023-12-08T08:22:03.083881+0000","last_became_peered":"2023-12-08T08:22:03.083881+0000","last_unstale":"2023-12-08T08:22:20.547885+0000","last_undegraded":"2023-12-08T08:22:20.547885+0000","last_fullsized":"2023-12-08T08:22:20.547885+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:30:11.797254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.535574+0000","last_change":"2023-12-08T08:22:02.072456+0000","last_active":"2023-12-08T08:22:20.535574+0000","last_peered":"2023-12-08T08:22:20.535574+0000","last_clean":"2023-12-08T08:22:20.535574+0000","last_became_active":"2023-12-08T08:22:02.072146+0000","last_became_peered":"2023-12-08T08:22:02.072146+0000","last_unstale":"2023-12-08T08:22:20.535574+0000","last_undegraded":"2023-12-08T08:22:20.535574+0000","last_fullsized":"2023-12-08T08:22:20.535574+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:39:09.598144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.760606+0000","last_change":"2023-12-08T08:22:20.549064+0000","last_active":"2023-12-08T08:22:21.760606+0000","last_peered":"2023-12-08T08:22:21.760606+0000","last_clean":"2023-12-08T08:22:21.760606+0000","last_became_active":"2023-12-08T08:22:20.548776+0000","last_became_peered":"2023-12-08T08:22:20.548776+0000","last_unstale":"2023-12-08T08:22:21.760606+0000","last_undegraded":"2023-12-08T08:22:21.760606+0000","last_fullsized":"2023-12-08T08:22:21.760606+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:06:55.257863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.762552+0000","last_change":"2023-12-08T08:22:19.607818+0000","last_active":"2023-12-08T08:22:21.762552+0000","last_peered":"2023-12-08T08:22:21.762552+0000","last_clean":"2023-12-08T08:22:21.762552+0000","last_became_active":"2023-12-08T08:22:19.607553+0000","last_became_peered":"2023-12-08T08:22:19.607553+0000","last_unstale":"2023-12-08T08:22:21.762552+0000","last_undegraded":"2023-12-08T08:22:21.762552+0000","last_fullsized":"2023-12-08T08:22:21.762552+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:50:04.525646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.550166+0000","last_change":"2023-12-08T08:22:03.082233+0000","last_active":"2023-12-08T08:22:20.550166+0000","last_peered":"2023-12-08T08:22:20.550166+0000","last_clean":"2023-12-08T08:22:20.550166+0000","last_became_active":"2023-12-08T08:22:03.082064+0000","last_became_peered":"2023-12-08T08:22:03.082064+0000","last_unstale":"2023-12-08T08:22:20.550166+0000","last_undegraded":"2023-12-08T08:22:20.550166+0000","last_fullsized":"2023-12-08T08:22:20.550166+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:09:02.981325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.536412+0000","last_change":"2023-12-08T08:22:02.065223+0000","last_active":"2023-12-08T08:22:20.536412+0000","last_peered":"2023-12-08T08:22:20.536412+0000","last_clean":"2023-12-08T08:22:20.536412+0000","last_became_active":"2023-12-08T08:22:02.064829+0000","last_became_peered":"2023-12-08T08:22:02.064829+0000","last_unstale":"2023-12-08T08:22:20.536412+0000","last_undegraded":"2023-12-08T08:22:20.536412+0000","last_fullsized":"2023-12-08T08:22:20.536412+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:37:19.999893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.761610+0000","last_change":"2023-12-08T08:22:20.562905+0000","last_active":"2023-12-08T08:22:21.761610+0000","last_peered":"2023-12-08T08:22:21.761610+0000","last_clean":"2023-12-08T08:22:21.761610+0000","last_became_active":"2023-12-08T08:22:20.562613+0000","last_became_peered":"2023-12-08T08:22:20.562613+0000","last_unstale":"2023-12-08T08:22:21.761610+0000","last_undegraded":"2023-12-08T08:22:21.761610+0000","last_fullsized":"2023-12-08T08:22:21.761610+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:34:13.600166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.762579+0000","last_change":"2023-12-08T08:22:19.605465+0000","last_active":"2023-12-08T08:22:21.762579+0000","last_peered":"2023-12-08T08:22:21.762579+0000","last_clean":"2023-12-08T08:22:21.762579+0000","last_became_active":"2023-12-08T08:22:19.605153+0000","last_became_peered":"2023-12-08T08:22:19.605153+0000","last_unstale":"2023-12-08T08:22:21.762579+0000","last_undegraded":"2023-12-08T08:22:21.762579+0000","last_fullsized":"2023-12-08T08:22:21.762579+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:43:20.250191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.537111+0000","last_change":"2023-12-08T08:22:03.078777+0000","last_active":"2023-12-08T08:22:20.537111+0000","last_peered":"2023-12-08T08:22:20.537111+0000","last_clean":"2023-12-08T08:22:20.537111+0000","last_became_active":"2023-12-08T08:22:03.078459+0000","last_became_peered":"2023-12-08T08:22:03.078459+0000","last_unstale":"2023-12-08T08:22:20.537111+0000","last_undegraded":"2023-12-08T08:22:20.537111+0000","last_fullsized":"2023-12-08T08:22:20.537111+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:09:22.027038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.538564+0000","last_change":"2023-12-08T08:22:02.057964+0000","last_active":"2023-12-08T08:22:20.538564+0000","last_peered":"2023-12-08T08:22:20.538564+0000","last_clean":"2023-12-08T08:22:20.538564+0000","last_became_active":"2023-12-08T08:22:02.057677+0000","last_became_peered":"2023-12-08T08:22:02.057677+0000","last_unstale":"2023-12-08T08:22:20.538564+0000","last_undegraded":"2023-12-08T08:22:20.538564+0000","last_fullsized":"2023-12-08T08:22:20.538564+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:59:29.971100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.762787+0000","last_change":"2023-12-08T08:22:20.569806+0000","last_active":"2023-12-08T08:22:21.762787+0000","last_peered":"2023-12-08T08:22:21.762787+0000","last_clean":"2023-12-08T08:22:21.762787+0000","last_became_active":"2023-12-08T08:22:20.569492+0000","last_became_peered":"2023-12-08T08:22:20.569492+0000","last_unstale":"2023-12-08T08:22:21.762787+0000","last_undegraded":"2023-12-08T08:22:21.762787+0000","last_fullsized":"2023-12-08T08:22:21.762787+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:17:14.368036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.760249+0000","last_change":"2023-12-08T08:22:19.610062+0000","last_active":"2023-12-08T08:22:21.760249+0000","last_peered":"2023-12-08T08:22:21.760249+0000","last_clean":"2023-12-08T08:22:21.760249+0000","last_became_active":"2023-12-08T08:22:19.609768+0000","last_became_peered":"2023-12-08T08:22:19.609768+0000","last_unstale":"2023-12-08T08:22:21.760249+0000","last_undegraded":"2023-12-08T08:22:21.760249+0000","last_fullsized":"2023-12-08T08:22:21.760249+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:23:55.325892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.537080+0000","last_change":"2023-12-08T08:22:03.087590+0000","last_active":"2023-12-08T08:22:20.537080+0000","last_peered":"2023-12-08T08:22:20.537080+0000","last_clean":"2023-12-08T08:22:20.537080+0000","last_became_active":"2023-12-08T08:22:03.087219+0000","last_became_peered":"2023-12-08T08:22:03.087219+0000","last_unstale":"2023-12-08T08:22:20.537080+0000","last_undegraded":"2023-12-08T08:22:20.537080+0000","last_fullsized":"2023-12-08T08:22:20.537080+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:14:25.475662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.542490+0000","last_change":"2023-12-08T08:22:02.061620+0000","last_active":"2023-12-08T08:22:20.542490+0000","last_peered":"2023-12-08T08:22:20.542490+0000","last_clean":"2023-12-08T08:22:20.542490+0000","last_became_active":"2023-12-08T08:22:02.061329+0000","last_became_peered":"2023-12-08T08:22:02.061329+0000","last_unstale":"2023-12-08T08:22:20.542490+0000","last_undegraded":"2023-12-08T08:22:20.542490+0000","last_fullsized":"2023-12-08T08:22:20.542490+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:14:24.473095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.761743+0000","last_change":"2023-12-08T08:22:20.553794+0000","last_active":"2023-12-08T08:22:21.761743+0000","last_peered":"2023-12-08T08:22:21.761743+0000","last_clean":"2023-12-08T08:22:21.761743+0000","last_became_active":"2023-12-08T08:22:20.553508+0000","last_became_peered":"2023-12-08T08:22:20.553508+0000","last_unstale":"2023-12-08T08:22:21.761743+0000","last_undegraded":"2023-12-08T08:22:21.761743+0000","last_fullsized":"2023-12-08T08:22:21.761743+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:07:06.327457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.764008+0000","last_change":"2023-12-08T08:22:19.605756+0000","last_active":"2023-12-08T08:22:21.764008+0000","last_peered":"2023-12-08T08:22:21.764008+0000","last_clean":"2023-12-08T08:22:21.764008+0000","last_became_active":"2023-12-08T08:22:19.605214+0000","last_became_peered":"2023-12-08T08:22:19.605214+0000","last_unstale":"2023-12-08T08:22:21.764008+0000","last_undegraded":"2023-12-08T08:22:21.764008+0000","last_fullsized":"2023-12-08T08:22:21.764008+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:23.920219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.537314+0000","last_change":"2023-12-08T08:22:03.080218+0000","last_active":"2023-12-08T08:22:20.537314+0000","last_peered":"2023-12-08T08:22:20.537314+0000","last_clean":"2023-12-08T08:22:20.537314+0000","last_became_active":"2023-12-08T08:22:03.079973+0000","last_became_peered":"2023-12-08T08:22:03.079973+0000","last_unstale":"2023-12-08T08:22:20.537314+0000","last_undegraded":"2023-12-08T08:22:20.537314+0000","last_fullsized":"2023-12-08T08:22:20.537314+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:25.833069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.547716+0000","last_change":"2023-12-08T08:22:02.059762+0000","last_active":"2023-12-08T08:22:20.547716+0000","last_peered":"2023-12-08T08:22:20.547716+0000","last_clean":"2023-12-08T08:22:20.547716+0000","last_became_active":"2023-12-08T08:22:02.059447+0000","last_became_peered":"2023-12-08T08:22:02.059447+0000","last_unstale":"2023-12-08T08:22:20.547716+0000","last_undegraded":"2023-12-08T08:22:20.547716+0000","last_fullsized":"2023-12-08T08:22:20.547716+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:32:25.205810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.540548+0000","last_change":"2023-12-08T08:22:20.543380+0000","last_active":"2023-12-08T08:22:21.540548+0000","last_peered":"2023-12-08T08:22:21.540548+0000","last_clean":"2023-12-08T08:22:21.540548+0000","last_became_active":"2023-12-08T08:22:20.543107+0000","last_became_peered":"2023-12-08T08:22:20.543107+0000","last_unstale":"2023-12-08T08:22:21.540548+0000","last_undegraded":"2023-12-08T08:22:21.540548+0000","last_fullsized":"2023-12-08T08:22:21.540548+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:01:49.093977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:22.130188+0000","last_change":"2023-12-08T08:22:19.609680+0000","last_active":"2023-12-08T08:22:22.130188+0000","last_peered":"2023-12-08T08:22:22.130188+0000","last_clean":"2023-12-08T08:22:22.130188+0000","last_became_active":"2023-12-08T08:22:19.609361+0000","last_became_peered":"2023-12-08T08:22:19.609361+0000","last_unstale":"2023-12-08T08:22:22.130188+0000","last_undegraded":"2023-12-08T08:22:22.130188+0000","last_fullsized":"2023-12-08T08:22:22.130188+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:55:43.456628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.542787+0000","last_change":"2023-12-08T08:22:03.081034+0000","last_active":"2023-12-08T08:22:20.542787+0000","last_peered":"2023-12-08T08:22:20.542787+0000","last_clean":"2023-12-08T08:22:20.542787+0000","last_became_active":"2023-12-08T08:22:03.078866+0000","last_became_peered":"2023-12-08T08:22:03.078866+0000","last_unstale":"2023-12-08T08:22:20.542787+0000","last_undegraded":"2023-12-08T08:22:20.542787+0000","last_fullsized":"2023-12-08T08:22:20.542787+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:32:22.573403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.537510+0000","last_change":"2023-12-08T08:22:02.069094+0000","last_active":"2023-12-08T08:22:20.537510+0000","last_peered":"2023-12-08T08:22:20.537510+0000","last_clean":"2023-12-08T08:22:20.537510+0000","last_became_active":"2023-12-08T08:22:02.068768+0000","last_became_peered":"2023-12-08T08:22:02.068768+0000","last_unstale":"2023-12-08T08:22:20.537510+0000","last_undegraded":"2023-12-08T08:22:20.537510+0000","last_fullsized":"2023-12-08T08:22:20.537510+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:01:20.857568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.535880+0000","last_change":"2023-12-08T08:22:20.550027+0000","last_active":"2023-12-08T08:22:21.535880+0000","last_peered":"2023-12-08T08:22:21.535880+0000","last_clean":"2023-12-08T08:22:21.535880+0000","last_became_active":"2023-12-08T08:22:20.549705+0000","last_became_peered":"2023-12-08T08:22:20.549705+0000","last_unstale":"2023-12-08T08:22:21.535880+0000","last_undegraded":"2023-12-08T08:22:21.535880+0000","last_fullsized":"2023-12-08T08:22:21.535880+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:32:36.835734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.761271+0000","last_change":"2023-12-08T08:22:19.603385+0000","last_active":"2023-12-08T08:22:21.761271+0000","last_peered":"2023-12-08T08:22:21.761271+0000","last_clean":"2023-12-08T08:22:21.761271+0000","last_became_active":"2023-12-08T08:22:19.602981+0000","last_became_peered":"2023-12-08T08:22:19.602981+0000","last_unstale":"2023-12-08T08:22:21.761271+0000","last_undegraded":"2023-12-08T08:22:21.761271+0000","last_fullsized":"2023-12-08T08:22:21.761271+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:19:43.518210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.545370+0000","last_change":"2023-12-08T08:22:03.088146+0000","last_active":"2023-12-08T08:22:20.545370+0000","last_peered":"2023-12-08T08:22:20.545370+0000","last_clean":"2023-12-08T08:22:20.545370+0000","last_became_active":"2023-12-08T08:22:03.087857+0000","last_became_peered":"2023-12-08T08:22:03.087857+0000","last_unstale":"2023-12-08T08:22:20.545370+0000","last_undegraded":"2023-12-08T08:22:20.545370+0000","last_fullsized":"2023-12-08T08:22:20.545370+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:55:26.929515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.535626+0000","last_change":"2023-12-08T08:22:02.064371+0000","last_active":"2023-12-08T08:22:20.535626+0000","last_peered":"2023-12-08T08:22:20.535626+0000","last_clean":"2023-12-08T08:22:20.535626+0000","last_became_active":"2023-12-08T08:22:02.063996+0000","last_became_peered":"2023-12-08T08:22:02.063996+0000","last_unstale":"2023-12-08T08:22:20.535626+0000","last_undegraded":"2023-12-08T08:22:20.535626+0000","last_fullsized":"2023-12-08T08:22:20.535626+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:44.535120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.761461+0000","last_change":"2023-12-08T08:22:20.555818+0000","last_active":"2023-12-08T08:22:21.761461+0000","last_peered":"2023-12-08T08:22:21.761461+0000","last_clean":"2023-12-08T08:22:21.761461+0000","last_became_active":"2023-12-08T08:22:20.554949+0000","last_became_peered":"2023-12-08T08:22:20.554949+0000","last_unstale":"2023-12-08T08:22:21.761461+0000","last_undegraded":"2023-12-08T08:22:21.761461+0000","last_fullsized":"2023-12-08T08:22:21.761461+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:20:52.761022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.761160+0000","last_change":"2023-12-08T08:22:19.607580+0000","last_active":"2023-12-08T08:22:21.761160+0000","last_peered":"2023-12-08T08:22:21.761160+0000","last_clean":"2023-12-08T08:22:21.761160+0000","last_became_active":"2023-12-08T08:22:19.607279+0000","last_became_peered":"2023-12-08T08:22:19.607279+0000","last_unstale":"2023-12-08T08:22:21.761160+0000","last_undegraded":"2023-12-08T08:22:21.761160+0000","last_fullsized":"2023-12-08T08:22:21.761160+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:14:42.002775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.550464+0000","last_change":"2023-12-08T08:22:03.096910+0000","last_active":"2023-12-08T08:22:20.550464+0000","last_peered":"2023-12-08T08:22:20.550464+0000","last_clean":"2023-12-08T08:22:20.550464+0000","last_became_active":"2023-12-08T08:22:03.096724+0000","last_became_peered":"2023-12-08T08:22:03.096724+0000","last_unstale":"2023-12-08T08:22:20.550464+0000","last_undegraded":"2023-12-08T08:22:20.550464+0000","last_fullsized":"2023-12-08T08:22:20.550464+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:32:19.298896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.545610+0000","last_change":"2023-12-08T08:22:02.063148+0000","last_active":"2023-12-08T08:22:20.545610+0000","last_peered":"2023-12-08T08:22:20.545610+0000","last_clean":"2023-12-08T08:22:20.545610+0000","last_became_active":"2023-12-08T08:22:02.062860+0000","last_became_peered":"2023-12-08T08:22:02.062860+0000","last_unstale":"2023-12-08T08:22:20.545610+0000","last_undegraded":"2023-12-08T08:22:20.545610+0000","last_fullsized":"2023-12-08T08:22:20.545610+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:02.472465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.761603+0000","last_change":"2023-12-08T08:22:20.559970+0000","last_active":"2023-12-08T08:22:21.761603+0000","last_peered":"2023-12-08T08:22:21.761603+0000","last_clean":"2023-12-08T08:22:21.761603+0000","last_became_active":"2023-12-08T08:22:20.559659+0000","last_became_peered":"2023-12-08T08:22:20.559659+0000","last_unstale":"2023-12-08T08:22:21.761603+0000","last_undegraded":"2023-12-08T08:22:21.761603+0000","last_fullsized":"2023-12-08T08:22:21.761603+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:34:06.920383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.761724+0000","last_change":"2023-12-08T08:22:19.603129+0000","last_active":"2023-12-08T08:22:21.761724+0000","last_peered":"2023-12-08T08:22:21.761724+0000","last_clean":"2023-12-08T08:22:21.761724+0000","last_became_active":"2023-12-08T08:22:19.602939+0000","last_became_peered":"2023-12-08T08:22:19.602939+0000","last_unstale":"2023-12-08T08:22:21.761724+0000","last_undegraded":"2023-12-08T08:22:21.761724+0000","last_fullsized":"2023-12-08T08:22:21.761724+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:50:09.463105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.535421+0000","last_change":"2023-12-08T08:22:03.078867+0000","last_active":"2023-12-08T08:22:20.535421+0000","last_peered":"2023-12-08T08:22:20.535421+0000","last_clean":"2023-12-08T08:22:20.535421+0000","last_became_active":"2023-12-08T08:22:03.078535+0000","last_became_peered":"2023-12-08T08:22:03.078535+0000","last_unstale":"2023-12-08T08:22:20.535421+0000","last_undegraded":"2023-12-08T08:22:20.535421+0000","last_fullsized":"2023-12-08T08:22:20.535421+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:17:42.639774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.535485+0000","last_change":"2023-12-08T08:22:02.055697+0000","last_active":"2023-12-08T08:22:20.535485+0000","last_peered":"2023-12-08T08:22:20.535485+0000","last_clean":"2023-12-08T08:22:20.535485+0000","last_became_active":"2023-12-08T08:22:02.055412+0000","last_became_peered":"2023-12-08T08:22:02.055412+0000","last_unstale":"2023-12-08T08:22:20.535485+0000","last_undegraded":"2023-12-08T08:22:20.535485+0000","last_fullsized":"2023-12-08T08:22:20.535485+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:32:25.205810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.762201+0000","last_change":"2023-12-08T08:22:20.566015+0000","last_active":"2023-12-08T08:22:21.762201+0000","last_peered":"2023-12-08T08:22:21.762201+0000","last_clean":"2023-12-08T08:22:21.762201+0000","last_became_active":"2023-12-08T08:22:20.565701+0000","last_became_peered":"2023-12-08T08:22:20.565701+0000","last_unstale":"2023-12-08T08:22:21.762201+0000","last_undegraded":"2023-12-08T08:22:21.762201+0000","last_fullsized":"2023-12-08T08:22:21.762201+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:32:40.110240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.536611+0000","last_change":"2023-12-08T08:22:19.602683+0000","last_active":"2023-12-08T08:22:21.536611+0000","last_peered":"2023-12-08T08:22:21.536611+0000","last_clean":"2023-12-08T08:22:21.536611+0000","last_became_active":"2023-12-08T08:22:19.602403+0000","last_became_peered":"2023-12-08T08:22:19.602403+0000","last_unstale":"2023-12-08T08:22:21.536611+0000","last_undegraded":"2023-12-08T08:22:21.536611+0000","last_fullsized":"2023-12-08T08:22:21.536611+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:40:48.521056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.545077+0000","last_change":"2023-12-08T08:22:03.083678+0000","last_active":"2023-12-08T08:22:20.545077+0000","last_peered":"2023-12-08T08:22:20.545077+0000","last_clean":"2023-12-08T08:22:20.545077+0000","last_became_active":"2023-12-08T08:22:03.079108+0000","last_became_peered":"2023-12-08T08:22:03.079108+0000","last_unstale":"2023-12-08T08:22:20.545077+0000","last_undegraded":"2023-12-08T08:22:20.545077+0000","last_fullsized":"2023-12-08T08:22:20.545077+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:13:57.755476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.544641+0000","last_change":"2023-12-08T08:22:02.065076+0000","last_active":"2023-12-08T08:22:20.544641+0000","last_peered":"2023-12-08T08:22:20.544641+0000","last_clean":"2023-12-08T08:22:20.544641+0000","last_became_active":"2023-12-08T08:22:02.064723+0000","last_became_peered":"2023-12-08T08:22:02.064723+0000","last_unstale":"2023-12-08T08:22:20.544641+0000","last_undegraded":"2023-12-08T08:22:20.544641+0000","last_fullsized":"2023-12-08T08:22:20.544641+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:27.429215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.760082+0000","last_change":"2023-12-08T08:22:20.555975+0000","last_active":"2023-12-08T08:22:21.760082+0000","last_peered":"2023-12-08T08:22:21.760082+0000","last_clean":"2023-12-08T08:22:21.760082+0000","last_became_active":"2023-12-08T08:22:20.555680+0000","last_became_peered":"2023-12-08T08:22:20.555680+0000","last_unstale":"2023-12-08T08:22:21.760082+0000","last_undegraded":"2023-12-08T08:22:21.760082+0000","last_fullsized":"2023-12-08T08:22:21.760082+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:19.571185+0000","last_clean_scrub_stamp":"2023-12-08T08:22:19.571185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:19:37.615696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-08T08:22:21.762313+0000","last_change":"2023-12-08T08:22:19.608048+0000","last_active":"2023-12-08T08:22:21.762313+0000","last_peered":"2023-12-08T08:22:21.762313+0000","last_clean":"2023-12-08T08:22:21.762313+0000","last_became_active":"2023-12-08T08:22:19.607792+0000","last_became_peered":"2023-12-08T08:22:19.607792+0000","last_unstale":"2023-12-08T08:22:21.762313+0000","last_undegraded":"2023-12-08T08:22:21.762313+0000","last_fullsized":"2023-12-08T08:22:21.762313+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:18.561460+0000","last_clean_scrub_stamp":"2023-12-08T08:22:18.561460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:28:58.256427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.544597+0000","last_change":"2023-12-08T08:22:03.074226+0000","last_active":"2023-12-08T08:22:20.544597+0000","last_peered":"2023-12-08T08:22:20.544597+0000","last_clean":"2023-12-08T08:22:20.544597+0000","last_became_active":"2023-12-08T08:22:03.073967+0000","last_became_peered":"2023-12-08T08:22:03.073967+0000","last_unstale":"2023-12-08T08:22:20.544597+0000","last_undegraded":"2023-12-08T08:22:20.544597+0000","last_fullsized":"2023-12-08T08:22:20.544597+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:02.034347+0000","last_clean_scrub_stamp":"2023-12-08T08:22:02.034347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:09:19.676534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.547917+0000","last_change":"2023-12-08T08:22:02.066497+0000","last_active":"2023-12-08T08:22:20.547917+0000","last_peered":"2023-12-08T08:22:20.547917+0000","last_clean":"2023-12-08T08:22:20.547917+0000","last_became_active":"2023-12-08T08:22:02.065532+0000","last_became_peered":"2023-12-08T08:22:02.065532+0000","last_unstale":"2023-12-08T08:22:20.547917+0000","last_undegraded":"2023-12-08T08:22:20.547917+0000","last_fullsized":"2023-12-08T08:22:20.547917+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:01.031780+0000","last_clean_scrub_stamp":"2023-12-08T08:22:01.031780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:44:58.303638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":193,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-08T08:22:20.544313+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:22:20.544313+0000","last_peered":"2023-12-08T08:22:20.544313+0000","last_clean":"2023-12-08T08:22:20.544313+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:22:20.544313+0000","last_undegraded":"2023-12-08T08:22:20.544313+0000","last_fullsized":"2023-12-08T08:22:20.544313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":729088,"data_stored":871826,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89900000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.85299999999999998,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85999999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89600000000000002,"5min":1.446,"15min":1.446},"last":0.72299999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.71999999999999997,"15min":0.72899999999999998},"min":{"1min":0.52100000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.871,"5min":1.379,"15min":1.379},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.47599999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.84599999999999997,"5min":1.706,"15min":1.706},"last":0.745}]},{"osd":3,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.751,"15min":0.76300000000000001},"min":{"1min":0.54500000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.88700000000000001,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.56699999999999995,"5min":0.496,"15min":0.496},"max":{"1min":0.83099999999999996,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.46899999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.90000000000000002,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.72599999999999998,"15min":0.74199999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83999999999999997,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.67700000000000005}]},{"osd":5,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.77500000000000002,"15min":0.79500000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81399999999999995,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.78500000000000003,"15min":0.80200000000000005},"min":{"1min":0.499,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93300000000000005,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.65700000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.84799999999999998,"15min":0.86499999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.95899999999999996,"5min":1.573,"15min":1.573},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.80000000000000004,"15min":0.81499999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91100000000000003,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.80500000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":280774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66800000000000004,"15min":0.66500000000000004},"min":{"1min":0.41399999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86699999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.58199999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.90700000000000003,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.82599999999999996}]},{"osd":1,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.72099999999999997,"15min":0.71799999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.74099999999999999,"15min":0.73599999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.71999999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.82999999999999996,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.745,"15min":0.749},"min":{"1min":0.51500000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91300000000000003,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.86099999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.55900000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.85299999999999998,"5min":0.998,"15min":0.998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75,"15min":0.753},"min":{"1min":0.497,"5min":0.434,"15min":0.434},"max":{"1min":0.878,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.79900000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.71599999999999997,"15min":0.73099999999999998},"min":{"1min":0.46400000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.98799999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.748},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.748,"15min":0.76500000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.95199999999999996,"5min":1.014,"15min":1.014},"last":0.60899999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.78100000000000003,"15min":0.80100000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.006,"5min":1.091,"15min":1.091},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.83299999999999996,"15min":0.84799999999999998},"min":{"1min":0.54800000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1419999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.89600000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.80300000000000005,"15min":0.82199999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.03,"5min":1.04,"15min":1.04},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.877,"15min":0.90300000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0740000000000001,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.84499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":659456,"data_stored":281424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.747,"5min":1.081,"15min":1.081},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.90300000000000002,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.73399999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.68999999999999995,"15min":0.68000000000000005},"min":{"1min":0.49399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.002,"5min":1.194,"15min":1.194},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70599999999999996,"15min":0.71499999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.879,"5min":1.143,"15min":1.143},"last":0.82599999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.69799999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.98099999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72899999999999998,"15min":0.73299999999999998},"min":{"1min":0.52400000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.92200000000000004,"5min":1.101,"15min":1.101},"last":0.76000000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.74099999999999999,"15min":0.746},"min":{"1min":0.47399999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0189999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.76300000000000001,"15min":0.753},"min":{"1min":0.61599999999999999,"5min":0.5,"15min":0.5},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.92300000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82099999999999995,"5min":1.01,"15min":1.01},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94099999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":1.048}]},{"osd":6,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77900000000000003,"15min":0.78600000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93999999999999995,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84899999999999998,"5min":1.073,"15min":1.073},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78800000000000003,"15min":0.79400000000000004},"min":{"1min":0.51000000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.995,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.85299999999999998,"15min":0.86099999999999999},"min":{"1min":0.54400000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.97699999999999998,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":1.0800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":663552,"data_stored":283859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69099999999999995,"15min":0.69699999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.95599999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.502},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66400000000000003,"15min":0.66200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.93799999999999994}]},{"osd":1,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.45400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.018,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51000000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90100000000000002,"5min":1.002,"15min":1.002},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.68500000000000005,"15min":0.69099999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88100000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.72499999999999998,"15min":0.71999999999999997},"min":{"1min":0.55700000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.66500000000000004}]},{"osd":3,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.751,"15min":0.755},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.92200000000000004,"5min":1.359,"15min":1.359},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.77700000000000002,"15min":0.79300000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93700000000000006,"5min":1.232,"15min":1.232},"last":0.83999999999999997}]},{"osd":5,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.66500000000000004,"15min":0.67500000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85599999999999998,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.77000000000000002,"15min":0.78900000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.995,"5min":1.091,"15min":1.091},"last":0.90600000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.70699999999999996,"15min":0.72199999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78400000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78800000000000003,"15min":0.79800000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93400000000000005,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.98199999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.81999999999999995,"15min":0.83199999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.96699999999999997,"5min":1.246,"15min":1.246},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.79200000000000004,"15min":0.80900000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97599999999999998,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.004}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":663552,"data_stored":280850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.42299999999999999,"15min":0.433},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.46500000000000002,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.379},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.45900000000000002,"15min":0.46400000000000002},"min":{"1min":0.33500000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.54900000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.496}]},{"osd":1,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.435,"15min":0.436},"min":{"1min":0.308,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.49299999999999999,"15min":0.497},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.433}]},{"osd":2,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.51600000000000001,"15min":0.52400000000000002},"min":{"1min":0.39600000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.64000000000000001,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.53600000000000003,"15min":0.54300000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.77100000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.47699999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.56599999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94099999999999995,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.747,"15min":0.76100000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0349999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.58199999999999996}]},{"osd":5,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.72799999999999998,"15min":0.73799999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.87,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.625},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.75800000000000001,"15min":0.77000000000000002},"min":{"1min":0.53000000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91600000000000004,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.51100000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.79300000000000004,"15min":0.80700000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.026,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.79000000000000004,"15min":0.80200000000000005},"min":{"1min":0.58699999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.89400000000000002,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.61699999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.755},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90400000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.77200000000000002,"15min":0.78300000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.86799999999999999,"5min":1.121,"15min":1.121},"last":0.65700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":282350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.39400000000000002,"15min":0.40200000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52500000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.52200000000000002,"15min":0.54000000000000004},"min":{"1min":0.32300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.63300000000000001,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.315}]},{"osd":1,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.47099999999999997,"15min":0.47399999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.67900000000000005,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.47399999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.56899999999999995,"15min":0.58599999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70399999999999996,"5min":3.008,"15min":3.008},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48499999999999999,"15min":0.48699999999999999},"min":{"1min":0.39200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.59499999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.51900000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.80300000000000005,"15min":0.82299999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92500000000000004,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.75800000000000001,"15min":0.76500000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93000000000000005,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.59899999999999998}]},{"osd":5,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76500000000000001,"15min":0.77100000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.05,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.81299999999999994,"15min":0.83699999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0129999999999999,"5min":3.637,"15min":3.637},"last":0.68600000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.78500000000000003,"15min":0.79600000000000004},"min":{"1min":0.55800000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.96899999999999997,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.629},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.78500000000000003,"15min":0.79700000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.002,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.71699999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.876,"15min":0.90900000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.83999999999999997,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.83199999999999996,"15min":0.84099999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.997,"5min":1.766,"15min":1.766},"last":0.76100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":283000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.65000000000000002,"15min":0.69299999999999995},"min":{"1min":0.29699999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.69899999999999995,"5min":5.2210000000000001,"15min":5.2210000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.83099999999999996,"15min":0.89100000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69499999999999995,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.435}]},{"osd":2,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.80600000000000005,"15min":0.87},"min":{"1min":0.309,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.52900000000000003,"5min":8.2070000000000007,"15min":8.2070000000000007},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.68200000000000005,"15min":0.71999999999999997},"min":{"1min":0.34200000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.70899999999999996,"5min":4.351,"15min":4.351},"last":0.63}]},{"osd":3,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.91000000000000003,"15min":0.97599999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.74199999999999999,"5min":8.1479999999999997,"15min":8.1479999999999997},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.746,"15min":0.79300000000000004},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63900000000000001,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.374}]},{"osd":4,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.98399999999999999,"15min":1.036},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.95499999999999996,"5min":4.8470000000000004,"15min":4.8470000000000004},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":1.0549999999999999,"15min":1.1080000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.97599999999999998,"5min":4.7939999999999996,"15min":4.7939999999999996},"last":0.78800000000000003}]},{"osd":5,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.97099999999999997,"15min":1.0089999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0329999999999999,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.96399999999999997,"15min":1.0009999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92900000000000005,"5min":4.5830000000000002,"15min":4.5830000000000002},"last":0.67700000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":1.0700000000000001,"15min":1.127},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.95599999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":1.0489999999999999,"15min":1.101},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0149999999999999,"5min":4.6289999999999996,"15min":4.6289999999999996},"last":0.73899999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.98199999999999998,"15min":1.024},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0169999999999999,"5min":4.665,"15min":4.665},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":1.0620000000000001,"15min":1.1120000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0720000000000001,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.81899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":729088,"data_stored":874739,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.48499999999999999,"15min":0.501},"min":{"1min":0.27300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61599999999999999,"5min":1.863,"15min":1.863},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.85499999999999998,"15min":0.91900000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.63200000000000001,"5min":8.2799999999999994,"15min":8.2799999999999994},"last":0.60199999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.89400000000000002,"15min":0.96999999999999997},"min":{"1min":0.314,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71299999999999997,"5min":7.9290000000000003,"15min":7.9290000000000003},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.89800000000000002,"15min":0.97599999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.57299999999999995,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.628}]},{"osd":3,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.65200000000000002,"15min":0.68999999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.73199999999999998,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.84199999999999997,"15min":0.90000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.745,"5min":7.8890000000000002,"15min":7.8890000000000002},"last":0.66100000000000003}]},{"osd":4,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":1.0309999999999999,"15min":1.0800000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77400000000000002,"15min":0.78500000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.101,"5min":1.607,"15min":1.607},"last":0.77800000000000002}]},{"osd":5,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.83199999999999996,"15min":0.83799999999999997},"min":{"1min":0.53000000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.133,"5min":1.514,"15min":1.514},"last":0.874},{"interface":"front","average":{"1min":0.71599999999999997,"5min":1.0800000000000001,"15min":1.1399999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98899999999999999,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.84399999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.81699999999999995,"15min":0.83499999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.042,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":1.032,"15min":1.081},"min":{"1min":0.55700000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0800000000000001,"5min":7.835,"15min":7.835},"last":0.753}]},{"osd":7,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":1.0580000000000001,"15min":1.1080000000000001},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1719999999999999,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.84299999999999997,"15min":0.86499999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1539999999999999,"5min":1.794,"15min":1.794},"last":0.86699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:22:25.045 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-08T08:22:25.045 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-12-08T08:22:25.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.218+0000 7efdfed08640 1 Processor -- start 2023-12-08T08:22:25.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.218+0000 7efdfed08640 1 -- start start 2023-12-08T08:22:25.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.222+0000 7efdfed08640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efdf80c5300 0x7efdf80a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:25.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.222+0000 7efdfed08640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdf81548c0 0x7efdf8154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:25.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.222+0000 7efdfed08640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf80a4e20 con 0x7efdf814b1e0 2023-12-08T08:22:25.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.222+0000 7efdfed08640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf80a50e0 con 0x7efdf80c5300 2023-12-08T08:22:25.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.222+0000 7efdfed08640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf80c0f00 con 0x7efdf81548c0 2023-12-08T08:22:25.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.222+0000 7efdeffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efdf80c5300 0x7efdf80a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:25.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.222+0000 7efdfcaa4640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7efdf814b1e0 0x7efdf80c1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46770/0 (socket says 172.21.15.88:46770) 2023-12-08T08:22:25.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.222+0000 7efdfcaa4640 1 -- 172.21.15.88:0/2456564718 learned_addr learned my addr 172.21.15.88:0/2456564718 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:25.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.222+0000 7efdfd2a5640 1 --2- 172.21.15.88:0/2456564718 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdf81548c0 0x7efdf8154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:25.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.222+0000 7efdeffff640 1 -- 172.21.15.88:0/2456564718 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdf81548c0 msgr2=0x7efdf8154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:25.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.222+0000 7efdeffff640 1 --2- 172.21.15.88:0/2456564718 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdf81548c0 0x7efdf8154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:25.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.222+0000 7efdeffff640 1 -- 172.21.15.88:0/2456564718 >> v1:172.21.15.88:6789/0 conn(0x7efdf814b1e0 legacy=0x7efdf80c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:25.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.222+0000 7efdeffff640 1 -- 172.21.15.88:0/2456564718 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf80c11e0 con 0x7efdf80c5300 2023-12-08T08:22:25.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.222+0000 7efdef7fe640 1 -- 172.21.15.88:0/2456564718 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2413766446 0 0) 0x7efdf80a4e20 con 0x7efdf814b1e0 2023-12-08T08:22:25.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.226+0000 7efdeffff640 1 --2- 172.21.15.88:0/2456564718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdf80c5300 0x7efdf80a9c30 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7efde80097c0 tx=0x7efde801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6105bc43fb3805e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:25.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.226+0000 7efdef7fe640 1 -- 172.21.15.88:0/2456564718 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde80ad640 con 0x7efdf80c5300 2023-12-08T08:22:25.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.226+0000 7efdef7fe640 1 -- 172.21.15.88:0/2456564718 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde80ad7a0 con 0x7efdf80c5300 2023-12-08T08:22:25.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.226+0000 7efdef7fe640 1 -- 172.21.15.88:0/2456564718 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde80adb30 con 0x7efdf80c5300 2023-12-08T08:22:25.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.226+0000 7efdfed08640 1 -- 172.21.15.88:0/2456564718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdf80c5300 msgr2=0x7efdf80a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:25.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.226+0000 7efdfed08640 1 --2- 172.21.15.88:0/2456564718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdf80c5300 0x7efdf80a9c30 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7efde80097c0 tx=0x7efde801c480 comp rx=0 tx=0).stop 2023-12-08T08:22:25.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.226+0000 7efdfed08640 1 -- 172.21.15.88:0/2456564718 shutdown_connections 2023-12-08T08:22:25.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.226+0000 7efdfed08640 1 --2- 172.21.15.88:0/2456564718 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdf81548c0 0x7efdf8154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:25.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.226+0000 7efdfed08640 1 --2- 172.21.15.88:0/2456564718 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdf80c5300 0x7efdf80a9c30 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:25.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.226+0000 7efdfed08640 1 -- 172.21.15.88:0/2456564718 >> 172.21.15.88:0/2456564718 conn(0x7efdf80c59f0 msgr2=0x7efdf80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:25.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.226+0000 7efdfed08640 1 -- 172.21.15.88:0/2456564718 shutdown_connections 2023-12-08T08:22:25.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.226+0000 7efdfed08640 1 -- 172.21.15.88:0/2456564718 wait complete. 2023-12-08T08:22:25.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.226+0000 7efdfed08640 1 Processor -- start 2023-12-08T08:22:25.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.226+0000 7efdfed08640 1 -- start start 2023-12-08T08:22:25.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.230+0000 7efdfed08640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdf80c5300 0x7efdf80707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:25.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.230+0000 7efdfed08640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdf814b1e0 0x7efdf81ee9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:25.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.230+0000 7efdfed08640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdf81548c0 0x7efdf80aa660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:25.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.230+0000 7efdfed08640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf8150610 con 0x7efdf814b1e0 2023-12-08T08:22:25.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.230+0000 7efdfed08640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf8151a50 con 0x7efdf81548c0 2023-12-08T08:22:25.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.230+0000 7efdfed08640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf8151f80 con 0x7efdf80c5300 2023-12-08T08:22:25.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.230+0000 7efdeffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdf814b1e0 0x7efdf81ee9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:25.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.230+0000 7efdeffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdf814b1e0 0x7efdf81ee9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48784/0 (socket says 172.21.15.88:48784) 2023-12-08T08:22:25.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.230+0000 7efdeffff640 1 -- 172.21.15.88:0/2727879986 learned_addr learned my addr 172.21.15.88:0/2727879986 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:25.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.230+0000 7efdfd2a5640 1 --2- 172.21.15.88:0/2727879986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdf81548c0 0x7efdf80aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:25.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.230+0000 7efdfcaa4640 1 --2- 172.21.15.88:0/2727879986 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdf80c5300 0x7efdf80707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:25.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.230+0000 7efdeffff640 1 -- 172.21.15.88:0/2727879986 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdf80c5300 msgr2=0x7efdf80707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:25.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.230+0000 7efdeffff640 1 --2- 172.21.15.88:0/2727879986 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdf80c5300 0x7efdf80707b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:25.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.230+0000 7efdeffff640 1 -- 172.21.15.88:0/2727879986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdf81548c0 msgr2=0x7efdf80aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:25.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.230+0000 7efdeffff640 1 --2- 172.21.15.88:0/2727879986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdf81548c0 0x7efdf80aa660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:25.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.230+0000 7efdeffff640 1 -- 172.21.15.88:0/2727879986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde8009420 con 0x7efdf814b1e0 2023-12-08T08:22:25.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.230+0000 7efdeffff640 1 --2- 172.21.15.88:0/2727879986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdf814b1e0 0x7efdf81ee9f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7efde801a0b0 tx=0x7efde8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:25.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.230+0000 7efded7fa640 1 -- 172.21.15.88:0/2727879986 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde80b6820 con 0x7efdf814b1e0 2023-12-08T08:22:25.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.230+0000 7efded7fa640 1 -- 172.21.15.88:0/2727879986 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde80a6040 con 0x7efdf814b1e0 2023-12-08T08:22:25.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.230+0000 7efded7fa640 1 -- 172.21.15.88:0/2727879986 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde80b6bc0 con 0x7efdf814b1e0 2023-12-08T08:22:25.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.230+0000 7efdfed08640 1 -- 172.21.15.88:0/2727879986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf8151ca0 con 0x7efdf814b1e0 2023-12-08T08:22:25.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.230+0000 7efdfed08640 1 -- 172.21.15.88:0/2727879986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf8072b60 con 0x7efdf814b1e0 2023-12-08T08:22:25.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.230+0000 7efdfed08640 1 -- 172.21.15.88:0/2727879986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf8067630 con 0x7efdf814b1e0 2023-12-08T08:22:25.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.230+0000 7efded7fa640 1 -- 172.21.15.88:0/2727879986 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efde80b4040 con 0x7efdf814b1e0 2023-12-08T08:22:25.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.234+0000 7efded7fa640 1 --2- 172.21.15.88:0/2727879986 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efde4066470 0x7efde4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:25.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.234+0000 7efded7fa640 1 -- 172.21.15.88:0/2727879986 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7efde811e600 con 0x7efdf814b1e0 2023-12-08T08:22:25.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.234+0000 7efdfcaa4640 1 --2- 172.21.15.88:0/2727879986 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efde4066470 0x7efde4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:25.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.234+0000 7efdfcaa4640 1 --2- 172.21.15.88:0/2727879986 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efde4066470 0x7efde4068930 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efdf4000f70 tx=0x7efdf4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:25.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.238+0000 7efded7fa640 1 -- 172.21.15.88:0/2727879986 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efde80eb710 con 0x7efdf814b1e0 2023-12-08T08:22:25.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.438+0000 7efdfed08640 1 -- 172.21.15.88:0/2727879986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7efdf80c0270 con 0x7efdf814b1e0 2023-12-08T08:22:25.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.442+0000 7efded7fa640 1 -- 172.21.15.88:0/2727879986 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v16) v1 ==== 185+0+142 (secure 0 0 0) 0x7efde80ad600 con 0x7efdf814b1e0 2023-12-08T08:22:25.447 INFO:teuthology.orchestra.run.smithi088.stdout:[client.1] 2023-12-08T08:22:25.447 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCJ0XJld2rjOBAAUnEIBuqXHktNpqFW/Ikf7g== 2023-12-08T08:22:25.447 INFO:teuthology.orchestra.run.smithi088.stdout: caps mds = "allow" 2023-12-08T08:22:25.447 INFO:teuthology.orchestra.run.smithi088.stdout: caps mon = "allow r" 2023-12-08T08:22:25.447 INFO:teuthology.orchestra.run.smithi088.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-12-08T08:22:25.447 INFO:teuthology.orchestra.run.smithi088.stderr:updated caps for client.1 2023-12-08T08:22:25.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.442+0000 7efdfed08640 1 -- 172.21.15.88:0/2727879986 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efde4066470 msgr2=0x7efde4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:25.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.442+0000 7efdfed08640 1 --2- 172.21.15.88:0/2727879986 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efde4066470 0x7efde4068930 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efdf4000f70 tx=0x7efdf4009040 comp rx=0 tx=0).stop 2023-12-08T08:22:25.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.442+0000 7efdfed08640 1 -- 172.21.15.88:0/2727879986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdf814b1e0 msgr2=0x7efdf81ee9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:25.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.442+0000 7efdfed08640 1 --2- 172.21.15.88:0/2727879986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdf814b1e0 0x7efdf81ee9f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7efde801a0b0 tx=0x7efde8019220 comp rx=0 tx=0).stop 2023-12-08T08:22:25.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.442+0000 7efdfed08640 1 -- 172.21.15.88:0/2727879986 shutdown_connections 2023-12-08T08:22:25.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.442+0000 7efdfed08640 1 --2- 172.21.15.88:0/2727879986 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efde4066470 0x7efde4068930 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:25.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.442+0000 7efdfed08640 1 --2- 172.21.15.88:0/2727879986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdf81548c0 0x7efdf80aa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:25.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.442+0000 7efdfed08640 1 --2- 172.21.15.88:0/2727879986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdf814b1e0 0x7efdf81ee9f0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:25.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.442+0000 7efdfed08640 1 --2- 172.21.15.88:0/2727879986 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efdf80c5300 0x7efdf80707b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:25.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.442+0000 7efdfed08640 1 -- 172.21.15.88:0/2727879986 >> 172.21.15.88:0/2727879986 conn(0x7efdf80c59f0 msgr2=0x7efdf80c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:25.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.442+0000 7efdfed08640 1 -- 172.21.15.88:0/2727879986 shutdown_connections 2023-12-08T08:22:25.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.442+0000 7efdfed08640 1 -- 172.21.15.88:0/2727879986 wait complete. 2023-12-08T08:22:25.468 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:22:25.468 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:22:25.478 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:22:25.478 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:22:25.531 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:22:25.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.666+0000 7f4e21d57640 1 Processor -- start 2023-12-08T08:22:25.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.666+0000 7f4e21d57640 1 -- start start 2023-12-08T08:22:25.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.666+0000 7f4e21d57640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4e1c154f20 0x7f4e1c06b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:25.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.666+0000 7f4e21d57640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4e1c06bf30 0x7f4e1c15ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:25.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.666+0000 7f4e21d57640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e1c0c4890 con 0x7f4e1c0af4c0 2023-12-08T08:22:25.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.666+0000 7f4e21d57640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1c1553d0 con 0x7f4e1c06bf30 2023-12-08T08:22:25.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.666+0000 7f4e21d57640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1c06c340 con 0x7f4e1c154f20 2023-12-08T08:22:25.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.666+0000 7f4e1b7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4e1c0af4c0 0x7f4e1c0c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46784/0 (socket says 172.21.15.88:46784) 2023-12-08T08:22:25.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.666+0000 7f4e1b7fe640 1 -- 172.21.15.88:0/4170403167 learned_addr learned my addr 172.21.15.88:0/4170403167 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:25.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.666+0000 7f4e1bfff640 1 --2- 172.21.15.88:0/4170403167 >> v2:172.21.15.88:3300/0 conn(0x7f4e1c06bf30 0x7f4e1c15ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:25.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.666+0000 7f4e1affd640 1 --2- 172.21.15.88:0/4170403167 >> v2:172.21.15.148:3300/0 conn(0x7f4e1c154f20 0x7f4e1c06b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:25.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.666+0000 7f4e1a7fc640 1 -- 172.21.15.88:0/4170403167 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1895052783 0 0) 0x7f4e1c0c4890 con 0x7f4e1c0af4c0 2023-12-08T08:22:25.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.666+0000 7f4e1a7fc640 1 -- 172.21.15.88:0/4170403167 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e04003530 con 0x7f4e1c0af4c0 2023-12-08T08:22:25.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.666+0000 7f4e1bfff640 1 -- 172.21.15.88:0/4170403167 >> v2:172.21.15.148:3300/0 conn(0x7f4e1c154f20 msgr2=0x7f4e1c06b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:25.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.666+0000 7f4e1bfff640 1 --2- 172.21.15.88:0/4170403167 >> v2:172.21.15.148:3300/0 conn(0x7f4e1c154f20 0x7f4e1c06b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:25.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.666+0000 7f4e1bfff640 1 -- 172.21.15.88:0/4170403167 >> v1:172.21.15.88:6789/0 conn(0x7f4e1c0af4c0 legacy=0x7f4e1c0c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:25.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.666+0000 7f4e1bfff640 1 -- 172.21.15.88:0/4170403167 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1c0af8a0 con 0x7f4e1c06bf30 2023-12-08T08:22:25.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.670+0000 7f4e1bfff640 1 --2- 172.21.15.88:0/4170403167 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c06bf30 0x7f4e1c15ee20 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c0c7290 tx=0x7f4e1401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab041b028904d2d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:25.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.670+0000 7f4e1a7fc640 1 -- 172.21.15.88:0/4170403167 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e140a5910 con 0x7f4e1c06bf30 2023-12-08T08:22:25.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.670+0000 7f4e1a7fc640 1 -- 172.21.15.88:0/4170403167 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e140a5a70 con 0x7f4e1c06bf30 2023-12-08T08:22:25.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.670+0000 7f4e1a7fc640 1 -- 172.21.15.88:0/4170403167 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e140a5e00 con 0x7f4e1c06bf30 2023-12-08T08:22:25.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.670+0000 7f4e21d57640 1 -- 172.21.15.88:0/4170403167 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c06bf30 msgr2=0x7f4e1c15ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:25.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.670+0000 7f4e21d57640 1 --2- 172.21.15.88:0/4170403167 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c06bf30 0x7f4e1c15ee20 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c0c7290 tx=0x7f4e1401c850 comp rx=0 tx=0).stop 2023-12-08T08:22:25.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.670+0000 7f4e21d57640 1 -- 172.21.15.88:0/4170403167 shutdown_connections 2023-12-08T08:22:25.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.670+0000 7f4e21d57640 1 --2- 172.21.15.88:0/4170403167 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c06bf30 0x7f4e1c15ee20 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:25.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.670+0000 7f4e21d57640 1 --2- 172.21.15.88:0/4170403167 >> v2:172.21.15.148:3300/0 conn(0x7f4e1c154f20 0x7f4e1c06b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:25.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.670+0000 7f4e21d57640 1 -- 172.21.15.88:0/4170403167 >> 172.21.15.88:0/4170403167 conn(0x7f4e1c0ab9d0 msgr2=0x7f4e1c0abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:25.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.670+0000 7f4e21d57640 1 -- 172.21.15.88:0/4170403167 shutdown_connections 2023-12-08T08:22:25.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.670+0000 7f4e21d57640 1 -- 172.21.15.88:0/4170403167 wait complete. 2023-12-08T08:22:25.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.674+0000 7f4e21d57640 1 Processor -- start 2023-12-08T08:22:25.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.674+0000 7f4e21d57640 1 -- start start 2023-12-08T08:22:25.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.674+0000 7f4e21d57640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e1c06bf30 0x7f4e1c14db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:25.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.674+0000 7f4e21d57640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c0af4c0 0x7f4e1c149020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:25.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.674+0000 7f4e21d57640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e1c154f20 0x7f4e1c0c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:25.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.674+0000 7f4e21d57640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c14e0d0 con 0x7f4e1c0af4c0 2023-12-08T08:22:25.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.674+0000 7f4e21d57640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c0c99a0 con 0x7f4e1c154f20 2023-12-08T08:22:25.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.674+0000 7f4e21d57640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c14d4c0 con 0x7f4e1c06bf30 2023-12-08T08:22:25.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.674+0000 7f4e1affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c0af4c0 0x7f4e1c149020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:25.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.674+0000 7f4e1affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c0af4c0 0x7f4e1c149020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48804/0 (socket says 172.21.15.88:48804) 2023-12-08T08:22:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.674+0000 7f4e1affd640 1 -- 172.21.15.88:0/2247303963 learned_addr learned my addr 172.21.15.88:0/2247303963 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.674+0000 7f4e1b7fe640 1 --2- 172.21.15.88:0/2247303963 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e1c06bf30 0x7f4e1c14db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.674+0000 7f4e1bfff640 1 --2- 172.21.15.88:0/2247303963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e1c154f20 0x7f4e1c0c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.674+0000 7f4e1affd640 1 -- 172.21.15.88:0/2247303963 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e1c06bf30 msgr2=0x7f4e1c14db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.674+0000 7f4e1affd640 1 --2- 172.21.15.88:0/2247303963 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e1c06bf30 0x7f4e1c14db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.674+0000 7f4e1affd640 1 -- 172.21.15.88:0/2247303963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e1c154f20 msgr2=0x7f4e1c0c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.674+0000 7f4e1affd640 1 --2- 172.21.15.88:0/2247303963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e1c154f20 0x7f4e1c0c7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.674+0000 7f4e1affd640 1 -- 172.21.15.88:0/2247303963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e14009a70 con 0x7f4e1c0af4c0 2023-12-08T08:22:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.674+0000 7f4e1b7fe640 1 --2- 172.21.15.88:0/2247303963 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e1c06bf30 0x7f4e1c14db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.674+0000 7f4e1affd640 1 --2- 172.21.15.88:0/2247303963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c0af4c0 0x7f4e1c149020 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f4e1000d620 tx=0x7f4e1000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.674+0000 7f4e03fff640 1 -- 172.21.15.88:0/2247303963 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1000b620 con 0x7f4e1c0af4c0 2023-12-08T08:22:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.674+0000 7f4e03fff640 1 -- 172.21.15.88:0/2247303963 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1000b780 con 0x7f4e1c0af4c0 2023-12-08T08:22:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.674+0000 7f4e03fff640 1 -- 172.21.15.88:0/2247303963 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1000bb10 con 0x7f4e1c0af4c0 2023-12-08T08:22:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.674+0000 7f4e21d57640 1 -- 172.21.15.88:0/2247303963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1c0c93e0 con 0x7f4e1c0af4c0 2023-12-08T08:22:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.674+0000 7f4e21d57640 1 -- 172.21.15.88:0/2247303963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e1c149560 con 0x7f4e1c0af4c0 2023-12-08T08:22:25.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.674+0000 7f4e21d57640 1 -- 172.21.15.88:0/2247303963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1c14d950 con 0x7f4e1c0af4c0 2023-12-08T08:22:25.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.678+0000 7f4e03fff640 1 -- 172.21.15.88:0/2247303963 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4e1000bc70 con 0x7f4e1c0af4c0 2023-12-08T08:22:25.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.678+0000 7f4e03fff640 1 --2- 172.21.15.88:0/2247303963 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4e08066470 0x7f4e08068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:25.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.678+0000 7f4e03fff640 1 -- 172.21.15.88:0/2247303963 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4e10084630 con 0x7f4e1c0af4c0 2023-12-08T08:22:25.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.678+0000 7f4e1b7fe640 1 --2- 172.21.15.88:0/2247303963 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4e08066470 0x7f4e08068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:25.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.678+0000 7f4e1b7fe640 1 --2- 172.21.15.88:0/2247303963 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4e08066470 0x7f4e08068930 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0011f0 tx=0x7f4e0c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:25.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.682+0000 7f4e03fff640 1 -- 172.21.15.88:0/2247303963 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4e10051740 con 0x7f4e1c0af4c0 2023-12-08T08:22:25.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.834+0000 7f4e21d57640 1 -- 172.21.15.88:0/2247303963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e1c0a9c90 con 0x7f4e1c0af4c0 2023-12-08T08:22:25.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.838+0000 7f4e03fff640 1 -- 172.21.15.88:0/2247303963 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20256 (secure 0 0 0) 0x7f4e10007380 con 0x7f4e1c0af4c0 2023-12-08T08:22:25.842 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:25.843 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":54,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:22:21.530364+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:00.520254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:01.423493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:22:17.787562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:22:18.955273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:22:25.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.838+0000 7f4e21d57640 1 -- 172.21.15.88:0/2247303963 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4e08066470 msgr2=0x7f4e08068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:25.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.838+0000 7f4e21d57640 1 --2- 172.21.15.88:0/2247303963 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4e08066470 0x7f4e08068930 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0011f0 tx=0x7f4e0c009040 comp rx=0 tx=0).stop 2023-12-08T08:22:25.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.838+0000 7f4e21d57640 1 -- 172.21.15.88:0/2247303963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c0af4c0 msgr2=0x7f4e1c149020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:25.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.838+0000 7f4e21d57640 1 --2- 172.21.15.88:0/2247303963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c0af4c0 0x7f4e1c149020 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f4e1000d620 tx=0x7f4e1000dae0 comp rx=0 tx=0).stop 2023-12-08T08:22:25.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.838+0000 7f4e21d57640 1 -- 172.21.15.88:0/2247303963 shutdown_connections 2023-12-08T08:22:25.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.838+0000 7f4e21d57640 1 --2- 172.21.15.88:0/2247303963 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4e08066470 0x7f4e08068930 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:25.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.838+0000 7f4e21d57640 1 --2- 172.21.15.88:0/2247303963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e1c154f20 0x7f4e1c0c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:25.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.838+0000 7f4e21d57640 1 --2- 172.21.15.88:0/2247303963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1c0af4c0 0x7f4e1c149020 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:25.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.838+0000 7f4e21d57640 1 --2- 172.21.15.88:0/2247303963 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e1c06bf30 0x7f4e1c14db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:25.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.838+0000 7f4e21d57640 1 -- 172.21.15.88:0/2247303963 >> 172.21.15.88:0/2247303963 conn(0x7f4e1c0ab9d0 msgr2=0x7f4e1c149c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:25.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.838+0000 7f4e21d57640 1 -- 172.21.15.88:0/2247303963 shutdown_connections 2023-12-08T08:22:25.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.838+0000 7f4e21d57640 1 -- 172.21.15.88:0/2247303963 wait complete. 2023-12-08T08:22:25.864 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:22:00.520254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:22:01.423493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:22:17.787562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:22:18.955273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:22:25.865 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:22:26.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.998+0000 7f144d91c640 1 Processor -- start 2023-12-08T08:22:26.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:25.998+0000 7f144d91c640 1 -- start start 2023-12-08T08:22:26.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.002+0000 7f144d91c640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f14480c47e0 0x7f14480c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:26.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.002+0000 7f144d91c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f14480c83d0 0x7f14480c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:26.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.002+0000 7f144d91c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1448155400 con 0x7f14480c9110 2023-12-08T08:22:26.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.002+0000 7f144d91c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14480c5830 con 0x7f14480c83d0 2023-12-08T08:22:26.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.002+0000 7f144d91c640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1448154620 con 0x7f14480c47e0 2023-12-08T08:22:26.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.002+0000 7f143ffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f14480c83d0 0x7f14480c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:26.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.002+0000 7f14477fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f14480c9110 0x7f1448157b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46794/0 (socket says 172.21.15.88:46794) 2023-12-08T08:22:26.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.002+0000 7f14477fe640 1 -- 172.21.15.88:0/2335642095 learned_addr learned my addr 172.21.15.88:0/2335642095 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:26.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.002+0000 7f1446ffd640 1 --2- 172.21.15.88:0/2335642095 >> v2:172.21.15.148:3300/0 conn(0x7f14480c47e0 0x7f14480c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:26.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.002+0000 7f143ffff640 1 -- 172.21.15.88:0/2335642095 >> v2:172.21.15.148:3300/0 conn(0x7f14480c47e0 msgr2=0x7f14480c4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:26.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.002+0000 7f143ffff640 1 --2- 172.21.15.88:0/2335642095 >> v2:172.21.15.148:3300/0 conn(0x7f14480c47e0 0x7f14480c4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:26.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.002+0000 7f143ffff640 1 -- 172.21.15.88:0/2335642095 >> v1:172.21.15.88:6789/0 conn(0x7f14480c9110 legacy=0x7f1448157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:26.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.002+0000 7f143ffff640 1 -- 172.21.15.88:0/2335642095 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1448154830 con 0x7f14480c83d0 2023-12-08T08:22:26.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.002+0000 7f14467fc640 1 -- 172.21.15.88:0/2335642095 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074816935 0 0) 0x7f1448155400 con 0x7f14480c9110 2023-12-08T08:22:26.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.006+0000 7f143ffff640 1 --2- 172.21.15.88:0/2335642095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14480c83d0 0x7f14480c8bd0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f14480c7640 tx=0x7f143001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb07a39b98f7242 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:26.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.006+0000 7f14467fc640 1 -- 172.21.15.88:0/2335642095 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14300ab600 con 0x7f14480c83d0 2023-12-08T08:22:26.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.006+0000 7f14467fc640 1 -- 172.21.15.88:0/2335642095 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14300a7050 con 0x7f14480c83d0 2023-12-08T08:22:26.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.006+0000 7f14467fc640 1 -- 172.21.15.88:0/2335642095 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14300ab980 con 0x7f14480c83d0 2023-12-08T08:22:26.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.006+0000 7f144d91c640 1 -- 172.21.15.88:0/2335642095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14480c83d0 msgr2=0x7f14480c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:26.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.006+0000 7f144d91c640 1 --2- 172.21.15.88:0/2335642095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14480c83d0 0x7f14480c8bd0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f14480c7640 tx=0x7f143001c3a0 comp rx=0 tx=0).stop 2023-12-08T08:22:26.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.006+0000 7f144d91c640 1 -- 172.21.15.88:0/2335642095 shutdown_connections 2023-12-08T08:22:26.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.006+0000 7f144d91c640 1 --2- 172.21.15.88:0/2335642095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14480c83d0 0x7f14480c8bd0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:26.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.006+0000 7f144d91c640 1 --2- 172.21.15.88:0/2335642095 >> v2:172.21.15.148:3300/0 conn(0x7f14480c47e0 0x7f14480c4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:26.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.006+0000 7f144d91c640 1 -- 172.21.15.88:0/2335642095 >> 172.21.15.88:0/2335642095 conn(0x7f14480ab920 msgr2=0x7f14480abd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:26.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.006+0000 7f144d91c640 1 -- 172.21.15.88:0/2335642095 shutdown_connections 2023-12-08T08:22:26.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.006+0000 7f144d91c640 1 -- 172.21.15.88:0/2335642095 wait complete. 2023-12-08T08:22:26.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.006+0000 7f144d91c640 1 Processor -- start 2023-12-08T08:22:26.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.006+0000 7f144d91c640 1 -- start start 2023-12-08T08:22:26.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.010+0000 7f144d91c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14480c47e0 0x7f144814e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:26.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.010+0000 7f144d91c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14480c83d0 0x7f14480c32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:26.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.010+0000 7f144d91c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14480c9110 0x7f144814ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:26.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.010+0000 7f144d91c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14480ae6b0 con 0x7f14480c83d0 2023-12-08T08:22:26.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.010+0000 7f144d91c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144814e660 con 0x7f14480c9110 2023-12-08T08:22:26.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.010+0000 7f144d91c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14480af7f0 con 0x7f14480c47e0 2023-12-08T08:22:26.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.010+0000 7f143ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14480c83d0 0x7f14480c32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:26.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.010+0000 7f143ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14480c83d0 0x7f14480c32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48808/0 (socket says 172.21.15.88:48808) 2023-12-08T08:22:26.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.010+0000 7f143ffff640 1 -- 172.21.15.88:0/730397574 learned_addr learned my addr 172.21.15.88:0/730397574 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:26.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.010+0000 7f1446ffd640 1 --2- 172.21.15.88:0/730397574 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14480c47e0 0x7f144814e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:26.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.010+0000 7f14477fe640 1 --2- 172.21.15.88:0/730397574 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14480c9110 0x7f144814ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:26.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.010+0000 7f143ffff640 1 -- 172.21.15.88:0/730397574 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14480c47e0 msgr2=0x7f144814e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:26.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.010+0000 7f143ffff640 1 --2- 172.21.15.88:0/730397574 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14480c47e0 0x7f144814e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:26.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.010+0000 7f143ffff640 1 -- 172.21.15.88:0/730397574 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14480c9110 msgr2=0x7f144814ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:26.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.010+0000 7f143ffff640 1 --2- 172.21.15.88:0/730397574 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14480c9110 0x7f144814ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:26.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.010+0000 7f143ffff640 1 -- 172.21.15.88:0/730397574 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1430009420 con 0x7f14480c83d0 2023-12-08T08:22:26.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.010+0000 7f1446ffd640 1 --2- 172.21.15.88:0/730397574 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14480c47e0 0x7f144814e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:26.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.010+0000 7f14477fe640 1 --2- 172.21.15.88:0/730397574 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14480c9110 0x7f144814ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:26.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.010+0000 7f143ffff640 1 --2- 172.21.15.88:0/730397574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14480c83d0 0x7f14480c32b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1430018fb0 tx=0x7f1430019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:26.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.010+0000 7f1444ff9640 1 -- 172.21.15.88:0/730397574 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1430004230 con 0x7f14480c83d0 2023-12-08T08:22:26.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.010+0000 7f1444ff9640 1 -- 172.21.15.88:0/730397574 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1430004390 con 0x7f14480c83d0 2023-12-08T08:22:26.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.010+0000 7f144d91c640 1 -- 172.21.15.88:0/730397574 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14480af4e0 con 0x7f14480c83d0 2023-12-08T08:22:26.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.010+0000 7f1444ff9640 1 -- 172.21.15.88:0/730397574 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1430003820 con 0x7f14480c83d0 2023-12-08T08:22:26.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.010+0000 7f144d91c640 1 -- 172.21.15.88:0/730397574 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14480ae190 con 0x7f14480c83d0 2023-12-08T08:22:26.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.010+0000 7f144d91c640 1 -- 172.21.15.88:0/730397574 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1448067630 con 0x7f14480c83d0 2023-12-08T08:22:26.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.010+0000 7f1444ff9640 1 -- 172.21.15.88:0/730397574 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f14300b2040 con 0x7f14480c83d0 2023-12-08T08:22:26.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.014+0000 7f1444ff9640 1 --2- 172.21.15.88:0/730397574 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1428066470 0x7f1428068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:26.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.014+0000 7f1444ff9640 1 -- 172.21.15.88:0/730397574 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f143011e0a0 con 0x7f14480c83d0 2023-12-08T08:22:26.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.014+0000 7f1446ffd640 1 --2- 172.21.15.88:0/730397574 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1428066470 0x7f1428068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:26.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.014+0000 7f1446ffd640 1 --2- 172.21.15.88:0/730397574 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1428066470 0x7f1428068930 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1438007a70 tx=0x7f1438008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:26.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.018+0000 7f1444ff9640 1 -- 172.21.15.88:0/730397574 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f14300eb1c0 con 0x7f14480c83d0 2023-12-08T08:22:26.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.170+0000 7f144d91c640 1 -- 172.21.15.88:0/730397574 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f144806c940 con 0x7f14480c83d0 2023-12-08T08:22:26.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.170+0000 7f1444ff9640 1 -- 172.21.15.88:0/730397574 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1430006e20 con 0x7f14480c83d0 2023-12-08T08:22:26.176 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:22:26.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.174+0000 7f144d91c640 1 -- 172.21.15.88:0/730397574 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1428066470 msgr2=0x7f1428068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:26.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.174+0000 7f144d91c640 1 --2- 172.21.15.88:0/730397574 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1428066470 0x7f1428068930 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1438007a70 tx=0x7f1438008040 comp rx=0 tx=0).stop 2023-12-08T08:22:26.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.174+0000 7f144d91c640 1 -- 172.21.15.88:0/730397574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14480c83d0 msgr2=0x7f14480c32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:26.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.174+0000 7f144d91c640 1 --2- 172.21.15.88:0/730397574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14480c83d0 0x7f14480c32b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1430018fb0 tx=0x7f1430019140 comp rx=0 tx=0).stop 2023-12-08T08:22:26.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.174+0000 7f144d91c640 1 -- 172.21.15.88:0/730397574 shutdown_connections 2023-12-08T08:22:26.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.174+0000 7f144d91c640 1 --2- 172.21.15.88:0/730397574 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1428066470 0x7f1428068930 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:26.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.174+0000 7f144d91c640 1 --2- 172.21.15.88:0/730397574 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14480c9110 0x7f144814ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:26.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.174+0000 7f144d91c640 1 --2- 172.21.15.88:0/730397574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14480c83d0 0x7f14480c32b0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:26.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.174+0000 7f144d91c640 1 --2- 172.21.15.88:0/730397574 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f14480c47e0 0x7f144814e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:26.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.174+0000 7f144d91c640 1 -- 172.21.15.88:0/730397574 >> 172.21.15.88:0/730397574 conn(0x7f14480ab920 msgr2=0x7f1448153c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:26.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.174+0000 7f144d91c640 1 -- 172.21.15.88:0/730397574 shutdown_connections 2023-12-08T08:22:26.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.174+0000 7f144d91c640 1 -- 172.21.15.88:0/730397574 wait complete. 2023-12-08T08:22:26.197 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:22:26.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.330+0000 7f492c417640 1 Processor -- start 2023-12-08T08:22:26.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.330+0000 7f492c417640 1 -- start start 2023-12-08T08:22:26.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.334+0000 7f492c417640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4924159c40 0x7f492415c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:26.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.334+0000 7f492c417640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49240a4e20 con 0x7f492414b1e0 2023-12-08T08:22:26.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.334+0000 7f492c417640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49240a50e0 con 0x7f49240c5300 2023-12-08T08:22:26.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.334+0000 7f492c417640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49241558d0 con 0x7f4924159c40 2023-12-08T08:22:26.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.334+0000 7f492a1b3640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f492414b1e0 0x7f49240c1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46810/0 (socket says 172.21.15.88:46810) 2023-12-08T08:22:26.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.334+0000 7f492a1b3640 1 -- 172.21.15.88:0/387902597 learned_addr learned my addr 172.21.15.88:0/387902597 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:26.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.334+0000 7f492a9b4640 1 --2- 172.21.15.88:0/387902597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4924159c40 0x7f492415c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:26.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.334+0000 7f49291b1640 1 -- 172.21.15.88:0/387902597 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839653160 0 0) 0x7f49240a4e20 con 0x7f492414b1e0 2023-12-08T08:22:26.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.334+0000 7f49291b1640 1 -- 172.21.15.88:0/387902597 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4910003530 con 0x7f492414b1e0 2023-12-08T08:22:26.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.334+0000 7f49291b1640 1 -- 172.21.15.88:0/387902597 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011004883 0 0) 0x7f49240a50e0 con 0x7f49240c5300 2023-12-08T08:22:26.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.334+0000 7f49291b1640 1 -- 172.21.15.88:0/387902597 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49240a4e20 con 0x7f49240c5300 2023-12-08T08:22:26.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.334+0000 7f492a9b4640 1 -- 172.21.15.88:0/387902597 >> v1:172.21.15.148:6789/0 conn(0x7f49240c5300 legacy=0x7f49240a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:26.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.334+0000 7f492a9b4640 1 -- 172.21.15.88:0/387902597 >> v1:172.21.15.88:6789/0 conn(0x7f492414b1e0 legacy=0x7f49240c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:26.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.334+0000 7f492a9b4640 1 -- 172.21.15.88:0/387902597 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49240c0f00 con 0x7f4924159c40 2023-12-08T08:22:26.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.338+0000 7f492a9b4640 1 --2- 172.21.15.88:0/387902597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4924159c40 0x7f492415c030 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f491c009dc0 tx=0x7f491c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c85319f46e50fc26 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:26.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.338+0000 7f49291b1640 1 -- 172.21.15.88:0/387902597 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c0a5940 con 0x7f4924159c40 2023-12-08T08:22:26.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.338+0000 7f49291b1640 1 -- 172.21.15.88:0/387902597 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491c0a5aa0 con 0x7f4924159c40 2023-12-08T08:22:26.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.338+0000 7f49291b1640 1 -- 172.21.15.88:0/387902597 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c0a5e30 con 0x7f4924159c40 2023-12-08T08:22:26.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.338+0000 7f492c417640 1 -- 172.21.15.88:0/387902597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4924159c40 msgr2=0x7f492415c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:26.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.338+0000 7f492c417640 1 --2- 172.21.15.88:0/387902597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4924159c40 0x7f492415c030 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f491c009dc0 tx=0x7f491c01c970 comp rx=0 tx=0).stop 2023-12-08T08:22:26.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.338+0000 7f492c417640 1 -- 172.21.15.88:0/387902597 shutdown_connections 2023-12-08T08:22:26.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.338+0000 7f492c417640 1 --2- 172.21.15.88:0/387902597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4924159c40 0x7f492415c030 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:26.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.338+0000 7f492c417640 1 -- 172.21.15.88:0/387902597 >> 172.21.15.88:0/387902597 conn(0x7f49240c59f0 msgr2=0x7f49240c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:26.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.338+0000 7f492c417640 1 -- 172.21.15.88:0/387902597 shutdown_connections 2023-12-08T08:22:26.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.338+0000 7f492c417640 1 -- 172.21.15.88:0/387902597 wait complete. 2023-12-08T08:22:26.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.338+0000 7f492c417640 1 Processor -- start 2023-12-08T08:22:26.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.338+0000 7f492c417640 1 -- start start 2023-12-08T08:22:26.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.342+0000 7f492c417640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49240c5300 0x7f49240a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:26.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.342+0000 7f492c417640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f492414b1e0 0x7f49241447a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:26.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.342+0000 7f492c417640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4924159c40 0x7f492414c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:26.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.342+0000 7f492c417640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49241f0de0 con 0x7f49240c5300 2023-12-08T08:22:26.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.342+0000 7f492c417640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492414bd50 con 0x7f492414b1e0 2023-12-08T08:22:26.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.342+0000 7f492c417640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4924071b80 con 0x7f4924159c40 2023-12-08T08:22:26.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.342+0000 7f492a1b3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49240c5300 0x7f49240a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:26.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.342+0000 7f492a1b3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49240c5300 0x7f49240a9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48810/0 (socket says 172.21.15.88:48810) 2023-12-08T08:22:26.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.342+0000 7f492a1b3640 1 -- 172.21.15.88:0/2845114790 learned_addr learned my addr 172.21.15.88:0/2845114790 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:26.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.342+0000 7f49299b2640 1 --2- 172.21.15.88:0/2845114790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f492414b1e0 0x7f49241447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:26.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.342+0000 7f492a9b4640 1 --2- 172.21.15.88:0/2845114790 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4924159c40 0x7f492414c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:26.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.342+0000 7f492a1b3640 1 -- 172.21.15.88:0/2845114790 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4924159c40 msgr2=0x7f492414c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:26.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.342+0000 7f492a1b3640 1 --2- 172.21.15.88:0/2845114790 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4924159c40 0x7f492414c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:26.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.342+0000 7f492a1b3640 1 -- 172.21.15.88:0/2845114790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f492414b1e0 msgr2=0x7f49241447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:26.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.342+0000 7f492a1b3640 1 --2- 172.21.15.88:0/2845114790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f492414b1e0 0x7f49241447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:26.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.342+0000 7f492a1b3640 1 -- 172.21.15.88:0/2845114790 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c009a70 con 0x7f49240c5300 2023-12-08T08:22:26.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.342+0000 7f492a1b3640 1 --2- 172.21.15.88:0/2845114790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49240c5300 0x7f49240a9b80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f492000c500 tx=0x7f492000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:26.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.342+0000 7f491affd640 1 -- 172.21.15.88:0/2845114790 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4920005cf0 con 0x7f49240c5300 2023-12-08T08:22:26.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.342+0000 7f491affd640 1 -- 172.21.15.88:0/2845114790 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4920005e50 con 0x7f49240c5300 2023-12-08T08:22:26.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.342+0000 7f491affd640 1 -- 172.21.15.88:0/2845114790 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4920007330 con 0x7f49240c5300 2023-12-08T08:22:26.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.342+0000 7f492c417640 1 -- 172.21.15.88:0/2845114790 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4924071e20 con 0x7f49240c5300 2023-12-08T08:22:26.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.342+0000 7f492c417640 1 -- 172.21.15.88:0/2845114790 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4924072100 con 0x7f49240c5300 2023-12-08T08:22:26.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.342+0000 7f492c417640 1 -- 172.21.15.88:0/2845114790 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f492414cf00 con 0x7f49240c5300 2023-12-08T08:22:26.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.346+0000 7f491affd640 1 -- 172.21.15.88:0/2845114790 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4920007490 con 0x7f49240c5300 2023-12-08T08:22:26.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.346+0000 7f491affd640 1 --2- 172.21.15.88:0/2845114790 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f49080664a0 0x7f4908068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:26.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.346+0000 7f491affd640 1 -- 172.21.15.88:0/2845114790 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4920083770 con 0x7f49240c5300 2023-12-08T08:22:26.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.346+0000 7f49299b2640 1 --2- 172.21.15.88:0/2845114790 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f49080664a0 0x7f4908068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:26.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.346+0000 7f49299b2640 1 --2- 172.21.15.88:0/2845114790 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f49080664a0 0x7f4908068960 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f492414aa30 tx=0x7f4914009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:26.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.350+0000 7f491affd640 1 -- 172.21.15.88:0/2845114790 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4920050930 con 0x7f49240c5300 2023-12-08T08:22:26.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.498+0000 7f492c417640 1 -- 172.21.15.88:0/2845114790 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4924067630 con 0x7f49240c5300 2023-12-08T08:22:26.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.498+0000 7f491affd640 1 -- 172.21.15.88:0/2845114790 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4920053f50 con 0x7f49240c5300 2023-12-08T08:22:26.504 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:22:26.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.502+0000 7f492c417640 1 -- 172.21.15.88:0/2845114790 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f49080664a0 msgr2=0x7f4908068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:26.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.502+0000 7f492c417640 1 --2- 172.21.15.88:0/2845114790 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f49080664a0 0x7f4908068960 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f492414aa30 tx=0x7f4914009040 comp rx=0 tx=0).stop 2023-12-08T08:22:26.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.502+0000 7f492c417640 1 -- 172.21.15.88:0/2845114790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49240c5300 msgr2=0x7f49240a9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:26.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.502+0000 7f492c417640 1 --2- 172.21.15.88:0/2845114790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49240c5300 0x7f49240a9b80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f492000c500 tx=0x7f492000c9c0 comp rx=0 tx=0).stop 2023-12-08T08:22:26.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.502+0000 7f492c417640 1 -- 172.21.15.88:0/2845114790 shutdown_connections 2023-12-08T08:22:26.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.502+0000 7f492c417640 1 --2- 172.21.15.88:0/2845114790 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f49080664a0 0x7f4908068960 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:26.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.502+0000 7f492c417640 1 --2- 172.21.15.88:0/2845114790 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4924159c40 0x7f492414c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:26.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.502+0000 7f492c417640 1 --2- 172.21.15.88:0/2845114790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f492414b1e0 0x7f49241447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:26.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.502+0000 7f492c417640 1 --2- 172.21.15.88:0/2845114790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49240c5300 0x7f49240a9b80 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:26.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.502+0000 7f492c417640 1 -- 172.21.15.88:0/2845114790 >> 172.21.15.88:0/2845114790 conn(0x7f49240c59f0 msgr2=0x7f49240c35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:26.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.502+0000 7f492c417640 1 -- 172.21.15.88:0/2845114790 shutdown_connections 2023-12-08T08:22:26.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.502+0000 7f492c417640 1 -- 172.21.15.88:0/2845114790 wait complete. 2023-12-08T08:22:26.525 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:22:26.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.662+0000 7f774caea640 1 Processor -- start 2023-12-08T08:22:26.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.662+0000 7f774caea640 1 -- start start 2023-12-08T08:22:26.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.662+0000 7f774caea640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f77480c5300 0x7f77480a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:26.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.662+0000 7f774caea640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77480a4e20 con 0x7f77481548c0 2023-12-08T08:22:26.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.662+0000 7f774caea640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77480a50e0 con 0x7f774814b1e0 2023-12-08T08:22:26.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.662+0000 7f774caea640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77480c0f00 con 0x7f77480c5300 2023-12-08T08:22:26.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.662+0000 7f7746d9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f77481548c0 0x7f7748154d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46818/0 (socket says 172.21.15.88:46818) 2023-12-08T08:22:26.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.662+0000 7f7746d9d640 1 -- 172.21.15.88:0/3171352207 learned_addr learned my addr 172.21.15.88:0/3171352207 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:26.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.662+0000 7f7745d9b640 1 --2- 172.21.15.88:0/3171352207 >> v2:172.21.15.148:3300/0 conn(0x7f77480c5300 0x7f77480a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:26.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.662+0000 7f774559a640 1 -- 172.21.15.88:0/3171352207 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2673780183 0 0) 0x7f77480a4e20 con 0x7f77481548c0 2023-12-08T08:22:26.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.662+0000 7f774559a640 1 -- 172.21.15.88:0/3171352207 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7730003530 con 0x7f77481548c0 2023-12-08T08:22:26.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.662+0000 7f774559a640 1 -- 172.21.15.88:0/3171352207 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3795994782 0 0) 0x7f77480a50e0 con 0x7f774814b1e0 2023-12-08T08:22:26.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.662+0000 7f774559a640 1 -- 172.21.15.88:0/3171352207 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77480a4e20 con 0x7f774814b1e0 2023-12-08T08:22:26.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.662+0000 7f774559a640 1 -- 172.21.15.88:0/3171352207 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2415468810 0 0) 0x7f7730003530 con 0x7f77481548c0 2023-12-08T08:22:26.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.662+0000 7f7745d9b640 1 -- 172.21.15.88:0/3171352207 >> v1:172.21.15.148:6789/0 conn(0x7f774814b1e0 legacy=0x7f77480c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:26.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.662+0000 7f7745d9b640 1 -- 172.21.15.88:0/3171352207 >> v1:172.21.15.88:6789/0 conn(0x7f77481548c0 legacy=0x7f7748154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:26.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.662+0000 7f7745d9b640 1 -- 172.21.15.88:0/3171352207 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77480c11e0 con 0x7f77480c5300 2023-12-08T08:22:26.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.666+0000 7f7745d9b640 1 --2- 172.21.15.88:0/3171352207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77480c5300 0x7f77480a9c30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f773c0097c0 tx=0x7f773c01c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50a50097bf014d42 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:26.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.666+0000 7f774559a640 1 -- 172.21.15.88:0/3171352207 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7740001a00 con 0x7f77480c5300 2023-12-08T08:22:26.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.666+0000 7f774559a640 1 -- 172.21.15.88:0/3171352207 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773c0a7050 con 0x7f77480c5300 2023-12-08T08:22:26.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.666+0000 7f774559a640 1 -- 172.21.15.88:0/3171352207 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773c0ab620 con 0x7f77480c5300 2023-12-08T08:22:26.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.666+0000 7f774caea640 1 -- 172.21.15.88:0/3171352207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77480c5300 msgr2=0x7f77480a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:26.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.666+0000 7f774caea640 1 --2- 172.21.15.88:0/3171352207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77480c5300 0x7f77480a9c30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f773c0097c0 tx=0x7f773c01c3a0 comp rx=0 tx=0).stop 2023-12-08T08:22:26.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.666+0000 7f774caea640 1 -- 172.21.15.88:0/3171352207 shutdown_connections 2023-12-08T08:22:26.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.666+0000 7f774caea640 1 --2- 172.21.15.88:0/3171352207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77480c5300 0x7f77480a9c30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:26.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.666+0000 7f774caea640 1 -- 172.21.15.88:0/3171352207 >> 172.21.15.88:0/3171352207 conn(0x7f77480c59f0 msgr2=0x7f77480c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:26.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.666+0000 7f774caea640 1 -- 172.21.15.88:0/3171352207 shutdown_connections 2023-12-08T08:22:26.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.666+0000 7f774caea640 1 -- 172.21.15.88:0/3171352207 wait complete. 2023-12-08T08:22:26.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.670+0000 7f774caea640 1 Processor -- start 2023-12-08T08:22:26.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.670+0000 7f774caea640 1 -- start start 2023-12-08T08:22:26.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.670+0000 7f774caea640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77480c5300 0x7f7748143db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:26.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.670+0000 7f774caea640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f774814b1e0 0x7f77480a6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:26.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.670+0000 7f774caea640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77481548c0 0x7f7748142cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:26.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.670+0000 7f774caea640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77480a5b40 con 0x7f774814b1e0 2023-12-08T08:22:26.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.670+0000 7f774caea640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77480a5e20 con 0x7f77480c5300 2023-12-08T08:22:26.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.670+0000 7f774caea640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77480a6100 con 0x7f77481548c0 2023-12-08T08:22:26.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.670+0000 7f7745d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f774814b1e0 0x7f77480a6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:26.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.670+0000 7f7745d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f774814b1e0 0x7f77480a6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48820/0 (socket says 172.21.15.88:48820) 2023-12-08T08:22:26.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.670+0000 7f7745d9b640 1 -- 172.21.15.88:0/1305909480 learned_addr learned my addr 172.21.15.88:0/1305909480 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:26.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.670+0000 7f7746d9d640 1 --2- 172.21.15.88:0/1305909480 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77481548c0 0x7f7748142cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:26.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.670+0000 7f774659c640 1 --2- 172.21.15.88:0/1305909480 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77480c5300 0x7f7748143db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:26.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.670+0000 7f7745d9b640 1 -- 172.21.15.88:0/1305909480 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77481548c0 msgr2=0x7f7748142cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:26.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.670+0000 7f7745d9b640 1 --2- 172.21.15.88:0/1305909480 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77481548c0 0x7f7748142cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:26.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.670+0000 7f7745d9b640 1 -- 172.21.15.88:0/1305909480 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77480c5300 msgr2=0x7f7748143db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:26.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.670+0000 7f7745d9b640 1 --2- 172.21.15.88:0/1305909480 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77480c5300 0x7f7748143db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:26.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.670+0000 7f7745d9b640 1 -- 172.21.15.88:0/1305909480 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773c009420 con 0x7f774814b1e0 2023-12-08T08:22:26.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.670+0000 7f7746d9d640 1 --2- 172.21.15.88:0/1305909480 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77481548c0 0x7f7748142cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:26.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.670+0000 7f774659c640 1 --2- 172.21.15.88:0/1305909480 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77480c5300 0x7f7748143db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:26.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.670+0000 7f7745d9b640 1 --2- 172.21.15.88:0/1305909480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f774814b1e0 0x7f77480a6a40 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f773c0097c0 tx=0x7f773c019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:26.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.670+0000 7f7736ffd640 1 -- 172.21.15.88:0/1305909480 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773c004020 con 0x7f774814b1e0 2023-12-08T08:22:26.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.670+0000 7f7736ffd640 1 -- 172.21.15.88:0/1305909480 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773c004180 con 0x7f774814b1e0 2023-12-08T08:22:26.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.670+0000 7f774caea640 1 -- 172.21.15.88:0/1305909480 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7748145650 con 0x7f774814b1e0 2023-12-08T08:22:26.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.670+0000 7f7736ffd640 1 -- 172.21.15.88:0/1305909480 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773c004510 con 0x7f774814b1e0 2023-12-08T08:22:26.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.670+0000 7f774caea640 1 -- 172.21.15.88:0/1305909480 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77480a6f80 con 0x7f774814b1e0 2023-12-08T08:22:26.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.670+0000 7f774caea640 1 -- 172.21.15.88:0/1305909480 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7748067630 con 0x7f774814b1e0 2023-12-08T08:22:26.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.674+0000 7f7736ffd640 1 -- 172.21.15.88:0/1305909480 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f773c0b2040 con 0x7f774814b1e0 2023-12-08T08:22:26.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.674+0000 7f7736ffd640 1 --2- 172.21.15.88:0/1305909480 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7728066470 0x7f7728068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:26.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.674+0000 7f7736ffd640 1 -- 172.21.15.88:0/1305909480 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f773c11e150 con 0x7f774814b1e0 2023-12-08T08:22:26.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.674+0000 7f774659c640 1 --2- 172.21.15.88:0/1305909480 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7728066470 0x7f7728068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:26.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.674+0000 7f774659c640 1 --2- 172.21.15.88:0/1305909480 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7728066470 0x7f7728068930 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f77380011f0 tx=0x7f7738009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:26.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.678+0000 7f7736ffd640 1 -- 172.21.15.88:0/1305909480 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f773c0eb260 con 0x7f774814b1e0 2023-12-08T08:22:26.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.826+0000 7f774caea640 1 -- 172.21.15.88:0/1305909480 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f77480c4f30 con 0x7f774814b1e0 2023-12-08T08:22:26.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.826+0000 7f7736ffd640 1 -- 172.21.15.88:0/1305909480 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f773c0ee880 con 0x7f774814b1e0 2023-12-08T08:22:26.833 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:22:26.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.830+0000 7f774caea640 1 -- 172.21.15.88:0/1305909480 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7728066470 msgr2=0x7f7728068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:26.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.830+0000 7f774caea640 1 --2- 172.21.15.88:0/1305909480 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7728066470 0x7f7728068930 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f77380011f0 tx=0x7f7738009040 comp rx=0 tx=0).stop 2023-12-08T08:22:26.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.830+0000 7f774caea640 1 -- 172.21.15.88:0/1305909480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f774814b1e0 msgr2=0x7f77480a6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:26.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.830+0000 7f774caea640 1 --2- 172.21.15.88:0/1305909480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f774814b1e0 0x7f77480a6a40 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f773c0097c0 tx=0x7f773c019140 comp rx=0 tx=0).stop 2023-12-08T08:22:26.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.830+0000 7f774caea640 1 -- 172.21.15.88:0/1305909480 shutdown_connections 2023-12-08T08:22:26.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.830+0000 7f774caea640 1 --2- 172.21.15.88:0/1305909480 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7728066470 0x7f7728068930 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:26.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.830+0000 7f774caea640 1 --2- 172.21.15.88:0/1305909480 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77481548c0 0x7f7748142cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:26.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.830+0000 7f774caea640 1 --2- 172.21.15.88:0/1305909480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f774814b1e0 0x7f77480a6a40 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:26.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.830+0000 7f774caea640 1 --2- 172.21.15.88:0/1305909480 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77480c5300 0x7f7748143db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:26.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.830+0000 7f774caea640 1 -- 172.21.15.88:0/1305909480 >> 172.21.15.88:0/1305909480 conn(0x7f77480c59f0 msgr2=0x7f7748148400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:26.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.830+0000 7f774caea640 1 -- 172.21.15.88:0/1305909480 shutdown_connections 2023-12-08T08:22:26.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.830+0000 7f774caea640 1 -- 172.21.15.88:0/1305909480 wait complete. 2023-12-08T08:22:26.854 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:22:26.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.990+0000 7f6263da1640 1 Processor -- start 2023-12-08T08:22:26.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.990+0000 7f6263da1640 1 -- start start 2023-12-08T08:22:26.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.990+0000 7f6263da1640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f625c0a89e0 0x7f625c14e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:26.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.990+0000 7f6263da1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f625c14eb60 0x7f625c151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:26.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.990+0000 7f6263da1640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f625c0c3080 con 0x7f625c0c6570 2023-12-08T08:22:26.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.990+0000 7f6263da1640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f625c0a6220 con 0x7f625c14eb60 2023-12-08T08:22:26.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.990+0000 7f6263da1640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f625c14ef80 con 0x7f625c0a89e0 2023-12-08T08:22:26.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.990+0000 7f626233e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f625c14eb60 0x7f625c151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:26.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.990+0000 7f626133c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f625c0c6570 0x7f625c151490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46828/0 (socket says 172.21.15.88:46828) 2023-12-08T08:22:26.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.990+0000 7f626133c640 1 -- 172.21.15.88:0/1647974408 learned_addr learned my addr 172.21.15.88:0/1647974408 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:26.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.990+0000 7f6261b3d640 1 --2- 172.21.15.88:0/1647974408 >> v2:172.21.15.148:3300/0 conn(0x7f625c0a89e0 0x7f625c14e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:26.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.990+0000 7f626233e640 1 -- 172.21.15.88:0/1647974408 >> v2:172.21.15.148:3300/0 conn(0x7f625c0a89e0 msgr2=0x7f625c14e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:26.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.990+0000 7f626233e640 1 --2- 172.21.15.88:0/1647974408 >> v2:172.21.15.148:3300/0 conn(0x7f625c0a89e0 0x7f625c14e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:26.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.990+0000 7f626233e640 1 -- 172.21.15.88:0/1647974408 >> v1:172.21.15.88:6789/0 conn(0x7f625c0c6570 legacy=0x7f625c151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:26.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.990+0000 7f626233e640 1 -- 172.21.15.88:0/1647974408 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c0c2d50 con 0x7f625c14eb60 2023-12-08T08:22:26.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.990+0000 7f6260b3b640 1 -- 172.21.15.88:0/1647974408 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3208507938 0 0) 0x7f625c0c3080 con 0x7f625c0c6570 2023-12-08T08:22:27.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.994+0000 7f626233e640 1 --2- 172.21.15.88:0/1647974408 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f625c14eb60 0x7f625c151ba0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f625c0a9320 tx=0x7f625401c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7fc22a2149ea8ec server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:27.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.994+0000 7f6260b3b640 1 -- 172.21.15.88:0/1647974408 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62540a58a0 con 0x7f625c14eb60 2023-12-08T08:22:27.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.994+0000 7f6260b3b640 1 -- 172.21.15.88:0/1647974408 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62540a5a00 con 0x7f625c14eb60 2023-12-08T08:22:27.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.994+0000 7f6260b3b640 1 -- 172.21.15.88:0/1647974408 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62540a5d90 con 0x7f625c14eb60 2023-12-08T08:22:27.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.994+0000 7f6263da1640 1 -- 172.21.15.88:0/1647974408 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f625c14eb60 msgr2=0x7f625c151ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:27.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.994+0000 7f6263da1640 1 --2- 172.21.15.88:0/1647974408 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f625c14eb60 0x7f625c151ba0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f625c0a9320 tx=0x7f625401c7c0 comp rx=0 tx=0).stop 2023-12-08T08:22:27.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.994+0000 7f6263da1640 1 -- 172.21.15.88:0/1647974408 shutdown_connections 2023-12-08T08:22:27.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.994+0000 7f6263da1640 1 --2- 172.21.15.88:0/1647974408 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f625c14eb60 0x7f625c151ba0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:27.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.994+0000 7f6263da1640 1 --2- 172.21.15.88:0/1647974408 >> v2:172.21.15.148:3300/0 conn(0x7f625c0a89e0 0x7f625c14e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:27.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.994+0000 7f6263da1640 1 -- 172.21.15.88:0/1647974408 >> 172.21.15.88:0/1647974408 conn(0x7f625c0c6b20 msgr2=0x7f625c0c6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:27.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.994+0000 7f6263da1640 1 -- 172.21.15.88:0/1647974408 shutdown_connections 2023-12-08T08:22:27.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.994+0000 7f6263da1640 1 -- 172.21.15.88:0/1647974408 wait complete. 2023-12-08T08:22:27.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.998+0000 7f6263da1640 1 Processor -- start 2023-12-08T08:22:27.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.998+0000 7f6263da1640 1 -- start start 2023-12-08T08:22:27.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.998+0000 7f6263da1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f625c0a89e0 0x7f625c147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:27.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.998+0000 7f6263da1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f625c0c6570 0x7f625c145cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:27.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.998+0000 7f6263da1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f625c14eb60 0x7f625c1461f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:27.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.998+0000 7f6263da1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c0ac010 con 0x7f625c0c6570 2023-12-08T08:22:27.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.998+0000 7f6263da1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c0abb20 con 0x7f625c0a89e0 2023-12-08T08:22:27.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.998+0000 7f6263da1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625c0ac700 con 0x7f625c14eb60 2023-12-08T08:22:27.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.998+0000 7f626133c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f625c0c6570 0x7f625c145cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:27.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.998+0000 7f626133c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f625c0c6570 0x7f625c145cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48836/0 (socket says 172.21.15.88:48836) 2023-12-08T08:22:27.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.998+0000 7f626133c640 1 -- 172.21.15.88:0/3899133259 learned_addr learned my addr 172.21.15.88:0/3899133259 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:27.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.998+0000 7f626133c640 1 -- 172.21.15.88:0/3899133259 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f625c14eb60 msgr2=0x7f625c1461f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:27.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.998+0000 7f626133c640 1 --2- 172.21.15.88:0/3899133259 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f625c14eb60 0x7f625c1461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:27.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.998+0000 7f626133c640 1 -- 172.21.15.88:0/3899133259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f625c0a89e0 msgr2=0x7f625c147ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:27.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.998+0000 7f626133c640 1 --2- 172.21.15.88:0/3899133259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f625c0a89e0 0x7f625c147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:27.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.998+0000 7f626133c640 1 -- 172.21.15.88:0/3899133259 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6254009a70 con 0x7f625c0c6570 2023-12-08T08:22:27.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.998+0000 7f626133c640 1 --2- 172.21.15.88:0/3899133259 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f625c0c6570 0x7f625c145cb0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f624c00c480 tx=0x7f624c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:27.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.998+0000 7f62527fc640 1 -- 172.21.15.88:0/3899133259 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c0074e0 con 0x7f625c0c6570 2023-12-08T08:22:27.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.998+0000 7f62527fc640 1 -- 172.21.15.88:0/3899133259 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624c007640 con 0x7f625c0c6570 2023-12-08T08:22:27.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.998+0000 7f62527fc640 1 -- 172.21.15.88:0/3899133259 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c0049f0 con 0x7f625c0c6570 2023-12-08T08:22:27.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.998+0000 7f6263da1640 1 -- 172.21.15.88:0/3899133259 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f625c14b620 con 0x7f625c0c6570 2023-12-08T08:22:27.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:26.998+0000 7f6263da1640 1 -- 172.21.15.88:0/3899133259 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f625c146730 con 0x7f625c0c6570 2023-12-08T08:22:27.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.002+0000 7f6263da1640 1 -- 172.21.15.88:0/3899133259 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f625c067630 con 0x7f625c0c6570 2023-12-08T08:22:27.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.002+0000 7f62527fc640 1 -- 172.21.15.88:0/3899133259 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f624c004b50 con 0x7f625c0c6570 2023-12-08T08:22:27.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.002+0000 7f62527fc640 1 --2- 172.21.15.88:0/3899133259 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f62400664a0 0x7f6240068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:27.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.002+0000 7f62527fc640 1 -- 172.21.15.88:0/3899133259 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f624c083420 con 0x7f625c0c6570 2023-12-08T08:22:27.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.002+0000 7f6261b3d640 1 --2- 172.21.15.88:0/3899133259 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f62400664a0 0x7f6240068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:27.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.002+0000 7f6261b3d640 1 --2- 172.21.15.88:0/3899133259 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f62400664a0 0x7f6240068960 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f625c14e130 tx=0x7f6258008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:27.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.006+0000 7f62527fc640 1 -- 172.21.15.88:0/3899133259 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f624c050530 con 0x7f625c0c6570 2023-12-08T08:22:27.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.162+0000 7f6263da1640 1 -- 172.21.15.88:0/3899133259 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f625c072320 con 0x7f625c0c6570 2023-12-08T08:22:27.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.162+0000 7f62527fc640 1 -- 172.21.15.88:0/3899133259 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v54) v1 ==== 105+0+11 (secure 0 0 0) 0x7f624c0180b0 con 0x7f625c0c6570 2023-12-08T08:22:27.166 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:22:27.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.162+0000 7f6263da1640 1 -- 172.21.15.88:0/3899133259 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f62400664a0 msgr2=0x7f6240068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:27.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.162+0000 7f6263da1640 1 --2- 172.21.15.88:0/3899133259 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f62400664a0 0x7f6240068960 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f625c14e130 tx=0x7f6258008040 comp rx=0 tx=0).stop 2023-12-08T08:22:27.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.162+0000 7f6263da1640 1 -- 172.21.15.88:0/3899133259 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f625c0c6570 msgr2=0x7f625c145cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:27.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.162+0000 7f6263da1640 1 --2- 172.21.15.88:0/3899133259 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f625c0c6570 0x7f625c145cb0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f624c00c480 tx=0x7f624c00c940 comp rx=0 tx=0).stop 2023-12-08T08:22:27.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.162+0000 7f6263da1640 1 -- 172.21.15.88:0/3899133259 shutdown_connections 2023-12-08T08:22:27.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.162+0000 7f6263da1640 1 --2- 172.21.15.88:0/3899133259 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f62400664a0 0x7f6240068960 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:27.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.162+0000 7f6263da1640 1 --2- 172.21.15.88:0/3899133259 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f625c14eb60 0x7f625c1461f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:27.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.162+0000 7f6263da1640 1 --2- 172.21.15.88:0/3899133259 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f625c0c6570 0x7f625c145cb0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:27.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.162+0000 7f6263da1640 1 --2- 172.21.15.88:0/3899133259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f625c0a89e0 0x7f625c147ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:27.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.162+0000 7f6263da1640 1 -- 172.21.15.88:0/3899133259 >> 172.21.15.88:0/3899133259 conn(0x7f625c0c6b20 msgr2=0x7f625c0c6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:27.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.162+0000 7f6263da1640 1 -- 172.21.15.88:0/3899133259 shutdown_connections 2023-12-08T08:22:27.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.162+0000 7f6263da1640 1 -- 172.21.15.88:0/3899133259 wait complete. 2023-12-08T08:22:27.186 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:22:27.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.322+0000 7f23e0d72640 1 Processor -- start 2023-12-08T08:22:27.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.322+0000 7f23e0d72640 1 -- start start 2023-12-08T08:22:27.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.322+0000 7f23e0d72640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f23dc151a20 0x7f23dc06e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:27.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.322+0000 7f23e0d72640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23dc0c1810 con 0x7f23dc154bd0 2023-12-08T08:22:27.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.322+0000 7f23e0d72640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23dc0c2320 con 0x7f23dc157a90 2023-12-08T08:22:27.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.322+0000 7f23e0d72640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23dc0c2720 con 0x7f23dc151a20 2023-12-08T08:22:27.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.322+0000 7f23dad9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f23dc154bd0 0x7f23dc15ee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46838/0 (socket says 172.21.15.88:46838) 2023-12-08T08:22:27.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.322+0000 7f23dad9d640 1 -- 172.21.15.88:0/2299138637 learned_addr learned my addr 172.21.15.88:0/2299138637 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:27.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.322+0000 7f23da59c640 1 --2- 172.21.15.88:0/2299138637 >> v2:172.21.15.148:3300/0 conn(0x7f23dc151a20 0x7f23dc06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:27.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.322+0000 7f23d9d9b640 1 -- 172.21.15.88:0/2299138637 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4101608196 0 0) 0x7f23dc0c1810 con 0x7f23dc154bd0 2023-12-08T08:22:27.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.322+0000 7f23d9d9b640 1 -- 172.21.15.88:0/2299138637 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23c8003530 con 0x7f23dc154bd0 2023-12-08T08:22:27.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.322+0000 7f23da59c640 1 -- 172.21.15.88:0/2299138637 >> v1:172.21.15.148:6789/0 conn(0x7f23dc157a90 legacy=0x7f23dc06b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:27.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.322+0000 7f23da59c640 1 -- 172.21.15.88:0/2299138637 >> v1:172.21.15.88:6789/0 conn(0x7f23dc154bd0 legacy=0x7f23dc15ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:27.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.322+0000 7f23da59c640 1 -- 172.21.15.88:0/2299138637 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23dc0c1a80 con 0x7f23dc151a20 2023-12-08T08:22:27.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.326+0000 7f23da59c640 1 --2- 172.21.15.88:0/2299138637 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23dc151a20 0x7f23dc06e890 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0097c0 tx=0x7f23cc01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4db53b67b3ca78b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:27.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.326+0000 7f23d9d9b640 1 -- 172.21.15.88:0/2299138637 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc0ab600 con 0x7f23dc151a20 2023-12-08T08:22:27.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.326+0000 7f23d9d9b640 1 -- 172.21.15.88:0/2299138637 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23cc0a7050 con 0x7f23dc151a20 2023-12-08T08:22:27.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.326+0000 7f23d9d9b640 1 -- 172.21.15.88:0/2299138637 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc0ab980 con 0x7f23dc151a20 2023-12-08T08:22:27.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.326+0000 7f23e0d72640 1 -- 172.21.15.88:0/2299138637 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23dc151a20 msgr2=0x7f23dc06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:27.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.326+0000 7f23e0d72640 1 --2- 172.21.15.88:0/2299138637 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23dc151a20 0x7f23dc06e890 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0097c0 tx=0x7f23cc01c3f0 comp rx=0 tx=0).stop 2023-12-08T08:22:27.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.326+0000 7f23e0d72640 1 -- 172.21.15.88:0/2299138637 shutdown_connections 2023-12-08T08:22:27.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.326+0000 7f23e0d72640 1 --2- 172.21.15.88:0/2299138637 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23dc151a20 0x7f23dc06e890 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:27.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.326+0000 7f23e0d72640 1 -- 172.21.15.88:0/2299138637 >> 172.21.15.88:0/2299138637 conn(0x7f23dc0c2e20 msgr2=0x7f23dc0c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:27.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.330+0000 7f23e0d72640 1 -- 172.21.15.88:0/2299138637 shutdown_connections 2023-12-08T08:22:27.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.330+0000 7f23e0d72640 1 -- 172.21.15.88:0/2299138637 wait complete. 2023-12-08T08:22:27.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.330+0000 7f23e0d72640 1 Processor -- start 2023-12-08T08:22:27.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.330+0000 7f23e0d72640 1 -- start start 2023-12-08T08:22:27.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.330+0000 7f23e0d72640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23dc151a20 0x7f23dc157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:27.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.330+0000 7f23e0d72640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23dc154bd0 0x7f23dc145fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:27.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.330+0000 7f23e0d72640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23dc157a90 0x7f23dc1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:27.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.330+0000 7f23e0d72640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc0c5d60 con 0x7f23dc154bd0 2023-12-08T08:22:27.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.330+0000 7f23e0d72640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc146a20 con 0x7f23dc157a90 2023-12-08T08:22:27.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.330+0000 7f23e0d72640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc14a2f0 con 0x7f23dc151a20 2023-12-08T08:22:27.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.330+0000 7f23d3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23dc154bd0 0x7f23dc145fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:27.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.330+0000 7f23d3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23dc154bd0 0x7f23dc145fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48838/0 (socket says 172.21.15.88:48838) 2023-12-08T08:22:27.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.330+0000 7f23d3fff640 1 -- 172.21.15.88:0/54505972 learned_addr learned my addr 172.21.15.88:0/54505972 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:27.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.330+0000 7f23da59c640 1 --2- 172.21.15.88:0/54505972 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23dc151a20 0x7f23dc157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:27.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.330+0000 7f23dad9d640 1 --2- 172.21.15.88:0/54505972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23dc157a90 0x7f23dc1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:27.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.330+0000 7f23d3fff640 1 -- 172.21.15.88:0/54505972 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23dc151a20 msgr2=0x7f23dc157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:27.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.330+0000 7f23d3fff640 1 --2- 172.21.15.88:0/54505972 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23dc151a20 0x7f23dc157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:27.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.330+0000 7f23d3fff640 1 -- 172.21.15.88:0/54505972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23dc157a90 msgr2=0x7f23dc1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:27.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.330+0000 7f23d3fff640 1 --2- 172.21.15.88:0/54505972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23dc157a90 0x7f23dc1464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:27.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.330+0000 7f23d3fff640 1 -- 172.21.15.88:0/54505972 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc009420 con 0x7f23dc154bd0 2023-12-08T08:22:27.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.330+0000 7f23dad9d640 1 --2- 172.21.15.88:0/54505972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23dc157a90 0x7f23dc1464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:27.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.330+0000 7f23d3fff640 1 --2- 172.21.15.88:0/54505972 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23dc154bd0 0x7f23dc145fa0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f23c400c3c0 tx=0x7f23c400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:27.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.330+0000 7f23d2ffd640 1 -- 172.21.15.88:0/54505972 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c40052d0 con 0x7f23dc154bd0 2023-12-08T08:22:27.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.330+0000 7f23d2ffd640 1 -- 172.21.15.88:0/54505972 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c4005430 con 0x7f23dc154bd0 2023-12-08T08:22:27.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.330+0000 7f23d2ffd640 1 -- 172.21.15.88:0/54505972 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c4003820 con 0x7f23dc154bd0 2023-12-08T08:22:27.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.334+0000 7f23e0d72640 1 -- 172.21.15.88:0/54505972 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23dc1edc20 con 0x7f23dc154bd0 2023-12-08T08:22:27.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.334+0000 7f23e0d72640 1 -- 172.21.15.88:0/54505972 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23dc14a5b0 con 0x7f23dc154bd0 2023-12-08T08:22:27.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.334+0000 7f23e0d72640 1 -- 172.21.15.88:0/54505972 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23dc066660 con 0x7f23dc154bd0 2023-12-08T08:22:27.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.334+0000 7f23d2ffd640 1 -- 172.21.15.88:0/54505972 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f23c4003980 con 0x7f23dc154bd0 2023-12-08T08:22:27.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.334+0000 7f23d2ffd640 1 --2- 172.21.15.88:0/54505972 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f23bc066470 0x7f23bc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:27.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.334+0000 7f23d2ffd640 1 -- 172.21.15.88:0/54505972 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f23c4083630 con 0x7f23dc154bd0 2023-12-08T08:22:27.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.334+0000 7f23da59c640 1 --2- 172.21.15.88:0/54505972 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f23bc066470 0x7f23bc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:27.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.338+0000 7f23da59c640 1 --2- 172.21.15.88:0/54505972 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f23bc066470 0x7f23bc068930 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0ad000 tx=0x7f23cc0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:27.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.338+0000 7f23d2ffd640 1 -- 172.21.15.88:0/54505972 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f23c40507f0 con 0x7f23dc154bd0 2023-12-08T08:22:27.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.486+0000 7f23e0d72640 1 -- 172.21.15.88:0/54505972 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f23dc067630 con 0x7f23dc154bd0 2023-12-08T08:22:27.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.490+0000 7f23d2ffd640 1 -- 172.21.15.88:0/54505972 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v54) v1 ==== 101+0+11 (secure 0 0 0) 0x7f23c4053e10 con 0x7f23dc154bd0 2023-12-08T08:22:27.494 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:22:27.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.490+0000 7f23e0d72640 1 -- 172.21.15.88:0/54505972 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f23bc066470 msgr2=0x7f23bc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:27.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.490+0000 7f23e0d72640 1 --2- 172.21.15.88:0/54505972 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f23bc066470 0x7f23bc068930 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0ad000 tx=0x7f23cc0a6000 comp rx=0 tx=0).stop 2023-12-08T08:22:27.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.490+0000 7f23e0d72640 1 -- 172.21.15.88:0/54505972 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23dc154bd0 msgr2=0x7f23dc145fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:27.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.490+0000 7f23e0d72640 1 --2- 172.21.15.88:0/54505972 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23dc154bd0 0x7f23dc145fa0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f23c400c3c0 tx=0x7f23c400c880 comp rx=0 tx=0).stop 2023-12-08T08:22:27.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.490+0000 7f23e0d72640 1 -- 172.21.15.88:0/54505972 shutdown_connections 2023-12-08T08:22:27.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.490+0000 7f23e0d72640 1 --2- 172.21.15.88:0/54505972 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f23bc066470 0x7f23bc068930 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:27.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.490+0000 7f23e0d72640 1 --2- 172.21.15.88:0/54505972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23dc157a90 0x7f23dc1464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:27.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.490+0000 7f23e0d72640 1 --2- 172.21.15.88:0/54505972 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23dc154bd0 0x7f23dc145fa0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:27.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.490+0000 7f23e0d72640 1 --2- 172.21.15.88:0/54505972 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f23dc151a20 0x7f23dc157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:27.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.490+0000 7f23e0d72640 1 -- 172.21.15.88:0/54505972 >> 172.21.15.88:0/54505972 conn(0x7f23dc0c2e20 msgr2=0x7f23dc153700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:27.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.490+0000 7f23e0d72640 1 -- 172.21.15.88:0/54505972 shutdown_connections 2023-12-08T08:22:27.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.490+0000 7f23e0d72640 1 -- 172.21.15.88:0/54505972 wait complete. 2023-12-08T08:22:27.515 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:22:27.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.650+0000 7f458dafe640 1 Processor -- start 2023-12-08T08:22:27.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.650+0000 7f458dafe640 1 -- start start 2023-12-08T08:22:27.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.650+0000 7f458dafe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f45880c66b0 0x7f45880a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:27.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.650+0000 7f458dafe640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f458814e550 0x7f4588150f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:27.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.650+0000 7f458dafe640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45880a4cc0 con 0x7f458806bc70 2023-12-08T08:22:27.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.650+0000 7f458dafe640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45880c23d0 con 0x7f45880c66b0 2023-12-08T08:22:27.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.650+0000 7f458dafe640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45880c1b70 con 0x7f458814e550 2023-12-08T08:22:27.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.650+0000 7f457ffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f45880c66b0 0x7f45880a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:27.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.650+0000 7f457ffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f45880c66b0 0x7f45880a4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48854/0 (socket says 172.21.15.88:48854) 2023-12-08T08:22:27.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.650+0000 7f457ffff640 1 -- 172.21.15.88:0/3511834484 learned_addr learned my addr 172.21.15.88:0/3511834484 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:27.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.650+0000 7f4587fff640 1 --2- 172.21.15.88:0/3511834484 >> v2:172.21.15.148:3300/0 conn(0x7f458814e550 0x7f4588150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:27.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.650+0000 7f457ffff640 1 -- 172.21.15.88:0/3511834484 >> v2:172.21.15.148:3300/0 conn(0x7f458814e550 msgr2=0x7f4588150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:27.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.650+0000 7f457ffff640 1 --2- 172.21.15.88:0/3511834484 >> v2:172.21.15.148:3300/0 conn(0x7f458814e550 0x7f4588150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:27.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.650+0000 7f457ffff640 1 -- 172.21.15.88:0/3511834484 >> v1:172.21.15.148:6789/0 conn(0x7f458806bc70 legacy=0x7f458814de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:27.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.650+0000 7f457ffff640 1 -- 172.21.15.88:0/3511834484 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45880c1d80 con 0x7f45880c66b0 2023-12-08T08:22:27.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.654+0000 7f457ffff640 1 --2- 172.21.15.88:0/3511834484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45880c66b0 0x7f45880a4fa0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f45880c6450 tx=0x7f457001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930d9f147a59dbcf server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:27.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.654+0000 7f4586ffd640 1 -- 172.21.15.88:0/3511834484 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45700ab600 con 0x7f45880c66b0 2023-12-08T08:22:27.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.654+0000 7f4586ffd640 1 -- 172.21.15.88:0/3511834484 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45700a7050 con 0x7f45880c66b0 2023-12-08T08:22:27.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.654+0000 7f4586ffd640 1 -- 172.21.15.88:0/3511834484 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45700ab980 con 0x7f45880c66b0 2023-12-08T08:22:27.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.654+0000 7f458dafe640 1 -- 172.21.15.88:0/3511834484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45880c66b0 msgr2=0x7f45880a4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:27.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.654+0000 7f458dafe640 1 --2- 172.21.15.88:0/3511834484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45880c66b0 0x7f45880a4fa0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f45880c6450 tx=0x7f457001c360 comp rx=0 tx=0).stop 2023-12-08T08:22:27.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.654+0000 7f458dafe640 1 -- 172.21.15.88:0/3511834484 shutdown_connections 2023-12-08T08:22:27.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.654+0000 7f458dafe640 1 --2- 172.21.15.88:0/3511834484 >> v2:172.21.15.148:3300/0 conn(0x7f458814e550 0x7f4588150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:27.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.654+0000 7f458dafe640 1 --2- 172.21.15.88:0/3511834484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45880c66b0 0x7f45880a4fa0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:27.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.654+0000 7f458dafe640 1 -- 172.21.15.88:0/3511834484 >> 172.21.15.88:0/3511834484 conn(0x7f458806b220 msgr2=0x7f45880a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:27.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.654+0000 7f458dafe640 1 -- 172.21.15.88:0/3511834484 shutdown_connections 2023-12-08T08:22:27.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.654+0000 7f458dafe640 1 -- 172.21.15.88:0/3511834484 wait complete. 2023-12-08T08:22:27.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.658+0000 7f458dafe640 1 Processor -- start 2023-12-08T08:22:27.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.658+0000 7f458dafe640 1 -- start start 2023-12-08T08:22:27.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.658+0000 7f458dafe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f458806bc70 0x7f45881ed670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:27.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.658+0000 7f458dafe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45880c66b0 0x7f45881f0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:27.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.658+0000 7f458dafe640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f458814e550 0x7f45880bee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:27.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.658+0000 7f458dafe640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45881ecbb0 con 0x7f45880c66b0 2023-12-08T08:22:27.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.658+0000 7f458dafe640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4588147870 con 0x7f458806bc70 2023-12-08T08:22:27.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.658+0000 7f458dafe640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4588147b50 con 0x7f458814e550 2023-12-08T08:22:27.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.658+0000 7f457ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45880c66b0 0x7f45881f0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:27.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.658+0000 7f457ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45880c66b0 0x7f45881f0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48860/0 (socket says 172.21.15.88:48860) 2023-12-08T08:22:27.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.658+0000 7f457ffff640 1 -- 172.21.15.88:0/1098721999 learned_addr learned my addr 172.21.15.88:0/1098721999 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:27.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.658+0000 7f45877fe640 1 --2- 172.21.15.88:0/1098721999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f458806bc70 0x7f45881ed670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:27.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.658+0000 7f4587fff640 1 --2- 172.21.15.88:0/1098721999 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f458814e550 0x7f45880bee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:27.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.658+0000 7f457ffff640 1 -- 172.21.15.88:0/1098721999 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f458814e550 msgr2=0x7f45880bee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:27.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.658+0000 7f457ffff640 1 --2- 172.21.15.88:0/1098721999 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f458814e550 0x7f45880bee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:27.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.658+0000 7f457ffff640 1 -- 172.21.15.88:0/1098721999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f458806bc70 msgr2=0x7f45881ed670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:27.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.658+0000 7f457ffff640 1 --2- 172.21.15.88:0/1098721999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f458806bc70 0x7f45881ed670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:27.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.658+0000 7f457ffff640 1 -- 172.21.15.88:0/1098721999 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45700094d0 con 0x7f45880c66b0 2023-12-08T08:22:27.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.658+0000 7f45877fe640 1 --2- 172.21.15.88:0/1098721999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f458806bc70 0x7f45881ed670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:27.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.658+0000 7f4587fff640 1 --2- 172.21.15.88:0/1098721999 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f458814e550 0x7f45880bee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:27.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.658+0000 7f457ffff640 1 --2- 172.21.15.88:0/1098721999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45880c66b0 0x7f45881f0120 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f45700ae040 tx=0x7f4570019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:27.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.658+0000 7f4584ff9640 1 -- 172.21.15.88:0/1098721999 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45700abde0 con 0x7f45880c66b0 2023-12-08T08:22:27.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.658+0000 7f4584ff9640 1 -- 172.21.15.88:0/1098721999 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45700b4440 con 0x7f45880c66b0 2023-12-08T08:22:27.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.658+0000 7f4584ff9640 1 -- 172.21.15.88:0/1098721999 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45700b47d0 con 0x7f45880c66b0 2023-12-08T08:22:27.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.658+0000 7f458dafe640 1 -- 172.21.15.88:0/1098721999 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45881ece70 con 0x7f45880c66b0 2023-12-08T08:22:27.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.658+0000 7f458dafe640 1 -- 172.21.15.88:0/1098721999 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4588144ac0 con 0x7f45880c66b0 2023-12-08T08:22:27.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.662+0000 7f458dafe640 1 -- 172.21.15.88:0/1098721999 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4588067630 con 0x7f45880c66b0 2023-12-08T08:22:27.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.662+0000 7f4584ff9640 1 -- 172.21.15.88:0/1098721999 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f45700b2070 con 0x7f45880c66b0 2023-12-08T08:22:27.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.662+0000 7f4584ff9640 1 --2- 172.21.15.88:0/1098721999 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4568066470 0x7f4568068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:27.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.662+0000 7f4584ff9640 1 -- 172.21.15.88:0/1098721999 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f457011e040 con 0x7f45880c66b0 2023-12-08T08:22:27.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.662+0000 7f45877fe640 1 --2- 172.21.15.88:0/1098721999 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4568066470 0x7f4568068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:27.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.662+0000 7f45877fe640 1 --2- 172.21.15.88:0/1098721999 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4568066470 0x7f4568068930 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4578003e40 tx=0x7f4578009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:27.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.666+0000 7f4584ff9640 1 -- 172.21.15.88:0/1098721999 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f457014f280 con 0x7f45880c66b0 2023-12-08T08:22:27.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.830+0000 7f458dafe640 1 -- 172.21.15.88:0/1098721999 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f45881ed320 con 0x7f45880c66b0 2023-12-08T08:22:27.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.830+0000 7f4584ff9640 1 -- 172.21.15.88:0/1098721999 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7f45700eb150 con 0x7f45880c66b0 2023-12-08T08:22:27.834 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-12-08T08:22:27.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.830+0000 7f458dafe640 1 -- 172.21.15.88:0/1098721999 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4568066470 msgr2=0x7f4568068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:27.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.830+0000 7f458dafe640 1 --2- 172.21.15.88:0/1098721999 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4568066470 0x7f4568068930 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4578003e40 tx=0x7f4578009040 comp rx=0 tx=0).stop 2023-12-08T08:22:27.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.830+0000 7f458dafe640 1 -- 172.21.15.88:0/1098721999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45880c66b0 msgr2=0x7f45881f0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:27.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.830+0000 7f458dafe640 1 --2- 172.21.15.88:0/1098721999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45880c66b0 0x7f45881f0120 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f45700ae040 tx=0x7f4570019100 comp rx=0 tx=0).stop 2023-12-08T08:22:27.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.830+0000 7f458dafe640 1 -- 172.21.15.88:0/1098721999 shutdown_connections 2023-12-08T08:22:27.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.830+0000 7f458dafe640 1 --2- 172.21.15.88:0/1098721999 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4568066470 0x7f4568068930 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:27.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.830+0000 7f458dafe640 1 --2- 172.21.15.88:0/1098721999 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f458814e550 0x7f45880bee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:27.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.830+0000 7f458dafe640 1 --2- 172.21.15.88:0/1098721999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45880c66b0 0x7f45881f0120 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:27.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.830+0000 7f458dafe640 1 --2- 172.21.15.88:0/1098721999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f458806bc70 0x7f45881ed670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:27.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.830+0000 7f458dafe640 1 -- 172.21.15.88:0/1098721999 >> 172.21.15.88:0/1098721999 conn(0x7f458806b220 msgr2=0x7f45880a5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:27.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.830+0000 7f458dafe640 1 -- 172.21.15.88:0/1098721999 shutdown_connections 2023-12-08T08:22:27.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:27.830+0000 7f458dafe640 1 -- 172.21.15.88:0/1098721999 wait complete. 2023-12-08T08:22:27.855 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-08T08:22:27.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:27.856 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-08T08:22:27.887 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-12-08T08:22:27.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:27.887 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-08T08:22:27.940 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:22:27.940 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:22:27.991 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354676k,nr_inodes=4088669,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9389 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-08T08:22:27.991 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:22:28.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.130+0000 7fe0b9e09640 1 Processor -- start 2023-12-08T08:22:28.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.130+0000 7fe0b9e09640 1 -- start start 2023-12-08T08:22:28.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.130+0000 7fe0b9e09640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe0b40c49c0 0x7fe0b40c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:28.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.130+0000 7fe0b9e09640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe0b40c59a0 0x7fe0b40c8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:28.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.130+0000 7fe0b9e09640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b40c62b0 con 0x7fe0b40bf690 2023-12-08T08:22:28.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.130+0000 7fe0b9e09640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b40c6590 con 0x7fe0b40c49c0 2023-12-08T08:22:28.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.130+0000 7fe0b9e09640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b41588d0 con 0x7fe0b40c59a0 2023-12-08T08:22:28.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.134+0000 7fe0b3fff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe0b40c59a0 0x7fe0b40c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:28.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.134+0000 7fe0b37fe640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe0b40c49c0 0x7fe0b40c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:28.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.134+0000 7fe0b37fe640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe0b40c49c0 0x7fe0b40c4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:46028/0 (socket says 172.21.15.88:46028) 2023-12-08T08:22:28.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.134+0000 7fe0b3fff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe0b40c59a0 0x7fe0b40c8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:59944/0 (socket says 172.21.15.88:59944) 2023-12-08T08:22:28.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.134+0000 7fe0b37fe640 1 -- 172.21.15.88:0/3499540908 learned_addr learned my addr 172.21.15.88:0/3499540908 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:28.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.134+0000 7fe0abfff640 1 --1- 172.21.15.88:0/3499540908 >> v1:172.21.15.148:6789/0 conn(0x7fe0b40bf690 0x7fe0b40c8280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:42186/0 (socket says 172.21.15.88:42186) 2023-12-08T08:22:28.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.134+0000 7fe0b37fe640 1 -- 172.21.15.88:0/3499540908 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe0b40c59a0 msgr2=0x7fe0b40c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:28.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.134+0000 7fe0b37fe640 1 --2- 172.21.15.88:0/3499540908 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe0b40c59a0 0x7fe0b40c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:28.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.134+0000 7fe0b37fe640 1 -- 172.21.15.88:0/3499540908 >> v1:172.21.15.148:6789/0 conn(0x7fe0b40bf690 legacy=0x7fe0b40c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:28.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.134+0000 7fe0b37fe640 1 -- 172.21.15.88:0/3499540908 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b40c7d60 con 0x7fe0b40c49c0 2023-12-08T08:22:28.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.134+0000 7fe0b2ffd640 1 -- 172.21.15.88:0/3499540908 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 231187953 0 0) 0x7fe0b40c62b0 con 0x7fe0b40bf690 2023-12-08T08:22:28.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.134+0000 7fe0b37fe640 1 --2- 172.21.15.88:0/3499540908 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b40c49c0 0x7fe0b40c4da0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4009870 tx=0x7fe0a401c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c25580e7edca747 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:28.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.138+0000 7fe0b2ffd640 1 -- 172.21.15.88:0/3499540908 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a40aa5f0 con 0x7fe0b40c49c0 2023-12-08T08:22:28.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.138+0000 7fe0b2ffd640 1 -- 172.21.15.88:0/3499540908 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a40aa750 con 0x7fe0b40c49c0 2023-12-08T08:22:28.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.138+0000 7fe0b2ffd640 1 -- 172.21.15.88:0/3499540908 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a40aaae0 con 0x7fe0b40c49c0 2023-12-08T08:22:28.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.138+0000 7fe0b9e09640 1 -- 172.21.15.88:0/3499540908 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b40c49c0 msgr2=0x7fe0b40c4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:28.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.138+0000 7fe0b9e09640 1 --2- 172.21.15.88:0/3499540908 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b40c49c0 0x7fe0b40c4da0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4009870 tx=0x7fe0a401c540 comp rx=0 tx=0).stop 2023-12-08T08:22:28.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.138+0000 7fe0b9e09640 1 -- 172.21.15.88:0/3499540908 shutdown_connections 2023-12-08T08:22:28.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.138+0000 7fe0b9e09640 1 --2- 172.21.15.88:0/3499540908 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe0b40c59a0 0x7fe0b40c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:28.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.138+0000 7fe0b9e09640 1 --2- 172.21.15.88:0/3499540908 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b40c49c0 0x7fe0b40c4da0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:28.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.138+0000 7fe0b9e09640 1 -- 172.21.15.88:0/3499540908 >> 172.21.15.88:0/3499540908 conn(0x7fe0b40c6840 msgr2=0x7fe0b40c6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:28.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.138+0000 7fe0b9e09640 1 -- 172.21.15.88:0/3499540908 shutdown_connections 2023-12-08T08:22:28.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.138+0000 7fe0b9e09640 1 -- 172.21.15.88:0/3499540908 wait complete. 2023-12-08T08:22:28.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.138+0000 7fe0b9e09640 1 Processor -- start 2023-12-08T08:22:28.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.138+0000 7fe0b9e09640 1 -- start start 2023-12-08T08:22:28.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.138+0000 7fe0b9e09640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe0b40bf690 0x7fe0b40abe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:28.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.138+0000 7fe0b9e09640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0b40c49c0 0x7fe0b40ac360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:28.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.138+0000 7fe0b9e09640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b40c59a0 0x7fe0b40ae830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:28.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.138+0000 7fe0b9e09640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b414e150 con 0x7fe0b40c49c0 2023-12-08T08:22:28.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.138+0000 7fe0b9e09640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b414d4d0 con 0x7fe0b40c59a0 2023-12-08T08:22:28.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.138+0000 7fe0b9e09640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b414d7b0 con 0x7fe0b40bf690 2023-12-08T08:22:28.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.138+0000 7fe0abfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0b40c49c0 0x7fe0b40ac360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:28.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.138+0000 7fe0abfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0b40c49c0 0x7fe0b40ac360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48864/0 (socket says 172.21.15.88:48864) 2023-12-08T08:22:28.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.138+0000 7fe0abfff640 1 -- 172.21.15.88:0/26587118 learned_addr learned my addr 172.21.15.88:0/26587118 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:28.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.138+0000 7fe0b3fff640 1 --2- 172.21.15.88:0/26587118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b40c59a0 0x7fe0b40ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:28.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.142+0000 7fe0b37fe640 1 --2- 172.21.15.88:0/26587118 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe0b40bf690 0x7fe0b40abe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:28.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.142+0000 7fe0abfff640 1 -- 172.21.15.88:0/26587118 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe0b40bf690 msgr2=0x7fe0b40abe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:28.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.142+0000 7fe0abfff640 1 --2- 172.21.15.88:0/26587118 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe0b40bf690 0x7fe0b40abe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:28.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.142+0000 7fe0abfff640 1 -- 172.21.15.88:0/26587118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b40c59a0 msgr2=0x7fe0b40ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:28.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.142+0000 7fe0abfff640 1 --2- 172.21.15.88:0/26587118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b40c59a0 0x7fe0b40ae830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:28.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.142+0000 7fe0abfff640 1 -- 172.21.15.88:0/26587118 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a40094d0 con 0x7fe0b40c49c0 2023-12-08T08:22:28.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.142+0000 7fe0abfff640 1 --2- 172.21.15.88:0/26587118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0b40c49c0 0x7fe0b40ac360 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00c450 tx=0x7fe09c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:28.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.142+0000 7fe0b0ff9640 1 -- 172.21.15.88:0/26587118 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c0074e0 con 0x7fe0b40c49c0 2023-12-08T08:22:28.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.142+0000 7fe0b0ff9640 1 -- 172.21.15.88:0/26587118 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09c007640 con 0x7fe0b40c49c0 2023-12-08T08:22:28.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.142+0000 7fe0b9e09640 1 -- 172.21.15.88:0/26587118 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b414da90 con 0x7fe0b40c49c0 2023-12-08T08:22:28.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.142+0000 7fe0b0ff9640 1 -- 172.21.15.88:0/26587118 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c0049f0 con 0x7fe0b40c49c0 2023-12-08T08:22:28.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.142+0000 7fe0b9e09640 1 -- 172.21.15.88:0/26587118 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b40adc30 con 0x7fe0b40c49c0 2023-12-08T08:22:28.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.142+0000 7fe0b9e09640 1 -- 172.21.15.88:0/26587118 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b40c0ac0 con 0x7fe0b40c49c0 2023-12-08T08:22:28.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.142+0000 7fe0b0ff9640 1 -- 172.21.15.88:0/26587118 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe09c004b50 con 0x7fe0b40c49c0 2023-12-08T08:22:28.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.146+0000 7fe0b0ff9640 1 --2- 172.21.15.88:0/26587118 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe094066470 0x7fe094068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:28.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.146+0000 7fe0b0ff9640 1 -- 172.21.15.88:0/26587118 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe09c0836e0 con 0x7fe0b40c49c0 2023-12-08T08:22:28.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.146+0000 7fe0b37fe640 1 --2- 172.21.15.88:0/26587118 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe094066470 0x7fe094068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:28.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.146+0000 7fe0b37fe640 1 --2- 172.21.15.88:0/26587118 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe094066470 0x7fe094068930 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe0a40ae000 tx=0x7fe0a40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:28.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.150+0000 7fe0b0ff9640 1 -- 172.21.15.88:0/26587118 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe09c0508a0 con 0x7fe0b40c49c0 2023-12-08T08:22:28.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.334+0000 7fe0b9e09640 1 -- 172.21.15.88:0/26587118 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe0b4150ab0 con 0x7fe0b40c49c0 2023-12-08T08:22:28.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.334+0000 7fe0b0ff9640 1 -- 172.21.15.88:0/26587118 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) v1 ==== 53+0+149 (secure 0 0 0) 0x7fe09c018070 con 0x7fe0b40c49c0 2023-12-08T08:22:28.339 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:22:28.339 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-08T08:22:28.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.334+0000 7fe0b9e09640 1 -- 172.21.15.88:0/26587118 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe094066470 msgr2=0x7fe094068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:28.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.334+0000 7fe0b9e09640 1 --2- 172.21.15.88:0/26587118 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe094066470 0x7fe094068930 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe0a40ae000 tx=0x7fe0a40a7000 comp rx=0 tx=0).stop 2023-12-08T08:22:28.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.334+0000 7fe0b9e09640 1 -- 172.21.15.88:0/26587118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0b40c49c0 msgr2=0x7fe0b40ac360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:28.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.334+0000 7fe0b9e09640 1 --2- 172.21.15.88:0/26587118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0b40c49c0 0x7fe0b40ac360 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00c450 tx=0x7fe09c00c910 comp rx=0 tx=0).stop 2023-12-08T08:22:28.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.334+0000 7fe0b9e09640 1 -- 172.21.15.88:0/26587118 shutdown_connections 2023-12-08T08:22:28.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.334+0000 7fe0b9e09640 1 --2- 172.21.15.88:0/26587118 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe094066470 0x7fe094068930 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:28.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.334+0000 7fe0b9e09640 1 --2- 172.21.15.88:0/26587118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b40c59a0 0x7fe0b40ae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:28.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.334+0000 7fe0b9e09640 1 --2- 172.21.15.88:0/26587118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0b40c49c0 0x7fe0b40ac360 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:28.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.334+0000 7fe0b9e09640 1 --2- 172.21.15.88:0/26587118 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe0b40bf690 0x7fe0b40abe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:28.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.334+0000 7fe0b9e09640 1 -- 172.21.15.88:0/26587118 >> 172.21.15.88:0/26587118 conn(0x7fe0b40c6840 msgr2=0x7fe0b40c6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:28.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.334+0000 7fe0b9e09640 1 -- 172.21.15.88:0/26587118 shutdown_connections 2023-12-08T08:22:28.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:28.334+0000 7fe0b9e09640 1 -- 172.21.15.88:0/26587118 wait complete. 2023-12-08T08:22:28.359 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-08T08:22:28.360 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:22:28.360 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-12-08T08:22:28.360 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-08T08:22:28.360 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-08T08:22:28.360 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-08T08:22:28.360 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-08T08:22:28.360 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:22:28.360 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:22:28.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:28.361 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-12-08T08:22:28.372 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:22:28.372 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:22:28.372 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:22:28.372 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:28.372 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-12-08T08:22:28.372 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:28.372 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:22:28.372 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:22:28.372 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-12-08T08:22:28.372 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:22:28.372 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:22:28.372 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-12-08T08:22:28.373 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:22:28.373 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:22:28.373 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:22:28.373 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:22:28.373 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-08T08:22:28.373 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42290sec preferred_lft 42290sec 2023-12-08T08:22:28.373 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-12-08T08:22:28.373 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:28.373 INFO:teuthology.orchestra.run.smithi148.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-08T08:22:28.373 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 02:42:93:b7:1f:fa brd ff:ff:ff:ff:ff:ff 2023-12-08T08:22:28.373 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-08T08:22:28.373 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:28.373 INFO:teuthology.orchestra.run.smithi148.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:22:28.374 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-08T08:22:28.374 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:22:28.374 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:28.374 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-08T08:22:28.374 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:28.374 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:22:28.374 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:22:28.374 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-08T08:22:28.374 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:28.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:28.376 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:22:28.443 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-12-08T08:22:28.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:28.446 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-12-08T08:22:28.506 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-12-08T08:22:28.506 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:22:28.506 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-08T08:22:28.506 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-08T08:22:28.506 INFO:teuthology.orchestra.run.smithi148.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-08T08:22:28.506 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-08T08:22:28.506 INFO:teuthology.orchestra.run.smithi148.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:22:28.506 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:22:28.506 INFO:teuthology.orchestra.run.smithi148.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:22:28.507 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:22:28.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:28.507 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-12-08T08:22:28.507 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-12-08T08:22:28.507 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-08T08:22:28.507 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-08T08:22:28.507 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-08T08:22:28.507 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-12-08T08:22:28.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:28.607 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-12-08T08:22:28.616 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-08T08:22:28.616 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:22:28.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:28.617 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-12-08T08:22:28.684 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:22:28.684 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-08T08:22:28.738 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:22:28.738 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:22:28.738 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:22:28.789 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-12-08T08:22:28.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:28.790 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:22:28.883 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:22:28.883 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:22:28.896 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:22:28.896 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:22:28.896 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-12-08T08:22:28.896 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with new device syntax: 1@681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3.cephfs2=/ 2023-12-08T08:22:28.896 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.88:3300/172.21.15.148:3300/172.21.15.148:3301" will pass to kernel 2023-12-08T08:22:28.900 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T08:22:28.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:28.900 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:22:28.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:28.921 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:22:28.978 INFO:teuthology.orchestra.run.smithi148.stdout:client6150 2023-12-08T08:22:28.979 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:22:28.979 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:22:29.035 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow rw fsname=cephfs, allow rw fsname=cephfs2' osd 'allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2' mds 'allow rw fsname=cephfs' 2023-12-08T08:22:29.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.178+0000 7f755bd1c640 1 Processor -- start 2023-12-08T08:22:29.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.178+0000 7f755bd1c640 1 -- start start 2023-12-08T08:22:29.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.178+0000 7f755bd1c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7554156200 0x7f75540c0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:29.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.178+0000 7f755bd1c640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f755415bf70 0x7f755415c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:29.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.178+0000 7f755bd1c640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f755406bce0 con 0x7f75540c0e10 2023-12-08T08:22:29.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.178+0000 7f755bd1c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f755406d8d0 con 0x7f7554156200 2023-12-08T08:22:29.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.178+0000 7f755bd1c640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75540c2270 con 0x7f755415bf70 2023-12-08T08:22:29.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.178+0000 7f7559ab8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7554156200 0x7f75540c0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:29.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.178+0000 7f7559ab8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7554156200 0x7f75540c0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48880/0 (socket says 172.21.15.88:48880) 2023-12-08T08:22:29.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.178+0000 7f7559ab8640 1 -- 172.21.15.88:0/2591020246 learned_addr learned my addr 172.21.15.88:0/2591020246 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:29.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.178+0000 7f755a2b9640 1 --2- 172.21.15.88:0/2591020246 >> v2:172.21.15.148:3300/0 conn(0x7f755415bf70 0x7f755415c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:29.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.178+0000 7f7559ab8640 1 -- 172.21.15.88:0/2591020246 >> v2:172.21.15.148:3300/0 conn(0x7f755415bf70 msgr2=0x7f755415c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:29.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.178+0000 7f7559ab8640 1 --2- 172.21.15.88:0/2591020246 >> v2:172.21.15.148:3300/0 conn(0x7f755415bf70 0x7f755415c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:29.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.178+0000 7f7559ab8640 1 -- 172.21.15.88:0/2591020246 >> v1:172.21.15.148:6789/0 conn(0x7f75540c0e10 legacy=0x7f75540c1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:29.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.178+0000 7f7559ab8640 1 -- 172.21.15.88:0/2591020246 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755415cc60 con 0x7f7554156200 2023-12-08T08:22:29.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.182+0000 7f7559ab8640 1 --2- 172.21.15.88:0/2591020246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7554156200 0x7f75540c0370 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f75540c6ad0 tx=0x7f755001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2933ca7a6995e479 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:29.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.182+0000 7f7558ab6640 1 -- 172.21.15.88:0/2591020246 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75500ab600 con 0x7f7554156200 2023-12-08T08:22:29.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.182+0000 7f7558ab6640 1 -- 172.21.15.88:0/2591020246 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75500a7050 con 0x7f7554156200 2023-12-08T08:22:29.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.182+0000 7f7558ab6640 1 -- 172.21.15.88:0/2591020246 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75500ab980 con 0x7f7554156200 2023-12-08T08:22:29.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.182+0000 7f755bd1c640 1 -- 172.21.15.88:0/2591020246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7554156200 msgr2=0x7f75540c0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:29.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.182+0000 7f755bd1c640 1 --2- 172.21.15.88:0/2591020246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7554156200 0x7f75540c0370 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f75540c6ad0 tx=0x7f755001c3b0 comp rx=0 tx=0).stop 2023-12-08T08:22:29.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.182+0000 7f755bd1c640 1 -- 172.21.15.88:0/2591020246 shutdown_connections 2023-12-08T08:22:29.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.182+0000 7f755bd1c640 1 --2- 172.21.15.88:0/2591020246 >> v2:172.21.15.148:3300/0 conn(0x7f755415bf70 0x7f755415c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:29.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.182+0000 7f755bd1c640 1 --2- 172.21.15.88:0/2591020246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7554156200 0x7f75540c0370 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:29.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.182+0000 7f755bd1c640 1 -- 172.21.15.88:0/2591020246 >> 172.21.15.88:0/2591020246 conn(0x7f75540c59f0 msgr2=0x7f75540c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:29.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.182+0000 7f755bd1c640 1 -- 172.21.15.88:0/2591020246 shutdown_connections 2023-12-08T08:22:29.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.182+0000 7f755bd1c640 1 -- 172.21.15.88:0/2591020246 wait complete. 2023-12-08T08:22:29.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.182+0000 7f755bd1c640 1 Processor -- start 2023-12-08T08:22:29.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.182+0000 7f755bd1c640 1 -- start start 2023-12-08T08:22:29.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.186+0000 7f755bd1c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f75540c0e10 0x7f75541f1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:29.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.186+0000 7f755bd1c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7554156200 0x7f75540ab230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:29.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.186+0000 7f755bd1c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f755415bf70 0x7f75540ab770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:29.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.186+0000 7f755bd1c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75541f21c0 con 0x7f755415bf70 2023-12-08T08:22:29.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.186+0000 7f755bd1c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7554148370 con 0x7f7554156200 2023-12-08T08:22:29.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.186+0000 7f755bd1c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755406fbf0 con 0x7f75540c0e10 2023-12-08T08:22:29.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.186+0000 7f75592b7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7554156200 0x7f75540ab230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:29.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.186+0000 7f755a2b9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f755415bf70 0x7f75540ab770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:29.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.186+0000 7f7559ab8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f75540c0e10 0x7f75541f1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:29.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.186+0000 7f755a2b9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f755415bf70 0x7f75540ab770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48894/0 (socket says 172.21.15.88:48894) 2023-12-08T08:22:29.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.186+0000 7f755a2b9640 1 -- 172.21.15.88:0/460011919 learned_addr learned my addr 172.21.15.88:0/460011919 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:29.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.186+0000 7f7559ab8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f75540c0e10 0x7f75541f1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:59974/0 (socket says 172.21.15.88:59974) 2023-12-08T08:22:29.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.186+0000 7f75592b7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7554156200 0x7f75540ab230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:46062/0 (socket says 172.21.15.88:46062) 2023-12-08T08:22:29.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.186+0000 7f755a2b9640 1 -- 172.21.15.88:0/460011919 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f75540c0e10 msgr2=0x7f75541f1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:29.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.186+0000 7f755a2b9640 1 --2- 172.21.15.88:0/460011919 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f75540c0e10 0x7f75541f1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:29.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.186+0000 7f755a2b9640 1 -- 172.21.15.88:0/460011919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7554156200 msgr2=0x7f75540ab230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:29.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.186+0000 7f755a2b9640 1 --2- 172.21.15.88:0/460011919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7554156200 0x7f75540ab230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:29.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.186+0000 7f755a2b9640 1 -- 172.21.15.88:0/460011919 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75500094d0 con 0x7f755415bf70 2023-12-08T08:22:29.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.186+0000 7f75592b7640 1 --2- 172.21.15.88:0/460011919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7554156200 0x7f75540ab230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:22:29.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.186+0000 7f755a2b9640 1 --2- 172.21.15.88:0/460011919 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f755415bf70 0x7f75540ab770 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f754c00efc0 tx=0x7f754c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:29.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.186+0000 7f754a7fc640 1 -- 172.21.15.88:0/460011919 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c014480 con 0x7f755415bf70 2023-12-08T08:22:29.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.186+0000 7f754a7fc640 1 -- 172.21.15.88:0/460011919 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c00f040 con 0x7f755415bf70 2023-12-08T08:22:29.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.186+0000 7f754a7fc640 1 -- 172.21.15.88:0/460011919 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c014820 con 0x7f755415bf70 2023-12-08T08:22:29.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.186+0000 7f755bd1c640 1 -- 172.21.15.88:0/460011919 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755406fed0 con 0x7f755415bf70 2023-12-08T08:22:29.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.186+0000 7f755bd1c640 1 -- 172.21.15.88:0/460011919 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75541488a0 con 0x7f755415bf70 2023-12-08T08:22:29.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.186+0000 7f755bd1c640 1 -- 172.21.15.88:0/460011919 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7554067630 con 0x7f755415bf70 2023-12-08T08:22:29.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.186+0000 7f754a7fc640 1 -- 172.21.15.88:0/460011919 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f754c014980 con 0x7f755415bf70 2023-12-08T08:22:29.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.190+0000 7f754a7fc640 1 --2- 172.21.15.88:0/460011919 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7538066470 0x7f7538068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:29.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.190+0000 7f754a7fc640 1 -- 172.21.15.88:0/460011919 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f754c084f30 con 0x7f755415bf70 2023-12-08T08:22:29.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.190+0000 7f7559ab8640 1 --2- 172.21.15.88:0/460011919 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7538066470 0x7f7538068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:29.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.190+0000 7f7559ab8640 1 --2- 172.21.15.88:0/460011919 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7538066470 0x7f7538068930 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f75500ad000 tx=0x7f7550008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:29.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.194+0000 7f754a7fc640 1 -- 172.21.15.88:0/460011919 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f754c0520f0 con 0x7f755415bf70 2023-12-08T08:22:29.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.394+0000 7f755bd1c640 1 -- 172.21.15.88:0/460011919 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]} v 0) v1 -- 0x7f75540abcc0 con 0x7f755415bf70 2023-12-08T08:22:29.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.398+0000 7f754a7fc640 1 -- 172.21.15.88:0/460011919 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]}]=0 added key for client.testuser v17) v1 ==== 291+0+0 (secure 0 0 0) 0x7f754c055710 con 0x7f755415bf70 2023-12-08T08:22:29.402 INFO:teuthology.orchestra.run.smithi088.stderr:added key for client.testuser 2023-12-08T08:22:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.398+0000 7f755bd1c640 1 -- 172.21.15.88:0/460011919 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7538066470 msgr2=0x7f7538068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.398+0000 7f755bd1c640 1 --2- 172.21.15.88:0/460011919 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7538066470 0x7f7538068930 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f75500ad000 tx=0x7f7550008040 comp rx=0 tx=0).stop 2023-12-08T08:22:29.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.398+0000 7f755bd1c640 1 -- 172.21.15.88:0/460011919 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f755415bf70 msgr2=0x7f75540ab770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:29.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.398+0000 7f755bd1c640 1 --2- 172.21.15.88:0/460011919 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f755415bf70 0x7f75540ab770 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f754c00efc0 tx=0x7f754c00c490 comp rx=0 tx=0).stop 2023-12-08T08:22:29.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.398+0000 7f755bd1c640 1 -- 172.21.15.88:0/460011919 shutdown_connections 2023-12-08T08:22:29.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.398+0000 7f755bd1c640 1 --2- 172.21.15.88:0/460011919 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7538066470 0x7f7538068930 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:29.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.398+0000 7f755bd1c640 1 --2- 172.21.15.88:0/460011919 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f755415bf70 0x7f75540ab770 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:29.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.398+0000 7f755bd1c640 1 --2- 172.21.15.88:0/460011919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7554156200 0x7f75540ab230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:29.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.398+0000 7f755bd1c640 1 --2- 172.21.15.88:0/460011919 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f75540c0e10 0x7f75541f1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:29.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.398+0000 7f755bd1c640 1 -- 172.21.15.88:0/460011919 >> 172.21.15.88:0/460011919 conn(0x7f75540c59f0 msgr2=0x7f7554150b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:29.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.398+0000 7f755bd1c640 1 -- 172.21.15.88:0/460011919 shutdown_connections 2023-12-08T08:22:29.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.398+0000 7f755bd1c640 1 -- 172.21.15.88:0/460011919 wait complete. 2023-12-08T08:22:29.423 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2023-12-08T08:22:29.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.554+0000 7faf4c957640 1 Processor -- start 2023-12-08T08:22:29.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.554+0000 7faf4c957640 1 -- start start 2023-12-08T08:22:29.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.558+0000 7faf4c957640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faf480c66b0 0x7faf480a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:29.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.558+0000 7faf4c957640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf480a4cc0 con 0x7faf4806bc70 2023-12-08T08:22:29.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.558+0000 7faf4c957640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf480c1d80 con 0x7faf4814de40 2023-12-08T08:22:29.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.558+0000 7faf4c957640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf480c23d0 con 0x7faf480c66b0 2023-12-08T08:22:29.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.558+0000 7faf3dd9b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7faf4806bc70 0x7faf480c5a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46850/0 (socket says 172.21.15.88:46850) 2023-12-08T08:22:29.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.558+0000 7faf3dd9b640 1 -- 172.21.15.88:0/1021665268 learned_addr learned my addr 172.21.15.88:0/1021665268 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:29.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.558+0000 7faf4659c640 1 --2- 172.21.15.88:0/1021665268 >> v2:172.21.15.148:3300/0 conn(0x7faf480c66b0 0x7faf480a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:29.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.558+0000 7faf45d9b640 1 -- 172.21.15.88:0/1021665268 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693231990 0 0) 0x7faf480a4cc0 con 0x7faf4806bc70 2023-12-08T08:22:29.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.558+0000 7faf45d9b640 1 -- 172.21.15.88:0/1021665268 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf34003530 con 0x7faf4806bc70 2023-12-08T08:22:29.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.558+0000 7faf4659c640 1 -- 172.21.15.88:0/1021665268 >> v1:172.21.15.148:6789/0 conn(0x7faf4814de40 legacy=0x7faf4814e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:29.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.558+0000 7faf4659c640 1 -- 172.21.15.88:0/1021665268 >> v1:172.21.15.88:6789/0 conn(0x7faf4806bc70 legacy=0x7faf480c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:29.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.558+0000 7faf4659c640 1 -- 172.21.15.88:0/1021665268 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf480c2060 con 0x7faf480c66b0 2023-12-08T08:22:29.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.562+0000 7faf4659c640 1 --2- 172.21.15.88:0/1021665268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf480c66b0 0x7faf480a4fa0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faf300097c0 tx=0x7faf3001c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d747603840e22725 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:29.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.562+0000 7faf45d9b640 1 -- 172.21.15.88:0/1021665268 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf300ab600 con 0x7faf480c66b0 2023-12-08T08:22:29.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.562+0000 7faf45d9b640 1 -- 172.21.15.88:0/1021665268 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf300a7050 con 0x7faf480c66b0 2023-12-08T08:22:29.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.562+0000 7faf45d9b640 1 -- 172.21.15.88:0/1021665268 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf300ab980 con 0x7faf480c66b0 2023-12-08T08:22:29.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.562+0000 7faf4c957640 1 -- 172.21.15.88:0/1021665268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf480c66b0 msgr2=0x7faf480a4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:29.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.562+0000 7faf4c957640 1 --2- 172.21.15.88:0/1021665268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf480c66b0 0x7faf480a4fa0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faf300097c0 tx=0x7faf3001c360 comp rx=0 tx=0).stop 2023-12-08T08:22:29.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.562+0000 7faf4c957640 1 -- 172.21.15.88:0/1021665268 shutdown_connections 2023-12-08T08:22:29.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.562+0000 7faf4c957640 1 --2- 172.21.15.88:0/1021665268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf480c66b0 0x7faf480a4fa0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:29.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.562+0000 7faf4c957640 1 -- 172.21.15.88:0/1021665268 >> 172.21.15.88:0/1021665268 conn(0x7faf4806b220 msgr2=0x7faf480a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:29.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.562+0000 7faf4c957640 1 -- 172.21.15.88:0/1021665268 shutdown_connections 2023-12-08T08:22:29.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.562+0000 7faf4c957640 1 -- 172.21.15.88:0/1021665268 wait complete. 2023-12-08T08:22:29.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.562+0000 7faf4c957640 1 Processor -- start 2023-12-08T08:22:29.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.562+0000 7faf4c957640 1 -- start start 2023-12-08T08:22:29.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.566+0000 7faf4c957640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf4806bc70 0x7faf4814d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:29.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.566+0000 7faf4c957640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf480c66b0 0x7faf4813d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:29.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.566+0000 7faf4c957640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf4814de40 0x7faf4813d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:29.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.566+0000 7faf4c957640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf48071760 con 0x7faf480c66b0 2023-12-08T08:22:29.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.566+0000 7faf4c957640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf480bfff0 con 0x7faf4806bc70 2023-12-08T08:22:29.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.566+0000 7faf4c957640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4813dbd0 con 0x7faf4814de40 2023-12-08T08:22:29.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.566+0000 7faf4659c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf4806bc70 0x7faf4814d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:29.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.566+0000 7faf3dd9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf480c66b0 0x7faf4813d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:29.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.566+0000 7faf4659c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf4806bc70 0x7faf4814d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:46084/0 (socket says 172.21.15.88:46084) 2023-12-08T08:22:29.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.566+0000 7faf4659c640 1 -- 172.21.15.88:0/860743526 learned_addr learned my addr 172.21.15.88:0/860743526 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:29.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.566+0000 7faf46d9d640 1 --2- 172.21.15.88:0/860743526 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf4814de40 0x7faf4813d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:29.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.566+0000 7faf3dd9b640 1 -- 172.21.15.88:0/860743526 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf4814de40 msgr2=0x7faf4813d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:29.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.566+0000 7faf3dd9b640 1 --2- 172.21.15.88:0/860743526 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf4814de40 0x7faf4813d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:29.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.566+0000 7faf3dd9b640 1 -- 172.21.15.88:0/860743526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf4806bc70 msgr2=0x7faf4814d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:29.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.566+0000 7faf3dd9b640 1 --2- 172.21.15.88:0/860743526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf4806bc70 0x7faf4814d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:29.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.566+0000 7faf3dd9b640 1 -- 172.21.15.88:0/860743526 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf30009420 con 0x7faf480c66b0 2023-12-08T08:22:29.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.566+0000 7faf4659c640 1 --2- 172.21.15.88:0/860743526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf4806bc70 0x7faf4814d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:22:29.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.566+0000 7faf3dd9b640 1 --2- 172.21.15.88:0/860743526 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf480c66b0 0x7faf4813d150 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7faf3800c400 tx=0x7faf3800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:29.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.566+0000 7faf3f7fe640 1 -- 172.21.15.88:0/860743526 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf38005cf0 con 0x7faf480c66b0 2023-12-08T08:22:29.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.566+0000 7faf3f7fe640 1 -- 172.21.15.88:0/860743526 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf38005e50 con 0x7faf480c66b0 2023-12-08T08:22:29.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.566+0000 7faf4c957640 1 -- 172.21.15.88:0/860743526 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf481f1430 con 0x7faf480c66b0 2023-12-08T08:22:29.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.566+0000 7faf3f7fe640 1 -- 172.21.15.88:0/860743526 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf380072d0 con 0x7faf480c66b0 2023-12-08T08:22:29.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.566+0000 7faf4c957640 1 -- 172.21.15.88:0/860743526 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf48072840 con 0x7faf480c66b0 2023-12-08T08:22:29.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.566+0000 7faf4c957640 1 -- 172.21.15.88:0/860743526 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf48067630 con 0x7faf480c66b0 2023-12-08T08:22:29.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.566+0000 7faf3f7fe640 1 -- 172.21.15.88:0/860743526 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faf38007430 con 0x7faf480c66b0 2023-12-08T08:22:29.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.570+0000 7faf3f7fe640 1 --2- 172.21.15.88:0/860743526 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faf280664a0 0x7faf28068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:29.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.570+0000 7faf3f7fe640 1 -- 172.21.15.88:0/860743526 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7faf380836a0 con 0x7faf480c66b0 2023-12-08T08:22:29.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.570+0000 7faf4659c640 1 --2- 172.21.15.88:0/860743526 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faf280664a0 0x7faf28068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:29.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.570+0000 7faf4659c640 1 --2- 172.21.15.88:0/860743526 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faf280664a0 0x7faf28068960 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7faf30019f90 tx=0x7faf300a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:29.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.574+0000 7faf3f7fe640 1 -- 172.21.15.88:0/860743526 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faf38050860 con 0x7faf480c66b0 2023-12-08T08:22:29.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.778+0000 7faf4c957640 1 -- 172.21.15.88:0/860743526 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7faf480aafc0 con 0x7faf480c66b0 2023-12-08T08:22:29.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.778+0000 7faf3f7fe640 1 -- 172.21.15.88:0/860743526 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v17) v1 ==== 85+0+245 (secure 0 0 0) 0x7faf38053e80 con 0x7faf480c66b0 2023-12-08T08:22:29.783 INFO:teuthology.orchestra.run.smithi088.stdout:[client.testuser] 2023-12-08T08:22:29.783 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBF0nJlSEvLFxAAmepyVlOnp/++jz37PCSPvA== 2023-12-08T08:22:29.784 INFO:teuthology.orchestra.run.smithi088.stdout: caps mds = "allow rw fsname=cephfs" 2023-12-08T08:22:29.784 INFO:teuthology.orchestra.run.smithi088.stdout: caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" 2023-12-08T08:22:29.784 INFO:teuthology.orchestra.run.smithi088.stdout: caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-12-08T08:22:29.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.778+0000 7faf4c957640 1 -- 172.21.15.88:0/860743526 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faf280664a0 msgr2=0x7faf28068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:29.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.778+0000 7faf4c957640 1 --2- 172.21.15.88:0/860743526 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faf280664a0 0x7faf28068960 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7faf30019f90 tx=0x7faf300a6000 comp rx=0 tx=0).stop 2023-12-08T08:22:29.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.778+0000 7faf4c957640 1 -- 172.21.15.88:0/860743526 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf480c66b0 msgr2=0x7faf4813d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:29.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.778+0000 7faf4c957640 1 --2- 172.21.15.88:0/860743526 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf480c66b0 0x7faf4813d150 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7faf3800c400 tx=0x7faf3800c8c0 comp rx=0 tx=0).stop 2023-12-08T08:22:29.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.778+0000 7faf4c957640 1 -- 172.21.15.88:0/860743526 shutdown_connections 2023-12-08T08:22:29.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.778+0000 7faf4c957640 1 --2- 172.21.15.88:0/860743526 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faf280664a0 0x7faf28068960 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:29.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.778+0000 7faf4c957640 1 --2- 172.21.15.88:0/860743526 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf4814de40 0x7faf4813d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:29.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.778+0000 7faf4c957640 1 --2- 172.21.15.88:0/860743526 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf480c66b0 0x7faf4813d150 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:29.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.778+0000 7faf4c957640 1 --2- 172.21.15.88:0/860743526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf4806bc70 0x7faf4814d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:29.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.778+0000 7faf4c957640 1 -- 172.21.15.88:0/860743526 >> 172.21.15.88:0/860743526 conn(0x7faf4806b220 msgr2=0x7faf4814f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:29.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.778+0000 7faf4c957640 1 -- 172.21.15.88:0/860743526 shutdown_connections 2023-12-08T08:22:29.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:29.778+0000 7faf4c957640 1 -- 172.21.15.88:0/860743526 wait complete. 2023-12-08T08:22:29.804 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2023-12-08T08:22:29.813 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.f7hmXY9oDh 2023-12-08T08:22:29.813 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:22:29.813 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/tmp/tmp.f7hmXY9oDh 2023-12-08T08:22:29.866 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:22:29.866 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:22:29.917 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:22:29.917 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:22:29.969 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:22:30.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.146+0000 7f1ff3279640 1 Processor -- start 2023-12-08T08:22:30.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.146+0000 7f1ff3279640 1 -- start start 2023-12-08T08:22:30.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.146+0000 7f1ff3279640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1fec0af4c0 0x7f1fec154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:30.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.146+0000 7f1ff3279640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1fec06c100 0x7f1fec0c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:30.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.146+0000 7f1ff3279640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fec0c4890 con 0x7f1fec0c67d0 2023-12-08T08:22:30.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.146+0000 7f1ff3279640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fec155460 con 0x7f1fec06c100 2023-12-08T08:22:30.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.146+0000 7f1ff3279640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fec0af8a0 con 0x7f1fec0af4c0 2023-12-08T08:22:30.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.146+0000 7f1ff1816640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1fec06c100 0x7f1fec0c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:30.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.146+0000 7f1ff1816640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1fec06c100 0x7f1fec0c6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57228/0 (socket says 172.21.15.88:57228) 2023-12-08T08:22:30.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.146+0000 7f1ff1816640 1 -- 172.21.15.88:0/884153720 learned_addr learned my addr 172.21.15.88:0/884153720 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:30.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.146+0000 7f1ff1015640 1 --2- 172.21.15.88:0/884153720 >> v2:172.21.15.148:3300/0 conn(0x7f1fec0af4c0 0x7f1fec154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:30.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.146+0000 7f1ff1816640 1 -- 172.21.15.88:0/884153720 >> v2:172.21.15.148:3300/0 conn(0x7f1fec0af4c0 msgr2=0x7f1fec154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:30.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.146+0000 7f1ff1816640 1 --2- 172.21.15.88:0/884153720 >> v2:172.21.15.148:3300/0 conn(0x7f1fec0af4c0 0x7f1fec154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.146+0000 7f1ff1816640 1 -- 172.21.15.88:0/884153720 >> v1:172.21.15.148:6789/0 conn(0x7f1fec0c67d0 legacy=0x7f1fec06b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:30.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.146+0000 7f1ff1816640 1 -- 172.21.15.88:0/884153720 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fec0c4b30 con 0x7f1fec06c100 2023-12-08T08:22:30.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.150+0000 7f1ff1816640 1 --2- 172.21.15.88:0/884153720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fec06c100 0x7f1fec0c6c80 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0a9790 tx=0x7f1fe401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6beefce67ebbc04 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:30.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.150+0000 7f1fe3fff640 1 -- 172.21.15.88:0/884153720 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe40a57d0 con 0x7f1fec06c100 2023-12-08T08:22:30.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.150+0000 7f1fe3fff640 1 -- 172.21.15.88:0/884153720 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe40a5930 con 0x7f1fec06c100 2023-12-08T08:22:30.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.150+0000 7f1fe3fff640 1 -- 172.21.15.88:0/884153720 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe40a5cc0 con 0x7f1fec06c100 2023-12-08T08:22:30.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.150+0000 7f1ff3279640 1 -- 172.21.15.88:0/884153720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fec06c100 msgr2=0x7f1fec0c6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:30.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.150+0000 7f1ff3279640 1 --2- 172.21.15.88:0/884153720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fec06c100 0x7f1fec0c6c80 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0a9790 tx=0x7f1fe401c910 comp rx=0 tx=0).stop 2023-12-08T08:22:30.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.150+0000 7f1ff3279640 1 -- 172.21.15.88:0/884153720 shutdown_connections 2023-12-08T08:22:30.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.150+0000 7f1ff3279640 1 --2- 172.21.15.88:0/884153720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fec06c100 0x7f1fec0c6c80 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.150+0000 7f1ff3279640 1 --2- 172.21.15.88:0/884153720 >> v2:172.21.15.148:3300/0 conn(0x7f1fec0af4c0 0x7f1fec154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.150+0000 7f1ff3279640 1 -- 172.21.15.88:0/884153720 >> 172.21.15.88:0/884153720 conn(0x7f1fec0ab9d0 msgr2=0x7f1fec0abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:30.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.150+0000 7f1ff3279640 1 -- 172.21.15.88:0/884153720 shutdown_connections 2023-12-08T08:22:30.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.150+0000 7f1ff3279640 1 -- 172.21.15.88:0/884153720 wait complete. 2023-12-08T08:22:30.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.154+0000 7f1ff3279640 1 Processor -- start 2023-12-08T08:22:30.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.154+0000 7f1ff3279640 1 -- start start 2023-12-08T08:22:30.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.154+0000 7f1ff3279640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fec06c100 0x7f1fec0c03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:30.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.154+0000 7f1ff3279640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fec0af4c0 0x7f1fec154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:30.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.154+0000 7f1ff3279640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fec0c67d0 0x7f1fec14b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:30.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.154+0000 7f1ff3279640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec0bd6e0 con 0x7f1fec0c67d0 2023-12-08T08:22:30.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.154+0000 7f1ff3279640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec0be4d0 con 0x7f1fec06c100 2023-12-08T08:22:30.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.154+0000 7f1ff3279640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec0c7bc0 con 0x7f1fec0af4c0 2023-12-08T08:22:30.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.154+0000 7f1ff1816640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fec0c67d0 0x7f1fec14b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:30.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.154+0000 7f1ff1816640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fec0c67d0 0x7f1fec14b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57242/0 (socket says 172.21.15.88:57242) 2023-12-08T08:22:30.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.154+0000 7f1ff1816640 1 -- 172.21.15.88:0/2440523603 learned_addr learned my addr 172.21.15.88:0/2440523603 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:30.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.154+0000 7f1ff1015640 1 --2- 172.21.15.88:0/2440523603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fec06c100 0x7f1fec0c03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:30.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.154+0000 7f1ff1816640 1 -- 172.21.15.88:0/2440523603 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fec0af4c0 msgr2=0x7f1fec154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:30.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.154+0000 7f1ff1816640 1 --2- 172.21.15.88:0/2440523603 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fec0af4c0 0x7f1fec154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.154+0000 7f1ff1816640 1 -- 172.21.15.88:0/2440523603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fec06c100 msgr2=0x7f1fec0c03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:30.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.154+0000 7f1ff1816640 1 --2- 172.21.15.88:0/2440523603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fec06c100 0x7f1fec0c03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.154+0000 7f1ff1816640 1 -- 172.21.15.88:0/2440523603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe4009b30 con 0x7f1fec0c67d0 2023-12-08T08:22:30.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.154+0000 7f1ff1015640 1 --2- 172.21.15.88:0/2440523603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fec06c100 0x7f1fec0c03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:30.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.154+0000 7f1ff1816640 1 --2- 172.21.15.88:0/2440523603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fec0c67d0 0x7f1fec14b2a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f1fe40af040 tx=0x7f1fe40196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:30.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.154+0000 7f1fe1ffb640 1 -- 172.21.15.88:0/2440523603 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe40b8670 con 0x7f1fec0c67d0 2023-12-08T08:22:30.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.154+0000 7f1fe1ffb640 1 -- 172.21.15.88:0/2440523603 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe40b87d0 con 0x7f1fec0c67d0 2023-12-08T08:22:30.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.154+0000 7f1ff3279640 1 -- 172.21.15.88:0/2440523603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fec15e650 con 0x7f1fec0c67d0 2023-12-08T08:22:30.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.154+0000 7f1fe1ffb640 1 -- 172.21.15.88:0/2440523603 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe40b8b80 con 0x7f1fec0c67d0 2023-12-08T08:22:30.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.154+0000 7f1ff3279640 1 -- 172.21.15.88:0/2440523603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fec0bdba0 con 0x7f1fec0c67d0 2023-12-08T08:22:30.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.158+0000 7f1ff3279640 1 -- 172.21.15.88:0/2440523603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fec067630 con 0x7f1fec0c67d0 2023-12-08T08:22:30.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.158+0000 7f1fe1ffb640 1 -- 172.21.15.88:0/2440523603 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1fe40b8ce0 con 0x7f1fec0c67d0 2023-12-08T08:22:30.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.158+0000 7f1fe1ffb640 1 --2- 172.21.15.88:0/2440523603 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1fd00664a0 0x7f1fd0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:30.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.158+0000 7f1fe1ffb640 1 -- 172.21.15.88:0/2440523603 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1fe411f790 con 0x7f1fec0c67d0 2023-12-08T08:22:30.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.158+0000 7f1ff1015640 1 --2- 172.21.15.88:0/2440523603 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1fd00664a0 0x7f1fd0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:30.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.158+0000 7f1ff1015640 1 --2- 172.21.15.88:0/2440523603 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1fd00664a0 0x7f1fd0068960 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80097a0 tx=0x7f1fe8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:30.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.162+0000 7f1fe1ffb640 1 -- 172.21.15.88:0/2440523603 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1fe40ec950 con 0x7f1fec0c67d0 2023-12-08T08:22:30.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.314+0000 7f1ff3279640 1 -- 172.21.15.88:0/2440523603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fec06c7a0 con 0x7f1fec0c67d0 2023-12-08T08:22:30.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.314+0000 7f1fe1ffb640 1 -- 172.21.15.88:0/2440523603 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20256 (secure 0 0 0) 0x7f1fe40eff70 con 0x7f1fec0c67d0 2023-12-08T08:22:30.320 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:30.320 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":54,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:22:21.530364+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:00.520254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:01.423493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:22:17.787562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:22:18.955273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:22:30.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.318+0000 7f1ff3279640 1 -- 172.21.15.88:0/2440523603 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1fd00664a0 msgr2=0x7f1fd0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:30.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.318+0000 7f1ff3279640 1 --2- 172.21.15.88:0/2440523603 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1fd00664a0 0x7f1fd0068960 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80097a0 tx=0x7f1fe8008040 comp rx=0 tx=0).stop 2023-12-08T08:22:30.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.318+0000 7f1ff3279640 1 -- 172.21.15.88:0/2440523603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fec0c67d0 msgr2=0x7f1fec14b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:30.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.318+0000 7f1ff3279640 1 --2- 172.21.15.88:0/2440523603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fec0c67d0 0x7f1fec14b2a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f1fe40af040 tx=0x7f1fe40196b0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.318+0000 7f1ff3279640 1 -- 172.21.15.88:0/2440523603 shutdown_connections 2023-12-08T08:22:30.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.318+0000 7f1ff3279640 1 --2- 172.21.15.88:0/2440523603 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1fd00664a0 0x7f1fd0068960 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.318+0000 7f1ff3279640 1 --2- 172.21.15.88:0/2440523603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fec0c67d0 0x7f1fec14b2a0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.318+0000 7f1ff3279640 1 --2- 172.21.15.88:0/2440523603 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1fec0af4c0 0x7f1fec154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.318+0000 7f1ff3279640 1 --2- 172.21.15.88:0/2440523603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fec06c100 0x7f1fec0c03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.318+0000 7f1ff3279640 1 -- 172.21.15.88:0/2440523603 >> 172.21.15.88:0/2440523603 conn(0x7f1fec0ab9d0 msgr2=0x7f1fec0abdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:30.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.318+0000 7f1ff3279640 1 -- 172.21.15.88:0/2440523603 shutdown_connections 2023-12-08T08:22:30.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.318+0000 7f1ff3279640 1 -- 172.21.15.88:0/2440523603 wait complete. 2023-12-08T08:22:30.341 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:22:00.520254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:22:01.423493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:22:17.787562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:22:18.955273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:22:30.342 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:22:30.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.478+0000 7fdb16701640 1 Processor -- start 2023-12-08T08:22:30.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.478+0000 7fdb16701640 1 -- start start 2023-12-08T08:22:30.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.478+0000 7fdb16701640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdb1014b1e0 0x7fdb100c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:30.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.478+0000 7fdb16701640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdb101548c0 0x7fdb10154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:30.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.478+0000 7fdb16701640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb100a4e20 con 0x7fdb100c5300 2023-12-08T08:22:30.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.478+0000 7fdb16701640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb100a50e0 con 0x7fdb101548c0 2023-12-08T08:22:30.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.478+0000 7fdb16701640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb100c0f00 con 0x7fdb1014b1e0 2023-12-08T08:22:30.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.478+0000 7fdb14c9e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdb101548c0 0x7fdb10154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:30.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.478+0000 7fdb14c9e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdb101548c0 0x7fdb10154d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57260/0 (socket says 172.21.15.88:57260) 2023-12-08T08:22:30.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.478+0000 7fdb14c9e640 1 -- 172.21.15.88:0/2058922747 learned_addr learned my addr 172.21.15.88:0/2058922747 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:30.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.478+0000 7fdb0ffff640 1 --2- 172.21.15.88:0/2058922747 >> v2:172.21.15.148:3300/0 conn(0x7fdb1014b1e0 0x7fdb100c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:30.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.478+0000 7fdb14c9e640 1 -- 172.21.15.88:0/2058922747 >> v2:172.21.15.148:3300/0 conn(0x7fdb1014b1e0 msgr2=0x7fdb100c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:30.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.478+0000 7fdb14c9e640 1 --2- 172.21.15.88:0/2058922747 >> v2:172.21.15.148:3300/0 conn(0x7fdb1014b1e0 0x7fdb100c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.478+0000 7fdb14c9e640 1 -- 172.21.15.88:0/2058922747 >> v1:172.21.15.148:6789/0 conn(0x7fdb100c5300 legacy=0x7fdb100a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:30.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.478+0000 7fdb14c9e640 1 -- 172.21.15.88:0/2058922747 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb100c11e0 con 0x7fdb101548c0 2023-12-08T08:22:30.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.482+0000 7fdb14c9e640 1 --2- 172.21.15.88:0/2058922747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb101548c0 0x7fdb10154d30 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fdb100c4150 tx=0x7fdb0801c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20139be14e6fd63d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:30.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.482+0000 7fdb0effd640 1 -- 172.21.15.88:0/2058922747 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb080a5760 con 0x7fdb101548c0 2023-12-08T08:22:30.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.482+0000 7fdb0effd640 1 -- 172.21.15.88:0/2058922747 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb080a58c0 con 0x7fdb101548c0 2023-12-08T08:22:30.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.482+0000 7fdb0effd640 1 -- 172.21.15.88:0/2058922747 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb080a5c50 con 0x7fdb101548c0 2023-12-08T08:22:30.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.482+0000 7fdb16701640 1 -- 172.21.15.88:0/2058922747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb101548c0 msgr2=0x7fdb10154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:30.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.482+0000 7fdb16701640 1 --2- 172.21.15.88:0/2058922747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb101548c0 0x7fdb10154d30 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fdb100c4150 tx=0x7fdb0801c990 comp rx=0 tx=0).stop 2023-12-08T08:22:30.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.482+0000 7fdb16701640 1 -- 172.21.15.88:0/2058922747 shutdown_connections 2023-12-08T08:22:30.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.482+0000 7fdb16701640 1 --2- 172.21.15.88:0/2058922747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb101548c0 0x7fdb10154d30 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.482+0000 7fdb16701640 1 --2- 172.21.15.88:0/2058922747 >> v2:172.21.15.148:3300/0 conn(0x7fdb1014b1e0 0x7fdb100c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.482+0000 7fdb16701640 1 -- 172.21.15.88:0/2058922747 >> 172.21.15.88:0/2058922747 conn(0x7fdb100c59f0 msgr2=0x7fdb100c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:30.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.482+0000 7fdb16701640 1 -- 172.21.15.88:0/2058922747 shutdown_connections 2023-12-08T08:22:30.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.482+0000 7fdb16701640 1 -- 172.21.15.88:0/2058922747 wait complete. 2023-12-08T08:22:30.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.486+0000 7fdb16701640 1 Processor -- start 2023-12-08T08:22:30.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.486+0000 7fdb16701640 1 -- start start 2023-12-08T08:22:30.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.486+0000 7fdb16701640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdb100c5300 0x7fdb100aabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:30.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.486+0000 7fdb16701640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb1014b1e0 0x7fdb1014c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:30.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.486+0000 7fdb16701640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb101548c0 0x7fdb1014cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:30.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.486+0000 7fdb16701640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb10150c60 con 0x7fdb1014b1e0 2023-12-08T08:22:30.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.486+0000 7fdb16701640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb101eb050 con 0x7fdb101548c0 2023-12-08T08:22:30.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.486+0000 7fdb16701640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb10072710 con 0x7fdb100c5300 2023-12-08T08:22:30.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.486+0000 7fdb0f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb1014b1e0 0x7fdb1014c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:30.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.486+0000 7fdb0ffff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdb100c5300 0x7fdb100aabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:30.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.486+0000 7fdb0f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb1014b1e0 0x7fdb1014c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57270/0 (socket says 172.21.15.88:57270) 2023-12-08T08:22:30.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.486+0000 7fdb0f7fe640 1 -- 172.21.15.88:0/4077491954 learned_addr learned my addr 172.21.15.88:0/4077491954 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:30.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.486+0000 7fdb14c9e640 1 --2- 172.21.15.88:0/4077491954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb101548c0 0x7fdb1014cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:30.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.486+0000 7fdb0f7fe640 1 -- 172.21.15.88:0/4077491954 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdb100c5300 msgr2=0x7fdb100aabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:30.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.486+0000 7fdb0f7fe640 1 --2- 172.21.15.88:0/4077491954 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdb100c5300 0x7fdb100aabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.486+0000 7fdb0f7fe640 1 -- 172.21.15.88:0/4077491954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb101548c0 msgr2=0x7fdb1014cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:30.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.486+0000 7fdb0f7fe640 1 --2- 172.21.15.88:0/4077491954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb101548c0 0x7fdb1014cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.486+0000 7fdb0f7fe640 1 -- 172.21.15.88:0/4077491954 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb08009b30 con 0x7fdb1014b1e0 2023-12-08T08:22:30.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.486+0000 7fdb0f7fe640 1 --2- 172.21.15.88:0/4077491954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb1014b1e0 0x7fdb1014c630 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400c410 tx=0x7fdb0400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:30.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.486+0000 7fdb0cff9640 1 -- 172.21.15.88:0/4077491954 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04011790 con 0x7fdb1014b1e0 2023-12-08T08:22:30.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.486+0000 7fdb0cff9640 1 -- 172.21.15.88:0/4077491954 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb040118f0 con 0x7fdb1014b1e0 2023-12-08T08:22:30.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.486+0000 7fdb16701640 1 -- 172.21.15.88:0/4077491954 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb101502c0 con 0x7fdb1014b1e0 2023-12-08T08:22:30.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.486+0000 7fdb0cff9640 1 -- 172.21.15.88:0/4077491954 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04011ce0 con 0x7fdb1014b1e0 2023-12-08T08:22:30.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.486+0000 7fdb16701640 1 -- 172.21.15.88:0/4077491954 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb10150880 con 0x7fdb1014b1e0 2023-12-08T08:22:30.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.490+0000 7fdb16701640 1 -- 172.21.15.88:0/4077491954 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb10150da0 con 0x7fdb1014b1e0 2023-12-08T08:22:30.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.490+0000 7fdb0cff9640 1 -- 172.21.15.88:0/4077491954 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdb0401c460 con 0x7fdb1014b1e0 2023-12-08T08:22:30.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.490+0000 7fdb0cff9640 1 --2- 172.21.15.88:0/4077491954 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdafc066470 0x7fdafc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:30.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.490+0000 7fdb0cff9640 1 -- 172.21.15.88:0/4077491954 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdb04083d50 con 0x7fdb1014b1e0 2023-12-08T08:22:30.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.490+0000 7fdb0ffff640 1 --2- 172.21.15.88:0/4077491954 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdafc066470 0x7fdafc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:30.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.490+0000 7fdb0ffff640 1 --2- 172.21.15.88:0/4077491954 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdafc066470 0x7fdafc068930 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdb00007a60 tx=0x7fdb00008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:30.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.494+0000 7fdb0cff9640 1 -- 172.21.15.88:0/4077491954 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdb10150da0 con 0x7fdb1014b1e0 2023-12-08T08:22:30.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.646+0000 7fdb16701640 1 -- 172.21.15.88:0/4077491954 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdb10150da0 con 0x7fdb1014b1e0 2023-12-08T08:22:30.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.646+0000 7fdb0cff9640 1 -- 172.21.15.88:0/4077491954 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdb10150da0 con 0x7fdb1014b1e0 2023-12-08T08:22:30.651 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:22:30.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.646+0000 7fdb16701640 1 -- 172.21.15.88:0/4077491954 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdafc066470 msgr2=0x7fdafc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:30.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.646+0000 7fdb16701640 1 --2- 172.21.15.88:0/4077491954 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdafc066470 0x7fdafc068930 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdb00007a60 tx=0x7fdb00008040 comp rx=0 tx=0).stop 2023-12-08T08:22:30.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.646+0000 7fdb16701640 1 -- 172.21.15.88:0/4077491954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb1014b1e0 msgr2=0x7fdb1014c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:30.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.646+0000 7fdb16701640 1 --2- 172.21.15.88:0/4077491954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb1014b1e0 0x7fdb1014c630 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400c410 tx=0x7fdb0400c8d0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.646+0000 7fdb16701640 1 -- 172.21.15.88:0/4077491954 shutdown_connections 2023-12-08T08:22:30.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.646+0000 7fdb16701640 1 --2- 172.21.15.88:0/4077491954 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdafc066470 0x7fdafc068930 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.646+0000 7fdb16701640 1 --2- 172.21.15.88:0/4077491954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb101548c0 0x7fdb1014cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.646+0000 7fdb16701640 1 --2- 172.21.15.88:0/4077491954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb1014b1e0 0x7fdb1014c630 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.646+0000 7fdb16701640 1 --2- 172.21.15.88:0/4077491954 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdb100c5300 0x7fdb100aabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.646+0000 7fdb16701640 1 -- 172.21.15.88:0/4077491954 >> 172.21.15.88:0/4077491954 conn(0x7fdb100c59f0 msgr2=0x7fdb10148040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:30.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.646+0000 7fdb16701640 1 -- 172.21.15.88:0/4077491954 shutdown_connections 2023-12-08T08:22:30.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.646+0000 7fdb16701640 1 -- 172.21.15.88:0/4077491954 wait complete. 2023-12-08T08:22:30.672 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:22:30.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.810+0000 7f8afaff5640 1 Processor -- start 2023-12-08T08:22:30.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.810+0000 7f8afaff5640 1 -- start start 2023-12-08T08:22:30.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.810+0000 7f8afaff5640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8af414b1e0 0x7f8af40c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:30.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.810+0000 7f8afaff5640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8af41548c0 0x7f8af4154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:30.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.810+0000 7f8afaff5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af40a4e20 con 0x7f8af40c5300 2023-12-08T08:22:30.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.810+0000 7f8afaff5640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af40a50e0 con 0x7f8af41548c0 2023-12-08T08:22:30.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.810+0000 7f8afaff5640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af40c0f00 con 0x7f8af414b1e0 2023-12-08T08:22:30.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.810+0000 7f8aebfff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8af40c5300 0x7f8af40a9c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41334/0 (socket says 172.21.15.88:41334) 2023-12-08T08:22:30.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.810+0000 7f8aebfff640 1 -- 172.21.15.88:0/795018584 learned_addr learned my addr 172.21.15.88:0/795018584 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:30.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.810+0000 7f8af9592640 1 --2- 172.21.15.88:0/795018584 >> v2:172.21.15.148:3300/0 conn(0x7f8af41548c0 0x7f8af4154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:30.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.810+0000 7f8af8d91640 1 --2- 172.21.15.88:0/795018584 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8af414b1e0 0x7f8af40c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:30.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.810+0000 7f8aeb7fe640 1 -- 172.21.15.88:0/795018584 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 422946539 0 0) 0x7f8af40a4e20 con 0x7f8af40c5300 2023-12-08T08:22:30.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.810+0000 7f8aeb7fe640 1 -- 172.21.15.88:0/795018584 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8adc003530 con 0x7f8af40c5300 2023-12-08T08:22:30.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.810+0000 7f8af9592640 1 -- 172.21.15.88:0/795018584 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8af414b1e0 msgr2=0x7f8af40c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:30.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.810+0000 7f8af9592640 1 --2- 172.21.15.88:0/795018584 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8af414b1e0 0x7f8af40c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.810+0000 7f8af9592640 1 -- 172.21.15.88:0/795018584 >> v1:172.21.15.88:6789/0 conn(0x7f8af40c5300 legacy=0x7f8af40a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:30.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.810+0000 7f8af9592640 1 -- 172.21.15.88:0/795018584 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af40c11e0 con 0x7f8af41548c0 2023-12-08T08:22:30.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.814+0000 7f8af9592640 1 --2- 172.21.15.88:0/795018584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8af41548c0 0x7f8af4154d50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8aec009d90 tx=0x7f8aec01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20f77f442dab3ac5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:30.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.814+0000 7f8aeb7fe640 1 -- 172.21.15.88:0/795018584 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af41558b0 con 0x7f8af41548c0 2023-12-08T08:22:30.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.814+0000 7f8aeb7fe640 1 -- 172.21.15.88:0/795018584 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aec0a5920 con 0x7f8af41548c0 2023-12-08T08:22:30.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.814+0000 7f8aeb7fe640 1 -- 172.21.15.88:0/795018584 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec0a5cb0 con 0x7f8af41548c0 2023-12-08T08:22:30.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.814+0000 7f8afaff5640 1 -- 172.21.15.88:0/795018584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8af41548c0 msgr2=0x7f8af4154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:30.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.814+0000 7f8afaff5640 1 --2- 172.21.15.88:0/795018584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8af41548c0 0x7f8af4154d50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8aec009d90 tx=0x7f8aec01c950 comp rx=0 tx=0).stop 2023-12-08T08:22:30.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.814+0000 7f8afaff5640 1 -- 172.21.15.88:0/795018584 shutdown_connections 2023-12-08T08:22:30.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.814+0000 7f8afaff5640 1 --2- 172.21.15.88:0/795018584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8af41548c0 0x7f8af4154d50 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.814+0000 7f8afaff5640 1 --2- 172.21.15.88:0/795018584 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8af414b1e0 0x7f8af40c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.814+0000 7f8afaff5640 1 -- 172.21.15.88:0/795018584 >> 172.21.15.88:0/795018584 conn(0x7f8af40c59f0 msgr2=0x7f8af40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:30.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.814+0000 7f8afaff5640 1 -- 172.21.15.88:0/795018584 shutdown_connections 2023-12-08T08:22:30.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.814+0000 7f8afaff5640 1 -- 172.21.15.88:0/795018584 wait complete. 2023-12-08T08:22:30.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.818+0000 7f8afaff5640 1 Processor -- start 2023-12-08T08:22:30.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.818+0000 7f8afaff5640 1 -- start start 2023-12-08T08:22:30.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.818+0000 7f8afaff5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8af40c5300 0x7f8af4152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:30.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.818+0000 7f8afaff5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8af414b1e0 0x7f8af40a6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:30.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.818+0000 7f8afaff5640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8af41548c0 0x7f8af41ebd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:30.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.818+0000 7f8afaff5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af40a6cc0 con 0x7f8af414b1e0 2023-12-08T08:22:30.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.818+0000 7f8afaff5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af41ecc80 con 0x7f8af40c5300 2023-12-08T08:22:30.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.818+0000 7f8afaff5640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af4071d50 con 0x7f8af41548c0 2023-12-08T08:22:30.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.818+0000 7f8aebfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8af414b1e0 0x7f8af40a6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:30.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.818+0000 7f8aebfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8af414b1e0 0x7f8af40a6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57276/0 (socket says 172.21.15.88:57276) 2023-12-08T08:22:30.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.818+0000 7f8aebfff640 1 -- 172.21.15.88:0/1676598808 learned_addr learned my addr 172.21.15.88:0/1676598808 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:30.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.818+0000 7f8af9592640 1 --2- 172.21.15.88:0/1676598808 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8af41548c0 0x7f8af41ebd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:30.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.818+0000 7f8af8d91640 1 --2- 172.21.15.88:0/1676598808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8af40c5300 0x7f8af4152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:30.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.818+0000 7f8aebfff640 1 -- 172.21.15.88:0/1676598808 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8af41548c0 msgr2=0x7f8af41ebd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:30.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.818+0000 7f8aebfff640 1 --2- 172.21.15.88:0/1676598808 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8af41548c0 0x7f8af41ebd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.818+0000 7f8aebfff640 1 -- 172.21.15.88:0/1676598808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8af40c5300 msgr2=0x7f8af4152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:30.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.818+0000 7f8aebfff640 1 --2- 172.21.15.88:0/1676598808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8af40c5300 0x7f8af4152380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.818+0000 7f8aebfff640 1 -- 172.21.15.88:0/1676598808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aec009a70 con 0x7f8af414b1e0 2023-12-08T08:22:30.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.818+0000 7f8aebfff640 1 --2- 172.21.15.88:0/1676598808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8af414b1e0 0x7f8af40a6780 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400c490 tx=0x7f8ae400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:30.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.818+0000 7f8ae97fa640 1 -- 172.21.15.88:0/1676598808 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4005cf0 con 0x7f8af414b1e0 2023-12-08T08:22:30.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.818+0000 7f8ae97fa640 1 -- 172.21.15.88:0/1676598808 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae4005e50 con 0x7f8af414b1e0 2023-12-08T08:22:30.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.818+0000 7f8afaff5640 1 -- 172.21.15.88:0/1676598808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af41ec9a0 con 0x7f8af414b1e0 2023-12-08T08:22:30.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.818+0000 7f8ae97fa640 1 -- 172.21.15.88:0/1676598808 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4007270 con 0x7f8af414b1e0 2023-12-08T08:22:30.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.818+0000 7f8afaff5640 1 -- 172.21.15.88:0/1676598808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af40722d0 con 0x7f8af414b1e0 2023-12-08T08:22:30.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.822+0000 7f8afaff5640 1 -- 172.21.15.88:0/1676598808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af4067630 con 0x7f8af414b1e0 2023-12-08T08:22:30.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.822+0000 7f8ae97fa640 1 -- 172.21.15.88:0/1676598808 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8ae40073d0 con 0x7f8af414b1e0 2023-12-08T08:22:30.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.822+0000 7f8ae97fa640 1 --2- 172.21.15.88:0/1676598808 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8ae00664a0 0x7f8ae0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:30.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.822+0000 7f8ae97fa640 1 -- 172.21.15.88:0/1676598808 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8ae4083530 con 0x7f8af414b1e0 2023-12-08T08:22:30.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.822+0000 7f8af8d91640 1 --2- 172.21.15.88:0/1676598808 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8ae00664a0 0x7f8ae0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:30.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.822+0000 7f8af8d91640 1 --2- 172.21.15.88:0/1676598808 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8ae00664a0 0x7f8ae0068960 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8af0009b60 tx=0x7f8af0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:30.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.826+0000 7f8ae97fa640 1 -- 172.21.15.88:0/1676598808 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8ae4050790 con 0x7f8af414b1e0 2023-12-08T08:22:30.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.978+0000 7f8afaff5640 1 -- 172.21.15.88:0/1676598808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8af4149bd0 con 0x7f8af414b1e0 2023-12-08T08:22:30.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.978+0000 7f8ae97fa640 1 -- 172.21.15.88:0/1676598808 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8ae4053db0 con 0x7f8af414b1e0 2023-12-08T08:22:30.982 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:22:30.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.978+0000 7f8afaff5640 1 -- 172.21.15.88:0/1676598808 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8ae00664a0 msgr2=0x7f8ae0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:30.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.978+0000 7f8afaff5640 1 --2- 172.21.15.88:0/1676598808 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8ae00664a0 0x7f8ae0068960 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8af0009b60 tx=0x7f8af0009190 comp rx=0 tx=0).stop 2023-12-08T08:22:30.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.978+0000 7f8afaff5640 1 -- 172.21.15.88:0/1676598808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8af414b1e0 msgr2=0x7f8af40a6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:30.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.978+0000 7f8afaff5640 1 --2- 172.21.15.88:0/1676598808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8af414b1e0 0x7f8af40a6780 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400c490 tx=0x7f8ae400c950 comp rx=0 tx=0).stop 2023-12-08T08:22:30.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.978+0000 7f8afaff5640 1 -- 172.21.15.88:0/1676598808 shutdown_connections 2023-12-08T08:22:30.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.978+0000 7f8afaff5640 1 --2- 172.21.15.88:0/1676598808 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8ae00664a0 0x7f8ae0068960 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.978+0000 7f8afaff5640 1 --2- 172.21.15.88:0/1676598808 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8af41548c0 0x7f8af41ebd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.978+0000 7f8afaff5640 1 --2- 172.21.15.88:0/1676598808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8af414b1e0 0x7f8af40a6780 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.978+0000 7f8afaff5640 1 --2- 172.21.15.88:0/1676598808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8af40c5300 0x7f8af4152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:30.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.978+0000 7f8afaff5640 1 -- 172.21.15.88:0/1676598808 >> 172.21.15.88:0/1676598808 conn(0x7f8af40c59f0 msgr2=0x7f8af40c5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:30.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.978+0000 7f8afaff5640 1 -- 172.21.15.88:0/1676598808 shutdown_connections 2023-12-08T08:22:30.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:30.978+0000 7f8afaff5640 1 -- 172.21.15.88:0/1676598808 wait complete. 2023-12-08T08:22:31.003 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:22:31.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.138+0000 7f882bc79640 1 Processor -- start 2023-12-08T08:22:31.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.138+0000 7f882bc79640 1 -- start start 2023-12-08T08:22:31.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.138+0000 7f882bc79640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f88240c6030 0x7f88240c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:31.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.138+0000 7f882bc79640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f88240c98f0 0x7f88240c8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:31.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.138+0000 7f882bc79640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8824158780 con 0x7f88240bf2d0 2023-12-08T08:22:31.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.138+0000 7f882bc79640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88240c0300 con 0x7f88240c6030 2023-12-08T08:22:31.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.138+0000 7f882bc79640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8824157b70 con 0x7f88240c98f0 2023-12-08T08:22:31.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.138+0000 7f8829214640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f88240c6030 0x7f88240c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:31.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.138+0000 7f8829214640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f88240c6030 0x7f88240c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57286/0 (socket says 172.21.15.88:57286) 2023-12-08T08:22:31.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.138+0000 7f8829214640 1 -- 172.21.15.88:0/1315613269 learned_addr learned my addr 172.21.15.88:0/1315613269 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:31.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.138+0000 7f882a216640 1 --2- 172.21.15.88:0/1315613269 >> v2:172.21.15.148:3300/0 conn(0x7f88240c98f0 0x7f88240c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:31.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.138+0000 7f8829214640 1 -- 172.21.15.88:0/1315613269 >> v2:172.21.15.148:3300/0 conn(0x7f88240c98f0 msgr2=0x7f88240c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:31.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.138+0000 7f8829214640 1 --2- 172.21.15.88:0/1315613269 >> v2:172.21.15.148:3300/0 conn(0x7f88240c98f0 0x7f88240c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.138+0000 7f8829214640 1 -- 172.21.15.88:0/1315613269 >> v1:172.21.15.148:6789/0 conn(0x7f88240bf2d0 legacy=0x7f8824151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:31.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.138+0000 7f8829214640 1 -- 172.21.15.88:0/1315613269 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8824157e50 con 0x7f88240c6030 2023-12-08T08:22:31.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.142+0000 7f8829214640 1 --2- 172.21.15.88:0/1315613269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88240c6030 0x7f88240c7cc0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f88240a9720 tx=0x7f881401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122a99560cc7a925 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:31.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.142+0000 7f8828a13640 1 -- 172.21.15.88:0/1315613269 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88140aa5f0 con 0x7f88240c6030 2023-12-08T08:22:31.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.142+0000 7f8828a13640 1 -- 172.21.15.88:0/1315613269 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88140aa750 con 0x7f88240c6030 2023-12-08T08:22:31.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.142+0000 7f8828a13640 1 -- 172.21.15.88:0/1315613269 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88140aaae0 con 0x7f88240c6030 2023-12-08T08:22:31.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.142+0000 7f882bc79640 1 -- 172.21.15.88:0/1315613269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88240c6030 msgr2=0x7f88240c7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:31.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.142+0000 7f882bc79640 1 --2- 172.21.15.88:0/1315613269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88240c6030 0x7f88240c7cc0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f88240a9720 tx=0x7f881401c490 comp rx=0 tx=0).stop 2023-12-08T08:22:31.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.142+0000 7f882bc79640 1 -- 172.21.15.88:0/1315613269 shutdown_connections 2023-12-08T08:22:31.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.142+0000 7f882bc79640 1 --2- 172.21.15.88:0/1315613269 >> v2:172.21.15.148:3300/0 conn(0x7f88240c98f0 0x7f88240c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.142+0000 7f882bc79640 1 --2- 172.21.15.88:0/1315613269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88240c6030 0x7f88240c7cc0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.142+0000 7f882bc79640 1 -- 172.21.15.88:0/1315613269 >> 172.21.15.88:0/1315613269 conn(0x7f88240c9dc0 msgr2=0x7f88240ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:31.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.142+0000 7f882bc79640 1 -- 172.21.15.88:0/1315613269 shutdown_connections 2023-12-08T08:22:31.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.142+0000 7f882bc79640 1 -- 172.21.15.88:0/1315613269 wait complete. 2023-12-08T08:22:31.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.146+0000 7f882bc79640 1 Processor -- start 2023-12-08T08:22:31.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.146+0000 7f882bc79640 1 -- start start 2023-12-08T08:22:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.146+0000 7f882bc79640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88240bf2d0 0x7f882406aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.146+0000 7f882bc79640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88240c6030 0x7f882406c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.146+0000 7f882bc79640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88240c98f0 0x7f88241503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.146+0000 7f882bc79640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8824148890 con 0x7f88240c6030 2023-12-08T08:22:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.146+0000 7f882bc79640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882406bdf0 con 0x7f88240c98f0 2023-12-08T08:22:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.146+0000 7f882bc79640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8824152780 con 0x7f88240bf2d0 2023-12-08T08:22:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.146+0000 7f8829214640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88240c6030 0x7f882406c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.146+0000 7f8829214640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88240c6030 0x7f882406c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57300/0 (socket says 172.21.15.88:57300) 2023-12-08T08:22:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.146+0000 7f8829214640 1 -- 172.21.15.88:0/967984054 learned_addr learned my addr 172.21.15.88:0/967984054 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.146+0000 7f8829a15640 1 --2- 172.21.15.88:0/967984054 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88240bf2d0 0x7f882406aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.146+0000 7f882a216640 1 --2- 172.21.15.88:0/967984054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88240c98f0 0x7f88241503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.146+0000 7f8829214640 1 -- 172.21.15.88:0/967984054 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88240bf2d0 msgr2=0x7f882406aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.146+0000 7f8829214640 1 --2- 172.21.15.88:0/967984054 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88240bf2d0 0x7f882406aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.146+0000 7f8829214640 1 -- 172.21.15.88:0/967984054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88240c98f0 msgr2=0x7f88241503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:31.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.146+0000 7f8829214640 1 --2- 172.21.15.88:0/967984054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88240c98f0 0x7f88241503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.146+0000 7f8829214640 1 -- 172.21.15.88:0/967984054 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88140094d0 con 0x7f88240c6030 2023-12-08T08:22:31.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.146+0000 7f8829a15640 1 --2- 172.21.15.88:0/967984054 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88240bf2d0 0x7f882406aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:31.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.146+0000 7f8829214640 1 --2- 172.21.15.88:0/967984054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88240c6030 0x7f882406c440 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f881401a0c0 tx=0x7f881401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:31.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.146+0000 7f881a7fc640 1 -- 172.21.15.88:0/967984054 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88140aa5f0 con 0x7f88240c6030 2023-12-08T08:22:31.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.146+0000 7f881a7fc640 1 -- 172.21.15.88:0/967984054 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88140b3800 con 0x7f88240c6030 2023-12-08T08:22:31.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.146+0000 7f881a7fc640 1 -- 172.21.15.88:0/967984054 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88140b3b90 con 0x7f88240c6030 2023-12-08T08:22:31.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.146+0000 7f882bc79640 1 -- 172.21.15.88:0/967984054 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f882414ff30 con 0x7f88240c6030 2023-12-08T08:22:31.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.146+0000 7f882bc79640 1 -- 172.21.15.88:0/967984054 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f882414f8e0 con 0x7f88240c6030 2023-12-08T08:22:31.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.146+0000 7f882bc79640 1 -- 172.21.15.88:0/967984054 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f882414f740 con 0x7f88240c6030 2023-12-08T08:22:31.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.150+0000 7f881a7fc640 1 -- 172.21.15.88:0/967984054 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f88140b3cf0 con 0x7f88240c6030 2023-12-08T08:22:31.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.150+0000 7f881a7fc640 1 --2- 172.21.15.88:0/967984054 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8808066470 0x7f8808068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:31.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.150+0000 7f881a7fc640 1 -- 172.21.15.88:0/967984054 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f88140a7070 con 0x7f88240c6030 2023-12-08T08:22:31.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.150+0000 7f8829a15640 1 --2- 172.21.15.88:0/967984054 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8808066470 0x7f8808068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:31.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.150+0000 7f8829a15640 1 --2- 172.21.15.88:0/967984054 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8808066470 0x7f8808068930 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8824155740 tx=0x7f8820009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:31.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.154+0000 7f881a7fc640 1 -- 172.21.15.88:0/967984054 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f882414f740 con 0x7f88240c6030 2023-12-08T08:22:31.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.302+0000 7f882bc79640 1 -- 172.21.15.88:0/967984054 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f882414f740 con 0x7f88240c6030 2023-12-08T08:22:31.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.302+0000 7f881a7fc640 1 -- 172.21.15.88:0/967984054 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f882414f740 con 0x7f88240c6030 2023-12-08T08:22:31.307 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:22:31.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.302+0000 7f882bc79640 1 -- 172.21.15.88:0/967984054 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8808066470 msgr2=0x7f8808068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:31.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.302+0000 7f882bc79640 1 --2- 172.21.15.88:0/967984054 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8808066470 0x7f8808068930 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8824155740 tx=0x7f8820009040 comp rx=0 tx=0).stop 2023-12-08T08:22:31.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.302+0000 7f882bc79640 1 -- 172.21.15.88:0/967984054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88240c6030 msgr2=0x7f882406c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:31.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.302+0000 7f882bc79640 1 --2- 172.21.15.88:0/967984054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88240c6030 0x7f882406c440 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f881401a0c0 tx=0x7f881401acd0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.302+0000 7f882bc79640 1 -- 172.21.15.88:0/967984054 shutdown_connections 2023-12-08T08:22:31.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.302+0000 7f882bc79640 1 --2- 172.21.15.88:0/967984054 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8808066470 0x7f8808068930 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.302+0000 7f882bc79640 1 --2- 172.21.15.88:0/967984054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88240c98f0 0x7f88241503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.302+0000 7f882bc79640 1 --2- 172.21.15.88:0/967984054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88240c6030 0x7f882406c440 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.302+0000 7f882bc79640 1 --2- 172.21.15.88:0/967984054 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f88240bf2d0 0x7f882406aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.302+0000 7f882bc79640 1 -- 172.21.15.88:0/967984054 >> 172.21.15.88:0/967984054 conn(0x7f88240c9dc0 msgr2=0x7f88241562c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:31.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.302+0000 7f882bc79640 1 -- 172.21.15.88:0/967984054 shutdown_connections 2023-12-08T08:22:31.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.302+0000 7f882bc79640 1 -- 172.21.15.88:0/967984054 wait complete. 2023-12-08T08:22:31.328 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:22:31.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.462+0000 7f0a4445a640 1 Processor -- start 2023-12-08T08:22:31.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.462+0000 7f0a4445a640 1 -- start start 2023-12-08T08:22:31.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.462+0000 7f0a4445a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a3c14b1e0 0x7f0a3c0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:31.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.462+0000 7f0a4445a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0a3c0c5300 0x7f0a3c0a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:31.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.462+0000 7f0a4445a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0a3c151280 0x7f0a3c151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:31.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.462+0000 7f0a4445a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a3c0a4e20 con 0x7f0a3c151280 2023-12-08T08:22:31.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.462+0000 7f0a4445a640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a3c0a50e0 con 0x7f0a3c0c5300 2023-12-08T08:22:31.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.462+0000 7f0a4445a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c0c0f00 con 0x7f0a3c14b1e0 2023-12-08T08:22:31.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.462+0000 7f0a429f7640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0a3c151280 0x7f0a3c151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:31.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.462+0000 7f0a429f7640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0a3c151280 0x7f0a3c151710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57312/0 (socket says 172.21.15.88:57312) 2023-12-08T08:22:31.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.462+0000 7f0a429f7640 1 -- 172.21.15.88:0/945246129 learned_addr learned my addr 172.21.15.88:0/945246129 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:31.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.462+0000 7f0a421f6640 1 --2- 172.21.15.88:0/945246129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a3c14b1e0 0x7f0a3c0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:31.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.462+0000 7f0a419f5640 1 --2- 172.21.15.88:0/945246129 >> v2:172.21.15.148:3300/0 conn(0x7f0a3c0c5300 0x7f0a3c0a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:31.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.462+0000 7f0a429f7640 1 -- 172.21.15.88:0/945246129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a3c14b1e0 msgr2=0x7f0a3c0c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:31.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.466+0000 7f0a429f7640 1 --2- 172.21.15.88:0/945246129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a3c14b1e0 0x7f0a3c0c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.466+0000 7f0a429f7640 1 -- 172.21.15.88:0/945246129 >> v2:172.21.15.148:3300/0 conn(0x7f0a3c0c5300 msgr2=0x7f0a3c0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:31.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.466+0000 7f0a429f7640 1 --2- 172.21.15.88:0/945246129 >> v2:172.21.15.148:3300/0 conn(0x7f0a3c0c5300 0x7f0a3c0a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.466+0000 7f0a429f7640 1 -- 172.21.15.88:0/945246129 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c0c11e0 con 0x7f0a3c151280 2023-12-08T08:22:31.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.466+0000 7f0a429f7640 1 --2- 172.21.15.88:0/945246129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a3c151280 0x7f0a3c151710 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c06f790 tx=0x7f0a3401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a44ecdd9d22d13e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:31.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.466+0000 7f0a411f4640 1 -- 172.21.15.88:0/945246129 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a340a56e0 con 0x7f0a3c151280 2023-12-08T08:22:31.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.466+0000 7f0a411f4640 1 -- 172.21.15.88:0/945246129 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a340a5840 con 0x7f0a3c151280 2023-12-08T08:22:31.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.466+0000 7f0a411f4640 1 -- 172.21.15.88:0/945246129 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a340a5bd0 con 0x7f0a3c151280 2023-12-08T08:22:31.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.466+0000 7f0a4445a640 1 -- 172.21.15.88:0/945246129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a3c151280 msgr2=0x7f0a3c151710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:31.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.466+0000 7f0a4445a640 1 --2- 172.21.15.88:0/945246129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a3c151280 0x7f0a3c151710 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c06f790 tx=0x7f0a3401c9d0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a4445a640 1 -- 172.21.15.88:0/945246129 shutdown_connections 2023-12-08T08:22:31.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a4445a640 1 --2- 172.21.15.88:0/945246129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a3c151280 0x7f0a3c151710 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a4445a640 1 --2- 172.21.15.88:0/945246129 >> v2:172.21.15.148:3300/0 conn(0x7f0a3c0c5300 0x7f0a3c0a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a4445a640 1 --2- 172.21.15.88:0/945246129 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a3c14b1e0 0x7f0a3c0c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a4445a640 1 -- 172.21.15.88:0/945246129 >> 172.21.15.88:0/945246129 conn(0x7f0a3c0c59f0 msgr2=0x7f0a3c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:31.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a4445a640 1 -- 172.21.15.88:0/945246129 shutdown_connections 2023-12-08T08:22:31.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a4445a640 1 -- 172.21.15.88:0/945246129 wait complete. 2023-12-08T08:22:31.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a4445a640 1 Processor -- start 2023-12-08T08:22:31.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a4445a640 1 -- start start 2023-12-08T08:22:31.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a4445a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a3c0c5300 0x7f0a3c149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:31.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a4445a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a3c14b1e0 0x7f0a3c1478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:31.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a4445a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a3c151280 0x7f0a3c153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:31.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a4445a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c149850 con 0x7f0a3c0c5300 2023-12-08T08:22:31.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a4445a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c149b30 con 0x7f0a3c151280 2023-12-08T08:22:31.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a4445a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c070170 con 0x7f0a3c14b1e0 2023-12-08T08:22:31.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a421f6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a3c0c5300 0x7f0a3c149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:31.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a421f6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a3c0c5300 0x7f0a3c149270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57314/0 (socket says 172.21.15.88:57314) 2023-12-08T08:22:31.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a421f6640 1 -- 172.21.15.88:0/2927311433 learned_addr learned my addr 172.21.15.88:0/2927311433 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:31.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a429f7640 1 --2- 172.21.15.88:0/2927311433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a3c151280 0x7f0a3c153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:31.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a419f5640 1 --2- 172.21.15.88:0/2927311433 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a3c14b1e0 0x7f0a3c1478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:31.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a421f6640 1 -- 172.21.15.88:0/2927311433 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a3c14b1e0 msgr2=0x7f0a3c1478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:31.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a421f6640 1 --2- 172.21.15.88:0/2927311433 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a3c14b1e0 0x7f0a3c1478d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a421f6640 1 -- 172.21.15.88:0/2927311433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a3c151280 msgr2=0x7f0a3c153a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:31.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a421f6640 1 --2- 172.21.15.88:0/2927311433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a3c151280 0x7f0a3c153a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a421f6640 1 -- 172.21.15.88:0/2927311433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a34009b30 con 0x7f0a3c0c5300 2023-12-08T08:22:31.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a429f7640 1 --2- 172.21.15.88:0/2927311433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a3c151280 0x7f0a3c153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:31.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a421f6640 1 --2- 172.21.15.88:0/2927311433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a3c0c5300 0x7f0a3c149270 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f0a3800d800 tx=0x7f0a3800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:31.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a32ffd640 1 -- 172.21.15.88:0/2927311433 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3800b6c0 con 0x7f0a3c0c5300 2023-12-08T08:22:31.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a32ffd640 1 -- 172.21.15.88:0/2927311433 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3800b820 con 0x7f0a3c0c5300 2023-12-08T08:22:31.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a32ffd640 1 -- 172.21.15.88:0/2927311433 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3800bb90 con 0x7f0a3c0c5300 2023-12-08T08:22:31.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.470+0000 7f0a4445a640 1 -- 172.21.15.88:0/2927311433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a3c070450 con 0x7f0a3c0c5300 2023-12-08T08:22:31.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.474+0000 7f0a4445a640 1 -- 172.21.15.88:0/2927311433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a3c153f70 con 0x7f0a3c0c5300 2023-12-08T08:22:31.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.474+0000 7f0a4445a640 1 -- 172.21.15.88:0/2927311433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a3c067630 con 0x7f0a3c0c5300 2023-12-08T08:22:31.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.474+0000 7f0a32ffd640 1 -- 172.21.15.88:0/2927311433 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0a3800bcf0 con 0x7f0a3c0c5300 2023-12-08T08:22:31.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.474+0000 7f0a32ffd640 1 --2- 172.21.15.88:0/2927311433 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0a200664a0 0x7f0a20068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:31.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.474+0000 7f0a32ffd640 1 -- 172.21.15.88:0/2927311433 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0a38084710 con 0x7f0a3c0c5300 2023-12-08T08:22:31.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.474+0000 7f0a419f5640 1 --2- 172.21.15.88:0/2927311433 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0a200664a0 0x7f0a20068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:31.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.474+0000 7f0a419f5640 1 --2- 172.21.15.88:0/2927311433 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0a200664a0 0x7f0a20068960 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c0c3930 tx=0x7f0a2c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:31.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.478+0000 7f0a32ffd640 1 -- 172.21.15.88:0/2927311433 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0a38051820 con 0x7f0a3c0c5300 2023-12-08T08:22:31.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.630+0000 7f0a4445a640 1 -- 172.21.15.88:0/2927311433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a3c149cf0 con 0x7f0a3c0c5300 2023-12-08T08:22:31.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.630+0000 7f0a32ffd640 1 -- 172.21.15.88:0/2927311433 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v54) v1 ==== 105+0+11 (secure 0 0 0) 0x7f0a38054e40 con 0x7f0a3c0c5300 2023-12-08T08:22:31.634 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:22:31.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.630+0000 7f0a4445a640 1 -- 172.21.15.88:0/2927311433 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0a200664a0 msgr2=0x7f0a20068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:31.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.630+0000 7f0a4445a640 1 --2- 172.21.15.88:0/2927311433 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0a200664a0 0x7f0a20068960 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c0c3930 tx=0x7f0a2c008040 comp rx=0 tx=0).stop 2023-12-08T08:22:31.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.630+0000 7f0a4445a640 1 -- 172.21.15.88:0/2927311433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a3c0c5300 msgr2=0x7f0a3c149270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:31.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.630+0000 7f0a4445a640 1 --2- 172.21.15.88:0/2927311433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a3c0c5300 0x7f0a3c149270 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f0a3800d800 tx=0x7f0a3800dcc0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.630+0000 7f0a4445a640 1 -- 172.21.15.88:0/2927311433 shutdown_connections 2023-12-08T08:22:31.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.630+0000 7f0a4445a640 1 --2- 172.21.15.88:0/2927311433 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0a200664a0 0x7f0a20068960 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.630+0000 7f0a4445a640 1 --2- 172.21.15.88:0/2927311433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a3c151280 0x7f0a3c153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.630+0000 7f0a4445a640 1 --2- 172.21.15.88:0/2927311433 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0a3c14b1e0 0x7f0a3c1478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.630+0000 7f0a4445a640 1 --2- 172.21.15.88:0/2927311433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a3c0c5300 0x7f0a3c149270 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.630+0000 7f0a4445a640 1 -- 172.21.15.88:0/2927311433 >> 172.21.15.88:0/2927311433 conn(0x7f0a3c0c59f0 msgr2=0x7f0a3c0c2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:31.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.630+0000 7f0a4445a640 1 -- 172.21.15.88:0/2927311433 shutdown_connections 2023-12-08T08:22:31.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.630+0000 7f0a4445a640 1 -- 172.21.15.88:0/2927311433 wait complete. 2023-12-08T08:22:31.655 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:22:31.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.790+0000 7fb200ad6640 1 Processor -- start 2023-12-08T08:22:31.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.790+0000 7fb200ad6640 1 -- start start 2023-12-08T08:22:31.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.790+0000 7fb200ad6640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1fc0bf2d0 0x7fb1fc151970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:31.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.790+0000 7fb200ad6640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb1fc0c6030 0x7fb1fc151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:31.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.790+0000 7fb200ad6640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1fc158780 con 0x7fb1fc0c98f0 2023-12-08T08:22:31.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.790+0000 7fb200ad6640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1fc0c0300 con 0x7fb1fc0c6030 2023-12-08T08:22:31.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.790+0000 7fb200ad6640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc157b70 con 0x7fb1fc0bf2d0 2023-12-08T08:22:31.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.790+0000 7fb1fad9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb1fc0c98f0 0x7fb1fc0c7cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41346/0 (socket says 172.21.15.88:41346) 2023-12-08T08:22:31.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.790+0000 7fb1fad9d640 1 -- 172.21.15.88:0/3882964950 learned_addr learned my addr 172.21.15.88:0/3882964950 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:31.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.790+0000 7fb1f1d9b640 1 --2- 172.21.15.88:0/3882964950 >> v2:172.21.15.148:3300/0 conn(0x7fb1fc0c6030 0x7fb1fc151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:31.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.790+0000 7fb1fa59c640 1 --2- 172.21.15.88:0/3882964950 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1fc0bf2d0 0x7fb1fc151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:31.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.790+0000 7fb1f9d9b640 1 -- 172.21.15.88:0/3882964950 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984518584 0 0) 0x7fb1fc158780 con 0x7fb1fc0c98f0 2023-12-08T08:22:31.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.790+0000 7fb1f9d9b640 1 -- 172.21.15.88:0/3882964950 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1e8003530 con 0x7fb1fc0c98f0 2023-12-08T08:22:31.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.790+0000 7fb1f9d9b640 1 -- 172.21.15.88:0/3882964950 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2806649487 0 0) 0x7fb1e8003530 con 0x7fb1fc0c98f0 2023-12-08T08:22:31.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.790+0000 7fb1f9d9b640 1 -- 172.21.15.88:0/3882964950 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1fc0bf2d0 msgr2=0x7fb1fc151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:31.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.790+0000 7fb1f9d9b640 1 --2- 172.21.15.88:0/3882964950 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1fc0bf2d0 0x7fb1fc151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.790+0000 7fb1f9d9b640 1 -- 172.21.15.88:0/3882964950 >> v2:172.21.15.148:3300/0 conn(0x7fb1fc0c6030 msgr2=0x7fb1fc151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:31.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.790+0000 7fb1f9d9b640 1 --2- 172.21.15.88:0/3882964950 >> v2:172.21.15.148:3300/0 conn(0x7fb1fc0c6030 0x7fb1fc151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.790+0000 7fb1f9d9b640 1 -- 172.21.15.88:0/3882964950 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc157e50 con 0x7fb1fc0c98f0 2023-12-08T08:22:31.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.790+0000 7fb1f9d9b640 1 -- 172.21.15.88:0/3882964950 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7fb1f4001680 con 0x7fb1fc0c98f0 2023-12-08T08:22:31.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.790+0000 7fb1f9d9b640 1 -- 172.21.15.88:0/3882964950 >> v1:172.21.15.88:6789/0 conn(0x7fb1fc0c98f0 legacy=0x7fb1fc0c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:31.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.790+0000 7fb1f9d9b640 1 --2- 172.21.15.88:0/3882964950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1e8003980 0x7fb1e8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:31.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.790+0000 7fb1f9d9b640 1 --2- 172.21.15.88:0/3882964950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1e80047d0 0x7fb1e8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:31.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.790+0000 7fb1f9d9b640 1 --2- 172.21.15.88:0/3882964950 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1fc0bf2d0 0x7fb1e8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:31.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.790+0000 7fb1f9d9b640 1 -- 172.21.15.88:0/3882964950 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc157b70 con 0x7fb1e8003980 2023-12-08T08:22:31.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.790+0000 7fb1f9d9b640 1 -- 172.21.15.88:0/3882964950 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e800b990 con 0x7fb1e80047d0 2023-12-08T08:22:31.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.790+0000 7fb1f9d9b640 1 -- 172.21.15.88:0/3882964950 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e800bad0 con 0x7fb1fc0bf2d0 2023-12-08T08:22:31.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.794+0000 7fb1fa59c640 1 --2- 172.21.15.88:0/3882964950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1e8003980 0x7fb1e8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:31.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.794+0000 7fb1f1d9b640 1 --2- 172.21.15.88:0/3882964950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1e80047d0 0x7fb1e8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:31.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.794+0000 7fb1fad9d640 1 --2- 172.21.15.88:0/3882964950 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1fc0bf2d0 0x7fb1e8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:31.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.794+0000 7fb1fa59c640 1 -- 172.21.15.88:0/3882964950 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1fc0bf2d0 msgr2=0x7fb1e8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:31.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.794+0000 7fb1fa59c640 1 --2- 172.21.15.88:0/3882964950 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1fc0bf2d0 0x7fb1e8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.794+0000 7fb1fa59c640 1 -- 172.21.15.88:0/3882964950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1e80047d0 msgr2=0x7fb1e8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:31.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.794+0000 7fb1fa59c640 1 --2- 172.21.15.88:0/3882964950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1e80047d0 0x7fb1e8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.794+0000 7fb1fa59c640 1 -- 172.21.15.88:0/3882964950 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e8003530 con 0x7fb1e8003980 2023-12-08T08:22:31.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.794+0000 7fb1fa59c640 1 --2- 172.21.15.88:0/3882964950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1e8003980 0x7fb1e8003da0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec009fc0 tx=0x7fb1ec01cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be16d43321328190 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:31.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.794+0000 7fb1f9d9b640 1 -- 172.21.15.88:0/3882964950 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec0a5a50 con 0x7fb1e8003980 2023-12-08T08:22:31.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.794+0000 7fb1f9d9b640 1 -- 172.21.15.88:0/3882964950 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ec00f040 con 0x7fb1e8003980 2023-12-08T08:22:31.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.794+0000 7fb1f9d9b640 1 -- 172.21.15.88:0/3882964950 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec0a5df0 con 0x7fb1e8003980 2023-12-08T08:22:31.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.798+0000 7fb200ad6640 1 -- 172.21.15.88:0/3882964950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1e8003980 msgr2=0x7fb1e8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:31.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.798+0000 7fb200ad6640 1 --2- 172.21.15.88:0/3882964950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1e8003980 0x7fb1e8003da0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec009fc0 tx=0x7fb1ec01cc30 comp rx=0 tx=0).stop 2023-12-08T08:22:31.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.798+0000 7fb1fad9d640 1 -- 172.21.15.88:0/3882964950 reap_dead start 2023-12-08T08:22:31.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.798+0000 7fb200ad6640 1 -- 172.21.15.88:0/3882964950 shutdown_connections 2023-12-08T08:22:31.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.798+0000 7fb200ad6640 1 -- 172.21.15.88:0/3882964950 >> 172.21.15.88:0/3882964950 conn(0x7fb1fc0c9dc0 msgr2=0x7fb1fc0ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:31.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.798+0000 7fb200ad6640 1 -- 172.21.15.88:0/3882964950 shutdown_connections 2023-12-08T08:22:31.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.798+0000 7fb200ad6640 1 -- 172.21.15.88:0/3882964950 wait complete. 2023-12-08T08:22:31.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.798+0000 7fb200ad6640 1 Processor -- start 2023-12-08T08:22:31.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.798+0000 7fb200ad6640 1 -- start start 2023-12-08T08:22:31.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.798+0000 7fb200ad6640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1e8003980 0x7fb1fc1f07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:31.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.798+0000 7fb200ad6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1fc0afa90 0x7fb1fc1f0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:31.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.798+0000 7fb200ad6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1fc06c3b0 0x7fb1fc06b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:31.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.798+0000 7fb200ad6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc0af770 con 0x7fb1fc06c3b0 2023-12-08T08:22:31.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.798+0000 7fb200ad6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc0ae760 con 0x7fb1fc0afa90 2023-12-08T08:22:31.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.798+0000 7fb200ad6640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc1f1310 con 0x7fb1e8003980 2023-12-08T08:22:31.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.798+0000 7fb1fa59c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1e8003980 0x7fb1fc1f07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:31.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.798+0000 7fb1fa59c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1e8003980 0x7fb1fc1f07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:38384/0 (socket says 172.21.15.88:38384) 2023-12-08T08:22:31.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.798+0000 7fb1fad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1fc06c3b0 0x7fb1fc06b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:31.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.798+0000 7fb1fa59c640 1 -- 172.21.15.88:0/833810406 learned_addr learned my addr 172.21.15.88:0/833810406 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:31.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.798+0000 7fb1f1d9b640 1 --2- 172.21.15.88:0/833810406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1fc0afa90 0x7fb1fc1f0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:31.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.802+0000 7fb1fa59c640 1 -- 172.21.15.88:0/833810406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1fc0afa90 msgr2=0x7fb1fc1f0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:31.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.802+0000 7fb1fa59c640 1 --2- 172.21.15.88:0/833810406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1fc0afa90 0x7fb1fc1f0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.802+0000 7fb1fa59c640 1 -- 172.21.15.88:0/833810406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1fc06c3b0 msgr2=0x7fb1fc06b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:31.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.802+0000 7fb1fa59c640 1 --2- 172.21.15.88:0/833810406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1fc06c3b0 0x7fb1fc06b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.802+0000 7fb1fa59c640 1 -- 172.21.15.88:0/833810406 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc0ae480 con 0x7fb1e8003980 2023-12-08T08:22:31.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.802+0000 7fb1fad9d640 1 --2- 172.21.15.88:0/833810406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1fc06c3b0 0x7fb1fc06b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:22:31.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.802+0000 7fb1fa59c640 1 --2- 172.21.15.88:0/833810406 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1e8003980 0x7fb1fc1f07c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec01c6a0 tx=0x7fb1ec009750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:31.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.802+0000 7fb1f37fe640 1 -- 172.21.15.88:0/833810406 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec003ba0 con 0x7fb1e8003980 2023-12-08T08:22:31.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.802+0000 7fb1f37fe640 1 -- 172.21.15.88:0/833810406 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ec003d00 con 0x7fb1e8003980 2023-12-08T08:22:31.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.802+0000 7fb200ad6640 1 -- 172.21.15.88:0/833810406 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1fc0aec10 con 0x7fb1e8003980 2023-12-08T08:22:31.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.802+0000 7fb1f37fe640 1 -- 172.21.15.88:0/833810406 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec004260 con 0x7fb1e8003980 2023-12-08T08:22:31.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.802+0000 7fb200ad6640 1 -- 172.21.15.88:0/833810406 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1fc06b830 con 0x7fb1e8003980 2023-12-08T08:22:31.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.802+0000 7fb200ad6640 1 -- 172.21.15.88:0/833810406 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1fc0aea70 con 0x7fb1e8003980 2023-12-08T08:22:31.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.802+0000 7fb1f37fe640 1 -- 172.21.15.88:0/833810406 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb1ec0b4040 con 0x7fb1e8003980 2023-12-08T08:22:31.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.802+0000 7fb1f37fe640 1 --2- 172.21.15.88:0/833810406 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb1dc066470 0x7fb1dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:31.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.802+0000 7fb1f37fe640 1 -- 172.21.15.88:0/833810406 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb1ec11ea10 con 0x7fb1e8003980 2023-12-08T08:22:31.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.806+0000 7fb1f1d9b640 1 --2- 172.21.15.88:0/833810406 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb1dc066470 0x7fb1dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:31.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.806+0000 7fb1f1d9b640 1 --2- 172.21.15.88:0/833810406 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb1dc066470 0x7fb1dc068930 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0bfcd0 tx=0x7fb1e4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:31.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.806+0000 7fb1f37fe640 1 -- 172.21.15.88:0/833810406 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb1ec0ebe10 con 0x7fb1e8003980 2023-12-08T08:22:31.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.958+0000 7fb200ad6640 1 -- 172.21.15.88:0/833810406 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fb1fc0aea70 con 0x7fb1e8003980 2023-12-08T08:22:31.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.958+0000 7fb1f37fe640 1 -- 172.21.15.88:0/833810406 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v54) v1 ==== 101+0+11 (secure 0 0 0) 0x7fb1fc0aea70 con 0x7fb1e8003980 2023-12-08T08:22:31.962 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:22:31.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.958+0000 7fb200ad6640 1 -- 172.21.15.88:0/833810406 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb1dc066470 msgr2=0x7fb1dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:31.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.958+0000 7fb200ad6640 1 --2- 172.21.15.88:0/833810406 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb1dc066470 0x7fb1dc068930 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0bfcd0 tx=0x7fb1e4009190 comp rx=0 tx=0).stop 2023-12-08T08:22:31.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.958+0000 7fb200ad6640 1 -- 172.21.15.88:0/833810406 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1e8003980 msgr2=0x7fb1fc1f07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:31.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.958+0000 7fb200ad6640 1 --2- 172.21.15.88:0/833810406 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1e8003980 0x7fb1fc1f07c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec01c6a0 tx=0x7fb1ec009750 comp rx=0 tx=0).stop 2023-12-08T08:22:31.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.958+0000 7fb200ad6640 1 -- 172.21.15.88:0/833810406 shutdown_connections 2023-12-08T08:22:31.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.958+0000 7fb200ad6640 1 --2- 172.21.15.88:0/833810406 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb1dc066470 0x7fb1dc068930 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.958+0000 7fb200ad6640 1 --2- 172.21.15.88:0/833810406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1fc06c3b0 0x7fb1fc06b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.958+0000 7fb200ad6640 1 --2- 172.21.15.88:0/833810406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1fc0afa90 0x7fb1fc1f0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.958+0000 7fb200ad6640 1 --2- 172.21.15.88:0/833810406 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1e8003980 0x7fb1fc1f07c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:31.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.958+0000 7fb200ad6640 1 -- 172.21.15.88:0/833810406 >> 172.21.15.88:0/833810406 conn(0x7fb1fc0c9dc0 msgr2=0x7fb1fc1573c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:31.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.958+0000 7fb200ad6640 1 -- 172.21.15.88:0/833810406 shutdown_connections 2023-12-08T08:22:31.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:31.958+0000 7fb200ad6640 1 -- 172.21.15.88:0/833810406 wait complete. 2023-12-08T08:22:31.984 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:22:32.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.118+0000 7f203f85a640 1 Processor -- start 2023-12-08T08:22:32.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.118+0000 7f203f85a640 1 -- start start 2023-12-08T08:22:32.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.118+0000 7f203f85a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f20380c0c80 0x7f20380c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:32.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.118+0000 7f203f85a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20380a93d0 con 0x7f20380c2110 2023-12-08T08:22:32.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.118+0000 7f203f85a640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20380a9640 con 0x7f2038154390 2023-12-08T08:22:32.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.118+0000 7f203f85a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20380aa1c0 con 0x7f20380c0c80 2023-12-08T08:22:32.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.118+0000 7f203ddf7640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f20380c0c80 0x7f20380c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:32.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.118+0000 7f203cdf5640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f20380c2110 0x7f20380c5ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41348/0 (socket says 172.21.15.88:41348) 2023-12-08T08:22:32.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.118+0000 7f203cdf5640 1 -- 172.21.15.88:0/2982592361 learned_addr learned my addr 172.21.15.88:0/2982592361 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:32.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.118+0000 7f203ddf7640 1 -- 172.21.15.88:0/2982592361 >> v1:172.21.15.148:6789/0 conn(0x7f2038154390 legacy=0x7f20380c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:32.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.118+0000 7f203ddf7640 1 -- 172.21.15.88:0/2982592361 >> v1:172.21.15.88:6789/0 conn(0x7f20380c2110 legacy=0x7f20380c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:32.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.118+0000 7f203ddf7640 1 -- 172.21.15.88:0/2982592361 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20380a9920 con 0x7f20380c0c80 2023-12-08T08:22:32.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.118+0000 7f202ffff640 1 -- 172.21.15.88:0/2982592361 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185685696 0 0) 0x7f20380a93d0 con 0x7f20380c2110 2023-12-08T08:22:32.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.122+0000 7f203ddf7640 1 --2- 172.21.15.88:0/2982592361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20380c0c80 0x7f20380c63b0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f2030009d90 tx=0x7f203001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216d6320a358ee7b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:32.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.122+0000 7f202ffff640 1 -- 172.21.15.88:0/2982592361 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20300a5920 con 0x7f20380c0c80 2023-12-08T08:22:32.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.122+0000 7f202ffff640 1 -- 172.21.15.88:0/2982592361 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20300a5a80 con 0x7f20380c0c80 2023-12-08T08:22:32.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.122+0000 7f202ffff640 1 -- 172.21.15.88:0/2982592361 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20300a5e10 con 0x7f20380c0c80 2023-12-08T08:22:32.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.122+0000 7f203f85a640 1 -- 172.21.15.88:0/2982592361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20380c0c80 msgr2=0x7f20380c63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:32.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.122+0000 7f203f85a640 1 --2- 172.21.15.88:0/2982592361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20380c0c80 0x7f20380c63b0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f2030009d90 tx=0x7f203001c950 comp rx=0 tx=0).stop 2023-12-08T08:22:32.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.122+0000 7f203f85a640 1 -- 172.21.15.88:0/2982592361 shutdown_connections 2023-12-08T08:22:32.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.122+0000 7f203f85a640 1 --2- 172.21.15.88:0/2982592361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20380c0c80 0x7f20380c63b0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:32.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.122+0000 7f203f85a640 1 -- 172.21.15.88:0/2982592361 >> 172.21.15.88:0/2982592361 conn(0x7f203806b220 msgr2=0x7f20380a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:32.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.122+0000 7f203f85a640 1 -- 172.21.15.88:0/2982592361 shutdown_connections 2023-12-08T08:22:32.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.122+0000 7f203f85a640 1 -- 172.21.15.88:0/2982592361 wait complete. 2023-12-08T08:22:32.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.126+0000 7f203f85a640 1 Processor -- start 2023-12-08T08:22:32.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.126+0000 7f203f85a640 1 -- start start 2023-12-08T08:22:32.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.126+0000 7f203f85a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20380c0c80 0x7f2038149220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:32.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.126+0000 7f203f85a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20380c2110 0x7f20380a6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:32.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.126+0000 7f203f85a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2038154390 0x7f203806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:32.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.126+0000 7f203f85a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20380a5760 con 0x7f20380c0c80 2023-12-08T08:22:32.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.126+0000 7f203f85a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20380a5a00 con 0x7f2038154390 2023-12-08T08:22:32.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.126+0000 7f203f85a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20380a5ce0 con 0x7f20380c2110 2023-12-08T08:22:32.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.126+0000 7f203d5f6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20380c0c80 0x7f2038149220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:32.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.126+0000 7f203d5f6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20380c0c80 0x7f2038149220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57364/0 (socket says 172.21.15.88:57364) 2023-12-08T08:22:32.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.126+0000 7f203d5f6640 1 -- 172.21.15.88:0/807921851 learned_addr learned my addr 172.21.15.88:0/807921851 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:32.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.126+0000 7f203cdf5640 1 --2- 172.21.15.88:0/807921851 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20380c2110 0x7f20380a6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:32.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.126+0000 7f203ddf7640 1 --2- 172.21.15.88:0/807921851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2038154390 0x7f203806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:32.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.126+0000 7f203d5f6640 1 -- 172.21.15.88:0/807921851 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20380c2110 msgr2=0x7f20380a6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:32.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.126+0000 7f203d5f6640 1 --2- 172.21.15.88:0/807921851 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20380c2110 0x7f20380a6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:32.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.126+0000 7f203d5f6640 1 -- 172.21.15.88:0/807921851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2038154390 msgr2=0x7f203806fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:32.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.126+0000 7f203d5f6640 1 --2- 172.21.15.88:0/807921851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2038154390 0x7f203806fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:32.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.126+0000 7f203d5f6640 1 -- 172.21.15.88:0/807921851 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2030009a70 con 0x7f20380c0c80 2023-12-08T08:22:32.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.126+0000 7f203cdf5640 1 --2- 172.21.15.88:0/807921851 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20380c2110 0x7f20380a6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:32.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.126+0000 7f203ddf7640 1 --2- 172.21.15.88:0/807921851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2038154390 0x7f203806fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:32.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.126+0000 7f203d5f6640 1 --2- 172.21.15.88:0/807921851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20380c0c80 0x7f2038149220 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f203400c3c0 tx=0x7f203400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:32.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.126+0000 7f202dffb640 1 -- 172.21.15.88:0/807921851 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20340052d0 con 0x7f20380c0c80 2023-12-08T08:22:32.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.126+0000 7f202dffb640 1 -- 172.21.15.88:0/807921851 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2034005430 con 0x7f20380c0c80 2023-12-08T08:22:32.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.126+0000 7f202dffb640 1 -- 172.21.15.88:0/807921851 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2034003840 con 0x7f20380c0c80 2023-12-08T08:22:32.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.126+0000 7f203f85a640 1 -- 172.21.15.88:0/807921851 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20380a5fc0 con 0x7f20380c0c80 2023-12-08T08:22:32.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.126+0000 7f203f85a640 1 -- 172.21.15.88:0/807921851 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2038149760 con 0x7f20380c0c80 2023-12-08T08:22:32.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.130+0000 7f203f85a640 1 -- 172.21.15.88:0/807921851 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2038067630 con 0x7f20380c0c80 2023-12-08T08:22:32.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.130+0000 7f202dffb640 1 -- 172.21.15.88:0/807921851 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f20340039a0 con 0x7f20380c0c80 2023-12-08T08:22:32.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.130+0000 7f202dffb640 1 --2- 172.21.15.88:0/807921851 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f201c0664a0 0x7f201c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:32.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.130+0000 7f202dffb640 1 -- 172.21.15.88:0/807921851 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f20340837d0 con 0x7f20380c0c80 2023-12-08T08:22:32.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.130+0000 7f203cdf5640 1 --2- 172.21.15.88:0/807921851 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f201c0664a0 0x7f201c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:32.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.130+0000 7f203cdf5640 1 --2- 172.21.15.88:0/807921851 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f201c0664a0 0x7f201c068960 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2038151f30 tx=0x7f2028007c60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:32.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.134+0000 7f202dffb640 1 -- 172.21.15.88:0/807921851 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2034050850 con 0x7f20380c0c80 2023-12-08T08:22:32.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.294+0000 7f203f85a640 1 -- 172.21.15.88:0/807921851 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f203806cd10 con 0x7f20380c0c80 2023-12-08T08:22:32.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.294+0000 7f202dffb640 1 -- 172.21.15.88:0/807921851 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2034053e70 con 0x7f20380c0c80 2023-12-08T08:22:32.298 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-12-08T08:22:32.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.294+0000 7f203f85a640 1 -- 172.21.15.88:0/807921851 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f201c0664a0 msgr2=0x7f201c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:32.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.294+0000 7f203f85a640 1 --2- 172.21.15.88:0/807921851 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f201c0664a0 0x7f201c068960 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2038151f30 tx=0x7f2028007c60 comp rx=0 tx=0).stop 2023-12-08T08:22:32.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.294+0000 7f203f85a640 1 -- 172.21.15.88:0/807921851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20380c0c80 msgr2=0x7f2038149220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:32.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.294+0000 7f203f85a640 1 --2- 172.21.15.88:0/807921851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20380c0c80 0x7f2038149220 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f203400c3c0 tx=0x7f203400c880 comp rx=0 tx=0).stop 2023-12-08T08:22:32.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.294+0000 7f203f85a640 1 -- 172.21.15.88:0/807921851 shutdown_connections 2023-12-08T08:22:32.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.294+0000 7f203f85a640 1 --2- 172.21.15.88:0/807921851 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f201c0664a0 0x7f201c068960 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:32.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.294+0000 7f203f85a640 1 --2- 172.21.15.88:0/807921851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2038154390 0x7f203806fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:32.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.294+0000 7f203f85a640 1 --2- 172.21.15.88:0/807921851 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20380c2110 0x7f20380a6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:32.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.294+0000 7f203f85a640 1 --2- 172.21.15.88:0/807921851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20380c0c80 0x7f2038149220 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:32.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.294+0000 7f203f85a640 1 -- 172.21.15.88:0/807921851 >> 172.21.15.88:0/807921851 conn(0x7f203806b220 msgr2=0x7f2038151100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:32.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.294+0000 7f203f85a640 1 -- 172.21.15.88:0/807921851 shutdown_connections 2023-12-08T08:22:32.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.294+0000 7f203f85a640 1 -- 172.21.15.88:0/807921851 wait complete. 2023-12-08T08:22:32.319 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-08T08:22:32.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:32.319 DEBUG:teuthology.orchestra.run.smithi088:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-08T08:22:32.346 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2023-12-08T08:22:32.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:32.346 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-08T08:22:32.398 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:22:32.398 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:22:32.449 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5383 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-08T08:22:32.450 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:22:32.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.626+0000 7faa8cd80640 1 Processor -- start 2023-12-08T08:22:32.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.626+0000 7faa8cd80640 1 -- start start 2023-12-08T08:22:32.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.626+0000 7faa8cd80640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa8806d2b0 0x7faa8806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:32.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.626+0000 7faa8cd80640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faa880c3b80 0x7faa880c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:32.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.626+0000 7faa8cd80640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa8806bb80 con 0x7faa8806c020 2023-12-08T08:22:32.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.626+0000 7faa8cd80640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa880c5840 con 0x7faa880c3b80 2023-12-08T08:22:32.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.626+0000 7faa8cd80640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa881515c0 con 0x7faa8806d2b0 2023-12-08T08:22:32.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.626+0000 7faa7dd9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faa880c3b80 0x7faa880c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:32.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.626+0000 7faa86d9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7faa8806c020 0x7faa8806c4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41362/0 (socket says 172.21.15.88:41362) 2023-12-08T08:22:32.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.626+0000 7faa7dd9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faa880c3b80 0x7faa880c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57372/0 (socket says 172.21.15.88:57372) 2023-12-08T08:22:32.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.626+0000 7faa86d9d640 1 -- 172.21.15.88:0/2808174930 learned_addr learned my addr 172.21.15.88:0/2808174930 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:32.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.626+0000 7faa8659c640 1 --2- 172.21.15.88:0/2808174930 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa8806d2b0 0x7faa8806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:32.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.626+0000 7faa7dd9b640 1 -- 172.21.15.88:0/2808174930 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa8806d2b0 msgr2=0x7faa8806d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:32.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.626+0000 7faa7dd9b640 1 --2- 172.21.15.88:0/2808174930 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa8806d2b0 0x7faa8806d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:32.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.626+0000 7faa7dd9b640 1 -- 172.21.15.88:0/2808174930 >> v1:172.21.15.88:6789/0 conn(0x7faa8806c020 legacy=0x7faa8806c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:32.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.626+0000 7faa7dd9b640 1 -- 172.21.15.88:0/2808174930 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa881518a0 con 0x7faa880c3b80 2023-12-08T08:22:32.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.626+0000 7faa85d9b640 1 -- 172.21.15.88:0/2808174930 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3149120489 0 0) 0x7faa8806bb80 con 0x7faa8806c020 2023-12-08T08:22:32.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.630+0000 7faa7dd9b640 1 --2- 172.21.15.88:0/2808174930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa880c3b80 0x7faa880c5300 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7faa7000ba60 tx=0x7faa7001eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c967504c15f7790c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:32.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.630+0000 7faa85d9b640 1 -- 172.21.15.88:0/2808174930 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa700a7af0 con 0x7faa880c3b80 2023-12-08T08:22:32.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.630+0000 7faa85d9b640 1 -- 172.21.15.88:0/2808174930 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa700a7c50 con 0x7faa880c3b80 2023-12-08T08:22:32.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.630+0000 7faa85d9b640 1 -- 172.21.15.88:0/2808174930 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa700af440 con 0x7faa880c3b80 2023-12-08T08:22:32.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.630+0000 7faa8cd80640 1 -- 172.21.15.88:0/2808174930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa880c3b80 msgr2=0x7faa880c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:32.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.630+0000 7faa8cd80640 1 --2- 172.21.15.88:0/2808174930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa880c3b80 0x7faa880c5300 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7faa7000ba60 tx=0x7faa7001eb20 comp rx=0 tx=0).stop 2023-12-08T08:22:32.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.630+0000 7faa8cd80640 1 -- 172.21.15.88:0/2808174930 shutdown_connections 2023-12-08T08:22:32.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.630+0000 7faa8cd80640 1 --2- 172.21.15.88:0/2808174930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa880c3b80 0x7faa880c5300 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:32.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.630+0000 7faa8cd80640 1 --2- 172.21.15.88:0/2808174930 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa8806d2b0 0x7faa8806d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:32.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.630+0000 7faa8cd80640 1 -- 172.21.15.88:0/2808174930 >> 172.21.15.88:0/2808174930 conn(0x7faa880a7810 msgr2=0x7faa880a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:32.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.630+0000 7faa8cd80640 1 -- 172.21.15.88:0/2808174930 shutdown_connections 2023-12-08T08:22:32.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.630+0000 7faa8cd80640 1 -- 172.21.15.88:0/2808174930 wait complete. 2023-12-08T08:22:32.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.634+0000 7faa8cd80640 1 Processor -- start 2023-12-08T08:22:32.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.634+0000 7faa8cd80640 1 -- start start 2023-12-08T08:22:32.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.634+0000 7faa8cd80640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa8806c020 0x7faa88149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:32.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.634+0000 7faa8cd80640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa8806d2b0 0x7faa880a87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:32.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.634+0000 7faa8cd80640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa880c3b80 0x7faa881ed910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:32.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.634+0000 7faa8cd80640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa881ede50 con 0x7faa880c3b80 2023-12-08T08:22:32.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.634+0000 7faa8cd80640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8814f3c0 con 0x7faa8806d2b0 2023-12-08T08:22:32.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.634+0000 7faa8cd80640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8814f6a0 con 0x7faa8806c020 2023-12-08T08:22:32.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.634+0000 7faa86d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa880c3b80 0x7faa881ed910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:32.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.634+0000 7faa86d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa880c3b80 0x7faa881ed910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57388/0 (socket says 172.21.15.88:57388) 2023-12-08T08:22:32.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.634+0000 7faa86d9d640 1 -- 172.21.15.88:0/395545811 learned_addr learned my addr 172.21.15.88:0/395545811 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:32.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.634+0000 7faa8659c640 1 --2- 172.21.15.88:0/395545811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa8806c020 0x7faa88149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:32.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.634+0000 7faa7dd9b640 1 --2- 172.21.15.88:0/395545811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa8806d2b0 0x7faa880a87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:32.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.634+0000 7faa86d9d640 1 -- 172.21.15.88:0/395545811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa8806c020 msgr2=0x7faa88149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:32.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.634+0000 7faa86d9d640 1 --2- 172.21.15.88:0/395545811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa8806c020 0x7faa88149660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:32.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.634+0000 7faa86d9d640 1 -- 172.21.15.88:0/395545811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa8806d2b0 msgr2=0x7faa880a87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:32.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.634+0000 7faa86d9d640 1 --2- 172.21.15.88:0/395545811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa8806d2b0 0x7faa880a87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:32.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.634+0000 7faa86d9d640 1 -- 172.21.15.88:0/395545811 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7000b6c0 con 0x7faa880c3b80 2023-12-08T08:22:32.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.634+0000 7faa7dd9b640 1 --2- 172.21.15.88:0/395545811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa8806d2b0 0x7faa880a87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:32.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.634+0000 7faa86d9d640 1 --2- 172.21.15.88:0/395545811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa880c3b80 0x7faa881ed910 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7faa80001570 tx=0x7faa8000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:32.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.634+0000 7faa7f7fe640 1 -- 172.21.15.88:0/395545811 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8000cea0 con 0x7faa880c3b80 2023-12-08T08:22:32.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.634+0000 7faa7f7fe640 1 -- 172.21.15.88:0/395545811 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa8000a5e0 con 0x7faa880c3b80 2023-12-08T08:22:32.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.634+0000 7faa7f7fe640 1 -- 172.21.15.88:0/395545811 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8000a990 con 0x7faa880c3b80 2023-12-08T08:22:32.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.634+0000 7faa8cd80640 1 -- 172.21.15.88:0/395545811 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa8814ef80 con 0x7faa880c3b80 2023-12-08T08:22:32.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.634+0000 7faa8cd80640 1 -- 172.21.15.88:0/395545811 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8814fc60 con 0x7faa880c3b80 2023-12-08T08:22:32.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.638+0000 7faa8cd80640 1 -- 172.21.15.88:0/395545811 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa8806cb40 con 0x7faa880c3b80 2023-12-08T08:22:32.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.638+0000 7faa7f7fe640 1 -- 172.21.15.88:0/395545811 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faa8000aaf0 con 0x7faa880c3b80 2023-12-08T08:22:32.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.638+0000 7faa7f7fe640 1 --2- 172.21.15.88:0/395545811 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faa680664a0 0x7faa68068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:32.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.638+0000 7faa7f7fe640 1 -- 172.21.15.88:0/395545811 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7faa80083600 con 0x7faa880c3b80 2023-12-08T08:22:32.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.638+0000 7faa8659c640 1 --2- 172.21.15.88:0/395545811 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faa680664a0 0x7faa68068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:32.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.638+0000 7faa8659c640 1 --2- 172.21.15.88:0/395545811 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faa680664a0 0x7faa68068960 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7faa880a8010 tx=0x7faa78008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:32.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.642+0000 7faa7f7fe640 1 -- 172.21.15.88:0/395545811 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faa80050710 con 0x7faa880c3b80 2023-12-08T08:22:32.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.830+0000 7faa8cd80640 1 -- 172.21.15.88:0/395545811 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faa88067630 con 0x7faa880c3b80 2023-12-08T08:22:32.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.830+0000 7faa7f7fe640 1 -- 172.21.15.88:0/395545811 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) v1 ==== 53+0+149 (secure 0 0 0) 0x7faa800180b0 con 0x7faa880c3b80 2023-12-08T08:22:32.835 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:22:32.835 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-08T08:22:32.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.830+0000 7faa8cd80640 1 -- 172.21.15.88:0/395545811 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faa680664a0 msgr2=0x7faa68068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:32.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.830+0000 7faa8cd80640 1 --2- 172.21.15.88:0/395545811 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faa680664a0 0x7faa68068960 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7faa880a8010 tx=0x7faa78008040 comp rx=0 tx=0).stop 2023-12-08T08:22:32.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.830+0000 7faa8cd80640 1 -- 172.21.15.88:0/395545811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa880c3b80 msgr2=0x7faa881ed910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:32.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.830+0000 7faa8cd80640 1 --2- 172.21.15.88:0/395545811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa880c3b80 0x7faa881ed910 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7faa80001570 tx=0x7faa8000cc50 comp rx=0 tx=0).stop 2023-12-08T08:22:32.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.830+0000 7faa8cd80640 1 -- 172.21.15.88:0/395545811 shutdown_connections 2023-12-08T08:22:32.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.830+0000 7faa8cd80640 1 --2- 172.21.15.88:0/395545811 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faa680664a0 0x7faa68068960 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:32.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.830+0000 7faa8cd80640 1 --2- 172.21.15.88:0/395545811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa880c3b80 0x7faa881ed910 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:32.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.830+0000 7faa8cd80640 1 --2- 172.21.15.88:0/395545811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa8806d2b0 0x7faa880a87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:32.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.830+0000 7faa8cd80640 1 --2- 172.21.15.88:0/395545811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa8806c020 0x7faa88149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:32.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.830+0000 7faa8cd80640 1 -- 172.21.15.88:0/395545811 >> 172.21.15.88:0/395545811 conn(0x7faa880a7810 msgr2=0x7faa880c0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:32.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.830+0000 7faa8cd80640 1 -- 172.21.15.88:0/395545811 shutdown_connections 2023-12-08T08:22:32.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:32.830+0000 7faa8cd80640 1 -- 172.21.15.88:0/395545811 wait complete. 2023-12-08T08:22:32.856 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-08T08:22:32.856 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:22:32.856 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2023-12-08T08:22:32.856 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-08T08:22:32.856 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T08:22:32.856 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-08T08:22:32.856 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-08T08:22:32.856 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.f7hmXY9oDh 2023-12-08T08:22:32.857 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2023-12-08T08:22:32.865 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.VsLPOJdcMY 2023-12-08T08:22:32.865 DEBUG:teuthology.orchestra.run.smithi088:> sudo cp /tmp/tmp.f7hmXY9oDh /tmp/tmp.VsLPOJdcMY 2023-12-08T08:22:32.933 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.VsLPOJdcMY 2023-12-08T08:22:33.054 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.VsLPOJdcMY is 245B 2023-12-08T08:22:33.070 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.VsLPOJdcMY 2023-12-08T08:22:33.078 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQBF0nJlSEvLFxAAmepyVlOnp/++jz37PCSPvA== caps mds = "allow rw fsname=cephfs" caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-12-08T08:22:33.078 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:22:33.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:33.079 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2023-12-08T08:22:33.130 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:22:33.130 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:22:33.130 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:22:33.130 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:33.130 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-12-08T08:22:33.130 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:33.130 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:22:33.131 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:22:33.131 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2023-12-08T08:22:33.131 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:22:33.131 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:22:33.131 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2023-12-08T08:22:33.131 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:22:33.131 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2023-12-08T08:22:33.131 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:22:33.131 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2023-12-08T08:22:33.131 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-08T08:22:33.131 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42306sec preferred_lft 42306sec 2023-12-08T08:22:33.131 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2023-12-08T08:22:33.131 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:33.131 INFO:teuthology.orchestra.run.smithi088.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-08T08:22:33.131 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 02:42:cd:51:97:e3 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:22:33.132 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-08T08:22:33.132 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:33.132 INFO:teuthology.orchestra.run.smithi088.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:22:33.132 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-08T08:22:33.132 INFO:teuthology.orchestra.run.smithi088.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:22:33.132 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:33.132 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-08T08:22:33.132 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:33.132 INFO:teuthology.orchestra.run.smithi088.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:22:33.132 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:22:33.132 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-08T08:22:33.132 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:22:33.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:33.133 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:22:33.192 INFO:teuthology.orchestra.run.smithi088.stdout:1 2023-12-08T08:22:33.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:33.194 DEBUG:teuthology.orchestra.run.smithi088:> route 2023-12-08T08:22:33.248 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2023-12-08T08:22:33.248 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:22:33.248 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-08T08:22:33.248 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-08T08:22:33.248 INFO:teuthology.orchestra.run.smithi088.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-08T08:22:33.248 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-08T08:22:33.248 INFO:teuthology.orchestra.run.smithi088.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:22:33.248 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:22:33.249 INFO:teuthology.orchestra.run.smithi088.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:22:33.249 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:22:33.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:33.249 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-12-08T08:22:33.249 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-12-08T08:22:33.249 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-08T08:22:33.249 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-08T08:22:33.250 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-08T08:22:33.250 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-12-08T08:22:33.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:33.339 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-12-08T08:22:33.350 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-08T08:22:33.350 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:22:33.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:33.350 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2023-12-08T08:22:33.413 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:22:33.413 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-08T08:22:33.466 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:22:33.466 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:22:33.466 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:22:33.517 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:22:33.517 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/tmp/tmp.f7hmXY9oDh of=/dev/stdout 2023-12-08T08:22:33.569 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-12-08T08:22:33.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:33.569 DEBUG:teuthology.orchestra.run.smithi088:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQBF0nJlSEvLFxAAmepyVlOnp/++jz37PCSPvA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:22:33.668 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,secret=AQBF0nJlSEvLFxAAmepyVlOnp/++jz37PCSPvA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:22:33.668 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:22:33.668 INFO:teuthology.orchestra.run.smithi088.stdout:keyring.get_secret failed 2023-12-08T08:22:33.679 INFO:teuthology.orchestra.run.smithi088.stderr:mount.ceph: kernel BUG! 2023-12-08T08:22:33.679 INFO:teuthology.orchestra.run.smithi088.stderr:mount error 13 = Permission denied 2023-12-08T08:22:33.680 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,secret=AQBF0nJlSEvLFxAAmepyVlOnp/++jz37PCSPvA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:22:33.680 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:22:33.680 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-12-08T08:22:33.680 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: trying mount with new device syntax: testuser@681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3.cephfs2=/ 2023-12-08T08:22:33.680 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.88:3300/172.21.15.148:3300/172.21.15.148:3301" will pass to kernel 2023-12-08T08:22:33.683 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-08T08:22:33.684 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-12-08T08:22:33.684 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-08T08:22:33.684 DEBUG:teuthology.orchestra.run.smithi088:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:22:33.776 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:22:33.861 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-08T08:22:33.861 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:22:33.861 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:22:33.871 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5383 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-08T08:22:33.871 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:22:33.871 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:22:33.880 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:22:33.880 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:22:33.931 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:22:34.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.062+0000 7fb1ff17d640 1 Processor -- start 2023-12-08T08:22:34.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.062+0000 7fb1ff17d640 1 -- start start 2023-12-08T08:22:34.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.062+0000 7fb1ff17d640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb1f80c65f0 0x7fb1f80c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:34.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.066+0000 7fb1ff17d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1f80c9210 0x7fb1f815ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:34.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.066+0000 7fb1ff17d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f8151f20 con 0x7fb1f80c8200 2023-12-08T08:22:34.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.066+0000 7fb1ff17d640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f8154450 con 0x7fb1f80c65f0 2023-12-08T08:22:34.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.066+0000 7fb1ff17d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f8154710 con 0x7fb1f80c9210 2023-12-08T08:22:34.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.066+0000 7fb1fd97a640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb1f80c8200 0x7fb1f80c8b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41370/0 (socket says 172.21.15.88:41370) 2023-12-08T08:22:34.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.066+0000 7fb1fd97a640 1 -- 172.21.15.88:0/3248563187 learned_addr learned my addr 172.21.15.88:0/3248563187 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:34.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.066+0000 7fb1fe97c640 1 --2- 172.21.15.88:0/3248563187 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1f80c9210 0x7fb1f815ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:34.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.066+0000 7fb1fe17b640 1 --2- 172.21.15.88:0/3248563187 >> v2:172.21.15.148:3300/0 conn(0x7fb1f80c65f0 0x7fb1f80c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:34.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.066+0000 7fb1fd179640 1 -- 172.21.15.88:0/3248563187 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598731981 0 0) 0x7fb1f8151f20 con 0x7fb1f80c8200 2023-12-08T08:22:34.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.066+0000 7fb1fd179640 1 -- 172.21.15.88:0/3248563187 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1e4003530 con 0x7fb1f80c8200 2023-12-08T08:22:34.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.066+0000 7fb1fe97c640 1 -- 172.21.15.88:0/3248563187 >> v2:172.21.15.148:3300/0 conn(0x7fb1f80c65f0 msgr2=0x7fb1f80c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:34.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.066+0000 7fb1fe97c640 1 --2- 172.21.15.88:0/3248563187 >> v2:172.21.15.148:3300/0 conn(0x7fb1f80c65f0 0x7fb1f80c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.066+0000 7fb1fe97c640 1 -- 172.21.15.88:0/3248563187 >> v1:172.21.15.88:6789/0 conn(0x7fb1f80c8200 legacy=0x7fb1f80c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:34.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.066+0000 7fb1fd179640 1 -- 172.21.15.88:0/3248563187 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 245083896 0 0) 0x7fb1e4003530 con 0x7fb1f80c8200 2023-12-08T08:22:34.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.066+0000 7fb1fe97c640 1 -- 172.21.15.88:0/3248563187 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f81549f0 con 0x7fb1f80c9210 2023-12-08T08:22:34.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.066+0000 7fb1fe17b640 1 --2- 172.21.15.88:0/3248563187 >> v2:172.21.15.148:3300/0 conn(0x7fb1f80c65f0 0x7fb1f80c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:22:34.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.070+0000 7fb1fe97c640 1 --2- 172.21.15.88:0/3248563187 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1f80c9210 0x7fb1f815ecf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0009d90 tx=0x7fb1f001c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5f6ecfcf4a9c691 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:34.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.070+0000 7fb1fd179640 1 -- 172.21.15.88:0/3248563187 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8001680 con 0x7fb1f80c9210 2023-12-08T08:22:34.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.070+0000 7fb1fd179640 1 -- 172.21.15.88:0/3248563187 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f00a55b0 con 0x7fb1f80c9210 2023-12-08T08:22:34.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.070+0000 7fb1fd179640 1 -- 172.21.15.88:0/3248563187 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f00a5940 con 0x7fb1f80c9210 2023-12-08T08:22:34.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.070+0000 7fb1ff17d640 1 -- 172.21.15.88:0/3248563187 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1f80c9210 msgr2=0x7fb1f815ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:34.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.070+0000 7fb1ff17d640 1 --2- 172.21.15.88:0/3248563187 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1f80c9210 0x7fb1f815ecf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0009d90 tx=0x7fb1f001c7b0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.070+0000 7fb1ff17d640 1 -- 172.21.15.88:0/3248563187 shutdown_connections 2023-12-08T08:22:34.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.070+0000 7fb1ff17d640 1 --2- 172.21.15.88:0/3248563187 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1f80c9210 0x7fb1f815ecf0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.070+0000 7fb1ff17d640 1 --2- 172.21.15.88:0/3248563187 >> v2:172.21.15.148:3300/0 conn(0x7fb1f80c65f0 0x7fb1f80c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.070+0000 7fb1ff17d640 1 -- 172.21.15.88:0/3248563187 >> 172.21.15.88:0/3248563187 conn(0x7fb1f80ab730 msgr2=0x7fb1f80abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:34.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.070+0000 7fb1ff17d640 1 -- 172.21.15.88:0/3248563187 shutdown_connections 2023-12-08T08:22:34.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.070+0000 7fb1ff17d640 1 -- 172.21.15.88:0/3248563187 wait complete. 2023-12-08T08:22:34.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.070+0000 7fb1ff17d640 1 Processor -- start 2023-12-08T08:22:34.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.070+0000 7fb1ff17d640 1 -- start start 2023-12-08T08:22:34.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.074+0000 7fb1ff17d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1f80c65f0 0x7fb1f80c26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:34.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.074+0000 7fb1ff17d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f80c8200 0x7fb1f814ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:34.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.074+0000 7fb1ff17d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1f80c9210 0x7fb1f814cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:34.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.074+0000 7fb1ff17d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f814b8e0 con 0x7fb1f80c8200 2023-12-08T08:22:34.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.074+0000 7fb1ff17d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f814d5e0 con 0x7fb1f80c9210 2023-12-08T08:22:34.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.074+0000 7fb1ff17d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f814ecd0 con 0x7fb1f80c65f0 2023-12-08T08:22:34.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.074+0000 7fb1fd97a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f80c8200 0x7fb1f814ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:34.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.074+0000 7fb1fd97a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f80c8200 0x7fb1f814ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57390/0 (socket says 172.21.15.88:57390) 2023-12-08T08:22:34.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.074+0000 7fb1fd97a640 1 -- 172.21.15.88:0/1514735144 learned_addr learned my addr 172.21.15.88:0/1514735144 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:34.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.074+0000 7fb1fe17b640 1 --2- 172.21.15.88:0/1514735144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1f80c65f0 0x7fb1f80c26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:34.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.074+0000 7fb1fe97c640 1 --2- 172.21.15.88:0/1514735144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1f80c9210 0x7fb1f814cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:34.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.074+0000 7fb1fd97a640 1 -- 172.21.15.88:0/1514735144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1f80c65f0 msgr2=0x7fb1f80c26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:34.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.074+0000 7fb1fd97a640 1 --2- 172.21.15.88:0/1514735144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1f80c65f0 0x7fb1f80c26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.074+0000 7fb1fd97a640 1 -- 172.21.15.88:0/1514735144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1f80c9210 msgr2=0x7fb1f814cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:34.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.074+0000 7fb1fd97a640 1 --2- 172.21.15.88:0/1514735144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1f80c9210 0x7fb1f814cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.074+0000 7fb1fd97a640 1 -- 172.21.15.88:0/1514735144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f4009420 con 0x7fb1f80c8200 2023-12-08T08:22:34.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.074+0000 7fb1fe97c640 1 --2- 172.21.15.88:0/1514735144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1f80c9210 0x7fb1f814cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:34.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.074+0000 7fb1fd97a640 1 --2- 172.21.15.88:0/1514735144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f80c8200 0x7fb1f814ca30 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fb1e80011f0 tx=0x7fb1e800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:34.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.074+0000 7fb1eeffd640 1 -- 172.21.15.88:0/1514735144 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8005ae0 con 0x7fb1f80c8200 2023-12-08T08:22:34.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.074+0000 7fb1eeffd640 1 -- 172.21.15.88:0/1514735144 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e8005c40 con 0x7fb1f80c8200 2023-12-08T08:22:34.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.074+0000 7fb1ff17d640 1 -- 172.21.15.88:0/1514735144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f0009a70 con 0x7fb1f80c8200 2023-12-08T08:22:34.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.074+0000 7fb1eeffd640 1 -- 172.21.15.88:0/1514735144 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8007070 con 0x7fb1f80c8200 2023-12-08T08:22:34.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.074+0000 7fb1ff17d640 1 -- 172.21.15.88:0/1514735144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f80bce20 con 0x7fb1f80c8200 2023-12-08T08:22:34.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.074+0000 7fb1ff17d640 1 -- 172.21.15.88:0/1514735144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f814d800 con 0x7fb1f80c8200 2023-12-08T08:22:34.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.074+0000 7fb1eeffd640 1 -- 172.21.15.88:0/1514735144 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb1e80071d0 con 0x7fb1f80c8200 2023-12-08T08:22:34.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.078+0000 7fb1eeffd640 1 --2- 172.21.15.88:0/1514735144 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb1dc0664a0 0x7fb1dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:34.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.078+0000 7fb1eeffd640 1 -- 172.21.15.88:0/1514735144 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb1e8083df0 con 0x7fb1f80c8200 2023-12-08T08:22:34.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.078+0000 7fb1fe17b640 1 --2- 172.21.15.88:0/1514735144 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb1dc0664a0 0x7fb1dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:34.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.078+0000 7fb1fe17b640 1 --2- 172.21.15.88:0/1514735144 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb1dc0664a0 0x7fb1dc068960 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4009c50 tx=0x7fb1f4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:34.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.082+0000 7fb1eeffd640 1 -- 172.21.15.88:0/1514735144 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb1e8050f00 con 0x7fb1f80c8200 2023-12-08T08:22:34.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.230+0000 7fb1ff17d640 1 -- 172.21.15.88:0/1514735144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1f80674b0 con 0x7fb1f80c8200 2023-12-08T08:22:34.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.234+0000 7fb1eeffd640 1 -- 172.21.15.88:0/1514735144 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20256 (secure 0 0 0) 0x7fb1e8054520 con 0x7fb1f80c8200 2023-12-08T08:22:34.238 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:34.238 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":54,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:22:21.530364+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:00.520254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:01.423493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:22:17.787562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:22:18.955273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:22:34.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.234+0000 7fb1ff17d640 1 -- 172.21.15.88:0/1514735144 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb1dc0664a0 msgr2=0x7fb1dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:34.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.234+0000 7fb1ff17d640 1 --2- 172.21.15.88:0/1514735144 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb1dc0664a0 0x7fb1dc068960 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4009c50 tx=0x7fb1f4009190 comp rx=0 tx=0).stop 2023-12-08T08:22:34.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.234+0000 7fb1ff17d640 1 -- 172.21.15.88:0/1514735144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f80c8200 msgr2=0x7fb1f814ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:34.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.234+0000 7fb1ff17d640 1 --2- 172.21.15.88:0/1514735144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f80c8200 0x7fb1f814ca30 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fb1e80011f0 tx=0x7fb1e800cbe0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.234+0000 7fb1ff17d640 1 -- 172.21.15.88:0/1514735144 shutdown_connections 2023-12-08T08:22:34.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.234+0000 7fb1ff17d640 1 --2- 172.21.15.88:0/1514735144 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb1dc0664a0 0x7fb1dc068960 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.234+0000 7fb1ff17d640 1 --2- 172.21.15.88:0/1514735144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1f80c9210 0x7fb1f814cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.234+0000 7fb1ff17d640 1 --2- 172.21.15.88:0/1514735144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f80c8200 0x7fb1f814ca30 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.234+0000 7fb1ff17d640 1 --2- 172.21.15.88:0/1514735144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb1f80c65f0 0x7fb1f80c26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.234+0000 7fb1ff17d640 1 -- 172.21.15.88:0/1514735144 >> 172.21.15.88:0/1514735144 conn(0x7fb1f80ab730 msgr2=0x7fb1f8140c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:34.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.234+0000 7fb1ff17d640 1 -- 172.21.15.88:0/1514735144 shutdown_connections 2023-12-08T08:22:34.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.234+0000 7fb1ff17d640 1 -- 172.21.15.88:0/1514735144 wait complete. 2023-12-08T08:22:34.259 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:22:00.520254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:22:01.423493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:22:17.787562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:22:18.955273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:22:34.259 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:22:34.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.394+0000 7f0ac8ec9640 1 Processor -- start 2023-12-08T08:22:34.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.394+0000 7f0ac8ec9640 1 -- start start 2023-12-08T08:22:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.394+0000 7f0ac8ec9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0ac414fc30 0x7f0ac40c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.394+0000 7f0ac8ec9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac4152910 con 0x7f0ac414f850 2023-12-08T08:22:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.394+0000 7f0ac8ec9640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac4152bf0 con 0x7f0ac406d840 2023-12-08T08:22:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.394+0000 7f0ac8ec9640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac40c2240 con 0x7f0ac414fc30 2023-12-08T08:22:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.398+0000 7f0ac1d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0ac414fc30 0x7f0ac40c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.398+0000 7f0ac1d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0ac414fc30 0x7f0ac40c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57394/0 (socket says 172.21.15.88:57394) 2023-12-08T08:22:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.398+0000 7f0ac1d9b640 1 -- 172.21.15.88:0/4004576088 learned_addr learned my addr 172.21.15.88:0/4004576088 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.398+0000 7f0ac1d9b640 1 -- 172.21.15.88:0/4004576088 >> v1:172.21.15.148:6789/0 conn(0x7f0ac406d840 legacy=0x7f0ac40c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.398+0000 7f0ac1d9b640 1 -- 172.21.15.88:0/4004576088 >> v1:172.21.15.88:6789/0 conn(0x7f0ac414f850 legacy=0x7f0ac40aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.398+0000 7f0ac1d9b640 1 -- 172.21.15.88:0/4004576088 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac4152ed0 con 0x7f0ac414fc30 2023-12-08T08:22:34.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.398+0000 7f0ac1d9b640 1 --2- 172.21.15.88:0/4004576088 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ac414fc30 0x7f0ac40c3cd0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8009870 tx=0x7f0ab801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c16fec1e3044f23 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:34.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.398+0000 7f0ac159a640 1 -- 172.21.15.88:0/4004576088 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab80a9620 con 0x7f0ac414fc30 2023-12-08T08:22:34.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.398+0000 7f0ac159a640 1 -- 172.21.15.88:0/4004576088 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab80a9780 con 0x7f0ac414fc30 2023-12-08T08:22:34.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.398+0000 7f0ac159a640 1 -- 172.21.15.88:0/4004576088 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab80a9b10 con 0x7f0ac414fc30 2023-12-08T08:22:34.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.402+0000 7f0ac8ec9640 1 -- 172.21.15.88:0/4004576088 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ac414fc30 msgr2=0x7f0ac40c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:34.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.402+0000 7f0ac8ec9640 1 --2- 172.21.15.88:0/4004576088 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ac414fc30 0x7f0ac40c3cd0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8009870 tx=0x7f0ab801c540 comp rx=0 tx=0).stop 2023-12-08T08:22:34.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.402+0000 7f0ac8ec9640 1 -- 172.21.15.88:0/4004576088 shutdown_connections 2023-12-08T08:22:34.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.402+0000 7f0ac8ec9640 1 --2- 172.21.15.88:0/4004576088 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ac414fc30 0x7f0ac40c3cd0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.402+0000 7f0ac8ec9640 1 -- 172.21.15.88:0/4004576088 >> 172.21.15.88:0/4004576088 conn(0x7f0ac40c59f0 msgr2=0x7f0ac40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:34.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.402+0000 7f0ac8ec9640 1 -- 172.21.15.88:0/4004576088 shutdown_connections 2023-12-08T08:22:34.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.402+0000 7f0ac8ec9640 1 -- 172.21.15.88:0/4004576088 wait complete. 2023-12-08T08:22:34.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.402+0000 7f0ac8ec9640 1 Processor -- start 2023-12-08T08:22:34.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.402+0000 7f0ac8ec9640 1 -- start start 2023-12-08T08:22:34.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.402+0000 7f0ac8ec9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ac406d840 0x7f0ac4156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:34.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.402+0000 7f0ac8ec9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ac414f850 0x7f0ac41514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:34.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.402+0000 7f0ac8ec9640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0ac414fc30 0x7f0ac414b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:34.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.402+0000 7f0ac8ec9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac41556d0 con 0x7f0ac406d840 2023-12-08T08:22:34.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.402+0000 7f0ac8ec9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac4154ab0 con 0x7f0ac414f850 2023-12-08T08:22:34.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.402+0000 7f0ac8ec9640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac4154e70 con 0x7f0ac414fc30 2023-12-08T08:22:34.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.402+0000 7f0ac259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ac406d840 0x7f0ac4156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:34.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.402+0000 7f0ac259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ac406d840 0x7f0ac4156130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57404/0 (socket says 172.21.15.88:57404) 2023-12-08T08:22:34.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.402+0000 7f0ac259c640 1 -- 172.21.15.88:0/3047458188 learned_addr learned my addr 172.21.15.88:0/3047458188 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:34.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.402+0000 7f0ac1d9b640 1 --2- 172.21.15.88:0/3047458188 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ac414f850 0x7f0ac41514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:34.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.402+0000 7f0ac2d9d640 1 --2- 172.21.15.88:0/3047458188 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0ac414fc30 0x7f0ac414b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:34.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.406+0000 7f0ac259c640 1 -- 172.21.15.88:0/3047458188 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0ac414fc30 msgr2=0x7f0ac414b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:34.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.406+0000 7f0ac259c640 1 --2- 172.21.15.88:0/3047458188 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0ac414fc30 0x7f0ac414b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.406+0000 7f0ac259c640 1 -- 172.21.15.88:0/3047458188 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ac414f850 msgr2=0x7f0ac41514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:34.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.406+0000 7f0ac259c640 1 --2- 172.21.15.88:0/3047458188 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ac414f850 0x7f0ac41514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.406+0000 7f0ac259c640 1 -- 172.21.15.88:0/3047458188 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab80094d0 con 0x7f0ac406d840 2023-12-08T08:22:34.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.406+0000 7f0ac259c640 1 --2- 172.21.15.88:0/3047458188 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ac406d840 0x7f0ac4156130 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400c530 tx=0x7f0ab400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:34.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.406+0000 7f0ab2ffd640 1 -- 172.21.15.88:0/3047458188 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4005220 con 0x7f0ac406d840 2023-12-08T08:22:34.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.406+0000 7f0ab2ffd640 1 -- 172.21.15.88:0/3047458188 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab4005380 con 0x7f0ac406d840 2023-12-08T08:22:34.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.406+0000 7f0ab2ffd640 1 -- 172.21.15.88:0/3047458188 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4007270 con 0x7f0ac406d840 2023-12-08T08:22:34.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.406+0000 7f0ac8ec9640 1 -- 172.21.15.88:0/3047458188 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac4155df0 con 0x7f0ac406d840 2023-12-08T08:22:34.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.406+0000 7f0ac8ec9640 1 -- 172.21.15.88:0/3047458188 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac41553f0 con 0x7f0ac406d840 2023-12-08T08:22:34.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.406+0000 7f0ac8ec9640 1 -- 172.21.15.88:0/3047458188 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac4067630 con 0x7f0ac406d840 2023-12-08T08:22:34.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.406+0000 7f0ab2ffd640 1 -- 172.21.15.88:0/3047458188 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0ab40073d0 con 0x7f0ac406d840 2023-12-08T08:22:34.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.406+0000 7f0ab2ffd640 1 --2- 172.21.15.88:0/3047458188 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0aa4066470 0x7f0aa4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:34.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.406+0000 7f0ab2ffd640 1 -- 172.21.15.88:0/3047458188 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0ab4083af0 con 0x7f0ac406d840 2023-12-08T08:22:34.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.410+0000 7f0ac1d9b640 1 --2- 172.21.15.88:0/3047458188 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0aa4066470 0x7f0aa4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:34.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.410+0000 7f0ac1d9b640 1 --2- 172.21.15.88:0/3047458188 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0aa4066470 0x7f0aa4068930 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0ab80ae000 tx=0x7f0ab8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:34.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.410+0000 7f0ab2ffd640 1 -- 172.21.15.88:0/3047458188 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0ab4050c00 con 0x7f0ac406d840 2023-12-08T08:22:34.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.562+0000 7f0ac8ec9640 1 -- 172.21.15.88:0/3047458188 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0ac415dc30 con 0x7f0ac406d840 2023-12-08T08:22:34.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.562+0000 7f0ab2ffd640 1 -- 172.21.15.88:0/3047458188 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0ab4054220 con 0x7f0ac406d840 2023-12-08T08:22:34.571 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:22:34.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.566+0000 7f0ac8ec9640 1 -- 172.21.15.88:0/3047458188 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0aa4066470 msgr2=0x7f0aa4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:34.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.566+0000 7f0ac8ec9640 1 --2- 172.21.15.88:0/3047458188 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0aa4066470 0x7f0aa4068930 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0ab80ae000 tx=0x7f0ab8009040 comp rx=0 tx=0).stop 2023-12-08T08:22:34.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.566+0000 7f0ac8ec9640 1 -- 172.21.15.88:0/3047458188 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ac406d840 msgr2=0x7f0ac4156130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:34.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.566+0000 7f0ac8ec9640 1 --2- 172.21.15.88:0/3047458188 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ac406d840 0x7f0ac4156130 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400c530 tx=0x7f0ab400c9f0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.566+0000 7f0ac8ec9640 1 -- 172.21.15.88:0/3047458188 shutdown_connections 2023-12-08T08:22:34.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.566+0000 7f0ac8ec9640 1 --2- 172.21.15.88:0/3047458188 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0aa4066470 0x7f0aa4068930 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.566+0000 7f0ac8ec9640 1 --2- 172.21.15.88:0/3047458188 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f0ac414fc30 0x7f0ac414b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.566+0000 7f0ac8ec9640 1 --2- 172.21.15.88:0/3047458188 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ac414f850 0x7f0ac41514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.566+0000 7f0ac8ec9640 1 --2- 172.21.15.88:0/3047458188 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ac406d840 0x7f0ac4156130 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.566+0000 7f0ac8ec9640 1 -- 172.21.15.88:0/3047458188 >> 172.21.15.88:0/3047458188 conn(0x7f0ac40c59f0 msgr2=0x7f0ac40bed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:34.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.566+0000 7f0ac8ec9640 1 -- 172.21.15.88:0/3047458188 shutdown_connections 2023-12-08T08:22:34.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.566+0000 7f0ac8ec9640 1 -- 172.21.15.88:0/3047458188 wait complete. 2023-12-08T08:22:34.590 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:22:34.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.726+0000 7f5963079640 1 Processor -- start 2023-12-08T08:22:34.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.726+0000 7f5963079640 1 -- start start 2023-12-08T08:22:34.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.726+0000 7f5963079640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f595c14b1e0 0x7f595c0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:34.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.726+0000 7f5963079640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f595c0a4e20 con 0x7f595c0c5300 2023-12-08T08:22:34.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.726+0000 7f5963079640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f595c0a50e0 con 0x7f595c1548c0 2023-12-08T08:22:34.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.726+0000 7f5963079640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f595c0c0f00 con 0x7f595c14b1e0 2023-12-08T08:22:34.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.726+0000 7f595bfff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f595c0c5300 0x7f595c0a9c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41388/0 (socket says 172.21.15.88:41388) 2023-12-08T08:22:34.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.726+0000 7f595bfff640 1 -- 172.21.15.88:0/3144333235 learned_addr learned my addr 172.21.15.88:0/3144333235 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:34.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.730+0000 7f595b7fe640 1 -- 172.21.15.88:0/3144333235 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3011010019 0 0) 0x7f595c0a4e20 con 0x7f595c0c5300 2023-12-08T08:22:34.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.730+0000 7f595b7fe640 1 -- 172.21.15.88:0/3144333235 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f594c003530 con 0x7f595c0c5300 2023-12-08T08:22:34.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.730+0000 7f5960e15640 1 --2- 172.21.15.88:0/3144333235 >> v2:172.21.15.148:3300/0 conn(0x7f595c14b1e0 0x7f595c0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:34.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.730+0000 7f595b7fe640 1 -- 172.21.15.88:0/3144333235 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 999978994 0 0) 0x7f594c003530 con 0x7f595c0c5300 2023-12-08T08:22:34.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.730+0000 7f595b7fe640 1 -- 172.21.15.88:0/3144333235 >> v2:172.21.15.148:3300/0 conn(0x7f595c14b1e0 msgr2=0x7f595c0c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:34.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.730+0000 7f595b7fe640 1 --2- 172.21.15.88:0/3144333235 >> v2:172.21.15.148:3300/0 conn(0x7f595c14b1e0 0x7f595c0c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.730+0000 7f595b7fe640 1 -- 172.21.15.88:0/3144333235 >> v1:172.21.15.148:6789/0 conn(0x7f595c1548c0 legacy=0x7f595c154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:34.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.730+0000 7f595b7fe640 1 -- 172.21.15.88:0/3144333235 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c0c11e0 con 0x7f595c0c5300 2023-12-08T08:22:34.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.730+0000 7f595b7fe640 1 -- 172.21.15.88:0/3144333235 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f5948001680 con 0x7f595c0c5300 2023-12-08T08:22:34.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.730+0000 7f595b7fe640 1 -- 172.21.15.88:0/3144333235 >> v1:172.21.15.88:6789/0 conn(0x7f595c0c5300 legacy=0x7f595c0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:34.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.730+0000 7f595b7fe640 1 --2- 172.21.15.88:0/3144333235 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f594c003980 0x7f594c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:34.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.730+0000 7f595b7fe640 1 --2- 172.21.15.88:0/3144333235 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f594c0047d0 0x7f594c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:34.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.730+0000 7f595b7fe640 1 --2- 172.21.15.88:0/3144333235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f594c005190 0x7f594c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:34.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.730+0000 7f595b7fe640 1 -- 172.21.15.88:0/3144333235 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c0c0f00 con 0x7f594c0047d0 2023-12-08T08:22:34.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.730+0000 7f595b7fe640 1 -- 172.21.15.88:0/3144333235 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594c00c030 con 0x7f594c005190 2023-12-08T08:22:34.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.730+0000 7f595b7fe640 1 -- 172.21.15.88:0/3144333235 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f594c00c1f0 con 0x7f594c003980 2023-12-08T08:22:34.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.730+0000 7f595bfff640 1 --2- 172.21.15.88:0/3144333235 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f594c0047d0 0x7f594c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:34.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.730+0000 7f5960e15640 1 --2- 172.21.15.88:0/3144333235 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f594c003980 0x7f594c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:34.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.730+0000 7f5961616640 1 --2- 172.21.15.88:0/3144333235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f594c005190 0x7f594c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:34.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.730+0000 7f595bfff640 1 -- 172.21.15.88:0/3144333235 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f594c003980 msgr2=0x7f594c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:34.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.730+0000 7f595bfff640 1 --2- 172.21.15.88:0/3144333235 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f594c003980 0x7f594c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.730+0000 7f595bfff640 1 -- 172.21.15.88:0/3144333235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f594c005190 msgr2=0x7f594c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:34.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.730+0000 7f595bfff640 1 --2- 172.21.15.88:0/3144333235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f594c005190 0x7f594c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.730+0000 7f595bfff640 1 -- 172.21.15.88:0/3144333235 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594c003530 con 0x7f594c0047d0 2023-12-08T08:22:34.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.730+0000 7f5961616640 1 --2- 172.21.15.88:0/3144333235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f594c005190 0x7f594c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:34.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.730+0000 7f5961616640 1 -- 172.21.15.88:0/3144333235 reap_dead start 2023-12-08T08:22:34.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.734+0000 7f595bfff640 1 --2- 172.21.15.88:0/3144333235 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f594c0047d0 0x7f594c004c50 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f594800c210 tx=0x7f594801f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2312c75e3f736272 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:34.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.734+0000 7f595b7fe640 1 -- 172.21.15.88:0/3144333235 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5948005ae0 con 0x7f594c0047d0 2023-12-08T08:22:34.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.734+0000 7f595b7fe640 1 -- 172.21.15.88:0/3144333235 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59480ab070 con 0x7f594c0047d0 2023-12-08T08:22:34.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.734+0000 7f595b7fe640 1 -- 172.21.15.88:0/3144333235 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5948007070 con 0x7f594c0047d0 2023-12-08T08:22:34.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.734+0000 7f5963079640 1 -- 172.21.15.88:0/3144333235 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f594c0047d0 msgr2=0x7f594c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:34.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.734+0000 7f5963079640 1 --2- 172.21.15.88:0/3144333235 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f594c0047d0 0x7f594c004c50 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f594800c210 tx=0x7f594801f370 comp rx=0 tx=0).stop 2023-12-08T08:22:34.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.734+0000 7f5963079640 1 -- 172.21.15.88:0/3144333235 shutdown_connections 2023-12-08T08:22:34.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.734+0000 7f5963079640 1 --2- 172.21.15.88:0/3144333235 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f594c0047d0 0x7f594c004c50 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.734+0000 7f5963079640 1 -- 172.21.15.88:0/3144333235 >> 172.21.15.88:0/3144333235 conn(0x7f595c0c59f0 msgr2=0x7f595c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:34.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.734+0000 7f5963079640 1 -- 172.21.15.88:0/3144333235 shutdown_connections 2023-12-08T08:22:34.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.734+0000 7f5963079640 1 -- 172.21.15.88:0/3144333235 wait complete. 2023-12-08T08:22:34.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.734+0000 7f5963079640 1 Processor -- start 2023-12-08T08:22:34.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.734+0000 7f5963079640 1 -- start start 2023-12-08T08:22:34.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.734+0000 7f5963079640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f594c0047d0 0x7f595c1e93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:34.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.734+0000 7f5963079640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f595c0729c0 0x7f595c070f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:34.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.734+0000 7f5963079640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f595c0a6c80 0x7f595c1e5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:34.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.734+0000 7f5963079640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c1e5430 con 0x7f594c0047d0 2023-12-08T08:22:34.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.734+0000 7f5963079640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c14f1f0 con 0x7f595c0729c0 2023-12-08T08:22:34.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.734+0000 7f5963079640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f595c14f4d0 con 0x7f595c0a6c80 2023-12-08T08:22:34.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.738+0000 7f5960e15640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f594c0047d0 0x7f595c1e93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:34.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.738+0000 7f5960e15640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f594c0047d0 0x7f595c1e93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57422/0 (socket says 172.21.15.88:57422) 2023-12-08T08:22:34.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.738+0000 7f5960e15640 1 -- 172.21.15.88:0/3981241762 learned_addr learned my addr 172.21.15.88:0/3981241762 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:34.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.738+0000 7f595bfff640 1 --2- 172.21.15.88:0/3981241762 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f595c0729c0 0x7f595c070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:34.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.738+0000 7f5961616640 1 --2- 172.21.15.88:0/3981241762 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f595c0a6c80 0x7f595c1e5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:34.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.738+0000 7f5960e15640 1 -- 172.21.15.88:0/3981241762 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f595c0a6c80 msgr2=0x7f595c1e5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:34.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.738+0000 7f5960e15640 1 --2- 172.21.15.88:0/3981241762 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f595c0a6c80 0x7f595c1e5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.738+0000 7f5960e15640 1 -- 172.21.15.88:0/3981241762 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f595c0729c0 msgr2=0x7f595c070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:34.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.738+0000 7f5960e15640 1 --2- 172.21.15.88:0/3981241762 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f595c0729c0 0x7f595c070f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.738+0000 7f5960e15640 1 -- 172.21.15.88:0/3981241762 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c14f7b0 con 0x7f594c0047d0 2023-12-08T08:22:34.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.738+0000 7f5960e15640 1 --2- 172.21.15.88:0/3981241762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f594c0047d0 0x7f595c1e93b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5950011aa0 tx=0x7f5950011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:34.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.738+0000 7f59597fa640 1 -- 172.21.15.88:0/3981241762 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595000fb80 con 0x7f594c0047d0 2023-12-08T08:22:34.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.738+0000 7f59597fa640 1 -- 172.21.15.88:0/3981241762 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595000fce0 con 0x7f594c0047d0 2023-12-08T08:22:34.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.738+0000 7f59597fa640 1 -- 172.21.15.88:0/3981241762 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5950014680 con 0x7f594c0047d0 2023-12-08T08:22:34.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.738+0000 7f5963079640 1 -- 172.21.15.88:0/3981241762 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f595c1e56f0 con 0x7f594c0047d0 2023-12-08T08:22:34.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.738+0000 7f5963079640 1 -- 172.21.15.88:0/3981241762 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f595c148600 con 0x7f594c0047d0 2023-12-08T08:22:34.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.738+0000 7f5963079640 1 -- 172.21.15.88:0/3981241762 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f595c1e5930 con 0x7f594c0047d0 2023-12-08T08:22:34.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.738+0000 7f59597fa640 1 -- 172.21.15.88:0/3981241762 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f59500147e0 con 0x7f594c0047d0 2023-12-08T08:22:34.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.738+0000 7f59597fa640 1 --2- 172.21.15.88:0/3981241762 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5940066470 0x7f5940068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:34.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.742+0000 7f59597fa640 1 -- 172.21.15.88:0/3981241762 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5950084bd0 con 0x7f594c0047d0 2023-12-08T08:22:34.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.742+0000 7f595bfff640 1 --2- 172.21.15.88:0/3981241762 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5940066470 0x7f5940068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:34.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.742+0000 7f595bfff640 1 --2- 172.21.15.88:0/3981241762 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5940066470 0x7f5940068930 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f59480af000 tx=0x7f59480aa000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:34.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.742+0000 7f59597fa640 1 -- 172.21.15.88:0/3981241762 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f595c1e5930 con 0x7f594c0047d0 2023-12-08T08:22:34.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.894+0000 7f5963079640 1 -- 172.21.15.88:0/3981241762 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f595c1e5930 con 0x7f594c0047d0 2023-12-08T08:22:34.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.894+0000 7f59597fa640 1 -- 172.21.15.88:0/3981241762 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f595c1e5930 con 0x7f594c0047d0 2023-12-08T08:22:34.901 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:22:34.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.898+0000 7f5963079640 1 -- 172.21.15.88:0/3981241762 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5940066470 msgr2=0x7f5940068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:34.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.898+0000 7f5963079640 1 --2- 172.21.15.88:0/3981241762 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5940066470 0x7f5940068930 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f59480af000 tx=0x7f59480aa000 comp rx=0 tx=0).stop 2023-12-08T08:22:34.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.898+0000 7f5963079640 1 -- 172.21.15.88:0/3981241762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f594c0047d0 msgr2=0x7f595c1e93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:34.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.898+0000 7f5963079640 1 --2- 172.21.15.88:0/3981241762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f594c0047d0 0x7f595c1e93b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5950011aa0 tx=0x7f5950011f60 comp rx=0 tx=0).stop 2023-12-08T08:22:34.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.898+0000 7f5963079640 1 -- 172.21.15.88:0/3981241762 shutdown_connections 2023-12-08T08:22:34.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.898+0000 7f5963079640 1 --2- 172.21.15.88:0/3981241762 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5940066470 0x7f5940068930 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.898+0000 7f5963079640 1 --2- 172.21.15.88:0/3981241762 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f595c0a6c80 0x7f595c1e5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.898+0000 7f5963079640 1 --2- 172.21.15.88:0/3981241762 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f595c0729c0 0x7f595c070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.898+0000 7f5963079640 1 --2- 172.21.15.88:0/3981241762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f594c0047d0 0x7f595c1e93b0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:34.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.898+0000 7f5963079640 1 -- 172.21.15.88:0/3981241762 >> 172.21.15.88:0/3981241762 conn(0x7f595c0c59f0 msgr2=0x7f595c153ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:34.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.898+0000 7f5963079640 1 -- 172.21.15.88:0/3981241762 shutdown_connections 2023-12-08T08:22:34.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:34.898+0000 7f5963079640 1 -- 172.21.15.88:0/3981241762 wait complete. 2023-12-08T08:22:34.922 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:22:35.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.058+0000 7f99fd9df640 1 Processor -- start 2023-12-08T08:22:35.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.058+0000 7f99fd9df640 1 -- start start 2023-12-08T08:22:35.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.058+0000 7f99fd9df640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f99f8154f20 0x7f99f8158050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:35.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.058+0000 7f99fd9df640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99f8158590 0x7f99f815ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:35.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.058+0000 7f99fd9df640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f80c67a0 con 0x7f99f80af550 2023-12-08T08:22:35.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.058+0000 7f99fd9df640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f81553d0 con 0x7f99f8154f20 2023-12-08T08:22:35.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.058+0000 7f99fd9df640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f80af930 con 0x7f99f8158590 2023-12-08T08:22:35.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.058+0000 7f99f67fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f99f8154f20 0x7f99f8158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:35.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.058+0000 7f99f6ffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f99f80af550 0x7f99f80c4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41394/0 (socket says 172.21.15.88:41394) 2023-12-08T08:22:35.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.058+0000 7f99f6ffd640 1 -- 172.21.15.88:0/2540119944 learned_addr learned my addr 172.21.15.88:0/2540119944 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:35.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.058+0000 7f99f77fe640 1 --2- 172.21.15.88:0/2540119944 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99f8158590 0x7f99f815ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:35.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.058+0000 7f99f5ffb640 1 -- 172.21.15.88:0/2540119944 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1800553229 0 0) 0x7f99f80c67a0 con 0x7f99f80af550 2023-12-08T08:22:35.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.058+0000 7f99f5ffb640 1 -- 172.21.15.88:0/2540119944 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99e4003530 con 0x7f99f80af550 2023-12-08T08:22:35.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.058+0000 7f99f67fc640 1 -- 172.21.15.88:0/2540119944 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99f8158590 msgr2=0x7f99f815ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:35.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.058+0000 7f99f67fc640 1 --2- 172.21.15.88:0/2540119944 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99f8158590 0x7f99f815ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.058+0000 7f99f67fc640 1 -- 172.21.15.88:0/2540119944 >> v1:172.21.15.88:6789/0 conn(0x7f99f80af550 legacy=0x7f99f80c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:35.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.058+0000 7f99f67fc640 1 -- 172.21.15.88:0/2540119944 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f8158990 con 0x7f99f8154f20 2023-12-08T08:22:35.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.062+0000 7f99f67fc640 1 --2- 172.21.15.88:0/2540119944 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99f8154f20 0x7f99f8158050 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f99e00097f0 tx=0x7f99e001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec96811567931588 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:35.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.062+0000 7f99f5ffb640 1 -- 172.21.15.88:0/2540119944 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e00ab600 con 0x7f99f8154f20 2023-12-08T08:22:35.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.062+0000 7f99f5ffb640 1 -- 172.21.15.88:0/2540119944 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e00a7050 con 0x7f99f8154f20 2023-12-08T08:22:35.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.062+0000 7f99f5ffb640 1 -- 172.21.15.88:0/2540119944 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e00ab980 con 0x7f99f8154f20 2023-12-08T08:22:35.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.062+0000 7f99fd9df640 1 -- 172.21.15.88:0/2540119944 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99f8154f20 msgr2=0x7f99f8158050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:35.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.062+0000 7f99fd9df640 1 --2- 172.21.15.88:0/2540119944 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99f8154f20 0x7f99f8158050 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f99e00097f0 tx=0x7f99e001c360 comp rx=0 tx=0).stop 2023-12-08T08:22:35.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.062+0000 7f99fd9df640 1 -- 172.21.15.88:0/2540119944 shutdown_connections 2023-12-08T08:22:35.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.062+0000 7f99fd9df640 1 --2- 172.21.15.88:0/2540119944 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99f8158590 0x7f99f815ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.062+0000 7f99fd9df640 1 --2- 172.21.15.88:0/2540119944 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99f8154f20 0x7f99f8158050 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.062+0000 7f99fd9df640 1 -- 172.21.15.88:0/2540119944 >> 172.21.15.88:0/2540119944 conn(0x7f99f80668d0 msgr2=0x7f99f80ab980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:35.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.062+0000 7f99fd9df640 1 -- 172.21.15.88:0/2540119944 shutdown_connections 2023-12-08T08:22:35.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.062+0000 7f99fd9df640 1 -- 172.21.15.88:0/2540119944 wait complete. 2023-12-08T08:22:35.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.062+0000 7f99fd9df640 1 Processor -- start 2023-12-08T08:22:35.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.066+0000 7f99fd9df640 1 -- start start 2023-12-08T08:22:35.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.066+0000 7f99fd9df640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99f80af550 0x7f99f814a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:35.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.066+0000 7f99fd9df640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99f8154f20 0x7f99f814bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:35.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.066+0000 7f99fd9df640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99f8158590 0x7f99f8151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:35.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.066+0000 7f99fd9df640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f8148f00 con 0x7f99f8158590 2023-12-08T08:22:35.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.066+0000 7f99fd9df640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f814ba70 con 0x7f99f8154f20 2023-12-08T08:22:35.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.066+0000 7f99fd9df640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f814ab00 con 0x7f99f80af550 2023-12-08T08:22:35.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.066+0000 7f99f77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99f8158590 0x7f99f8151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:35.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.066+0000 7f99f6ffd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99f80af550 0x7f99f814a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:35.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.066+0000 7f99f77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99f8158590 0x7f99f8151180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57426/0 (socket says 172.21.15.88:57426) 2023-12-08T08:22:35.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.066+0000 7f99f77fe640 1 -- 172.21.15.88:0/2553227318 learned_addr learned my addr 172.21.15.88:0/2553227318 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:35.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.066+0000 7f99f67fc640 1 --2- 172.21.15.88:0/2553227318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99f8154f20 0x7f99f814bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:35.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.066+0000 7f99f77fe640 1 -- 172.21.15.88:0/2553227318 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99f80af550 msgr2=0x7f99f814a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:35.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.066+0000 7f99f77fe640 1 --2- 172.21.15.88:0/2553227318 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99f80af550 0x7f99f814a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.066+0000 7f99f77fe640 1 -- 172.21.15.88:0/2553227318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99f8154f20 msgr2=0x7f99f814bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:35.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.066+0000 7f99f77fe640 1 --2- 172.21.15.88:0/2553227318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99f8154f20 0x7f99f814bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.066+0000 7f99f77fe640 1 -- 172.21.15.88:0/2553227318 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e0009420 con 0x7f99f8158590 2023-12-08T08:22:35.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.066+0000 7f99f77fe640 1 --2- 172.21.15.88:0/2553227318 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99f8158590 0x7f99f8151180 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f99f000e7f0 tx=0x7f99f000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:35.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.066+0000 7f99effff640 1 -- 172.21.15.88:0/2553227318 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0009530 con 0x7f99f8158590 2023-12-08T08:22:35.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.066+0000 7f99effff640 1 -- 172.21.15.88:0/2553227318 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f000eea0 con 0x7f99f8158590 2023-12-08T08:22:35.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.066+0000 7f99effff640 1 -- 172.21.15.88:0/2553227318 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f000cb60 con 0x7f99f8158590 2023-12-08T08:22:35.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.066+0000 7f99fd9df640 1 -- 172.21.15.88:0/2553227318 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f814b140 con 0x7f99f8158590 2023-12-08T08:22:35.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.066+0000 7f99fd9df640 1 -- 172.21.15.88:0/2553227318 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f814b700 con 0x7f99f8158590 2023-12-08T08:22:35.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.066+0000 7f99fd9df640 1 -- 172.21.15.88:0/2553227318 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f814bc00 con 0x7f99f8158590 2023-12-08T08:22:35.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.070+0000 7f99effff640 1 -- 172.21.15.88:0/2553227318 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f99f000ccc0 con 0x7f99f8158590 2023-12-08T08:22:35.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.070+0000 7f99effff640 1 --2- 172.21.15.88:0/2553227318 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f99d8066470 0x7f99d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:35.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.070+0000 7f99effff640 1 -- 172.21.15.88:0/2553227318 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f99f0084290 con 0x7f99f8158590 2023-12-08T08:22:35.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.070+0000 7f99f6ffd640 1 --2- 172.21.15.88:0/2553227318 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f99d8066470 0x7f99d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:35.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.070+0000 7f99f6ffd640 1 --2- 172.21.15.88:0/2553227318 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f99d8066470 0x7f99d8068930 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f99e8001570 tx=0x7f99e8001aa0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:35.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.074+0000 7f99effff640 1 -- 172.21.15.88:0/2553227318 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f99f00513c0 con 0x7f99f8158590 2023-12-08T08:22:35.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.226+0000 7f99fd9df640 1 -- 172.21.15.88:0/2553227318 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f99f8067630 con 0x7f99f8158590 2023-12-08T08:22:35.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.226+0000 7f99effff640 1 -- 172.21.15.88:0/2553227318 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f99f0059e60 con 0x7f99f8158590 2023-12-08T08:22:35.231 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:22:35.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.226+0000 7f99fd9df640 1 -- 172.21.15.88:0/2553227318 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f99d8066470 msgr2=0x7f99d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:35.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.226+0000 7f99fd9df640 1 --2- 172.21.15.88:0/2553227318 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f99d8066470 0x7f99d8068930 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f99e8001570 tx=0x7f99e8001aa0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.226+0000 7f99fd9df640 1 -- 172.21.15.88:0/2553227318 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99f8158590 msgr2=0x7f99f8151180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:35.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.226+0000 7f99fd9df640 1 --2- 172.21.15.88:0/2553227318 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99f8158590 0x7f99f8151180 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f99f000e7f0 tx=0x7f99f000ecb0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.226+0000 7f99fd9df640 1 -- 172.21.15.88:0/2553227318 shutdown_connections 2023-12-08T08:22:35.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.226+0000 7f99fd9df640 1 --2- 172.21.15.88:0/2553227318 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f99d8066470 0x7f99d8068930 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.226+0000 7f99fd9df640 1 --2- 172.21.15.88:0/2553227318 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99f8158590 0x7f99f8151180 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.226+0000 7f99fd9df640 1 --2- 172.21.15.88:0/2553227318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99f8154f20 0x7f99f814bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.226+0000 7f99fd9df640 1 --2- 172.21.15.88:0/2553227318 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f99f80af550 0x7f99f814a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.226+0000 7f99fd9df640 1 -- 172.21.15.88:0/2553227318 >> 172.21.15.88:0/2553227318 conn(0x7f99f80668d0 msgr2=0x7f99f80c4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:35.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.226+0000 7f99fd9df640 1 -- 172.21.15.88:0/2553227318 shutdown_connections 2023-12-08T08:22:35.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.226+0000 7f99fd9df640 1 -- 172.21.15.88:0/2553227318 wait complete. 2023-12-08T08:22:35.251 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:22:35.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.386+0000 7fa05b879640 1 Processor -- start 2023-12-08T08:22:35.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.386+0000 7fa05b879640 1 -- start start 2023-12-08T08:22:35.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.386+0000 7fa05b879640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0540bed60 0x7fa0540bf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:35.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.386+0000 7fa05b879640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa0540c4b20 0x7fa0541585d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:35.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.386+0000 7fa05b879640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa054157b80 con 0x7fa0540a4f30 2023-12-08T08:22:35.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.386+0000 7fa05b879640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa054158b10 con 0x7fa0540c4b20 2023-12-08T08:22:35.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.386+0000 7fa05b879640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05406d6c0 con 0x7fa0540bed60 2023-12-08T08:22:35.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.386+0000 7fa059615640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0540bed60 0x7fa0540bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:35.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.386+0000 7fa059e16640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa0540c4b20 0x7fa0541585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:35.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.386+0000 7fa059615640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0540bed60 0x7fa0540bf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:38490/0 (socket says 172.21.15.88:38490) 2023-12-08T08:22:35.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.386+0000 7fa059615640 1 -- 172.21.15.88:0/3420392313 learned_addr learned my addr 172.21.15.88:0/3420392313 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:35.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.390+0000 7fa059615640 1 -- 172.21.15.88:0/3420392313 >> v2:172.21.15.148:3300/0 conn(0x7fa0540c4b20 msgr2=0x7fa0541585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:35.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.390+0000 7fa059615640 1 --2- 172.21.15.88:0/3420392313 >> v2:172.21.15.148:3300/0 conn(0x7fa0540c4b20 0x7fa0541585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.390+0000 7fa059615640 1 -- 172.21.15.88:0/3420392313 >> v1:172.21.15.148:6789/0 conn(0x7fa0540a4f30 legacy=0x7fa054154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:35.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.390+0000 7fa059615640 1 -- 172.21.15.88:0/3420392313 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05406d960 con 0x7fa0540bed60 2023-12-08T08:22:35.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.390+0000 7fa059615640 1 --2- 172.21.15.88:0/3420392313 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0540bed60 0x7fa0540bf140 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa050009870 tx=0x7fa05001c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5840d812b153199 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:35.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.390+0000 7fa04bfff640 1 -- 172.21.15.88:0/3420392313 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0500ac600 con 0x7fa0540bed60 2023-12-08T08:22:35.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.390+0000 7fa04bfff640 1 -- 172.21.15.88:0/3420392313 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0500a8050 con 0x7fa0540bed60 2023-12-08T08:22:35.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.390+0000 7fa04bfff640 1 -- 172.21.15.88:0/3420392313 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0500ac980 con 0x7fa0540bed60 2023-12-08T08:22:35.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.390+0000 7fa05b879640 1 -- 172.21.15.88:0/3420392313 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0540bed60 msgr2=0x7fa0540bf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:35.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.390+0000 7fa05b879640 1 --2- 172.21.15.88:0/3420392313 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0540bed60 0x7fa0540bf140 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa050009870 tx=0x7fa05001c4b0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.390+0000 7fa05b879640 1 -- 172.21.15.88:0/3420392313 shutdown_connections 2023-12-08T08:22:35.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.390+0000 7fa05b879640 1 --2- 172.21.15.88:0/3420392313 >> v2:172.21.15.148:3300/0 conn(0x7fa0540c4b20 0x7fa0541585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.390+0000 7fa05b879640 1 --2- 172.21.15.88:0/3420392313 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0540bed60 0x7fa0540bf140 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.394+0000 7fa05b879640 1 -- 172.21.15.88:0/3420392313 >> 172.21.15.88:0/3420392313 conn(0x7fa0540c59f0 msgr2=0x7fa0540c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:35.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.394+0000 7fa05b879640 1 -- 172.21.15.88:0/3420392313 shutdown_connections 2023-12-08T08:22:35.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.394+0000 7fa05b879640 1 -- 172.21.15.88:0/3420392313 wait complete. 2023-12-08T08:22:35.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.394+0000 7fa05b879640 1 Processor -- start 2023-12-08T08:22:35.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.394+0000 7fa05b879640 1 -- start start 2023-12-08T08:22:35.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.394+0000 7fa05b879640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0540a4f30 0x7fa0540c04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:35.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.394+0000 7fa05b879640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0540bed60 0x7fa0541ed630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:35.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.394+0000 7fa05b879640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0540c4b20 0x7fa0541edb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:35.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.394+0000 7fa05b879640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0540a8e80 con 0x7fa0540bed60 2023-12-08T08:22:35.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.394+0000 7fa05b879640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0540ab0c0 con 0x7fa0540a4f30 2023-12-08T08:22:35.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.394+0000 7fa05b879640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0541ecf50 con 0x7fa0540c4b20 2023-12-08T08:22:35.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.394+0000 7fa058e14640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0540bed60 0x7fa0541ed630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:35.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.394+0000 7fa058e14640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0540bed60 0x7fa0541ed630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57432/0 (socket says 172.21.15.88:57432) 2023-12-08T08:22:35.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.394+0000 7fa058e14640 1 -- 172.21.15.88:0/352505164 learned_addr learned my addr 172.21.15.88:0/352505164 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:35.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.394+0000 7fa059e16640 1 --2- 172.21.15.88:0/352505164 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0540c4b20 0x7fa0541edb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:35.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.394+0000 7fa059615640 1 --2- 172.21.15.88:0/352505164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0540a4f30 0x7fa0540c04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:35.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.394+0000 7fa058e14640 1 -- 172.21.15.88:0/352505164 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0540c4b20 msgr2=0x7fa0541edb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:35.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.394+0000 7fa058e14640 1 --2- 172.21.15.88:0/352505164 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0540c4b20 0x7fa0541edb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.394+0000 7fa058e14640 1 -- 172.21.15.88:0/352505164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0540a4f30 msgr2=0x7fa0540c04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:35.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.394+0000 7fa058e14640 1 --2- 172.21.15.88:0/352505164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0540a4f30 0x7fa0540c04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.394+0000 7fa058e14640 1 -- 172.21.15.88:0/352505164 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0500094d0 con 0x7fa0540bed60 2023-12-08T08:22:35.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.394+0000 7fa059615640 1 --2- 172.21.15.88:0/352505164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0540a4f30 0x7fa0540c04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:35.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.394+0000 7fa059e16640 1 --2- 172.21.15.88:0/352505164 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0540c4b20 0x7fa0541edb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:35.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.394+0000 7fa058e14640 1 --2- 172.21.15.88:0/352505164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0540bed60 0x7fa0541ed630 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fa04400c390 tx=0x7fa04400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:35.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.398+0000 7fa049ffb640 1 -- 172.21.15.88:0/352505164 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0440052d0 con 0x7fa0540bed60 2023-12-08T08:22:35.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.398+0000 7fa049ffb640 1 -- 172.21.15.88:0/352505164 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa044005430 con 0x7fa0540bed60 2023-12-08T08:22:35.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.398+0000 7fa049ffb640 1 -- 172.21.15.88:0/352505164 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa044003820 con 0x7fa0540bed60 2023-12-08T08:22:35.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.398+0000 7fa05b879640 1 -- 172.21.15.88:0/352505164 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0540c10a0 con 0x7fa0540bed60 2023-12-08T08:22:35.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.398+0000 7fa05b879640 1 -- 172.21.15.88:0/352505164 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0540ab5f0 con 0x7fa0540bed60 2023-12-08T08:22:35.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.398+0000 7fa05b879640 1 -- 172.21.15.88:0/352505164 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa054067630 con 0x7fa0540bed60 2023-12-08T08:22:35.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.398+0000 7fa049ffb640 1 -- 172.21.15.88:0/352505164 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa044003980 con 0x7fa0540bed60 2023-12-08T08:22:35.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.398+0000 7fa049ffb640 1 --2- 172.21.15.88:0/352505164 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa038066470 0x7fa038068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:35.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.398+0000 7fa049ffb640 1 -- 172.21.15.88:0/352505164 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa044083690 con 0x7fa0540bed60 2023-12-08T08:22:35.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.398+0000 7fa059615640 1 --2- 172.21.15.88:0/352505164 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa038066470 0x7fa038068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:35.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.398+0000 7fa059615640 1 --2- 172.21.15.88:0/352505164 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa038066470 0x7fa038068930 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa0500ae000 tx=0x7fa0500a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:35.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.402+0000 7fa049ffb640 1 -- 172.21.15.88:0/352505164 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa044050840 con 0x7fa0540bed60 2023-12-08T08:22:35.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.554+0000 7fa05b879640 1 -- 172.21.15.88:0/352505164 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa0540c5710 con 0x7fa0540bed60 2023-12-08T08:22:35.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.554+0000 7fa049ffb640 1 -- 172.21.15.88:0/352505164 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v54) v1 ==== 105+0+11 (secure 0 0 0) 0x7fa044053e60 con 0x7fa0540bed60 2023-12-08T08:22:35.560 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:22:35.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.558+0000 7fa05b879640 1 -- 172.21.15.88:0/352505164 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa038066470 msgr2=0x7fa038068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:35.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.558+0000 7fa05b879640 1 --2- 172.21.15.88:0/352505164 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa038066470 0x7fa038068930 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa0500ae000 tx=0x7fa0500a7000 comp rx=0 tx=0).stop 2023-12-08T08:22:35.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.558+0000 7fa05b879640 1 -- 172.21.15.88:0/352505164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0540bed60 msgr2=0x7fa0541ed630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:35.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.558+0000 7fa05b879640 1 --2- 172.21.15.88:0/352505164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0540bed60 0x7fa0541ed630 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fa04400c390 tx=0x7fa04400c850 comp rx=0 tx=0).stop 2023-12-08T08:22:35.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.558+0000 7fa05b879640 1 -- 172.21.15.88:0/352505164 shutdown_connections 2023-12-08T08:22:35.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.558+0000 7fa05b879640 1 --2- 172.21.15.88:0/352505164 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa038066470 0x7fa038068930 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.558+0000 7fa05b879640 1 --2- 172.21.15.88:0/352505164 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa0540c4b20 0x7fa0541edb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.558+0000 7fa05b879640 1 --2- 172.21.15.88:0/352505164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0540bed60 0x7fa0541ed630 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.558+0000 7fa05b879640 1 --2- 172.21.15.88:0/352505164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0540a4f30 0x7fa0540c04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.558+0000 7fa05b879640 1 -- 172.21.15.88:0/352505164 >> 172.21.15.88:0/352505164 conn(0x7fa0540c59f0 msgr2=0x7fa0540bf140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:35.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.558+0000 7fa05b879640 1 -- 172.21.15.88:0/352505164 shutdown_connections 2023-12-08T08:22:35.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.558+0000 7fa05b879640 1 -- 172.21.15.88:0/352505164 wait complete. 2023-12-08T08:22:35.581 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:22:35.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.718+0000 7f0708c17640 1 Processor -- start 2023-12-08T08:22:35.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.718+0000 7f0708c17640 1 -- start start 2023-12-08T08:22:35.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.718+0000 7f0708c17640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f070414b1e0 0x7f07040c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:35.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.718+0000 7f0708c17640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07040c5300 0x7f07040a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:35.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.718+0000 7f0708c17640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07040a4e20 con 0x7f0704151280 2023-12-08T08:22:35.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.718+0000 7f0708c17640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07041558d0 con 0x7f070414b1e0 2023-12-08T08:22:35.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.718+0000 7f0708c17640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07040a50e0 con 0x7f07040c5300 2023-12-08T08:22:35.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.718+0000 7f070259c640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f070414b1e0 0x7f07040c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:35.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.718+0000 7f06f9d9b640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07040c5300 0x7f07040a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:35.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.722+0000 7f0702d9d640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f0704151280 0x7f0704151710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:43606/0 (socket says 172.21.15.88:43606) 2023-12-08T08:22:35.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.722+0000 7f0702d9d640 1 -- 172.21.15.88:0/4243075124 learned_addr learned my addr 172.21.15.88:0/4243075124 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:35.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.722+0000 7f0701d9b640 1 -- 172.21.15.88:0/4243075124 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925576964 0 0) 0x7f07040a4e20 con 0x7f0704151280 2023-12-08T08:22:35.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.722+0000 7f06f9d9b640 1 -- 172.21.15.88:0/4243075124 >> v2:172.21.15.148:3300/0 conn(0x7f070414b1e0 msgr2=0x7f07040c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:35.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.722+0000 7f06f9d9b640 1 --2- 172.21.15.88:0/4243075124 >> v2:172.21.15.148:3300/0 conn(0x7f070414b1e0 0x7f07040c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.722+0000 7f06f9d9b640 1 -- 172.21.15.88:0/4243075124 >> v1:172.21.15.148:6789/0 conn(0x7f0704151280 legacy=0x7f0704151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:35.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.722+0000 7f06f9d9b640 1 -- 172.21.15.88:0/4243075124 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07040c0f00 con 0x7f07040c5300 2023-12-08T08:22:35.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.722+0000 7f070259c640 1 --2- 172.21.15.88:0/4243075124 >> v2:172.21.15.148:3300/0 conn(0x7f070414b1e0 0x7f07040c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:22:35.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.722+0000 7f06f9d9b640 1 --2- 172.21.15.88:0/4243075124 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07040c5300 0x7f07040a9c30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0097c0 tx=0x7f06ec01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97dd0302fe6fcf2f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:35.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.722+0000 7f0701d9b640 1 -- 172.21.15.88:0/4243075124 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec0ad640 con 0x7f07040c5300 2023-12-08T08:22:35.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.722+0000 7f0701d9b640 1 -- 172.21.15.88:0/4243075124 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec0ad7a0 con 0x7f07040c5300 2023-12-08T08:22:35.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.722+0000 7f0701d9b640 1 -- 172.21.15.88:0/4243075124 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec0adb30 con 0x7f07040c5300 2023-12-08T08:22:35.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.726+0000 7f0708c17640 1 -- 172.21.15.88:0/4243075124 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07040c5300 msgr2=0x7f07040a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:35.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.726+0000 7f0708c17640 1 --2- 172.21.15.88:0/4243075124 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07040c5300 0x7f07040a9c30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0097c0 tx=0x7f06ec01c480 comp rx=0 tx=0).stop 2023-12-08T08:22:35.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.726+0000 7f0708c17640 1 -- 172.21.15.88:0/4243075124 shutdown_connections 2023-12-08T08:22:35.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.726+0000 7f0708c17640 1 --2- 172.21.15.88:0/4243075124 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f07040c5300 0x7f07040a9c30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.726+0000 7f0708c17640 1 --2- 172.21.15.88:0/4243075124 >> v2:172.21.15.148:3300/0 conn(0x7f070414b1e0 0x7f07040c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.726+0000 7f0708c17640 1 -- 172.21.15.88:0/4243075124 >> 172.21.15.88:0/4243075124 conn(0x7f07040c59f0 msgr2=0x7f07040c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:35.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.726+0000 7f0708c17640 1 -- 172.21.15.88:0/4243075124 shutdown_connections 2023-12-08T08:22:35.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.726+0000 7f0708c17640 1 -- 172.21.15.88:0/4243075124 wait complete. 2023-12-08T08:22:35.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.726+0000 7f0708c17640 1 Processor -- start 2023-12-08T08:22:35.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.726+0000 7f0708c17640 1 -- start start 2023-12-08T08:22:35.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.726+0000 7f0708c17640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07040c5300 0x7f07040a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:35.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.726+0000 7f0708c17640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f070414b1e0 0x7f0704149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:35.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.726+0000 7f0708c17640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0704151280 0x7f0704146510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:35.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.726+0000 7f0708c17640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07040a57a0 con 0x7f0704151280 2023-12-08T08:22:35.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.726+0000 7f0708c17640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070406d6c0 con 0x7f07040c5300 2023-12-08T08:22:35.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.726+0000 7f0708c17640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07040a54c0 con 0x7f070414b1e0 2023-12-08T08:22:35.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.726+0000 7f0702d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0704151280 0x7f0704146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:35.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.726+0000 7f06f9d9b640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f070414b1e0 0x7f0704149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:35.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.726+0000 7f0702d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0704151280 0x7f0704146510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57438/0 (socket says 172.21.15.88:57438) 2023-12-08T08:22:35.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.726+0000 7f0702d9d640 1 -- 172.21.15.88:0/4082225965 learned_addr learned my addr 172.21.15.88:0/4082225965 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:35.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.726+0000 7f070259c640 1 --2- 172.21.15.88:0/4082225965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07040c5300 0x7f07040a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:35.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.730+0000 7f06f9d9b640 1 -- 172.21.15.88:0/4082225965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07040c5300 msgr2=0x7f07040a6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:35.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.730+0000 7f06f9d9b640 1 --2- 172.21.15.88:0/4082225965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07040c5300 0x7f07040a6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.730+0000 7f06f9d9b640 1 -- 172.21.15.88:0/4082225965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0704151280 msgr2=0x7f0704146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:35.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.730+0000 7f06f9d9b640 1 --2- 172.21.15.88:0/4082225965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0704151280 0x7f0704146510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.730+0000 7f06f9d9b640 1 -- 172.21.15.88:0/4082225965 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f4009a70 con 0x7f070414b1e0 2023-12-08T08:22:35.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.730+0000 7f0702d9d640 1 --2- 172.21.15.88:0/4082225965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0704151280 0x7f0704146510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:22:35.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.730+0000 7f070259c640 1 --2- 172.21.15.88:0/4082225965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07040c5300 0x7f07040a6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:22:35.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.730+0000 7f06f9d9b640 1 --2- 172.21.15.88:0/4082225965 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f070414b1e0 0x7f0704149bf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0ac000 tx=0x7f06ec019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:35.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.730+0000 7f06fb7fe640 1 -- 172.21.15.88:0/4082225965 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec0b6610 con 0x7f070414b1e0 2023-12-08T08:22:35.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.730+0000 7f06fb7fe640 1 -- 172.21.15.88:0/4082225965 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec0a6040 con 0x7f070414b1e0 2023-12-08T08:22:35.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.730+0000 7f06fb7fe640 1 -- 172.21.15.88:0/4082225965 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec0b69b0 con 0x7f070414b1e0 2023-12-08T08:22:35.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.730+0000 7f0708c17640 1 -- 172.21.15.88:0/4082225965 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ec009420 con 0x7f070414b1e0 2023-12-08T08:22:35.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.730+0000 7f0708c17640 1 -- 172.21.15.88:0/4082225965 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07040a6680 con 0x7f070414b1e0 2023-12-08T08:22:35.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.730+0000 7f0708c17640 1 -- 172.21.15.88:0/4082225965 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0704146230 con 0x7f070414b1e0 2023-12-08T08:22:35.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.730+0000 7f06fb7fe640 1 -- 172.21.15.88:0/4082225965 <== mon.2 v2:172.21.15.148:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f06ec0b4040 con 0x7f070414b1e0 2023-12-08T08:22:35.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.730+0000 7f06fb7fe640 1 --2- 172.21.15.88:0/4082225965 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f06e4066470 0x7f06e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:35.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.730+0000 7f06fb7fe640 1 -- 172.21.15.88:0/4082225965 <== mon.2 v2:172.21.15.148:3301/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f06ec11e390 con 0x7f070414b1e0 2023-12-08T08:22:35.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.730+0000 7f070259c640 1 --2- 172.21.15.88:0/4082225965 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f06e4066470 0x7f06e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:35.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.734+0000 7f070259c640 1 --2- 172.21.15.88:0/4082225965 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f06e4066470 0x7f06e4068930 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f06f4009fd0 tx=0x7f06f400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:35.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.738+0000 7f06fb7fe640 1 -- 172.21.15.88:0/4082225965 <== mon.2 v2:172.21.15.148:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0704146230 con 0x7f070414b1e0 2023-12-08T08:22:35.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.886+0000 7f0708c17640 1 -- 172.21.15.88:0/4082225965 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f0704146230 con 0x7f070414b1e0 2023-12-08T08:22:35.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.886+0000 7f06fb7fe640 1 -- 172.21.15.88:0/4082225965 <== mon.2 v2:172.21.15.148:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v54) v1 ==== 101+0+11 (secure 0 0 0) 0x7f0704146230 con 0x7f070414b1e0 2023-12-08T08:22:35.892 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:22:35.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.890+0000 7f0708c17640 1 -- 172.21.15.88:0/4082225965 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f06e4066470 msgr2=0x7f06e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:35.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.890+0000 7f0708c17640 1 --2- 172.21.15.88:0/4082225965 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f06e4066470 0x7f06e4068930 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f06f4009fd0 tx=0x7f06f400b040 comp rx=0 tx=0).stop 2023-12-08T08:22:35.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.890+0000 7f0708c17640 1 -- 172.21.15.88:0/4082225965 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f070414b1e0 msgr2=0x7f0704149bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:35.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.890+0000 7f0708c17640 1 --2- 172.21.15.88:0/4082225965 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f070414b1e0 0x7f0704149bf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0ac000 tx=0x7f06ec019220 comp rx=0 tx=0).stop 2023-12-08T08:22:35.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.890+0000 7f0708c17640 1 -- 172.21.15.88:0/4082225965 shutdown_connections 2023-12-08T08:22:35.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.890+0000 7f0708c17640 1 --2- 172.21.15.88:0/4082225965 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f06e4066470 0x7f06e4068930 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.890+0000 7f0708c17640 1 --2- 172.21.15.88:0/4082225965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0704151280 0x7f0704146510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.890+0000 7f0708c17640 1 --2- 172.21.15.88:0/4082225965 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f070414b1e0 0x7f0704149bf0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.890+0000 7f0708c17640 1 --2- 172.21.15.88:0/4082225965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07040c5300 0x7f07040a6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:35.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.890+0000 7f0708c17640 1 -- 172.21.15.88:0/4082225965 >> 172.21.15.88:0/4082225965 conn(0x7f07040c59f0 msgr2=0x7f07040bf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:35.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.890+0000 7f0708c17640 1 -- 172.21.15.88:0/4082225965 shutdown_connections 2023-12-08T08:22:35.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:35.890+0000 7f0708c17640 1 -- 172.21.15.88:0/4082225965 wait complete. 2023-12-08T08:22:35.913 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:22:36.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.046+0000 7fb86c09a640 1 Processor -- start 2023-12-08T08:22:36.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.046+0000 7fb86c09a640 1 -- start start 2023-12-08T08:22:36.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.046+0000 7fb86c09a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8640a4f90 0x7fb8640c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:36.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.046+0000 7fb86c09a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb8640a5370 0x7fb86414f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:36.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.046+0000 7fb86c09a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb864072810 0x7fb86414fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:36.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.046+0000 7fb86c09a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8641524b0 con 0x7fb8640a4f90 2023-12-08T08:22:36.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.046+0000 7fb86c09a640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8640c62f0 con 0x7fb8640a5370 2023-12-08T08:22:36.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.046+0000 7fb86c09a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb864152770 con 0x7fb864072810 2023-12-08T08:22:36.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.046+0000 7fb869e36640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8640a4f90 0x7fb8640c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:36.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.046+0000 7fb869e36640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8640a4f90 0x7fb8640c59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57442/0 (socket says 172.21.15.88:57442) 2023-12-08T08:22:36.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.046+0000 7fb869e36640 1 -- 172.21.15.88:0/320584202 learned_addr learned my addr 172.21.15.88:0/320584202 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:36.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.050+0000 7fb86a637640 1 --2- 172.21.15.88:0/320584202 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb864072810 0x7fb86414fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:36.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.050+0000 7fb869635640 1 --2- 172.21.15.88:0/320584202 >> v2:172.21.15.148:3300/0 conn(0x7fb8640a5370 0x7fb86414f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:36.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.050+0000 7fb869e36640 1 -- 172.21.15.88:0/320584202 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb864072810 msgr2=0x7fb86414fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:36.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.050+0000 7fb869e36640 1 --2- 172.21.15.88:0/320584202 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb864072810 0x7fb86414fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:36.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.050+0000 7fb869e36640 1 -- 172.21.15.88:0/320584202 >> v2:172.21.15.148:3300/0 conn(0x7fb8640a5370 msgr2=0x7fb86414f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:36.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.050+0000 7fb869e36640 1 --2- 172.21.15.88:0/320584202 >> v2:172.21.15.148:3300/0 conn(0x7fb8640a5370 0x7fb86414f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:36.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.050+0000 7fb869e36640 1 -- 172.21.15.88:0/320584202 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb864152a50 con 0x7fb8640a4f90 2023-12-08T08:22:36.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.050+0000 7fb869e36640 1 --2- 172.21.15.88:0/320584202 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8640a4f90 0x7fb8640c59c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb8640c6a60 tx=0x7fb86001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c83a1e6b9e777ae server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:36.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.050+0000 7fb868e34640 1 -- 172.21.15.88:0/320584202 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8600ab600 con 0x7fb8640a4f90 2023-12-08T08:22:36.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.050+0000 7fb868e34640 1 -- 172.21.15.88:0/320584202 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8600a7050 con 0x7fb8640a4f90 2023-12-08T08:22:36.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.050+0000 7fb868e34640 1 -- 172.21.15.88:0/320584202 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8600ab980 con 0x7fb8640a4f90 2023-12-08T08:22:36.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb86c09a640 1 -- 172.21.15.88:0/320584202 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8640a4f90 msgr2=0x7fb8640c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:36.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb86c09a640 1 --2- 172.21.15.88:0/320584202 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8640a4f90 0x7fb8640c59c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb8640c6a60 tx=0x7fb86001c470 comp rx=0 tx=0).stop 2023-12-08T08:22:36.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb86c09a640 1 -- 172.21.15.88:0/320584202 shutdown_connections 2023-12-08T08:22:36.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb86c09a640 1 --2- 172.21.15.88:0/320584202 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb864072810 0x7fb86414fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:36.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb86c09a640 1 --2- 172.21.15.88:0/320584202 >> v2:172.21.15.148:3300/0 conn(0x7fb8640a5370 0x7fb86414f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:36.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb86c09a640 1 --2- 172.21.15.88:0/320584202 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8640a4f90 0x7fb8640c59c0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:36.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb86c09a640 1 -- 172.21.15.88:0/320584202 >> 172.21.15.88:0/320584202 conn(0x7fb86406b220 msgr2=0x7fb8640a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:36.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb86c09a640 1 -- 172.21.15.88:0/320584202 shutdown_connections 2023-12-08T08:22:36.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb86c09a640 1 -- 172.21.15.88:0/320584202 wait complete. 2023-12-08T08:22:36.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb86c09a640 1 Processor -- start 2023-12-08T08:22:36.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb86c09a640 1 -- start start 2023-12-08T08:22:36.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb86c09a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb864072810 0x7fb864070c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:36.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb86c09a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8640a4f90 0x7fb864151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:36.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb86c09a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8640a5370 0x7fb864151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:36.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb86c09a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8641ebf80 con 0x7fb8640a5370 2023-12-08T08:22:36.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb86c09a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8641511b0 con 0x7fb8640a4f90 2023-12-08T08:22:36.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb86c09a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb864071550 con 0x7fb864072810 2023-12-08T08:22:36.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb86a637640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8640a5370 0x7fb864151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:36.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb86a637640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8640a5370 0x7fb864151b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57448/0 (socket says 172.21.15.88:57448) 2023-12-08T08:22:36.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb86a637640 1 -- 172.21.15.88:0/1523029089 learned_addr learned my addr 172.21.15.88:0/1523029089 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:36.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb869e36640 1 --2- 172.21.15.88:0/1523029089 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb864072810 0x7fb864070c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:36.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb869635640 1 --2- 172.21.15.88:0/1523029089 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8640a4f90 0x7fb864151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:36.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb86a637640 1 -- 172.21.15.88:0/1523029089 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb864072810 msgr2=0x7fb864070c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:36.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb86a637640 1 --2- 172.21.15.88:0/1523029089 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb864072810 0x7fb864070c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:36.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb86a637640 1 -- 172.21.15.88:0/1523029089 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8640a4f90 msgr2=0x7fb864151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:36.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb86a637640 1 --2- 172.21.15.88:0/1523029089 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8640a4f90 0x7fb864151640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:36.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb86a637640 1 -- 172.21.15.88:0/1523029089 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8600094d0 con 0x7fb8640a5370 2023-12-08T08:22:36.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.054+0000 7fb86a637640 1 --2- 172.21.15.88:0/1523029089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8640a5370 0x7fb864151b80 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009e30 tx=0x7fb85c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:36.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.058+0000 7fb85a7fc640 1 -- 172.21.15.88:0/1523029089 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c009ca0 con 0x7fb8640a5370 2023-12-08T08:22:36.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.058+0000 7fb85a7fc640 1 -- 172.21.15.88:0/1523029089 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c00f040 con 0x7fb8640a5370 2023-12-08T08:22:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.058+0000 7fb85a7fc640 1 -- 172.21.15.88:0/1523029089 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c0146c0 con 0x7fb8640a5370 2023-12-08T08:22:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.058+0000 7fb86c09a640 1 -- 172.21.15.88:0/1523029089 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8641eb320 con 0x7fb8640a5370 2023-12-08T08:22:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.058+0000 7fb86c09a640 1 -- 172.21.15.88:0/1523029089 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8641eafd0 con 0x7fb8640a5370 2023-12-08T08:22:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.058+0000 7fb86c09a640 1 -- 172.21.15.88:0/1523029089 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8640721d0 con 0x7fb8640a5370 2023-12-08T08:22:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.058+0000 7fb85a7fc640 1 -- 172.21.15.88:0/1523029089 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb85c014820 con 0x7fb8640a5370 2023-12-08T08:22:36.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.058+0000 7fb85a7fc640 1 --2- 172.21.15.88:0/1523029089 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb8480664a0 0x7fb848068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:36.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.058+0000 7fb85a7fc640 1 -- 172.21.15.88:0/1523029089 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb85c084f50 con 0x7fb8640a5370 2023-12-08T08:22:36.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.058+0000 7fb869e36640 1 --2- 172.21.15.88:0/1523029089 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb8480664a0 0x7fb848068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:36.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.058+0000 7fb869e36640 1 --2- 172.21.15.88:0/1523029089 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb8480664a0 0x7fb848068960 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb8600ad000 tx=0x7fb860008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:36.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.062+0000 7fb85a7fc640 1 -- 172.21.15.88:0/1523029089 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb85c052110 con 0x7fb8640a5370 2023-12-08T08:22:36.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.226+0000 7fb86c09a640 1 -- 172.21.15.88:0/1523029089 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb864067630 con 0x7fb8640a5370 2023-12-08T08:22:36.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.226+0000 7fb85a7fc640 1 -- 172.21.15.88:0/1523029089 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb85c018080 con 0x7fb8640a5370 2023-12-08T08:22:36.231 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-12-08T08:22:36.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.230+0000 7fb86c09a640 1 -- 172.21.15.88:0/1523029089 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb8480664a0 msgr2=0x7fb848068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:36.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.230+0000 7fb86c09a640 1 --2- 172.21.15.88:0/1523029089 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb8480664a0 0x7fb848068960 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb8600ad000 tx=0x7fb860008040 comp rx=0 tx=0).stop 2023-12-08T08:22:36.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.230+0000 7fb86c09a640 1 -- 172.21.15.88:0/1523029089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8640a5370 msgr2=0x7fb864151b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:36.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.230+0000 7fb86c09a640 1 --2- 172.21.15.88:0/1523029089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8640a5370 0x7fb864151b80 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009e30 tx=0x7fb85c00c490 comp rx=0 tx=0).stop 2023-12-08T08:22:36.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.230+0000 7fb86c09a640 1 -- 172.21.15.88:0/1523029089 shutdown_connections 2023-12-08T08:22:36.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.230+0000 7fb86c09a640 1 --2- 172.21.15.88:0/1523029089 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb8480664a0 0x7fb848068960 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:36.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.230+0000 7fb86c09a640 1 --2- 172.21.15.88:0/1523029089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8640a5370 0x7fb864151b80 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:36.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.230+0000 7fb86c09a640 1 --2- 172.21.15.88:0/1523029089 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8640a4f90 0x7fb864151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:36.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.230+0000 7fb86c09a640 1 --2- 172.21.15.88:0/1523029089 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb864072810 0x7fb864070c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:36.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.230+0000 7fb86c09a640 1 -- 172.21.15.88:0/1523029089 >> 172.21.15.88:0/1523029089 conn(0x7fb86406b220 msgr2=0x7fb8640a77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:36.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.230+0000 7fb86c09a640 1 -- 172.21.15.88:0/1523029089 shutdown_connections 2023-12-08T08:22:36.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.230+0000 7fb86c09a640 1 -- 172.21.15.88:0/1523029089 wait complete. 2023-12-08T08:22:36.252 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-08T08:22:36.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:36.252 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-08T08:22:36.283 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-12-08T08:22:36.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:22:36.283 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-08T08:22:36.336 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:22:36.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.466+0000 7fee24bc1640 1 Processor -- start 2023-12-08T08:22:36.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.466+0000 7fee24bc1640 1 -- start start 2023-12-08T08:22:36.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.470+0000 7fee24bc1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee2006d890 0x7fee20154610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:36.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.470+0000 7fee24bc1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fee20154b50 0x7fee2015ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:36.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.470+0000 7fee24bc1640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee20158a40 con 0x7fee20151bf0 2023-12-08T08:22:36.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.470+0000 7fee24bc1640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee201584c0 con 0x7fee20154b50 2023-12-08T08:22:36.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.470+0000 7fee24bc1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee20158760 con 0x7fee2006d890 2023-12-08T08:22:36.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.470+0000 7fee1ed9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fee20154b50 0x7fee2015ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:36.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.470+0000 7fee1ed9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fee20154b50 0x7fee2015ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57452/0 (socket says 172.21.15.88:57452) 2023-12-08T08:22:36.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.470+0000 7fee1ed9d640 1 -- 172.21.15.88:0/3888854411 learned_addr learned my addr 172.21.15.88:0/3888854411 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:36.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.470+0000 7fee1ed9d640 1 -- 172.21.15.88:0/3888854411 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee2006d890 msgr2=0x7fee20154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:36.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.470+0000 7fee1dd9b640 1 --2- 172.21.15.88:0/3888854411 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee2006d890 0x7fee20154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:36.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.470+0000 7fee1ed9d640 1 --2- 172.21.15.88:0/3888854411 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee2006d890 0x7fee20154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:36.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.470+0000 7fee1ed9d640 1 -- 172.21.15.88:0/3888854411 >> v1:172.21.15.148:6789/0 conn(0x7fee20151bf0 legacy=0x7fee2006b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:36.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.470+0000 7fee1ed9d640 1 -- 172.21.15.88:0/3888854411 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee200c0ce0 con 0x7fee20154b50 2023-12-08T08:22:36.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.470+0000 7fee1dd9b640 1 --2- 172.21.15.88:0/3888854411 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee2006d890 0x7fee20154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:36.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.474+0000 7fee1ed9d640 1 --2- 172.21.15.88:0/3888854411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee20154b50 0x7fee2015ee90 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fee18009e50 tx=0x7fee1801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3d76135b338134 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:36.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.474+0000 7fee1d59a640 1 -- 172.21.15.88:0/3888854411 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee180a5820 con 0x7fee20154b50 2023-12-08T08:22:36.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.474+0000 7fee1d59a640 1 -- 172.21.15.88:0/3888854411 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee180a5980 con 0x7fee20154b50 2023-12-08T08:22:36.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.474+0000 7fee1d59a640 1 -- 172.21.15.88:0/3888854411 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee180a5d10 con 0x7fee20154b50 2023-12-08T08:22:36.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.474+0000 7fee24bc1640 1 -- 172.21.15.88:0/3888854411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee20154b50 msgr2=0x7fee2015ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:36.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.474+0000 7fee24bc1640 1 --2- 172.21.15.88:0/3888854411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee20154b50 0x7fee2015ee90 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fee18009e50 tx=0x7fee1801c9a0 comp rx=0 tx=0).stop 2023-12-08T08:22:36.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.474+0000 7fee24bc1640 1 -- 172.21.15.88:0/3888854411 shutdown_connections 2023-12-08T08:22:36.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.474+0000 7fee24bc1640 1 --2- 172.21.15.88:0/3888854411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee20154b50 0x7fee2015ee90 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:36.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.474+0000 7fee24bc1640 1 --2- 172.21.15.88:0/3888854411 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee2006d890 0x7fee20154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:36.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.474+0000 7fee24bc1640 1 -- 172.21.15.88:0/3888854411 >> 172.21.15.88:0/3888854411 conn(0x7fee200c61f0 msgr2=0x7fee200c6600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:36.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.474+0000 7fee24bc1640 1 -- 172.21.15.88:0/3888854411 shutdown_connections 2023-12-08T08:22:36.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.474+0000 7fee24bc1640 1 -- 172.21.15.88:0/3888854411 wait complete. 2023-12-08T08:22:36.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.474+0000 7fee24bc1640 1 Processor -- start 2023-12-08T08:22:36.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.474+0000 7fee24bc1640 1 -- start start 2023-12-08T08:22:36.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.478+0000 7fee24bc1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee2006d890 0x7fee200c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:36.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.478+0000 7fee24bc1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee20151bf0 0x7fee200c5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:36.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.478+0000 7fee24bc1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee20154b50 0x7fee20142930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:36.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.478+0000 7fee24bc1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee20155f40 con 0x7fee2006d890 2023-12-08T08:22:36.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.478+0000 7fee24bc1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee200c4c20 con 0x7fee20154b50 2023-12-08T08:22:36.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.478+0000 7fee24bc1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee201edaf0 con 0x7fee20151bf0 2023-12-08T08:22:36.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.478+0000 7fee1e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee2006d890 0x7fee200c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:36.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.478+0000 7fee1e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee2006d890 0x7fee200c46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57466/0 (socket says 172.21.15.88:57466) 2023-12-08T08:22:36.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.478+0000 7fee1e59c640 1 -- 172.21.15.88:0/2395581471 learned_addr learned my addr 172.21.15.88:0/2395581471 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:36.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.478+0000 7fee1dd9b640 1 --2- 172.21.15.88:0/2395581471 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee20151bf0 0x7fee200c5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:36.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.478+0000 7fee1ed9d640 1 --2- 172.21.15.88:0/2395581471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee20154b50 0x7fee20142930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:36.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.478+0000 7fee1e59c640 1 -- 172.21.15.88:0/2395581471 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee20151bf0 msgr2=0x7fee200c5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:36.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.478+0000 7fee1e59c640 1 --2- 172.21.15.88:0/2395581471 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee20151bf0 0x7fee200c5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:36.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.478+0000 7fee1e59c640 1 -- 172.21.15.88:0/2395581471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee20154b50 msgr2=0x7fee20142930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:36.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.478+0000 7fee1e59c640 1 --2- 172.21.15.88:0/2395581471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee20154b50 0x7fee20142930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:36.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.478+0000 7fee1e59c640 1 -- 172.21.15.88:0/2395581471 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee18009b30 con 0x7fee2006d890 2023-12-08T08:22:36.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.478+0000 7fee1ed9d640 1 --2- 172.21.15.88:0/2395581471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee20154b50 0x7fee20142930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:36.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.478+0000 7fee1e59c640 1 --2- 172.21.15.88:0/2395581471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee2006d890 0x7fee200c46e0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fee1000b440 tx=0x7fee1000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:36.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.478+0000 7fee0effd640 1 -- 172.21.15.88:0/2395581471 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee10011890 con 0x7fee2006d890 2023-12-08T08:22:36.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.478+0000 7fee0effd640 1 -- 172.21.15.88:0/2395581471 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee100119f0 con 0x7fee2006d890 2023-12-08T08:22:36.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.478+0000 7fee24bc1640 1 -- 172.21.15.88:0/2395581471 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee201561e0 con 0x7fee2006d890 2023-12-08T08:22:36.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.478+0000 7fee0effd640 1 -- 172.21.15.88:0/2395581471 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee10011da0 con 0x7fee2006d890 2023-12-08T08:22:36.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.478+0000 7fee24bc1640 1 -- 172.21.15.88:0/2395581471 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee200c4400 con 0x7fee2006d890 2023-12-08T08:22:36.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.478+0000 7fee24bc1640 1 -- 172.21.15.88:0/2395581471 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee20067630 con 0x7fee2006d890 2023-12-08T08:22:36.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.478+0000 7fee0effd640 1 -- 172.21.15.88:0/2395581471 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fee1001a400 con 0x7fee2006d890 2023-12-08T08:22:36.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.482+0000 7fee0effd640 1 --2- 172.21.15.88:0/2395581471 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fee00066470 0x7fee00068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:36.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.482+0000 7fee0effd640 1 -- 172.21.15.88:0/2395581471 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fee10084290 con 0x7fee2006d890 2023-12-08T08:22:36.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.482+0000 7fee1dd9b640 1 --2- 172.21.15.88:0/2395581471 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fee00066470 0x7fee00068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:36.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.482+0000 7fee1dd9b640 1 --2- 172.21.15.88:0/2395581471 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fee00066470 0x7fee00068930 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fee14006fd0 tx=0x7fee14008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:36.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.486+0000 7fee0effd640 1 -- 172.21.15.88:0/2395581471 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fee100513a0 con 0x7fee2006d890 2023-12-08T08:22:36.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.670+0000 7fee24bc1640 1 -- 172.21.15.88:0/2395581471 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee2015eef0 con 0x7fee2006d890 2023-12-08T08:22:36.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.670+0000 7fee0effd640 1 -- 172.21.15.88:0/2395581471 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6135 (secure 0 0 0) 0x7fee100549c0 con 0x7fee2006d890 2023-12-08T08:22:36.675 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:36.676 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5240,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/2576328340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2576328340},{"type":"v1","addr":"172.21.15.148:6834","nonce":2576328340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5626,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/1685449423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1685449423},{"type":"v1","addr":"172.21.15.88:6836","nonce":1685449423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:22:02.420431+0000","modified":"2023-12-08T08:22:05.454472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5793},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5793":{"gid":5793,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/4167133153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":4167133153},{"type":"v1","addr":"172.21.15.88:6837","nonce":4167133153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:22:19.959416+0000","modified":"2023-12-08T08:22:22.972913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5635},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5635":{"gid":5635,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":7,"addr":"172.21.15.148:6835/604820378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":604820378},{"type":"v1","addr":"172.21.15.148:6835","nonce":604820378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-08T08:22:36.676 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 37 2023-12-08T08:22:36.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.670+0000 7fee24bc1640 1 -- 172.21.15.88:0/2395581471 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fee00066470 msgr2=0x7fee00068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:36.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.670+0000 7fee24bc1640 1 --2- 172.21.15.88:0/2395581471 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fee00066470 0x7fee00068930 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fee14006fd0 tx=0x7fee14008040 comp rx=0 tx=0).stop 2023-12-08T08:22:36.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.670+0000 7fee24bc1640 1 -- 172.21.15.88:0/2395581471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee2006d890 msgr2=0x7fee200c46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:36.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.670+0000 7fee24bc1640 1 --2- 172.21.15.88:0/2395581471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee2006d890 0x7fee200c46e0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fee1000b440 tx=0x7fee1000b900 comp rx=0 tx=0).stop 2023-12-08T08:22:36.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.674+0000 7fee24bc1640 1 -- 172.21.15.88:0/2395581471 shutdown_connections 2023-12-08T08:22:36.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.674+0000 7fee24bc1640 1 --2- 172.21.15.88:0/2395581471 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fee00066470 0x7fee00068930 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:36.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.674+0000 7fee24bc1640 1 --2- 172.21.15.88:0/2395581471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee20154b50 0x7fee20142930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:36.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.674+0000 7fee24bc1640 1 --2- 172.21.15.88:0/2395581471 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fee20151bf0 0x7fee200c5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:36.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.674+0000 7fee24bc1640 1 --2- 172.21.15.88:0/2395581471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee2006d890 0x7fee200c46e0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:36.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.674+0000 7fee24bc1640 1 -- 172.21.15.88:0/2395581471 >> 172.21.15.88:0/2395581471 conn(0x7fee200c61f0 msgr2=0x7fee2014fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:36.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.674+0000 7fee24bc1640 1 -- 172.21.15.88:0/2395581471 shutdown_connections 2023-12-08T08:22:36.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.674+0000 7fee24bc1640 1 -- 172.21.15.88:0/2395581471 wait complete. 2023-12-08T08:22:36.696 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:22:36.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.830+0000 7f2decd72640 1 Processor -- start 2023-12-08T08:22:36.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.830+0000 7f2decd72640 1 -- start start 2023-12-08T08:22:36.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.830+0000 7f2decd72640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2de806d2b0 0x7f2de806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:36.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.830+0000 7f2decd72640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2de80c3b80 0x7f2de80c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:36.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.830+0000 7f2decd72640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de806bb80 con 0x7f2de806c020 2023-12-08T08:22:36.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.830+0000 7f2decd72640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de80c5840 con 0x7f2de806d2b0 2023-12-08T08:22:36.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.830+0000 7f2decd72640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de81515c0 con 0x7f2de80c3b80 2023-12-08T08:22:36.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.830+0000 7f2de659c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2de806d2b0 0x7f2de806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:36.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.830+0000 7f2de659c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2de806d2b0 0x7f2de806d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57468/0 (socket says 172.21.15.88:57468) 2023-12-08T08:22:36.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.830+0000 7f2de659c640 1 -- 172.21.15.88:0/1791536705 learned_addr learned my addr 172.21.15.88:0/1791536705 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:36.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.830+0000 7f2de5d9b640 1 --2- 172.21.15.88:0/1791536705 >> v2:172.21.15.148:3300/0 conn(0x7f2de80c3b80 0x7f2de80c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:36.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.830+0000 7f2de659c640 1 -- 172.21.15.88:0/1791536705 >> v2:172.21.15.148:3300/0 conn(0x7f2de80c3b80 msgr2=0x7f2de80c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:36.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.830+0000 7f2de659c640 1 --2- 172.21.15.88:0/1791536705 >> v2:172.21.15.148:3300/0 conn(0x7f2de80c3b80 0x7f2de80c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:36.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.830+0000 7f2de659c640 1 -- 172.21.15.88:0/1791536705 >> v1:172.21.15.148:6789/0 conn(0x7f2de806c020 legacy=0x7f2de806c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:36.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.830+0000 7f2de659c640 1 -- 172.21.15.88:0/1791536705 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de81518a0 con 0x7f2de806d2b0 2023-12-08T08:22:36.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.834+0000 7f2de659c640 1 --2- 172.21.15.88:0/1791536705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2de806d2b0 0x7f2de806d690 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f2de806b5a0 tx=0x7f2dd801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51eddd3f66facd7e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:36.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.834+0000 7f2de559a640 1 -- 172.21.15.88:0/1791536705 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd80ac600 con 0x7f2de806d2b0 2023-12-08T08:22:36.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.834+0000 7f2de559a640 1 -- 172.21.15.88:0/1791536705 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd80a8050 con 0x7f2de806d2b0 2023-12-08T08:22:36.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.834+0000 7f2de559a640 1 -- 172.21.15.88:0/1791536705 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd80ac980 con 0x7f2de806d2b0 2023-12-08T08:22:36.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.834+0000 7f2decd72640 1 -- 172.21.15.88:0/1791536705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2de806d2b0 msgr2=0x7f2de806d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:36.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.834+0000 7f2decd72640 1 --2- 172.21.15.88:0/1791536705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2de806d2b0 0x7f2de806d690 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f2de806b5a0 tx=0x7f2dd801c490 comp rx=0 tx=0).stop 2023-12-08T08:22:36.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.834+0000 7f2decd72640 1 -- 172.21.15.88:0/1791536705 shutdown_connections 2023-12-08T08:22:36.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.834+0000 7f2decd72640 1 --2- 172.21.15.88:0/1791536705 >> v2:172.21.15.148:3300/0 conn(0x7f2de80c3b80 0x7f2de80c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:36.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.834+0000 7f2decd72640 1 --2- 172.21.15.88:0/1791536705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2de806d2b0 0x7f2de806d690 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:36.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.834+0000 7f2decd72640 1 -- 172.21.15.88:0/1791536705 >> 172.21.15.88:0/1791536705 conn(0x7f2de80a7810 msgr2=0x7f2de80a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:36.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.834+0000 7f2decd72640 1 -- 172.21.15.88:0/1791536705 shutdown_connections 2023-12-08T08:22:36.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.834+0000 7f2decd72640 1 -- 172.21.15.88:0/1791536705 wait complete. 2023-12-08T08:22:36.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.838+0000 7f2decd72640 1 Processor -- start 2023-12-08T08:22:36.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.838+0000 7f2decd72640 1 -- start start 2023-12-08T08:22:36.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.838+0000 7f2decd72640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2de806c020 0x7f2de81eeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:36.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.838+0000 7f2decd72640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2de806d2b0 0x7f2de814a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:36.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.838+0000 7f2decd72640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2de80c3b80 0x7f2de81eaa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:36.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.838+0000 7f2decd72640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de8157080 con 0x7f2de80c3b80 2023-12-08T08:22:36.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.838+0000 7f2decd72640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de814a8f0 con 0x7f2de806d2b0 2023-12-08T08:22:36.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.838+0000 7f2decd72640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de8156040 con 0x7f2de806c020 2023-12-08T08:22:36.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.838+0000 7f2de6d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2de80c3b80 0x7f2de81eaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:36.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.838+0000 7f2de6d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2de80c3b80 0x7f2de81eaa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57478/0 (socket says 172.21.15.88:57478) 2023-12-08T08:22:36.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.838+0000 7f2de6d9d640 1 -- 172.21.15.88:0/2685310710 learned_addr learned my addr 172.21.15.88:0/2685310710 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:36.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.838+0000 7f2de5d9b640 1 --2- 172.21.15.88:0/2685310710 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2de806d2b0 0x7f2de814a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:36.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.838+0000 7f2de659c640 1 --2- 172.21.15.88:0/2685310710 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2de806c020 0x7f2de81eeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:36.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.838+0000 7f2de6d9d640 1 -- 172.21.15.88:0/2685310710 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2de806c020 msgr2=0x7f2de81eeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:36.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.838+0000 7f2de6d9d640 1 --2- 172.21.15.88:0/2685310710 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2de806c020 0x7f2de81eeb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:36.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.838+0000 7f2de6d9d640 1 -- 172.21.15.88:0/2685310710 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2de806d2b0 msgr2=0x7f2de814a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:36.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.838+0000 7f2de6d9d640 1 --2- 172.21.15.88:0/2685310710 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2de806d2b0 0x7f2de814a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:36.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.838+0000 7f2de6d9d640 1 -- 172.21.15.88:0/2685310710 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd80094d0 con 0x7f2de80c3b80 2023-12-08T08:22:36.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.838+0000 7f2de659c640 1 --2- 172.21.15.88:0/2685310710 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2de806c020 0x7f2de81eeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:36.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.838+0000 7f2de5d9b640 1 --2- 172.21.15.88:0/2685310710 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2de806d2b0 0x7f2de814a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:36.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.838+0000 7f2de6d9d640 1 --2- 172.21.15.88:0/2685310710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2de80c3b80 0x7f2de81eaa40 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f2de000c780 tx=0x7f2de000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:36.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.838+0000 7f2dd6ffd640 1 -- 172.21.15.88:0/2685310710 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de0004b20 con 0x7f2de80c3b80 2023-12-08T08:22:36.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.838+0000 7f2dd6ffd640 1 -- 172.21.15.88:0/2685310710 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de0004c80 con 0x7f2de80c3b80 2023-12-08T08:22:36.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.838+0000 7f2decd72640 1 -- 172.21.15.88:0/2685310710 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de814ef80 con 0x7f2de80c3b80 2023-12-08T08:22:36.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.838+0000 7f2dd6ffd640 1 -- 172.21.15.88:0/2685310710 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de000aa30 con 0x7f2de80c3b80 2023-12-08T08:22:36.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.838+0000 7f2decd72640 1 -- 172.21.15.88:0/2685310710 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de81ee330 con 0x7f2de80c3b80 2023-12-08T08:22:36.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.842+0000 7f2decd72640 1 -- 172.21.15.88:0/2685310710 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de8067630 con 0x7f2de80c3b80 2023-12-08T08:22:36.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.842+0000 7f2dd6ffd640 1 -- 172.21.15.88:0/2685310710 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2de000ab90 con 0x7f2de80c3b80 2023-12-08T08:22:36.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.842+0000 7f2dd6ffd640 1 --2- 172.21.15.88:0/2685310710 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2dc8066470 0x7f2dc8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:36.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.842+0000 7f2dd6ffd640 1 -- 172.21.15.88:0/2685310710 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2de00842c0 con 0x7f2de80c3b80 2023-12-08T08:22:36.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.842+0000 7f2de659c640 1 --2- 172.21.15.88:0/2685310710 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2dc8066470 0x7f2dc8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:36.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.842+0000 7f2de659c640 1 --2- 172.21.15.88:0/2685310710 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2dc8066470 0x7f2dc8068930 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2dd80ae000 tx=0x7f2dd8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:36.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.846+0000 7f2dd6ffd640 1 -- 172.21.15.88:0/2685310710 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2de00513d0 con 0x7f2de80c3b80 2023-12-08T08:22:37.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.998+0000 7f2decd72640 1 -- 172.21.15.88:0/2685310710 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2de806bd70 con 0x7f2de80c3b80 2023-12-08T08:22:37.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:36.998+0000 7f2dd6ffd640 1 -- 172.21.15.88:0/2685310710 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20256 (secure 0 0 0) 0x7f2de00549f0 con 0x7f2de80c3b80 2023-12-08T08:22:37.004 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:37.004 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":54,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:22:21.530364+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:00.520254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:01.423493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:22:17.787562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:22:18.955273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:22:37.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.002+0000 7f2decd72640 1 -- 172.21.15.88:0/2685310710 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2dc8066470 msgr2=0x7f2dc8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:37.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.002+0000 7f2decd72640 1 --2- 172.21.15.88:0/2685310710 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2dc8066470 0x7f2dc8068930 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2dd80ae000 tx=0x7f2dd8008040 comp rx=0 tx=0).stop 2023-12-08T08:22:37.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.002+0000 7f2decd72640 1 -- 172.21.15.88:0/2685310710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2de80c3b80 msgr2=0x7f2de81eaa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:37.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.002+0000 7f2decd72640 1 --2- 172.21.15.88:0/2685310710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2de80c3b80 0x7f2de81eaa40 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f2de000c780 tx=0x7f2de000cc40 comp rx=0 tx=0).stop 2023-12-08T08:22:37.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.002+0000 7f2decd72640 1 -- 172.21.15.88:0/2685310710 shutdown_connections 2023-12-08T08:22:37.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.002+0000 7f2decd72640 1 --2- 172.21.15.88:0/2685310710 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2dc8066470 0x7f2dc8068930 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.002+0000 7f2decd72640 1 --2- 172.21.15.88:0/2685310710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2de80c3b80 0x7f2de81eaa40 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.002+0000 7f2decd72640 1 --2- 172.21.15.88:0/2685310710 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2de806d2b0 0x7f2de814a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.002+0000 7f2decd72640 1 --2- 172.21.15.88:0/2685310710 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2de806c020 0x7f2de81eeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.002+0000 7f2decd72640 1 -- 172.21.15.88:0/2685310710 >> 172.21.15.88:0/2685310710 conn(0x7f2de80a7810 msgr2=0x7f2de80723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:37.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.002+0000 7f2decd72640 1 -- 172.21.15.88:0/2685310710 shutdown_connections 2023-12-08T08:22:37.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.002+0000 7f2decd72640 1 -- 172.21.15.88:0/2685310710 wait complete. 2023-12-08T08:22:37.025 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:22:00.520254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:22:01.423493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:22:17.787562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:22:18.955273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:22:37.025 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:22:37.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.162+0000 7f7552868640 1 Processor -- start 2023-12-08T08:22:37.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.162+0000 7f7552868640 1 -- start start 2023-12-08T08:22:37.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.162+0000 7f7552868640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f754c14b1e0 0x7f754c0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:37.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.162+0000 7f7552868640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f754c0c5300 0x7f754c0a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:37.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.162+0000 7f7552868640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f754c0a4e20 con 0x7f754c151280 2023-12-08T08:22:37.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.162+0000 7f7552868640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f754c1558d0 con 0x7f754c0c5300 2023-12-08T08:22:37.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.162+0000 7f7552868640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754c0a50e0 con 0x7f754c14b1e0 2023-12-08T08:22:37.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.162+0000 7f754bfff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f754c14b1e0 0x7f754c0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:37.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.162+0000 7f754b7fe640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f754c0c5300 0x7f754c0a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:37.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.162+0000 7f754b7fe640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f754c0c5300 0x7f754c0a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:57502/0 (socket says 172.21.15.88:57502) 2023-12-08T08:22:37.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.162+0000 7f754b7fe640 1 -- 172.21.15.88:0/394702478 learned_addr learned my addr 172.21.15.88:0/394702478 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:37.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.162+0000 7f7550e05640 1 --1- 172.21.15.88:0/394702478 >> v1:172.21.15.148:6789/0 conn(0x7f754c151280 0x7f754c151710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:43634/0 (socket says 172.21.15.88:43634) 2023-12-08T08:22:37.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.162+0000 7f754b7fe640 1 -- 172.21.15.88:0/394702478 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f754c14b1e0 msgr2=0x7f754c0c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:37.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.162+0000 7f754b7fe640 1 --2- 172.21.15.88:0/394702478 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f754c14b1e0 0x7f754c0c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.162+0000 7f754b7fe640 1 -- 172.21.15.88:0/394702478 >> v1:172.21.15.148:6789/0 conn(0x7f754c151280 legacy=0x7f754c151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:37.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.162+0000 7f754b7fe640 1 -- 172.21.15.88:0/394702478 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754c0c0f00 con 0x7f754c0c5300 2023-12-08T08:22:37.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.166+0000 7f754b7fe640 1 --2- 172.21.15.88:0/394702478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f754c0c5300 0x7f754c0a9c30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7540009870 tx=0x7f754001c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cdcc2fbef980229 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:37.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.166+0000 7f754affd640 1 -- 172.21.15.88:0/394702478 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75400ab650 con 0x7f754c0c5300 2023-12-08T08:22:37.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.166+0000 7f754affd640 1 -- 172.21.15.88:0/394702478 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75400ab7b0 con 0x7f754c0c5300 2023-12-08T08:22:37.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.166+0000 7f754affd640 1 -- 172.21.15.88:0/394702478 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75400abb40 con 0x7f754c0c5300 2023-12-08T08:22:37.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.166+0000 7f7552868640 1 -- 172.21.15.88:0/394702478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f754c0c5300 msgr2=0x7f754c0a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:37.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.166+0000 7f7552868640 1 --2- 172.21.15.88:0/394702478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f754c0c5300 0x7f754c0a9c30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7540009870 tx=0x7f754001c540 comp rx=0 tx=0).stop 2023-12-08T08:22:37.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.166+0000 7f7552868640 1 -- 172.21.15.88:0/394702478 shutdown_connections 2023-12-08T08:22:37.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.166+0000 7f7552868640 1 --2- 172.21.15.88:0/394702478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f754c0c5300 0x7f754c0a9c30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.166+0000 7f7552868640 1 --2- 172.21.15.88:0/394702478 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f754c14b1e0 0x7f754c0c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.166+0000 7f7552868640 1 -- 172.21.15.88:0/394702478 >> 172.21.15.88:0/394702478 conn(0x7f754c0c59f0 msgr2=0x7f754c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:37.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.166+0000 7f7552868640 1 -- 172.21.15.88:0/394702478 shutdown_connections 2023-12-08T08:22:37.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.166+0000 7f7552868640 1 -- 172.21.15.88:0/394702478 wait complete. 2023-12-08T08:22:37.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.170+0000 7f7552868640 1 Processor -- start 2023-12-08T08:22:37.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.170+0000 7f7552868640 1 -- start start 2023-12-08T08:22:37.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.170+0000 7f7552868640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f754c0c5300 0x7f754c1f0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:37.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.170+0000 7f7552868640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f754c14b1e0 0x7f754c0befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:37.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.170+0000 7f7552868640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f754c151280 0x7f754c1ed8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:37.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.170+0000 7f7552868640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c1f16a0 con 0x7f754c14b1e0 2023-12-08T08:22:37.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.170+0000 7f7552868640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c1ed190 con 0x7f754c151280 2023-12-08T08:22:37.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.170+0000 7f7552868640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754c1ed430 con 0x7f754c0c5300 2023-12-08T08:22:37.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.170+0000 7f754b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f754c14b1e0 0x7f754c0befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:37.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.170+0000 7f754b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f754c14b1e0 0x7f754c0befc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57492/0 (socket says 172.21.15.88:57492) 2023-12-08T08:22:37.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.170+0000 7f754b7fe640 1 -- 172.21.15.88:0/3230491432 learned_addr learned my addr 172.21.15.88:0/3230491432 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:37.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.170+0000 7f754bfff640 1 --2- 172.21.15.88:0/3230491432 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f754c0c5300 0x7f754c1f0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:37.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.170+0000 7f7550e05640 1 --2- 172.21.15.88:0/3230491432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f754c151280 0x7f754c1ed8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:37.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.170+0000 7f754b7fe640 1 -- 172.21.15.88:0/3230491432 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f754c0c5300 msgr2=0x7f754c1f0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:37.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.170+0000 7f754b7fe640 1 --2- 172.21.15.88:0/3230491432 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f754c0c5300 0x7f754c1f0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.170+0000 7f754b7fe640 1 -- 172.21.15.88:0/3230491432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f754c151280 msgr2=0x7f754c1ed8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:37.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.170+0000 7f754b7fe640 1 --2- 172.21.15.88:0/3230491432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f754c151280 0x7f754c1ed8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.170+0000 7f754b7fe640 1 -- 172.21.15.88:0/3230491432 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75400094d0 con 0x7f754c14b1e0 2023-12-08T08:22:37.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.170+0000 7f754b7fe640 1 --2- 172.21.15.88:0/3230491432 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f754c14b1e0 0x7f754c0befc0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f75400ad040 tx=0x7f754001ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:37.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.170+0000 7f7548ff9640 1 -- 172.21.15.88:0/3230491432 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75400b4800 con 0x7f754c14b1e0 2023-12-08T08:22:37.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.170+0000 7f7548ff9640 1 -- 172.21.15.88:0/3230491432 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75400b4980 con 0x7f754c14b1e0 2023-12-08T08:22:37.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.170+0000 7f7548ff9640 1 -- 172.21.15.88:0/3230491432 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75400b4d30 con 0x7f754c14b1e0 2023-12-08T08:22:37.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.170+0000 7f7552868640 1 -- 172.21.15.88:0/3230491432 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f754c150160 con 0x7f754c14b1e0 2023-12-08T08:22:37.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.170+0000 7f7552868640 1 -- 172.21.15.88:0/3230491432 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f754c1f10e0 con 0x7f754c14b1e0 2023-12-08T08:22:37.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.170+0000 7f7552868640 1 -- 172.21.15.88:0/3230491432 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f754c067630 con 0x7f754c14b1e0 2023-12-08T08:22:37.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.174+0000 7f7548ff9640 1 -- 172.21.15.88:0/3230491432 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f75400b3380 con 0x7f754c14b1e0 2023-12-08T08:22:37.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.174+0000 7f7548ff9640 1 --2- 172.21.15.88:0/3230491432 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7538066470 0x7f7538068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:37.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.174+0000 7f7548ff9640 1 -- 172.21.15.88:0/3230491432 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f754011e820 con 0x7f754c14b1e0 2023-12-08T08:22:37.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.174+0000 7f754bfff640 1 --2- 172.21.15.88:0/3230491432 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7538066470 0x7f7538068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:37.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.174+0000 7f754bfff640 1 --2- 172.21.15.88:0/3230491432 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7538066470 0x7f7538068930 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f753c009b60 tx=0x7f753c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:37.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.178+0000 7f7548ff9640 1 -- 172.21.15.88:0/3230491432 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f75400ebb00 con 0x7f754c14b1e0 2023-12-08T08:22:37.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.326+0000 7f7552868640 1 -- 172.21.15.88:0/3230491432 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f754c0a9c30 con 0x7f754c14b1e0 2023-12-08T08:22:37.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.326+0000 7f7548ff9640 1 -- 172.21.15.88:0/3230491432 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f75400ab610 con 0x7f754c14b1e0 2023-12-08T08:22:37.332 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:22:37.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.330+0000 7f7552868640 1 -- 172.21.15.88:0/3230491432 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7538066470 msgr2=0x7f7538068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:37.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.330+0000 7f7552868640 1 --2- 172.21.15.88:0/3230491432 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7538066470 0x7f7538068930 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f753c009b60 tx=0x7f753c009190 comp rx=0 tx=0).stop 2023-12-08T08:22:37.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.330+0000 7f7552868640 1 -- 172.21.15.88:0/3230491432 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f754c14b1e0 msgr2=0x7f754c0befc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:37.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.330+0000 7f7552868640 1 --2- 172.21.15.88:0/3230491432 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f754c14b1e0 0x7f754c0befc0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f75400ad040 tx=0x7f754001ad80 comp rx=0 tx=0).stop 2023-12-08T08:22:37.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.330+0000 7f7552868640 1 -- 172.21.15.88:0/3230491432 shutdown_connections 2023-12-08T08:22:37.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.330+0000 7f7552868640 1 --2- 172.21.15.88:0/3230491432 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7538066470 0x7f7538068930 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.330+0000 7f7552868640 1 --2- 172.21.15.88:0/3230491432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f754c151280 0x7f754c1ed8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.330+0000 7f7552868640 1 --2- 172.21.15.88:0/3230491432 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f754c14b1e0 0x7f754c0befc0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.330+0000 7f7552868640 1 --2- 172.21.15.88:0/3230491432 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f754c0c5300 0x7f754c1f0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.330+0000 7f7552868640 1 -- 172.21.15.88:0/3230491432 >> 172.21.15.88:0/3230491432 conn(0x7f754c0c59f0 msgr2=0x7f754c151710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:37.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.330+0000 7f7552868640 1 -- 172.21.15.88:0/3230491432 shutdown_connections 2023-12-08T08:22:37.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.330+0000 7f7552868640 1 -- 172.21.15.88:0/3230491432 wait complete. 2023-12-08T08:22:37.355 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:22:37.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.490+0000 7fe67772a640 1 Processor -- start 2023-12-08T08:22:37.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.490+0000 7fe67772a640 1 -- start start 2023-12-08T08:22:37.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.490+0000 7fe67772a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe67014b1e0 0x7fe6700c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:37.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.490+0000 7fe67772a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe6700c5300 0x7fe6700a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:37.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.490+0000 7fe67772a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6700a4e20 con 0x7fe670151280 2023-12-08T08:22:37.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.490+0000 7fe67772a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6701558d0 con 0x7fe6700c5300 2023-12-08T08:22:37.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.490+0000 7fe67772a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6700a50e0 con 0x7fe67014b1e0 2023-12-08T08:22:37.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.490+0000 7fe674cc5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe6700c5300 0x7fe6700a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:37.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.490+0000 7fe675cc7640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe670151280 0x7fe670151710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41398/0 (socket says 172.21.15.88:41398) 2023-12-08T08:22:37.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.490+0000 7fe675cc7640 1 -- 172.21.15.88:0/3270003371 learned_addr learned my addr 172.21.15.88:0/3270003371 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:37.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.490+0000 7fe6754c6640 1 --2- 172.21.15.88:0/3270003371 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe67014b1e0 0x7fe6700c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:37.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.490+0000 7fe674cc5640 1 -- 172.21.15.88:0/3270003371 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe67014b1e0 msgr2=0x7fe6700c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:37.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.490+0000 7fe674cc5640 1 --2- 172.21.15.88:0/3270003371 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe67014b1e0 0x7fe6700c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.490+0000 7fe674cc5640 1 -- 172.21.15.88:0/3270003371 >> v1:172.21.15.88:6789/0 conn(0x7fe670151280 legacy=0x7fe670151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:37.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.490+0000 7fe674cc5640 1 -- 172.21.15.88:0/3270003371 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6700c0f00 con 0x7fe6700c5300 2023-12-08T08:22:37.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.494+0000 7fe674cc5640 1 --2- 172.21.15.88:0/3270003371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6700c5300 0x7fe6700a9c30 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe6600097c0 tx=0x7fe66001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a23aa00ce686d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:37.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.494+0000 7fe667fff640 1 -- 172.21.15.88:0/3270003371 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6600ad640 con 0x7fe6700c5300 2023-12-08T08:22:37.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.494+0000 7fe667fff640 1 -- 172.21.15.88:0/3270003371 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6600ad7a0 con 0x7fe6700c5300 2023-12-08T08:22:37.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.494+0000 7fe667fff640 1 -- 172.21.15.88:0/3270003371 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6600adb30 con 0x7fe6700c5300 2023-12-08T08:22:37.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.494+0000 7fe67772a640 1 -- 172.21.15.88:0/3270003371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6700c5300 msgr2=0x7fe6700a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:37.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.494+0000 7fe67772a640 1 --2- 172.21.15.88:0/3270003371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6700c5300 0x7fe6700a9c30 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe6600097c0 tx=0x7fe66001c480 comp rx=0 tx=0).stop 2023-12-08T08:22:37.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.494+0000 7fe67772a640 1 -- 172.21.15.88:0/3270003371 shutdown_connections 2023-12-08T08:22:37.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.494+0000 7fe67772a640 1 --2- 172.21.15.88:0/3270003371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6700c5300 0x7fe6700a9c30 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.494+0000 7fe67772a640 1 --2- 172.21.15.88:0/3270003371 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe67014b1e0 0x7fe6700c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.494+0000 7fe67772a640 1 -- 172.21.15.88:0/3270003371 >> 172.21.15.88:0/3270003371 conn(0x7fe6700c59f0 msgr2=0x7fe6700c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:37.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.494+0000 7fe67772a640 1 -- 172.21.15.88:0/3270003371 shutdown_connections 2023-12-08T08:22:37.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.494+0000 7fe67772a640 1 -- 172.21.15.88:0/3270003371 wait complete. 2023-12-08T08:22:37.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.498+0000 7fe67772a640 1 Processor -- start 2023-12-08T08:22:37.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.498+0000 7fe67772a640 1 -- start start 2023-12-08T08:22:37.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.498+0000 7fe67772a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700c5300 0x7fe6701f1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:37.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.498+0000 7fe67772a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67014b1e0 0x7fe6701f0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:37.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.498+0000 7fe67772a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe670151280 0x7fe6700bf170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:37.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.498+0000 7fe67772a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe670144970 con 0x7fe67014b1e0 2023-12-08T08:22:37.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.498+0000 7fe67772a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe670146cf0 con 0x7fe670151280 2023-12-08T08:22:37.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.498+0000 7fe67772a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6701eaca0 con 0x7fe6700c5300 2023-12-08T08:22:37.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.498+0000 7fe674cc5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67014b1e0 0x7fe6701f0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:37.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.498+0000 7fe674cc5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67014b1e0 0x7fe6701f0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57510/0 (socket says 172.21.15.88:57510) 2023-12-08T08:22:37.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.498+0000 7fe674cc5640 1 -- 172.21.15.88:0/980291510 learned_addr learned my addr 172.21.15.88:0/980291510 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:37.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.498+0000 7fe6754c6640 1 --2- 172.21.15.88:0/980291510 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700c5300 0x7fe6701f1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:37.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.498+0000 7fe675cc7640 1 --2- 172.21.15.88:0/980291510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe670151280 0x7fe6700bf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:37.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.498+0000 7fe674cc5640 1 -- 172.21.15.88:0/980291510 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700c5300 msgr2=0x7fe6701f1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:37.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.498+0000 7fe674cc5640 1 --2- 172.21.15.88:0/980291510 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700c5300 0x7fe6701f1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.498+0000 7fe674cc5640 1 -- 172.21.15.88:0/980291510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe670151280 msgr2=0x7fe6700bf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:37.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.498+0000 7fe674cc5640 1 --2- 172.21.15.88:0/980291510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe670151280 0x7fe6700bf170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.498+0000 7fe674cc5640 1 -- 172.21.15.88:0/980291510 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe660009420 con 0x7fe67014b1e0 2023-12-08T08:22:37.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.498+0000 7fe6754c6640 1 --2- 172.21.15.88:0/980291510 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700c5300 0x7fe6701f1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:37.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.498+0000 7fe674cc5640 1 --2- 172.21.15.88:0/980291510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67014b1e0 0x7fe6701f0520 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe66001a0b0 tx=0x7fe660019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:37.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.498+0000 7fe665ffb640 1 -- 172.21.15.88:0/980291510 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6600b6610 con 0x7fe67014b1e0 2023-12-08T08:22:37.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.498+0000 7fe665ffb640 1 -- 172.21.15.88:0/980291510 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6600a6040 con 0x7fe67014b1e0 2023-12-08T08:22:37.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.498+0000 7fe665ffb640 1 -- 172.21.15.88:0/980291510 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6600b69b0 con 0x7fe67014b1e0 2023-12-08T08:22:37.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.498+0000 7fe67772a640 1 -- 172.21.15.88:0/980291510 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6700a5460 con 0x7fe67014b1e0 2023-12-08T08:22:37.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.498+0000 7fe67772a640 1 -- 172.21.15.88:0/980291510 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6700a5700 con 0x7fe67014b1e0 2023-12-08T08:22:37.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.502+0000 7fe67772a640 1 -- 172.21.15.88:0/980291510 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6700a58f0 con 0x7fe67014b1e0 2023-12-08T08:22:37.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.502+0000 7fe665ffb640 1 -- 172.21.15.88:0/980291510 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe6600b4040 con 0x7fe67014b1e0 2023-12-08T08:22:37.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.502+0000 7fe665ffb640 1 --2- 172.21.15.88:0/980291510 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe654066470 0x7fe654068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:37.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.502+0000 7fe665ffb640 1 -- 172.21.15.88:0/980291510 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe66011e340 con 0x7fe67014b1e0 2023-12-08T08:22:37.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.502+0000 7fe6754c6640 1 --2- 172.21.15.88:0/980291510 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe654066470 0x7fe654068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:37.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.502+0000 7fe6754c6640 1 --2- 172.21.15.88:0/980291510 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe654066470 0x7fe654068930 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe67015bb20 tx=0x7fe66c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:37.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.506+0000 7fe665ffb640 1 -- 172.21.15.88:0/980291510 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe6600eb4f0 con 0x7fe67014b1e0 2023-12-08T08:22:37.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.654+0000 7fe67772a640 1 -- 172.21.15.88:0/980291510 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe670067630 con 0x7fe67014b1e0 2023-12-08T08:22:37.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.658+0000 7fe665ffb640 1 -- 172.21.15.88:0/980291510 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe6600eeb10 con 0x7fe67014b1e0 2023-12-08T08:22:37.662 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:22:37.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.658+0000 7fe67772a640 1 -- 172.21.15.88:0/980291510 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe654066470 msgr2=0x7fe654068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:37.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.658+0000 7fe67772a640 1 --2- 172.21.15.88:0/980291510 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe654066470 0x7fe654068930 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe67015bb20 tx=0x7fe66c008040 comp rx=0 tx=0).stop 2023-12-08T08:22:37.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.658+0000 7fe67772a640 1 -- 172.21.15.88:0/980291510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67014b1e0 msgr2=0x7fe6701f0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:37.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.658+0000 7fe67772a640 1 --2- 172.21.15.88:0/980291510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67014b1e0 0x7fe6701f0520 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe66001a0b0 tx=0x7fe660019220 comp rx=0 tx=0).stop 2023-12-08T08:22:37.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.658+0000 7fe67772a640 1 -- 172.21.15.88:0/980291510 shutdown_connections 2023-12-08T08:22:37.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.658+0000 7fe67772a640 1 --2- 172.21.15.88:0/980291510 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe654066470 0x7fe654068930 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.658+0000 7fe67772a640 1 --2- 172.21.15.88:0/980291510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe670151280 0x7fe6700bf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.658+0000 7fe67772a640 1 --2- 172.21.15.88:0/980291510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67014b1e0 0x7fe6701f0520 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.658+0000 7fe67772a640 1 --2- 172.21.15.88:0/980291510 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700c5300 0x7fe6701f1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.658+0000 7fe67772a640 1 -- 172.21.15.88:0/980291510 >> 172.21.15.88:0/980291510 conn(0x7fe6700c59f0 msgr2=0x7fe67014a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:37.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.658+0000 7fe67772a640 1 -- 172.21.15.88:0/980291510 shutdown_connections 2023-12-08T08:22:37.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.658+0000 7fe67772a640 1 -- 172.21.15.88:0/980291510 wait complete. 2023-12-08T08:22:37.684 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:22:37.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.818+0000 7f342190e640 1 Processor -- start 2023-12-08T08:22:37.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.818+0000 7f342190e640 1 -- start start 2023-12-08T08:22:37.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.822+0000 7f342190e640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f341c14b1e0 0x7f341c0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:37.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.822+0000 7f342190e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f341c1548c0 0x7f341c154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:37.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.822+0000 7f342190e640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f341c0a4e20 con 0x7f341c0c5300 2023-12-08T08:22:37.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.822+0000 7f342190e640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f341c0a50e0 con 0x7f341c14b1e0 2023-12-08T08:22:37.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.822+0000 7f342190e640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341c0c0f00 con 0x7f341c1548c0 2023-12-08T08:22:37.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.822+0000 7f341affd640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f341c14b1e0 0x7f341c0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:37.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.822+0000 7f341b7fe640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f341c1548c0 0x7f341c154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:37.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.822+0000 7f341b7fe640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f341c1548c0 0x7f341c154d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:38594/0 (socket says 172.21.15.88:38594) 2023-12-08T08:22:37.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.822+0000 7f341b7fe640 1 -- 172.21.15.88:0/2666932935 learned_addr learned my addr 172.21.15.88:0/2666932935 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:37.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.822+0000 7f341b7fe640 1 -- 172.21.15.88:0/2666932935 >> v2:172.21.15.148:3300/0 conn(0x7f341c14b1e0 msgr2=0x7f341c0c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:37.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.822+0000 7f341b7fe640 1 --2- 172.21.15.88:0/2666932935 >> v2:172.21.15.148:3300/0 conn(0x7f341c14b1e0 0x7f341c0c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.822+0000 7f341a7fc640 1 -- 172.21.15.88:0/2666932935 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 293790779 0 0) 0x7f341c0a4e20 con 0x7f341c0c5300 2023-12-08T08:22:37.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.822+0000 7f341b7fe640 1 -- 172.21.15.88:0/2666932935 >> v1:172.21.15.148:6789/0 conn(0x7f341c0c5300 legacy=0x7f341c0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:37.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.822+0000 7f341b7fe640 1 -- 172.21.15.88:0/2666932935 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341c0c11e0 con 0x7f341c1548c0 2023-12-08T08:22:37.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.826+0000 7f341b7fe640 1 --2- 172.21.15.88:0/2666932935 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f341c1548c0 0x7f341c154d30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3414009e50 tx=0x7f341401ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=930012d587ab148b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:37.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.826+0000 7f341a7fc640 1 -- 172.21.15.88:0/2666932935 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34140a57f0 con 0x7f341c1548c0 2023-12-08T08:22:37.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.826+0000 7f341a7fc640 1 -- 172.21.15.88:0/2666932935 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34140a5950 con 0x7f341c1548c0 2023-12-08T08:22:37.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.826+0000 7f341a7fc640 1 -- 172.21.15.88:0/2666932935 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34140a5ce0 con 0x7f341c1548c0 2023-12-08T08:22:37.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.826+0000 7f342190e640 1 -- 172.21.15.88:0/2666932935 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f341c1548c0 msgr2=0x7f341c154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:37.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.826+0000 7f342190e640 1 --2- 172.21.15.88:0/2666932935 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f341c1548c0 0x7f341c154d30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3414009e50 tx=0x7f341401ca10 comp rx=0 tx=0).stop 2023-12-08T08:22:37.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.826+0000 7f342190e640 1 -- 172.21.15.88:0/2666932935 shutdown_connections 2023-12-08T08:22:37.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.826+0000 7f342190e640 1 --2- 172.21.15.88:0/2666932935 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f341c1548c0 0x7f341c154d30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.826+0000 7f342190e640 1 --2- 172.21.15.88:0/2666932935 >> v2:172.21.15.148:3300/0 conn(0x7f341c14b1e0 0x7f341c0c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.826+0000 7f342190e640 1 -- 172.21.15.88:0/2666932935 >> 172.21.15.88:0/2666932935 conn(0x7f341c0c59f0 msgr2=0x7f341c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:37.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.826+0000 7f342190e640 1 -- 172.21.15.88:0/2666932935 shutdown_connections 2023-12-08T08:22:37.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.826+0000 7f342190e640 1 -- 172.21.15.88:0/2666932935 wait complete. 2023-12-08T08:22:37.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.826+0000 7f342190e640 1 Processor -- start 2023-12-08T08:22:37.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.826+0000 7f342190e640 1 -- start start 2023-12-08T08:22:37.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.830+0000 7f342190e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f341c0c5300 0x7f341c15df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:37.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.830+0000 7f342190e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f341c14b1e0 0x7f341c0a6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:37.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.830+0000 7f342190e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f341c1548c0 0x7f341c06c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:37.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.830+0000 7f342190e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341c1f11d0 con 0x7f341c0c5300 2023-12-08T08:22:37.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.830+0000 7f342190e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341c1414f0 con 0x7f341c1548c0 2023-12-08T08:22:37.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.830+0000 7f342190e640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341c1ecd00 con 0x7f341c14b1e0 2023-12-08T08:22:37.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.830+0000 7f341affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f341c0c5300 0x7f341c15df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:37.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.830+0000 7f341affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f341c0c5300 0x7f341c15df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57518/0 (socket says 172.21.15.88:57518) 2023-12-08T08:22:37.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.830+0000 7f341affd640 1 -- 172.21.15.88:0/717223791 learned_addr learned my addr 172.21.15.88:0/717223791 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:37.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.830+0000 7f34127fc640 1 --2- 172.21.15.88:0/717223791 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f341c14b1e0 0x7f341c0a6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:37.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.830+0000 7f341b7fe640 1 --2- 172.21.15.88:0/717223791 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f341c1548c0 0x7f341c06c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:37.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.830+0000 7f341affd640 1 -- 172.21.15.88:0/717223791 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f341c14b1e0 msgr2=0x7f341c0a6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:37.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.830+0000 7f341affd640 1 --2- 172.21.15.88:0/717223791 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f341c14b1e0 0x7f341c0a6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.830+0000 7f341affd640 1 -- 172.21.15.88:0/717223791 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f341c1548c0 msgr2=0x7f341c06c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:37.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.830+0000 7f341affd640 1 --2- 172.21.15.88:0/717223791 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f341c1548c0 0x7f341c06c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.830+0000 7f341affd640 1 -- 172.21.15.88:0/717223791 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3414009b30 con 0x7f341c0c5300 2023-12-08T08:22:37.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.830+0000 7f34127fc640 1 --2- 172.21.15.88:0/717223791 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f341c14b1e0 0x7f341c0a6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:37.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.830+0000 7f341affd640 1 --2- 172.21.15.88:0/717223791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f341c0c5300 0x7f341c15df10 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f340400e930 tx=0x7f340400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:37.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.830+0000 7f3418ff9640 1 -- 172.21.15.88:0/717223791 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3404009690 con 0x7f341c0c5300 2023-12-08T08:22:37.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.830+0000 7f3418ff9640 1 -- 172.21.15.88:0/717223791 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340400c8e0 con 0x7f341c0c5300 2023-12-08T08:22:37.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.830+0000 7f342190e640 1 -- 172.21.15.88:0/717223791 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f341c1edcd0 con 0x7f341c0c5300 2023-12-08T08:22:37.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.830+0000 7f3418ff9640 1 -- 172.21.15.88:0/717223791 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340400cc50 con 0x7f341c0c5300 2023-12-08T08:22:37.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.830+0000 7f342190e640 1 -- 172.21.15.88:0/717223791 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f341c1ed1f0 con 0x7f341c0c5300 2023-12-08T08:22:37.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.830+0000 7f342190e640 1 -- 172.21.15.88:0/717223791 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f341c067630 con 0x7f341c0c5300 2023-12-08T08:22:37.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.830+0000 7f3418ff9640 1 -- 172.21.15.88:0/717223791 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3404013470 con 0x7f341c0c5300 2023-12-08T08:22:37.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.834+0000 7f3418ff9640 1 --2- 172.21.15.88:0/717223791 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f33fc066470 0x7f33fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:37.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.834+0000 7f3418ff9640 1 -- 172.21.15.88:0/717223791 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f34040843a0 con 0x7f341c0c5300 2023-12-08T08:22:37.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.834+0000 7f34127fc640 1 --2- 172.21.15.88:0/717223791 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f33fc066470 0x7f33fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:37.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.834+0000 7f34127fc640 1 --2- 172.21.15.88:0/717223791 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f33fc066470 0x7f33fc068930 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f341c15ecc0 tx=0x7f340c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:37.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.838+0000 7f3418ff9640 1 -- 172.21.15.88:0/717223791 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f34040514b0 con 0x7f341c0c5300 2023-12-08T08:22:37.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.986+0000 7f342190e640 1 -- 172.21.15.88:0/717223791 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f341c0c0410 con 0x7f341c0c5300 2023-12-08T08:22:37.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.986+0000 7f3418ff9640 1 -- 172.21.15.88:0/717223791 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3404054ad0 con 0x7f341c0c5300 2023-12-08T08:22:37.992 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:22:37.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.990+0000 7f342190e640 1 -- 172.21.15.88:0/717223791 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f33fc066470 msgr2=0x7f33fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:37.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.990+0000 7f342190e640 1 --2- 172.21.15.88:0/717223791 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f33fc066470 0x7f33fc068930 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f341c15ecc0 tx=0x7f340c009040 comp rx=0 tx=0).stop 2023-12-08T08:22:37.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.990+0000 7f342190e640 1 -- 172.21.15.88:0/717223791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f341c0c5300 msgr2=0x7f341c15df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:37.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.990+0000 7f342190e640 1 --2- 172.21.15.88:0/717223791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f341c0c5300 0x7f341c15df10 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f340400e930 tx=0x7f340400edf0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.990+0000 7f342190e640 1 -- 172.21.15.88:0/717223791 shutdown_connections 2023-12-08T08:22:37.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.990+0000 7f342190e640 1 --2- 172.21.15.88:0/717223791 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f33fc066470 0x7f33fc068930 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.990+0000 7f342190e640 1 --2- 172.21.15.88:0/717223791 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f341c1548c0 0x7f341c06c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.990+0000 7f342190e640 1 --2- 172.21.15.88:0/717223791 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f341c14b1e0 0x7f341c0a6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.990+0000 7f342190e640 1 --2- 172.21.15.88:0/717223791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f341c0c5300 0x7f341c15df10 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:37.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.990+0000 7f342190e640 1 -- 172.21.15.88:0/717223791 >> 172.21.15.88:0/717223791 conn(0x7f341c0c59f0 msgr2=0x7f341c13c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:37.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.990+0000 7f342190e640 1 -- 172.21.15.88:0/717223791 shutdown_connections 2023-12-08T08:22:37.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:37.990+0000 7f342190e640 1 -- 172.21.15.88:0/717223791 wait complete. 2023-12-08T08:22:38.013 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:22:38.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.146+0000 7f7eb049c640 1 Processor -- start 2023-12-08T08:22:38.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.146+0000 7f7eb049c640 1 -- start start 2023-12-08T08:22:38.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.150+0000 7f7eb049c640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7ea814b1e0 0x7f7ea80c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:38.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.150+0000 7f7eb049c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ea80c5300 0x7f7ea80a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:38.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.150+0000 7f7eb049c640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea80a4e20 con 0x7f7ea8151280 2023-12-08T08:22:38.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.150+0000 7f7eb049c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ea81558d0 con 0x7f7ea80c5300 2023-12-08T08:22:38.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.150+0000 7f7eb049c640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ea80a50e0 con 0x7f7ea814b1e0 2023-12-08T08:22:38.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.150+0000 7f7eada37640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ea80c5300 0x7f7ea80a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:38.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.150+0000 7f7eada37640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ea80c5300 0x7f7ea80a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57532/0 (socket says 172.21.15.88:57532) 2023-12-08T08:22:38.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.150+0000 7f7eada37640 1 -- 172.21.15.88:0/1123806693 learned_addr learned my addr 172.21.15.88:0/1123806693 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:38.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.150+0000 7f7eae238640 1 --2- 172.21.15.88:0/1123806693 >> v2:172.21.15.148:3300/0 conn(0x7f7ea814b1e0 0x7f7ea80c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:38.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.150+0000 7f7eada37640 1 -- 172.21.15.88:0/1123806693 >> v2:172.21.15.148:3300/0 conn(0x7f7ea814b1e0 msgr2=0x7f7ea80c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:38.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.150+0000 7f7eada37640 1 --2- 172.21.15.88:0/1123806693 >> v2:172.21.15.148:3300/0 conn(0x7f7ea814b1e0 0x7f7ea80c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:38.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.150+0000 7f7eada37640 1 -- 172.21.15.88:0/1123806693 >> v1:172.21.15.148:6789/0 conn(0x7f7ea8151280 legacy=0x7f7ea81516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:38.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.150+0000 7f7eada37640 1 -- 172.21.15.88:0/1123806693 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea80c0f00 con 0x7f7ea80c5300 2023-12-08T08:22:38.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.154+0000 7f7eada37640 1 --2- 172.21.15.88:0/1123806693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ea80c5300 0x7f7ea80a9c30 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7ea80c4150 tx=0x7f7e9801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbde7710453efc3b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:38.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.154+0000 7f7ead236640 1 -- 172.21.15.88:0/1123806693 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e980ab600 con 0x7f7ea80c5300 2023-12-08T08:22:38.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.154+0000 7f7ead236640 1 -- 172.21.15.88:0/1123806693 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e980a7050 con 0x7f7ea80c5300 2023-12-08T08:22:38.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.154+0000 7f7ead236640 1 -- 172.21.15.88:0/1123806693 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e980ab980 con 0x7f7ea80c5300 2023-12-08T08:22:38.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.154+0000 7f7eb049c640 1 -- 172.21.15.88:0/1123806693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ea80c5300 msgr2=0x7f7ea80a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:38.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.154+0000 7f7eb049c640 1 --2- 172.21.15.88:0/1123806693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ea80c5300 0x7f7ea80a9c30 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7ea80c4150 tx=0x7f7e9801c4c0 comp rx=0 tx=0).stop 2023-12-08T08:22:38.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.154+0000 7f7eb049c640 1 -- 172.21.15.88:0/1123806693 shutdown_connections 2023-12-08T08:22:38.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.154+0000 7f7eb049c640 1 --2- 172.21.15.88:0/1123806693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ea80c5300 0x7f7ea80a9c30 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:38.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.154+0000 7f7eb049c640 1 --2- 172.21.15.88:0/1123806693 >> v2:172.21.15.148:3300/0 conn(0x7f7ea814b1e0 0x7f7ea80c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:38.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.154+0000 7f7eb049c640 1 -- 172.21.15.88:0/1123806693 >> 172.21.15.88:0/1123806693 conn(0x7f7ea80c59f0 msgr2=0x7f7ea80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:38.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.154+0000 7f7eb049c640 1 -- 172.21.15.88:0/1123806693 shutdown_connections 2023-12-08T08:22:38.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.154+0000 7f7eb049c640 1 -- 172.21.15.88:0/1123806693 wait complete. 2023-12-08T08:22:38.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.154+0000 7f7eb049c640 1 Processor -- start 2023-12-08T08:22:38.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.154+0000 7f7eb049c640 1 -- start start 2023-12-08T08:22:38.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.158+0000 7f7eb049c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ea80c5300 0x7f7ea81454d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:38.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.158+0000 7f7eb049c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ea814b1e0 0x7f7ea806cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:38.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.158+0000 7f7eb049c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ea8151280 0x7f7ea806fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:38.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.158+0000 7f7eb049c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea81450b0 con 0x7f7ea8151280 2023-12-08T08:22:38.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.158+0000 7f7eb049c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea8145a10 con 0x7f7ea80c5300 2023-12-08T08:22:38.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.158+0000 7f7eb049c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea8144430 con 0x7f7ea814b1e0 2023-12-08T08:22:38.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.158+0000 7f7eaea39640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ea8151280 0x7f7ea806fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:38.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.158+0000 7f7eaea39640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ea8151280 0x7f7ea806fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57542/0 (socket says 172.21.15.88:57542) 2023-12-08T08:22:38.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.158+0000 7f7eaea39640 1 -- 172.21.15.88:0/3802603597 learned_addr learned my addr 172.21.15.88:0/3802603597 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:38.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.158+0000 7f7eae238640 1 --2- 172.21.15.88:0/3802603597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ea80c5300 0x7f7ea81454d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:38.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.158+0000 7f7eada37640 1 --2- 172.21.15.88:0/3802603597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ea814b1e0 0x7f7ea806cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:38.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.158+0000 7f7eaea39640 1 -- 172.21.15.88:0/3802603597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ea814b1e0 msgr2=0x7f7ea806cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:38.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.158+0000 7f7eaea39640 1 --2- 172.21.15.88:0/3802603597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ea814b1e0 0x7f7ea806cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:38.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.158+0000 7f7eaea39640 1 -- 172.21.15.88:0/3802603597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ea80c5300 msgr2=0x7f7ea81454d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:38.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.158+0000 7f7eaea39640 1 --2- 172.21.15.88:0/3802603597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ea80c5300 0x7f7ea81454d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:38.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.158+0000 7f7eaea39640 1 -- 172.21.15.88:0/3802603597 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e980094d0 con 0x7f7ea8151280 2023-12-08T08:22:38.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.158+0000 7f7eaea39640 1 --2- 172.21.15.88:0/3802603597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ea8151280 0x7f7ea806fac0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f7ea000b9a0 tx=0x7f7ea000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:38.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.158+0000 7f7e9effd640 1 -- 172.21.15.88:0/3802603597 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea000cba0 con 0x7f7ea8151280 2023-12-08T08:22:38.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.158+0000 7f7e9effd640 1 -- 172.21.15.88:0/3802603597 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea000cd00 con 0x7f7ea8151280 2023-12-08T08:22:38.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.158+0000 7f7eb049c640 1 -- 172.21.15.88:0/3802603597 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea8144710 con 0x7f7ea8151280 2023-12-08T08:22:38.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.158+0000 7f7e9effd640 1 -- 172.21.15.88:0/3802603597 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0014680 con 0x7f7ea8151280 2023-12-08T08:22:38.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.158+0000 7f7eb049c640 1 -- 172.21.15.88:0/3802603597 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea8144cd0 con 0x7f7ea8151280 2023-12-08T08:22:38.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.158+0000 7f7eb049c640 1 -- 172.21.15.88:0/3802603597 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea81451f0 con 0x7f7ea8151280 2023-12-08T08:22:38.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.158+0000 7f7e9effd640 1 -- 172.21.15.88:0/3802603597 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7ea001d3b0 con 0x7f7ea8151280 2023-12-08T08:22:38.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.162+0000 7f7e9effd640 1 --2- 172.21.15.88:0/3802603597 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7e8c066470 0x7f7e8c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:38.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.162+0000 7f7e9effd640 1 -- 172.21.15.88:0/3802603597 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7ea0083f10 con 0x7f7ea8151280 2023-12-08T08:22:38.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.162+0000 7f7eae238640 1 --2- 172.21.15.88:0/3802603597 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7e8c066470 0x7f7e8c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:38.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.162+0000 7f7eae238640 1 --2- 172.21.15.88:0/3802603597 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7e8c066470 0x7f7e8c068930 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4007a60 tx=0x7f7ea4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:38.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.166+0000 7f7e9effd640 1 -- 172.21.15.88:0/3802603597 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7ea81451f0 con 0x7f7ea8151280 2023-12-08T08:22:38.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.314+0000 7f7eb049c640 1 -- 172.21.15.88:0/3802603597 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7ea81451f0 con 0x7f7ea8151280 2023-12-08T08:22:38.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.318+0000 7f7e9effd640 1 -- 172.21.15.88:0/3802603597 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v54) v1 ==== 105+0+11 (secure 0 0 0) 0x7f7ea81451f0 con 0x7f7ea8151280 2023-12-08T08:22:38.321 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:22:38.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.318+0000 7f7eb049c640 1 -- 172.21.15.88:0/3802603597 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7e8c066470 msgr2=0x7f7e8c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:38.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.318+0000 7f7eb049c640 1 --2- 172.21.15.88:0/3802603597 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7e8c066470 0x7f7e8c068930 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4007a60 tx=0x7f7ea4008040 comp rx=0 tx=0).stop 2023-12-08T08:22:38.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.318+0000 7f7eb049c640 1 -- 172.21.15.88:0/3802603597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ea8151280 msgr2=0x7f7ea806fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:38.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.318+0000 7f7eb049c640 1 --2- 172.21.15.88:0/3802603597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ea8151280 0x7f7ea806fac0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f7ea000b9a0 tx=0x7f7ea000be60 comp rx=0 tx=0).stop 2023-12-08T08:22:38.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.318+0000 7f7eb049c640 1 -- 172.21.15.88:0/3802603597 shutdown_connections 2023-12-08T08:22:38.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.318+0000 7f7eb049c640 1 --2- 172.21.15.88:0/3802603597 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7e8c066470 0x7f7e8c068930 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:38.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.318+0000 7f7eb049c640 1 --2- 172.21.15.88:0/3802603597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ea8151280 0x7f7ea806fac0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:38.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.318+0000 7f7eb049c640 1 --2- 172.21.15.88:0/3802603597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ea814b1e0 0x7f7ea806cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:38.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.318+0000 7f7eb049c640 1 --2- 172.21.15.88:0/3802603597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ea80c5300 0x7f7ea81454d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:38.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.318+0000 7f7eb049c640 1 -- 172.21.15.88:0/3802603597 >> 172.21.15.88:0/3802603597 conn(0x7f7ea80c59f0 msgr2=0x7f7ea8146460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:38.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.318+0000 7f7eb049c640 1 -- 172.21.15.88:0/3802603597 shutdown_connections 2023-12-08T08:22:38.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.318+0000 7f7eb049c640 1 -- 172.21.15.88:0/3802603597 wait complete. 2023-12-08T08:22:38.342 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:22:38.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.478+0000 7f424ad10640 1 Processor -- start 2023-12-08T08:22:38.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.478+0000 7f424ad10640 1 -- start start 2023-12-08T08:22:38.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.478+0000 7f424ad10640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4244151a90 0x7f424406c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:38.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.478+0000 7f424ad10640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f42440c66b0 0x7f42440c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:38.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.478+0000 7f424ad10640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4244151e70 con 0x7f42440c9580 2023-12-08T08:22:38.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.478+0000 7f424ad10640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42440c5790 con 0x7f42440c66b0 2023-12-08T08:22:38.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.478+0000 7f424ad10640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42440c4e00 con 0x7f4244151a90 2023-12-08T08:22:38.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.478+0000 7f424950d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f42440c9580 0x7f42440c4620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41402/0 (socket says 172.21.15.88:41402) 2023-12-08T08:22:38.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.478+0000 7f424950d640 1 -- 172.21.15.88:0/250300062 learned_addr learned my addr 172.21.15.88:0/250300062 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:38.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.478+0000 7f424a50f640 1 --2- 172.21.15.88:0/250300062 >> v2:172.21.15.88:3300/0 conn(0x7f42440c66b0 0x7f42440c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:38.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.478+0000 7f4249d0e640 1 --2- 172.21.15.88:0/250300062 >> v2:172.21.15.148:3300/0 conn(0x7f4244151a90 0x7f424406c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:38.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.478+0000 7f4248d0c640 1 -- 172.21.15.88:0/250300062 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798702229 0 0) 0x7f4244151e70 con 0x7f42440c9580 2023-12-08T08:22:38.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.478+0000 7f4248d0c640 1 -- 172.21.15.88:0/250300062 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4230003530 con 0x7f42440c9580 2023-12-08T08:22:38.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.478+0000 7f424a50f640 1 -- 172.21.15.88:0/250300062 >> v2:172.21.15.148:3300/0 conn(0x7f4244151a90 msgr2=0x7f424406c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:38.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.478+0000 7f424a50f640 1 --2- 172.21.15.88:0/250300062 >> v2:172.21.15.148:3300/0 conn(0x7f4244151a90 0x7f424406c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:38.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.478+0000 7f424a50f640 1 -- 172.21.15.88:0/250300062 >> v1:172.21.15.88:6789/0 conn(0x7f42440c9580 legacy=0x7f42440c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:38.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.478+0000 7f424a50f640 1 -- 172.21.15.88:0/250300062 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42440c8aa0 con 0x7f42440c66b0 2023-12-08T08:22:38.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.482+0000 7f424a50f640 1 --2- 172.21.15.88:0/250300062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42440c66b0 0x7f42440c6ac0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f424408b650 tx=0x7f423c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0090f5025a0371 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:38.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.482+0000 7f4248d0c640 1 -- 172.21.15.88:0/250300062 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c0a5910 con 0x7f42440c66b0 2023-12-08T08:22:38.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.482+0000 7f4248d0c640 1 -- 172.21.15.88:0/250300062 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c0a5a70 con 0x7f42440c66b0 2023-12-08T08:22:38.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.482+0000 7f4248d0c640 1 -- 172.21.15.88:0/250300062 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c0a5e00 con 0x7f42440c66b0 2023-12-08T08:22:38.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.482+0000 7f424ad10640 1 -- 172.21.15.88:0/250300062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42440c66b0 msgr2=0x7f42440c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:38.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.482+0000 7f424ad10640 1 --2- 172.21.15.88:0/250300062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42440c66b0 0x7f42440c6ac0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f424408b650 tx=0x7f423c01c850 comp rx=0 tx=0).stop 2023-12-08T08:22:38.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.482+0000 7f424ad10640 1 -- 172.21.15.88:0/250300062 shutdown_connections 2023-12-08T08:22:38.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.482+0000 7f424ad10640 1 --2- 172.21.15.88:0/250300062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42440c66b0 0x7f42440c6ac0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:38.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.482+0000 7f424ad10640 1 --2- 172.21.15.88:0/250300062 >> v2:172.21.15.148:3300/0 conn(0x7f4244151a90 0x7f424406c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:38.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.482+0000 7f424ad10640 1 -- 172.21.15.88:0/250300062 >> 172.21.15.88:0/250300062 conn(0x7f42440ab9e0 msgr2=0x7f42440abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:38.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.482+0000 7f424ad10640 1 -- 172.21.15.88:0/250300062 shutdown_connections 2023-12-08T08:22:38.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.482+0000 7f424ad10640 1 -- 172.21.15.88:0/250300062 wait complete. 2023-12-08T08:22:38.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.486+0000 7f424ad10640 1 Processor -- start 2023-12-08T08:22:38.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.486+0000 7f424ad10640 1 -- start start 2023-12-08T08:22:38.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.486+0000 7f424ad10640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42440c66b0 0x7f42441f0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:38.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.486+0000 7f424ad10640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42440c9580 0x7f42441539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:38.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.486+0000 7f424ad10640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4244151a90 0x7f42441ec590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:38.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.486+0000 7f424ad10640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4244150720 con 0x7f42440c9580 2023-12-08T08:22:38.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.486+0000 7f424ad10640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42441f01f0 con 0x7f42440c66b0 2023-12-08T08:22:38.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.486+0000 7f424ad10640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42440ab2e0 con 0x7f4244151a90 2023-12-08T08:22:38.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.486+0000 7f424950d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42440c9580 0x7f42441539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:38.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.486+0000 7f424950d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42440c9580 0x7f42441539e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57560/0 (socket says 172.21.15.88:57560) 2023-12-08T08:22:38.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.486+0000 7f424950d640 1 -- 172.21.15.88:0/3706837725 learned_addr learned my addr 172.21.15.88:0/3706837725 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:38.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.486+0000 7f4249d0e640 1 --2- 172.21.15.88:0/3706837725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42440c66b0 0x7f42441f0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:38.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.486+0000 7f424a50f640 1 --2- 172.21.15.88:0/3706837725 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4244151a90 0x7f42441ec590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:38.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.486+0000 7f424950d640 1 -- 172.21.15.88:0/3706837725 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4244151a90 msgr2=0x7f42441ec590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:38.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.486+0000 7f424950d640 1 --2- 172.21.15.88:0/3706837725 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4244151a90 0x7f42441ec590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:38.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.486+0000 7f424950d640 1 -- 172.21.15.88:0/3706837725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42440c66b0 msgr2=0x7f42441f0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:38.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.486+0000 7f424950d640 1 --2- 172.21.15.88:0/3706837725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42440c66b0 0x7f42441f0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:38.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.486+0000 7f424950d640 1 -- 172.21.15.88:0/3706837725 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423c009a70 con 0x7f42440c9580 2023-12-08T08:22:38.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.486+0000 7f424950d640 1 --2- 172.21.15.88:0/3706837725 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42440c9580 0x7f42441539e0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f423400c4d0 tx=0x7f423400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:38.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.486+0000 7f423a7fc640 1 -- 172.21.15.88:0/3706837725 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4234005cf0 con 0x7f42440c9580 2023-12-08T08:22:38.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.486+0000 7f423a7fc640 1 -- 172.21.15.88:0/3706837725 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4234005e50 con 0x7f42440c9580 2023-12-08T08:22:38.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.486+0000 7f423a7fc640 1 -- 172.21.15.88:0/3706837725 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4234007270 con 0x7f42440c9580 2023-12-08T08:22:38.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.486+0000 7f424ad10640 1 -- 172.21.15.88:0/3706837725 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42441efba0 con 0x7f42440c9580 2023-12-08T08:22:38.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.486+0000 7f424ad10640 1 -- 172.21.15.88:0/3706837725 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42440ab5c0 con 0x7f42440c9580 2023-12-08T08:22:38.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.486+0000 7f424ad10640 1 -- 172.21.15.88:0/3706837725 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42440674b0 con 0x7f42440c9580 2023-12-08T08:22:38.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.490+0000 7f423a7fc640 1 -- 172.21.15.88:0/3706837725 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f42340073d0 con 0x7f42440c9580 2023-12-08T08:22:38.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.490+0000 7f423a7fc640 1 --2- 172.21.15.88:0/3706837725 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4228066470 0x7f4228068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:38.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.490+0000 7f423a7fc640 1 -- 172.21.15.88:0/3706837725 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4234083240 con 0x7f42440c9580 2023-12-08T08:22:38.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.490+0000 7f4249d0e640 1 --2- 172.21.15.88:0/3706837725 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4228066470 0x7f4228068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:38.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.490+0000 7f4249d0e640 1 --2- 172.21.15.88:0/3706837725 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4228066470 0x7f4228068930 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f42440aaa20 tx=0x7f4240008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:38.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.494+0000 7f423a7fc640 1 -- 172.21.15.88:0/3706837725 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4234050560 con 0x7f42440c9580 2023-12-08T08:22:38.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.642+0000 7f424ad10640 1 -- 172.21.15.88:0/3706837725 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f42440c7ba0 con 0x7f42440c9580 2023-12-08T08:22:38.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.646+0000 7f423a7fc640 1 -- 172.21.15.88:0/3706837725 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v54) v1 ==== 101+0+11 (secure 0 0 0) 0x7f4234053b80 con 0x7f42440c9580 2023-12-08T08:22:38.650 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:22:38.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.646+0000 7f424ad10640 1 -- 172.21.15.88:0/3706837725 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4228066470 msgr2=0x7f4228068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:38.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.646+0000 7f424ad10640 1 --2- 172.21.15.88:0/3706837725 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4228066470 0x7f4228068930 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f42440aaa20 tx=0x7f4240008040 comp rx=0 tx=0).stop 2023-12-08T08:22:38.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.646+0000 7f424ad10640 1 -- 172.21.15.88:0/3706837725 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42440c9580 msgr2=0x7f42441539e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:38.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.646+0000 7f424ad10640 1 --2- 172.21.15.88:0/3706837725 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42440c9580 0x7f42441539e0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f423400c4d0 tx=0x7f423400c990 comp rx=0 tx=0).stop 2023-12-08T08:22:38.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.646+0000 7f424ad10640 1 -- 172.21.15.88:0/3706837725 shutdown_connections 2023-12-08T08:22:38.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.646+0000 7f424ad10640 1 --2- 172.21.15.88:0/3706837725 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4228066470 0x7f4228068930 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:38.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.646+0000 7f424ad10640 1 --2- 172.21.15.88:0/3706837725 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4244151a90 0x7f42441ec590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:38.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.646+0000 7f424ad10640 1 --2- 172.21.15.88:0/3706837725 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42440c9580 0x7f42441539e0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:38.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.646+0000 7f424ad10640 1 --2- 172.21.15.88:0/3706837725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42440c66b0 0x7f42441f0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:38.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.646+0000 7f424ad10640 1 -- 172.21.15.88:0/3706837725 >> 172.21.15.88:0/3706837725 conn(0x7f42440ab9e0 msgr2=0x7f42441544c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:38.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.646+0000 7f424ad10640 1 -- 172.21.15.88:0/3706837725 shutdown_connections 2023-12-08T08:22:38.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.646+0000 7f424ad10640 1 -- 172.21.15.88:0/3706837725 wait complete. 2023-12-08T08:22:38.672 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:22:38.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.810+0000 7f852b268640 1 Processor -- start 2023-12-08T08:22:38.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.810+0000 7f852b268640 1 -- start start 2023-12-08T08:22:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.810+0000 7f852b268640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f85240af4c0 0x7f8524154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.810+0000 7f852b268640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f852406c100 0x7f85240c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.810+0000 7f852b268640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85240c4890 con 0x7f85240c67d0 2023-12-08T08:22:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.810+0000 7f852b268640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8524155460 con 0x7f852406c100 2023-12-08T08:22:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.810+0000 7f852b268640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85240af8a0 con 0x7f85240af4c0 2023-12-08T08:22:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.810+0000 7f8528803640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f85240c67d0 0x7f852406b9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41410/0 (socket says 172.21.15.88:41410) 2023-12-08T08:22:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.810+0000 7f8528803640 1 -- 172.21.15.88:0/3404471128 learned_addr learned my addr 172.21.15.88:0/3404471128 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:38.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.810+0000 7f8529805640 1 --2- 172.21.15.88:0/3404471128 >> v2:172.21.15.148:3300/0 conn(0x7f852406c100 0x7f85240c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:38.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.810+0000 7f8529004640 1 --2- 172.21.15.88:0/3404471128 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f85240af4c0 0x7f8524154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:38.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.810+0000 7f851bfff640 1 -- 172.21.15.88:0/3404471128 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060544005 0 0) 0x7f85240c4890 con 0x7f85240c67d0 2023-12-08T08:22:38.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.810+0000 7f851bfff640 1 -- 172.21.15.88:0/3404471128 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8510003530 con 0x7f85240c67d0 2023-12-08T08:22:38.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.810+0000 7f8529805640 1 -- 172.21.15.88:0/3404471128 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f85240af4c0 msgr2=0x7f8524154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:38.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.810+0000 7f8529805640 1 --2- 172.21.15.88:0/3404471128 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f85240af4c0 0x7f8524154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:38.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.810+0000 7f8529805640 1 -- 172.21.15.88:0/3404471128 >> v1:172.21.15.88:6789/0 conn(0x7f85240c67d0 legacy=0x7f852406b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:38.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.810+0000 7f8529805640 1 -- 172.21.15.88:0/3404471128 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85240c4b30 con 0x7f852406c100 2023-12-08T08:22:38.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.810+0000 7f8529004640 1 --2- 172.21.15.88:0/3404471128 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f85240af4c0 0x7f8524154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:22:38.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.814+0000 7f8529805640 1 --2- 172.21.15.88:0/3404471128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f852406c100 0x7f85240c6c50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f851c009d90 tx=0x7f851c01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7d34bd7c2e744c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:38.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.814+0000 7f851bfff640 1 -- 172.21.15.88:0/3404471128 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c0a5950 con 0x7f852406c100 2023-12-08T08:22:38.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.814+0000 7f851bfff640 1 -- 172.21.15.88:0/3404471128 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851c0a5ab0 con 0x7f852406c100 2023-12-08T08:22:38.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.814+0000 7f851bfff640 1 -- 172.21.15.88:0/3404471128 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c0a5e40 con 0x7f852406c100 2023-12-08T08:22:38.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.814+0000 7f852b268640 1 -- 172.21.15.88:0/3404471128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f852406c100 msgr2=0x7f85240c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:38.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.814+0000 7f852b268640 1 --2- 172.21.15.88:0/3404471128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f852406c100 0x7f85240c6c50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f851c009d90 tx=0x7f851c01c890 comp rx=0 tx=0).stop 2023-12-08T08:22:38.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.814+0000 7f852b268640 1 -- 172.21.15.88:0/3404471128 shutdown_connections 2023-12-08T08:22:38.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.814+0000 7f852b268640 1 --2- 172.21.15.88:0/3404471128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f852406c100 0x7f85240c6c50 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:38.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.814+0000 7f852b268640 1 --2- 172.21.15.88:0/3404471128 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f85240af4c0 0x7f8524154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:38.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.814+0000 7f852b268640 1 -- 172.21.15.88:0/3404471128 >> 172.21.15.88:0/3404471128 conn(0x7f85240ab9d0 msgr2=0x7f85240abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:38.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.814+0000 7f852b268640 1 -- 172.21.15.88:0/3404471128 shutdown_connections 2023-12-08T08:22:38.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.814+0000 7f852b268640 1 -- 172.21.15.88:0/3404471128 wait complete. 2023-12-08T08:22:38.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.818+0000 7f852b268640 1 Processor -- start 2023-12-08T08:22:38.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.818+0000 7f852b268640 1 -- start start 2023-12-08T08:22:38.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.818+0000 7f852b268640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f852406c100 0x7f8524154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:38.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.818+0000 7f852b268640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85240af4c0 0x7f85241f0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:38.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.818+0000 7f852b268640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85240c67d0 0x7f85241561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:38.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.818+0000 7f852b268640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852414cd60 con 0x7f85240c67d0 2023-12-08T08:22:38.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.818+0000 7f852b268640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85241f09b0 con 0x7f85240af4c0 2023-12-08T08:22:38.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.818+0000 7f852b268640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8524152930 con 0x7f852406c100 2023-12-08T08:22:38.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.818+0000 7f8529805640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85240c67d0 0x7f85241561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:38.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.818+0000 7f8529805640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85240c67d0 0x7f85241561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57572/0 (socket says 172.21.15.88:57572) 2023-12-08T08:22:38.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.818+0000 7f8529805640 1 -- 172.21.15.88:0/2190594360 learned_addr learned my addr 172.21.15.88:0/2190594360 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:38.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.818+0000 7f8529004640 1 --2- 172.21.15.88:0/2190594360 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f852406c100 0x7f8524154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:38.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.818+0000 7f8528803640 1 --2- 172.21.15.88:0/2190594360 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85240af4c0 0x7f85241f0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:38.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.818+0000 7f8529805640 1 -- 172.21.15.88:0/2190594360 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f852406c100 msgr2=0x7f8524154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:38.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.818+0000 7f8529805640 1 --2- 172.21.15.88:0/2190594360 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f852406c100 0x7f8524154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:38.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.818+0000 7f8529805640 1 -- 172.21.15.88:0/2190594360 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85240af4c0 msgr2=0x7f85241f0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:38.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.818+0000 7f8529805640 1 --2- 172.21.15.88:0/2190594360 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85240af4c0 0x7f85241f0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:38.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.818+0000 7f8529805640 1 -- 172.21.15.88:0/2190594360 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8520009420 con 0x7f85240c67d0 2023-12-08T08:22:38.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.818+0000 7f8528803640 1 --2- 172.21.15.88:0/2190594360 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85240af4c0 0x7f85241f0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:38.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.818+0000 7f8529805640 1 --2- 172.21.15.88:0/2190594360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85240c67d0 0x7f85241561d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f851c0b0040 tx=0x7f851c019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:38.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.818+0000 7f8519ffb640 1 -- 172.21.15.88:0/2190594360 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c0adce0 con 0x7f85240c67d0 2023-12-08T08:22:38.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.818+0000 7f8519ffb640 1 -- 172.21.15.88:0/2190594360 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851c0ade40 con 0x7f85240c67d0 2023-12-08T08:22:38.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.818+0000 7f852b268640 1 -- 172.21.15.88:0/2190594360 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f851c009a70 con 0x7f85240c67d0 2023-12-08T08:22:38.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.818+0000 7f8519ffb640 1 -- 172.21.15.88:0/2190594360 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c0b9690 con 0x7f85240c67d0 2023-12-08T08:22:38.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.822+0000 7f852b268640 1 -- 172.21.15.88:0/2190594360 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85240c3830 con 0x7f85240c67d0 2023-12-08T08:22:38.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.822+0000 7f852b268640 1 -- 172.21.15.88:0/2190594360 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8524067630 con 0x7f85240c67d0 2023-12-08T08:22:38.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.822+0000 7f8519ffb640 1 -- 172.21.15.88:0/2190594360 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f851c0b97f0 con 0x7f85240c67d0 2023-12-08T08:22:38.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.822+0000 7f8519ffb640 1 --2- 172.21.15.88:0/2190594360 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8508066470 0x7f8508068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:38.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.822+0000 7f8519ffb640 1 -- 172.21.15.88:0/2190594360 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f851c11f7b0 con 0x7f85240c67d0 2023-12-08T08:22:38.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.822+0000 7f8529004640 1 --2- 172.21.15.88:0/2190594360 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8508066470 0x7f8508068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:38.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.822+0000 7f8529004640 1 --2- 172.21.15.88:0/2190594360 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8508066470 0x7f8508068930 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8520009cf0 tx=0x7f8520009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:38.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:38.826+0000 7f8519ffb640 1 -- 172.21.15.88:0/2190594360 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f851c0ec8c0 con 0x7f85240c67d0 2023-12-08T08:22:39.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.006+0000 7f852b268640 1 -- 172.21.15.88:0/2190594360 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f852414f9e0 con 0x7f85240c67d0 2023-12-08T08:22:39.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.006+0000 7f8519ffb640 1 -- 172.21.15.88:0/2190594360 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6135 (secure 0 0 0) 0x7f851c009450 con 0x7f85240c67d0 2023-12-08T08:22:39.013 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:39.013 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5240,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/2576328340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2576328340},{"type":"v1","addr":"172.21.15.148:6834","nonce":2576328340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5626,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/1685449423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1685449423},{"type":"v1","addr":"172.21.15.88:6836","nonce":1685449423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:22:02.420431+0000","modified":"2023-12-08T08:22:05.454472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5793},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5793":{"gid":5793,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/4167133153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":4167133153},{"type":"v1","addr":"172.21.15.88:6837","nonce":4167133153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:22:19.959416+0000","modified":"2023-12-08T08:22:22.972913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5635},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5635":{"gid":5635,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":7,"addr":"172.21.15.148:6835/604820378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":604820378},{"type":"v1","addr":"172.21.15.148:6835","nonce":604820378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-08T08:22:39.014 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 37 2023-12-08T08:22:39.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.010+0000 7f852b268640 1 -- 172.21.15.88:0/2190594360 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8508066470 msgr2=0x7f8508068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:39.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.010+0000 7f852b268640 1 --2- 172.21.15.88:0/2190594360 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8508066470 0x7f8508068930 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8520009cf0 tx=0x7f8520009190 comp rx=0 tx=0).stop 2023-12-08T08:22:39.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.010+0000 7f852b268640 1 -- 172.21.15.88:0/2190594360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85240c67d0 msgr2=0x7f85241561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:39.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.010+0000 7f852b268640 1 --2- 172.21.15.88:0/2190594360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85240c67d0 0x7f85241561d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f851c0b0040 tx=0x7f851c019630 comp rx=0 tx=0).stop 2023-12-08T08:22:39.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.010+0000 7f852b268640 1 -- 172.21.15.88:0/2190594360 shutdown_connections 2023-12-08T08:22:39.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.010+0000 7f852b268640 1 --2- 172.21.15.88:0/2190594360 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8508066470 0x7f8508068930 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.010+0000 7f852b268640 1 --2- 172.21.15.88:0/2190594360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85240c67d0 0x7f85241561d0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.010+0000 7f852b268640 1 --2- 172.21.15.88:0/2190594360 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85240af4c0 0x7f85241f0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.010+0000 7f852b268640 1 --2- 172.21.15.88:0/2190594360 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f852406c100 0x7f8524154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.010+0000 7f852b268640 1 -- 172.21.15.88:0/2190594360 >> 172.21.15.88:0/2190594360 conn(0x7f85240ab9d0 msgr2=0x7f85240aad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:39.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.010+0000 7f852b268640 1 -- 172.21.15.88:0/2190594360 shutdown_connections 2023-12-08T08:22:39.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.010+0000 7f852b268640 1 -- 172.21.15.88:0/2190594360 wait complete. 2023-12-08T08:22:39.034 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:22:39.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.170+0000 7f9de9a16640 1 Processor -- start 2023-12-08T08:22:39.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.170+0000 7f9de9a16640 1 -- start start 2023-12-08T08:22:39.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.170+0000 7f9de9a16640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9de4154fd0 0x7f9de41584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:39.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.170+0000 7f9de9a16640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9de40ca190 0x7f9de40ca600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:39.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.170+0000 7f9de9a16640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de40c5140 con 0x7f9de414e570 2023-12-08T08:22:39.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.170+0000 7f9de9a16640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9de40c4b80 con 0x7f9de40ca190 2023-12-08T08:22:39.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.170+0000 7f9de9a16640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de40c4e60 con 0x7f9de4154fd0 2023-12-08T08:22:39.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.174+0000 7f9dda7fc640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9de4154fd0 0x7f9de41584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:39.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.174+0000 7f9dda7fc640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9de4154fd0 0x7f9de41584e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:38664/0 (socket says 172.21.15.88:38664) 2023-12-08T08:22:39.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.174+0000 7f9dda7fc640 1 -- 172.21.15.88:0/2743434328 learned_addr learned my addr 172.21.15.88:0/2743434328 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:39.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.174+0000 7f9de37fe640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9de40ca190 0x7f9de40ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:39.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.174+0000 7f9dda7fc640 1 -- 172.21.15.88:0/2743434328 >> v2:172.21.15.148:3300/0 conn(0x7f9de40ca190 msgr2=0x7f9de40ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:39.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.174+0000 7f9dda7fc640 1 --2- 172.21.15.88:0/2743434328 >> v2:172.21.15.148:3300/0 conn(0x7f9de40ca190 0x7f9de40ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.174+0000 7f9dda7fc640 1 -- 172.21.15.88:0/2743434328 >> v1:172.21.15.148:6789/0 conn(0x7f9de414e570 legacy=0x7f9de40c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:39.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.174+0000 7f9dda7fc640 1 -- 172.21.15.88:0/2743434328 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de4157ce0 con 0x7f9de4154fd0 2023-12-08T08:22:39.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.174+0000 7f9dda7fc640 1 --2- 172.21.15.88:0/2743434328 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9de4154fd0 0x7f9de41584e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc009e50 tx=0x7f9dcc01c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=677933006e23b207 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:39.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.174+0000 7f9de27fc640 1 -- 172.21.15.88:0/2743434328 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc0a5830 con 0x7f9de4154fd0 2023-12-08T08:22:39.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.178+0000 7f9de27fc640 1 -- 172.21.15.88:0/2743434328 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dcc0a5990 con 0x7f9de4154fd0 2023-12-08T08:22:39.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.178+0000 7f9de27fc640 1 -- 172.21.15.88:0/2743434328 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc0a5d20 con 0x7f9de4154fd0 2023-12-08T08:22:39.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.178+0000 7f9de9a16640 1 -- 172.21.15.88:0/2743434328 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9de4154fd0 msgr2=0x7f9de41584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:39.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.178+0000 7f9de9a16640 1 --2- 172.21.15.88:0/2743434328 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9de4154fd0 0x7f9de41584e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc009e50 tx=0x7f9dcc01c950 comp rx=0 tx=0).stop 2023-12-08T08:22:39.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.178+0000 7f9de9a16640 1 -- 172.21.15.88:0/2743434328 shutdown_connections 2023-12-08T08:22:39.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.178+0000 7f9de9a16640 1 --2- 172.21.15.88:0/2743434328 >> v2:172.21.15.148:3300/0 conn(0x7f9de40ca190 0x7f9de40ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.178+0000 7f9de9a16640 1 --2- 172.21.15.88:0/2743434328 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9de4154fd0 0x7f9de41584e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.178+0000 7f9de9a16640 1 -- 172.21.15.88:0/2743434328 >> 172.21.15.88:0/2743434328 conn(0x7f9de40abb10 msgr2=0x7f9de40abf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:39.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.178+0000 7f9de9a16640 1 -- 172.21.15.88:0/2743434328 shutdown_connections 2023-12-08T08:22:39.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.178+0000 7f9de9a16640 1 -- 172.21.15.88:0/2743434328 wait complete. 2023-12-08T08:22:39.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.178+0000 7f9de9a16640 1 Processor -- start 2023-12-08T08:22:39.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.178+0000 7f9de9a16640 1 -- start start 2023-12-08T08:22:39.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.178+0000 7f9de9a16640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9de40ca190 0x7f9de40ab060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:39.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.178+0000 7f9de9a16640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9de414e570 0x7f9de40ace90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:39.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.178+0000 7f9de9a16640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9de4154fd0 0x7f9de41ecbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:39.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.178+0000 7f9de9a16640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de40afb30 con 0x7f9de414e570 2023-12-08T08:22:39.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.178+0000 7f9de9a16640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de414da70 con 0x7f9de40ca190 2023-12-08T08:22:39.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.178+0000 7f9de9a16640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de40af5b0 con 0x7f9de4154fd0 2023-12-08T08:22:39.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.178+0000 7f9dda7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9de414e570 0x7f9de40ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:39.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.178+0000 7f9dda7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9de414e570 0x7f9de40ace90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57586/0 (socket says 172.21.15.88:57586) 2023-12-08T08:22:39.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.178+0000 7f9dda7fc640 1 -- 172.21.15.88:0/659133981 learned_addr learned my addr 172.21.15.88:0/659133981 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:39.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.178+0000 7f9de37fe640 1 --2- 172.21.15.88:0/659133981 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9de4154fd0 0x7f9de41ecbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:39.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.178+0000 7f9de2ffd640 1 --2- 172.21.15.88:0/659133981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9de40ca190 0x7f9de40ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:39.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.182+0000 7f9dda7fc640 1 -- 172.21.15.88:0/659133981 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9de4154fd0 msgr2=0x7f9de41ecbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:39.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.182+0000 7f9dda7fc640 1 --2- 172.21.15.88:0/659133981 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9de4154fd0 0x7f9de41ecbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.182+0000 7f9dda7fc640 1 -- 172.21.15.88:0/659133981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9de40ca190 msgr2=0x7f9de40ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:39.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.182+0000 7f9dda7fc640 1 --2- 172.21.15.88:0/659133981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9de40ca190 0x7f9de40ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.182+0000 7f9dda7fc640 1 -- 172.21.15.88:0/659133981 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc009b30 con 0x7f9de414e570 2023-12-08T08:22:39.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.182+0000 7f9de2ffd640 1 --2- 172.21.15.88:0/659133981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9de40ca190 0x7f9de40ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:39.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.182+0000 7f9dda7fc640 1 --2- 172.21.15.88:0/659133981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9de414e570 0x7f9de40ace90 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc01b000 tx=0x7f9dcc0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:39.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.182+0000 7f9de0ff9640 1 -- 172.21.15.88:0/659133981 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc0b8650 con 0x7f9de414e570 2023-12-08T08:22:39.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.182+0000 7f9de0ff9640 1 -- 172.21.15.88:0/659133981 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dcc0b87d0 con 0x7f9de414e570 2023-12-08T08:22:39.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.182+0000 7f9de0ff9640 1 -- 172.21.15.88:0/659133981 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc0b8b80 con 0x7f9de414e570 2023-12-08T08:22:39.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.182+0000 7f9de9a16640 1 -- 172.21.15.88:0/659133981 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de41ec5d0 con 0x7f9de414e570 2023-12-08T08:22:39.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.182+0000 7f9de9a16640 1 -- 172.21.15.88:0/659133981 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de414d2e0 con 0x7f9de414e570 2023-12-08T08:22:39.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.182+0000 7f9de9a16640 1 -- 172.21.15.88:0/659133981 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de4067630 con 0x7f9de414e570 2023-12-08T08:22:39.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.182+0000 7f9de0ff9640 1 -- 172.21.15.88:0/659133981 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9dcc0b8ce0 con 0x7f9de414e570 2023-12-08T08:22:39.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.182+0000 7f9de0ff9640 1 --2- 172.21.15.88:0/659133981 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9dc4066470 0x7f9dc4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:39.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.182+0000 7f9de0ff9640 1 -- 172.21.15.88:0/659133981 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9dcc11ed40 con 0x7f9de414e570 2023-12-08T08:22:39.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.182+0000 7f9de2ffd640 1 --2- 172.21.15.88:0/659133981 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9dc4066470 0x7f9dc4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:39.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.186+0000 7f9de2ffd640 1 --2- 172.21.15.88:0/659133981 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9dc4066470 0x7f9dc4068930 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4000f70 tx=0x7f9dd4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:39.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.186+0000 7f9de0ff9640 1 -- 172.21.15.88:0/659133981 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9dcc0ebfa0 con 0x7f9de414e570 2023-12-08T08:22:39.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.338+0000 7f9de9a16640 1 -- 172.21.15.88:0/659133981 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9de406c830 con 0x7f9de414e570 2023-12-08T08:22:39.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.338+0000 7f9de0ff9640 1 -- 172.21.15.88:0/659133981 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20256 (secure 0 0 0) 0x7f9dcc0ef5c0 con 0x7f9de414e570 2023-12-08T08:22:39.345 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:39.345 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":54,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:22:21.530364+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:00.520254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:01.423493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:22:17.787562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:22:18.955273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:22:39.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.342+0000 7f9de9a16640 1 -- 172.21.15.88:0/659133981 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9dc4066470 msgr2=0x7f9dc4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:39.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.342+0000 7f9de9a16640 1 --2- 172.21.15.88:0/659133981 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9dc4066470 0x7f9dc4068930 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4000f70 tx=0x7f9dd4009040 comp rx=0 tx=0).stop 2023-12-08T08:22:39.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.342+0000 7f9de9a16640 1 -- 172.21.15.88:0/659133981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9de414e570 msgr2=0x7f9de40ace90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:39.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.342+0000 7f9de9a16640 1 --2- 172.21.15.88:0/659133981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9de414e570 0x7f9de40ace90 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc01b000 tx=0x7f9dcc0196f0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.342+0000 7f9de9a16640 1 -- 172.21.15.88:0/659133981 shutdown_connections 2023-12-08T08:22:39.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.342+0000 7f9de9a16640 1 --2- 172.21.15.88:0/659133981 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9dc4066470 0x7f9dc4068930 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.342+0000 7f9de9a16640 1 --2- 172.21.15.88:0/659133981 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9de4154fd0 0x7f9de41ecbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.342+0000 7f9de9a16640 1 --2- 172.21.15.88:0/659133981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9de414e570 0x7f9de40ace90 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.342+0000 7f9de9a16640 1 --2- 172.21.15.88:0/659133981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9de40ca190 0x7f9de40ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.342+0000 7f9de9a16640 1 -- 172.21.15.88:0/659133981 >> 172.21.15.88:0/659133981 conn(0x7f9de40abb10 msgr2=0x7f9de415e190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:39.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.342+0000 7f9de9a16640 1 -- 172.21.15.88:0/659133981 shutdown_connections 2023-12-08T08:22:39.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.342+0000 7f9de9a16640 1 -- 172.21.15.88:0/659133981 wait complete. 2023-12-08T08:22:39.366 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-08T08:22:39.367 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:22:39.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.498+0000 7f247ece3640 1 Processor -- start 2023-12-08T08:22:39.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.498+0000 7f247ece3640 1 -- start start 2023-12-08T08:22:39.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.502+0000 7f247ece3640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f247814fd10 0x7f24780a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:39.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.502+0000 7f247ece3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2478156110 0x7f2478156580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:39.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.502+0000 7f247ece3640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24780c5710 con 0x7f24780a5300 2023-12-08T08:22:39.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.502+0000 7f247ece3640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f247806c5e0 con 0x7f2478156110 2023-12-08T08:22:39.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.502+0000 7f247ece3640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2478155c80 con 0x7f247814fd10 2023-12-08T08:22:39.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.502+0000 7f247d280640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2478156110 0x7f2478156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:39.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.502+0000 7f247d280640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2478156110 0x7f2478156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57588/0 (socket says 172.21.15.88:57588) 2023-12-08T08:22:39.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.502+0000 7f247d280640 1 -- 172.21.15.88:0/3330345026 learned_addr learned my addr 172.21.15.88:0/3330345026 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:39.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.502+0000 7f247ca7f640 1 --2- 172.21.15.88:0/3330345026 >> v2:172.21.15.148:3300/0 conn(0x7f247814fd10 0x7f24780a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:39.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.502+0000 7f247d280640 1 -- 172.21.15.88:0/3330345026 >> v2:172.21.15.148:3300/0 conn(0x7f247814fd10 msgr2=0x7f24780a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:39.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.502+0000 7f247d280640 1 --2- 172.21.15.88:0/3330345026 >> v2:172.21.15.148:3300/0 conn(0x7f247814fd10 0x7f24780a4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.502+0000 7f247d280640 1 -- 172.21.15.88:0/3330345026 >> v1:172.21.15.148:6789/0 conn(0x7f24780a5300 legacy=0x7f2478071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:39.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.502+0000 7f247d280640 1 -- 172.21.15.88:0/3330345026 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24780c4e70 con 0x7f2478156110 2023-12-08T08:22:39.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.506+0000 7f247d280640 1 --2- 172.21.15.88:0/3330345026 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2478156110 0x7f2478156580 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f247806b5a0 tx=0x7f247001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf793beba2e9453 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:39.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.506+0000 7f246f7fe640 1 -- 172.21.15.88:0/3330345026 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24700a5730 con 0x7f2478156110 2023-12-08T08:22:39.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.506+0000 7f246f7fe640 1 -- 172.21.15.88:0/3330345026 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24700a5890 con 0x7f2478156110 2023-12-08T08:22:39.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.506+0000 7f246f7fe640 1 -- 172.21.15.88:0/3330345026 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24700a5c20 con 0x7f2478156110 2023-12-08T08:22:39.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.506+0000 7f247ece3640 1 -- 172.21.15.88:0/3330345026 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2478156110 msgr2=0x7f2478156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:39.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.506+0000 7f247ece3640 1 --2- 172.21.15.88:0/3330345026 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2478156110 0x7f2478156580 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f247806b5a0 tx=0x7f247001c870 comp rx=0 tx=0).stop 2023-12-08T08:22:39.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.506+0000 7f247ece3640 1 -- 172.21.15.88:0/3330345026 shutdown_connections 2023-12-08T08:22:39.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.506+0000 7f247ece3640 1 --2- 172.21.15.88:0/3330345026 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2478156110 0x7f2478156580 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.506+0000 7f247ece3640 1 --2- 172.21.15.88:0/3330345026 >> v2:172.21.15.148:3300/0 conn(0x7f247814fd10 0x7f24780a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.506+0000 7f247ece3640 1 -- 172.21.15.88:0/3330345026 >> 172.21.15.88:0/3330345026 conn(0x7f24780a7810 msgr2=0x7f24780a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:39.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.506+0000 7f247ece3640 1 -- 172.21.15.88:0/3330345026 shutdown_connections 2023-12-08T08:22:39.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.506+0000 7f247ece3640 1 -- 172.21.15.88:0/3330345026 wait complete. 2023-12-08T08:22:39.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.506+0000 7f247ece3640 1 Processor -- start 2023-12-08T08:22:39.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.506+0000 7f247ece3640 1 -- start start 2023-12-08T08:22:39.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.506+0000 7f247ece3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24780a5300 0x7f24781eaa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:39.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.506+0000 7f247ece3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f247814fd10 0x7f24781497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:39.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.506+0000 7f247ece3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2478156110 0x7f2478154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:39.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.506+0000 7f247ece3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24781478e0 con 0x7f247814fd10 2023-12-08T08:22:39.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.506+0000 7f247ece3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247814bec0 con 0x7f24780a5300 2023-12-08T08:22:39.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.506+0000 7f247ece3640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2478143b20 con 0x7f2478156110 2023-12-08T08:22:39.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.510+0000 7f246ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f247814fd10 0x7f24781497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:39.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.510+0000 7f247ca7f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24780a5300 0x7f24781eaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:39.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.510+0000 7f247ca7f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24780a5300 0x7f24781eaa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:57646/0 (socket says 172.21.15.88:57646) 2023-12-08T08:22:39.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.510+0000 7f247ca7f640 1 -- 172.21.15.88:0/141399776 learned_addr learned my addr 172.21.15.88:0/141399776 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:39.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.510+0000 7f247d280640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2478156110 0x7f2478154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:39.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.510+0000 7f247ca7f640 1 -- 172.21.15.88:0/141399776 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2478156110 msgr2=0x7f2478154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:39.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.510+0000 7f247ca7f640 1 --2- 172.21.15.88:0/141399776 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2478156110 0x7f2478154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.510+0000 7f247ca7f640 1 -- 172.21.15.88:0/141399776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f247814fd10 msgr2=0x7f24781497a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:39.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.510+0000 7f247ca7f640 1 --2- 172.21.15.88:0/141399776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f247814fd10 0x7f24781497a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.510+0000 7f247ca7f640 1 -- 172.21.15.88:0/141399776 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2470009b30 con 0x7f24780a5300 2023-12-08T08:22:39.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.510+0000 7f246ffff640 1 --2- 172.21.15.88:0/141399776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f247814fd10 0x7f24781497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:22:39.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.510+0000 7f247ca7f640 1 --2- 172.21.15.88:0/141399776 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24780a5300 0x7f24781eaa50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f247400d800 tx=0x7f247400dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:39.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.510+0000 7f246d7fa640 1 -- 172.21.15.88:0/141399776 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247400b6c0 con 0x7f24780a5300 2023-12-08T08:22:39.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.510+0000 7f246d7fa640 1 -- 172.21.15.88:0/141399776 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247400b860 con 0x7f24780a5300 2023-12-08T08:22:39.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.510+0000 7f246d7fa640 1 -- 172.21.15.88:0/141399776 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247400bc10 con 0x7f24780a5300 2023-12-08T08:22:39.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.510+0000 7f247ece3640 1 -- 172.21.15.88:0/141399776 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24781eb370 con 0x7f24780a5300 2023-12-08T08:22:39.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.510+0000 7f247ece3640 1 -- 172.21.15.88:0/141399776 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2478147290 con 0x7f24780a5300 2023-12-08T08:22:39.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.510+0000 7f247ece3640 1 -- 172.21.15.88:0/141399776 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2478067630 con 0x7f24780a5300 2023-12-08T08:22:39.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.510+0000 7f246d7fa640 1 -- 172.21.15.88:0/141399776 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f247401e460 con 0x7f24780a5300 2023-12-08T08:22:39.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.514+0000 7f246d7fa640 1 --2- 172.21.15.88:0/141399776 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2464066470 0x7f2464068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:39.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.514+0000 7f246d7fa640 1 -- 172.21.15.88:0/141399776 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2474085360 con 0x7f24780a5300 2023-12-08T08:22:39.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.514+0000 7f246ffff640 1 --2- 172.21.15.88:0/141399776 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2464066470 0x7f2464068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:39.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.514+0000 7f246ffff640 1 --2- 172.21.15.88:0/141399776 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2464066470 0x7f2464068930 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2478154b40 tx=0x7f2468007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:39.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.514+0000 7f246d7fa640 1 -- 172.21.15.88:0/141399776 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f24740525a0 con 0x7f24780a5300 2023-12-08T08:22:39.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.702+0000 7f247ece3640 1 -- 172.21.15.88:0/141399776 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24781405e0 con 0x7f24780a5300 2023-12-08T08:22:39.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.702+0000 7f246d7fa640 1 -- 172.21.15.88:0/141399776 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6135 (secure 0 0 0) 0x7f2474055bc0 con 0x7f24780a5300 2023-12-08T08:22:39.707 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:39.707 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5240,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/2576328340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2576328340},{"type":"v1","addr":"172.21.15.148:6834","nonce":2576328340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5626,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/1685449423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1685449423},{"type":"v1","addr":"172.21.15.88:6836","nonce":1685449423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:22:02.420431+0000","modified":"2023-12-08T08:22:05.454472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5793},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5793":{"gid":5793,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/4167133153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":4167133153},{"type":"v1","addr":"172.21.15.88:6837","nonce":4167133153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:22:19.959416+0000","modified":"2023-12-08T08:22:22.972913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5635},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5635":{"gid":5635,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":7,"addr":"172.21.15.148:6835/604820378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":604820378},{"type":"v1","addr":"172.21.15.148:6835","nonce":604820378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-08T08:22:39.707 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 37 2023-12-08T08:22:39.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.702+0000 7f247ece3640 1 -- 172.21.15.88:0/141399776 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2464066470 msgr2=0x7f2464068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:39.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.702+0000 7f247ece3640 1 --2- 172.21.15.88:0/141399776 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2464066470 0x7f2464068930 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2478154b40 tx=0x7f2468007e40 comp rx=0 tx=0).stop 2023-12-08T08:22:39.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.702+0000 7f247ece3640 1 -- 172.21.15.88:0/141399776 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24780a5300 msgr2=0x7f24781eaa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:39.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.702+0000 7f247ece3640 1 --2- 172.21.15.88:0/141399776 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24780a5300 0x7f24781eaa50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f247400d800 tx=0x7f247400dcc0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.702+0000 7f247ece3640 1 -- 172.21.15.88:0/141399776 shutdown_connections 2023-12-08T08:22:39.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.702+0000 7f247ece3640 1 --2- 172.21.15.88:0/141399776 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2464066470 0x7f2464068930 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.702+0000 7f247ece3640 1 --2- 172.21.15.88:0/141399776 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2478156110 0x7f2478154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.702+0000 7f247ece3640 1 --2- 172.21.15.88:0/141399776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f247814fd10 0x7f24781497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.702+0000 7f247ece3640 1 --2- 172.21.15.88:0/141399776 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24780a5300 0x7f24781eaa50 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.702+0000 7f247ece3640 1 -- 172.21.15.88:0/141399776 >> 172.21.15.88:0/141399776 conn(0x7f24780a7810 msgr2=0x7f24780a59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:39.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.702+0000 7f247ece3640 1 -- 172.21.15.88:0/141399776 shutdown_connections 2023-12-08T08:22:39.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.702+0000 7f247ece3640 1 -- 172.21.15.88:0/141399776 wait complete. 2023-12-08T08:22:39.728 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:22:39.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.862+0000 7f0096c68640 1 Processor -- start 2023-12-08T08:22:39.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.862+0000 7f0096c68640 1 -- start start 2023-12-08T08:22:39.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.862+0000 7f0096c68640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f009006bef0 0x7f00900bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:39.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.862+0000 7f0096c68640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f009006c5b0 0x7f009006ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:39.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.862+0000 7f0096c68640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0090151690 con 0x7f009014e3f0 2023-12-08T08:22:39.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.862+0000 7f0096c68640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0090151bc0 con 0x7f009006c5b0 2023-12-08T08:22:39.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.862+0000 7f0096c68640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00901518e0 con 0x7f009006bef0 2023-12-08T08:22:39.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.862+0000 7f0095205640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f009006c5b0 0x7f009006ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:39.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.862+0000 7f0095205640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f009006c5b0 0x7f009006ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57600/0 (socket says 172.21.15.88:57600) 2023-12-08T08:22:39.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.862+0000 7f0095205640 1 -- 172.21.15.88:0/2093677954 learned_addr learned my addr 172.21.15.88:0/2093677954 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:39.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.862+0000 7f008ffff640 1 --2- 172.21.15.88:0/2093677954 >> v2:172.21.15.148:3300/0 conn(0x7f009006bef0 0x7f00900bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:39.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.862+0000 7f0095205640 1 -- 172.21.15.88:0/2093677954 >> v2:172.21.15.148:3300/0 conn(0x7f009006bef0 msgr2=0x7f00900bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:39.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.862+0000 7f0095205640 1 --2- 172.21.15.88:0/2093677954 >> v2:172.21.15.148:3300/0 conn(0x7f009006bef0 0x7f00900bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.862+0000 7f0095205640 1 -- 172.21.15.88:0/2093677954 >> v1:172.21.15.148:6789/0 conn(0x7f009014e3f0 legacy=0x7f00900c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:39.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.862+0000 7f0095205640 1 -- 172.21.15.88:0/2093677954 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00900c1de0 con 0x7f009006c5b0 2023-12-08T08:22:39.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.862+0000 7f008ffff640 1 --2- 172.21.15.88:0/2093677954 >> v2:172.21.15.148:3300/0 conn(0x7f009006bef0 0x7f00900bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:39.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.866+0000 7f0095205640 1 --2- 172.21.15.88:0/2093677954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f009006c5b0 0x7f009006ca20 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f009006b520 tx=0x7f008801d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386b471f34686ac7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:39.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.866+0000 7f008f7fe640 1 -- 172.21.15.88:0/2093677954 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008800a2d0 con 0x7f009006c5b0 2023-12-08T08:22:39.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.866+0000 7f008f7fe640 1 -- 172.21.15.88:0/2093677954 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00880a6740 con 0x7f009006c5b0 2023-12-08T08:22:39.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.866+0000 7f008f7fe640 1 -- 172.21.15.88:0/2093677954 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00880a6ad0 con 0x7f009006c5b0 2023-12-08T08:22:39.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.866+0000 7f0096c68640 1 -- 172.21.15.88:0/2093677954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f009006c5b0 msgr2=0x7f009006ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:39.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.866+0000 7f0096c68640 1 --2- 172.21.15.88:0/2093677954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f009006c5b0 0x7f009006ca20 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f009006b520 tx=0x7f008801d9d0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.866+0000 7f0096c68640 1 -- 172.21.15.88:0/2093677954 shutdown_connections 2023-12-08T08:22:39.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.866+0000 7f0096c68640 1 --2- 172.21.15.88:0/2093677954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f009006c5b0 0x7f009006ca20 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.866+0000 7f0096c68640 1 --2- 172.21.15.88:0/2093677954 >> v2:172.21.15.148:3300/0 conn(0x7f009006bef0 0x7f00900bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.866+0000 7f0096c68640 1 -- 172.21.15.88:0/2093677954 >> 172.21.15.88:0/2093677954 conn(0x7f00900a7810 msgr2=0x7f00900a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:39.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.866+0000 7f0096c68640 1 -- 172.21.15.88:0/2093677954 shutdown_connections 2023-12-08T08:22:39.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.866+0000 7f0096c68640 1 -- 172.21.15.88:0/2093677954 wait complete. 2023-12-08T08:22:39.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.866+0000 7f0096c68640 1 Processor -- start 2023-12-08T08:22:39.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.870+0000 7f0096c68640 1 -- start start 2023-12-08T08:22:39.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.870+0000 7f0096c68640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f009006bef0 0x7f0090071950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:39.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.870+0000 7f0096c68640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f009006c5b0 0x7f0090071e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:39.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.870+0000 7f0096c68640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f009014e3f0 0x7f00901f0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:39.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.870+0000 7f0096c68640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0090150550 con 0x7f009006c5b0 2023-12-08T08:22:39.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.870+0000 7f0096c68640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009014f6b0 con 0x7f009006bef0 2023-12-08T08:22:39.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.870+0000 7f0096c68640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009014ff90 con 0x7f009014e3f0 2023-12-08T08:22:39.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.870+0000 7f008ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f009006c5b0 0x7f0090071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:39.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.870+0000 7f008ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f009006c5b0 0x7f0090071e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57602/0 (socket says 172.21.15.88:57602) 2023-12-08T08:22:39.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.870+0000 7f008ffff640 1 -- 172.21.15.88:0/1584825735 learned_addr learned my addr 172.21.15.88:0/1584825735 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:39.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.870+0000 7f0094a04640 1 --2- 172.21.15.88:0/1584825735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f009006bef0 0x7f0090071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:39.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.870+0000 7f0095205640 1 --2- 172.21.15.88:0/1584825735 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f009014e3f0 0x7f00901f0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:39.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.870+0000 7f008ffff640 1 -- 172.21.15.88:0/1584825735 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f009014e3f0 msgr2=0x7f00901f0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:39.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.870+0000 7f008ffff640 1 --2- 172.21.15.88:0/1584825735 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f009014e3f0 0x7f00901f0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.870+0000 7f008ffff640 1 -- 172.21.15.88:0/1584825735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f009006bef0 msgr2=0x7f0090071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:39.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.870+0000 7f008ffff640 1 --2- 172.21.15.88:0/1584825735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f009006bef0 0x7f0090071950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:39.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.870+0000 7f008ffff640 1 -- 172.21.15.88:0/1584825735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008800ac40 con 0x7f009006c5b0 2023-12-08T08:22:39.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.870+0000 7f008ffff640 1 --2- 172.21.15.88:0/1584825735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f009006c5b0 0x7f0090071e90 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f007c00c7f0 tx=0x7f007c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:39.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.870+0000 7f008d7fa640 1 -- 172.21.15.88:0/1584825735 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007c00cea0 con 0x7f009006c5b0 2023-12-08T08:22:39.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.870+0000 7f008d7fa640 1 -- 172.21.15.88:0/1584825735 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007c007a30 con 0x7f009006c5b0 2023-12-08T08:22:39.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.870+0000 7f0096c68640 1 -- 172.21.15.88:0/1584825735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0090150270 con 0x7f009006c5b0 2023-12-08T08:22:39.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.870+0000 7f008d7fa640 1 -- 172.21.15.88:0/1584825735 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007c007de0 con 0x7f009006c5b0 2023-12-08T08:22:39.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.870+0000 7f0096c68640 1 -- 172.21.15.88:0/1584825735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00900723d0 con 0x7f009006c5b0 2023-12-08T08:22:39.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.870+0000 7f0096c68640 1 -- 172.21.15.88:0/1584825735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f009014f840 con 0x7f009006c5b0 2023-12-08T08:22:39.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.874+0000 7f008d7fa640 1 -- 172.21.15.88:0/1584825735 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f007c0113f0 con 0x7f009006c5b0 2023-12-08T08:22:39.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.874+0000 7f008d7fa640 1 --2- 172.21.15.88:0/1584825735 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f00740664a0 0x7f0074068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:39.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.874+0000 7f008d7fa640 1 -- 172.21.15.88:0/1584825735 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f007c084120 con 0x7f009006c5b0 2023-12-08T08:22:39.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.874+0000 7f0094a04640 1 --2- 172.21.15.88:0/1584825735 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f00740664a0 0x7f0074068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:39.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.874+0000 7f0094a04640 1 --2- 172.21.15.88:0/1584825735 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f00740664a0 0x7f0074068960 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f00840098e0 tx=0x7f0084009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:39.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:39.878+0000 7f008d7fa640 1 -- 172.21.15.88:0/1584825735 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f007c051380 con 0x7f009006c5b0 2023-12-08T08:22:40.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.054+0000 7f0096c68640 1 -- 172.21.15.88:0/1584825735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0090067630 con 0x7f009006c5b0 2023-12-08T08:22:40.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.058+0000 7f008d7fa640 1 -- 172.21.15.88:0/1584825735 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6135 (secure 0 0 0) 0x7f007c0549a0 con 0x7f009006c5b0 2023-12-08T08:22:40.062 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:40.062 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5240,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/2576328340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2576328340},{"type":"v1","addr":"172.21.15.148:6834","nonce":2576328340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5626,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/1685449423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1685449423},{"type":"v1","addr":"172.21.15.88:6836","nonce":1685449423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:22:02.420431+0000","modified":"2023-12-08T08:22:05.454472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5793},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5793":{"gid":5793,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/4167133153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":4167133153},{"type":"v1","addr":"172.21.15.88:6837","nonce":4167133153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:22:19.959416+0000","modified":"2023-12-08T08:22:22.972913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5635},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5635":{"gid":5635,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":7,"addr":"172.21.15.148:6835/604820378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":604820378},{"type":"v1","addr":"172.21.15.148:6835","nonce":604820378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-08T08:22:40.062 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 37 2023-12-08T08:22:40.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.058+0000 7f0096c68640 1 -- 172.21.15.88:0/1584825735 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f00740664a0 msgr2=0x7f0074068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:40.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.058+0000 7f0096c68640 1 --2- 172.21.15.88:0/1584825735 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f00740664a0 0x7f0074068960 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f00840098e0 tx=0x7f0084009060 comp rx=0 tx=0).stop 2023-12-08T08:22:40.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.058+0000 7f0096c68640 1 -- 172.21.15.88:0/1584825735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f009006c5b0 msgr2=0x7f0090071e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:40.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.058+0000 7f0096c68640 1 --2- 172.21.15.88:0/1584825735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f009006c5b0 0x7f0090071e90 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f007c00c7f0 tx=0x7f007c00ccb0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.058+0000 7f0096c68640 1 -- 172.21.15.88:0/1584825735 shutdown_connections 2023-12-08T08:22:40.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.058+0000 7f0096c68640 1 --2- 172.21.15.88:0/1584825735 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f00740664a0 0x7f0074068960 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.058+0000 7f0096c68640 1 --2- 172.21.15.88:0/1584825735 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f009014e3f0 0x7f00901f0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.058+0000 7f0096c68640 1 --2- 172.21.15.88:0/1584825735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f009006c5b0 0x7f0090071e90 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.058+0000 7f0096c68640 1 --2- 172.21.15.88:0/1584825735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f009006bef0 0x7f0090071950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.058+0000 7f0096c68640 1 -- 172.21.15.88:0/1584825735 >> 172.21.15.88:0/1584825735 conn(0x7f00900a7810 msgr2=0x7f009014aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:40.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.058+0000 7f0096c68640 1 -- 172.21.15.88:0/1584825735 shutdown_connections 2023-12-08T08:22:40.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.058+0000 7f0096c68640 1 -- 172.21.15.88:0/1584825735 wait complete. 2023-12-08T08:22:40.083 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:22:40.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.214+0000 7fdf0791d640 1 Processor -- start 2023-12-08T08:22:40.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.214+0000 7fdf0791d640 1 -- start start 2023-12-08T08:22:40.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.218+0000 7fdf0791d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdf0014e3f0 0x7fdf000bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:40.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.218+0000 7fdf0791d640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdf0006bef0 0x7fdf000c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:40.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.218+0000 7fdf0791d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf00151690 con 0x7fdf000c4730 2023-12-08T08:22:40.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.218+0000 7fdf0791d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf00151bc0 con 0x7fdf0014e3f0 2023-12-08T08:22:40.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.218+0000 7fdf0791d640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf001518e0 con 0x7fdf0006bef0 2023-12-08T08:22:40.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.218+0000 7fdf056b9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdf0014e3f0 0x7fdf000bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:40.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.218+0000 7fdf05eba640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdf000c4730 0x7fdf0006c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35808/0 (socket says 172.21.15.88:35808) 2023-12-08T08:22:40.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.218+0000 7fdf05eba640 1 -- 172.21.15.88:0/1515933518 learned_addr learned my addr 172.21.15.88:0/1515933518 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:40.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.218+0000 7fdf04eb8640 1 --2- 172.21.15.88:0/1515933518 >> v2:172.21.15.148:3300/0 conn(0x7fdf0006bef0 0x7fdf000c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:40.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.218+0000 7fdef7fff640 1 -- 172.21.15.88:0/1515933518 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493280502 0 0) 0x7fdf00151690 con 0x7fdf000c4730 2023-12-08T08:22:40.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.218+0000 7fdef7fff640 1 -- 172.21.15.88:0/1515933518 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdeec003450 con 0x7fdf000c4730 2023-12-08T08:22:40.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.218+0000 7fdf056b9640 1 -- 172.21.15.88:0/1515933518 >> v2:172.21.15.148:3300/0 conn(0x7fdf0006bef0 msgr2=0x7fdf000c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:40.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.218+0000 7fdf056b9640 1 --2- 172.21.15.88:0/1515933518 >> v2:172.21.15.148:3300/0 conn(0x7fdf0006bef0 0x7fdf000c41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.218+0000 7fdf056b9640 1 -- 172.21.15.88:0/1515933518 >> v1:172.21.15.88:6789/0 conn(0x7fdf000c4730 legacy=0x7fdf0006c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:40.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.218+0000 7fdf056b9640 1 -- 172.21.15.88:0/1515933518 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf000c1de0 con 0x7fdf0014e3f0 2023-12-08T08:22:40.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.218+0000 7fdf04eb8640 1 --2- 172.21.15.88:0/1515933518 >> v2:172.21.15.148:3300/0 conn(0x7fdf0006bef0 0x7fdf000c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:40.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.222+0000 7fdf056b9640 1 --2- 172.21.15.88:0/1515933518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf0014e3f0 0x7fdf000bfce0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fdf0006b520 tx=0x7fdefc01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8227025f157f9d82 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:40.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.222+0000 7fdef7fff640 1 -- 172.21.15.88:0/1515933518 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc0ab600 con 0x7fdf0014e3f0 2023-12-08T08:22:40.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.222+0000 7fdef7fff640 1 -- 172.21.15.88:0/1515933518 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdefc0a7050 con 0x7fdf0014e3f0 2023-12-08T08:22:40.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.222+0000 7fdef7fff640 1 -- 172.21.15.88:0/1515933518 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc0ab980 con 0x7fdf0014e3f0 2023-12-08T08:22:40.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.222+0000 7fdf0791d640 1 -- 172.21.15.88:0/1515933518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf0014e3f0 msgr2=0x7fdf000bfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:40.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.222+0000 7fdf0791d640 1 --2- 172.21.15.88:0/1515933518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf0014e3f0 0x7fdf000bfce0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fdf0006b520 tx=0x7fdefc01c3a0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.222+0000 7fdf0791d640 1 -- 172.21.15.88:0/1515933518 shutdown_connections 2023-12-08T08:22:40.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.222+0000 7fdf0791d640 1 --2- 172.21.15.88:0/1515933518 >> v2:172.21.15.148:3300/0 conn(0x7fdf0006bef0 0x7fdf000c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.222+0000 7fdf0791d640 1 --2- 172.21.15.88:0/1515933518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf0014e3f0 0x7fdf000bfce0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.222+0000 7fdf0791d640 1 -- 172.21.15.88:0/1515933518 >> 172.21.15.88:0/1515933518 conn(0x7fdf000a7810 msgr2=0x7fdf000a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:40.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.222+0000 7fdf0791d640 1 -- 172.21.15.88:0/1515933518 shutdown_connections 2023-12-08T08:22:40.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.222+0000 7fdf0791d640 1 -- 172.21.15.88:0/1515933518 wait complete. 2023-12-08T08:22:40.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.222+0000 7fdf0791d640 1 Processor -- start 2023-12-08T08:22:40.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.222+0000 7fdf0791d640 1 -- start start 2023-12-08T08:22:40.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.226+0000 7fdf0791d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf0006bef0 0x7fdf000aa460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:40.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.226+0000 7fdf0791d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf000c4730 0x7fdf001f0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:40.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.226+0000 7fdf0791d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf0014e3f0 0x7fdf00148a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:40.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.226+0000 7fdf0791d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf001f0f90 con 0x7fdf000c4730 2023-12-08T08:22:40.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.226+0000 7fdf0791d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf000a9430 con 0x7fdf0006bef0 2023-12-08T08:22:40.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.226+0000 7fdf0791d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf000a9710 con 0x7fdf0014e3f0 2023-12-08T08:22:40.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.226+0000 7fdf04eb8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf000c4730 0x7fdf001f0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:40.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.226+0000 7fdf04eb8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf000c4730 0x7fdf001f0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53242/0 (socket says 172.21.15.88:53242) 2023-12-08T08:22:40.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.226+0000 7fdf04eb8640 1 -- 172.21.15.88:0/3685437760 learned_addr learned my addr 172.21.15.88:0/3685437760 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:40.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.226+0000 7fdf056b9640 1 --2- 172.21.15.88:0/3685437760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf0006bef0 0x7fdf000aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:40.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.226+0000 7fdf05eba640 1 --2- 172.21.15.88:0/3685437760 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf0014e3f0 0x7fdf00148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:40.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.226+0000 7fdf04eb8640 1 -- 172.21.15.88:0/3685437760 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf0014e3f0 msgr2=0x7fdf00148a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:40.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.226+0000 7fdf04eb8640 1 --2- 172.21.15.88:0/3685437760 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf0014e3f0 0x7fdf00148a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.226+0000 7fdf04eb8640 1 -- 172.21.15.88:0/3685437760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf0006bef0 msgr2=0x7fdf000aa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:40.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.226+0000 7fdf04eb8640 1 --2- 172.21.15.88:0/3685437760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf0006bef0 0x7fdf000aa460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.226+0000 7fdf04eb8640 1 -- 172.21.15.88:0/3685437760 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdefc009420 con 0x7fdf000c4730 2023-12-08T08:22:40.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.226+0000 7fdf04eb8640 1 --2- 172.21.15.88:0/3685437760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf000c4730 0x7fdf001f0a50 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fdef000d800 tx=0x7fdef000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:40.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.226+0000 7fdef5ffb640 1 -- 172.21.15.88:0/3685437760 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef000b6c0 con 0x7fdf000c4730 2023-12-08T08:22:40.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.226+0000 7fdef5ffb640 1 -- 172.21.15.88:0/3685437760 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef000b820 con 0x7fdf000c4730 2023-12-08T08:22:40.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.226+0000 7fdf0791d640 1 -- 172.21.15.88:0/3685437760 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf000a99f0 con 0x7fdf000c4730 2023-12-08T08:22:40.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.226+0000 7fdef5ffb640 1 -- 172.21.15.88:0/3685437760 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef000bb90 con 0x7fdf000c4730 2023-12-08T08:22:40.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.226+0000 7fdf0791d640 1 -- 172.21.15.88:0/3685437760 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf00148fb0 con 0x7fdf000c4730 2023-12-08T08:22:40.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.226+0000 7fdf0791d640 1 -- 172.21.15.88:0/3685437760 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf00067630 con 0x7fdf000c4730 2023-12-08T08:22:40.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.226+0000 7fdef5ffb640 1 -- 172.21.15.88:0/3685437760 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdef000bcf0 con 0x7fdf000c4730 2023-12-08T08:22:40.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.230+0000 7fdef5ffb640 1 --2- 172.21.15.88:0/3685437760 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdee4066470 0x7fdee4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:40.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.230+0000 7fdef5ffb640 1 -- 172.21.15.88:0/3685437760 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdef00845c0 con 0x7fdf000c4730 2023-12-08T08:22:40.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.230+0000 7fdf056b9640 1 --2- 172.21.15.88:0/3685437760 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdee4066470 0x7fdee4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:40.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.230+0000 7fdf056b9640 1 --2- 172.21.15.88:0/3685437760 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdee4066470 0x7fdee4068930 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdefc0ad000 tx=0x7fdefc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:40.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.234+0000 7fdef5ffb640 1 -- 172.21.15.88:0/3685437760 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdef0051770 con 0x7fdf000c4730 2023-12-08T08:22:40.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.382+0000 7fdf0791d640 1 -- 172.21.15.88:0/3685437760 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf000c5370 con 0x7fdf000c4730 2023-12-08T08:22:40.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.382+0000 7fdef5ffb640 1 -- 172.21.15.88:0/3685437760 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20256 (secure 0 0 0) 0x7fdef0054d90 con 0x7fdf000c4730 2023-12-08T08:22:40.388 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:40.388 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":54,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:22:21.530364+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:00.520254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:01.423493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:22:17.787562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:22:18.955273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:22:40.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.386+0000 7fdf0791d640 1 -- 172.21.15.88:0/3685437760 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdee4066470 msgr2=0x7fdee4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:40.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.386+0000 7fdf0791d640 1 --2- 172.21.15.88:0/3685437760 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdee4066470 0x7fdee4068930 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdefc0ad000 tx=0x7fdefc008040 comp rx=0 tx=0).stop 2023-12-08T08:22:40.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.386+0000 7fdf0791d640 1 -- 172.21.15.88:0/3685437760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf000c4730 msgr2=0x7fdf001f0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:40.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.386+0000 7fdf0791d640 1 --2- 172.21.15.88:0/3685437760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf000c4730 0x7fdf001f0a50 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fdef000d800 tx=0x7fdef000dcc0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.386+0000 7fdf0791d640 1 -- 172.21.15.88:0/3685437760 shutdown_connections 2023-12-08T08:22:40.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.386+0000 7fdf0791d640 1 --2- 172.21.15.88:0/3685437760 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdee4066470 0x7fdee4068930 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.386+0000 7fdf0791d640 1 --2- 172.21.15.88:0/3685437760 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdf0014e3f0 0x7fdf00148a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.386+0000 7fdf0791d640 1 --2- 172.21.15.88:0/3685437760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf000c4730 0x7fdf001f0a50 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.386+0000 7fdf0791d640 1 --2- 172.21.15.88:0/3685437760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf0006bef0 0x7fdf000aa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.386+0000 7fdf0791d640 1 -- 172.21.15.88:0/3685437760 >> 172.21.15.88:0/3685437760 conn(0x7fdf000a7810 msgr2=0x7fdf000c0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:40.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.386+0000 7fdf0791d640 1 -- 172.21.15.88:0/3685437760 shutdown_connections 2023-12-08T08:22:40.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.386+0000 7fdf0791d640 1 -- 172.21.15.88:0/3685437760 wait complete. 2023-12-08T08:22:40.409 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-08T08:22:40.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.542+0000 7f820171d640 1 Processor -- start 2023-12-08T08:22:40.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.542+0000 7f820171d640 1 -- start start 2023-12-08T08:22:40.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.542+0000 7f820171d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f81fc0a4f90 0x7f81fc0c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:40.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.542+0000 7f820171d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81fc072810 0x7f81fc0c0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:40.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.542+0000 7f820171d640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81fc1524b0 con 0x7f81fc0a5370 2023-12-08T08:22:40.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.542+0000 7f820171d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81fc0c62f0 con 0x7f81fc0a4f90 2023-12-08T08:22:40.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.542+0000 7f820171d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc152770 con 0x7f81fc072810 2023-12-08T08:22:40.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.546+0000 7f81faffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f81fc0a4f90 0x7f81fc0c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:40.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.546+0000 7f81faffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f81fc0a4f90 0x7f81fc0c59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53244/0 (socket says 172.21.15.88:53244) 2023-12-08T08:22:40.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.546+0000 7f81faffd640 1 -- 172.21.15.88:0/2145047470 learned_addr learned my addr 172.21.15.88:0/2145047470 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:40.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.546+0000 7f81fb7fe640 1 --2- 172.21.15.88:0/2145047470 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81fc072810 0x7f81fc0c0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:40.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.546+0000 7f81faffd640 1 -- 172.21.15.88:0/2145047470 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81fc072810 msgr2=0x7f81fc0c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:40.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.546+0000 7f81faffd640 1 --2- 172.21.15.88:0/2145047470 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81fc072810 0x7f81fc0c0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.546+0000 7f81faffd640 1 -- 172.21.15.88:0/2145047470 >> v1:172.21.15.148:6789/0 conn(0x7f81fc0a5370 legacy=0x7f81fc14f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:40.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.546+0000 7f81faffd640 1 -- 172.21.15.88:0/2145047470 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc152a50 con 0x7f81fc0a4f90 2023-12-08T08:22:40.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.546+0000 7f81faffd640 1 --2- 172.21.15.88:0/2145047470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81fc0a4f90 0x7f81fc0c59c0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009870 tx=0x7f81ec01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da88fd8e455ca758 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:40.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.546+0000 7f81fa7fc640 1 -- 172.21.15.88:0/2145047470 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec0ab600 con 0x7f81fc0a4f90 2023-12-08T08:22:40.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.546+0000 7f81fa7fc640 1 -- 172.21.15.88:0/2145047470 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ec0a7050 con 0x7f81fc0a4f90 2023-12-08T08:22:40.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.546+0000 7f81fa7fc640 1 -- 172.21.15.88:0/2145047470 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec0ab980 con 0x7f81fc0a4f90 2023-12-08T08:22:40.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f820171d640 1 -- 172.21.15.88:0/2145047470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81fc0a4f90 msgr2=0x7f81fc0c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:40.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f820171d640 1 --2- 172.21.15.88:0/2145047470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81fc0a4f90 0x7f81fc0c59c0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009870 tx=0x7f81ec01c4b0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f820171d640 1 -- 172.21.15.88:0/2145047470 shutdown_connections 2023-12-08T08:22:40.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f820171d640 1 --2- 172.21.15.88:0/2145047470 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81fc072810 0x7f81fc0c0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f820171d640 1 --2- 172.21.15.88:0/2145047470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81fc0a4f90 0x7f81fc0c59c0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f820171d640 1 -- 172.21.15.88:0/2145047470 >> 172.21.15.88:0/2145047470 conn(0x7f81fc06b220 msgr2=0x7f81fc0a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:40.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f820171d640 1 -- 172.21.15.88:0/2145047470 shutdown_connections 2023-12-08T08:22:40.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f820171d640 1 -- 172.21.15.88:0/2145047470 wait complete. 2023-12-08T08:22:40.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f820171d640 1 Processor -- start 2023-12-08T08:22:40.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f820171d640 1 -- start start 2023-12-08T08:22:40.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f820171d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81fc072810 0x7f81fc15bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:40.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f820171d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81fc0a4f90 0x7f81fc0bf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:40.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f820171d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81fc0a5370 0x7f81fc154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:40.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f820171d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc1f0ed0 con 0x7f81fc0a4f90 2023-12-08T08:22:40.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f820171d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc15c320 con 0x7f81fc072810 2023-12-08T08:22:40.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f820171d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc1f0570 con 0x7f81fc0a5370 2023-12-08T08:22:40.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f81f27fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81fc0a4f90 0x7f81fc0bf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:40.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f81f27fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81fc0a4f90 0x7f81fc0bf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53258/0 (socket says 172.21.15.88:53258) 2023-12-08T08:22:40.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f81f27fc640 1 -- 172.21.15.88:0/3690137923 learned_addr learned my addr 172.21.15.88:0/3690137923 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:40.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f81faffd640 1 --2- 172.21.15.88:0/3690137923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81fc072810 0x7f81fc15bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:40.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f81fb7fe640 1 --2- 172.21.15.88:0/3690137923 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81fc0a5370 0x7f81fc154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:40.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f81f27fc640 1 -- 172.21.15.88:0/3690137923 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81fc0a5370 msgr2=0x7f81fc154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:40.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f81f27fc640 1 --2- 172.21.15.88:0/3690137923 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81fc0a5370 0x7f81fc154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f81f27fc640 1 -- 172.21.15.88:0/3690137923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81fc072810 msgr2=0x7f81fc15bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:40.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f81f27fc640 1 --2- 172.21.15.88:0/3690137923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81fc072810 0x7f81fc15bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f81f27fc640 1 -- 172.21.15.88:0/3690137923 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ec0094d0 con 0x7f81fc0a4f90 2023-12-08T08:22:40.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f81fb7fe640 1 --2- 172.21.15.88:0/3690137923 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81fc0a5370 0x7f81fc154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:40.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.550+0000 7f81f27fc640 1 --2- 172.21.15.88:0/3690137923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81fc0a4f90 0x7f81fc0bf0c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f81e400c7a0 tx=0x7f81e400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:40.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.554+0000 7f81f3fff640 1 -- 172.21.15.88:0/3690137923 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4003b80 con 0x7f81fc0a4f90 2023-12-08T08:22:40.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.554+0000 7f81f3fff640 1 -- 172.21.15.88:0/3690137923 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e4003ce0 con 0x7f81fc0a4f90 2023-12-08T08:22:40.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.554+0000 7f81f3fff640 1 -- 172.21.15.88:0/3690137923 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e400aa90 con 0x7f81fc0a4f90 2023-12-08T08:22:40.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.554+0000 7f820171d640 1 -- 172.21.15.88:0/3690137923 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81fc1f0810 con 0x7f81fc0a4f90 2023-12-08T08:22:40.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.554+0000 7f820171d640 1 -- 172.21.15.88:0/3690137923 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81fc0c4660 con 0x7f81fc0a4f90 2023-12-08T08:22:40.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.554+0000 7f820171d640 1 -- 172.21.15.88:0/3690137923 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81fc0c0780 con 0x7f81fc0a4f90 2023-12-08T08:22:40.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.554+0000 7f81f3fff640 1 -- 172.21.15.88:0/3690137923 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f81e400abf0 con 0x7f81fc0a4f90 2023-12-08T08:22:40.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.554+0000 7f81f3fff640 1 --2- 172.21.15.88:0/3690137923 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f81dc066470 0x7f81dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:40.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.554+0000 7f81f3fff640 1 -- 172.21.15.88:0/3690137923 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f81e4083f90 con 0x7f81fc0a4f90 2023-12-08T08:22:40.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.554+0000 7f81faffd640 1 --2- 172.21.15.88:0/3690137923 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f81dc066470 0x7f81dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:40.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.558+0000 7f81faffd640 1 --2- 172.21.15.88:0/3690137923 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f81dc066470 0x7f81dc068930 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f81ec0ad000 tx=0x7f81ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:40.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.558+0000 7f81f3fff640 1 -- 172.21.15.88:0/3690137923 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f81e40510a0 con 0x7f81fc0a4f90 2023-12-08T08:22:40.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.742+0000 7f820171d640 1 -- 172.21.15.88:0/3690137923 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f81fc067630 con 0x7f81fc0a4f90 2023-12-08T08:22:40.748 INFO:tasks.ceph.mon.a.smithi088.stderr:2023-12-08T08:22:40.742+0000 7f9f56907640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-08T08:22:40.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.746+0000 7f81f3fff640 1 -- 172.21.15.88:0/3690137923 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) v1 ==== 161+0+0 (secure 0 0 0) 0x7f81e40546c0 con 0x7f81fc0a4f90 2023-12-08T08:22:40.750 INFO:teuthology.orchestra.run.smithi088.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-08T08:22:40.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.746+0000 7f820171d640 1 -- 172.21.15.88:0/3690137923 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f81dc066470 msgr2=0x7f81dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:40.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.746+0000 7f820171d640 1 --2- 172.21.15.88:0/3690137923 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f81dc066470 0x7f81dc068930 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f81ec0ad000 tx=0x7f81ec008040 comp rx=0 tx=0).stop 2023-12-08T08:22:40.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.746+0000 7f820171d640 1 -- 172.21.15.88:0/3690137923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81fc0a4f90 msgr2=0x7f81fc0bf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:40.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.746+0000 7f820171d640 1 --2- 172.21.15.88:0/3690137923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81fc0a4f90 0x7f81fc0bf0c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f81e400c7a0 tx=0x7f81e400cc60 comp rx=0 tx=0).stop 2023-12-08T08:22:40.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.746+0000 7f820171d640 1 -- 172.21.15.88:0/3690137923 shutdown_connections 2023-12-08T08:22:40.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.746+0000 7f820171d640 1 --2- 172.21.15.88:0/3690137923 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f81dc066470 0x7f81dc068930 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.746+0000 7f820171d640 1 --2- 172.21.15.88:0/3690137923 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f81fc0a5370 0x7f81fc154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.746+0000 7f820171d640 1 --2- 172.21.15.88:0/3690137923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81fc0a4f90 0x7f81fc0bf0c0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.746+0000 7f820171d640 1 --2- 172.21.15.88:0/3690137923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81fc072810 0x7f81fc15bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.746+0000 7f820171d640 1 -- 172.21.15.88:0/3690137923 >> 172.21.15.88:0/3690137923 conn(0x7f81fc06b220 msgr2=0x7f81fc0a6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:40.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.746+0000 7f820171d640 1 -- 172.21.15.88:0/3690137923 shutdown_connections 2023-12-08T08:22:40.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.746+0000 7f820171d640 1 -- 172.21.15.88:0/3690137923 wait complete. 2023-12-08T08:22:40.760 INFO:tasks.ceph.mds.c.smithi088.stderr: -2785> 2023-12-08T08:22:08.031+0000 7fdc2dcbf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:22:40.775 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-08T08:22:40.807 INFO:tasks.ceph.mds.c.smithi088.stdout:starting mds.c at 2023-12-08T08:22:40.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.914+0000 7f6a7a5f5640 1 Processor -- start 2023-12-08T08:22:40.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.914+0000 7f6a7a5f5640 1 -- start start 2023-12-08T08:22:40.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.914+0000 7f6a7a5f5640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6a74151a20 0x7f6a74157a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:40.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.914+0000 7f6a7a5f5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6a7406e890 0x7f6a74154c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:40.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.914+0000 7f6a7a5f5640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a741547f0 con 0x7f6a741551c0 2023-12-08T08:22:40.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.914+0000 7f6a7a5f5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a740c2720 con 0x7f6a7406e890 2023-12-08T08:22:40.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.914+0000 7f6a7a5f5640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a741544a0 con 0x7f6a74151a20 2023-12-08T08:22:40.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.914+0000 7f6a737fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6a7406e890 0x7f6a74154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:40.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.914+0000 7f6a737fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6a7406e890 0x7f6a74154c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53284/0 (socket says 172.21.15.88:53284) 2023-12-08T08:22:40.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.914+0000 7f6a737fe640 1 -- 172.21.15.88:0/3442750004 learned_addr learned my addr 172.21.15.88:0/3442750004 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:40.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.914+0000 7f6a73fff640 1 --2- 172.21.15.88:0/3442750004 >> v2:172.21.15.148:3300/0 conn(0x7f6a74151a20 0x7f6a74157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:40.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.914+0000 7f6a737fe640 1 -- 172.21.15.88:0/3442750004 >> v2:172.21.15.148:3300/0 conn(0x7f6a74151a20 msgr2=0x7f6a74157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:40.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.914+0000 7f6a737fe640 1 --2- 172.21.15.88:0/3442750004 >> v2:172.21.15.148:3300/0 conn(0x7f6a74151a20 0x7f6a74157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.914+0000 7f6a737fe640 1 -- 172.21.15.88:0/3442750004 >> v1:172.21.15.148:6789/0 conn(0x7f6a741551c0 legacy=0x7f6a7406b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:40.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.914+0000 7f6a737fe640 1 -- 172.21.15.88:0/3442750004 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a740c1810 con 0x7f6a7406e890 2023-12-08T08:22:40.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.918+0000 7f6a737fe640 1 --2- 172.21.15.88:0/3442750004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7406e890 0x7f6a74154c80 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f6a7406f820 tx=0x7f6a6801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81412e28b7786155 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:40.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.918+0000 7f6a72ffd640 1 -- 172.21.15.88:0/3442750004 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a680ac410 con 0x7f6a7406e890 2023-12-08T08:22:40.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.918+0000 7f6a72ffd640 1 -- 172.21.15.88:0/3442750004 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a680ac570 con 0x7f6a7406e890 2023-12-08T08:22:40.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.918+0000 7f6a72ffd640 1 -- 172.21.15.88:0/3442750004 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a680ac900 con 0x7f6a7406e890 2023-12-08T08:22:40.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.918+0000 7f6a7a5f5640 1 -- 172.21.15.88:0/3442750004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7406e890 msgr2=0x7f6a74154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:40.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.918+0000 7f6a7a5f5640 1 --2- 172.21.15.88:0/3442750004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7406e890 0x7f6a74154c80 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f6a7406f820 tx=0x7f6a6801c3b0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.918+0000 7f6a7a5f5640 1 -- 172.21.15.88:0/3442750004 shutdown_connections 2023-12-08T08:22:40.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.918+0000 7f6a7a5f5640 1 --2- 172.21.15.88:0/3442750004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7406e890 0x7f6a74154c80 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.918+0000 7f6a7a5f5640 1 --2- 172.21.15.88:0/3442750004 >> v2:172.21.15.148:3300/0 conn(0x7f6a74151a20 0x7f6a74157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.918+0000 7f6a7a5f5640 1 -- 172.21.15.88:0/3442750004 >> 172.21.15.88:0/3442750004 conn(0x7f6a740c2e20 msgr2=0x7f6a740c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:40.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.918+0000 7f6a7a5f5640 1 -- 172.21.15.88:0/3442750004 shutdown_connections 2023-12-08T08:22:40.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.918+0000 7f6a7a5f5640 1 -- 172.21.15.88:0/3442750004 wait complete. 2023-12-08T08:22:40.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.922+0000 7f6a7a5f5640 1 Processor -- start 2023-12-08T08:22:40.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.922+0000 7f6a7a5f5640 1 -- start start 2023-12-08T08:22:40.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.922+0000 7f6a7a5f5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7406e890 0x7f6a741501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:40.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.922+0000 7f6a7a5f5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a74151a20 0x7f6a7414ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:40.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.922+0000 7f6a7a5f5640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a74150f00 0x7f6a7414bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:40.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.922+0000 7f6a7a5f5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7414c4a0 con 0x7f6a7406e890 2023-12-08T08:22:40.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.922+0000 7f6a7a5f5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a740ab850 con 0x7f6a74151a20 2023-12-08T08:22:40.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.922+0000 7f6a7a5f5640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a741514c0 con 0x7f6a74150f00 2023-12-08T08:22:40.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.922+0000 7f6a73fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7406e890 0x7f6a741501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:40.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.922+0000 7f6a73fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7406e890 0x7f6a741501f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53288/0 (socket says 172.21.15.88:53288) 2023-12-08T08:22:40.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.922+0000 7f6a73fff640 1 -- 172.21.15.88:0/1594626799 learned_addr learned my addr 172.21.15.88:0/1594626799 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:40.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.922+0000 7f6a737fe640 1 --2- 172.21.15.88:0/1594626799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a74151a20 0x7f6a7414ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:40.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.922+0000 7f6a78b92640 1 --2- 172.21.15.88:0/1594626799 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a74150f00 0x7f6a7414bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:40.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.922+0000 7f6a73fff640 1 -- 172.21.15.88:0/1594626799 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a74150f00 msgr2=0x7f6a7414bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:40.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.922+0000 7f6a73fff640 1 --2- 172.21.15.88:0/1594626799 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a74150f00 0x7f6a7414bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.922+0000 7f6a73fff640 1 -- 172.21.15.88:0/1594626799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a74151a20 msgr2=0x7f6a7414ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:40.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.922+0000 7f6a73fff640 1 --2- 172.21.15.88:0/1594626799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a74151a20 0x7f6a7414ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:40.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.922+0000 7f6a73fff640 1 -- 172.21.15.88:0/1594626799 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a680094d0 con 0x7f6a7406e890 2023-12-08T08:22:40.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.922+0000 7f6a73fff640 1 --2- 172.21.15.88:0/1594626799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7406e890 0x7f6a741501f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400d830 tx=0x7f6a6400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:40.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.922+0000 7f6a70ff9640 1 -- 172.21.15.88:0/1594626799 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6400b6c0 con 0x7f6a7406e890 2023-12-08T08:22:40.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.922+0000 7f6a70ff9640 1 -- 172.21.15.88:0/1594626799 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6400b820 con 0x7f6a7406e890 2023-12-08T08:22:40.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.922+0000 7f6a7a5f5640 1 -- 172.21.15.88:0/1594626799 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a741ecb00 con 0x7f6a7406e890 2023-12-08T08:22:40.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.922+0000 7f6a70ff9640 1 -- 172.21.15.88:0/1594626799 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6400bb90 con 0x7f6a7406e890 2023-12-08T08:22:40.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.922+0000 7f6a7a5f5640 1 -- 172.21.15.88:0/1594626799 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a741ed0c0 con 0x7f6a7406e890 2023-12-08T08:22:40.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.922+0000 7f6a7a5f5640 1 -- 172.21.15.88:0/1594626799 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a74066660 con 0x7f6a7406e890 2023-12-08T08:22:40.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.926+0000 7f6a70ff9640 1 -- 172.21.15.88:0/1594626799 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6a6401e460 con 0x7f6a7406e890 2023-12-08T08:22:40.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.926+0000 7f6a70ff9640 1 --2- 172.21.15.88:0/1594626799 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6a60066470 0x7f6a60068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:40.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.926+0000 7f6a70ff9640 1 -- 172.21.15.88:0/1594626799 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f6a64084980 con 0x7f6a7406e890 2023-12-08T08:22:40.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.926+0000 7f6a737fe640 1 --2- 172.21.15.88:0/1594626799 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6a60066470 0x7f6a60068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:40.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.926+0000 7f6a737fe640 1 --2- 172.21.15.88:0/1594626799 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6a60066470 0x7f6a60068930 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6a680ae000 tx=0x7f6a68009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:40.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:40.930+0000 7f6a70ff9640 1 -- 172.21.15.88:0/1594626799 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6a64051a40 con 0x7f6a7406e890 2023-12-08T08:22:41.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.110+0000 7f6a7a5f5640 1 -- 172.21.15.88:0/1594626799 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6a74067630 con 0x7f6a7406e890 2023-12-08T08:22:41.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.750+0000 7f6a70ff9640 1 -- 172.21.15.88:0/1594626799 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6a64055060 con 0x7f6a7406e890 2023-12-08T08:22:41.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.754+0000 7f6a7a5f5640 1 -- 172.21.15.88:0/1594626799 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6a60066470 msgr2=0x7f6a60068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:41.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.754+0000 7f6a7a5f5640 1 --2- 172.21.15.88:0/1594626799 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6a60066470 0x7f6a60068930 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6a680ae000 tx=0x7f6a68009040 comp rx=0 tx=0).stop 2023-12-08T08:22:41.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.754+0000 7f6a7a5f5640 1 -- 172.21.15.88:0/1594626799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7406e890 msgr2=0x7f6a741501f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:41.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.754+0000 7f6a7a5f5640 1 --2- 172.21.15.88:0/1594626799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7406e890 0x7f6a741501f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400d830 tx=0x7f6a6400dcf0 comp rx=0 tx=0).stop 2023-12-08T08:22:41.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.754+0000 7f6a7a5f5640 1 -- 172.21.15.88:0/1594626799 shutdown_connections 2023-12-08T08:22:41.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.754+0000 7f6a7a5f5640 1 --2- 172.21.15.88:0/1594626799 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6a60066470 0x7f6a60068930 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:41.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.754+0000 7f6a7a5f5640 1 --2- 172.21.15.88:0/1594626799 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a74150f00 0x7f6a7414bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:41.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.754+0000 7f6a7a5f5640 1 --2- 172.21.15.88:0/1594626799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a74151a20 0x7f6a7414ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:41.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.754+0000 7f6a7a5f5640 1 --2- 172.21.15.88:0/1594626799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7406e890 0x7f6a741501f0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:41.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.754+0000 7f6a7a5f5640 1 -- 172.21.15.88:0/1594626799 >> 172.21.15.88:0/1594626799 conn(0x7f6a740c2e20 msgr2=0x7f6a741537f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:41.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.754+0000 7f6a7a5f5640 1 -- 172.21.15.88:0/1594626799 shutdown_connections 2023-12-08T08:22:41.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.754+0000 7f6a7a5f5640 1 -- 172.21.15.88:0/1594626799 wait complete. 2023-12-08T08:22:41.781 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-08T08:22:41.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.962+0000 7f831a0bb640 1 Processor -- start 2023-12-08T08:22:41.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.962+0000 7f831a0bb640 1 -- start start 2023-12-08T08:22:41.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.966+0000 7f831a0bb640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f831406b820 0x7f83140a93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:41.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.966+0000 7f831a0bb640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83140abe90 0x7f8314152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:41.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.966+0000 7f831a0bb640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83140ab760 con 0x7f83140c1290 2023-12-08T08:22:41.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.966+0000 7f831a0bb640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83140aba40 con 0x7f831406b820 2023-12-08T08:22:41.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.966+0000 7f831a0bb640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8314152410 con 0x7f83140abe90 2023-12-08T08:22:41.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.966+0000 7f83137fe640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f831406b820 0x7f83140a93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:41.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.966+0000 7f830bfff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83140abe90 0x7f8314152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:41.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.966+0000 7f8313fff640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f83140c1290 0x7f831414f6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:33606/0 (socket says 172.21.15.88:33606) 2023-12-08T08:22:41.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.966+0000 7f8313fff640 1 -- 172.21.15.88:0/2217533597 learned_addr learned my addr 172.21.15.88:0/2217533597 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:41.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.966+0000 7f8312ffd640 1 -- 172.21.15.88:0/2217533597 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1243772217 0 0) 0x7f83140ab760 con 0x7f83140c1290 2023-12-08T08:22:41.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.966+0000 7f8312ffd640 1 -- 172.21.15.88:0/2217533597 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8300003530 con 0x7f83140c1290 2023-12-08T08:22:41.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.966+0000 7f830bfff640 1 -- 172.21.15.88:0/2217533597 >> v2:172.21.15.148:3300/0 conn(0x7f831406b820 msgr2=0x7f83140a93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:41.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.966+0000 7f830bfff640 1 --2- 172.21.15.88:0/2217533597 >> v2:172.21.15.148:3300/0 conn(0x7f831406b820 0x7f83140a93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:41.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.966+0000 7f830bfff640 1 -- 172.21.15.88:0/2217533597 >> v1:172.21.15.148:6789/0 conn(0x7f83140c1290 legacy=0x7f831414f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:41.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.966+0000 7f830bfff640 1 -- 172.21.15.88:0/2217533597 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83141526f0 con 0x7f83140abe90 2023-12-08T08:22:41.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.966+0000 7f83137fe640 1 --2- 172.21.15.88:0/2217533597 >> v2:172.21.15.148:3300/0 conn(0x7f831406b820 0x7f83140a93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:22:41.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.970+0000 7f830bfff640 1 --2- 172.21.15.88:0/2217533597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83140abe90 0x7f8314152ef0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f82fc0097c0 tx=0x7f82fc01c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d83d15e3c3ea337 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:41.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.970+0000 7f8312ffd640 1 -- 172.21.15.88:0/2217533597 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc0ab600 con 0x7f83140abe90 2023-12-08T08:22:41.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.970+0000 7f8312ffd640 1 -- 172.21.15.88:0/2217533597 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82fc0a7050 con 0x7f83140abe90 2023-12-08T08:22:41.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.970+0000 7f8312ffd640 1 -- 172.21.15.88:0/2217533597 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc0ab980 con 0x7f83140abe90 2023-12-08T08:22:41.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.970+0000 7f831a0bb640 1 -- 172.21.15.88:0/2217533597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83140abe90 msgr2=0x7f8314152ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:41.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.970+0000 7f831a0bb640 1 --2- 172.21.15.88:0/2217533597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83140abe90 0x7f8314152ef0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f82fc0097c0 tx=0x7f82fc01c360 comp rx=0 tx=0).stop 2023-12-08T08:22:41.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.970+0000 7f831a0bb640 1 -- 172.21.15.88:0/2217533597 shutdown_connections 2023-12-08T08:22:41.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.970+0000 7f831a0bb640 1 --2- 172.21.15.88:0/2217533597 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f83140abe90 0x7f8314152ef0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:41.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.970+0000 7f831a0bb640 1 --2- 172.21.15.88:0/2217533597 >> v2:172.21.15.148:3300/0 conn(0x7f831406b820 0x7f83140a93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:41.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.970+0000 7f831a0bb640 1 -- 172.21.15.88:0/2217533597 >> 172.21.15.88:0/2217533597 conn(0x7f83140c2e20 msgr2=0x7f83140c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:41.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.970+0000 7f831a0bb640 1 -- 172.21.15.88:0/2217533597 shutdown_connections 2023-12-08T08:22:41.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.970+0000 7f831a0bb640 1 -- 172.21.15.88:0/2217533597 wait complete. 2023-12-08T08:22:41.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.974+0000 7f831a0bb640 1 Processor -- start 2023-12-08T08:22:41.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.974+0000 7f831a0bb640 1 -- start start 2023-12-08T08:22:41.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.974+0000 7f831a0bb640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f831406b820 0x7f83141ec9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:41.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.974+0000 7f831a0bb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83140abe90 0x7f8314150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.974+0000 7f831a0bb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83140c1290 0x7f831413d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.974+0000 7f831a0bb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831414f0f0 con 0x7f83140abe90 2023-12-08T08:22:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.974+0000 7f831a0bb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831414eac0 con 0x7f83140c1290 2023-12-08T08:22:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.974+0000 7f831a0bb640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8314150c30 con 0x7f831406b820 2023-12-08T08:22:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.974+0000 7f830bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83140abe90 0x7f8314150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.974+0000 7f830bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83140abe90 0x7f8314150370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53300/0 (socket says 172.21.15.88:53300) 2023-12-08T08:22:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.974+0000 7f830bfff640 1 -- 172.21.15.88:0/990036043 learned_addr learned my addr 172.21.15.88:0/990036043 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.974+0000 7f83137fe640 1 --2- 172.21.15.88:0/990036043 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f831406b820 0x7f83141ec9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.974+0000 7f8313fff640 1 --2- 172.21.15.88:0/990036043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83140c1290 0x7f831413d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.974+0000 7f830bfff640 1 -- 172.21.15.88:0/990036043 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f831406b820 msgr2=0x7f83141ec9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.974+0000 7f830bfff640 1 --2- 172.21.15.88:0/990036043 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f831406b820 0x7f83141ec9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.974+0000 7f830bfff640 1 -- 172.21.15.88:0/990036043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83140c1290 msgr2=0x7f831413d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.974+0000 7f830bfff640 1 --2- 172.21.15.88:0/990036043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83140c1290 0x7f831413d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.974+0000 7f830bfff640 1 -- 172.21.15.88:0/990036043 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8304009420 con 0x7f83140abe90 2023-12-08T08:22:41.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.974+0000 7f8313fff640 1 --2- 172.21.15.88:0/990036043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83140c1290 0x7f831413d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:41.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.974+0000 7f830bfff640 1 --2- 172.21.15.88:0/990036043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83140abe90 0x7f8314150370 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f82fc019f90 tx=0x7f82fc019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:41.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.974+0000 7f8310ff9640 1 -- 172.21.15.88:0/990036043 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc0b4410 con 0x7f83140abe90 2023-12-08T08:22:41.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.974+0000 7f8310ff9640 1 -- 172.21.15.88:0/990036043 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82fc0b4590 con 0x7f83140abe90 2023-12-08T08:22:41.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.974+0000 7f831a0bb640 1 -- 172.21.15.88:0/990036043 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82fc009420 con 0x7f83140abe90 2023-12-08T08:22:41.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.974+0000 7f8310ff9640 1 -- 172.21.15.88:0/990036043 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc0b4940 con 0x7f83140abe90 2023-12-08T08:22:41.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.974+0000 7f831a0bb640 1 -- 172.21.15.88:0/990036043 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83141f0cf0 con 0x7f83140abe90 2023-12-08T08:22:41.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.974+0000 7f831a0bb640 1 -- 172.21.15.88:0/990036043 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8314150170 con 0x7f83140abe90 2023-12-08T08:22:41.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.978+0000 7f8310ff9640 1 -- 172.21.15.88:0/990036043 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f82fc0b2040 con 0x7f83140abe90 2023-12-08T08:22:41.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.978+0000 7f8310ff9640 1 --2- 172.21.15.88:0/990036043 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f82f4066470 0x7f82f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:41.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.978+0000 7f8310ff9640 1 -- 172.21.15.88:0/990036043 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f82fc11e100 con 0x7f83140abe90 2023-12-08T08:22:41.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.978+0000 7f83137fe640 1 --2- 172.21.15.88:0/990036043 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f82f4066470 0x7f82f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:41.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.978+0000 7f83137fe640 1 --2- 172.21.15.88:0/990036043 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f82f4066470 0x7f82f4068930 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8304009c50 tx=0x7f8304009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:41.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:41.982+0000 7f8310ff9640 1 -- 172.21.15.88:0/990036043 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f82fc0eb310 con 0x7f83140abe90 2023-12-08T08:22:42.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.134+0000 7f831a0bb640 1 -- 172.21.15.88:0/990036043 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8314067630 con 0x7f83140abe90 2023-12-08T08:22:42.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.754+0000 7f8310ff9640 1 -- 172.21.15.88:0/990036043 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v56) v1 ==== 181+0+0 (secure 0 0 0) 0x7f82fc0ee930 con 0x7f83140abe90 2023-12-08T08:22:42.759 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' removed 2023-12-08T08:22:42.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.754+0000 7f831a0bb640 1 -- 172.21.15.88:0/990036043 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f82f4066470 msgr2=0x7f82f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:42.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.754+0000 7f831a0bb640 1 --2- 172.21.15.88:0/990036043 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f82f4066470 0x7f82f4068930 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8304009c50 tx=0x7f8304009190 comp rx=0 tx=0).stop 2023-12-08T08:22:42.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.754+0000 7f831a0bb640 1 -- 172.21.15.88:0/990036043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83140abe90 msgr2=0x7f8314150370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:42.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.754+0000 7f831a0bb640 1 --2- 172.21.15.88:0/990036043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83140abe90 0x7f8314150370 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f82fc019f90 tx=0x7f82fc019100 comp rx=0 tx=0).stop 2023-12-08T08:22:42.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.754+0000 7f831a0bb640 1 -- 172.21.15.88:0/990036043 shutdown_connections 2023-12-08T08:22:42.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.754+0000 7f831a0bb640 1 --2- 172.21.15.88:0/990036043 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f82f4066470 0x7f82f4068930 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:42.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.754+0000 7f831a0bb640 1 --2- 172.21.15.88:0/990036043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83140c1290 0x7f831413d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:42.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.754+0000 7f831a0bb640 1 --2- 172.21.15.88:0/990036043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83140abe90 0x7f8314150370 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:42.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.754+0000 7f831a0bb640 1 --2- 172.21.15.88:0/990036043 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f831406b820 0x7f83141ec9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:42.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.754+0000 7f831a0bb640 1 -- 172.21.15.88:0/990036043 >> 172.21.15.88:0/990036043 conn(0x7f83140c2e20 msgr2=0x7f83141419d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:42.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.754+0000 7f831a0bb640 1 -- 172.21.15.88:0/990036043 shutdown_connections 2023-12-08T08:22:42.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.754+0000 7f831a0bb640 1 -- 172.21.15.88:0/990036043 wait complete. 2023-12-08T08:22:42.786 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-08T08:22:42.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.922+0000 7f1a27206640 1 Processor -- start 2023-12-08T08:22:42.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.926+0000 7f1a27206640 1 -- start start 2023-12-08T08:22:42.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.926+0000 7f1a27206640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1a200c7ac0 0x7f1a20157950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:42.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.926+0000 7f1a27206640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1a200bd250 0x7f1a20157e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:42.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.926+0000 7f1a27206640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2014e780 con 0x7f1a2014e3a0 2023-12-08T08:22:42.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.926+0000 7f1a27206640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a20154ce0 con 0x7f1a200bd250 2023-12-08T08:22:42.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.926+0000 7f1a27206640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a200c4c80 con 0x7f1a200c7ac0 2023-12-08T08:22:42.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.926+0000 7f1a26a05640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1a200bd250 0x7f1a20157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:42.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.926+0000 7f1a26a05640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1a200bd250 0x7f1a20157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53302/0 (socket says 172.21.15.88:53302) 2023-12-08T08:22:42.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.926+0000 7f1a26a05640 1 -- 172.21.15.88:0/1709214125 learned_addr learned my addr 172.21.15.88:0/1709214125 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:42.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.926+0000 7f1a26204640 1 --1- 172.21.15.88:0/1709214125 >> v1:172.21.15.88:6789/0 conn(0x7f1a2014e3a0 0x7f1a200c65d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35836/0 (socket says 172.21.15.88:35836) 2023-12-08T08:22:42.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.926+0000 7f1a25a03640 1 --2- 172.21.15.88:0/1709214125 >> v2:172.21.15.148:3300/0 conn(0x7f1a200c7ac0 0x7f1a20157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:42.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.926+0000 7f1a26a05640 1 -- 172.21.15.88:0/1709214125 >> v2:172.21.15.148:3300/0 conn(0x7f1a200c7ac0 msgr2=0x7f1a20157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:42.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.926+0000 7f1a26a05640 1 --2- 172.21.15.88:0/1709214125 >> v2:172.21.15.148:3300/0 conn(0x7f1a200c7ac0 0x7f1a20157950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:42.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.926+0000 7f1a26a05640 1 -- 172.21.15.88:0/1709214125 >> v1:172.21.15.88:6789/0 conn(0x7f1a2014e3a0 legacy=0x7f1a200c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:42.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.926+0000 7f1a26a05640 1 -- 172.21.15.88:0/1709214125 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a20155210 con 0x7f1a200bd250 2023-12-08T08:22:42.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.930+0000 7f1a26a05640 1 --2- 172.21.15.88:0/1709214125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a200bd250 0x7f1a20157e90 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1a200ac3a0 tx=0x7f1a1801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6e0a4da516af81 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:42.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.930+0000 7f1a25202640 1 -- 172.21.15.88:0/1709214125 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a180a5660 con 0x7f1a200bd250 2023-12-08T08:22:42.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.930+0000 7f1a25202640 1 -- 172.21.15.88:0/1709214125 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a180a57c0 con 0x7f1a200bd250 2023-12-08T08:22:42.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.930+0000 7f1a25202640 1 -- 172.21.15.88:0/1709214125 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a180a5b50 con 0x7f1a200bd250 2023-12-08T08:22:42.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.930+0000 7f1a27206640 1 -- 172.21.15.88:0/1709214125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a200bd250 msgr2=0x7f1a20157e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:42.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.930+0000 7f1a27206640 1 --2- 172.21.15.88:0/1709214125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a200bd250 0x7f1a20157e90 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1a200ac3a0 tx=0x7f1a1801c8b0 comp rx=0 tx=0).stop 2023-12-08T08:22:42.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.930+0000 7f1a27206640 1 -- 172.21.15.88:0/1709214125 shutdown_connections 2023-12-08T08:22:42.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.930+0000 7f1a27206640 1 --2- 172.21.15.88:0/1709214125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a200bd250 0x7f1a20157e90 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:42.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.930+0000 7f1a27206640 1 --2- 172.21.15.88:0/1709214125 >> v2:172.21.15.148:3300/0 conn(0x7f1a200c7ac0 0x7f1a20157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:42.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.930+0000 7f1a27206640 1 -- 172.21.15.88:0/1709214125 >> 172.21.15.88:0/1709214125 conn(0x7f1a20066d20 msgr2=0x7f1a200ab750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:42.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.930+0000 7f1a27206640 1 -- 172.21.15.88:0/1709214125 shutdown_connections 2023-12-08T08:22:42.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.930+0000 7f1a27206640 1 -- 172.21.15.88:0/1709214125 wait complete. 2023-12-08T08:22:42.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.930+0000 7f1a27206640 1 Processor -- start 2023-12-08T08:22:42.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.934+0000 7f1a27206640 1 -- start start 2023-12-08T08:22:42.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.934+0000 7f1a27206640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a200bd250 0x7f1a200aa1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:42.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.934+0000 7f1a27206640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a200c7ac0 0x7f1a20153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:42.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.934+0000 7f1a27206640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a2014e3a0 0x7f1a200bef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:42.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.934+0000 7f1a27206640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a201ed9b0 con 0x7f1a200bd250 2023-12-08T08:22:42.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.934+0000 7f1a27206640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a201ecda0 con 0x7f1a2014e3a0 2023-12-08T08:22:42.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.934+0000 7f1a27206640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a201ed080 con 0x7f1a200c7ac0 2023-12-08T08:22:42.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.934+0000 7f1a26204640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a200bd250 0x7f1a200aa1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:42.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.934+0000 7f1a26204640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a200bd250 0x7f1a200aa1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53318/0 (socket says 172.21.15.88:53318) 2023-12-08T08:22:42.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.934+0000 7f1a26204640 1 -- 172.21.15.88:0/2763482821 learned_addr learned my addr 172.21.15.88:0/2763482821 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:42.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.934+0000 7f1a25a03640 1 --2- 172.21.15.88:0/2763482821 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a200c7ac0 0x7f1a20153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:42.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.934+0000 7f1a26a05640 1 --2- 172.21.15.88:0/2763482821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a2014e3a0 0x7f1a200bef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:42.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.934+0000 7f1a26204640 1 -- 172.21.15.88:0/2763482821 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a200c7ac0 msgr2=0x7f1a20153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:42.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.934+0000 7f1a26204640 1 --2- 172.21.15.88:0/2763482821 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a200c7ac0 0x7f1a20153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:42.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.934+0000 7f1a26204640 1 -- 172.21.15.88:0/2763482821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a2014e3a0 msgr2=0x7f1a200bef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:42.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.934+0000 7f1a26204640 1 --2- 172.21.15.88:0/2763482821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a2014e3a0 0x7f1a200bef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:42.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.934+0000 7f1a26204640 1 -- 172.21.15.88:0/2763482821 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a18009b30 con 0x7f1a200bd250 2023-12-08T08:22:42.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.934+0000 7f1a25a03640 1 --2- 172.21.15.88:0/2763482821 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a200c7ac0 0x7f1a20153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:42.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.934+0000 7f1a26a05640 1 --2- 172.21.15.88:0/2763482821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a2014e3a0 0x7f1a200bef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:42.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.934+0000 7f1a26204640 1 --2- 172.21.15.88:0/2763482821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a200bd250 0x7f1a200aa1c0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00c490 tx=0x7f1a1c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:42.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.934+0000 7f1a16ffd640 1 -- 172.21.15.88:0/2763482821 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c007480 con 0x7f1a200bd250 2023-12-08T08:22:42.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.934+0000 7f1a16ffd640 1 -- 172.21.15.88:0/2763482821 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1c0075e0 con 0x7f1a200bd250 2023-12-08T08:22:42.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.934+0000 7f1a27206640 1 -- 172.21.15.88:0/2763482821 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a201ed360 con 0x7f1a200bd250 2023-12-08T08:22:42.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.934+0000 7f1a16ffd640 1 -- 172.21.15.88:0/2763482821 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c004a10 con 0x7f1a200bd250 2023-12-08T08:22:42.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.934+0000 7f1a27206640 1 -- 172.21.15.88:0/2763482821 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a200aa700 con 0x7f1a200bd250 2023-12-08T08:22:42.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.934+0000 7f1a27206640 1 -- 172.21.15.88:0/2763482821 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a200674b0 con 0x7f1a200bd250 2023-12-08T08:22:42.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.938+0000 7f1a16ffd640 1 -- 172.21.15.88:0/2763482821 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1a1c004b70 con 0x7f1a200bd250 2023-12-08T08:22:42.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.938+0000 7f1a16ffd640 1 --2- 172.21.15.88:0/2763482821 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1a04066470 0x7f1a04068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:42.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.938+0000 7f1a16ffd640 1 -- 172.21.15.88:0/2763482821 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6213+0+0 (secure 0 0 0) 0x7f1a1c0830b0 con 0x7f1a200bd250 2023-12-08T08:22:42.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.938+0000 7f1a25a03640 1 --2- 172.21.15.88:0/2763482821 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1a04066470 0x7f1a04068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:42.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.938+0000 7f1a25a03640 1 --2- 172.21.15.88:0/2763482821 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1a04066470 0x7f1a04068930 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1a200ab3d0 tx=0x7f1a10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:42.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:42.942+0000 7f1a16ffd640 1 -- 172.21.15.88:0/2763482821 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1a1c050330 con 0x7f1a200bd250 2023-12-08T08:22:43.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.094+0000 7f1a27206640 1 -- 172.21.15.88:0/2763482821 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1a2014e780 con 0x7f1a200bd250 2023-12-08T08:22:43.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.758+0000 7f1a16ffd640 1 -- 172.21.15.88:0/2763482821 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v57) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1a2014e780 con 0x7f1a200bd250 2023-12-08T08:22:43.765 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' removed 2023-12-08T08:22:43.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.762+0000 7f1a27206640 1 -- 172.21.15.88:0/2763482821 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1a04066470 msgr2=0x7f1a04068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:43.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.762+0000 7f1a27206640 1 --2- 172.21.15.88:0/2763482821 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1a04066470 0x7f1a04068930 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1a200ab3d0 tx=0x7f1a10008040 comp rx=0 tx=0).stop 2023-12-08T08:22:43.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.762+0000 7f1a27206640 1 -- 172.21.15.88:0/2763482821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a200bd250 msgr2=0x7f1a200aa1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:43.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.762+0000 7f1a27206640 1 --2- 172.21.15.88:0/2763482821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a200bd250 0x7f1a200aa1c0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00c490 tx=0x7f1a1c00c950 comp rx=0 tx=0).stop 2023-12-08T08:22:43.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.762+0000 7f1a27206640 1 -- 172.21.15.88:0/2763482821 shutdown_connections 2023-12-08T08:22:43.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.762+0000 7f1a27206640 1 --2- 172.21.15.88:0/2763482821 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1a04066470 0x7f1a04068930 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:43.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.762+0000 7f1a27206640 1 --2- 172.21.15.88:0/2763482821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a2014e3a0 0x7f1a200bef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:43.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.762+0000 7f1a27206640 1 --2- 172.21.15.88:0/2763482821 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a200c7ac0 0x7f1a20153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:43.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.762+0000 7f1a27206640 1 --2- 172.21.15.88:0/2763482821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a200bd250 0x7f1a200aa1c0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:43.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.762+0000 7f1a27206640 1 -- 172.21.15.88:0/2763482821 >> 172.21.15.88:0/2763482821 conn(0x7f1a20066d20 msgr2=0x7f1a2014c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:43.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.762+0000 7f1a27206640 1 -- 172.21.15.88:0/2763482821 shutdown_connections 2023-12-08T08:22:43.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.762+0000 7f1a27206640 1 -- 172.21.15.88:0/2763482821 wait complete. 2023-12-08T08:22:43.793 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:22:43.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.938+0000 7f0a026ea640 1 Processor -- start 2023-12-08T08:22:43.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.938+0000 7f0a026ea640 1 -- start start 2023-12-08T08:22:43.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.938+0000 7f0a026ea640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f09fc06d2b0 0x7f09fc06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:43.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.938+0000 7f0a026ea640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f09fc0c5300 0x7f09fc06c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:43.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.938+0000 7f0a026ea640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09fc06bb80 con 0x7f09fc0c3b80 2023-12-08T08:22:43.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.938+0000 7f0a026ea640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09fc06cc70 con 0x7f09fc06d2b0 2023-12-08T08:22:43.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.938+0000 7f0a026ea640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09fc0c5790 con 0x7f09fc0c5300 2023-12-08T08:22:43.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.938+0000 7f09fbfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f09fc06d2b0 0x7f09fc06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:43.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.938+0000 7f09fbfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f09fc06d2b0 0x7f09fc06d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53324/0 (socket says 172.21.15.88:53324) 2023-12-08T08:22:43.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.938+0000 7f09fbfff640 1 -- 172.21.15.88:0/2066815132 learned_addr learned my addr 172.21.15.88:0/2066815132 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:43.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.938+0000 7f09fb7fe640 1 --1- 172.21.15.88:0/2066815132 >> v1:172.21.15.88:6789/0 conn(0x7f09fc0c3b80 0x7f09fc06c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35846/0 (socket says 172.21.15.88:35846) 2023-12-08T08:22:43.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.938+0000 7f0a00c87640 1 --2- 172.21.15.88:0/2066815132 >> v2:172.21.15.148:3300/0 conn(0x7f09fc0c5300 0x7f09fc06c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:43.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.938+0000 7f09fbfff640 1 -- 172.21.15.88:0/2066815132 >> v2:172.21.15.148:3300/0 conn(0x7f09fc0c5300 msgr2=0x7f09fc06c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:43.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.938+0000 7f09fbfff640 1 --2- 172.21.15.88:0/2066815132 >> v2:172.21.15.148:3300/0 conn(0x7f09fc0c5300 0x7f09fc06c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:43.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.938+0000 7f09fbfff640 1 -- 172.21.15.88:0/2066815132 >> v1:172.21.15.88:6789/0 conn(0x7f09fc0c3b80 legacy=0x7f09fc06c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:43.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.938+0000 7f09fbfff640 1 -- 172.21.15.88:0/2066815132 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc1515c0 con 0x7f09fc06d2b0 2023-12-08T08:22:43.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.942+0000 7f09fbfff640 1 --2- 172.21.15.88:0/2066815132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09fc06d2b0 0x7f09fc06d690 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f09fc06e3c0 tx=0x7f09ec01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72a38c44d44637f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:43.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.942+0000 7f09faffd640 1 -- 172.21.15.88:0/2066815132 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec0ac640 con 0x7f09fc06d2b0 2023-12-08T08:22:43.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.942+0000 7f09faffd640 1 -- 172.21.15.88:0/2066815132 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ec0ac7a0 con 0x7f09fc06d2b0 2023-12-08T08:22:43.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.942+0000 7f09faffd640 1 -- 172.21.15.88:0/2066815132 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec0acb30 con 0x7f09fc06d2b0 2023-12-08T08:22:43.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.942+0000 7f0a026ea640 1 -- 172.21.15.88:0/2066815132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09fc06d2b0 msgr2=0x7f09fc06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:43.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.942+0000 7f0a026ea640 1 --2- 172.21.15.88:0/2066815132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09fc06d2b0 0x7f09fc06d690 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f09fc06e3c0 tx=0x7f09ec01c4d0 comp rx=0 tx=0).stop 2023-12-08T08:22:43.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.942+0000 7f0a026ea640 1 -- 172.21.15.88:0/2066815132 shutdown_connections 2023-12-08T08:22:43.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.942+0000 7f0a026ea640 1 --2- 172.21.15.88:0/2066815132 >> v2:172.21.15.148:3300/0 conn(0x7f09fc0c5300 0x7f09fc06c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:43.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.942+0000 7f0a026ea640 1 --2- 172.21.15.88:0/2066815132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09fc06d2b0 0x7f09fc06d690 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:43.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.942+0000 7f0a026ea640 1 -- 172.21.15.88:0/2066815132 >> 172.21.15.88:0/2066815132 conn(0x7f09fc0a7810 msgr2=0x7f09fc0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:43.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.942+0000 7f0a026ea640 1 -- 172.21.15.88:0/2066815132 shutdown_connections 2023-12-08T08:22:43.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.942+0000 7f0a026ea640 1 -- 172.21.15.88:0/2066815132 wait complete. 2023-12-08T08:22:43.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.946+0000 7f0a026ea640 1 Processor -- start 2023-12-08T08:22:43.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.946+0000 7f0a026ea640 1 -- start start 2023-12-08T08:22:43.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.946+0000 7f0a026ea640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09fc06d2b0 0x7f09fc154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:43.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.946+0000 7f0a026ea640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09fc0c3b80 0x7f09fc152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:43.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.946+0000 7f0a026ea640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09fc0c5300 0x7f09fc150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:43.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.946+0000 7f0a026ea640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc151380 con 0x7f09fc06d2b0 2023-12-08T08:22:43.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.946+0000 7f0a026ea640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc1ed7c0 con 0x7f09fc0c3b80 2023-12-08T08:22:43.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.946+0000 7f0a026ea640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc1edcf0 con 0x7f09fc0c5300 2023-12-08T08:22:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.946+0000 7f09fbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09fc06d2b0 0x7f09fc154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.946+0000 7f09fbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09fc06d2b0 0x7f09fc154590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53340/0 (socket says 172.21.15.88:53340) 2023-12-08T08:22:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.946+0000 7f09fbfff640 1 -- 172.21.15.88:0/3285861805 learned_addr learned my addr 172.21.15.88:0/3285861805 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.946+0000 7f09fb7fe640 1 --2- 172.21.15.88:0/3285861805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09fc0c3b80 0x7f09fc152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.946+0000 7f0a00c87640 1 --2- 172.21.15.88:0/3285861805 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09fc0c5300 0x7f09fc150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.946+0000 7f09fbfff640 1 -- 172.21.15.88:0/3285861805 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09fc0c5300 msgr2=0x7f09fc150e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.946+0000 7f09fbfff640 1 --2- 172.21.15.88:0/3285861805 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09fc0c5300 0x7f09fc150e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.946+0000 7f09fbfff640 1 -- 172.21.15.88:0/3285861805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09fc0c3b80 msgr2=0x7f09fc152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.946+0000 7f09fbfff640 1 --2- 172.21.15.88:0/3285861805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09fc0c3b80 0x7f09fc152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.946+0000 7f09fbfff640 1 -- 172.21.15.88:0/3285861805 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ec0094d0 con 0x7f09fc06d2b0 2023-12-08T08:22:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.946+0000 7f09fbfff640 1 --2- 172.21.15.88:0/3285861805 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09fc06d2b0 0x7f09fc154590 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f09ec0af040 tx=0x7f09ec019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.946+0000 7f09f8ff9640 1 -- 172.21.15.88:0/3285861805 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec0b7670 con 0x7f09fc06d2b0 2023-12-08T08:22:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.946+0000 7f09f8ff9640 1 -- 172.21.15.88:0/3285861805 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ec0b77d0 con 0x7f09fc06d2b0 2023-12-08T08:22:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.946+0000 7f0a026ea640 1 -- 172.21.15.88:0/3285861805 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09fc14ef80 con 0x7f09fc06d2b0 2023-12-08T08:22:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.946+0000 7f09f8ff9640 1 -- 172.21.15.88:0/3285861805 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec0b7b60 con 0x7f09fc06d2b0 2023-12-08T08:22:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.946+0000 7f0a026ea640 1 -- 172.21.15.88:0/3285861805 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09fc0ab730 con 0x7f09fc06d2b0 2023-12-08T08:22:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.950+0000 7f0a026ea640 1 -- 172.21.15.88:0/3285861805 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09fc067630 con 0x7f09fc06d2b0 2023-12-08T08:22:43.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.950+0000 7f09f8ff9640 1 -- 172.21.15.88:0/3285861805 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f09ec0b3070 con 0x7f09fc06d2b0 2023-12-08T08:22:43.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.950+0000 7f09f8ff9640 1 --2- 172.21.15.88:0/3285861805 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f09e8066470 0x7f09e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:43.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.950+0000 7f09f8ff9640 1 -- 172.21.15.88:0/3285861805 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f09ec11e7b0 con 0x7f09fc06d2b0 2023-12-08T08:22:43.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.950+0000 7f09fb7fe640 1 --2- 172.21.15.88:0/3285861805 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f09e8066470 0x7f09e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:43.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.950+0000 7f09fb7fe640 1 --2- 172.21.15.88:0/3285861805 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f09e8066470 0x7f09e8068930 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f09fc154ad0 tx=0x7f09f0007e50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:43.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:43.954+0000 7f09f8ff9640 1 -- 172.21.15.88:0/3285861805 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f09ec0ebc60 con 0x7f09fc06d2b0 2023-12-08T08:22:44.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.106+0000 7f0a026ea640 1 -- 172.21.15.88:0/3285861805 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09fc1529b0 con 0x7f09fc06d2b0 2023-12-08T08:22:44.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.106+0000 7f09f8ff9640 1 -- 172.21.15.88:0/3285861805 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16677 (secure 0 0 0) 0x7f09ec0b1090 con 0x7f09fc06d2b0 2023-12-08T08:22:44.111 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:44.111 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":57,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:22:43.757870+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:22:17.787562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:22:18.955273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6837/4167133153":"2023-12-09T08:22:40.747080+0000","172.21.15.88:6835/4167133153":"2023-12-09T08:22:40.747080+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:22:44.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.106+0000 7f0a026ea640 1 -- 172.21.15.88:0/3285861805 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f09e8066470 msgr2=0x7f09e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:44.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.106+0000 7f0a026ea640 1 --2- 172.21.15.88:0/3285861805 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f09e8066470 0x7f09e8068930 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f09fc154ad0 tx=0x7f09f0007e50 comp rx=0 tx=0).stop 2023-12-08T08:22:44.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.106+0000 7f0a026ea640 1 -- 172.21.15.88:0/3285861805 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09fc06d2b0 msgr2=0x7f09fc154590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:44.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.106+0000 7f0a026ea640 1 --2- 172.21.15.88:0/3285861805 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09fc06d2b0 0x7f09fc154590 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f09ec0af040 tx=0x7f09ec019270 comp rx=0 tx=0).stop 2023-12-08T08:22:44.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.110+0000 7f0a026ea640 1 -- 172.21.15.88:0/3285861805 shutdown_connections 2023-12-08T08:22:44.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.110+0000 7f0a026ea640 1 --2- 172.21.15.88:0/3285861805 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f09e8066470 0x7f09e8068930 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.110+0000 7f0a026ea640 1 --2- 172.21.15.88:0/3285861805 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f09fc0c5300 0x7f09fc150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.110+0000 7f0a026ea640 1 --2- 172.21.15.88:0/3285861805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09fc0c3b80 0x7f09fc152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.110+0000 7f0a026ea640 1 --2- 172.21.15.88:0/3285861805 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09fc06d2b0 0x7f09fc154590 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.110+0000 7f0a026ea640 1 -- 172.21.15.88:0/3285861805 >> 172.21.15.88:0/3285861805 conn(0x7f09fc0a7810 msgr2=0x7f09fc0c1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:44.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.110+0000 7f0a026ea640 1 -- 172.21.15.88:0/3285861805 shutdown_connections 2023-12-08T08:22:44.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.110+0000 7f0a026ea640 1 -- 172.21.15.88:0/3285861805 wait complete. 2023-12-08T08:22:44.133 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:22:17.787562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:22:18.955273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:22:44.134 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:22:44.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.270+0000 7f2be5b8d640 1 Processor -- start 2023-12-08T08:22:44.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.270+0000 7f2be5b8d640 1 -- start start 2023-12-08T08:22:44.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.270+0000 7f2be5b8d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2be014fc30 0x7f2be00c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:44.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.270+0000 7f2be5b8d640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2be006d840 0x7f2be00c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:44.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.270+0000 7f2be5b8d640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2be0152910 con 0x7f2be014f850 2023-12-08T08:22:44.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.270+0000 7f2be5b8d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2be00c2240 con 0x7f2be014fc30 2023-12-08T08:22:44.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.270+0000 7f2be5b8d640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2be0152bf0 con 0x7f2be006d840 2023-12-08T08:22:44.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.270+0000 7f2bd7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2be014fc30 0x7f2be00c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:44.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.270+0000 7f2bd7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2be014fc30 0x7f2be00c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53352/0 (socket says 172.21.15.88:53352) 2023-12-08T08:22:44.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.270+0000 7f2bd7fff640 1 -- 172.21.15.88:0/4189983458 learned_addr learned my addr 172.21.15.88:0/4189983458 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:44.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.270+0000 7f2bdffff640 1 --2- 172.21.15.88:0/4189983458 >> v2:172.21.15.148:3300/0 conn(0x7f2be006d840 0x7f2be00c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:44.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.270+0000 7f2bd7fff640 1 -- 172.21.15.88:0/4189983458 >> v2:172.21.15.148:3300/0 conn(0x7f2be006d840 msgr2=0x7f2be00c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:44.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.270+0000 7f2bd7fff640 1 --2- 172.21.15.88:0/4189983458 >> v2:172.21.15.148:3300/0 conn(0x7f2be006d840 0x7f2be00c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.270+0000 7f2bd7fff640 1 -- 172.21.15.88:0/4189983458 >> v1:172.21.15.148:6789/0 conn(0x7f2be014f850 legacy=0x7f2be00aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:44.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.270+0000 7f2bd7fff640 1 -- 172.21.15.88:0/4189983458 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be0152ed0 con 0x7f2be014fc30 2023-12-08T08:22:44.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.270+0000 7f2bdffff640 1 --2- 172.21.15.88:0/4189983458 >> v2:172.21.15.148:3300/0 conn(0x7f2be006d840 0x7f2be00c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:44.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.274+0000 7f2bd7fff640 1 --2- 172.21.15.88:0/4189983458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2be014fc30 0x7f2be00c3cd0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f2be00c2440 tx=0x7f2bc801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0c224f9d11ec08 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:44.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.274+0000 7f2bdeffd640 1 -- 172.21.15.88:0/4189983458 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc80ab5f0 con 0x7f2be014fc30 2023-12-08T08:22:44.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.274+0000 7f2bdeffd640 1 -- 172.21.15.88:0/4189983458 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc80ab750 con 0x7f2be014fc30 2023-12-08T08:22:44.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.274+0000 7f2bdeffd640 1 -- 172.21.15.88:0/4189983458 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc80abae0 con 0x7f2be014fc30 2023-12-08T08:22:44.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.274+0000 7f2be5b8d640 1 -- 172.21.15.88:0/4189983458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2be014fc30 msgr2=0x7f2be00c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:44.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.274+0000 7f2be5b8d640 1 --2- 172.21.15.88:0/4189983458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2be014fc30 0x7f2be00c3cd0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f2be00c2440 tx=0x7f2bc801c4c0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.274+0000 7f2be5b8d640 1 -- 172.21.15.88:0/4189983458 shutdown_connections 2023-12-08T08:22:44.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.274+0000 7f2be5b8d640 1 --2- 172.21.15.88:0/4189983458 >> v2:172.21.15.148:3300/0 conn(0x7f2be006d840 0x7f2be00c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.274+0000 7f2be5b8d640 1 --2- 172.21.15.88:0/4189983458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2be014fc30 0x7f2be00c3cd0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.274+0000 7f2be5b8d640 1 -- 172.21.15.88:0/4189983458 >> 172.21.15.88:0/4189983458 conn(0x7f2be00c59f0 msgr2=0x7f2be00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:44.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.274+0000 7f2be5b8d640 1 -- 172.21.15.88:0/4189983458 shutdown_connections 2023-12-08T08:22:44.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.274+0000 7f2be5b8d640 1 -- 172.21.15.88:0/4189983458 wait complete. 2023-12-08T08:22:44.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.274+0000 7f2be5b8d640 1 Processor -- start 2023-12-08T08:22:44.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.274+0000 7f2be5b8d640 1 -- start start 2023-12-08T08:22:44.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.278+0000 7f2be5b8d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2be006d840 0x7f2be01471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:44.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.278+0000 7f2be5b8d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2be014f850 0x7f2be0072100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:44.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.278+0000 7f2be5b8d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2be014fc30 0x7f2be0072640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:44.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.278+0000 7f2be5b8d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be00a9be0 con 0x7f2be014fc30 2023-12-08T08:22:44.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.278+0000 7f2be5b8d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be00a5a40 con 0x7f2be014f850 2023-12-08T08:22:44.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.278+0000 7f2be5b8d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be00a9620 con 0x7f2be006d840 2023-12-08T08:22:44.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.278+0000 7f2bdffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2be014fc30 0x7f2be0072640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:44.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.278+0000 7f2bdffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2be014fc30 0x7f2be0072640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53362/0 (socket says 172.21.15.88:53362) 2023-12-08T08:22:44.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.278+0000 7f2bdffff640 1 -- 172.21.15.88:0/3140245869 learned_addr learned my addr 172.21.15.88:0/3140245869 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:44.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.278+0000 7f2bd7fff640 1 --2- 172.21.15.88:0/3140245869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2be014f850 0x7f2be0072100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:44.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.278+0000 7f2bdf7fe640 1 --2- 172.21.15.88:0/3140245869 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2be006d840 0x7f2be01471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:44.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.278+0000 7f2bdffff640 1 -- 172.21.15.88:0/3140245869 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2be006d840 msgr2=0x7f2be01471a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:44.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.278+0000 7f2bdffff640 1 --2- 172.21.15.88:0/3140245869 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2be006d840 0x7f2be01471a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.278+0000 7f2bdffff640 1 -- 172.21.15.88:0/3140245869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2be014f850 msgr2=0x7f2be0072100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:44.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.278+0000 7f2bdffff640 1 --2- 172.21.15.88:0/3140245869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2be014f850 0x7f2be0072100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.278+0000 7f2bdffff640 1 -- 172.21.15.88:0/3140245869 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc80094d0 con 0x7f2be014fc30 2023-12-08T08:22:44.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.278+0000 7f2bdf7fe640 1 --2- 172.21.15.88:0/3140245869 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2be006d840 0x7f2be01471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:44.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.278+0000 7f2bdffff640 1 --2- 172.21.15.88:0/3140245869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2be014fc30 0x7f2be0072640 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8007f20 tx=0x7f2bd800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:44.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.278+0000 7f2bdcff9640 1 -- 172.21.15.88:0/3140245869 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd800dee0 con 0x7f2be014fc30 2023-12-08T08:22:44.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.278+0000 7f2bdcff9640 1 -- 172.21.15.88:0/3140245869 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd800f040 con 0x7f2be014fc30 2023-12-08T08:22:44.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.278+0000 7f2bdcff9640 1 -- 172.21.15.88:0/3140245869 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd8003de0 con 0x7f2be014fc30 2023-12-08T08:22:44.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.278+0000 7f2be5b8d640 1 -- 172.21.15.88:0/3140245869 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be00a9900 con 0x7f2be014fc30 2023-12-08T08:22:44.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.278+0000 7f2be5b8d640 1 -- 172.21.15.88:0/3140245869 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be01476e0 con 0x7f2be014fc30 2023-12-08T08:22:44.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.278+0000 7f2be5b8d640 1 -- 172.21.15.88:0/3140245869 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2be0067630 con 0x7f2be014fc30 2023-12-08T08:22:44.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.278+0000 7f2bdcff9640 1 -- 172.21.15.88:0/3140245869 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2bd8004030 con 0x7f2be014fc30 2023-12-08T08:22:44.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.282+0000 7f2bdcff9640 1 --2- 172.21.15.88:0/3140245869 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2bc00664a0 0x7f2bc0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:44.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.282+0000 7f2bdcff9640 1 -- 172.21.15.88:0/3140245869 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f2bd8084100 con 0x7f2be014fc30 2023-12-08T08:22:44.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.282+0000 7f2bdf7fe640 1 --2- 172.21.15.88:0/3140245869 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2bc00664a0 0x7f2bc0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:44.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.282+0000 7f2bdf7fe640 1 --2- 172.21.15.88:0/3140245869 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2bc00664a0 0x7f2bc0068960 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0003ec0 tx=0x7f2bd0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:44.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.286+0000 7f2bdcff9640 1 -- 172.21.15.88:0/3140245869 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2bd8051660 con 0x7f2be014fc30 2023-12-08T08:22:44.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.434+0000 7f2be5b8d640 1 -- 172.21.15.88:0/3140245869 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2be00a5b80 con 0x7f2be014fc30 2023-12-08T08:22:44.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.434+0000 7f2bdcff9640 1 -- 172.21.15.88:0/3140245869 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2bd8054c80 con 0x7f2be014fc30 2023-12-08T08:22:44.439 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:22:44.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.434+0000 7f2be5b8d640 1 -- 172.21.15.88:0/3140245869 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2bc00664a0 msgr2=0x7f2bc0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:44.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.434+0000 7f2be5b8d640 1 --2- 172.21.15.88:0/3140245869 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2bc00664a0 0x7f2bc0068960 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0003ec0 tx=0x7f2bd0009040 comp rx=0 tx=0).stop 2023-12-08T08:22:44.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.434+0000 7f2be5b8d640 1 -- 172.21.15.88:0/3140245869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2be014fc30 msgr2=0x7f2be0072640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:44.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.434+0000 7f2be5b8d640 1 --2- 172.21.15.88:0/3140245869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2be014fc30 0x7f2be0072640 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8007f20 tx=0x7f2bd800d560 comp rx=0 tx=0).stop 2023-12-08T08:22:44.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.434+0000 7f2be5b8d640 1 -- 172.21.15.88:0/3140245869 shutdown_connections 2023-12-08T08:22:44.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.434+0000 7f2be5b8d640 1 --2- 172.21.15.88:0/3140245869 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2bc00664a0 0x7f2bc0068960 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.434+0000 7f2be5b8d640 1 --2- 172.21.15.88:0/3140245869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2be014fc30 0x7f2be0072640 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.434+0000 7f2be5b8d640 1 --2- 172.21.15.88:0/3140245869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2be014f850 0x7f2be0072100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.434+0000 7f2be5b8d640 1 --2- 172.21.15.88:0/3140245869 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2be006d840 0x7f2be01471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.434+0000 7f2be5b8d640 1 -- 172.21.15.88:0/3140245869 >> 172.21.15.88:0/3140245869 conn(0x7f2be00c59f0 msgr2=0x7f2be00bed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:44.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.434+0000 7f2be5b8d640 1 -- 172.21.15.88:0/3140245869 shutdown_connections 2023-12-08T08:22:44.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.434+0000 7f2be5b8d640 1 -- 172.21.15.88:0/3140245869 wait complete. 2023-12-08T08:22:44.460 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:22:44.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.598+0000 7fbee85df640 1 Processor -- start 2023-12-08T08:22:44.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.598+0000 7fbee85df640 1 -- start start 2023-12-08T08:22:44.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.598+0000 7fbee85df640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbee014b1e0 0x7fbee00c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:44.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.598+0000 7fbee85df640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbee00c5300 0x7fbee00a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:44.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.598+0000 7fbee85df640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee00a4e20 con 0x7fbee0151280 2023-12-08T08:22:44.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.598+0000 7fbee85df640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee01558d0 con 0x7fbee014b1e0 2023-12-08T08:22:44.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.598+0000 7fbee85df640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee00a50e0 con 0x7fbee00c5300 2023-12-08T08:22:44.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.598+0000 7fbee637b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbee014b1e0 0x7fbee00c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:44.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.598+0000 7fbee637b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbee014b1e0 0x7fbee00c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53370/0 (socket says 172.21.15.88:53370) 2023-12-08T08:22:44.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.598+0000 7fbee637b640 1 -- 172.21.15.88:0/2055514272 learned_addr learned my addr 172.21.15.88:0/2055514272 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:44.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.598+0000 7fbee637b640 1 -- 172.21.15.88:0/2055514272 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbee00c5300 msgr2=0x7fbee00a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:44.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.598+0000 7fbee5b7a640 1 --2- 172.21.15.88:0/2055514272 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbee00c5300 0x7fbee00a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:44.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.598+0000 7fbee637b640 1 --2- 172.21.15.88:0/2055514272 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbee00c5300 0x7fbee00a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.598+0000 7fbee637b640 1 -- 172.21.15.88:0/2055514272 >> v1:172.21.15.148:6789/0 conn(0x7fbee0151280 legacy=0x7fbee0151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:44.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.598+0000 7fbee637b640 1 -- 172.21.15.88:0/2055514272 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee00c0f00 con 0x7fbee014b1e0 2023-12-08T08:22:44.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.598+0000 7fbee5b7a640 1 --2- 172.21.15.88:0/2055514272 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbee00c5300 0x7fbee00a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:44.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.602+0000 7fbee637b640 1 --2- 172.21.15.88:0/2055514272 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbee014b1e0 0x7fbee00c1700 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fbee00c4150 tx=0x7fbedc01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e200e956cbae7076 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:44.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.602+0000 7fbee5379640 1 -- 172.21.15.88:0/2055514272 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc0ad640 con 0x7fbee014b1e0 2023-12-08T08:22:44.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.602+0000 7fbee5379640 1 -- 172.21.15.88:0/2055514272 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbedc0ad7a0 con 0x7fbee014b1e0 2023-12-08T08:22:44.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.602+0000 7fbee5379640 1 -- 172.21.15.88:0/2055514272 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc0adb30 con 0x7fbee014b1e0 2023-12-08T08:22:44.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.602+0000 7fbee85df640 1 -- 172.21.15.88:0/2055514272 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbee014b1e0 msgr2=0x7fbee00c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:44.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.602+0000 7fbee85df640 1 --2- 172.21.15.88:0/2055514272 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbee014b1e0 0x7fbee00c1700 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fbee00c4150 tx=0x7fbedc01c4c0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.602+0000 7fbee85df640 1 -- 172.21.15.88:0/2055514272 shutdown_connections 2023-12-08T08:22:44.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.602+0000 7fbee85df640 1 --2- 172.21.15.88:0/2055514272 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbee00c5300 0x7fbee00a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.602+0000 7fbee85df640 1 --2- 172.21.15.88:0/2055514272 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbee014b1e0 0x7fbee00c1700 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.602+0000 7fbee85df640 1 -- 172.21.15.88:0/2055514272 >> 172.21.15.88:0/2055514272 conn(0x7fbee00c59f0 msgr2=0x7fbee00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:44.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.602+0000 7fbee85df640 1 -- 172.21.15.88:0/2055514272 shutdown_connections 2023-12-08T08:22:44.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.602+0000 7fbee85df640 1 -- 172.21.15.88:0/2055514272 wait complete. 2023-12-08T08:22:44.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.602+0000 7fbee85df640 1 Processor -- start 2023-12-08T08:22:44.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.606+0000 7fbee85df640 1 -- start start 2023-12-08T08:22:44.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.606+0000 7fbee85df640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbee00c5300 0x7fbee0149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:44.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.606+0000 7fbee85df640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbee014b1e0 0x7fbee0144cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:44.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.606+0000 7fbee85df640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbee0151280 0x7fbee0145210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:44.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.606+0000 7fbee85df640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee0146b50 con 0x7fbee014b1e0 2023-12-08T08:22:44.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.606+0000 7fbee85df640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee0140df0 con 0x7fbee00c5300 2023-12-08T08:22:44.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.606+0000 7fbee85df640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee01ec2f0 con 0x7fbee0151280 2023-12-08T08:22:44.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.606+0000 7fbee5b7a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbee014b1e0 0x7fbee0144cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:44.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.606+0000 7fbee5b7a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbee014b1e0 0x7fbee0144cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53382/0 (socket says 172.21.15.88:53382) 2023-12-08T08:22:44.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.606+0000 7fbee5b7a640 1 -- 172.21.15.88:0/3342396095 learned_addr learned my addr 172.21.15.88:0/3342396095 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:44.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.606+0000 7fbee637b640 1 --2- 172.21.15.88:0/3342396095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbee00c5300 0x7fbee0149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:44.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.606+0000 7fbee6b7c640 1 --2- 172.21.15.88:0/3342396095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbee0151280 0x7fbee0145210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:44.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.606+0000 7fbee5b7a640 1 -- 172.21.15.88:0/3342396095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbee0151280 msgr2=0x7fbee0145210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:44.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.606+0000 7fbee5b7a640 1 --2- 172.21.15.88:0/3342396095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbee0151280 0x7fbee0145210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.606+0000 7fbee5b7a640 1 -- 172.21.15.88:0/3342396095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbee00c5300 msgr2=0x7fbee0149ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:44.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.606+0000 7fbee5b7a640 1 --2- 172.21.15.88:0/3342396095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbee00c5300 0x7fbee0149ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.606+0000 7fbee5b7a640 1 -- 172.21.15.88:0/3342396095 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbedc0094d0 con 0x7fbee014b1e0 2023-12-08T08:22:44.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.606+0000 7fbee6b7c640 1 --2- 172.21.15.88:0/3342396095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbee0151280 0x7fbee0145210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:44.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.606+0000 7fbee5b7a640 1 --2- 172.21.15.88:0/3342396095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbee014b1e0 0x7fbee0144cd0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fbed000c7f0 tx=0x7fbed000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:44.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.606+0000 7fbed6ffd640 1 -- 172.21.15.88:0/3342396095 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed000cea0 con 0x7fbee014b1e0 2023-12-08T08:22:44.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.606+0000 7fbed6ffd640 1 -- 172.21.15.88:0/3342396095 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed0007a30 con 0x7fbee014b1e0 2023-12-08T08:22:44.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.606+0000 7fbed6ffd640 1 -- 172.21.15.88:0/3342396095 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed0007dc0 con 0x7fbee014b1e0 2023-12-08T08:22:44.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.606+0000 7fbee85df640 1 -- 172.21.15.88:0/3342396095 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee01ec5d0 con 0x7fbee014b1e0 2023-12-08T08:22:44.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.606+0000 7fbee85df640 1 -- 172.21.15.88:0/3342396095 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee01ecb90 con 0x7fbee014b1e0 2023-12-08T08:22:44.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.606+0000 7fbee85df640 1 -- 172.21.15.88:0/3342396095 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee0067630 con 0x7fbee014b1e0 2023-12-08T08:22:44.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.610+0000 7fbed6ffd640 1 -- 172.21.15.88:0/3342396095 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbed00113f0 con 0x7fbee014b1e0 2023-12-08T08:22:44.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.610+0000 7fbed6ffd640 1 --2- 172.21.15.88:0/3342396095 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbec4066470 0x7fbec4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:44.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.610+0000 7fbed6ffd640 1 -- 172.21.15.88:0/3342396095 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fbed0083ff0 con 0x7fbee014b1e0 2023-12-08T08:22:44.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.610+0000 7fbee637b640 1 --2- 172.21.15.88:0/3342396095 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbec4066470 0x7fbec4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:44.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.610+0000 7fbee637b640 1 --2- 172.21.15.88:0/3342396095 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbec4066470 0x7fbec4068930 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbedc0af000 tx=0x7fbedc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:44.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.614+0000 7fbed6ffd640 1 -- 172.21.15.88:0/3342396095 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbed00514b0 con 0x7fbee014b1e0 2023-12-08T08:22:44.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.762+0000 7fbee85df640 1 -- 172.21.15.88:0/3342396095 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbee006dc80 con 0x7fbee014b1e0 2023-12-08T08:22:44.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.766+0000 7fbed6ffd640 1 -- 172.21.15.88:0/3342396095 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v57) v1 ==== 105+0+11 (secure 0 0 0) 0x7fbed0054ad0 con 0x7fbee014b1e0 2023-12-08T08:22:44.770 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:22:44.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.766+0000 7fbee85df640 1 -- 172.21.15.88:0/3342396095 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbec4066470 msgr2=0x7fbec4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:44.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.766+0000 7fbee85df640 1 --2- 172.21.15.88:0/3342396095 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbec4066470 0x7fbec4068930 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbedc0af000 tx=0x7fbedc008040 comp rx=0 tx=0).stop 2023-12-08T08:22:44.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.766+0000 7fbee85df640 1 -- 172.21.15.88:0/3342396095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbee014b1e0 msgr2=0x7fbee0144cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:44.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.766+0000 7fbee85df640 1 --2- 172.21.15.88:0/3342396095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbee014b1e0 0x7fbee0144cd0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fbed000c7f0 tx=0x7fbed000ccb0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.766+0000 7fbee85df640 1 -- 172.21.15.88:0/3342396095 shutdown_connections 2023-12-08T08:22:44.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.766+0000 7fbee85df640 1 --2- 172.21.15.88:0/3342396095 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbec4066470 0x7fbec4068930 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.766+0000 7fbee85df640 1 --2- 172.21.15.88:0/3342396095 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbee0151280 0x7fbee0145210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.766+0000 7fbee85df640 1 --2- 172.21.15.88:0/3342396095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbee014b1e0 0x7fbee0144cd0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.766+0000 7fbee85df640 1 --2- 172.21.15.88:0/3342396095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbee00c5300 0x7fbee0149ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.766+0000 7fbee85df640 1 -- 172.21.15.88:0/3342396095 >> 172.21.15.88:0/3342396095 conn(0x7fbee00c59f0 msgr2=0x7fbee01442a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:44.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.766+0000 7fbee85df640 1 -- 172.21.15.88:0/3342396095 shutdown_connections 2023-12-08T08:22:44.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.766+0000 7fbee85df640 1 -- 172.21.15.88:0/3342396095 wait complete. 2023-12-08T08:22:44.791 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:22:44.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.926+0000 7f810d8e3640 1 Processor -- start 2023-12-08T08:22:44.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.926+0000 7f810d8e3640 1 -- start start 2023-12-08T08:22:44.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.926+0000 7f810d8e3640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8108157a90 0x7f810806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:44.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.926+0000 7f810d8e3640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81080c1810 con 0x7f8108151a20 2023-12-08T08:22:44.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.926+0000 7f810d8e3640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81080c2320 con 0x7f810806bb00 2023-12-08T08:22:44.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.926+0000 7f810d8e3640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81080c2720 con 0x7f8108157a90 2023-12-08T08:22:44.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.926+0000 7f8106ffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8108151a20 0x7f810806e890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35852/0 (socket says 172.21.15.88:35852) 2023-12-08T08:22:44.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.926+0000 7f8106ffd640 1 -- 172.21.15.88:0/2223759158 learned_addr learned my addr 172.21.15.88:0/2223759158 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:44.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.930+0000 7f80fe7fc640 1 --2- 172.21.15.88:0/2223759158 >> v2:172.21.15.148:3300/0 conn(0x7f8108157a90 0x7f810806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:44.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.930+0000 7f81067fc640 1 -- 172.21.15.88:0/2223759158 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 873831956 0 0) 0x7f81080c1810 con 0x7f8108151a20 2023-12-08T08:22:44.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.930+0000 7f81067fc640 1 -- 172.21.15.88:0/2223759158 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80f4003530 con 0x7f8108151a20 2023-12-08T08:22:44.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.930+0000 7f81067fc640 1 -- 172.21.15.88:0/2223759158 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 908124799 0 0) 0x7f80f4003530 con 0x7f8108151a20 2023-12-08T08:22:44.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.930+0000 7f81067fc640 1 -- 172.21.15.88:0/2223759158 >> v2:172.21.15.148:3300/0 conn(0x7f8108157a90 msgr2=0x7f810806b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:44.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.930+0000 7f81067fc640 1 --2- 172.21.15.88:0/2223759158 >> v2:172.21.15.148:3300/0 conn(0x7f8108157a90 0x7f810806b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.930+0000 7f81067fc640 1 -- 172.21.15.88:0/2223759158 >> v1:172.21.15.148:6789/0 conn(0x7f810806bb00 legacy=0x7f8108154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:44.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.930+0000 7f81067fc640 1 -- 172.21.15.88:0/2223759158 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81080c1a80 con 0x7f8108151a20 2023-12-08T08:22:44.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.930+0000 7f81067fc640 1 -- 172.21.15.88:0/2223759158 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f80f8001a00 con 0x7f8108151a20 2023-12-08T08:22:44.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.930+0000 7f81067fc640 1 -- 172.21.15.88:0/2223759158 >> v1:172.21.15.88:6789/0 conn(0x7f8108151a20 legacy=0x7f810806e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:44.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.930+0000 7f81067fc640 1 --2- 172.21.15.88:0/2223759158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80f40039d0 0x7f80f4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:44.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.930+0000 7f81067fc640 1 --2- 172.21.15.88:0/2223759158 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80f40047d0 0x7f80f4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:44.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.930+0000 7f81067fc640 1 --2- 172.21.15.88:0/2223759158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80f40051e0 0x7f80f400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:44.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.930+0000 7f81067fc640 1 -- 172.21.15.88:0/2223759158 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81080c2720 con 0x7f80f40039d0 2023-12-08T08:22:44.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.930+0000 7f81067fc640 1 -- 172.21.15.88:0/2223759158 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f400c130 con 0x7f80f40051e0 2023-12-08T08:22:44.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.930+0000 7f81067fc640 1 -- 172.21.15.88:0/2223759158 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f400c2f0 con 0x7f80f40047d0 2023-12-08T08:22:44.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.930+0000 7f8106ffd640 1 --2- 172.21.15.88:0/2223759158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80f40039d0 0x7f80f4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:44.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.930+0000 7f80fe7fc640 1 --2- 172.21.15.88:0/2223759158 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80f40047d0 0x7f80f4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:44.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.930+0000 7f81077fe640 1 --2- 172.21.15.88:0/2223759158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80f40051e0 0x7f80f400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:44.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.930+0000 7f8106ffd640 1 -- 172.21.15.88:0/2223759158 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80f40047d0 msgr2=0x7f80f4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:44.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.930+0000 7f8106ffd640 1 --2- 172.21.15.88:0/2223759158 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80f40047d0 0x7f80f4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.930+0000 7f8106ffd640 1 -- 172.21.15.88:0/2223759158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80f40051e0 msgr2=0x7f80f400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:44.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.930+0000 7f8106ffd640 1 --2- 172.21.15.88:0/2223759158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80f40051e0 0x7f80f400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.930+0000 7f8106ffd640 1 -- 172.21.15.88:0/2223759158 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f4003530 con 0x7f80f40039d0 2023-12-08T08:22:44.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.930+0000 7f80fe7fc640 1 --2- 172.21.15.88:0/2223759158 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80f40047d0 0x7f80f4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:44.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.930+0000 7f81077fe640 1 --2- 172.21.15.88:0/2223759158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80f40051e0 0x7f80f400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:44.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.930+0000 7f81077fe640 1 -- 172.21.15.88:0/2223759158 reap_dead start 2023-12-08T08:22:44.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.934+0000 7f8106ffd640 1 --2- 172.21.15.88:0/2223759158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80f40039d0 0x7f80f4003df0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f80f8002240 tx=0x7f80f801d220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=816f3158d066dd64 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:44.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.934+0000 7f81067fc640 1 -- 172.21.15.88:0/2223759158 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f80ae470 con 0x7f80f40039d0 2023-12-08T08:22:44.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.934+0000 7f81067fc640 1 -- 172.21.15.88:0/2223759158 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f80ae5d0 con 0x7f80f40039d0 2023-12-08T08:22:44.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.934+0000 7f81067fc640 1 -- 172.21.15.88:0/2223759158 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f80aea00 con 0x7f80f40039d0 2023-12-08T08:22:44.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.934+0000 7f810d8e3640 1 -- 172.21.15.88:0/2223759158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80f40039d0 msgr2=0x7f80f4003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:44.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.934+0000 7f810d8e3640 1 --2- 172.21.15.88:0/2223759158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80f40039d0 0x7f80f4003df0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f80f8002240 tx=0x7f80f801d220 comp rx=0 tx=0).stop 2023-12-08T08:22:44.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.934+0000 7f810d8e3640 1 -- 172.21.15.88:0/2223759158 shutdown_connections 2023-12-08T08:22:44.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.934+0000 7f810d8e3640 1 --2- 172.21.15.88:0/2223759158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80f40039d0 0x7f80f4003df0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.934+0000 7f810d8e3640 1 -- 172.21.15.88:0/2223759158 >> 172.21.15.88:0/2223759158 conn(0x7f81080c2e20 msgr2=0x7f81080c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:44.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.934+0000 7f810d8e3640 1 -- 172.21.15.88:0/2223759158 shutdown_connections 2023-12-08T08:22:44.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.934+0000 7f810d8e3640 1 -- 172.21.15.88:0/2223759158 wait complete. 2023-12-08T08:22:44.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.934+0000 7f810d8e3640 1 Processor -- start 2023-12-08T08:22:44.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.934+0000 7f810d8e3640 1 -- start start 2023-12-08T08:22:44.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.938+0000 7f810d8e3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80f40039d0 0x7f81080bf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:44.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.938+0000 7f810d8e3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8108153bc0 0x7f8108152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:44.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.938+0000 7f810d8e3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8108153510 0x7f810814ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:44.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.938+0000 7f810d8e3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81080a9720 con 0x7f8108153bc0 2023-12-08T08:22:44.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.938+0000 7f810d8e3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8108153990 con 0x7f80f40039d0 2023-12-08T08:22:44.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.938+0000 7f810d8e3640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81080a9970 con 0x7f8108153510 2023-12-08T08:22:44.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.938+0000 7f80fe7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8108153bc0 0x7f8108152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:44.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.938+0000 7f80fe7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8108153bc0 0x7f8108152fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53392/0 (socket says 172.21.15.88:53392) 2023-12-08T08:22:44.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.938+0000 7f80fe7fc640 1 -- 172.21.15.88:0/1547425482 learned_addr learned my addr 172.21.15.88:0/1547425482 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:44.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.938+0000 7f8106ffd640 1 --2- 172.21.15.88:0/1547425482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80f40039d0 0x7f81080bf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:44.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.938+0000 7f81077fe640 1 --2- 172.21.15.88:0/1547425482 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8108153510 0x7f810814ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:44.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.938+0000 7f80fe7fc640 1 -- 172.21.15.88:0/1547425482 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8108153510 msgr2=0x7f810814ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:44.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.938+0000 7f80fe7fc640 1 --2- 172.21.15.88:0/1547425482 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8108153510 0x7f810814ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.938+0000 7f80fe7fc640 1 -- 172.21.15.88:0/1547425482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80f40039d0 msgr2=0x7f81080bf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:44.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.938+0000 7f80fe7fc640 1 --2- 172.21.15.88:0/1547425482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80f40039d0 0x7f81080bf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:44.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.938+0000 7f80fe7fc640 1 -- 172.21.15.88:0/1547425482 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81080a9c50 con 0x7f8108153bc0 2023-12-08T08:22:44.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.938+0000 7f80fe7fc640 1 --2- 172.21.15.88:0/1547425482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8108153bc0 0x7f8108152fd0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f80f0011530 tx=0x7f80f00119f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:44.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.938+0000 7f8104ff9640 1 -- 172.21.15.88:0/1547425482 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0004220 con 0x7f8108153bc0 2023-12-08T08:22:44.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.938+0000 7f8104ff9640 1 -- 172.21.15.88:0/1547425482 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f0004380 con 0x7f8108153bc0 2023-12-08T08:22:44.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.938+0000 7f8104ff9640 1 -- 172.21.15.88:0/1547425482 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0015870 con 0x7f8108153bc0 2023-12-08T08:22:44.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.938+0000 7f810d8e3640 1 -- 172.21.15.88:0/1547425482 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81080a9f30 con 0x7f8108153bc0 2023-12-08T08:22:44.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.938+0000 7f810d8e3640 1 -- 172.21.15.88:0/1547425482 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8108152ab0 con 0x7f8108153bc0 2023-12-08T08:22:44.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.938+0000 7f810d8e3640 1 -- 172.21.15.88:0/1547425482 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8108152c70 con 0x7f8108153bc0 2023-12-08T08:22:44.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.938+0000 7f8104ff9640 1 -- 172.21.15.88:0/1547425482 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f80f00159d0 con 0x7f8108153bc0 2023-12-08T08:22:44.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.942+0000 7f8104ff9640 1 --2- 172.21.15.88:0/1547425482 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f80e80664a0 0x7f80e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:44.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.942+0000 7f8104ff9640 1 -- 172.21.15.88:0/1547425482 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f80f0084270 con 0x7f8108153bc0 2023-12-08T08:22:44.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.942+0000 7f8106ffd640 1 --2- 172.21.15.88:0/1547425482 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f80e80664a0 0x7f80e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:44.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.942+0000 7f8106ffd640 1 --2- 172.21.15.88:0/1547425482 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f80e80664a0 0x7f80e8068960 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f80f80ad000 tx=0x7f80f80a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:44.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:44.946+0000 7f8104ff9640 1 -- 172.21.15.88:0/1547425482 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f80f00516a0 con 0x7f8108153bc0 2023-12-08T08:22:45.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.094+0000 7f810d8e3640 1 -- 172.21.15.88:0/1547425482 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f8108066660 con 0x7f8108153bc0 2023-12-08T08:22:45.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.094+0000 7f8104ff9640 1 -- 172.21.15.88:0/1547425482 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v57) v1 ==== 101+0+11 (secure 0 0 0) 0x7f80f0054cc0 con 0x7f8108153bc0 2023-12-08T08:22:45.101 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:22:45.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.098+0000 7f810d8e3640 1 -- 172.21.15.88:0/1547425482 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f80e80664a0 msgr2=0x7f80e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:45.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.098+0000 7f810d8e3640 1 --2- 172.21.15.88:0/1547425482 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f80e80664a0 0x7f80e8068960 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f80f80ad000 tx=0x7f80f80a7070 comp rx=0 tx=0).stop 2023-12-08T08:22:45.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.098+0000 7f810d8e3640 1 -- 172.21.15.88:0/1547425482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8108153bc0 msgr2=0x7f8108152fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:45.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.098+0000 7f810d8e3640 1 --2- 172.21.15.88:0/1547425482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8108153bc0 0x7f8108152fd0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f80f0011530 tx=0x7f80f00119f0 comp rx=0 tx=0).stop 2023-12-08T08:22:45.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.098+0000 7f810d8e3640 1 -- 172.21.15.88:0/1547425482 shutdown_connections 2023-12-08T08:22:45.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.098+0000 7f810d8e3640 1 --2- 172.21.15.88:0/1547425482 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f80e80664a0 0x7f80e8068960 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:45.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.098+0000 7f810d8e3640 1 --2- 172.21.15.88:0/1547425482 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8108153510 0x7f810814ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:45.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.098+0000 7f810d8e3640 1 --2- 172.21.15.88:0/1547425482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8108153bc0 0x7f8108152fd0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:45.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.098+0000 7f810d8e3640 1 --2- 172.21.15.88:0/1547425482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80f40039d0 0x7f81080bf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:45.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.098+0000 7f810d8e3640 1 -- 172.21.15.88:0/1547425482 >> 172.21.15.88:0/1547425482 conn(0x7f81080c2e20 msgr2=0x7f810806d830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:45.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.098+0000 7f810d8e3640 1 -- 172.21.15.88:0/1547425482 shutdown_connections 2023-12-08T08:22:45.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.098+0000 7f810d8e3640 1 -- 172.21.15.88:0/1547425482 wait complete. 2023-12-08T08:22:45.122 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:22:45.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.254+0000 7fcd0ee68640 1 Processor -- start 2023-12-08T08:22:45.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.254+0000 7fcd0ee68640 1 -- start start 2023-12-08T08:22:45.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.254+0000 7fcd0ee68640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcd080c47c0 0x7fcd08155100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:45.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.254+0000 7fcd0ee68640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd08155640 con 0x7fcd0806b320 2023-12-08T08:22:45.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.254+0000 7fcd0ee68640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd080c8aa0 con 0x7fcd08151ec0 2023-12-08T08:22:45.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.254+0000 7fcd0ee68640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd080c9060 con 0x7fcd080c47c0 2023-12-08T08:22:45.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.254+0000 7fcd0d405640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcd0806b320 0x7fcd080c7f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35854/0 (socket says 172.21.15.88:35854) 2023-12-08T08:22:45.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.254+0000 7fcd0d405640 1 -- 172.21.15.88:0/3034004530 learned_addr learned my addr 172.21.15.88:0/3034004530 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:45.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.254+0000 7fcd07fff640 1 --2- 172.21.15.88:0/3034004530 >> v2:172.21.15.148:3300/0 conn(0x7fcd080c47c0 0x7fcd08155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:45.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.254+0000 7fcd077fe640 1 -- 172.21.15.88:0/3034004530 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 374011870 0 0) 0x7fcd000014a0 con 0x7fcd0806b320 2023-12-08T08:22:45.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.254+0000 7fcd077fe640 1 -- 172.21.15.88:0/3034004530 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccf8003530 con 0x7fcd0806b320 2023-12-08T08:22:45.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.254+0000 7fcd077fe640 1 -- 172.21.15.88:0/3034004530 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034288035 0 0) 0x7fcd080c8aa0 con 0x7fcd08151ec0 2023-12-08T08:22:45.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.254+0000 7fcd077fe640 1 -- 172.21.15.88:0/3034004530 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd000014a0 con 0x7fcd08151ec0 2023-12-08T08:22:45.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.254+0000 7fcd077fe640 1 -- 172.21.15.88:0/3034004530 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1650396899 0 0) 0x7fccf8003530 con 0x7fcd0806b320 2023-12-08T08:22:45.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.254+0000 7fcd07fff640 1 -- 172.21.15.88:0/3034004530 >> v1:172.21.15.148:6789/0 conn(0x7fcd08151ec0 legacy=0x7fcd080c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:45.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.254+0000 7fcd07fff640 1 -- 172.21.15.88:0/3034004530 >> v1:172.21.15.88:6789/0 conn(0x7fcd0806b320 legacy=0x7fcd080c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:45.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.254+0000 7fcd07fff640 1 -- 172.21.15.88:0/3034004530 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd080c4d30 con 0x7fcd080c47c0 2023-12-08T08:22:45.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.258+0000 7fcd07fff640 1 --2- 172.21.15.88:0/3034004530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd080c47c0 0x7fcd08155100 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fccf40097c0 tx=0x7fccf401c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f36a1f5faac14c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:45.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.258+0000 7fcd077fe640 1 -- 172.21.15.88:0/3034004530 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd00001b90 con 0x7fcd080c47c0 2023-12-08T08:22:45.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.258+0000 7fcd077fe640 1 -- 172.21.15.88:0/3034004530 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf40a7050 con 0x7fcd080c47c0 2023-12-08T08:22:45.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.258+0000 7fcd077fe640 1 -- 172.21.15.88:0/3034004530 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf40ab620 con 0x7fcd080c47c0 2023-12-08T08:22:45.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.258+0000 7fcd0ee68640 1 -- 172.21.15.88:0/3034004530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd080c47c0 msgr2=0x7fcd08155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:45.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.258+0000 7fcd0ee68640 1 --2- 172.21.15.88:0/3034004530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd080c47c0 0x7fcd08155100 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fccf40097c0 tx=0x7fccf401c3a0 comp rx=0 tx=0).stop 2023-12-08T08:22:45.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.258+0000 7fcd0ee68640 1 -- 172.21.15.88:0/3034004530 shutdown_connections 2023-12-08T08:22:45.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.258+0000 7fcd0ee68640 1 --2- 172.21.15.88:0/3034004530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd080c47c0 0x7fcd08155100 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:45.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.258+0000 7fcd0ee68640 1 -- 172.21.15.88:0/3034004530 >> 172.21.15.88:0/3034004530 conn(0x7fcd080c9e40 msgr2=0x7fcd080ca250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:45.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.258+0000 7fcd0ee68640 1 -- 172.21.15.88:0/3034004530 shutdown_connections 2023-12-08T08:22:45.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.258+0000 7fcd0ee68640 1 -- 172.21.15.88:0/3034004530 wait complete. 2023-12-08T08:22:45.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.262+0000 7fcd0ee68640 1 Processor -- start 2023-12-08T08:22:45.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.262+0000 7fcd0ee68640 1 -- start start 2023-12-08T08:22:45.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.262+0000 7fcd0ee68640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd0806b320 0x7fcd080c3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:45.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.262+0000 7fcd0ee68640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd080c47c0 0x7fcd0814db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:45.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.262+0000 7fcd0ee68640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd08151ec0 0x7fcd0814e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:45.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.262+0000 7fcd0ee68640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd080c1f20 con 0x7fcd080c47c0 2023-12-08T08:22:45.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.262+0000 7fcd0ee68640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd08158350 con 0x7fcd0806b320 2023-12-08T08:22:45.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.262+0000 7fcd0ee68640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd08158910 con 0x7fcd08151ec0 2023-12-08T08:22:45.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.262+0000 7fcd07fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd080c47c0 0x7fcd0814db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:45.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.262+0000 7fcd07fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd080c47c0 0x7fcd0814db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53398/0 (socket says 172.21.15.88:53398) 2023-12-08T08:22:45.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.262+0000 7fcd07fff640 1 -- 172.21.15.88:0/3059293739 learned_addr learned my addr 172.21.15.88:0/3059293739 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:45.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.262+0000 7fcd07fff640 1 -- 172.21.15.88:0/3059293739 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd08151ec0 msgr2=0x7fcd0814e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:45.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.262+0000 7fcd0d405640 1 --2- 172.21.15.88:0/3059293739 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd08151ec0 0x7fcd0814e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:45.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.262+0000 7fcd0cc04640 1 --2- 172.21.15.88:0/3059293739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd0806b320 0x7fcd080c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:45.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.262+0000 7fcd07fff640 1 --2- 172.21.15.88:0/3059293739 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd08151ec0 0x7fcd0814e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:45.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.262+0000 7fcd07fff640 1 -- 172.21.15.88:0/3059293739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd0806b320 msgr2=0x7fcd080c3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:45.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.262+0000 7fcd07fff640 1 --2- 172.21.15.88:0/3059293739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd0806b320 0x7fcd080c3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:45.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.262+0000 7fcd07fff640 1 -- 172.21.15.88:0/3059293739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf4009420 con 0x7fcd080c47c0 2023-12-08T08:22:45.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.262+0000 7fcd0d405640 1 --2- 172.21.15.88:0/3059293739 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd08151ec0 0x7fcd0814e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:45.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.262+0000 7fcd0cc04640 1 --2- 172.21.15.88:0/3059293739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd0806b320 0x7fcd080c3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:45.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.262+0000 7fcd07fff640 1 --2- 172.21.15.88:0/3059293739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd080c47c0 0x7fcd0814db80 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fccf40097c0 tx=0x7fccf4019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:45.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.262+0000 7fcd057fa640 1 -- 172.21.15.88:0/3059293739 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf40abe80 con 0x7fcd080c47c0 2023-12-08T08:22:45.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.262+0000 7fcd057fa640 1 -- 172.21.15.88:0/3059293739 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf4004020 con 0x7fcd080c47c0 2023-12-08T08:22:45.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.262+0000 7fcd0ee68640 1 -- 172.21.15.88:0/3059293739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd081ed5b0 con 0x7fcd080c47c0 2023-12-08T08:22:45.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.262+0000 7fcd057fa640 1 -- 172.21.15.88:0/3059293739 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf40043d0 con 0x7fcd080c47c0 2023-12-08T08:22:45.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.262+0000 7fcd0ee68640 1 -- 172.21.15.88:0/3059293739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd081585a0 con 0x7fcd080c47c0 2023-12-08T08:22:45.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.266+0000 7fcd0ee68640 1 -- 172.21.15.88:0/3059293739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd08158a80 con 0x7fcd080c47c0 2023-12-08T08:22:45.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.266+0000 7fcd057fa640 1 -- 172.21.15.88:0/3059293739 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fccf40b2040 con 0x7fcd080c47c0 2023-12-08T08:22:45.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.266+0000 7fcd057fa640 1 --2- 172.21.15.88:0/3059293739 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fccec0664a0 0x7fccec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:45.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.266+0000 7fcd057fa640 1 -- 172.21.15.88:0/3059293739 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fccf411dbf0 con 0x7fcd080c47c0 2023-12-08T08:22:45.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.266+0000 7fcd0cc04640 1 --2- 172.21.15.88:0/3059293739 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fccec0664a0 0x7fccec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:45.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.266+0000 7fcd0cc04640 1 --2- 172.21.15.88:0/3059293739 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fccec0664a0 0x7fccec068960 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0011f0 tx=0x7fccfc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:45.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.270+0000 7fcd057fa640 1 -- 172.21.15.88:0/3059293739 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fccf40eb0a0 con 0x7fcd080c47c0 2023-12-08T08:22:45.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.454+0000 7fcd0ee68640 1 -- 172.21.15.88:0/3059293739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd08067630 con 0x7fcd080c47c0 2023-12-08T08:22:45.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.454+0000 7fcd057fa640 1 -- 172.21.15.88:0/3059293739 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4917 (secure 0 0 0) 0x7fccf40b0090 con 0x7fcd080c47c0 2023-12-08T08:22:45.459 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:45.459 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5240,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/2576328340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2576328340},{"type":"v1","addr":"172.21.15.148:6834","nonce":2576328340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5626,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/1685449423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1685449423},{"type":"v1","addr":"172.21.15.88:6836","nonce":1685449423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6348,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/245978965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":245978965},{"type":"v1","addr":"172.21.15.88:6837","nonce":245978965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:22:19.959416+0000","modified":"2023-12-08T08:22:22.972913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5635},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5635":{"gid":5635,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":7,"addr":"172.21.15.148:6835/604820378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":604820378},{"type":"v1","addr":"172.21.15.148:6835","nonce":604820378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-08T08:22:45.459 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 39 2023-12-08T08:22:45.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.454+0000 7fcd0ee68640 1 -- 172.21.15.88:0/3059293739 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fccec0664a0 msgr2=0x7fccec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:45.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.454+0000 7fcd0ee68640 1 --2- 172.21.15.88:0/3059293739 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fccec0664a0 0x7fccec068960 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0011f0 tx=0x7fccfc009040 comp rx=0 tx=0).stop 2023-12-08T08:22:45.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.454+0000 7fcd0ee68640 1 -- 172.21.15.88:0/3059293739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd080c47c0 msgr2=0x7fcd0814db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:45.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.454+0000 7fcd0ee68640 1 --2- 172.21.15.88:0/3059293739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd080c47c0 0x7fcd0814db80 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fccf40097c0 tx=0x7fccf4019140 comp rx=0 tx=0).stop 2023-12-08T08:22:45.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.454+0000 7fcd0ee68640 1 -- 172.21.15.88:0/3059293739 shutdown_connections 2023-12-08T08:22:45.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.454+0000 7fcd0ee68640 1 --2- 172.21.15.88:0/3059293739 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fccec0664a0 0x7fccec068960 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:45.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.454+0000 7fcd0ee68640 1 --2- 172.21.15.88:0/3059293739 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcd08151ec0 0x7fcd0814e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:45.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.454+0000 7fcd0ee68640 1 --2- 172.21.15.88:0/3059293739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd080c47c0 0x7fcd0814db80 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:45.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.454+0000 7fcd0ee68640 1 --2- 172.21.15.88:0/3059293739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd0806b320 0x7fcd080c3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:45.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.454+0000 7fcd0ee68640 1 -- 172.21.15.88:0/3059293739 >> 172.21.15.88:0/3059293739 conn(0x7fcd080c9e40 msgr2=0x7fcd0815f720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:45.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.454+0000 7fcd0ee68640 1 -- 172.21.15.88:0/3059293739 shutdown_connections 2023-12-08T08:22:45.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.454+0000 7fcd0ee68640 1 -- 172.21.15.88:0/3059293739 wait complete. 2023-12-08T08:22:45.479 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:22:45.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.614+0000 7efe8e12a640 1 Processor -- start 2023-12-08T08:22:45.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.614+0000 7efe8e12a640 1 -- start start 2023-12-08T08:22:45.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.614+0000 7efe8e12a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efe880af4c0 0x7efe88154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:45.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.614+0000 7efe8e12a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe880c4890 con 0x7efe8806c100 2023-12-08T08:22:45.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.614+0000 7efe8e12a640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe880af8a0 con 0x7efe880c67d0 2023-12-08T08:22:45.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.614+0000 7efe8e12a640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe88155460 con 0x7efe880af4c0 2023-12-08T08:22:45.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.614+0000 7efe87fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7efe8806c100 0x7efe8815ee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35870/0 (socket says 172.21.15.88:35870) 2023-12-08T08:22:45.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.614+0000 7efe87fff640 1 -- 172.21.15.88:0/668387680 learned_addr learned my addr 172.21.15.88:0/668387680 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:45.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.614+0000 7efe877fe640 1 --2- 172.21.15.88:0/668387680 >> v2:172.21.15.148:3300/0 conn(0x7efe880af4c0 0x7efe88154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:45.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.614+0000 7efe867fc640 1 -- 172.21.15.88:0/668387680 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3069158471 0 0) 0x7efe880c4890 con 0x7efe8806c100 2023-12-08T08:22:45.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.614+0000 7efe867fc640 1 -- 172.21.15.88:0/668387680 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe70003530 con 0x7efe8806c100 2023-12-08T08:22:45.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.614+0000 7efe877fe640 1 -- 172.21.15.88:0/668387680 >> v1:172.21.15.148:6789/0 conn(0x7efe880c67d0 legacy=0x7efe8806b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:45.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.614+0000 7efe877fe640 1 -- 172.21.15.88:0/668387680 >> v1:172.21.15.88:6789/0 conn(0x7efe8806c100 legacy=0x7efe8815ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:45.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.614+0000 7efe877fe640 1 -- 172.21.15.88:0/668387680 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe880c4b30 con 0x7efe880af4c0 2023-12-08T08:22:45.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.618+0000 7efe877fe640 1 --2- 172.21.15.88:0/668387680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe880af4c0 0x7efe88154f20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7efe780097c0 tx=0x7efe7801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ab4e42f49133f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:45.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.618+0000 7efe867fc640 1 -- 172.21.15.88:0/668387680 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe780ab600 con 0x7efe880af4c0 2023-12-08T08:22:45.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.618+0000 7efe867fc640 1 -- 172.21.15.88:0/668387680 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe780a7050 con 0x7efe880af4c0 2023-12-08T08:22:45.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.618+0000 7efe867fc640 1 -- 172.21.15.88:0/668387680 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe780ab980 con 0x7efe880af4c0 2023-12-08T08:22:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.618+0000 7efe8e12a640 1 -- 172.21.15.88:0/668387680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe880af4c0 msgr2=0x7efe88154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.618+0000 7efe8e12a640 1 --2- 172.21.15.88:0/668387680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe880af4c0 0x7efe88154f20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7efe780097c0 tx=0x7efe7801c3c0 comp rx=0 tx=0).stop 2023-12-08T08:22:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.618+0000 7efe8e12a640 1 -- 172.21.15.88:0/668387680 shutdown_connections 2023-12-08T08:22:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.618+0000 7efe8e12a640 1 --2- 172.21.15.88:0/668387680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe880af4c0 0x7efe88154f20 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.618+0000 7efe8e12a640 1 -- 172.21.15.88:0/668387680 >> 172.21.15.88:0/668387680 conn(0x7efe880ab9d0 msgr2=0x7efe880abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.618+0000 7efe8e12a640 1 -- 172.21.15.88:0/668387680 shutdown_connections 2023-12-08T08:22:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.618+0000 7efe8e12a640 1 -- 172.21.15.88:0/668387680 wait complete. 2023-12-08T08:22:45.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.622+0000 7efe8e12a640 1 Processor -- start 2023-12-08T08:22:45.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.622+0000 7efe8e12a640 1 -- start start 2023-12-08T08:22:45.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.622+0000 7efe8e12a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe8806c100 0x7efe8814afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:45.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.622+0000 7efe8e12a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe880af4c0 0x7efe8814b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:45.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.622+0000 7efe8e12a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe880c67d0 0x7efe88147940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:45.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.622+0000 7efe8e12a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8814a780 con 0x7efe8806c100 2023-12-08T08:22:45.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.622+0000 7efe8e12a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8814a450 con 0x7efe880c67d0 2023-12-08T08:22:45.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.622+0000 7efe8e12a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe880c3870 con 0x7efe880af4c0 2023-12-08T08:22:45.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.622+0000 7efe877fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe8806c100 0x7efe8814afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:45.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.622+0000 7efe877fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe8806c100 0x7efe8814afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53408/0 (socket says 172.21.15.88:53408) 2023-12-08T08:22:45.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.622+0000 7efe877fe640 1 -- 172.21.15.88:0/1640589103 learned_addr learned my addr 172.21.15.88:0/1640589103 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:45.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.622+0000 7efe87fff640 1 --2- 172.21.15.88:0/1640589103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe880c67d0 0x7efe88147940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:45.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.622+0000 7efe86ffd640 1 --2- 172.21.15.88:0/1640589103 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe880af4c0 0x7efe8814b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:45.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.622+0000 7efe877fe640 1 -- 172.21.15.88:0/1640589103 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe880af4c0 msgr2=0x7efe8814b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:45.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.622+0000 7efe877fe640 1 --2- 172.21.15.88:0/1640589103 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe880af4c0 0x7efe8814b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:45.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.622+0000 7efe877fe640 1 -- 172.21.15.88:0/1640589103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe880c67d0 msgr2=0x7efe88147940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:45.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.622+0000 7efe877fe640 1 --2- 172.21.15.88:0/1640589103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe880c67d0 0x7efe88147940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:45.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.622+0000 7efe877fe640 1 -- 172.21.15.88:0/1640589103 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe78009420 con 0x7efe8806c100 2023-12-08T08:22:45.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.622+0000 7efe87fff640 1 --2- 172.21.15.88:0/1640589103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe880c67d0 0x7efe88147940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:45.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.622+0000 7efe877fe640 1 --2- 172.21.15.88:0/1640589103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe8806c100 0x7efe8814afd0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7efe78018fd0 tx=0x7efe7801ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:45.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.622+0000 7efe6ffff640 1 -- 172.21.15.88:0/1640589103 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe780b7450 con 0x7efe8806c100 2023-12-08T08:22:45.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.622+0000 7efe6ffff640 1 -- 172.21.15.88:0/1640589103 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe780b75b0 con 0x7efe8806c100 2023-12-08T08:22:45.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.622+0000 7efe8e12a640 1 -- 172.21.15.88:0/1640589103 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe8814ba50 con 0x7efe8806c100 2023-12-08T08:22:45.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.622+0000 7efe6ffff640 1 -- 172.21.15.88:0/1640589103 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe780b7960 con 0x7efe8806c100 2023-12-08T08:22:45.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.622+0000 7efe8e12a640 1 -- 172.21.15.88:0/1640589103 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe880c1060 con 0x7efe8806c100 2023-12-08T08:22:45.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.626+0000 7efe8e12a640 1 -- 172.21.15.88:0/1640589103 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe880c3d20 con 0x7efe8806c100 2023-12-08T08:22:45.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.626+0000 7efe6ffff640 1 -- 172.21.15.88:0/1640589103 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efe780b7ac0 con 0x7efe8806c100 2023-12-08T08:22:45.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.626+0000 7efe6ffff640 1 --2- 172.21.15.88:0/1640589103 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efe74066470 0x7efe74068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:45.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.626+0000 7efe6ffff640 1 -- 172.21.15.88:0/1640589103 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7efe7811e740 con 0x7efe8806c100 2023-12-08T08:22:45.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.626+0000 7efe86ffd640 1 --2- 172.21.15.88:0/1640589103 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efe74066470 0x7efe74068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:45.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.626+0000 7efe86ffd640 1 --2- 172.21.15.88:0/1640589103 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efe74066470 0x7efe74068930 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efe880ab480 tx=0x7efe7c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:45.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.630+0000 7efe6ffff640 1 -- 172.21.15.88:0/1640589103 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efe780ebc70 con 0x7efe8806c100 2023-12-08T08:22:45.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.786+0000 7efe8e12a640 1 -- 172.21.15.88:0/1640589103 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe88067630 con 0x7efe8806c100 2023-12-08T08:22:45.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.786+0000 7efe6ffff640 1 -- 172.21.15.88:0/1640589103 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16677 (secure 0 0 0) 0x7efe780ef290 con 0x7efe8806c100 2023-12-08T08:22:45.791 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:45.791 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":57,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:22:43.757870+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:22:17.787562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:22:18.955273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6837/4167133153":"2023-12-09T08:22:40.747080+0000","172.21.15.88:6835/4167133153":"2023-12-09T08:22:40.747080+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:22:45.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.786+0000 7efe8e12a640 1 -- 172.21.15.88:0/1640589103 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efe74066470 msgr2=0x7efe74068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:45.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.786+0000 7efe8e12a640 1 --2- 172.21.15.88:0/1640589103 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efe74066470 0x7efe74068930 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efe880ab480 tx=0x7efe7c009040 comp rx=0 tx=0).stop 2023-12-08T08:22:45.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.786+0000 7efe8e12a640 1 -- 172.21.15.88:0/1640589103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe8806c100 msgr2=0x7efe8814afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:45.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.786+0000 7efe8e12a640 1 --2- 172.21.15.88:0/1640589103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe8806c100 0x7efe8814afd0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7efe78018fd0 tx=0x7efe7801ac00 comp rx=0 tx=0).stop 2023-12-08T08:22:45.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.786+0000 7efe8e12a640 1 -- 172.21.15.88:0/1640589103 shutdown_connections 2023-12-08T08:22:45.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.786+0000 7efe8e12a640 1 --2- 172.21.15.88:0/1640589103 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efe74066470 0x7efe74068930 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:45.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.786+0000 7efe8e12a640 1 --2- 172.21.15.88:0/1640589103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe880c67d0 0x7efe88147940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:45.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.786+0000 7efe8e12a640 1 --2- 172.21.15.88:0/1640589103 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efe880af4c0 0x7efe8814b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:45.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.786+0000 7efe8e12a640 1 --2- 172.21.15.88:0/1640589103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe8806c100 0x7efe8814afd0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:45.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.790+0000 7efe8e12a640 1 -- 172.21.15.88:0/1640589103 >> 172.21.15.88:0/1640589103 conn(0x7efe880ab9d0 msgr2=0x7efe8814cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:45.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.790+0000 7efe8e12a640 1 -- 172.21.15.88:0/1640589103 shutdown_connections 2023-12-08T08:22:45.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.790+0000 7efe8e12a640 1 -- 172.21.15.88:0/1640589103 wait complete. 2023-12-08T08:22:45.812 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-12-08T08:22:45.813 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:22:45.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.946+0000 7f89522ea640 1 Processor -- start 2023-12-08T08:22:45.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.946+0000 7f89522ea640 1 -- start start 2023-12-08T08:22:45.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.946+0000 7f89522ea640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f894c06c100 0x7f894c15fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:45.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.946+0000 7f89522ea640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f894c0c4890 con 0x7f894c0af4c0 2023-12-08T08:22:45.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.946+0000 7f89522ea640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f894c1553d0 con 0x7f894c154f20 2023-12-08T08:22:45.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.946+0000 7f89522ea640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f894c0af8a0 con 0x7f894c06c100 2023-12-08T08:22:45.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.946+0000 7f894bfff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f894c0af4c0 0x7f894c0c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35880/0 (socket says 172.21.15.88:35880) 2023-12-08T08:22:45.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.946+0000 7f894bfff640 1 -- 172.21.15.88:0/856358582 learned_addr learned my addr 172.21.15.88:0/856358582 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:45.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.946+0000 7f8950887640 1 --2- 172.21.15.88:0/856358582 >> v2:172.21.15.148:3300/0 conn(0x7f894c06c100 0x7f894c15fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:45.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.946+0000 7f894affd640 1 -- 172.21.15.88:0/856358582 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4256448793 0 0) 0x7f894c0c4890 con 0x7f894c0af4c0 2023-12-08T08:22:45.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.946+0000 7f894affd640 1 -- 172.21.15.88:0/856358582 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8934003530 con 0x7f894c0af4c0 2023-12-08T08:22:45.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.946+0000 7f8950887640 1 -- 172.21.15.88:0/856358582 >> v1:172.21.15.148:6789/0 conn(0x7f894c154f20 legacy=0x7f894c06b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:45.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.946+0000 7f8950887640 1 -- 172.21.15.88:0/856358582 >> v1:172.21.15.88:6789/0 conn(0x7f894c0af4c0 legacy=0x7f894c0c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:45.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.946+0000 7f894affd640 1 -- 172.21.15.88:0/856358582 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2984267212 0 0) 0x7f8934003530 con 0x7f894c0af4c0 2023-12-08T08:22:45.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.946+0000 7f8950887640 1 -- 172.21.15.88:0/856358582 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894c0c4b30 con 0x7f894c06c100 2023-12-08T08:22:45.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.950+0000 7f8950887640 1 --2- 172.21.15.88:0/856358582 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f894c06c100 0x7f894c15fe30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8944009d90 tx=0x7f894401c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7c53d5e6d6ed8b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:45.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.950+0000 7f894affd640 1 -- 172.21.15.88:0/856358582 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c001680 con 0x7f894c06c100 2023-12-08T08:22:45.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.950+0000 7f894affd640 1 -- 172.21.15.88:0/856358582 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89440a55f0 con 0x7f894c06c100 2023-12-08T08:22:45.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.950+0000 7f894affd640 1 -- 172.21.15.88:0/856358582 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89440a5980 con 0x7f894c06c100 2023-12-08T08:22:45.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.950+0000 7f89522ea640 1 -- 172.21.15.88:0/856358582 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f894c06c100 msgr2=0x7f894c15fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:45.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.950+0000 7f89522ea640 1 --2- 172.21.15.88:0/856358582 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f894c06c100 0x7f894c15fe30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8944009d90 tx=0x7f894401c7b0 comp rx=0 tx=0).stop 2023-12-08T08:22:45.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.950+0000 7f89522ea640 1 -- 172.21.15.88:0/856358582 shutdown_connections 2023-12-08T08:22:45.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.950+0000 7f89522ea640 1 --2- 172.21.15.88:0/856358582 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f894c06c100 0x7f894c15fe30 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:45.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.950+0000 7f89522ea640 1 -- 172.21.15.88:0/856358582 >> 172.21.15.88:0/856358582 conn(0x7f894c0ab9d0 msgr2=0x7f894c0abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:45.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.950+0000 7f89522ea640 1 -- 172.21.15.88:0/856358582 shutdown_connections 2023-12-08T08:22:45.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.950+0000 7f89522ea640 1 -- 172.21.15.88:0/856358582 wait complete. 2023-12-08T08:22:45.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.954+0000 7f89522ea640 1 Processor -- start 2023-12-08T08:22:45.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.954+0000 7f89522ea640 1 -- start start 2023-12-08T08:22:45.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.954+0000 7f89522ea640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f894c06c100 0x7f894c0aad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:45.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.954+0000 7f89522ea640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f894c0af4c0 0x7f894c147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:45.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.954+0000 7f89522ea640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f894c154f20 0x7f894c1479c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:45.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.954+0000 7f89522ea640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894c1ed8c0 con 0x7f894c154f20 2023-12-08T08:22:45.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.954+0000 7f89522ea640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894c0c34a0 con 0x7f894c0af4c0 2023-12-08T08:22:45.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.954+0000 7f89522ea640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894c1ecd40 con 0x7f894c06c100 2023-12-08T08:22:45.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.954+0000 7f8950887640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f894c154f20 0x7f894c1479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:45.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.954+0000 7f8950887640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f894c154f20 0x7f894c1479c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53412/0 (socket says 172.21.15.88:53412) 2023-12-08T08:22:45.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.954+0000 7f8950887640 1 -- 172.21.15.88:0/2520172829 learned_addr learned my addr 172.21.15.88:0/2520172829 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:45.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.954+0000 7f894b7fe640 1 --2- 172.21.15.88:0/2520172829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f894c0af4c0 0x7f894c147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:45.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.954+0000 7f894bfff640 1 --2- 172.21.15.88:0/2520172829 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f894c06c100 0x7f894c0aad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:45.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.954+0000 7f8950887640 1 -- 172.21.15.88:0/2520172829 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f894c06c100 msgr2=0x7f894c0aad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:45.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.954+0000 7f8950887640 1 --2- 172.21.15.88:0/2520172829 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f894c06c100 0x7f894c0aad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:45.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.954+0000 7f8950887640 1 -- 172.21.15.88:0/2520172829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f894c0af4c0 msgr2=0x7f894c147480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:45.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.954+0000 7f8950887640 1 --2- 172.21.15.88:0/2520172829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f894c0af4c0 0x7f894c147480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:45.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.954+0000 7f8950887640 1 -- 172.21.15.88:0/2520172829 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8944009a70 con 0x7f894c154f20 2023-12-08T08:22:45.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.954+0000 7f8950887640 1 --2- 172.21.15.88:0/2520172829 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f894c154f20 0x7f894c1479c0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f89440b0040 tx=0x7f8944019550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:45.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.954+0000 7f8948ff9640 1 -- 172.21.15.88:0/2520172829 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8944003ba0 con 0x7f894c154f20 2023-12-08T08:22:45.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.954+0000 7f8948ff9640 1 -- 172.21.15.88:0/2520172829 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8944003d00 con 0x7f894c154f20 2023-12-08T08:22:45.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.954+0000 7f89522ea640 1 -- 172.21.15.88:0/2520172829 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f894c1ed020 con 0x7f894c154f20 2023-12-08T08:22:45.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.954+0000 7f8948ff9640 1 -- 172.21.15.88:0/2520172829 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89440ad890 con 0x7f894c154f20 2023-12-08T08:22:45.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.958+0000 7f89522ea640 1 -- 172.21.15.88:0/2520172829 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f894c1ed5e0 con 0x7f894c154f20 2023-12-08T08:22:45.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.958+0000 7f89522ea640 1 -- 172.21.15.88:0/2520172829 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f894c1471a0 con 0x7f894c154f20 2023-12-08T08:22:45.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.958+0000 7f8948ff9640 1 -- 172.21.15.88:0/2520172829 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f89440b4050 con 0x7f894c154f20 2023-12-08T08:22:45.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.958+0000 7f8948ff9640 1 --2- 172.21.15.88:0/2520172829 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f89380664a0 0x7f8938068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:45.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.958+0000 7f8948ff9640 1 -- 172.21.15.88:0/2520172829 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f894411ea00 con 0x7f894c154f20 2023-12-08T08:22:45.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.958+0000 7f894bfff640 1 --2- 172.21.15.88:0/2520172829 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f89380664a0 0x7f8938068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:45.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.958+0000 7f894bfff640 1 --2- 172.21.15.88:0/2520172829 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f89380664a0 0x7f8938068960 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f893c000f70 tx=0x7f893c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:45.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:45.962+0000 7f8948ff9640 1 -- 172.21.15.88:0/2520172829 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f894c1471a0 con 0x7f894c154f20 2023-12-08T08:22:46.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.142+0000 7f89522ea640 1 -- 172.21.15.88:0/2520172829 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f894c1471a0 con 0x7f894c154f20 2023-12-08T08:22:46.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.142+0000 7f8948ff9640 1 -- 172.21.15.88:0/2520172829 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4917 (secure 0 0 0) 0x7f894c1471a0 con 0x7f894c154f20 2023-12-08T08:22:46.147 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:46.148 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5240,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/2576328340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2576328340},{"type":"v1","addr":"172.21.15.148:6834","nonce":2576328340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5626,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/1685449423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1685449423},{"type":"v1","addr":"172.21.15.88:6836","nonce":1685449423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6348,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/245978965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":245978965},{"type":"v1","addr":"172.21.15.88:6837","nonce":245978965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:22:19.959416+0000","modified":"2023-12-08T08:22:22.972913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5635},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5635":{"gid":5635,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":7,"addr":"172.21.15.148:6835/604820378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":604820378},{"type":"v1","addr":"172.21.15.148:6835","nonce":604820378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-08T08:22:46.148 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 39 2023-12-08T08:22:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.142+0000 7f89522ea640 1 -- 172.21.15.88:0/2520172829 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f89380664a0 msgr2=0x7f8938068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.142+0000 7f89522ea640 1 --2- 172.21.15.88:0/2520172829 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f89380664a0 0x7f8938068960 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f893c000f70 tx=0x7f893c009040 comp rx=0 tx=0).stop 2023-12-08T08:22:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.142+0000 7f89522ea640 1 -- 172.21.15.88:0/2520172829 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f894c154f20 msgr2=0x7f894c1479c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.142+0000 7f89522ea640 1 --2- 172.21.15.88:0/2520172829 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f894c154f20 0x7f894c1479c0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f89440b0040 tx=0x7f8944019550 comp rx=0 tx=0).stop 2023-12-08T08:22:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.146+0000 7f89522ea640 1 -- 172.21.15.88:0/2520172829 shutdown_connections 2023-12-08T08:22:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.146+0000 7f89522ea640 1 --2- 172.21.15.88:0/2520172829 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f89380664a0 0x7f8938068960 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.146+0000 7f89522ea640 1 --2- 172.21.15.88:0/2520172829 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f894c154f20 0x7f894c1479c0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.146+0000 7f89522ea640 1 --2- 172.21.15.88:0/2520172829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f894c0af4c0 0x7f894c147480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.146+0000 7f89522ea640 1 --2- 172.21.15.88:0/2520172829 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f894c06c100 0x7f894c0aad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.146+0000 7f89522ea640 1 -- 172.21.15.88:0/2520172829 >> 172.21.15.88:0/2520172829 conn(0x7f894c0ab9d0 msgr2=0x7f894c0733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.146+0000 7f89522ea640 1 -- 172.21.15.88:0/2520172829 shutdown_connections 2023-12-08T08:22:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.146+0000 7f89522ea640 1 -- 172.21.15.88:0/2520172829 wait complete. 2023-12-08T08:22:46.169 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:22:46.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25fa72a640 1 Processor -- start 2023-12-08T08:22:46.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25fa72a640 1 -- start start 2023-12-08T08:22:46.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25fa72a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f25f40af4c0 0x7f25f4154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:46.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25fa72a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f25f406c100 0x7f25f40c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:46.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25fa72a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f40c4890 con 0x7f25f40c67d0 2023-12-08T08:22:46.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25fa72a640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f4155460 con 0x7f25f406c100 2023-12-08T08:22:46.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25fa72a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f40af8a0 con 0x7f25f40af4c0 2023-12-08T08:22:46.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25f37fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f25f40c67d0 0x7f25f406b9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35886/0 (socket says 172.21.15.88:35886) 2023-12-08T08:22:46.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25f37fe640 1 -- 172.21.15.88:0/2115861194 learned_addr learned my addr 172.21.15.88:0/2115861194 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:46.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25f8cc7640 1 --2- 172.21.15.88:0/2115861194 >> v2:172.21.15.148:3300/0 conn(0x7f25f406c100 0x7f25f40c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:46.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25f3fff640 1 --2- 172.21.15.88:0/2115861194 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f25f40af4c0 0x7f25f4154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:46.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25f2ffd640 1 -- 172.21.15.88:0/2115861194 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 368762771 0 0) 0x7f25f40c4890 con 0x7f25f40c67d0 2023-12-08T08:22:46.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25f2ffd640 1 -- 172.21.15.88:0/2115861194 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25dc003530 con 0x7f25f40c67d0 2023-12-08T08:22:46.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25f2ffd640 1 -- 172.21.15.88:0/2115861194 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 647774420 0 0) 0x7f25dc003530 con 0x7f25f40c67d0 2023-12-08T08:22:46.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25f2ffd640 1 -- 172.21.15.88:0/2115861194 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f25f40af4c0 msgr2=0x7f25f4154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:46.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25f2ffd640 1 --2- 172.21.15.88:0/2115861194 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f25f40af4c0 0x7f25f4154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:46.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25f2ffd640 1 -- 172.21.15.88:0/2115861194 >> v2:172.21.15.148:3300/0 conn(0x7f25f406c100 msgr2=0x7f25f40c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:46.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25f2ffd640 1 --2- 172.21.15.88:0/2115861194 >> v2:172.21.15.148:3300/0 conn(0x7f25f406c100 0x7f25f40c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:46.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25f2ffd640 1 -- 172.21.15.88:0/2115861194 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f40c4b30 con 0x7f25f40c67d0 2023-12-08T08:22:46.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25f2ffd640 1 -- 172.21.15.88:0/2115861194 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f25e8001680 con 0x7f25f40c67d0 2023-12-08T08:22:46.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25f2ffd640 1 -- 172.21.15.88:0/2115861194 >> v1:172.21.15.88:6789/0 conn(0x7f25f40c67d0 legacy=0x7f25f406b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:46.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25f2ffd640 1 --2- 172.21.15.88:0/2115861194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25dc003980 0x7f25dc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:46.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25f2ffd640 1 --2- 172.21.15.88:0/2115861194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25dc0047d0 0x7f25dc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:46.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25f2ffd640 1 --2- 172.21.15.88:0/2115861194 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f25f40af4c0 0x7f25dc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:46.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25f2ffd640 1 -- 172.21.15.88:0/2115861194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4155460 con 0x7f25dc003980 2023-12-08T08:22:46.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25f2ffd640 1 -- 172.21.15.88:0/2115861194 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f40af8a0 con 0x7f25dc0047d0 2023-12-08T08:22:46.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25f2ffd640 1 -- 172.21.15.88:0/2115861194 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc00b9e0 con 0x7f25f40af4c0 2023-12-08T08:22:46.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25f3fff640 1 --2- 172.21.15.88:0/2115861194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25dc003980 0x7f25dc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:46.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25f8cc7640 1 --2- 172.21.15.88:0/2115861194 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f25f40af4c0 0x7f25dc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:46.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.302+0000 7f25f37fe640 1 --2- 172.21.15.88:0/2115861194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25dc0047d0 0x7f25dc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:46.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.306+0000 7f25f3fff640 1 -- 172.21.15.88:0/2115861194 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f25f40af4c0 msgr2=0x7f25dc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:46.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.306+0000 7f25f3fff640 1 --2- 172.21.15.88:0/2115861194 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f25f40af4c0 0x7f25dc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:46.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.306+0000 7f25f3fff640 1 -- 172.21.15.88:0/2115861194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25dc0047d0 msgr2=0x7f25dc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:46.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.306+0000 7f25f3fff640 1 --2- 172.21.15.88:0/2115861194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25dc0047d0 0x7f25dc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:46.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.306+0000 7f25f3fff640 1 -- 172.21.15.88:0/2115861194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25dc003530 con 0x7f25dc003980 2023-12-08T08:22:46.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.306+0000 7f25f3fff640 1 --2- 172.21.15.88:0/2115861194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25dc003980 0x7f25dc003da0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f25e4009b10 tx=0x7f25e401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8296b7cedfa21eaf server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:46.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.306+0000 7f25f2ffd640 1 -- 172.21.15.88:0/2115861194 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e40a6430 con 0x7f25dc003980 2023-12-08T08:22:46.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.306+0000 7f25f2ffd640 1 -- 172.21.15.88:0/2115861194 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e40a6590 con 0x7f25dc003980 2023-12-08T08:22:46.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.306+0000 7f25f2ffd640 1 -- 172.21.15.88:0/2115861194 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e40a6940 con 0x7f25dc003980 2023-12-08T08:22:46.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.306+0000 7f25fa72a640 1 -- 172.21.15.88:0/2115861194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25dc003980 msgr2=0x7f25dc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:46.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.306+0000 7f25fa72a640 1 --2- 172.21.15.88:0/2115861194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25dc003980 0x7f25dc003da0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f25e4009b10 tx=0x7f25e401ca20 comp rx=0 tx=0).stop 2023-12-08T08:22:46.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.306+0000 7f25f8cc7640 1 -- 172.21.15.88:0/2115861194 reap_dead start 2023-12-08T08:22:46.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.310+0000 7f25fa72a640 1 -- 172.21.15.88:0/2115861194 shutdown_connections 2023-12-08T08:22:46.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.310+0000 7f25fa72a640 1 -- 172.21.15.88:0/2115861194 >> 172.21.15.88:0/2115861194 conn(0x7f25f40ab9d0 msgr2=0x7f25f40abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:46.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.310+0000 7f25fa72a640 1 -- 172.21.15.88:0/2115861194 shutdown_connections 2023-12-08T08:22:46.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.310+0000 7f25fa72a640 1 -- 172.21.15.88:0/2115861194 wait complete. 2023-12-08T08:22:46.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.310+0000 7f25fa72a640 1 Processor -- start 2023-12-08T08:22:46.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.310+0000 7f25fa72a640 1 -- start start 2023-12-08T08:22:46.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.310+0000 7f25fa72a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25dc003980 0x7f25f41f0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:46.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.310+0000 7f25fa72a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f25f40aa510 0x7f25f414efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:46.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.310+0000 7f25fa72a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f414f4f0 0x7f25f40c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:46.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.310+0000 7f25fa72a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f41f1210 con 0x7f25dc003980 2023-12-08T08:22:46.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.310+0000 7f25fa72a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f415aea0 con 0x7f25f414f4f0 2023-12-08T08:22:46.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.310+0000 7f25fa72a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f415b180 con 0x7f25f40aa510 2023-12-08T08:22:46.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.310+0000 7f25f3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25dc003980 0x7f25f41f0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:46.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.310+0000 7f25f3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25dc003980 0x7f25f41f0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53430/0 (socket says 172.21.15.88:53430) 2023-12-08T08:22:46.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.310+0000 7f25f3fff640 1 -- 172.21.15.88:0/1361210850 learned_addr learned my addr 172.21.15.88:0/1361210850 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:46.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.310+0000 7f25f8cc7640 1 --2- 172.21.15.88:0/1361210850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f414f4f0 0x7f25f40c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:46.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.310+0000 7f25f37fe640 1 --2- 172.21.15.88:0/1361210850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f25f40aa510 0x7f25f414efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:46.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.310+0000 7f25f3fff640 1 -- 172.21.15.88:0/1361210850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f25f40aa510 msgr2=0x7f25f414efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:46.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.310+0000 7f25f3fff640 1 --2- 172.21.15.88:0/1361210850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f25f40aa510 0x7f25f414efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:46.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.310+0000 7f25f3fff640 1 -- 172.21.15.88:0/1361210850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f414f4f0 msgr2=0x7f25f40c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:46.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.310+0000 7f25f3fff640 1 --2- 172.21.15.88:0/1361210850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f414f4f0 0x7f25f40c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:46.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.310+0000 7f25f3fff640 1 -- 172.21.15.88:0/1361210850 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f40c8fc0 con 0x7f25dc003980 2023-12-08T08:22:46.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.310+0000 7f25f37fe640 1 --2- 172.21.15.88:0/1361210850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f25f40aa510 0x7f25f414efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:46.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.310+0000 7f25f3fff640 1 --2- 172.21.15.88:0/1361210850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25dc003980 0x7f25f41f0cd0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f25e401c850 tx=0x7f25dc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:46.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.314+0000 7f25f0ff9640 1 -- 172.21.15.88:0/1361210850 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e40b5070 con 0x7f25dc003980 2023-12-08T08:22:46.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.314+0000 7f25f0ff9640 1 -- 172.21.15.88:0/1361210850 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e400f000 con 0x7f25dc003980 2023-12-08T08:22:46.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.314+0000 7f25f0ff9640 1 -- 172.21.15.88:0/1361210850 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e40bb420 con 0x7f25dc003980 2023-12-08T08:22:46.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.314+0000 7f25fa72a640 1 -- 172.21.15.88:0/1361210850 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f40c92a0 con 0x7f25dc003980 2023-12-08T08:22:46.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.314+0000 7f25fa72a640 1 -- 172.21.15.88:0/1361210850 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f40c2fe0 con 0x7f25dc003980 2023-12-08T08:22:46.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.314+0000 7f25fa72a640 1 -- 172.21.15.88:0/1361210850 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f40c8e00 con 0x7f25dc003980 2023-12-08T08:22:46.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.314+0000 7f25f0ff9640 1 -- 172.21.15.88:0/1361210850 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f25e40b9070 con 0x7f25dc003980 2023-12-08T08:22:46.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.314+0000 7f25f0ff9640 1 --2- 172.21.15.88:0/1361210850 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f25e00664a0 0x7f25e0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:46.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.314+0000 7f25f0ff9640 1 -- 172.21.15.88:0/1361210850 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f25e411da00 con 0x7f25dc003980 2023-12-08T08:22:46.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.314+0000 7f25f37fe640 1 --2- 172.21.15.88:0/1361210850 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f25e00664a0 0x7f25e0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:46.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.314+0000 7f25f37fe640 1 --2- 172.21.15.88:0/1361210850 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f25e00664a0 0x7f25e0068960 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f25e8001060 tx=0x7f25e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:46.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.318+0000 7f25f0ff9640 1 -- 172.21.15.88:0/1361210850 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f25e40eaf50 con 0x7f25dc003980 2023-12-08T08:22:46.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.498+0000 7f25fa72a640 1 -- 172.21.15.88:0/1361210850 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25f41f1210 con 0x7f25dc003980 2023-12-08T08:22:46.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.498+0000 7f25f0ff9640 1 -- 172.21.15.88:0/1361210850 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4917 (secure 0 0 0) 0x7f25e40c0070 con 0x7f25dc003980 2023-12-08T08:22:46.505 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:46.505 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5240,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/2576328340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2576328340},{"type":"v1","addr":"172.21.15.148:6834","nonce":2576328340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5626,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/1685449423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1685449423},{"type":"v1","addr":"172.21.15.88:6836","nonce":1685449423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6348,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/245978965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":245978965},{"type":"v1","addr":"172.21.15.88:6837","nonce":245978965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:22:19.959416+0000","modified":"2023-12-08T08:22:22.972913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5635},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5635":{"gid":5635,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":7,"addr":"172.21.15.148:6835/604820378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":604820378},{"type":"v1","addr":"172.21.15.148:6835","nonce":604820378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-08T08:22:46.505 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 39 2023-12-08T08:22:46.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.502+0000 7f25fa72a640 1 -- 172.21.15.88:0/1361210850 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f25e00664a0 msgr2=0x7f25e0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:46.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.502+0000 7f25fa72a640 1 --2- 172.21.15.88:0/1361210850 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f25e00664a0 0x7f25e0068960 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f25e8001060 tx=0x7f25e8009040 comp rx=0 tx=0).stop 2023-12-08T08:22:46.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.502+0000 7f25fa72a640 1 -- 172.21.15.88:0/1361210850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25dc003980 msgr2=0x7f25f41f0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:46.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.502+0000 7f25fa72a640 1 --2- 172.21.15.88:0/1361210850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25dc003980 0x7f25f41f0cd0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f25e401c850 tx=0x7f25dc005800 comp rx=0 tx=0).stop 2023-12-08T08:22:46.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.502+0000 7f25fa72a640 1 -- 172.21.15.88:0/1361210850 shutdown_connections 2023-12-08T08:22:46.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.502+0000 7f25fa72a640 1 --2- 172.21.15.88:0/1361210850 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f25e00664a0 0x7f25e0068960 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:46.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.502+0000 7f25fa72a640 1 --2- 172.21.15.88:0/1361210850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f414f4f0 0x7f25f40c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:46.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.502+0000 7f25fa72a640 1 --2- 172.21.15.88:0/1361210850 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f25f40aa510 0x7f25f414efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:46.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.502+0000 7f25fa72a640 1 --2- 172.21.15.88:0/1361210850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25dc003980 0x7f25f41f0cd0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:46.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.502+0000 7f25fa72a640 1 -- 172.21.15.88:0/1361210850 >> 172.21.15.88:0/1361210850 conn(0x7f25f40ab9d0 msgr2=0x7f25f40ab260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:46.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.502+0000 7f25fa72a640 1 -- 172.21.15.88:0/1361210850 shutdown_connections 2023-12-08T08:22:46.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.502+0000 7f25fa72a640 1 -- 172.21.15.88:0/1361210850 wait complete. 2023-12-08T08:22:46.526 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:22:46.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.658+0000 7fb581232640 1 Processor -- start 2023-12-08T08:22:46.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.658+0000 7fb581232640 1 -- start start 2023-12-08T08:22:46.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.658+0000 7fb581232640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb57c0c47c0 0x7fb57c155100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:46.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.658+0000 7fb581232640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57c155640 con 0x7fb57c06b320 2023-12-08T08:22:46.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.658+0000 7fb581232640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57c0c8aa0 con 0x7fb57c151ec0 2023-12-08T08:22:46.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.658+0000 7fb581232640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c0c9060 con 0x7fb57c0c47c0 2023-12-08T08:22:46.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.658+0000 7fb57b59e640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb57c06b320 0x7fb57c0c7f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35894/0 (socket says 172.21.15.88:35894) 2023-12-08T08:22:46.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.658+0000 7fb57b59e640 1 -- 172.21.15.88:0/4226758834 learned_addr learned my addr 172.21.15.88:0/4226758834 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:46.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.658+0000 7fb57259c640 1 --2- 172.21.15.88:0/4226758834 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb57c0c47c0 0x7fb57c155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:46.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.658+0000 7fb57a59c640 1 -- 172.21.15.88:0/4226758834 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325033988 0 0) 0x7fb5740014a0 con 0x7fb57c06b320 2023-12-08T08:22:46.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.658+0000 7fb57a59c640 1 -- 172.21.15.88:0/4226758834 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb568003530 con 0x7fb57c06b320 2023-12-08T08:22:46.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.658+0000 7fb57a59c640 1 -- 172.21.15.88:0/4226758834 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4122115860 0 0) 0x7fb57c0c8aa0 con 0x7fb57c151ec0 2023-12-08T08:22:46.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.658+0000 7fb57a59c640 1 -- 172.21.15.88:0/4226758834 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5740014a0 con 0x7fb57c151ec0 2023-12-08T08:22:46.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.658+0000 7fb57259c640 1 -- 172.21.15.88:0/4226758834 >> v1:172.21.15.148:6789/0 conn(0x7fb57c151ec0 legacy=0x7fb57c0c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:46.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.658+0000 7fb57259c640 1 -- 172.21.15.88:0/4226758834 >> v1:172.21.15.88:6789/0 conn(0x7fb57c06b320 legacy=0x7fb57c0c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:46.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.658+0000 7fb57259c640 1 -- 172.21.15.88:0/4226758834 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c0c4d30 con 0x7fb57c0c47c0 2023-12-08T08:22:46.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.662+0000 7fb57259c640 1 --2- 172.21.15.88:0/4226758834 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb57c0c47c0 0x7fb57c155100 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb56c009820 tx=0x7fb56c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddde2124cd2ef7c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:46.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.662+0000 7fb57a59c640 1 -- 172.21.15.88:0/4226758834 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c0a6040 con 0x7fb57c0c47c0 2023-12-08T08:22:46.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.662+0000 7fb57a59c640 1 -- 172.21.15.88:0/4226758834 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56c0aa600 con 0x7fb57c0c47c0 2023-12-08T08:22:46.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.662+0000 7fb57a59c640 1 -- 172.21.15.88:0/4226758834 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c0aa990 con 0x7fb57c0c47c0 2023-12-08T08:22:46.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.662+0000 7fb581232640 1 -- 172.21.15.88:0/4226758834 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb57c0c47c0 msgr2=0x7fb57c155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:46.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.662+0000 7fb581232640 1 --2- 172.21.15.88:0/4226758834 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb57c0c47c0 0x7fb57c155100 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb56c009820 tx=0x7fb56c01c4a0 comp rx=0 tx=0).stop 2023-12-08T08:22:46.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.662+0000 7fb581232640 1 -- 172.21.15.88:0/4226758834 shutdown_connections 2023-12-08T08:22:46.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.662+0000 7fb581232640 1 --2- 172.21.15.88:0/4226758834 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb57c0c47c0 0x7fb57c155100 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:46.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.662+0000 7fb581232640 1 -- 172.21.15.88:0/4226758834 >> 172.21.15.88:0/4226758834 conn(0x7fb57c0c9e40 msgr2=0x7fb57c0ca250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:46.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.662+0000 7fb581232640 1 -- 172.21.15.88:0/4226758834 shutdown_connections 2023-12-08T08:22:46.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.662+0000 7fb581232640 1 -- 172.21.15.88:0/4226758834 wait complete. 2023-12-08T08:22:46.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.666+0000 7fb581232640 1 Processor -- start 2023-12-08T08:22:46.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.666+0000 7fb581232640 1 -- start start 2023-12-08T08:22:46.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.666+0000 7fb581232640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb57c06b320 0x7fb57c1f0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:46.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.666+0000 7fb581232640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb57c0c47c0 0x7fb57c1ecc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:46.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.666+0000 7fb581232640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb57c151ec0 0x7fb57c14cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:46.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.666+0000 7fb581232640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c152f90 con 0x7fb57c06b320 2023-12-08T08:22:46.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.666+0000 7fb581232640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c1f01c0 con 0x7fb57c151ec0 2023-12-08T08:22:46.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.666+0000 7fb581232640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c147c00 con 0x7fb57c0c47c0 2023-12-08T08:22:46.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.666+0000 7fb57ad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb57c06b320 0x7fb57c1f0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:46.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.666+0000 7fb57ad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb57c06b320 0x7fb57c1f0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53442/0 (socket says 172.21.15.88:53442) 2023-12-08T08:22:46.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.666+0000 7fb57ad9d640 1 -- 172.21.15.88:0/1107216394 learned_addr learned my addr 172.21.15.88:0/1107216394 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:46.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.666+0000 7fb57b59e640 1 --2- 172.21.15.88:0/1107216394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb57c151ec0 0x7fb57c14cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:46.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.666+0000 7fb57259c640 1 --2- 172.21.15.88:0/1107216394 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb57c0c47c0 0x7fb57c1ecc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:46.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.666+0000 7fb57ad9d640 1 -- 172.21.15.88:0/1107216394 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb57c0c47c0 msgr2=0x7fb57c1ecc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:46.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.666+0000 7fb57ad9d640 1 --2- 172.21.15.88:0/1107216394 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb57c0c47c0 0x7fb57c1ecc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:46.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.666+0000 7fb57ad9d640 1 -- 172.21.15.88:0/1107216394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb57c151ec0 msgr2=0x7fb57c14cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:46.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.666+0000 7fb57ad9d640 1 --2- 172.21.15.88:0/1107216394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb57c151ec0 0x7fb57c14cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:46.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.666+0000 7fb57ad9d640 1 -- 172.21.15.88:0/1107216394 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56c009420 con 0x7fb57c06b320 2023-12-08T08:22:46.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.666+0000 7fb57259c640 1 --2- 172.21.15.88:0/1107216394 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb57c0c47c0 0x7fb57c1ecc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:46.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.666+0000 7fb57ad9d640 1 --2- 172.21.15.88:0/1107216394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb57c06b320 0x7fb57c1f0c10 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fb56400c430 tx=0x7fb56400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:46.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.670+0000 7fb573fff640 1 -- 172.21.15.88:0/1107216394 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5640052d0 con 0x7fb57c06b320 2023-12-08T08:22:46.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.670+0000 7fb573fff640 1 -- 172.21.15.88:0/1107216394 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb564005450 con 0x7fb57c06b320 2023-12-08T08:22:46.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.670+0000 7fb573fff640 1 -- 172.21.15.88:0/1107216394 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb564003840 con 0x7fb57c06b320 2023-12-08T08:22:46.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.670+0000 7fb581232640 1 -- 172.21.15.88:0/1107216394 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57c1f0410 con 0x7fb57c06b320 2023-12-08T08:22:46.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.670+0000 7fb581232640 1 -- 172.21.15.88:0/1107216394 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57c153f00 con 0x7fb57c06b320 2023-12-08T08:22:46.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.670+0000 7fb581232640 1 -- 172.21.15.88:0/1107216394 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57c067630 con 0x7fb57c06b320 2023-12-08T08:22:46.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.670+0000 7fb573fff640 1 -- 172.21.15.88:0/1107216394 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb5640039a0 con 0x7fb57c06b320 2023-12-08T08:22:46.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.670+0000 7fb573fff640 1 --2- 172.21.15.88:0/1107216394 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb55c066470 0x7fb55c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:46.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.670+0000 7fb573fff640 1 -- 172.21.15.88:0/1107216394 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fb564083520 con 0x7fb57c06b320 2023-12-08T08:22:46.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.670+0000 7fb57259c640 1 --2- 172.21.15.88:0/1107216394 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb55c066470 0x7fb55c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:46.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.670+0000 7fb57259c640 1 --2- 172.21.15.88:0/1107216394 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb55c066470 0x7fb55c068930 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb56c0ae000 tx=0x7fb56c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:46.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.674+0000 7fb573fff640 1 -- 172.21.15.88:0/1107216394 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb564050930 con 0x7fb57c06b320 2023-12-08T08:22:46.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.826+0000 7fb581232640 1 -- 172.21.15.88:0/1107216394 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb57c0c5930 con 0x7fb57c06b320 2023-12-08T08:22:46.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.830+0000 7fb573fff640 1 -- 172.21.15.88:0/1107216394 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16677 (secure 0 0 0) 0x7fb564053f50 con 0x7fb57c06b320 2023-12-08T08:22:46.834 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:46.834 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":57,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:22:43.757870+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:22:17.787562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:22:18.955273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6837/4167133153":"2023-12-09T08:22:40.747080+0000","172.21.15.88:6835/4167133153":"2023-12-09T08:22:40.747080+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:22:46.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.830+0000 7fb581232640 1 -- 172.21.15.88:0/1107216394 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb55c066470 msgr2=0x7fb55c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:46.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.830+0000 7fb581232640 1 --2- 172.21.15.88:0/1107216394 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb55c066470 0x7fb55c068930 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb56c0ae000 tx=0x7fb56c008040 comp rx=0 tx=0).stop 2023-12-08T08:22:46.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.830+0000 7fb581232640 1 -- 172.21.15.88:0/1107216394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb57c06b320 msgr2=0x7fb57c1f0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:46.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.830+0000 7fb581232640 1 --2- 172.21.15.88:0/1107216394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb57c06b320 0x7fb57c1f0c10 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fb56400c430 tx=0x7fb56400c8f0 comp rx=0 tx=0).stop 2023-12-08T08:22:46.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.830+0000 7fb581232640 1 -- 172.21.15.88:0/1107216394 shutdown_connections 2023-12-08T08:22:46.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.830+0000 7fb581232640 1 --2- 172.21.15.88:0/1107216394 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb55c066470 0x7fb55c068930 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:46.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.830+0000 7fb581232640 1 --2- 172.21.15.88:0/1107216394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb57c151ec0 0x7fb57c14cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:46.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.830+0000 7fb581232640 1 --2- 172.21.15.88:0/1107216394 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb57c0c47c0 0x7fb57c1ecc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:46.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.830+0000 7fb581232640 1 --2- 172.21.15.88:0/1107216394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb57c06b320 0x7fb57c1f0c10 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:46.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.830+0000 7fb581232640 1 -- 172.21.15.88:0/1107216394 >> 172.21.15.88:0/1107216394 conn(0x7fb57c0c9e40 msgr2=0x7fb57c15f460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:46.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.830+0000 7fb581232640 1 -- 172.21.15.88:0/1107216394 shutdown_connections 2023-12-08T08:22:46.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.830+0000 7fb581232640 1 -- 172.21.15.88:0/1107216394 wait complete. 2023-12-08T08:22:46.855 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-12-08T08:22:46.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.990+0000 7f154189c640 1 Processor -- start 2023-12-08T08:22:46.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.990+0000 7f154189c640 1 -- start start 2023-12-08T08:22:46.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.990+0000 7f154189c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f153c0a5370 0x7f153c14f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:46.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.990+0000 7f154189c640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f153c072810 0x7f153c14fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:46.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.990+0000 7f154189c640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f153c1524b0 con 0x7f153c0a4f90 2023-12-08T08:22:46.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.990+0000 7f154189c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f153c0c60d0 con 0x7f153c0a5370 2023-12-08T08:22:46.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.990+0000 7f154189c640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f153c0c62f0 con 0x7f153c072810 2023-12-08T08:22:46.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.990+0000 7f15327fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f153c0a5370 0x7f153c14f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:46.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.990+0000 7f15327fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f153c0a5370 0x7f153c14f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53454/0 (socket says 172.21.15.88:53454) 2023-12-08T08:22:46.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.990+0000 7f15327fc640 1 -- 172.21.15.88:0/1001551824 learned_addr learned my addr 172.21.15.88:0/1001551824 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:46.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.990+0000 7f153b7fe640 1 --2- 172.21.15.88:0/1001551824 >> v2:172.21.15.148:3300/0 conn(0x7f153c072810 0x7f153c14fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:46.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.990+0000 7f15327fc640 1 -- 172.21.15.88:0/1001551824 >> v2:172.21.15.148:3300/0 conn(0x7f153c072810 msgr2=0x7f153c14fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:46.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.990+0000 7f15327fc640 1 --2- 172.21.15.88:0/1001551824 >> v2:172.21.15.148:3300/0 conn(0x7f153c072810 0x7f153c14fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:46.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.990+0000 7f15327fc640 1 -- 172.21.15.88:0/1001551824 >> v1:172.21.15.148:6789/0 conn(0x7f153c0a4f90 legacy=0x7f153c0c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:46.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.990+0000 7f15327fc640 1 -- 172.21.15.88:0/1001551824 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153c152770 con 0x7f153c0a5370 2023-12-08T08:22:46.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.994+0000 7f15327fc640 1 --2- 172.21.15.88:0/1001551824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f153c0a5370 0x7f153c14f870 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f153c06dc90 tx=0x7f152401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49e6fa488ed8c4dc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:46.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.994+0000 7f153a7fc640 1 -- 172.21.15.88:0/1001551824 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15240a55c0 con 0x7f153c0a5370 2023-12-08T08:22:46.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.994+0000 7f153a7fc640 1 -- 172.21.15.88:0/1001551824 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15240a5720 con 0x7f153c0a5370 2023-12-08T08:22:46.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.994+0000 7f153a7fc640 1 -- 172.21.15.88:0/1001551824 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15240a5ab0 con 0x7f153c0a5370 2023-12-08T08:22:46.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.994+0000 7f154189c640 1 -- 172.21.15.88:0/1001551824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f153c0a5370 msgr2=0x7f153c14f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:47.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.994+0000 7f154189c640 1 --2- 172.21.15.88:0/1001551824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f153c0a5370 0x7f153c14f870 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f153c06dc90 tx=0x7f152401c900 comp rx=0 tx=0).stop 2023-12-08T08:22:47.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.994+0000 7f154189c640 1 -- 172.21.15.88:0/1001551824 shutdown_connections 2023-12-08T08:22:47.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.994+0000 7f154189c640 1 --2- 172.21.15.88:0/1001551824 >> v2:172.21.15.148:3300/0 conn(0x7f153c072810 0x7f153c14fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:47.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.994+0000 7f154189c640 1 --2- 172.21.15.88:0/1001551824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f153c0a5370 0x7f153c14f870 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:47.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.994+0000 7f154189c640 1 -- 172.21.15.88:0/1001551824 >> 172.21.15.88:0/1001551824 conn(0x7f153c06b220 msgr2=0x7f153c0a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:47.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.994+0000 7f154189c640 1 -- 172.21.15.88:0/1001551824 shutdown_connections 2023-12-08T08:22:47.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.994+0000 7f154189c640 1 -- 172.21.15.88:0/1001551824 wait complete. 2023-12-08T08:22:47.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.998+0000 7f154189c640 1 Processor -- start 2023-12-08T08:22:47.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.998+0000 7f154189c640 1 -- start start 2023-12-08T08:22:47.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.998+0000 7f154189c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f153c072810 0x7f153c0c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:47.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.998+0000 7f154189c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f153c0a4f90 0x7f153c148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:47.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.998+0000 7f154189c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f153c0a5370 0x7f153c149060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:47.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.998+0000 7f154189c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153c1eee50 con 0x7f153c0a5370 2023-12-08T08:22:47.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.998+0000 7f154189c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153c071d10 con 0x7f153c0a4f90 2023-12-08T08:22:47.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.998+0000 7f154189c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153c1495a0 con 0x7f153c072810 2023-12-08T08:22:47.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.998+0000 7f153b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f153c0a5370 0x7f153c149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:47.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.998+0000 7f153b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f153c0a5370 0x7f153c149060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53464/0 (socket says 172.21.15.88:53464) 2023-12-08T08:22:47.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.998+0000 7f153b7fe640 1 -- 172.21.15.88:0/1864220491 learned_addr learned my addr 172.21.15.88:0/1864220491 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:47.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.998+0000 7f153affd640 1 --2- 172.21.15.88:0/1864220491 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f153c072810 0x7f153c0c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:47.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.998+0000 7f15327fc640 1 --2- 172.21.15.88:0/1864220491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f153c0a4f90 0x7f153c148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:47.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.998+0000 7f153b7fe640 1 -- 172.21.15.88:0/1864220491 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f153c072810 msgr2=0x7f153c0c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:47.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.998+0000 7f153b7fe640 1 --2- 172.21.15.88:0/1864220491 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f153c072810 0x7f153c0c3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:47.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.998+0000 7f153b7fe640 1 -- 172.21.15.88:0/1864220491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f153c0a4f90 msgr2=0x7f153c148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:47.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.998+0000 7f153b7fe640 1 --2- 172.21.15.88:0/1864220491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f153c0a4f90 0x7f153c148b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:47.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.998+0000 7f153b7fe640 1 -- 172.21.15.88:0/1864220491 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1524009b30 con 0x7f153c0a5370 2023-12-08T08:22:47.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.998+0000 7f153affd640 1 --2- 172.21.15.88:0/1864220491 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f153c072810 0x7f153c0c3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:47.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.998+0000 7f15327fc640 1 --2- 172.21.15.88:0/1864220491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f153c0a4f90 0x7f153c148b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:47.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.998+0000 7f153b7fe640 1 --2- 172.21.15.88:0/1864220491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f153c0a5370 0x7f153c149060 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f153400d800 tx=0x7f153400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:47.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.998+0000 7f1538ff9640 1 -- 172.21.15.88:0/1864220491 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153400b6c0 con 0x7f153c0a5370 2023-12-08T08:22:47.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.998+0000 7f1538ff9640 1 -- 172.21.15.88:0/1864220491 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153400b820 con 0x7f153c0a5370 2023-12-08T08:22:47.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.998+0000 7f1538ff9640 1 -- 172.21.15.88:0/1864220491 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153400bbd0 con 0x7f153c0a5370 2023-12-08T08:22:47.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.998+0000 7f154189c640 1 -- 172.21.15.88:0/1864220491 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f153c1ef2e0 con 0x7f153c0a5370 2023-12-08T08:22:47.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.998+0000 7f154189c640 1 -- 172.21.15.88:0/1864220491 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f153c06fe90 con 0x7f153c0a5370 2023-12-08T08:22:47.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:46.998+0000 7f154189c640 1 -- 172.21.15.88:0/1864220491 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f153c1eefc0 con 0x7f153c0a5370 2023-12-08T08:22:47.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.002+0000 7f1538ff9640 1 -- 172.21.15.88:0/1864220491 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f153400bd30 con 0x7f153c0a5370 2023-12-08T08:22:47.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.002+0000 7f1538ff9640 1 --2- 172.21.15.88:0/1864220491 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f151c066470 0x7f151c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:47.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.002+0000 7f1538ff9640 1 -- 172.21.15.88:0/1864220491 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f1534084440 con 0x7f153c0a5370 2023-12-08T08:22:47.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.002+0000 7f153affd640 1 --2- 172.21.15.88:0/1864220491 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f151c066470 0x7f151c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:47.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.002+0000 7f153affd640 1 --2- 172.21.15.88:0/1864220491 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f151c066470 0x7f151c068930 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f153c153970 tx=0x7f152c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:47.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.006+0000 7f1538ff9640 1 -- 172.21.15.88:0/1864220491 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1534051850 con 0x7f153c0a5370 2023-12-08T08:22:47.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.186+0000 7f154189c640 1 -- 172.21.15.88:0/1864220491 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f153c067630 con 0x7f153c0a5370 2023-12-08T08:22:47.193 INFO:tasks.ceph.mon.a.smithi088.stderr:2023-12-08T08:22:47.190+0000 7f9f56907640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-08T08:22:47.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.190+0000 7f1538ff9640 1 -- 172.21.15.88:0/1864220491 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) v1 ==== 163+0+0 (secure 0 0 0) 0x7f1534054e70 con 0x7f153c0a5370 2023-12-08T08:22:47.196 INFO:teuthology.orchestra.run.smithi088.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-08T08:22:47.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.194+0000 7f154189c640 1 -- 172.21.15.88:0/1864220491 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f151c066470 msgr2=0x7f151c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:47.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.194+0000 7f154189c640 1 --2- 172.21.15.88:0/1864220491 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f151c066470 0x7f151c068930 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f153c153970 tx=0x7f152c009040 comp rx=0 tx=0).stop 2023-12-08T08:22:47.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.194+0000 7f154189c640 1 -- 172.21.15.88:0/1864220491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f153c0a5370 msgr2=0x7f153c149060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:47.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.194+0000 7f154189c640 1 --2- 172.21.15.88:0/1864220491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f153c0a5370 0x7f153c149060 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f153400d800 tx=0x7f153400dcc0 comp rx=0 tx=0).stop 2023-12-08T08:22:47.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.194+0000 7f154189c640 1 -- 172.21.15.88:0/1864220491 shutdown_connections 2023-12-08T08:22:47.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.194+0000 7f154189c640 1 --2- 172.21.15.88:0/1864220491 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f151c066470 0x7f151c068930 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:47.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.194+0000 7f154189c640 1 --2- 172.21.15.88:0/1864220491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f153c0a5370 0x7f153c149060 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:47.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.194+0000 7f154189c640 1 --2- 172.21.15.88:0/1864220491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f153c0a4f90 0x7f153c148b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:47.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.194+0000 7f154189c640 1 --2- 172.21.15.88:0/1864220491 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f153c072810 0x7f153c0c3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:47.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.194+0000 7f154189c640 1 -- 172.21.15.88:0/1864220491 >> 172.21.15.88:0/1864220491 conn(0x7f153c06b220 msgr2=0x7f153c0a6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:47.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.194+0000 7f154189c640 1 -- 172.21.15.88:0/1864220491 shutdown_connections 2023-12-08T08:22:47.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.194+0000 7f154189c640 1 -- 172.21.15.88:0/1864220491 wait complete. 2023-12-08T08:22:47.207 INFO:tasks.ceph.mds.d.smithi148.stderr: -2056> 2023-12-08T08:22:23.037+0000 7f5c8bbda640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:22:47.218 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-12-08T08:22:47.253 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-12-08T08:22:47.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.354+0000 7f3d21d01640 1 Processor -- start 2023-12-08T08:22:47.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.354+0000 7f3d21d01640 1 -- start start 2023-12-08T08:22:47.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.354+0000 7f3d21d01640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3d1c0c5300 0x7f3d1c0a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:47.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.354+0000 7f3d21d01640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3d1c1548c0 0x7f3d1c154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:47.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.354+0000 7f3d21d01640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d1c0a4e20 con 0x7f3d1c14b1e0 2023-12-08T08:22:47.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.354+0000 7f3d21d01640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d1c0a50e0 con 0x7f3d1c0c5300 2023-12-08T08:22:47.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.354+0000 7f3d21d01640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d1c0c0f00 con 0x7f3d1c1548c0 2023-12-08T08:22:47.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.354+0000 7f3d1affd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3d1c0c5300 0x7f3d1c0a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:47.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.354+0000 7f3d1affd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3d1c0c5300 0x7f3d1c0a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53468/0 (socket says 172.21.15.88:53468) 2023-12-08T08:22:47.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.354+0000 7f3d1affd640 1 -- 172.21.15.88:0/2522812692 learned_addr learned my addr 172.21.15.88:0/2522812692 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:47.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.354+0000 7f3d1bfff640 1 --2- 172.21.15.88:0/2522812692 >> v2:172.21.15.148:3300/0 conn(0x7f3d1c1548c0 0x7f3d1c154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:47.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.354+0000 7f3d1affd640 1 -- 172.21.15.88:0/2522812692 >> v2:172.21.15.148:3300/0 conn(0x7f3d1c1548c0 msgr2=0x7f3d1c154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:47.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.354+0000 7f3d1affd640 1 --2- 172.21.15.88:0/2522812692 >> v2:172.21.15.148:3300/0 conn(0x7f3d1c1548c0 0x7f3d1c154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:47.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.354+0000 7f3d1affd640 1 -- 172.21.15.88:0/2522812692 >> v1:172.21.15.148:6789/0 conn(0x7f3d1c14b1e0 legacy=0x7f3d1c0c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:47.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.354+0000 7f3d1affd640 1 -- 172.21.15.88:0/2522812692 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1c0c11e0 con 0x7f3d1c0c5300 2023-12-08T08:22:47.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.354+0000 7f3d1bfff640 1 --2- 172.21.15.88:0/2522812692 >> v2:172.21.15.148:3300/0 conn(0x7f3d1c1548c0 0x7f3d1c154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:47.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.358+0000 7f3d1affd640 1 --2- 172.21.15.88:0/2522812692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d1c0c5300 0x7f3d1c0a9c30 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c0c5850 tx=0x7f3d1001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1228a03b89bd17fa server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:47.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.358+0000 7f3d1a7fc640 1 -- 172.21.15.88:0/2522812692 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d100ab610 con 0x7f3d1c0c5300 2023-12-08T08:22:47.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.358+0000 7f3d1a7fc640 1 -- 172.21.15.88:0/2522812692 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d100ab770 con 0x7f3d1c0c5300 2023-12-08T08:22:47.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.358+0000 7f3d1a7fc640 1 -- 172.21.15.88:0/2522812692 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d100abb00 con 0x7f3d1c0c5300 2023-12-08T08:22:47.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.358+0000 7f3d21d01640 1 -- 172.21.15.88:0/2522812692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d1c0c5300 msgr2=0x7f3d1c0a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:47.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.358+0000 7f3d21d01640 1 --2- 172.21.15.88:0/2522812692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d1c0c5300 0x7f3d1c0a9c30 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c0c5850 tx=0x7f3d1001c500 comp rx=0 tx=0).stop 2023-12-08T08:22:47.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.358+0000 7f3d21d01640 1 -- 172.21.15.88:0/2522812692 shutdown_connections 2023-12-08T08:22:47.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.358+0000 7f3d21d01640 1 --2- 172.21.15.88:0/2522812692 >> v2:172.21.15.148:3300/0 conn(0x7f3d1c1548c0 0x7f3d1c154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:47.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.358+0000 7f3d21d01640 1 --2- 172.21.15.88:0/2522812692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d1c0c5300 0x7f3d1c0a9c30 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:47.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.358+0000 7f3d21d01640 1 -- 172.21.15.88:0/2522812692 >> 172.21.15.88:0/2522812692 conn(0x7f3d1c0c59f0 msgr2=0x7f3d1c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:47.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.358+0000 7f3d21d01640 1 -- 172.21.15.88:0/2522812692 shutdown_connections 2023-12-08T08:22:47.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.358+0000 7f3d21d01640 1 -- 172.21.15.88:0/2522812692 wait complete. 2023-12-08T08:22:47.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.358+0000 7f3d21d01640 1 Processor -- start 2023-12-08T08:22:47.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.362+0000 7f3d21d01640 1 -- start start 2023-12-08T08:22:47.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.362+0000 7f3d21d01640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3d1c0c5300 0x7f3d1c0a55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:47.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.362+0000 7f3d21d01640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d1c14b1e0 0x7f3d1c0a61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:47.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.362+0000 7f3d21d01640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d1c1548c0 0x7f3d1c147ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:47.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.362+0000 7f3d21d01640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c0a7080 con 0x7f3d1c1548c0 2023-12-08T08:22:47.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.362+0000 7f3d21d01640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c1f5330 con 0x7f3d1c14b1e0 2023-12-08T08:22:47.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.362+0000 7f3d21d01640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c1f4720 con 0x7f3d1c0c5300 2023-12-08T08:22:47.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.362+0000 7f3d1bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d1c1548c0 0x7f3d1c147ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:47.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.362+0000 7f3d1bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d1c1548c0 0x7f3d1c147ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53470/0 (socket says 172.21.15.88:53470) 2023-12-08T08:22:47.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.362+0000 7f3d1bfff640 1 -- 172.21.15.88:0/854493659 learned_addr learned my addr 172.21.15.88:0/854493659 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:47.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.362+0000 7f3d1affd640 1 --2- 172.21.15.88:0/854493659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d1c14b1e0 0x7f3d1c0a61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:47.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.362+0000 7f3d1b7fe640 1 --2- 172.21.15.88:0/854493659 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3d1c0c5300 0x7f3d1c0a55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:47.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.362+0000 7f3d1bfff640 1 -- 172.21.15.88:0/854493659 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3d1c0c5300 msgr2=0x7f3d1c0a55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:47.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.362+0000 7f3d1bfff640 1 --2- 172.21.15.88:0/854493659 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3d1c0c5300 0x7f3d1c0a55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:47.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.362+0000 7f3d1bfff640 1 -- 172.21.15.88:0/854493659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d1c14b1e0 msgr2=0x7f3d1c0a61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:47.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.362+0000 7f3d1bfff640 1 --2- 172.21.15.88:0/854493659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d1c14b1e0 0x7f3d1c0a61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:47.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.362+0000 7f3d1bfff640 1 -- 172.21.15.88:0/854493659 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d100094d0 con 0x7f3d1c1548c0 2023-12-08T08:22:47.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.362+0000 7f3d1bfff640 1 --2- 172.21.15.88:0/854493659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d1c1548c0 0x7f3d1c147ec0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f3d14007e20 tx=0x7f3d1400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:47.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.362+0000 7f3d03fff640 1 -- 172.21.15.88:0/854493659 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d14003ba0 con 0x7f3d1c1548c0 2023-12-08T08:22:47.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.362+0000 7f3d03fff640 1 -- 172.21.15.88:0/854493659 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1400f040 con 0x7f3d1c1548c0 2023-12-08T08:22:47.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.362+0000 7f3d21d01640 1 -- 172.21.15.88:0/854493659 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d1c1f4a00 con 0x7f3d1c1548c0 2023-12-08T08:22:47.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.362+0000 7f3d03fff640 1 -- 172.21.15.88:0/854493659 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1400de80 con 0x7f3d1c1548c0 2023-12-08T08:22:47.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.362+0000 7f3d21d01640 1 -- 172.21.15.88:0/854493659 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d1c1f4fc0 con 0x7f3d1c1548c0 2023-12-08T08:22:47.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.362+0000 7f3d21d01640 1 -- 172.21.15.88:0/854493659 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d1c1f54c0 con 0x7f3d1c1548c0 2023-12-08T08:22:47.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.366+0000 7f3d03fff640 1 -- 172.21.15.88:0/854493659 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3d14004030 con 0x7f3d1c1548c0 2023-12-08T08:22:47.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.366+0000 7f3d03fff640 1 --2- 172.21.15.88:0/854493659 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3d080664a0 0x7f3d08068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:47.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.366+0000 7f3d03fff640 1 -- 172.21.15.88:0/854493659 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f3d140840c0 con 0x7f3d1c1548c0 2023-12-08T08:22:47.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.366+0000 7f3d1b7fe640 1 --2- 172.21.15.88:0/854493659 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3d080664a0 0x7f3d08068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:47.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.366+0000 7f3d1b7fe640 1 --2- 172.21.15.88:0/854493659 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3d080664a0 0x7f3d08068960 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c007fd0 tx=0x7f3d0c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:47.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.370+0000 7f3d03fff640 1 -- 172.21.15.88:0/854493659 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3d140515b0 con 0x7f3d1c1548c0 2023-12-08T08:22:47.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:47.550+0000 7f3d21d01640 1 -- 172.21.15.88:0/854493659 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3d1c067630 con 0x7f3d1c1548c0 2023-12-08T08:22:48.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.194+0000 7f3d03fff640 1 -- 172.21.15.88:0/854493659 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v41) v1 ==== 105+0+0 (secure 0 0 0) 0x7f3d14054bd0 con 0x7f3d1c1548c0 2023-12-08T08:22:48.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.198+0000 7f3d21d01640 1 -- 172.21.15.88:0/854493659 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3d080664a0 msgr2=0x7f3d08068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:48.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.198+0000 7f3d21d01640 1 --2- 172.21.15.88:0/854493659 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3d080664a0 0x7f3d08068960 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c007fd0 tx=0x7f3d0c009040 comp rx=0 tx=0).stop 2023-12-08T08:22:48.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.198+0000 7f3d21d01640 1 -- 172.21.15.88:0/854493659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d1c1548c0 msgr2=0x7f3d1c147ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:48.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.198+0000 7f3d21d01640 1 --2- 172.21.15.88:0/854493659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d1c1548c0 0x7f3d1c147ec0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f3d14007e20 tx=0x7f3d1400d4a0 comp rx=0 tx=0).stop 2023-12-08T08:22:48.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.198+0000 7f3d21d01640 1 -- 172.21.15.88:0/854493659 shutdown_connections 2023-12-08T08:22:48.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.198+0000 7f3d21d01640 1 --2- 172.21.15.88:0/854493659 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3d080664a0 0x7f3d08068960 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:48.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.198+0000 7f3d21d01640 1 --2- 172.21.15.88:0/854493659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d1c1548c0 0x7f3d1c147ec0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:48.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.198+0000 7f3d21d01640 1 --2- 172.21.15.88:0/854493659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d1c14b1e0 0x7f3d1c0a61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:48.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.198+0000 7f3d21d01640 1 --2- 172.21.15.88:0/854493659 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3d1c0c5300 0x7f3d1c0a55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:48.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.198+0000 7f3d21d01640 1 -- 172.21.15.88:0/854493659 >> 172.21.15.88:0/854493659 conn(0x7f3d1c0c59f0 msgr2=0x7f3d1c0c1550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:48.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.198+0000 7f3d21d01640 1 -- 172.21.15.88:0/854493659 shutdown_connections 2023-12-08T08:22:48.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.198+0000 7f3d21d01640 1 -- 172.21.15.88:0/854493659 wait complete. 2023-12-08T08:22:48.224 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-12-08T08:22:48.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.362+0000 7f2529bd1640 1 Processor -- start 2023-12-08T08:22:48.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.362+0000 7f2529bd1640 1 -- start start 2023-12-08T08:22:48.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.362+0000 7f2529bd1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f252414e2a0 0x7f25241516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:48.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.362+0000 7f2529bd1640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2524151210 con 0x7f25240a98e0 2023-12-08T08:22:48.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.362+0000 7f2529bd1640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f252414e680 con 0x7f25240a9460 2023-12-08T08:22:48.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.362+0000 7f2529bd1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2524150be0 con 0x7f252414e2a0 2023-12-08T08:22:48.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.362+0000 7f2523fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f25240a98e0 0x7f252406bc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35896/0 (socket says 172.21.15.88:35896) 2023-12-08T08:22:48.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.362+0000 7f2523fff640 1 -- 172.21.15.88:0/58904054 learned_addr learned my addr 172.21.15.88:0/58904054 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:48.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.362+0000 7f25237fe640 1 --2- 172.21.15.88:0/58904054 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f252414e2a0 0x7f25241516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:48.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.362+0000 7f2522ffd640 1 -- 172.21.15.88:0/58904054 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4103189376 0 0) 0x7f2524151210 con 0x7f25240a98e0 2023-12-08T08:22:48.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.362+0000 7f2522ffd640 1 -- 172.21.15.88:0/58904054 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2510004640 con 0x7f25240a98e0 2023-12-08T08:22:48.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.362+0000 7f2522ffd640 1 -- 172.21.15.88:0/58904054 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4045954771 0 0) 0x7f252414e680 con 0x7f25240a9460 2023-12-08T08:22:48.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.362+0000 7f2522ffd640 1 -- 172.21.15.88:0/58904054 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2524151210 con 0x7f25240a9460 2023-12-08T08:22:48.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.362+0000 7f25237fe640 1 -- 172.21.15.88:0/58904054 >> v1:172.21.15.148:6789/0 conn(0x7f25240a9460 legacy=0x7f25240c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:48.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.362+0000 7f25237fe640 1 -- 172.21.15.88:0/58904054 >> v1:172.21.15.88:6789/0 conn(0x7f25240a98e0 legacy=0x7f252406bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:48.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.362+0000 7f25237fe640 1 -- 172.21.15.88:0/58904054 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25240c53c0 con 0x7f252414e2a0 2023-12-08T08:22:48.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.366+0000 7f25237fe640 1 --2- 172.21.15.88:0/58904054 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f252414e2a0 0x7f25241516a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f25140097f0 tx=0x7f251401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84feae6cc4e244d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:48.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.366+0000 7f2522ffd640 1 -- 172.21.15.88:0/58904054 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2514004230 con 0x7f252414e2a0 2023-12-08T08:22:48.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.366+0000 7f2522ffd640 1 -- 172.21.15.88:0/58904054 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25140a7050 con 0x7f252414e2a0 2023-12-08T08:22:48.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.366+0000 7f2522ffd640 1 -- 172.21.15.88:0/58904054 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2514003620 con 0x7f252414e2a0 2023-12-08T08:22:48.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.366+0000 7f2529bd1640 1 -- 172.21.15.88:0/58904054 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f252414e2a0 msgr2=0x7f25241516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:48.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.366+0000 7f2529bd1640 1 --2- 172.21.15.88:0/58904054 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f252414e2a0 0x7f25241516a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f25140097f0 tx=0x7f251401c4c0 comp rx=0 tx=0).stop 2023-12-08T08:22:48.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.366+0000 7f2529bd1640 1 -- 172.21.15.88:0/58904054 shutdown_connections 2023-12-08T08:22:48.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.366+0000 7f2529bd1640 1 --2- 172.21.15.88:0/58904054 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f252414e2a0 0x7f25241516a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:48.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.366+0000 7f2529bd1640 1 -- 172.21.15.88:0/58904054 >> 172.21.15.88:0/58904054 conn(0x7f25240c59f0 msgr2=0x7f25240c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:48.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.366+0000 7f2529bd1640 1 -- 172.21.15.88:0/58904054 shutdown_connections 2023-12-08T08:22:48.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.366+0000 7f2529bd1640 1 -- 172.21.15.88:0/58904054 wait complete. 2023-12-08T08:22:48.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.370+0000 7f2529bd1640 1 Processor -- start 2023-12-08T08:22:48.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.370+0000 7f2529bd1640 1 -- start start 2023-12-08T08:22:48.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.370+0000 7f2529bd1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f25240a9460 0x7f252414bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:48.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.370+0000 7f2529bd1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25240a98e0 0x7f252415bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:48.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.370+0000 7f2529bd1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f252414e2a0 0x7f2524143be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:48.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.370+0000 7f2529bd1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252414b4a0 con 0x7f252414e2a0 2023-12-08T08:22:48.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.370+0000 7f2529bd1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252414c180 con 0x7f25240a98e0 2023-12-08T08:22:48.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.370+0000 7f2529bd1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25241ea680 con 0x7f25240a9460 2023-12-08T08:22:48.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.370+0000 7f2523fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f252414e2a0 0x7f2524143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:48.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.370+0000 7f2523fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f252414e2a0 0x7f2524143be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53472/0 (socket says 172.21.15.88:53472) 2023-12-08T08:22:48.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.370+0000 7f2523fff640 1 -- 172.21.15.88:0/3080452915 learned_addr learned my addr 172.21.15.88:0/3080452915 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:48.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.370+0000 7f25237fe640 1 --2- 172.21.15.88:0/3080452915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f25240a9460 0x7f252414bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:48.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.370+0000 7f251bfff640 1 --2- 172.21.15.88:0/3080452915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25240a98e0 0x7f252415bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:48.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.370+0000 7f2523fff640 1 -- 172.21.15.88:0/3080452915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f25240a9460 msgr2=0x7f252414bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:48.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.370+0000 7f2523fff640 1 --2- 172.21.15.88:0/3080452915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f25240a9460 0x7f252414bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:48.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.370+0000 7f2523fff640 1 -- 172.21.15.88:0/3080452915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25240a98e0 msgr2=0x7f252415bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:48.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.370+0000 7f2523fff640 1 --2- 172.21.15.88:0/3080452915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25240a98e0 0x7f252415bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:48.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.370+0000 7f2523fff640 1 -- 172.21.15.88:0/3080452915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2514009420 con 0x7f252414e2a0 2023-12-08T08:22:48.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.370+0000 7f2523fff640 1 --2- 172.21.15.88:0/3080452915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f252414e2a0 0x7f2524143be0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f251c00cb70 tx=0x7f251c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:48.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.370+0000 7f2520ff9640 1 -- 172.21.15.88:0/3080452915 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c00ace0 con 0x7f252414e2a0 2023-12-08T08:22:48.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.370+0000 7f2520ff9640 1 -- 172.21.15.88:0/3080452915 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251c00ae40 con 0x7f252414e2a0 2023-12-08T08:22:48.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.370+0000 7f2520ff9640 1 -- 172.21.15.88:0/3080452915 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c012620 con 0x7f252414e2a0 2023-12-08T08:22:48.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.370+0000 7f2529bd1640 1 -- 172.21.15.88:0/3080452915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25241ea940 con 0x7f252414e2a0 2023-12-08T08:22:48.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.370+0000 7f2529bd1640 1 -- 172.21.15.88:0/3080452915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25241eaf00 con 0x7f252414e2a0 2023-12-08T08:22:48.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.374+0000 7f2529bd1640 1 -- 172.21.15.88:0/3080452915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2524067630 con 0x7f252414e2a0 2023-12-08T08:22:48.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.374+0000 7f2520ff9640 1 -- 172.21.15.88:0/3080452915 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f251c007070 con 0x7f252414e2a0 2023-12-08T08:22:48.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.374+0000 7f2520ff9640 1 --2- 172.21.15.88:0/3080452915 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2504066470 0x7f2504068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:48.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.374+0000 7f2520ff9640 1 -- 172.21.15.88:0/3080452915 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f251c083f30 con 0x7f252414e2a0 2023-12-08T08:22:48.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.374+0000 7f25237fe640 1 --2- 172.21.15.88:0/3080452915 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2504066470 0x7f2504068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:48.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.374+0000 7f25237fe640 1 --2- 172.21.15.88:0/3080452915 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2504066470 0x7f2504068930 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f25140ad000 tx=0x7f25140a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:48.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.378+0000 7f2520ff9640 1 -- 172.21.15.88:0/3080452915 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f251c054d80 con 0x7f252414e2a0 2023-12-08T08:22:48.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:48.530+0000 7f2529bd1640 1 -- 172.21.15.88:0/3080452915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f252414d450 con 0x7f252414e2a0 2023-12-08T08:22:49.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.202+0000 7f2520ff9640 1 -- 172.21.15.88:0/3080452915 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v59) v1 ==== 184+0+0 (secure 0 0 0) 0x7f251c0170e0 con 0x7f252414e2a0 2023-12-08T08:22:49.208 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs2_metadata' removed 2023-12-08T08:22:49.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.206+0000 7f2529bd1640 1 -- 172.21.15.88:0/3080452915 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2504066470 msgr2=0x7f2504068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:49.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.206+0000 7f2529bd1640 1 --2- 172.21.15.88:0/3080452915 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2504066470 0x7f2504068930 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f25140ad000 tx=0x7f25140a6000 comp rx=0 tx=0).stop 2023-12-08T08:22:49.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.206+0000 7f2529bd1640 1 -- 172.21.15.88:0/3080452915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f252414e2a0 msgr2=0x7f2524143be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:49.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.206+0000 7f2529bd1640 1 --2- 172.21.15.88:0/3080452915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f252414e2a0 0x7f2524143be0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f251c00cb70 tx=0x7f251c00a430 comp rx=0 tx=0).stop 2023-12-08T08:22:49.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.206+0000 7f2529bd1640 1 -- 172.21.15.88:0/3080452915 shutdown_connections 2023-12-08T08:22:49.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.206+0000 7f2529bd1640 1 --2- 172.21.15.88:0/3080452915 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2504066470 0x7f2504068930 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:49.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.206+0000 7f2529bd1640 1 --2- 172.21.15.88:0/3080452915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f252414e2a0 0x7f2524143be0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:49.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.206+0000 7f2529bd1640 1 --2- 172.21.15.88:0/3080452915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25240a98e0 0x7f252415bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:49.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.206+0000 7f2529bd1640 1 --2- 172.21.15.88:0/3080452915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f25240a9460 0x7f252414bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:49.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.206+0000 7f2529bd1640 1 -- 172.21.15.88:0/3080452915 >> 172.21.15.88:0/3080452915 conn(0x7f25240c59f0 msgr2=0x7f252406bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:49.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.206+0000 7f2529bd1640 1 -- 172.21.15.88:0/3080452915 shutdown_connections 2023-12-08T08:22:49.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.206+0000 7f2529bd1640 1 -- 172.21.15.88:0/3080452915 wait complete. 2023-12-08T08:22:49.235 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-12-08T08:22:49.349 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:22:49.353 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:22:49.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.370+0000 7faf66b65640 1 Processor -- start 2023-12-08T08:22:49.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.370+0000 7faf66b65640 1 -- start start 2023-12-08T08:22:49.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.374+0000 7faf66b65640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faf6014e2a0 0x7faf601516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:49.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.374+0000 7faf66b65640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faf600a9460 0x7faf600c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:49.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.374+0000 7faf66b65640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf60151210 con 0x7faf600a9910 2023-12-08T08:22:49.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.374+0000 7faf66b65640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf6014e680 con 0x7faf600a9460 2023-12-08T08:22:49.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.374+0000 7faf66b65640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf60150be0 con 0x7faf6014e2a0 2023-12-08T08:22:49.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.374+0000 7faf5ffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faf600a9460 0x7faf600c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:49.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.374+0000 7faf5ffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faf600a9460 0x7faf600c4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53484/0 (socket says 172.21.15.88:53484) 2023-12-08T08:22:49.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.374+0000 7faf5ffff640 1 -- 172.21.15.88:0/4028830125 learned_addr learned my addr 172.21.15.88:0/4028830125 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:49.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.374+0000 7faf65102640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7faf600a9910 0x7faf6006bc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35898/0 (socket says 172.21.15.88:35898) 2023-12-08T08:22:49.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.374+0000 7faf64901640 1 --2- 172.21.15.88:0/4028830125 >> v2:172.21.15.148:3300/0 conn(0x7faf6014e2a0 0x7faf601516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:49.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.374+0000 7faf5ffff640 1 -- 172.21.15.88:0/4028830125 >> v2:172.21.15.148:3300/0 conn(0x7faf6014e2a0 msgr2=0x7faf601516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:49.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.374+0000 7faf5ffff640 1 --2- 172.21.15.88:0/4028830125 >> v2:172.21.15.148:3300/0 conn(0x7faf6014e2a0 0x7faf601516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:49.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.374+0000 7faf5ffff640 1 -- 172.21.15.88:0/4028830125 >> v1:172.21.15.88:6789/0 conn(0x7faf600a9910 legacy=0x7faf6006bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:49.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.374+0000 7faf5ffff640 1 -- 172.21.15.88:0/4028830125 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf600c53c0 con 0x7faf600a9460 2023-12-08T08:22:49.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.374+0000 7faf5f7fe640 1 -- 172.21.15.88:0/4028830125 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2526929660 0 0) 0x7faf60151210 con 0x7faf600a9910 2023-12-08T08:22:49.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.378+0000 7faf5ffff640 1 --2- 172.21.15.88:0/4028830125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf600a9460 0x7faf600c4180 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7faf600c6910 tx=0x7faf4c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5efe857333de15ed server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:49.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.378+0000 7faf5f7fe640 1 -- 172.21.15.88:0/4028830125 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c0ab610 con 0x7faf600a9460 2023-12-08T08:22:49.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.378+0000 7faf5f7fe640 1 -- 172.21.15.88:0/4028830125 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c0ab770 con 0x7faf600a9460 2023-12-08T08:22:49.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.378+0000 7faf5f7fe640 1 -- 172.21.15.88:0/4028830125 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c0abb00 con 0x7faf600a9460 2023-12-08T08:22:49.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.378+0000 7faf66b65640 1 -- 172.21.15.88:0/4028830125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf600a9460 msgr2=0x7faf600c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:49.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.378+0000 7faf66b65640 1 --2- 172.21.15.88:0/4028830125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf600a9460 0x7faf600c4180 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7faf600c6910 tx=0x7faf4c01c500 comp rx=0 tx=0).stop 2023-12-08T08:22:49.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.378+0000 7faf66b65640 1 -- 172.21.15.88:0/4028830125 shutdown_connections 2023-12-08T08:22:49.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.378+0000 7faf66b65640 1 --2- 172.21.15.88:0/4028830125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf600a9460 0x7faf600c4180 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:49.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.378+0000 7faf66b65640 1 --2- 172.21.15.88:0/4028830125 >> v2:172.21.15.148:3300/0 conn(0x7faf6014e2a0 0x7faf601516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:49.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.378+0000 7faf66b65640 1 -- 172.21.15.88:0/4028830125 >> 172.21.15.88:0/4028830125 conn(0x7faf600c59f0 msgr2=0x7faf600c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:49.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.378+0000 7faf66b65640 1 -- 172.21.15.88:0/4028830125 shutdown_connections 2023-12-08T08:22:49.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.378+0000 7faf66b65640 1 -- 172.21.15.88:0/4028830125 wait complete. 2023-12-08T08:22:49.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.378+0000 7faf66b65640 1 Processor -- start 2023-12-08T08:22:49.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.378+0000 7faf66b65640 1 -- start start 2023-12-08T08:22:49.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.382+0000 7faf66b65640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf600a9460 0x7faf60155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:49.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.382+0000 7faf66b65640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf600a9910 0x7faf60152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:49.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.382+0000 7faf66b65640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf6014e2a0 0x7faf60071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:49.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.382+0000 7faf66b65640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf601563d0 con 0x7faf600a9460 2023-12-08T08:22:49.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.382+0000 7faf66b65640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6014b0c0 con 0x7faf6014e2a0 2023-12-08T08:22:49.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.382+0000 7faf66b65640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf60153040 con 0x7faf600a9910 2023-12-08T08:22:49.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.382+0000 7faf64901640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf600a9460 0x7faf60155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:49.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.382+0000 7faf64901640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf600a9460 0x7faf60155e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53490/0 (socket says 172.21.15.88:53490) 2023-12-08T08:22:49.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.382+0000 7faf64901640 1 -- 172.21.15.88:0/4230121313 learned_addr learned my addr 172.21.15.88:0/4230121313 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:49.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.382+0000 7faf64901640 1 -- 172.21.15.88:0/4230121313 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf600a9910 msgr2=0x7faf60152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:49.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.382+0000 7faf64901640 1 --2- 172.21.15.88:0/4230121313 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf600a9910 0x7faf60152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:49.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.382+0000 7faf64901640 1 -- 172.21.15.88:0/4230121313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf6014e2a0 msgr2=0x7faf60071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:49.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.382+0000 7faf64901640 1 --2- 172.21.15.88:0/4230121313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf6014e2a0 0x7faf60071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:49.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.382+0000 7faf64901640 1 -- 172.21.15.88:0/4230121313 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c0094d0 con 0x7faf600a9460 2023-12-08T08:22:49.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.382+0000 7faf64901640 1 --2- 172.21.15.88:0/4230121313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf600a9460 0x7faf60155e90 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7faf5400d5f0 tx=0x7faf5400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:49.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.382+0000 7faf5d7fa640 1 -- 172.21.15.88:0/4230121313 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf540125f0 con 0x7faf600a9460 2023-12-08T08:22:49.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.382+0000 7faf5d7fa640 1 -- 172.21.15.88:0/4230121313 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf54012750 con 0x7faf600a9460 2023-12-08T08:22:49.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.382+0000 7faf5d7fa640 1 -- 172.21.15.88:0/4230121313 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf54012ae0 con 0x7faf600a9460 2023-12-08T08:22:49.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.382+0000 7faf66b65640 1 -- 172.21.15.88:0/4230121313 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf60152d60 con 0x7faf600a9460 2023-12-08T08:22:49.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.382+0000 7faf66b65640 1 -- 172.21.15.88:0/4230121313 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6014ad50 con 0x7faf600a9460 2023-12-08T08:22:49.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.382+0000 7faf66b65640 1 -- 172.21.15.88:0/4230121313 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf601ed800 con 0x7faf600a9460 2023-12-08T08:22:49.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.386+0000 7faf5d7fa640 1 -- 172.21.15.88:0/4230121313 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faf54012c40 con 0x7faf600a9460 2023-12-08T08:22:49.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.386+0000 7faf5d7fa640 1 --2- 172.21.15.88:0/4230121313 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faf44066470 0x7faf44068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:49.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.386+0000 7faf5d7fa640 1 -- 172.21.15.88:0/4230121313 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5445+0+0 (secure 0 0 0) 0x7faf540842d0 con 0x7faf600a9460 2023-12-08T08:22:49.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.386+0000 7faf5ffff640 1 --2- 172.21.15.88:0/4230121313 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faf44066470 0x7faf44068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:49.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.386+0000 7faf5ffff640 1 --2- 172.21.15.88:0/4230121313 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faf44066470 0x7faf44068930 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0af000 tx=0x7faf4c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:49.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.390+0000 7faf5d7fa640 1 -- 172.21.15.88:0/4230121313 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faf54051840 con 0x7faf600a9460 2023-12-08T08:22:49.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:49.546+0000 7faf66b65640 1 -- 172.21.15.88:0/4230121313 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faf60067630 con 0x7faf600a9460 2023-12-08T08:22:50.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.206+0000 7faf5d7fa640 1 -- 172.21.15.88:0/4230121313 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v60) v1 ==== 172+0+0 (secure 0 0 0) 0x7faf54007380 con 0x7faf600a9460 2023-12-08T08:22:50.210 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs2_data' removed 2023-12-08T08:22:50.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.206+0000 7faf66b65640 1 -- 172.21.15.88:0/4230121313 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faf44066470 msgr2=0x7faf44068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:50.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.206+0000 7faf66b65640 1 --2- 172.21.15.88:0/4230121313 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faf44066470 0x7faf44068930 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0af000 tx=0x7faf4c008040 comp rx=0 tx=0).stop 2023-12-08T08:22:50.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.206+0000 7faf66b65640 1 -- 172.21.15.88:0/4230121313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf600a9460 msgr2=0x7faf60155e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:50.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.206+0000 7faf66b65640 1 --2- 172.21.15.88:0/4230121313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf600a9460 0x7faf60155e90 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7faf5400d5f0 tx=0x7faf5400dab0 comp rx=0 tx=0).stop 2023-12-08T08:22:50.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.206+0000 7faf66b65640 1 -- 172.21.15.88:0/4230121313 shutdown_connections 2023-12-08T08:22:50.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.206+0000 7faf66b65640 1 --2- 172.21.15.88:0/4230121313 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faf44066470 0x7faf44068930 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:50.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.206+0000 7faf66b65640 1 --2- 172.21.15.88:0/4230121313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf6014e2a0 0x7faf60071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:50.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.206+0000 7faf66b65640 1 --2- 172.21.15.88:0/4230121313 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faf600a9910 0x7faf60152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:50.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.206+0000 7faf66b65640 1 --2- 172.21.15.88:0/4230121313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf600a9460 0x7faf60155e90 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:50.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.206+0000 7faf66b65640 1 -- 172.21.15.88:0/4230121313 >> 172.21.15.88:0/4230121313 conn(0x7faf600c59f0 msgr2=0x7faf600aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:50.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.206+0000 7faf66b65640 1 -- 172.21.15.88:0/4230121313 shutdown_connections 2023-12-08T08:22:50.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.206+0000 7faf66b65640 1 -- 172.21.15.88:0/4230121313 wait complete. 2023-12-08T08:22:50.236 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-08T08:22:50.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.370+0000 7f4cb5f72640 1 Processor -- start 2023-12-08T08:22:50.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.370+0000 7f4cb5f72640 1 -- start start 2023-12-08T08:22:50.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.370+0000 7f4cb5f72640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4cb014b1e0 0x7f4cb00c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:50.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.370+0000 7f4cb5f72640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4cb01548c0 0x7f4cb0154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:50.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.370+0000 7f4cb5f72640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb00a4e20 con 0x7f4cb00c5300 2023-12-08T08:22:50.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.370+0000 7f4cb5f72640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb00a50e0 con 0x7f4cb014b1e0 2023-12-08T08:22:50.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.370+0000 7f4cb5f72640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb00c0f00 con 0x7f4cb01548c0 2023-12-08T08:22:50.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.370+0000 7f4caf7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4cb014b1e0 0x7f4cb00c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:50.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.370+0000 7f4caf7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4cb014b1e0 0x7f4cb00c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60544/0 (socket says 172.21.15.88:60544) 2023-12-08T08:22:50.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.370+0000 7f4caf7fe640 1 -- 172.21.15.88:0/4167142930 learned_addr learned my addr 172.21.15.88:0/4167142930 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:50.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.370+0000 7f4caffff640 1 --2- 172.21.15.88:0/4167142930 >> v2:172.21.15.148:3300/0 conn(0x7f4cb01548c0 0x7f4cb0154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:50.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.370+0000 7f4caf7fe640 1 -- 172.21.15.88:0/4167142930 >> v2:172.21.15.148:3300/0 conn(0x7f4cb01548c0 msgr2=0x7f4cb0154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:50.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.370+0000 7f4caf7fe640 1 --2- 172.21.15.88:0/4167142930 >> v2:172.21.15.148:3300/0 conn(0x7f4cb01548c0 0x7f4cb0154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:50.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.370+0000 7f4caf7fe640 1 -- 172.21.15.88:0/4167142930 >> v1:172.21.15.148:6789/0 conn(0x7f4cb00c5300 legacy=0x7f4cb00a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:50.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.370+0000 7f4caf7fe640 1 -- 172.21.15.88:0/4167142930 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb00c11e0 con 0x7f4cb014b1e0 2023-12-08T08:22:50.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.374+0000 7f4caf7fe640 1 --2- 172.21.15.88:0/4167142930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb014b1e0 0x7f4cb00c1700 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f4cb00c5850 tx=0x7f4ca001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a7d8ecc886504c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:50.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.374+0000 7f4cae7fc640 1 -- 172.21.15.88:0/4167142930 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca00ac630 con 0x7f4cb014b1e0 2023-12-08T08:22:50.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.374+0000 7f4cae7fc640 1 -- 172.21.15.88:0/4167142930 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca00ac790 con 0x7f4cb014b1e0 2023-12-08T08:22:50.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.374+0000 7f4cae7fc640 1 -- 172.21.15.88:0/4167142930 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca00acb20 con 0x7f4cb014b1e0 2023-12-08T08:22:50.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.374+0000 7f4cb5f72640 1 -- 172.21.15.88:0/4167142930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb014b1e0 msgr2=0x7f4cb00c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:50.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.374+0000 7f4cb5f72640 1 --2- 172.21.15.88:0/4167142930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb014b1e0 0x7f4cb00c1700 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f4cb00c5850 tx=0x7f4ca001c4c0 comp rx=0 tx=0).stop 2023-12-08T08:22:50.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.374+0000 7f4cb5f72640 1 -- 172.21.15.88:0/4167142930 shutdown_connections 2023-12-08T08:22:50.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.374+0000 7f4cb5f72640 1 --2- 172.21.15.88:0/4167142930 >> v2:172.21.15.148:3300/0 conn(0x7f4cb01548c0 0x7f4cb0154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:50.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.374+0000 7f4cb5f72640 1 --2- 172.21.15.88:0/4167142930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb014b1e0 0x7f4cb00c1700 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:50.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.374+0000 7f4cb5f72640 1 -- 172.21.15.88:0/4167142930 >> 172.21.15.88:0/4167142930 conn(0x7f4cb00c59f0 msgr2=0x7f4cb00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:50.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.374+0000 7f4cb5f72640 1 -- 172.21.15.88:0/4167142930 shutdown_connections 2023-12-08T08:22:50.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.374+0000 7f4cb5f72640 1 -- 172.21.15.88:0/4167142930 wait complete. 2023-12-08T08:22:50.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.378+0000 7f4cb5f72640 1 Processor -- start 2023-12-08T08:22:50.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.378+0000 7f4cb5f72640 1 -- start start 2023-12-08T08:22:50.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.378+0000 7f4cb5f72640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb00c5300 0x7f4cb006cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:50.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.378+0000 7f4cb5f72640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4cb014b1e0 0x7f4cb0141770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:50.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.378+0000 7f4cb5f72640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4cb01548c0 0x7f4cb0141cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:50.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.378+0000 7f4cb5f72640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb006fe40 con 0x7f4cb00c5300 2023-12-08T08:22:50.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.378+0000 7f4cb5f72640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb0146420 con 0x7f4cb01548c0 2023-12-08T08:22:50.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.378+0000 7f4cb5f72640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb01421f0 con 0x7f4cb014b1e0 2023-12-08T08:22:50.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.378+0000 7f4caf7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb00c5300 0x7f4cb006cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:50.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.378+0000 7f4caf7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb00c5300 0x7f4cb006cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60560/0 (socket says 172.21.15.88:60560) 2023-12-08T08:22:50.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.378+0000 7f4caf7fe640 1 -- 172.21.15.88:0/355880217 learned_addr learned my addr 172.21.15.88:0/355880217 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:50.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.378+0000 7f4caffff640 1 --2- 172.21.15.88:0/355880217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4cb01548c0 0x7f4cb0141cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:50.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.378+0000 7f4caeffd640 1 --2- 172.21.15.88:0/355880217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4cb014b1e0 0x7f4cb0141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:50.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.378+0000 7f4caf7fe640 1 -- 172.21.15.88:0/355880217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4cb014b1e0 msgr2=0x7f4cb0141770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:50.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.378+0000 7f4caf7fe640 1 --2- 172.21.15.88:0/355880217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4cb014b1e0 0x7f4cb0141770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:50.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.378+0000 7f4caf7fe640 1 -- 172.21.15.88:0/355880217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4cb01548c0 msgr2=0x7f4cb0141cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:50.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.378+0000 7f4caf7fe640 1 --2- 172.21.15.88:0/355880217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4cb01548c0 0x7f4cb0141cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:50.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.378+0000 7f4caf7fe640 1 -- 172.21.15.88:0/355880217 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca00094d0 con 0x7f4cb00c5300 2023-12-08T08:22:50.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.378+0000 7f4caf7fe640 1 --2- 172.21.15.88:0/355880217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb00c5300 0x7f4cb006cbd0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f4ca001ab70 tx=0x7f4ca001ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:50.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.378+0000 7f4c97fff640 1 -- 172.21.15.88:0/355880217 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca00b7620 con 0x7f4cb00c5300 2023-12-08T08:22:50.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.378+0000 7f4cb5f72640 1 -- 172.21.15.88:0/355880217 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb01488b0 con 0x7f4cb00c5300 2023-12-08T08:22:50.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.378+0000 7f4c97fff640 1 -- 172.21.15.88:0/355880217 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca00b7780 con 0x7f4cb00c5300 2023-12-08T08:22:50.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.378+0000 7f4c97fff640 1 -- 172.21.15.88:0/355880217 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca00b7b10 con 0x7f4cb00c5300 2023-12-08T08:22:50.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.378+0000 7f4cb5f72640 1 -- 172.21.15.88:0/355880217 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb0071f80 con 0x7f4cb00c5300 2023-12-08T08:22:50.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.382+0000 7f4cb5f72640 1 -- 172.21.15.88:0/355880217 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb0067630 con 0x7f4cb00c5300 2023-12-08T08:22:50.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.382+0000 7f4c97fff640 1 -- 172.21.15.88:0/355880217 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4ca00b3040 con 0x7f4cb00c5300 2023-12-08T08:22:50.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.382+0000 7f4c97fff640 1 --2- 172.21.15.88:0/355880217 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4c9c066470 0x7f4c9c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:50.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.382+0000 7f4c97fff640 1 -- 172.21.15.88:0/355880217 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f4ca011dfe0 con 0x7f4cb00c5300 2023-12-08T08:22:50.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.382+0000 7f4caeffd640 1 --2- 172.21.15.88:0/355880217 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4c9c066470 0x7f4c9c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:50.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.382+0000 7f4caeffd640 1 --2- 172.21.15.88:0/355880217 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4c9c066470 0x7f4c9c068930 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4cb00c62d0 tx=0x7f4ca4007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:50.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.386+0000 7f4c97fff640 1 -- 172.21.15.88:0/355880217 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4ca00eb690 con 0x7f4cb00c5300 2023-12-08T08:22:50.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.538+0000 7f4cb5f72640 1 -- 172.21.15.88:0/355880217 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4cb0155050 con 0x7f4cb00c5300 2023-12-08T08:22:50.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.542+0000 7f4c97fff640 1 -- 172.21.15.88:0/355880217 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4ca00eecb0 con 0x7f4cb00c5300 2023-12-08T08:22:50.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.542+0000 7f4cb5f72640 1 -- 172.21.15.88:0/355880217 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4c9c066470 msgr2=0x7f4c9c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:50.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.542+0000 7f4cb5f72640 1 --2- 172.21.15.88:0/355880217 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4c9c066470 0x7f4c9c068930 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4cb00c62d0 tx=0x7f4ca4007e40 comp rx=0 tx=0).stop 2023-12-08T08:22:50.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.542+0000 7f4cb5f72640 1 -- 172.21.15.88:0/355880217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb00c5300 msgr2=0x7f4cb006cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:50.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.542+0000 7f4cb5f72640 1 --2- 172.21.15.88:0/355880217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb00c5300 0x7f4cb006cbd0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f4ca001ab70 tx=0x7f4ca001ad00 comp rx=0 tx=0).stop 2023-12-08T08:22:50.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.542+0000 7f4cb5f72640 1 -- 172.21.15.88:0/355880217 shutdown_connections 2023-12-08T08:22:50.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.542+0000 7f4cb5f72640 1 --2- 172.21.15.88:0/355880217 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4c9c066470 0x7f4c9c068930 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:50.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.542+0000 7f4cb5f72640 1 --2- 172.21.15.88:0/355880217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4cb01548c0 0x7f4cb0141cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:50.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.542+0000 7f4cb5f72640 1 --2- 172.21.15.88:0/355880217 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4cb014b1e0 0x7f4cb0141770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:50.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.542+0000 7f4cb5f72640 1 --2- 172.21.15.88:0/355880217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4cb00c5300 0x7f4cb006cbd0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:50.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.542+0000 7f4cb5f72640 1 -- 172.21.15.88:0/355880217 >> 172.21.15.88:0/355880217 conn(0x7f4cb00c59f0 msgr2=0x7f4cb00c0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:50.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.542+0000 7f4cb5f72640 1 -- 172.21.15.88:0/355880217 shutdown_connections 2023-12-08T08:22:50.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.542+0000 7f4cb5f72640 1 -- 172.21.15.88:0/355880217 wait complete. 2023-12-08T08:22:50.567 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2023-12-08T08:22:50.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.698+0000 7fe454d2a640 1 Processor -- start 2023-12-08T08:22:50.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.698+0000 7fe454d2a640 1 -- start start 2023-12-08T08:22:50.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.702+0000 7fe454d2a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe450154f20 0x7fe45006b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:50.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.702+0000 7fe454d2a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe45006bf30 0x7fe45015ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:50.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.702+0000 7fe454d2a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4500c4890 con 0x7fe4500af4c0 2023-12-08T08:22:50.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.702+0000 7fe454d2a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4501553d0 con 0x7fe45006bf30 2023-12-08T08:22:50.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.702+0000 7fe454d2a640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe45006c340 con 0x7fe450154f20 2023-12-08T08:22:50.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.702+0000 7fe44e59c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe4500af4c0 0x7fe4500c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51266/0 (socket says 172.21.15.88:51266) 2023-12-08T08:22:50.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.702+0000 7fe44e59c640 1 -- 172.21.15.88:0/671988992 learned_addr learned my addr 172.21.15.88:0/671988992 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:50.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.702+0000 7fe44ed9d640 1 --2- 172.21.15.88:0/671988992 >> v2:172.21.15.88:3300/0 conn(0x7fe45006bf30 0x7fe45015ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:50.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.702+0000 7fe445d9b640 1 --2- 172.21.15.88:0/671988992 >> v2:172.21.15.148:3300/0 conn(0x7fe450154f20 0x7fe45006b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:50.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.702+0000 7fe44dd9b640 1 -- 172.21.15.88:0/671988992 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935258351 0 0) 0x7fe4500c4890 con 0x7fe4500af4c0 2023-12-08T08:22:50.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.702+0000 7fe44ed9d640 1 -- 172.21.15.88:0/671988992 >> v2:172.21.15.148:3300/0 conn(0x7fe450154f20 msgr2=0x7fe45006b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:50.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.702+0000 7fe44ed9d640 1 --2- 172.21.15.88:0/671988992 >> v2:172.21.15.148:3300/0 conn(0x7fe450154f20 0x7fe45006b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:50.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.702+0000 7fe44ed9d640 1 -- 172.21.15.88:0/671988992 >> v1:172.21.15.88:6789/0 conn(0x7fe4500af4c0 legacy=0x7fe4500c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:50.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.702+0000 7fe44ed9d640 1 -- 172.21.15.88:0/671988992 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4500af8a0 con 0x7fe45006bf30 2023-12-08T08:22:50.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.702+0000 7fe445d9b640 1 --2- 172.21.15.88:0/671988992 >> v2:172.21.15.148:3300/0 conn(0x7fe450154f20 0x7fe45006b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:50.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.702+0000 7fe44ed9d640 1 --2- 172.21.15.88:0/671988992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe45006bf30 0x7fe45015ee20 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fe4500c7290 tx=0x7fe44801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce220edf038a442 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:50.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.702+0000 7fe44dd9b640 1 -- 172.21.15.88:0/671988992 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4480a5910 con 0x7fe45006bf30 2023-12-08T08:22:50.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.702+0000 7fe44dd9b640 1 -- 172.21.15.88:0/671988992 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4480a5a70 con 0x7fe45006bf30 2023-12-08T08:22:50.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.702+0000 7fe44dd9b640 1 -- 172.21.15.88:0/671988992 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4480a5e00 con 0x7fe45006bf30 2023-12-08T08:22:50.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.706+0000 7fe454d2a640 1 -- 172.21.15.88:0/671988992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe45006bf30 msgr2=0x7fe45015ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:50.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.706+0000 7fe454d2a640 1 --2- 172.21.15.88:0/671988992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe45006bf30 0x7fe45015ee20 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fe4500c7290 tx=0x7fe44801c850 comp rx=0 tx=0).stop 2023-12-08T08:22:50.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.706+0000 7fe454d2a640 1 -- 172.21.15.88:0/671988992 shutdown_connections 2023-12-08T08:22:50.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.706+0000 7fe454d2a640 1 --2- 172.21.15.88:0/671988992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe45006bf30 0x7fe45015ee20 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:50.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.706+0000 7fe454d2a640 1 --2- 172.21.15.88:0/671988992 >> v2:172.21.15.148:3300/0 conn(0x7fe450154f20 0x7fe45006b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:50.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.706+0000 7fe454d2a640 1 -- 172.21.15.88:0/671988992 >> 172.21.15.88:0/671988992 conn(0x7fe4500ab9d0 msgr2=0x7fe4500abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:50.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.706+0000 7fe454d2a640 1 -- 172.21.15.88:0/671988992 shutdown_connections 2023-12-08T08:22:50.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.706+0000 7fe454d2a640 1 -- 172.21.15.88:0/671988992 wait complete. 2023-12-08T08:22:50.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.706+0000 7fe454d2a640 1 Processor -- start 2023-12-08T08:22:50.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.706+0000 7fe454d2a640 1 -- start start 2023-12-08T08:22:50.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.706+0000 7fe454d2a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe45006bf30 0x7fe450149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:50.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.706+0000 7fe454d2a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4500af4c0 0x7fe4501ec8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:50.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.706+0000 7fe454d2a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe450154f20 0x7fe4501ece30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:50.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.706+0000 7fe454d2a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4501f06c0 con 0x7fe450154f20 2023-12-08T08:22:50.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.706+0000 7fe454d2a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45014c440 con 0x7fe4500af4c0 2023-12-08T08:22:50.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.706+0000 7fe454d2a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45014d130 con 0x7fe45006bf30 2023-12-08T08:22:50.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.706+0000 7fe44ed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe450154f20 0x7fe4501ece30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:50.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.706+0000 7fe44ed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe450154f20 0x7fe4501ece30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60578/0 (socket says 172.21.15.88:60578) 2023-12-08T08:22:50.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.706+0000 7fe44ed9d640 1 -- 172.21.15.88:0/2219744315 learned_addr learned my addr 172.21.15.88:0/2219744315 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:50.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.710+0000 7fe445d9b640 1 --2- 172.21.15.88:0/2219744315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4500af4c0 0x7fe4501ec8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:50.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.710+0000 7fe44e59c640 1 --2- 172.21.15.88:0/2219744315 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe45006bf30 0x7fe450149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:50.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.710+0000 7fe44ed9d640 1 -- 172.21.15.88:0/2219744315 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe45006bf30 msgr2=0x7fe450149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:50.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.710+0000 7fe44ed9d640 1 --2- 172.21.15.88:0/2219744315 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe45006bf30 0x7fe450149c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:50.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.710+0000 7fe44ed9d640 1 -- 172.21.15.88:0/2219744315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4500af4c0 msgr2=0x7fe4501ec8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:50.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.710+0000 7fe44ed9d640 1 --2- 172.21.15.88:0/2219744315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4500af4c0 0x7fe4501ec8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:50.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.710+0000 7fe44ed9d640 1 -- 172.21.15.88:0/2219744315 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe448009a70 con 0x7fe450154f20 2023-12-08T08:22:50.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.710+0000 7fe44ed9d640 1 --2- 172.21.15.88:0/2219744315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe450154f20 0x7fe4501ece30 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fe448019460 tx=0x7fe4480195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:50.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.710+0000 7fe4477fe640 1 -- 172.21.15.88:0/2219744315 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4480ad850 con 0x7fe450154f20 2023-12-08T08:22:50.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.710+0000 7fe4477fe640 1 -- 172.21.15.88:0/2219744315 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4480ad9b0 con 0x7fe450154f20 2023-12-08T08:22:50.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.710+0000 7fe4477fe640 1 -- 172.21.15.88:0/2219744315 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4480add60 con 0x7fe450154f20 2023-12-08T08:22:50.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.710+0000 7fe454d2a640 1 -- 172.21.15.88:0/2219744315 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe45014c040 con 0x7fe450154f20 2023-12-08T08:22:50.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.710+0000 7fe454d2a640 1 -- 172.21.15.88:0/2219744315 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4501f0000 con 0x7fe450154f20 2023-12-08T08:22:50.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.710+0000 7fe454d2a640 1 -- 172.21.15.88:0/2219744315 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4501efe60 con 0x7fe450154f20 2023-12-08T08:22:50.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.710+0000 7fe4477fe640 1 -- 172.21.15.88:0/2219744315 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe4480b4050 con 0x7fe450154f20 2023-12-08T08:22:50.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.710+0000 7fe4477fe640 1 --2- 172.21.15.88:0/2219744315 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe430066470 0x7fe430068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:50.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.714+0000 7fe4477fe640 1 -- 172.21.15.88:0/2219744315 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fe44811eb20 con 0x7fe450154f20 2023-12-08T08:22:50.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.714+0000 7fe44e59c640 1 --2- 172.21.15.88:0/2219744315 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe430066470 0x7fe430068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:50.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.714+0000 7fe44e59c640 1 --2- 172.21.15.88:0/2219744315 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe430066470 0x7fe430068930 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe440000f70 tx=0x7fe440007df0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:50.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.718+0000 7fe4477fe640 1 -- 172.21.15.88:0/2219744315 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe4501efe60 con 0x7fe450154f20 2023-12-08T08:22:50.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:50.922+0000 7fe454d2a640 1 -- 172.21.15.88:0/2219744315 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7fe4501efe60 con 0x7fe450154f20 2023-12-08T08:22:51.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.206+0000 7fe4477fe640 1 -- 172.21.15.88:0/2219744315 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v168) v1 ==== 184+0+0 (secure 0 0 0) 0x7fe4501efe60 con 0x7fe450154f20 2023-12-08T08:22:51.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.210+0000 7fe454d2a640 1 -- 172.21.15.88:0/2219744315 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe430066470 msgr2=0x7fe430068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:51.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.210+0000 7fe454d2a640 1 --2- 172.21.15.88:0/2219744315 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe430066470 0x7fe430068930 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe440000f70 tx=0x7fe440007df0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.210+0000 7fe454d2a640 1 -- 172.21.15.88:0/2219744315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe450154f20 msgr2=0x7fe4501ece30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:51.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.210+0000 7fe454d2a640 1 --2- 172.21.15.88:0/2219744315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe450154f20 0x7fe4501ece30 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fe448019460 tx=0x7fe4480195f0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.210+0000 7fe454d2a640 1 -- 172.21.15.88:0/2219744315 shutdown_connections 2023-12-08T08:22:51.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.210+0000 7fe454d2a640 1 --2- 172.21.15.88:0/2219744315 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe430066470 0x7fe430068930 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.210+0000 7fe454d2a640 1 --2- 172.21.15.88:0/2219744315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe450154f20 0x7fe4501ece30 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.210+0000 7fe454d2a640 1 --2- 172.21.15.88:0/2219744315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4500af4c0 0x7fe4501ec8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.210+0000 7fe454d2a640 1 --2- 172.21.15.88:0/2219744315 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe45006bf30 0x7fe450149c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.210+0000 7fe454d2a640 1 -- 172.21.15.88:0/2219744315 >> 172.21.15.88:0/2219744315 conn(0x7fe4500ab9d0 msgr2=0x7fe4500733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:51.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.210+0000 7fe454d2a640 1 -- 172.21.15.88:0/2219744315 shutdown_connections 2023-12-08T08:22:51.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.210+0000 7fe454d2a640 1 -- 172.21.15.88:0/2219744315 wait complete. 2023-12-08T08:22:51.234 INFO:tasks.cephfs_test_runner:test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2023-12-08T08:22:51.234 INFO:tasks.cephfs_test_runner:Starting test: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-08T08:22:51.235 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:22:51.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ece3a3640 1 Processor -- start 2023-12-08T08:22:51.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ece3a3640 1 -- start start 2023-12-08T08:22:51.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ece3a3640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7ec80c8200 0x7f7ec80c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:51.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ece3a3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ec80c9210 0x7f7ec815ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:51.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ece3a3640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec8151f20 con 0x7f7ec80c65f0 2023-12-08T08:22:51.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ece3a3640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec8154450 con 0x7f7ec80c8200 2023-12-08T08:22:51.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ece3a3640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec8154710 con 0x7f7ec80c9210 2023-12-08T08:22:51.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ecd3a1640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7ec80c65f0 0x7f7ec80c8b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51272/0 (socket says 172.21.15.88:51272) 2023-12-08T08:22:51.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ecd3a1640 1 -- 172.21.15.88:0/1366526119 learned_addr learned my addr 172.21.15.88:0/1366526119 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:51.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ebffff640 1 -- 172.21.15.88:0/1366526119 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028668101 0 0) 0x7f7ec8151f20 con 0x7f7ec80c65f0 2023-12-08T08:22:51.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7eccba0640 1 --2- 172.21.15.88:0/1366526119 >> v2:172.21.15.148:3300/0 conn(0x7f7ec80c8200 0x7f7ec80c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:51.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ebffff640 1 -- 172.21.15.88:0/1366526119 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eb4003530 con 0x7f7ec80c65f0 2023-12-08T08:22:51.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ecdba2640 1 --2- 172.21.15.88:0/1366526119 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ec80c9210 0x7f7ec815ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:51.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ebffff640 1 -- 172.21.15.88:0/1366526119 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3544307172 0 0) 0x7f7eb4003530 con 0x7f7ec80c65f0 2023-12-08T08:22:51.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ebffff640 1 -- 172.21.15.88:0/1366526119 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ec80c9210 msgr2=0x7f7ec815ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:51.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ebffff640 1 --2- 172.21.15.88:0/1366526119 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ec80c9210 0x7f7ec815ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ebffff640 1 -- 172.21.15.88:0/1366526119 >> v2:172.21.15.148:3300/0 conn(0x7f7ec80c8200 msgr2=0x7f7ec80c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:51.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ebffff640 1 --2- 172.21.15.88:0/1366526119 >> v2:172.21.15.148:3300/0 conn(0x7f7ec80c8200 0x7f7ec80c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ebffff640 1 -- 172.21.15.88:0/1366526119 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec81549f0 con 0x7f7ec80c65f0 2023-12-08T08:22:51.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ebffff640 1 -- 172.21.15.88:0/1366526119 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f7ec4001680 con 0x7f7ec80c65f0 2023-12-08T08:22:51.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ebffff640 1 -- 172.21.15.88:0/1366526119 >> v1:172.21.15.88:6789/0 conn(0x7f7ec80c65f0 legacy=0x7f7ec80c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:51.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ebffff640 1 --2- 172.21.15.88:0/1366526119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7eb4003980 0x7f7eb4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:51.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ebffff640 1 --2- 172.21.15.88:0/1366526119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7eb40047d0 0x7f7eb4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:51.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ebffff640 1 --2- 172.21.15.88:0/1366526119 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ec80c9210 0x7f7eb4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:51.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ebffff640 1 -- 172.21.15.88:0/1366526119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec8154450 con 0x7f7eb40047d0 2023-12-08T08:22:51.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ebffff640 1 -- 172.21.15.88:0/1366526119 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec8154710 con 0x7f7eb4003980 2023-12-08T08:22:51.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ebffff640 1 -- 172.21.15.88:0/1366526119 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb400ba10 con 0x7f7ec80c9210 2023-12-08T08:22:51.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7eccba0640 1 --2- 172.21.15.88:0/1366526119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7eb40047d0 0x7f7eb4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:51.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ecdba2640 1 --2- 172.21.15.88:0/1366526119 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ec80c9210 0x7f7eb4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:51.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7ecd3a1640 1 --2- 172.21.15.88:0/1366526119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7eb4003980 0x7f7eb4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:51.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7eccba0640 1 -- 172.21.15.88:0/1366526119 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ec80c9210 msgr2=0x7f7eb4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:51.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7eccba0640 1 --2- 172.21.15.88:0/1366526119 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ec80c9210 0x7f7eb4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7eccba0640 1 -- 172.21.15.88:0/1366526119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7eb4003980 msgr2=0x7f7eb4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:51.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7eccba0640 1 --2- 172.21.15.88:0/1366526119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7eb4003980 0x7f7eb4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.370+0000 7f7eccba0640 1 -- 172.21.15.88:0/1366526119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb4003530 con 0x7f7eb40047d0 2023-12-08T08:22:51.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.374+0000 7f7eccba0640 1 --2- 172.21.15.88:0/1366526119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7eb40047d0 0x7f7eb4004c50 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009ab0 tx=0x7f7eb801ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657bb7b2a4c52170 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:51.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.374+0000 7f7ebffff640 1 -- 172.21.15.88:0/1366526119 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb80a5530 con 0x7f7eb40047d0 2023-12-08T08:22:51.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.374+0000 7f7ebffff640 1 -- 172.21.15.88:0/1366526119 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb80a5690 con 0x7f7eb40047d0 2023-12-08T08:22:51.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.374+0000 7f7ebffff640 1 -- 172.21.15.88:0/1366526119 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb80a5a00 con 0x7f7eb40047d0 2023-12-08T08:22:51.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.374+0000 7f7ece3a3640 1 -- 172.21.15.88:0/1366526119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7eb40047d0 msgr2=0x7f7eb4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:51.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.374+0000 7f7ece3a3640 1 --2- 172.21.15.88:0/1366526119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7eb40047d0 0x7f7eb4004c50 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009ab0 tx=0x7f7eb801ca40 comp rx=0 tx=0).stop 2023-12-08T08:22:51.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.374+0000 7f7ecdba2640 1 -- 172.21.15.88:0/1366526119 reap_dead start 2023-12-08T08:22:51.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.374+0000 7f7ece3a3640 1 -- 172.21.15.88:0/1366526119 shutdown_connections 2023-12-08T08:22:51.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.374+0000 7f7ece3a3640 1 -- 172.21.15.88:0/1366526119 >> 172.21.15.88:0/1366526119 conn(0x7f7ec80ab730 msgr2=0x7f7ec80abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:51.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.374+0000 7f7ece3a3640 1 -- 172.21.15.88:0/1366526119 shutdown_connections 2023-12-08T08:22:51.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.374+0000 7f7ece3a3640 1 -- 172.21.15.88:0/1366526119 wait complete. 2023-12-08T08:22:51.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.378+0000 7f7ece3a3640 1 Processor -- start 2023-12-08T08:22:51.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.378+0000 7f7ece3a3640 1 -- start start 2023-12-08T08:22:51.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.378+0000 7f7ece3a3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7eb40047d0 0x7f7ec814ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:51.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.378+0000 7f7ece3a3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ec8158470 0x7f7ec81531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:51.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.378+0000 7f7ece3a3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ec8158cc0 0x7f7ec81ece20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:51.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.378+0000 7f7ece3a3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec814ec00 con 0x7f7eb40047d0 2023-12-08T08:22:51.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.378+0000 7f7ece3a3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec8156f50 con 0x7f7ec8158cc0 2023-12-08T08:22:51.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.378+0000 7f7ece3a3640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec81ec6f0 con 0x7f7ec8158470 2023-12-08T08:22:51.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.378+0000 7f7ecd3a1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7eb40047d0 0x7f7ec814ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:51.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.378+0000 7f7ecd3a1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7eb40047d0 0x7f7ec814ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60606/0 (socket says 172.21.15.88:60606) 2023-12-08T08:22:51.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.378+0000 7f7ecd3a1640 1 -- 172.21.15.88:0/3986693464 learned_addr learned my addr 172.21.15.88:0/3986693464 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:51.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.378+0000 7f7ecdba2640 1 --2- 172.21.15.88:0/3986693464 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ec8158cc0 0x7f7ec81ece20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:51.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.378+0000 7f7eccba0640 1 --2- 172.21.15.88:0/3986693464 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ec8158470 0x7f7ec81531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:51.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.378+0000 7f7ecd3a1640 1 -- 172.21.15.88:0/3986693464 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ec8158470 msgr2=0x7f7ec81531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:51.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.378+0000 7f7ecd3a1640 1 --2- 172.21.15.88:0/3986693464 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ec8158470 0x7f7ec81531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.378+0000 7f7ecd3a1640 1 -- 172.21.15.88:0/3986693464 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ec8158cc0 msgr2=0x7f7ec81ece20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:51.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.378+0000 7f7ecd3a1640 1 --2- 172.21.15.88:0/3986693464 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ec8158cc0 0x7f7ec81ece20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.378+0000 7f7ecd3a1640 1 -- 172.21.15.88:0/3986693464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec81566b0 con 0x7f7eb40047d0 2023-12-08T08:22:51.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.378+0000 7f7ecd3a1640 1 --2- 172.21.15.88:0/3986693464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7eb40047d0 0x7f7ec814ef50 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4007340 tx=0x7f7ec4007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:51.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.378+0000 7f7ebdffb640 1 -- 172.21.15.88:0/3986693464 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec40014f0 con 0x7f7eb40047d0 2023-12-08T08:22:51.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.378+0000 7f7ebdffb640 1 -- 172.21.15.88:0/3986693464 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec400f9c0 con 0x7f7eb40047d0 2023-12-08T08:22:51.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.378+0000 7f7ece3a3640 1 -- 172.21.15.88:0/3986693464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec8156990 con 0x7f7eb40047d0 2023-12-08T08:22:51.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.378+0000 7f7ebdffb640 1 -- 172.21.15.88:0/3986693464 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec400fd70 con 0x7f7eb40047d0 2023-12-08T08:22:51.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.378+0000 7f7ece3a3640 1 -- 172.21.15.88:0/3986693464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec81ec900 con 0x7f7eb40047d0 2023-12-08T08:22:51.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.382+0000 7f7ece3a3640 1 -- 172.21.15.88:0/3986693464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec81ecaf0 con 0x7f7eb40047d0 2023-12-08T08:22:51.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.382+0000 7f7ebdffb640 1 -- 172.21.15.88:0/3986693464 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7ec401d460 con 0x7f7eb40047d0 2023-12-08T08:22:51.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.382+0000 7f7ebdffb640 1 --2- 172.21.15.88:0/3986693464 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7eac0664a0 0x7f7eac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:51.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.382+0000 7f7ebdffb640 1 -- 172.21.15.88:0/3986693464 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f7ec4083d70 con 0x7f7eb40047d0 2023-12-08T08:22:51.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.382+0000 7f7eccba0640 1 --2- 172.21.15.88:0/3986693464 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7eac0664a0 0x7f7eac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:51.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.382+0000 7f7eccba0640 1 --2- 172.21.15.88:0/3986693464 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7eac0664a0 0x7f7eac068960 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009ab0 tx=0x7f7eb80046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:51.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.386+0000 7f7ebdffb640 1 -- 172.21.15.88:0/3986693464 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7ec40513f0 con 0x7f7eb40047d0 2023-12-08T08:22:51.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.534+0000 7f7ece3a3640 1 -- 172.21.15.88:0/3986693464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ec80674b0 con 0x7f7eb40047d0 2023-12-08T08:22:51.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.534+0000 7f7ebdffb640 1 -- 172.21.15.88:0/3986693464 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+13093 (secure 0 0 0) 0x7f7ec4054a10 con 0x7f7eb40047d0 2023-12-08T08:22:51.541 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:51.541 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":60,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:22:50.207070+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:6835/604820378":"2023-12-09T08:22:47.192497+0000","172.21.15.148:6833/604820378":"2023-12-09T08:22:47.192497+0000","172.21.15.88:6837/4167133153":"2023-12-09T08:22:40.747080+0000","172.21.15.88:6835/4167133153":"2023-12-09T08:22:40.747080+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:22:51.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.538+0000 7f7ece3a3640 1 -- 172.21.15.88:0/3986693464 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7eac0664a0 msgr2=0x7f7eac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:51.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.538+0000 7f7ece3a3640 1 --2- 172.21.15.88:0/3986693464 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7eac0664a0 0x7f7eac068960 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009ab0 tx=0x7f7eb80046d0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.538+0000 7f7ece3a3640 1 -- 172.21.15.88:0/3986693464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7eb40047d0 msgr2=0x7f7ec814ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:51.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.538+0000 7f7ece3a3640 1 --2- 172.21.15.88:0/3986693464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7eb40047d0 0x7f7ec814ef50 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4007340 tx=0x7f7ec4007800 comp rx=0 tx=0).stop 2023-12-08T08:22:51.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.538+0000 7f7ece3a3640 1 -- 172.21.15.88:0/3986693464 shutdown_connections 2023-12-08T08:22:51.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.538+0000 7f7ece3a3640 1 --2- 172.21.15.88:0/3986693464 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7eac0664a0 0x7f7eac068960 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.538+0000 7f7ece3a3640 1 --2- 172.21.15.88:0/3986693464 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ec8158cc0 0x7f7ec81ece20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.538+0000 7f7ece3a3640 1 --2- 172.21.15.88:0/3986693464 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ec8158470 0x7f7ec81531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.538+0000 7f7ece3a3640 1 --2- 172.21.15.88:0/3986693464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7eb40047d0 0x7f7ec814ef50 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.538+0000 7f7ece3a3640 1 -- 172.21.15.88:0/3986693464 >> 172.21.15.88:0/3986693464 conn(0x7f7ec80ab730 msgr2=0x7f7ec8148100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:51.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.538+0000 7f7ece3a3640 1 -- 172.21.15.88:0/3986693464 shutdown_connections 2023-12-08T08:22:51.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.538+0000 7f7ece3a3640 1 -- 172.21.15.88:0/3986693464 wait complete. 2023-12-08T08:22:51.563 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:22:51.564 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:22:51.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.698+0000 7faa6dd85640 1 Processor -- start 2023-12-08T08:22:51.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.698+0000 7faa6dd85640 1 -- start start 2023-12-08T08:22:51.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa6dd85640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa6814f8f0 0x7faa680aac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:51.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa6dd85640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa681525e0 con 0x7faa681520e0 2023-12-08T08:22:51.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa6dd85640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa681528c0 con 0x7faa6806d990 2023-12-08T08:22:51.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa6dd85640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa68152ba0 con 0x7faa6814f8f0 2023-12-08T08:22:51.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa6d584640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7faa681520e0 0x7faa680c4240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51288/0 (socket says 172.21.15.88:51288) 2023-12-08T08:22:51.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa6d584640 1 -- 172.21.15.88:0/126497051 learned_addr learned my addr 172.21.15.88:0/126497051 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:51.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa5f7fe640 1 -- 172.21.15.88:0/126497051 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2002523505 0 0) 0x7faa681525e0 con 0x7faa681520e0 2023-12-08T08:22:51.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa6cd83640 1 --2- 172.21.15.88:0/126497051 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa6814f8f0 0x7faa680aac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:51.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa5f7fe640 1 -- 172.21.15.88:0/126497051 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa50003530 con 0x7faa681520e0 2023-12-08T08:22:51.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa5f7fe640 1 -- 172.21.15.88:0/126497051 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4111053819 0 0) 0x7faa50003530 con 0x7faa681520e0 2023-12-08T08:22:51.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa5f7fe640 1 -- 172.21.15.88:0/126497051 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa6814f8f0 msgr2=0x7faa680aac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:51.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa5f7fe640 1 --2- 172.21.15.88:0/126497051 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa6814f8f0 0x7faa680aac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa5f7fe640 1 -- 172.21.15.88:0/126497051 >> v1:172.21.15.148:6789/0 conn(0x7faa6806d990 legacy=0x7faa680c3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:51.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa5f7fe640 1 -- 172.21.15.88:0/126497051 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa68152e80 con 0x7faa681520e0 2023-12-08T08:22:51.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa5f7fe640 1 -- 172.21.15.88:0/126497051 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7faa60001a00 con 0x7faa681520e0 2023-12-08T08:22:51.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa5f7fe640 1 -- 172.21.15.88:0/126497051 >> v1:172.21.15.88:6789/0 conn(0x7faa681520e0 legacy=0x7faa680c4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:51.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa5f7fe640 1 --2- 172.21.15.88:0/126497051 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa500039b0 0x7faa50003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:51.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa5f7fe640 1 --2- 172.21.15.88:0/126497051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa500047d0 0x7faa50004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:51.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa5f7fe640 1 --2- 172.21.15.88:0/126497051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa50005190 0x7faa5000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:51.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa5f7fe640 1 -- 172.21.15.88:0/126497051 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa68152ba0 con 0x7faa50005190 2023-12-08T08:22:51.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa5f7fe640 1 -- 172.21.15.88:0/126497051 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5000c060 con 0x7faa500047d0 2023-12-08T08:22:51.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa5f7fe640 1 -- 172.21.15.88:0/126497051 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5000c220 con 0x7faa500039b0 2023-12-08T08:22:51.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa6cd83640 1 --2- 172.21.15.88:0/126497051 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa6814f8f0 0x7faa680aac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:51.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa6d584640 1 --2- 172.21.15.88:0/126497051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa50005190 0x7faa5000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:51.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa5ffff640 1 --2- 172.21.15.88:0/126497051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa500047d0 0x7faa50004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:51.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa6cd83640 1 --2- 172.21.15.88:0/126497051 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa500039b0 0x7faa50003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:51.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa6d584640 1 -- 172.21.15.88:0/126497051 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa500039b0 msgr2=0x7faa50003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:51.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa6d584640 1 --2- 172.21.15.88:0/126497051 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa500039b0 0x7faa50003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa6d584640 1 -- 172.21.15.88:0/126497051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa500047d0 msgr2=0x7faa50004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:51.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa6d584640 1 --2- 172.21.15.88:0/126497051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa500047d0 0x7faa50004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.702+0000 7faa6d584640 1 -- 172.21.15.88:0/126497051 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa50003530 con 0x7faa50005190 2023-12-08T08:22:51.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.706+0000 7faa6d584640 1 --2- 172.21.15.88:0/126497051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa50005190 0x7faa5000b990 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7faa68152510 tx=0x7faa6001d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47a6d6691627d91 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:51.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.706+0000 7faa5f7fe640 1 -- 172.21.15.88:0/126497051 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa600072d0 con 0x7faa50005190 2023-12-08T08:22:51.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.706+0000 7faa5f7fe640 1 -- 172.21.15.88:0/126497051 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa600a8070 con 0x7faa50005190 2023-12-08T08:22:51.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.706+0000 7faa5f7fe640 1 -- 172.21.15.88:0/126497051 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa600076b0 con 0x7faa50005190 2023-12-08T08:22:51.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.706+0000 7faa6dd85640 1 -- 172.21.15.88:0/126497051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa50005190 msgr2=0x7faa5000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:51.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.706+0000 7faa6dd85640 1 --2- 172.21.15.88:0/126497051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa50005190 0x7faa5000b990 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7faa68152510 tx=0x7faa6001d2e0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.706+0000 7faa6d584640 1 -- 172.21.15.88:0/126497051 reap_dead start 2023-12-08T08:22:51.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.706+0000 7faa6dd85640 1 -- 172.21.15.88:0/126497051 shutdown_connections 2023-12-08T08:22:51.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.706+0000 7faa6dd85640 1 -- 172.21.15.88:0/126497051 >> 172.21.15.88:0/126497051 conn(0x7faa680c2350 msgr2=0x7faa680c2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:51.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.706+0000 7faa6dd85640 1 -- 172.21.15.88:0/126497051 shutdown_connections 2023-12-08T08:22:51.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.706+0000 7faa6dd85640 1 -- 172.21.15.88:0/126497051 wait complete. 2023-12-08T08:22:51.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.706+0000 7faa6dd85640 1 Processor -- start 2023-12-08T08:22:51.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.706+0000 7faa6dd85640 1 -- start start 2023-12-08T08:22:51.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.710+0000 7faa6dd85640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa50005190 0x7faa680727e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:51.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.710+0000 7faa6dd85640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa68072290 0x7faa680aa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:51.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.710+0000 7faa6dd85640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa68071580 0x7faa68071a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:51.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.710+0000 7faa6dd85640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa681ecac0 con 0x7faa68072290 2023-12-08T08:22:51.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.710+0000 7faa6dd85640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa681ecd10 con 0x7faa68071580 2023-12-08T08:22:51.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.710+0000 7faa6dd85640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa681ecff0 con 0x7faa50005190 2023-12-08T08:22:51.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.710+0000 7faa5ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa68072290 0x7faa680aa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:51.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.710+0000 7faa5ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa68072290 0x7faa680aa5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60612/0 (socket says 172.21.15.88:60612) 2023-12-08T08:22:51.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.710+0000 7faa5ffff640 1 -- 172.21.15.88:0/476679584 learned_addr learned my addr 172.21.15.88:0/476679584 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:51.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.710+0000 7faa6cd83640 1 --2- 172.21.15.88:0/476679584 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa50005190 0x7faa680727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:51.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.710+0000 7faa6d584640 1 --2- 172.21.15.88:0/476679584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa68071580 0x7faa68071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:51.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.710+0000 7faa5ffff640 1 -- 172.21.15.88:0/476679584 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa50005190 msgr2=0x7faa680727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:51.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.710+0000 7faa5ffff640 1 --2- 172.21.15.88:0/476679584 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa50005190 0x7faa680727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.710+0000 7faa5ffff640 1 -- 172.21.15.88:0/476679584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa68071580 msgr2=0x7faa68071a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:51.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.710+0000 7faa5ffff640 1 --2- 172.21.15.88:0/476679584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa68071580 0x7faa68071a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.710+0000 7faa5ffff640 1 -- 172.21.15.88:0/476679584 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa681ed2d0 con 0x7faa68072290 2023-12-08T08:22:51.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.710+0000 7faa5ffff640 1 --2- 172.21.15.88:0/476679584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa68072290 0x7faa680aa5e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7faa5800f5f0 tx=0x7faa5800fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:51.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.710+0000 7faa5d7fa640 1 -- 172.21.15.88:0/476679584 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa580052e0 con 0x7faa68072290 2023-12-08T08:22:51.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.710+0000 7faa5d7fa640 1 -- 172.21.15.88:0/476679584 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa58005440 con 0x7faa68072290 2023-12-08T08:22:51.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.710+0000 7faa6dd85640 1 -- 172.21.15.88:0/476679584 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa681ed5b0 con 0x7faa68072290 2023-12-08T08:22:51.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.710+0000 7faa5d7fa640 1 -- 172.21.15.88:0/476679584 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58003840 con 0x7faa68072290 2023-12-08T08:22:51.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.710+0000 7faa6dd85640 1 -- 172.21.15.88:0/476679584 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa68071f40 con 0x7faa68072290 2023-12-08T08:22:51.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.710+0000 7faa6dd85640 1 -- 172.21.15.88:0/476679584 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa680674b0 con 0x7faa68072290 2023-12-08T08:22:51.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.710+0000 7faa5d7fa640 1 -- 172.21.15.88:0/476679584 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faa580039a0 con 0x7faa68072290 2023-12-08T08:22:51.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.714+0000 7faa5d7fa640 1 --2- 172.21.15.88:0/476679584 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faa54066470 0x7faa54068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:51.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.714+0000 7faa5d7fa640 1 -- 172.21.15.88:0/476679584 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7faa58083a00 con 0x7faa68072290 2023-12-08T08:22:51.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.714+0000 7faa6cd83640 1 --2- 172.21.15.88:0/476679584 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faa54066470 0x7faa54068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:51.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.714+0000 7faa6cd83640 1 --2- 172.21.15.88:0/476679584 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faa54066470 0x7faa54068930 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7faa64006e90 tx=0x7faa64008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:51.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.718+0000 7faa5d7fa640 1 -- 172.21.15.88:0/476679584 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faa58051110 con 0x7faa68072290 2023-12-08T08:22:51.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.882+0000 7faa6dd85640 1 -- 172.21.15.88:0/476679584 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faa6814e6a0 con 0x7faa68072290 2023-12-08T08:22:51.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.882+0000 7faa5d7fa640 1 -- 172.21.15.88:0/476679584 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7faa58054730 con 0x7faa68072290 2023-12-08T08:22:51.889 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:22:51.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.886+0000 7faa6dd85640 1 -- 172.21.15.88:0/476679584 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faa54066470 msgr2=0x7faa54068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:51.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.886+0000 7faa6dd85640 1 --2- 172.21.15.88:0/476679584 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faa54066470 0x7faa54068930 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7faa64006e90 tx=0x7faa64008040 comp rx=0 tx=0).stop 2023-12-08T08:22:51.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.886+0000 7faa6dd85640 1 -- 172.21.15.88:0/476679584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa68072290 msgr2=0x7faa680aa5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:51.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.886+0000 7faa6dd85640 1 --2- 172.21.15.88:0/476679584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa68072290 0x7faa680aa5e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7faa5800f5f0 tx=0x7faa5800fab0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.886+0000 7faa6dd85640 1 -- 172.21.15.88:0/476679584 shutdown_connections 2023-12-08T08:22:51.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.886+0000 7faa6dd85640 1 --2- 172.21.15.88:0/476679584 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7faa54066470 0x7faa54068930 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.886+0000 7faa6dd85640 1 --2- 172.21.15.88:0/476679584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa68071580 0x7faa68071a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.886+0000 7faa6dd85640 1 --2- 172.21.15.88:0/476679584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa68072290 0x7faa680aa5e0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.886+0000 7faa6dd85640 1 --2- 172.21.15.88:0/476679584 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faa50005190 0x7faa680727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:51.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.886+0000 7faa6dd85640 1 -- 172.21.15.88:0/476679584 >> 172.21.15.88:0/476679584 conn(0x7faa680c2350 msgr2=0x7faa680ab3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:51.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.886+0000 7faa6dd85640 1 -- 172.21.15.88:0/476679584 shutdown_connections 2023-12-08T08:22:51.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:51.886+0000 7faa6dd85640 1 -- 172.21.15.88:0/476679584 wait complete. 2023-12-08T08:22:51.910 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2023-12-08T08:22:52.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.042+0000 7fe7c2157640 1 Processor -- start 2023-12-08T08:22:52.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.042+0000 7fe7c2157640 1 -- start start 2023-12-08T08:22:52.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.042+0000 7fe7c2157640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe7bc06d2b0 0x7fe7bc06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:52.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.042+0000 7fe7c2157640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe7bc0c5300 0x7fe7bc06c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:52.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.042+0000 7fe7c2157640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7bc06bb80 con 0x7fe7bc0c3b80 2023-12-08T08:22:52.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.042+0000 7fe7c2157640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7bc06cc70 con 0x7fe7bc06d2b0 2023-12-08T08:22:52.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.042+0000 7fe7c2157640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7bc0c5790 con 0x7fe7bc0c5300 2023-12-08T08:22:52.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.042+0000 7fe7bb7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe7bc06d2b0 0x7fe7bc06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:52.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.042+0000 7fe7bb7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe7bc06d2b0 0x7fe7bc06d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60626/0 (socket says 172.21.15.88:60626) 2023-12-08T08:22:52.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.042+0000 7fe7bb7fe640 1 -- 172.21.15.88:0/2890226611 learned_addr learned my addr 172.21.15.88:0/2890226611 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:52.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.042+0000 7fe7bbfff640 1 --2- 172.21.15.88:0/2890226611 >> v2:172.21.15.148:3300/0 conn(0x7fe7bc0c5300 0x7fe7bc06c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:52.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.046+0000 7fe7bb7fe640 1 -- 172.21.15.88:0/2890226611 >> v2:172.21.15.148:3300/0 conn(0x7fe7bc0c5300 msgr2=0x7fe7bc06c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:52.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.046+0000 7fe7bb7fe640 1 --2- 172.21.15.88:0/2890226611 >> v2:172.21.15.148:3300/0 conn(0x7fe7bc0c5300 0x7fe7bc06c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:52.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.046+0000 7fe7bb7fe640 1 -- 172.21.15.88:0/2890226611 >> v1:172.21.15.148:6789/0 conn(0x7fe7bc0c3b80 legacy=0x7fe7bc06c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:52.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.046+0000 7fe7bb7fe640 1 -- 172.21.15.88:0/2890226611 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc1515c0 con 0x7fe7bc06d2b0 2023-12-08T08:22:52.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.046+0000 7fe7bb7fe640 1 --2- 172.21.15.88:0/2890226611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7bc06d2b0 0x7fe7bc06d690 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc06e3c0 tx=0x7fe7ac01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6fcb59235f93cbd server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:52.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.046+0000 7fe7baffd640 1 -- 172.21.15.88:0/2890226611 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac0aa5f0 con 0x7fe7bc06d2b0 2023-12-08T08:22:52.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.046+0000 7fe7baffd640 1 -- 172.21.15.88:0/2890226611 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac0aa750 con 0x7fe7bc06d2b0 2023-12-08T08:22:52.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.046+0000 7fe7baffd640 1 -- 172.21.15.88:0/2890226611 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac0aaae0 con 0x7fe7bc06d2b0 2023-12-08T08:22:52.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.050+0000 7fe7c2157640 1 -- 172.21.15.88:0/2890226611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7bc06d2b0 msgr2=0x7fe7bc06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:52.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.050+0000 7fe7c2157640 1 --2- 172.21.15.88:0/2890226611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7bc06d2b0 0x7fe7bc06d690 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc06e3c0 tx=0x7fe7ac01c490 comp rx=0 tx=0).stop 2023-12-08T08:22:52.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.050+0000 7fe7c2157640 1 -- 172.21.15.88:0/2890226611 shutdown_connections 2023-12-08T08:22:52.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.050+0000 7fe7c2157640 1 --2- 172.21.15.88:0/2890226611 >> v2:172.21.15.148:3300/0 conn(0x7fe7bc0c5300 0x7fe7bc06c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:52.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.050+0000 7fe7c2157640 1 --2- 172.21.15.88:0/2890226611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7bc06d2b0 0x7fe7bc06d690 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:52.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.050+0000 7fe7c2157640 1 -- 172.21.15.88:0/2890226611 >> 172.21.15.88:0/2890226611 conn(0x7fe7bc0a7810 msgr2=0x7fe7bc0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:52.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.050+0000 7fe7c2157640 1 -- 172.21.15.88:0/2890226611 shutdown_connections 2023-12-08T08:22:52.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.050+0000 7fe7c2157640 1 -- 172.21.15.88:0/2890226611 wait complete. 2023-12-08T08:22:52.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.050+0000 7fe7c2157640 1 Processor -- start 2023-12-08T08:22:52.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.050+0000 7fe7c2157640 1 -- start start 2023-12-08T08:22:52.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.050+0000 7fe7c2157640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7bc06d2b0 0x7fe7bc1eda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:52.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.050+0000 7fe7c2157640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7bc0c3b80 0x7fe7bc15a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:52.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.050+0000 7fe7c2157640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7bc0c5300 0x7fe7bc1f0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:52.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.050+0000 7fe7c2157640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc0ab7f0 con 0x7fe7bc0c5300 2023-12-08T08:22:52.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.050+0000 7fe7c2157640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc1ed5f0 con 0x7fe7bc06d2b0 2023-12-08T08:22:52.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.050+0000 7fe7c2157640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc1ecfc0 con 0x7fe7bc0c3b80 2023-12-08T08:22:52.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.050+0000 7fe7bbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7bc0c5300 0x7fe7bc1f0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:52.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.050+0000 7fe7bbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7bc0c5300 0x7fe7bc1f0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60628/0 (socket says 172.21.15.88:60628) 2023-12-08T08:22:52.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.050+0000 7fe7bbfff640 1 -- 172.21.15.88:0/2087508261 learned_addr learned my addr 172.21.15.88:0/2087508261 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:52.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.050+0000 7fe7bb7fe640 1 --2- 172.21.15.88:0/2087508261 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7bc06d2b0 0x7fe7bc1eda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:52.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.050+0000 7fe7b3fff640 1 --2- 172.21.15.88:0/2087508261 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7bc0c3b80 0x7fe7bc15a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:52.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.050+0000 7fe7bbfff640 1 -- 172.21.15.88:0/2087508261 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7bc0c3b80 msgr2=0x7fe7bc15a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:52.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.050+0000 7fe7bbfff640 1 --2- 172.21.15.88:0/2087508261 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7bc0c3b80 0x7fe7bc15a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:52.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.050+0000 7fe7bbfff640 1 -- 172.21.15.88:0/2087508261 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7bc06d2b0 msgr2=0x7fe7bc1eda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:52.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.050+0000 7fe7bbfff640 1 --2- 172.21.15.88:0/2087508261 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7bc06d2b0 0x7fe7bc1eda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:52.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.050+0000 7fe7bbfff640 1 -- 172.21.15.88:0/2087508261 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac0094d0 con 0x7fe7bc0c5300 2023-12-08T08:22:52.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.050+0000 7fe7bbfff640 1 --2- 172.21.15.88:0/2087508261 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7bc0c5300 0x7fe7bc1f0590 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4007cf0 tx=0x7fe7b400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:52.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.054+0000 7fe7b8ff9640 1 -- 172.21.15.88:0/2087508261 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4014420 con 0x7fe7bc0c5300 2023-12-08T08:22:52.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.054+0000 7fe7b8ff9640 1 -- 172.21.15.88:0/2087508261 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b40145a0 con 0x7fe7bc0c5300 2023-12-08T08:22:52.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.054+0000 7fe7c2157640 1 -- 172.21.15.88:0/2087508261 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7bc14ef80 con 0x7fe7bc0c5300 2023-12-08T08:22:52.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.054+0000 7fe7b8ff9640 1 -- 172.21.15.88:0/2087508261 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4014950 con 0x7fe7bc0c5300 2023-12-08T08:22:52.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.054+0000 7fe7c2157640 1 -- 172.21.15.88:0/2087508261 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7bc0a8ab0 con 0x7fe7bc0c5300 2023-12-08T08:22:52.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.054+0000 7fe7c2157640 1 -- 172.21.15.88:0/2087508261 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7bc1ed7a0 con 0x7fe7bc0c5300 2023-12-08T08:22:52.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.054+0000 7fe7b8ff9640 1 -- 172.21.15.88:0/2087508261 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe7b4014ab0 con 0x7fe7bc0c5300 2023-12-08T08:22:52.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.054+0000 7fe7b8ff9640 1 --2- 172.21.15.88:0/2087508261 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe79c066470 0x7fe79c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:52.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.054+0000 7fe7b8ff9640 1 -- 172.21.15.88:0/2087508261 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fe7b40842a0 con 0x7fe7bc0c5300 2023-12-08T08:22:52.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.054+0000 7fe7bb7fe640 1 --2- 172.21.15.88:0/2087508261 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe79c066470 0x7fe79c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:52.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.054+0000 7fe7bb7fe640 1 --2- 172.21.15.88:0/2087508261 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe79c066470 0x7fe79c068930 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac0ae000 tx=0x7fe7ac0b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:52.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.058+0000 7fe7b8ff9640 1 -- 172.21.15.88:0/2087508261 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe7bc1ed7a0 con 0x7fe7bc0c5300 2023-12-08T08:22:52.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:52.262+0000 7fe7c2157640 1 -- 172.21.15.88:0/2087508261 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7fe7bc1ed760 con 0x7fe7bc0c5300 2023-12-08T08:22:53.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.210+0000 7fe7b8ff9640 1 -- 172.21.15.88:0/2087508261 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v170) v1 ==== 162+0+0 (secure 0 0 0) 0x7fe7b4051a60 con 0x7fe7bc0c5300 2023-12-08T08:22:53.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.214+0000 7fe7c2157640 1 -- 172.21.15.88:0/2087508261 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe79c066470 msgr2=0x7fe79c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:53.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.214+0000 7fe7c2157640 1 --2- 172.21.15.88:0/2087508261 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe79c066470 0x7fe79c068930 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac0ae000 tx=0x7fe7ac0b5040 comp rx=0 tx=0).stop 2023-12-08T08:22:53.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.214+0000 7fe7c2157640 1 -- 172.21.15.88:0/2087508261 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7bc0c5300 msgr2=0x7fe7bc1f0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:53.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.214+0000 7fe7c2157640 1 --2- 172.21.15.88:0/2087508261 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7bc0c5300 0x7fe7bc1f0590 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4007cf0 tx=0x7fe7b400e4b0 comp rx=0 tx=0).stop 2023-12-08T08:22:53.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.214+0000 7fe7c2157640 1 -- 172.21.15.88:0/2087508261 shutdown_connections 2023-12-08T08:22:53.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.214+0000 7fe7c2157640 1 --2- 172.21.15.88:0/2087508261 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe79c066470 0x7fe79c068930 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:53.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.214+0000 7fe7c2157640 1 --2- 172.21.15.88:0/2087508261 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7bc0c5300 0x7fe7bc1f0590 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:53.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.214+0000 7fe7c2157640 1 --2- 172.21.15.88:0/2087508261 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe7bc0c3b80 0x7fe7bc15a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:53.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.214+0000 7fe7c2157640 1 --2- 172.21.15.88:0/2087508261 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7bc06d2b0 0x7fe7bc1eda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:53.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.214+0000 7fe7c2157640 1 -- 172.21.15.88:0/2087508261 >> 172.21.15.88:0/2087508261 conn(0x7fe7bc0a7810 msgr2=0x7fe7bc0c2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:53.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.214+0000 7fe7c2157640 1 -- 172.21.15.88:0/2087508261 shutdown_connections 2023-12-08T08:22:53.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.214+0000 7fe7c2157640 1 -- 172.21.15.88:0/2087508261 wait complete. 2023-12-08T08:22:53.241 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-08T08:22:53.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.378+0000 7f67f806b640 1 Processor -- start 2023-12-08T08:22:53.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.378+0000 7f67f806b640 1 -- start start 2023-12-08T08:22:53.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.378+0000 7f67f806b640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67f014fc30 0x7f67f00c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:53.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.378+0000 7f67f806b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f67f006d840 0x7f67f00c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:53.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.378+0000 7f67f806b640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f0152910 con 0x7f67f014f850 2023-12-08T08:22:53.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.378+0000 7f67f806b640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f00c2240 con 0x7f67f006d840 2023-12-08T08:22:53.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.378+0000 7f67f806b640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f0152bf0 con 0x7f67f014fc30 2023-12-08T08:22:53.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.378+0000 7f67f6608640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f67f006d840 0x7f67f00c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:53.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.378+0000 7f67f6608640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f67f006d840 0x7f67f00c4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60632/0 (socket says 172.21.15.88:60632) 2023-12-08T08:22:53.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.378+0000 7f67f6608640 1 -- 172.21.15.88:0/2473100225 learned_addr learned my addr 172.21.15.88:0/2473100225 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:53.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.378+0000 7f67f5606640 1 --2- 172.21.15.88:0/2473100225 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67f014fc30 0x7f67f00c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:53.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.378+0000 7f67f6608640 1 -- 172.21.15.88:0/2473100225 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67f014fc30 msgr2=0x7f67f00c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:53.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.378+0000 7f67f6608640 1 --2- 172.21.15.88:0/2473100225 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67f014fc30 0x7f67f00c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:53.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.378+0000 7f67f6608640 1 -- 172.21.15.88:0/2473100225 >> v1:172.21.15.148:6789/0 conn(0x7f67f014f850 legacy=0x7f67f00aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:53.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.378+0000 7f67f6608640 1 -- 172.21.15.88:0/2473100225 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f0152ed0 con 0x7f67f006d840 2023-12-08T08:22:53.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.382+0000 7f67f6608640 1 --2- 172.21.15.88:0/2473100225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f006d840 0x7f67f00c4210 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f67e8009e50 tx=0x7f67e801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c6dc5a443e58a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:53.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.382+0000 7f67f4e05640 1 -- 172.21.15.88:0/2473100225 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e80a5780 con 0x7f67f006d840 2023-12-08T08:22:53.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.382+0000 7f67f4e05640 1 -- 172.21.15.88:0/2473100225 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e80a58e0 con 0x7f67f006d840 2023-12-08T08:22:53.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.382+0000 7f67f4e05640 1 -- 172.21.15.88:0/2473100225 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e80a5c70 con 0x7f67f006d840 2023-12-08T08:22:53.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.382+0000 7f67f806b640 1 -- 172.21.15.88:0/2473100225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f006d840 msgr2=0x7f67f00c4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:53.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.382+0000 7f67f806b640 1 --2- 172.21.15.88:0/2473100225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f006d840 0x7f67f00c4210 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f67e8009e50 tx=0x7f67e801c9d0 comp rx=0 tx=0).stop 2023-12-08T08:22:53.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.382+0000 7f67f806b640 1 -- 172.21.15.88:0/2473100225 shutdown_connections 2023-12-08T08:22:53.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.382+0000 7f67f806b640 1 --2- 172.21.15.88:0/2473100225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f006d840 0x7f67f00c4210 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:53.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.382+0000 7f67f806b640 1 --2- 172.21.15.88:0/2473100225 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67f014fc30 0x7f67f00c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:53.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.382+0000 7f67f806b640 1 -- 172.21.15.88:0/2473100225 >> 172.21.15.88:0/2473100225 conn(0x7f67f00c59f0 msgr2=0x7f67f00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:53.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.382+0000 7f67f806b640 1 -- 172.21.15.88:0/2473100225 shutdown_connections 2023-12-08T08:22:53.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.382+0000 7f67f806b640 1 -- 172.21.15.88:0/2473100225 wait complete. 2023-12-08T08:22:53.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.386+0000 7f67f806b640 1 Processor -- start 2023-12-08T08:22:53.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.386+0000 7f67f806b640 1 -- start start 2023-12-08T08:22:53.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.386+0000 7f67f806b640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67f006d840 0x7f67f01f1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:53.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.386+0000 7f67f806b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67f014f850 0x7f67f01560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:53.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.386+0000 7f67f806b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f014fc30 0x7f67f015b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:53.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.386+0000 7f67f806b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f00a8c70 con 0x7f67f014fc30 2023-12-08T08:22:53.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.386+0000 7f67f806b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f01493c0 con 0x7f67f014f850 2023-12-08T08:22:53.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.386+0000 7f67f806b640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f0149610 con 0x7f67f006d840 2023-12-08T08:22:53.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.386+0000 7f67f6608640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f014fc30 0x7f67f015b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:53.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.386+0000 7f67f6608640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f014fc30 0x7f67f015b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60638/0 (socket says 172.21.15.88:60638) 2023-12-08T08:22:53.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.386+0000 7f67f6608640 1 -- 172.21.15.88:0/2715429306 learned_addr learned my addr 172.21.15.88:0/2715429306 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:53.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.386+0000 7f67f5e07640 1 --2- 172.21.15.88:0/2715429306 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67f006d840 0x7f67f01f1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:53.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.386+0000 7f67f5606640 1 --2- 172.21.15.88:0/2715429306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67f014f850 0x7f67f01560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:53.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.386+0000 7f67f6608640 1 -- 172.21.15.88:0/2715429306 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67f006d840 msgr2=0x7f67f01f1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:53.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.386+0000 7f67f6608640 1 --2- 172.21.15.88:0/2715429306 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67f006d840 0x7f67f01f1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:53.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.386+0000 7f67f6608640 1 -- 172.21.15.88:0/2715429306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67f014f850 msgr2=0x7f67f01560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:53.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.386+0000 7f67f6608640 1 --2- 172.21.15.88:0/2715429306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67f014f850 0x7f67f01560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:53.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.386+0000 7f67f6608640 1 -- 172.21.15.88:0/2715429306 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e8009b30 con 0x7f67f014fc30 2023-12-08T08:22:53.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.386+0000 7f67f6608640 1 --2- 172.21.15.88:0/2715429306 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f014fc30 0x7f67f015b3f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f67e80af040 tx=0x7f67e8019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:53.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.386+0000 7f67e67fc640 1 -- 172.21.15.88:0/2715429306 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e80b8670 con 0x7f67f014fc30 2023-12-08T08:22:53.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.386+0000 7f67e67fc640 1 -- 172.21.15.88:0/2715429306 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e80b87d0 con 0x7f67f014fc30 2023-12-08T08:22:53.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.386+0000 7f67e67fc640 1 -- 172.21.15.88:0/2715429306 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e80b8b80 con 0x7f67f014fc30 2023-12-08T08:22:53.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.386+0000 7f67f806b640 1 -- 172.21.15.88:0/2715429306 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f01f0e80 con 0x7f67f014fc30 2023-12-08T08:22:53.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.386+0000 7f67f806b640 1 -- 172.21.15.88:0/2715429306 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f01f1440 con 0x7f67f014fc30 2023-12-08T08:22:53.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.390+0000 7f67f806b640 1 -- 172.21.15.88:0/2715429306 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f0067630 con 0x7f67f014fc30 2023-12-08T08:22:53.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.390+0000 7f67e67fc640 1 -- 172.21.15.88:0/2715429306 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f67e80b8ce0 con 0x7f67f014fc30 2023-12-08T08:22:53.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.390+0000 7f67e67fc640 1 --2- 172.21.15.88:0/2715429306 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f67d4066470 0x7f67d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:53.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.390+0000 7f67e67fc640 1 -- 172.21.15.88:0/2715429306 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f67e811eff0 con 0x7f67f014fc30 2023-12-08T08:22:53.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.390+0000 7f67f5e07640 1 --2- 172.21.15.88:0/2715429306 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f67d4066470 0x7f67d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:53.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.390+0000 7f67f5e07640 1 --2- 172.21.15.88:0/2715429306 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f67d4066470 0x7f67d4068930 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f67f01ee9a0 tx=0x7f67ec007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:53.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.394+0000 7f67e67fc640 1 -- 172.21.15.88:0/2715429306 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f67e80ec7b0 con 0x7f67f014fc30 2023-12-08T08:22:53.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.542+0000 7f67f806b640 1 -- 172.21.15.88:0/2715429306 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f67f00a4a90 con 0x7f67f014fc30 2023-12-08T08:22:53.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.546+0000 7f67e67fc640 1 -- 172.21.15.88:0/2715429306 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f67e80bc0c0 con 0x7f67f014fc30 2023-12-08T08:22:53.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.550+0000 7f67f806b640 1 -- 172.21.15.88:0/2715429306 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f67d4066470 msgr2=0x7f67d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:53.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.550+0000 7f67f806b640 1 --2- 172.21.15.88:0/2715429306 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f67d4066470 0x7f67d4068930 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f67f01ee9a0 tx=0x7f67ec007e40 comp rx=0 tx=0).stop 2023-12-08T08:22:53.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.550+0000 7f67f806b640 1 -- 172.21.15.88:0/2715429306 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f014fc30 msgr2=0x7f67f015b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:53.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.550+0000 7f67f806b640 1 --2- 172.21.15.88:0/2715429306 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f014fc30 0x7f67f015b3f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f67e80af040 tx=0x7f67e8019770 comp rx=0 tx=0).stop 2023-12-08T08:22:53.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.550+0000 7f67f806b640 1 -- 172.21.15.88:0/2715429306 shutdown_connections 2023-12-08T08:22:53.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.550+0000 7f67f806b640 1 --2- 172.21.15.88:0/2715429306 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f67d4066470 0x7f67d4068930 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:53.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.550+0000 7f67f806b640 1 --2- 172.21.15.88:0/2715429306 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f014fc30 0x7f67f015b3f0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:53.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.550+0000 7f67f806b640 1 --2- 172.21.15.88:0/2715429306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67f014f850 0x7f67f01560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:53.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.550+0000 7f67f806b640 1 --2- 172.21.15.88:0/2715429306 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67f006d840 0x7f67f01f1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:53.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.550+0000 7f67f806b640 1 -- 172.21.15.88:0/2715429306 >> 172.21.15.88:0/2715429306 conn(0x7f67f00c59f0 msgr2=0x7f67f00c3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:53.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.550+0000 7f67f806b640 1 -- 172.21.15.88:0/2715429306 shutdown_connections 2023-12-08T08:22:53.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.550+0000 7f67f806b640 1 -- 172.21.15.88:0/2715429306 wait complete. 2023-12-08T08:22:53.574 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-08T08:22:53.574 DEBUG:teuthology.orchestra.run.smithi088:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:22:53.663 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:22:53.713 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-08T08:22:53.713 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:22:53.713 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:22:53.723 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5383 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-08T08:22:53.723 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:22:53.723 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:22:53.763 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354676k,nr_inodes=4088669,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9389 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-08T08:22:53.763 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-12-08T08:22:53.764 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:22:53.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.898+0000 7f08ab5aa640 1 Processor -- start 2023-12-08T08:22:53.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.898+0000 7f08ab5aa640 1 -- start start 2023-12-08T08:22:53.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.902+0000 7f08ab5aa640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f08a414fd10 0x7f08a40a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:53.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.902+0000 7f08ab5aa640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f08a40a5300 0x7f08a4071e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:53.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.902+0000 7f08ab5aa640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08a4072370 0x7f08a4156110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:53.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.902+0000 7f08ab5aa640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a406c5e0 con 0x7f08a40a5300 2023-12-08T08:22:53.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.902+0000 7f08ab5aa640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a40c5710 con 0x7f08a414fd10 2023-12-08T08:22:53.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.902+0000 7f08ab5aa640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a4155c80 con 0x7f08a4072370 2023-12-08T08:22:53.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.902+0000 7f08a8b45640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f08a40a5300 0x7f08a4071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:53.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.902+0000 7f08a8b45640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f08a40a5300 0x7f08a4071e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60648/0 (socket says 172.21.15.88:60648) 2023-12-08T08:22:53.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.902+0000 7f08a8b45640 1 -- 172.21.15.88:0/893020053 learned_addr learned my addr 172.21.15.88:0/893020053 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:53.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.902+0000 7f08a9b47640 1 --2- 172.21.15.88:0/893020053 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08a4072370 0x7f08a4156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:53.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.902+0000 7f08a9346640 1 --2- 172.21.15.88:0/893020053 >> v2:172.21.15.148:3300/0 conn(0x7f08a414fd10 0x7f08a40a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:53.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.902+0000 7f08a8b45640 1 -- 172.21.15.88:0/893020053 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08a4072370 msgr2=0x7f08a4156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:53.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.902+0000 7f08a8b45640 1 --2- 172.21.15.88:0/893020053 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08a4072370 0x7f08a4156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:53.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.902+0000 7f08a8b45640 1 -- 172.21.15.88:0/893020053 >> v2:172.21.15.148:3300/0 conn(0x7f08a414fd10 msgr2=0x7f08a40a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:53.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.902+0000 7f08a8b45640 1 --2- 172.21.15.88:0/893020053 >> v2:172.21.15.148:3300/0 conn(0x7f08a414fd10 0x7f08a40a4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:53.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.902+0000 7f08a8b45640 1 -- 172.21.15.88:0/893020053 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a40c4e70 con 0x7f08a40a5300 2023-12-08T08:22:53.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.902+0000 7f08a9346640 1 --2- 172.21.15.88:0/893020053 >> v2:172.21.15.148:3300/0 conn(0x7f08a414fd10 0x7f08a40a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:53.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.906+0000 7f08a8b45640 1 --2- 172.21.15.88:0/893020053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08a40a5300 0x7f08a4071e30 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f08a406b5a0 tx=0x7f089401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540954d9111eee86 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:53.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.906+0000 7f089bfff640 1 -- 172.21.15.88:0/893020053 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08940ab600 con 0x7f08a40a5300 2023-12-08T08:22:53.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.906+0000 7f089bfff640 1 -- 172.21.15.88:0/893020053 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08940a7050 con 0x7f08a40a5300 2023-12-08T08:22:53.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.906+0000 7f089bfff640 1 -- 172.21.15.88:0/893020053 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08940ab980 con 0x7f08a40a5300 2023-12-08T08:22:53.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.906+0000 7f08ab5aa640 1 -- 172.21.15.88:0/893020053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08a40a5300 msgr2=0x7f08a4071e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:53.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.906+0000 7f08ab5aa640 1 --2- 172.21.15.88:0/893020053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08a40a5300 0x7f08a4071e30 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f08a406b5a0 tx=0x7f089401c3b0 comp rx=0 tx=0).stop 2023-12-08T08:22:53.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.906+0000 7f08ab5aa640 1 -- 172.21.15.88:0/893020053 shutdown_connections 2023-12-08T08:22:53.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.906+0000 7f08ab5aa640 1 --2- 172.21.15.88:0/893020053 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08a4072370 0x7f08a4156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:53.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.906+0000 7f08ab5aa640 1 --2- 172.21.15.88:0/893020053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08a40a5300 0x7f08a4071e30 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:53.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.906+0000 7f08ab5aa640 1 --2- 172.21.15.88:0/893020053 >> v2:172.21.15.148:3300/0 conn(0x7f08a414fd10 0x7f08a40a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:53.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.906+0000 7f08ab5aa640 1 -- 172.21.15.88:0/893020053 >> 172.21.15.88:0/893020053 conn(0x7f08a40a7810 msgr2=0x7f08a40a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:53.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.906+0000 7f08ab5aa640 1 -- 172.21.15.88:0/893020053 shutdown_connections 2023-12-08T08:22:53.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.906+0000 7f08ab5aa640 1 -- 172.21.15.88:0/893020053 wait complete. 2023-12-08T08:22:53.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.906+0000 7f08ab5aa640 1 Processor -- start 2023-12-08T08:22:53.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.906+0000 7f08ab5aa640 1 -- start start 2023-12-08T08:22:53.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.910+0000 7f08ab5aa640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08a4072370 0x7f08a414e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:53.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.910+0000 7f08ab5aa640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08a40a5300 0x7f08a414c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:53.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.910+0000 7f08ab5aa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08a414fd10 0x7f08a414c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:53.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.910+0000 7f08ab5aa640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a40a4f30 con 0x7f08a414fd10 2023-12-08T08:22:53.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.910+0000 7f08ab5aa640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a40a8bc0 con 0x7f08a40a5300 2023-12-08T08:22:53.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.910+0000 7f08ab5aa640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a41ee210 con 0x7f08a4072370 2023-12-08T08:22:53.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.910+0000 7f08a9b47640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08a414fd10 0x7f08a414c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:53.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.910+0000 7f08a8b45640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08a40a5300 0x7f08a414c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:53.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.910+0000 7f08a9346640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08a4072370 0x7f08a414e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:53.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.910+0000 7f08a8b45640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08a40a5300 0x7f08a414c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:57508/0 (socket says 172.21.15.88:57508) 2023-12-08T08:22:53.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.910+0000 7f08a9b47640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08a414fd10 0x7f08a414c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60658/0 (socket says 172.21.15.88:60658) 2023-12-08T08:22:53.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.910+0000 7f08a8b45640 1 -- 172.21.15.88:0/205436967 learned_addr learned my addr 172.21.15.88:0/205436967 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:53.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.910+0000 7f08a9b47640 1 -- 172.21.15.88:0/205436967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08a4072370 msgr2=0x7f08a414e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:53.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.910+0000 7f08a9b47640 1 --2- 172.21.15.88:0/205436967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08a4072370 0x7f08a414e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:53.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.910+0000 7f08a9b47640 1 -- 172.21.15.88:0/205436967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08a40a5300 msgr2=0x7f08a414c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:53.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.910+0000 7f08a9b47640 1 --2- 172.21.15.88:0/205436967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08a40a5300 0x7f08a414c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:53.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.910+0000 7f08a9b47640 1 -- 172.21.15.88:0/205436967 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08940094d0 con 0x7f08a414fd10 2023-12-08T08:22:53.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.910+0000 7f08a8b45640 1 --2- 172.21.15.88:0/205436967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08a40a5300 0x7f08a414c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:22:53.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.910+0000 7f08a9b47640 1 --2- 172.21.15.88:0/205436967 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08a414fd10 0x7f08a414c6b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f089c007d40 tx=0x7f089c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:53.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.910+0000 7f0899ffb640 1 -- 172.21.15.88:0/205436967 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c018070 con 0x7f08a414fd10 2023-12-08T08:22:53.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.910+0000 7f0899ffb640 1 -- 172.21.15.88:0/205436967 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089c00ed70 con 0x7f08a414fd10 2023-12-08T08:22:53.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.910+0000 7f0899ffb640 1 -- 172.21.15.88:0/205436967 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c003bc0 con 0x7f08a414fd10 2023-12-08T08:22:53.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.910+0000 7f08ab5aa640 1 -- 172.21.15.88:0/205436967 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a41ee4f0 con 0x7f08a414fd10 2023-12-08T08:22:53.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.910+0000 7f08ab5aa640 1 -- 172.21.15.88:0/205436967 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a40a92c0 con 0x7f08a414fd10 2023-12-08T08:22:53.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.910+0000 7f08ab5aa640 1 -- 172.21.15.88:0/205436967 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a4146a00 con 0x7f08a414fd10 2023-12-08T08:22:53.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.910+0000 7f0899ffb640 1 -- 172.21.15.88:0/205436967 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f089c014420 con 0x7f08a414fd10 2023-12-08T08:22:53.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.914+0000 7f0899ffb640 1 --2- 172.21.15.88:0/205436967 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0888066470 0x7f0888068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:53.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.914+0000 7f0899ffb640 1 -- 172.21.15.88:0/205436967 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f089c083cf0 con 0x7f08a414fd10 2023-12-08T08:22:53.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.914+0000 7f08a9346640 1 --2- 172.21.15.88:0/205436967 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0888066470 0x7f0888068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:53.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.914+0000 7f08a9346640 1 --2- 172.21.15.88:0/205436967 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0888066470 0x7f0888068930 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f08a0006fd0 tx=0x7f08a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:53.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:53.918+0000 7f0899ffb640 1 -- 172.21.15.88:0/205436967 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f089c051420 con 0x7f08a414fd10 2023-12-08T08:22:54.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.098+0000 7f08ab5aa640 1 -- 172.21.15.88:0/205436967 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08a41ee6e0 con 0x7f08a414fd10 2023-12-08T08:22:54.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.098+0000 7f0899ffb640 1 -- 172.21.15.88:0/205436967 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+3699 (secure 0 0 0) 0x7f089c054a40 con 0x7f08a414fd10 2023-12-08T08:22:54.102 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:54.102 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":41,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5240,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/2576328340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2576328340},{"type":"v1","addr":"172.21.15.148:6834","nonce":2576328340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5626,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/1685449423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1685449423},{"type":"v1","addr":"172.21.15.88:6836","nonce":1685449423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5639,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/943975427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":943975427},{"type":"v1","addr":"172.21.15.148:6835","nonce":943975427}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6348,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/245978965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":245978965},{"type":"v1","addr":"172.21.15.88:6837","nonce":245978965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[]} 2023-12-08T08:22:54.103 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 41 2023-12-08T08:22:54.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.098+0000 7f08ab5aa640 1 -- 172.21.15.88:0/205436967 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0888066470 msgr2=0x7f0888068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:54.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.098+0000 7f08ab5aa640 1 --2- 172.21.15.88:0/205436967 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0888066470 0x7f0888068930 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f08a0006fd0 tx=0x7f08a0008040 comp rx=0 tx=0).stop 2023-12-08T08:22:54.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.098+0000 7f08ab5aa640 1 -- 172.21.15.88:0/205436967 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08a414fd10 msgr2=0x7f08a414c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:54.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.098+0000 7f08ab5aa640 1 --2- 172.21.15.88:0/205436967 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08a414fd10 0x7f08a414c6b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f089c007d40 tx=0x7f089c00e4b0 comp rx=0 tx=0).stop 2023-12-08T08:22:54.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.098+0000 7f08ab5aa640 1 -- 172.21.15.88:0/205436967 shutdown_connections 2023-12-08T08:22:54.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.098+0000 7f08ab5aa640 1 --2- 172.21.15.88:0/205436967 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f0888066470 0x7f0888068930 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:54.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.098+0000 7f08ab5aa640 1 --2- 172.21.15.88:0/205436967 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08a414fd10 0x7f08a414c6b0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:54.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.098+0000 7f08ab5aa640 1 --2- 172.21.15.88:0/205436967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08a40a5300 0x7f08a414c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:54.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.098+0000 7f08ab5aa640 1 --2- 172.21.15.88:0/205436967 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f08a4072370 0x7f08a414e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:54.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.098+0000 7f08ab5aa640 1 -- 172.21.15.88:0/205436967 >> 172.21.15.88:0/205436967 conn(0x7f08a40a7810 msgr2=0x7f08a40a6820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:54.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.098+0000 7f08ab5aa640 1 -- 172.21.15.88:0/205436967 shutdown_connections 2023-12-08T08:22:54.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.098+0000 7f08ab5aa640 1 -- 172.21.15.88:0/205436967 wait complete. 2023-12-08T08:22:54.123 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-08T08:22:54.123 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-08T08:22:54.123 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-08T08:22:54.124 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:22:54.124 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-08T08:22:54.124 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-08T08:22:54.124 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-08T08:22:54.124 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:22:54.124 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-08T08:22:54.124 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-08T08:22:54.125 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-08T08:22:54.125 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:22:54.125 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-08T08:22:54.125 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-08T08:22:54.125 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-08T08:22:54.125 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:22:54.138 INFO:tasks.ceph.mds.a:Stopped 2023-12-08T08:22:54.138 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-08T08:22:54.139 INFO:tasks.ceph.mds.c:Stopped 2023-12-08T08:22:54.139 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-08T08:22:54.140 INFO:tasks.ceph.mds.b:Stopped 2023-12-08T08:22:54.140 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-08T08:22:54.141 INFO:tasks.ceph.mds.d:Stopped 2023-12-08T08:22:54.142 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-08T08:22:54.189 INFO:tasks.ceph.mds.b:Started 2023-12-08T08:22:54.190 DEBUG:teuthology.parallel:result is None 2023-12-08T08:22:54.190 INFO:tasks.ceph.mds.a:Started 2023-12-08T08:22:54.191 DEBUG:teuthology.parallel:result is None 2023-12-08T08:22:54.191 INFO:tasks.ceph.mds.c:Started 2023-12-08T08:22:54.191 DEBUG:teuthology.parallel:result is None 2023-12-08T08:22:54.192 INFO:tasks.ceph.mds.d:Started 2023-12-08T08:22:54.192 DEBUG:teuthology.parallel:result is None 2023-12-08T08:22:54.193 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-08T08:22:54.278 INFO:tasks.ceph.mds.a.smithi088.stdout:starting mds.a at 2023-12-08T08:22:54.281 INFO:tasks.ceph.mds.b.smithi148.stdout:starting mds.b at 2023-12-08T08:22:54.281 INFO:tasks.ceph.mds.c.smithi088.stdout:starting mds.c at 2023-12-08T08:22:54.282 INFO:tasks.ceph.mds.d.smithi148.stdout:starting mds.d at 2023-12-08T08:22:54.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.334+0000 7f76d22c9640 1 Processor -- start 2023-12-08T08:22:54.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.334+0000 7f76d22c9640 1 -- start start 2023-12-08T08:22:54.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.334+0000 7f76d22c9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f76cc0bd4c0 0x7f76cc154e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:54.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.334+0000 7f76d22c9640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f76cc155900 0x7f76cc0c4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:54.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.334+0000 7f76d22c9640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76cc0ca400 con 0x7f76cc14b090 2023-12-08T08:22:54.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.334+0000 7f76d22c9640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76cc1553d0 con 0x7f76cc0bd4c0 2023-12-08T08:22:54.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.334+0000 7f76d22c9640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76cc0ca6e0 con 0x7f76cc155900 2023-12-08T08:22:54.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.338+0000 7f76cb7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f76cc0bd4c0 0x7f76cc154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:54.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.338+0000 7f76d0866640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f76cc155900 0x7f76cc0c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:54.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.338+0000 7f76cb7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f76cc0bd4c0 0x7f76cc154e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60706/0 (socket says 172.21.15.88:60706) 2023-12-08T08:22:54.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.338+0000 7f76d0866640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f76cc155900 0x7f76cc0c4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:57530/0 (socket says 172.21.15.88:57530) 2023-12-08T08:22:54.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.338+0000 7f76cbfff640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f76cc14b090 0x7f76cc1580c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:59578/0 (socket says 172.21.15.88:59578) 2023-12-08T08:22:54.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.338+0000 7f76d0866640 1 -- 172.21.15.88:0/4031769173 learned_addr learned my addr 172.21.15.88:0/4031769173 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:54.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.338+0000 7f76d0866640 1 -- 172.21.15.88:0/4031769173 >> v2:172.21.15.88:3300/0 conn(0x7f76cc0bd4c0 msgr2=0x7f76cc154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:54.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.338+0000 7f76d0866640 1 --2- 172.21.15.88:0/4031769173 >> v2:172.21.15.88:3300/0 conn(0x7f76cc0bd4c0 0x7f76cc154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:54.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.338+0000 7f76d0866640 1 -- 172.21.15.88:0/4031769173 >> v1:172.21.15.148:6789/0 conn(0x7f76cc14b090 legacy=0x7f76cc1580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:54.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.338+0000 7f76d0866640 1 -- 172.21.15.88:0/4031769173 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc0ca9c0 con 0x7f76cc155900 2023-12-08T08:22:54.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.338+0000 7f76d0866640 1 --2- 172.21.15.88:0/4031769173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76cc155900 0x7f76cc0c4720 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f76cc0c78f0 tx=0x7f76c401c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c74d07ec07556b24 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:54.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.338+0000 7f76caffd640 1 -- 172.21.15.88:0/4031769173 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c40a5770 con 0x7f76cc155900 2023-12-08T08:22:54.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.338+0000 7f76caffd640 1 -- 172.21.15.88:0/4031769173 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c40a58d0 con 0x7f76cc155900 2023-12-08T08:22:54.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.338+0000 7f76caffd640 1 -- 172.21.15.88:0/4031769173 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c40a5c60 con 0x7f76cc155900 2023-12-08T08:22:54.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.342+0000 7f76d22c9640 1 -- 172.21.15.88:0/4031769173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76cc155900 msgr2=0x7f76cc0c4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:54.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.342+0000 7f76d22c9640 1 --2- 172.21.15.88:0/4031769173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76cc155900 0x7f76cc0c4720 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f76cc0c78f0 tx=0x7f76c401c910 comp rx=0 tx=0).stop 2023-12-08T08:22:54.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.342+0000 7f76d22c9640 1 -- 172.21.15.88:0/4031769173 shutdown_connections 2023-12-08T08:22:54.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.342+0000 7f76d22c9640 1 --2- 172.21.15.88:0/4031769173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76cc155900 0x7f76cc0c4720 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:54.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.342+0000 7f76d22c9640 1 --2- 172.21.15.88:0/4031769173 >> v2:172.21.15.88:3300/0 conn(0x7f76cc0bd4c0 0x7f76cc154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:54.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.342+0000 7f76d22c9640 1 -- 172.21.15.88:0/4031769173 >> 172.21.15.88:0/4031769173 conn(0x7f76cc0666a0 msgr2=0x7f76cc066ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:54.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.342+0000 7f76d22c9640 1 -- 172.21.15.88:0/4031769173 shutdown_connections 2023-12-08T08:22:54.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.342+0000 7f76d22c9640 1 -- 172.21.15.88:0/4031769173 wait complete. 2023-12-08T08:22:54.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.342+0000 7f76d22c9640 1 Processor -- start 2023-12-08T08:22:54.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.342+0000 7f76d22c9640 1 -- start start 2023-12-08T08:22:54.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.342+0000 7f76d22c9640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76cc0bd4c0 0x7f76cc0c10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:54.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.342+0000 7f76d22c9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76cc14b090 0x7f76cc0c1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:54.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.342+0000 7f76d22c9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76cc155900 0x7f76cc149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:54.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.342+0000 7f76d22c9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc0c1df0 con 0x7f76cc14b090 2023-12-08T08:22:54.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.342+0000 7f76d22c9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc0af1e0 con 0x7f76cc155900 2023-12-08T08:22:54.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.342+0000 7f76d22c9640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc0ae5c0 con 0x7f76cc0bd4c0 2023-12-08T08:22:54.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.342+0000 7f76cb7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76cc14b090 0x7f76cc0c1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:54.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.342+0000 7f76cb7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76cc14b090 0x7f76cc0c1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60710/0 (socket says 172.21.15.88:60710) 2023-12-08T08:22:54.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.342+0000 7f76cb7fe640 1 -- 172.21.15.88:0/4060854012 learned_addr learned my addr 172.21.15.88:0/4060854012 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:54.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.342+0000 7f76cbfff640 1 --2- 172.21.15.88:0/4060854012 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76cc0bd4c0 0x7f76cc0c10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:54.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.342+0000 7f76d0866640 1 --2- 172.21.15.88:0/4060854012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76cc155900 0x7f76cc149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:54.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.346+0000 7f76cb7fe640 1 -- 172.21.15.88:0/4060854012 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76cc0bd4c0 msgr2=0x7f76cc0c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:54.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.346+0000 7f76cb7fe640 1 --2- 172.21.15.88:0/4060854012 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76cc0bd4c0 0x7f76cc0c10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:54.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.346+0000 7f76cb7fe640 1 -- 172.21.15.88:0/4060854012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76cc155900 msgr2=0x7f76cc149fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:54.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.346+0000 7f76cb7fe640 1 --2- 172.21.15.88:0/4060854012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76cc155900 0x7f76cc149fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:54.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.346+0000 7f76cb7fe640 1 -- 172.21.15.88:0/4060854012 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c4009b30 con 0x7f76cc14b090 2023-12-08T08:22:54.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.346+0000 7f76cb7fe640 1 --2- 172.21.15.88:0/4060854012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76cc14b090 0x7f76cc0c1610 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f76c000e900 tx=0x7f76c000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:54.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.346+0000 7f76c8ff9640 1 -- 172.21.15.88:0/4060854012 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c0009690 con 0x7f76cc14b090 2023-12-08T08:22:54.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.346+0000 7f76c8ff9640 1 -- 172.21.15.88:0/4060854012 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c000ca00 con 0x7f76cc14b090 2023-12-08T08:22:54.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.346+0000 7f76d22c9640 1 -- 172.21.15.88:0/4060854012 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76cc0ae810 con 0x7f76cc14b090 2023-12-08T08:22:54.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.346+0000 7f76c8ff9640 1 -- 172.21.15.88:0/4060854012 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c000cdb0 con 0x7f76cc14b090 2023-12-08T08:22:54.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.346+0000 7f76d22c9640 1 -- 172.21.15.88:0/4060854012 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76cc0af690 con 0x7f76cc14b090 2023-12-08T08:22:54.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.346+0000 7f76d22c9640 1 -- 172.21.15.88:0/4060854012 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76cc0c5630 con 0x7f76cc14b090 2023-12-08T08:22:54.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.346+0000 7f76c8ff9640 1 -- 172.21.15.88:0/4060854012 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f76c0013470 con 0x7f76cc14b090 2023-12-08T08:22:54.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.346+0000 7f76c8ff9640 1 --2- 172.21.15.88:0/4060854012 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f76b8066470 0x7f76b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:54.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.346+0000 7f76c8ff9640 1 -- 172.21.15.88:0/4060854012 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f76c0083d90 con 0x7f76cc14b090 2023-12-08T08:22:54.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.346+0000 7f76cbfff640 1 --2- 172.21.15.88:0/4060854012 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f76b8066470 0x7f76b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:54.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.350+0000 7f76cbfff640 1 --2- 172.21.15.88:0/4060854012 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f76b8066470 0x7f76b8068930 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f76bc000f70 tx=0x7f76bc007e50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:54.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.350+0000 7f76c8ff9640 1 -- 172.21.15.88:0/4060854012 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f76c0051550 con 0x7f76cc14b090 2023-12-08T08:22:54.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:54.510+0000 7f76d22c9640 1 -- 172.21.15.88:0/4060854012 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f76cc0af4f0 con 0x7f76cc14b090 2023-12-08T08:22:55.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.226+0000 7f76c8ff9640 1 -- 172.21.15.88:0/4060854012 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v62) v1 ==== 97+0+0 (secure 0 0 0) 0x7f76cc0af4f0 con 0x7f76cc14b090 2023-12-08T08:22:55.232 INFO:teuthology.orchestra.run.smithi088.stderr: removed all blocklist entries 2023-12-08T08:22:55.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.230+0000 7f76d22c9640 1 -- 172.21.15.88:0/4060854012 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f76b8066470 msgr2=0x7f76b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:55.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.230+0000 7f76d22c9640 1 --2- 172.21.15.88:0/4060854012 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f76b8066470 0x7f76b8068930 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f76bc000f70 tx=0x7f76bc007e50 comp rx=0 tx=0).stop 2023-12-08T08:22:55.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.230+0000 7f76d22c9640 1 -- 172.21.15.88:0/4060854012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76cc14b090 msgr2=0x7f76cc0c1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:55.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.230+0000 7f76d22c9640 1 --2- 172.21.15.88:0/4060854012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76cc14b090 0x7f76cc0c1610 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f76c000e900 tx=0x7f76c000edc0 comp rx=0 tx=0).stop 2023-12-08T08:22:55.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.230+0000 7f76d22c9640 1 -- 172.21.15.88:0/4060854012 shutdown_connections 2023-12-08T08:22:55.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.230+0000 7f76d22c9640 1 --2- 172.21.15.88:0/4060854012 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f76b8066470 0x7f76b8068930 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:55.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.230+0000 7f76d22c9640 1 --2- 172.21.15.88:0/4060854012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76cc155900 0x7f76cc149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:55.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.230+0000 7f76d22c9640 1 --2- 172.21.15.88:0/4060854012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76cc14b090 0x7f76cc0c1610 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:55.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.230+0000 7f76d22c9640 1 --2- 172.21.15.88:0/4060854012 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f76cc0bd4c0 0x7f76cc0c10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:55.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.230+0000 7f76d22c9640 1 -- 172.21.15.88:0/4060854012 >> 172.21.15.88:0/4060854012 conn(0x7f76cc0666a0 msgr2=0x7f76cc155dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:55.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.230+0000 7f76d22c9640 1 -- 172.21.15.88:0/4060854012 shutdown_connections 2023-12-08T08:22:55.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.230+0000 7f76d22c9640 1 -- 172.21.15.88:0/4060854012 wait complete. 2023-12-08T08:22:55.258 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-08T08:22:55.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.394+0000 7f4c20878640 1 Processor -- start 2023-12-08T08:22:55.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.394+0000 7f4c20878640 1 -- start start 2023-12-08T08:22:55.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.394+0000 7f4c20878640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4c1c151b40 0x7f4c1c0c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:55.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.394+0000 7f4c20878640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4c1c0c9f80 0x7f4c1c0ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:55.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.394+0000 7f4c20878640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c1c1584b0 con 0x7f4c1c157910 2023-12-08T08:22:55.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.394+0000 7f4c20878640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1c154320 con 0x7f4c1c0c9f80 2023-12-08T08:22:55.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.394+0000 7f4c20878640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1c1552f0 con 0x7f4c1c151b40 2023-12-08T08:22:55.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.394+0000 7f4c1a59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4c1c0c9f80 0x7f4c1c0ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:55.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.394+0000 7f4c1a59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4c1c0c9f80 0x7f4c1c0ca410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60720/0 (socket says 172.21.15.88:60720) 2023-12-08T08:22:55.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.394+0000 7f4c1a59c640 1 -- 172.21.15.88:0/3811013876 learned_addr learned my addr 172.21.15.88:0/3811013876 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:55.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.394+0000 7f4c1ad9d640 1 --2- 172.21.15.88:0/3811013876 >> v2:172.21.15.148:3300/0 conn(0x7f4c1c151b40 0x7f4c1c0c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:55.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.394+0000 7f4c1a59c640 1 -- 172.21.15.88:0/3811013876 >> v2:172.21.15.148:3300/0 conn(0x7f4c1c151b40 msgr2=0x7f4c1c0c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:55.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.394+0000 7f4c1a59c640 1 --2- 172.21.15.88:0/3811013876 >> v2:172.21.15.148:3300/0 conn(0x7f4c1c151b40 0x7f4c1c0c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:55.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.394+0000 7f4c1a59c640 1 -- 172.21.15.88:0/3811013876 >> v1:172.21.15.148:6789/0 conn(0x7f4c1c157910 legacy=0x7f4c1c157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:55.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.394+0000 7f4c1a59c640 1 -- 172.21.15.88:0/3811013876 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c154530 con 0x7f4c1c0c9f80 2023-12-08T08:22:55.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.398+0000 7f4c1a59c640 1 --2- 172.21.15.88:0/3811013876 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c1c0c9f80 0x7f4c1c0ca410 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c067230 tx=0x7f4c1001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2278ae87b8327053 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:55.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.398+0000 7f4c19d9b640 1 -- 172.21.15.88:0/3811013876 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c100ad680 con 0x7f4c1c0c9f80 2023-12-08T08:22:55.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.398+0000 7f4c19d9b640 1 -- 172.21.15.88:0/3811013876 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c100ad7e0 con 0x7f4c1c0c9f80 2023-12-08T08:22:55.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.398+0000 7f4c19d9b640 1 -- 172.21.15.88:0/3811013876 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c100adb70 con 0x7f4c1c0c9f80 2023-12-08T08:22:55.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.398+0000 7f4c20878640 1 -- 172.21.15.88:0/3811013876 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c1c0c9f80 msgr2=0x7f4c1c0ca410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:55.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.398+0000 7f4c20878640 1 --2- 172.21.15.88:0/3811013876 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c1c0c9f80 0x7f4c1c0ca410 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c067230 tx=0x7f4c1001c470 comp rx=0 tx=0).stop 2023-12-08T08:22:55.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.398+0000 7f4c20878640 1 -- 172.21.15.88:0/3811013876 shutdown_connections 2023-12-08T08:22:55.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.398+0000 7f4c20878640 1 --2- 172.21.15.88:0/3811013876 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c1c0c9f80 0x7f4c1c0ca410 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:55.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.398+0000 7f4c20878640 1 --2- 172.21.15.88:0/3811013876 >> v2:172.21.15.148:3300/0 conn(0x7f4c1c151b40 0x7f4c1c0c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:55.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.398+0000 7f4c20878640 1 -- 172.21.15.88:0/3811013876 >> 172.21.15.88:0/3811013876 conn(0x7f4c1c066470 msgr2=0x7f4c1c066880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:55.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.398+0000 7f4c20878640 1 -- 172.21.15.88:0/3811013876 shutdown_connections 2023-12-08T08:22:55.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.398+0000 7f4c20878640 1 -- 172.21.15.88:0/3811013876 wait complete. 2023-12-08T08:22:55.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.398+0000 7f4c20878640 1 Processor -- start 2023-12-08T08:22:55.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.402+0000 7f4c20878640 1 -- start start 2023-12-08T08:22:55.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.402+0000 7f4c20878640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c1c0c9f80 0x7f4c1c1497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:55.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.402+0000 7f4c20878640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c1c151b40 0x7f4c1c1f01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:55.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.402+0000 7f4c20878640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c1c157910 0x7f4c1c147f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:55.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.402+0000 7f4c20878640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c1f0ea0 con 0x7f4c1c0c9f80 2023-12-08T08:22:55.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.402+0000 7f4c20878640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c148e10 con 0x7f4c1c151b40 2023-12-08T08:22:55.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.402+0000 7f4c20878640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c1490f0 con 0x7f4c1c157910 2023-12-08T08:22:55.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.402+0000 7f4c1ad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c1c0c9f80 0x7f4c1c1497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:55.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.402+0000 7f4c1ad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c1c0c9f80 0x7f4c1c1497d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60722/0 (socket says 172.21.15.88:60722) 2023-12-08T08:22:55.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.402+0000 7f4c1ad9d640 1 -- 172.21.15.88:0/1278877247 learned_addr learned my addr 172.21.15.88:0/1278877247 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:55.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.402+0000 7f4c1a59c640 1 --2- 172.21.15.88:0/1278877247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c1c151b40 0x7f4c1c1f01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:55.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.402+0000 7f4c1b59e640 1 --2- 172.21.15.88:0/1278877247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c1c157910 0x7f4c1c147f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:55.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.402+0000 7f4c1ad9d640 1 -- 172.21.15.88:0/1278877247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c1c157910 msgr2=0x7f4c1c147f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:55.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.402+0000 7f4c1ad9d640 1 --2- 172.21.15.88:0/1278877247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c1c157910 0x7f4c1c147f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:55.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.402+0000 7f4c1ad9d640 1 -- 172.21.15.88:0/1278877247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c1c151b40 msgr2=0x7f4c1c1f01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:55.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.402+0000 7f4c1ad9d640 1 --2- 172.21.15.88:0/1278877247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c1c151b40 0x7f4c1c1f01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:55.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.402+0000 7f4c1ad9d640 1 -- 172.21.15.88:0/1278877247 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c100094d0 con 0x7f4c1c0c9f80 2023-12-08T08:22:55.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.402+0000 7f4c1ad9d640 1 --2- 172.21.15.88:0/1278877247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c1c0c9f80 0x7f4c1c1497d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c00e9b0 tx=0x7f4c0c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:55.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.402+0000 7f4c037fe640 1 -- 172.21.15.88:0/1278877247 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c0096b0 con 0x7f4c1c0c9f80 2023-12-08T08:22:55.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.402+0000 7f4c037fe640 1 -- 172.21.15.88:0/1278877247 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c00c9a0 con 0x7f4c1c0c9f80 2023-12-08T08:22:55.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.402+0000 7f4c20878640 1 -- 172.21.15.88:0/1278877247 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c1c1f0bc0 con 0x7f4c1c0c9f80 2023-12-08T08:22:55.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.402+0000 7f4c037fe640 1 -- 172.21.15.88:0/1278877247 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c00cd30 con 0x7f4c1c0c9f80 2023-12-08T08:22:55.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.402+0000 7f4c20878640 1 -- 172.21.15.88:0/1278877247 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c1c155920 con 0x7f4c1c0c9f80 2023-12-08T08:22:55.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.402+0000 7f4c20878640 1 -- 172.21.15.88:0/1278877247 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1c1492b0 con 0x7f4c1c0c9f80 2023-12-08T08:22:55.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.406+0000 7f4c037fe640 1 -- 172.21.15.88:0/1278877247 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4c0c013470 con 0x7f4c1c0c9f80 2023-12-08T08:22:55.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.406+0000 7f4c037fe640 1 --2- 172.21.15.88:0/1278877247 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4c08066470 0x7f4c08068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:55.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.406+0000 7f4c037fe640 1 -- 172.21.15.88:0/1278877247 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4c0c083db0 con 0x7f4c1c0c9f80 2023-12-08T08:22:55.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.406+0000 7f4c1a59c640 1 --2- 172.21.15.88:0/1278877247 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4c08066470 0x7f4c08068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:55.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.406+0000 7f4c1a59c640 1 --2- 172.21.15.88:0/1278877247 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4c08066470 0x7f4c08068930 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4c100af000 tx=0x7f4c100a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:55.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.410+0000 7f4c037fe640 1 -- 172.21.15.88:0/1278877247 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4c0c088070 con 0x7f4c1c0c9f80 2023-12-08T08:22:55.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.610+0000 7f4c20878640 1 -- 172.21.15.88:0/1278877247 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4c1c067bc0 con 0x7f4c1c0c9f80 2023-12-08T08:22:55.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.610+0000 7f4c037fe640 1 -- 172.21.15.88:0/1278877247 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5081 (secure 0 0 0) 0x7f4c0c017090 con 0x7f4c1c0c9f80 2023-12-08T08:22:55.614 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:55.614 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-08T08:22:55.614 INFO:teuthology.orchestra.run.smithi088.stdout: "auth_dump": [ 2023-12-08T08:22:55.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:22:55.614 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mds.a", 2023-12-08T08:22:55.614 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCJ0XJloTK6HRAAu8n+gz+R9g+apHf4wBCxeQ==", 2023-12-08T08:22:55.614 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:22:55.614 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-12-08T08:22:55.614 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2023-12-08T08:22:55.614 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2023-12-08T08:22:55.615 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:22:55.615 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:22:55.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:22:55.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:22:55.615 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mds.b", 2023-12-08T08:22:55.615 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCJ0XJlrbnLKRAAO9XhdXDMFK67UwNQyAt2gg==", 2023-12-08T08:22:55.615 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:22:55.615 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-12-08T08:22:55.615 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2023-12-08T08:22:55.615 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2023-12-08T08:22:55.615 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:22:55.615 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:22:55.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:22:55.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:22:55.615 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mds.c", 2023-12-08T08:22:55.616 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCJ0XJlDhLZJBAACSOMzN+IeMzMVLNekOe7dw==", 2023-12-08T08:22:55.617 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:22:55.617 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-12-08T08:22:55.617 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2023-12-08T08:22:55.617 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2023-12-08T08:22:55.617 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:22:55.617 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:22:55.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:22:55.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:22:55.618 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mds.d", 2023-12-08T08:22:55.618 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCJ0XJlWdgsMRAAuaC4T6rzN3zYLCszue26tw==", 2023-12-08T08:22:55.618 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:22:55.618 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-12-08T08:22:55.618 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2023-12-08T08:22:55.618 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2023-12-08T08:22:55.618 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:22:55.618 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:22:55.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:22:55.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:22:55.618 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.0", 2023-12-08T08:22:55.618 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCM0XJlWUyMOxAA6Q7lleuO31iXvAYMe7LWNw==", 2023-12-08T08:22:55.618 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:22:55.618 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-12-08T08:22:55.619 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-12-08T08:22:55.619 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:22:55.619 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:22:55.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:22:55.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:22:55.619 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.1", 2023-12-08T08:22:55.619 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCQ0XJlc0EeBxAA+a5ftRhbAX9Re+hWg9dLsQ==", 2023-12-08T08:22:55.619 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:22:55.619 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-12-08T08:22:55.619 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-12-08T08:22:55.619 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:22:55.619 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:22:55.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:22:55.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:22:55.619 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.2", 2023-12-08T08:22:55.620 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCT0XJlZAYzDRAAXGdagNNhMTiFIzHDaKgFQg==", 2023-12-08T08:22:55.620 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:22:55.620 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-12-08T08:22:55.620 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-12-08T08:22:55.620 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:22:55.620 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:22:55.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:22:55.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:22:55.620 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.3", 2023-12-08T08:22:55.620 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCW0XJlGa+gExAA/BQ9Po66U86hYML+eMjuUQ==", 2023-12-08T08:22:55.620 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:22:55.620 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-12-08T08:22:55.620 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-12-08T08:22:55.620 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:22:55.620 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:22:55.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:22:55.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:22:55.621 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.4", 2023-12-08T08:22:55.621 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCc0XJlvrSlHxAAEabqt1NzUyyON8/eGwqo1Q==", 2023-12-08T08:22:55.621 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:22:55.621 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-12-08T08:22:55.621 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-12-08T08:22:55.621 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:22:55.621 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:22:55.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:22:55.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:22:55.621 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.5", 2023-12-08T08:22:55.621 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCf0XJl0W+8JRAA8Twf/r3v6rJWcXMfLT0LCA==", 2023-12-08T08:22:55.621 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:22:55.621 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-12-08T08:22:55.622 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-12-08T08:22:55.622 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:22:55.622 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:22:55.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:22:55.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:22:55.622 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.6", 2023-12-08T08:22:55.622 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCi0XJljGjUKxAAOgrH0WvuIwuzZsgOki/fsA==", 2023-12-08T08:22:55.622 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:22:55.622 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-12-08T08:22:55.622 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-12-08T08:22:55.622 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:22:55.622 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:22:55.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:22:55.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:22:55.623 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.7", 2023-12-08T08:22:55.623 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCl0XJl5NI2MhAA2zOJ9DGnD4JtXTfmVjgkmw==", 2023-12-08T08:22:55.623 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:22:55.623 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-12-08T08:22:55.623 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-12-08T08:22:55.623 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:22:55.623 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:22:55.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:22:55.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:22:55.623 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.0", 2023-12-08T08:22:55.623 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCJ0XJlCC1UNRAARGaNCoJFAvsCcXsQY6BjFg==", 2023-12-08T08:22:55.623 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:22:55.623 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-12-08T08:22:55.623 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow r", 2023-12-08T08:22:55.624 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-08T08:22:55.624 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:22:55.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:22:55.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:22:55.624 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.1", 2023-12-08T08:22:55.624 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCJ0XJld2rjOBAAUnEIBuqXHktNpqFW/Ikf7g==", 2023-12-08T08:22:55.624 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:22:55.624 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-12-08T08:22:55.624 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow r", 2023-12-08T08:22:55.624 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow rw pool=cephfs2_data" 2023-12-08T08:22:55.624 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:22:55.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:22:55.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:22:55.624 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.admin", 2023-12-08T08:22:55.624 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCJ0XJl5zt3ARAACqokMwcpmbL/boyr7vMJvw==", 2023-12-08T08:22:55.624 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:22:55.625 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow *", 2023-12-08T08:22:55.625 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2023-12-08T08:22:55.625 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2023-12-08T08:22:55.625 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:22:55.625 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:22:55.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:22:55.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:22:55.625 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.testuser", 2023-12-08T08:22:55.625 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQBF0nJlSEvLFxAAmepyVlOnp/++jz37PCSPvA==", 2023-12-08T08:22:55.625 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:22:55.625 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow rw fsname=cephfs", 2023-12-08T08:22:55.625 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow rw fsname=cephfs, allow rw fsname=cephfs2", 2023-12-08T08:22:55.625 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-12-08T08:22:55.625 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:22:55.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:22:55.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:22:55.626 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mgr.x", 2023-12-08T08:22:55.626 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCJ0XJl4fEwGRAA7AYI8JM8WALXPX5s5d4ybg==", 2023-12-08T08:22:55.626 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:22:55.626 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow *", 2023-12-08T08:22:55.626 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile mgr", 2023-12-08T08:22:55.626 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:22:55.626 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:22:55.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:22:55.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:22:55.626 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mgr.y", 2023-12-08T08:22:55.626 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCJ0XJlIJRaFRAALL9eP2riyJXD1ZixzxpiWw==", 2023-12-08T08:22:55.626 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-12-08T08:22:55.626 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow *", 2023-12-08T08:22:55.626 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile mgr", 2023-12-08T08:22:55.626 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-12-08T08:22:55.627 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:22:55.627 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:22:55.627 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-12-08T08:22:55.627 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-08T08:22:55.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.610+0000 7f4c20878640 1 -- 172.21.15.88:0/1278877247 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4c08066470 msgr2=0x7f4c08068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:55.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.610+0000 7f4c20878640 1 --2- 172.21.15.88:0/1278877247 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4c08066470 0x7f4c08068930 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4c100af000 tx=0x7f4c100a7000 comp rx=0 tx=0).stop 2023-12-08T08:22:55.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.610+0000 7f4c20878640 1 -- 172.21.15.88:0/1278877247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c1c0c9f80 msgr2=0x7f4c1c1497d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:55.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.610+0000 7f4c20878640 1 --2- 172.21.15.88:0/1278877247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c1c0c9f80 0x7f4c1c1497d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c00e9b0 tx=0x7f4c0c00ee70 comp rx=0 tx=0).stop 2023-12-08T08:22:55.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.610+0000 7f4c20878640 1 -- 172.21.15.88:0/1278877247 shutdown_connections 2023-12-08T08:22:55.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.610+0000 7f4c20878640 1 --2- 172.21.15.88:0/1278877247 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4c08066470 0x7f4c08068930 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:55.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.610+0000 7f4c20878640 1 --2- 172.21.15.88:0/1278877247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c1c157910 0x7f4c1c147f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:55.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.610+0000 7f4c20878640 1 --2- 172.21.15.88:0/1278877247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c1c151b40 0x7f4c1c1f01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:55.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.610+0000 7f4c20878640 1 --2- 172.21.15.88:0/1278877247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c1c0c9f80 0x7f4c1c1497d0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:55.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.610+0000 7f4c20878640 1 -- 172.21.15.88:0/1278877247 >> 172.21.15.88:0/1278877247 conn(0x7f4c1c066470 msgr2=0x7f4c1c066850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:55.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.610+0000 7f4c20878640 1 -- 172.21.15.88:0/1278877247 shutdown_connections 2023-12-08T08:22:55.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.610+0000 7f4c20878640 1 -- 172.21.15.88:0/1278877247 wait complete. 2023-12-08T08:22:55.634 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2023-12-08T08:22:55.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.766+0000 7fce34d10640 1 Processor -- start 2023-12-08T08:22:55.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.766+0000 7fce34d10640 1 -- start start 2023-12-08T08:22:55.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce34d10640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce300c8730 0x7fce301580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:55.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce34d10640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce300c54d0 con 0x7fce30070230 2023-12-08T08:22:55.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce34d10640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce300c6120 con 0x7fce300728f0 2023-12-08T08:22:55.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce34d10640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce30158710 con 0x7fce300c8730 2023-12-08T08:22:55.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce2f7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fce30070230 0x7fce300a6e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51300/0 (socket says 172.21.15.88:51300) 2023-12-08T08:22:55.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce2f7fe640 1 -- 172.21.15.88:0/1286885949 learned_addr learned my addr 172.21.15.88:0/1286885949 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:55.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce2e7fc640 1 -- 172.21.15.88:0/1286885949 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 459195258 0 0) 0x7fce300c54d0 con 0x7fce30070230 2023-12-08T08:22:55.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce2e7fc640 1 -- 172.21.15.88:0/1286885949 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce18003530 con 0x7fce30070230 2023-12-08T08:22:55.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce2ffff640 1 --2- 172.21.15.88:0/1286885949 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce300c8730 0x7fce301580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:55.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce2e7fc640 1 -- 172.21.15.88:0/1286885949 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2908329535 0 0) 0x7fce18003530 con 0x7fce30070230 2023-12-08T08:22:55.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce2e7fc640 1 -- 172.21.15.88:0/1286885949 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce300c8730 msgr2=0x7fce301580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:55.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce2e7fc640 1 --2- 172.21.15.88:0/1286885949 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce300c8730 0x7fce301580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:55.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce2e7fc640 1 -- 172.21.15.88:0/1286885949 >> v1:172.21.15.148:6789/0 conn(0x7fce300728f0 legacy=0x7fce30157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:55.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce2e7fc640 1 -- 172.21.15.88:0/1286885949 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce300c1ad0 con 0x7fce30070230 2023-12-08T08:22:55.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce2e7fc640 1 -- 172.21.15.88:0/1286885949 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7fce20001680 con 0x7fce30070230 2023-12-08T08:22:55.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce2e7fc640 1 -- 172.21.15.88:0/1286885949 >> v1:172.21.15.88:6789/0 conn(0x7fce30070230 legacy=0x7fce300a6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:55.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce2e7fc640 1 --2- 172.21.15.88:0/1286885949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce180039b0 0x7fce18003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:55.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce2e7fc640 1 --2- 172.21.15.88:0/1286885949 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce300c8730 0x7fce180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:55.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce2e7fc640 1 --2- 172.21.15.88:0/1286885949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce18004d10 0x7fce18005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:55.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce2e7fc640 1 -- 172.21.15.88:0/1286885949 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce30158710 con 0x7fce18004d10 2023-12-08T08:22:55.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce2e7fc640 1 -- 172.21.15.88:0/1286885949 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1800bb20 con 0x7fce180039b0 2023-12-08T08:22:55.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce2e7fc640 1 -- 172.21.15.88:0/1286885949 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1800bce0 con 0x7fce300c8730 2023-12-08T08:22:55.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce2ffff640 1 --2- 172.21.15.88:0/1286885949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce18004d10 0x7fce18005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:55.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce2effd640 1 --2- 172.21.15.88:0/1286885949 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce300c8730 0x7fce180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:55.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce2f7fe640 1 --2- 172.21.15.88:0/1286885949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce180039b0 0x7fce18003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:55.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce2ffff640 1 -- 172.21.15.88:0/1286885949 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce300c8730 msgr2=0x7fce180047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:55.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce2ffff640 1 --2- 172.21.15.88:0/1286885949 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce300c8730 0x7fce180047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:55.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce2ffff640 1 -- 172.21.15.88:0/1286885949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce180039b0 msgr2=0x7fce18003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:55.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce2ffff640 1 --2- 172.21.15.88:0/1286885949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce180039b0 0x7fce18003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:55.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.770+0000 7fce2ffff640 1 -- 172.21.15.88:0/1286885949 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce18003530 con 0x7fce18004d10 2023-12-08T08:22:55.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.774+0000 7fce2ffff640 1 --2- 172.21.15.88:0/1286885949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce18004d10 0x7fce18005190 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fce28009f90 tx=0x7fce2801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987b22da167008f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:55.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.774+0000 7fce2e7fc640 1 -- 172.21.15.88:0/1286885949 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce280a5c30 con 0x7fce18004d10 2023-12-08T08:22:55.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.774+0000 7fce2e7fc640 1 -- 172.21.15.88:0/1286885949 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2800f040 con 0x7fce18004d10 2023-12-08T08:22:55.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.774+0000 7fce2e7fc640 1 -- 172.21.15.88:0/1286885949 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce280ad440 con 0x7fce18004d10 2023-12-08T08:22:55.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.774+0000 7fce34d10640 1 -- 172.21.15.88:0/1286885949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce18004d10 msgr2=0x7fce18005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:55.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.774+0000 7fce34d10640 1 --2- 172.21.15.88:0/1286885949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce18004d10 0x7fce18005190 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fce28009f90 tx=0x7fce2801cc20 comp rx=0 tx=0).stop 2023-12-08T08:22:55.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.774+0000 7fce2ffff640 1 -- 172.21.15.88:0/1286885949 reap_dead start 2023-12-08T08:22:55.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.774+0000 7fce34d10640 1 -- 172.21.15.88:0/1286885949 shutdown_connections 2023-12-08T08:22:55.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.774+0000 7fce34d10640 1 -- 172.21.15.88:0/1286885949 >> 172.21.15.88:0/1286885949 conn(0x7fce300c7af0 msgr2=0x7fce300c7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:55.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.774+0000 7fce34d10640 1 -- 172.21.15.88:0/1286885949 shutdown_connections 2023-12-08T08:22:55.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.774+0000 7fce34d10640 1 -- 172.21.15.88:0/1286885949 wait complete. 2023-12-08T08:22:55.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.774+0000 7fce34d10640 1 Processor -- start 2023-12-08T08:22:55.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.774+0000 7fce34d10640 1 -- start start 2023-12-08T08:22:55.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.778+0000 7fce34d10640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce18004d10 0x7fce301ea100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:55.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.778+0000 7fce34d10640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce301461d0 0x7fce30145830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:55.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.778+0000 7fce34d10640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce30145d70 0x7fce30154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:55.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.778+0000 7fce34d10640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce301520d0 con 0x7fce18004d10 2023-12-08T08:22:55.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.778+0000 7fce34d10640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce301522e0 con 0x7fce30145d70 2023-12-08T08:22:55.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.778+0000 7fce34d10640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce301525c0 con 0x7fce301461d0 2023-12-08T08:22:55.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.778+0000 7fce2f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce18004d10 0x7fce301ea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:55.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.778+0000 7fce2f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce18004d10 0x7fce301ea100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60736/0 (socket says 172.21.15.88:60736) 2023-12-08T08:22:55.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.778+0000 7fce2f7fe640 1 -- 172.21.15.88:0/1741067116 learned_addr learned my addr 172.21.15.88:0/1741067116 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:55.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.778+0000 7fce2effd640 1 --2- 172.21.15.88:0/1741067116 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce301461d0 0x7fce30145830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:55.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.778+0000 7fce2ffff640 1 --2- 172.21.15.88:0/1741067116 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce30145d70 0x7fce30154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:55.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.778+0000 7fce2f7fe640 1 -- 172.21.15.88:0/1741067116 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce301461d0 msgr2=0x7fce30145830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:55.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.778+0000 7fce2f7fe640 1 --2- 172.21.15.88:0/1741067116 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce301461d0 0x7fce30145830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:55.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.778+0000 7fce2f7fe640 1 -- 172.21.15.88:0/1741067116 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce30145d70 msgr2=0x7fce30154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:55.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.778+0000 7fce2f7fe640 1 --2- 172.21.15.88:0/1741067116 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce30145d70 0x7fce30154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:55.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.778+0000 7fce2f7fe640 1 -- 172.21.15.88:0/1741067116 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce301528a0 con 0x7fce18004d10 2023-12-08T08:22:55.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.778+0000 7fce2ffff640 1 --2- 172.21.15.88:0/1741067116 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce30145d70 0x7fce30154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:55.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.778+0000 7fce2f7fe640 1 --2- 172.21.15.88:0/1741067116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce18004d10 0x7fce301ea100 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fce20012510 tx=0x7fce200129d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:55.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.778+0000 7fce17fff640 1 -- 172.21.15.88:0/1741067116 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce20014810 con 0x7fce18004d10 2023-12-08T08:22:55.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.778+0000 7fce17fff640 1 -- 172.21.15.88:0/1741067116 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce20014990 con 0x7fce18004d10 2023-12-08T08:22:55.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.778+0000 7fce34d10640 1 -- 172.21.15.88:0/1741067116 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce30152b80 con 0x7fce18004d10 2023-12-08T08:22:55.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.778+0000 7fce17fff640 1 -- 172.21.15.88:0/1741067116 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce20014d40 con 0x7fce18004d10 2023-12-08T08:22:55.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.778+0000 7fce34d10640 1 -- 172.21.15.88:0/1741067116 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce301eab70 con 0x7fce18004d10 2023-12-08T08:22:55.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.778+0000 7fce34d10640 1 -- 172.21.15.88:0/1741067116 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce300674b0 con 0x7fce18004d10 2023-12-08T08:22:55.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.778+0000 7fce17fff640 1 -- 172.21.15.88:0/1741067116 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fce20016480 con 0x7fce18004d10 2023-12-08T08:22:55.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.782+0000 7fce17fff640 1 --2- 172.21.15.88:0/1741067116 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fce1c0664a0 0x7fce1c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:55.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.782+0000 7fce17fff640 1 -- 172.21.15.88:0/1741067116 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fce200870e0 con 0x7fce18004d10 2023-12-08T08:22:55.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.782+0000 7fce2effd640 1 --2- 172.21.15.88:0/1741067116 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fce1c0664a0 0x7fce1c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:55.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.782+0000 7fce2effd640 1 --2- 172.21.15.88:0/1741067116 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fce1c0664a0 0x7fce1c068960 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fce30150dc0 tx=0x7fce24009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:55.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.786+0000 7fce17fff640 1 -- 172.21.15.88:0/1741067116 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fce200548a0 con 0x7fce18004d10 2023-12-08T08:22:55.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.990+0000 7fce34d10640 1 -- 172.21.15.88:0/1741067116 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7fce3006b2a0 con 0x7fce18004d10 2023-12-08T08:22:55.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.994+0000 7fce17fff640 1 -- 172.21.15.88:0/1741067116 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v18) v1 ==== 85+0+0 (secure 0 0 0) 0x7fce3006b2a0 con 0x7fce18004d10 2023-12-08T08:22:56.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.994+0000 7fce34d10640 1 -- 172.21.15.88:0/1741067116 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fce1c0664a0 msgr2=0x7fce1c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:56.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.994+0000 7fce34d10640 1 --2- 172.21.15.88:0/1741067116 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fce1c0664a0 0x7fce1c068960 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fce30150dc0 tx=0x7fce24009040 comp rx=0 tx=0).stop 2023-12-08T08:22:56.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.994+0000 7fce34d10640 1 -- 172.21.15.88:0/1741067116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce18004d10 msgr2=0x7fce301ea100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:56.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.994+0000 7fce34d10640 1 --2- 172.21.15.88:0/1741067116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce18004d10 0x7fce301ea100 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fce20012510 tx=0x7fce200129d0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.994+0000 7fce34d10640 1 -- 172.21.15.88:0/1741067116 shutdown_connections 2023-12-08T08:22:56.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.994+0000 7fce34d10640 1 --2- 172.21.15.88:0/1741067116 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fce1c0664a0 0x7fce1c068960 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.994+0000 7fce34d10640 1 --2- 172.21.15.88:0/1741067116 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce30145d70 0x7fce30154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.994+0000 7fce34d10640 1 --2- 172.21.15.88:0/1741067116 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fce301461d0 0x7fce30145830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.994+0000 7fce34d10640 1 --2- 172.21.15.88:0/1741067116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce18004d10 0x7fce301ea100 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.994+0000 7fce34d10640 1 -- 172.21.15.88:0/1741067116 >> 172.21.15.88:0/1741067116 conn(0x7fce300c7af0 msgr2=0x7fce3006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:56.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.994+0000 7fce34d10640 1 -- 172.21.15.88:0/1741067116 shutdown_connections 2023-12-08T08:22:56.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:55.994+0000 7fce34d10640 1 -- 172.21.15.88:0/1741067116 wait complete. 2023-12-08T08:22:56.019 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:22:56.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.150+0000 7fa999cfe640 1 Processor -- start 2023-12-08T08:22:56.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.150+0000 7fa999cfe640 1 -- start start 2023-12-08T08:22:56.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.154+0000 7fa999cfe640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa994071e30 0x7fa9940722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:56.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.154+0000 7fa999cfe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa994156110 0x7fa994156580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:56.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.154+0000 7fa999cfe640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9940c5710 con 0x7fa99414fd10 2023-12-08T08:22:56.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.154+0000 7fa999cfe640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99406c5e0 con 0x7fa994156110 2023-12-08T08:22:56.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.154+0000 7fa999cfe640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa994155c80 con 0x7fa994071e30 2023-12-08T08:22:56.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.154+0000 7fa993fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa994156110 0x7fa994156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:56.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.154+0000 7fa993fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa994156110 0x7fa994156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60740/0 (socket says 172.21.15.88:60740) 2023-12-08T08:22:56.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.154+0000 7fa993fff640 1 -- 172.21.15.88:0/1296404560 learned_addr learned my addr 172.21.15.88:0/1296404560 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:56.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.154+0000 7fa992ffd640 1 --2- 172.21.15.88:0/1296404560 >> v2:172.21.15.148:3300/0 conn(0x7fa994071e30 0x7fa9940722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:56.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.154+0000 7fa993fff640 1 -- 172.21.15.88:0/1296404560 >> v2:172.21.15.148:3300/0 conn(0x7fa994071e30 msgr2=0x7fa9940722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:56.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.154+0000 7fa993fff640 1 --2- 172.21.15.88:0/1296404560 >> v2:172.21.15.148:3300/0 conn(0x7fa994071e30 0x7fa9940722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.154+0000 7fa993fff640 1 -- 172.21.15.88:0/1296404560 >> v1:172.21.15.148:6789/0 conn(0x7fa99414fd10 legacy=0x7fa9940a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:56.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.154+0000 7fa993fff640 1 -- 172.21.15.88:0/1296404560 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9940c4e70 con 0x7fa994156110 2023-12-08T08:22:56.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.158+0000 7fa993fff640 1 --2- 172.21.15.88:0/1296404560 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa994156110 0x7fa994156580 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fa994066e30 tx=0x7fa98c01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a77951947dd34b67 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:56.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.158+0000 7fa9927fc640 1 -- 172.21.15.88:0/1296404560 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c0a5770 con 0x7fa994156110 2023-12-08T08:22:56.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.158+0000 7fa9927fc640 1 -- 172.21.15.88:0/1296404560 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98c0a58d0 con 0x7fa994156110 2023-12-08T08:22:56.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.158+0000 7fa9927fc640 1 -- 172.21.15.88:0/1296404560 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c0a5c60 con 0x7fa994156110 2023-12-08T08:22:56.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.158+0000 7fa999cfe640 1 -- 172.21.15.88:0/1296404560 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa994156110 msgr2=0x7fa994156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:56.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.158+0000 7fa999cfe640 1 --2- 172.21.15.88:0/1296404560 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa994156110 0x7fa994156580 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fa994066e30 tx=0x7fa98c01c8b0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.158+0000 7fa999cfe640 1 -- 172.21.15.88:0/1296404560 shutdown_connections 2023-12-08T08:22:56.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.158+0000 7fa999cfe640 1 --2- 172.21.15.88:0/1296404560 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa994156110 0x7fa994156580 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.158+0000 7fa999cfe640 1 --2- 172.21.15.88:0/1296404560 >> v2:172.21.15.148:3300/0 conn(0x7fa994071e30 0x7fa9940722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.158+0000 7fa999cfe640 1 -- 172.21.15.88:0/1296404560 >> 172.21.15.88:0/1296404560 conn(0x7fa9940a7810 msgr2=0x7fa9940a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:56.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.158+0000 7fa999cfe640 1 -- 172.21.15.88:0/1296404560 shutdown_connections 2023-12-08T08:22:56.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.158+0000 7fa999cfe640 1 -- 172.21.15.88:0/1296404560 wait complete. 2023-12-08T08:22:56.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.158+0000 7fa999cfe640 1 Processor -- start 2023-12-08T08:22:56.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.158+0000 7fa999cfe640 1 -- start start 2023-12-08T08:22:56.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.162+0000 7fa999cfe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa994071e30 0x7fa994070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:56.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.162+0000 7fa999cfe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa99414fd10 0x7fa99414be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:56.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.162+0000 7fa999cfe640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa994156110 0x7fa994152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:56.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.162+0000 7fa999cfe640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99415ccb0 con 0x7fa99414fd10 2023-12-08T08:22:56.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.162+0000 7fa999cfe640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9940a9fe0 con 0x7fa994071e30 2023-12-08T08:22:56.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.162+0000 7fa999cfe640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9940aa2c0 con 0x7fa994156110 2023-12-08T08:22:56.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.162+0000 7fa992ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa99414fd10 0x7fa99414be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:56.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.162+0000 7fa992ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa99414fd10 0x7fa99414be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60748/0 (socket says 172.21.15.88:60748) 2023-12-08T08:22:56.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.162+0000 7fa992ffd640 1 -- 172.21.15.88:0/299142687 learned_addr learned my addr 172.21.15.88:0/299142687 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:56.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.162+0000 7fa9937fe640 1 --2- 172.21.15.88:0/299142687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa994071e30 0x7fa994070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:56.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.162+0000 7fa993fff640 1 --2- 172.21.15.88:0/299142687 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa994156110 0x7fa994152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:56.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.162+0000 7fa992ffd640 1 -- 172.21.15.88:0/299142687 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa994156110 msgr2=0x7fa994152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:56.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.162+0000 7fa992ffd640 1 --2- 172.21.15.88:0/299142687 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa994156110 0x7fa994152310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.162+0000 7fa992ffd640 1 -- 172.21.15.88:0/299142687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa994071e30 msgr2=0x7fa994070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:56.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.162+0000 7fa992ffd640 1 --2- 172.21.15.88:0/299142687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa994071e30 0x7fa994070ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.162+0000 7fa992ffd640 1 -- 172.21.15.88:0/299142687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98c009b30 con 0x7fa99414fd10 2023-12-08T08:22:56.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.162+0000 7fa992ffd640 1 --2- 172.21.15.88:0/299142687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa99414fd10 0x7fa99414be30 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fa98800d5f0 tx=0x7fa98800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:56.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.162+0000 7fa97bfff640 1 -- 172.21.15.88:0/299142687 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9880125f0 con 0x7fa99414fd10 2023-12-08T08:22:56.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.162+0000 7fa97bfff640 1 -- 172.21.15.88:0/299142687 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa988012750 con 0x7fa99414fd10 2023-12-08T08:22:56.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.162+0000 7fa999cfe640 1 -- 172.21.15.88:0/299142687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9941f0540 con 0x7fa99414fd10 2023-12-08T08:22:56.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.162+0000 7fa97bfff640 1 -- 172.21.15.88:0/299142687 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa988012ae0 con 0x7fa99414fd10 2023-12-08T08:22:56.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.162+0000 7fa999cfe640 1 -- 172.21.15.88:0/299142687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9941f0b00 con 0x7fa99414fd10 2023-12-08T08:22:56.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.162+0000 7fa999cfe640 1 -- 172.21.15.88:0/299142687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9941f0cc0 con 0x7fa99414fd10 2023-12-08T08:22:56.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.162+0000 7fa97bfff640 1 -- 172.21.15.88:0/299142687 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa988012c40 con 0x7fa99414fd10 2023-12-08T08:22:56.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.166+0000 7fa97bfff640 1 --2- 172.21.15.88:0/299142687 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa980066470 0x7fa980068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:56.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.166+0000 7fa97bfff640 1 -- 172.21.15.88:0/299142687 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa988083ff0 con 0x7fa99414fd10 2023-12-08T08:22:56.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.166+0000 7fa9937fe640 1 --2- 172.21.15.88:0/299142687 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa980066470 0x7fa980068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:56.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.166+0000 7fa9937fe640 1 --2- 172.21.15.88:0/299142687 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa980066470 0x7fa980068930 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa984007fd0 tx=0x7fa984009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:56.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.170+0000 7fa97bfff640 1 -- 172.21.15.88:0/299142687 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa988051750 con 0x7fa99414fd10 2023-12-08T08:22:56.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.326+0000 7fa999cfe640 1 -- 172.21.15.88:0/299142687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9941f03a0 con 0x7fa99414fd10 2023-12-08T08:22:56.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.326+0000 7fa97bfff640 1 -- 172.21.15.88:0/299142687 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+12834 (secure 0 0 0) 0x7fa9941f03a0 con 0x7fa99414fd10 2023-12-08T08:22:56.331 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:56.331 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":64,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:22:55.239690+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:22:56.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.326+0000 7fa999cfe640 1 -- 172.21.15.88:0/299142687 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa980066470 msgr2=0x7fa980068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:56.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.326+0000 7fa999cfe640 1 --2- 172.21.15.88:0/299142687 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa980066470 0x7fa980068930 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa984007fd0 tx=0x7fa984009040 comp rx=0 tx=0).stop 2023-12-08T08:22:56.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.326+0000 7fa999cfe640 1 -- 172.21.15.88:0/299142687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa99414fd10 msgr2=0x7fa99414be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:56.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.326+0000 7fa999cfe640 1 --2- 172.21.15.88:0/299142687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa99414fd10 0x7fa99414be30 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fa98800d5f0 tx=0x7fa98800dab0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.326+0000 7fa999cfe640 1 -- 172.21.15.88:0/299142687 shutdown_connections 2023-12-08T08:22:56.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.326+0000 7fa999cfe640 1 --2- 172.21.15.88:0/299142687 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa980066470 0x7fa980068930 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.326+0000 7fa999cfe640 1 --2- 172.21.15.88:0/299142687 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa994156110 0x7fa994152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.326+0000 7fa999cfe640 1 --2- 172.21.15.88:0/299142687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa99414fd10 0x7fa99414be30 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.326+0000 7fa999cfe640 1 --2- 172.21.15.88:0/299142687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa994071e30 0x7fa994070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.326+0000 7fa999cfe640 1 -- 172.21.15.88:0/299142687 >> 172.21.15.88:0/299142687 conn(0x7fa9940a7810 msgr2=0x7fa9941552a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:56.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.330+0000 7fa999cfe640 1 -- 172.21.15.88:0/299142687 shutdown_connections 2023-12-08T08:22:56.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.330+0000 7fa999cfe640 1 -- 172.21.15.88:0/299142687 wait complete. 2023-12-08T08:22:56.352 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:22:56.352 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:22:56.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.490+0000 7f55c611c640 1 Processor -- start 2023-12-08T08:22:56.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.490+0000 7f55c611c640 1 -- start start 2023-12-08T08:22:56.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.490+0000 7f55c611c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f55c014e2a0 0x7f55c01516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:56.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.490+0000 7f55c611c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f55c00a98e0 0x7f55c006bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:56.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.490+0000 7f55c611c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c0151210 con 0x7f55c00a9460 2023-12-08T08:22:56.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.490+0000 7f55c611c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c014e680 con 0x7f55c00a98e0 2023-12-08T08:22:56.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.490+0000 7f55c611c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c0150be0 con 0x7f55c014e2a0 2023-12-08T08:22:56.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.490+0000 7f55bffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f55c00a98e0 0x7f55c006bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:56.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.490+0000 7f55beffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f55c00a9460 0x7f55c00c4180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51308/0 (socket says 172.21.15.88:51308) 2023-12-08T08:22:56.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.490+0000 7f55beffd640 1 -- 172.21.15.88:0/1991985029 learned_addr learned my addr 172.21.15.88:0/1991985029 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:56.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.490+0000 7f55bf7fe640 1 --2- 172.21.15.88:0/1991985029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f55c014e2a0 0x7f55c01516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:56.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.490+0000 7f55bffff640 1 -- 172.21.15.88:0/1991985029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f55c014e2a0 msgr2=0x7f55c01516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:56.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.490+0000 7f55bffff640 1 --2- 172.21.15.88:0/1991985029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f55c014e2a0 0x7f55c01516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.490+0000 7f55bffff640 1 -- 172.21.15.88:0/1991985029 >> v1:172.21.15.88:6789/0 conn(0x7f55c00a9460 legacy=0x7f55c00c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:56.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.490+0000 7f55bffff640 1 -- 172.21.15.88:0/1991985029 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c00c53c0 con 0x7f55c00a98e0 2023-12-08T08:22:56.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.490+0000 7f55be7fc640 1 -- 172.21.15.88:0/1991985029 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3542142194 0 0) 0x7f55c0151210 con 0x7f55c00a9460 2023-12-08T08:22:56.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.494+0000 7f55bffff640 1 --2- 172.21.15.88:0/1991985029 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c00a98e0 0x7f55c006bc80 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f55b8009d90 tx=0x7f55b801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945a8dfeb8d8ec6e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:56.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.494+0000 7f55be7fc640 1 -- 172.21.15.88:0/1991985029 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b80a5790 con 0x7f55c00a98e0 2023-12-08T08:22:56.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.494+0000 7f55be7fc640 1 -- 172.21.15.88:0/1991985029 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b80a58f0 con 0x7f55c00a98e0 2023-12-08T08:22:56.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.494+0000 7f55be7fc640 1 -- 172.21.15.88:0/1991985029 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b80a5c80 con 0x7f55c00a98e0 2023-12-08T08:22:56.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.494+0000 7f55c611c640 1 -- 172.21.15.88:0/1991985029 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c00a98e0 msgr2=0x7f55c006bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:56.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.494+0000 7f55c611c640 1 --2- 172.21.15.88:0/1991985029 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c00a98e0 0x7f55c006bc80 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f55b8009d90 tx=0x7f55b801c950 comp rx=0 tx=0).stop 2023-12-08T08:22:56.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.494+0000 7f55c611c640 1 -- 172.21.15.88:0/1991985029 shutdown_connections 2023-12-08T08:22:56.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.494+0000 7f55c611c640 1 --2- 172.21.15.88:0/1991985029 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c00a98e0 0x7f55c006bc80 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.494+0000 7f55c611c640 1 --2- 172.21.15.88:0/1991985029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f55c014e2a0 0x7f55c01516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.494+0000 7f55c611c640 1 -- 172.21.15.88:0/1991985029 >> 172.21.15.88:0/1991985029 conn(0x7f55c00c59f0 msgr2=0x7f55c00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:56.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.494+0000 7f55c611c640 1 -- 172.21.15.88:0/1991985029 shutdown_connections 2023-12-08T08:22:56.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.494+0000 7f55c611c640 1 -- 172.21.15.88:0/1991985029 wait complete. 2023-12-08T08:22:56.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.494+0000 7f55c611c640 1 Processor -- start 2023-12-08T08:22:56.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.498+0000 7f55c611c640 1 -- start start 2023-12-08T08:22:56.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.498+0000 7f55c611c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c00a9460 0x7f55c00c1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:56.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.498+0000 7f55c611c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55c00a98e0 0x7f55c0148e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:56.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.498+0000 7f55c611c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f55c014e2a0 0x7f55c01493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:56.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.498+0000 7f55c611c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c00c1d90 con 0x7f55c00a9460 2023-12-08T08:22:56.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.498+0000 7f55c611c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c00c08d0 con 0x7f55c00a98e0 2023-12-08T08:22:56.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.498+0000 7f55c611c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c00c2fb0 con 0x7f55c014e2a0 2023-12-08T08:22:56.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.498+0000 7f55bf7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c00a9460 0x7f55c00c1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:56.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.498+0000 7f55bf7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c00a9460 0x7f55c00c1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60758/0 (socket says 172.21.15.88:60758) 2023-12-08T08:22:56.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.498+0000 7f55bf7fe640 1 -- 172.21.15.88:0/239649885 learned_addr learned my addr 172.21.15.88:0/239649885 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:56.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.498+0000 7f55bffff640 1 --2- 172.21.15.88:0/239649885 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f55c014e2a0 0x7f55c01493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:56.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.498+0000 7f55beffd640 1 --2- 172.21.15.88:0/239649885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55c00a98e0 0x7f55c0148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:56.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.498+0000 7f55bf7fe640 1 -- 172.21.15.88:0/239649885 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f55c014e2a0 msgr2=0x7f55c01493a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:56.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.498+0000 7f55bf7fe640 1 --2- 172.21.15.88:0/239649885 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f55c014e2a0 0x7f55c01493a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.498+0000 7f55bf7fe640 1 -- 172.21.15.88:0/239649885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55c00a98e0 msgr2=0x7f55c0148e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:56.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.498+0000 7f55bf7fe640 1 --2- 172.21.15.88:0/239649885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55c00a98e0 0x7f55c0148e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.498+0000 7f55bf7fe640 1 -- 172.21.15.88:0/239649885 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b8009a70 con 0x7f55c00a9460 2023-12-08T08:22:56.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.498+0000 7f55beffd640 1 --2- 172.21.15.88:0/239649885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55c00a98e0 0x7f55c0148e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:56.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.498+0000 7f55bf7fe640 1 --2- 172.21.15.88:0/239649885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c00a9460 0x7f55c00c1290 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f55b000d6d0 tx=0x7f55b000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:56.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.498+0000 7f55a7fff640 1 -- 172.21.15.88:0/239649885 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b0007900 con 0x7f55c00a9460 2023-12-08T08:22:56.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.498+0000 7f55a7fff640 1 -- 172.21.15.88:0/239649885 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b0007a60 con 0x7f55c00a9460 2023-12-08T08:22:56.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.498+0000 7f55a7fff640 1 -- 172.21.15.88:0/239649885 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b0007df0 con 0x7f55c00a9460 2023-12-08T08:22:56.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.498+0000 7f55c611c640 1 -- 172.21.15.88:0/239649885 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c00c3250 con 0x7f55c00a9460 2023-12-08T08:22:56.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.498+0000 7f55c611c640 1 -- 172.21.15.88:0/239649885 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c00c05f0 con 0x7f55c00a9460 2023-12-08T08:22:56.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.498+0000 7f55c611c640 1 -- 172.21.15.88:0/239649885 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c0067630 con 0x7f55c00a9460 2023-12-08T08:22:56.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.502+0000 7f55a7fff640 1 -- 172.21.15.88:0/239649885 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f55b0011460 con 0x7f55c00a9460 2023-12-08T08:22:56.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.502+0000 7f55a7fff640 1 --2- 172.21.15.88:0/239649885 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f55ac066470 0x7f55ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:56.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.502+0000 7f55a7fff640 1 -- 172.21.15.88:0/239649885 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f55b0083d50 con 0x7f55c00a9460 2023-12-08T08:22:56.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.502+0000 7f55beffd640 1 --2- 172.21.15.88:0/239649885 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f55ac066470 0x7f55ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:56.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.502+0000 7f55beffd640 1 --2- 172.21.15.88:0/239649885 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f55ac066470 0x7f55ac068930 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f55c00a6e60 tx=0x7f55b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:56.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.506+0000 7f55a7fff640 1 -- 172.21.15.88:0/239649885 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f55b0087030 con 0x7f55c00a9460 2023-12-08T08:22:56.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.654+0000 7f55c611c640 1 -- 172.21.15.88:0/239649885 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f55c00c5100 con 0x7f55c00a9460 2023-12-08T08:22:56.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.654+0000 7f55a7fff640 1 -- 172.21.15.88:0/239649885 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7f55b00515b0 con 0x7f55c00a9460 2023-12-08T08:22:56.660 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:22:56.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.658+0000 7f55c611c640 1 -- 172.21.15.88:0/239649885 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f55ac066470 msgr2=0x7f55ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:56.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.658+0000 7f55c611c640 1 --2- 172.21.15.88:0/239649885 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f55ac066470 0x7f55ac068930 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f55c00a6e60 tx=0x7f55b4009040 comp rx=0 tx=0).stop 2023-12-08T08:22:56.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.658+0000 7f55c611c640 1 -- 172.21.15.88:0/239649885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c00a9460 msgr2=0x7f55c00c1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:56.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.658+0000 7f55c611c640 1 --2- 172.21.15.88:0/239649885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c00a9460 0x7f55c00c1290 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f55b000d6d0 tx=0x7f55b000db90 comp rx=0 tx=0).stop 2023-12-08T08:22:56.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.658+0000 7f55c611c640 1 -- 172.21.15.88:0/239649885 shutdown_connections 2023-12-08T08:22:56.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.658+0000 7f55c611c640 1 --2- 172.21.15.88:0/239649885 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f55ac066470 0x7f55ac068930 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.658+0000 7f55c611c640 1 --2- 172.21.15.88:0/239649885 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f55c014e2a0 0x7f55c01493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.658+0000 7f55c611c640 1 --2- 172.21.15.88:0/239649885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55c00a98e0 0x7f55c0148e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.658+0000 7f55c611c640 1 --2- 172.21.15.88:0/239649885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c00a9460 0x7f55c00c1290 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.658+0000 7f55c611c640 1 -- 172.21.15.88:0/239649885 >> 172.21.15.88:0/239649885 conn(0x7f55c00c59f0 msgr2=0x7f55c00bed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:56.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.658+0000 7f55c611c640 1 -- 172.21.15.88:0/239649885 shutdown_connections 2023-12-08T08:22:56.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.658+0000 7f55c611c640 1 -- 172.21.15.88:0/239649885 wait complete. 2023-12-08T08:22:56.681 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-08T08:22:56.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.814+0000 7f2a0d85a640 1 Processor -- start 2023-12-08T08:22:56.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.814+0000 7f2a0d85a640 1 -- start start 2023-12-08T08:22:56.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.814+0000 7f2a0d85a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2a0806d2b0 0x7f2a0806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:56.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.814+0000 7f2a0d85a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2a080c3b80 0x7f2a080c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:56.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.814+0000 7f2a0d85a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a0806c020 0x7f2a0806c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:56.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.814+0000 7f2a0d85a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a080c5840 con 0x7f2a0806d2b0 2023-12-08T08:22:56.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.814+0000 7f2a0d85a640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a0806bb80 con 0x7f2a080c3b80 2023-12-08T08:22:56.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.814+0000 7f2a0d85a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a081515c0 con 0x7f2a0806c020 2023-12-08T08:22:56.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.818+0000 7f2a06ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2a0806d2b0 0x7f2a0806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:56.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.818+0000 7f2a06ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2a0806d2b0 0x7f2a0806d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60762/0 (socket says 172.21.15.88:60762) 2023-12-08T08:22:56.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.818+0000 7f2a06ffd640 1 -- 172.21.15.88:0/891980585 learned_addr learned my addr 172.21.15.88:0/891980585 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:56.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.818+0000 7f2a077fe640 1 --2- 172.21.15.88:0/891980585 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a0806c020 0x7f2a0806c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:56.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.818+0000 7f29fe7fc640 1 --2- 172.21.15.88:0/891980585 >> v2:172.21.15.148:3300/0 conn(0x7f2a080c3b80 0x7f2a080c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:56.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.818+0000 7f2a06ffd640 1 -- 172.21.15.88:0/891980585 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a0806c020 msgr2=0x7f2a0806c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:56.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.818+0000 7f2a06ffd640 1 --2- 172.21.15.88:0/891980585 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a0806c020 0x7f2a0806c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.818+0000 7f2a06ffd640 1 -- 172.21.15.88:0/891980585 >> v2:172.21.15.148:3300/0 conn(0x7f2a080c3b80 msgr2=0x7f2a080c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:56.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.818+0000 7f2a06ffd640 1 --2- 172.21.15.88:0/891980585 >> v2:172.21.15.148:3300/0 conn(0x7f2a080c3b80 0x7f2a080c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.818+0000 7f2a06ffd640 1 -- 172.21.15.88:0/891980585 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a081518a0 con 0x7f2a0806d2b0 2023-12-08T08:22:56.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.818+0000 7f29fe7fc640 1 --2- 172.21.15.88:0/891980585 >> v2:172.21.15.148:3300/0 conn(0x7f2a080c3b80 0x7f2a080c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:56.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.818+0000 7f2a06ffd640 1 --2- 172.21.15.88:0/891980585 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a0806d2b0 0x7f2a0806d690 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f2a0806b5a0 tx=0x7f29f001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb0fba73bf18f21 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:56.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.818+0000 7f2a067fc640 1 -- 172.21.15.88:0/891980585 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f00ac600 con 0x7f2a0806d2b0 2023-12-08T08:22:56.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.818+0000 7f2a067fc640 1 -- 172.21.15.88:0/891980585 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f00a8050 con 0x7f2a0806d2b0 2023-12-08T08:22:56.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.818+0000 7f2a067fc640 1 -- 172.21.15.88:0/891980585 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f00ac980 con 0x7f2a0806d2b0 2023-12-08T08:22:56.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f2a0d85a640 1 -- 172.21.15.88:0/891980585 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a0806d2b0 msgr2=0x7f2a0806d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:56.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f2a0d85a640 1 --2- 172.21.15.88:0/891980585 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a0806d2b0 0x7f2a0806d690 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f2a0806b5a0 tx=0x7f29f001c4d0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f2a0d85a640 1 -- 172.21.15.88:0/891980585 shutdown_connections 2023-12-08T08:22:56.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f2a0d85a640 1 --2- 172.21.15.88:0/891980585 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a0806c020 0x7f2a0806c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f2a0d85a640 1 --2- 172.21.15.88:0/891980585 >> v2:172.21.15.148:3300/0 conn(0x7f2a080c3b80 0x7f2a080c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f2a0d85a640 1 --2- 172.21.15.88:0/891980585 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a0806d2b0 0x7f2a0806d690 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f2a0d85a640 1 -- 172.21.15.88:0/891980585 >> 172.21.15.88:0/891980585 conn(0x7f2a080a7810 msgr2=0x7f2a080a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:56.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f2a0d85a640 1 -- 172.21.15.88:0/891980585 shutdown_connections 2023-12-08T08:22:56.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f2a0d85a640 1 -- 172.21.15.88:0/891980585 wait complete. 2023-12-08T08:22:56.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f2a0d85a640 1 Processor -- start 2023-12-08T08:22:56.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f2a0d85a640 1 -- start start 2023-12-08T08:22:56.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f2a0d85a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a0806c020 0x7f2a0814e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:56.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f2a0d85a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a0806d2b0 0x7f2a080aabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:56.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f2a0d85a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a080c3b80 0x7f2a0814b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:56.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f2a0d85a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a080aa490 con 0x7f2a0806d2b0 2023-12-08T08:22:56.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f2a0d85a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a081ef4c0 con 0x7f2a080c3b80 2023-12-08T08:22:56.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f2a0d85a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a080bb8e0 con 0x7f2a0806c020 2023-12-08T08:22:56.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f29fe7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a0806d2b0 0x7f2a080aabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:56.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f29fe7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a0806d2b0 0x7f2a080aabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60766/0 (socket says 172.21.15.88:60766) 2023-12-08T08:22:56.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f29fe7fc640 1 -- 172.21.15.88:0/3074991288 learned_addr learned my addr 172.21.15.88:0/3074991288 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:56.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f2a06ffd640 1 --2- 172.21.15.88:0/3074991288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a0806c020 0x7f2a0814e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:56.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f29fe7fc640 1 -- 172.21.15.88:0/3074991288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a0806c020 msgr2=0x7f2a0814e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:56.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f2a077fe640 1 --2- 172.21.15.88:0/3074991288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a080c3b80 0x7f2a0814b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:56.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f29fe7fc640 1 --2- 172.21.15.88:0/3074991288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a0806c020 0x7f2a0814e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f29fe7fc640 1 -- 172.21.15.88:0/3074991288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a080c3b80 msgr2=0x7f2a0814b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:56.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f29fe7fc640 1 --2- 172.21.15.88:0/3074991288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a080c3b80 0x7f2a0814b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f29fe7fc640 1 -- 172.21.15.88:0/3074991288 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f00094d0 con 0x7f2a0806d2b0 2023-12-08T08:22:56.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f2a06ffd640 1 --2- 172.21.15.88:0/3074991288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a0806c020 0x7f2a0814e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:56.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.822+0000 7f2a077fe640 1 --2- 172.21.15.88:0/3074991288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a080c3b80 0x7f2a0814b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:56.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.826+0000 7f29fe7fc640 1 --2- 172.21.15.88:0/3074991288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a0806d2b0 0x7f2a080aabf0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f29f800ce00 tx=0x7f29f800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:56.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.826+0000 7f2a04ff9640 1 -- 172.21.15.88:0/3074991288 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f800f890 con 0x7f2a0806d2b0 2023-12-08T08:22:56.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.826+0000 7f2a04ff9640 1 -- 172.21.15.88:0/3074991288 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f800f9f0 con 0x7f2a0806d2b0 2023-12-08T08:22:56.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.826+0000 7f2a0d85a640 1 -- 172.21.15.88:0/3074991288 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a0814ef80 con 0x7f2a0806d2b0 2023-12-08T08:22:56.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.826+0000 7f2a04ff9640 1 -- 172.21.15.88:0/3074991288 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f800fdc0 con 0x7f2a0806d2b0 2023-12-08T08:22:56.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.826+0000 7f2a0d85a640 1 -- 172.21.15.88:0/3074991288 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a080aa6d0 con 0x7f2a0806d2b0 2023-12-08T08:22:56.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.826+0000 7f2a0d85a640 1 -- 172.21.15.88:0/3074991288 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a08067630 con 0x7f2a0806d2b0 2023-12-08T08:22:56.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.826+0000 7f2a04ff9640 1 -- 172.21.15.88:0/3074991288 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f29f800b040 con 0x7f2a0806d2b0 2023-12-08T08:22:56.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.826+0000 7f2a04ff9640 1 --2- 172.21.15.88:0/3074991288 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f29e8066470 0x7f29e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:56.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.826+0000 7f2a04ff9640 1 -- 172.21.15.88:0/3074991288 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f29f80844b0 con 0x7f2a0806d2b0 2023-12-08T08:22:56.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.826+0000 7f2a06ffd640 1 --2- 172.21.15.88:0/3074991288 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f29e8066470 0x7f29e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:56.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.826+0000 7f2a06ffd640 1 --2- 172.21.15.88:0/3074991288 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f29e8066470 0x7f29e8068930 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f29f00ae000 tx=0x7f29f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:56.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.830+0000 7f2a04ff9640 1 -- 172.21.15.88:0/3074991288 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f29f8051c70 con 0x7f2a0806d2b0 2023-12-08T08:22:56.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.982+0000 7f2a0d85a640 1 -- 172.21.15.88:0/3074991288 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2a0815bb30 con 0x7f2a0806d2b0 2023-12-08T08:22:56.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.986+0000 7f2a04ff9640 1 -- 172.21.15.88:0/3074991288 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v64) v1 ==== 84+0+65 (secure 0 0 0) 0x7f29f801d090 con 0x7f2a0806d2b0 2023-12-08T08:22:56.989 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:22:56.989 INFO:teuthology.orchestra.run.smithi088.stdout:[ 2023-12-08T08:22:56.990 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:22:56.990 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 1, 2023-12-08T08:22:56.990 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": ".mgr" 2023-12-08T08:22:56.990 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:22:56.990 INFO:teuthology.orchestra.run.smithi088.stdout:] 2023-12-08T08:22:56.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.986+0000 7f2a0d85a640 1 -- 172.21.15.88:0/3074991288 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f29e8066470 msgr2=0x7f29e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:56.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.986+0000 7f2a0d85a640 1 --2- 172.21.15.88:0/3074991288 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f29e8066470 0x7f29e8068930 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f29f00ae000 tx=0x7f29f0008040 comp rx=0 tx=0).stop 2023-12-08T08:22:56.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.986+0000 7f2a0d85a640 1 -- 172.21.15.88:0/3074991288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a0806d2b0 msgr2=0x7f2a080aabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:56.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.986+0000 7f2a0d85a640 1 --2- 172.21.15.88:0/3074991288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a0806d2b0 0x7f2a080aabf0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f29f800ce00 tx=0x7f29f800a650 comp rx=0 tx=0).stop 2023-12-08T08:22:56.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.986+0000 7f2a0d85a640 1 -- 172.21.15.88:0/3074991288 shutdown_connections 2023-12-08T08:22:56.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.986+0000 7f2a0d85a640 1 --2- 172.21.15.88:0/3074991288 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f29e8066470 0x7f29e8068930 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.986+0000 7f2a0d85a640 1 --2- 172.21.15.88:0/3074991288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a080c3b80 0x7f2a0814b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.986+0000 7f2a0d85a640 1 --2- 172.21.15.88:0/3074991288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a0806d2b0 0x7f2a080aabf0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.986+0000 7f2a0d85a640 1 --2- 172.21.15.88:0/3074991288 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2a0806c020 0x7f2a0814e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:56.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.986+0000 7f2a0d85a640 1 -- 172.21.15.88:0/3074991288 >> 172.21.15.88:0/3074991288 conn(0x7f2a080a7810 msgr2=0x7f2a08071ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:56.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.986+0000 7f2a0d85a640 1 -- 172.21.15.88:0/3074991288 shutdown_connections 2023-12-08T08:22:56.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:56.986+0000 7f2a0d85a640 1 -- 172.21.15.88:0/3074991288 wait complete. 2023-12-08T08:22:57.009 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-08T08:22:57.010 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-08T08:22:57.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.146+0000 7f73ff468640 1 Processor -- start 2023-12-08T08:22:57.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.146+0000 7f73ff468640 1 -- start start 2023-12-08T08:22:57.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.146+0000 7f73ff468640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f73f815a580 0x7f73f815c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:57.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.146+0000 7f73ff468640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f8151210 con 0x7f73f81516a0 2023-12-08T08:22:57.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.146+0000 7f73ff468640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f814e680 con 0x7f73f814e2a0 2023-12-08T08:22:57.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.146+0000 7f73ff468640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f8151b50 con 0x7f73f815a580 2023-12-08T08:22:57.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.146+0000 7f73fca03640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f73f81516a0 0x7f73f806bc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51314/0 (socket says 172.21.15.88:51314) 2023-12-08T08:22:57.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.146+0000 7f73fca03640 1 -- 172.21.15.88:0/452828126 learned_addr learned my addr 172.21.15.88:0/452828126 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:57.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.146+0000 7f73fda05640 1 --2- 172.21.15.88:0/452828126 >> v2:172.21.15.148:3300/0 conn(0x7f73f815a580 0x7f73f815c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:57.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.150+0000 7f73effff640 1 -- 172.21.15.88:0/452828126 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375337653 0 0) 0x7f73f8151210 con 0x7f73f81516a0 2023-12-08T08:22:57.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.150+0000 7f73effff640 1 -- 172.21.15.88:0/452828126 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73e4003530 con 0x7f73f81516a0 2023-12-08T08:22:57.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.150+0000 7f73effff640 1 -- 172.21.15.88:0/452828126 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 378994392 0 0) 0x7f73f814e680 con 0x7f73f814e2a0 2023-12-08T08:22:57.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.150+0000 7f73effff640 1 -- 172.21.15.88:0/452828126 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73f8151210 con 0x7f73f814e2a0 2023-12-08T08:22:57.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.150+0000 7f73effff640 1 -- 172.21.15.88:0/452828126 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3326385615 0 0) 0x7f73e4003530 con 0x7f73f81516a0 2023-12-08T08:22:57.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.150+0000 7f73effff640 1 -- 172.21.15.88:0/452828126 >> v2:172.21.15.148:3300/0 conn(0x7f73f815a580 msgr2=0x7f73f815c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:57.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.150+0000 7f73effff640 1 --2- 172.21.15.88:0/452828126 >> v2:172.21.15.148:3300/0 conn(0x7f73f815a580 0x7f73f815c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:57.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.150+0000 7f73effff640 1 -- 172.21.15.88:0/452828126 >> v1:172.21.15.148:6789/0 conn(0x7f73f814e2a0 legacy=0x7f73f80a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:57.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.150+0000 7f73effff640 1 -- 172.21.15.88:0/452828126 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f80a9b70 con 0x7f73f81516a0 2023-12-08T08:22:57.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.150+0000 7f73effff640 1 -- 172.21.15.88:0/452828126 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f73e8001680 con 0x7f73f81516a0 2023-12-08T08:22:57.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.150+0000 7f73effff640 1 -- 172.21.15.88:0/452828126 >> v1:172.21.15.88:6789/0 conn(0x7f73f81516a0 legacy=0x7f73f806bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:57.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.150+0000 7f73effff640 1 --2- 172.21.15.88:0/452828126 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73e4003b60 0x7f73e4003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:57.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.150+0000 7f73effff640 1 --2- 172.21.15.88:0/452828126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73e40047d0 0x7f73e4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:57.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.150+0000 7f73effff640 1 --2- 172.21.15.88:0/452828126 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73e4005190 0x7f73e400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:57.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.150+0000 7f73effff640 1 -- 172.21.15.88:0/452828126 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f8151b50 con 0x7f73e4005190 2023-12-08T08:22:57.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.150+0000 7f73effff640 1 -- 172.21.15.88:0/452828126 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e400e270 con 0x7f73e40047d0 2023-12-08T08:22:57.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.150+0000 7f73effff640 1 -- 172.21.15.88:0/452828126 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e400e430 con 0x7f73e4003b60 2023-12-08T08:22:57.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.150+0000 7f73fda05640 1 --2- 172.21.15.88:0/452828126 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73e4005190 0x7f73e400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:57.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.150+0000 7f73fd204640 1 --2- 172.21.15.88:0/452828126 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73e4003b60 0x7f73e4003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:57.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.150+0000 7f73fca03640 1 --2- 172.21.15.88:0/452828126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73e40047d0 0x7f73e4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:57.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.150+0000 7f73fda05640 1 -- 172.21.15.88:0/452828126 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73e4003b60 msgr2=0x7f73e4003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:57.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.150+0000 7f73fda05640 1 --2- 172.21.15.88:0/452828126 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73e4003b60 0x7f73e4003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:57.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.150+0000 7f73fda05640 1 -- 172.21.15.88:0/452828126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73e40047d0 msgr2=0x7f73e4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:57.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.150+0000 7f73fda05640 1 --2- 172.21.15.88:0/452828126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73e40047d0 0x7f73e4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:57.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.150+0000 7f73fda05640 1 -- 172.21.15.88:0/452828126 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e4003530 con 0x7f73e4005190 2023-12-08T08:22:57.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.150+0000 7f73fca03640 1 --2- 172.21.15.88:0/452828126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73e40047d0 0x7f73e4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:22:57.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.150+0000 7f73fda05640 1 -- 172.21.15.88:0/452828126 reap_dead start 2023-12-08T08:22:57.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.154+0000 7f73fda05640 1 --2- 172.21.15.88:0/452828126 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73e4005190 0x7f73e400dba0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f73f806fb70 tx=0x7f73f001cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3eb3c928201d34d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:57.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.154+0000 7f73effff640 1 -- 172.21.15.88:0/452828126 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f00a5c60 con 0x7f73e4005190 2023-12-08T08:22:57.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.154+0000 7f73effff640 1 -- 172.21.15.88:0/452828126 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f000f040 con 0x7f73e4005190 2023-12-08T08:22:57.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.154+0000 7f73effff640 1 -- 172.21.15.88:0/452828126 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f00ad440 con 0x7f73e4005190 2023-12-08T08:22:57.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.154+0000 7f73ff468640 1 -- 172.21.15.88:0/452828126 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73e4005190 msgr2=0x7f73e400dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:57.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.154+0000 7f73ff468640 1 --2- 172.21.15.88:0/452828126 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73e4005190 0x7f73e400dba0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f73f806fb70 tx=0x7f73f001cbf0 comp rx=0 tx=0).stop 2023-12-08T08:22:57.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.154+0000 7f73ff468640 1 -- 172.21.15.88:0/452828126 shutdown_connections 2023-12-08T08:22:57.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.154+0000 7f73ff468640 1 --2- 172.21.15.88:0/452828126 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73e4005190 0x7f73e400dba0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:57.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.154+0000 7f73ff468640 1 -- 172.21.15.88:0/452828126 >> 172.21.15.88:0/452828126 conn(0x7f73f80c59f0 msgr2=0x7f73f80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:57.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.154+0000 7f73ff468640 1 -- 172.21.15.88:0/452828126 shutdown_connections 2023-12-08T08:22:57.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.154+0000 7f73ff468640 1 -- 172.21.15.88:0/452828126 wait complete. 2023-12-08T08:22:57.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.154+0000 7f73ff468640 1 Processor -- start 2023-12-08T08:22:57.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.154+0000 7f73ff468640 1 -- start start 2023-12-08T08:22:57.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.154+0000 7f73ff468640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73e4005190 0x7f73f81ea790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:57.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.154+0000 7f73ff468640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73f814bc00 0x7f73f8153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:57.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.154+0000 7f73ff468640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73f8154470 0x7f73f80c1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:57.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.154+0000 7f73ff468640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f814d330 con 0x7f73e4005190 2023-12-08T08:22:57.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.154+0000 7f73ff468640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f81eacd0 con 0x7f73f814bc00 2023-12-08T08:22:57.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.154+0000 7f73ff468640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f8146b80 con 0x7f73f8154470 2023-12-08T08:22:57.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.154+0000 7f73fd204640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73e4005190 0x7f73f81ea790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:57.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.158+0000 7f73fd204640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73e4005190 0x7f73f81ea790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60790/0 (socket says 172.21.15.88:60790) 2023-12-08T08:22:57.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.158+0000 7f73fd204640 1 -- 172.21.15.88:0/3197925024 learned_addr learned my addr 172.21.15.88:0/3197925024 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:57.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.158+0000 7f73fda05640 1 --2- 172.21.15.88:0/3197925024 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73f8154470 0x7f73f80c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:57.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.158+0000 7f73fca03640 1 --2- 172.21.15.88:0/3197925024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73f814bc00 0x7f73f8153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:57.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.158+0000 7f73fd204640 1 -- 172.21.15.88:0/3197925024 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73f8154470 msgr2=0x7f73f80c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:57.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.158+0000 7f73fd204640 1 --2- 172.21.15.88:0/3197925024 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73f8154470 0x7f73f80c1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:57.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.158+0000 7f73fd204640 1 -- 172.21.15.88:0/3197925024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73f814bc00 msgr2=0x7f73f8153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:57.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.158+0000 7f73fd204640 1 --2- 172.21.15.88:0/3197925024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73f814bc00 0x7f73f8153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:57.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.158+0000 7f73fd204640 1 -- 172.21.15.88:0/3197925024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f814c7b0 con 0x7f73e4005190 2023-12-08T08:22:57.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.158+0000 7f73fd204640 1 --2- 172.21.15.88:0/3197925024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73e4005190 0x7f73f81ea790 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f73f400f7d0 tx=0x7f73f400fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:57.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.158+0000 7f73edffb640 1 -- 172.21.15.88:0/3197925024 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f4005110 con 0x7f73e4005190 2023-12-08T08:22:57.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.158+0000 7f73edffb640 1 -- 172.21.15.88:0/3197925024 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f4005270 con 0x7f73e4005190 2023-12-08T08:22:57.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.158+0000 7f73edffb640 1 -- 172.21.15.88:0/3197925024 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f40067e0 con 0x7f73e4005190 2023-12-08T08:22:57.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.158+0000 7f73ff468640 1 -- 172.21.15.88:0/3197925024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f814ca90 con 0x7f73e4005190 2023-12-08T08:22:57.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.158+0000 7f73ff468640 1 -- 172.21.15.88:0/3197925024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f814d050 con 0x7f73e4005190 2023-12-08T08:22:57.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.158+0000 7f73ff468640 1 -- 172.21.15.88:0/3197925024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f8067630 con 0x7f73e4005190 2023-12-08T08:22:57.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.158+0000 7f73edffb640 1 -- 172.21.15.88:0/3197925024 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f73f4006940 con 0x7f73e4005190 2023-12-08T08:22:57.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.158+0000 7f73edffb640 1 --2- 172.21.15.88:0/3197925024 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f73dc066470 0x7f73dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:57.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.162+0000 7f73edffb640 1 -- 172.21.15.88:0/3197925024 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f73f4083030 con 0x7f73e4005190 2023-12-08T08:22:57.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.162+0000 7f73fca03640 1 --2- 172.21.15.88:0/3197925024 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f73dc066470 0x7f73dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:57.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.162+0000 7f73fca03640 1 --2- 172.21.15.88:0/3197925024 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f73dc066470 0x7f73dc068930 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f73e8001040 tx=0x7f73e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:57.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.166+0000 7f73edffb640 1 -- 172.21.15.88:0/3197925024 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f73f4050890 con 0x7f73e4005190 2023-12-08T08:22:57.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:57.318+0000 7f73ff468640 1 -- 172.21.15.88:0/3197925024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f73f80c5100 con 0x7f73e4005190 2023-12-08T08:22:58.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.238+0000 7f73edffb640 1 -- 172.21.15.88:0/3197925024 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v65) v1 ==== 138+0+0 (secure 0 0 0) 0x7f73f4053eb0 con 0x7f73e4005190 2023-12-08T08:22:58.244 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' created 2023-12-08T08:22:58.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.242+0000 7f73ff468640 1 -- 172.21.15.88:0/3197925024 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f73dc066470 msgr2=0x7f73dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:58.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.242+0000 7f73ff468640 1 --2- 172.21.15.88:0/3197925024 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f73dc066470 0x7f73dc068930 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f73e8001040 tx=0x7f73e8009040 comp rx=0 tx=0).stop 2023-12-08T08:22:58.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.242+0000 7f73ff468640 1 -- 172.21.15.88:0/3197925024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73e4005190 msgr2=0x7f73f81ea790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:58.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.242+0000 7f73ff468640 1 --2- 172.21.15.88:0/3197925024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73e4005190 0x7f73f81ea790 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f73f400f7d0 tx=0x7f73f400fc90 comp rx=0 tx=0).stop 2023-12-08T08:22:58.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.242+0000 7f73ff468640 1 -- 172.21.15.88:0/3197925024 shutdown_connections 2023-12-08T08:22:58.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.242+0000 7f73ff468640 1 --2- 172.21.15.88:0/3197925024 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f73dc066470 0x7f73dc068930 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:58.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.242+0000 7f73ff468640 1 --2- 172.21.15.88:0/3197925024 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f73f8154470 0x7f73f80c1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:58.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.242+0000 7f73ff468640 1 --2- 172.21.15.88:0/3197925024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73f814bc00 0x7f73f8153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:58.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.242+0000 7f73ff468640 1 --2- 172.21.15.88:0/3197925024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73e4005190 0x7f73f81ea790 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:58.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.242+0000 7f73ff468640 1 -- 172.21.15.88:0/3197925024 >> 172.21.15.88:0/3197925024 conn(0x7f73f80c59f0 msgr2=0x7f73f80733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:58.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.246+0000 7f73ff468640 1 -- 172.21.15.88:0/3197925024 shutdown_connections 2023-12-08T08:22:58.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.246+0000 7f73ff468640 1 -- 172.21.15.88:0/3197925024 wait complete. 2023-12-08T08:22:58.275 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-08T08:22:58.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.418+0000 7f40a49d1640 1 Processor -- start 2023-12-08T08:22:58.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.418+0000 7f40a49d1640 1 -- start start 2023-12-08T08:22:58.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.418+0000 7f40a49d1640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f40a0151a20 0x7f40a006e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:58.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.418+0000 7f40a49d1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f40a0157a90 0x7f40a006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:58.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.418+0000 7f40a49d1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40a006bb00 0x7f40a0154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:58.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.418+0000 7f40a49d1640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a00c2720 con 0x7f40a0157a90 2023-12-08T08:22:58.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.418+0000 7f40a49d1640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a0072c50 con 0x7f40a0151a20 2023-12-08T08:22:58.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.418+0000 7f40a49d1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a01544a0 con 0x7f40a006bb00 2023-12-08T08:22:58.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.418+0000 7f409dd9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f40a0157a90 0x7f40a006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:58.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.418+0000 7f409dd9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f40a0157a90 0x7f40a006b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60794/0 (socket says 172.21.15.88:60794) 2023-12-08T08:22:58.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.418+0000 7f409dd9b640 1 -- 172.21.15.88:0/2278410914 learned_addr learned my addr 172.21.15.88:0/2278410914 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:58.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.418+0000 7f409e59c640 1 --2- 172.21.15.88:0/2278410914 >> v2:172.21.15.148:3300/0 conn(0x7f40a0151a20 0x7f40a006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:58.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.418+0000 7f409dd9b640 1 -- 172.21.15.88:0/2278410914 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40a006bb00 msgr2=0x7f40a0154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:58.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.418+0000 7f409ed9d640 1 --2- 172.21.15.88:0/2278410914 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40a006bb00 0x7f40a0154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:58.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.418+0000 7f409dd9b640 1 --2- 172.21.15.88:0/2278410914 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40a006bb00 0x7f40a0154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:58.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.418+0000 7f409dd9b640 1 -- 172.21.15.88:0/2278410914 >> v2:172.21.15.148:3300/0 conn(0x7f40a0151a20 msgr2=0x7f40a006e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:58.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.418+0000 7f409dd9b640 1 --2- 172.21.15.88:0/2278410914 >> v2:172.21.15.148:3300/0 conn(0x7f40a0151a20 0x7f40a006e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:58.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.418+0000 7f409dd9b640 1 -- 172.21.15.88:0/2278410914 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a00c1810 con 0x7f40a0157a90 2023-12-08T08:22:58.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.418+0000 7f409e59c640 1 --2- 172.21.15.88:0/2278410914 >> v2:172.21.15.148:3300/0 conn(0x7f40a0151a20 0x7f40a006e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:58.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.418+0000 7f409ed9d640 1 --2- 172.21.15.88:0/2278410914 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40a006bb00 0x7f40a0154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:58.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.422+0000 7f409dd9b640 1 --2- 172.21.15.88:0/2278410914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40a0157a90 0x7f40a006b5c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f40a006d1e0 tx=0x7f409401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a050a8639d951ba server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:58.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.422+0000 7f409d59a640 1 -- 172.21.15.88:0/2278410914 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40940ab600 con 0x7f40a0157a90 2023-12-08T08:22:58.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.422+0000 7f409d59a640 1 -- 172.21.15.88:0/2278410914 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40940a7050 con 0x7f40a0157a90 2023-12-08T08:22:58.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.422+0000 7f409d59a640 1 -- 172.21.15.88:0/2278410914 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40940ab980 con 0x7f40a0157a90 2023-12-08T08:22:58.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.422+0000 7f40a49d1640 1 -- 172.21.15.88:0/2278410914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40a0157a90 msgr2=0x7f40a006b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:58.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.422+0000 7f40a49d1640 1 --2- 172.21.15.88:0/2278410914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40a0157a90 0x7f40a006b5c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f40a006d1e0 tx=0x7f409401c470 comp rx=0 tx=0).stop 2023-12-08T08:22:58.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.422+0000 7f40a49d1640 1 -- 172.21.15.88:0/2278410914 shutdown_connections 2023-12-08T08:22:58.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.422+0000 7f40a49d1640 1 --2- 172.21.15.88:0/2278410914 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40a006bb00 0x7f40a0154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:58.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.422+0000 7f40a49d1640 1 --2- 172.21.15.88:0/2278410914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40a0157a90 0x7f40a006b5c0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:58.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.422+0000 7f40a49d1640 1 --2- 172.21.15.88:0/2278410914 >> v2:172.21.15.148:3300/0 conn(0x7f40a0151a20 0x7f40a006e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:58.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.422+0000 7f40a49d1640 1 -- 172.21.15.88:0/2278410914 >> 172.21.15.88:0/2278410914 conn(0x7f40a00c2e20 msgr2=0x7f40a00c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:58.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.422+0000 7f40a49d1640 1 -- 172.21.15.88:0/2278410914 shutdown_connections 2023-12-08T08:22:58.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.422+0000 7f40a49d1640 1 -- 172.21.15.88:0/2278410914 wait complete. 2023-12-08T08:22:58.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.426+0000 7f40a49d1640 1 Processor -- start 2023-12-08T08:22:58.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.426+0000 7f40a49d1640 1 -- start start 2023-12-08T08:22:58.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.426+0000 7f40a49d1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40a006bb00 0x7f40a006da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:58.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.426+0000 7f40a49d1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40a0151a20 0x7f40a00aadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:58.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.426+0000 7f40a49d1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40a0157a90 0x7f40a00ab330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:58.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.426+0000 7f40a49d1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a00ab870 con 0x7f40a0157a90 2023-12-08T08:22:58.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.426+0000 7f40a49d1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a0156d90 con 0x7f40a0151a20 2023-12-08T08:22:58.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.426+0000 7f40a49d1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a0156460 con 0x7f40a006bb00 2023-12-08T08:22:58.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.426+0000 7f409ed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40a0157a90 0x7f40a00ab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:58.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.426+0000 7f409ed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40a0157a90 0x7f40a00ab330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60808/0 (socket says 172.21.15.88:60808) 2023-12-08T08:22:58.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.426+0000 7f409ed9d640 1 -- 172.21.15.88:0/546404665 learned_addr learned my addr 172.21.15.88:0/546404665 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:58.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.426+0000 7f409dd9b640 1 --2- 172.21.15.88:0/546404665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40a0151a20 0x7f40a00aadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:58.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.426+0000 7f409e59c640 1 --2- 172.21.15.88:0/546404665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40a006bb00 0x7f40a006da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:58.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.426+0000 7f409ed9d640 1 -- 172.21.15.88:0/546404665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40a006bb00 msgr2=0x7f40a006da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:58.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.426+0000 7f409ed9d640 1 --2- 172.21.15.88:0/546404665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40a006bb00 0x7f40a006da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:58.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.426+0000 7f409ed9d640 1 -- 172.21.15.88:0/546404665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40a0151a20 msgr2=0x7f40a00aadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:58.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.426+0000 7f409ed9d640 1 --2- 172.21.15.88:0/546404665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40a0151a20 0x7f40a00aadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:58.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.426+0000 7f409ed9d640 1 -- 172.21.15.88:0/546404665 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40940094d0 con 0x7f40a0157a90 2023-12-08T08:22:58.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.426+0000 7f409ed9d640 1 --2- 172.21.15.88:0/546404665 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40a0157a90 0x7f40a00ab330 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f409800cef0 tx=0x7f409800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:58.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.426+0000 7f408effd640 1 -- 172.21.15.88:0/546404665 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409800d840 con 0x7f40a0157a90 2023-12-08T08:22:58.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.426+0000 7f408effd640 1 -- 172.21.15.88:0/546404665 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409800d9c0 con 0x7f40a0157a90 2023-12-08T08:22:58.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.426+0000 7f408effd640 1 -- 172.21.15.88:0/546404665 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409800dd70 con 0x7f40a0157a90 2023-12-08T08:22:58.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.426+0000 7f40a49d1640 1 -- 172.21.15.88:0/546404665 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a0156740 con 0x7f40a0157a90 2023-12-08T08:22:58.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.426+0000 7f40a49d1640 1 -- 172.21.15.88:0/546404665 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a0157220 con 0x7f40a0157a90 2023-12-08T08:22:58.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.426+0000 7f40a49d1640 1 -- 172.21.15.88:0/546404665 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a0066660 con 0x7f40a0157a90 2023-12-08T08:22:58.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.430+0000 7f408effd640 1 -- 172.21.15.88:0/546404665 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f409801e3b0 con 0x7f40a0157a90 2023-12-08T08:22:58.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.430+0000 7f408effd640 1 --2- 172.21.15.88:0/546404665 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f40800664a0 0x7f4080068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:58.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.430+0000 7f408effd640 1 -- 172.21.15.88:0/546404665 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f4098084670 con 0x7f40a0157a90 2023-12-08T08:22:58.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.430+0000 7f409e59c640 1 --2- 172.21.15.88:0/546404665 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f40800664a0 0x7f4080068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:58.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.430+0000 7f409e59c640 1 --2- 172.21.15.88:0/546404665 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f40800664a0 0x7f4080068960 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f409000aae0 tx=0x7f4090008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:58.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.434+0000 7f408effd640 1 -- 172.21.15.88:0/546404665 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4098051e30 con 0x7f40a0157a90 2023-12-08T08:22:58.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:58.586+0000 7f40a49d1640 1 -- 172.21.15.88:0/546404665 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f40a0070790 con 0x7f40a0157a90 2023-12-08T08:22:59.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.246+0000 7f408effd640 1 -- 172.21.15.88:0/546404665 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v66) v1 ==== 170+0+0 (secure 0 0 0) 0x7f409801a0d0 con 0x7f40a0157a90 2023-12-08T08:22:59.252 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' created 2023-12-08T08:22:59.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.250+0000 7f40a49d1640 1 -- 172.21.15.88:0/546404665 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f40800664a0 msgr2=0x7f4080068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:59.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.250+0000 7f40a49d1640 1 --2- 172.21.15.88:0/546404665 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f40800664a0 0x7f4080068960 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f409000aae0 tx=0x7f4090008040 comp rx=0 tx=0).stop 2023-12-08T08:22:59.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.250+0000 7f40a49d1640 1 -- 172.21.15.88:0/546404665 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40a0157a90 msgr2=0x7f40a00ab330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:59.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.250+0000 7f40a49d1640 1 --2- 172.21.15.88:0/546404665 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40a0157a90 0x7f40a00ab330 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f409800cef0 tx=0x7f409800a710 comp rx=0 tx=0).stop 2023-12-08T08:22:59.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.250+0000 7f40a49d1640 1 -- 172.21.15.88:0/546404665 shutdown_connections 2023-12-08T08:22:59.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.250+0000 7f40a49d1640 1 --2- 172.21.15.88:0/546404665 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f40800664a0 0x7f4080068960 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:59.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.250+0000 7f40a49d1640 1 --2- 172.21.15.88:0/546404665 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40a0157a90 0x7f40a00ab330 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:59.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.250+0000 7f40a49d1640 1 --2- 172.21.15.88:0/546404665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40a0151a20 0x7f40a00aadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:59.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.250+0000 7f40a49d1640 1 --2- 172.21.15.88:0/546404665 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f40a006bb00 0x7f40a006da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:59.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.250+0000 7f40a49d1640 1 -- 172.21.15.88:0/546404665 >> 172.21.15.88:0/546404665 conn(0x7f40a00c2e20 msgr2=0x7f40a0153d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:59.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.250+0000 7f40a49d1640 1 -- 172.21.15.88:0/546404665 shutdown_connections 2023-12-08T08:22:59.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.250+0000 7f40a49d1640 1 -- 172.21.15.88:0/546404665 wait complete. 2023-12-08T08:22:59.296 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-08T08:22:59.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.434+0000 7ff791bdf640 1 Processor -- start 2023-12-08T08:22:59.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.434+0000 7ff791bdf640 1 -- start start 2023-12-08T08:22:59.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.434+0000 7ff791bdf640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff78c0c5300 0x7ff78c0a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:59.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.434+0000 7ff791bdf640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff78c1548c0 0x7ff78c154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:59.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.434+0000 7ff791bdf640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff78c0a4e20 con 0x7ff78c14b1e0 2023-12-08T08:22:59.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.434+0000 7ff791bdf640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff78c0a50e0 con 0x7ff78c1548c0 2023-12-08T08:22:59.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.434+0000 7ff791bdf640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff78c0c0f00 con 0x7ff78c0c5300 2023-12-08T08:22:59.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.434+0000 7ff78b7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff78c14b1e0 0x7ff78c0c1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51324/0 (socket says 172.21.15.88:51324) 2023-12-08T08:22:59.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.434+0000 7ff78b7fe640 1 -- 172.21.15.88:0/1497031224 learned_addr learned my addr 172.21.15.88:0/1497031224 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:22:59.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.434+0000 7ff78bfff640 1 --2- 172.21.15.88:0/1497031224 >> v2:172.21.15.88:3300/0 conn(0x7ff78c1548c0 0x7ff78c154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:59.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.434+0000 7ff78affd640 1 --2- 172.21.15.88:0/1497031224 >> v2:172.21.15.148:3300/0 conn(0x7ff78c0c5300 0x7ff78c0a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:59.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.434+0000 7ff78a7fc640 1 -- 172.21.15.88:0/1497031224 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2388577800 0 0) 0x7ff78c0a4e20 con 0x7ff78c14b1e0 2023-12-08T08:22:59.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.434+0000 7ff78a7fc640 1 -- 172.21.15.88:0/1497031224 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff774003530 con 0x7ff78c14b1e0 2023-12-08T08:22:59.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.434+0000 7ff78bfff640 1 -- 172.21.15.88:0/1497031224 >> v2:172.21.15.148:3300/0 conn(0x7ff78c0c5300 msgr2=0x7ff78c0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:22:59.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.434+0000 7ff78bfff640 1 --2- 172.21.15.88:0/1497031224 >> v2:172.21.15.148:3300/0 conn(0x7ff78c0c5300 0x7ff78c0a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:59.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.434+0000 7ff78bfff640 1 -- 172.21.15.88:0/1497031224 >> v1:172.21.15.88:6789/0 conn(0x7ff78c14b1e0 legacy=0x7ff78c0c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:59.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.434+0000 7ff78bfff640 1 -- 172.21.15.88:0/1497031224 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c0c11e0 con 0x7ff78c1548c0 2023-12-08T08:22:59.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.438+0000 7ff78bfff640 1 --2- 172.21.15.88:0/1497031224 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff78c1548c0 0x7ff78c154d30 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7ff78c0a9650 tx=0x7ff78401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cebc9eb047bfe3f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:59.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.438+0000 7ff78a7fc640 1 -- 172.21.15.88:0/1497031224 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7840a58e0 con 0x7ff78c1548c0 2023-12-08T08:22:59.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.438+0000 7ff78a7fc640 1 -- 172.21.15.88:0/1497031224 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7840a5a40 con 0x7ff78c1548c0 2023-12-08T08:22:59.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.438+0000 7ff78a7fc640 1 -- 172.21.15.88:0/1497031224 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7840a5dd0 con 0x7ff78c1548c0 2023-12-08T08:22:59.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.438+0000 7ff791bdf640 1 -- 172.21.15.88:0/1497031224 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff78c1548c0 msgr2=0x7ff78c154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:59.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.438+0000 7ff791bdf640 1 --2- 172.21.15.88:0/1497031224 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff78c1548c0 0x7ff78c154d30 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7ff78c0a9650 tx=0x7ff78401c910 comp rx=0 tx=0).stop 2023-12-08T08:22:59.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.438+0000 7ff791bdf640 1 -- 172.21.15.88:0/1497031224 shutdown_connections 2023-12-08T08:22:59.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.438+0000 7ff791bdf640 1 --2- 172.21.15.88:0/1497031224 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff78c1548c0 0x7ff78c154d30 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:59.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.438+0000 7ff791bdf640 1 --2- 172.21.15.88:0/1497031224 >> v2:172.21.15.148:3300/0 conn(0x7ff78c0c5300 0x7ff78c0a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:59.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.438+0000 7ff791bdf640 1 -- 172.21.15.88:0/1497031224 >> 172.21.15.88:0/1497031224 conn(0x7ff78c0c59f0 msgr2=0x7ff78c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:22:59.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.438+0000 7ff791bdf640 1 -- 172.21.15.88:0/1497031224 shutdown_connections 2023-12-08T08:22:59.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.438+0000 7ff791bdf640 1 -- 172.21.15.88:0/1497031224 wait complete. 2023-12-08T08:22:59.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.442+0000 7ff791bdf640 1 Processor -- start 2023-12-08T08:22:59.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.442+0000 7ff791bdf640 1 -- start start 2023-12-08T08:22:59.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.442+0000 7ff791bdf640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff78c0c5300 0x7ff78c152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:59.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.442+0000 7ff791bdf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff78c14b1e0 0x7ff78c1ed460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:59.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.442+0000 7ff791bdf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff78c1548c0 0x7ff78c1ed9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:59.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.442+0000 7ff791bdf640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c1ed010 con 0x7ff78c1548c0 2023-12-08T08:22:59.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.442+0000 7ff791bdf640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c14bd90 con 0x7ff78c14b1e0 2023-12-08T08:22:59.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.442+0000 7ff791bdf640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c14cd80 con 0x7ff78c0c5300 2023-12-08T08:22:59.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.442+0000 7ff78bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff78c1548c0 0x7ff78c1ed9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:59.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.442+0000 7ff78bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff78c1548c0 0x7ff78c1ed9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60834/0 (socket says 172.21.15.88:60834) 2023-12-08T08:22:59.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.442+0000 7ff78bfff640 1 -- 172.21.15.88:0/1793866786 learned_addr learned my addr 172.21.15.88:0/1793866786 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:22:59.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.442+0000 7ff78affd640 1 --2- 172.21.15.88:0/1793866786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff78c14b1e0 0x7ff78c1ed460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:59.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.442+0000 7ff78b7fe640 1 --2- 172.21.15.88:0/1793866786 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff78c0c5300 0x7ff78c152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:59.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.442+0000 7ff78bfff640 1 -- 172.21.15.88:0/1793866786 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff78c0c5300 msgr2=0x7ff78c152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:59.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.442+0000 7ff78bfff640 1 --2- 172.21.15.88:0/1793866786 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff78c0c5300 0x7ff78c152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:59.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.442+0000 7ff78bfff640 1 -- 172.21.15.88:0/1793866786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff78c14b1e0 msgr2=0x7ff78c1ed460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:22:59.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.442+0000 7ff78bfff640 1 --2- 172.21.15.88:0/1793866786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff78c14b1e0 0x7ff78c1ed460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:22:59.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.442+0000 7ff78bfff640 1 -- 172.21.15.88:0/1793866786 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff784009a70 con 0x7ff78c1548c0 2023-12-08T08:22:59.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.442+0000 7ff78b7fe640 1 --2- 172.21.15.88:0/1793866786 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff78c0c5300 0x7ff78c152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:22:59.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.442+0000 7ff78bfff640 1 --2- 172.21.15.88:0/1793866786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff78c1548c0 0x7ff78c1ed9a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7ff7840b0040 tx=0x7ff7840196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:59.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.442+0000 7ff773fff640 1 -- 172.21.15.88:0/1793866786 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7840ad850 con 0x7ff78c1548c0 2023-12-08T08:22:59.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.442+0000 7ff773fff640 1 -- 172.21.15.88:0/1793866786 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7840ad9b0 con 0x7ff78c1548c0 2023-12-08T08:22:59.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.442+0000 7ff773fff640 1 -- 172.21.15.88:0/1793866786 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7840add60 con 0x7ff78c1548c0 2023-12-08T08:22:59.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.442+0000 7ff791bdf640 1 -- 172.21.15.88:0/1793866786 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff78c0bf7b0 con 0x7ff78c1548c0 2023-12-08T08:22:59.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.442+0000 7ff791bdf640 1 -- 172.21.15.88:0/1793866786 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff78c153440 con 0x7ff78c1548c0 2023-12-08T08:22:59.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.442+0000 7ff791bdf640 1 -- 172.21.15.88:0/1793866786 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff78c1ed180 con 0x7ff78c1548c0 2023-12-08T08:22:59.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.446+0000 7ff773fff640 1 -- 172.21.15.88:0/1793866786 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff7840b4050 con 0x7ff78c1548c0 2023-12-08T08:22:59.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.446+0000 7ff773fff640 1 --2- 172.21.15.88:0/1793866786 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff778066470 0x7ff778068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:22:59.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.446+0000 7ff773fff640 1 -- 172.21.15.88:0/1793866786 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5609+0+0 (secure 0 0 0) 0x7ff78411ec30 con 0x7ff78c1548c0 2023-12-08T08:22:59.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.446+0000 7ff78b7fe640 1 --2- 172.21.15.88:0/1793866786 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff778066470 0x7ff778068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:22:59.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.446+0000 7ff78b7fe640 1 --2- 172.21.15.88:0/1793866786 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff778066470 0x7ff778068930 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff77c005890 tx=0x7ff77c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:22:59.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.450+0000 7ff773fff640 1 -- 172.21.15.88:0/1793866786 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff78c1ed180 con 0x7ff78c1548c0 2023-12-08T08:22:59.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:22:59.634+0000 7ff791bdf640 1 -- 172.21.15.88:0/1793866786 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff78c1ed150 con 0x7ff78c1548c0 2023-12-08T08:23:00.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.250+0000 7ff773fff640 1 -- 172.21.15.88:0/1793866786 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v44) v1 ==== 174+0+0 (secure 0 0 0) 0x7ff7840ec220 con 0x7ff78c1548c0 2023-12-08T08:23:00.255 INFO:teuthology.orchestra.run.smithi088.stderr:new fs with metadata pool 12 and data pool 13 2023-12-08T08:23:00.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.254+0000 7ff791bdf640 1 -- 172.21.15.88:0/1793866786 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff778066470 msgr2=0x7ff778068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:00.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.254+0000 7ff791bdf640 1 --2- 172.21.15.88:0/1793866786 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff778066470 0x7ff778068930 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff77c005890 tx=0x7ff77c009040 comp rx=0 tx=0).stop 2023-12-08T08:23:00.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.254+0000 7ff791bdf640 1 -- 172.21.15.88:0/1793866786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff78c1548c0 msgr2=0x7ff78c1ed9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:00.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.254+0000 7ff791bdf640 1 --2- 172.21.15.88:0/1793866786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff78c1548c0 0x7ff78c1ed9a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7ff7840b0040 tx=0x7ff7840196b0 comp rx=0 tx=0).stop 2023-12-08T08:23:00.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.254+0000 7ff791bdf640 1 -- 172.21.15.88:0/1793866786 shutdown_connections 2023-12-08T08:23:00.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.254+0000 7ff791bdf640 1 --2- 172.21.15.88:0/1793866786 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff778066470 0x7ff778068930 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:00.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.254+0000 7ff791bdf640 1 --2- 172.21.15.88:0/1793866786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff78c1548c0 0x7ff78c1ed9a0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:00.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.254+0000 7ff791bdf640 1 --2- 172.21.15.88:0/1793866786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff78c14b1e0 0x7ff78c1ed460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:00.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.254+0000 7ff791bdf640 1 --2- 172.21.15.88:0/1793866786 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff78c0c5300 0x7ff78c152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:00.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.254+0000 7ff791bdf640 1 -- 172.21.15.88:0/1793866786 >> 172.21.15.88:0/1793866786 conn(0x7ff78c0c59f0 msgr2=0x7ff78c0c36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:00.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.254+0000 7ff791bdf640 1 -- 172.21.15.88:0/1793866786 shutdown_connections 2023-12-08T08:23:00.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.254+0000 7ff791bdf640 1 -- 172.21.15.88:0/1793866786 wait complete. 2023-12-08T08:23:00.306 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:23:00.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.442+0000 7f67f6ff5640 1 Processor -- start 2023-12-08T08:23:00.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.442+0000 7f67f6ff5640 1 -- start start 2023-12-08T08:23:00.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.442+0000 7f67f6ff5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f67f00af4c0 0x7f67f0154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:00.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.442+0000 7f67f6ff5640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f67f006c100 0x7f67f00c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:00.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.442+0000 7f67f6ff5640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f00c4890 con 0x7f67f00c67d0 2023-12-08T08:23:00.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.442+0000 7f67f6ff5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f0155460 con 0x7f67f00af4c0 2023-12-08T08:23:00.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.442+0000 7f67f6ff5640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f00af8a0 con 0x7f67f006c100 2023-12-08T08:23:00.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.442+0000 7f67f4d91640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f67f00af4c0 0x7f67f0154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:00.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.442+0000 7f67f4d91640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f67f00af4c0 0x7f67f0154f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49826/0 (socket says 172.21.15.88:49826) 2023-12-08T08:23:00.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.442+0000 7f67f4d91640 1 -- 172.21.15.88:0/66428603 learned_addr learned my addr 172.21.15.88:0/66428603 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:00.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.442+0000 7f67f4d91640 1 -- 172.21.15.88:0/66428603 >> v2:172.21.15.148:3300/0 conn(0x7f67f006c100 msgr2=0x7f67f00c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:00.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.442+0000 7f67f4d91640 1 --2- 172.21.15.88:0/66428603 >> v2:172.21.15.148:3300/0 conn(0x7f67f006c100 0x7f67f00c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:00.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.442+0000 7f67f4d91640 1 -- 172.21.15.88:0/66428603 >> v1:172.21.15.148:6789/0 conn(0x7f67f00c67d0 legacy=0x7f67f006b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:00.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.442+0000 7f67f4d91640 1 -- 172.21.15.88:0/66428603 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f00c4b30 con 0x7f67f00af4c0 2023-12-08T08:23:00.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.446+0000 7f67f4d91640 1 --2- 172.21.15.88:0/66428603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f00af4c0 0x7f67f0154f20 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f67f00c9d90 tx=0x7f67ec01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e014fda903e285d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:00.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.446+0000 7f67e77fe640 1 -- 172.21.15.88:0/66428603 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec0ab600 con 0x7f67f00af4c0 2023-12-08T08:23:00.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.446+0000 7f67e77fe640 1 -- 172.21.15.88:0/66428603 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ec0ab760 con 0x7f67f00af4c0 2023-12-08T08:23:00.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.446+0000 7f67e77fe640 1 -- 172.21.15.88:0/66428603 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec0abaf0 con 0x7f67f00af4c0 2023-12-08T08:23:00.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.446+0000 7f67f6ff5640 1 -- 172.21.15.88:0/66428603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f00af4c0 msgr2=0x7f67f0154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:00.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.446+0000 7f67f6ff5640 1 --2- 172.21.15.88:0/66428603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f00af4c0 0x7f67f0154f20 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f67f00c9d90 tx=0x7f67ec01c400 comp rx=0 tx=0).stop 2023-12-08T08:23:00.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.446+0000 7f67f6ff5640 1 -- 172.21.15.88:0/66428603 shutdown_connections 2023-12-08T08:23:00.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.446+0000 7f67f6ff5640 1 --2- 172.21.15.88:0/66428603 >> v2:172.21.15.148:3300/0 conn(0x7f67f006c100 0x7f67f00c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:00.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.446+0000 7f67f6ff5640 1 --2- 172.21.15.88:0/66428603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f00af4c0 0x7f67f0154f20 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:00.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.446+0000 7f67f6ff5640 1 -- 172.21.15.88:0/66428603 >> 172.21.15.88:0/66428603 conn(0x7f67f00ab9d0 msgr2=0x7f67f00abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:00.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.446+0000 7f67f6ff5640 1 -- 172.21.15.88:0/66428603 shutdown_connections 2023-12-08T08:23:00.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.446+0000 7f67f6ff5640 1 -- 172.21.15.88:0/66428603 wait complete. 2023-12-08T08:23:00.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.450+0000 7f67f6ff5640 1 Processor -- start 2023-12-08T08:23:00.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.450+0000 7f67f6ff5640 1 -- start start 2023-12-08T08:23:00.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.450+0000 7f67f6ff5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67f006c100 0x7f67f00aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:00.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.450+0000 7f67f6ff5640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67f00af4c0 0x7f67f01ede60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:00.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.450+0000 7f67f6ff5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f00c67d0 0x7f67f01eff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:00.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.450+0000 7f67f6ff5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f00adab0 con 0x7f67f00c67d0 2023-12-08T08:23:00.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.450+0000 7f67f6ff5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f00ad430 con 0x7f67f006c100 2023-12-08T08:23:00.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.450+0000 7f67f6ff5640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f01f0a10 con 0x7f67f00af4c0 2023-12-08T08:23:00.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.450+0000 7f67f5592640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f00c67d0 0x7f67f01eff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:00.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.450+0000 7f67f5592640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f00c67d0 0x7f67f01eff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49838/0 (socket says 172.21.15.88:49838) 2023-12-08T08:23:00.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.450+0000 7f67f5592640 1 -- 172.21.15.88:0/846766647 learned_addr learned my addr 172.21.15.88:0/846766647 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:00.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.450+0000 7f67f4d91640 1 --2- 172.21.15.88:0/846766647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67f006c100 0x7f67f00aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:00.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.450+0000 7f67e7fff640 1 --2- 172.21.15.88:0/846766647 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67f00af4c0 0x7f67f01ede60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:00.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.450+0000 7f67f5592640 1 -- 172.21.15.88:0/846766647 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67f00af4c0 msgr2=0x7f67f01ede60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:00.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.450+0000 7f67f5592640 1 --2- 172.21.15.88:0/846766647 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67f00af4c0 0x7f67f01ede60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:00.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.450+0000 7f67f5592640 1 -- 172.21.15.88:0/846766647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67f006c100 msgr2=0x7f67f00aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:00.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.450+0000 7f67f5592640 1 --2- 172.21.15.88:0/846766647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67f006c100 0x7f67f00aded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:00.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.450+0000 7f67f5592640 1 -- 172.21.15.88:0/846766647 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ec0094d0 con 0x7f67f00c67d0 2023-12-08T08:23:00.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.450+0000 7f67f5592640 1 --2- 172.21.15.88:0/846766647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f00c67d0 0x7f67f01eff60 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f67e800b970 tx=0x7f67e800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:00.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.450+0000 7f67e57fa640 1 -- 172.21.15.88:0/846766647 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e800cb40 con 0x7f67f00c67d0 2023-12-08T08:23:00.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.450+0000 7f67e57fa640 1 -- 172.21.15.88:0/846766647 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e800ccc0 con 0x7f67f00c67d0 2023-12-08T08:23:00.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.450+0000 7f67e57fa640 1 -- 172.21.15.88:0/846766647 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e8014680 con 0x7f67f00c67d0 2023-12-08T08:23:00.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.450+0000 7f67f6ff5640 1 -- 172.21.15.88:0/846766647 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f01f0cf0 con 0x7f67f00c67d0 2023-12-08T08:23:00.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.450+0000 7f67f6ff5640 1 -- 172.21.15.88:0/846766647 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f00ab400 con 0x7f67f00c67d0 2023-12-08T08:23:00.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.450+0000 7f67f6ff5640 1 -- 172.21.15.88:0/846766647 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f00adbf0 con 0x7f67f00c67d0 2023-12-08T08:23:00.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.454+0000 7f67e57fa640 1 -- 172.21.15.88:0/846766647 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f67e801d3b0 con 0x7f67f00c67d0 2023-12-08T08:23:00.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.454+0000 7f67e57fa640 1 --2- 172.21.15.88:0/846766647 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f67dc066470 0x7f67dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:00.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.454+0000 7f67e57fa640 1 -- 172.21.15.88:0/846766647 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67e8083dc0 con 0x7f67f00c67d0 2023-12-08T08:23:00.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.454+0000 7f67f4d91640 1 --2- 172.21.15.88:0/846766647 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f67dc066470 0x7f67dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:00.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.454+0000 7f67f4d91640 1 --2- 172.21.15.88:0/846766647 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f67dc066470 0x7f67dc068930 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0af000 tx=0x7f67ec0b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:00.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.458+0000 7f67e57fa640 1 -- 172.21.15.88:0/846766647 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f67f00adbf0 con 0x7f67f00c67d0 2023-12-08T08:23:00.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.610+0000 7f67f6ff5640 1 -- 172.21.15.88:0/846766647 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67f00adbf0 con 0x7f67f00c67d0 2023-12-08T08:23:00.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.614+0000 7f67e57fa640 1 -- 172.21.15.88:0/846766647 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16549 (secure 0 0 0) 0x7f67e80810c0 con 0x7f67f00c67d0 2023-12-08T08:23:00.618 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:00.618 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":67,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:22:59.637626+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:57.367467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:58.632605+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:23:00.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.614+0000 7f67f6ff5640 1 -- 172.21.15.88:0/846766647 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f67dc066470 msgr2=0x7f67dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:00.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.614+0000 7f67f6ff5640 1 --2- 172.21.15.88:0/846766647 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f67dc066470 0x7f67dc068930 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0af000 tx=0x7f67ec0b6040 comp rx=0 tx=0).stop 2023-12-08T08:23:00.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.614+0000 7f67f6ff5640 1 -- 172.21.15.88:0/846766647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f00c67d0 msgr2=0x7f67f01eff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:00.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.614+0000 7f67f6ff5640 1 --2- 172.21.15.88:0/846766647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f00c67d0 0x7f67f01eff60 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f67e800b970 tx=0x7f67e800be30 comp rx=0 tx=0).stop 2023-12-08T08:23:00.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.614+0000 7f67f6ff5640 1 -- 172.21.15.88:0/846766647 shutdown_connections 2023-12-08T08:23:00.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.614+0000 7f67f6ff5640 1 --2- 172.21.15.88:0/846766647 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f67dc066470 0x7f67dc068930 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:00.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.614+0000 7f67f6ff5640 1 --2- 172.21.15.88:0/846766647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f00c67d0 0x7f67f01eff60 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:00.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.614+0000 7f67f6ff5640 1 --2- 172.21.15.88:0/846766647 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f67f00af4c0 0x7f67f01ede60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:00.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.614+0000 7f67f6ff5640 1 --2- 172.21.15.88:0/846766647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f67f006c100 0x7f67f00aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:00.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.614+0000 7f67f6ff5640 1 -- 172.21.15.88:0/846766647 >> 172.21.15.88:0/846766647 conn(0x7f67f00ab9d0 msgr2=0x7f67f0157a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:00.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.614+0000 7f67f6ff5640 1 -- 172.21.15.88:0/846766647 shutdown_connections 2023-12-08T08:23:00.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.614+0000 7f67f6ff5640 1 -- 172.21.15.88:0/846766647 wait complete. 2023-12-08T08:23:00.638 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:23:00.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.770+0000 7fe44b3aa640 1 Processor -- start 2023-12-08T08:23:00.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.770+0000 7fe44b3aa640 1 -- start start 2023-12-08T08:23:00.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe44b3aa640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe44406d690 0x7fe4440c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:00.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe44b3aa640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe44406db20 con 0x7fe44406d2b0 2023-12-08T08:23:00.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe44b3aa640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe44406bb80 con 0x7fe4440c3b80 2023-12-08T08:23:00.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe44b3aa640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4440c5840 con 0x7fe44406d690 2023-12-08T08:23:00.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe449146640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe44406d2b0 0x7fe44406c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41200/0 (socket says 172.21.15.88:41200) 2023-12-08T08:23:00.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe449146640 1 -- 172.21.15.88:0/504186916 learned_addr learned my addr 172.21.15.88:0/504186916 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:00.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe449947640 1 --2- 172.21.15.88:0/504186916 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe44406d690 0x7fe4440c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:00.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe43bfff640 1 -- 172.21.15.88:0/504186916 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4124576168 0 0) 0x7fe440001120 con 0x7fe44406d2b0 2023-12-08T08:23:00.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe43bfff640 1 -- 172.21.15.88:0/504186916 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe430003530 con 0x7fe44406d2b0 2023-12-08T08:23:00.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe43bfff640 1 -- 172.21.15.88:0/504186916 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 525504681 0 0) 0x7fe430003530 con 0x7fe44406d2b0 2023-12-08T08:23:00.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe43bfff640 1 -- 172.21.15.88:0/504186916 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe44406d690 msgr2=0x7fe4440c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:00.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe43bfff640 1 --2- 172.21.15.88:0/504186916 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe44406d690 0x7fe4440c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:00.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe43bfff640 1 -- 172.21.15.88:0/504186916 >> v1:172.21.15.148:6789/0 conn(0x7fe4440c3b80 legacy=0x7fe44406c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:00.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe43bfff640 1 -- 172.21.15.88:0/504186916 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4441515c0 con 0x7fe44406d2b0 2023-12-08T08:23:00.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe43bfff640 1 -- 172.21.15.88:0/504186916 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7fe440001810 con 0x7fe44406d2b0 2023-12-08T08:23:00.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe43bfff640 1 -- 172.21.15.88:0/504186916 >> v1:172.21.15.88:6789/0 conn(0x7fe44406d2b0 legacy=0x7fe44406c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:00.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe43bfff640 1 --2- 172.21.15.88:0/504186916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4300039b0 0x7fe430003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:00.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe43bfff640 1 --2- 172.21.15.88:0/504186916 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe44406d690 0x7fe4300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:00.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe43bfff640 1 --2- 172.21.15.88:0/504186916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe430004d10 0x7fe430005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:00.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe43bfff640 1 -- 172.21.15.88:0/504186916 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4440c5840 con 0x7fe430004d10 2023-12-08T08:23:00.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe43bfff640 1 -- 172.21.15.88:0/504186916 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43000b9c0 con 0x7fe4300039b0 2023-12-08T08:23:00.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe43bfff640 1 -- 172.21.15.88:0/504186916 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43000dd90 con 0x7fe44406d690 2023-12-08T08:23:00.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe449146640 1 --2- 172.21.15.88:0/504186916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4300039b0 0x7fe430003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:00.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe448945640 1 --2- 172.21.15.88:0/504186916 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe44406d690 0x7fe4300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:00.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe449947640 1 --2- 172.21.15.88:0/504186916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe430004d10 0x7fe430005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:00.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe448945640 1 -- 172.21.15.88:0/504186916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4300039b0 msgr2=0x7fe430003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:00.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe448945640 1 --2- 172.21.15.88:0/504186916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4300039b0 0x7fe430003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:00.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe448945640 1 -- 172.21.15.88:0/504186916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe430004d10 msgr2=0x7fe430005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:00.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe448945640 1 --2- 172.21.15.88:0/504186916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe430004d10 0x7fe430005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:00.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe448945640 1 -- 172.21.15.88:0/504186916 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe430003530 con 0x7fe44406d690 2023-12-08T08:23:00.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.774+0000 7fe449947640 1 --2- 172.21.15.88:0/504186916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe430004d10 0x7fe430005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:23:00.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.778+0000 7fe448945640 1 --2- 172.21.15.88:0/504186916 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe44406d690 0x7fe4300047d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe434001860 tx=0x7fe43401c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=436f266d5ecc2e46 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:00.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.778+0000 7fe43bfff640 1 -- 172.21.15.88:0/504186916 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4340ab600 con 0x7fe44406d690 2023-12-08T08:23:00.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.778+0000 7fe43bfff640 1 -- 172.21.15.88:0/504186916 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4340a7050 con 0x7fe44406d690 2023-12-08T08:23:00.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.778+0000 7fe43bfff640 1 -- 172.21.15.88:0/504186916 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4340ab9a0 con 0x7fe44406d690 2023-12-08T08:23:00.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.778+0000 7fe44b3aa640 1 -- 172.21.15.88:0/504186916 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe44406d690 msgr2=0x7fe4300047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:00.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.778+0000 7fe44b3aa640 1 --2- 172.21.15.88:0/504186916 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe44406d690 0x7fe4300047d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe434001860 tx=0x7fe43401c420 comp rx=0 tx=0).stop 2023-12-08T08:23:00.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.778+0000 7fe449947640 1 -- 172.21.15.88:0/504186916 reap_dead start 2023-12-08T08:23:00.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.778+0000 7fe44b3aa640 1 -- 172.21.15.88:0/504186916 shutdown_connections 2023-12-08T08:23:00.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.778+0000 7fe44b3aa640 1 -- 172.21.15.88:0/504186916 >> 172.21.15.88:0/504186916 conn(0x7fe4440a7810 msgr2=0x7fe4440a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:00.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.778+0000 7fe44b3aa640 1 -- 172.21.15.88:0/504186916 shutdown_connections 2023-12-08T08:23:00.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.778+0000 7fe44b3aa640 1 -- 172.21.15.88:0/504186916 wait complete. 2023-12-08T08:23:00.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.778+0000 7fe44b3aa640 1 Processor -- start 2023-12-08T08:23:00.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.782+0000 7fe44b3aa640 1 -- start start 2023-12-08T08:23:00.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.782+0000 7fe44b3aa640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe44406d690 0x7fe444155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:00.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.782+0000 7fe44b3aa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe44414b080 0x7fe4440bf690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:00.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.782+0000 7fe44b3aa640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4440a8900 0x7fe4441ed380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:00.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.782+0000 7fe44b3aa640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe444153890 con 0x7fe44414b080 2023-12-08T08:23:00.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.782+0000 7fe44b3aa640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4441548f0 con 0x7fe4440a8900 2023-12-08T08:23:00.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.782+0000 7fe44b3aa640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4441541f0 con 0x7fe44406d690 2023-12-08T08:23:00.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.782+0000 7fe448945640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe44414b080 0x7fe4440bf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:00.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.782+0000 7fe448945640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe44414b080 0x7fe4440bf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49860/0 (socket says 172.21.15.88:49860) 2023-12-08T08:23:00.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.782+0000 7fe448945640 1 -- 172.21.15.88:0/618112301 learned_addr learned my addr 172.21.15.88:0/618112301 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:00.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.782+0000 7fe449146640 1 --2- 172.21.15.88:0/618112301 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe44406d690 0x7fe444155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:00.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.782+0000 7fe449947640 1 --2- 172.21.15.88:0/618112301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4440a8900 0x7fe4441ed380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:00.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.782+0000 7fe448945640 1 -- 172.21.15.88:0/618112301 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe44406d690 msgr2=0x7fe444155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:00.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.782+0000 7fe448945640 1 --2- 172.21.15.88:0/618112301 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe44406d690 0x7fe444155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:00.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.782+0000 7fe448945640 1 -- 172.21.15.88:0/618112301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4440a8900 msgr2=0x7fe4441ed380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:00.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.782+0000 7fe448945640 1 --2- 172.21.15.88:0/618112301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4440a8900 0x7fe4441ed380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:00.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.782+0000 7fe448945640 1 -- 172.21.15.88:0/618112301 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4441532d0 con 0x7fe44414b080 2023-12-08T08:23:00.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.782+0000 7fe448945640 1 --2- 172.21.15.88:0/618112301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe44414b080 0x7fe4440bf690 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe434001860 tx=0x7fe430005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:00.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.782+0000 7fe439ffb640 1 -- 172.21.15.88:0/618112301 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4340054e0 con 0x7fe44414b080 2023-12-08T08:23:00.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.782+0000 7fe439ffb640 1 -- 172.21.15.88:0/618112301 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe434007040 con 0x7fe44414b080 2023-12-08T08:23:00.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.782+0000 7fe44b3aa640 1 -- 172.21.15.88:0/618112301 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4441535b0 con 0x7fe44414b080 2023-12-08T08:23:00.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.782+0000 7fe439ffb640 1 -- 172.21.15.88:0/618112301 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4340073b0 con 0x7fe44414b080 2023-12-08T08:23:00.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.782+0000 7fe44b3aa640 1 -- 172.21.15.88:0/618112301 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4441544d0 con 0x7fe44414b080 2023-12-08T08:23:00.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.782+0000 7fe44b3aa640 1 -- 172.21.15.88:0/618112301 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe444067630 con 0x7fe44414b080 2023-12-08T08:23:00.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.786+0000 7fe439ffb640 1 -- 172.21.15.88:0/618112301 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe4340b2050 con 0x7fe44414b080 2023-12-08T08:23:00.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.786+0000 7fe439ffb640 1 --2- 172.21.15.88:0/618112301 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe428066470 0x7fe428068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:00.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.786+0000 7fe439ffb640 1 -- 172.21.15.88:0/618112301 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe43411dc20 con 0x7fe44414b080 2023-12-08T08:23:00.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.786+0000 7fe449146640 1 --2- 172.21.15.88:0/618112301 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe428066470 0x7fe428068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:00.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.786+0000 7fe449146640 1 --2- 172.21.15.88:0/618112301 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe428066470 0x7fe428068930 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe440000f70 tx=0x7fe440000ee0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:00.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.790+0000 7fe439ffb640 1 -- 172.21.15.88:0/618112301 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe4340eec60 con 0x7fe44414b080 2023-12-08T08:23:00.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.942+0000 7fe44b3aa640 1 -- 172.21.15.88:0/618112301 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe44406bd70 con 0x7fe44414b080 2023-12-08T08:23:00.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.942+0000 7fe439ffb640 1 -- 172.21.15.88:0/618112301 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16549 (secure 0 0 0) 0x7fe4340ee7f0 con 0x7fe44414b080 2023-12-08T08:23:00.948 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:00.948 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":67,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:22:59.637626+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:57.367467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:58.632605+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:23:00.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.946+0000 7fe44b3aa640 1 -- 172.21.15.88:0/618112301 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe428066470 msgr2=0x7fe428068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:00.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.946+0000 7fe44b3aa640 1 --2- 172.21.15.88:0/618112301 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe428066470 0x7fe428068930 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe440000f70 tx=0x7fe440000ee0 comp rx=0 tx=0).stop 2023-12-08T08:23:00.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.946+0000 7fe44b3aa640 1 -- 172.21.15.88:0/618112301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe44414b080 msgr2=0x7fe4440bf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:00.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.946+0000 7fe44b3aa640 1 --2- 172.21.15.88:0/618112301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe44414b080 0x7fe4440bf690 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe434001860 tx=0x7fe430005800 comp rx=0 tx=0).stop 2023-12-08T08:23:00.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.946+0000 7fe44b3aa640 1 -- 172.21.15.88:0/618112301 shutdown_connections 2023-12-08T08:23:00.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.946+0000 7fe44b3aa640 1 --2- 172.21.15.88:0/618112301 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe428066470 0x7fe428068930 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:00.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.946+0000 7fe44b3aa640 1 --2- 172.21.15.88:0/618112301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4440a8900 0x7fe4441ed380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:00.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.946+0000 7fe44b3aa640 1 --2- 172.21.15.88:0/618112301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe44414b080 0x7fe4440bf690 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:00.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.946+0000 7fe44b3aa640 1 --2- 172.21.15.88:0/618112301 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe44406d690 0x7fe444155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:00.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.946+0000 7fe44b3aa640 1 -- 172.21.15.88:0/618112301 >> 172.21.15.88:0/618112301 conn(0x7fe4440a7810 msgr2=0x7fe4440c41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:00.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.946+0000 7fe44b3aa640 1 -- 172.21.15.88:0/618112301 shutdown_connections 2023-12-08T08:23:00.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:00.946+0000 7fe44b3aa640 1 -- 172.21.15.88:0/618112301 wait complete. 2023-12-08T08:23:00.969 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-08T08:23:01.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.102+0000 7f9467c79640 1 Processor -- start 2023-12-08T08:23:01.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.102+0000 7f9467c79640 1 -- start start 2023-12-08T08:23:01.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.106+0000 7f9467c79640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f946014b1e0 0x7f94600c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:01.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.106+0000 7f9467c79640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f94601548c0 0x7f9460154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:01.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.106+0000 7f9467c79640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94600a4e20 con 0x7f94600c5300 2023-12-08T08:23:01.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.106+0000 7f9467c79640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94600a50e0 con 0x7f94601548c0 2023-12-08T08:23:01.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.106+0000 7f9467c79640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94600c0f00 con 0x7f946014b1e0 2023-12-08T08:23:01.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.106+0000 7f9466216640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f94601548c0 0x7f9460154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:01.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.106+0000 7f9466216640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f94601548c0 0x7f9460154d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49876/0 (socket says 172.21.15.88:49876) 2023-12-08T08:23:01.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.106+0000 7f9466216640 1 -- 172.21.15.88:0/2850443874 learned_addr learned my addr 172.21.15.88:0/2850443874 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:01.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.106+0000 7f9465a15640 1 --2- 172.21.15.88:0/2850443874 >> v2:172.21.15.148:3300/0 conn(0x7f946014b1e0 0x7f94600c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:01.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.106+0000 7f9466216640 1 -- 172.21.15.88:0/2850443874 >> v2:172.21.15.148:3300/0 conn(0x7f946014b1e0 msgr2=0x7f94600c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:01.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.106+0000 7f9466216640 1 --2- 172.21.15.88:0/2850443874 >> v2:172.21.15.148:3300/0 conn(0x7f946014b1e0 0x7f94600c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:01.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.106+0000 7f9466216640 1 -- 172.21.15.88:0/2850443874 >> v1:172.21.15.148:6789/0 conn(0x7f94600c5300 legacy=0x7f94600a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:01.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.106+0000 7f9466216640 1 -- 172.21.15.88:0/2850443874 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94600c11e0 con 0x7f94601548c0 2023-12-08T08:23:01.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.110+0000 7f9466216640 1 --2- 172.21.15.88:0/2850443874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94601548c0 0x7f9460154d30 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f94600c4150 tx=0x7f945801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f2922710eaf7fe server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:01.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.110+0000 7f9464a13640 1 -- 172.21.15.88:0/2850443874 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94580a57a0 con 0x7f94601548c0 2023-12-08T08:23:01.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.110+0000 7f9464a13640 1 -- 172.21.15.88:0/2850443874 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94580a5900 con 0x7f94601548c0 2023-12-08T08:23:01.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.110+0000 7f9464a13640 1 -- 172.21.15.88:0/2850443874 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94580a5c90 con 0x7f94601548c0 2023-12-08T08:23:01.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.110+0000 7f9467c79640 1 -- 172.21.15.88:0/2850443874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94601548c0 msgr2=0x7f9460154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:01.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.110+0000 7f9467c79640 1 --2- 172.21.15.88:0/2850443874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94601548c0 0x7f9460154d30 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f94600c4150 tx=0x7f945801c9d0 comp rx=0 tx=0).stop 2023-12-08T08:23:01.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.110+0000 7f9467c79640 1 -- 172.21.15.88:0/2850443874 shutdown_connections 2023-12-08T08:23:01.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.110+0000 7f9467c79640 1 --2- 172.21.15.88:0/2850443874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94601548c0 0x7f9460154d30 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:01.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.110+0000 7f9467c79640 1 --2- 172.21.15.88:0/2850443874 >> v2:172.21.15.148:3300/0 conn(0x7f946014b1e0 0x7f94600c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:01.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.110+0000 7f9467c79640 1 -- 172.21.15.88:0/2850443874 >> 172.21.15.88:0/2850443874 conn(0x7f94600c59f0 msgr2=0x7f94600c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:01.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.110+0000 7f9467c79640 1 -- 172.21.15.88:0/2850443874 shutdown_connections 2023-12-08T08:23:01.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.110+0000 7f9467c79640 1 -- 172.21.15.88:0/2850443874 wait complete. 2023-12-08T08:23:01.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.110+0000 7f9467c79640 1 Processor -- start 2023-12-08T08:23:01.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.110+0000 7f9467c79640 1 -- start start 2023-12-08T08:23:01.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.110+0000 7f9467c79640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94600c5300 0x7f94600aab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:01.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.110+0000 7f9467c79640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f946014b1e0 0x7f94601eaf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:01.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.110+0000 7f9467c79640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94601548c0 0x7f94601eb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:01.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.110+0000 7f9467c79640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94600727c0 con 0x7f94600c5300 2023-12-08T08:23:01.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.110+0000 7f9467c79640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94601461e0 con 0x7f946014b1e0 2023-12-08T08:23:01.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.110+0000 7f9467c79640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9460151b50 con 0x7f94601548c0 2023-12-08T08:23:01.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.114+0000 7f9465a15640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94600c5300 0x7f94600aab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:01.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.114+0000 7f9465a15640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94600c5300 0x7f94600aab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49882/0 (socket says 172.21.15.88:49882) 2023-12-08T08:23:01.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.114+0000 7f9465a15640 1 -- 172.21.15.88:0/2698475295 learned_addr learned my addr 172.21.15.88:0/2698475295 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:01.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.114+0000 7f9465214640 1 --2- 172.21.15.88:0/2698475295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f946014b1e0 0x7f94601eaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:01.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.114+0000 7f9466216640 1 --2- 172.21.15.88:0/2698475295 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94601548c0 0x7f94601eb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:01.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.114+0000 7f9465a15640 1 -- 172.21.15.88:0/2698475295 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94601548c0 msgr2=0x7f94601eb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:01.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.114+0000 7f9465a15640 1 --2- 172.21.15.88:0/2698475295 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94601548c0 0x7f94601eb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:01.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.114+0000 7f9465a15640 1 -- 172.21.15.88:0/2698475295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f946014b1e0 msgr2=0x7f94601eaf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:01.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.114+0000 7f9465a15640 1 --2- 172.21.15.88:0/2698475295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f946014b1e0 0x7f94601eaf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:01.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.114+0000 7f9465a15640 1 -- 172.21.15.88:0/2698475295 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9458009b30 con 0x7f94600c5300 2023-12-08T08:23:01.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.114+0000 7f9466216640 1 --2- 172.21.15.88:0/2698475295 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94601548c0 0x7f94601eb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:01.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.114+0000 7f9465214640 1 --2- 172.21.15.88:0/2698475295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f946014b1e0 0x7f94601eaf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:01.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.114+0000 7f9465a15640 1 --2- 172.21.15.88:0/2698475295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94600c5300 0x7f94600aab40 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f945c00d800 tx=0x7f945c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:01.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.114+0000 7f94567fc640 1 -- 172.21.15.88:0/2698475295 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c00b6c0 con 0x7f94600c5300 2023-12-08T08:23:01.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.114+0000 7f94567fc640 1 -- 172.21.15.88:0/2698475295 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945c00b860 con 0x7f94600c5300 2023-12-08T08:23:01.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.114+0000 7f94567fc640 1 -- 172.21.15.88:0/2698475295 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c00bc10 con 0x7f94600c5300 2023-12-08T08:23:01.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.114+0000 7f9467c79640 1 -- 172.21.15.88:0/2698475295 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94601eaa80 con 0x7f94600c5300 2023-12-08T08:23:01.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.114+0000 7f9467c79640 1 -- 172.21.15.88:0/2698475295 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94601eebb0 con 0x7f94600c5300 2023-12-08T08:23:01.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.114+0000 7f9467c79640 1 -- 172.21.15.88:0/2698475295 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9460067630 con 0x7f94600c5300 2023-12-08T08:23:01.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.114+0000 7f94567fc640 1 -- 172.21.15.88:0/2698475295 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f945c01e460 con 0x7f94600c5300 2023-12-08T08:23:01.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.114+0000 7f94567fc640 1 --2- 172.21.15.88:0/2698475295 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9444066470 0x7f9444068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:01.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.118+0000 7f94567fc640 1 -- 172.21.15.88:0/2698475295 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f945c084410 con 0x7f94600c5300 2023-12-08T08:23:01.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.118+0000 7f9465214640 1 --2- 172.21.15.88:0/2698475295 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9444066470 0x7f9444068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:01.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.118+0000 7f9465214640 1 --2- 172.21.15.88:0/2698475295 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9444066470 0x7f9444068930 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9460072d90 tx=0x7f9450009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:01.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.118+0000 7f94567fc640 1 -- 172.21.15.88:0/2698475295 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f945c051920 con 0x7f94600c5300 2023-12-08T08:23:01.236 INFO:tasks.ceph.mds.c.smithi088.stderr:2023-12-08T08:23:01.230+0000 7f8e66e3a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:23:01.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:01.314+0000 7f9467c79640 1 -- 172.21.15.88:0/2698475295 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9460154e70 con 0x7f94600c5300 2023-12-08T08:23:02.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.282+0000 7f94567fc640 1 -- 172.21.15.88:0/2698475295 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v46) v1 ==== 118+0+0 (secure 0 0 0) 0x7f945c054f40 con 0x7f94600c5300 2023-12-08T08:23:02.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.286+0000 7f9467c79640 1 -- 172.21.15.88:0/2698475295 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9444066470 msgr2=0x7f9444068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:02.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.286+0000 7f9467c79640 1 --2- 172.21.15.88:0/2698475295 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9444066470 0x7f9444068930 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9460072d90 tx=0x7f9450009040 comp rx=0 tx=0).stop 2023-12-08T08:23:02.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.286+0000 7f9467c79640 1 -- 172.21.15.88:0/2698475295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94600c5300 msgr2=0x7f94600aab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:02.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.286+0000 7f9467c79640 1 --2- 172.21.15.88:0/2698475295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94600c5300 0x7f94600aab40 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f945c00d800 tx=0x7f945c00dcc0 comp rx=0 tx=0).stop 2023-12-08T08:23:02.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.286+0000 7f9467c79640 1 -- 172.21.15.88:0/2698475295 shutdown_connections 2023-12-08T08:23:02.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.286+0000 7f9467c79640 1 --2- 172.21.15.88:0/2698475295 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9444066470 0x7f9444068930 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:02.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.286+0000 7f9467c79640 1 --2- 172.21.15.88:0/2698475295 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f94601548c0 0x7f94601eb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:02.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.286+0000 7f9467c79640 1 --2- 172.21.15.88:0/2698475295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f946014b1e0 0x7f94601eaf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:02.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.286+0000 7f9467c79640 1 --2- 172.21.15.88:0/2698475295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94600c5300 0x7f94600aab40 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:02.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.286+0000 7f9467c79640 1 -- 172.21.15.88:0/2698475295 >> 172.21.15.88:0/2698475295 conn(0x7f94600c59f0 msgr2=0x7f94600c4180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:02.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.286+0000 7f9467c79640 1 -- 172.21.15.88:0/2698475295 shutdown_connections 2023-12-08T08:23:02.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.286+0000 7f9467c79640 1 -- 172.21.15.88:0/2698475295 wait complete. 2023-12-08T08:23:02.310 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-08T08:23:02.310 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-08T08:23:02.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.446+0000 7fabfb3df640 1 Processor -- start 2023-12-08T08:23:02.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.446+0000 7fabfb3df640 1 -- start start 2023-12-08T08:23:02.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.446+0000 7fabfb3df640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fabf4156200 0x7fabf40c0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:02.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.446+0000 7fabfb3df640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fabf415bf70 0x7fabf415c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:02.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.446+0000 7fabfb3df640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf406bce0 con 0x7fabf40c0e10 2023-12-08T08:23:02.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.446+0000 7fabfb3df640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf406d8d0 con 0x7fabf4156200 2023-12-08T08:23:02.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.446+0000 7fabfb3df640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf40c2270 con 0x7fabf415bf70 2023-12-08T08:23:02.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.446+0000 7fabf917b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fabf4156200 0x7fabf40c0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:02.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.446+0000 7fabf917b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fabf4156200 0x7fabf40c0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49894/0 (socket says 172.21.15.88:49894) 2023-12-08T08:23:02.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.446+0000 7fabf897a640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fabf40c0e10 0x7fabf40c1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41214/0 (socket says 172.21.15.88:41214) 2023-12-08T08:23:02.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.446+0000 7fabf917b640 1 -- 172.21.15.88:0/2572784279 learned_addr learned my addr 172.21.15.88:0/2572784279 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:02.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.450+0000 7fabf997c640 1 --2- 172.21.15.88:0/2572784279 >> v2:172.21.15.148:3300/0 conn(0x7fabf415bf70 0x7fabf415c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:02.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.450+0000 7fabf917b640 1 -- 172.21.15.88:0/2572784279 >> v2:172.21.15.148:3300/0 conn(0x7fabf415bf70 msgr2=0x7fabf415c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:02.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.450+0000 7fabf917b640 1 --2- 172.21.15.88:0/2572784279 >> v2:172.21.15.148:3300/0 conn(0x7fabf415bf70 0x7fabf415c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:02.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.450+0000 7fabf917b640 1 -- 172.21.15.88:0/2572784279 >> v1:172.21.15.88:6789/0 conn(0x7fabf40c0e10 legacy=0x7fabf40c1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:02.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.450+0000 7fabebfff640 1 -- 172.21.15.88:0/2572784279 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304623694 0 0) 0x7fabf406bce0 con 0x7fabf40c0e10 2023-12-08T08:23:02.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.450+0000 7fabf917b640 1 -- 172.21.15.88:0/2572784279 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf415cc60 con 0x7fabf4156200 2023-12-08T08:23:02.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.450+0000 7fabf997c640 1 --2- 172.21.15.88:0/2572784279 >> v2:172.21.15.148:3300/0 conn(0x7fabf415bf70 0x7fabf415c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:02.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.450+0000 7fabf917b640 1 --2- 172.21.15.88:0/2572784279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabf4156200 0x7fabf40c0370 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fabf40c6ad0 tx=0x7fabf001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed04fc5e90991413 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:02.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.450+0000 7fabebfff640 1 -- 172.21.15.88:0/2572784279 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf00ab600 con 0x7fabf4156200 2023-12-08T08:23:02.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.450+0000 7fabebfff640 1 -- 172.21.15.88:0/2572784279 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf00a7050 con 0x7fabf4156200 2023-12-08T08:23:02.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.450+0000 7fabebfff640 1 -- 172.21.15.88:0/2572784279 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf00ab980 con 0x7fabf4156200 2023-12-08T08:23:02.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.450+0000 7fabfb3df640 1 -- 172.21.15.88:0/2572784279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabf4156200 msgr2=0x7fabf40c0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:02.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.450+0000 7fabfb3df640 1 --2- 172.21.15.88:0/2572784279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabf4156200 0x7fabf40c0370 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fabf40c6ad0 tx=0x7fabf001c3b0 comp rx=0 tx=0).stop 2023-12-08T08:23:02.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.450+0000 7fabfb3df640 1 -- 172.21.15.88:0/2572784279 shutdown_connections 2023-12-08T08:23:02.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.450+0000 7fabfb3df640 1 --2- 172.21.15.88:0/2572784279 >> v2:172.21.15.148:3300/0 conn(0x7fabf415bf70 0x7fabf415c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:02.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.450+0000 7fabfb3df640 1 --2- 172.21.15.88:0/2572784279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabf4156200 0x7fabf40c0370 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:02.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.450+0000 7fabfb3df640 1 -- 172.21.15.88:0/2572784279 >> 172.21.15.88:0/2572784279 conn(0x7fabf40c59f0 msgr2=0x7fabf40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:02.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.454+0000 7fabfb3df640 1 -- 172.21.15.88:0/2572784279 shutdown_connections 2023-12-08T08:23:02.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.454+0000 7fabfb3df640 1 -- 172.21.15.88:0/2572784279 wait complete. 2023-12-08T08:23:02.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.454+0000 7fabfb3df640 1 Processor -- start 2023-12-08T08:23:02.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.454+0000 7fabfb3df640 1 -- start start 2023-12-08T08:23:02.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.454+0000 7fabfb3df640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabf40c0e10 0x7fabf40ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:02.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.454+0000 7fabfb3df640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabf4156200 0x7fabf41586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:02.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.454+0000 7fabfb3df640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabf415bf70 0x7fabf4148b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:02.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.454+0000 7fabfb3df640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf40aabe0 con 0x7fabf415bf70 2023-12-08T08:23:02.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.454+0000 7fabfb3df640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf40abb20 con 0x7fabf40c0e10 2023-12-08T08:23:02.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.454+0000 7fabfb3df640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf4157780 con 0x7fabf4156200 2023-12-08T08:23:02.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.454+0000 7fabf997c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabf415bf70 0x7fabf4148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:02.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.454+0000 7fabf997c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabf415bf70 0x7fabf4148b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49898/0 (socket says 172.21.15.88:49898) 2023-12-08T08:23:02.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.454+0000 7fabf997c640 1 -- 172.21.15.88:0/3352008552 learned_addr learned my addr 172.21.15.88:0/3352008552 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:02.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.454+0000 7fabf897a640 1 --2- 172.21.15.88:0/3352008552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabf4156200 0x7fabf41586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:02.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.454+0000 7fabf997c640 1 -- 172.21.15.88:0/3352008552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabf4156200 msgr2=0x7fabf41586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:02.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.454+0000 7fabf917b640 1 --2- 172.21.15.88:0/3352008552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabf40c0e10 0x7fabf40ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:02.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.454+0000 7fabf997c640 1 --2- 172.21.15.88:0/3352008552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabf4156200 0x7fabf41586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:02.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.454+0000 7fabf997c640 1 -- 172.21.15.88:0/3352008552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabf40c0e10 msgr2=0x7fabf40ab5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:02.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.454+0000 7fabf997c640 1 --2- 172.21.15.88:0/3352008552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabf40c0e10 0x7fabf40ab5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:02.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.454+0000 7fabf997c640 1 -- 172.21.15.88:0/3352008552 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf00094d0 con 0x7fabf415bf70 2023-12-08T08:23:02.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.454+0000 7fabf897a640 1 --2- 172.21.15.88:0/3352008552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabf4156200 0x7fabf41586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:02.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.454+0000 7fabf917b640 1 --2- 172.21.15.88:0/3352008552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabf40c0e10 0x7fabf40ab5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:02.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.454+0000 7fabf997c640 1 --2- 172.21.15.88:0/3352008552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabf415bf70 0x7fabf4148b10 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fabec00cef0 tx=0x7fabec00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:02.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.458+0000 7fabe9ffb640 1 -- 172.21.15.88:0/3352008552 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec00d840 con 0x7fabf415bf70 2023-12-08T08:23:02.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.458+0000 7fabe9ffb640 1 -- 172.21.15.88:0/3352008552 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabec00d9c0 con 0x7fabf415bf70 2023-12-08T08:23:02.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.458+0000 7fabfb3df640 1 -- 172.21.15.88:0/3352008552 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf4158200 con 0x7fabf415bf70 2023-12-08T08:23:02.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.458+0000 7fabe9ffb640 1 -- 172.21.15.88:0/3352008552 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec00dd70 con 0x7fabf415bf70 2023-12-08T08:23:02.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.458+0000 7fabfb3df640 1 -- 172.21.15.88:0/3352008552 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf4157130 con 0x7fabf415bf70 2023-12-08T08:23:02.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.458+0000 7fabfb3df640 1 -- 172.21.15.88:0/3352008552 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf40ab300 con 0x7fabf415bf70 2023-12-08T08:23:02.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.458+0000 7fabe9ffb640 1 -- 172.21.15.88:0/3352008552 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fabec01e3b0 con 0x7fabf415bf70 2023-12-08T08:23:02.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.458+0000 7fabe9ffb640 1 --2- 172.21.15.88:0/3352008552 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fabd8066470 0x7fabd8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:02.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.458+0000 7fabe9ffb640 1 -- 172.21.15.88:0/3352008552 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabec084870 con 0x7fabf415bf70 2023-12-08T08:23:02.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.458+0000 7fabf917b640 1 --2- 172.21.15.88:0/3352008552 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fabd8066470 0x7fabd8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:02.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.458+0000 7fabf917b640 1 --2- 172.21.15.88:0/3352008552 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fabd8066470 0x7fabd8068930 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fabf00ad000 tx=0x7fabf0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:02.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.462+0000 7fabe9ffb640 1 -- 172.21.15.88:0/3352008552 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fabf40ab300 con 0x7fabf415bf70 2023-12-08T08:23:02.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:02.642+0000 7fabfb3df640 1 -- 172.21.15.88:0/3352008552 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fabf40ab300 con 0x7fabf415bf70 2023-12-08T08:23:03.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.290+0000 7fabe9ffb640 1 -- 172.21.15.88:0/3352008552 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v47) v1 ==== 122+0+0 (secure 0 0 0) 0x7fabf40ab300 con 0x7fabf415bf70 2023-12-08T08:23:03.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.290+0000 7fabfb3df640 1 -- 172.21.15.88:0/3352008552 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fabd8066470 msgr2=0x7fabd8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:03.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.290+0000 7fabfb3df640 1 --2- 172.21.15.88:0/3352008552 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fabd8066470 0x7fabd8068930 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fabf00ad000 tx=0x7fabf0008040 comp rx=0 tx=0).stop 2023-12-08T08:23:03.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.290+0000 7fabfb3df640 1 -- 172.21.15.88:0/3352008552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabf415bf70 msgr2=0x7fabf4148b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:03.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.290+0000 7fabfb3df640 1 --2- 172.21.15.88:0/3352008552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabf415bf70 0x7fabf4148b10 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fabec00cef0 tx=0x7fabec00a710 comp rx=0 tx=0).stop 2023-12-08T08:23:03.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.290+0000 7fabfb3df640 1 -- 172.21.15.88:0/3352008552 shutdown_connections 2023-12-08T08:23:03.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.290+0000 7fabfb3df640 1 --2- 172.21.15.88:0/3352008552 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fabd8066470 0x7fabd8068930 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:03.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.290+0000 7fabfb3df640 1 --2- 172.21.15.88:0/3352008552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabf415bf70 0x7fabf4148b10 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:03.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.290+0000 7fabfb3df640 1 --2- 172.21.15.88:0/3352008552 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fabf4156200 0x7fabf41586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:03.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.290+0000 7fabfb3df640 1 --2- 172.21.15.88:0/3352008552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabf40c0e10 0x7fabf40ab5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:03.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.290+0000 7fabfb3df640 1 -- 172.21.15.88:0/3352008552 >> 172.21.15.88:0/3352008552 conn(0x7fabf40c59f0 msgr2=0x7fabf4159d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:03.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.290+0000 7fabfb3df640 1 -- 172.21.15.88:0/3352008552 shutdown_connections 2023-12-08T08:23:03.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.290+0000 7fabfb3df640 1 -- 172.21.15.88:0/3352008552 wait complete. 2023-12-08T08:23:03.317 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-08T08:23:03.317 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:23:03.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.450+0000 7f3a9098d640 1 Processor -- start 2023-12-08T08:23:03.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.450+0000 7f3a9098d640 1 -- start start 2023-12-08T08:23:03.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.454+0000 7f3a9098d640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3a8c0c3b80 0x7f3a8c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:03.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.454+0000 7f3a9098d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3a8c0c5300 0x7f3a8c06c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:03.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.454+0000 7f3a9098d640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a8c06bb80 con 0x7f3a8c06d2b0 2023-12-08T08:23:03.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.454+0000 7f3a9098d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a8c06cc70 con 0x7f3a8c0c5300 2023-12-08T08:23:03.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.454+0000 7f3a9098d640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a8c0c5790 con 0x7f3a8c0c3b80 2023-12-08T08:23:03.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.454+0000 7f3a8ad9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3a8c0c5300 0x7f3a8c06c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:03.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.454+0000 7f3a8ad9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3a8c0c5300 0x7f3a8c06c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49914/0 (socket says 172.21.15.88:49914) 2023-12-08T08:23:03.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.454+0000 7f3a8ad9d640 1 -- 172.21.15.88:0/3632485171 learned_addr learned my addr 172.21.15.88:0/3632485171 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:03.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.454+0000 7f3a81d9b640 1 --2- 172.21.15.88:0/3632485171 >> v2:172.21.15.148:3300/0 conn(0x7f3a8c0c3b80 0x7f3a8c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:03.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.454+0000 7f3a8ad9d640 1 -- 172.21.15.88:0/3632485171 >> v2:172.21.15.148:3300/0 conn(0x7f3a8c0c3b80 msgr2=0x7f3a8c06d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:03.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.454+0000 7f3a8ad9d640 1 --2- 172.21.15.88:0/3632485171 >> v2:172.21.15.148:3300/0 conn(0x7f3a8c0c3b80 0x7f3a8c06d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:03.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.454+0000 7f3a8ad9d640 1 -- 172.21.15.88:0/3632485171 >> v1:172.21.15.148:6789/0 conn(0x7f3a8c06d2b0 legacy=0x7f3a8c06c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:03.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.454+0000 7f3a8ad9d640 1 -- 172.21.15.88:0/3632485171 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8c1515c0 con 0x7f3a8c0c5300 2023-12-08T08:23:03.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.454+0000 7f3a8ad9d640 1 --2- 172.21.15.88:0/3632485171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a8c0c5300 0x7f3a8c06c730 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c06b5a0 tx=0x7f3a8401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ed125f48f2df4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:03.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.454+0000 7f3a89d9b640 1 -- 172.21.15.88:0/3632485171 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a840ac640 con 0x7f3a8c0c5300 2023-12-08T08:23:03.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.454+0000 7f3a89d9b640 1 -- 172.21.15.88:0/3632485171 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a840ac7a0 con 0x7f3a8c0c5300 2023-12-08T08:23:03.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.454+0000 7f3a89d9b640 1 -- 172.21.15.88:0/3632485171 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a840acb30 con 0x7f3a8c0c5300 2023-12-08T08:23:03.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.458+0000 7f3a9098d640 1 -- 172.21.15.88:0/3632485171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a8c0c5300 msgr2=0x7f3a8c06c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:03.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.458+0000 7f3a9098d640 1 --2- 172.21.15.88:0/3632485171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a8c0c5300 0x7f3a8c06c730 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c06b5a0 tx=0x7f3a8401c4d0 comp rx=0 tx=0).stop 2023-12-08T08:23:03.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.458+0000 7f3a9098d640 1 -- 172.21.15.88:0/3632485171 shutdown_connections 2023-12-08T08:23:03.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.458+0000 7f3a9098d640 1 --2- 172.21.15.88:0/3632485171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a8c0c5300 0x7f3a8c06c730 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:03.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.458+0000 7f3a9098d640 1 --2- 172.21.15.88:0/3632485171 >> v2:172.21.15.148:3300/0 conn(0x7f3a8c0c3b80 0x7f3a8c06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:03.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.458+0000 7f3a9098d640 1 -- 172.21.15.88:0/3632485171 >> 172.21.15.88:0/3632485171 conn(0x7f3a8c0a7810 msgr2=0x7f3a8c0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:03.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.458+0000 7f3a9098d640 1 -- 172.21.15.88:0/3632485171 shutdown_connections 2023-12-08T08:23:03.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.458+0000 7f3a9098d640 1 -- 172.21.15.88:0/3632485171 wait complete. 2023-12-08T08:23:03.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.458+0000 7f3a9098d640 1 Processor -- start 2023-12-08T08:23:03.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.458+0000 7f3a9098d640 1 -- start start 2023-12-08T08:23:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.458+0000 7f3a9098d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a8c06d2b0 0x7f3a8c1ed4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.458+0000 7f3a9098d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3a8c0c3b80 0x7f3a8c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.458+0000 7f3a9098d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a8c0c5300 0x7f3a8c14b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.458+0000 7f3a9098d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c1eda20 con 0x7f3a8c0c5300 2023-12-08T08:23:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.458+0000 7f3a9098d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c155eb0 con 0x7f3a8c06d2b0 2023-12-08T08:23:03.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.458+0000 7f3a9098d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c14f320 con 0x7f3a8c0c3b80 2023-12-08T08:23:03.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.458+0000 7f3a8ad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a8c0c5300 0x7f3a8c14b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:03.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.458+0000 7f3a8ad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a8c0c5300 0x7f3a8c14b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49926/0 (socket says 172.21.15.88:49926) 2023-12-08T08:23:03.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.458+0000 7f3a8ad9d640 1 -- 172.21.15.88:0/3726570043 learned_addr learned my addr 172.21.15.88:0/3726570043 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:03.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.462+0000 7f3a8ad9d640 1 -- 172.21.15.88:0/3726570043 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3a8c0c3b80 msgr2=0x7f3a8c15b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:03.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.462+0000 7f3a8ad9d640 1 --2- 172.21.15.88:0/3726570043 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3a8c0c3b80 0x7f3a8c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:03.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.462+0000 7f3a8ad9d640 1 -- 172.21.15.88:0/3726570043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a8c06d2b0 msgr2=0x7f3a8c1ed4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:03.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.462+0000 7f3a8a59c640 1 --2- 172.21.15.88:0/3726570043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a8c06d2b0 0x7f3a8c1ed4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:03.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.462+0000 7f3a8ad9d640 1 --2- 172.21.15.88:0/3726570043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a8c06d2b0 0x7f3a8c1ed4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:03.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.462+0000 7f3a8ad9d640 1 -- 172.21.15.88:0/3726570043 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a840094d0 con 0x7f3a8c0c5300 2023-12-08T08:23:03.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.462+0000 7f3a8a59c640 1 --2- 172.21.15.88:0/3726570043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a8c06d2b0 0x7f3a8c1ed4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:03.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.462+0000 7f3a8ad9d640 1 --2- 172.21.15.88:0/3726570043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a8c0c5300 0x7f3a8c14b840 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f3a840190e0 tx=0x7f3a8401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:03.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.462+0000 7f3a837fe640 1 -- 172.21.15.88:0/3726570043 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a840b7860 con 0x7f3a8c0c5300 2023-12-08T08:23:03.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.462+0000 7f3a837fe640 1 -- 172.21.15.88:0/3726570043 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a840b79c0 con 0x7f3a8c0c5300 2023-12-08T08:23:03.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.462+0000 7f3a837fe640 1 -- 172.21.15.88:0/3726570043 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a840b7d70 con 0x7f3a8c0c5300 2023-12-08T08:23:03.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.462+0000 7f3a9098d640 1 -- 172.21.15.88:0/3726570043 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a8c14ef80 con 0x7f3a8c0c5300 2023-12-08T08:23:03.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.462+0000 7f3a9098d640 1 -- 172.21.15.88:0/3726570043 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a8c0a8f50 con 0x7f3a8c0c5300 2023-12-08T08:23:03.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.462+0000 7f3a9098d640 1 -- 172.21.15.88:0/3726570043 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a8c067630 con 0x7f3a8c0c5300 2023-12-08T08:23:03.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.462+0000 7f3a837fe640 1 -- 172.21.15.88:0/3726570043 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3a840b3070 con 0x7f3a8c0c5300 2023-12-08T08:23:03.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.462+0000 7f3a837fe640 1 --2- 172.21.15.88:0/3726570043 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3a6c0664a0 0x7f3a6c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:03.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.462+0000 7f3a837fe640 1 -- 172.21.15.88:0/3726570043 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a8411e740 con 0x7f3a8c0c5300 2023-12-08T08:23:03.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.462+0000 7f3a8a59c640 1 --2- 172.21.15.88:0/3726570043 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3a6c0664a0 0x7f3a6c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:03.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.466+0000 7f3a8a59c640 1 --2- 172.21.15.88:0/3726570043 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3a6c0664a0 0x7f3a6c068960 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c000f70 tx=0x7f3a7c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:03.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.466+0000 7f3a837fe640 1 -- 172.21.15.88:0/3726570043 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3a840ebbb0 con 0x7f3a8c0c5300 2023-12-08T08:23:03.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.646+0000 7f3a9098d640 1 -- 172.21.15.88:0/3726570043 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a8c06bd70 con 0x7f3a8c0c5300 2023-12-08T08:23:03.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.646+0000 7f3a837fe640 1 -- 172.21.15.88:0/3726570043 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f3a840ac600 con 0x7f3a8c0c5300 2023-12-08T08:23:03.651 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:03.651 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5693,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4194250074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4194250074},{"type":"v1","addr":"172.21.15.148:6833","nonce":4194250074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":5699,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3923000603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3923000603},{"type":"v1","addr":"172.21.15.148:6835","nonce":3923000603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6519,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/1294328415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1294328415},{"type":"v1","addr":"172.21.15.88:6835","nonce":1294328415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:22:59.638045+0000","modified":"2023-12-08T08:23:02.646442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6525":{"gid":6525,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/698349615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":698349615},{"type":"v1","addr":"172.21.15.88:6837","nonce":698349615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-08T08:23:03.651 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 47 2023-12-08T08:23:03.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.646+0000 7f3a9098d640 1 -- 172.21.15.88:0/3726570043 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3a6c0664a0 msgr2=0x7f3a6c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:03.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.646+0000 7f3a9098d640 1 --2- 172.21.15.88:0/3726570043 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3a6c0664a0 0x7f3a6c068960 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c000f70 tx=0x7f3a7c009040 comp rx=0 tx=0).stop 2023-12-08T08:23:03.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.646+0000 7f3a9098d640 1 -- 172.21.15.88:0/3726570043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a8c0c5300 msgr2=0x7f3a8c14b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:03.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.646+0000 7f3a9098d640 1 --2- 172.21.15.88:0/3726570043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a8c0c5300 0x7f3a8c14b840 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f3a840190e0 tx=0x7f3a8401ad10 comp rx=0 tx=0).stop 2023-12-08T08:23:03.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.646+0000 7f3a9098d640 1 -- 172.21.15.88:0/3726570043 shutdown_connections 2023-12-08T08:23:03.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.646+0000 7f3a9098d640 1 --2- 172.21.15.88:0/3726570043 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3a6c0664a0 0x7f3a6c068960 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:03.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.646+0000 7f3a9098d640 1 --2- 172.21.15.88:0/3726570043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a8c0c5300 0x7f3a8c14b840 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:03.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.646+0000 7f3a9098d640 1 --2- 172.21.15.88:0/3726570043 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3a8c0c3b80 0x7f3a8c15b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:03.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.646+0000 7f3a9098d640 1 --2- 172.21.15.88:0/3726570043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a8c06d2b0 0x7f3a8c1ed4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:03.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.646+0000 7f3a9098d640 1 -- 172.21.15.88:0/3726570043 >> 172.21.15.88:0/3726570043 conn(0x7f3a8c0a7810 msgr2=0x7f3a8c071f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:03.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.646+0000 7f3a9098d640 1 -- 172.21.15.88:0/3726570043 shutdown_connections 2023-12-08T08:23:03.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.650+0000 7f3a9098d640 1 -- 172.21.15.88:0/3726570043 wait complete. 2023-12-08T08:23:03.672 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:23:03.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.802+0000 7f2e778d6640 1 Processor -- start 2023-12-08T08:23:03.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.802+0000 7f2e778d6640 1 -- start start 2023-12-08T08:23:03.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.806+0000 7f2e778d6640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2e7006d2b0 0x7f2e7006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:03.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.806+0000 7f2e778d6640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e700c3b80 0x7f2e700c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:03.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.806+0000 7f2e778d6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2e7006c020 0x7f2e7006c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:03.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.806+0000 7f2e778d6640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e700c5840 con 0x7f2e7006c020 2023-12-08T08:23:03.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.806+0000 7f2e778d6640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7006bb80 con 0x7f2e7006d2b0 2023-12-08T08:23:03.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.806+0000 7f2e778d6640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e701515c0 con 0x7f2e700c3b80 2023-12-08T08:23:03.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.806+0000 7f2e75e73640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2e7006c020 0x7f2e7006c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:03.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.806+0000 7f2e75e73640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2e7006c020 0x7f2e7006c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49942/0 (socket says 172.21.15.88:49942) 2023-12-08T08:23:03.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.806+0000 7f2e75e73640 1 -- 172.21.15.88:0/3836492431 learned_addr learned my addr 172.21.15.88:0/3836492431 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:03.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.806+0000 7f2e74e71640 1 --2- 172.21.15.88:0/3836492431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e700c3b80 0x7f2e700c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:03.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.806+0000 7f2e75672640 1 --2- 172.21.15.88:0/3836492431 >> v2:172.21.15.148:3300/0 conn(0x7f2e7006d2b0 0x7f2e7006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:03.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.806+0000 7f2e75e73640 1 -- 172.21.15.88:0/3836492431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e700c3b80 msgr2=0x7f2e700c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:03.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.806+0000 7f2e75e73640 1 --2- 172.21.15.88:0/3836492431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e700c3b80 0x7f2e700c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:03.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.806+0000 7f2e75e73640 1 -- 172.21.15.88:0/3836492431 >> v2:172.21.15.148:3300/0 conn(0x7f2e7006d2b0 msgr2=0x7f2e7006d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:03.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.806+0000 7f2e75e73640 1 --2- 172.21.15.88:0/3836492431 >> v2:172.21.15.148:3300/0 conn(0x7f2e7006d2b0 0x7f2e7006d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:03.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.806+0000 7f2e75e73640 1 -- 172.21.15.88:0/3836492431 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e701518a0 con 0x7f2e7006c020 2023-12-08T08:23:03.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.806+0000 7f2e75672640 1 --2- 172.21.15.88:0/3836492431 >> v2:172.21.15.148:3300/0 conn(0x7f2e7006d2b0 0x7f2e7006d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:03.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.810+0000 7f2e75e73640 1 --2- 172.21.15.88:0/3836492431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e7006c020 0x7f2e7006c4b0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f2e700c2130 tx=0x7f2e6801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14fd63cdbb88bd3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.810+0000 7f2e67fff640 1 -- 172.21.15.88:0/3836492431 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e680a5730 con 0x7f2e7006c020 2023-12-08T08:23:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.810+0000 7f2e67fff640 1 -- 172.21.15.88:0/3836492431 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e680a5890 con 0x7f2e7006c020 2023-12-08T08:23:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.810+0000 7f2e67fff640 1 -- 172.21.15.88:0/3836492431 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e680a5c20 con 0x7f2e7006c020 2023-12-08T08:23:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.810+0000 7f2e778d6640 1 -- 172.21.15.88:0/3836492431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e7006c020 msgr2=0x7f2e7006c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.810+0000 7f2e778d6640 1 --2- 172.21.15.88:0/3836492431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e7006c020 0x7f2e7006c4b0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f2e700c2130 tx=0x7f2e6801c9a0 comp rx=0 tx=0).stop 2023-12-08T08:23:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.810+0000 7f2e778d6640 1 -- 172.21.15.88:0/3836492431 shutdown_connections 2023-12-08T08:23:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.810+0000 7f2e778d6640 1 --2- 172.21.15.88:0/3836492431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e7006c020 0x7f2e7006c4b0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.810+0000 7f2e778d6640 1 --2- 172.21.15.88:0/3836492431 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e700c3b80 0x7f2e700c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.810+0000 7f2e778d6640 1 --2- 172.21.15.88:0/3836492431 >> v2:172.21.15.148:3300/0 conn(0x7f2e7006d2b0 0x7f2e7006d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.810+0000 7f2e778d6640 1 -- 172.21.15.88:0/3836492431 >> 172.21.15.88:0/3836492431 conn(0x7f2e700a7810 msgr2=0x7f2e700a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.810+0000 7f2e778d6640 1 -- 172.21.15.88:0/3836492431 shutdown_connections 2023-12-08T08:23:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.810+0000 7f2e778d6640 1 -- 172.21.15.88:0/3836492431 wait complete. 2023-12-08T08:23:03.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.810+0000 7f2e778d6640 1 Processor -- start 2023-12-08T08:23:03.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.810+0000 7f2e778d6640 1 -- start start 2023-12-08T08:23:03.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.814+0000 7f2e778d6640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e7006c020 0x7f2e7015a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:03.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.814+0000 7f2e778d6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e7006d2b0 0x7f2e700a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:03.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.814+0000 7f2e778d6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e700c3b80 0x7f2e700a8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:03.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.814+0000 7f2e778d6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7014ff80 con 0x7f2e700c3b80 2023-12-08T08:23:03.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.814+0000 7f2e778d6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7014f830 con 0x7f2e7006d2b0 2023-12-08T08:23:03.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.814+0000 7f2e778d6640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e701f10c0 con 0x7f2e7006c020 2023-12-08T08:23:03.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.814+0000 7f2e75e73640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e700c3b80 0x7f2e700a8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:03.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.814+0000 7f2e75e73640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e700c3b80 0x7f2e700a8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49958/0 (socket says 172.21.15.88:49958) 2023-12-08T08:23:03.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.814+0000 7f2e75e73640 1 -- 172.21.15.88:0/242456797 learned_addr learned my addr 172.21.15.88:0/242456797 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:03.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.814+0000 7f2e75672640 1 --2- 172.21.15.88:0/242456797 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e7006c020 0x7f2e7015a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:03.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.814+0000 7f2e74e71640 1 --2- 172.21.15.88:0/242456797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e7006d2b0 0x7f2e700a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:03.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.814+0000 7f2e75e73640 1 -- 172.21.15.88:0/242456797 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e7006c020 msgr2=0x7f2e7015a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:03.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.814+0000 7f2e75e73640 1 --2- 172.21.15.88:0/242456797 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e7006c020 0x7f2e7015a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:03.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.814+0000 7f2e75e73640 1 -- 172.21.15.88:0/242456797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e7006d2b0 msgr2=0x7f2e700a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:03.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.814+0000 7f2e75e73640 1 --2- 172.21.15.88:0/242456797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e7006d2b0 0x7f2e700a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:03.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.814+0000 7f2e75e73640 1 -- 172.21.15.88:0/242456797 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e68009b30 con 0x7f2e700c3b80 2023-12-08T08:23:03.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.814+0000 7f2e75e73640 1 --2- 172.21.15.88:0/242456797 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e700c3b80 0x7f2e700a8e10 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f2e6801b050 tx=0x7f2e68019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:03.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.814+0000 7f2e65ffb640 1 -- 172.21.15.88:0/242456797 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e680b8670 con 0x7f2e700c3b80 2023-12-08T08:23:03.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.814+0000 7f2e65ffb640 1 -- 172.21.15.88:0/242456797 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e680b87d0 con 0x7f2e700c3b80 2023-12-08T08:23:03.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.814+0000 7f2e778d6640 1 -- 172.21.15.88:0/242456797 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e7014ef80 con 0x7f2e700c3b80 2023-12-08T08:23:03.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.814+0000 7f2e65ffb640 1 -- 172.21.15.88:0/242456797 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e680b8b80 con 0x7f2e700c3b80 2023-12-08T08:23:03.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.814+0000 7f2e778d6640 1 -- 172.21.15.88:0/242456797 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e7014f4c0 con 0x7f2e700c3b80 2023-12-08T08:23:03.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.814+0000 7f2e778d6640 1 -- 172.21.15.88:0/242456797 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e7014f320 con 0x7f2e700c3b80 2023-12-08T08:23:03.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.814+0000 7f2e65ffb640 1 -- 172.21.15.88:0/242456797 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2e680b8ce0 con 0x7f2e700c3b80 2023-12-08T08:23:03.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.818+0000 7f2e65ffb640 1 --2- 172.21.15.88:0/242456797 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2e54066470 0x7f2e54068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:03.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.818+0000 7f2e65ffb640 1 -- 172.21.15.88:0/242456797 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e6811f3f0 con 0x7f2e700c3b80 2023-12-08T08:23:03.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.818+0000 7f2e75672640 1 --2- 172.21.15.88:0/242456797 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2e54066470 0x7f2e54068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:03.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.818+0000 7f2e75672640 1 --2- 172.21.15.88:0/242456797 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2e54066470 0x7f2e54068930 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c006e90 tx=0x7f2e6c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:03.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.822+0000 7f2e65ffb640 1 -- 172.21.15.88:0/242456797 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2e7014f320 con 0x7f2e700c3b80 2023-12-08T08:23:03.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.970+0000 7f2e778d6640 1 -- 172.21.15.88:0/242456797 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e7014f320 con 0x7f2e700c3b80 2023-12-08T08:23:03.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.970+0000 7f2e65ffb640 1 -- 172.21.15.88:0/242456797 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16536 (secure 0 0 0) 0x7f2e7014f320 con 0x7f2e700c3b80 2023-12-08T08:23:03.976 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:03.976 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":68,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:23:01.269360+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:57.367467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:58.632605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:23:03.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.974+0000 7f2e778d6640 1 -- 172.21.15.88:0/242456797 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2e54066470 msgr2=0x7f2e54068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:03.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.974+0000 7f2e778d6640 1 --2- 172.21.15.88:0/242456797 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2e54066470 0x7f2e54068930 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c006e90 tx=0x7f2e6c008040 comp rx=0 tx=0).stop 2023-12-08T08:23:03.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.974+0000 7f2e778d6640 1 -- 172.21.15.88:0/242456797 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e700c3b80 msgr2=0x7f2e700a8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:03.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.974+0000 7f2e778d6640 1 --2- 172.21.15.88:0/242456797 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e700c3b80 0x7f2e700a8e10 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f2e6801b050 tx=0x7f2e68019740 comp rx=0 tx=0).stop 2023-12-08T08:23:03.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.974+0000 7f2e778d6640 1 -- 172.21.15.88:0/242456797 shutdown_connections 2023-12-08T08:23:03.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.974+0000 7f2e778d6640 1 --2- 172.21.15.88:0/242456797 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2e54066470 0x7f2e54068930 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:03.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.974+0000 7f2e778d6640 1 --2- 172.21.15.88:0/242456797 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e700c3b80 0x7f2e700a8e10 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:03.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.974+0000 7f2e778d6640 1 --2- 172.21.15.88:0/242456797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e7006d2b0 0x7f2e700a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:03.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.974+0000 7f2e778d6640 1 --2- 172.21.15.88:0/242456797 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2e7006c020 0x7f2e7015a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:03.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.974+0000 7f2e778d6640 1 -- 172.21.15.88:0/242456797 >> 172.21.15.88:0/242456797 conn(0x7f2e700a7810 msgr2=0x7f2e700723b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:03.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.974+0000 7f2e778d6640 1 -- 172.21.15.88:0/242456797 shutdown_connections 2023-12-08T08:23:03.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:03.974+0000 7f2e778d6640 1 -- 172.21.15.88:0/242456797 wait complete. 2023-12-08T08:23:03.997 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-08T08:23:03.997 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:23:04.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.130+0000 7f1bf0df5640 1 Processor -- start 2023-12-08T08:23:04.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.130+0000 7f1bf0df5640 1 -- start start 2023-12-08T08:23:04.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.130+0000 7f1bf0df5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1bec14fd10 0x7f1bec0a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:04.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.130+0000 7f1bf0df5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bec0c5710 con 0x7f1bec156110 2023-12-08T08:23:04.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.130+0000 7f1bf0df5640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bec155c80 con 0x7f1bec0a5300 2023-12-08T08:23:04.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.130+0000 7f1bf0df5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bec06c5e0 con 0x7f1bec14fd10 2023-12-08T08:23:04.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.130+0000 7f1bea59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1bec14fd10 0x7f1bec0a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:04.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.130+0000 7f1bead9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1bec156110 0x7f1bec15ce50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41226/0 (socket says 172.21.15.88:41226) 2023-12-08T08:23:04.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.130+0000 7f1bead9d640 1 -- 172.21.15.88:0/4206642241 learned_addr learned my addr 172.21.15.88:0/4206642241 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:04.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.130+0000 7f1bea59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1bec14fd10 0x7f1bec0a4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49960/0 (socket says 172.21.15.88:49960) 2023-12-08T08:23:04.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.130+0000 7f1bea59c640 1 -- 172.21.15.88:0/4206642241 >> v1:172.21.15.148:6789/0 conn(0x7f1bec0a5300 legacy=0x7f1bec071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:04.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.130+0000 7f1bea59c640 1 -- 172.21.15.88:0/4206642241 >> v1:172.21.15.88:6789/0 conn(0x7f1bec156110 legacy=0x7f1bec15ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:04.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.130+0000 7f1be959a640 1 -- 172.21.15.88:0/4206642241 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633437425 0 0) 0x7f1bec0c5710 con 0x7f1bec156110 2023-12-08T08:23:04.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.130+0000 7f1bea59c640 1 -- 172.21.15.88:0/4206642241 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bec0c4e70 con 0x7f1bec14fd10 2023-12-08T08:23:04.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.134+0000 7f1bea59c640 1 --2- 172.21.15.88:0/4206642241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1bec14fd10 0x7f1bec0a4dc0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc0097c0 tx=0x7f1bdc01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348d0dc3ded1ffdc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:04.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.134+0000 7f1be959a640 1 -- 172.21.15.88:0/4206642241 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc0ab600 con 0x7f1bec14fd10 2023-12-08T08:23:04.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.134+0000 7f1be959a640 1 -- 172.21.15.88:0/4206642241 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bdc0a7050 con 0x7f1bec14fd10 2023-12-08T08:23:04.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.134+0000 7f1be959a640 1 -- 172.21.15.88:0/4206642241 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc0ab980 con 0x7f1bec14fd10 2023-12-08T08:23:04.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.134+0000 7f1bf0df5640 1 -- 172.21.15.88:0/4206642241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1bec14fd10 msgr2=0x7f1bec0a4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:04.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.134+0000 7f1bf0df5640 1 --2- 172.21.15.88:0/4206642241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1bec14fd10 0x7f1bec0a4dc0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc0097c0 tx=0x7f1bdc01c330 comp rx=0 tx=0).stop 2023-12-08T08:23:04.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.134+0000 7f1bf0df5640 1 -- 172.21.15.88:0/4206642241 shutdown_connections 2023-12-08T08:23:04.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.134+0000 7f1bf0df5640 1 --2- 172.21.15.88:0/4206642241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1bec14fd10 0x7f1bec0a4dc0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:04.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.134+0000 7f1bf0df5640 1 -- 172.21.15.88:0/4206642241 >> 172.21.15.88:0/4206642241 conn(0x7f1bec0a7810 msgr2=0x7f1bec0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:04.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.134+0000 7f1bf0df5640 1 -- 172.21.15.88:0/4206642241 shutdown_connections 2023-12-08T08:23:04.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.134+0000 7f1bf0df5640 1 -- 172.21.15.88:0/4206642241 wait complete. 2023-12-08T08:23:04.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.138+0000 7f1bf0df5640 1 Processor -- start 2023-12-08T08:23:04.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.138+0000 7f1bf0df5640 1 -- start start 2023-12-08T08:23:04.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.138+0000 7f1bf0df5640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1bec0a5300 0x7f1bec14a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:04.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.138+0000 7f1bf0df5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1bec14fd10 0x7f1bec14ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:04.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.138+0000 7f1bf0df5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bec156110 0x7f1bec06fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:04.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.138+0000 7f1bf0df5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec0714a0 con 0x7f1bec14fd10 2023-12-08T08:23:04.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.138+0000 7f1bf0df5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec1ed980 con 0x7f1bec156110 2023-12-08T08:23:04.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.138+0000 7f1bf0df5640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec1531c0 con 0x7f1bec0a5300 2023-12-08T08:23:04.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.138+0000 7f1be9d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1bec14fd10 0x7f1bec14ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:04.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.138+0000 7f1be9d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1bec14fd10 0x7f1bec14ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49976/0 (socket says 172.21.15.88:49976) 2023-12-08T08:23:04.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.138+0000 7f1be9d9b640 1 -- 172.21.15.88:0/1295417220 learned_addr learned my addr 172.21.15.88:0/1295417220 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:04.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.138+0000 7f1bea59c640 1 --2- 172.21.15.88:0/1295417220 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1bec0a5300 0x7f1bec14a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:04.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.138+0000 7f1be9d9b640 1 -- 172.21.15.88:0/1295417220 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1bec0a5300 msgr2=0x7f1bec14a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:04.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.138+0000 7f1be9d9b640 1 --2- 172.21.15.88:0/1295417220 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1bec0a5300 0x7f1bec14a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:04.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.138+0000 7f1be9d9b640 1 -- 172.21.15.88:0/1295417220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bec156110 msgr2=0x7f1bec06fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:04.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.138+0000 7f1be9d9b640 1 --2- 172.21.15.88:0/1295417220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bec156110 0x7f1bec06fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:04.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.138+0000 7f1be9d9b640 1 -- 172.21.15.88:0/1295417220 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bdc009420 con 0x7f1bec14fd10 2023-12-08T08:23:04.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.138+0000 7f1be9d9b640 1 --2- 172.21.15.88:0/1295417220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1bec14fd10 0x7f1bec14ad70 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f1be000c4d0 tx=0x7f1be000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:04.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.138+0000 7f1bdaffd640 1 -- 172.21.15.88:0/1295417220 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be00052d0 con 0x7f1bec14fd10 2023-12-08T08:23:04.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.138+0000 7f1bdaffd640 1 -- 172.21.15.88:0/1295417220 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be0005430 con 0x7f1bec14fd10 2023-12-08T08:23:04.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.138+0000 7f1bf0df5640 1 -- 172.21.15.88:0/1295417220 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bec1534a0 con 0x7f1bec14fd10 2023-12-08T08:23:04.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.138+0000 7f1bdaffd640 1 -- 172.21.15.88:0/1295417220 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be0012830 con 0x7f1bec14fd10 2023-12-08T08:23:04.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.138+0000 7f1bf0df5640 1 -- 172.21.15.88:0/1295417220 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bec071990 con 0x7f1bec14fd10 2023-12-08T08:23:04.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.142+0000 7f1bf0df5640 1 -- 172.21.15.88:0/1295417220 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bec1eddf0 con 0x7f1bec14fd10 2023-12-08T08:23:04.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.142+0000 7f1bdaffd640 1 -- 172.21.15.88:0/1295417220 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1be0012990 con 0x7f1bec14fd10 2023-12-08T08:23:04.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.142+0000 7f1bdaffd640 1 --2- 172.21.15.88:0/1295417220 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1bcc0664a0 0x7f1bcc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:04.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.142+0000 7f1bdaffd640 1 -- 172.21.15.88:0/1295417220 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1be0083940 con 0x7f1bec14fd10 2023-12-08T08:23:04.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.142+0000 7f1bea59c640 1 --2- 172.21.15.88:0/1295417220 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1bcc0664a0 0x7f1bcc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:04.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.142+0000 7f1bea59c640 1 --2- 172.21.15.88:0/1295417220 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1bcc0664a0 0x7f1bcc068960 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc0ad000 tx=0x7f1bdc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:04.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.146+0000 7f1bdaffd640 1 -- 172.21.15.88:0/1295417220 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1be0050db0 con 0x7f1bec14fd10 2023-12-08T08:23:04.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.294+0000 7f1bf0df5640 1 -- 172.21.15.88:0/1295417220 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1bec0aba00 con 0x7f1bcc0664a0 2023-12-08T08:23:04.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.298+0000 7f1bdaffd640 1 -- 172.21.15.88:0/1295417220 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274608 (secure 0 0 0) 0x7f1bdc0bb090 con 0x7f1bcc0664a0 2023-12-08T08:23:04.308 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:04.310 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:23:04.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.302+0000 7f1bf0df5640 1 -- 172.21.15.88:0/1295417220 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1bcc0664a0 msgr2=0x7f1bcc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:04.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.302+0000 7f1bf0df5640 1 --2- 172.21.15.88:0/1295417220 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1bcc0664a0 0x7f1bcc068960 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc0ad000 tx=0x7f1bdc008040 comp rx=0 tx=0).stop 2023-12-08T08:23:04.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.302+0000 7f1bf0df5640 1 -- 172.21.15.88:0/1295417220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1bec14fd10 msgr2=0x7f1bec14ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:04.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.302+0000 7f1bf0df5640 1 --2- 172.21.15.88:0/1295417220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1bec14fd10 0x7f1bec14ad70 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f1be000c4d0 tx=0x7f1be000c990 comp rx=0 tx=0).stop 2023-12-08T08:23:04.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.302+0000 7f1bf0df5640 1 -- 172.21.15.88:0/1295417220 shutdown_connections 2023-12-08T08:23:04.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.302+0000 7f1bf0df5640 1 --2- 172.21.15.88:0/1295417220 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1bcc0664a0 0x7f1bcc068960 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:04.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.302+0000 7f1bf0df5640 1 --2- 172.21.15.88:0/1295417220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bec156110 0x7f1bec06fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:04.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.302+0000 7f1bf0df5640 1 --2- 172.21.15.88:0/1295417220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1bec14fd10 0x7f1bec14ad70 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:04.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.302+0000 7f1bf0df5640 1 --2- 172.21.15.88:0/1295417220 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1bec0a5300 0x7f1bec14a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:04.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.302+0000 7f1bf0df5640 1 -- 172.21.15.88:0/1295417220 >> 172.21.15.88:0/1295417220 conn(0x7f1bec0a7810 msgr2=0x7f1bec0c17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:04.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.302+0000 7f1bf0df5640 1 -- 172.21.15.88:0/1295417220 shutdown_connections 2023-12-08T08:23:04.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.302+0000 7f1bf0df5640 1 -- 172.21.15.88:0/1295417220 wait complete. 2023-12-08T08:23:04.327 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2023-12-08T08:23:02.780721+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":239104,"kb_used_data":6272,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735616,"statfs":{"total":773094113280,"available":772849270784,"internally_reserved":0,"allocated":6422528,"data_stored":3895584,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.536923"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":201,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:22:55.266808+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:22:55.266808+0000","last_peered":"2023-12-08T08:22:55.266808+0000","last_clean":"2023-12-08T08:22:55.266808+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:22:55.266808+0000","last_undegraded":"2023-12-08T08:22:55.266808+0000","last_fullsized":"2023-12-08T08:22:55.266808+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":851968,"data_stored":929724,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89900000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.85299999999999998,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.63100000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85999999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89600000000000002,"5min":1.446,"15min":1.446},"last":0.80900000000000005}]},{"osd":2,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.71999999999999997,"15min":0.72899999999999998},"min":{"1min":0.52100000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.871,"5min":1.379,"15min":1.379},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.47599999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.84599999999999997,"5min":1.706,"15min":1.706},"last":0.68200000000000005}]},{"osd":3,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.751,"15min":0.76300000000000001},"min":{"1min":0.54500000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.88700000000000001,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.56699999999999995,"5min":0.496,"15min":0.496},"max":{"1min":0.83099999999999996,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.746}]},{"osd":4,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.46899999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.90000000000000002,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.72599999999999998,"15min":0.74199999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83999999999999997,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.66400000000000003}]},{"osd":5,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.77500000000000002,"15min":0.79500000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81399999999999995,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.78500000000000003,"15min":0.80200000000000005},"min":{"1min":0.499,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93300000000000005,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.72499999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.84799999999999998,"15min":0.86499999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.95899999999999996,"5min":1.573,"15min":1.573},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.80000000000000004,"15min":0.81499999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91100000000000003,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.70499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27792,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":786432,"data_stored":339356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66800000000000004,"15min":0.66500000000000004},"min":{"1min":0.41399999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86699999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.58199999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.90700000000000003,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.78300000000000003}]},{"osd":1,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.72099999999999997,"15min":0.71799999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.74099999999999999,"15min":0.73599999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.73499999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.82999999999999996,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.745,"15min":0.749},"min":{"1min":0.51500000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91300000000000003,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.80000000000000004}]},{"osd":3,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.55900000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.85299999999999998,"5min":0.998,"15min":0.998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75,"15min":0.753},"min":{"1min":0.497,"5min":0.434,"15min":0.434},"max":{"1min":0.878,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.67100000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.71599999999999997,"15min":0.73099999999999998},"min":{"1min":0.46400000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.98799999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.748,"15min":0.76500000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.95199999999999996,"5min":1.014,"15min":1.014},"last":0.496}]},{"osd":5,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.78100000000000003,"15min":0.80100000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.006,"5min":1.091,"15min":1.091},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.83299999999999996,"15min":0.84799999999999998},"min":{"1min":0.54800000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1419999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.70999999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.80300000000000005,"15min":0.82199999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.03,"5min":1.04,"15min":1.04},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.877,"15min":0.90300000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0740000000000001,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.75600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27792,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":786432,"data_stored":339356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.747,"5min":1.081,"15min":1.081},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.90300000000000002,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.67400000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.68999999999999995,"15min":0.68000000000000005},"min":{"1min":0.49399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.002,"5min":1.194,"15min":1.194},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70599999999999996,"15min":0.71499999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.879,"5min":1.143,"15min":1.143},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.69799999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.98099999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72899999999999998,"15min":0.73299999999999998},"min":{"1min":0.52400000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.92200000000000004,"5min":1.101,"15min":1.101},"last":0.81499999999999995}]},{"osd":3,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.74099999999999999,"15min":0.746},"min":{"1min":0.47399999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0189999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.76300000000000001,"15min":0.753},"min":{"1min":0.61599999999999999,"5min":0.5,"15min":0.5},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.71499999999999997}]},{"osd":4,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82099999999999995,"5min":1.01,"15min":1.01},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94099999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.84299999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77900000000000003,"15min":0.78600000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93999999999999995,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84899999999999998,"5min":1.073,"15min":1.073},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78800000000000003,"15min":0.79400000000000004},"min":{"1min":0.51000000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.995,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.624},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.85299999999999998,"15min":0.86099999999999999},"min":{"1min":0.54400000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.97699999999999998,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.57099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27792,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":786432,"data_stored":339356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69099999999999995,"15min":0.69699999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.95599999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66400000000000003,"15min":0.66200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.84199999999999997}]},{"osd":1,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.45400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.018,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51000000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90100000000000002,"5min":1.002,"15min":1.002},"last":0.58899999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.68500000000000005,"15min":0.69099999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88100000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.72499999999999998,"15min":0.71999999999999997},"min":{"1min":0.55700000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.54400000000000004}]},{"osd":3,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.751,"15min":0.755},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.92200000000000004,"5min":1.359,"15min":1.359},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.77700000000000002,"15min":0.79300000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93700000000000006,"5min":1.232,"15min":1.232},"last":0.79300000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.66500000000000004,"15min":0.67500000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85599999999999998,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.77000000000000002,"15min":0.78900000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.995,"5min":1.091,"15min":1.091},"last":0.95199999999999996}]},{"osd":6,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.70699999999999996,"15min":0.72199999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78400000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78800000000000003,"15min":0.79800000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93400000000000005,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.70499999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.81999999999999995,"15min":0.83199999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.96699999999999997,"5min":1.246,"15min":1.246},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.79200000000000004,"15min":0.80900000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97599999999999998,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.72799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31948,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":786432,"data_stored":339356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.42299999999999999,"15min":0.433},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.46500000000000002,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.45900000000000002,"15min":0.46400000000000002},"min":{"1min":0.33500000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.54900000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.45600000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.435,"15min":0.436},"min":{"1min":0.308,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.371},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.49299999999999999,"15min":0.497},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.39600000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.51600000000000001,"15min":0.52400000000000002},"min":{"1min":0.39600000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.64000000000000001,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.53600000000000003,"15min":0.54300000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.77100000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.49099999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.56599999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94099999999999995,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.747,"15min":0.76100000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0349999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.70299999999999996}]},{"osd":5,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.72799999999999998,"15min":0.73799999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.87,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.75800000000000001,"15min":0.77000000000000002},"min":{"1min":0.53000000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91600000000000004,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.85699999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.79300000000000004,"15min":0.80700000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.026,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.79000000000000004,"15min":0.80200000000000005},"min":{"1min":0.58699999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.89400000000000002,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.93100000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.755},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90400000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.77200000000000002,"15min":0.78300000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.86799999999999999,"5min":1.121,"15min":1.121},"last":0.874}]}]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31956,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":786432,"data_stored":339356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.39400000000000002,"15min":0.40200000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52500000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.52200000000000002,"15min":0.54000000000000004},"min":{"1min":0.32300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.63300000000000001,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.34399999999999997}]},{"osd":1,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.47099999999999997,"15min":0.47399999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.67900000000000005,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.432}]},{"osd":3,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.56899999999999995,"15min":0.58599999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70399999999999996,"5min":3.008,"15min":3.008},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48499999999999999,"15min":0.48699999999999999},"min":{"1min":0.39200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.59499999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.48399999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.80300000000000005,"15min":0.82299999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92500000000000004,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.75800000000000001,"15min":0.76500000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93000000000000005,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.64200000000000002}]},{"osd":5,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76500000000000001,"15min":0.77100000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.05,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.81299999999999994,"15min":0.83699999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0129999999999999,"5min":3.637,"15min":3.637},"last":0.76400000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.78500000000000003,"15min":0.79600000000000004},"min":{"1min":0.55800000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.96899999999999997,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.78500000000000003,"15min":0.79700000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.002,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.82999999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.876,"15min":0.90900000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.83999999999999997,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.83199999999999996,"15min":0.84099999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.997,"5min":1.766,"15min":1.766},"last":0.78100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27792,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":786432,"data_stored":339356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.65000000000000002,"15min":0.69299999999999995},"min":{"1min":0.29699999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.69899999999999995,"5min":5.2210000000000001,"15min":5.2210000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.83099999999999996,"15min":0.89100000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69499999999999995,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.80600000000000005,"15min":0.87},"min":{"1min":0.309,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.52900000000000003,"5min":8.2070000000000007,"15min":8.2070000000000007},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.68200000000000005,"15min":0.71999999999999997},"min":{"1min":0.34200000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.70899999999999996,"5min":4.351,"15min":4.351},"last":0.56799999999999995}]},{"osd":3,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.91000000000000003,"15min":0.97599999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.74199999999999999,"5min":8.1479999999999997,"15min":8.1479999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.746,"15min":0.79300000000000004},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63900000000000001,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.44700000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.98399999999999999,"15min":1.036},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.95499999999999996,"5min":4.8470000000000004,"15min":4.8470000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":1.0549999999999999,"15min":1.1080000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.97599999999999998,"5min":4.7939999999999996,"15min":4.7939999999999996},"last":0.73999999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.97099999999999997,"15min":1.0089999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0329999999999999,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.96399999999999997,"15min":1.0009999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92900000000000005,"5min":4.5830000000000002,"15min":4.5830000000000002},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":1.0700000000000001,"15min":1.127},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.95599999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":1.0489999999999999,"15min":1.101},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0149999999999999,"5min":4.6289999999999996,"15min":4.6289999999999996},"last":0.75700000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.98199999999999998,"15min":1.024},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0169999999999999,"5min":4.665,"15min":4.665},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":1.0620000000000001,"15min":1.1120000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0720000000000001,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.77300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":851968,"data_stored":929724,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.48499999999999999,"15min":0.501},"min":{"1min":0.27300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61599999999999999,"5min":1.863,"15min":1.863},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.85499999999999998,"15min":0.91900000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.63200000000000001,"5min":8.2799999999999994,"15min":8.2799999999999994},"last":0.34499999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.89400000000000002,"15min":0.96999999999999997},"min":{"1min":0.314,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71299999999999997,"5min":7.9290000000000003,"15min":7.9290000000000003},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.89800000000000002,"15min":0.97599999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.57299999999999995,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.30499999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.65200000000000002,"15min":0.68999999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.73199999999999998,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.84199999999999997,"15min":0.90000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.745,"5min":7.8890000000000002,"15min":7.8890000000000002},"last":0.32900000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":1.0309999999999999,"15min":1.0800000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77400000000000002,"15min":0.78500000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.101,"5min":1.607,"15min":1.607},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.83199999999999996,"15min":0.83799999999999997},"min":{"1min":0.53000000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.133,"5min":1.514,"15min":1.514},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":1.0800000000000001,"15min":1.1399999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98899999999999999,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.81699999999999995,"15min":0.83499999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.042,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":1.032,"15min":1.081},"min":{"1min":0.55700000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0800000000000001,"5min":7.835,"15min":7.835},"last":0.72199999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":1.0580000000000001,"15min":1.1080000000000001},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1719999999999999,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.84299999999999997,"15min":0.86499999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1539999999999999,"5min":1.794,"15min":1.794},"last":0.65900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:23:04.333 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:23:04.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.506+0000 7f874169c640 1 Processor -- start 2023-12-08T08:23:04.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.506+0000 7f874169c640 1 -- start start 2023-12-08T08:23:04.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.506+0000 7f874169c640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f873c0c47c0 0x7f873c155100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:04.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.506+0000 7f874169c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f873c155640 con 0x7f873c151ec0 2023-12-08T08:23:04.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.506+0000 7f874169c640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f873c0c8aa0 con 0x7f873c06b320 2023-12-08T08:23:04.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.506+0000 7f874169c640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f873c0c9060 con 0x7f873c0c47c0 2023-12-08T08:23:04.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.506+0000 7f873affd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f873c151ec0 0x7f873c0c94f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41236/0 (socket says 172.21.15.88:41236) 2023-12-08T08:23:04.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.506+0000 7f873affd640 1 -- 172.21.15.88:0/1969612570 learned_addr learned my addr 172.21.15.88:0/1969612570 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:04.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.506+0000 7f87327fc640 1 --2- 172.21.15.88:0/1969612570 >> v2:172.21.15.148:3300/0 conn(0x7f873c0c47c0 0x7f873c155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:04.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.506+0000 7f873a7fc640 1 -- 172.21.15.88:0/1969612570 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901347250 0 0) 0x7f8724001120 con 0x7f873c151ec0 2023-12-08T08:23:04.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.506+0000 7f873a7fc640 1 -- 172.21.15.88:0/1969612570 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8728003530 con 0x7f873c151ec0 2023-12-08T08:23:04.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.506+0000 7f873a7fc640 1 -- 172.21.15.88:0/1969612570 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1464184397 0 0) 0x7f8728003530 con 0x7f873c151ec0 2023-12-08T08:23:04.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.506+0000 7f87327fc640 1 -- 172.21.15.88:0/1969612570 >> v1:172.21.15.148:6789/0 conn(0x7f873c06b320 legacy=0x7f873c0c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:04.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.506+0000 7f87327fc640 1 -- 172.21.15.88:0/1969612570 >> v1:172.21.15.88:6789/0 conn(0x7f873c151ec0 legacy=0x7f873c0c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:04.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.506+0000 7f87327fc640 1 -- 172.21.15.88:0/1969612570 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873c0c4d30 con 0x7f873c0c47c0 2023-12-08T08:23:04.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.510+0000 7f87327fc640 1 --2- 172.21.15.88:0/1969612570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f873c0c47c0 0x7f873c155100 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f872c0097c0 tx=0x7f872c01c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b2a29780d6a1adb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:04.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.510+0000 7f873a7fc640 1 -- 172.21.15.88:0/1969612570 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8724001810 con 0x7f873c0c47c0 2023-12-08T08:23:04.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.510+0000 7f873a7fc640 1 -- 172.21.15.88:0/1969612570 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872c0a7050 con 0x7f873c0c47c0 2023-12-08T08:23:04.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.510+0000 7f873a7fc640 1 -- 172.21.15.88:0/1969612570 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c0ab620 con 0x7f873c0c47c0 2023-12-08T08:23:04.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.510+0000 7f874169c640 1 -- 172.21.15.88:0/1969612570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f873c0c47c0 msgr2=0x7f873c155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:04.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.510+0000 7f874169c640 1 --2- 172.21.15.88:0/1969612570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f873c0c47c0 0x7f873c155100 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f872c0097c0 tx=0x7f872c01c3a0 comp rx=0 tx=0).stop 2023-12-08T08:23:04.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.510+0000 7f874169c640 1 -- 172.21.15.88:0/1969612570 shutdown_connections 2023-12-08T08:23:04.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.510+0000 7f874169c640 1 --2- 172.21.15.88:0/1969612570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f873c0c47c0 0x7f873c155100 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:04.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.510+0000 7f874169c640 1 -- 172.21.15.88:0/1969612570 >> 172.21.15.88:0/1969612570 conn(0x7f873c0c9e40 msgr2=0x7f873c0ca250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:04.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.510+0000 7f874169c640 1 -- 172.21.15.88:0/1969612570 shutdown_connections 2023-12-08T08:23:04.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.510+0000 7f874169c640 1 -- 172.21.15.88:0/1969612570 wait complete. 2023-12-08T08:23:04.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.514+0000 7f874169c640 1 Processor -- start 2023-12-08T08:23:04.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.514+0000 7f874169c640 1 -- start start 2023-12-08T08:23:04.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.514+0000 7f874169c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f873c06b320 0x7f873c1f0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:04.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.514+0000 7f874169c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f873c0c47c0 0x7f873c14e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:04.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.514+0000 7f874169c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f873c151ec0 0x7f873c14b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:04.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.514+0000 7f874169c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873c1f14e0 con 0x7f873c06b320 2023-12-08T08:23:04.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.514+0000 7f874169c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873c0c2ba0 con 0x7f873c151ec0 2023-12-08T08:23:04.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.514+0000 7f874169c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873c0c2e80 con 0x7f873c0c47c0 2023-12-08T08:23:04.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.514+0000 7f873affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f873c06b320 0x7f873c1f0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:04.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.514+0000 7f873affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f873c06b320 0x7f873c1f0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49990/0 (socket says 172.21.15.88:49990) 2023-12-08T08:23:04.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.514+0000 7f873affd640 1 -- 172.21.15.88:0/617232915 learned_addr learned my addr 172.21.15.88:0/617232915 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:04.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.514+0000 7f87327fc640 1 --2- 172.21.15.88:0/617232915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f873c0c47c0 0x7f873c14e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:04.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.514+0000 7f873b7fe640 1 --2- 172.21.15.88:0/617232915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f873c151ec0 0x7f873c14b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:04.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.514+0000 7f873affd640 1 -- 172.21.15.88:0/617232915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f873c0c47c0 msgr2=0x7f873c14e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:04.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.514+0000 7f873affd640 1 --2- 172.21.15.88:0/617232915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f873c0c47c0 0x7f873c14e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:04.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.514+0000 7f873affd640 1 -- 172.21.15.88:0/617232915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f873c151ec0 msgr2=0x7f873c14b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:04.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.514+0000 7f873affd640 1 --2- 172.21.15.88:0/617232915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f873c151ec0 0x7f873c14b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:04.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.514+0000 7f873affd640 1 -- 172.21.15.88:0/617232915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c009420 con 0x7f873c06b320 2023-12-08T08:23:04.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.514+0000 7f873affd640 1 --2- 172.21.15.88:0/617232915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f873c06b320 0x7f873c1f0f00 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f872400c780 tx=0x7f872400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:04.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.514+0000 7f8733fff640 1 -- 172.21.15.88:0/617232915 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8724005ae0 con 0x7f873c06b320 2023-12-08T08:23:04.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.514+0000 7f8733fff640 1 -- 172.21.15.88:0/617232915 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8724005c40 con 0x7f873c06b320 2023-12-08T08:23:04.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.514+0000 7f8733fff640 1 -- 172.21.15.88:0/617232915 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8724007070 con 0x7f873c06b320 2023-12-08T08:23:04.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.514+0000 7f874169c640 1 -- 172.21.15.88:0/617232915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f873c0c0fb0 con 0x7f873c06b320 2023-12-08T08:23:04.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.514+0000 7f874169c640 1 -- 172.21.15.88:0/617232915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f873c14e7d0 con 0x7f873c06b320 2023-12-08T08:23:04.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.514+0000 7f874169c640 1 -- 172.21.15.88:0/617232915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f873c0c2ce0 con 0x7f873c06b320 2023-12-08T08:23:04.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.518+0000 7f8733fff640 1 -- 172.21.15.88:0/617232915 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f87240071d0 con 0x7f873c06b320 2023-12-08T08:23:04.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.518+0000 7f8733fff640 1 --2- 172.21.15.88:0/617232915 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f871c066470 0x7f871c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:04.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.518+0000 7f8733fff640 1 -- 172.21.15.88:0/617232915 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8724083820 con 0x7f873c06b320 2023-12-08T08:23:04.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.518+0000 7f87327fc640 1 --2- 172.21.15.88:0/617232915 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f871c066470 0x7f871c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:04.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.518+0000 7f87327fc640 1 --2- 172.21.15.88:0/617232915 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f871c066470 0x7f871c068930 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f872c0ad000 tx=0x7f872c0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:04.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.522+0000 7f8733fff640 1 -- 172.21.15.88:0/617232915 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f873c0c2ce0 con 0x7f873c06b320 2023-12-08T08:23:04.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.666+0000 7f874169c640 1 -- 172.21.15.88:0/617232915 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f873c0c2ff0 con 0x7f871c066470 2023-12-08T08:23:04.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.674+0000 7f8733fff640 1 -- 172.21.15.88:0/617232915 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274608 (secure 0 0 0) 0x7f873c0c2ff0 con 0x7f871c066470 2023-12-08T08:23:04.683 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:04.684 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:23:04.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.678+0000 7f874169c640 1 -- 172.21.15.88:0/617232915 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f871c066470 msgr2=0x7f871c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:04.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.678+0000 7f874169c640 1 --2- 172.21.15.88:0/617232915 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f871c066470 0x7f871c068930 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f872c0ad000 tx=0x7f872c0a6000 comp rx=0 tx=0).stop 2023-12-08T08:23:04.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.678+0000 7f874169c640 1 -- 172.21.15.88:0/617232915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f873c06b320 msgr2=0x7f873c1f0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:04.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.678+0000 7f874169c640 1 --2- 172.21.15.88:0/617232915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f873c06b320 0x7f873c1f0f00 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f872400c780 tx=0x7f872400cc40 comp rx=0 tx=0).stop 2023-12-08T08:23:04.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.678+0000 7f874169c640 1 -- 172.21.15.88:0/617232915 shutdown_connections 2023-12-08T08:23:04.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.678+0000 7f874169c640 1 --2- 172.21.15.88:0/617232915 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f871c066470 0x7f871c068930 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:04.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.678+0000 7f874169c640 1 --2- 172.21.15.88:0/617232915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f873c151ec0 0x7f873c14b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:04.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.678+0000 7f874169c640 1 --2- 172.21.15.88:0/617232915 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f873c0c47c0 0x7f873c14e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:04.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.678+0000 7f874169c640 1 --2- 172.21.15.88:0/617232915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f873c06b320 0x7f873c1f0f00 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:04.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.678+0000 7f874169c640 1 -- 172.21.15.88:0/617232915 >> 172.21.15.88:0/617232915 conn(0x7f873c0c9e40 msgr2=0x7f873c0c94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:04.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.678+0000 7f874169c640 1 -- 172.21.15.88:0/617232915 shutdown_connections 2023-12-08T08:23:04.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.678+0000 7f874169c640 1 -- 172.21.15.88:0/617232915 wait complete. 2023-12-08T08:23:04.702 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2023-12-08T08:23:02.780721+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":239104,"kb_used_data":6272,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735616,"statfs":{"total":773094113280,"available":772849270784,"internally_reserved":0,"allocated":6422528,"data_stored":3895584,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.536923"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:59.243703+0000","last_change":"2023-12-08T08:22:59.243703+0000","last_active":"2023-12-08T08:22:59.243703+0000","last_peered":"2023-12-08T08:22:59.243703+0000","last_clean":"2023-12-08T08:22:59.243703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:59.243703+0000","last_undegraded":"2023-12-08T08:22:59.243703+0000","last_fullsized":"2023-12-08T08:22:59.243703+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:22:58.236083+0000","last_change":"2023-12-08T08:22:58.236083+0000","last_active":"2023-12-08T08:22:58.236083+0000","last_peered":"2023-12-08T08:22:58.236083+0000","last_clean":"2023-12-08T08:22:58.236083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:22:58.236083+0000","last_undegraded":"2023-12-08T08:22:58.236083+0000","last_fullsized":"2023-12-08T08:22:58.236083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":201,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:22:55.266808+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:22:55.266808+0000","last_peered":"2023-12-08T08:22:55.266808+0000","last_clean":"2023-12-08T08:22:55.266808+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:22:55.266808+0000","last_undegraded":"2023-12-08T08:22:55.266808+0000","last_fullsized":"2023-12-08T08:22:55.266808+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":851968,"data_stored":929724,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89900000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.85299999999999998,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.63100000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85999999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89600000000000002,"5min":1.446,"15min":1.446},"last":0.80900000000000005}]},{"osd":2,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.71999999999999997,"15min":0.72899999999999998},"min":{"1min":0.52100000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.871,"5min":1.379,"15min":1.379},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.47599999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.84599999999999997,"5min":1.706,"15min":1.706},"last":0.68200000000000005}]},{"osd":3,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.751,"15min":0.76300000000000001},"min":{"1min":0.54500000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.88700000000000001,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.56699999999999995,"5min":0.496,"15min":0.496},"max":{"1min":0.83099999999999996,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.746}]},{"osd":4,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.46899999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.90000000000000002,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.72599999999999998,"15min":0.74199999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83999999999999997,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.66400000000000003}]},{"osd":5,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.77500000000000002,"15min":0.79500000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81399999999999995,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.78500000000000003,"15min":0.80200000000000005},"min":{"1min":0.499,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93300000000000005,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.72499999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.84799999999999998,"15min":0.86499999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.95899999999999996,"5min":1.573,"15min":1.573},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.80000000000000004,"15min":0.81499999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91100000000000003,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.70499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27792,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":786432,"data_stored":339356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66800000000000004,"15min":0.66500000000000004},"min":{"1min":0.41399999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86699999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.58199999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.90700000000000003,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.78300000000000003}]},{"osd":1,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.72099999999999997,"15min":0.71799999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.74099999999999999,"15min":0.73599999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.73499999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.82999999999999996,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.745,"15min":0.749},"min":{"1min":0.51500000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91300000000000003,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.80000000000000004}]},{"osd":3,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.55900000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.85299999999999998,"5min":0.998,"15min":0.998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75,"15min":0.753},"min":{"1min":0.497,"5min":0.434,"15min":0.434},"max":{"1min":0.878,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.67100000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.71599999999999997,"15min":0.73099999999999998},"min":{"1min":0.46400000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.98799999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.748,"15min":0.76500000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.95199999999999996,"5min":1.014,"15min":1.014},"last":0.496}]},{"osd":5,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.78100000000000003,"15min":0.80100000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.006,"5min":1.091,"15min":1.091},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.83299999999999996,"15min":0.84799999999999998},"min":{"1min":0.54800000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1419999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.70999999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.80300000000000005,"15min":0.82199999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.03,"5min":1.04,"15min":1.04},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.877,"15min":0.90300000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0740000000000001,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.75600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27792,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":786432,"data_stored":339356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.747,"5min":1.081,"15min":1.081},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.90300000000000002,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.67400000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.68999999999999995,"15min":0.68000000000000005},"min":{"1min":0.49399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.002,"5min":1.194,"15min":1.194},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70599999999999996,"15min":0.71499999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.879,"5min":1.143,"15min":1.143},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.69799999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.98099999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72899999999999998,"15min":0.73299999999999998},"min":{"1min":0.52400000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.92200000000000004,"5min":1.101,"15min":1.101},"last":0.81499999999999995}]},{"osd":3,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.74099999999999999,"15min":0.746},"min":{"1min":0.47399999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0189999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.76300000000000001,"15min":0.753},"min":{"1min":0.61599999999999999,"5min":0.5,"15min":0.5},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.71499999999999997}]},{"osd":4,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82099999999999995,"5min":1.01,"15min":1.01},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94099999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.84299999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77900000000000003,"15min":0.78600000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93999999999999995,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84899999999999998,"5min":1.073,"15min":1.073},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78800000000000003,"15min":0.79400000000000004},"min":{"1min":0.51000000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.995,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.624},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.85299999999999998,"15min":0.86099999999999999},"min":{"1min":0.54400000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.97699999999999998,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.57099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27792,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":786432,"data_stored":339356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69099999999999995,"15min":0.69699999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.95599999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66400000000000003,"15min":0.66200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.84199999999999997}]},{"osd":1,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.45400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.018,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51000000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90100000000000002,"5min":1.002,"15min":1.002},"last":0.58899999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.68500000000000005,"15min":0.69099999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88100000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.72499999999999998,"15min":0.71999999999999997},"min":{"1min":0.55700000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.54400000000000004}]},{"osd":3,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.751,"15min":0.755},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.92200000000000004,"5min":1.359,"15min":1.359},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.77700000000000002,"15min":0.79300000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93700000000000006,"5min":1.232,"15min":1.232},"last":0.79300000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.66500000000000004,"15min":0.67500000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85599999999999998,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.77000000000000002,"15min":0.78900000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.995,"5min":1.091,"15min":1.091},"last":0.95199999999999996}]},{"osd":6,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.70699999999999996,"15min":0.72199999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78400000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78800000000000003,"15min":0.79800000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93400000000000005,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.70499999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.81999999999999995,"15min":0.83199999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.96699999999999997,"5min":1.246,"15min":1.246},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.79200000000000004,"15min":0.80900000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97599999999999998,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.72799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31948,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":786432,"data_stored":339356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.42299999999999999,"15min":0.433},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.46500000000000002,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.45900000000000002,"15min":0.46400000000000002},"min":{"1min":0.33500000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.54900000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.45600000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.435,"15min":0.436},"min":{"1min":0.308,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.371},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.49299999999999999,"15min":0.497},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.39600000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.51600000000000001,"15min":0.52400000000000002},"min":{"1min":0.39600000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.64000000000000001,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.53600000000000003,"15min":0.54300000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.77100000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.49099999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.56599999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94099999999999995,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.747,"15min":0.76100000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0349999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.70299999999999996}]},{"osd":5,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.72799999999999998,"15min":0.73799999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.87,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.75800000000000001,"15min":0.77000000000000002},"min":{"1min":0.53000000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91600000000000004,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.85699999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.79300000000000004,"15min":0.80700000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.026,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.79000000000000004,"15min":0.80200000000000005},"min":{"1min":0.58699999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.89400000000000002,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.93100000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.755},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90400000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.77200000000000002,"15min":0.78300000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.86799999999999999,"5min":1.121,"15min":1.121},"last":0.874}]}]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31956,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":786432,"data_stored":339356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.39400000000000002,"15min":0.40200000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52500000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.52200000000000002,"15min":0.54000000000000004},"min":{"1min":0.32300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.63300000000000001,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.34399999999999997}]},{"osd":1,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.47099999999999997,"15min":0.47399999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.67900000000000005,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.432}]},{"osd":3,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.56899999999999995,"15min":0.58599999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70399999999999996,"5min":3.008,"15min":3.008},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48499999999999999,"15min":0.48699999999999999},"min":{"1min":0.39200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.59499999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.48399999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.80300000000000005,"15min":0.82299999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92500000000000004,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.75800000000000001,"15min":0.76500000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93000000000000005,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.64200000000000002}]},{"osd":5,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76500000000000001,"15min":0.77100000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.05,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.81299999999999994,"15min":0.83699999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0129999999999999,"5min":3.637,"15min":3.637},"last":0.76400000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.78500000000000003,"15min":0.79600000000000004},"min":{"1min":0.55800000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.96899999999999997,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.78500000000000003,"15min":0.79700000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.002,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.82999999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.876,"15min":0.90900000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.83999999999999997,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.83199999999999996,"15min":0.84099999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.997,"5min":1.766,"15min":1.766},"last":0.78100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27792,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":786432,"data_stored":339356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.65000000000000002,"15min":0.69299999999999995},"min":{"1min":0.29699999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.69899999999999995,"5min":5.2210000000000001,"15min":5.2210000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.83099999999999996,"15min":0.89100000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69499999999999995,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.80600000000000005,"15min":0.87},"min":{"1min":0.309,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.52900000000000003,"5min":8.2070000000000007,"15min":8.2070000000000007},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.68200000000000005,"15min":0.71999999999999997},"min":{"1min":0.34200000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.70899999999999996,"5min":4.351,"15min":4.351},"last":0.56799999999999995}]},{"osd":3,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.91000000000000003,"15min":0.97599999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.74199999999999999,"5min":8.1479999999999997,"15min":8.1479999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.746,"15min":0.79300000000000004},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63900000000000001,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.44700000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.98399999999999999,"15min":1.036},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.95499999999999996,"5min":4.8470000000000004,"15min":4.8470000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":1.0549999999999999,"15min":1.1080000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.97599999999999998,"5min":4.7939999999999996,"15min":4.7939999999999996},"last":0.73999999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.97099999999999997,"15min":1.0089999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0329999999999999,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.96399999999999997,"15min":1.0009999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92900000000000005,"5min":4.5830000000000002,"15min":4.5830000000000002},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":1.0700000000000001,"15min":1.127},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.95599999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":1.0489999999999999,"15min":1.101},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0149999999999999,"5min":4.6289999999999996,"15min":4.6289999999999996},"last":0.75700000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.98199999999999998,"15min":1.024},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0169999999999999,"5min":4.665,"15min":4.665},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":1.0620000000000001,"15min":1.1120000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0720000000000001,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.77300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":851968,"data_stored":929724,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.48499999999999999,"15min":0.501},"min":{"1min":0.27300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61599999999999999,"5min":1.863,"15min":1.863},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.85499999999999998,"15min":0.91900000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.63200000000000001,"5min":8.2799999999999994,"15min":8.2799999999999994},"last":0.34499999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.89400000000000002,"15min":0.96999999999999997},"min":{"1min":0.314,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71299999999999997,"5min":7.9290000000000003,"15min":7.9290000000000003},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.89800000000000002,"15min":0.97599999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.57299999999999995,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.30499999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.65200000000000002,"15min":0.68999999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.73199999999999998,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.84199999999999997,"15min":0.90000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.745,"5min":7.8890000000000002,"15min":7.8890000000000002},"last":0.32900000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":1.0309999999999999,"15min":1.0800000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77400000000000002,"15min":0.78500000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.101,"5min":1.607,"15min":1.607},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.83199999999999996,"15min":0.83799999999999997},"min":{"1min":0.53000000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.133,"5min":1.514,"15min":1.514},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":1.0800000000000001,"15min":1.1399999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98899999999999999,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.81699999999999995,"15min":0.83499999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.042,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":1.032,"15min":1.081},"min":{"1min":0.55700000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0800000000000001,"5min":7.835,"15min":7.835},"last":0.72199999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":1.0580000000000001,"15min":1.1080000000000001},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1719999999999999,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.84299999999999997,"15min":0.86499999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1539999999999999,"5min":1.794,"15min":1.794},"last":0.65900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:23:04.706 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:23:04.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.882+0000 7fca7b232640 1 Processor -- start 2023-12-08T08:23:04.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.882+0000 7fca7b232640 1 -- start start 2023-12-08T08:23:04.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.882+0000 7fca7b232640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fca74154f00 0x7fca7406b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:04.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.882+0000 7fca7b232640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fca740c7d30 0x7fca7406bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:04.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.882+0000 7fca7b232640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca740c8450 con 0x7fca740af4d0 2023-12-08T08:23:04.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.882+0000 7fca7b232640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca740af8b0 con 0x7fca74154f00 2023-12-08T08:23:04.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.882+0000 7fca7b232640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca74155470 con 0x7fca740c7d30 2023-12-08T08:23:04.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.882+0000 7fca6bfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fca74154f00 0x7fca7406b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:04.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.882+0000 7fca6bfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fca74154f00 0x7fca7406b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50000/0 (socket says 172.21.15.88:50000) 2023-12-08T08:23:04.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.882+0000 7fca6bfff640 1 -- 172.21.15.88:0/130072066 learned_addr learned my addr 172.21.15.88:0/130072066 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:04.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.882+0000 7fca797cf640 1 --2- 172.21.15.88:0/130072066 >> v2:172.21.15.148:3300/0 conn(0x7fca740c7d30 0x7fca7406bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:04.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.882+0000 7fca6bfff640 1 -- 172.21.15.88:0/130072066 >> v2:172.21.15.148:3300/0 conn(0x7fca740c7d30 msgr2=0x7fca7406bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:04.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.882+0000 7fca6bfff640 1 --2- 172.21.15.88:0/130072066 >> v2:172.21.15.148:3300/0 conn(0x7fca740c7d30 0x7fca7406bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:04.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.882+0000 7fca6bfff640 1 -- 172.21.15.88:0/130072066 >> v1:172.21.15.148:6789/0 conn(0x7fca740af4d0 legacy=0x7fca740c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:04.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.882+0000 7fca6bfff640 1 -- 172.21.15.88:0/130072066 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca740c48c0 con 0x7fca74154f00 2023-12-08T08:23:04.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.886+0000 7fca6bfff640 1 --2- 172.21.15.88:0/130072066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca74154f00 0x7fca7406b710 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fca7406acd0 tx=0x7fca6401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f194ca9af8b3abbe server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:04.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.886+0000 7fca6b7fe640 1 -- 172.21.15.88:0/130072066 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca640ac410 con 0x7fca74154f00 2023-12-08T08:23:04.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.886+0000 7fca6b7fe640 1 -- 172.21.15.88:0/130072066 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca640ac570 con 0x7fca74154f00 2023-12-08T08:23:04.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.886+0000 7fca6b7fe640 1 -- 172.21.15.88:0/130072066 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca640ac900 con 0x7fca74154f00 2023-12-08T08:23:04.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.886+0000 7fca7b232640 1 -- 172.21.15.88:0/130072066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca74154f00 msgr2=0x7fca7406b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:04.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.886+0000 7fca7b232640 1 --2- 172.21.15.88:0/130072066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca74154f00 0x7fca7406b710 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fca7406acd0 tx=0x7fca6401c3b0 comp rx=0 tx=0).stop 2023-12-08T08:23:04.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.886+0000 7fca7b232640 1 -- 172.21.15.88:0/130072066 shutdown_connections 2023-12-08T08:23:04.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.886+0000 7fca7b232640 1 --2- 172.21.15.88:0/130072066 >> v2:172.21.15.148:3300/0 conn(0x7fca740c7d30 0x7fca7406bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:04.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.886+0000 7fca7b232640 1 --2- 172.21.15.88:0/130072066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca74154f00 0x7fca7406b710 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:04.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.886+0000 7fca7b232640 1 -- 172.21.15.88:0/130072066 >> 172.21.15.88:0/130072066 conn(0x7fca740aba00 msgr2=0x7fca740abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:04.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.886+0000 7fca7b232640 1 -- 172.21.15.88:0/130072066 shutdown_connections 2023-12-08T08:23:04.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.886+0000 7fca7b232640 1 -- 172.21.15.88:0/130072066 wait complete. 2023-12-08T08:23:04.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.890+0000 7fca7b232640 1 Processor -- start 2023-12-08T08:23:04.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.890+0000 7fca7b232640 1 -- start start 2023-12-08T08:23:04.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.890+0000 7fca7b232640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca740af4d0 0x7fca7414c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:04.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.890+0000 7fca7b232640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca740c7d30 0x7fca7414c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:04.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.890+0000 7fca7b232640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca74154f00 0x7fca741f0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:04.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.890+0000 7fca7b232640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca740c0f00 con 0x7fca74154f00 2023-12-08T08:23:04.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.890+0000 7fca7b232640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca740c1430 con 0x7fca740af4d0 2023-12-08T08:23:04.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.890+0000 7fca7b232640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca740c1150 con 0x7fca740c7d30 2023-12-08T08:23:04.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.890+0000 7fca797cf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca74154f00 0x7fca741f0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:04.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.890+0000 7fca797cf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca74154f00 0x7fca741f0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50002/0 (socket says 172.21.15.88:50002) 2023-12-08T08:23:04.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.890+0000 7fca797cf640 1 -- 172.21.15.88:0/1728448814 learned_addr learned my addr 172.21.15.88:0/1728448814 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:04.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.890+0000 7fca6bfff640 1 --2- 172.21.15.88:0/1728448814 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca740c7d30 0x7fca7414c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:04.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.890+0000 7fca78fce640 1 --2- 172.21.15.88:0/1728448814 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca740af4d0 0x7fca7414c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:04.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.890+0000 7fca797cf640 1 -- 172.21.15.88:0/1728448814 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca740c7d30 msgr2=0x7fca7414c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:04.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.890+0000 7fca797cf640 1 --2- 172.21.15.88:0/1728448814 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca740c7d30 0x7fca7414c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:04.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.890+0000 7fca797cf640 1 -- 172.21.15.88:0/1728448814 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca740af4d0 msgr2=0x7fca7414c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:04.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.890+0000 7fca797cf640 1 --2- 172.21.15.88:0/1728448814 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca740af4d0 0x7fca7414c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:04.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.890+0000 7fca797cf640 1 -- 172.21.15.88:0/1728448814 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca640094d0 con 0x7fca74154f00 2023-12-08T08:23:04.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.890+0000 7fca78fce640 1 --2- 172.21.15.88:0/1728448814 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca740af4d0 0x7fca7414c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:04.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.890+0000 7fca797cf640 1 --2- 172.21.15.88:0/1728448814 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca74154f00 0x7fca741f0420 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fca6c00efc0 tx=0x7fca6c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:04.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.890+0000 7fca697fa640 1 -- 172.21.15.88:0/1728448814 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c014480 con 0x7fca74154f00 2023-12-08T08:23:04.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.890+0000 7fca697fa640 1 -- 172.21.15.88:0/1728448814 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c00f040 con 0x7fca74154f00 2023-12-08T08:23:04.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.890+0000 7fca7b232640 1 -- 172.21.15.88:0/1728448814 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca741e6e70 con 0x7fca74154f00 2023-12-08T08:23:04.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.890+0000 7fca697fa640 1 -- 172.21.15.88:0/1728448814 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c014820 con 0x7fca74154f00 2023-12-08T08:23:04.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.890+0000 7fca7b232640 1 -- 172.21.15.88:0/1728448814 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca74151490 con 0x7fca74154f00 2023-12-08T08:23:04.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.894+0000 7fca7b232640 1 -- 172.21.15.88:0/1728448814 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca741f1120 con 0x7fca74154f00 2023-12-08T08:23:04.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.894+0000 7fca697fa640 1 -- 172.21.15.88:0/1728448814 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fca6c014980 con 0x7fca74154f00 2023-12-08T08:23:04.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.894+0000 7fca697fa640 1 --2- 172.21.15.88:0/1728448814 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fca60066470 0x7fca60068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:04.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.894+0000 7fca697fa640 1 -- 172.21.15.88:0/1728448814 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca6c0848a0 con 0x7fca74154f00 2023-12-08T08:23:04.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.894+0000 7fca78fce640 1 --2- 172.21.15.88:0/1728448814 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fca60066470 0x7fca60068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:04.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.894+0000 7fca78fce640 1 --2- 172.21.15.88:0/1728448814 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fca60066470 0x7fca60068930 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fca741eaa90 tx=0x7fca70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:04.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:04.898+0000 7fca697fa640 1 -- 172.21.15.88:0/1728448814 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fca6c051db0 con 0x7fca74154f00 2023-12-08T08:23:05.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.046+0000 7fca7b232640 1 -- 172.21.15.88:0/1728448814 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca740aec80 con 0x7fca60066470 2023-12-08T08:23:05.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.054+0000 7fca697fa640 1 -- 172.21.15.88:0/1728448814 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289287 (secure 0 0 0) 0x7fca740aec80 con 0x7fca60066470 2023-12-08T08:23:05.062 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:05.063 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:23:05.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.058+0000 7fca7b232640 1 -- 172.21.15.88:0/1728448814 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fca60066470 msgr2=0x7fca60068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:05.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.058+0000 7fca7b232640 1 --2- 172.21.15.88:0/1728448814 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fca60066470 0x7fca60068930 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fca741eaa90 tx=0x7fca70009040 comp rx=0 tx=0).stop 2023-12-08T08:23:05.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.058+0000 7fca7b232640 1 -- 172.21.15.88:0/1728448814 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca74154f00 msgr2=0x7fca741f0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:05.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.058+0000 7fca7b232640 1 --2- 172.21.15.88:0/1728448814 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca74154f00 0x7fca741f0420 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fca6c00efc0 tx=0x7fca6c00c490 comp rx=0 tx=0).stop 2023-12-08T08:23:05.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.058+0000 7fca7b232640 1 -- 172.21.15.88:0/1728448814 shutdown_connections 2023-12-08T08:23:05.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.058+0000 7fca7b232640 1 --2- 172.21.15.88:0/1728448814 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fca60066470 0x7fca60068930 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:05.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.058+0000 7fca7b232640 1 --2- 172.21.15.88:0/1728448814 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca74154f00 0x7fca741f0420 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:05.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.058+0000 7fca7b232640 1 --2- 172.21.15.88:0/1728448814 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fca740c7d30 0x7fca7414c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:05.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.058+0000 7fca7b232640 1 --2- 172.21.15.88:0/1728448814 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca740af4d0 0x7fca7414c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:05.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.058+0000 7fca7b232640 1 -- 172.21.15.88:0/1728448814 >> 172.21.15.88:0/1728448814 conn(0x7fca740aba00 msgr2=0x7fca7414ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:05.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.058+0000 7fca7b232640 1 -- 172.21.15.88:0/1728448814 shutdown_connections 2023-12-08T08:23:05.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.058+0000 7fca7b232640 1 -- 172.21.15.88:0/1728448814 wait complete. 2023-12-08T08:23:05.082 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2023-12-08T08:23:04.781010+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":251992,"kb_used_data":6696,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754722728,"statfs":{"total":773094113280,"available":772836073472,"internally_reserved":0,"allocated":6856704,"data_stored":4089140,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000906"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277373+0000","last_change":"2023-12-08T08:23:00.281512+0000","last_active":"2023-12-08T08:23:01.277373+0000","last_peered":"2023-12-08T08:23:01.277373+0000","last_clean":"2023-12-08T08:23:01.277373+0000","last_became_active":"2023-12-08T08:23:00.281118+0000","last_became_peered":"2023-12-08T08:23:00.281118+0000","last_unstale":"2023-12-08T08:23:01.277373+0000","last_undegraded":"2023-12-08T08:23:01.277373+0000","last_fullsized":"2023-12-08T08:23:01.277373+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:15.472021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093886+0000","last_change":"2023-12-08T08:23:00.276523+0000","last_active":"2023-12-08T08:23:02.093886+0000","last_peered":"2023-12-08T08:23:02.093886+0000","last_clean":"2023-12-08T08:23:02.093886+0000","last_became_active":"2023-12-08T08:23:00.276039+0000","last_became_peered":"2023-12-08T08:23:00.276039+0000","last_unstale":"2023-12-08T08:23:02.093886+0000","last_undegraded":"2023-12-08T08:23:02.093886+0000","last_fullsized":"2023-12-08T08:23:02.093886+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:31:16.893953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093136+0000","last_change":"2023-12-08T08:23:00.283198+0000","last_active":"2023-12-08T08:23:02.093136+0000","last_peered":"2023-12-08T08:23:02.093136+0000","last_clean":"2023-12-08T08:23:02.093136+0000","last_became_active":"2023-12-08T08:23:00.282944+0000","last_became_peered":"2023-12-08T08:23:00.282944+0000","last_unstale":"2023-12-08T08:23:02.093136+0000","last_undegraded":"2023-12-08T08:23:02.093136+0000","last_fullsized":"2023-12-08T08:23:02.093136+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:33.898137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277234+0000","last_change":"2023-12-08T08:23:00.285685+0000","last_active":"2023-12-08T08:23:01.277234+0000","last_peered":"2023-12-08T08:23:01.277234+0000","last_clean":"2023-12-08T08:23:01.277234+0000","last_became_active":"2023-12-08T08:23:00.285351+0000","last_became_peered":"2023-12-08T08:23:00.285351+0000","last_unstale":"2023-12-08T08:23:01.277234+0000","last_undegraded":"2023-12-08T08:23:01.277234+0000","last_fullsized":"2023-12-08T08:23:01.277234+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:43:34.830332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983339+0000","last_change":"2023-12-08T08:23:00.264270+0000","last_active":"2023-12-08T08:23:01.983339+0000","last_peered":"2023-12-08T08:23:01.983339+0000","last_clean":"2023-12-08T08:23:01.983339+0000","last_became_active":"2023-12-08T08:23:00.263994+0000","last_became_peered":"2023-12-08T08:23:00.263994+0000","last_unstale":"2023-12-08T08:23:01.983339+0000","last_undegraded":"2023-12-08T08:23:01.983339+0000","last_fullsized":"2023-12-08T08:23:01.983339+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:33.905575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093489+0000","last_change":"2023-12-08T08:23:00.300354+0000","last_active":"2023-12-08T08:23:02.093489+0000","last_peered":"2023-12-08T08:23:02.093489+0000","last_clean":"2023-12-08T08:23:02.093489+0000","last_became_active":"2023-12-08T08:23:00.300026+0000","last_became_peered":"2023-12-08T08:23:00.300026+0000","last_unstale":"2023-12-08T08:23:02.093489+0000","last_undegraded":"2023-12-08T08:23:02.093489+0000","last_fullsized":"2023-12-08T08:23:02.093489+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277001+0000","last_change":"2023-12-08T08:23:00.278456+0000","last_active":"2023-12-08T08:23:01.277001+0000","last_peered":"2023-12-08T08:23:01.277001+0000","last_clean":"2023-12-08T08:23:01.277001+0000","last_became_active":"2023-12-08T08:23:00.277186+0000","last_became_peered":"2023-12-08T08:23:00.277186+0000","last_unstale":"2023-12-08T08:23:01.277001+0000","last_undegraded":"2023-12-08T08:23:01.277001+0000","last_fullsized":"2023-12-08T08:23:01.277001+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:20:16.170951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093242+0000","last_change":"2023-12-08T08:23:00.272694+0000","last_active":"2023-12-08T08:23:02.093242+0000","last_peered":"2023-12-08T08:23:02.093242+0000","last_clean":"2023-12-08T08:23:02.093242+0000","last_became_active":"2023-12-08T08:23:00.272440+0000","last_became_peered":"2023-12-08T08:23:00.272440+0000","last_unstale":"2023-12-08T08:23:02.093242+0000","last_undegraded":"2023-12-08T08:23:02.093242+0000","last_fullsized":"2023-12-08T08:23:02.093242+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:15.472021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093691+0000","last_change":"2023-12-08T08:23:00.298447+0000","last_active":"2023-12-08T08:23:02.093691+0000","last_peered":"2023-12-08T08:23:02.093691+0000","last_clean":"2023-12-08T08:23:02.093691+0000","last_became_active":"2023-12-08T08:23:00.298113+0000","last_became_peered":"2023-12-08T08:23:00.298113+0000","last_unstale":"2023-12-08T08:23:02.093691+0000","last_undegraded":"2023-12-08T08:23:02.093691+0000","last_fullsized":"2023-12-08T08:23:02.093691+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277439+0000","last_change":"2023-12-08T08:23:00.277064+0000","last_active":"2023-12-08T08:23:01.277439+0000","last_peered":"2023-12-08T08:23:01.277439+0000","last_clean":"2023-12-08T08:23:01.277439+0000","last_became_active":"2023-12-08T08:23:00.276850+0000","last_became_peered":"2023-12-08T08:23:00.276850+0000","last_unstale":"2023-12-08T08:23:01.277439+0000","last_undegraded":"2023-12-08T08:23:01.277439+0000","last_fullsized":"2023-12-08T08:23:01.277439+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093759+0000","last_change":"2023-12-08T08:23:00.286362+0000","last_active":"2023-12-08T08:23:02.093759+0000","last_peered":"2023-12-08T08:23:02.093759+0000","last_clean":"2023-12-08T08:23:02.093759+0000","last_became_active":"2023-12-08T08:23:00.286071+0000","last_became_peered":"2023-12-08T08:23:00.286071+0000","last_unstale":"2023-12-08T08:23:02.093759+0000","last_undegraded":"2023-12-08T08:23:02.093759+0000","last_fullsized":"2023-12-08T08:23:02.093759+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:50.890759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277084+0000","last_change":"2023-12-08T08:23:00.277187+0000","last_active":"2023-12-08T08:23:01.277084+0000","last_peered":"2023-12-08T08:23:01.277084+0000","last_clean":"2023-12-08T08:23:01.277084+0000","last_became_active":"2023-12-08T08:23:00.276929+0000","last_became_peered":"2023-12-08T08:23:00.276929+0000","last_unstale":"2023-12-08T08:23:01.277084+0000","last_undegraded":"2023-12-08T08:23:01.277084+0000","last_fullsized":"2023-12-08T08:23:01.277084+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:55:36.390421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093011+0000","last_change":"2023-12-08T08:23:00.275837+0000","last_active":"2023-12-08T08:23:02.093011+0000","last_peered":"2023-12-08T08:23:02.093011+0000","last_clean":"2023-12-08T08:23:02.093011+0000","last_became_active":"2023-12-08T08:23:00.275561+0000","last_became_peered":"2023-12-08T08:23:00.275561+0000","last_unstale":"2023-12-08T08:23:02.093011+0000","last_undegraded":"2023-12-08T08:23:02.093011+0000","last_fullsized":"2023-12-08T08:23:02.093011+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277312+0000","last_change":"2023-12-08T08:23:00.295614+0000","last_active":"2023-12-08T08:23:01.277312+0000","last_peered":"2023-12-08T08:23:01.277312+0000","last_clean":"2023-12-08T08:23:01.277312+0000","last_became_active":"2023-12-08T08:23:00.295111+0000","last_became_peered":"2023-12-08T08:23:00.295111+0000","last_unstale":"2023-12-08T08:23:01.277312+0000","last_undegraded":"2023-12-08T08:23:01.277312+0000","last_fullsized":"2023-12-08T08:23:01.277312+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:10:16.885890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092580+0000","last_change":"2023-12-08T08:23:00.292909+0000","last_active":"2023-12-08T08:23:02.092580+0000","last_peered":"2023-12-08T08:23:02.092580+0000","last_clean":"2023-12-08T08:23:02.092580+0000","last_became_active":"2023-12-08T08:23:00.292500+0000","last_became_peered":"2023-12-08T08:23:00.292500+0000","last_unstale":"2023-12-08T08:23:02.092580+0000","last_undegraded":"2023-12-08T08:23:02.092580+0000","last_fullsized":"2023-12-08T08:23:02.092580+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:21:14.553932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983314+0000","last_change":"2023-12-08T08:23:00.273084+0000","last_active":"2023-12-08T08:23:01.983314+0000","last_peered":"2023-12-08T08:23:01.983314+0000","last_clean":"2023-12-08T08:23:01.983314+0000","last_became_active":"2023-12-08T08:23:00.272803+0000","last_became_peered":"2023-12-08T08:23:00.272803+0000","last_unstale":"2023-12-08T08:23:01.983314+0000","last_undegraded":"2023-12-08T08:23:01.983314+0000","last_fullsized":"2023-12-08T08:23:01.983314+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:16.068318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983826+0000","last_change":"2023-12-08T08:23:00.300292+0000","last_active":"2023-12-08T08:23:01.983826+0000","last_peered":"2023-12-08T08:23:01.983826+0000","last_clean":"2023-12-08T08:23:01.983826+0000","last_became_active":"2023-12-08T08:23:00.300008+0000","last_became_peered":"2023-12-08T08:23:00.300008+0000","last_unstale":"2023-12-08T08:23:01.983826+0000","last_undegraded":"2023-12-08T08:23:01.983826+0000","last_fullsized":"2023-12-08T08:23:01.983826+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:39.385907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277554+0000","last_change":"2023-12-08T08:23:00.299621+0000","last_active":"2023-12-08T08:23:01.277554+0000","last_peered":"2023-12-08T08:23:01.277554+0000","last_clean":"2023-12-08T08:23:01.277554+0000","last_became_active":"2023-12-08T08:23:00.299255+0000","last_became_peered":"2023-12-08T08:23:00.299255+0000","last_unstale":"2023-12-08T08:23:01.277554+0000","last_undegraded":"2023-12-08T08:23:01.277554+0000","last_fullsized":"2023-12-08T08:23:01.277554+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:28:46.845466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093084+0000","last_change":"2023-12-08T08:23:00.296010+0000","last_active":"2023-12-08T08:23:02.093084+0000","last_peered":"2023-12-08T08:23:02.093084+0000","last_clean":"2023-12-08T08:23:02.093084+0000","last_became_active":"2023-12-08T08:23:00.295749+0000","last_became_peered":"2023-12-08T08:23:00.295749+0000","last_unstale":"2023-12-08T08:23:02.093084+0000","last_undegraded":"2023-12-08T08:23:02.093084+0000","last_fullsized":"2023-12-08T08:23:02.093084+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:39.385907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277430+0000","last_change":"2023-12-08T08:23:00.301831+0000","last_active":"2023-12-08T08:23:01.277430+0000","last_peered":"2023-12-08T08:23:01.277430+0000","last_clean":"2023-12-08T08:23:01.277430+0000","last_became_active":"2023-12-08T08:23:00.301321+0000","last_became_peered":"2023-12-08T08:23:00.301321+0000","last_unstale":"2023-12-08T08:23:01.277430+0000","last_undegraded":"2023-12-08T08:23:01.277430+0000","last_fullsized":"2023-12-08T08:23:01.277430+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:14:54.964832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277284+0000","last_change":"2023-12-08T08:23:00.301605+0000","last_active":"2023-12-08T08:23:01.277284+0000","last_peered":"2023-12-08T08:23:01.277284+0000","last_clean":"2023-12-08T08:23:01.277284+0000","last_became_active":"2023-12-08T08:23:00.301346+0000","last_became_peered":"2023-12-08T08:23:00.301346+0000","last_unstale":"2023-12-08T08:23:01.277284+0000","last_undegraded":"2023-12-08T08:23:01.277284+0000","last_fullsized":"2023-12-08T08:23:01.277284+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:35:35.139064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093024+0000","last_change":"2023-12-08T08:23:00.301440+0000","last_active":"2023-12-08T08:23:02.093024+0000","last_peered":"2023-12-08T08:23:02.093024+0000","last_clean":"2023-12-08T08:23:02.093024+0000","last_became_active":"2023-12-08T08:23:00.301156+0000","last_became_peered":"2023-12-08T08:23:00.301156+0000","last_unstale":"2023-12-08T08:23:02.093024+0000","last_undegraded":"2023-12-08T08:23:02.093024+0000","last_fullsized":"2023-12-08T08:23:02.093024+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:04:21.562137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277139+0000","last_change":"2023-12-08T08:23:00.301914+0000","last_active":"2023-12-08T08:23:01.277139+0000","last_peered":"2023-12-08T08:23:01.277139+0000","last_clean":"2023-12-08T08:23:01.277139+0000","last_became_active":"2023-12-08T08:23:00.301688+0000","last_became_peered":"2023-12-08T08:23:00.301688+0000","last_unstale":"2023-12-08T08:23:01.277139+0000","last_undegraded":"2023-12-08T08:23:01.277139+0000","last_fullsized":"2023-12-08T08:23:01.277139+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:27:39.303886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.276995+0000","last_change":"2023-12-08T08:23:00.298664+0000","last_active":"2023-12-08T08:23:01.276995+0000","last_peered":"2023-12-08T08:23:01.276995+0000","last_clean":"2023-12-08T08:23:01.276995+0000","last_became_active":"2023-12-08T08:23:00.298341+0000","last_became_peered":"2023-12-08T08:23:00.298341+0000","last_unstale":"2023-12-08T08:23:01.276995+0000","last_undegraded":"2023-12-08T08:23:01.276995+0000","last_fullsized":"2023-12-08T08:23:01.276995+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:20:20.944416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093896+0000","last_change":"2023-12-08T08:23:00.280235+0000","last_active":"2023-12-08T08:23:02.093896+0000","last_peered":"2023-12-08T08:23:02.093896+0000","last_clean":"2023-12-08T08:23:02.093896+0000","last_became_active":"2023-12-08T08:23:00.278807+0000","last_became_peered":"2023-12-08T08:23:00.278807+0000","last_unstale":"2023-12-08T08:23:02.093896+0000","last_undegraded":"2023-12-08T08:23:02.093896+0000","last_fullsized":"2023-12-08T08:23:02.093896+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:30:44.391621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093551+0000","last_change":"2023-12-08T08:23:00.278532+0000","last_active":"2023-12-08T08:23:02.093551+0000","last_peered":"2023-12-08T08:23:02.093551+0000","last_clean":"2023-12-08T08:23:02.093551+0000","last_became_active":"2023-12-08T08:23:00.278177+0000","last_became_peered":"2023-12-08T08:23:00.278177+0000","last_unstale":"2023-12-08T08:23:02.093551+0000","last_undegraded":"2023-12-08T08:23:02.093551+0000","last_fullsized":"2023-12-08T08:23:02.093551+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:56.216551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983525+0000","last_change":"2023-12-08T08:23:00.284090+0000","last_active":"2023-12-08T08:23:01.983525+0000","last_peered":"2023-12-08T08:23:01.983525+0000","last_clean":"2023-12-08T08:23:01.983525+0000","last_became_active":"2023-12-08T08:23:00.283777+0000","last_became_peered":"2023-12-08T08:23:00.283777+0000","last_unstale":"2023-12-08T08:23:01.983525+0000","last_undegraded":"2023-12-08T08:23:01.983525+0000","last_fullsized":"2023-12-08T08:23:01.983525+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277149+0000","last_change":"2023-12-08T08:23:00.277149+0000","last_active":"2023-12-08T08:23:01.277149+0000","last_peered":"2023-12-08T08:23:01.277149+0000","last_clean":"2023-12-08T08:23:01.277149+0000","last_became_active":"2023-12-08T08:23:00.276879+0000","last_became_peered":"2023-12-08T08:23:00.276879+0000","last_unstale":"2023-12-08T08:23:01.277149+0000","last_undegraded":"2023-12-08T08:23:01.277149+0000","last_fullsized":"2023-12-08T08:23:01.277149+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:16.068318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093285+0000","last_change":"2023-12-08T08:23:00.294726+0000","last_active":"2023-12-08T08:23:02.093285+0000","last_peered":"2023-12-08T08:23:02.093285+0000","last_clean":"2023-12-08T08:23:02.093285+0000","last_became_active":"2023-12-08T08:23:00.294450+0000","last_became_peered":"2023-12-08T08:23:00.294450+0000","last_unstale":"2023-12-08T08:23:02.093285+0000","last_undegraded":"2023-12-08T08:23:02.093285+0000","last_fullsized":"2023-12-08T08:23:02.093285+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:28:25.934029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093151+0000","last_change":"2023-12-08T08:23:00.288804+0000","last_active":"2023-12-08T08:23:02.093151+0000","last_peered":"2023-12-08T08:23:02.093151+0000","last_clean":"2023-12-08T08:23:02.093151+0000","last_became_active":"2023-12-08T08:23:00.288315+0000","last_became_peered":"2023-12-08T08:23:00.288315+0000","last_unstale":"2023-12-08T08:23:02.093151+0000","last_undegraded":"2023-12-08T08:23:02.093151+0000","last_fullsized":"2023-12-08T08:23:02.093151+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:23:06.925359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983279+0000","last_change":"2023-12-08T08:23:00.294482+0000","last_active":"2023-12-08T08:23:01.983279+0000","last_peered":"2023-12-08T08:23:01.983279+0000","last_clean":"2023-12-08T08:23:01.983279+0000","last_became_active":"2023-12-08T08:23:00.294057+0000","last_became_peered":"2023-12-08T08:23:00.294057+0000","last_unstale":"2023-12-08T08:23:01.983279+0000","last_undegraded":"2023-12-08T08:23:01.983279+0000","last_fullsized":"2023-12-08T08:23:01.983279+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:42:20.038693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.276897+0000","last_change":"2023-12-08T08:23:00.272949+0000","last_active":"2023-12-08T08:23:01.276897+0000","last_peered":"2023-12-08T08:23:01.276897+0000","last_clean":"2023-12-08T08:23:01.276897+0000","last_became_active":"2023-12-08T08:23:00.272655+0000","last_became_peered":"2023-12-08T08:23:00.272655+0000","last_unstale":"2023-12-08T08:23:01.276897+0000","last_undegraded":"2023-12-08T08:23:01.276897+0000","last_fullsized":"2023-12-08T08:23:01.276897+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:28.275394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983738+0000","last_change":"2023-12-08T08:23:00.273779+0000","last_active":"2023-12-08T08:23:01.983738+0000","last_peered":"2023-12-08T08:23:01.983738+0000","last_clean":"2023-12-08T08:23:01.983738+0000","last_became_active":"2023-12-08T08:23:00.273256+0000","last_became_peered":"2023-12-08T08:23:00.273256+0000","last_unstale":"2023-12-08T08:23:01.983738+0000","last_undegraded":"2023-12-08T08:23:01.983738+0000","last_fullsized":"2023-12-08T08:23:01.983738+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"67'4","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277464+0000","last_change":"2023-12-08T08:22:59.285668+0000","last_active":"2023-12-08T08:23:01.277464+0000","last_peered":"2023-12-08T08:23:01.277464+0000","last_clean":"2023-12-08T08:23:01.277464+0000","last_became_active":"2023-12-08T08:22:59.285340+0000","last_became_peered":"2023-12-08T08:22:59.285340+0000","last_unstale":"2023-12-08T08:23:01.277464+0000","last_undegraded":"2023-12-08T08:23:01.277464+0000","last_fullsized":"2023-12-08T08:23:01.277464+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:35:15.000491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277385+0000","last_change":"2023-12-08T08:23:00.300874+0000","last_active":"2023-12-08T08:23:01.277385+0000","last_peered":"2023-12-08T08:23:01.277385+0000","last_clean":"2023-12-08T08:23:01.277385+0000","last_became_active":"2023-12-08T08:23:00.300595+0000","last_became_peered":"2023-12-08T08:23:00.300595+0000","last_unstale":"2023-12-08T08:23:01.277385+0000","last_undegraded":"2023-12-08T08:23:01.277385+0000","last_fullsized":"2023-12-08T08:23:01.277385+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983848+0000","last_change":"2023-12-08T08:22:59.274595+0000","last_active":"2023-12-08T08:23:01.983848+0000","last_peered":"2023-12-08T08:23:01.983848+0000","last_clean":"2023-12-08T08:23:01.983848+0000","last_became_active":"2023-12-08T08:22:59.274280+0000","last_became_peered":"2023-12-08T08:22:59.274280+0000","last_unstale":"2023-12-08T08:23:01.983848+0000","last_undegraded":"2023-12-08T08:23:01.983848+0000","last_fullsized":"2023-12-08T08:23:01.983848+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:27.267774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277372+0000","last_change":"2023-12-08T08:23:00.280594+0000","last_active":"2023-12-08T08:23:01.277372+0000","last_peered":"2023-12-08T08:23:01.277372+0000","last_clean":"2023-12-08T08:23:01.277372+0000","last_became_active":"2023-12-08T08:23:00.279794+0000","last_became_peered":"2023-12-08T08:23:00.279794+0000","last_unstale":"2023-12-08T08:23:01.277372+0000","last_undegraded":"2023-12-08T08:23:01.277372+0000","last_fullsized":"2023-12-08T08:23:01.277372+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:33.905575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093181+0000","last_change":"2023-12-08T08:22:59.282892+0000","last_active":"2023-12-08T08:23:02.093181+0000","last_peered":"2023-12-08T08:23:02.093181+0000","last_clean":"2023-12-08T08:23:02.093181+0000","last_became_active":"2023-12-08T08:22:59.282172+0000","last_became_peered":"2023-12-08T08:22:59.282172+0000","last_unstale":"2023-12-08T08:23:02.093181+0000","last_undegraded":"2023-12-08T08:23:02.093181+0000","last_fullsized":"2023-12-08T08:23:02.093181+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:32.890517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093181+0000","last_change":"2023-12-08T08:23:00.304580+0000","last_active":"2023-12-08T08:23:02.093181+0000","last_peered":"2023-12-08T08:23:02.093181+0000","last_clean":"2023-12-08T08:23:02.093181+0000","last_became_active":"2023-12-08T08:23:00.304098+0000","last_became_peered":"2023-12-08T08:23:00.304098+0000","last_unstale":"2023-12-08T08:23:02.093181+0000","last_undegraded":"2023-12-08T08:23:02.093181+0000","last_fullsized":"2023-12-08T08:23:02.093181+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:29:03.020360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093192+0000","last_change":"2023-12-08T08:22:59.283290+0000","last_active":"2023-12-08T08:23:02.093192+0000","last_peered":"2023-12-08T08:23:02.093192+0000","last_clean":"2023-12-08T08:23:02.093192+0000","last_became_active":"2023-12-08T08:22:59.282103+0000","last_became_peered":"2023-12-08T08:22:59.282103+0000","last_unstale":"2023-12-08T08:23:02.093192+0000","last_undegraded":"2023-12-08T08:23:02.093192+0000","last_fullsized":"2023-12-08T08:23:02.093192+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:15.256488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093289+0000","last_change":"2023-12-08T08:23:00.288605+0000","last_active":"2023-12-08T08:23:02.093289+0000","last_peered":"2023-12-08T08:23:02.093289+0000","last_clean":"2023-12-08T08:23:02.093289+0000","last_became_active":"2023-12-08T08:23:00.287910+0000","last_became_peered":"2023-12-08T08:23:00.287910+0000","last_unstale":"2023-12-08T08:23:02.093289+0000","last_undegraded":"2023-12-08T08:23:02.093289+0000","last_fullsized":"2023-12-08T08:23:02.093289+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:55.193260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983566+0000","last_change":"2023-12-08T08:22:59.267027+0000","last_active":"2023-12-08T08:23:01.983566+0000","last_peered":"2023-12-08T08:23:01.983566+0000","last_clean":"2023-12-08T08:23:01.983566+0000","last_became_active":"2023-12-08T08:22:59.265676+0000","last_became_peered":"2023-12-08T08:22:59.265676+0000","last_unstale":"2023-12-08T08:23:01.983566+0000","last_undegraded":"2023-12-08T08:23:01.983566+0000","last_fullsized":"2023-12-08T08:23:01.983566+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:19.279362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983439+0000","last_change":"2023-12-08T08:23:00.300280+0000","last_active":"2023-12-08T08:23:01.983439+0000","last_peered":"2023-12-08T08:23:01.983439+0000","last_clean":"2023-12-08T08:23:01.983439+0000","last_became_active":"2023-12-08T08:23:00.299998+0000","last_became_peered":"2023-12-08T08:23:00.299998+0000","last_unstale":"2023-12-08T08:23:01.983439+0000","last_undegraded":"2023-12-08T08:23:01.983439+0000","last_fullsized":"2023-12-08T08:23:01.983439+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:15.472021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983222+0000","last_change":"2023-12-08T08:22:59.274800+0000","last_active":"2023-12-08T08:23:01.983222+0000","last_peered":"2023-12-08T08:23:01.983222+0000","last_clean":"2023-12-08T08:23:01.983222+0000","last_became_active":"2023-12-08T08:22:59.274501+0000","last_became_peered":"2023-12-08T08:22:59.274501+0000","last_unstale":"2023-12-08T08:23:01.983222+0000","last_undegraded":"2023-12-08T08:23:01.983222+0000","last_fullsized":"2023-12-08T08:23:01.983222+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:54.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092935+0000","last_change":"2023-12-08T08:23:00.298811+0000","last_active":"2023-12-08T08:23:02.092935+0000","last_peered":"2023-12-08T08:23:02.092935+0000","last_clean":"2023-12-08T08:23:02.092935+0000","last_became_active":"2023-12-08T08:23:00.298524+0000","last_became_peered":"2023-12-08T08:23:00.298524+0000","last_unstale":"2023-12-08T08:23:02.092935+0000","last_undegraded":"2023-12-08T08:23:02.092935+0000","last_fullsized":"2023-12-08T08:23:02.092935+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093491+0000","last_change":"2023-12-08T08:22:59.274339+0000","last_active":"2023-12-08T08:23:02.093491+0000","last_peered":"2023-12-08T08:23:02.093491+0000","last_clean":"2023-12-08T08:23:02.093491+0000","last_became_active":"2023-12-08T08:22:59.272932+0000","last_became_peered":"2023-12-08T08:22:59.272932+0000","last_unstale":"2023-12-08T08:23:02.093491+0000","last_undegraded":"2023-12-08T08:23:02.093491+0000","last_fullsized":"2023-12-08T08:23:02.093491+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:14.464401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092664+0000","last_change":"2023-12-08T08:23:00.292745+0000","last_active":"2023-12-08T08:23:02.092664+0000","last_peered":"2023-12-08T08:23:02.092664+0000","last_clean":"2023-12-08T08:23:02.092664+0000","last_became_active":"2023-12-08T08:23:00.292132+0000","last_became_peered":"2023-12-08T08:23:00.292132+0000","last_unstale":"2023-12-08T08:23:02.092664+0000","last_undegraded":"2023-12-08T08:23:02.092664+0000","last_fullsized":"2023-12-08T08:23:02.092664+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:13.139346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092554+0000","last_change":"2023-12-08T08:22:59.268769+0000","last_active":"2023-12-08T08:23:02.092554+0000","last_peered":"2023-12-08T08:23:02.092554+0000","last_clean":"2023-12-08T08:23:02.092554+0000","last_became_active":"2023-12-08T08:22:59.268494+0000","last_became_peered":"2023-12-08T08:22:59.268494+0000","last_unstale":"2023-12-08T08:23:02.092554+0000","last_undegraded":"2023-12-08T08:23:02.092554+0000","last_fullsized":"2023-12-08T08:23:02.092554+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:56:23.131251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093698+0000","last_change":"2023-12-08T08:23:00.275783+0000","last_active":"2023-12-08T08:23:02.093698+0000","last_peered":"2023-12-08T08:23:02.093698+0000","last_clean":"2023-12-08T08:23:02.093698+0000","last_became_active":"2023-12-08T08:23:00.275444+0000","last_became_peered":"2023-12-08T08:23:00.275444+0000","last_unstale":"2023-12-08T08:23:02.093698+0000","last_undegraded":"2023-12-08T08:23:02.093698+0000","last_fullsized":"2023-12-08T08:23:02.093698+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:56:00.436152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277518+0000","last_change":"2023-12-08T08:22:59.280443+0000","last_active":"2023-12-08T08:23:01.277518+0000","last_peered":"2023-12-08T08:23:01.277518+0000","last_clean":"2023-12-08T08:23:01.277518+0000","last_became_active":"2023-12-08T08:22:59.280138+0000","last_became_peered":"2023-12-08T08:22:59.280138+0000","last_unstale":"2023-12-08T08:23:01.277518+0000","last_undegraded":"2023-12-08T08:23:01.277518+0000","last_fullsized":"2023-12-08T08:23:01.277518+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:13:21.524504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093806+0000","last_change":"2023-12-08T08:23:00.304825+0000","last_active":"2023-12-08T08:23:02.093806+0000","last_peered":"2023-12-08T08:23:02.093806+0000","last_clean":"2023-12-08T08:23:02.093806+0000","last_became_active":"2023-12-08T08:23:00.304549+0000","last_became_peered":"2023-12-08T08:23:00.304549+0000","last_unstale":"2023-12-08T08:23:02.093806+0000","last_undegraded":"2023-12-08T08:23:02.093806+0000","last_fullsized":"2023-12-08T08:23:02.093806+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277432+0000","last_change":"2023-12-08T08:22:59.283795+0000","last_active":"2023-12-08T08:23:01.277432+0000","last_peered":"2023-12-08T08:23:01.277432+0000","last_clean":"2023-12-08T08:23:01.277432+0000","last_became_active":"2023-12-08T08:22:59.283486+0000","last_became_peered":"2023-12-08T08:22:59.283486+0000","last_unstale":"2023-12-08T08:23:01.277432+0000","last_undegraded":"2023-12-08T08:23:01.277432+0000","last_fullsized":"2023-12-08T08:23:01.277432+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:30:43.384001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093094+0000","last_change":"2023-12-08T08:23:00.293145+0000","last_active":"2023-12-08T08:23:02.093094+0000","last_peered":"2023-12-08T08:23:02.093094+0000","last_clean":"2023-12-08T08:23:02.093094+0000","last_became_active":"2023-12-08T08:23:00.292927+0000","last_became_peered":"2023-12-08T08:23:00.292927+0000","last_unstale":"2023-12-08T08:23:02.093094+0000","last_undegraded":"2023-12-08T08:23:02.093094+0000","last_fullsized":"2023-12-08T08:23:02.093094+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:56.216551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"67'3","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277143+0000","last_change":"2023-12-08T08:22:59.281141+0000","last_active":"2023-12-08T08:23:01.277143+0000","last_peered":"2023-12-08T08:23:01.277143+0000","last_clean":"2023-12-08T08:23:01.277143+0000","last_became_active":"2023-12-08T08:22:59.280748+0000","last_became_peered":"2023-12-08T08:22:59.280748+0000","last_unstale":"2023-12-08T08:23:01.277143+0000","last_undegraded":"2023-12-08T08:23:01.277143+0000","last_fullsized":"2023-12-08T08:23:01.277143+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:07:33.922762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983595+0000","last_change":"2023-12-08T08:23:00.299179+0000","last_active":"2023-12-08T08:23:01.983595+0000","last_peered":"2023-12-08T08:23:01.983595+0000","last_clean":"2023-12-08T08:23:01.983595+0000","last_became_active":"2023-12-08T08:23:00.298936+0000","last_became_peered":"2023-12-08T08:23:00.298936+0000","last_unstale":"2023-12-08T08:23:01.983595+0000","last_undegraded":"2023-12-08T08:23:01.983595+0000","last_fullsized":"2023-12-08T08:23:01.983595+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"67'6","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093460+0000","last_change":"2023-12-08T08:22:59.278612+0000","last_active":"2023-12-08T08:23:02.093460+0000","last_peered":"2023-12-08T08:23:02.093460+0000","last_clean":"2023-12-08T08:23:02.093460+0000","last_became_active":"2023-12-08T08:22:59.278325+0000","last_became_peered":"2023-12-08T08:22:59.278325+0000","last_unstale":"2023-12-08T08:23:02.093460+0000","last_undegraded":"2023-12-08T08:23:02.093460+0000","last_fullsized":"2023-12-08T08:23:02.093460+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:55:35.382801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092905+0000","last_change":"2023-12-08T08:23:00.292867+0000","last_active":"2023-12-08T08:23:02.092905+0000","last_peered":"2023-12-08T08:23:02.092905+0000","last_clean":"2023-12-08T08:23:02.092905+0000","last_became_active":"2023-12-08T08:23:00.292648+0000","last_became_peered":"2023-12-08T08:23:00.292648+0000","last_unstale":"2023-12-08T08:23:02.092905+0000","last_undegraded":"2023-12-08T08:23:02.092905+0000","last_fullsized":"2023-12-08T08:23:02.092905+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:29:03.020360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093400+0000","last_change":"2023-12-08T08:22:59.262821+0000","last_active":"2023-12-08T08:23:02.093400+0000","last_peered":"2023-12-08T08:23:02.093400+0000","last_clean":"2023-12-08T08:23:02.093400+0000","last_became_active":"2023-12-08T08:22:59.262569+0000","last_became_peered":"2023-12-08T08:22:59.262569+0000","last_unstale":"2023-12-08T08:23:02.093400+0000","last_undegraded":"2023-12-08T08:23:02.093400+0000","last_fullsized":"2023-12-08T08:23:02.093400+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:52:55.751217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093233+0000","last_change":"2023-12-08T08:23:00.298706+0000","last_active":"2023-12-08T08:23:02.093233+0000","last_peered":"2023-12-08T08:23:02.093233+0000","last_clean":"2023-12-08T08:23:02.093233+0000","last_became_active":"2023-12-08T08:23:00.298452+0000","last_became_peered":"2023-12-08T08:23:00.298452+0000","last_unstale":"2023-12-08T08:23:02.093233+0000","last_undegraded":"2023-12-08T08:23:02.093233+0000","last_fullsized":"2023-12-08T08:23:02.093233+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:39.385907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093064+0000","last_change":"2023-12-08T08:22:59.270322+0000","last_active":"2023-12-08T08:23:02.093064+0000","last_peered":"2023-12-08T08:23:02.093064+0000","last_clean":"2023-12-08T08:23:02.093064+0000","last_became_active":"2023-12-08T08:22:59.270059+0000","last_became_peered":"2023-12-08T08:22:59.270059+0000","last_unstale":"2023-12-08T08:23:02.093064+0000","last_undegraded":"2023-12-08T08:23:02.093064+0000","last_fullsized":"2023-12-08T08:23:02.093064+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:21:58.531919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093504+0000","last_change":"2023-12-08T08:23:00.304324+0000","last_active":"2023-12-08T08:23:02.093504+0000","last_peered":"2023-12-08T08:23:02.093504+0000","last_clean":"2023-12-08T08:23:02.093504+0000","last_became_active":"2023-12-08T08:23:00.304038+0000","last_became_peered":"2023-12-08T08:23:00.304038+0000","last_unstale":"2023-12-08T08:23:02.093504+0000","last_undegraded":"2023-12-08T08:23:02.093504+0000","last_fullsized":"2023-12-08T08:23:02.093504+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:33:27.464394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093348+0000","last_change":"2023-12-08T08:22:59.270216+0000","last_active":"2023-12-08T08:23:02.093348+0000","last_peered":"2023-12-08T08:23:02.093348+0000","last_clean":"2023-12-08T08:23:02.093348+0000","last_became_active":"2023-12-08T08:22:59.269292+0000","last_became_peered":"2023-12-08T08:22:59.269292+0000","last_unstale":"2023-12-08T08:23:02.093348+0000","last_undegraded":"2023-12-08T08:23:02.093348+0000","last_fullsized":"2023-12-08T08:23:02.093348+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:18:01.309002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092503+0000","last_change":"2023-12-08T08:23:00.276305+0000","last_active":"2023-12-08T08:23:02.092503+0000","last_peered":"2023-12-08T08:23:02.092503+0000","last_clean":"2023-12-08T08:23:02.092503+0000","last_became_active":"2023-12-08T08:23:00.275989+0000","last_became_peered":"2023-12-08T08:23:00.275989+0000","last_unstale":"2023-12-08T08:23:02.092503+0000","last_undegraded":"2023-12-08T08:23:02.092503+0000","last_fullsized":"2023-12-08T08:23:02.092503+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:24:33.735501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"67'8","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092786+0000","last_change":"2023-12-08T08:22:59.271542+0000","last_active":"2023-12-08T08:23:02.092786+0000","last_peered":"2023-12-08T08:23:02.092786+0000","last_clean":"2023-12-08T08:23:02.092786+0000","last_became_active":"2023-12-08T08:22:59.271240+0000","last_became_peered":"2023-12-08T08:22:59.271240+0000","last_unstale":"2023-12-08T08:23:02.092786+0000","last_undegraded":"2023-12-08T08:23:02.092786+0000","last_fullsized":"2023-12-08T08:23:02.092786+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:32.897955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093623+0000","last_change":"2023-12-08T08:23:00.280374+0000","last_active":"2023-12-08T08:23:02.093623+0000","last_peered":"2023-12-08T08:23:02.093623+0000","last_clean":"2023-12-08T08:23:02.093623+0000","last_became_active":"2023-12-08T08:23:00.280096+0000","last_became_peered":"2023-12-08T08:23:00.280096+0000","last_unstale":"2023-12-08T08:23:02.093623+0000","last_undegraded":"2023-12-08T08:23:02.093623+0000","last_fullsized":"2023-12-08T08:23:02.093623+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:21:59.539539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277612+0000","last_change":"2023-12-08T08:22:59.283727+0000","last_active":"2023-12-08T08:23:01.277612+0000","last_peered":"2023-12-08T08:23:01.277612+0000","last_clean":"2023-12-08T08:23:01.277612+0000","last_became_active":"2023-12-08T08:22:59.283254+0000","last_became_peered":"2023-12-08T08:22:59.283254+0000","last_unstale":"2023-12-08T08:23:01.277612+0000","last_undegraded":"2023-12-08T08:23:01.277612+0000","last_fullsized":"2023-12-08T08:23:01.277612+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:18:01.309002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277572+0000","last_change":"2023-12-08T08:23:00.282901+0000","last_active":"2023-12-08T08:23:01.277572+0000","last_peered":"2023-12-08T08:23:01.277572+0000","last_clean":"2023-12-08T08:23:01.277572+0000","last_became_active":"2023-12-08T08:23:00.282646+0000","last_became_peered":"2023-12-08T08:23:00.282646+0000","last_unstale":"2023-12-08T08:23:01.277572+0000","last_undegraded":"2023-12-08T08:23:01.277572+0000","last_fullsized":"2023-12-08T08:23:01.277572+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092773+0000","last_change":"2023-12-08T08:22:59.265669+0000","last_active":"2023-12-08T08:23:02.092773+0000","last_peered":"2023-12-08T08:23:02.092773+0000","last_clean":"2023-12-08T08:23:02.092773+0000","last_became_active":"2023-12-08T08:22:59.265364+0000","last_became_peered":"2023-12-08T08:22:59.265364+0000","last_unstale":"2023-12-08T08:23:02.092773+0000","last_undegraded":"2023-12-08T08:23:02.092773+0000","last_fullsized":"2023-12-08T08:23:02.092773+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:27:38.296266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983692+0000","last_change":"2023-12-08T08:23:00.270198+0000","last_active":"2023-12-08T08:23:01.983692+0000","last_peered":"2023-12-08T08:23:01.983692+0000","last_clean":"2023-12-08T08:23:01.983692+0000","last_became_active":"2023-12-08T08:23:00.269930+0000","last_became_peered":"2023-12-08T08:23:00.269930+0000","last_unstale":"2023-12-08T08:23:01.983692+0000","last_undegraded":"2023-12-08T08:23:01.983692+0000","last_fullsized":"2023-12-08T08:23:01.983692+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093281+0000","last_change":"2023-12-08T08:22:59.273655+0000","last_active":"2023-12-08T08:23:02.093281+0000","last_peered":"2023-12-08T08:23:02.093281+0000","last_clean":"2023-12-08T08:23:02.093281+0000","last_became_active":"2023-12-08T08:22:59.273396+0000","last_became_peered":"2023-12-08T08:22:59.273396+0000","last_unstale":"2023-12-08T08:23:02.093281+0000","last_undegraded":"2023-12-08T08:23:02.093281+0000","last_fullsized":"2023-12-08T08:23:02.093281+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.886510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277418+0000","last_change":"2023-12-08T08:23:00.285854+0000","last_active":"2023-12-08T08:23:01.277418+0000","last_peered":"2023-12-08T08:23:01.277418+0000","last_clean":"2023-12-08T08:23:01.277418+0000","last_became_active":"2023-12-08T08:23:00.285553+0000","last_became_peered":"2023-12-08T08:23:00.285553+0000","last_unstale":"2023-12-08T08:23:01.277418+0000","last_undegraded":"2023-12-08T08:23:01.277418+0000","last_fullsized":"2023-12-08T08:23:01.277418+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:15:44.184576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093292+0000","last_change":"2023-12-08T08:22:59.282745+0000","last_active":"2023-12-08T08:23:02.093292+0000","last_peered":"2023-12-08T08:23:02.093292+0000","last_clean":"2023-12-08T08:23:02.093292+0000","last_became_active":"2023-12-08T08:22:59.282443+0000","last_became_peered":"2023-12-08T08:22:59.282443+0000","last_unstale":"2023-12-08T08:23:02.093292+0000","last_undegraded":"2023-12-08T08:23:02.093292+0000","last_fullsized":"2023-12-08T08:23:02.093292+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:21.899236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093125+0000","last_change":"2023-12-08T08:23:00.286165+0000","last_active":"2023-12-08T08:23:02.093125+0000","last_peered":"2023-12-08T08:23:02.093125+0000","last_clean":"2023-12-08T08:23:02.093125+0000","last_became_active":"2023-12-08T08:23:00.285209+0000","last_became_peered":"2023-12-08T08:23:00.285209+0000","last_unstale":"2023-12-08T08:23:02.093125+0000","last_undegraded":"2023-12-08T08:23:02.093125+0000","last_fullsized":"2023-12-08T08:23:02.093125+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:16.068318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277643+0000","last_change":"2023-12-08T08:22:59.272934+0000","last_active":"2023-12-08T08:23:01.277643+0000","last_peered":"2023-12-08T08:23:01.277643+0000","last_clean":"2023-12-08T08:23:01.277643+0000","last_became_active":"2023-12-08T08:22:59.272094+0000","last_became_peered":"2023-12-08T08:22:59.272094+0000","last_unstale":"2023-12-08T08:23:01.277643+0000","last_undegraded":"2023-12-08T08:23:01.277643+0000","last_fullsized":"2023-12-08T08:23:01.277643+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:33:18.775139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277017+0000","last_change":"2023-12-08T08:23:00.287292+0000","last_active":"2023-12-08T08:23:01.277017+0000","last_peered":"2023-12-08T08:23:01.277017+0000","last_clean":"2023-12-08T08:23:01.277017+0000","last_became_active":"2023-12-08T08:23:00.284565+0000","last_became_peered":"2023-12-08T08:23:00.284565+0000","last_unstale":"2023-12-08T08:23:01.277017+0000","last_undegraded":"2023-12-08T08:23:01.277017+0000","last_fullsized":"2023-12-08T08:23:01.277017+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:17:25.641139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277017+0000","last_change":"2023-12-08T08:22:59.279857+0000","last_active":"2023-12-08T08:23:01.277017+0000","last_peered":"2023-12-08T08:23:01.277017+0000","last_clean":"2023-12-08T08:23:01.277017+0000","last_became_active":"2023-12-08T08:22:59.279508+0000","last_became_peered":"2023-12-08T08:22:59.279508+0000","last_unstale":"2023-12-08T08:23:01.277017+0000","last_undegraded":"2023-12-08T08:23:01.277017+0000","last_fullsized":"2023-12-08T08:23:01.277017+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:23.192834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093241+0000","last_change":"2023-12-08T08:23:00.291227+0000","last_active":"2023-12-08T08:23:02.093241+0000","last_peered":"2023-12-08T08:23:02.093241+0000","last_clean":"2023-12-08T08:23:02.093241+0000","last_became_active":"2023-12-08T08:23:00.290984+0000","last_became_peered":"2023-12-08T08:23:00.290984+0000","last_unstale":"2023-12-08T08:23:02.093241+0000","last_undegraded":"2023-12-08T08:23:02.093241+0000","last_fullsized":"2023-12-08T08:23:02.093241+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:33.905575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092294+0000","last_change":"2023-12-08T08:22:59.282842+0000","last_active":"2023-12-08T08:23:02.092294+0000","last_peered":"2023-12-08T08:23:02.092294+0000","last_clean":"2023-12-08T08:23:02.092294+0000","last_became_active":"2023-12-08T08:22:59.282605+0000","last_became_peered":"2023-12-08T08:22:59.282605+0000","last_unstale":"2023-12-08T08:23:02.092294+0000","last_undegraded":"2023-12-08T08:23:02.092294+0000","last_fullsized":"2023-12-08T08:23:02.092294+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:55.208931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983775+0000","last_change":"2023-12-08T08:23:00.270620+0000","last_active":"2023-12-08T08:23:01.983775+0000","last_peered":"2023-12-08T08:23:01.983775+0000","last_clean":"2023-12-08T08:23:01.983775+0000","last_became_active":"2023-12-08T08:23:00.270369+0000","last_became_peered":"2023-12-08T08:23:00.270369+0000","last_unstale":"2023-12-08T08:23:01.983775+0000","last_undegraded":"2023-12-08T08:23:01.983775+0000","last_fullsized":"2023-12-08T08:23:01.983775+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:33.898137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093945+0000","last_change":"2023-12-08T08:22:59.269712+0000","last_active":"2023-12-08T08:23:02.093945+0000","last_peered":"2023-12-08T08:23:02.093945+0000","last_clean":"2023-12-08T08:23:02.093945+0000","last_became_active":"2023-12-08T08:22:59.269426+0000","last_became_peered":"2023-12-08T08:22:59.269426+0000","last_unstale":"2023-12-08T08:23:02.093945+0000","last_undegraded":"2023-12-08T08:23:02.093945+0000","last_fullsized":"2023-12-08T08:23:02.093945+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:49:28.705874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093710+0000","last_change":"2023-12-08T08:23:00.280543+0000","last_active":"2023-12-08T08:23:02.093710+0000","last_peered":"2023-12-08T08:23:02.093710+0000","last_clean":"2023-12-08T08:23:02.093710+0000","last_became_active":"2023-12-08T08:23:00.280152+0000","last_became_peered":"2023-12-08T08:23:00.280152+0000","last_unstale":"2023-12-08T08:23:02.093710+0000","last_undegraded":"2023-12-08T08:23:02.093710+0000","last_fullsized":"2023-12-08T08:23:02.093710+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:37:47.067543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093863+0000","last_change":"2023-12-08T08:22:59.263185+0000","last_active":"2023-12-08T08:23:02.093863+0000","last_peered":"2023-12-08T08:23:02.093863+0000","last_clean":"2023-12-08T08:23:02.093863+0000","last_became_active":"2023-12-08T08:22:59.262924+0000","last_became_peered":"2023-12-08T08:22:59.262924+0000","last_unstale":"2023-12-08T08:23:02.093863+0000","last_undegraded":"2023-12-08T08:23:02.093863+0000","last_fullsized":"2023-12-08T08:23:02.093863+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:39:59.028170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277399+0000","last_change":"2023-12-08T08:23:00.304740+0000","last_active":"2023-12-08T08:23:01.277399+0000","last_peered":"2023-12-08T08:23:01.277399+0000","last_clean":"2023-12-08T08:23:01.277399+0000","last_became_active":"2023-12-08T08:23:00.304390+0000","last_became_peered":"2023-12-08T08:23:00.304390+0000","last_unstale":"2023-12-08T08:23:01.277399+0000","last_undegraded":"2023-12-08T08:23:01.277399+0000","last_fullsized":"2023-12-08T08:23:01.277399+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277282+0000","last_change":"2023-12-08T08:22:59.285952+0000","last_active":"2023-12-08T08:23:01.277282+0000","last_peered":"2023-12-08T08:23:01.277282+0000","last_clean":"2023-12-08T08:23:01.277282+0000","last_became_active":"2023-12-08T08:22:59.285309+0000","last_became_peered":"2023-12-08T08:22:59.285309+0000","last_unstale":"2023-12-08T08:23:01.277282+0000","last_undegraded":"2023-12-08T08:23:01.277282+0000","last_fullsized":"2023-12-08T08:23:01.277282+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:19.279362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983788+0000","last_change":"2023-12-08T08:23:00.299161+0000","last_active":"2023-12-08T08:23:01.983788+0000","last_peered":"2023-12-08T08:23:01.983788+0000","last_clean":"2023-12-08T08:23:01.983788+0000","last_became_active":"2023-12-08T08:23:00.298876+0000","last_became_peered":"2023-12-08T08:23:00.298876+0000","last_unstale":"2023-12-08T08:23:01.983788+0000","last_undegraded":"2023-12-08T08:23:01.983788+0000","last_fullsized":"2023-12-08T08:23:01.983788+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:29:03.020360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277470+0000","last_change":"2023-12-08T08:22:59.280536+0000","last_active":"2023-12-08T08:23:01.277470+0000","last_peered":"2023-12-08T08:23:01.277470+0000","last_clean":"2023-12-08T08:23:01.277470+0000","last_became_active":"2023-12-08T08:22:59.280213+0000","last_became_peered":"2023-12-08T08:22:59.280213+0000","last_unstale":"2023-12-08T08:23:01.277470+0000","last_undegraded":"2023-12-08T08:23:01.277470+0000","last_fullsized":"2023-12-08T08:23:01.277470+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:49.883139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093626+0000","last_change":"2023-12-08T08:23:00.285721+0000","last_active":"2023-12-08T08:23:02.093626+0000","last_peered":"2023-12-08T08:23:02.093626+0000","last_clean":"2023-12-08T08:23:02.093626+0000","last_became_active":"2023-12-08T08:23:00.285446+0000","last_became_peered":"2023-12-08T08:23:00.285446+0000","last_unstale":"2023-12-08T08:23:02.093626+0000","last_undegraded":"2023-12-08T08:23:02.093626+0000","last_fullsized":"2023-12-08T08:23:02.093626+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093391+0000","last_change":"2023-12-08T08:22:59.272111+0000","last_active":"2023-12-08T08:23:02.093391+0000","last_peered":"2023-12-08T08:23:02.093391+0000","last_clean":"2023-12-08T08:23:02.093391+0000","last_became_active":"2023-12-08T08:22:59.271849+0000","last_became_peered":"2023-12-08T08:22:59.271849+0000","last_unstale":"2023-12-08T08:23:02.093391+0000","last_undegraded":"2023-12-08T08:23:02.093391+0000","last_fullsized":"2023-12-08T08:23:02.093391+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:15.060698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093317+0000","last_change":"2023-12-08T08:23:00.292346+0000","last_active":"2023-12-08T08:23:02.093317+0000","last_peered":"2023-12-08T08:23:02.093317+0000","last_clean":"2023-12-08T08:23:02.093317+0000","last_became_active":"2023-12-08T08:23:00.292166+0000","last_became_peered":"2023-12-08T08:23:00.292166+0000","last_unstale":"2023-12-08T08:23:02.093317+0000","last_undegraded":"2023-12-08T08:23:02.093317+0000","last_fullsized":"2023-12-08T08:23:02.093317+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:21:59.539539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983368+0000","last_change":"2023-12-08T08:22:59.271088+0000","last_active":"2023-12-08T08:23:01.983368+0000","last_peered":"2023-12-08T08:23:01.983368+0000","last_clean":"2023-12-08T08:23:01.983368+0000","last_became_active":"2023-12-08T08:22:59.270783+0000","last_became_peered":"2023-12-08T08:22:59.270783+0000","last_unstale":"2023-12-08T08:23:01.983368+0000","last_undegraded":"2023-12-08T08:23:01.983368+0000","last_fullsized":"2023-12-08T08:23:01.983368+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:30:43.384001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092920+0000","last_change":"2023-12-08T08:23:00.283700+0000","last_active":"2023-12-08T08:23:02.092920+0000","last_peered":"2023-12-08T08:23:02.092920+0000","last_clean":"2023-12-08T08:23:02.092920+0000","last_became_active":"2023-12-08T08:23:00.283439+0000","last_became_peered":"2023-12-08T08:23:00.283439+0000","last_unstale":"2023-12-08T08:23:02.092920+0000","last_undegraded":"2023-12-08T08:23:02.092920+0000","last_fullsized":"2023-12-08T08:23:02.092920+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277224+0000","last_change":"2023-12-08T08:22:59.280725+0000","last_active":"2023-12-08T08:23:01.277224+0000","last_peered":"2023-12-08T08:23:01.277224+0000","last_clean":"2023-12-08T08:23:01.277224+0000","last_became_active":"2023-12-08T08:22:59.279736+0000","last_became_peered":"2023-12-08T08:22:59.279736+0000","last_unstale":"2023-12-08T08:23:01.277224+0000","last_undegraded":"2023-12-08T08:23:01.277224+0000","last_fullsized":"2023-12-08T08:23:01.277224+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:54.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277100+0000","last_change":"2023-12-08T08:23:00.305076+0000","last_active":"2023-12-08T08:23:01.277100+0000","last_peered":"2023-12-08T08:23:01.277100+0000","last_clean":"2023-12-08T08:23:01.277100+0000","last_became_active":"2023-12-08T08:23:00.304435+0000","last_became_peered":"2023-12-08T08:23:00.304435+0000","last_unstale":"2023-12-08T08:23:01.277100+0000","last_undegraded":"2023-12-08T08:23:01.277100+0000","last_fullsized":"2023-12-08T08:23:01.277100+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:42:20.038693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983235+0000","last_change":"2023-12-08T08:22:59.278661+0000","last_active":"2023-12-08T08:23:01.983235+0000","last_peered":"2023-12-08T08:23:01.983235+0000","last_clean":"2023-12-08T08:23:01.983235+0000","last_became_active":"2023-12-08T08:22:59.278383+0000","last_became_peered":"2023-12-08T08:22:59.278383+0000","last_unstale":"2023-12-08T08:23:01.983235+0000","last_undegraded":"2023-12-08T08:23:01.983235+0000","last_fullsized":"2023-12-08T08:23:01.983235+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:35:15.000491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093148+0000","last_change":"2023-12-08T08:23:00.270574+0000","last_active":"2023-12-08T08:23:02.093148+0000","last_peered":"2023-12-08T08:23:02.093148+0000","last_clean":"2023-12-08T08:23:02.093148+0000","last_became_active":"2023-12-08T08:23:00.270304+0000","last_became_peered":"2023-12-08T08:23:00.270304+0000","last_unstale":"2023-12-08T08:23:02.093148+0000","last_undegraded":"2023-12-08T08:23:02.093148+0000","last_fullsized":"2023-12-08T08:23:02.093148+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:15:55.762883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093485+0000","last_change":"2023-12-08T08:22:59.275324+0000","last_active":"2023-12-08T08:23:02.093485+0000","last_peered":"2023-12-08T08:23:02.093485+0000","last_clean":"2023-12-08T08:23:02.093485+0000","last_became_active":"2023-12-08T08:22:59.275038+0000","last_became_peered":"2023-12-08T08:22:59.275038+0000","last_unstale":"2023-12-08T08:23:02.093485+0000","last_undegraded":"2023-12-08T08:23:02.093485+0000","last_fullsized":"2023-12-08T08:23:02.093485+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:09.089659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":205,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-08T08:23:00.270124+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:23:00.270124+0000","last_peered":"2023-12-08T08:23:00.270124+0000","last_clean":"2023-12-08T08:23:00.270124+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:23:00.270124+0000","last_undegraded":"2023-12-08T08:23:00.270124+0000","last_fullsized":"2023-12-08T08:23:00.270124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":892928,"data_stored":948661,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89900000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.85299999999999998,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.72099999999999997}]},{"osd":1,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85999999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89600000000000002,"5min":1.446,"15min":1.446},"last":0.61499999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.71999999999999997,"15min":0.72899999999999998},"min":{"1min":0.52100000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.871,"5min":1.379,"15min":1.379},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.47599999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.84599999999999997,"5min":1.706,"15min":1.706},"last":0.67900000000000005}]},{"osd":3,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.751,"15min":0.76300000000000001},"min":{"1min":0.54500000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.88700000000000001,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.56699999999999995,"5min":0.496,"15min":0.496},"max":{"1min":0.83099999999999996,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.59399999999999997}]},{"osd":4,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.46899999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.90000000000000002,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.502},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.72599999999999998,"15min":0.74199999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83999999999999997,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.64200000000000002}]},{"osd":5,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.77500000000000002,"15min":0.79500000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81399999999999995,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.78500000000000003,"15min":0.80200000000000005},"min":{"1min":0.499,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93300000000000005,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.66300000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.84799999999999998,"15min":0.86499999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.95899999999999996,"5min":1.573,"15min":1.573},"last":0.749},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.80000000000000004,"15min":0.81499999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91100000000000003,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.57499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":847872,"data_stored":365217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66800000000000004,"15min":0.66500000000000004},"min":{"1min":0.41399999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86699999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.58199999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.90700000000000003,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.79200000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.72099999999999997,"15min":0.71799999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.74099999999999999,"15min":0.73599999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.70199999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.82999999999999996,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.745,"15min":0.749},"min":{"1min":0.51500000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91300000000000003,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.65900000000000003}]},{"osd":3,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.55900000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.85299999999999998,"5min":0.998,"15min":0.998},"last":0.751},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75,"15min":0.753},"min":{"1min":0.497,"5min":0.434,"15min":0.434},"max":{"1min":0.878,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.63900000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.71599999999999997,"15min":0.73099999999999998},"min":{"1min":0.46400000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.98799999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.748,"15min":0.76500000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.95199999999999996,"5min":1.014,"15min":1.014},"last":0.54100000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.78100000000000003,"15min":0.80100000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.006,"5min":1.091,"15min":1.091},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.83299999999999996,"15min":0.84799999999999998},"min":{"1min":0.54800000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1419999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.71999999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.80300000000000005,"15min":0.82199999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.03,"5min":1.04,"15min":1.04},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.877,"15min":0.90300000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0740000000000001,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.57199999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":851968,"data_stored":366157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.747,"5min":1.081,"15min":1.081},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.90300000000000002,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.60299999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.68999999999999995,"15min":0.68000000000000005},"min":{"1min":0.49399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.002,"5min":1.194,"15min":1.194},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70599999999999996,"15min":0.71499999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.879,"5min":1.143,"15min":1.143},"last":0.69999999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.69799999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.98099999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72899999999999998,"15min":0.73299999999999998},"min":{"1min":0.52400000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.92200000000000004,"5min":1.101,"15min":1.101},"last":0.57799999999999996}]},{"osd":3,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.74099999999999999,"15min":0.746},"min":{"1min":0.47399999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0189999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.75},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.76300000000000001,"15min":0.753},"min":{"1min":0.61599999999999999,"5min":0.5,"15min":0.5},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.71899999999999997}]},{"osd":4,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82099999999999995,"5min":1.01,"15min":1.01},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94099999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.879}]},{"osd":6,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77900000000000003,"15min":0.78600000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93999999999999995,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84899999999999998,"5min":1.073,"15min":1.073},"last":0.85499999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78800000000000003,"15min":0.79400000000000004},"min":{"1min":0.51000000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.995,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.85299999999999998,"15min":0.86099999999999999},"min":{"1min":0.54400000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.97699999999999998,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.83599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":835584,"data_stored":364523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69099999999999995,"15min":0.69699999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.95599999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66400000000000003,"15min":0.66200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.68300000000000005}]},{"osd":1,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.45400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.018,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51000000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90100000000000002,"5min":1.002,"15min":1.002},"last":0.65100000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.68500000000000005,"15min":0.69099999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88100000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.72499999999999998,"15min":0.71999999999999997},"min":{"1min":0.55700000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.753}]},{"osd":3,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.751,"15min":0.755},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.92200000000000004,"5min":1.359,"15min":1.359},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.77700000000000002,"15min":0.79300000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93700000000000006,"5min":1.232,"15min":1.232},"last":0.623}]},{"osd":5,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.66500000000000004,"15min":0.67500000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85599999999999998,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.77000000000000002,"15min":0.78900000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.995,"5min":1.091,"15min":1.091},"last":0.85599999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.70699999999999996,"15min":0.72199999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78400000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78800000000000003,"15min":0.79800000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93400000000000005,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.83699999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.81999999999999995,"15min":0.83199999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.96699999999999997,"5min":1.246,"15min":1.246},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.79200000000000004,"15min":0.80900000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97599999999999998,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.879}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":847872,"data_stored":366135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.42299999999999999,"15min":0.433},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.46500000000000002,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.45900000000000002,"15min":0.46400000000000002},"min":{"1min":0.33500000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.54900000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.38100000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.435,"15min":0.436},"min":{"1min":0.308,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.49299999999999999,"15min":0.497},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.51600000000000001,"15min":0.52400000000000002},"min":{"1min":0.39600000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.64000000000000001,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.53600000000000003,"15min":0.54300000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.77100000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.497}]},{"osd":4,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.56599999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94099999999999995,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.747,"15min":0.76100000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0349999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.61799999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.72799999999999998,"15min":0.73799999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.87,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.75800000000000001,"15min":0.77000000000000002},"min":{"1min":0.53000000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91600000000000004,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.60499999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.79300000000000004,"15min":0.80700000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.026,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.79000000000000004,"15min":0.80200000000000005},"min":{"1min":0.58699999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.89400000000000002,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.755},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90400000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.77200000000000002,"15min":0.78300000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.86799999999999999,"5min":1.121,"15min":1.121},"last":0.59499999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":839680,"data_stored":365105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.39400000000000002,"15min":0.40200000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52500000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.311},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.52200000000000002,"15min":0.54000000000000004},"min":{"1min":0.32300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.63300000000000001,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.38900000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.47099999999999997,"15min":0.47399999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.67900000000000005,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.49199999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.56899999999999995,"15min":0.58599999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70399999999999996,"5min":3.008,"15min":3.008},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48499999999999999,"15min":0.48699999999999999},"min":{"1min":0.39200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.59499999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.44400000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.80300000000000005,"15min":0.82299999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92500000000000004,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":1.004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.75800000000000001,"15min":0.76500000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93000000000000005,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.61499999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76500000000000001,"15min":0.77100000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.05,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.81299999999999994,"15min":0.83699999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0129999999999999,"5min":3.637,"15min":3.637},"last":0.90900000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.78500000000000003,"15min":0.79600000000000004},"min":{"1min":0.55800000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.96899999999999997,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.78500000000000003,"15min":0.79700000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.002,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":1.038}]},{"osd":7,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.876,"15min":0.90900000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.83999999999999997,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.83199999999999996,"15min":0.84099999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.997,"5min":1.766,"15min":1.766},"last":0.84899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":847872,"data_stored":364717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.65000000000000002,"15min":0.69299999999999995},"min":{"1min":0.29699999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.69899999999999995,"5min":5.2210000000000001,"15min":5.2210000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.83099999999999996,"15min":0.89100000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69499999999999995,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.80600000000000005,"15min":0.87},"min":{"1min":0.309,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.52900000000000003,"5min":8.2070000000000007,"15min":8.2070000000000007},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.68200000000000005,"15min":0.71999999999999997},"min":{"1min":0.34200000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.70899999999999996,"5min":4.351,"15min":4.351},"last":0.56799999999999995}]},{"osd":3,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.91000000000000003,"15min":0.97599999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.74199999999999999,"5min":8.1479999999999997,"15min":8.1479999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.746,"15min":0.79300000000000004},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63900000000000001,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.44700000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.98399999999999999,"15min":1.036},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.95499999999999996,"5min":4.8470000000000004,"15min":4.8470000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":1.0549999999999999,"15min":1.1080000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.97599999999999998,"5min":4.7939999999999996,"15min":4.7939999999999996},"last":0.73999999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.97099999999999997,"15min":1.0089999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0329999999999999,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.96399999999999997,"15min":1.0009999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92900000000000005,"5min":4.5830000000000002,"15min":4.5830000000000002},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":1.0700000000000001,"15min":1.127},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.95599999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":1.0489999999999999,"15min":1.101},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0149999999999999,"5min":4.6289999999999996,"15min":4.6289999999999996},"last":0.75700000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.98199999999999998,"15min":1.024},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0169999999999999,"5min":4.665,"15min":4.665},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":1.0620000000000001,"15min":1.1120000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0720000000000001,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.77300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":892928,"data_stored":948625,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.48499999999999999,"15min":0.501},"min":{"1min":0.27300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61599999999999999,"5min":1.863,"15min":1.863},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.85499999999999998,"15min":0.91900000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.63200000000000001,"5min":8.2799999999999994,"15min":8.2799999999999994},"last":0.442}]},{"osd":2,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.89400000000000002,"15min":0.96999999999999997},"min":{"1min":0.314,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71299999999999997,"5min":7.9290000000000003,"15min":7.9290000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.433,"5min":0.89800000000000002,"15min":0.97599999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.57299999999999995,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.65200000000000002,"15min":0.68999999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.73199999999999998,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.84199999999999997,"15min":0.90000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.745,"5min":7.8890000000000002,"15min":7.8890000000000002},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":1.0309999999999999,"15min":1.0800000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77400000000000002,"15min":0.78500000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.101,"5min":1.607,"15min":1.607},"last":0.68500000000000005}]},{"osd":5,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.83199999999999996,"15min":0.83799999999999997},"min":{"1min":0.53000000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.133,"5min":1.514,"15min":1.514},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":1.0800000000000001,"15min":1.1399999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98899999999999999,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.51400000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.81699999999999995,"15min":0.83499999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.042,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":1.032,"15min":1.081},"min":{"1min":0.55700000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0800000000000001,"5min":7.835,"15min":7.835},"last":0.67000000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":1.0580000000000001,"15min":1.1080000000000001},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1719999999999999,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.84299999999999997,"15min":0.86499999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1539999999999999,"5min":1.794,"15min":1.794},"last":0.71499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:23:05.087 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-08T08:23:05.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.262+0000 7fa457f1d640 1 Processor -- start 2023-12-08T08:23:05.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.262+0000 7fa457f1d640 1 -- start start 2023-12-08T08:23:05.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.262+0000 7fa457f1d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa4500af4c0 0x7fa450154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:05.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.262+0000 7fa457f1d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4500c67d0 0x7fa4500c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:05.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.262+0000 7fa457f1d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4500c4890 con 0x7fa45006b9f0 2023-12-08T08:23:05.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.262+0000 7fa457f1d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa450155460 con 0x7fa4500af4c0 2023-12-08T08:23:05.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.262+0000 7fa457f1d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4500af8a0 con 0x7fa4500c67d0 2023-12-08T08:23:05.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.262+0000 7fa455cb9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa4500af4c0 0x7fa450154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:05.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.262+0000 7fa4564ba640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa45006b9f0 0x7fa450157a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41242/0 (socket says 172.21.15.88:41242) 2023-12-08T08:23:05.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.262+0000 7fa4564ba640 1 -- 172.21.15.88:0/1865609686 learned_addr learned my addr 172.21.15.88:0/1865609686 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:05.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.262+0000 7fa4554b8640 1 --2- 172.21.15.88:0/1865609686 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4500c67d0 0x7fa4500c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:05.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.266+0000 7fa455cb9640 1 -- 172.21.15.88:0/1865609686 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4500c67d0 msgr2=0x7fa4500c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:05.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.266+0000 7fa455cb9640 1 --2- 172.21.15.88:0/1865609686 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4500c67d0 0x7fa4500c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:05.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.266+0000 7fa455cb9640 1 -- 172.21.15.88:0/1865609686 >> v1:172.21.15.88:6789/0 conn(0x7fa45006b9f0 legacy=0x7fa450157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:05.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.266+0000 7fa455cb9640 1 -- 172.21.15.88:0/1865609686 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4500c4b30 con 0x7fa4500af4c0 2023-12-08T08:23:05.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.266+0000 7fa4554b8640 1 --2- 172.21.15.88:0/1865609686 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4500c67d0 0x7fa4500c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:05.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.266+0000 7fa454cb7640 1 -- 172.21.15.88:0/1865609686 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987558316 0 0) 0x7fa4500c4890 con 0x7fa45006b9f0 2023-12-08T08:23:05.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.266+0000 7fa455cb9640 1 --2- 172.21.15.88:0/1865609686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4500af4c0 0x7fa450154f20 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fa44c009d90 tx=0x7fa44c01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6dc8a08f69831a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:05.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.266+0000 7fa454cb7640 1 -- 172.21.15.88:0/1865609686 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c0a5950 con 0x7fa4500af4c0 2023-12-08T08:23:05.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.266+0000 7fa454cb7640 1 -- 172.21.15.88:0/1865609686 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44c0a5ab0 con 0x7fa4500af4c0 2023-12-08T08:23:05.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.266+0000 7fa454cb7640 1 -- 172.21.15.88:0/1865609686 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c0a5e40 con 0x7fa4500af4c0 2023-12-08T08:23:05.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.266+0000 7fa457f1d640 1 -- 172.21.15.88:0/1865609686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4500af4c0 msgr2=0x7fa450154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:05.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.266+0000 7fa457f1d640 1 --2- 172.21.15.88:0/1865609686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4500af4c0 0x7fa450154f20 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fa44c009d90 tx=0x7fa44c01c890 comp rx=0 tx=0).stop 2023-12-08T08:23:05.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.266+0000 7fa457f1d640 1 -- 172.21.15.88:0/1865609686 shutdown_connections 2023-12-08T08:23:05.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.266+0000 7fa457f1d640 1 --2- 172.21.15.88:0/1865609686 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa4500c67d0 0x7fa4500c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:05.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.266+0000 7fa457f1d640 1 --2- 172.21.15.88:0/1865609686 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4500af4c0 0x7fa450154f20 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:05.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.266+0000 7fa457f1d640 1 -- 172.21.15.88:0/1865609686 >> 172.21.15.88:0/1865609686 conn(0x7fa4500ab9d0 msgr2=0x7fa4500abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:05.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.270+0000 7fa457f1d640 1 -- 172.21.15.88:0/1865609686 shutdown_connections 2023-12-08T08:23:05.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.270+0000 7fa457f1d640 1 -- 172.21.15.88:0/1865609686 wait complete. 2023-12-08T08:23:05.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.270+0000 7fa457f1d640 1 Processor -- start 2023-12-08T08:23:05.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.270+0000 7fa457f1d640 1 -- start start 2023-12-08T08:23:05.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.270+0000 7fa457f1d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa45006b9f0 0x7fa450143b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:05.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.270+0000 7fa457f1d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4500af4c0 0x7fa450148ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:05.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.270+0000 7fa457f1d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4500c67d0 0x7fa450142f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:05.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.270+0000 7fa457f1d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4500ab080 con 0x7fa4500af4c0 2023-12-08T08:23:05.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.270+0000 7fa457f1d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4501ed630 con 0x7fa4500c67d0 2023-12-08T08:23:05.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.270+0000 7fa457f1d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4501edb60 con 0x7fa45006b9f0 2023-12-08T08:23:05.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.270+0000 7fa4554b8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4500af4c0 0x7fa450148ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:05.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.270+0000 7fa4554b8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4500af4c0 0x7fa450148ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50026/0 (socket says 172.21.15.88:50026) 2023-12-08T08:23:05.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.270+0000 7fa4554b8640 1 -- 172.21.15.88:0/1269093086 learned_addr learned my addr 172.21.15.88:0/1269093086 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:05.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.270+0000 7fa455cb9640 1 --2- 172.21.15.88:0/1269093086 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa45006b9f0 0x7fa450143b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:05.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.270+0000 7fa4564ba640 1 --2- 172.21.15.88:0/1269093086 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4500c67d0 0x7fa450142f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:05.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.270+0000 7fa4554b8640 1 -- 172.21.15.88:0/1269093086 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa45006b9f0 msgr2=0x7fa450143b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:05.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.270+0000 7fa4554b8640 1 --2- 172.21.15.88:0/1269093086 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa45006b9f0 0x7fa450143b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:05.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.270+0000 7fa4554b8640 1 -- 172.21.15.88:0/1269093086 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4500c67d0 msgr2=0x7fa450142f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:05.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.270+0000 7fa4554b8640 1 --2- 172.21.15.88:0/1269093086 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4500c67d0 0x7fa450142f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:05.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.270+0000 7fa4554b8640 1 -- 172.21.15.88:0/1269093086 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44c009a70 con 0x7fa4500af4c0 2023-12-08T08:23:05.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.270+0000 7fa4554b8640 1 --2- 172.21.15.88:0/1269093086 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4500af4c0 0x7fa450148ef0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fa44000e810 tx=0x7fa44000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:05.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.270+0000 7fa4467fc640 1 -- 172.21.15.88:0/1269093086 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44000c8d0 con 0x7fa4500af4c0 2023-12-08T08:23:05.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.270+0000 7fa4467fc640 1 -- 172.21.15.88:0/1269093086 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44000ca30 con 0x7fa4500af4c0 2023-12-08T08:23:05.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.270+0000 7fa4467fc640 1 -- 172.21.15.88:0/1269093086 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44000cde0 con 0x7fa4500af4c0 2023-12-08T08:23:05.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.270+0000 7fa457f1d640 1 -- 172.21.15.88:0/1269093086 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4501499d0 con 0x7fa4500af4c0 2023-12-08T08:23:05.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.270+0000 7fa457f1d640 1 -- 172.21.15.88:0/1269093086 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4500ab510 con 0x7fa4500af4c0 2023-12-08T08:23:05.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.274+0000 7fa457f1d640 1 -- 172.21.15.88:0/1269093086 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa450067630 con 0x7fa4500af4c0 2023-12-08T08:23:05.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.274+0000 7fa4467fc640 1 -- 172.21.15.88:0/1269093086 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa440013410 con 0x7fa4500af4c0 2023-12-08T08:23:05.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.274+0000 7fa4467fc640 1 --2- 172.21.15.88:0/1269093086 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa434066470 0x7fa434068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:05.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.274+0000 7fa4467fc640 1 -- 172.21.15.88:0/1269093086 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa440083c90 con 0x7fa4500af4c0 2023-12-08T08:23:05.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.274+0000 7fa455cb9640 1 --2- 172.21.15.88:0/1269093086 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa434066470 0x7fa434068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:05.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.274+0000 7fa455cb9640 1 --2- 172.21.15.88:0/1269093086 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa434066470 0x7fa434068930 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa44c0af000 tx=0x7fa44c0a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:05.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.278+0000 7fa4467fc640 1 -- 172.21.15.88:0/1269093086 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa440051100 con 0x7fa4500af4c0 2023-12-08T08:23:05.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.486+0000 7fa457f1d640 1 -- 172.21.15.88:0/1269093086 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa45015fc10 con 0x7fa4500af4c0 2023-12-08T08:23:05.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.486+0000 7fa4467fc640 1 -- 172.21.15.88:0/1269093086 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1431 (secure 0 0 0) 0x7fa440054720 con 0x7fa4500af4c0 2023-12-08T08:23:05.490 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:05.490 INFO:teuthology.orchestra.run.smithi088.stdout:{"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":189,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":68,"num_osds":8,"num_up_osds":8,"osd_up_since":1702023607,"num_in_osds":8,"osd_in_since":1702023598,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":258039808,"bytes_avail":772836073472,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":47,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":6525}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-12-08T08:22:40.776840+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-08T08:23:05.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.486+0000 7fa457f1d640 1 -- 172.21.15.88:0/1269093086 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa434066470 msgr2=0x7fa434068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:05.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.486+0000 7fa457f1d640 1 --2- 172.21.15.88:0/1269093086 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa434066470 0x7fa434068930 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa44c0af000 tx=0x7fa44c0a7070 comp rx=0 tx=0).stop 2023-12-08T08:23:05.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.486+0000 7fa457f1d640 1 -- 172.21.15.88:0/1269093086 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4500af4c0 msgr2=0x7fa450148ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:05.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.486+0000 7fa457f1d640 1 --2- 172.21.15.88:0/1269093086 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4500af4c0 0x7fa450148ef0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fa44000e810 tx=0x7fa44000ecd0 comp rx=0 tx=0).stop 2023-12-08T08:23:05.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.486+0000 7fa457f1d640 1 -- 172.21.15.88:0/1269093086 shutdown_connections 2023-12-08T08:23:05.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.486+0000 7fa457f1d640 1 --2- 172.21.15.88:0/1269093086 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa434066470 0x7fa434068930 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:05.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.486+0000 7fa457f1d640 1 --2- 172.21.15.88:0/1269093086 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4500c67d0 0x7fa450142f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:05.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.486+0000 7fa457f1d640 1 --2- 172.21.15.88:0/1269093086 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4500af4c0 0x7fa450148ef0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:05.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.486+0000 7fa457f1d640 1 --2- 172.21.15.88:0/1269093086 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa45006b9f0 0x7fa450143b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:05.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.486+0000 7fa457f1d640 1 -- 172.21.15.88:0/1269093086 >> 172.21.15.88:0/1269093086 conn(0x7fa4500ab9d0 msgr2=0x7fa4501561f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:05.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.486+0000 7fa457f1d640 1 -- 172.21.15.88:0/1269093086 shutdown_connections 2023-12-08T08:23:05.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.486+0000 7fa457f1d640 1 -- 172.21.15.88:0/1269093086 wait complete. 2023-12-08T08:23:05.511 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-08T08:23:05.511 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:23:05.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.646+0000 7f5275b2a640 1 Processor -- start 2023-12-08T08:23:05.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.646+0000 7f5275b2a640 1 -- start start 2023-12-08T08:23:05.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.646+0000 7f5275b2a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f527006d2b0 0x7f527006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:05.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.646+0000 7f5275b2a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f52700c5300 0x7f527006c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:05.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.646+0000 7f5275b2a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f527006bb80 con 0x7f52700c3b80 2023-12-08T08:23:05.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.646+0000 7f5275b2a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f527006cc70 con 0x7f527006d2b0 2023-12-08T08:23:05.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.646+0000 7f5275b2a640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52700c5790 con 0x7f52700c5300 2023-12-08T08:23:05.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.646+0000 7f526f7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f527006d2b0 0x7f527006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:05.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.646+0000 7f526effd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f52700c3b80 0x7f527006c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41250/0 (socket says 172.21.15.88:41250) 2023-12-08T08:23:05.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.646+0000 7f526effd640 1 -- 172.21.15.88:0/91359878 learned_addr learned my addr 172.21.15.88:0/91359878 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:05.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.646+0000 7f526ffff640 1 --2- 172.21.15.88:0/91359878 >> v2:172.21.15.148:3300/0 conn(0x7f52700c5300 0x7f527006c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:05.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.646+0000 7f526f7fe640 1 -- 172.21.15.88:0/91359878 >> v2:172.21.15.148:3300/0 conn(0x7f52700c5300 msgr2=0x7f527006c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:05.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.646+0000 7f526f7fe640 1 --2- 172.21.15.88:0/91359878 >> v2:172.21.15.148:3300/0 conn(0x7f52700c5300 0x7f527006c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:05.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.646+0000 7f526f7fe640 1 -- 172.21.15.88:0/91359878 >> v1:172.21.15.88:6789/0 conn(0x7f52700c3b80 legacy=0x7f527006c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:05.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.646+0000 7f526f7fe640 1 -- 172.21.15.88:0/91359878 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52701515c0 con 0x7f527006d2b0 2023-12-08T08:23:05.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.646+0000 7f526ffff640 1 --2- 172.21.15.88:0/91359878 >> v2:172.21.15.148:3300/0 conn(0x7f52700c5300 0x7f527006c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:05.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.646+0000 7f526e7fc640 1 -- 172.21.15.88:0/91359878 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736192900 0 0) 0x7f527006bb80 con 0x7f52700c3b80 2023-12-08T08:23:05.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.650+0000 7f526f7fe640 1 --2- 172.21.15.88:0/91359878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f527006d2b0 0x7f527006d690 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f527006e3c0 tx=0x7f526001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b4652d49edff38 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:05.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.650+0000 7f526e7fc640 1 -- 172.21.15.88:0/91359878 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52600ab600 con 0x7f527006d2b0 2023-12-08T08:23:05.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.650+0000 7f526e7fc640 1 -- 172.21.15.88:0/91359878 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52600a7050 con 0x7f527006d2b0 2023-12-08T08:23:05.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.650+0000 7f526e7fc640 1 -- 172.21.15.88:0/91359878 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52600ab980 con 0x7f527006d2b0 2023-12-08T08:23:05.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.650+0000 7f5275b2a640 1 -- 172.21.15.88:0/91359878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f527006d2b0 msgr2=0x7f527006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:05.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.650+0000 7f5275b2a640 1 --2- 172.21.15.88:0/91359878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f527006d2b0 0x7f527006d690 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f527006e3c0 tx=0x7f526001c430 comp rx=0 tx=0).stop 2023-12-08T08:23:05.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.650+0000 7f5275b2a640 1 -- 172.21.15.88:0/91359878 shutdown_connections 2023-12-08T08:23:05.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.650+0000 7f5275b2a640 1 --2- 172.21.15.88:0/91359878 >> v2:172.21.15.148:3300/0 conn(0x7f52700c5300 0x7f527006c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:05.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.650+0000 7f5275b2a640 1 --2- 172.21.15.88:0/91359878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f527006d2b0 0x7f527006d690 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:05.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.650+0000 7f5275b2a640 1 -- 172.21.15.88:0/91359878 >> 172.21.15.88:0/91359878 conn(0x7f52700a7810 msgr2=0x7f52700a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:05.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.650+0000 7f5275b2a640 1 -- 172.21.15.88:0/91359878 shutdown_connections 2023-12-08T08:23:05.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.650+0000 7f5275b2a640 1 -- 172.21.15.88:0/91359878 wait complete. 2023-12-08T08:23:05.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.650+0000 7f5275b2a640 1 Processor -- start 2023-12-08T08:23:05.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.650+0000 7f5275b2a640 1 -- start start 2023-12-08T08:23:05.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.654+0000 7f5275b2a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f527006d2b0 0x7f52700a8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:05.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.654+0000 7f5275b2a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52700c3b80 0x7f52700c1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:05.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.654+0000 7f5275b2a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52700c5300 0x7f52700aae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:05.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.654+0000 7f5275b2a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52700a9b40 con 0x7f527006d2b0 2023-12-08T08:23:05.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.654+0000 7f5275b2a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52700bfa80 con 0x7f52700c5300 2023-12-08T08:23:05.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.654+0000 7f5275b2a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52700bee90 con 0x7f52700c3b80 2023-12-08T08:23:05.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.654+0000 7f526f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f527006d2b0 0x7f52700a8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:05.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.654+0000 7f526f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f527006d2b0 0x7f52700a8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50030/0 (socket says 172.21.15.88:50030) 2023-12-08T08:23:05.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.654+0000 7f526f7fe640 1 -- 172.21.15.88:0/3212282731 learned_addr learned my addr 172.21.15.88:0/3212282731 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:05.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.654+0000 7f526ffff640 1 --2- 172.21.15.88:0/3212282731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52700c5300 0x7f52700aae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:05.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.654+0000 7f526effd640 1 --2- 172.21.15.88:0/3212282731 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52700c3b80 0x7f52700c1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:05.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.654+0000 7f526f7fe640 1 -- 172.21.15.88:0/3212282731 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52700c3b80 msgr2=0x7f52700c1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:05.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.654+0000 7f526f7fe640 1 --2- 172.21.15.88:0/3212282731 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52700c3b80 0x7f52700c1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:05.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.654+0000 7f526f7fe640 1 -- 172.21.15.88:0/3212282731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52700c5300 msgr2=0x7f52700aae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:05.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.654+0000 7f526f7fe640 1 --2- 172.21.15.88:0/3212282731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52700c5300 0x7f52700aae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:05.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.654+0000 7f526f7fe640 1 -- 172.21.15.88:0/3212282731 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5260009420 con 0x7f527006d2b0 2023-12-08T08:23:05.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.654+0000 7f526f7fe640 1 --2- 172.21.15.88:0/3212282731 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f527006d2b0 0x7f52700a8fc0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f526001a060 tx=0x7f52600191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:05.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.654+0000 7f5257fff640 1 -- 172.21.15.88:0/3212282731 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52600b4600 con 0x7f527006d2b0 2023-12-08T08:23:05.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.654+0000 7f5257fff640 1 -- 172.21.15.88:0/3212282731 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52600b4760 con 0x7f527006d2b0 2023-12-08T08:23:05.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.654+0000 7f5257fff640 1 -- 172.21.15.88:0/3212282731 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52600b4ad0 con 0x7f527006d2b0 2023-12-08T08:23:05.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.654+0000 7f5275b2a640 1 -- 172.21.15.88:0/3212282731 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f527014ef80 con 0x7f527006d2b0 2023-12-08T08:23:05.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.654+0000 7f5275b2a640 1 -- 172.21.15.88:0/3212282731 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52700bf0e0 con 0x7f527006d2b0 2023-12-08T08:23:05.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.654+0000 7f5275b2a640 1 -- 172.21.15.88:0/3212282731 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52700aacb0 con 0x7f527006d2b0 2023-12-08T08:23:05.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.658+0000 7f5257fff640 1 -- 172.21.15.88:0/3212282731 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f52600b2040 con 0x7f527006d2b0 2023-12-08T08:23:05.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.658+0000 7f5257fff640 1 --2- 172.21.15.88:0/3212282731 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f525c066470 0x7f525c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:05.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.658+0000 7f5257fff640 1 -- 172.21.15.88:0/3212282731 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f526011ddc0 con 0x7f527006d2b0 2023-12-08T08:23:05.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.658+0000 7f526effd640 1 --2- 172.21.15.88:0/3212282731 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f525c066470 0x7f525c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:05.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.658+0000 7f526effd640 1 --2- 172.21.15.88:0/3212282731 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f525c066470 0x7f525c068930 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f52700a7e10 tx=0x7f5264007d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:05.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.662+0000 7f5257fff640 1 -- 172.21.15.88:0/3212282731 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f52600eb2f0 con 0x7f527006d2b0 2023-12-08T08:23:05.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.810+0000 7f5275b2a640 1 -- 172.21.15.88:0/3212282731 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f527014ee00 con 0x7f525c066470 2023-12-08T08:23:05.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.818+0000 7f5257fff640 1 -- 172.21.15.88:0/3212282731 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289287 (secure 0 0 0) 0x7f5264004c80 con 0x7f525c066470 2023-12-08T08:23:05.825 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:05.826 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:23:05.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.822+0000 7f5275b2a640 1 -- 172.21.15.88:0/3212282731 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f525c066470 msgr2=0x7f525c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:05.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.822+0000 7f5275b2a640 1 --2- 172.21.15.88:0/3212282731 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f525c066470 0x7f525c068930 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f52700a7e10 tx=0x7f5264007d60 comp rx=0 tx=0).stop 2023-12-08T08:23:05.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.822+0000 7f5275b2a640 1 -- 172.21.15.88:0/3212282731 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f527006d2b0 msgr2=0x7f52700a8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:05.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.822+0000 7f5275b2a640 1 --2- 172.21.15.88:0/3212282731 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f527006d2b0 0x7f52700a8fc0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f526001a060 tx=0x7f52600191d0 comp rx=0 tx=0).stop 2023-12-08T08:23:05.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.822+0000 7f5275b2a640 1 -- 172.21.15.88:0/3212282731 shutdown_connections 2023-12-08T08:23:05.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.822+0000 7f5275b2a640 1 --2- 172.21.15.88:0/3212282731 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f525c066470 0x7f525c068930 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:05.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.822+0000 7f5275b2a640 1 --2- 172.21.15.88:0/3212282731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52700c5300 0x7f52700aae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:05.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.822+0000 7f5275b2a640 1 --2- 172.21.15.88:0/3212282731 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52700c3b80 0x7f52700c1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:05.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.822+0000 7f5275b2a640 1 --2- 172.21.15.88:0/3212282731 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f527006d2b0 0x7f52700a8fc0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:05.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.822+0000 7f5275b2a640 1 -- 172.21.15.88:0/3212282731 >> 172.21.15.88:0/3212282731 conn(0x7f52700a7810 msgr2=0x7f5270154b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:05.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.822+0000 7f5275b2a640 1 -- 172.21.15.88:0/3212282731 shutdown_connections 2023-12-08T08:23:05.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:05.822+0000 7f5275b2a640 1 -- 172.21.15.88:0/3212282731 wait complete. 2023-12-08T08:23:05.845 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2023-12-08T08:23:04.781010+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":251992,"kb_used_data":6696,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754722728,"statfs":{"total":773094113280,"available":772836073472,"internally_reserved":0,"allocated":6856704,"data_stored":4089140,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000906"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277373+0000","last_change":"2023-12-08T08:23:00.281512+0000","last_active":"2023-12-08T08:23:01.277373+0000","last_peered":"2023-12-08T08:23:01.277373+0000","last_clean":"2023-12-08T08:23:01.277373+0000","last_became_active":"2023-12-08T08:23:00.281118+0000","last_became_peered":"2023-12-08T08:23:00.281118+0000","last_unstale":"2023-12-08T08:23:01.277373+0000","last_undegraded":"2023-12-08T08:23:01.277373+0000","last_fullsized":"2023-12-08T08:23:01.277373+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:15.472021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093886+0000","last_change":"2023-12-08T08:23:00.276523+0000","last_active":"2023-12-08T08:23:02.093886+0000","last_peered":"2023-12-08T08:23:02.093886+0000","last_clean":"2023-12-08T08:23:02.093886+0000","last_became_active":"2023-12-08T08:23:00.276039+0000","last_became_peered":"2023-12-08T08:23:00.276039+0000","last_unstale":"2023-12-08T08:23:02.093886+0000","last_undegraded":"2023-12-08T08:23:02.093886+0000","last_fullsized":"2023-12-08T08:23:02.093886+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:31:16.893953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093136+0000","last_change":"2023-12-08T08:23:00.283198+0000","last_active":"2023-12-08T08:23:02.093136+0000","last_peered":"2023-12-08T08:23:02.093136+0000","last_clean":"2023-12-08T08:23:02.093136+0000","last_became_active":"2023-12-08T08:23:00.282944+0000","last_became_peered":"2023-12-08T08:23:00.282944+0000","last_unstale":"2023-12-08T08:23:02.093136+0000","last_undegraded":"2023-12-08T08:23:02.093136+0000","last_fullsized":"2023-12-08T08:23:02.093136+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:33.898137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277234+0000","last_change":"2023-12-08T08:23:00.285685+0000","last_active":"2023-12-08T08:23:01.277234+0000","last_peered":"2023-12-08T08:23:01.277234+0000","last_clean":"2023-12-08T08:23:01.277234+0000","last_became_active":"2023-12-08T08:23:00.285351+0000","last_became_peered":"2023-12-08T08:23:00.285351+0000","last_unstale":"2023-12-08T08:23:01.277234+0000","last_undegraded":"2023-12-08T08:23:01.277234+0000","last_fullsized":"2023-12-08T08:23:01.277234+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:43:34.830332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983339+0000","last_change":"2023-12-08T08:23:00.264270+0000","last_active":"2023-12-08T08:23:01.983339+0000","last_peered":"2023-12-08T08:23:01.983339+0000","last_clean":"2023-12-08T08:23:01.983339+0000","last_became_active":"2023-12-08T08:23:00.263994+0000","last_became_peered":"2023-12-08T08:23:00.263994+0000","last_unstale":"2023-12-08T08:23:01.983339+0000","last_undegraded":"2023-12-08T08:23:01.983339+0000","last_fullsized":"2023-12-08T08:23:01.983339+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:33.905575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093489+0000","last_change":"2023-12-08T08:23:00.300354+0000","last_active":"2023-12-08T08:23:02.093489+0000","last_peered":"2023-12-08T08:23:02.093489+0000","last_clean":"2023-12-08T08:23:02.093489+0000","last_became_active":"2023-12-08T08:23:00.300026+0000","last_became_peered":"2023-12-08T08:23:00.300026+0000","last_unstale":"2023-12-08T08:23:02.093489+0000","last_undegraded":"2023-12-08T08:23:02.093489+0000","last_fullsized":"2023-12-08T08:23:02.093489+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277001+0000","last_change":"2023-12-08T08:23:00.278456+0000","last_active":"2023-12-08T08:23:01.277001+0000","last_peered":"2023-12-08T08:23:01.277001+0000","last_clean":"2023-12-08T08:23:01.277001+0000","last_became_active":"2023-12-08T08:23:00.277186+0000","last_became_peered":"2023-12-08T08:23:00.277186+0000","last_unstale":"2023-12-08T08:23:01.277001+0000","last_undegraded":"2023-12-08T08:23:01.277001+0000","last_fullsized":"2023-12-08T08:23:01.277001+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:20:16.170951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093242+0000","last_change":"2023-12-08T08:23:00.272694+0000","last_active":"2023-12-08T08:23:02.093242+0000","last_peered":"2023-12-08T08:23:02.093242+0000","last_clean":"2023-12-08T08:23:02.093242+0000","last_became_active":"2023-12-08T08:23:00.272440+0000","last_became_peered":"2023-12-08T08:23:00.272440+0000","last_unstale":"2023-12-08T08:23:02.093242+0000","last_undegraded":"2023-12-08T08:23:02.093242+0000","last_fullsized":"2023-12-08T08:23:02.093242+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:15.472021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093691+0000","last_change":"2023-12-08T08:23:00.298447+0000","last_active":"2023-12-08T08:23:02.093691+0000","last_peered":"2023-12-08T08:23:02.093691+0000","last_clean":"2023-12-08T08:23:02.093691+0000","last_became_active":"2023-12-08T08:23:00.298113+0000","last_became_peered":"2023-12-08T08:23:00.298113+0000","last_unstale":"2023-12-08T08:23:02.093691+0000","last_undegraded":"2023-12-08T08:23:02.093691+0000","last_fullsized":"2023-12-08T08:23:02.093691+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277439+0000","last_change":"2023-12-08T08:23:00.277064+0000","last_active":"2023-12-08T08:23:01.277439+0000","last_peered":"2023-12-08T08:23:01.277439+0000","last_clean":"2023-12-08T08:23:01.277439+0000","last_became_active":"2023-12-08T08:23:00.276850+0000","last_became_peered":"2023-12-08T08:23:00.276850+0000","last_unstale":"2023-12-08T08:23:01.277439+0000","last_undegraded":"2023-12-08T08:23:01.277439+0000","last_fullsized":"2023-12-08T08:23:01.277439+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093759+0000","last_change":"2023-12-08T08:23:00.286362+0000","last_active":"2023-12-08T08:23:02.093759+0000","last_peered":"2023-12-08T08:23:02.093759+0000","last_clean":"2023-12-08T08:23:02.093759+0000","last_became_active":"2023-12-08T08:23:00.286071+0000","last_became_peered":"2023-12-08T08:23:00.286071+0000","last_unstale":"2023-12-08T08:23:02.093759+0000","last_undegraded":"2023-12-08T08:23:02.093759+0000","last_fullsized":"2023-12-08T08:23:02.093759+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:50.890759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277084+0000","last_change":"2023-12-08T08:23:00.277187+0000","last_active":"2023-12-08T08:23:01.277084+0000","last_peered":"2023-12-08T08:23:01.277084+0000","last_clean":"2023-12-08T08:23:01.277084+0000","last_became_active":"2023-12-08T08:23:00.276929+0000","last_became_peered":"2023-12-08T08:23:00.276929+0000","last_unstale":"2023-12-08T08:23:01.277084+0000","last_undegraded":"2023-12-08T08:23:01.277084+0000","last_fullsized":"2023-12-08T08:23:01.277084+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:55:36.390421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093011+0000","last_change":"2023-12-08T08:23:00.275837+0000","last_active":"2023-12-08T08:23:02.093011+0000","last_peered":"2023-12-08T08:23:02.093011+0000","last_clean":"2023-12-08T08:23:02.093011+0000","last_became_active":"2023-12-08T08:23:00.275561+0000","last_became_peered":"2023-12-08T08:23:00.275561+0000","last_unstale":"2023-12-08T08:23:02.093011+0000","last_undegraded":"2023-12-08T08:23:02.093011+0000","last_fullsized":"2023-12-08T08:23:02.093011+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277312+0000","last_change":"2023-12-08T08:23:00.295614+0000","last_active":"2023-12-08T08:23:01.277312+0000","last_peered":"2023-12-08T08:23:01.277312+0000","last_clean":"2023-12-08T08:23:01.277312+0000","last_became_active":"2023-12-08T08:23:00.295111+0000","last_became_peered":"2023-12-08T08:23:00.295111+0000","last_unstale":"2023-12-08T08:23:01.277312+0000","last_undegraded":"2023-12-08T08:23:01.277312+0000","last_fullsized":"2023-12-08T08:23:01.277312+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:10:16.885890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092580+0000","last_change":"2023-12-08T08:23:00.292909+0000","last_active":"2023-12-08T08:23:02.092580+0000","last_peered":"2023-12-08T08:23:02.092580+0000","last_clean":"2023-12-08T08:23:02.092580+0000","last_became_active":"2023-12-08T08:23:00.292500+0000","last_became_peered":"2023-12-08T08:23:00.292500+0000","last_unstale":"2023-12-08T08:23:02.092580+0000","last_undegraded":"2023-12-08T08:23:02.092580+0000","last_fullsized":"2023-12-08T08:23:02.092580+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:21:14.553932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983314+0000","last_change":"2023-12-08T08:23:00.273084+0000","last_active":"2023-12-08T08:23:01.983314+0000","last_peered":"2023-12-08T08:23:01.983314+0000","last_clean":"2023-12-08T08:23:01.983314+0000","last_became_active":"2023-12-08T08:23:00.272803+0000","last_became_peered":"2023-12-08T08:23:00.272803+0000","last_unstale":"2023-12-08T08:23:01.983314+0000","last_undegraded":"2023-12-08T08:23:01.983314+0000","last_fullsized":"2023-12-08T08:23:01.983314+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:16.068318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983826+0000","last_change":"2023-12-08T08:23:00.300292+0000","last_active":"2023-12-08T08:23:01.983826+0000","last_peered":"2023-12-08T08:23:01.983826+0000","last_clean":"2023-12-08T08:23:01.983826+0000","last_became_active":"2023-12-08T08:23:00.300008+0000","last_became_peered":"2023-12-08T08:23:00.300008+0000","last_unstale":"2023-12-08T08:23:01.983826+0000","last_undegraded":"2023-12-08T08:23:01.983826+0000","last_fullsized":"2023-12-08T08:23:01.983826+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:39.385907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277554+0000","last_change":"2023-12-08T08:23:00.299621+0000","last_active":"2023-12-08T08:23:01.277554+0000","last_peered":"2023-12-08T08:23:01.277554+0000","last_clean":"2023-12-08T08:23:01.277554+0000","last_became_active":"2023-12-08T08:23:00.299255+0000","last_became_peered":"2023-12-08T08:23:00.299255+0000","last_unstale":"2023-12-08T08:23:01.277554+0000","last_undegraded":"2023-12-08T08:23:01.277554+0000","last_fullsized":"2023-12-08T08:23:01.277554+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:28:46.845466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093084+0000","last_change":"2023-12-08T08:23:00.296010+0000","last_active":"2023-12-08T08:23:02.093084+0000","last_peered":"2023-12-08T08:23:02.093084+0000","last_clean":"2023-12-08T08:23:02.093084+0000","last_became_active":"2023-12-08T08:23:00.295749+0000","last_became_peered":"2023-12-08T08:23:00.295749+0000","last_unstale":"2023-12-08T08:23:02.093084+0000","last_undegraded":"2023-12-08T08:23:02.093084+0000","last_fullsized":"2023-12-08T08:23:02.093084+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:39.385907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277430+0000","last_change":"2023-12-08T08:23:00.301831+0000","last_active":"2023-12-08T08:23:01.277430+0000","last_peered":"2023-12-08T08:23:01.277430+0000","last_clean":"2023-12-08T08:23:01.277430+0000","last_became_active":"2023-12-08T08:23:00.301321+0000","last_became_peered":"2023-12-08T08:23:00.301321+0000","last_unstale":"2023-12-08T08:23:01.277430+0000","last_undegraded":"2023-12-08T08:23:01.277430+0000","last_fullsized":"2023-12-08T08:23:01.277430+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:14:54.964832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277284+0000","last_change":"2023-12-08T08:23:00.301605+0000","last_active":"2023-12-08T08:23:01.277284+0000","last_peered":"2023-12-08T08:23:01.277284+0000","last_clean":"2023-12-08T08:23:01.277284+0000","last_became_active":"2023-12-08T08:23:00.301346+0000","last_became_peered":"2023-12-08T08:23:00.301346+0000","last_unstale":"2023-12-08T08:23:01.277284+0000","last_undegraded":"2023-12-08T08:23:01.277284+0000","last_fullsized":"2023-12-08T08:23:01.277284+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:35:35.139064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093024+0000","last_change":"2023-12-08T08:23:00.301440+0000","last_active":"2023-12-08T08:23:02.093024+0000","last_peered":"2023-12-08T08:23:02.093024+0000","last_clean":"2023-12-08T08:23:02.093024+0000","last_became_active":"2023-12-08T08:23:00.301156+0000","last_became_peered":"2023-12-08T08:23:00.301156+0000","last_unstale":"2023-12-08T08:23:02.093024+0000","last_undegraded":"2023-12-08T08:23:02.093024+0000","last_fullsized":"2023-12-08T08:23:02.093024+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:04:21.562137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277139+0000","last_change":"2023-12-08T08:23:00.301914+0000","last_active":"2023-12-08T08:23:01.277139+0000","last_peered":"2023-12-08T08:23:01.277139+0000","last_clean":"2023-12-08T08:23:01.277139+0000","last_became_active":"2023-12-08T08:23:00.301688+0000","last_became_peered":"2023-12-08T08:23:00.301688+0000","last_unstale":"2023-12-08T08:23:01.277139+0000","last_undegraded":"2023-12-08T08:23:01.277139+0000","last_fullsized":"2023-12-08T08:23:01.277139+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:27:39.303886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.276995+0000","last_change":"2023-12-08T08:23:00.298664+0000","last_active":"2023-12-08T08:23:01.276995+0000","last_peered":"2023-12-08T08:23:01.276995+0000","last_clean":"2023-12-08T08:23:01.276995+0000","last_became_active":"2023-12-08T08:23:00.298341+0000","last_became_peered":"2023-12-08T08:23:00.298341+0000","last_unstale":"2023-12-08T08:23:01.276995+0000","last_undegraded":"2023-12-08T08:23:01.276995+0000","last_fullsized":"2023-12-08T08:23:01.276995+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:20:20.944416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093896+0000","last_change":"2023-12-08T08:23:00.280235+0000","last_active":"2023-12-08T08:23:02.093896+0000","last_peered":"2023-12-08T08:23:02.093896+0000","last_clean":"2023-12-08T08:23:02.093896+0000","last_became_active":"2023-12-08T08:23:00.278807+0000","last_became_peered":"2023-12-08T08:23:00.278807+0000","last_unstale":"2023-12-08T08:23:02.093896+0000","last_undegraded":"2023-12-08T08:23:02.093896+0000","last_fullsized":"2023-12-08T08:23:02.093896+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:30:44.391621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093551+0000","last_change":"2023-12-08T08:23:00.278532+0000","last_active":"2023-12-08T08:23:02.093551+0000","last_peered":"2023-12-08T08:23:02.093551+0000","last_clean":"2023-12-08T08:23:02.093551+0000","last_became_active":"2023-12-08T08:23:00.278177+0000","last_became_peered":"2023-12-08T08:23:00.278177+0000","last_unstale":"2023-12-08T08:23:02.093551+0000","last_undegraded":"2023-12-08T08:23:02.093551+0000","last_fullsized":"2023-12-08T08:23:02.093551+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:56.216551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983525+0000","last_change":"2023-12-08T08:23:00.284090+0000","last_active":"2023-12-08T08:23:01.983525+0000","last_peered":"2023-12-08T08:23:01.983525+0000","last_clean":"2023-12-08T08:23:01.983525+0000","last_became_active":"2023-12-08T08:23:00.283777+0000","last_became_peered":"2023-12-08T08:23:00.283777+0000","last_unstale":"2023-12-08T08:23:01.983525+0000","last_undegraded":"2023-12-08T08:23:01.983525+0000","last_fullsized":"2023-12-08T08:23:01.983525+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277149+0000","last_change":"2023-12-08T08:23:00.277149+0000","last_active":"2023-12-08T08:23:01.277149+0000","last_peered":"2023-12-08T08:23:01.277149+0000","last_clean":"2023-12-08T08:23:01.277149+0000","last_became_active":"2023-12-08T08:23:00.276879+0000","last_became_peered":"2023-12-08T08:23:00.276879+0000","last_unstale":"2023-12-08T08:23:01.277149+0000","last_undegraded":"2023-12-08T08:23:01.277149+0000","last_fullsized":"2023-12-08T08:23:01.277149+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:16.068318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093285+0000","last_change":"2023-12-08T08:23:00.294726+0000","last_active":"2023-12-08T08:23:02.093285+0000","last_peered":"2023-12-08T08:23:02.093285+0000","last_clean":"2023-12-08T08:23:02.093285+0000","last_became_active":"2023-12-08T08:23:00.294450+0000","last_became_peered":"2023-12-08T08:23:00.294450+0000","last_unstale":"2023-12-08T08:23:02.093285+0000","last_undegraded":"2023-12-08T08:23:02.093285+0000","last_fullsized":"2023-12-08T08:23:02.093285+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:28:25.934029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093151+0000","last_change":"2023-12-08T08:23:00.288804+0000","last_active":"2023-12-08T08:23:02.093151+0000","last_peered":"2023-12-08T08:23:02.093151+0000","last_clean":"2023-12-08T08:23:02.093151+0000","last_became_active":"2023-12-08T08:23:00.288315+0000","last_became_peered":"2023-12-08T08:23:00.288315+0000","last_unstale":"2023-12-08T08:23:02.093151+0000","last_undegraded":"2023-12-08T08:23:02.093151+0000","last_fullsized":"2023-12-08T08:23:02.093151+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:23:06.925359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983279+0000","last_change":"2023-12-08T08:23:00.294482+0000","last_active":"2023-12-08T08:23:01.983279+0000","last_peered":"2023-12-08T08:23:01.983279+0000","last_clean":"2023-12-08T08:23:01.983279+0000","last_became_active":"2023-12-08T08:23:00.294057+0000","last_became_peered":"2023-12-08T08:23:00.294057+0000","last_unstale":"2023-12-08T08:23:01.983279+0000","last_undegraded":"2023-12-08T08:23:01.983279+0000","last_fullsized":"2023-12-08T08:23:01.983279+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:42:20.038693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.276897+0000","last_change":"2023-12-08T08:23:00.272949+0000","last_active":"2023-12-08T08:23:01.276897+0000","last_peered":"2023-12-08T08:23:01.276897+0000","last_clean":"2023-12-08T08:23:01.276897+0000","last_became_active":"2023-12-08T08:23:00.272655+0000","last_became_peered":"2023-12-08T08:23:00.272655+0000","last_unstale":"2023-12-08T08:23:01.276897+0000","last_undegraded":"2023-12-08T08:23:01.276897+0000","last_fullsized":"2023-12-08T08:23:01.276897+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:28.275394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983738+0000","last_change":"2023-12-08T08:23:00.273779+0000","last_active":"2023-12-08T08:23:01.983738+0000","last_peered":"2023-12-08T08:23:01.983738+0000","last_clean":"2023-12-08T08:23:01.983738+0000","last_became_active":"2023-12-08T08:23:00.273256+0000","last_became_peered":"2023-12-08T08:23:00.273256+0000","last_unstale":"2023-12-08T08:23:01.983738+0000","last_undegraded":"2023-12-08T08:23:01.983738+0000","last_fullsized":"2023-12-08T08:23:01.983738+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"67'4","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277464+0000","last_change":"2023-12-08T08:22:59.285668+0000","last_active":"2023-12-08T08:23:01.277464+0000","last_peered":"2023-12-08T08:23:01.277464+0000","last_clean":"2023-12-08T08:23:01.277464+0000","last_became_active":"2023-12-08T08:22:59.285340+0000","last_became_peered":"2023-12-08T08:22:59.285340+0000","last_unstale":"2023-12-08T08:23:01.277464+0000","last_undegraded":"2023-12-08T08:23:01.277464+0000","last_fullsized":"2023-12-08T08:23:01.277464+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:35:15.000491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277385+0000","last_change":"2023-12-08T08:23:00.300874+0000","last_active":"2023-12-08T08:23:01.277385+0000","last_peered":"2023-12-08T08:23:01.277385+0000","last_clean":"2023-12-08T08:23:01.277385+0000","last_became_active":"2023-12-08T08:23:00.300595+0000","last_became_peered":"2023-12-08T08:23:00.300595+0000","last_unstale":"2023-12-08T08:23:01.277385+0000","last_undegraded":"2023-12-08T08:23:01.277385+0000","last_fullsized":"2023-12-08T08:23:01.277385+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983848+0000","last_change":"2023-12-08T08:22:59.274595+0000","last_active":"2023-12-08T08:23:01.983848+0000","last_peered":"2023-12-08T08:23:01.983848+0000","last_clean":"2023-12-08T08:23:01.983848+0000","last_became_active":"2023-12-08T08:22:59.274280+0000","last_became_peered":"2023-12-08T08:22:59.274280+0000","last_unstale":"2023-12-08T08:23:01.983848+0000","last_undegraded":"2023-12-08T08:23:01.983848+0000","last_fullsized":"2023-12-08T08:23:01.983848+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:27.267774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277372+0000","last_change":"2023-12-08T08:23:00.280594+0000","last_active":"2023-12-08T08:23:01.277372+0000","last_peered":"2023-12-08T08:23:01.277372+0000","last_clean":"2023-12-08T08:23:01.277372+0000","last_became_active":"2023-12-08T08:23:00.279794+0000","last_became_peered":"2023-12-08T08:23:00.279794+0000","last_unstale":"2023-12-08T08:23:01.277372+0000","last_undegraded":"2023-12-08T08:23:01.277372+0000","last_fullsized":"2023-12-08T08:23:01.277372+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:33.905575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093181+0000","last_change":"2023-12-08T08:22:59.282892+0000","last_active":"2023-12-08T08:23:02.093181+0000","last_peered":"2023-12-08T08:23:02.093181+0000","last_clean":"2023-12-08T08:23:02.093181+0000","last_became_active":"2023-12-08T08:22:59.282172+0000","last_became_peered":"2023-12-08T08:22:59.282172+0000","last_unstale":"2023-12-08T08:23:02.093181+0000","last_undegraded":"2023-12-08T08:23:02.093181+0000","last_fullsized":"2023-12-08T08:23:02.093181+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:32.890517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093181+0000","last_change":"2023-12-08T08:23:00.304580+0000","last_active":"2023-12-08T08:23:02.093181+0000","last_peered":"2023-12-08T08:23:02.093181+0000","last_clean":"2023-12-08T08:23:02.093181+0000","last_became_active":"2023-12-08T08:23:00.304098+0000","last_became_peered":"2023-12-08T08:23:00.304098+0000","last_unstale":"2023-12-08T08:23:02.093181+0000","last_undegraded":"2023-12-08T08:23:02.093181+0000","last_fullsized":"2023-12-08T08:23:02.093181+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:29:03.020360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093192+0000","last_change":"2023-12-08T08:22:59.283290+0000","last_active":"2023-12-08T08:23:02.093192+0000","last_peered":"2023-12-08T08:23:02.093192+0000","last_clean":"2023-12-08T08:23:02.093192+0000","last_became_active":"2023-12-08T08:22:59.282103+0000","last_became_peered":"2023-12-08T08:22:59.282103+0000","last_unstale":"2023-12-08T08:23:02.093192+0000","last_undegraded":"2023-12-08T08:23:02.093192+0000","last_fullsized":"2023-12-08T08:23:02.093192+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:15.256488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093289+0000","last_change":"2023-12-08T08:23:00.288605+0000","last_active":"2023-12-08T08:23:02.093289+0000","last_peered":"2023-12-08T08:23:02.093289+0000","last_clean":"2023-12-08T08:23:02.093289+0000","last_became_active":"2023-12-08T08:23:00.287910+0000","last_became_peered":"2023-12-08T08:23:00.287910+0000","last_unstale":"2023-12-08T08:23:02.093289+0000","last_undegraded":"2023-12-08T08:23:02.093289+0000","last_fullsized":"2023-12-08T08:23:02.093289+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:55.193260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983566+0000","last_change":"2023-12-08T08:22:59.267027+0000","last_active":"2023-12-08T08:23:01.983566+0000","last_peered":"2023-12-08T08:23:01.983566+0000","last_clean":"2023-12-08T08:23:01.983566+0000","last_became_active":"2023-12-08T08:22:59.265676+0000","last_became_peered":"2023-12-08T08:22:59.265676+0000","last_unstale":"2023-12-08T08:23:01.983566+0000","last_undegraded":"2023-12-08T08:23:01.983566+0000","last_fullsized":"2023-12-08T08:23:01.983566+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:19.279362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983439+0000","last_change":"2023-12-08T08:23:00.300280+0000","last_active":"2023-12-08T08:23:01.983439+0000","last_peered":"2023-12-08T08:23:01.983439+0000","last_clean":"2023-12-08T08:23:01.983439+0000","last_became_active":"2023-12-08T08:23:00.299998+0000","last_became_peered":"2023-12-08T08:23:00.299998+0000","last_unstale":"2023-12-08T08:23:01.983439+0000","last_undegraded":"2023-12-08T08:23:01.983439+0000","last_fullsized":"2023-12-08T08:23:01.983439+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:15.472021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983222+0000","last_change":"2023-12-08T08:22:59.274800+0000","last_active":"2023-12-08T08:23:01.983222+0000","last_peered":"2023-12-08T08:23:01.983222+0000","last_clean":"2023-12-08T08:23:01.983222+0000","last_became_active":"2023-12-08T08:22:59.274501+0000","last_became_peered":"2023-12-08T08:22:59.274501+0000","last_unstale":"2023-12-08T08:23:01.983222+0000","last_undegraded":"2023-12-08T08:23:01.983222+0000","last_fullsized":"2023-12-08T08:23:01.983222+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:54.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092935+0000","last_change":"2023-12-08T08:23:00.298811+0000","last_active":"2023-12-08T08:23:02.092935+0000","last_peered":"2023-12-08T08:23:02.092935+0000","last_clean":"2023-12-08T08:23:02.092935+0000","last_became_active":"2023-12-08T08:23:00.298524+0000","last_became_peered":"2023-12-08T08:23:00.298524+0000","last_unstale":"2023-12-08T08:23:02.092935+0000","last_undegraded":"2023-12-08T08:23:02.092935+0000","last_fullsized":"2023-12-08T08:23:02.092935+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093491+0000","last_change":"2023-12-08T08:22:59.274339+0000","last_active":"2023-12-08T08:23:02.093491+0000","last_peered":"2023-12-08T08:23:02.093491+0000","last_clean":"2023-12-08T08:23:02.093491+0000","last_became_active":"2023-12-08T08:22:59.272932+0000","last_became_peered":"2023-12-08T08:22:59.272932+0000","last_unstale":"2023-12-08T08:23:02.093491+0000","last_undegraded":"2023-12-08T08:23:02.093491+0000","last_fullsized":"2023-12-08T08:23:02.093491+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:14.464401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092664+0000","last_change":"2023-12-08T08:23:00.292745+0000","last_active":"2023-12-08T08:23:02.092664+0000","last_peered":"2023-12-08T08:23:02.092664+0000","last_clean":"2023-12-08T08:23:02.092664+0000","last_became_active":"2023-12-08T08:23:00.292132+0000","last_became_peered":"2023-12-08T08:23:00.292132+0000","last_unstale":"2023-12-08T08:23:02.092664+0000","last_undegraded":"2023-12-08T08:23:02.092664+0000","last_fullsized":"2023-12-08T08:23:02.092664+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:13.139346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092554+0000","last_change":"2023-12-08T08:22:59.268769+0000","last_active":"2023-12-08T08:23:02.092554+0000","last_peered":"2023-12-08T08:23:02.092554+0000","last_clean":"2023-12-08T08:23:02.092554+0000","last_became_active":"2023-12-08T08:22:59.268494+0000","last_became_peered":"2023-12-08T08:22:59.268494+0000","last_unstale":"2023-12-08T08:23:02.092554+0000","last_undegraded":"2023-12-08T08:23:02.092554+0000","last_fullsized":"2023-12-08T08:23:02.092554+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:56:23.131251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093698+0000","last_change":"2023-12-08T08:23:00.275783+0000","last_active":"2023-12-08T08:23:02.093698+0000","last_peered":"2023-12-08T08:23:02.093698+0000","last_clean":"2023-12-08T08:23:02.093698+0000","last_became_active":"2023-12-08T08:23:00.275444+0000","last_became_peered":"2023-12-08T08:23:00.275444+0000","last_unstale":"2023-12-08T08:23:02.093698+0000","last_undegraded":"2023-12-08T08:23:02.093698+0000","last_fullsized":"2023-12-08T08:23:02.093698+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:56:00.436152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277518+0000","last_change":"2023-12-08T08:22:59.280443+0000","last_active":"2023-12-08T08:23:01.277518+0000","last_peered":"2023-12-08T08:23:01.277518+0000","last_clean":"2023-12-08T08:23:01.277518+0000","last_became_active":"2023-12-08T08:22:59.280138+0000","last_became_peered":"2023-12-08T08:22:59.280138+0000","last_unstale":"2023-12-08T08:23:01.277518+0000","last_undegraded":"2023-12-08T08:23:01.277518+0000","last_fullsized":"2023-12-08T08:23:01.277518+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:13:21.524504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093806+0000","last_change":"2023-12-08T08:23:00.304825+0000","last_active":"2023-12-08T08:23:02.093806+0000","last_peered":"2023-12-08T08:23:02.093806+0000","last_clean":"2023-12-08T08:23:02.093806+0000","last_became_active":"2023-12-08T08:23:00.304549+0000","last_became_peered":"2023-12-08T08:23:00.304549+0000","last_unstale":"2023-12-08T08:23:02.093806+0000","last_undegraded":"2023-12-08T08:23:02.093806+0000","last_fullsized":"2023-12-08T08:23:02.093806+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277432+0000","last_change":"2023-12-08T08:22:59.283795+0000","last_active":"2023-12-08T08:23:01.277432+0000","last_peered":"2023-12-08T08:23:01.277432+0000","last_clean":"2023-12-08T08:23:01.277432+0000","last_became_active":"2023-12-08T08:22:59.283486+0000","last_became_peered":"2023-12-08T08:22:59.283486+0000","last_unstale":"2023-12-08T08:23:01.277432+0000","last_undegraded":"2023-12-08T08:23:01.277432+0000","last_fullsized":"2023-12-08T08:23:01.277432+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:30:43.384001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093094+0000","last_change":"2023-12-08T08:23:00.293145+0000","last_active":"2023-12-08T08:23:02.093094+0000","last_peered":"2023-12-08T08:23:02.093094+0000","last_clean":"2023-12-08T08:23:02.093094+0000","last_became_active":"2023-12-08T08:23:00.292927+0000","last_became_peered":"2023-12-08T08:23:00.292927+0000","last_unstale":"2023-12-08T08:23:02.093094+0000","last_undegraded":"2023-12-08T08:23:02.093094+0000","last_fullsized":"2023-12-08T08:23:02.093094+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:56.216551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"67'3","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277143+0000","last_change":"2023-12-08T08:22:59.281141+0000","last_active":"2023-12-08T08:23:01.277143+0000","last_peered":"2023-12-08T08:23:01.277143+0000","last_clean":"2023-12-08T08:23:01.277143+0000","last_became_active":"2023-12-08T08:22:59.280748+0000","last_became_peered":"2023-12-08T08:22:59.280748+0000","last_unstale":"2023-12-08T08:23:01.277143+0000","last_undegraded":"2023-12-08T08:23:01.277143+0000","last_fullsized":"2023-12-08T08:23:01.277143+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:07:33.922762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983595+0000","last_change":"2023-12-08T08:23:00.299179+0000","last_active":"2023-12-08T08:23:01.983595+0000","last_peered":"2023-12-08T08:23:01.983595+0000","last_clean":"2023-12-08T08:23:01.983595+0000","last_became_active":"2023-12-08T08:23:00.298936+0000","last_became_peered":"2023-12-08T08:23:00.298936+0000","last_unstale":"2023-12-08T08:23:01.983595+0000","last_undegraded":"2023-12-08T08:23:01.983595+0000","last_fullsized":"2023-12-08T08:23:01.983595+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"67'6","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093460+0000","last_change":"2023-12-08T08:22:59.278612+0000","last_active":"2023-12-08T08:23:02.093460+0000","last_peered":"2023-12-08T08:23:02.093460+0000","last_clean":"2023-12-08T08:23:02.093460+0000","last_became_active":"2023-12-08T08:22:59.278325+0000","last_became_peered":"2023-12-08T08:22:59.278325+0000","last_unstale":"2023-12-08T08:23:02.093460+0000","last_undegraded":"2023-12-08T08:23:02.093460+0000","last_fullsized":"2023-12-08T08:23:02.093460+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:55:35.382801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092905+0000","last_change":"2023-12-08T08:23:00.292867+0000","last_active":"2023-12-08T08:23:02.092905+0000","last_peered":"2023-12-08T08:23:02.092905+0000","last_clean":"2023-12-08T08:23:02.092905+0000","last_became_active":"2023-12-08T08:23:00.292648+0000","last_became_peered":"2023-12-08T08:23:00.292648+0000","last_unstale":"2023-12-08T08:23:02.092905+0000","last_undegraded":"2023-12-08T08:23:02.092905+0000","last_fullsized":"2023-12-08T08:23:02.092905+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:29:03.020360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093400+0000","last_change":"2023-12-08T08:22:59.262821+0000","last_active":"2023-12-08T08:23:02.093400+0000","last_peered":"2023-12-08T08:23:02.093400+0000","last_clean":"2023-12-08T08:23:02.093400+0000","last_became_active":"2023-12-08T08:22:59.262569+0000","last_became_peered":"2023-12-08T08:22:59.262569+0000","last_unstale":"2023-12-08T08:23:02.093400+0000","last_undegraded":"2023-12-08T08:23:02.093400+0000","last_fullsized":"2023-12-08T08:23:02.093400+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:52:55.751217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093233+0000","last_change":"2023-12-08T08:23:00.298706+0000","last_active":"2023-12-08T08:23:02.093233+0000","last_peered":"2023-12-08T08:23:02.093233+0000","last_clean":"2023-12-08T08:23:02.093233+0000","last_became_active":"2023-12-08T08:23:00.298452+0000","last_became_peered":"2023-12-08T08:23:00.298452+0000","last_unstale":"2023-12-08T08:23:02.093233+0000","last_undegraded":"2023-12-08T08:23:02.093233+0000","last_fullsized":"2023-12-08T08:23:02.093233+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:39.385907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093064+0000","last_change":"2023-12-08T08:22:59.270322+0000","last_active":"2023-12-08T08:23:02.093064+0000","last_peered":"2023-12-08T08:23:02.093064+0000","last_clean":"2023-12-08T08:23:02.093064+0000","last_became_active":"2023-12-08T08:22:59.270059+0000","last_became_peered":"2023-12-08T08:22:59.270059+0000","last_unstale":"2023-12-08T08:23:02.093064+0000","last_undegraded":"2023-12-08T08:23:02.093064+0000","last_fullsized":"2023-12-08T08:23:02.093064+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:21:58.531919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093504+0000","last_change":"2023-12-08T08:23:00.304324+0000","last_active":"2023-12-08T08:23:02.093504+0000","last_peered":"2023-12-08T08:23:02.093504+0000","last_clean":"2023-12-08T08:23:02.093504+0000","last_became_active":"2023-12-08T08:23:00.304038+0000","last_became_peered":"2023-12-08T08:23:00.304038+0000","last_unstale":"2023-12-08T08:23:02.093504+0000","last_undegraded":"2023-12-08T08:23:02.093504+0000","last_fullsized":"2023-12-08T08:23:02.093504+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:33:27.464394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093348+0000","last_change":"2023-12-08T08:22:59.270216+0000","last_active":"2023-12-08T08:23:02.093348+0000","last_peered":"2023-12-08T08:23:02.093348+0000","last_clean":"2023-12-08T08:23:02.093348+0000","last_became_active":"2023-12-08T08:22:59.269292+0000","last_became_peered":"2023-12-08T08:22:59.269292+0000","last_unstale":"2023-12-08T08:23:02.093348+0000","last_undegraded":"2023-12-08T08:23:02.093348+0000","last_fullsized":"2023-12-08T08:23:02.093348+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:18:01.309002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092503+0000","last_change":"2023-12-08T08:23:00.276305+0000","last_active":"2023-12-08T08:23:02.092503+0000","last_peered":"2023-12-08T08:23:02.092503+0000","last_clean":"2023-12-08T08:23:02.092503+0000","last_became_active":"2023-12-08T08:23:00.275989+0000","last_became_peered":"2023-12-08T08:23:00.275989+0000","last_unstale":"2023-12-08T08:23:02.092503+0000","last_undegraded":"2023-12-08T08:23:02.092503+0000","last_fullsized":"2023-12-08T08:23:02.092503+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:24:33.735501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"67'8","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092786+0000","last_change":"2023-12-08T08:22:59.271542+0000","last_active":"2023-12-08T08:23:02.092786+0000","last_peered":"2023-12-08T08:23:02.092786+0000","last_clean":"2023-12-08T08:23:02.092786+0000","last_became_active":"2023-12-08T08:22:59.271240+0000","last_became_peered":"2023-12-08T08:22:59.271240+0000","last_unstale":"2023-12-08T08:23:02.092786+0000","last_undegraded":"2023-12-08T08:23:02.092786+0000","last_fullsized":"2023-12-08T08:23:02.092786+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:32.897955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093623+0000","last_change":"2023-12-08T08:23:00.280374+0000","last_active":"2023-12-08T08:23:02.093623+0000","last_peered":"2023-12-08T08:23:02.093623+0000","last_clean":"2023-12-08T08:23:02.093623+0000","last_became_active":"2023-12-08T08:23:00.280096+0000","last_became_peered":"2023-12-08T08:23:00.280096+0000","last_unstale":"2023-12-08T08:23:02.093623+0000","last_undegraded":"2023-12-08T08:23:02.093623+0000","last_fullsized":"2023-12-08T08:23:02.093623+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:21:59.539539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277612+0000","last_change":"2023-12-08T08:22:59.283727+0000","last_active":"2023-12-08T08:23:01.277612+0000","last_peered":"2023-12-08T08:23:01.277612+0000","last_clean":"2023-12-08T08:23:01.277612+0000","last_became_active":"2023-12-08T08:22:59.283254+0000","last_became_peered":"2023-12-08T08:22:59.283254+0000","last_unstale":"2023-12-08T08:23:01.277612+0000","last_undegraded":"2023-12-08T08:23:01.277612+0000","last_fullsized":"2023-12-08T08:23:01.277612+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:18:01.309002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277572+0000","last_change":"2023-12-08T08:23:00.282901+0000","last_active":"2023-12-08T08:23:01.277572+0000","last_peered":"2023-12-08T08:23:01.277572+0000","last_clean":"2023-12-08T08:23:01.277572+0000","last_became_active":"2023-12-08T08:23:00.282646+0000","last_became_peered":"2023-12-08T08:23:00.282646+0000","last_unstale":"2023-12-08T08:23:01.277572+0000","last_undegraded":"2023-12-08T08:23:01.277572+0000","last_fullsized":"2023-12-08T08:23:01.277572+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092773+0000","last_change":"2023-12-08T08:22:59.265669+0000","last_active":"2023-12-08T08:23:02.092773+0000","last_peered":"2023-12-08T08:23:02.092773+0000","last_clean":"2023-12-08T08:23:02.092773+0000","last_became_active":"2023-12-08T08:22:59.265364+0000","last_became_peered":"2023-12-08T08:22:59.265364+0000","last_unstale":"2023-12-08T08:23:02.092773+0000","last_undegraded":"2023-12-08T08:23:02.092773+0000","last_fullsized":"2023-12-08T08:23:02.092773+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:27:38.296266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983692+0000","last_change":"2023-12-08T08:23:00.270198+0000","last_active":"2023-12-08T08:23:01.983692+0000","last_peered":"2023-12-08T08:23:01.983692+0000","last_clean":"2023-12-08T08:23:01.983692+0000","last_became_active":"2023-12-08T08:23:00.269930+0000","last_became_peered":"2023-12-08T08:23:00.269930+0000","last_unstale":"2023-12-08T08:23:01.983692+0000","last_undegraded":"2023-12-08T08:23:01.983692+0000","last_fullsized":"2023-12-08T08:23:01.983692+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093281+0000","last_change":"2023-12-08T08:22:59.273655+0000","last_active":"2023-12-08T08:23:02.093281+0000","last_peered":"2023-12-08T08:23:02.093281+0000","last_clean":"2023-12-08T08:23:02.093281+0000","last_became_active":"2023-12-08T08:22:59.273396+0000","last_became_peered":"2023-12-08T08:22:59.273396+0000","last_unstale":"2023-12-08T08:23:02.093281+0000","last_undegraded":"2023-12-08T08:23:02.093281+0000","last_fullsized":"2023-12-08T08:23:02.093281+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.886510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277418+0000","last_change":"2023-12-08T08:23:00.285854+0000","last_active":"2023-12-08T08:23:01.277418+0000","last_peered":"2023-12-08T08:23:01.277418+0000","last_clean":"2023-12-08T08:23:01.277418+0000","last_became_active":"2023-12-08T08:23:00.285553+0000","last_became_peered":"2023-12-08T08:23:00.285553+0000","last_unstale":"2023-12-08T08:23:01.277418+0000","last_undegraded":"2023-12-08T08:23:01.277418+0000","last_fullsized":"2023-12-08T08:23:01.277418+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:15:44.184576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093292+0000","last_change":"2023-12-08T08:22:59.282745+0000","last_active":"2023-12-08T08:23:02.093292+0000","last_peered":"2023-12-08T08:23:02.093292+0000","last_clean":"2023-12-08T08:23:02.093292+0000","last_became_active":"2023-12-08T08:22:59.282443+0000","last_became_peered":"2023-12-08T08:22:59.282443+0000","last_unstale":"2023-12-08T08:23:02.093292+0000","last_undegraded":"2023-12-08T08:23:02.093292+0000","last_fullsized":"2023-12-08T08:23:02.093292+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:21.899236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093125+0000","last_change":"2023-12-08T08:23:00.286165+0000","last_active":"2023-12-08T08:23:02.093125+0000","last_peered":"2023-12-08T08:23:02.093125+0000","last_clean":"2023-12-08T08:23:02.093125+0000","last_became_active":"2023-12-08T08:23:00.285209+0000","last_became_peered":"2023-12-08T08:23:00.285209+0000","last_unstale":"2023-12-08T08:23:02.093125+0000","last_undegraded":"2023-12-08T08:23:02.093125+0000","last_fullsized":"2023-12-08T08:23:02.093125+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:16.068318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277643+0000","last_change":"2023-12-08T08:22:59.272934+0000","last_active":"2023-12-08T08:23:01.277643+0000","last_peered":"2023-12-08T08:23:01.277643+0000","last_clean":"2023-12-08T08:23:01.277643+0000","last_became_active":"2023-12-08T08:22:59.272094+0000","last_became_peered":"2023-12-08T08:22:59.272094+0000","last_unstale":"2023-12-08T08:23:01.277643+0000","last_undegraded":"2023-12-08T08:23:01.277643+0000","last_fullsized":"2023-12-08T08:23:01.277643+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:33:18.775139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277017+0000","last_change":"2023-12-08T08:23:00.287292+0000","last_active":"2023-12-08T08:23:01.277017+0000","last_peered":"2023-12-08T08:23:01.277017+0000","last_clean":"2023-12-08T08:23:01.277017+0000","last_became_active":"2023-12-08T08:23:00.284565+0000","last_became_peered":"2023-12-08T08:23:00.284565+0000","last_unstale":"2023-12-08T08:23:01.277017+0000","last_undegraded":"2023-12-08T08:23:01.277017+0000","last_fullsized":"2023-12-08T08:23:01.277017+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:17:25.641139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277017+0000","last_change":"2023-12-08T08:22:59.279857+0000","last_active":"2023-12-08T08:23:01.277017+0000","last_peered":"2023-12-08T08:23:01.277017+0000","last_clean":"2023-12-08T08:23:01.277017+0000","last_became_active":"2023-12-08T08:22:59.279508+0000","last_became_peered":"2023-12-08T08:22:59.279508+0000","last_unstale":"2023-12-08T08:23:01.277017+0000","last_undegraded":"2023-12-08T08:23:01.277017+0000","last_fullsized":"2023-12-08T08:23:01.277017+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:23.192834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093241+0000","last_change":"2023-12-08T08:23:00.291227+0000","last_active":"2023-12-08T08:23:02.093241+0000","last_peered":"2023-12-08T08:23:02.093241+0000","last_clean":"2023-12-08T08:23:02.093241+0000","last_became_active":"2023-12-08T08:23:00.290984+0000","last_became_peered":"2023-12-08T08:23:00.290984+0000","last_unstale":"2023-12-08T08:23:02.093241+0000","last_undegraded":"2023-12-08T08:23:02.093241+0000","last_fullsized":"2023-12-08T08:23:02.093241+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:33.905575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092294+0000","last_change":"2023-12-08T08:22:59.282842+0000","last_active":"2023-12-08T08:23:02.092294+0000","last_peered":"2023-12-08T08:23:02.092294+0000","last_clean":"2023-12-08T08:23:02.092294+0000","last_became_active":"2023-12-08T08:22:59.282605+0000","last_became_peered":"2023-12-08T08:22:59.282605+0000","last_unstale":"2023-12-08T08:23:02.092294+0000","last_undegraded":"2023-12-08T08:23:02.092294+0000","last_fullsized":"2023-12-08T08:23:02.092294+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:55.208931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983775+0000","last_change":"2023-12-08T08:23:00.270620+0000","last_active":"2023-12-08T08:23:01.983775+0000","last_peered":"2023-12-08T08:23:01.983775+0000","last_clean":"2023-12-08T08:23:01.983775+0000","last_became_active":"2023-12-08T08:23:00.270369+0000","last_became_peered":"2023-12-08T08:23:00.270369+0000","last_unstale":"2023-12-08T08:23:01.983775+0000","last_undegraded":"2023-12-08T08:23:01.983775+0000","last_fullsized":"2023-12-08T08:23:01.983775+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:33.898137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093945+0000","last_change":"2023-12-08T08:22:59.269712+0000","last_active":"2023-12-08T08:23:02.093945+0000","last_peered":"2023-12-08T08:23:02.093945+0000","last_clean":"2023-12-08T08:23:02.093945+0000","last_became_active":"2023-12-08T08:22:59.269426+0000","last_became_peered":"2023-12-08T08:22:59.269426+0000","last_unstale":"2023-12-08T08:23:02.093945+0000","last_undegraded":"2023-12-08T08:23:02.093945+0000","last_fullsized":"2023-12-08T08:23:02.093945+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:49:28.705874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093710+0000","last_change":"2023-12-08T08:23:00.280543+0000","last_active":"2023-12-08T08:23:02.093710+0000","last_peered":"2023-12-08T08:23:02.093710+0000","last_clean":"2023-12-08T08:23:02.093710+0000","last_became_active":"2023-12-08T08:23:00.280152+0000","last_became_peered":"2023-12-08T08:23:00.280152+0000","last_unstale":"2023-12-08T08:23:02.093710+0000","last_undegraded":"2023-12-08T08:23:02.093710+0000","last_fullsized":"2023-12-08T08:23:02.093710+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:37:47.067543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093863+0000","last_change":"2023-12-08T08:22:59.263185+0000","last_active":"2023-12-08T08:23:02.093863+0000","last_peered":"2023-12-08T08:23:02.093863+0000","last_clean":"2023-12-08T08:23:02.093863+0000","last_became_active":"2023-12-08T08:22:59.262924+0000","last_became_peered":"2023-12-08T08:22:59.262924+0000","last_unstale":"2023-12-08T08:23:02.093863+0000","last_undegraded":"2023-12-08T08:23:02.093863+0000","last_fullsized":"2023-12-08T08:23:02.093863+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:39:59.028170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277399+0000","last_change":"2023-12-08T08:23:00.304740+0000","last_active":"2023-12-08T08:23:01.277399+0000","last_peered":"2023-12-08T08:23:01.277399+0000","last_clean":"2023-12-08T08:23:01.277399+0000","last_became_active":"2023-12-08T08:23:00.304390+0000","last_became_peered":"2023-12-08T08:23:00.304390+0000","last_unstale":"2023-12-08T08:23:01.277399+0000","last_undegraded":"2023-12-08T08:23:01.277399+0000","last_fullsized":"2023-12-08T08:23:01.277399+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277282+0000","last_change":"2023-12-08T08:22:59.285952+0000","last_active":"2023-12-08T08:23:01.277282+0000","last_peered":"2023-12-08T08:23:01.277282+0000","last_clean":"2023-12-08T08:23:01.277282+0000","last_became_active":"2023-12-08T08:22:59.285309+0000","last_became_peered":"2023-12-08T08:22:59.285309+0000","last_unstale":"2023-12-08T08:23:01.277282+0000","last_undegraded":"2023-12-08T08:23:01.277282+0000","last_fullsized":"2023-12-08T08:23:01.277282+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:19.279362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983788+0000","last_change":"2023-12-08T08:23:00.299161+0000","last_active":"2023-12-08T08:23:01.983788+0000","last_peered":"2023-12-08T08:23:01.983788+0000","last_clean":"2023-12-08T08:23:01.983788+0000","last_became_active":"2023-12-08T08:23:00.298876+0000","last_became_peered":"2023-12-08T08:23:00.298876+0000","last_unstale":"2023-12-08T08:23:01.983788+0000","last_undegraded":"2023-12-08T08:23:01.983788+0000","last_fullsized":"2023-12-08T08:23:01.983788+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:29:03.020360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277470+0000","last_change":"2023-12-08T08:22:59.280536+0000","last_active":"2023-12-08T08:23:01.277470+0000","last_peered":"2023-12-08T08:23:01.277470+0000","last_clean":"2023-12-08T08:23:01.277470+0000","last_became_active":"2023-12-08T08:22:59.280213+0000","last_became_peered":"2023-12-08T08:22:59.280213+0000","last_unstale":"2023-12-08T08:23:01.277470+0000","last_undegraded":"2023-12-08T08:23:01.277470+0000","last_fullsized":"2023-12-08T08:23:01.277470+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:49.883139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093626+0000","last_change":"2023-12-08T08:23:00.285721+0000","last_active":"2023-12-08T08:23:02.093626+0000","last_peered":"2023-12-08T08:23:02.093626+0000","last_clean":"2023-12-08T08:23:02.093626+0000","last_became_active":"2023-12-08T08:23:00.285446+0000","last_became_peered":"2023-12-08T08:23:00.285446+0000","last_unstale":"2023-12-08T08:23:02.093626+0000","last_undegraded":"2023-12-08T08:23:02.093626+0000","last_fullsized":"2023-12-08T08:23:02.093626+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093391+0000","last_change":"2023-12-08T08:22:59.272111+0000","last_active":"2023-12-08T08:23:02.093391+0000","last_peered":"2023-12-08T08:23:02.093391+0000","last_clean":"2023-12-08T08:23:02.093391+0000","last_became_active":"2023-12-08T08:22:59.271849+0000","last_became_peered":"2023-12-08T08:22:59.271849+0000","last_unstale":"2023-12-08T08:23:02.093391+0000","last_undegraded":"2023-12-08T08:23:02.093391+0000","last_fullsized":"2023-12-08T08:23:02.093391+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:15.060698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093317+0000","last_change":"2023-12-08T08:23:00.292346+0000","last_active":"2023-12-08T08:23:02.093317+0000","last_peered":"2023-12-08T08:23:02.093317+0000","last_clean":"2023-12-08T08:23:02.093317+0000","last_became_active":"2023-12-08T08:23:00.292166+0000","last_became_peered":"2023-12-08T08:23:00.292166+0000","last_unstale":"2023-12-08T08:23:02.093317+0000","last_undegraded":"2023-12-08T08:23:02.093317+0000","last_fullsized":"2023-12-08T08:23:02.093317+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:21:59.539539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983368+0000","last_change":"2023-12-08T08:22:59.271088+0000","last_active":"2023-12-08T08:23:01.983368+0000","last_peered":"2023-12-08T08:23:01.983368+0000","last_clean":"2023-12-08T08:23:01.983368+0000","last_became_active":"2023-12-08T08:22:59.270783+0000","last_became_peered":"2023-12-08T08:22:59.270783+0000","last_unstale":"2023-12-08T08:23:01.983368+0000","last_undegraded":"2023-12-08T08:23:01.983368+0000","last_fullsized":"2023-12-08T08:23:01.983368+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:30:43.384001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092920+0000","last_change":"2023-12-08T08:23:00.283700+0000","last_active":"2023-12-08T08:23:02.092920+0000","last_peered":"2023-12-08T08:23:02.092920+0000","last_clean":"2023-12-08T08:23:02.092920+0000","last_became_active":"2023-12-08T08:23:00.283439+0000","last_became_peered":"2023-12-08T08:23:00.283439+0000","last_unstale":"2023-12-08T08:23:02.092920+0000","last_undegraded":"2023-12-08T08:23:02.092920+0000","last_fullsized":"2023-12-08T08:23:02.092920+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277224+0000","last_change":"2023-12-08T08:22:59.280725+0000","last_active":"2023-12-08T08:23:01.277224+0000","last_peered":"2023-12-08T08:23:01.277224+0000","last_clean":"2023-12-08T08:23:01.277224+0000","last_became_active":"2023-12-08T08:22:59.279736+0000","last_became_peered":"2023-12-08T08:22:59.279736+0000","last_unstale":"2023-12-08T08:23:01.277224+0000","last_undegraded":"2023-12-08T08:23:01.277224+0000","last_fullsized":"2023-12-08T08:23:01.277224+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:54.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277100+0000","last_change":"2023-12-08T08:23:00.305076+0000","last_active":"2023-12-08T08:23:01.277100+0000","last_peered":"2023-12-08T08:23:01.277100+0000","last_clean":"2023-12-08T08:23:01.277100+0000","last_became_active":"2023-12-08T08:23:00.304435+0000","last_became_peered":"2023-12-08T08:23:00.304435+0000","last_unstale":"2023-12-08T08:23:01.277100+0000","last_undegraded":"2023-12-08T08:23:01.277100+0000","last_fullsized":"2023-12-08T08:23:01.277100+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:42:20.038693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983235+0000","last_change":"2023-12-08T08:22:59.278661+0000","last_active":"2023-12-08T08:23:01.983235+0000","last_peered":"2023-12-08T08:23:01.983235+0000","last_clean":"2023-12-08T08:23:01.983235+0000","last_became_active":"2023-12-08T08:22:59.278383+0000","last_became_peered":"2023-12-08T08:22:59.278383+0000","last_unstale":"2023-12-08T08:23:01.983235+0000","last_undegraded":"2023-12-08T08:23:01.983235+0000","last_fullsized":"2023-12-08T08:23:01.983235+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:35:15.000491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093148+0000","last_change":"2023-12-08T08:23:00.270574+0000","last_active":"2023-12-08T08:23:02.093148+0000","last_peered":"2023-12-08T08:23:02.093148+0000","last_clean":"2023-12-08T08:23:02.093148+0000","last_became_active":"2023-12-08T08:23:00.270304+0000","last_became_peered":"2023-12-08T08:23:00.270304+0000","last_unstale":"2023-12-08T08:23:02.093148+0000","last_undegraded":"2023-12-08T08:23:02.093148+0000","last_fullsized":"2023-12-08T08:23:02.093148+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:15:55.762883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093485+0000","last_change":"2023-12-08T08:22:59.275324+0000","last_active":"2023-12-08T08:23:02.093485+0000","last_peered":"2023-12-08T08:23:02.093485+0000","last_clean":"2023-12-08T08:23:02.093485+0000","last_became_active":"2023-12-08T08:22:59.275038+0000","last_became_peered":"2023-12-08T08:22:59.275038+0000","last_unstale":"2023-12-08T08:23:02.093485+0000","last_undegraded":"2023-12-08T08:23:02.093485+0000","last_fullsized":"2023-12-08T08:23:02.093485+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:09.089659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":205,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-08T08:23:00.270124+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:23:00.270124+0000","last_peered":"2023-12-08T08:23:00.270124+0000","last_clean":"2023-12-08T08:23:00.270124+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:23:00.270124+0000","last_undegraded":"2023-12-08T08:23:00.270124+0000","last_fullsized":"2023-12-08T08:23:00.270124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":892928,"data_stored":948661,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89900000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.85299999999999998,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.72099999999999997}]},{"osd":1,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85999999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89600000000000002,"5min":1.446,"15min":1.446},"last":0.61499999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.71999999999999997,"15min":0.72899999999999998},"min":{"1min":0.52100000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.871,"5min":1.379,"15min":1.379},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.47599999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.84599999999999997,"5min":1.706,"15min":1.706},"last":0.67900000000000005}]},{"osd":3,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.751,"15min":0.76300000000000001},"min":{"1min":0.54500000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.88700000000000001,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.56699999999999995,"5min":0.496,"15min":0.496},"max":{"1min":0.83099999999999996,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.59399999999999997}]},{"osd":4,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.46899999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.90000000000000002,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.502},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.72599999999999998,"15min":0.74199999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83999999999999997,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.64200000000000002}]},{"osd":5,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.77500000000000002,"15min":0.79500000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81399999999999995,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.78500000000000003,"15min":0.80200000000000005},"min":{"1min":0.499,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93300000000000005,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.66300000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.84799999999999998,"15min":0.86499999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.95899999999999996,"5min":1.573,"15min":1.573},"last":0.749},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.80000000000000004,"15min":0.81499999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91100000000000003,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.57499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":847872,"data_stored":365217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66800000000000004,"15min":0.66500000000000004},"min":{"1min":0.41399999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86699999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.58199999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.90700000000000003,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.79200000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.72099999999999997,"15min":0.71799999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.74099999999999999,"15min":0.73599999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.70199999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.82999999999999996,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.745,"15min":0.749},"min":{"1min":0.51500000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91300000000000003,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.65900000000000003}]},{"osd":3,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.55900000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.85299999999999998,"5min":0.998,"15min":0.998},"last":0.751},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75,"15min":0.753},"min":{"1min":0.497,"5min":0.434,"15min":0.434},"max":{"1min":0.878,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.63900000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.71599999999999997,"15min":0.73099999999999998},"min":{"1min":0.46400000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.98799999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.748,"15min":0.76500000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.95199999999999996,"5min":1.014,"15min":1.014},"last":0.54100000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.78100000000000003,"15min":0.80100000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.006,"5min":1.091,"15min":1.091},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.83299999999999996,"15min":0.84799999999999998},"min":{"1min":0.54800000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1419999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.71999999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.80300000000000005,"15min":0.82199999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.03,"5min":1.04,"15min":1.04},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.877,"15min":0.90300000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0740000000000001,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.57199999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":851968,"data_stored":366157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.747,"5min":1.081,"15min":1.081},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.90300000000000002,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.60299999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.68999999999999995,"15min":0.68000000000000005},"min":{"1min":0.49399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.002,"5min":1.194,"15min":1.194},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70599999999999996,"15min":0.71499999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.879,"5min":1.143,"15min":1.143},"last":0.69999999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.69799999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.98099999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72899999999999998,"15min":0.73299999999999998},"min":{"1min":0.52400000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.92200000000000004,"5min":1.101,"15min":1.101},"last":0.57799999999999996}]},{"osd":3,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.74099999999999999,"15min":0.746},"min":{"1min":0.47399999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0189999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.75},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.76300000000000001,"15min":0.753},"min":{"1min":0.61599999999999999,"5min":0.5,"15min":0.5},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.71899999999999997}]},{"osd":4,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82099999999999995,"5min":1.01,"15min":1.01},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94099999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.879}]},{"osd":6,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77900000000000003,"15min":0.78600000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93999999999999995,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84899999999999998,"5min":1.073,"15min":1.073},"last":0.85499999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78800000000000003,"15min":0.79400000000000004},"min":{"1min":0.51000000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.995,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.85299999999999998,"15min":0.86099999999999999},"min":{"1min":0.54400000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.97699999999999998,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.83599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":835584,"data_stored":364523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69099999999999995,"15min":0.69699999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.95599999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66400000000000003,"15min":0.66200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.68300000000000005}]},{"osd":1,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.45400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.018,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51000000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90100000000000002,"5min":1.002,"15min":1.002},"last":0.65100000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.68500000000000005,"15min":0.69099999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88100000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.72499999999999998,"15min":0.71999999999999997},"min":{"1min":0.55700000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.753}]},{"osd":3,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.751,"15min":0.755},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.92200000000000004,"5min":1.359,"15min":1.359},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.77700000000000002,"15min":0.79300000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93700000000000006,"5min":1.232,"15min":1.232},"last":0.623}]},{"osd":5,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.66500000000000004,"15min":0.67500000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85599999999999998,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.77000000000000002,"15min":0.78900000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.995,"5min":1.091,"15min":1.091},"last":0.85599999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.70699999999999996,"15min":0.72199999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78400000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78800000000000003,"15min":0.79800000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93400000000000005,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.83699999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.81999999999999995,"15min":0.83199999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.96699999999999997,"5min":1.246,"15min":1.246},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.79200000000000004,"15min":0.80900000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97599999999999998,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.879}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":847872,"data_stored":366135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.42299999999999999,"15min":0.433},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.46500000000000002,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.45900000000000002,"15min":0.46400000000000002},"min":{"1min":0.33500000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.54900000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.38100000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.435,"15min":0.436},"min":{"1min":0.308,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.49299999999999999,"15min":0.497},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.51600000000000001,"15min":0.52400000000000002},"min":{"1min":0.39600000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.64000000000000001,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.53600000000000003,"15min":0.54300000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.77100000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.497}]},{"osd":4,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.56599999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94099999999999995,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.747,"15min":0.76100000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0349999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.61799999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.72799999999999998,"15min":0.73799999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.87,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.75800000000000001,"15min":0.77000000000000002},"min":{"1min":0.53000000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91600000000000004,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.60499999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.79300000000000004,"15min":0.80700000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.026,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.79000000000000004,"15min":0.80200000000000005},"min":{"1min":0.58699999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.89400000000000002,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.755},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90400000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.77200000000000002,"15min":0.78300000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.86799999999999999,"5min":1.121,"15min":1.121},"last":0.59499999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":839680,"data_stored":365105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.39400000000000002,"15min":0.40200000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52500000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.311},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.52200000000000002,"15min":0.54000000000000004},"min":{"1min":0.32300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.63300000000000001,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.38900000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.47099999999999997,"15min":0.47399999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.67900000000000005,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.49199999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.56899999999999995,"15min":0.58599999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70399999999999996,"5min":3.008,"15min":3.008},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48499999999999999,"15min":0.48699999999999999},"min":{"1min":0.39200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.59499999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.44400000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.80300000000000005,"15min":0.82299999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92500000000000004,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":1.004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.75800000000000001,"15min":0.76500000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93000000000000005,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.61499999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76500000000000001,"15min":0.77100000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.05,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.81299999999999994,"15min":0.83699999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0129999999999999,"5min":3.637,"15min":3.637},"last":0.90900000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.78500000000000003,"15min":0.79600000000000004},"min":{"1min":0.55800000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.96899999999999997,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.78500000000000003,"15min":0.79700000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.002,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":1.038}]},{"osd":7,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.876,"15min":0.90900000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.83999999999999997,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.83199999999999996,"15min":0.84099999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.997,"5min":1.766,"15min":1.766},"last":0.84899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":847872,"data_stored":364717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.65000000000000002,"15min":0.69299999999999995},"min":{"1min":0.29699999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.69899999999999995,"5min":5.2210000000000001,"15min":5.2210000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.83099999999999996,"15min":0.89100000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69499999999999995,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.80600000000000005,"15min":0.87},"min":{"1min":0.309,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.52900000000000003,"5min":8.2070000000000007,"15min":8.2070000000000007},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.68200000000000005,"15min":0.71999999999999997},"min":{"1min":0.34200000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.70899999999999996,"5min":4.351,"15min":4.351},"last":0.56799999999999995}]},{"osd":3,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.91000000000000003,"15min":0.97599999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.74199999999999999,"5min":8.1479999999999997,"15min":8.1479999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.746,"15min":0.79300000000000004},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63900000000000001,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.44700000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.98399999999999999,"15min":1.036},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.95499999999999996,"5min":4.8470000000000004,"15min":4.8470000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":1.0549999999999999,"15min":1.1080000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.97599999999999998,"5min":4.7939999999999996,"15min":4.7939999999999996},"last":0.73999999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.97099999999999997,"15min":1.0089999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0329999999999999,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.96399999999999997,"15min":1.0009999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92900000000000005,"5min":4.5830000000000002,"15min":4.5830000000000002},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":1.0700000000000001,"15min":1.127},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.95599999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":1.0489999999999999,"15min":1.101},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0149999999999999,"5min":4.6289999999999996,"15min":4.6289999999999996},"last":0.75700000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.98199999999999998,"15min":1.024},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0169999999999999,"5min":4.665,"15min":4.665},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":1.0620000000000001,"15min":1.1120000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0720000000000001,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.77300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":892928,"data_stored":948625,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.48499999999999999,"15min":0.501},"min":{"1min":0.27300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61599999999999999,"5min":1.863,"15min":1.863},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.85499999999999998,"15min":0.91900000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.63200000000000001,"5min":8.2799999999999994,"15min":8.2799999999999994},"last":0.442}]},{"osd":2,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.89400000000000002,"15min":0.96999999999999997},"min":{"1min":0.314,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71299999999999997,"5min":7.9290000000000003,"15min":7.9290000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.433,"5min":0.89800000000000002,"15min":0.97599999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.57299999999999995,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.65200000000000002,"15min":0.68999999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.73199999999999998,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.84199999999999997,"15min":0.90000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.745,"5min":7.8890000000000002,"15min":7.8890000000000002},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":1.0309999999999999,"15min":1.0800000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77400000000000002,"15min":0.78500000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.101,"5min":1.607,"15min":1.607},"last":0.68500000000000005}]},{"osd":5,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.83199999999999996,"15min":0.83799999999999997},"min":{"1min":0.53000000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.133,"5min":1.514,"15min":1.514},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":1.0800000000000001,"15min":1.1399999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98899999999999999,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.51400000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.81699999999999995,"15min":0.83499999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.042,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":1.032,"15min":1.081},"min":{"1min":0.55700000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0800000000000001,"5min":7.835,"15min":7.835},"last":0.67000000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":1.0580000000000001,"15min":1.1080000000000001},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1719999999999999,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.84299999999999997,"15min":0.86499999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1539999999999999,"5min":1.794,"15min":1.794},"last":0.71499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:23:08.851 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:23:08.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.990+0000 7f651e772640 1 Processor -- start 2023-12-08T08:23:08.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.990+0000 7f651e772640 1 -- start start 2023-12-08T08:23:08.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f651e772640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f651806bef0 0x7f65180bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:08.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f651e772640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f651806ccc0 0x7f65180c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:08.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f651e772640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6518151690 con 0x7f651814e3f0 2023-12-08T08:23:08.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f651e772640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6518151bc0 con 0x7f651806ccc0 2023-12-08T08:23:08.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f651e772640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65181518e0 con 0x7f651806bef0 2023-12-08T08:23:08.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f65177fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f651814e3f0 0x7f651806c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41254/0 (socket says 172.21.15.88:41254) 2023-12-08T08:23:08.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f65177fe640 1 -- 172.21.15.88:0/92897502 learned_addr learned my addr 172.21.15.88:0/92897502 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:09.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f651cd0f640 1 --2- 172.21.15.88:0/92897502 >> v2:172.21.15.148:3300/0 conn(0x7f651806ccc0 0x7f65180c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:09.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f6517fff640 1 --2- 172.21.15.88:0/92897502 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f651806bef0 0x7f65180bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:09.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f6516ffd640 1 -- 172.21.15.88:0/92897502 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1219210162 0 0) 0x7f6518151690 con 0x7f651814e3f0 2023-12-08T08:23:09.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f6516ffd640 1 -- 172.21.15.88:0/92897502 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6500003530 con 0x7f651814e3f0 2023-12-08T08:23:09.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f6516ffd640 1 -- 172.21.15.88:0/92897502 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 978337977 0 0) 0x7f6500003530 con 0x7f651814e3f0 2023-12-08T08:23:09.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f6516ffd640 1 -- 172.21.15.88:0/92897502 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f651806bef0 msgr2=0x7f65180bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:09.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f6516ffd640 1 --2- 172.21.15.88:0/92897502 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f651806bef0 0x7f65180bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f6516ffd640 1 -- 172.21.15.88:0/92897502 >> v2:172.21.15.148:3300/0 conn(0x7f651806ccc0 msgr2=0x7f65180c3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:09.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f6516ffd640 1 --2- 172.21.15.88:0/92897502 >> v2:172.21.15.148:3300/0 conn(0x7f651806ccc0 0x7f65180c3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f6516ffd640 1 -- 172.21.15.88:0/92897502 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65180c1de0 con 0x7f651814e3f0 2023-12-08T08:23:09.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f6516ffd640 1 -- 172.21.15.88:0/92897502 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f650c001680 con 0x7f651814e3f0 2023-12-08T08:23:09.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f651cd0f640 1 --2- 172.21.15.88:0/92897502 >> v2:172.21.15.148:3300/0 conn(0x7f651806ccc0 0x7f65180c3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:23:09.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f6516ffd640 1 -- 172.21.15.88:0/92897502 >> v1:172.21.15.88:6789/0 conn(0x7f651814e3f0 legacy=0x7f651806c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:09.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f6516ffd640 1 --2- 172.21.15.88:0/92897502 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6500003980 0x7f6500003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:09.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f6516ffd640 1 --2- 172.21.15.88:0/92897502 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f651806bef0 0x7f65000047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:09.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f6516ffd640 1 --2- 172.21.15.88:0/92897502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6500004d10 0x7f6500005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:09.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f6516ffd640 1 -- 172.21.15.88:0/92897502 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6518151bc0 con 0x7f6500003980 2023-12-08T08:23:09.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f6516ffd640 1 -- 172.21.15.88:0/92897502 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65181518e0 con 0x7f6500004d10 2023-12-08T08:23:09.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f6516ffd640 1 -- 172.21.15.88:0/92897502 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650000b990 con 0x7f651806bef0 2023-12-08T08:23:09.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f6517fff640 1 --2- 172.21.15.88:0/92897502 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6500003980 0x7f6500003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:09.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f65177fe640 1 --2- 172.21.15.88:0/92897502 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f651806bef0 0x7f65000047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:09.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f651cd0f640 1 --2- 172.21.15.88:0/92897502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6500004d10 0x7f6500005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:09.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f6517fff640 1 -- 172.21.15.88:0/92897502 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f651806bef0 msgr2=0x7f65000047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:09.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f6517fff640 1 --2- 172.21.15.88:0/92897502 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f651806bef0 0x7f65000047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f6517fff640 1 -- 172.21.15.88:0/92897502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6500004d10 msgr2=0x7f6500005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:09.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f6517fff640 1 --2- 172.21.15.88:0/92897502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6500004d10 0x7f6500005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f6517fff640 1 -- 172.21.15.88:0/92897502 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6500003530 con 0x7f6500003980 2023-12-08T08:23:09.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.994+0000 7f65177fe640 1 --2- 172.21.15.88:0/92897502 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f651806bef0 0x7f65000047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:09.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.998+0000 7f6517fff640 1 --2- 172.21.15.88:0/92897502 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6500003980 0x7f6500003da0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f6508009ae0 tx=0x7f650801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47192ecaf03ab735 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:09.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.998+0000 7f6516ffd640 1 -- 172.21.15.88:0/92897502 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65080a6430 con 0x7f6500003980 2023-12-08T08:23:09.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.998+0000 7f6516ffd640 1 -- 172.21.15.88:0/92897502 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65080a6590 con 0x7f6500003980 2023-12-08T08:23:09.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.998+0000 7f6516ffd640 1 -- 172.21.15.88:0/92897502 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65080a6940 con 0x7f6500003980 2023-12-08T08:23:09.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.998+0000 7f651e772640 1 -- 172.21.15.88:0/92897502 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6500003980 msgr2=0x7f6500003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:09.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.998+0000 7f651e772640 1 --2- 172.21.15.88:0/92897502 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6500003980 0x7f6500003da0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f6508009ae0 tx=0x7f650801ca50 comp rx=0 tx=0).stop 2023-12-08T08:23:09.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.998+0000 7f651cd0f640 1 -- 172.21.15.88:0/92897502 reap_dead start 2023-12-08T08:23:09.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.998+0000 7f651e772640 1 -- 172.21.15.88:0/92897502 shutdown_connections 2023-12-08T08:23:09.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.998+0000 7f651e772640 1 -- 172.21.15.88:0/92897502 >> 172.21.15.88:0/92897502 conn(0x7f65180a7810 msgr2=0x7f65180a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:09.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.998+0000 7f651e772640 1 -- 172.21.15.88:0/92897502 shutdown_connections 2023-12-08T08:23:09.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:08.998+0000 7f651e772640 1 -- 172.21.15.88:0/92897502 wait complete. 2023-12-08T08:23:09.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.002+0000 7f651e772640 1 Processor -- start 2023-12-08T08:23:09.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.002+0000 7f651e772640 1 -- start start 2023-12-08T08:23:09.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.002+0000 7f651e772640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6500003980 0x7f65180a97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:09.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.002+0000 7f651e772640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6518149a20 0x7f65180ab620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:09.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.002+0000 7f651e772640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65180a52c0 0x7f6518153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:09.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.002+0000 7f651e772640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65181ee430 con 0x7f65180a52c0 2023-12-08T08:23:09.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.002+0000 7f651e772640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65181ee920 con 0x7f6518149a20 2023-12-08T08:23:09.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.002+0000 7f651e772640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6518152010 con 0x7f6500003980 2023-12-08T08:23:09.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.002+0000 7f651cd0f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65180a52c0 0x7f6518153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:09.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.002+0000 7f651cd0f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65180a52c0 0x7f6518153ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50052/0 (socket says 172.21.15.88:50052) 2023-12-08T08:23:09.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.002+0000 7f651cd0f640 1 -- 172.21.15.88:0/2950149741 learned_addr learned my addr 172.21.15.88:0/2950149741 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:09.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.002+0000 7f6517fff640 1 --2- 172.21.15.88:0/2950149741 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6500003980 0x7f65180a97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:09.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.002+0000 7f65177fe640 1 --2- 172.21.15.88:0/2950149741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6518149a20 0x7f65180ab620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:09.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.002+0000 7f651cd0f640 1 -- 172.21.15.88:0/2950149741 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6500003980 msgr2=0x7f65180a97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:09.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.002+0000 7f651cd0f640 1 --2- 172.21.15.88:0/2950149741 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6500003980 0x7f65180a97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.002+0000 7f651cd0f640 1 -- 172.21.15.88:0/2950149741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6518149a20 msgr2=0x7f65180ab620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:09.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.002+0000 7f651cd0f640 1 --2- 172.21.15.88:0/2950149741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6518149a20 0x7f65180ab620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.002+0000 7f651cd0f640 1 -- 172.21.15.88:0/2950149741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6518154f90 con 0x7f65180a52c0 2023-12-08T08:23:09.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.002+0000 7f651cd0f640 1 --2- 172.21.15.88:0/2950149741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65180a52c0 0x7f6518153ae0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f65180abdd0 tx=0x7f6510009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:09.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.002+0000 7f6514ff9640 1 -- 172.21.15.88:0/2950149741 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651000e040 con 0x7f65180a52c0 2023-12-08T08:23:09.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.002+0000 7f6514ff9640 1 -- 172.21.15.88:0/2950149741 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651000f040 con 0x7f65180a52c0 2023-12-08T08:23:09.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.002+0000 7f6514ff9640 1 -- 172.21.15.88:0/2950149741 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6510003be0 con 0x7f65180a52c0 2023-12-08T08:23:09.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.002+0000 7f651e772640 1 -- 172.21.15.88:0/2950149741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65181ee640 con 0x7f65180a52c0 2023-12-08T08:23:09.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.002+0000 7f651e772640 1 -- 172.21.15.88:0/2950149741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6518152590 con 0x7f65180a52c0 2023-12-08T08:23:09.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.002+0000 7f651e772640 1 -- 172.21.15.88:0/2950149741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6518067630 con 0x7f65180a52c0 2023-12-08T08:23:09.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.006+0000 7f6514ff9640 1 -- 172.21.15.88:0/2950149741 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6510015430 con 0x7f65180a52c0 2023-12-08T08:23:09.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.006+0000 7f6514ff9640 1 --2- 172.21.15.88:0/2950149741 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f65040664a0 0x7f6504068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:09.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.006+0000 7f6514ff9640 1 -- 172.21.15.88:0/2950149741 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65100845e0 con 0x7f65180a52c0 2023-12-08T08:23:09.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.006+0000 7f6517fff640 1 --2- 172.21.15.88:0/2950149741 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f65040664a0 0x7f6504068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:09.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.006+0000 7f6517fff640 1 --2- 172.21.15.88:0/2950149741 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f65040664a0 0x7f6504068960 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f65080ad000 tx=0x7f65080b3040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:09.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.010+0000 7f6514ff9640 1 -- 172.21.15.88:0/2950149741 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6510051b00 con 0x7f65180a52c0 2023-12-08T08:23:09.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.154+0000 7f651e772640 1 -- 172.21.15.88:0/2950149741 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f651806d460 con 0x7f65040664a0 2023-12-08T08:23:09.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.162+0000 7f6514ff9640 1 -- 172.21.15.88:0/2950149741 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289187 (secure 0 0 0) 0x7f651806d460 con 0x7f65040664a0 2023-12-08T08:23:09.170 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:09.172 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:23:09.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.166+0000 7f651e772640 1 -- 172.21.15.88:0/2950149741 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f65040664a0 msgr2=0x7f6504068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:09.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.166+0000 7f651e772640 1 --2- 172.21.15.88:0/2950149741 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f65040664a0 0x7f6504068960 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f65080ad000 tx=0x7f65080b3040 comp rx=0 tx=0).stop 2023-12-08T08:23:09.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.166+0000 7f651e772640 1 -- 172.21.15.88:0/2950149741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65180a52c0 msgr2=0x7f6518153ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:09.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.166+0000 7f651e772640 1 --2- 172.21.15.88:0/2950149741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65180a52c0 0x7f6518153ae0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f65180abdd0 tx=0x7f6510009f90 comp rx=0 tx=0).stop 2023-12-08T08:23:09.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.166+0000 7f651e772640 1 -- 172.21.15.88:0/2950149741 shutdown_connections 2023-12-08T08:23:09.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.166+0000 7f651e772640 1 --2- 172.21.15.88:0/2950149741 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f65040664a0 0x7f6504068960 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.166+0000 7f651e772640 1 --2- 172.21.15.88:0/2950149741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65180a52c0 0x7f6518153ae0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.166+0000 7f651e772640 1 --2- 172.21.15.88:0/2950149741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6518149a20 0x7f65180ab620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.166+0000 7f651e772640 1 --2- 172.21.15.88:0/2950149741 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6500003980 0x7f65180a97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.166+0000 7f651e772640 1 -- 172.21.15.88:0/2950149741 >> 172.21.15.88:0/2950149741 conn(0x7f65180a7810 msgr2=0x7f65180a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:09.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.166+0000 7f651e772640 1 -- 172.21.15.88:0/2950149741 shutdown_connections 2023-12-08T08:23:09.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.166+0000 7f651e772640 1 -- 172.21.15.88:0/2950149741 wait complete. 2023-12-08T08:23:09.190 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2023-12-08T08:23:08.781667+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252024,"kb_used_data":6720,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754722696,"statfs":{"total":773094113280,"available":772836040704,"internally_reserved":0,"allocated":6881280,"data_stored":4101740,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.526506"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277373+0000","last_change":"2023-12-08T08:23:00.281512+0000","last_active":"2023-12-08T08:23:01.277373+0000","last_peered":"2023-12-08T08:23:01.277373+0000","last_clean":"2023-12-08T08:23:01.277373+0000","last_became_active":"2023-12-08T08:23:00.281118+0000","last_became_peered":"2023-12-08T08:23:00.281118+0000","last_unstale":"2023-12-08T08:23:01.277373+0000","last_undegraded":"2023-12-08T08:23:01.277373+0000","last_fullsized":"2023-12-08T08:23:01.277373+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:15.472021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093886+0000","last_change":"2023-12-08T08:23:00.276523+0000","last_active":"2023-12-08T08:23:02.093886+0000","last_peered":"2023-12-08T08:23:02.093886+0000","last_clean":"2023-12-08T08:23:02.093886+0000","last_became_active":"2023-12-08T08:23:00.276039+0000","last_became_peered":"2023-12-08T08:23:00.276039+0000","last_unstale":"2023-12-08T08:23:02.093886+0000","last_undegraded":"2023-12-08T08:23:02.093886+0000","last_fullsized":"2023-12-08T08:23:02.093886+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:31:16.893953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093136+0000","last_change":"2023-12-08T08:23:00.283198+0000","last_active":"2023-12-08T08:23:02.093136+0000","last_peered":"2023-12-08T08:23:02.093136+0000","last_clean":"2023-12-08T08:23:02.093136+0000","last_became_active":"2023-12-08T08:23:00.282944+0000","last_became_peered":"2023-12-08T08:23:00.282944+0000","last_unstale":"2023-12-08T08:23:02.093136+0000","last_undegraded":"2023-12-08T08:23:02.093136+0000","last_fullsized":"2023-12-08T08:23:02.093136+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:33.898137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277234+0000","last_change":"2023-12-08T08:23:00.285685+0000","last_active":"2023-12-08T08:23:01.277234+0000","last_peered":"2023-12-08T08:23:01.277234+0000","last_clean":"2023-12-08T08:23:01.277234+0000","last_became_active":"2023-12-08T08:23:00.285351+0000","last_became_peered":"2023-12-08T08:23:00.285351+0000","last_unstale":"2023-12-08T08:23:01.277234+0000","last_undegraded":"2023-12-08T08:23:01.277234+0000","last_fullsized":"2023-12-08T08:23:01.277234+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:43:34.830332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983339+0000","last_change":"2023-12-08T08:23:00.264270+0000","last_active":"2023-12-08T08:23:01.983339+0000","last_peered":"2023-12-08T08:23:01.983339+0000","last_clean":"2023-12-08T08:23:01.983339+0000","last_became_active":"2023-12-08T08:23:00.263994+0000","last_became_peered":"2023-12-08T08:23:00.263994+0000","last_unstale":"2023-12-08T08:23:01.983339+0000","last_undegraded":"2023-12-08T08:23:01.983339+0000","last_fullsized":"2023-12-08T08:23:01.983339+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:33.905575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093489+0000","last_change":"2023-12-08T08:23:00.300354+0000","last_active":"2023-12-08T08:23:02.093489+0000","last_peered":"2023-12-08T08:23:02.093489+0000","last_clean":"2023-12-08T08:23:02.093489+0000","last_became_active":"2023-12-08T08:23:00.300026+0000","last_became_peered":"2023-12-08T08:23:00.300026+0000","last_unstale":"2023-12-08T08:23:02.093489+0000","last_undegraded":"2023-12-08T08:23:02.093489+0000","last_fullsized":"2023-12-08T08:23:02.093489+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277001+0000","last_change":"2023-12-08T08:23:00.278456+0000","last_active":"2023-12-08T08:23:01.277001+0000","last_peered":"2023-12-08T08:23:01.277001+0000","last_clean":"2023-12-08T08:23:01.277001+0000","last_became_active":"2023-12-08T08:23:00.277186+0000","last_became_peered":"2023-12-08T08:23:00.277186+0000","last_unstale":"2023-12-08T08:23:01.277001+0000","last_undegraded":"2023-12-08T08:23:01.277001+0000","last_fullsized":"2023-12-08T08:23:01.277001+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:20:16.170951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093242+0000","last_change":"2023-12-08T08:23:00.272694+0000","last_active":"2023-12-08T08:23:02.093242+0000","last_peered":"2023-12-08T08:23:02.093242+0000","last_clean":"2023-12-08T08:23:02.093242+0000","last_became_active":"2023-12-08T08:23:00.272440+0000","last_became_peered":"2023-12-08T08:23:00.272440+0000","last_unstale":"2023-12-08T08:23:02.093242+0000","last_undegraded":"2023-12-08T08:23:02.093242+0000","last_fullsized":"2023-12-08T08:23:02.093242+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:15.472021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093691+0000","last_change":"2023-12-08T08:23:00.298447+0000","last_active":"2023-12-08T08:23:02.093691+0000","last_peered":"2023-12-08T08:23:02.093691+0000","last_clean":"2023-12-08T08:23:02.093691+0000","last_became_active":"2023-12-08T08:23:00.298113+0000","last_became_peered":"2023-12-08T08:23:00.298113+0000","last_unstale":"2023-12-08T08:23:02.093691+0000","last_undegraded":"2023-12-08T08:23:02.093691+0000","last_fullsized":"2023-12-08T08:23:02.093691+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277439+0000","last_change":"2023-12-08T08:23:00.277064+0000","last_active":"2023-12-08T08:23:01.277439+0000","last_peered":"2023-12-08T08:23:01.277439+0000","last_clean":"2023-12-08T08:23:01.277439+0000","last_became_active":"2023-12-08T08:23:00.276850+0000","last_became_peered":"2023-12-08T08:23:00.276850+0000","last_unstale":"2023-12-08T08:23:01.277439+0000","last_undegraded":"2023-12-08T08:23:01.277439+0000","last_fullsized":"2023-12-08T08:23:01.277439+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093759+0000","last_change":"2023-12-08T08:23:00.286362+0000","last_active":"2023-12-08T08:23:02.093759+0000","last_peered":"2023-12-08T08:23:02.093759+0000","last_clean":"2023-12-08T08:23:02.093759+0000","last_became_active":"2023-12-08T08:23:00.286071+0000","last_became_peered":"2023-12-08T08:23:00.286071+0000","last_unstale":"2023-12-08T08:23:02.093759+0000","last_undegraded":"2023-12-08T08:23:02.093759+0000","last_fullsized":"2023-12-08T08:23:02.093759+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:50.890759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277084+0000","last_change":"2023-12-08T08:23:00.277187+0000","last_active":"2023-12-08T08:23:01.277084+0000","last_peered":"2023-12-08T08:23:01.277084+0000","last_clean":"2023-12-08T08:23:01.277084+0000","last_became_active":"2023-12-08T08:23:00.276929+0000","last_became_peered":"2023-12-08T08:23:00.276929+0000","last_unstale":"2023-12-08T08:23:01.277084+0000","last_undegraded":"2023-12-08T08:23:01.277084+0000","last_fullsized":"2023-12-08T08:23:01.277084+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:55:36.390421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093011+0000","last_change":"2023-12-08T08:23:00.275837+0000","last_active":"2023-12-08T08:23:02.093011+0000","last_peered":"2023-12-08T08:23:02.093011+0000","last_clean":"2023-12-08T08:23:02.093011+0000","last_became_active":"2023-12-08T08:23:00.275561+0000","last_became_peered":"2023-12-08T08:23:00.275561+0000","last_unstale":"2023-12-08T08:23:02.093011+0000","last_undegraded":"2023-12-08T08:23:02.093011+0000","last_fullsized":"2023-12-08T08:23:02.093011+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277312+0000","last_change":"2023-12-08T08:23:00.295614+0000","last_active":"2023-12-08T08:23:01.277312+0000","last_peered":"2023-12-08T08:23:01.277312+0000","last_clean":"2023-12-08T08:23:01.277312+0000","last_became_active":"2023-12-08T08:23:00.295111+0000","last_became_peered":"2023-12-08T08:23:00.295111+0000","last_unstale":"2023-12-08T08:23:01.277312+0000","last_undegraded":"2023-12-08T08:23:01.277312+0000","last_fullsized":"2023-12-08T08:23:01.277312+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:10:16.885890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092580+0000","last_change":"2023-12-08T08:23:00.292909+0000","last_active":"2023-12-08T08:23:02.092580+0000","last_peered":"2023-12-08T08:23:02.092580+0000","last_clean":"2023-12-08T08:23:02.092580+0000","last_became_active":"2023-12-08T08:23:00.292500+0000","last_became_peered":"2023-12-08T08:23:00.292500+0000","last_unstale":"2023-12-08T08:23:02.092580+0000","last_undegraded":"2023-12-08T08:23:02.092580+0000","last_fullsized":"2023-12-08T08:23:02.092580+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:21:14.553932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983314+0000","last_change":"2023-12-08T08:23:00.273084+0000","last_active":"2023-12-08T08:23:01.983314+0000","last_peered":"2023-12-08T08:23:01.983314+0000","last_clean":"2023-12-08T08:23:01.983314+0000","last_became_active":"2023-12-08T08:23:00.272803+0000","last_became_peered":"2023-12-08T08:23:00.272803+0000","last_unstale":"2023-12-08T08:23:01.983314+0000","last_undegraded":"2023-12-08T08:23:01.983314+0000","last_fullsized":"2023-12-08T08:23:01.983314+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:16.068318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983826+0000","last_change":"2023-12-08T08:23:00.300292+0000","last_active":"2023-12-08T08:23:01.983826+0000","last_peered":"2023-12-08T08:23:01.983826+0000","last_clean":"2023-12-08T08:23:01.983826+0000","last_became_active":"2023-12-08T08:23:00.300008+0000","last_became_peered":"2023-12-08T08:23:00.300008+0000","last_unstale":"2023-12-08T08:23:01.983826+0000","last_undegraded":"2023-12-08T08:23:01.983826+0000","last_fullsized":"2023-12-08T08:23:01.983826+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:39.385907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277554+0000","last_change":"2023-12-08T08:23:00.299621+0000","last_active":"2023-12-08T08:23:01.277554+0000","last_peered":"2023-12-08T08:23:01.277554+0000","last_clean":"2023-12-08T08:23:01.277554+0000","last_became_active":"2023-12-08T08:23:00.299255+0000","last_became_peered":"2023-12-08T08:23:00.299255+0000","last_unstale":"2023-12-08T08:23:01.277554+0000","last_undegraded":"2023-12-08T08:23:01.277554+0000","last_fullsized":"2023-12-08T08:23:01.277554+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:28:46.845466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093084+0000","last_change":"2023-12-08T08:23:00.296010+0000","last_active":"2023-12-08T08:23:02.093084+0000","last_peered":"2023-12-08T08:23:02.093084+0000","last_clean":"2023-12-08T08:23:02.093084+0000","last_became_active":"2023-12-08T08:23:00.295749+0000","last_became_peered":"2023-12-08T08:23:00.295749+0000","last_unstale":"2023-12-08T08:23:02.093084+0000","last_undegraded":"2023-12-08T08:23:02.093084+0000","last_fullsized":"2023-12-08T08:23:02.093084+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:39.385907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277430+0000","last_change":"2023-12-08T08:23:00.301831+0000","last_active":"2023-12-08T08:23:01.277430+0000","last_peered":"2023-12-08T08:23:01.277430+0000","last_clean":"2023-12-08T08:23:01.277430+0000","last_became_active":"2023-12-08T08:23:00.301321+0000","last_became_peered":"2023-12-08T08:23:00.301321+0000","last_unstale":"2023-12-08T08:23:01.277430+0000","last_undegraded":"2023-12-08T08:23:01.277430+0000","last_fullsized":"2023-12-08T08:23:01.277430+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:14:54.964832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277284+0000","last_change":"2023-12-08T08:23:00.301605+0000","last_active":"2023-12-08T08:23:01.277284+0000","last_peered":"2023-12-08T08:23:01.277284+0000","last_clean":"2023-12-08T08:23:01.277284+0000","last_became_active":"2023-12-08T08:23:00.301346+0000","last_became_peered":"2023-12-08T08:23:00.301346+0000","last_unstale":"2023-12-08T08:23:01.277284+0000","last_undegraded":"2023-12-08T08:23:01.277284+0000","last_fullsized":"2023-12-08T08:23:01.277284+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:35:35.139064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093024+0000","last_change":"2023-12-08T08:23:00.301440+0000","last_active":"2023-12-08T08:23:02.093024+0000","last_peered":"2023-12-08T08:23:02.093024+0000","last_clean":"2023-12-08T08:23:02.093024+0000","last_became_active":"2023-12-08T08:23:00.301156+0000","last_became_peered":"2023-12-08T08:23:00.301156+0000","last_unstale":"2023-12-08T08:23:02.093024+0000","last_undegraded":"2023-12-08T08:23:02.093024+0000","last_fullsized":"2023-12-08T08:23:02.093024+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:04:21.562137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277139+0000","last_change":"2023-12-08T08:23:00.301914+0000","last_active":"2023-12-08T08:23:01.277139+0000","last_peered":"2023-12-08T08:23:01.277139+0000","last_clean":"2023-12-08T08:23:01.277139+0000","last_became_active":"2023-12-08T08:23:00.301688+0000","last_became_peered":"2023-12-08T08:23:00.301688+0000","last_unstale":"2023-12-08T08:23:01.277139+0000","last_undegraded":"2023-12-08T08:23:01.277139+0000","last_fullsized":"2023-12-08T08:23:01.277139+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:27:39.303886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.276995+0000","last_change":"2023-12-08T08:23:00.298664+0000","last_active":"2023-12-08T08:23:01.276995+0000","last_peered":"2023-12-08T08:23:01.276995+0000","last_clean":"2023-12-08T08:23:01.276995+0000","last_became_active":"2023-12-08T08:23:00.298341+0000","last_became_peered":"2023-12-08T08:23:00.298341+0000","last_unstale":"2023-12-08T08:23:01.276995+0000","last_undegraded":"2023-12-08T08:23:01.276995+0000","last_fullsized":"2023-12-08T08:23:01.276995+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:20:20.944416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093896+0000","last_change":"2023-12-08T08:23:00.280235+0000","last_active":"2023-12-08T08:23:02.093896+0000","last_peered":"2023-12-08T08:23:02.093896+0000","last_clean":"2023-12-08T08:23:02.093896+0000","last_became_active":"2023-12-08T08:23:00.278807+0000","last_became_peered":"2023-12-08T08:23:00.278807+0000","last_unstale":"2023-12-08T08:23:02.093896+0000","last_undegraded":"2023-12-08T08:23:02.093896+0000","last_fullsized":"2023-12-08T08:23:02.093896+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:30:44.391621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093551+0000","last_change":"2023-12-08T08:23:00.278532+0000","last_active":"2023-12-08T08:23:02.093551+0000","last_peered":"2023-12-08T08:23:02.093551+0000","last_clean":"2023-12-08T08:23:02.093551+0000","last_became_active":"2023-12-08T08:23:00.278177+0000","last_became_peered":"2023-12-08T08:23:00.278177+0000","last_unstale":"2023-12-08T08:23:02.093551+0000","last_undegraded":"2023-12-08T08:23:02.093551+0000","last_fullsized":"2023-12-08T08:23:02.093551+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:56.216551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983525+0000","last_change":"2023-12-08T08:23:00.284090+0000","last_active":"2023-12-08T08:23:01.983525+0000","last_peered":"2023-12-08T08:23:01.983525+0000","last_clean":"2023-12-08T08:23:01.983525+0000","last_became_active":"2023-12-08T08:23:00.283777+0000","last_became_peered":"2023-12-08T08:23:00.283777+0000","last_unstale":"2023-12-08T08:23:01.983525+0000","last_undegraded":"2023-12-08T08:23:01.983525+0000","last_fullsized":"2023-12-08T08:23:01.983525+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277149+0000","last_change":"2023-12-08T08:23:00.277149+0000","last_active":"2023-12-08T08:23:01.277149+0000","last_peered":"2023-12-08T08:23:01.277149+0000","last_clean":"2023-12-08T08:23:01.277149+0000","last_became_active":"2023-12-08T08:23:00.276879+0000","last_became_peered":"2023-12-08T08:23:00.276879+0000","last_unstale":"2023-12-08T08:23:01.277149+0000","last_undegraded":"2023-12-08T08:23:01.277149+0000","last_fullsized":"2023-12-08T08:23:01.277149+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:16.068318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093285+0000","last_change":"2023-12-08T08:23:00.294726+0000","last_active":"2023-12-08T08:23:02.093285+0000","last_peered":"2023-12-08T08:23:02.093285+0000","last_clean":"2023-12-08T08:23:02.093285+0000","last_became_active":"2023-12-08T08:23:00.294450+0000","last_became_peered":"2023-12-08T08:23:00.294450+0000","last_unstale":"2023-12-08T08:23:02.093285+0000","last_undegraded":"2023-12-08T08:23:02.093285+0000","last_fullsized":"2023-12-08T08:23:02.093285+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:28:25.934029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093151+0000","last_change":"2023-12-08T08:23:00.288804+0000","last_active":"2023-12-08T08:23:02.093151+0000","last_peered":"2023-12-08T08:23:02.093151+0000","last_clean":"2023-12-08T08:23:02.093151+0000","last_became_active":"2023-12-08T08:23:00.288315+0000","last_became_peered":"2023-12-08T08:23:00.288315+0000","last_unstale":"2023-12-08T08:23:02.093151+0000","last_undegraded":"2023-12-08T08:23:02.093151+0000","last_fullsized":"2023-12-08T08:23:02.093151+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:23:06.925359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983279+0000","last_change":"2023-12-08T08:23:00.294482+0000","last_active":"2023-12-08T08:23:01.983279+0000","last_peered":"2023-12-08T08:23:01.983279+0000","last_clean":"2023-12-08T08:23:01.983279+0000","last_became_active":"2023-12-08T08:23:00.294057+0000","last_became_peered":"2023-12-08T08:23:00.294057+0000","last_unstale":"2023-12-08T08:23:01.983279+0000","last_undegraded":"2023-12-08T08:23:01.983279+0000","last_fullsized":"2023-12-08T08:23:01.983279+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:42:20.038693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.276897+0000","last_change":"2023-12-08T08:23:00.272949+0000","last_active":"2023-12-08T08:23:01.276897+0000","last_peered":"2023-12-08T08:23:01.276897+0000","last_clean":"2023-12-08T08:23:01.276897+0000","last_became_active":"2023-12-08T08:23:00.272655+0000","last_became_peered":"2023-12-08T08:23:00.272655+0000","last_unstale":"2023-12-08T08:23:01.276897+0000","last_undegraded":"2023-12-08T08:23:01.276897+0000","last_fullsized":"2023-12-08T08:23:01.276897+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:28.275394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983738+0000","last_change":"2023-12-08T08:23:00.273779+0000","last_active":"2023-12-08T08:23:01.983738+0000","last_peered":"2023-12-08T08:23:01.983738+0000","last_clean":"2023-12-08T08:23:01.983738+0000","last_became_active":"2023-12-08T08:23:00.273256+0000","last_became_peered":"2023-12-08T08:23:00.273256+0000","last_unstale":"2023-12-08T08:23:01.983738+0000","last_undegraded":"2023-12-08T08:23:01.983738+0000","last_fullsized":"2023-12-08T08:23:01.983738+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"67'4","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277464+0000","last_change":"2023-12-08T08:22:59.285668+0000","last_active":"2023-12-08T08:23:01.277464+0000","last_peered":"2023-12-08T08:23:01.277464+0000","last_clean":"2023-12-08T08:23:01.277464+0000","last_became_active":"2023-12-08T08:22:59.285340+0000","last_became_peered":"2023-12-08T08:22:59.285340+0000","last_unstale":"2023-12-08T08:23:01.277464+0000","last_undegraded":"2023-12-08T08:23:01.277464+0000","last_fullsized":"2023-12-08T08:23:01.277464+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:35:15.000491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277385+0000","last_change":"2023-12-08T08:23:00.300874+0000","last_active":"2023-12-08T08:23:01.277385+0000","last_peered":"2023-12-08T08:23:01.277385+0000","last_clean":"2023-12-08T08:23:01.277385+0000","last_became_active":"2023-12-08T08:23:00.300595+0000","last_became_peered":"2023-12-08T08:23:00.300595+0000","last_unstale":"2023-12-08T08:23:01.277385+0000","last_undegraded":"2023-12-08T08:23:01.277385+0000","last_fullsized":"2023-12-08T08:23:01.277385+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983848+0000","last_change":"2023-12-08T08:22:59.274595+0000","last_active":"2023-12-08T08:23:01.983848+0000","last_peered":"2023-12-08T08:23:01.983848+0000","last_clean":"2023-12-08T08:23:01.983848+0000","last_became_active":"2023-12-08T08:22:59.274280+0000","last_became_peered":"2023-12-08T08:22:59.274280+0000","last_unstale":"2023-12-08T08:23:01.983848+0000","last_undegraded":"2023-12-08T08:23:01.983848+0000","last_fullsized":"2023-12-08T08:23:01.983848+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:27.267774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277372+0000","last_change":"2023-12-08T08:23:00.280594+0000","last_active":"2023-12-08T08:23:01.277372+0000","last_peered":"2023-12-08T08:23:01.277372+0000","last_clean":"2023-12-08T08:23:01.277372+0000","last_became_active":"2023-12-08T08:23:00.279794+0000","last_became_peered":"2023-12-08T08:23:00.279794+0000","last_unstale":"2023-12-08T08:23:01.277372+0000","last_undegraded":"2023-12-08T08:23:01.277372+0000","last_fullsized":"2023-12-08T08:23:01.277372+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:33.905575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093181+0000","last_change":"2023-12-08T08:22:59.282892+0000","last_active":"2023-12-08T08:23:02.093181+0000","last_peered":"2023-12-08T08:23:02.093181+0000","last_clean":"2023-12-08T08:23:02.093181+0000","last_became_active":"2023-12-08T08:22:59.282172+0000","last_became_peered":"2023-12-08T08:22:59.282172+0000","last_unstale":"2023-12-08T08:23:02.093181+0000","last_undegraded":"2023-12-08T08:23:02.093181+0000","last_fullsized":"2023-12-08T08:23:02.093181+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:32.890517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093181+0000","last_change":"2023-12-08T08:23:00.304580+0000","last_active":"2023-12-08T08:23:02.093181+0000","last_peered":"2023-12-08T08:23:02.093181+0000","last_clean":"2023-12-08T08:23:02.093181+0000","last_became_active":"2023-12-08T08:23:00.304098+0000","last_became_peered":"2023-12-08T08:23:00.304098+0000","last_unstale":"2023-12-08T08:23:02.093181+0000","last_undegraded":"2023-12-08T08:23:02.093181+0000","last_fullsized":"2023-12-08T08:23:02.093181+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:29:03.020360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093192+0000","last_change":"2023-12-08T08:22:59.283290+0000","last_active":"2023-12-08T08:23:02.093192+0000","last_peered":"2023-12-08T08:23:02.093192+0000","last_clean":"2023-12-08T08:23:02.093192+0000","last_became_active":"2023-12-08T08:22:59.282103+0000","last_became_peered":"2023-12-08T08:22:59.282103+0000","last_unstale":"2023-12-08T08:23:02.093192+0000","last_undegraded":"2023-12-08T08:23:02.093192+0000","last_fullsized":"2023-12-08T08:23:02.093192+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:15.256488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093289+0000","last_change":"2023-12-08T08:23:00.288605+0000","last_active":"2023-12-08T08:23:02.093289+0000","last_peered":"2023-12-08T08:23:02.093289+0000","last_clean":"2023-12-08T08:23:02.093289+0000","last_became_active":"2023-12-08T08:23:00.287910+0000","last_became_peered":"2023-12-08T08:23:00.287910+0000","last_unstale":"2023-12-08T08:23:02.093289+0000","last_undegraded":"2023-12-08T08:23:02.093289+0000","last_fullsized":"2023-12-08T08:23:02.093289+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:55.193260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983566+0000","last_change":"2023-12-08T08:22:59.267027+0000","last_active":"2023-12-08T08:23:01.983566+0000","last_peered":"2023-12-08T08:23:01.983566+0000","last_clean":"2023-12-08T08:23:01.983566+0000","last_became_active":"2023-12-08T08:22:59.265676+0000","last_became_peered":"2023-12-08T08:22:59.265676+0000","last_unstale":"2023-12-08T08:23:01.983566+0000","last_undegraded":"2023-12-08T08:23:01.983566+0000","last_fullsized":"2023-12-08T08:23:01.983566+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:19.279362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983439+0000","last_change":"2023-12-08T08:23:00.300280+0000","last_active":"2023-12-08T08:23:01.983439+0000","last_peered":"2023-12-08T08:23:01.983439+0000","last_clean":"2023-12-08T08:23:01.983439+0000","last_became_active":"2023-12-08T08:23:00.299998+0000","last_became_peered":"2023-12-08T08:23:00.299998+0000","last_unstale":"2023-12-08T08:23:01.983439+0000","last_undegraded":"2023-12-08T08:23:01.983439+0000","last_fullsized":"2023-12-08T08:23:01.983439+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:15.472021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983222+0000","last_change":"2023-12-08T08:22:59.274800+0000","last_active":"2023-12-08T08:23:01.983222+0000","last_peered":"2023-12-08T08:23:01.983222+0000","last_clean":"2023-12-08T08:23:01.983222+0000","last_became_active":"2023-12-08T08:22:59.274501+0000","last_became_peered":"2023-12-08T08:22:59.274501+0000","last_unstale":"2023-12-08T08:23:01.983222+0000","last_undegraded":"2023-12-08T08:23:01.983222+0000","last_fullsized":"2023-12-08T08:23:01.983222+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:54.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092935+0000","last_change":"2023-12-08T08:23:00.298811+0000","last_active":"2023-12-08T08:23:02.092935+0000","last_peered":"2023-12-08T08:23:02.092935+0000","last_clean":"2023-12-08T08:23:02.092935+0000","last_became_active":"2023-12-08T08:23:00.298524+0000","last_became_peered":"2023-12-08T08:23:00.298524+0000","last_unstale":"2023-12-08T08:23:02.092935+0000","last_undegraded":"2023-12-08T08:23:02.092935+0000","last_fullsized":"2023-12-08T08:23:02.092935+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093491+0000","last_change":"2023-12-08T08:22:59.274339+0000","last_active":"2023-12-08T08:23:02.093491+0000","last_peered":"2023-12-08T08:23:02.093491+0000","last_clean":"2023-12-08T08:23:02.093491+0000","last_became_active":"2023-12-08T08:22:59.272932+0000","last_became_peered":"2023-12-08T08:22:59.272932+0000","last_unstale":"2023-12-08T08:23:02.093491+0000","last_undegraded":"2023-12-08T08:23:02.093491+0000","last_fullsized":"2023-12-08T08:23:02.093491+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:14.464401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092664+0000","last_change":"2023-12-08T08:23:00.292745+0000","last_active":"2023-12-08T08:23:02.092664+0000","last_peered":"2023-12-08T08:23:02.092664+0000","last_clean":"2023-12-08T08:23:02.092664+0000","last_became_active":"2023-12-08T08:23:00.292132+0000","last_became_peered":"2023-12-08T08:23:00.292132+0000","last_unstale":"2023-12-08T08:23:02.092664+0000","last_undegraded":"2023-12-08T08:23:02.092664+0000","last_fullsized":"2023-12-08T08:23:02.092664+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:13.139346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092554+0000","last_change":"2023-12-08T08:22:59.268769+0000","last_active":"2023-12-08T08:23:02.092554+0000","last_peered":"2023-12-08T08:23:02.092554+0000","last_clean":"2023-12-08T08:23:02.092554+0000","last_became_active":"2023-12-08T08:22:59.268494+0000","last_became_peered":"2023-12-08T08:22:59.268494+0000","last_unstale":"2023-12-08T08:23:02.092554+0000","last_undegraded":"2023-12-08T08:23:02.092554+0000","last_fullsized":"2023-12-08T08:23:02.092554+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:56:23.131251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093698+0000","last_change":"2023-12-08T08:23:00.275783+0000","last_active":"2023-12-08T08:23:02.093698+0000","last_peered":"2023-12-08T08:23:02.093698+0000","last_clean":"2023-12-08T08:23:02.093698+0000","last_became_active":"2023-12-08T08:23:00.275444+0000","last_became_peered":"2023-12-08T08:23:00.275444+0000","last_unstale":"2023-12-08T08:23:02.093698+0000","last_undegraded":"2023-12-08T08:23:02.093698+0000","last_fullsized":"2023-12-08T08:23:02.093698+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:56:00.436152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277518+0000","last_change":"2023-12-08T08:22:59.280443+0000","last_active":"2023-12-08T08:23:01.277518+0000","last_peered":"2023-12-08T08:23:01.277518+0000","last_clean":"2023-12-08T08:23:01.277518+0000","last_became_active":"2023-12-08T08:22:59.280138+0000","last_became_peered":"2023-12-08T08:22:59.280138+0000","last_unstale":"2023-12-08T08:23:01.277518+0000","last_undegraded":"2023-12-08T08:23:01.277518+0000","last_fullsized":"2023-12-08T08:23:01.277518+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:13:21.524504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093806+0000","last_change":"2023-12-08T08:23:00.304825+0000","last_active":"2023-12-08T08:23:02.093806+0000","last_peered":"2023-12-08T08:23:02.093806+0000","last_clean":"2023-12-08T08:23:02.093806+0000","last_became_active":"2023-12-08T08:23:00.304549+0000","last_became_peered":"2023-12-08T08:23:00.304549+0000","last_unstale":"2023-12-08T08:23:02.093806+0000","last_undegraded":"2023-12-08T08:23:02.093806+0000","last_fullsized":"2023-12-08T08:23:02.093806+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277432+0000","last_change":"2023-12-08T08:22:59.283795+0000","last_active":"2023-12-08T08:23:01.277432+0000","last_peered":"2023-12-08T08:23:01.277432+0000","last_clean":"2023-12-08T08:23:01.277432+0000","last_became_active":"2023-12-08T08:22:59.283486+0000","last_became_peered":"2023-12-08T08:22:59.283486+0000","last_unstale":"2023-12-08T08:23:01.277432+0000","last_undegraded":"2023-12-08T08:23:01.277432+0000","last_fullsized":"2023-12-08T08:23:01.277432+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:30:43.384001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093094+0000","last_change":"2023-12-08T08:23:00.293145+0000","last_active":"2023-12-08T08:23:02.093094+0000","last_peered":"2023-12-08T08:23:02.093094+0000","last_clean":"2023-12-08T08:23:02.093094+0000","last_became_active":"2023-12-08T08:23:00.292927+0000","last_became_peered":"2023-12-08T08:23:00.292927+0000","last_unstale":"2023-12-08T08:23:02.093094+0000","last_undegraded":"2023-12-08T08:23:02.093094+0000","last_fullsized":"2023-12-08T08:23:02.093094+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:56.216551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"67'3","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277143+0000","last_change":"2023-12-08T08:22:59.281141+0000","last_active":"2023-12-08T08:23:01.277143+0000","last_peered":"2023-12-08T08:23:01.277143+0000","last_clean":"2023-12-08T08:23:01.277143+0000","last_became_active":"2023-12-08T08:22:59.280748+0000","last_became_peered":"2023-12-08T08:22:59.280748+0000","last_unstale":"2023-12-08T08:23:01.277143+0000","last_undegraded":"2023-12-08T08:23:01.277143+0000","last_fullsized":"2023-12-08T08:23:01.277143+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:07:33.922762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983595+0000","last_change":"2023-12-08T08:23:00.299179+0000","last_active":"2023-12-08T08:23:01.983595+0000","last_peered":"2023-12-08T08:23:01.983595+0000","last_clean":"2023-12-08T08:23:01.983595+0000","last_became_active":"2023-12-08T08:23:00.298936+0000","last_became_peered":"2023-12-08T08:23:00.298936+0000","last_unstale":"2023-12-08T08:23:01.983595+0000","last_undegraded":"2023-12-08T08:23:01.983595+0000","last_fullsized":"2023-12-08T08:23:01.983595+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"67'6","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093460+0000","last_change":"2023-12-08T08:22:59.278612+0000","last_active":"2023-12-08T08:23:02.093460+0000","last_peered":"2023-12-08T08:23:02.093460+0000","last_clean":"2023-12-08T08:23:02.093460+0000","last_became_active":"2023-12-08T08:22:59.278325+0000","last_became_peered":"2023-12-08T08:22:59.278325+0000","last_unstale":"2023-12-08T08:23:02.093460+0000","last_undegraded":"2023-12-08T08:23:02.093460+0000","last_fullsized":"2023-12-08T08:23:02.093460+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:55:35.382801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092905+0000","last_change":"2023-12-08T08:23:00.292867+0000","last_active":"2023-12-08T08:23:02.092905+0000","last_peered":"2023-12-08T08:23:02.092905+0000","last_clean":"2023-12-08T08:23:02.092905+0000","last_became_active":"2023-12-08T08:23:00.292648+0000","last_became_peered":"2023-12-08T08:23:00.292648+0000","last_unstale":"2023-12-08T08:23:02.092905+0000","last_undegraded":"2023-12-08T08:23:02.092905+0000","last_fullsized":"2023-12-08T08:23:02.092905+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:29:03.020360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093400+0000","last_change":"2023-12-08T08:22:59.262821+0000","last_active":"2023-12-08T08:23:02.093400+0000","last_peered":"2023-12-08T08:23:02.093400+0000","last_clean":"2023-12-08T08:23:02.093400+0000","last_became_active":"2023-12-08T08:22:59.262569+0000","last_became_peered":"2023-12-08T08:22:59.262569+0000","last_unstale":"2023-12-08T08:23:02.093400+0000","last_undegraded":"2023-12-08T08:23:02.093400+0000","last_fullsized":"2023-12-08T08:23:02.093400+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:52:55.751217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093233+0000","last_change":"2023-12-08T08:23:00.298706+0000","last_active":"2023-12-08T08:23:02.093233+0000","last_peered":"2023-12-08T08:23:02.093233+0000","last_clean":"2023-12-08T08:23:02.093233+0000","last_became_active":"2023-12-08T08:23:00.298452+0000","last_became_peered":"2023-12-08T08:23:00.298452+0000","last_unstale":"2023-12-08T08:23:02.093233+0000","last_undegraded":"2023-12-08T08:23:02.093233+0000","last_fullsized":"2023-12-08T08:23:02.093233+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:39.385907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093064+0000","last_change":"2023-12-08T08:22:59.270322+0000","last_active":"2023-12-08T08:23:02.093064+0000","last_peered":"2023-12-08T08:23:02.093064+0000","last_clean":"2023-12-08T08:23:02.093064+0000","last_became_active":"2023-12-08T08:22:59.270059+0000","last_became_peered":"2023-12-08T08:22:59.270059+0000","last_unstale":"2023-12-08T08:23:02.093064+0000","last_undegraded":"2023-12-08T08:23:02.093064+0000","last_fullsized":"2023-12-08T08:23:02.093064+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:21:58.531919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093504+0000","last_change":"2023-12-08T08:23:00.304324+0000","last_active":"2023-12-08T08:23:02.093504+0000","last_peered":"2023-12-08T08:23:02.093504+0000","last_clean":"2023-12-08T08:23:02.093504+0000","last_became_active":"2023-12-08T08:23:00.304038+0000","last_became_peered":"2023-12-08T08:23:00.304038+0000","last_unstale":"2023-12-08T08:23:02.093504+0000","last_undegraded":"2023-12-08T08:23:02.093504+0000","last_fullsized":"2023-12-08T08:23:02.093504+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:33:27.464394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093348+0000","last_change":"2023-12-08T08:22:59.270216+0000","last_active":"2023-12-08T08:23:02.093348+0000","last_peered":"2023-12-08T08:23:02.093348+0000","last_clean":"2023-12-08T08:23:02.093348+0000","last_became_active":"2023-12-08T08:22:59.269292+0000","last_became_peered":"2023-12-08T08:22:59.269292+0000","last_unstale":"2023-12-08T08:23:02.093348+0000","last_undegraded":"2023-12-08T08:23:02.093348+0000","last_fullsized":"2023-12-08T08:23:02.093348+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:18:01.309002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092503+0000","last_change":"2023-12-08T08:23:00.276305+0000","last_active":"2023-12-08T08:23:02.092503+0000","last_peered":"2023-12-08T08:23:02.092503+0000","last_clean":"2023-12-08T08:23:02.092503+0000","last_became_active":"2023-12-08T08:23:00.275989+0000","last_became_peered":"2023-12-08T08:23:00.275989+0000","last_unstale":"2023-12-08T08:23:02.092503+0000","last_undegraded":"2023-12-08T08:23:02.092503+0000","last_fullsized":"2023-12-08T08:23:02.092503+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:24:33.735501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"67'8","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092786+0000","last_change":"2023-12-08T08:22:59.271542+0000","last_active":"2023-12-08T08:23:02.092786+0000","last_peered":"2023-12-08T08:23:02.092786+0000","last_clean":"2023-12-08T08:23:02.092786+0000","last_became_active":"2023-12-08T08:22:59.271240+0000","last_became_peered":"2023-12-08T08:22:59.271240+0000","last_unstale":"2023-12-08T08:23:02.092786+0000","last_undegraded":"2023-12-08T08:23:02.092786+0000","last_fullsized":"2023-12-08T08:23:02.092786+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:32.897955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093623+0000","last_change":"2023-12-08T08:23:00.280374+0000","last_active":"2023-12-08T08:23:02.093623+0000","last_peered":"2023-12-08T08:23:02.093623+0000","last_clean":"2023-12-08T08:23:02.093623+0000","last_became_active":"2023-12-08T08:23:00.280096+0000","last_became_peered":"2023-12-08T08:23:00.280096+0000","last_unstale":"2023-12-08T08:23:02.093623+0000","last_undegraded":"2023-12-08T08:23:02.093623+0000","last_fullsized":"2023-12-08T08:23:02.093623+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:21:59.539539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277612+0000","last_change":"2023-12-08T08:22:59.283727+0000","last_active":"2023-12-08T08:23:01.277612+0000","last_peered":"2023-12-08T08:23:01.277612+0000","last_clean":"2023-12-08T08:23:01.277612+0000","last_became_active":"2023-12-08T08:22:59.283254+0000","last_became_peered":"2023-12-08T08:22:59.283254+0000","last_unstale":"2023-12-08T08:23:01.277612+0000","last_undegraded":"2023-12-08T08:23:01.277612+0000","last_fullsized":"2023-12-08T08:23:01.277612+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:18:01.309002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277572+0000","last_change":"2023-12-08T08:23:00.282901+0000","last_active":"2023-12-08T08:23:01.277572+0000","last_peered":"2023-12-08T08:23:01.277572+0000","last_clean":"2023-12-08T08:23:01.277572+0000","last_became_active":"2023-12-08T08:23:00.282646+0000","last_became_peered":"2023-12-08T08:23:00.282646+0000","last_unstale":"2023-12-08T08:23:01.277572+0000","last_undegraded":"2023-12-08T08:23:01.277572+0000","last_fullsized":"2023-12-08T08:23:01.277572+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092773+0000","last_change":"2023-12-08T08:22:59.265669+0000","last_active":"2023-12-08T08:23:02.092773+0000","last_peered":"2023-12-08T08:23:02.092773+0000","last_clean":"2023-12-08T08:23:02.092773+0000","last_became_active":"2023-12-08T08:22:59.265364+0000","last_became_peered":"2023-12-08T08:22:59.265364+0000","last_unstale":"2023-12-08T08:23:02.092773+0000","last_undegraded":"2023-12-08T08:23:02.092773+0000","last_fullsized":"2023-12-08T08:23:02.092773+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:27:38.296266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983692+0000","last_change":"2023-12-08T08:23:00.270198+0000","last_active":"2023-12-08T08:23:01.983692+0000","last_peered":"2023-12-08T08:23:01.983692+0000","last_clean":"2023-12-08T08:23:01.983692+0000","last_became_active":"2023-12-08T08:23:00.269930+0000","last_became_peered":"2023-12-08T08:23:00.269930+0000","last_unstale":"2023-12-08T08:23:01.983692+0000","last_undegraded":"2023-12-08T08:23:01.983692+0000","last_fullsized":"2023-12-08T08:23:01.983692+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093281+0000","last_change":"2023-12-08T08:22:59.273655+0000","last_active":"2023-12-08T08:23:02.093281+0000","last_peered":"2023-12-08T08:23:02.093281+0000","last_clean":"2023-12-08T08:23:02.093281+0000","last_became_active":"2023-12-08T08:22:59.273396+0000","last_became_peered":"2023-12-08T08:22:59.273396+0000","last_unstale":"2023-12-08T08:23:02.093281+0000","last_undegraded":"2023-12-08T08:23:02.093281+0000","last_fullsized":"2023-12-08T08:23:02.093281+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.886510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277418+0000","last_change":"2023-12-08T08:23:00.285854+0000","last_active":"2023-12-08T08:23:01.277418+0000","last_peered":"2023-12-08T08:23:01.277418+0000","last_clean":"2023-12-08T08:23:01.277418+0000","last_became_active":"2023-12-08T08:23:00.285553+0000","last_became_peered":"2023-12-08T08:23:00.285553+0000","last_unstale":"2023-12-08T08:23:01.277418+0000","last_undegraded":"2023-12-08T08:23:01.277418+0000","last_fullsized":"2023-12-08T08:23:01.277418+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:15:44.184576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093292+0000","last_change":"2023-12-08T08:22:59.282745+0000","last_active":"2023-12-08T08:23:02.093292+0000","last_peered":"2023-12-08T08:23:02.093292+0000","last_clean":"2023-12-08T08:23:02.093292+0000","last_became_active":"2023-12-08T08:22:59.282443+0000","last_became_peered":"2023-12-08T08:22:59.282443+0000","last_unstale":"2023-12-08T08:23:02.093292+0000","last_undegraded":"2023-12-08T08:23:02.093292+0000","last_fullsized":"2023-12-08T08:23:02.093292+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:21.899236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093125+0000","last_change":"2023-12-08T08:23:00.286165+0000","last_active":"2023-12-08T08:23:02.093125+0000","last_peered":"2023-12-08T08:23:02.093125+0000","last_clean":"2023-12-08T08:23:02.093125+0000","last_became_active":"2023-12-08T08:23:00.285209+0000","last_became_peered":"2023-12-08T08:23:00.285209+0000","last_unstale":"2023-12-08T08:23:02.093125+0000","last_undegraded":"2023-12-08T08:23:02.093125+0000","last_fullsized":"2023-12-08T08:23:02.093125+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:16.068318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277643+0000","last_change":"2023-12-08T08:22:59.272934+0000","last_active":"2023-12-08T08:23:01.277643+0000","last_peered":"2023-12-08T08:23:01.277643+0000","last_clean":"2023-12-08T08:23:01.277643+0000","last_became_active":"2023-12-08T08:22:59.272094+0000","last_became_peered":"2023-12-08T08:22:59.272094+0000","last_unstale":"2023-12-08T08:23:01.277643+0000","last_undegraded":"2023-12-08T08:23:01.277643+0000","last_fullsized":"2023-12-08T08:23:01.277643+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:33:18.775139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277017+0000","last_change":"2023-12-08T08:23:00.287292+0000","last_active":"2023-12-08T08:23:01.277017+0000","last_peered":"2023-12-08T08:23:01.277017+0000","last_clean":"2023-12-08T08:23:01.277017+0000","last_became_active":"2023-12-08T08:23:00.284565+0000","last_became_peered":"2023-12-08T08:23:00.284565+0000","last_unstale":"2023-12-08T08:23:01.277017+0000","last_undegraded":"2023-12-08T08:23:01.277017+0000","last_fullsized":"2023-12-08T08:23:01.277017+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:17:25.641139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277017+0000","last_change":"2023-12-08T08:22:59.279857+0000","last_active":"2023-12-08T08:23:01.277017+0000","last_peered":"2023-12-08T08:23:01.277017+0000","last_clean":"2023-12-08T08:23:01.277017+0000","last_became_active":"2023-12-08T08:22:59.279508+0000","last_became_peered":"2023-12-08T08:22:59.279508+0000","last_unstale":"2023-12-08T08:23:01.277017+0000","last_undegraded":"2023-12-08T08:23:01.277017+0000","last_fullsized":"2023-12-08T08:23:01.277017+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:23.192834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093241+0000","last_change":"2023-12-08T08:23:00.291227+0000","last_active":"2023-12-08T08:23:02.093241+0000","last_peered":"2023-12-08T08:23:02.093241+0000","last_clean":"2023-12-08T08:23:02.093241+0000","last_became_active":"2023-12-08T08:23:00.290984+0000","last_became_peered":"2023-12-08T08:23:00.290984+0000","last_unstale":"2023-12-08T08:23:02.093241+0000","last_undegraded":"2023-12-08T08:23:02.093241+0000","last_fullsized":"2023-12-08T08:23:02.093241+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:33.905575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092294+0000","last_change":"2023-12-08T08:22:59.282842+0000","last_active":"2023-12-08T08:23:02.092294+0000","last_peered":"2023-12-08T08:23:02.092294+0000","last_clean":"2023-12-08T08:23:02.092294+0000","last_became_active":"2023-12-08T08:22:59.282605+0000","last_became_peered":"2023-12-08T08:22:59.282605+0000","last_unstale":"2023-12-08T08:23:02.092294+0000","last_undegraded":"2023-12-08T08:23:02.092294+0000","last_fullsized":"2023-12-08T08:23:02.092294+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:55.208931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983775+0000","last_change":"2023-12-08T08:23:00.270620+0000","last_active":"2023-12-08T08:23:01.983775+0000","last_peered":"2023-12-08T08:23:01.983775+0000","last_clean":"2023-12-08T08:23:01.983775+0000","last_became_active":"2023-12-08T08:23:00.270369+0000","last_became_peered":"2023-12-08T08:23:00.270369+0000","last_unstale":"2023-12-08T08:23:01.983775+0000","last_undegraded":"2023-12-08T08:23:01.983775+0000","last_fullsized":"2023-12-08T08:23:01.983775+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:33.898137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093945+0000","last_change":"2023-12-08T08:22:59.269712+0000","last_active":"2023-12-08T08:23:02.093945+0000","last_peered":"2023-12-08T08:23:02.093945+0000","last_clean":"2023-12-08T08:23:02.093945+0000","last_became_active":"2023-12-08T08:22:59.269426+0000","last_became_peered":"2023-12-08T08:22:59.269426+0000","last_unstale":"2023-12-08T08:23:02.093945+0000","last_undegraded":"2023-12-08T08:23:02.093945+0000","last_fullsized":"2023-12-08T08:23:02.093945+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:49:28.705874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093710+0000","last_change":"2023-12-08T08:23:00.280543+0000","last_active":"2023-12-08T08:23:02.093710+0000","last_peered":"2023-12-08T08:23:02.093710+0000","last_clean":"2023-12-08T08:23:02.093710+0000","last_became_active":"2023-12-08T08:23:00.280152+0000","last_became_peered":"2023-12-08T08:23:00.280152+0000","last_unstale":"2023-12-08T08:23:02.093710+0000","last_undegraded":"2023-12-08T08:23:02.093710+0000","last_fullsized":"2023-12-08T08:23:02.093710+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:37:47.067543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"68'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.810155+0000","last_change":"2023-12-08T08:22:59.263185+0000","last_active":"2023-12-08T08:23:02.810155+0000","last_peered":"2023-12-08T08:23:02.810155+0000","last_clean":"2023-12-08T08:23:02.810155+0000","last_became_active":"2023-12-08T08:22:59.262924+0000","last_became_peered":"2023-12-08T08:22:59.262924+0000","last_unstale":"2023-12-08T08:23:02.810155+0000","last_undegraded":"2023-12-08T08:23:02.810155+0000","last_fullsized":"2023-12-08T08:23:02.810155+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:39:59.028170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277399+0000","last_change":"2023-12-08T08:23:00.304740+0000","last_active":"2023-12-08T08:23:01.277399+0000","last_peered":"2023-12-08T08:23:01.277399+0000","last_clean":"2023-12-08T08:23:01.277399+0000","last_became_active":"2023-12-08T08:23:00.304390+0000","last_became_peered":"2023-12-08T08:23:00.304390+0000","last_unstale":"2023-12-08T08:23:01.277399+0000","last_undegraded":"2023-12-08T08:23:01.277399+0000","last_fullsized":"2023-12-08T08:23:01.277399+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277282+0000","last_change":"2023-12-08T08:22:59.285952+0000","last_active":"2023-12-08T08:23:01.277282+0000","last_peered":"2023-12-08T08:23:01.277282+0000","last_clean":"2023-12-08T08:23:01.277282+0000","last_became_active":"2023-12-08T08:22:59.285309+0000","last_became_peered":"2023-12-08T08:22:59.285309+0000","last_unstale":"2023-12-08T08:23:01.277282+0000","last_undegraded":"2023-12-08T08:23:01.277282+0000","last_fullsized":"2023-12-08T08:23:01.277282+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:19.279362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983788+0000","last_change":"2023-12-08T08:23:00.299161+0000","last_active":"2023-12-08T08:23:01.983788+0000","last_peered":"2023-12-08T08:23:01.983788+0000","last_clean":"2023-12-08T08:23:01.983788+0000","last_became_active":"2023-12-08T08:23:00.298876+0000","last_became_peered":"2023-12-08T08:23:00.298876+0000","last_unstale":"2023-12-08T08:23:01.983788+0000","last_undegraded":"2023-12-08T08:23:01.983788+0000","last_fullsized":"2023-12-08T08:23:01.983788+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:29:03.020360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277470+0000","last_change":"2023-12-08T08:22:59.280536+0000","last_active":"2023-12-08T08:23:01.277470+0000","last_peered":"2023-12-08T08:23:01.277470+0000","last_clean":"2023-12-08T08:23:01.277470+0000","last_became_active":"2023-12-08T08:22:59.280213+0000","last_became_peered":"2023-12-08T08:22:59.280213+0000","last_unstale":"2023-12-08T08:23:01.277470+0000","last_undegraded":"2023-12-08T08:23:01.277470+0000","last_fullsized":"2023-12-08T08:23:01.277470+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:49.883139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093626+0000","last_change":"2023-12-08T08:23:00.285721+0000","last_active":"2023-12-08T08:23:02.093626+0000","last_peered":"2023-12-08T08:23:02.093626+0000","last_clean":"2023-12-08T08:23:02.093626+0000","last_became_active":"2023-12-08T08:23:00.285446+0000","last_became_peered":"2023-12-08T08:23:00.285446+0000","last_unstale":"2023-12-08T08:23:02.093626+0000","last_undegraded":"2023-12-08T08:23:02.093626+0000","last_fullsized":"2023-12-08T08:23:02.093626+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093391+0000","last_change":"2023-12-08T08:22:59.272111+0000","last_active":"2023-12-08T08:23:02.093391+0000","last_peered":"2023-12-08T08:23:02.093391+0000","last_clean":"2023-12-08T08:23:02.093391+0000","last_became_active":"2023-12-08T08:22:59.271849+0000","last_became_peered":"2023-12-08T08:22:59.271849+0000","last_unstale":"2023-12-08T08:23:02.093391+0000","last_undegraded":"2023-12-08T08:23:02.093391+0000","last_fullsized":"2023-12-08T08:23:02.093391+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:15.060698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093317+0000","last_change":"2023-12-08T08:23:00.292346+0000","last_active":"2023-12-08T08:23:02.093317+0000","last_peered":"2023-12-08T08:23:02.093317+0000","last_clean":"2023-12-08T08:23:02.093317+0000","last_became_active":"2023-12-08T08:23:00.292166+0000","last_became_peered":"2023-12-08T08:23:00.292166+0000","last_unstale":"2023-12-08T08:23:02.093317+0000","last_undegraded":"2023-12-08T08:23:02.093317+0000","last_fullsized":"2023-12-08T08:23:02.093317+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:21:59.539539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983368+0000","last_change":"2023-12-08T08:22:59.271088+0000","last_active":"2023-12-08T08:23:01.983368+0000","last_peered":"2023-12-08T08:23:01.983368+0000","last_clean":"2023-12-08T08:23:01.983368+0000","last_became_active":"2023-12-08T08:22:59.270783+0000","last_became_peered":"2023-12-08T08:22:59.270783+0000","last_unstale":"2023-12-08T08:23:01.983368+0000","last_undegraded":"2023-12-08T08:23:01.983368+0000","last_fullsized":"2023-12-08T08:23:01.983368+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:30:43.384001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.092920+0000","last_change":"2023-12-08T08:23:00.283700+0000","last_active":"2023-12-08T08:23:02.092920+0000","last_peered":"2023-12-08T08:23:02.092920+0000","last_clean":"2023-12-08T08:23:02.092920+0000","last_became_active":"2023-12-08T08:23:00.283439+0000","last_became_peered":"2023-12-08T08:23:00.283439+0000","last_unstale":"2023-12-08T08:23:02.092920+0000","last_undegraded":"2023-12-08T08:23:02.092920+0000","last_fullsized":"2023-12-08T08:23:02.092920+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277224+0000","last_change":"2023-12-08T08:22:59.280725+0000","last_active":"2023-12-08T08:23:01.277224+0000","last_peered":"2023-12-08T08:23:01.277224+0000","last_clean":"2023-12-08T08:23:01.277224+0000","last_became_active":"2023-12-08T08:22:59.279736+0000","last_became_peered":"2023-12-08T08:22:59.279736+0000","last_unstale":"2023-12-08T08:23:01.277224+0000","last_undegraded":"2023-12-08T08:23:01.277224+0000","last_fullsized":"2023-12-08T08:23:01.277224+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:54.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.277100+0000","last_change":"2023-12-08T08:23:00.305076+0000","last_active":"2023-12-08T08:23:01.277100+0000","last_peered":"2023-12-08T08:23:01.277100+0000","last_clean":"2023-12-08T08:23:01.277100+0000","last_became_active":"2023-12-08T08:23:00.304435+0000","last_became_peered":"2023-12-08T08:23:00.304435+0000","last_unstale":"2023-12-08T08:23:01.277100+0000","last_undegraded":"2023-12-08T08:23:01.277100+0000","last_fullsized":"2023-12-08T08:23:01.277100+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:42:20.038693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:01.983235+0000","last_change":"2023-12-08T08:22:59.278661+0000","last_active":"2023-12-08T08:23:01.983235+0000","last_peered":"2023-12-08T08:23:01.983235+0000","last_clean":"2023-12-08T08:23:01.983235+0000","last_became_active":"2023-12-08T08:22:59.278383+0000","last_became_peered":"2023-12-08T08:22:59.278383+0000","last_unstale":"2023-12-08T08:23:01.983235+0000","last_undegraded":"2023-12-08T08:23:01.983235+0000","last_fullsized":"2023-12-08T08:23:01.983235+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:35:15.000491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093148+0000","last_change":"2023-12-08T08:23:00.270574+0000","last_active":"2023-12-08T08:23:02.093148+0000","last_peered":"2023-12-08T08:23:02.093148+0000","last_clean":"2023-12-08T08:23:02.093148+0000","last_became_active":"2023-12-08T08:23:00.270304+0000","last_became_peered":"2023-12-08T08:23:00.270304+0000","last_unstale":"2023-12-08T08:23:02.093148+0000","last_undegraded":"2023-12-08T08:23:02.093148+0000","last_fullsized":"2023-12-08T08:23:02.093148+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:15:55.762883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-08T08:23:02.093485+0000","last_change":"2023-12-08T08:22:59.275324+0000","last_active":"2023-12-08T08:23:02.093485+0000","last_peered":"2023-12-08T08:23:02.093485+0000","last_clean":"2023-12-08T08:23:02.093485+0000","last_became_active":"2023-12-08T08:22:59.275038+0000","last_became_peered":"2023-12-08T08:22:59.275038+0000","last_unstale":"2023-12-08T08:23:02.093485+0000","last_undegraded":"2023-12-08T08:23:02.093485+0000","last_fullsized":"2023-12-08T08:23:02.093485+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:09.089659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":205,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-08T08:23:00.270124+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:23:00.270124+0000","last_peered":"2023-12-08T08:23:00.270124+0000","last_clean":"2023-12-08T08:23:00.270124+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:23:00.270124+0000","last_undegraded":"2023-12-08T08:23:00.270124+0000","last_fullsized":"2023-12-08T08:23:00.270124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":905216,"data_stored":954961,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89900000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.85299999999999998,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.623}]},{"osd":1,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85999999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89600000000000002,"5min":1.446,"15min":1.446},"last":0.79600000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.71999999999999997,"15min":0.72899999999999998},"min":{"1min":0.52100000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.871,"5min":1.379,"15min":1.379},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.47599999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.84599999999999997,"5min":1.706,"15min":1.706},"last":0.68600000000000005}]},{"osd":3,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.751,"15min":0.76300000000000001},"min":{"1min":0.54500000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.88700000000000001,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.56699999999999995,"5min":0.496,"15min":0.496},"max":{"1min":0.83099999999999996,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.81899999999999995}]},{"osd":4,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.46899999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.90000000000000002,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.72599999999999998,"15min":0.74199999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83999999999999997,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.89800000000000002}]},{"osd":5,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.77500000000000002,"15min":0.79500000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81399999999999995,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.78500000000000003,"15min":0.80200000000000005},"min":{"1min":0.499,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93300000000000005,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.95199999999999996}]},{"osd":6,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.84799999999999998,"15min":0.86499999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.95899999999999996,"5min":1.573,"15min":1.573},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.80000000000000004,"15min":0.81499999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91100000000000003,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.97099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":847872,"data_stored":365217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66800000000000004,"15min":0.66500000000000004},"min":{"1min":0.41399999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86699999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.58199999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.90700000000000003,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.88700000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.72099999999999997,"15min":0.71799999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.74099999999999999,"15min":0.73599999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.747}]},{"osd":2,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.82999999999999996,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.745,"15min":0.749},"min":{"1min":0.51500000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91300000000000003,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.86499999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.55900000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.85299999999999998,"5min":0.998,"15min":0.998},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75,"15min":0.753},"min":{"1min":0.497,"5min":0.434,"15min":0.434},"max":{"1min":0.878,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.72799999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.71599999999999997,"15min":0.73099999999999998},"min":{"1min":0.46400000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.98799999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.748,"15min":0.76500000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.95199999999999996,"5min":1.014,"15min":1.014},"last":0.65600000000000003}]},{"osd":5,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.78100000000000003,"15min":0.80100000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.006,"5min":1.091,"15min":1.091},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.83299999999999996,"15min":0.84799999999999998},"min":{"1min":0.54800000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1419999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.77700000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.80300000000000005,"15min":0.82199999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.03,"5min":1.04,"15min":1.04},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.877,"15min":0.90300000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0740000000000001,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.76300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":851968,"data_stored":366157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.747,"5min":1.081,"15min":1.081},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.90300000000000002,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.755}]},{"osd":1,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.68999999999999995,"15min":0.68000000000000005},"min":{"1min":0.49399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.002,"5min":1.194,"15min":1.194},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70599999999999996,"15min":0.71499999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.879,"5min":1.143,"15min":1.143},"last":0.79900000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.69799999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.98099999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72899999999999998,"15min":0.73299999999999998},"min":{"1min":0.52400000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.92200000000000004,"5min":1.101,"15min":1.101},"last":0.81999999999999995}]},{"osd":3,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.74099999999999999,"15min":0.746},"min":{"1min":0.47399999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0189999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.76300000000000001,"15min":0.753},"min":{"1min":0.61599999999999999,"5min":0.5,"15min":0.5},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.89300000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82099999999999995,"5min":1.01,"15min":1.01},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94099999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.58899999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77900000000000003,"15min":0.78600000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93999999999999995,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84899999999999998,"5min":1.073,"15min":1.073},"last":0.60899999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:22:12 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78800000000000003,"15min":0.79400000000000004},"min":{"1min":0.51000000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.995,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.85299999999999998,"15min":0.86099999999999999},"min":{"1min":0.54400000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.97699999999999998,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.72699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":835584,"data_stored":364523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69099999999999995,"15min":0.69699999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.95599999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66400000000000003,"15min":0.66200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.81299999999999994}]},{"osd":1,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.45400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.018,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51000000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90100000000000002,"5min":1.002,"15min":1.002},"last":0.74199999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.68500000000000005,"15min":0.69099999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88100000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.72499999999999998,"15min":0.71999999999999997},"min":{"1min":0.55700000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.67500000000000004}]},{"osd":3,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.751,"15min":0.755},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.92200000000000004,"5min":1.359,"15min":1.359},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.77700000000000002,"15min":0.79300000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93700000000000006,"5min":1.232,"15min":1.232},"last":0.77100000000000002}]},{"osd":5,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.66500000000000004,"15min":0.67500000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85599999999999998,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.442},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.77000000000000002,"15min":0.78900000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.995,"5min":1.091,"15min":1.091},"last":0.503}]},{"osd":6,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.70699999999999996,"15min":0.72199999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78400000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78800000000000003,"15min":0.79800000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93400000000000005,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.52500000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.81999999999999995,"15min":0.83199999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.96699999999999997,"5min":1.246,"15min":1.246},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.79200000000000004,"15min":0.80900000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97599999999999998,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.55700000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":847872,"data_stored":366135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.42299999999999999,"15min":0.433},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.46500000000000002,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.45900000000000002,"15min":0.46400000000000002},"min":{"1min":0.33500000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.54900000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.53700000000000003}]},{"osd":1,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.435,"15min":0.436},"min":{"1min":0.308,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.49299999999999999,"15min":0.497},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.42799999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.51600000000000001,"15min":0.52400000000000002},"min":{"1min":0.39600000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.64000000000000001,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.53600000000000003,"15min":0.54300000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.77100000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.48099999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.56599999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94099999999999995,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.747,"15min":0.76100000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0349999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.77100000000000002}]},{"osd":5,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.72799999999999998,"15min":0.73799999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.87,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.75800000000000001,"15min":0.77000000000000002},"min":{"1min":0.53000000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91600000000000004,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.79100000000000004}]},{"osd":6,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.79300000000000004,"15min":0.80700000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.026,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.752},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.79000000000000004,"15min":0.80200000000000005},"min":{"1min":0.58699999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.89400000000000002,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.68600000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:22:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.755},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90400000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.77200000000000002,"15min":0.78300000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.86799999999999999,"5min":1.121,"15min":1.121},"last":0.84199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":839680,"data_stored":365105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.39400000000000002,"15min":0.40200000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52500000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.52200000000000002,"15min":0.54000000000000004},"min":{"1min":0.32300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.63300000000000001,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.38100000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.47099999999999997,"15min":0.47399999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.67900000000000005,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.45800000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.56899999999999995,"15min":0.58599999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70399999999999996,"5min":3.008,"15min":3.008},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48499999999999999,"15min":0.48699999999999999},"min":{"1min":0.39200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.59499999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.42199999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.80300000000000005,"15min":0.82299999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92500000000000004,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.747},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.75800000000000001,"15min":0.76500000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93000000000000005,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.69199999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76500000000000001,"15min":0.77100000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.05,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.81299999999999994,"15min":0.83699999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0129999999999999,"5min":3.637,"15min":3.637},"last":0.81899999999999995}]},{"osd":6,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.78500000000000003,"15min":0.79600000000000004},"min":{"1min":0.55800000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.96899999999999997,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.78500000000000003,"15min":0.79700000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.002,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.879}]},{"osd":7,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.876,"15min":0.90900000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.83999999999999997,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.83199999999999996,"15min":0.84099999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.997,"5min":1.766,"15min":1.766},"last":0.86199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":847872,"data_stored":364717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.65000000000000002,"15min":0.69299999999999995},"min":{"1min":0.29699999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.69899999999999995,"5min":5.2210000000000001,"15min":5.2210000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.83099999999999996,"15min":0.89100000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69499999999999995,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.46000000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.80600000000000005,"15min":0.87},"min":{"1min":0.309,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.52900000000000003,"5min":8.2070000000000007,"15min":8.2070000000000007},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.68200000000000005,"15min":0.71999999999999997},"min":{"1min":0.34200000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.70899999999999996,"5min":4.351,"15min":4.351},"last":0.56999999999999995}]},{"osd":3,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.91000000000000003,"15min":0.97599999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.74199999999999999,"5min":8.1479999999999997,"15min":8.1479999999999997},"last":0.62},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.746,"15min":0.79300000000000004},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63900000000000001,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.58799999999999997}]},{"osd":4,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.98399999999999999,"15min":1.036},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.95499999999999996,"5min":4.8470000000000004,"15min":4.8470000000000004},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":1.0549999999999999,"15min":1.1080000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.97599999999999998,"5min":4.7939999999999996,"15min":4.7939999999999996},"last":0.81000000000000005}]},{"osd":5,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.97099999999999997,"15min":1.0089999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0329999999999999,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.96399999999999997,"15min":1.0009999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92900000000000005,"5min":4.5830000000000002,"15min":4.5830000000000002},"last":0.64600000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":1.0700000000000001,"15min":1.127},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.95599999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.749},{"interface":"front","average":{"1min":0.74099999999999999,"5min":1.0489999999999999,"15min":1.101},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0149999999999999,"5min":4.6289999999999996,"15min":4.6289999999999996},"last":0.75700000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.98199999999999998,"15min":1.024},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0169999999999999,"5min":4.665,"15min":4.665},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":1.0620000000000001,"15min":1.1120000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0720000000000001,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.78500000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":905216,"data_stored":954925,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.48499999999999999,"15min":0.501},"min":{"1min":0.27300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61599999999999999,"5min":1.863,"15min":1.863},"last":0.629},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.85499999999999998,"15min":0.91900000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.63200000000000001,"5min":8.2799999999999994,"15min":8.2799999999999994},"last":0.70799999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.89400000000000002,"15min":0.96999999999999997},"min":{"1min":0.314,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71299999999999997,"5min":7.9290000000000003,"15min":7.9290000000000003},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.89800000000000002,"15min":0.97599999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.57299999999999995,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.61099999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.65200000000000002,"15min":0.68999999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.73199999999999998,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.84199999999999997,"15min":0.90000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.745,"5min":7.8890000000000002,"15min":7.8890000000000002},"last":0.82399999999999995}]},{"osd":4,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":1.0309999999999999,"15min":1.0800000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77400000000000002,"15min":0.78500000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.101,"5min":1.607,"15min":1.607},"last":0.80700000000000005}]},{"osd":5,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.83199999999999996,"15min":0.83799999999999997},"min":{"1min":0.53000000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.133,"5min":1.514,"15min":1.514},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":1.0800000000000001,"15min":1.1399999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98899999999999999,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.91000000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.81699999999999995,"15min":0.83499999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.042,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":1.032,"15min":1.081},"min":{"1min":0.55700000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0800000000000001,"5min":7.835,"15min":7.835},"last":0.89700000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":1.0580000000000001,"15min":1.1080000000000001},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1719999999999999,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.877},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.84299999999999997,"15min":0.86499999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1539999999999999,"5min":1.794,"15min":1.794},"last":0.86299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:23:09.195 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-08T08:23:09.195 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-08T08:23:09.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.374+0000 7f4880b2a640 1 Processor -- start 2023-12-08T08:23:09.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.374+0000 7f4880b2a640 1 -- start start 2023-12-08T08:23:09.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.374+0000 7f4880b2a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f487c14fc30 0x7f487c0c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:09.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.374+0000 7f4880b2a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f487c06d840 0x7f487c0c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:09.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.374+0000 7f4880b2a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f487c152910 con 0x7f487c14f850 2023-12-08T08:23:09.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.374+0000 7f4880b2a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487c0c2240 con 0x7f487c14fc30 2023-12-08T08:23:09.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.374+0000 7f4880b2a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487c152bf0 con 0x7f487c06d840 2023-12-08T08:23:09.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.378+0000 7f4879d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f487c14fc30 0x7f487c0c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:09.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.378+0000 7f487a59c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f487c14f850 0x7f487c0aacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41256/0 (socket says 172.21.15.88:41256) 2023-12-08T08:23:09.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.378+0000 7f4879d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f487c14fc30 0x7f487c0c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50058/0 (socket says 172.21.15.88:50058) 2023-12-08T08:23:09.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.378+0000 7f487a59c640 1 -- 172.21.15.88:0/1108612063 learned_addr learned my addr 172.21.15.88:0/1108612063 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:09.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.378+0000 7f487ad9d640 1 --2- 172.21.15.88:0/1108612063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f487c06d840 0x7f487c0c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:09.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.378+0000 7f4879d9b640 1 -- 172.21.15.88:0/1108612063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f487c06d840 msgr2=0x7f487c0c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:09.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.378+0000 7f4879d9b640 1 --2- 172.21.15.88:0/1108612063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f487c06d840 0x7f487c0c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.378+0000 7f4879d9b640 1 -- 172.21.15.88:0/1108612063 >> v1:172.21.15.88:6789/0 conn(0x7f487c14f850 legacy=0x7f487c0aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:09.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.378+0000 7f4879d9b640 1 -- 172.21.15.88:0/1108612063 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c152ed0 con 0x7f487c14fc30 2023-12-08T08:23:09.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.378+0000 7f487ad9d640 1 --2- 172.21.15.88:0/1108612063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f487c06d840 0x7f487c0c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:09.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.378+0000 7f4879d9b640 1 --2- 172.21.15.88:0/1108612063 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f487c14fc30 0x7f487c0c3cd0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f48700097c0 tx=0x7f487001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c4aa88961e87a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:09.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.378+0000 7f487959a640 1 -- 172.21.15.88:0/1108612063 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48700ac410 con 0x7f487c14fc30 2023-12-08T08:23:09.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.378+0000 7f487959a640 1 -- 172.21.15.88:0/1108612063 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48700ac570 con 0x7f487c14fc30 2023-12-08T08:23:09.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.378+0000 7f487959a640 1 -- 172.21.15.88:0/1108612063 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48700ac900 con 0x7f487c14fc30 2023-12-08T08:23:09.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f4880b2a640 1 -- 172.21.15.88:0/1108612063 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f487c14fc30 msgr2=0x7f487c0c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:09.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f4880b2a640 1 --2- 172.21.15.88:0/1108612063 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f487c14fc30 0x7f487c0c3cd0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f48700097c0 tx=0x7f487001c480 comp rx=0 tx=0).stop 2023-12-08T08:23:09.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f4880b2a640 1 -- 172.21.15.88:0/1108612063 shutdown_connections 2023-12-08T08:23:09.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f4880b2a640 1 --2- 172.21.15.88:0/1108612063 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f487c06d840 0x7f487c0c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f4880b2a640 1 --2- 172.21.15.88:0/1108612063 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f487c14fc30 0x7f487c0c3cd0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f4880b2a640 1 -- 172.21.15.88:0/1108612063 >> 172.21.15.88:0/1108612063 conn(0x7f487c0c59f0 msgr2=0x7f487c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:09.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f4880b2a640 1 -- 172.21.15.88:0/1108612063 shutdown_connections 2023-12-08T08:23:09.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f4880b2a640 1 -- 172.21.15.88:0/1108612063 wait complete. 2023-12-08T08:23:09.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f4880b2a640 1 Processor -- start 2023-12-08T08:23:09.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f4880b2a640 1 -- start start 2023-12-08T08:23:09.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f4880b2a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f487c06d840 0x7f487c1f10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:09.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f4880b2a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f487c14f850 0x7f487c14c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:09.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f4880b2a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f487c14fc30 0x7f487c14ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:09.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f4880b2a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c14aa00 con 0x7f487c14fc30 2023-12-08T08:23:09.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f4880b2a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c14ac50 con 0x7f487c14f850 2023-12-08T08:23:09.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f4880b2a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487c1f1b50 con 0x7f487c06d840 2023-12-08T08:23:09.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f487ad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f487c14fc30 0x7f487c14ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:09.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f487ad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f487c14fc30 0x7f487c14ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50074/0 (socket says 172.21.15.88:50074) 2023-12-08T08:23:09.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f487ad9d640 1 -- 172.21.15.88:0/2082441258 learned_addr learned my addr 172.21.15.88:0/2082441258 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:09.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f487a59c640 1 --2- 172.21.15.88:0/2082441258 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f487c06d840 0x7f487c1f10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:09.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f4879d9b640 1 --2- 172.21.15.88:0/2082441258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f487c14f850 0x7f487c14c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:09.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f487ad9d640 1 -- 172.21.15.88:0/2082441258 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f487c06d840 msgr2=0x7f487c1f10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:09.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f487ad9d640 1 --2- 172.21.15.88:0/2082441258 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f487c06d840 0x7f487c1f10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f487ad9d640 1 -- 172.21.15.88:0/2082441258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f487c14f850 msgr2=0x7f487c14c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:09.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f487ad9d640 1 --2- 172.21.15.88:0/2082441258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f487c14f850 0x7f487c14c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f487ad9d640 1 -- 172.21.15.88:0/2082441258 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4870009420 con 0x7f487c14fc30 2023-12-08T08:23:09.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f4879d9b640 1 --2- 172.21.15.88:0/2082441258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f487c14f850 0x7f487c14c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:09.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.382+0000 7f487a59c640 1 --2- 172.21.15.88:0/2082441258 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f487c06d840 0x7f487c1f10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:09.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.386+0000 7f487ad9d640 1 --2- 172.21.15.88:0/2082441258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f487c14fc30 0x7f487c14ca00 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f4874007ef0 tx=0x7f487400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:09.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.386+0000 7f486affd640 1 -- 172.21.15.88:0/2082441258 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4874003ba0 con 0x7f487c14fc30 2023-12-08T08:23:09.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.386+0000 7f486affd640 1 -- 172.21.15.88:0/2082441258 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487400f040 con 0x7f487c14fc30 2023-12-08T08:23:09.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.386+0000 7f4880b2a640 1 -- 172.21.15.88:0/2082441258 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f487c14dcf0 con 0x7f487c14fc30 2023-12-08T08:23:09.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.386+0000 7f486affd640 1 -- 172.21.15.88:0/2082441258 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487400de80 con 0x7f487c14fc30 2023-12-08T08:23:09.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.386+0000 7f4880b2a640 1 -- 172.21.15.88:0/2082441258 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487c14b120 con 0x7f487c14fc30 2023-12-08T08:23:09.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.386+0000 7f4880b2a640 1 -- 172.21.15.88:0/2082441258 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f487c067630 con 0x7f487c14fc30 2023-12-08T08:23:09.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.386+0000 7f486affd640 1 -- 172.21.15.88:0/2082441258 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4874004030 con 0x7f487c14fc30 2023-12-08T08:23:09.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.386+0000 7f486affd640 1 --2- 172.21.15.88:0/2082441258 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f485c066470 0x7f485c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:09.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.386+0000 7f486affd640 1 -- 172.21.15.88:0/2082441258 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4874084060 con 0x7f487c14fc30 2023-12-08T08:23:09.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.386+0000 7f487a59c640 1 --2- 172.21.15.88:0/2082441258 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f485c066470 0x7f485c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:09.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.390+0000 7f487a59c640 1 --2- 172.21.15.88:0/2082441258 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f485c066470 0x7f485c068930 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f486c000f70 tx=0x7f486c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:09.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.390+0000 7f486affd640 1 -- 172.21.15.88:0/2082441258 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4874051620 con 0x7f487c14fc30 2023-12-08T08:23:09.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.590+0000 7f4880b2a640 1 -- 172.21.15.88:0/2082441258 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f487c0a4a90 con 0x7f487c14fc30 2023-12-08T08:23:09.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.594+0000 7f486affd640 1 -- 172.21.15.88:0/2082441258 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+147 (secure 0 0 0) 0x7f487401a0b0 con 0x7f487c14fc30 2023-12-08T08:23:09.598 INFO:teuthology.orchestra.run.smithi088.stdout:[client.0] 2023-12-08T08:23:09.598 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCJ0XJlCC1UNRAARGaNCoJFAvsCcXsQY6BjFg== 2023-12-08T08:23:09.598 INFO:teuthology.orchestra.run.smithi088.stdout: caps mds = "allow" 2023-12-08T08:23:09.598 INFO:teuthology.orchestra.run.smithi088.stdout: caps mon = "allow r" 2023-12-08T08:23:09.598 INFO:teuthology.orchestra.run.smithi088.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-08T08:23:09.598 INFO:teuthology.orchestra.run.smithi088.stderr:updated caps for client.0 2023-12-08T08:23:09.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.594+0000 7f4880b2a640 1 -- 172.21.15.88:0/2082441258 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f485c066470 msgr2=0x7f485c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:09.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.594+0000 7f4880b2a640 1 --2- 172.21.15.88:0/2082441258 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f485c066470 0x7f485c068930 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f486c000f70 tx=0x7f486c009040 comp rx=0 tx=0).stop 2023-12-08T08:23:09.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.594+0000 7f4880b2a640 1 -- 172.21.15.88:0/2082441258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f487c14fc30 msgr2=0x7f487c14ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:09.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.594+0000 7f4880b2a640 1 --2- 172.21.15.88:0/2082441258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f487c14fc30 0x7f487c14ca00 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f4874007ef0 tx=0x7f487400d4a0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.594+0000 7f4880b2a640 1 -- 172.21.15.88:0/2082441258 shutdown_connections 2023-12-08T08:23:09.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.594+0000 7f4880b2a640 1 --2- 172.21.15.88:0/2082441258 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f485c066470 0x7f485c068930 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.594+0000 7f4880b2a640 1 --2- 172.21.15.88:0/2082441258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f487c14fc30 0x7f487c14ca00 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.594+0000 7f4880b2a640 1 --2- 172.21.15.88:0/2082441258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f487c14f850 0x7f487c14c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.594+0000 7f4880b2a640 1 --2- 172.21.15.88:0/2082441258 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f487c06d840 0x7f487c1f10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.594+0000 7f4880b2a640 1 -- 172.21.15.88:0/2082441258 >> 172.21.15.88:0/2082441258 conn(0x7f487c0c59f0 msgr2=0x7f487c06cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:09.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.594+0000 7f4880b2a640 1 -- 172.21.15.88:0/2082441258 shutdown_connections 2023-12-08T08:23:09.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.594+0000 7f4880b2a640 1 -- 172.21.15.88:0/2082441258 wait complete. 2023-12-08T08:23:09.619 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:23:09.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.750+0000 7ff17ec94640 1 Processor -- start 2023-12-08T08:23:09.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.750+0000 7ff17ec94640 1 -- start start 2023-12-08T08:23:09.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.754+0000 7ff17ec94640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff178071e30 0x7ff1780722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:09.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.754+0000 7ff17ec94640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff178156110 0x7ff178156580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:09.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.754+0000 7ff17ec94640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1780c5710 con 0x7ff17814fd10 2023-12-08T08:23:09.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.754+0000 7ff17ec94640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff17806c5e0 con 0x7ff178156110 2023-12-08T08:23:09.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.754+0000 7ff17ec94640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff178155c80 con 0x7ff178071e30 2023-12-08T08:23:09.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.754+0000 7ff17d231640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff178156110 0x7ff178156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:09.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.754+0000 7ff17d231640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff178156110 0x7ff178156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50080/0 (socket says 172.21.15.88:50080) 2023-12-08T08:23:09.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.754+0000 7ff17d231640 1 -- 172.21.15.88:0/384546399 learned_addr learned my addr 172.21.15.88:0/384546399 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:09.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.754+0000 7ff16ffff640 1 --2- 172.21.15.88:0/384546399 >> v2:172.21.15.148:3300/0 conn(0x7ff178071e30 0x7ff1780722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:09.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.754+0000 7ff17d231640 1 -- 172.21.15.88:0/384546399 >> v2:172.21.15.148:3300/0 conn(0x7ff178071e30 msgr2=0x7ff1780722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:09.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.754+0000 7ff17d231640 1 --2- 172.21.15.88:0/384546399 >> v2:172.21.15.148:3300/0 conn(0x7ff178071e30 0x7ff1780722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.754+0000 7ff17d231640 1 -- 172.21.15.88:0/384546399 >> v1:172.21.15.148:6789/0 conn(0x7ff17814fd10 legacy=0x7ff1780a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:09.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.754+0000 7ff17d231640 1 -- 172.21.15.88:0/384546399 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1780c4e70 con 0x7ff178156110 2023-12-08T08:23:09.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.754+0000 7ff16ffff640 1 --2- 172.21.15.88:0/384546399 >> v2:172.21.15.148:3300/0 conn(0x7ff178071e30 0x7ff1780722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:09.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.758+0000 7ff17d231640 1 --2- 172.21.15.88:0/384546399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff178156110 0x7ff178156580 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff178066e30 tx=0x7ff17001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb42cba4af87ce81 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:09.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.758+0000 7ff16f7fe640 1 -- 172.21.15.88:0/384546399 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1700a5770 con 0x7ff178156110 2023-12-08T08:23:09.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.758+0000 7ff16f7fe640 1 -- 172.21.15.88:0/384546399 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1700a58d0 con 0x7ff178156110 2023-12-08T08:23:09.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.758+0000 7ff16f7fe640 1 -- 172.21.15.88:0/384546399 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1700a5c60 con 0x7ff178156110 2023-12-08T08:23:09.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.758+0000 7ff17ec94640 1 -- 172.21.15.88:0/384546399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff178156110 msgr2=0x7ff178156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:09.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.758+0000 7ff17ec94640 1 --2- 172.21.15.88:0/384546399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff178156110 0x7ff178156580 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff178066e30 tx=0x7ff17001c8b0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.758+0000 7ff17ec94640 1 -- 172.21.15.88:0/384546399 shutdown_connections 2023-12-08T08:23:09.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.758+0000 7ff17ec94640 1 --2- 172.21.15.88:0/384546399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff178156110 0x7ff178156580 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.758+0000 7ff17ec94640 1 --2- 172.21.15.88:0/384546399 >> v2:172.21.15.148:3300/0 conn(0x7ff178071e30 0x7ff1780722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.758+0000 7ff17ec94640 1 -- 172.21.15.88:0/384546399 >> 172.21.15.88:0/384546399 conn(0x7ff1780a7810 msgr2=0x7ff1780a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:09.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.758+0000 7ff17ec94640 1 -- 172.21.15.88:0/384546399 shutdown_connections 2023-12-08T08:23:09.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.758+0000 7ff17ec94640 1 -- 172.21.15.88:0/384546399 wait complete. 2023-12-08T08:23:09.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.758+0000 7ff17ec94640 1 Processor -- start 2023-12-08T08:23:09.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.758+0000 7ff17ec94640 1 -- start start 2023-12-08T08:23:09.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.758+0000 7ff17ec94640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff178071e30 0x7ff17815a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:09.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.762+0000 7ff17ec94640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff17814fd10 0x7ff178159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:09.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.762+0000 7ff17ec94640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff178156110 0x7ff17815b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:09.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.762+0000 7ff17ec94640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1781526c0 con 0x7ff178156110 2023-12-08T08:23:09.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.762+0000 7ff17ec94640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff178156e20 con 0x7ff17814fd10 2023-12-08T08:23:09.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.762+0000 7ff17ec94640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1781573a0 con 0x7ff178071e30 2023-12-08T08:23:09.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.762+0000 7ff17d231640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff178156110 0x7ff17815b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:09.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.762+0000 7ff17d231640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff178156110 0x7ff17815b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50092/0 (socket says 172.21.15.88:50092) 2023-12-08T08:23:09.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.762+0000 7ff17d231640 1 -- 172.21.15.88:0/2585836946 learned_addr learned my addr 172.21.15.88:0/2585836946 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:09.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.762+0000 7ff16ffff640 1 --2- 172.21.15.88:0/2585836946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff17814fd10 0x7ff178159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:09.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.762+0000 7ff17ca30640 1 --2- 172.21.15.88:0/2585836946 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff178071e30 0x7ff17815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:09.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.762+0000 7ff17d231640 1 -- 172.21.15.88:0/2585836946 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff178071e30 msgr2=0x7ff17815a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:09.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.762+0000 7ff17d231640 1 --2- 172.21.15.88:0/2585836946 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff178071e30 0x7ff17815a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.762+0000 7ff17d231640 1 -- 172.21.15.88:0/2585836946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff17814fd10 msgr2=0x7ff178159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:09.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.762+0000 7ff17d231640 1 --2- 172.21.15.88:0/2585836946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff17814fd10 0x7ff178159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.762+0000 7ff17d231640 1 -- 172.21.15.88:0/2585836946 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff170009b30 con 0x7ff178156110 2023-12-08T08:23:09.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.762+0000 7ff17d231640 1 --2- 172.21.15.88:0/2585836946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff178156110 0x7ff17815b1a0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7ff1700af040 tx=0x7ff170019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:09.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.762+0000 7ff16d7fa640 1 -- 172.21.15.88:0/2585836946 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1700b8670 con 0x7ff178156110 2023-12-08T08:23:09.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.762+0000 7ff16d7fa640 1 -- 172.21.15.88:0/2585836946 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1700b87d0 con 0x7ff178156110 2023-12-08T08:23:09.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.762+0000 7ff16d7fa640 1 -- 172.21.15.88:0/2585836946 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1700b8b80 con 0x7ff178156110 2023-12-08T08:23:09.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.762+0000 7ff17ec94640 1 -- 172.21.15.88:0/2585836946 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1781eb5a0 con 0x7ff178156110 2023-12-08T08:23:09.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.762+0000 7ff17ec94640 1 -- 172.21.15.88:0/2585836946 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1781eb190 con 0x7ff178156110 2023-12-08T08:23:09.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.762+0000 7ff17ec94640 1 -- 172.21.15.88:0/2585836946 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1781eb320 con 0x7ff178156110 2023-12-08T08:23:09.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.762+0000 7ff16d7fa640 1 -- 172.21.15.88:0/2585836946 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff1700b8ce0 con 0x7ff178156110 2023-12-08T08:23:09.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.766+0000 7ff16d7fa640 1 --2- 172.21.15.88:0/2585836946 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff164066470 0x7ff164068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:09.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.766+0000 7ff16d7fa640 1 -- 172.21.15.88:0/2585836946 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff17011f200 con 0x7ff178156110 2023-12-08T08:23:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.766+0000 7ff17ca30640 1 --2- 172.21.15.88:0/2585836946 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff164066470 0x7ff164068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.766+0000 7ff17ca30640 1 --2- 172.21.15.88:0/2585836946 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff164066470 0x7ff164068930 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff1780c1400 tx=0x7ff174009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:09.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.770+0000 7ff16d7fa640 1 -- 172.21.15.88:0/2585836946 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff1700ec750 con 0x7ff178156110 2023-12-08T08:23:09.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.950+0000 7ff17ec94640 1 -- 172.21.15.88:0/2585836946 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff178067630 con 0x7ff178156110 2023-12-08T08:23:09.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.950+0000 7ff16d7fa640 1 -- 172.21.15.88:0/2585836946 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4918 (secure 0 0 0) 0x7ff1700efd70 con 0x7ff178156110 2023-12-08T08:23:09.956 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:09.956 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5693,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4194250074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4194250074},{"type":"v1","addr":"172.21.15.148:6833","nonce":4194250074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":5699,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3923000603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3923000603},{"type":"v1","addr":"172.21.15.148:6835","nonce":3923000603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6519,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/1294328415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1294328415},{"type":"v1","addr":"172.21.15.88:6835","nonce":1294328415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:22:59.638045+0000","modified":"2023-12-08T08:23:02.646442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6525":{"gid":6525,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/698349615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":698349615},{"type":"v1","addr":"172.21.15.88:6837","nonce":698349615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-08T08:23:09.957 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 47 2023-12-08T08:23:09.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.954+0000 7ff17ec94640 1 -- 172.21.15.88:0/2585836946 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff164066470 msgr2=0x7ff164068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:09.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.954+0000 7ff17ec94640 1 --2- 172.21.15.88:0/2585836946 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff164066470 0x7ff164068930 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff1780c1400 tx=0x7ff174009040 comp rx=0 tx=0).stop 2023-12-08T08:23:09.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.954+0000 7ff17ec94640 1 -- 172.21.15.88:0/2585836946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff178156110 msgr2=0x7ff17815b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:09.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.954+0000 7ff17ec94640 1 --2- 172.21.15.88:0/2585836946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff178156110 0x7ff17815b1a0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7ff1700af040 tx=0x7ff170019650 comp rx=0 tx=0).stop 2023-12-08T08:23:09.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.954+0000 7ff17ec94640 1 -- 172.21.15.88:0/2585836946 shutdown_connections 2023-12-08T08:23:09.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.954+0000 7ff17ec94640 1 --2- 172.21.15.88:0/2585836946 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff164066470 0x7ff164068930 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.954+0000 7ff17ec94640 1 --2- 172.21.15.88:0/2585836946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff178156110 0x7ff17815b1a0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.954+0000 7ff17ec94640 1 --2- 172.21.15.88:0/2585836946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff17814fd10 0x7ff178159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.954+0000 7ff17ec94640 1 --2- 172.21.15.88:0/2585836946 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff178071e30 0x7ff17815a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:09.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.954+0000 7ff17ec94640 1 -- 172.21.15.88:0/2585836946 >> 172.21.15.88:0/2585836946 conn(0x7ff1780a7810 msgr2=0x7ff17815c210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:09.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.954+0000 7ff17ec94640 1 -- 172.21.15.88:0/2585836946 shutdown_connections 2023-12-08T08:23:09.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:09.954+0000 7ff17ec94640 1 -- 172.21.15.88:0/2585836946 wait complete. 2023-12-08T08:23:10.379 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-08T08:22:59.638045+0000', 'modified': '2023-12-08T08:23:02.646442+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6525}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6525': {'gid': 6525, 'name': 'c', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.88:6837/698349615', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6836', 'nonce': 698349615}, {'type': 'v1', 'addr': '172.21.15.88:6837', 'nonce': 698349615}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-08T08:23:10.379 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-08T08:23:10.380 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-08T08:23:10.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.514+0000 7f7bf67e4640 1 Processor -- start 2023-12-08T08:23:10.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.514+0000 7f7bf67e4640 1 -- start start 2023-12-08T08:23:10.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.514+0000 7f7bf67e4640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7bf0151900 0x7f7bf00c4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:10.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.514+0000 7f7bf67e4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7bf00c7b10 0x7f7bf01542d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:10.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.514+0000 7f7bf67e4640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf00ca0c0 con 0x7f7bf00bd2a0 2023-12-08T08:23:10.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.514+0000 7f7bf67e4640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf00cab10 con 0x7f7bf00c7b10 2023-12-08T08:23:10.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.514+0000 7f7bf67e4640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf00c5310 con 0x7f7bf0151900 2023-12-08T08:23:10.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.514+0000 7f7bf4fe1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7bf00c7b10 0x7f7bf01542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:10.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.514+0000 7f7bf5fe3640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7bf00bd2a0 0x7f7bf0154810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38546/0 (socket says 172.21.15.88:38546) 2023-12-08T08:23:10.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.514+0000 7f7bf5fe3640 1 -- 172.21.15.88:0/2637792184 learned_addr learned my addr 172.21.15.88:0/2637792184 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:10.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.514+0000 7f7bf57e2640 1 --2- 172.21.15.88:0/2637792184 >> v2:172.21.15.148:3300/0 conn(0x7f7bf0151900 0x7f7bf00c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:10.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.514+0000 7f7bf4fe1640 1 -- 172.21.15.88:0/2637792184 >> v2:172.21.15.148:3300/0 conn(0x7f7bf0151900 msgr2=0x7f7bf00c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:10.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.514+0000 7f7bf4fe1640 1 --2- 172.21.15.88:0/2637792184 >> v2:172.21.15.148:3300/0 conn(0x7f7bf0151900 0x7f7bf00c4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.514+0000 7f7bf4fe1640 1 -- 172.21.15.88:0/2637792184 >> v1:172.21.15.88:6789/0 conn(0x7f7bf00bd2a0 legacy=0x7f7bf0154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:10.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.514+0000 7f7bf4fe1640 1 -- 172.21.15.88:0/2637792184 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf0151ce0 con 0x7f7bf00c7b10 2023-12-08T08:23:10.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.514+0000 7f7be7fff640 1 -- 172.21.15.88:0/2637792184 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3322936859 0 0) 0x7f7bf00ca0c0 con 0x7f7bf00bd2a0 2023-12-08T08:23:10.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.518+0000 7f7bf4fe1640 1 --2- 172.21.15.88:0/2637792184 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bf00c7b10 0x7f7bf01542d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f7bf006c390 tx=0x7f7be001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3547c0951e8e58 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:10.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.518+0000 7f7be7fff640 1 -- 172.21.15.88:0/2637792184 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be00ab600 con 0x7f7bf00c7b10 2023-12-08T08:23:10.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.518+0000 7f7be7fff640 1 -- 172.21.15.88:0/2637792184 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be00a7050 con 0x7f7bf00c7b10 2023-12-08T08:23:10.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.518+0000 7f7be7fff640 1 -- 172.21.15.88:0/2637792184 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be00ab980 con 0x7f7bf00c7b10 2023-12-08T08:23:10.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.518+0000 7f7bf67e4640 1 -- 172.21.15.88:0/2637792184 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bf00c7b10 msgr2=0x7f7bf01542d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:10.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.518+0000 7f7bf67e4640 1 --2- 172.21.15.88:0/2637792184 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bf00c7b10 0x7f7bf01542d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f7bf006c390 tx=0x7f7be001c3d0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.518+0000 7f7bf67e4640 1 -- 172.21.15.88:0/2637792184 shutdown_connections 2023-12-08T08:23:10.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.518+0000 7f7bf67e4640 1 --2- 172.21.15.88:0/2637792184 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bf00c7b10 0x7f7bf01542d0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.518+0000 7f7bf67e4640 1 --2- 172.21.15.88:0/2637792184 >> v2:172.21.15.148:3300/0 conn(0x7f7bf0151900 0x7f7bf00c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.518+0000 7f7bf67e4640 1 -- 172.21.15.88:0/2637792184 >> 172.21.15.88:0/2637792184 conn(0x7f7bf0066670 msgr2=0x7f7bf0066a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:10.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.518+0000 7f7bf67e4640 1 -- 172.21.15.88:0/2637792184 shutdown_connections 2023-12-08T08:23:10.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.518+0000 7f7bf67e4640 1 -- 172.21.15.88:0/2637792184 wait complete. 2023-12-08T08:23:10.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.522+0000 7f7bf67e4640 1 Processor -- start 2023-12-08T08:23:10.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.522+0000 7f7bf67e4640 1 -- start start 2023-12-08T08:23:10.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.522+0000 7f7bf67e4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bf00bd2a0 0x7f7bf01ec850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:10.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.522+0000 7f7bf67e4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7bf00c7b10 0x7f7bf0142960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:10.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.522+0000 7f7bf67e4640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7bf0151900 0x7f7bf014f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:10.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.522+0000 7f7bf67e4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf0152630 con 0x7f7bf00bd2a0 2023-12-08T08:23:10.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.522+0000 7f7bf67e4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf00ab3c0 con 0x7f7bf00c7b10 2023-12-08T08:23:10.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.522+0000 7f7bf67e4640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf01ece30 con 0x7f7bf0151900 2023-12-08T08:23:10.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.522+0000 7f7bf57e2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bf00bd2a0 0x7f7bf01ec850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:10.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.522+0000 7f7bf57e2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bf00bd2a0 0x7f7bf01ec850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51680/0 (socket says 172.21.15.88:51680) 2023-12-08T08:23:10.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.522+0000 7f7bf57e2640 1 -- 172.21.15.88:0/1162279229 learned_addr learned my addr 172.21.15.88:0/1162279229 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:10.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.522+0000 7f7bf4fe1640 1 --2- 172.21.15.88:0/1162279229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7bf00c7b10 0x7f7bf0142960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:10.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.522+0000 7f7bf5fe3640 1 --2- 172.21.15.88:0/1162279229 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7bf0151900 0x7f7bf014f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:10.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.522+0000 7f7bf57e2640 1 -- 172.21.15.88:0/1162279229 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7bf0151900 msgr2=0x7f7bf014f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:10.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.522+0000 7f7bf57e2640 1 --2- 172.21.15.88:0/1162279229 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7bf0151900 0x7f7bf014f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.522+0000 7f7bf57e2640 1 -- 172.21.15.88:0/1162279229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7bf00c7b10 msgr2=0x7f7bf0142960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:10.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.522+0000 7f7bf57e2640 1 --2- 172.21.15.88:0/1162279229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7bf00c7b10 0x7f7bf0142960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.522+0000 7f7bf57e2640 1 -- 172.21.15.88:0/1162279229 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be0009420 con 0x7f7bf00bd2a0 2023-12-08T08:23:10.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.522+0000 7f7bf57e2640 1 --2- 172.21.15.88:0/1162279229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bf00bd2a0 0x7f7bf01ec850 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00d5f0 tx=0x7f7bec00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:10.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.522+0000 7f7be5ffb640 1 -- 172.21.15.88:0/1162279229 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec0125f0 con 0x7f7bf00bd2a0 2023-12-08T08:23:10.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.522+0000 7f7be5ffb640 1 -- 172.21.15.88:0/1162279229 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bec012750 con 0x7f7bf00bd2a0 2023-12-08T08:23:10.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.522+0000 7f7be5ffb640 1 -- 172.21.15.88:0/1162279229 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec012ae0 con 0x7f7bf00bd2a0 2023-12-08T08:23:10.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.522+0000 7f7bf67e4640 1 -- 172.21.15.88:0/1162279229 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf01ed110 con 0x7f7bf00bd2a0 2023-12-08T08:23:10.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.522+0000 7f7bf67e4640 1 -- 172.21.15.88:0/1162279229 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf01ed6d0 con 0x7f7bf00bd2a0 2023-12-08T08:23:10.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.526+0000 7f7be5ffb640 1 -- 172.21.15.88:0/1162279229 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7bec012c40 con 0x7f7bf00bd2a0 2023-12-08T08:23:10.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.526+0000 7f7be5ffb640 1 --2- 172.21.15.88:0/1162279229 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7bd4066470 0x7f7bd4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:10.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.526+0000 7f7be5ffb640 1 -- 172.21.15.88:0/1162279229 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7bec084320 con 0x7f7bf00bd2a0 2023-12-08T08:23:10.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.526+0000 7f7bf4fe1640 1 --2- 172.21.15.88:0/1162279229 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7bd4066470 0x7f7bd4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:10.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.526+0000 7f7bfadb5000 1 Processor -- start 2023-12-08T08:23:10.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.526+0000 7f7bfadb5000 1 -- start start 2023-12-08T08:23:10.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.526+0000 7f7bf4fe1640 1 --2- 172.21.15.88:0/1162279229 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7bd4066470 0x7f7bd4068930 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7be00ad000 tx=0x7f7be0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:10.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.526+0000 7f7bfadb5000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb352e0 0x558cdcb356c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:10.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.526+0000 7f7bfadb5000 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x558cdcb35c00 0x558cdcb35fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:10.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.526+0000 7f7bfadb5000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cdcb36520 0x558cdcb7fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:10.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.526+0000 7f7bfadb5000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cdc9a2130 con 0x558cdcb352e0 2023-12-08T08:23:10.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.526+0000 7f7bfadb5000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cdc98f9a0 con 0x558cdcb36520 2023-12-08T08:23:10.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.526+0000 7f7bfadb5000 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x558cdc98ced0 con 0x558cdcb35c00 2023-12-08T08:23:10.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bf57e2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb352e0 0x558cdcb356c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:10.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bf57e2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb352e0 0x558cdcb356c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51682/0 (socket says 172.21.15.88:51682) 2023-12-08T08:23:10.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bf57e2640 1 -- 172.21.15.88:0/3943686879 learned_addr learned my addr 172.21.15.88:0/3943686879 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:10.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bf57e2640 1 -- 172.21.15.88:0/3943686879 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x558cdcb35c00 msgr2=0x558cdcb35fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:10.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bf57e2640 1 --2- 172.21.15.88:0/3943686879 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x558cdcb35c00 0x558cdcb35fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bf57e2640 1 -- 172.21.15.88:0/3943686879 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cdcb36520 msgr2=0x558cdcb7fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:10.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bf57e2640 1 --2- 172.21.15.88:0/3943686879 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cdcb36520 0x558cdcb7fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bf57e2640 1 -- 172.21.15.88:0/3943686879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cdc680890 con 0x558cdcb352e0 2023-12-08T08:23:10.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bf57e2640 1 --2- 172.21.15.88:0/3943686879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb352e0 0x558cdcb356c0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f7bec05d190 tx=0x7f7bec055ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd311ae6d0fb5b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:10.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bd2ffd640 1 -- 172.21.15.88:0/3943686879 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec05d6c0 con 0x558cdcb352e0 2023-12-08T08:23:10.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bd2ffd640 1 -- 172.21.15.88:0/3943686879 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bec053760 con 0x558cdcb352e0 2023-12-08T08:23:10.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bd2ffd640 1 -- 172.21.15.88:0/3943686879 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec051ad0 con 0x558cdcb352e0 2023-12-08T08:23:10.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bfadb5000 1 -- 172.21.15.88:0/3943686879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb352e0 msgr2=0x558cdcb356c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:10.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bfadb5000 1 --2- 172.21.15.88:0/3943686879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb352e0 0x558cdcb356c0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f7bec05d190 tx=0x7f7bec055ac0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bfadb5000 1 -- 172.21.15.88:0/3943686879 shutdown_connections 2023-12-08T08:23:10.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bfadb5000 1 --2- 172.21.15.88:0/3943686879 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cdcb36520 0x558cdcb7fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bfadb5000 1 --2- 172.21.15.88:0/3943686879 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x558cdcb35c00 0x558cdcb35fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bfadb5000 1 --2- 172.21.15.88:0/3943686879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb352e0 0x558cdcb356c0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bfadb5000 1 -- 172.21.15.88:0/3943686879 >> 172.21.15.88:0/3943686879 conn(0x558cdcb3e190 msgr2=0x558cdcb757a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:10.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bfadb5000 1 -- 172.21.15.88:0/3943686879 shutdown_connections 2023-12-08T08:23:10.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bfadb5000 1 -- 172.21.15.88:0/3943686879 wait complete. 2023-12-08T08:23:10.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bfadb5000 1 -- start start 2023-12-08T08:23:10.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bfadb5000 1 Processor -- start 2023-12-08T08:23:10.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bfadb5000 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x558cdcb352e0 0x558cdcb71d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:10.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bfadb5000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cdcb35c00 0x558cdcb72240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:10.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bfadb5000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb36520 0x558cdcb3ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:10.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bfadb5000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cdc9887c0 con 0x558cdcb36520 2023-12-08T08:23:10.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bfadb5000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cdc940bf0 con 0x558cdcb35c00 2023-12-08T08:23:10.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bfadb5000 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x558cdc946a90 con 0x558cdcb352e0 2023-12-08T08:23:10.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bfadb5000 10 client.0 _ll_register_callbacks cb 0x558cdcb233c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T08:23:10.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.530+0000 7f7bf5fe3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb36520 0x558cdcb3ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:10.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bf5fe3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb36520 0x558cdcb3ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51692/0 (socket says 172.21.15.88:51692) 2023-12-08T08:23:10.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bf5fe3640 1 -- 172.21.15.88:0/1093155481 learned_addr learned my addr 172.21.15.88:0/1093155481 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:10.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bf4fe1640 1 --2- 172.21.15.88:0/1093155481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cdcb35c00 0x558cdcb72240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:10.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bf57e2640 1 --2- 172.21.15.88:0/1093155481 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x558cdcb352e0 0x558cdcb71d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:10.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bf5fe3640 1 -- 172.21.15.88:0/1093155481 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x558cdcb352e0 msgr2=0x558cdcb71d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:10.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bf5fe3640 1 --2- 172.21.15.88:0/1093155481 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x558cdcb352e0 0x558cdcb71d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bf5fe3640 1 -- 172.21.15.88:0/1093155481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cdcb35c00 msgr2=0x558cdcb72240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:10.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bf5fe3640 1 --2- 172.21.15.88:0/1093155481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cdcb35c00 0x558cdcb72240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bf5fe3640 1 -- 172.21.15.88:0/1093155481 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf01ed6d0 con 0x558cdcb36520 2023-12-08T08:23:10.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bf5fe3640 1 --2- 172.21.15.88:0/1093155481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb36520 0x558cdcb3ba80 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f7be8007b00 tx=0x7f7be8007b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42df51051b0445a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:10.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bcbfff640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-12-08T08:23:10.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bcbfff640 1 -- 172.21.15.88:0/1093155481 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be80114f0 con 0x558cdcb36520 2023-12-08T08:23:10.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bcbfff640 1 -- 172.21.15.88:0/1093155481 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7be8011650 con 0x558cdcb36520 2023-12-08T08:23:10.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bfadb5000 1 -- 172.21.15.88:0/1093155481 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558cdc94a470 con 0x558cdcb36520 2023-12-08T08:23:10.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bcbfff640 1 -- 172.21.15.88:0/1093155481 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7be8011850 con 0x558cdcb36520 2023-12-08T08:23:10.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bfadb5000 10 client.6702 fetch_fsmap learned FSMap version 47 2023-12-08T08:23:10.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bfadb5000 1 -- 172.21.15.88:0/1093155481 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x558cdc949190 con 0x558cdcb36520 2023-12-08T08:23:10.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bcbfff640 1 -- 172.21.15.88:0/1093155481 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558cdc94a470 con 0x558cdcb36520 2023-12-08T08:23:10.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bcbfff640 1 -- 172.21.15.88:0/1093155481 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 47) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7be8004b70 con 0x558cdcb36520 2023-12-08T08:23:10.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bfadb5000 10 client.6702 fetch_fsmap finished waiting for FSMap version 47 2023-12-08T08:23:10.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bfadb5000 10 client.6702 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-08T08:23:10.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bfadb5000 20 client.6702 populate_metadata read hostname 'smithi088' 2023-12-08T08:23:10.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bfadb5000 1 --2- 172.21.15.88:0/1093155481 >> [v2:172.21.15.88:6836/698349615,v1:172.21.15.88:6837/698349615] conn(0x558cdcb3c7c0 0x558cdcb3cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:10.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bfadb5000 4 client.6702 mds_command: new command op to 6525 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-08T08:23:10.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bfadb5000 1 -- 172.21.15.88:0/1093155481 --> [v2:172.21.15.88:6836/698349615,v1:172.21.15.88:6837/698349615] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558cdc94db50 con 0x558cdcb3c7c0 2023-12-08T08:23:10.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bf57e2640 1 --2- 172.21.15.88:0/1093155481 >> [v2:172.21.15.88:6836/698349615,v1:172.21.15.88:6837/698349615] conn(0x558cdcb3c7c0 0x558cdcb3cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:10.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bcbfff640 10 client.6702 ms_handle_connect on v2:172.21.15.88:6836/698349615 2023-12-08T08:23:10.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bf57e2640 1 --2- 172.21.15.88:0/1093155481 >> [v2:172.21.15.88:6836/698349615,v1:172.21.15.88:6837/698349615] conn(0x558cdcb3c7c0 0x558cdcb3cba0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa5a4b057283918 server_cookie=ee34c63c5cb60977 in_seq=0 out_seq=0 2023-12-08T08:23:10.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bcbfff640 1 -- 172.21.15.88:0/1093155481 <== mds.0 v2:172.21.15.88:6836/698349615 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x558cdc94db50 con 0x558cdcb3c7c0 2023-12-08T08:23:10.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bcbfff640 10 client.6702 handle_command_reply: tid=0 2023-12-08T08:23:10.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bfadb5000 1 client.6702 shutdown 2023-12-08T08:23:10.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bfadb5000 1 -- 172.21.15.88:0/1093155481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb36520 msgr2=0x558cdcb3ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:10.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bfadb5000 1 --2- 172.21.15.88:0/1093155481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb36520 0x558cdcb3ba80 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f7be8007b00 tx=0x7f7be8007b30 comp rx=0 tx=0).stop 2023-12-08T08:23:10.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bfadb5000 1 -- 172.21.15.88:0/1093155481 shutdown_connections 2023-12-08T08:23:10.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bfadb5000 1 --2- 172.21.15.88:0/1093155481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb36520 0x558cdcb3ba80 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bfadb5000 1 --2- 172.21.15.88:0/1093155481 >> [v2:172.21.15.88:6836/698349615,v1:172.21.15.88:6837/698349615] conn(0x558cdcb3c7c0 0x558cdcb3cba0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bfadb5000 1 --2- 172.21.15.88:0/1093155481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cdcb35c00 0x558cdcb72240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bfadb5000 1 --2- 172.21.15.88:0/1093155481 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x558cdcb352e0 0x558cdcb71d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bfadb5000 1 -- 172.21.15.88:0/1093155481 >> 172.21.15.88:0/1093155481 conn(0x558cdcb3e190 msgr2=0x558cdcb349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:10.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bcbfff640 0 client.6702 ms_handle_reset on v2:172.21.15.88:6836/698349615 2023-12-08T08:23:10.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bfadb5000 1 -- 172.21.15.88:0/1093155481 shutdown_connections 2023-12-08T08:23:10.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bfadb5000 1 -- 172.21.15.88:0/1093155481 wait complete. 2023-12-08T08:23:10.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.534+0000 7f7bfadb5000 20 client.6702 trim_cache size 0 max 16384 2023-12-08T08:23:10.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.550+0000 7f7bfadb5000 1 Processor -- start 2023-12-08T08:23:10.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.550+0000 7f7bfadb5000 1 -- start start 2023-12-08T08:23:10.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bfadb5000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb352e0 0x558cdcb87850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:10.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bfadb5000 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x558cdcb35c00 0x558cdcb37010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:10.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bfadb5000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cdcb36520 0x558cdcb90430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:10.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bfadb5000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cdc641940 con 0x558cdcb352e0 2023-12-08T08:23:10.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bfadb5000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cdcb3f890 con 0x558cdcb36520 2023-12-08T08:23:10.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bfadb5000 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x558cdc9845c0 con 0x558cdcb35c00 2023-12-08T08:23:10.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bf57e2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb352e0 0x558cdcb87850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:10.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bf57e2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb352e0 0x558cdcb87850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51694/0 (socket says 172.21.15.88:51694) 2023-12-08T08:23:10.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bf57e2640 1 -- 172.21.15.88:0/4024853168 learned_addr learned my addr 172.21.15.88:0/4024853168 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:10.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bf4fe1640 1 --2- 172.21.15.88:0/4024853168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x558cdcb35c00 0x558cdcb37010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:10.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bf5fe3640 1 --2- 172.21.15.88:0/4024853168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cdcb36520 0x558cdcb90430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:10.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bf57e2640 1 -- 172.21.15.88:0/4024853168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x558cdcb35c00 msgr2=0x558cdcb37010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:10.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bf57e2640 1 --2- 172.21.15.88:0/4024853168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x558cdcb35c00 0x558cdcb37010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bf57e2640 1 -- 172.21.15.88:0/4024853168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cdcb36520 msgr2=0x558cdcb90430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:10.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bf57e2640 1 --2- 172.21.15.88:0/4024853168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cdcb36520 0x558cdcb90430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bf57e2640 1 -- 172.21.15.88:0/4024853168 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cdc92f490 con 0x558cdcb352e0 2023-12-08T08:23:10.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bf57e2640 1 --2- 172.21.15.88:0/4024853168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb352e0 0x558cdcb87850 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f7bec013010 tx=0x7f7bec084000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2232408d9bf1ca server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:10.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bd37fe640 1 -- 172.21.15.88:0/4024853168 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec053760 con 0x558cdcb352e0 2023-12-08T08:23:10.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bd37fe640 1 -- 172.21.15.88:0/4024853168 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bec084070 con 0x558cdcb352e0 2023-12-08T08:23:10.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bd37fe640 1 -- 172.21.15.88:0/4024853168 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec051ad0 con 0x558cdcb352e0 2023-12-08T08:23:10.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bfadb5000 1 -- 172.21.15.88:0/4024853168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb352e0 msgr2=0x558cdcb87850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:10.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bfadb5000 1 --2- 172.21.15.88:0/4024853168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb352e0 0x558cdcb87850 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f7bec013010 tx=0x7f7bec084000 comp rx=0 tx=0).stop 2023-12-08T08:23:10.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bfadb5000 1 -- 172.21.15.88:0/4024853168 shutdown_connections 2023-12-08T08:23:10.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bfadb5000 1 --2- 172.21.15.88:0/4024853168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cdcb36520 0x558cdcb90430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bfadb5000 1 --2- 172.21.15.88:0/4024853168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x558cdcb35c00 0x558cdcb37010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bfadb5000 1 --2- 172.21.15.88:0/4024853168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb352e0 0x558cdcb87850 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bfadb5000 1 -- 172.21.15.88:0/4024853168 >> 172.21.15.88:0/4024853168 conn(0x558cdcb3e190 msgr2=0x558cdcb36900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:10.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bfadb5000 1 -- 172.21.15.88:0/4024853168 shutdown_connections 2023-12-08T08:23:10.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bfadb5000 1 -- 172.21.15.88:0/4024853168 wait complete. 2023-12-08T08:23:10.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bfadb5000 1 -- start start 2023-12-08T08:23:10.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bfadb5000 1 Processor -- start 2023-12-08T08:23:10.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bfadb5000 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x558cdcb352e0 0x558cdcb8c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:10.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bfadb5000 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cdcb35c00 0x558cdcb8c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:10.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bfadb5000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb36520 0x558cdcb8ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:10.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bfadb5000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cdc962e30 con 0x558cdcb36520 2023-12-08T08:23:10.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bfadb5000 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cdc987650 con 0x558cdcb35c00 2023-12-08T08:23:10.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bfadb5000 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x558cdcb3f890 con 0x558cdcb352e0 2023-12-08T08:23:10.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.554+0000 7f7bfadb5000 10 client.0 _ll_register_callbacks cb 0x558cdcb03bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T08:23:10.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bf5fe3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb36520 0x558cdcb8ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:10.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bf5fe3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb36520 0x558cdcb8ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51706/0 (socket says 172.21.15.88:51706) 2023-12-08T08:23:10.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bf5fe3640 1 -- 172.21.15.88:0/988401610 learned_addr learned my addr 172.21.15.88:0/988401610 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:10.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bf4fe1640 1 --2- 172.21.15.88:0/988401610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cdcb35c00 0x558cdcb8c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:10.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bf57e2640 1 --2- 172.21.15.88:0/988401610 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x558cdcb352e0 0x558cdcb8c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:10.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bf5fe3640 1 -- 172.21.15.88:0/988401610 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x558cdcb352e0 msgr2=0x558cdcb8c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:10.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bf5fe3640 1 --2- 172.21.15.88:0/988401610 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x558cdcb352e0 0x558cdcb8c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bf5fe3640 1 -- 172.21.15.88:0/988401610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cdcb35c00 msgr2=0x558cdcb8c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:10.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bf5fe3640 1 --2- 172.21.15.88:0/988401610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cdcb35c00 0x558cdcb8c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bf5fe3640 1 -- 172.21.15.88:0/988401610 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558cdc680890 con 0x558cdcb36520 2023-12-08T08:23:10.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bf5fe3640 1 --2- 172.21.15.88:0/988401610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb36520 0x558cdcb8ce70 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f7be8001fc0 tx=0x7f7be80013b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a245b1f11236764e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:10.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bcbfff640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-12-08T08:23:10.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bcbfff640 1 -- 172.21.15.88:0/988401610 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be8007670 con 0x558cdcb36520 2023-12-08T08:23:10.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bcbfff640 1 -- 172.21.15.88:0/988401610 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7be80077d0 con 0x558cdcb36520 2023-12-08T08:23:10.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bfadb5000 1 -- 172.21.15.88:0/988401610 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558cdcb38770 con 0x558cdcb36520 2023-12-08T08:23:10.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bcbfff640 1 -- 172.21.15.88:0/988401610 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7be8011af0 con 0x558cdcb36520 2023-12-08T08:23:10.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bfadb5000 10 client.6708 fetch_fsmap learned FSMap version 47 2023-12-08T08:23:10.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bfadb5000 1 -- 172.21.15.88:0/988401610 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x558cdc680cc0 con 0x558cdcb36520 2023-12-08T08:23:10.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bcbfff640 1 -- 172.21.15.88:0/988401610 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558cdcb38770 con 0x558cdcb36520 2023-12-08T08:23:10.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bcbfff640 1 -- 172.21.15.88:0/988401610 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 47) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7be8011c50 con 0x558cdcb36520 2023-12-08T08:23:10.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bfadb5000 10 client.6708 fetch_fsmap finished waiting for FSMap version 47 2023-12-08T08:23:10.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bfadb5000 10 client.6708 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-08T08:23:10.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bfadb5000 20 client.6708 populate_metadata read hostname 'smithi088' 2023-12-08T08:23:10.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bfadb5000 1 --2- 172.21.15.88:0/988401610 >> [v2:172.21.15.88:6836/698349615,v1:172.21.15.88:6837/698349615] conn(0x558cdcb8d3b0 0x558cdcb8d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:10.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bfadb5000 4 client.6708 mds_command: new command op to 6525 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-08T08:23:10.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bfadb5000 1 -- 172.21.15.88:0/988401610 --> [v2:172.21.15.88:6836/698349615,v1:172.21.15.88:6837/698349615] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558cdc987110 con 0x558cdcb8d3b0 2023-12-08T08:23:10.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bf57e2640 1 --2- 172.21.15.88:0/988401610 >> [v2:172.21.15.88:6836/698349615,v1:172.21.15.88:6837/698349615] conn(0x558cdcb8d3b0 0x558cdcb8d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:10.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bf57e2640 1 --2- 172.21.15.88:0/988401610 >> [v2:172.21.15.88:6836/698349615,v1:172.21.15.88:6837/698349615] conn(0x558cdcb8d3b0 0x558cdcb8d790 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99290a6fc636bd06 server_cookie=cd1bcbbc834dbcde in_seq=0 out_seq=0 2023-12-08T08:23:10.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bcbfff640 10 client.6708 ms_handle_connect on v2:172.21.15.88:6836/698349615 2023-12-08T08:23:10.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bcbfff640 1 -- 172.21.15.88:0/988401610 <== mds.0 v2:172.21.15.88:6836/698349615 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x558cdc987110 con 0x558cdcb8d3b0 2023-12-08T08:23:10.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bcbfff640 10 client.6708 handle_command_reply: tid=0 2023-12-08T08:23:10.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bfadb5000 1 client.6708 shutdown 2023-12-08T08:23:10.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bfadb5000 1 -- 172.21.15.88:0/988401610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb36520 msgr2=0x558cdcb8ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:10.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bfadb5000 1 --2- 172.21.15.88:0/988401610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb36520 0x558cdcb8ce70 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f7be8001fc0 tx=0x7f7be80013b0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bfadb5000 1 -- 172.21.15.88:0/988401610 shutdown_connections 2023-12-08T08:23:10.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bfadb5000 1 --2- 172.21.15.88:0/988401610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558cdcb36520 0x558cdcb8ce70 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bfadb5000 1 --2- 172.21.15.88:0/988401610 >> [v2:172.21.15.88:6836/698349615,v1:172.21.15.88:6837/698349615] conn(0x558cdcb8d3b0 0x558cdcb8d790 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bfadb5000 1 --2- 172.21.15.88:0/988401610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cdcb35c00 0x558cdcb8c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bfadb5000 1 --2- 172.21.15.88:0/988401610 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x558cdcb352e0 0x558cdcb8c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bcbfff640 0 client.6708 ms_handle_reset on v2:172.21.15.88:6836/698349615 2023-12-08T08:23:10.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bfadb5000 1 -- 172.21.15.88:0/988401610 >> 172.21.15.88:0/988401610 conn(0x558cdcb3e190 msgr2=0x558cdcb37190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:10.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bfadb5000 1 -- 172.21.15.88:0/988401610 shutdown_connections 2023-12-08T08:23:10.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bfadb5000 1 -- 172.21.15.88:0/988401610 wait complete. 2023-12-08T08:23:10.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.558+0000 7f7bfadb5000 20 client.6708 trim_cache size 0 max 16384 2023-12-08T08:23:10.569 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-08T08:23:10.569 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_fsid": "681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3", 2023-12-08T08:23:10.569 INFO:teuthology.orchestra.run.smithi088.stdout: "whoami": 0, 2023-12-08T08:23:10.569 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 6525, 2023-12-08T08:23:10.569 INFO:teuthology.orchestra.run.smithi088.stdout: "want_state": "up:active", 2023-12-08T08:23:10.569 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "up:active", 2023-12-08T08:23:10.569 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs", 2023-12-08T08:23:10.569 INFO:teuthology.orchestra.run.smithi088.stdout: "rank_uptime": 10.308249902, 2023-12-08T08:23:10.569 INFO:teuthology.orchestra.run.smithi088.stdout: "mdsmap_epoch": 47, 2023-12-08T08:23:10.569 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch": 68, 2023-12-08T08:23:10.569 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch_barrier": 68, 2023-12-08T08:23:10.570 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 16.277961510000001 2023-12-08T08:23:10.570 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-08T08:23:10.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.562+0000 7f7bf67e4640 1 -- 172.21.15.88:0/1162279229 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7bd4066470 msgr2=0x7f7bd4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:10.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.562+0000 7f7bf67e4640 1 --2- 172.21.15.88:0/1162279229 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7bd4066470 0x7f7bd4068930 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7be00ad000 tx=0x7f7be0008040 comp rx=0 tx=0).stop 2023-12-08T08:23:10.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.562+0000 7f7bf67e4640 1 -- 172.21.15.88:0/1162279229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bf00bd2a0 msgr2=0x7f7bf01ec850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:10.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.562+0000 7f7bf67e4640 1 --2- 172.21.15.88:0/1162279229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bf00bd2a0 0x7f7bf01ec850 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00d5f0 tx=0x7f7bec00dab0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.562+0000 7f7bf67e4640 1 -- 172.21.15.88:0/1162279229 shutdown_connections 2023-12-08T08:23:10.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.562+0000 7f7bf67e4640 1 --2- 172.21.15.88:0/1162279229 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7bd4066470 0x7f7bd4068930 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.562+0000 7f7bf67e4640 1 --2- 172.21.15.88:0/1162279229 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7bf0151900 0x7f7bf014f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.562+0000 7f7bf67e4640 1 --2- 172.21.15.88:0/1162279229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7bf00c7b10 0x7f7bf0142960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.562+0000 7f7bf67e4640 1 --2- 172.21.15.88:0/1162279229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bf00bd2a0 0x7f7bf01ec850 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.562+0000 7f7bf67e4640 1 -- 172.21.15.88:0/1162279229 >> 172.21.15.88:0/1162279229 conn(0x7f7bf0066670 msgr2=0x7f7bf00c6620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:10.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.562+0000 7f7bf67e4640 1 -- 172.21.15.88:0/1162279229 shutdown_connections 2023-12-08T08:23:10.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.562+0000 7f7bf67e4640 1 -- 172.21.15.88:0/1162279229 wait complete. 2023-12-08T08:23:10.584 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:23:10.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.718+0000 7f2ed48fd640 1 Processor -- start 2023-12-08T08:23:10.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.718+0000 7f2ed48fd640 1 -- start start 2023-12-08T08:23:10.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.718+0000 7f2ed48fd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2ed00c7fd0 0x7f2ed0157910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:10.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.718+0000 7f2ed48fd640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed00c8460 con 0x7f2ed0157e50 2023-12-08T08:23:10.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.718+0000 7f2ed48fd640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed0154530 con 0x7f2ed0151b40 2023-12-08T08:23:10.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.718+0000 7f2ed48fd640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed0154320 con 0x7f2ed00c7fd0 2023-12-08T08:23:10.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.718+0000 7f2ece59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2ed00c7fd0 0x7f2ed0157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:10.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.718+0000 7f2ece59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2ed00c7fd0 0x7f2ed0157910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51708/0 (socket says 172.21.15.88:51708) 2023-12-08T08:23:10.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.718+0000 7f2ece59c640 1 -- 172.21.15.88:0/226872075 learned_addr learned my addr 172.21.15.88:0/226872075 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:10.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.718+0000 7f2ecf59e640 1 --1- 172.21.15.88:0/226872075 >> v1:172.21.15.88:6789/0 conn(0x7f2ed0157e50 0x7f2ed015eca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38554/0 (socket says 172.21.15.88:38554) 2023-12-08T08:23:10.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.718+0000 7f2ece59c640 1 -- 172.21.15.88:0/226872075 >> v1:172.21.15.148:6789/0 conn(0x7f2ed0151b40 legacy=0x7f2ed00c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:10.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.718+0000 7f2ece59c640 1 -- 172.21.15.88:0/226872075 >> v1:172.21.15.88:6789/0 conn(0x7f2ed0157e50 legacy=0x7f2ed015eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:10.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.718+0000 7f2ece59c640 1 -- 172.21.15.88:0/226872075 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed0154810 con 0x7f2ed00c7fd0 2023-12-08T08:23:10.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.722+0000 7f2ece59c640 1 --2- 172.21.15.88:0/226872075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed00c7fd0 0x7f2ed0157910 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4009870 tx=0x7f2ec401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09dab0e3c1f64fe server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:10.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.722+0000 7f2ecdd9b640 1 -- 172.21.15.88:0/226872075 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec40ad680 con 0x7f2ed00c7fd0 2023-12-08T08:23:10.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.722+0000 7f2ecdd9b640 1 -- 172.21.15.88:0/226872075 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec40ad7e0 con 0x7f2ed00c7fd0 2023-12-08T08:23:10.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.722+0000 7f2ecdd9b640 1 -- 172.21.15.88:0/226872075 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec40adb70 con 0x7f2ed00c7fd0 2023-12-08T08:23:10.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.722+0000 7f2ed48fd640 1 -- 172.21.15.88:0/226872075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed00c7fd0 msgr2=0x7f2ed0157910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:10.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.722+0000 7f2ed48fd640 1 --2- 172.21.15.88:0/226872075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed00c7fd0 0x7f2ed0157910 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4009870 tx=0x7f2ec401c470 comp rx=0 tx=0).stop 2023-12-08T08:23:10.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.722+0000 7f2ed48fd640 1 -- 172.21.15.88:0/226872075 shutdown_connections 2023-12-08T08:23:10.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.722+0000 7f2ed48fd640 1 --2- 172.21.15.88:0/226872075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed00c7fd0 0x7f2ed0157910 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.722+0000 7f2ed48fd640 1 -- 172.21.15.88:0/226872075 >> 172.21.15.88:0/226872075 conn(0x7f2ed0066470 msgr2=0x7f2ed0066880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:10.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.722+0000 7f2ed48fd640 1 -- 172.21.15.88:0/226872075 shutdown_connections 2023-12-08T08:23:10.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.722+0000 7f2ed48fd640 1 -- 172.21.15.88:0/226872075 wait complete. 2023-12-08T08:23:10.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.722+0000 7f2ed48fd640 1 Processor -- start 2023-12-08T08:23:10.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.722+0000 7f2ed48fd640 1 -- start start 2023-12-08T08:23:10.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.726+0000 7f2ed48fd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed00c7fd0 0x7f2ed0149fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:10.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.726+0000 7f2ed48fd640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ed0151b40 0x7f2ed01ee3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:10.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.726+0000 7f2ed48fd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ed0157e50 0x7f2ed0147b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:10.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.726+0000 7f2ed48fd640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed014e7d0 con 0x7f2ed00c7fd0 2023-12-08T08:23:10.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.726+0000 7f2ed48fd640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed014b2c0 con 0x7f2ed0157e50 2023-12-08T08:23:10.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.726+0000 7f2ed48fd640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed014b510 con 0x7f2ed0151b40 2023-12-08T08:23:10.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.726+0000 7f2eced9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed00c7fd0 0x7f2ed0149fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:10.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.726+0000 7f2eced9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed00c7fd0 0x7f2ed0149fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51716/0 (socket says 172.21.15.88:51716) 2023-12-08T08:23:10.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.726+0000 7f2eced9d640 1 -- 172.21.15.88:0/1083537694 learned_addr learned my addr 172.21.15.88:0/1083537694 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:10.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.726+0000 7f2ecf59e640 1 --2- 172.21.15.88:0/1083537694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ed0157e50 0x7f2ed0147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:10.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.726+0000 7f2ece59c640 1 --2- 172.21.15.88:0/1083537694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ed0151b40 0x7f2ed01ee3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:10.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.726+0000 7f2eced9d640 1 -- 172.21.15.88:0/1083537694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ed0151b40 msgr2=0x7f2ed01ee3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:10.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.726+0000 7f2eced9d640 1 --2- 172.21.15.88:0/1083537694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ed0151b40 0x7f2ed01ee3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.726+0000 7f2eced9d640 1 -- 172.21.15.88:0/1083537694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ed0157e50 msgr2=0x7f2ed0147b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:10.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.726+0000 7f2eced9d640 1 --2- 172.21.15.88:0/1083537694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ed0157e50 0x7f2ed0147b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.726+0000 7f2eced9d640 1 -- 172.21.15.88:0/1083537694 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec40094d0 con 0x7f2ed00c7fd0 2023-12-08T08:23:10.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.726+0000 7f2eced9d640 1 --2- 172.21.15.88:0/1083537694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed00c7fd0 0x7f2ed0149fa0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f2ec000c450 tx=0x7f2ec000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:10.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.726+0000 7f2eb77fe640 1 -- 172.21.15.88:0/1083537694 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0012830 con 0x7f2ed00c7fd0 2023-12-08T08:23:10.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.726+0000 7f2eb77fe640 1 -- 172.21.15.88:0/1083537694 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec00129b0 con 0x7f2ed00c7fd0 2023-12-08T08:23:10.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.726+0000 7f2eb77fe640 1 -- 172.21.15.88:0/1083537694 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0012d60 con 0x7f2ed00c7fd0 2023-12-08T08:23:10.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.726+0000 7f2ed48fd640 1 -- 172.21.15.88:0/1083537694 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed014b7f0 con 0x7f2ed00c7fd0 2023-12-08T08:23:10.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.726+0000 7f2ed48fd640 1 -- 172.21.15.88:0/1083537694 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed0149a80 con 0x7f2ed00c7fd0 2023-12-08T08:23:10.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.726+0000 7f2ed48fd640 1 -- 172.21.15.88:0/1083537694 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed0067bc0 con 0x7f2ed00c7fd0 2023-12-08T08:23:10.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.726+0000 7f2eb77fe640 1 -- 172.21.15.88:0/1083537694 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2ec001c460 con 0x7f2ed00c7fd0 2023-12-08T08:23:10.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.730+0000 7f2eb77fe640 1 --2- 172.21.15.88:0/1083537694 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2ebc0664a0 0x7f2ebc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:10.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.730+0000 7f2eb77fe640 1 -- 172.21.15.88:0/1083537694 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ec0083cf0 con 0x7f2ed00c7fd0 2023-12-08T08:23:10.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.730+0000 7f2ece59c640 1 --2- 172.21.15.88:0/1083537694 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2ebc0664a0 0x7f2ebc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:10.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.730+0000 7f2ece59c640 1 --2- 172.21.15.88:0/1083537694 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2ebc0664a0 0x7f2ebc068960 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2ec40af000 tx=0x7f2ec40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:10.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.734+0000 7f2eb77fe640 1 -- 172.21.15.88:0/1083537694 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2ec0051160 con 0x7f2ed00c7fd0 2023-12-08T08:23:10.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.918+0000 7f2ed48fd640 1 -- 172.21.15.88:0/1083537694 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2ed01601a0 con 0x7f2ed00c7fd0 2023-12-08T08:23:10.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.918+0000 7f2eb77fe640 1 -- 172.21.15.88:0/1083537694 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2ec0054780 con 0x7f2ed00c7fd0 2023-12-08T08:23:10.924 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:23:10.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.922+0000 7f2ed48fd640 1 -- 172.21.15.88:0/1083537694 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2ebc0664a0 msgr2=0x7f2ebc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:10.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.922+0000 7f2ed48fd640 1 --2- 172.21.15.88:0/1083537694 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2ebc0664a0 0x7f2ebc068960 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2ec40af000 tx=0x7f2ec40a7000 comp rx=0 tx=0).stop 2023-12-08T08:23:10.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.922+0000 7f2ed48fd640 1 -- 172.21.15.88:0/1083537694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed00c7fd0 msgr2=0x7f2ed0149fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:10.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.922+0000 7f2ed48fd640 1 --2- 172.21.15.88:0/1083537694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed00c7fd0 0x7f2ed0149fa0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f2ec000c450 tx=0x7f2ec000c910 comp rx=0 tx=0).stop 2023-12-08T08:23:10.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.922+0000 7f2ed48fd640 1 -- 172.21.15.88:0/1083537694 shutdown_connections 2023-12-08T08:23:10.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.922+0000 7f2ed48fd640 1 --2- 172.21.15.88:0/1083537694 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2ebc0664a0 0x7f2ebc068960 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.922+0000 7f2ed48fd640 1 --2- 172.21.15.88:0/1083537694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ed0157e50 0x7f2ed0147b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.922+0000 7f2ed48fd640 1 --2- 172.21.15.88:0/1083537694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ed0151b40 0x7f2ed01ee3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.922+0000 7f2ed48fd640 1 --2- 172.21.15.88:0/1083537694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ed00c7fd0 0x7f2ed0149fa0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:10.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.922+0000 7f2ed48fd640 1 -- 172.21.15.88:0/1083537694 >> 172.21.15.88:0/1083537694 conn(0x7f2ed0066470 msgr2=0x7f2ed0066850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:10.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.922+0000 7f2ed48fd640 1 -- 172.21.15.88:0/1083537694 shutdown_connections 2023-12-08T08:23:10.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:10.922+0000 7f2ed48fd640 1 -- 172.21.15.88:0/1083537694 wait complete. 2023-12-08T08:23:10.945 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-08T08:23:10.945 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:23:10.945 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2023-12-08T08:23:10.945 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-08T08:23:10.945 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T08:23:10.945 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-08T08:23:10.946 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-08T08:23:10.946 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:23:10.946 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:23:10.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:10.946 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2023-12-08T08:23:10.956 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:23:10.956 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:23:10.956 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:23:10.956 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:10.957 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-12-08T08:23:10.957 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:10.957 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:23:10.957 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:10.957 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2023-12-08T08:23:10.957 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:23:10.957 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:10.957 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2023-12-08T08:23:10.957 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:23:10.957 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:10.957 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:23:10.957 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:10.958 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-08T08:23:10.958 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42268sec preferred_lft 42268sec 2023-12-08T08:23:10.958 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2023-12-08T08:23:10.958 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:10.958 INFO:teuthology.orchestra.run.smithi088.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-08T08:23:10.958 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 02:42:cd:51:97:e3 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:10.958 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-08T08:23:10.958 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:10.958 INFO:teuthology.orchestra.run.smithi088.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:23:10.958 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:10.958 INFO:teuthology.orchestra.run.smithi088.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:23:10.958 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:10.958 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-08T08:23:10.958 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:10.959 INFO:teuthology.orchestra.run.smithi088.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:23:10.959 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:23:10.959 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-08T08:23:10.959 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:10.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:10.960 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:23:11.019 INFO:teuthology.orchestra.run.smithi088.stdout:1 2023-12-08T08:23:11.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:11.022 DEBUG:teuthology.orchestra.run.smithi088:> route 2023-12-08T08:23:11.075 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2023-12-08T08:23:11.075 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:23:11.075 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-08T08:23:11.075 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-08T08:23:11.075 INFO:teuthology.orchestra.run.smithi088.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-08T08:23:11.075 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-08T08:23:11.075 INFO:teuthology.orchestra.run.smithi088.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:23:11.075 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:23:11.076 INFO:teuthology.orchestra.run.smithi088.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:23:11.076 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:23:11.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:11.076 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-12-08T08:23:11.076 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-12-08T08:23:11.076 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-08T08:23:11.076 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-08T08:23:11.076 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-08T08:23:11.077 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-12-08T08:23:11.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:11.168 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-12-08T08:23:11.177 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-08T08:23:11.177 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:23:11.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:11.178 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2023-12-08T08:23:11.241 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:23:11.241 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-08T08:23:11.293 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:23:11.293 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:23:11.344 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-08T08:23:11.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:11.345 DEBUG:teuthology.orchestra.run.smithi088:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:23:11.438 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:23:11.438 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:23:11.452 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:23:11.452 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:23:11.452 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-12-08T08:23:11.452 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: trying mount with new device syntax: 0@681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3.cephfs=/ 2023-12-08T08:23:11.452 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.88:3300/172.21.15.148:3300/172.21.15.148:3301" will pass to kernel 2023-12-08T08:23:11.456 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T08:23:11.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:11.456 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:23:11.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:11.477 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:23:11.541 INFO:teuthology.orchestra.run.smithi088.stdout:client6457 2023-12-08T08:23:11.542 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:23:11.542 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:23:11.594 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:23:11.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.770+0000 7f981cae3640 1 Processor -- start 2023-12-08T08:23:11.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.770+0000 7f981cae3640 1 -- start start 2023-12-08T08:23:11.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.770+0000 7f981cae3640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f981806c100 0x7f981815fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:11.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.770+0000 7f981cae3640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98180c4890 con 0x7f9818154f20 2023-12-08T08:23:11.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.770+0000 7f981cae3640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98181553d0 con 0x7f98180af4c0 2023-12-08T08:23:11.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.770+0000 7f981cae3640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98180af8a0 con 0x7f981806c100 2023-12-08T08:23:11.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.770+0000 7f9815d9b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9818154f20 0x7f981806b9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38558/0 (socket says 172.21.15.88:38558) 2023-12-08T08:23:11.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.770+0000 7f9815d9b640 1 -- 172.21.15.88:0/1779977386 learned_addr learned my addr 172.21.15.88:0/1779977386 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:11.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.770+0000 7f9816d9d640 1 --2- 172.21.15.88:0/1779977386 >> v2:172.21.15.148:3300/0 conn(0x7f981806c100 0x7f981815fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:11.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.770+0000 7f981559a640 1 -- 172.21.15.88:0/1779977386 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2133925531 0 0) 0x7f98180c4890 con 0x7f9818154f20 2023-12-08T08:23:11.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.770+0000 7f981559a640 1 -- 172.21.15.88:0/1779977386 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9800003530 con 0x7f9818154f20 2023-12-08T08:23:11.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.770+0000 7f9816d9d640 1 -- 172.21.15.88:0/1779977386 >> v1:172.21.15.148:6789/0 conn(0x7f98180af4c0 legacy=0x7f98180c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:11.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.770+0000 7f9816d9d640 1 -- 172.21.15.88:0/1779977386 >> v1:172.21.15.88:6789/0 conn(0x7f9818154f20 legacy=0x7f981806b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:11.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.770+0000 7f9816d9d640 1 -- 172.21.15.88:0/1779977386 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98180c4b30 con 0x7f981806c100 2023-12-08T08:23:11.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.774+0000 7f9816d9d640 1 --2- 172.21.15.88:0/1779977386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f981806c100 0x7f981815fe30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9810009d90 tx=0x7f981001c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ba53c850bbdf8a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.774+0000 7f981559a640 1 -- 172.21.15.88:0/1779977386 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98100a5950 con 0x7f981806c100 2023-12-08T08:23:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.774+0000 7f981559a640 1 -- 172.21.15.88:0/1779977386 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98100a5ab0 con 0x7f981806c100 2023-12-08T08:23:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.774+0000 7f981559a640 1 -- 172.21.15.88:0/1779977386 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98100a5e40 con 0x7f981806c100 2023-12-08T08:23:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.774+0000 7f981cae3640 1 -- 172.21.15.88:0/1779977386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f981806c100 msgr2=0x7f981815fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.774+0000 7f981cae3640 1 --2- 172.21.15.88:0/1779977386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f981806c100 0x7f981815fe30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9810009d90 tx=0x7f981001c890 comp rx=0 tx=0).stop 2023-12-08T08:23:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.774+0000 7f981cae3640 1 -- 172.21.15.88:0/1779977386 shutdown_connections 2023-12-08T08:23:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.774+0000 7f981cae3640 1 --2- 172.21.15.88:0/1779977386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f981806c100 0x7f981815fe30 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:11.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.774+0000 7f981cae3640 1 -- 172.21.15.88:0/1779977386 >> 172.21.15.88:0/1779977386 conn(0x7f98180ab9d0 msgr2=0x7f98180abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:11.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.774+0000 7f981cae3640 1 -- 172.21.15.88:0/1779977386 shutdown_connections 2023-12-08T08:23:11.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.774+0000 7f981cae3640 1 -- 172.21.15.88:0/1779977386 wait complete. 2023-12-08T08:23:11.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.778+0000 7f981cae3640 1 Processor -- start 2023-12-08T08:23:11.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.778+0000 7f981cae3640 1 -- start start 2023-12-08T08:23:11.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.778+0000 7f981cae3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f981806c100 0x7f98180add70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:11.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.778+0000 7f981cae3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f98180af4c0 0x7f98180c2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:11.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.778+0000 7f981cae3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9818154f20 0x7f98180c2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:11.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.778+0000 7f981cae3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981814c8e0 con 0x7f9818154f20 2023-12-08T08:23:11.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.778+0000 7f981cae3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98181f0810 con 0x7f981806c100 2023-12-08T08:23:11.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.778+0000 7f981cae3640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981814cb50 con 0x7f98180af4c0 2023-12-08T08:23:11.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.778+0000 7f9816d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9818154f20 0x7f98180c2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:11.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.778+0000 7f9816d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9818154f20 0x7f98180c2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51726/0 (socket says 172.21.15.88:51726) 2023-12-08T08:23:11.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.778+0000 7f9816d9d640 1 -- 172.21.15.88:0/4110977768 learned_addr learned my addr 172.21.15.88:0/4110977768 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:11.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.778+0000 7f981659c640 1 --2- 172.21.15.88:0/4110977768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f981806c100 0x7f98180add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:11.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.778+0000 7f9815d9b640 1 --2- 172.21.15.88:0/4110977768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f98180af4c0 0x7f98180c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:11.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.778+0000 7f9816d9d640 1 -- 172.21.15.88:0/4110977768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f98180af4c0 msgr2=0x7f98180c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:11.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.778+0000 7f9816d9d640 1 --2- 172.21.15.88:0/4110977768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f98180af4c0 0x7f98180c2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:11.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.778+0000 7f9816d9d640 1 -- 172.21.15.88:0/4110977768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f981806c100 msgr2=0x7f98180add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:11.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.778+0000 7f9816d9d640 1 --2- 172.21.15.88:0/4110977768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f981806c100 0x7f98180add70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:11.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.778+0000 7f9816d9d640 1 -- 172.21.15.88:0/4110977768 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9810009a70 con 0x7f9818154f20 2023-12-08T08:23:11.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.778+0000 7f9816d9d640 1 --2- 172.21.15.88:0/4110977768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9818154f20 0x7f98180c2ab0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f98100b0040 tx=0x7f9810019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:11.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.778+0000 7f9806ffd640 1 -- 172.21.15.88:0/4110977768 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98100add90 con 0x7f9818154f20 2023-12-08T08:23:11.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.778+0000 7f9806ffd640 1 -- 172.21.15.88:0/4110977768 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9810009450 con 0x7f9818154f20 2023-12-08T08:23:11.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.778+0000 7f981cae3640 1 -- 172.21.15.88:0/4110977768 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981814ce30 con 0x7f9818154f20 2023-12-08T08:23:11.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.778+0000 7f9806ffd640 1 -- 172.21.15.88:0/4110977768 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98100b9690 con 0x7f9818154f20 2023-12-08T08:23:11.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.778+0000 7f981cae3640 1 -- 172.21.15.88:0/4110977768 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98180ae2b0 con 0x7f9818154f20 2023-12-08T08:23:11.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.778+0000 7f981cae3640 1 -- 172.21.15.88:0/4110977768 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9818067630 con 0x7f9818154f20 2023-12-08T08:23:11.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.782+0000 7f9806ffd640 1 -- 172.21.15.88:0/4110977768 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f98100b97f0 con 0x7f9818154f20 2023-12-08T08:23:11.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.782+0000 7f9806ffd640 1 --2- 172.21.15.88:0/4110977768 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f97f80664a0 0x7f97f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:11.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.782+0000 7f9806ffd640 1 -- 172.21.15.88:0/4110977768 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f981011f4c0 con 0x7f9818154f20 2023-12-08T08:23:11.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.782+0000 7f981659c640 1 --2- 172.21.15.88:0/4110977768 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f97f80664a0 0x7f97f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:11.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.782+0000 7f981659c640 1 --2- 172.21.15.88:0/4110977768 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f97f80664a0 0x7f97f8068960 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9808007fd0 tx=0x7f9808009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:11.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.786+0000 7f9806ffd640 1 -- 172.21.15.88:0/4110977768 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f98100ecb00 con 0x7f9818154f20 2023-12-08T08:23:11.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.966+0000 7f981cae3640 1 -- 172.21.15.88:0/4110977768 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f981806c7a0 con 0x7f9818154f20 2023-12-08T08:23:11.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.970+0000 7f9806ffd640 1 -- 172.21.15.88:0/4110977768 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) v1 ==== 53+0+73 (secure 0 0 0) 0x7f98100f0120 con 0x7f9818154f20 2023-12-08T08:23:11.973 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:23:11.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.970+0000 7f981cae3640 1 -- 172.21.15.88:0/4110977768 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f97f80664a0 msgr2=0x7f97f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:11.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.970+0000 7f981cae3640 1 --2- 172.21.15.88:0/4110977768 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f97f80664a0 0x7f97f8068960 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9808007fd0 tx=0x7f9808009040 comp rx=0 tx=0).stop 2023-12-08T08:23:11.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.970+0000 7f981cae3640 1 -- 172.21.15.88:0/4110977768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9818154f20 msgr2=0x7f98180c2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:11.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.970+0000 7f981cae3640 1 --2- 172.21.15.88:0/4110977768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9818154f20 0x7f98180c2ab0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f98100b0040 tx=0x7f9810019630 comp rx=0 tx=0).stop 2023-12-08T08:23:11.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.970+0000 7f981cae3640 1 -- 172.21.15.88:0/4110977768 shutdown_connections 2023-12-08T08:23:11.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.970+0000 7f981cae3640 1 --2- 172.21.15.88:0/4110977768 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f97f80664a0 0x7f97f8068960 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:11.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.970+0000 7f981cae3640 1 --2- 172.21.15.88:0/4110977768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9818154f20 0x7f98180c2ab0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:11.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.970+0000 7f981cae3640 1 --2- 172.21.15.88:0/4110977768 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f98180af4c0 0x7f98180c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:11.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.970+0000 7f981cae3640 1 --2- 172.21.15.88:0/4110977768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f981806c100 0x7f98180add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:11.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.970+0000 7f981cae3640 1 -- 172.21.15.88:0/4110977768 >> 172.21.15.88:0/4110977768 conn(0x7f98180ab9d0 msgr2=0x7f98180abdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:11.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.970+0000 7f981cae3640 1 -- 172.21.15.88:0/4110977768 shutdown_connections 2023-12-08T08:23:11.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:11.970+0000 7f981cae3640 1 -- 172.21.15.88:0/4110977768 wait complete. 2023-12-08T08:23:11.993 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-08T08:23:11.993 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:23:11.993 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-12-08T08:23:11.993 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-08T08:23:11.994 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-08T08:23:11.994 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-08T08:23:11.994 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-08T08:23:11.994 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:23:11.994 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:23:11.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:11.994 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-12-08T08:23:12.004 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:23:12.005 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:23:12.005 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:23:12.005 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:12.005 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-12-08T08:23:12.005 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:12.005 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:23:12.005 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:12.005 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-12-08T08:23:12.005 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:23:12.005 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:12.005 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-12-08T08:23:12.005 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:23:12.005 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:12.005 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:23:12.006 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:12.006 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-08T08:23:12.006 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42247sec preferred_lft 42247sec 2023-12-08T08:23:12.006 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-12-08T08:23:12.006 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:12.006 INFO:teuthology.orchestra.run.smithi148.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-08T08:23:12.006 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 02:42:93:b7:1f:fa brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:12.006 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-08T08:23:12.006 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:12.006 INFO:teuthology.orchestra.run.smithi148.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:23:12.006 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:12.006 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:23:12.006 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:12.006 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-08T08:23:12.007 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:12.007 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:23:12.007 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:23:12.007 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-08T08:23:12.007 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:12.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:12.008 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:23:12.070 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-12-08T08:23:12.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:12.073 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-12-08T08:23:12.126 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-12-08T08:23:12.126 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:23:12.126 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-08T08:23:12.126 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-08T08:23:12.126 INFO:teuthology.orchestra.run.smithi148.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-08T08:23:12.126 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-08T08:23:12.126 INFO:teuthology.orchestra.run.smithi148.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:23:12.126 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:23:12.126 INFO:teuthology.orchestra.run.smithi148.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:23:12.126 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:23:12.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:12.127 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-12-08T08:23:12.127 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-12-08T08:23:12.127 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-08T08:23:12.127 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-08T08:23:12.127 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-08T08:23:12.127 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-12-08T08:23:12.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:12.226 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-12-08T08:23:12.235 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-08T08:23:12.235 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:23:12.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:12.236 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-12-08T08:23:12.299 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:23:12.299 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-08T08:23:12.355 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:23:12.355 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:23:12.355 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:23:12.405 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-08T08:23:12.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:12.406 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:23:12.501 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:23:12.501 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:23:12.515 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:23:12.515 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:23:12.515 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-12-08T08:23:12.515 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with new device syntax: 1@681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3.cephfs=/ 2023-12-08T08:23:12.515 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.88:3300/172.21.15.148:3300/172.21.15.148:3301" will pass to kernel 2023-12-08T08:23:12.519 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T08:23:12.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:12.519 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:23:12.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:12.540 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:23:12.597 INFO:teuthology.orchestra.run.smithi148.stdout:client5798 2023-12-08T08:23:12.597 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:23:12.598 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:23:12.650 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-12-08T08:23:12.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.782+0000 7f4e411e7640 1 Processor -- start 2023-12-08T08:23:12.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.782+0000 7f4e411e7640 1 -- start start 2023-12-08T08:23:12.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.786+0000 7f4e411e7640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e3c1519f0 0x7f4e3c0c0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:12.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.786+0000 7f4e411e7640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4e3c155030 0x7f4e3c06e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:12.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.786+0000 7f4e411e7640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3c0c1500 con 0x7f4e3c1582a0 2023-12-08T08:23:12.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.786+0000 7f4e411e7640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3c06e000 con 0x7f4e3c155030 2023-12-08T08:23:12.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.786+0000 7f4e411e7640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c06da80 con 0x7f4e3c1519f0 2023-12-08T08:23:12.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.786+0000 7f4e3a59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4e3c155030 0x7f4e3c06e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:12.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.786+0000 7f4e3b59e640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4e3c1582a0 0x7f4e3c06b5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38566/0 (socket says 172.21.15.88:38566) 2023-12-08T08:23:12.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.786+0000 7f4e3b59e640 1 -- 172.21.15.88:0/3757355470 learned_addr learned my addr 172.21.15.88:0/3757355470 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:12.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.786+0000 7f4e3ad9d640 1 --2- 172.21.15.88:0/3757355470 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e3c1519f0 0x7f4e3c0c0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:12.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.786+0000 7f4e3a59c640 1 -- 172.21.15.88:0/3757355470 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e3c1519f0 msgr2=0x7f4e3c0c0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:12.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.786+0000 7f4e3a59c640 1 --2- 172.21.15.88:0/3757355470 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e3c1519f0 0x7f4e3c0c0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:12.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.786+0000 7f4e3a59c640 1 -- 172.21.15.88:0/3757355470 >> v1:172.21.15.88:6789/0 conn(0x7f4e3c1582a0 legacy=0x7f4e3c06b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:12.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.786+0000 7f4e3a59c640 1 -- 172.21.15.88:0/3757355470 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3c157ae0 con 0x7f4e3c155030 2023-12-08T08:23:12.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.786+0000 7f4e3ad9d640 1 --2- 172.21.15.88:0/3757355470 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e3c1519f0 0x7f4e3c0c0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:12.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.786+0000 7f4e3a59c640 1 --2- 172.21.15.88:0/3757355470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e3c155030 0x7f4e3c06e8c0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f4e300097b0 tx=0x7f4e3001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b3980e6cbd2ddb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:12.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.790+0000 7f4e39d9b640 1 -- 172.21.15.88:0/3757355470 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e300ab600 con 0x7f4e3c155030 2023-12-08T08:23:12.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.790+0000 7f4e39d9b640 1 -- 172.21.15.88:0/3757355470 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e300a7050 con 0x7f4e3c155030 2023-12-08T08:23:12.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.790+0000 7f4e39d9b640 1 -- 172.21.15.88:0/3757355470 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e300ab980 con 0x7f4e3c155030 2023-12-08T08:23:12.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.790+0000 7f4e411e7640 1 -- 172.21.15.88:0/3757355470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e3c155030 msgr2=0x7f4e3c06e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:12.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.790+0000 7f4e411e7640 1 --2- 172.21.15.88:0/3757355470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e3c155030 0x7f4e3c06e8c0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f4e300097b0 tx=0x7f4e3001c3f0 comp rx=0 tx=0).stop 2023-12-08T08:23:12.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.790+0000 7f4e411e7640 1 -- 172.21.15.88:0/3757355470 shutdown_connections 2023-12-08T08:23:12.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.790+0000 7f4e411e7640 1 --2- 172.21.15.88:0/3757355470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e3c155030 0x7f4e3c06e8c0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:12.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.790+0000 7f4e411e7640 1 --2- 172.21.15.88:0/3757355470 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e3c1519f0 0x7f4e3c0c0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:12.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.790+0000 7f4e411e7640 1 -- 172.21.15.88:0/3757355470 >> 172.21.15.88:0/3757355470 conn(0x7f4e3c0c2e20 msgr2=0x7f4e3c0c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:12.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.790+0000 7f4e411e7640 1 -- 172.21.15.88:0/3757355470 shutdown_connections 2023-12-08T08:23:12.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.790+0000 7f4e411e7640 1 -- 172.21.15.88:0/3757355470 wait complete. 2023-12-08T08:23:12.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.790+0000 7f4e411e7640 1 Processor -- start 2023-12-08T08:23:12.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.790+0000 7f4e411e7640 1 -- start start 2023-12-08T08:23:12.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.790+0000 7f4e411e7640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e3c1519f0 0x7f4e3c1f0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:12.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.790+0000 7f4e411e7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e3c155030 0x7f4e3c1537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:12.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.790+0000 7f4e411e7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e3c1582a0 0x7f4e3c13dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:12.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.790+0000 7f4e411e7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c1ec830 con 0x7f4e3c155030 2023-12-08T08:23:12.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.790+0000 7f4e411e7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c0aa9a0 con 0x7f4e3c1582a0 2023-12-08T08:23:12.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.790+0000 7f4e411e7640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c0a94d0 con 0x7f4e3c1519f0 2023-12-08T08:23:12.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.790+0000 7f4e3a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e3c155030 0x7f4e3c1537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:12.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.794+0000 7f4e3a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e3c155030 0x7f4e3c1537f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51746/0 (socket says 172.21.15.88:51746) 2023-12-08T08:23:12.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.794+0000 7f4e3a59c640 1 -- 172.21.15.88:0/3099584789 learned_addr learned my addr 172.21.15.88:0/3099584789 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:12.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.794+0000 7f4e3b59e640 1 --2- 172.21.15.88:0/3099584789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e3c1582a0 0x7f4e3c13dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:12.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.794+0000 7f4e3ad9d640 1 --2- 172.21.15.88:0/3099584789 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e3c1519f0 0x7f4e3c1f0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:12.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.794+0000 7f4e3a59c640 1 -- 172.21.15.88:0/3099584789 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e3c1519f0 msgr2=0x7f4e3c1f0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:12.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.794+0000 7f4e3a59c640 1 --2- 172.21.15.88:0/3099584789 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e3c1519f0 0x7f4e3c1f0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:12.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.794+0000 7f4e3a59c640 1 -- 172.21.15.88:0/3099584789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e3c1582a0 msgr2=0x7f4e3c13dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:12.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.794+0000 7f4e3a59c640 1 --2- 172.21.15.88:0/3099584789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e3c1582a0 0x7f4e3c13dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:12.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.794+0000 7f4e3a59c640 1 -- 172.21.15.88:0/3099584789 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e300093c0 con 0x7f4e3c155030 2023-12-08T08:23:12.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.794+0000 7f4e3ad9d640 1 --2- 172.21.15.88:0/3099584789 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e3c1519f0 0x7f4e3c1f0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:12.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.794+0000 7f4e3b59e640 1 --2- 172.21.15.88:0/3099584789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e3c1582a0 0x7f4e3c13dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:12.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.794+0000 7f4e3a59c640 1 --2- 172.21.15.88:0/3099584789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e3c155030 0x7f4e3c1537f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f4e3001a020 tx=0x7f4e30019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:12.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.794+0000 7f4e237fe640 1 -- 172.21.15.88:0/3099584789 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e300b4620 con 0x7f4e3c155030 2023-12-08T08:23:12.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.794+0000 7f4e237fe640 1 -- 172.21.15.88:0/3099584789 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e300b47a0 con 0x7f4e3c155030 2023-12-08T08:23:12.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.794+0000 7f4e237fe640 1 -- 172.21.15.88:0/3099584789 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e300b4b50 con 0x7f4e3c155030 2023-12-08T08:23:12.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.794+0000 7f4e411e7640 1 -- 172.21.15.88:0/3099584789 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e3c14e5d0 con 0x7f4e3c155030 2023-12-08T08:23:12.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.794+0000 7f4e411e7640 1 -- 172.21.15.88:0/3099584789 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3c0a9a00 con 0x7f4e3c155030 2023-12-08T08:23:12.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.794+0000 7f4e411e7640 1 -- 172.21.15.88:0/3099584789 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e3c067630 con 0x7f4e3c155030 2023-12-08T08:23:12.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.794+0000 7f4e237fe640 1 -- 172.21.15.88:0/3099584789 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4e300b2040 con 0x7f4e3c155030 2023-12-08T08:23:12.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.794+0000 7f4e237fe640 1 --2- 172.21.15.88:0/3099584789 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4e280664a0 0x7f4e28068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:12.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.794+0000 7f4e237fe640 1 -- 172.21.15.88:0/3099584789 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e3011e120 con 0x7f4e3c155030 2023-12-08T08:23:12.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.794+0000 7f4e3ad9d640 1 --2- 172.21.15.88:0/3099584789 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4e280664a0 0x7f4e28068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:12.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.798+0000 7f4e3ad9d640 1 --2- 172.21.15.88:0/3099584789 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4e280664a0 0x7f4e28068960 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c0097a0 tx=0x7f4e2c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:12.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:12.798+0000 7f4e237fe640 1 -- 172.21.15.88:0/3099584789 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4e300eb590 con 0x7f4e3c155030 2023-12-08T08:23:13.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.006+0000 7f4e411e7640 1 -- 172.21.15.88:0/3099584789 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f4e3c06d6c0 con 0x7f4e3c155030 2023-12-08T08:23:13.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.006+0000 7f4e237fe640 1 -- 172.21.15.88:0/3099584789 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v19) v1 ==== 84+0+0 (secure 0 0 0) 0x7f4e300eebb0 con 0x7f4e3c155030 2023-12-08T08:23:13.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.010+0000 7f4e411e7640 1 -- 172.21.15.88:0/3099584789 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4e280664a0 msgr2=0x7f4e28068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:13.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.010+0000 7f4e411e7640 1 --2- 172.21.15.88:0/3099584789 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4e280664a0 0x7f4e28068960 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c0097a0 tx=0x7f4e2c008040 comp rx=0 tx=0).stop 2023-12-08T08:23:13.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.010+0000 7f4e411e7640 1 -- 172.21.15.88:0/3099584789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e3c155030 msgr2=0x7f4e3c1537f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:13.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.010+0000 7f4e411e7640 1 --2- 172.21.15.88:0/3099584789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e3c155030 0x7f4e3c1537f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f4e3001a020 tx=0x7f4e30019190 comp rx=0 tx=0).stop 2023-12-08T08:23:13.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.010+0000 7f4e411e7640 1 -- 172.21.15.88:0/3099584789 shutdown_connections 2023-12-08T08:23:13.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.010+0000 7f4e411e7640 1 --2- 172.21.15.88:0/3099584789 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4e280664a0 0x7f4e28068960 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.010+0000 7f4e411e7640 1 --2- 172.21.15.88:0/3099584789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e3c1582a0 0x7f4e3c13dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.010+0000 7f4e411e7640 1 --2- 172.21.15.88:0/3099584789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e3c155030 0x7f4e3c1537f0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.010+0000 7f4e411e7640 1 --2- 172.21.15.88:0/3099584789 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e3c1519f0 0x7f4e3c1f0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.010+0000 7f4e411e7640 1 -- 172.21.15.88:0/3099584789 >> 172.21.15.88:0/3099584789 conn(0x7f4e3c0c2e20 msgr2=0x7f4e3c0c1690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:13.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.010+0000 7f4e411e7640 1 -- 172.21.15.88:0/3099584789 shutdown_connections 2023-12-08T08:23:13.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.010+0000 7f4e411e7640 1 -- 172.21.15.88:0/3099584789 wait complete. 2023-12-08T08:23:13.034 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:23:13.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.166+0000 7f4899079640 1 Processor -- start 2023-12-08T08:23:13.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.166+0000 7f4899079640 1 -- start start 2023-12-08T08:23:13.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.166+0000 7f4899079640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f48940c3b80 0x7f489406d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:13.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.166+0000 7f4899079640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48940c5300 0x7f489406c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:13.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.166+0000 7f4899079640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f489406bb80 con 0x7f489406d2b0 2023-12-08T08:23:13.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.166+0000 7f4899079640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f489406cc70 con 0x7f48940c3b80 2023-12-08T08:23:13.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.166+0000 7f4899079640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48940c5790 con 0x7f48940c5300 2023-12-08T08:23:13.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.166+0000 7f488a59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f48940c3b80 0x7f489406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:13.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.166+0000 7f4892d9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f489406d2b0 0x7f489406c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38576/0 (socket says 172.21.15.88:38576) 2023-12-08T08:23:13.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.166+0000 7f4892d9d640 1 -- 172.21.15.88:0/3752019403 learned_addr learned my addr 172.21.15.88:0/3752019403 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:13.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.166+0000 7f489359e640 1 --2- 172.21.15.88:0/3752019403 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48940c5300 0x7f489406c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:13.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.166+0000 7f488a59c640 1 -- 172.21.15.88:0/3752019403 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48940c5300 msgr2=0x7f489406c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:13.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.166+0000 7f488a59c640 1 --2- 172.21.15.88:0/3752019403 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48940c5300 0x7f489406c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.166+0000 7f488a59c640 1 -- 172.21.15.88:0/3752019403 >> v1:172.21.15.88:6789/0 conn(0x7f489406d2b0 legacy=0x7f489406c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:13.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.166+0000 7f488a59c640 1 -- 172.21.15.88:0/3752019403 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48941515c0 con 0x7f48940c3b80 2023-12-08T08:23:13.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.166+0000 7f489259c640 1 -- 172.21.15.88:0/3752019403 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366927677 0 0) 0x7f489406bb80 con 0x7f489406d2b0 2023-12-08T08:23:13.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.166+0000 7f489359e640 1 --2- 172.21.15.88:0/3752019403 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48940c5300 0x7f489406c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:13.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.170+0000 7f488a59c640 1 --2- 172.21.15.88:0/3752019403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48940c3b80 0x7f489406d690 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f487c0097c0 tx=0x7f487c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956b1bbc8029decc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:13.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.170+0000 7f489259c640 1 -- 172.21.15.88:0/3752019403 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487c0ab650 con 0x7f48940c3b80 2023-12-08T08:23:13.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.170+0000 7f489259c640 1 -- 172.21.15.88:0/3752019403 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487c0ab7b0 con 0x7f48940c3b80 2023-12-08T08:23:13.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.170+0000 7f489259c640 1 -- 172.21.15.88:0/3752019403 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487c0abb40 con 0x7f48940c3b80 2023-12-08T08:23:13.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.170+0000 7f4899079640 1 -- 172.21.15.88:0/3752019403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48940c3b80 msgr2=0x7f489406d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:13.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.170+0000 7f4899079640 1 --2- 172.21.15.88:0/3752019403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48940c3b80 0x7f489406d690 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f487c0097c0 tx=0x7f487c01c450 comp rx=0 tx=0).stop 2023-12-08T08:23:13.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.170+0000 7f4899079640 1 -- 172.21.15.88:0/3752019403 shutdown_connections 2023-12-08T08:23:13.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.170+0000 7f4899079640 1 --2- 172.21.15.88:0/3752019403 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48940c5300 0x7f489406c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.170+0000 7f4899079640 1 --2- 172.21.15.88:0/3752019403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48940c3b80 0x7f489406d690 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.170+0000 7f4899079640 1 -- 172.21.15.88:0/3752019403 >> 172.21.15.88:0/3752019403 conn(0x7f48940a7810 msgr2=0x7f48940a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:13.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.170+0000 7f4899079640 1 -- 172.21.15.88:0/3752019403 shutdown_connections 2023-12-08T08:23:13.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.170+0000 7f4899079640 1 -- 172.21.15.88:0/3752019403 wait complete. 2023-12-08T08:23:13.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.174+0000 7f4899079640 1 Processor -- start 2023-12-08T08:23:13.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.174+0000 7f4899079640 1 -- start start 2023-12-08T08:23:13.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.174+0000 7f4899079640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f489406d2b0 0x7f48940a9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:13.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.174+0000 7f4899079640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48940c3b80 0x7f48941ed570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:13.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.174+0000 7f4899079640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48940c5300 0x7f48940bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:13.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.174+0000 7f4899079640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4894156680 con 0x7f489406d2b0 2023-12-08T08:23:13.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.174+0000 7f4899079640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489415b790 con 0x7f48940c3b80 2023-12-08T08:23:13.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.174+0000 7f4899079640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48941edab0 con 0x7f48940c5300 2023-12-08T08:23:13.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.174+0000 7f4892d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f489406d2b0 0x7f48940a9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:13.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.174+0000 7f4892d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f489406d2b0 0x7f48940a9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51756/0 (socket says 172.21.15.88:51756) 2023-12-08T08:23:13.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.174+0000 7f4892d9d640 1 -- 172.21.15.88:0/2807527162 learned_addr learned my addr 172.21.15.88:0/2807527162 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:13.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.174+0000 7f489359e640 1 --2- 172.21.15.88:0/2807527162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48940c5300 0x7f48940bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:13.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.174+0000 7f4892d9d640 1 -- 172.21.15.88:0/2807527162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48940c5300 msgr2=0x7f48940bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:13.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.174+0000 7f488a59c640 1 --2- 172.21.15.88:0/2807527162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48940c3b80 0x7f48941ed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:13.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.174+0000 7f4892d9d640 1 --2- 172.21.15.88:0/2807527162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48940c5300 0x7f48940bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.174+0000 7f4892d9d640 1 -- 172.21.15.88:0/2807527162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48940c3b80 msgr2=0x7f48941ed570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:13.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.174+0000 7f4892d9d640 1 --2- 172.21.15.88:0/2807527162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48940c3b80 0x7f48941ed570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.174+0000 7f4892d9d640 1 -- 172.21.15.88:0/2807527162 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c009420 con 0x7f489406d2b0 2023-12-08T08:23:13.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.174+0000 7f488a59c640 1 --2- 172.21.15.88:0/2807527162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48940c3b80 0x7f48941ed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:13.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.174+0000 7f489359e640 1 --2- 172.21.15.88:0/2807527162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48940c5300 0x7f48940bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:13.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.174+0000 7f4892d9d640 1 --2- 172.21.15.88:0/2807527162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f489406d2b0 0x7f48940a9e50 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f4884001570 tx=0x7f488400cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:13.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.174+0000 7f488bfff640 1 -- 172.21.15.88:0/2807527162 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488400a640 con 0x7f489406d2b0 2023-12-08T08:23:13.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.174+0000 7f488bfff640 1 -- 172.21.15.88:0/2807527162 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488400a7c0 con 0x7f489406d2b0 2023-12-08T08:23:13.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.174+0000 7f488bfff640 1 -- 172.21.15.88:0/2807527162 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488400ab70 con 0x7f489406d2b0 2023-12-08T08:23:13.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.174+0000 7f4899079640 1 -- 172.21.15.88:0/2807527162 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489414ef80 con 0x7f489406d2b0 2023-12-08T08:23:13.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.174+0000 7f4899079640 1 -- 172.21.15.88:0/2807527162 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48940a94f0 con 0x7f489406d2b0 2023-12-08T08:23:13.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.178+0000 7f4899079640 1 -- 172.21.15.88:0/2807527162 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4894067630 con 0x7f489406d2b0 2023-12-08T08:23:13.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.178+0000 7f488bfff640 1 -- 172.21.15.88:0/2807527162 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f488400acd0 con 0x7f489406d2b0 2023-12-08T08:23:13.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.178+0000 7f488bfff640 1 --2- 172.21.15.88:0/2807527162 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4874066470 0x7f4874068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:13.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.178+0000 7f488bfff640 1 -- 172.21.15.88:0/2807527162 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4884083390 con 0x7f489406d2b0 2023-12-08T08:23:13.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.178+0000 7f488a59c640 1 --2- 172.21.15.88:0/2807527162 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4874066470 0x7f4874068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:13.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.178+0000 7f488a59c640 1 --2- 172.21.15.88:0/2807527162 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4874066470 0x7f4874068930 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f487c0af000 tx=0x7f487c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.182+0000 7f488bfff640 1 -- 172.21.15.88:0/2807527162 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4884050820 con 0x7f489406d2b0 2023-12-08T08:23:13.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.334+0000 7f4899079640 1 -- 172.21.15.88:0/2807527162 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f489406bd70 con 0x7f489406d2b0 2023-12-08T08:23:13.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.334+0000 7f488bfff640 1 -- 172.21.15.88:0/2807527162 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16536 (secure 0 0 0) 0x7f4884053e40 con 0x7f489406d2b0 2023-12-08T08:23:13.339 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:13.340 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":68,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:23:01.269360+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:57.367467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:58.632605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:23:13.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.338+0000 7f4899079640 1 -- 172.21.15.88:0/2807527162 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4874066470 msgr2=0x7f4874068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:13.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.338+0000 7f4899079640 1 --2- 172.21.15.88:0/2807527162 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4874066470 0x7f4874068930 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f487c0af000 tx=0x7f487c0a7000 comp rx=0 tx=0).stop 2023-12-08T08:23:13.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.338+0000 7f4899079640 1 -- 172.21.15.88:0/2807527162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f489406d2b0 msgr2=0x7f48940a9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:13.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.338+0000 7f4899079640 1 --2- 172.21.15.88:0/2807527162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f489406d2b0 0x7f48940a9e50 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f4884001570 tx=0x7f488400cd20 comp rx=0 tx=0).stop 2023-12-08T08:23:13.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.338+0000 7f4899079640 1 -- 172.21.15.88:0/2807527162 shutdown_connections 2023-12-08T08:23:13.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.338+0000 7f4899079640 1 --2- 172.21.15.88:0/2807527162 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4874066470 0x7f4874068930 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.338+0000 7f4899079640 1 --2- 172.21.15.88:0/2807527162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f48940c5300 0x7f48940bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.338+0000 7f4899079640 1 --2- 172.21.15.88:0/2807527162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48940c3b80 0x7f48941ed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.338+0000 7f4899079640 1 --2- 172.21.15.88:0/2807527162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f489406d2b0 0x7f48940a9e50 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.338+0000 7f4899079640 1 -- 172.21.15.88:0/2807527162 >> 172.21.15.88:0/2807527162 conn(0x7f48940a7810 msgr2=0x7f489414df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:13.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.338+0000 7f4899079640 1 -- 172.21.15.88:0/2807527162 shutdown_connections 2023-12-08T08:23:13.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.338+0000 7f4899079640 1 -- 172.21.15.88:0/2807527162 wait complete. 2023-12-08T08:23:13.360 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:22:57.367467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:22:58.632605+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:23:13.361 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:23:13.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.494+0000 7f52a9f2a640 1 Processor -- start 2023-12-08T08:23:13.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.494+0000 7f52a9f2a640 1 -- start start 2023-12-08T08:23:13.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.498+0000 7f52a9f2a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52a4151a20 0x7f52a406e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:13.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.498+0000 7f52a9f2a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f52a4154bd0 0x7f52a4155010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:13.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.498+0000 7f52a9f2a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52a40c1810 con 0x7f52a4157a90 2023-12-08T08:23:13.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.498+0000 7f52a9f2a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a40c2720 con 0x7f52a4154bd0 2023-12-08T08:23:13.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.498+0000 7f52a9f2a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a4072c50 con 0x7f52a4151a20 2023-12-08T08:23:13.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.498+0000 7f52a2ffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f52a4157a90 0x7f52a406b5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38588/0 (socket says 172.21.15.88:38588) 2023-12-08T08:23:13.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.498+0000 7f52a2ffd640 1 -- 172.21.15.88:0/2453190452 learned_addr learned my addr 172.21.15.88:0/2453190452 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:13.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.498+0000 7f52a3fff640 1 --2- 172.21.15.88:0/2453190452 >> v2:172.21.15.88:3300/0 conn(0x7f52a4154bd0 0x7f52a4155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:13.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.498+0000 7f52a37fe640 1 --2- 172.21.15.88:0/2453190452 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52a4151a20 0x7f52a406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:13.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.498+0000 7f52a3fff640 1 -- 172.21.15.88:0/2453190452 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52a4151a20 msgr2=0x7f52a406e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:13.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.498+0000 7f52a3fff640 1 --2- 172.21.15.88:0/2453190452 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52a4151a20 0x7f52a406e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.498+0000 7f52a3fff640 1 -- 172.21.15.88:0/2453190452 >> v1:172.21.15.88:6789/0 conn(0x7f52a4157a90 legacy=0x7f52a406b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:13.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.498+0000 7f52a3fff640 1 -- 172.21.15.88:0/2453190452 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a40c2320 con 0x7f52a4154bd0 2023-12-08T08:23:13.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.498+0000 7f52a27fc640 1 -- 172.21.15.88:0/2453190452 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1126844148 0 0) 0x7f52a40c1810 con 0x7f52a4157a90 2023-12-08T08:23:13.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.502+0000 7f52a3fff640 1 --2- 172.21.15.88:0/2453190452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52a4154bd0 0x7f52a4155010 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f529c009d90 tx=0x7f529c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc7278c44cf16c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:13.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.502+0000 7f52a27fc640 1 -- 172.21.15.88:0/2453190452 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c0a5870 con 0x7f52a4154bd0 2023-12-08T08:23:13.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.502+0000 7f52a27fc640 1 -- 172.21.15.88:0/2453190452 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529c0a59d0 con 0x7f52a4154bd0 2023-12-08T08:23:13.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.502+0000 7f52a27fc640 1 -- 172.21.15.88:0/2453190452 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c0a5d60 con 0x7f52a4154bd0 2023-12-08T08:23:13.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.502+0000 7f52a9f2a640 1 -- 172.21.15.88:0/2453190452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52a4154bd0 msgr2=0x7f52a4155010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:13.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.502+0000 7f52a9f2a640 1 --2- 172.21.15.88:0/2453190452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52a4154bd0 0x7f52a4155010 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f529c009d90 tx=0x7f529c01c8c0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.502+0000 7f52a9f2a640 1 -- 172.21.15.88:0/2453190452 shutdown_connections 2023-12-08T08:23:13.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.502+0000 7f52a9f2a640 1 --2- 172.21.15.88:0/2453190452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52a4154bd0 0x7f52a4155010 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.502+0000 7f52a9f2a640 1 --2- 172.21.15.88:0/2453190452 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52a4151a20 0x7f52a406e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.502+0000 7f52a9f2a640 1 -- 172.21.15.88:0/2453190452 >> 172.21.15.88:0/2453190452 conn(0x7f52a40c2e20 msgr2=0x7f52a40c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:13.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.502+0000 7f52a9f2a640 1 -- 172.21.15.88:0/2453190452 shutdown_connections 2023-12-08T08:23:13.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.502+0000 7f52a9f2a640 1 -- 172.21.15.88:0/2453190452 wait complete. 2023-12-08T08:23:13.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.502+0000 7f52a9f2a640 1 Processor -- start 2023-12-08T08:23:13.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.502+0000 7f52a9f2a640 1 -- start start 2023-12-08T08:23:13.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.506+0000 7f52a9f2a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52a4151a20 0x7f52a40c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:13.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.506+0000 7f52a9f2a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52a4154bd0 0x7f52a41499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:13.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.506+0000 7f52a9f2a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52a4157a90 0x7f52a406ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:13.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.506+0000 7f52a9f2a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a40aa9a0 con 0x7f52a4151a20 2023-12-08T08:23:13.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.506+0000 7f52a9f2a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a4149ee0 con 0x7f52a4157a90 2023-12-08T08:23:13.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.506+0000 7f52a9f2a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a40aa310 con 0x7f52a4154bd0 2023-12-08T08:23:13.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.506+0000 7f52a37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52a4151a20 0x7f52a40c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:13.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.506+0000 7f52a37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52a4151a20 0x7f52a40c4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51786/0 (socket says 172.21.15.88:51786) 2023-12-08T08:23:13.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.506+0000 7f52a37fe640 1 -- 172.21.15.88:0/715511443 learned_addr learned my addr 172.21.15.88:0/715511443 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:13.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.506+0000 7f52a2ffd640 1 --2- 172.21.15.88:0/715511443 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52a4154bd0 0x7f52a41499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:13.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.506+0000 7f52a3fff640 1 --2- 172.21.15.88:0/715511443 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52a4157a90 0x7f52a406ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:13.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.506+0000 7f52a37fe640 1 -- 172.21.15.88:0/715511443 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52a4154bd0 msgr2=0x7f52a41499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:13.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.506+0000 7f52a37fe640 1 --2- 172.21.15.88:0/715511443 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52a4154bd0 0x7f52a41499a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.506+0000 7f52a37fe640 1 -- 172.21.15.88:0/715511443 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52a4157a90 msgr2=0x7f52a406ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:13.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.506+0000 7f52a37fe640 1 --2- 172.21.15.88:0/715511443 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52a4157a90 0x7f52a406ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.506+0000 7f52a37fe640 1 -- 172.21.15.88:0/715511443 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529c009a70 con 0x7f52a4151a20 2023-12-08T08:23:13.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.506+0000 7f52a37fe640 1 --2- 172.21.15.88:0/715511443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52a4151a20 0x7f52a40c4350 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f529400e930 tx=0x7f529400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:13.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.506+0000 7f528bfff640 1 -- 172.21.15.88:0/715511443 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5294009690 con 0x7f52a4151a20 2023-12-08T08:23:13.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.506+0000 7f528bfff640 1 -- 172.21.15.88:0/715511443 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529400c8e0 con 0x7f52a4151a20 2023-12-08T08:23:13.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.506+0000 7f528bfff640 1 -- 172.21.15.88:0/715511443 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529400cc50 con 0x7f52a4151a20 2023-12-08T08:23:13.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.506+0000 7f52a9f2a640 1 -- 172.21.15.88:0/715511443 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a40a9ae0 con 0x7f52a4151a20 2023-12-08T08:23:13.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.506+0000 7f52a9f2a640 1 -- 172.21.15.88:0/715511443 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a40c60a0 con 0x7f52a4151a20 2023-12-08T08:23:13.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.506+0000 7f52a9f2a640 1 -- 172.21.15.88:0/715511443 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a4070790 con 0x7f52a4151a20 2023-12-08T08:23:13.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.510+0000 7f528bfff640 1 -- 172.21.15.88:0/715511443 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5294013470 con 0x7f52a4151a20 2023-12-08T08:23:13.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.510+0000 7f528bfff640 1 --2- 172.21.15.88:0/715511443 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f52900664a0 0x7f5290068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:13.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.510+0000 7f528bfff640 1 -- 172.21.15.88:0/715511443 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5294083e50 con 0x7f52a4151a20 2023-12-08T08:23:13.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.510+0000 7f52a2ffd640 1 --2- 172.21.15.88:0/715511443 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f52900664a0 0x7f5290068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:13.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.510+0000 7f52a2ffd640 1 --2- 172.21.15.88:0/715511443 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f52900664a0 0x7f5290068960 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f52a406c9c0 tx=0x7f5298007df0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:13.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.514+0000 7f528bfff640 1 -- 172.21.15.88:0/715511443 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5294051410 con 0x7f52a4151a20 2023-12-08T08:23:13.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.662+0000 7f52a9f2a640 1 -- 172.21.15.88:0/715511443 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52a4066660 con 0x7f52a4151a20 2023-12-08T08:23:13.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.662+0000 7f528bfff640 1 -- 172.21.15.88:0/715511443 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5294054a30 con 0x7f52a4151a20 2023-12-08T08:23:13.668 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:23:13.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.666+0000 7f52a9f2a640 1 -- 172.21.15.88:0/715511443 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f52900664a0 msgr2=0x7f5290068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:13.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.666+0000 7f52a9f2a640 1 --2- 172.21.15.88:0/715511443 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f52900664a0 0x7f5290068960 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f52a406c9c0 tx=0x7f5298007df0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.666+0000 7f52a9f2a640 1 -- 172.21.15.88:0/715511443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52a4151a20 msgr2=0x7f52a40c4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:13.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.666+0000 7f52a9f2a640 1 --2- 172.21.15.88:0/715511443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52a4151a20 0x7f52a40c4350 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f529400e930 tx=0x7f529400edf0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.666+0000 7f52a9f2a640 1 -- 172.21.15.88:0/715511443 shutdown_connections 2023-12-08T08:23:13.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.666+0000 7f52a9f2a640 1 --2- 172.21.15.88:0/715511443 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f52900664a0 0x7f5290068960 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.666+0000 7f52a9f2a640 1 --2- 172.21.15.88:0/715511443 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52a4157a90 0x7f52a406ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.666+0000 7f52a9f2a640 1 --2- 172.21.15.88:0/715511443 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52a4154bd0 0x7f52a41499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.666+0000 7f52a9f2a640 1 --2- 172.21.15.88:0/715511443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52a4151a20 0x7f52a40c4350 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.666+0000 7f52a9f2a640 1 -- 172.21.15.88:0/715511443 >> 172.21.15.88:0/715511443 conn(0x7f52a40c2e20 msgr2=0x7f52a4153af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:13.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.666+0000 7f52a9f2a640 1 -- 172.21.15.88:0/715511443 shutdown_connections 2023-12-08T08:23:13.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.666+0000 7f52a9f2a640 1 -- 172.21.15.88:0/715511443 wait complete. 2023-12-08T08:23:13.689 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:23:13.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.826+0000 7f26847b8640 1 Processor -- start 2023-12-08T08:23:13.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.826+0000 7f26847b8640 1 -- start start 2023-12-08T08:23:13.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.826+0000 7f26847b8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f267c14fc30 0x7f267c0c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:13.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.826+0000 7f26847b8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f267c06d840 0x7f267c0c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:13.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.826+0000 7f26847b8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f267c152910 con 0x7f267c14f850 2023-12-08T08:23:13.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.826+0000 7f26847b8640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f267c0c2240 con 0x7f267c06d840 2023-12-08T08:23:13.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.826+0000 7f26847b8640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267c152bf0 con 0x7f267c14fc30 2023-12-08T08:23:13.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.826+0000 7f2682d55640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f267c06d840 0x7f267c0c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:13.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.826+0000 7f2682554640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f267c14f850 0x7f267c0aacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38594/0 (socket says 172.21.15.88:38594) 2023-12-08T08:23:13.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.826+0000 7f2682554640 1 -- 172.21.15.88:0/3853944324 learned_addr learned my addr 172.21.15.88:0/3853944324 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:13.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.826+0000 7f2681d53640 1 --2- 172.21.15.88:0/3853944324 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f267c14fc30 0x7f267c0c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:13.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.826+0000 7f2682d55640 1 -- 172.21.15.88:0/3853944324 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f267c14fc30 msgr2=0x7f267c0c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:13.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.826+0000 7f2682d55640 1 --2- 172.21.15.88:0/3853944324 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f267c14fc30 0x7f267c0c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.826+0000 7f2682d55640 1 -- 172.21.15.88:0/3853944324 >> v1:172.21.15.88:6789/0 conn(0x7f267c14f850 legacy=0x7f267c0aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:13.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.826+0000 7f2682d55640 1 -- 172.21.15.88:0/3853944324 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267c152ed0 con 0x7f267c06d840 2023-12-08T08:23:13.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.826+0000 7f2681552640 1 -- 172.21.15.88:0/3853944324 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523516515 0 0) 0x7f267c152910 con 0x7f267c14f850 2023-12-08T08:23:13.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.826+0000 7f2681d53640 1 --2- 172.21.15.88:0/3853944324 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f267c14fc30 0x7f267c0c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:13.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.830+0000 7f2682d55640 1 --2- 172.21.15.88:0/3853944324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f267c06d840 0x7f267c0c4210 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f2674009d90 tx=0x7f267401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d838918372f45a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:13.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.830+0000 7f2681552640 1 -- 172.21.15.88:0/3853944324 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26740a5940 con 0x7f267c06d840 2023-12-08T08:23:13.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.830+0000 7f2681552640 1 -- 172.21.15.88:0/3853944324 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26740a5aa0 con 0x7f267c06d840 2023-12-08T08:23:13.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.830+0000 7f2681552640 1 -- 172.21.15.88:0/3853944324 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26740a5e30 con 0x7f267c06d840 2023-12-08T08:23:13.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.830+0000 7f26847b8640 1 -- 172.21.15.88:0/3853944324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f267c06d840 msgr2=0x7f267c0c4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:13.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.830+0000 7f26847b8640 1 --2- 172.21.15.88:0/3853944324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f267c06d840 0x7f267c0c4210 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f2674009d90 tx=0x7f267401c950 comp rx=0 tx=0).stop 2023-12-08T08:23:13.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.830+0000 7f26847b8640 1 -- 172.21.15.88:0/3853944324 shutdown_connections 2023-12-08T08:23:13.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.830+0000 7f26847b8640 1 --2- 172.21.15.88:0/3853944324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f267c06d840 0x7f267c0c4210 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.830+0000 7f26847b8640 1 --2- 172.21.15.88:0/3853944324 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f267c14fc30 0x7f267c0c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.830+0000 7f26847b8640 1 -- 172.21.15.88:0/3853944324 >> 172.21.15.88:0/3853944324 conn(0x7f267c0c59f0 msgr2=0x7f267c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:13.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.830+0000 7f26847b8640 1 -- 172.21.15.88:0/3853944324 shutdown_connections 2023-12-08T08:23:13.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.830+0000 7f26847b8640 1 -- 172.21.15.88:0/3853944324 wait complete. 2023-12-08T08:23:13.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.834+0000 7f26847b8640 1 Processor -- start 2023-12-08T08:23:13.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.834+0000 7f26847b8640 1 -- start start 2023-12-08T08:23:13.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.834+0000 7f26847b8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f267c06d840 0x7f267c1edc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:13.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.834+0000 7f26847b8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f267c14f850 0x7f267c151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:13.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.834+0000 7f26847b8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f267c14fc30 0x7f267c0a9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:13.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.834+0000 7f26847b8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267c140b20 con 0x7f267c14fc30 2023-12-08T08:23:13.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.834+0000 7f26847b8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267c1ee150 con 0x7f267c14f850 2023-12-08T08:23:13.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.834+0000 7f26847b8640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267c0aa420 con 0x7f267c06d840 2023-12-08T08:23:13.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.834+0000 7f2682d55640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f267c14fc30 0x7f267c0a9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:13.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.834+0000 7f2682d55640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f267c14fc30 0x7f267c0a9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51808/0 (socket says 172.21.15.88:51808) 2023-12-08T08:23:13.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.834+0000 7f2682d55640 1 -- 172.21.15.88:0/1316186190 learned_addr learned my addr 172.21.15.88:0/1316186190 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:13.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.834+0000 7f2682554640 1 --2- 172.21.15.88:0/1316186190 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f267c06d840 0x7f267c1edc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:13.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.834+0000 7f2681d53640 1 --2- 172.21.15.88:0/1316186190 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f267c14f850 0x7f267c151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:13.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.834+0000 7f2682d55640 1 -- 172.21.15.88:0/1316186190 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f267c06d840 msgr2=0x7f267c1edc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:13.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.834+0000 7f2682d55640 1 --2- 172.21.15.88:0/1316186190 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f267c06d840 0x7f267c1edc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.834+0000 7f2682d55640 1 -- 172.21.15.88:0/1316186190 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f267c14f850 msgr2=0x7f267c151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:13.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.834+0000 7f2682d55640 1 --2- 172.21.15.88:0/1316186190 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f267c14f850 0x7f267c151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:13.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.834+0000 7f2682d55640 1 -- 172.21.15.88:0/1316186190 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2674009a70 con 0x7f267c14fc30 2023-12-08T08:23:13.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.834+0000 7f2682554640 1 --2- 172.21.15.88:0/1316186190 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f267c06d840 0x7f267c1edc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:13.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.834+0000 7f2682d55640 1 --2- 172.21.15.88:0/1316186190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f267c14fc30 0x7f267c0a9600 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f267401b000 tx=0x7f26740196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:13.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.834+0000 7f2672ffd640 1 -- 172.21.15.88:0/1316186190 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26740ade40 con 0x7f267c14fc30 2023-12-08T08:23:13.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.834+0000 7f2672ffd640 1 -- 172.21.15.88:0/1316186190 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26740b9450 con 0x7f267c14fc30 2023-12-08T08:23:13.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.834+0000 7f26847b8640 1 -- 172.21.15.88:0/1316186190 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f267c0a8b60 con 0x7f267c14fc30 2023-12-08T08:23:13.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.834+0000 7f2672ffd640 1 -- 172.21.15.88:0/1316186190 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26740b97e0 con 0x7f267c14fc30 2023-12-08T08:23:13.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.834+0000 7f26847b8640 1 -- 172.21.15.88:0/1316186190 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f267c0a8e00 con 0x7f267c14fc30 2023-12-08T08:23:13.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.834+0000 7f26847b8640 1 -- 172.21.15.88:0/1316186190 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f267c067630 con 0x7f267c14fc30 2023-12-08T08:23:13.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.838+0000 7f2672ffd640 1 -- 172.21.15.88:0/1316186190 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f26740039a0 con 0x7f267c14fc30 2023-12-08T08:23:13.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.838+0000 7f2672ffd640 1 --2- 172.21.15.88:0/1316186190 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f26600664a0 0x7f2660068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:13.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.838+0000 7f2672ffd640 1 -- 172.21.15.88:0/1316186190 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f267411f260 con 0x7f267c14fc30 2023-12-08T08:23:13.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.838+0000 7f2682554640 1 --2- 172.21.15.88:0/1316186190 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f26600664a0 0x7f2660068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:13.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.838+0000 7f2682554640 1 --2- 172.21.15.88:0/1316186190 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f26600664a0 0x7f2660068960 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2678007fd0 tx=0x7f2678007c20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:13.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.842+0000 7f2672ffd640 1 -- 172.21.15.88:0/1316186190 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f26740ec790 con 0x7f267c14fc30 2023-12-08T08:23:13.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.994+0000 7f26847b8640 1 -- 172.21.15.88:0/1316186190 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f267c0a4a90 con 0x7f267c14fc30 2023-12-08T08:23:13.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.994+0000 7f2672ffd640 1 -- 172.21.15.88:0/1316186190 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v68) v1 ==== 104+0+11 (secure 0 0 0) 0x7f26740efdb0 con 0x7f267c14fc30 2023-12-08T08:23:13.998 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:23:13.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.994+0000 7f26847b8640 1 -- 172.21.15.88:0/1316186190 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f26600664a0 msgr2=0x7f2660068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:13.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.994+0000 7f26847b8640 1 --2- 172.21.15.88:0/1316186190 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f26600664a0 0x7f2660068960 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2678007fd0 tx=0x7f2678007c20 comp rx=0 tx=0).stop 2023-12-08T08:23:13.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.994+0000 7f26847b8640 1 -- 172.21.15.88:0/1316186190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f267c14fc30 msgr2=0x7f267c0a9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:14.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.994+0000 7f26847b8640 1 --2- 172.21.15.88:0/1316186190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f267c14fc30 0x7f267c0a9600 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f267401b000 tx=0x7f26740196f0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.994+0000 7f26847b8640 1 -- 172.21.15.88:0/1316186190 shutdown_connections 2023-12-08T08:23:14.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.994+0000 7f26847b8640 1 --2- 172.21.15.88:0/1316186190 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f26600664a0 0x7f2660068960 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.994+0000 7f26847b8640 1 --2- 172.21.15.88:0/1316186190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f267c14fc30 0x7f267c0a9600 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.994+0000 7f26847b8640 1 --2- 172.21.15.88:0/1316186190 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f267c14f850 0x7f267c151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.994+0000 7f26847b8640 1 --2- 172.21.15.88:0/1316186190 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f267c06d840 0x7f267c1edc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.994+0000 7f26847b8640 1 -- 172.21.15.88:0/1316186190 >> 172.21.15.88:0/1316186190 conn(0x7f267c0c59f0 msgr2=0x7f267c0befa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:14.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.994+0000 7f26847b8640 1 -- 172.21.15.88:0/1316186190 shutdown_connections 2023-12-08T08:23:14.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:13.994+0000 7f26847b8640 1 -- 172.21.15.88:0/1316186190 wait complete. 2023-12-08T08:23:14.018 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:23:14.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.154+0000 7fcad5854640 1 Processor -- start 2023-12-08T08:23:14.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.154+0000 7fcad5854640 1 -- start start 2023-12-08T08:23:14.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.154+0000 7fcad5854640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcad00c5f60 0x7fcad00c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:14.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.154+0000 7fcad5854640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcad00c4870 0x7fcad00c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:14.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.154+0000 7fcad5854640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad00c6a10 con 0x7fcad0155310 2023-12-08T08:23:14.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.154+0000 7fcad5854640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad00c2740 con 0x7fcad00c5f60 2023-12-08T08:23:14.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.154+0000 7fcad5854640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad006bc80 con 0x7fcad00c4870 2023-12-08T08:23:14.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.154+0000 7fcace7fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcad00c5f60 0x7fcad00c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:14.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.154+0000 7fcace7fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcad00c5f60 0x7fcad00c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51816/0 (socket says 172.21.15.88:51816) 2023-12-08T08:23:14.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.154+0000 7fcace7fc640 1 -- 172.21.15.88:0/4032028056 learned_addr learned my addr 172.21.15.88:0/4032028056 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:14.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.154+0000 7fcacf7fe640 1 --2- 172.21.15.88:0/4032028056 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcad00c4870 0x7fcad00c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:14.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.154+0000 7fcace7fc640 1 -- 172.21.15.88:0/4032028056 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcad00c4870 msgr2=0x7fcad00c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:14.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.154+0000 7fcace7fc640 1 --2- 172.21.15.88:0/4032028056 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcad00c4870 0x7fcad00c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.154+0000 7fcace7fc640 1 -- 172.21.15.88:0/4032028056 >> v1:172.21.15.148:6789/0 conn(0x7fcad0155310 legacy=0x7fcad0158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:14.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.154+0000 7fcace7fc640 1 -- 172.21.15.88:0/4032028056 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad00c2f80 con 0x7fcad00c5f60 2023-12-08T08:23:14.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.158+0000 7fcace7fc640 1 --2- 172.21.15.88:0/4032028056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcad00c5f60 0x7fcad00c4330 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fcac4009870 tx=0x7fcac401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d65b906cd16d34d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:14.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.158+0000 7fcacdffb640 1 -- 172.21.15.88:0/4032028056 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac40ab620 con 0x7fcad00c5f60 2023-12-08T08:23:14.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.158+0000 7fcacdffb640 1 -- 172.21.15.88:0/4032028056 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac40ab780 con 0x7fcad00c5f60 2023-12-08T08:23:14.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.158+0000 7fcacdffb640 1 -- 172.21.15.88:0/4032028056 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac40abb10 con 0x7fcad00c5f60 2023-12-08T08:23:14.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.158+0000 7fcad5854640 1 -- 172.21.15.88:0/4032028056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcad00c5f60 msgr2=0x7fcad00c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:14.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.158+0000 7fcad5854640 1 --2- 172.21.15.88:0/4032028056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcad00c5f60 0x7fcad00c4330 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fcac4009870 tx=0x7fcac401c510 comp rx=0 tx=0).stop 2023-12-08T08:23:14.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.158+0000 7fcad5854640 1 -- 172.21.15.88:0/4032028056 shutdown_connections 2023-12-08T08:23:14.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.158+0000 7fcad5854640 1 --2- 172.21.15.88:0/4032028056 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcad00c4870 0x7fcad00c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.158+0000 7fcad5854640 1 --2- 172.21.15.88:0/4032028056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcad00c5f60 0x7fcad00c4330 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.158+0000 7fcad5854640 1 -- 172.21.15.88:0/4032028056 >> 172.21.15.88:0/4032028056 conn(0x7fcad00a9830 msgr2=0x7fcad00a9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:14.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.158+0000 7fcad5854640 1 -- 172.21.15.88:0/4032028056 shutdown_connections 2023-12-08T08:23:14.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.158+0000 7fcad5854640 1 -- 172.21.15.88:0/4032028056 wait complete. 2023-12-08T08:23:14.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.162+0000 7fcad5854640 1 Processor -- start 2023-12-08T08:23:14.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.162+0000 7fcad5854640 1 -- start start 2023-12-08T08:23:14.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.162+0000 7fcad5854640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcad00c4870 0x7fcad01f17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:14.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.162+0000 7fcad5854640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcad00c5f60 0x7fcad00a8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:14.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.162+0000 7fcad5854640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcad0155310 0x7fcad01edfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:14.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.162+0000 7fcad5854640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad01f1d10 con 0x7fcad00c5f60 2023-12-08T08:23:14.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.162+0000 7fcad5854640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad01ed890 con 0x7fcad0155310 2023-12-08T08:23:14.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.162+0000 7fcad5854640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad01edb30 con 0x7fcad00c4870 2023-12-08T08:23:14.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.162+0000 7fcace7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcad00c5f60 0x7fcad00a8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:14.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.162+0000 7fcace7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcad00c5f60 0x7fcad00a8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51824/0 (socket says 172.21.15.88:51824) 2023-12-08T08:23:14.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.162+0000 7fcace7fc640 1 -- 172.21.15.88:0/89410348 learned_addr learned my addr 172.21.15.88:0/89410348 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:14.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.162+0000 7fcaceffd640 1 --2- 172.21.15.88:0/89410348 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcad00c4870 0x7fcad01f17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:14.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.162+0000 7fcacf7fe640 1 --2- 172.21.15.88:0/89410348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcad0155310 0x7fcad01edfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:14.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.162+0000 7fcace7fc640 1 -- 172.21.15.88:0/89410348 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcad00c4870 msgr2=0x7fcad01f17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:14.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.162+0000 7fcace7fc640 1 --2- 172.21.15.88:0/89410348 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcad00c4870 0x7fcad01f17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.162+0000 7fcace7fc640 1 -- 172.21.15.88:0/89410348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcad0155310 msgr2=0x7fcad01edfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:14.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.162+0000 7fcace7fc640 1 --2- 172.21.15.88:0/89410348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcad0155310 0x7fcad01edfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.162+0000 7fcace7fc640 1 -- 172.21.15.88:0/89410348 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac40094d0 con 0x7fcad00c5f60 2023-12-08T08:23:14.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.162+0000 7fcace7fc640 1 --2- 172.21.15.88:0/89410348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcad00c5f60 0x7fcad00a8a30 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fcac40ad040 tx=0x7fcac401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:14.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.162+0000 7fcab7fff640 1 -- 172.21.15.88:0/89410348 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac40be3f0 con 0x7fcad00c5f60 2023-12-08T08:23:14.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.162+0000 7fcab7fff640 1 -- 172.21.15.88:0/89410348 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac40be570 con 0x7fcad00c5f60 2023-12-08T08:23:14.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.162+0000 7fcad5854640 1 -- 172.21.15.88:0/89410348 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad0158980 con 0x7fcad00c5f60 2023-12-08T08:23:14.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.162+0000 7fcab7fff640 1 -- 172.21.15.88:0/89410348 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac40be920 con 0x7fcad00c5f60 2023-12-08T08:23:14.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.162+0000 7fcad5854640 1 -- 172.21.15.88:0/89410348 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad0157c30 con 0x7fcad00c5f60 2023-12-08T08:23:14.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.166+0000 7fcad5854640 1 -- 172.21.15.88:0/89410348 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad01edca0 con 0x7fcad00c5f60 2023-12-08T08:23:14.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.166+0000 7fcab7fff640 1 -- 172.21.15.88:0/89410348 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcac40b43f0 con 0x7fcad00c5f60 2023-12-08T08:23:14.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.166+0000 7fcab7fff640 1 --2- 172.21.15.88:0/89410348 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcabc0664a0 0x7fcabc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:14.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.166+0000 7fcab7fff640 1 -- 172.21.15.88:0/89410348 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcac411e510 con 0x7fcad00c5f60 2023-12-08T08:23:14.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.166+0000 7fcaceffd640 1 --2- 172.21.15.88:0/89410348 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcabc0664a0 0x7fcabc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:14.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.166+0000 7fcaceffd640 1 --2- 172.21.15.88:0/89410348 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcabc0664a0 0x7fcabc068960 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fcac0000f70 tx=0x7fcac0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:14.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.170+0000 7fcab7fff640 1 -- 172.21.15.88:0/89410348 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcac40eba20 con 0x7fcad00c5f60 2023-12-08T08:23:14.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.318+0000 7fcad5854640 1 -- 172.21.15.88:0/89410348 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcad0067630 con 0x7fcad00c5f60 2023-12-08T08:23:14.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.318+0000 7fcab7fff640 1 -- 172.21.15.88:0/89410348 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v68) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcac411ce60 con 0x7fcad00c5f60 2023-12-08T08:23:14.324 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:23:14.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.322+0000 7fcad5854640 1 -- 172.21.15.88:0/89410348 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcabc0664a0 msgr2=0x7fcabc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:14.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.322+0000 7fcad5854640 1 --2- 172.21.15.88:0/89410348 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcabc0664a0 0x7fcabc068960 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fcac0000f70 tx=0x7fcac0009040 comp rx=0 tx=0).stop 2023-12-08T08:23:14.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.322+0000 7fcad5854640 1 -- 172.21.15.88:0/89410348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcad00c5f60 msgr2=0x7fcad00a8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:14.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.322+0000 7fcad5854640 1 --2- 172.21.15.88:0/89410348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcad00c5f60 0x7fcad00a8a30 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fcac40ad040 tx=0x7fcac401ad50 comp rx=0 tx=0).stop 2023-12-08T08:23:14.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.322+0000 7fcad5854640 1 -- 172.21.15.88:0/89410348 shutdown_connections 2023-12-08T08:23:14.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.322+0000 7fcad5854640 1 --2- 172.21.15.88:0/89410348 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcabc0664a0 0x7fcabc068960 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.322+0000 7fcad5854640 1 --2- 172.21.15.88:0/89410348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcad0155310 0x7fcad01edfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.322+0000 7fcad5854640 1 --2- 172.21.15.88:0/89410348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcad00c5f60 0x7fcad00a8a30 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.322+0000 7fcad5854640 1 --2- 172.21.15.88:0/89410348 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcad00c4870 0x7fcad01f17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.322+0000 7fcad5854640 1 -- 172.21.15.88:0/89410348 >> 172.21.15.88:0/89410348 conn(0x7fcad00a9830 msgr2=0x7fcad00a9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:14.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.322+0000 7fcad5854640 1 -- 172.21.15.88:0/89410348 shutdown_connections 2023-12-08T08:23:14.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.322+0000 7fcad5854640 1 -- 172.21.15.88:0/89410348 wait complete. 2023-12-08T08:23:14.345 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-08T08:23:14.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.478+0000 7f43d4079640 1 Processor -- start 2023-12-08T08:23:14.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.478+0000 7f43d4079640 1 -- start start 2023-12-08T08:23:14.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.478+0000 7f43d4079640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43cc06bef0 0x7f43cc0bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:14.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.478+0000 7f43d4079640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f43cc14e3f0 0x7f43cc06c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:14.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.478+0000 7f43d4079640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f43cc06caf0 0x7f43cc154180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:14.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.478+0000 7f43d4079640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43cc151690 con 0x7f43cc14e3f0 2023-12-08T08:23:14.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.478+0000 7f43d4079640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43cc151bc0 con 0x7f43cc06caf0 2023-12-08T08:23:14.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.478+0000 7f43d4079640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc1518e0 con 0x7f43cc06bef0 2023-12-08T08:23:14.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.478+0000 7f43d1614640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f43cc14e3f0 0x7f43cc06c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:14.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.478+0000 7f43d1614640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f43cc14e3f0 0x7f43cc06c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51834/0 (socket says 172.21.15.88:51834) 2023-12-08T08:23:14.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.478+0000 7f43d1614640 1 -- 172.21.15.88:0/4043811843 learned_addr learned my addr 172.21.15.88:0/4043811843 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:14.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.478+0000 7f43d1e15640 1 --2- 172.21.15.88:0/4043811843 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43cc06bef0 0x7f43cc0bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:14.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.478+0000 7f43d2616640 1 --2- 172.21.15.88:0/4043811843 >> v2:172.21.15.148:3300/0 conn(0x7f43cc06caf0 0x7f43cc154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:14.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.478+0000 7f43d1614640 1 -- 172.21.15.88:0/4043811843 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43cc06bef0 msgr2=0x7f43cc0bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:14.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.478+0000 7f43d1614640 1 --2- 172.21.15.88:0/4043811843 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43cc06bef0 0x7f43cc0bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.478+0000 7f43d1614640 1 -- 172.21.15.88:0/4043811843 >> v2:172.21.15.148:3300/0 conn(0x7f43cc06caf0 msgr2=0x7f43cc154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:14.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.478+0000 7f43d1614640 1 --2- 172.21.15.88:0/4043811843 >> v2:172.21.15.148:3300/0 conn(0x7f43cc06caf0 0x7f43cc154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.478+0000 7f43d1614640 1 -- 172.21.15.88:0/4043811843 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc0c1de0 con 0x7f43cc14e3f0 2023-12-08T08:23:14.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.482+0000 7f43d1614640 1 --2- 172.21.15.88:0/4043811843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43cc14e3f0 0x7f43cc06c5b0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0a5750 tx=0x7f43bc01e680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=683436ad57140823 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:14.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.482+0000 7f43d0e13640 1 -- 172.21.15.88:0/4043811843 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc0ad650 con 0x7f43cc14e3f0 2023-12-08T08:23:14.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.482+0000 7f43d0e13640 1 -- 172.21.15.88:0/4043811843 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43bc0ad7b0 con 0x7f43cc14e3f0 2023-12-08T08:23:14.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.482+0000 7f43d0e13640 1 -- 172.21.15.88:0/4043811843 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc0adb40 con 0x7f43cc14e3f0 2023-12-08T08:23:14.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.482+0000 7f43d4079640 1 -- 172.21.15.88:0/4043811843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43cc14e3f0 msgr2=0x7f43cc06c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:14.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.482+0000 7f43d4079640 1 --2- 172.21.15.88:0/4043811843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43cc14e3f0 0x7f43cc06c5b0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0a5750 tx=0x7f43bc01e680 comp rx=0 tx=0).stop 2023-12-08T08:23:14.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.482+0000 7f43d4079640 1 -- 172.21.15.88:0/4043811843 shutdown_connections 2023-12-08T08:23:14.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.482+0000 7f43d4079640 1 --2- 172.21.15.88:0/4043811843 >> v2:172.21.15.148:3300/0 conn(0x7f43cc06caf0 0x7f43cc154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.482+0000 7f43d4079640 1 --2- 172.21.15.88:0/4043811843 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43cc14e3f0 0x7f43cc06c5b0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.482+0000 7f43d4079640 1 --2- 172.21.15.88:0/4043811843 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43cc06bef0 0x7f43cc0bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.482+0000 7f43d4079640 1 -- 172.21.15.88:0/4043811843 >> 172.21.15.88:0/4043811843 conn(0x7f43cc0a7810 msgr2=0x7f43cc0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:14.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.482+0000 7f43d4079640 1 -- 172.21.15.88:0/4043811843 shutdown_connections 2023-12-08T08:23:14.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.482+0000 7f43d4079640 1 -- 172.21.15.88:0/4043811843 wait complete. 2023-12-08T08:23:14.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.486+0000 7f43d4079640 1 Processor -- start 2023-12-08T08:23:14.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.486+0000 7f43d4079640 1 -- start start 2023-12-08T08:23:14.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.486+0000 7f43d4079640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43cc06bef0 0x7f43cc1ee1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:14.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.486+0000 7f43d4079640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43cc06caf0 0x7f43cc1f1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:14.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.486+0000 7f43d4079640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43cc14e3f0 0x7f43cc0a9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:14.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.486+0000 7f43d4079640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc1f1ac0 con 0x7f43cc14e3f0 2023-12-08T08:23:14.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.486+0000 7f43d4079640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc1edd60 con 0x7f43cc06bef0 2023-12-08T08:23:14.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.486+0000 7f43d4079640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc153f60 con 0x7f43cc06caf0 2023-12-08T08:23:14.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.486+0000 7f43d2616640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43cc14e3f0 0x7f43cc0a9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:14.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.486+0000 7f43d2616640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43cc14e3f0 0x7f43cc0a9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51848/0 (socket says 172.21.15.88:51848) 2023-12-08T08:23:14.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.486+0000 7f43d2616640 1 -- 172.21.15.88:0/937206900 learned_addr learned my addr 172.21.15.88:0/937206900 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:14.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.486+0000 7f43d1e15640 1 --2- 172.21.15.88:0/937206900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43cc06bef0 0x7f43cc1ee1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:14.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.486+0000 7f43d1614640 1 --2- 172.21.15.88:0/937206900 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43cc06caf0 0x7f43cc1f1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:14.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.486+0000 7f43d2616640 1 -- 172.21.15.88:0/937206900 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43cc06caf0 msgr2=0x7f43cc1f1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:14.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.486+0000 7f43d2616640 1 --2- 172.21.15.88:0/937206900 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43cc06caf0 0x7f43cc1f1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.486+0000 7f43d2616640 1 -- 172.21.15.88:0/937206900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43cc06bef0 msgr2=0x7f43cc1ee1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:14.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.486+0000 7f43d2616640 1 --2- 172.21.15.88:0/937206900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43cc06bef0 0x7f43cc1ee1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.486+0000 7f43d2616640 1 -- 172.21.15.88:0/937206900 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc0094d0 con 0x7f43cc14e3f0 2023-12-08T08:23:14.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.486+0000 7f43d2616640 1 --2- 172.21.15.88:0/937206900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43cc14e3f0 0x7f43cc0a9010 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f43c4007d90 tx=0x7f43c400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:14.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.486+0000 7f43c27fc640 1 -- 172.21.15.88:0/937206900 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4014420 con 0x7f43cc14e3f0 2023-12-08T08:23:14.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.486+0000 7f43c27fc640 1 -- 172.21.15.88:0/937206900 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c40145a0 con 0x7f43cc14e3f0 2023-12-08T08:23:14.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.486+0000 7f43d4079640 1 -- 172.21.15.88:0/937206900 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43cc1ed710 con 0x7f43cc14e3f0 2023-12-08T08:23:14.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.486+0000 7f43c27fc640 1 -- 172.21.15.88:0/937206900 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4014950 con 0x7f43cc14e3f0 2023-12-08T08:23:14.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.486+0000 7f43d4079640 1 -- 172.21.15.88:0/937206900 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43cc0a9550 con 0x7f43cc14e3f0 2023-12-08T08:23:14.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.486+0000 7f43d4079640 1 -- 172.21.15.88:0/937206900 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43cc1edef0 con 0x7f43cc14e3f0 2023-12-08T08:23:14.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.490+0000 7f43c27fc640 1 -- 172.21.15.88:0/937206900 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f43c4014ab0 con 0x7f43cc14e3f0 2023-12-08T08:23:14.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.490+0000 7f43c27fc640 1 --2- 172.21.15.88:0/937206900 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f43b0066470 0x7f43b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:14.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.490+0000 7f43c27fc640 1 -- 172.21.15.88:0/937206900 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43c40847b0 con 0x7f43cc14e3f0 2023-12-08T08:23:14.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.490+0000 7f43d1e15640 1 --2- 172.21.15.88:0/937206900 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f43b0066470 0x7f43b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:14.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.490+0000 7f43d1e15640 1 --2- 172.21.15.88:0/937206900 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f43b0066470 0x7f43b0068930 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f43cc06c9e0 tx=0x7f43c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:14.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.494+0000 7f43c27fc640 1 -- 172.21.15.88:0/937206900 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f43c4051b90 con 0x7f43cc14e3f0 2023-12-08T08:23:14.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.646+0000 7f43d4079640 1 -- 172.21.15.88:0/937206900 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f43cc067630 con 0x7f43cc14e3f0 2023-12-08T08:23:14.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.646+0000 7f43c27fc640 1 -- 172.21.15.88:0/937206900 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) v1 ==== 84+0+209 (secure 0 0 0) 0x7f43c40551b0 con 0x7f43cc14e3f0 2023-12-08T08:23:14.651 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:14.652 INFO:teuthology.orchestra.run.smithi088.stdout:[ 2023-12-08T08:23:14.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:23:14.652 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 1, 2023-12-08T08:23:14.652 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": ".mgr" 2023-12-08T08:23:14.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:23:14.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:23:14.652 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 12, 2023-12-08T08:23:14.652 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": "cephfs_metadata" 2023-12-08T08:23:14.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-12-08T08:23:14.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-12-08T08:23:14.652 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 13, 2023-12-08T08:23:14.653 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": "cephfs_data" 2023-12-08T08:23:14.653 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-12-08T08:23:14.653 INFO:teuthology.orchestra.run.smithi088.stdout:] 2023-12-08T08:23:14.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.650+0000 7f43d4079640 1 -- 172.21.15.88:0/937206900 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f43b0066470 msgr2=0x7f43b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:14.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.650+0000 7f43d4079640 1 --2- 172.21.15.88:0/937206900 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f43b0066470 0x7f43b0068930 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f43cc06c9e0 tx=0x7f43c8008040 comp rx=0 tx=0).stop 2023-12-08T08:23:14.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.650+0000 7f43d4079640 1 -- 172.21.15.88:0/937206900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43cc14e3f0 msgr2=0x7f43cc0a9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:14.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.650+0000 7f43d4079640 1 --2- 172.21.15.88:0/937206900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43cc14e3f0 0x7f43cc0a9010 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f43c4007d90 tx=0x7f43c400e4b0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.650+0000 7f43d4079640 1 -- 172.21.15.88:0/937206900 shutdown_connections 2023-12-08T08:23:14.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.650+0000 7f43d4079640 1 --2- 172.21.15.88:0/937206900 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f43b0066470 0x7f43b0068930 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.650+0000 7f43d4079640 1 --2- 172.21.15.88:0/937206900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43cc14e3f0 0x7f43cc0a9010 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.650+0000 7f43d4079640 1 --2- 172.21.15.88:0/937206900 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f43cc06caf0 0x7f43cc1f1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.650+0000 7f43d4079640 1 --2- 172.21.15.88:0/937206900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43cc06bef0 0x7f43cc1ee1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.650+0000 7f43d4079640 1 -- 172.21.15.88:0/937206900 >> 172.21.15.88:0/937206900 conn(0x7f43cc0a7810 msgr2=0x7f43cc14d700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:14.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.650+0000 7f43d4079640 1 -- 172.21.15.88:0/937206900 shutdown_connections 2023-12-08T08:23:14.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.650+0000 7f43d4079640 1 -- 172.21.15.88:0/937206900 wait complete. 2023-12-08T08:23:14.672 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-12-08T08:23:14.672 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-12-08T08:23:14.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.810+0000 7fa10e817640 1 Processor -- start 2023-12-08T08:23:14.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.810+0000 7fa10e817640 1 -- start start 2023-12-08T08:23:14.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.810+0000 7fa10e817640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa10814b1e0 0x7fa1080c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:14.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.810+0000 7fa10e817640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa1080c5300 0x7fa1080a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:14.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.810+0000 7fa10e817640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1080a4e20 con 0x7fa108151280 2023-12-08T08:23:14.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.810+0000 7fa10e817640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1081558d0 con 0x7fa1080c5300 2023-12-08T08:23:14.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.810+0000 7fa10e817640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1080a50e0 con 0x7fa10814b1e0 2023-12-08T08:23:14.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.810+0000 7fa1077fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa1080c5300 0x7fa1080a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:14.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.814+0000 7fa1077fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa1080c5300 0x7fa1080a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51858/0 (socket says 172.21.15.88:51858) 2023-12-08T08:23:14.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.814+0000 7fa1077fe640 1 -- 172.21.15.88:0/3440067872 learned_addr learned my addr 172.21.15.88:0/3440067872 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:14.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.814+0000 7fa107fff640 1 --2- 172.21.15.88:0/3440067872 >> v2:172.21.15.148:3300/0 conn(0x7fa10814b1e0 0x7fa1080c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:14.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.814+0000 7fa1077fe640 1 -- 172.21.15.88:0/3440067872 >> v2:172.21.15.148:3300/0 conn(0x7fa10814b1e0 msgr2=0x7fa1080c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:14.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.814+0000 7fa1077fe640 1 --2- 172.21.15.88:0/3440067872 >> v2:172.21.15.148:3300/0 conn(0x7fa10814b1e0 0x7fa1080c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.814+0000 7fa1077fe640 1 -- 172.21.15.88:0/3440067872 >> v1:172.21.15.148:6789/0 conn(0x7fa108151280 legacy=0x7fa1081516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:14.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.814+0000 7fa1077fe640 1 -- 172.21.15.88:0/3440067872 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1080c0f00 con 0x7fa1080c5300 2023-12-08T08:23:14.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.814+0000 7fa107fff640 1 --2- 172.21.15.88:0/3440067872 >> v2:172.21.15.148:3300/0 conn(0x7fa10814b1e0 0x7fa1080c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:14.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.814+0000 7fa1077fe640 1 --2- 172.21.15.88:0/3440067872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1080c5300 0x7fa1080a9c30 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fa1080c4150 tx=0x7fa0fc01e710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29a6db006c87f73 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:14.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.814+0000 7fa106ffd640 1 -- 172.21.15.88:0/3440067872 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc0ad620 con 0x7fa1080c5300 2023-12-08T08:23:14.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.814+0000 7fa106ffd640 1 -- 172.21.15.88:0/3440067872 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0fc0ad780 con 0x7fa1080c5300 2023-12-08T08:23:14.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.814+0000 7fa106ffd640 1 -- 172.21.15.88:0/3440067872 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc0adb10 con 0x7fa1080c5300 2023-12-08T08:23:14.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.818+0000 7fa10e817640 1 -- 172.21.15.88:0/3440067872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1080c5300 msgr2=0x7fa1080a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:14.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.818+0000 7fa10e817640 1 --2- 172.21.15.88:0/3440067872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1080c5300 0x7fa1080a9c30 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fa1080c4150 tx=0x7fa0fc01e710 comp rx=0 tx=0).stop 2023-12-08T08:23:14.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.818+0000 7fa10e817640 1 -- 172.21.15.88:0/3440067872 shutdown_connections 2023-12-08T08:23:14.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.818+0000 7fa10e817640 1 --2- 172.21.15.88:0/3440067872 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1080c5300 0x7fa1080a9c30 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.818+0000 7fa10e817640 1 --2- 172.21.15.88:0/3440067872 >> v2:172.21.15.148:3300/0 conn(0x7fa10814b1e0 0x7fa1080c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.818+0000 7fa10e817640 1 -- 172.21.15.88:0/3440067872 >> 172.21.15.88:0/3440067872 conn(0x7fa1080c59f0 msgr2=0x7fa1080c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:14.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.818+0000 7fa10e817640 1 -- 172.21.15.88:0/3440067872 shutdown_connections 2023-12-08T08:23:14.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.818+0000 7fa10e817640 1 -- 172.21.15.88:0/3440067872 wait complete. 2023-12-08T08:23:14.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.818+0000 7fa10e817640 1 Processor -- start 2023-12-08T08:23:14.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.818+0000 7fa10e817640 1 -- start start 2023-12-08T08:23:14.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.818+0000 7fa10e817640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1080c5300 0x7fa10806bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:14.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.818+0000 7fa10e817640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa10814b1e0 0x7fa1081e94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:14.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.818+0000 7fa10e817640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa108151280 0x7fa10806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:14.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.818+0000 7fa10e817640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10806caf0 con 0x7fa10814b1e0 2023-12-08T08:23:14.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.818+0000 7fa10e817640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10813c500 con 0x7fa108151280 2023-12-08T08:23:14.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.818+0000 7fa10e817640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa108148900 con 0x7fa1080c5300 2023-12-08T08:23:14.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.818+0000 7fa1077fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa10814b1e0 0x7fa1081e94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:14.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.818+0000 7fa1077fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa10814b1e0 0x7fa1081e94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51872/0 (socket says 172.21.15.88:51872) 2023-12-08T08:23:14.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.818+0000 7fa1077fe640 1 -- 172.21.15.88:0/1563536582 learned_addr learned my addr 172.21.15.88:0/1563536582 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:14.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.818+0000 7fa107fff640 1 --2- 172.21.15.88:0/1563536582 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1080c5300 0x7fa10806bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:14.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.818+0000 7fa10cdb4640 1 --2- 172.21.15.88:0/1563536582 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa108151280 0x7fa10806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:14.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.818+0000 7fa1077fe640 1 -- 172.21.15.88:0/1563536582 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1080c5300 msgr2=0x7fa10806bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:14.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.818+0000 7fa1077fe640 1 --2- 172.21.15.88:0/1563536582 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1080c5300 0x7fa10806bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.818+0000 7fa1077fe640 1 -- 172.21.15.88:0/1563536582 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa108151280 msgr2=0x7fa10806cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:14.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.818+0000 7fa1077fe640 1 --2- 172.21.15.88:0/1563536582 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa108151280 0x7fa10806cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:14.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.818+0000 7fa1077fe640 1 -- 172.21.15.88:0/1563536582 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0fc0094d0 con 0x7fa10814b1e0 2023-12-08T08:23:14.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.818+0000 7fa1077fe640 1 --2- 172.21.15.88:0/1563536582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa10814b1e0 0x7fa1081e94f0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc01b320 tx=0x7fa0fc01cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:14.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.822+0000 7fa104ff9640 1 -- 172.21.15.88:0/1563536582 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc0b8440 con 0x7fa10814b1e0 2023-12-08T08:23:14.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.822+0000 7fa104ff9640 1 -- 172.21.15.88:0/1563536582 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0fc0b85a0 con 0x7fa10814b1e0 2023-12-08T08:23:14.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.822+0000 7fa104ff9640 1 -- 172.21.15.88:0/1563536582 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc0b8950 con 0x7fa10814b1e0 2023-12-08T08:23:14.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.822+0000 7fa10e817640 1 -- 172.21.15.88:0/1563536582 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1081ecc90 con 0x7fa10814b1e0 2023-12-08T08:23:14.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.822+0000 7fa10e817640 1 -- 172.21.15.88:0/1563536582 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1081e8fd0 con 0x7fa10814b1e0 2023-12-08T08:23:14.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.822+0000 7fa10e817640 1 -- 172.21.15.88:0/1563536582 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa108067630 con 0x7fa10814b1e0 2023-12-08T08:23:14.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.822+0000 7fa104ff9640 1 -- 172.21.15.88:0/1563536582 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa0fc0b8ab0 con 0x7fa10814b1e0 2023-12-08T08:23:14.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.822+0000 7fa104ff9640 1 --2- 172.21.15.88:0/1563536582 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa0f4066470 0x7fa0f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:14.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.822+0000 7fa104ff9640 1 -- 172.21.15.88:0/1563536582 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0fc11e6c0 con 0x7fa10814b1e0 2023-12-08T08:23:14.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.822+0000 7fa107fff640 1 --2- 172.21.15.88:0/1563536582 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa0f4066470 0x7fa0f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:14.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.822+0000 7fa107fff640 1 --2- 172.21.15.88:0/1563536582 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa0f4066470 0x7fa0f4068930 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa1080c1930 tx=0x7fa0f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:14.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.826+0000 7fa104ff9640 1 -- 172.21.15.88:0/1563536582 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa0fc0ebbe0 con 0x7fa10814b1e0 2023-12-08T08:23:14.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:14.982+0000 7fa10e817640 1 -- 172.21.15.88:0/1563536582 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa1081e9190 con 0x7fa10814b1e0 2023-12-08T08:23:15.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:15.878+0000 7fa104ff9640 1 -- 172.21.15.88:0/1563536582 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v69) v1 ==== 140+0+0 (secure 0 0 0) 0x7fa0fc0ef200 con 0x7fa10814b1e0 2023-12-08T08:23:15.881 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs2_metadata' created 2023-12-08T08:23:15.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:15.878+0000 7fa10e817640 1 -- 172.21.15.88:0/1563536582 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa0f4066470 msgr2=0x7fa0f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:15.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:15.878+0000 7fa10e817640 1 --2- 172.21.15.88:0/1563536582 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa0f4066470 0x7fa0f4068930 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa1080c1930 tx=0x7fa0f8008040 comp rx=0 tx=0).stop 2023-12-08T08:23:15.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:15.878+0000 7fa10e817640 1 -- 172.21.15.88:0/1563536582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa10814b1e0 msgr2=0x7fa1081e94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:15.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:15.878+0000 7fa10e817640 1 --2- 172.21.15.88:0/1563536582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa10814b1e0 0x7fa1081e94f0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc01b320 tx=0x7fa0fc01cf50 comp rx=0 tx=0).stop 2023-12-08T08:23:15.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:15.878+0000 7fa10e817640 1 -- 172.21.15.88:0/1563536582 shutdown_connections 2023-12-08T08:23:15.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:15.878+0000 7fa10e817640 1 --2- 172.21.15.88:0/1563536582 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa0f4066470 0x7fa0f4068930 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:15.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:15.878+0000 7fa10e817640 1 --2- 172.21.15.88:0/1563536582 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa108151280 0x7fa10806cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:15.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:15.878+0000 7fa10e817640 1 --2- 172.21.15.88:0/1563536582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa10814b1e0 0x7fa1081e94f0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:15.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:15.878+0000 7fa10e817640 1 --2- 172.21.15.88:0/1563536582 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa1080c5300 0x7fa10806bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:15.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:15.878+0000 7fa10e817640 1 -- 172.21.15.88:0/1563536582 >> 172.21.15.88:0/1563536582 conn(0x7fa1080c59f0 msgr2=0x7fa108149470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:15.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:15.878+0000 7fa10e817640 1 -- 172.21.15.88:0/1563536582 shutdown_connections 2023-12-08T08:23:15.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:15.878+0000 7fa10e817640 1 -- 172.21.15.88:0/1563536582 wait complete. 2023-12-08T08:23:15.912 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-08T08:23:16.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.054+0000 7fed06fdf640 1 Processor -- start 2023-12-08T08:23:16.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.054+0000 7fed06fdf640 1 -- start start 2023-12-08T08:23:16.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.054+0000 7fed06fdf640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fed0014f850 0x7fed000aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:16.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.054+0000 7fed06fdf640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fed0006d840 0x7fed000c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:16.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.054+0000 7fed06fdf640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed00152910 con 0x7fed0014fc30 2023-12-08T08:23:16.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.054+0000 7fed06fdf640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed000c2240 con 0x7fed0006d840 2023-12-08T08:23:16.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.054+0000 7fed06fdf640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed00152bf0 con 0x7fed0014f850 2023-12-08T08:23:16.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.054+0000 7fed0557c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fed0006d840 0x7fed000c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:16.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.054+0000 7fed0557c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fed0006d840 0x7fed000c43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51884/0 (socket says 172.21.15.88:51884) 2023-12-08T08:23:16.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.054+0000 7fed0557c640 1 -- 172.21.15.88:0/3507753955 learned_addr learned my addr 172.21.15.88:0/3507753955 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:16.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.054+0000 7fed04d7b640 1 --2- 172.21.15.88:0/3507753955 >> v2:172.21.15.148:3300/0 conn(0x7fed0014f850 0x7fed000aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:16.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.054+0000 7fed0557c640 1 -- 172.21.15.88:0/3507753955 >> v2:172.21.15.148:3300/0 conn(0x7fed0014f850 msgr2=0x7fed000aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:16.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.054+0000 7fed0557c640 1 --2- 172.21.15.88:0/3507753955 >> v2:172.21.15.148:3300/0 conn(0x7fed0014f850 0x7fed000aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:16.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.054+0000 7fed0557c640 1 -- 172.21.15.88:0/3507753955 >> v1:172.21.15.148:6789/0 conn(0x7fed0014fc30 legacy=0x7fed000c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:16.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.054+0000 7fed0557c640 1 -- 172.21.15.88:0/3507753955 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed00152ed0 con 0x7fed0006d840 2023-12-08T08:23:16.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.054+0000 7fed04d7b640 1 --2- 172.21.15.88:0/3507753955 >> v2:172.21.15.148:3300/0 conn(0x7fed0014f850 0x7fed000aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:16.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.058+0000 7fed0557c640 1 --2- 172.21.15.88:0/3507753955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed0006d840 0x7fed000c43e0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fed00066f50 tx=0x7fecf801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7401568037a881e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:16.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.058+0000 7fecf77fe640 1 -- 172.21.15.88:0/3507753955 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf80aa640 con 0x7fed0006d840 2023-12-08T08:23:16.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.058+0000 7fecf77fe640 1 -- 172.21.15.88:0/3507753955 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf80aa7a0 con 0x7fed0006d840 2023-12-08T08:23:16.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.058+0000 7fecf77fe640 1 -- 172.21.15.88:0/3507753955 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf80aab30 con 0x7fed0006d840 2023-12-08T08:23:16.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.058+0000 7fed06fdf640 1 -- 172.21.15.88:0/3507753955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed0006d840 msgr2=0x7fed000c43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:16.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.058+0000 7fed06fdf640 1 --2- 172.21.15.88:0/3507753955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed0006d840 0x7fed000c43e0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fed00066f50 tx=0x7fecf801c4c0 comp rx=0 tx=0).stop 2023-12-08T08:23:16.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.058+0000 7fed06fdf640 1 -- 172.21.15.88:0/3507753955 shutdown_connections 2023-12-08T08:23:16.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.058+0000 7fed06fdf640 1 --2- 172.21.15.88:0/3507753955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed0006d840 0x7fed000c43e0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:16.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.058+0000 7fed06fdf640 1 --2- 172.21.15.88:0/3507753955 >> v2:172.21.15.148:3300/0 conn(0x7fed0014f850 0x7fed000aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:16.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.058+0000 7fed06fdf640 1 -- 172.21.15.88:0/3507753955 >> 172.21.15.88:0/3507753955 conn(0x7fed000c59f0 msgr2=0x7fed000c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:16.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.058+0000 7fed06fdf640 1 -- 172.21.15.88:0/3507753955 shutdown_connections 2023-12-08T08:23:16.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.058+0000 7fed06fdf640 1 -- 172.21.15.88:0/3507753955 wait complete. 2023-12-08T08:23:16.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.062+0000 7fed06fdf640 1 Processor -- start 2023-12-08T08:23:16.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.062+0000 7fed06fdf640 1 -- start start 2023-12-08T08:23:16.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.062+0000 7fed06fdf640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed0006d840 0x7fed000befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:16.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.062+0000 7fed06fdf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed0014f850 0x7fed000a8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:16.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.062+0000 7fed06fdf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed0014fc30 0x7fed0014bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:16.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.062+0000 7fed06fdf640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed000aab50 con 0x7fed0014fc30 2023-12-08T08:23:16.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.062+0000 7fed06fdf640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed000aa870 con 0x7fed0014f850 2023-12-08T08:23:16.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.062+0000 7fed06fdf640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed001f0960 con 0x7fed0006d840 2023-12-08T08:23:16.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.062+0000 7fed0557c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed0014fc30 0x7fed0014bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:16.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.062+0000 7fed0557c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed0014fc30 0x7fed0014bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51898/0 (socket says 172.21.15.88:51898) 2023-12-08T08:23:16.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.062+0000 7fed04d7b640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed0006d840 0x7fed000befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:16.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.062+0000 7fed0557c640 1 -- 172.21.15.88:0/2751813932 learned_addr learned my addr 172.21.15.88:0/2751813932 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:16.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.062+0000 7fecf7fff640 1 --2- 172.21.15.88:0/2751813932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed0014f850 0x7fed000a8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:16.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.062+0000 7fed0557c640 1 -- 172.21.15.88:0/2751813932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed0006d840 msgr2=0x7fed000befc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:16.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.062+0000 7fed0557c640 1 --2- 172.21.15.88:0/2751813932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed0006d840 0x7fed000befc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:16.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.062+0000 7fed0557c640 1 -- 172.21.15.88:0/2751813932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed0014f850 msgr2=0x7fed000a8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:16.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.062+0000 7fed0557c640 1 --2- 172.21.15.88:0/2751813932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed0014f850 0x7fed000a8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:16.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.062+0000 7fed0557c640 1 -- 172.21.15.88:0/2751813932 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf80094d0 con 0x7fed0014fc30 2023-12-08T08:23:16.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.062+0000 7fed0557c640 1 --2- 172.21.15.88:0/2751813932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed0014fc30 0x7fed0014bbf0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fecf80ac040 tx=0x7fecf801ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:16.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.062+0000 7fecf57fa640 1 -- 172.21.15.88:0/2751813932 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf80bd5f0 con 0x7fed0014fc30 2023-12-08T08:23:16.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.062+0000 7fecf57fa640 1 -- 172.21.15.88:0/2751813932 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf80bd770 con 0x7fed0014fc30 2023-12-08T08:23:16.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.062+0000 7fecf57fa640 1 -- 172.21.15.88:0/2751813932 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf80bdb20 con 0x7fed0014fc30 2023-12-08T08:23:16.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.062+0000 7fed06fdf640 1 -- 172.21.15.88:0/2751813932 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed001f0c40 con 0x7fed0014fc30 2023-12-08T08:23:16.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.062+0000 7fed06fdf640 1 -- 172.21.15.88:0/2751813932 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed000bfd40 con 0x7fed0014fc30 2023-12-08T08:23:16.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.062+0000 7fed06fdf640 1 -- 172.21.15.88:0/2751813932 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed001f07c0 con 0x7fed0014fc30 2023-12-08T08:23:16.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.066+0000 7fecf57fa640 1 -- 172.21.15.88:0/2751813932 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fecf80a8050 con 0x7fed0014fc30 2023-12-08T08:23:16.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.066+0000 7fecf57fa640 1 --2- 172.21.15.88:0/2751813932 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fecec066470 0x7fecec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:16.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.066+0000 7fecf57fa640 1 -- 172.21.15.88:0/2751813932 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6080+0+0 (secure 0 0 0) 0x7fecf811e5f0 con 0x7fed0014fc30 2023-12-08T08:23:16.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.066+0000 7fed04d7b640 1 --2- 172.21.15.88:0/2751813932 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fecec066470 0x7fecec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:16.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.066+0000 7fed04d7b640 1 --2- 172.21.15.88:0/2751813932 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fecec066470 0x7fecec068930 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fecfc00d620 tx=0x7fecfc007810 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:16.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.070+0000 7fecf57fa640 1 -- 172.21.15.88:0/2751813932 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fecf80ebc60 con 0x7fed0014fc30 2023-12-08T08:23:16.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.222+0000 7fed06fdf640 1 -- 172.21.15.88:0/2751813932 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fed001f07c0 con 0x7fed0014fc30 2023-12-08T08:23:16.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.882+0000 7fecf57fa640 1 -- 172.21.15.88:0/2751813932 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v70) v1 ==== 172+0+0 (secure 0 0 0) 0x7fed001f07c0 con 0x7fed0014fc30 2023-12-08T08:23:16.888 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs2_data' created 2023-12-08T08:23:16.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.886+0000 7fed06fdf640 1 -- 172.21.15.88:0/2751813932 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fecec066470 msgr2=0x7fecec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:16.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.886+0000 7fed06fdf640 1 --2- 172.21.15.88:0/2751813932 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fecec066470 0x7fecec068930 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fecfc00d620 tx=0x7fecfc007810 comp rx=0 tx=0).stop 2023-12-08T08:23:16.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.886+0000 7fed06fdf640 1 -- 172.21.15.88:0/2751813932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed0014fc30 msgr2=0x7fed0014bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:16.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.886+0000 7fed06fdf640 1 --2- 172.21.15.88:0/2751813932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed0014fc30 0x7fed0014bbf0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fecf80ac040 tx=0x7fecf801ad00 comp rx=0 tx=0).stop 2023-12-08T08:23:16.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.886+0000 7fed06fdf640 1 -- 172.21.15.88:0/2751813932 shutdown_connections 2023-12-08T08:23:16.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.886+0000 7fed06fdf640 1 --2- 172.21.15.88:0/2751813932 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fecec066470 0x7fecec068930 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:16.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.886+0000 7fed06fdf640 1 --2- 172.21.15.88:0/2751813932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed0014fc30 0x7fed0014bbf0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:16.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.886+0000 7fed06fdf640 1 --2- 172.21.15.88:0/2751813932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed0014f850 0x7fed000a8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:16.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.886+0000 7fed06fdf640 1 --2- 172.21.15.88:0/2751813932 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fed0006d840 0x7fed000befc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:16.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.886+0000 7fed06fdf640 1 -- 172.21.15.88:0/2751813932 >> 172.21.15.88:0/2751813932 conn(0x7fed000c59f0 msgr2=0x7fed0014ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:16.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.886+0000 7fed06fdf640 1 -- 172.21.15.88:0/2751813932 shutdown_connections 2023-12-08T08:23:16.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:16.886+0000 7fed06fdf640 1 -- 172.21.15.88:0/2751813932 wait complete. 2023-12-08T08:23:16.929 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-12-08T08:23:17.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.066+0000 7f6a84679640 1 Processor -- start 2023-12-08T08:23:17.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.066+0000 7f6a84679640 1 -- start start 2023-12-08T08:23:17.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.066+0000 7f6a84679640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6a7c14b1e0 0x7f6a7c0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:17.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.066+0000 7f6a84679640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7c0a4e20 con 0x7f6a7c1548c0 2023-12-08T08:23:17.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.066+0000 7f6a84679640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7c0a50e0 con 0x7f6a7c0c5300 2023-12-08T08:23:17.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.066+0000 7f6a84679640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a7c0c0f00 con 0x7f6a7c14b1e0 2023-12-08T08:23:17.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.066+0000 7f6a82415640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6a7c14b1e0 0x7f6a7c0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:17.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.066+0000 7f6a82c16640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6a7c1548c0 0x7f6a7c154d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38602/0 (socket says 172.21.15.88:38602) 2023-12-08T08:23:17.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.066+0000 7f6a82c16640 1 -- 172.21.15.88:0/1860319761 learned_addr learned my addr 172.21.15.88:0/1860319761 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:17.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.066+0000 7f6a82415640 1 -- 172.21.15.88:0/1860319761 >> v1:172.21.15.148:6789/0 conn(0x7f6a7c0c5300 legacy=0x7f6a7c0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:17.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.066+0000 7f6a82415640 1 -- 172.21.15.88:0/1860319761 >> v1:172.21.15.88:6789/0 conn(0x7f6a7c1548c0 legacy=0x7f6a7c154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:17.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.066+0000 7f6a82415640 1 -- 172.21.15.88:0/1860319761 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7c0c11e0 con 0x7f6a7c14b1e0 2023-12-08T08:23:17.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.066+0000 7f6a81413640 1 -- 172.21.15.88:0/1860319761 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4167775312 0 0) 0x7f6a7c0a4e20 con 0x7f6a7c1548c0 2023-12-08T08:23:17.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.070+0000 7f6a82415640 1 --2- 172.21.15.88:0/1860319761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7c14b1e0 0x7f6a7c0c1700 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f6a780097c0 tx=0x7f6a7801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f47ca268747ee1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:17.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.070+0000 7f6a81413640 1 -- 172.21.15.88:0/1860319761 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a780ab600 con 0x7f6a7c14b1e0 2023-12-08T08:23:17.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.070+0000 7f6a81413640 1 -- 172.21.15.88:0/1860319761 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a780a7050 con 0x7f6a7c14b1e0 2023-12-08T08:23:17.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.070+0000 7f6a81413640 1 -- 172.21.15.88:0/1860319761 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a780ab980 con 0x7f6a7c14b1e0 2023-12-08T08:23:17.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.070+0000 7f6a84679640 1 -- 172.21.15.88:0/1860319761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7c14b1e0 msgr2=0x7f6a7c0c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:17.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.070+0000 7f6a84679640 1 --2- 172.21.15.88:0/1860319761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7c14b1e0 0x7f6a7c0c1700 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f6a780097c0 tx=0x7f6a7801c480 comp rx=0 tx=0).stop 2023-12-08T08:23:17.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.070+0000 7f6a84679640 1 -- 172.21.15.88:0/1860319761 shutdown_connections 2023-12-08T08:23:17.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.070+0000 7f6a84679640 1 --2- 172.21.15.88:0/1860319761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7c14b1e0 0x7f6a7c0c1700 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:17.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.070+0000 7f6a84679640 1 -- 172.21.15.88:0/1860319761 >> 172.21.15.88:0/1860319761 conn(0x7f6a7c0c59f0 msgr2=0x7f6a7c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:17.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.070+0000 7f6a84679640 1 -- 172.21.15.88:0/1860319761 shutdown_connections 2023-12-08T08:23:17.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.070+0000 7f6a84679640 1 -- 172.21.15.88:0/1860319761 wait complete. 2023-12-08T08:23:17.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.074+0000 7f6a84679640 1 Processor -- start 2023-12-08T08:23:17.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.074+0000 7f6a84679640 1 -- start start 2023-12-08T08:23:17.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.074+0000 7f6a84679640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7c0c5300 0x7f6a7c149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:17.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.074+0000 7f6a84679640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a7c14b1e0 0x7f6a7c0a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:17.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.074+0000 7f6a84679640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a7c1548c0 0x7f6a7c0a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:17.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.074+0000 7f6a84679640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c1532b0 con 0x7f6a7c0c5300 2023-12-08T08:23:17.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.074+0000 7f6a84679640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c0a6a20 con 0x7f6a7c1548c0 2023-12-08T08:23:17.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.074+0000 7f6a84679640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c0a6d00 con 0x7f6a7c14b1e0 2023-12-08T08:23:17.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.074+0000 7f6a82415640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7c0c5300 0x7f6a7c149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:17.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.074+0000 7f6a82415640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7c0c5300 0x7f6a7c149430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51906/0 (socket says 172.21.15.88:51906) 2023-12-08T08:23:17.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.074+0000 7f6a82415640 1 -- 172.21.15.88:0/1756035397 learned_addr learned my addr 172.21.15.88:0/1756035397 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:17.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.074+0000 7f6a81c14640 1 --2- 172.21.15.88:0/1756035397 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a7c14b1e0 0x7f6a7c0a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:17.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.074+0000 7f6a82c16640 1 --2- 172.21.15.88:0/1756035397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a7c1548c0 0x7f6a7c0a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:17.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.074+0000 7f6a82415640 1 -- 172.21.15.88:0/1756035397 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a7c14b1e0 msgr2=0x7f6a7c0a5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:17.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.074+0000 7f6a82415640 1 --2- 172.21.15.88:0/1756035397 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a7c14b1e0 0x7f6a7c0a5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:17.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.074+0000 7f6a82415640 1 -- 172.21.15.88:0/1756035397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a7c1548c0 msgr2=0x7f6a7c0a62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:17.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.074+0000 7f6a82415640 1 --2- 172.21.15.88:0/1756035397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a7c1548c0 0x7f6a7c0a62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:17.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.074+0000 7f6a82415640 1 -- 172.21.15.88:0/1756035397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a78009420 con 0x7f6a7c0c5300 2023-12-08T08:23:17.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.074+0000 7f6a81c14640 1 --2- 172.21.15.88:0/1756035397 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a7c14b1e0 0x7f6a7c0a5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:17.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.074+0000 7f6a82c16640 1 --2- 172.21.15.88:0/1756035397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a7c1548c0 0x7f6a7c0a62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:17.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.074+0000 7f6a82415640 1 --2- 172.21.15.88:0/1756035397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7c0c5300 0x7f6a7c149430 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f6a7801a0b0 tx=0x7f6a7801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:17.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.074+0000 7f6a72ffd640 1 -- 172.21.15.88:0/1756035397 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a78004020 con 0x7f6a7c0c5300 2023-12-08T08:23:17.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.074+0000 7f6a72ffd640 1 -- 172.21.15.88:0/1756035397 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a78004180 con 0x7f6a7c0c5300 2023-12-08T08:23:17.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.074+0000 7f6a84679640 1 -- 172.21.15.88:0/1756035397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7c0a6fe0 con 0x7f6a7c0c5300 2023-12-08T08:23:17.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.074+0000 7f6a72ffd640 1 -- 172.21.15.88:0/1756035397 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a780044f0 con 0x7f6a7c0c5300 2023-12-08T08:23:17.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.074+0000 7f6a84679640 1 -- 172.21.15.88:0/1756035397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7c152f40 con 0x7f6a7c0c5300 2023-12-08T08:23:17.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.078+0000 7f6a84679640 1 -- 172.21.15.88:0/1756035397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a7c067630 con 0x7f6a7c0c5300 2023-12-08T08:23:17.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.078+0000 7f6a72ffd640 1 -- 172.21.15.88:0/1756035397 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6a78003620 con 0x7f6a7c0c5300 2023-12-08T08:23:17.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.078+0000 7f6a72ffd640 1 --2- 172.21.15.88:0/1756035397 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6a60066470 0x7f6a60068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:17.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.078+0000 7f6a72ffd640 1 -- 172.21.15.88:0/1756035397 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f6a7811ebd0 con 0x7f6a7c0c5300 2023-12-08T08:23:17.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.078+0000 7f6a81c14640 1 --2- 172.21.15.88:0/1756035397 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6a60066470 0x7f6a60068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:17.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.082+0000 7f6a81c14640 1 --2- 172.21.15.88:0/1756035397 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6a60066470 0x7f6a60068930 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c06feb0 tx=0x7f6a6c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:17.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.082+0000 7f6a72ffd640 1 -- 172.21.15.88:0/1756035397 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6a780ebdd0 con 0x7f6a7c0c5300 2023-12-08T08:23:17.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.262+0000 7f6a84679640 1 -- 172.21.15.88:0/1756035397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f6a7c0c3740 con 0x7f6a7c0c5300 2023-12-08T08:23:17.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.886+0000 7f6a72ffd640 1 -- 172.21.15.88:0/1756035397 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 14 and data pool 15 v48) v1 ==== 177+0+0 (secure 0 0 0) 0x7f6a780c30c0 con 0x7f6a7c0c5300 2023-12-08T08:23:17.891 INFO:teuthology.orchestra.run.smithi088.stderr:new fs with metadata pool 14 and data pool 15 2023-12-08T08:23:17.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.890+0000 7f6a84679640 1 -- 172.21.15.88:0/1756035397 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6a60066470 msgr2=0x7f6a60068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:17.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.890+0000 7f6a84679640 1 --2- 172.21.15.88:0/1756035397 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6a60066470 0x7f6a60068930 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c06feb0 tx=0x7f6a6c009040 comp rx=0 tx=0).stop 2023-12-08T08:23:17.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.890+0000 7f6a84679640 1 -- 172.21.15.88:0/1756035397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7c0c5300 msgr2=0x7f6a7c149430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:17.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.890+0000 7f6a84679640 1 --2- 172.21.15.88:0/1756035397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7c0c5300 0x7f6a7c149430 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f6a7801a0b0 tx=0x7f6a7801acc0 comp rx=0 tx=0).stop 2023-12-08T08:23:17.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.890+0000 7f6a84679640 1 -- 172.21.15.88:0/1756035397 shutdown_connections 2023-12-08T08:23:17.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.890+0000 7f6a84679640 1 --2- 172.21.15.88:0/1756035397 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6a60066470 0x7f6a60068930 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:17.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.890+0000 7f6a84679640 1 --2- 172.21.15.88:0/1756035397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a7c1548c0 0x7f6a7c0a62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:17.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.890+0000 7f6a84679640 1 --2- 172.21.15.88:0/1756035397 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6a7c14b1e0 0x7f6a7c0a5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:17.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.890+0000 7f6a84679640 1 --2- 172.21.15.88:0/1756035397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a7c0c5300 0x7f6a7c149430 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:17.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.890+0000 7f6a84679640 1 -- 172.21.15.88:0/1756035397 >> 172.21.15.88:0/1756035397 conn(0x7f6a7c0c59f0 msgr2=0x7f6a7c0c5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:17.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.894+0000 7f6a84679640 1 -- 172.21.15.88:0/1756035397 shutdown_connections 2023-12-08T08:23:17.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:17.894+0000 7f6a84679640 1 -- 172.21.15.88:0/1756035397 wait complete. 2023-12-08T08:23:17.945 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:23:18.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.078+0000 7f7e5b9b8640 1 Processor -- start 2023-12-08T08:23:18.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.078+0000 7f7e5b9b8640 1 -- start start 2023-12-08T08:23:18.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.078+0000 7f7e5b9b8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7e5414fd10 0x7f7e540a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:18.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.078+0000 7f7e5b9b8640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7e540a5300 0x7f7e54071e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:18.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.078+0000 7f7e5b9b8640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e540c5710 con 0x7f7e54072370 2023-12-08T08:23:18.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.078+0000 7f7e5b9b8640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e5406c5e0 con 0x7f7e5414fd10 2023-12-08T08:23:18.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.078+0000 7f7e5b9b8640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e54155c80 con 0x7f7e540a5300 2023-12-08T08:23:18.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.078+0000 7f7e59754640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7e5414fd10 0x7f7e540a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:18.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.078+0000 7f7e59754640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7e5414fd10 0x7f7e540a4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51914/0 (socket says 172.21.15.88:51914) 2023-12-08T08:23:18.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.078+0000 7f7e59754640 1 -- 172.21.15.88:0/98887662 learned_addr learned my addr 172.21.15.88:0/98887662 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:18.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.078+0000 7f7e58f53640 1 --2- 172.21.15.88:0/98887662 >> v2:172.21.15.148:3300/0 conn(0x7f7e540a5300 0x7f7e54071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:18.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.078+0000 7f7e59754640 1 -- 172.21.15.88:0/98887662 >> v2:172.21.15.148:3300/0 conn(0x7f7e540a5300 msgr2=0x7f7e54071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:18.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.078+0000 7f7e59754640 1 --2- 172.21.15.88:0/98887662 >> v2:172.21.15.148:3300/0 conn(0x7f7e540a5300 0x7f7e54071e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:18.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.078+0000 7f7e59754640 1 -- 172.21.15.88:0/98887662 >> v1:172.21.15.148:6789/0 conn(0x7f7e54072370 legacy=0x7f7e54156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:18.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.078+0000 7f7e59754640 1 -- 172.21.15.88:0/98887662 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e540c4e70 con 0x7f7e5414fd10 2023-12-08T08:23:18.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.082+0000 7f7e59754640 1 --2- 172.21.15.88:0/98887662 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e5414fd10 0x7f7e540a4dc0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f7e54066e30 tx=0x7f7e5001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=548557f22a8d9f3f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:18.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.082+0000 7f7e4bfff640 1 -- 172.21.15.88:0/98887662 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e500ac410 con 0x7f7e5414fd10 2023-12-08T08:23:18.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.082+0000 7f7e4bfff640 1 -- 172.21.15.88:0/98887662 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e500ac570 con 0x7f7e5414fd10 2023-12-08T08:23:18.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.082+0000 7f7e4bfff640 1 -- 172.21.15.88:0/98887662 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e500ac900 con 0x7f7e5414fd10 2023-12-08T08:23:18.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.082+0000 7f7e5b9b8640 1 -- 172.21.15.88:0/98887662 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e5414fd10 msgr2=0x7f7e540a4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:18.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.082+0000 7f7e5b9b8640 1 --2- 172.21.15.88:0/98887662 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e5414fd10 0x7f7e540a4dc0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f7e54066e30 tx=0x7f7e5001c3b0 comp rx=0 tx=0).stop 2023-12-08T08:23:18.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.082+0000 7f7e5b9b8640 1 -- 172.21.15.88:0/98887662 shutdown_connections 2023-12-08T08:23:18.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.082+0000 7f7e5b9b8640 1 --2- 172.21.15.88:0/98887662 >> v2:172.21.15.148:3300/0 conn(0x7f7e540a5300 0x7f7e54071e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:18.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.082+0000 7f7e5b9b8640 1 --2- 172.21.15.88:0/98887662 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e5414fd10 0x7f7e540a4dc0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:18.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.082+0000 7f7e5b9b8640 1 -- 172.21.15.88:0/98887662 >> 172.21.15.88:0/98887662 conn(0x7f7e540a7810 msgr2=0x7f7e540a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:18.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.082+0000 7f7e5b9b8640 1 -- 172.21.15.88:0/98887662 shutdown_connections 2023-12-08T08:23:18.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.082+0000 7f7e5b9b8640 1 -- 172.21.15.88:0/98887662 wait complete. 2023-12-08T08:23:18.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.086+0000 7f7e5b9b8640 1 Processor -- start 2023-12-08T08:23:18.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.086+0000 7f7e5b9b8640 1 -- start start 2023-12-08T08:23:18.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.086+0000 7f7e5b9b8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e54072370 0x7f7e5415c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:18.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.086+0000 7f7e5b9b8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e540a5300 0x7f7e54071680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:18.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.086+0000 7f7e5b9b8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7e5414fd10 0x7f7e5413d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:18.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.086+0000 7f7e5b9b8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5414c480 con 0x7f7e54072370 2023-12-08T08:23:18.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.086+0000 7f7e5b9b8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e540a9f50 con 0x7f7e540a5300 2023-12-08T08:23:18.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.086+0000 7f7e5b9b8640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e540a8d90 con 0x7f7e5414fd10 2023-12-08T08:23:18.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.086+0000 7f7e59754640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e54072370 0x7f7e5415c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:18.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.086+0000 7f7e59754640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e54072370 0x7f7e5415c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51930/0 (socket says 172.21.15.88:51930) 2023-12-08T08:23:18.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.086+0000 7f7e59754640 1 -- 172.21.15.88:0/1897848029 learned_addr learned my addr 172.21.15.88:0/1897848029 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:18.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.086+0000 7f7e58f53640 1 --2- 172.21.15.88:0/1897848029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e540a5300 0x7f7e54071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:18.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.086+0000 7f7e59f55640 1 --2- 172.21.15.88:0/1897848029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7e5414fd10 0x7f7e5413d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:18.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.086+0000 7f7e59754640 1 -- 172.21.15.88:0/1897848029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7e5414fd10 msgr2=0x7f7e5413d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:18.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.086+0000 7f7e59754640 1 --2- 172.21.15.88:0/1897848029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7e5414fd10 0x7f7e5413d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:18.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.086+0000 7f7e59754640 1 -- 172.21.15.88:0/1897848029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e540a5300 msgr2=0x7f7e54071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:18.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.086+0000 7f7e59754640 1 --2- 172.21.15.88:0/1897848029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e540a5300 0x7f7e54071680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:18.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.086+0000 7f7e59754640 1 -- 172.21.15.88:0/1897848029 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e500094d0 con 0x7f7e54072370 2023-12-08T08:23:18.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.086+0000 7f7e59754640 1 --2- 172.21.15.88:0/1897848029 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e54072370 0x7f7e5415c2e0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f7e50018fc0 tx=0x7f7e50019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:18.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.086+0000 7f7e49ffb640 1 -- 172.21.15.88:0/1897848029 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e500ac410 con 0x7f7e54072370 2023-12-08T08:23:18.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.086+0000 7f7e49ffb640 1 -- 172.21.15.88:0/1897848029 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e500ace90 con 0x7f7e54072370 2023-12-08T08:23:18.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.086+0000 7f7e49ffb640 1 -- 172.21.15.88:0/1897848029 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e500b6830 con 0x7f7e54072370 2023-12-08T08:23:18.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.086+0000 7f7e5b9b8640 1 -- 172.21.15.88:0/1897848029 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e540a9070 con 0x7f7e54072370 2023-12-08T08:23:18.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.086+0000 7f7e5b9b8640 1 -- 172.21.15.88:0/1897848029 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e540a9be0 con 0x7f7e54072370 2023-12-08T08:23:18.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.090+0000 7f7e5b9b8640 1 -- 172.21.15.88:0/1897848029 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e54067630 con 0x7f7e54072370 2023-12-08T08:23:18.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.090+0000 7f7e49ffb640 1 -- 172.21.15.88:0/1897848029 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7e500b6990 con 0x7f7e54072370 2023-12-08T08:23:18.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.090+0000 7f7e49ffb640 1 --2- 172.21.15.88:0/1897848029 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7e38066470 0x7f7e38068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:18.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.090+0000 7f7e49ffb640 1 -- 172.21.15.88:0/1897848029 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7e5011e960 con 0x7f7e54072370 2023-12-08T08:23:18.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.090+0000 7f7e58f53640 1 --2- 172.21.15.88:0/1897848029 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7e38066470 0x7f7e38068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:18.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.090+0000 7f7e58f53640 1 --2- 172.21.15.88:0/1897848029 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7e38066470 0x7f7e38068930 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7e540c0e50 tx=0x7f7e44009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:18.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.094+0000 7f7e49ffb640 1 -- 172.21.15.88:0/1897848029 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7e500ebb90 con 0x7f7e54072370 2023-12-08T08:23:18.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.246+0000 7f7e5b9b8640 1 -- 172.21.15.88:0/1897848029 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e540c4b20 con 0x7f7e54072370 2023-12-08T08:23:18.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.246+0000 7f7e49ffb640 1 -- 172.21.15.88:0/1897848029 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+20203 (secure 0 0 0) 0x7f7e500ef1b0 con 0x7f7e54072370 2023-12-08T08:23:18.252 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:18.252 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":71,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:23:17.267691+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:57.367467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:58.632605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:23:15.029129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:23:16.271716+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:23:18.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.250+0000 7f7e5b9b8640 1 -- 172.21.15.88:0/1897848029 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7e38066470 msgr2=0x7f7e38068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:18.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.250+0000 7f7e5b9b8640 1 --2- 172.21.15.88:0/1897848029 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7e38066470 0x7f7e38068930 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7e540c0e50 tx=0x7f7e44009190 comp rx=0 tx=0).stop 2023-12-08T08:23:18.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.250+0000 7f7e5b9b8640 1 -- 172.21.15.88:0/1897848029 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e54072370 msgr2=0x7f7e5415c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:18.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.250+0000 7f7e5b9b8640 1 --2- 172.21.15.88:0/1897848029 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e54072370 0x7f7e5415c2e0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f7e50018fc0 tx=0x7f7e50019150 comp rx=0 tx=0).stop 2023-12-08T08:23:18.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.250+0000 7f7e5b9b8640 1 -- 172.21.15.88:0/1897848029 shutdown_connections 2023-12-08T08:23:18.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.250+0000 7f7e5b9b8640 1 --2- 172.21.15.88:0/1897848029 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7e38066470 0x7f7e38068930 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:18.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.250+0000 7f7e5b9b8640 1 --2- 172.21.15.88:0/1897848029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7e5414fd10 0x7f7e5413d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:18.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.250+0000 7f7e5b9b8640 1 --2- 172.21.15.88:0/1897848029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e540a5300 0x7f7e54071680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:18.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.250+0000 7f7e5b9b8640 1 --2- 172.21.15.88:0/1897848029 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e54072370 0x7f7e5415c2e0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:18.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.250+0000 7f7e5b9b8640 1 -- 172.21.15.88:0/1897848029 >> 172.21.15.88:0/1897848029 conn(0x7f7e540a7810 msgr2=0x7f7e54156110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:18.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.250+0000 7f7e5b9b8640 1 -- 172.21.15.88:0/1897848029 shutdown_connections 2023-12-08T08:23:18.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.250+0000 7f7e5b9b8640 1 -- 172.21.15.88:0/1897848029 wait complete. 2023-12-08T08:23:18.273 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:23:18.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.406+0000 7fc34bf1d640 1 Processor -- start 2023-12-08T08:23:18.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.406+0000 7fc34bf1d640 1 -- start start 2023-12-08T08:23:18.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.406+0000 7fc34bf1d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc3440af4c0 0x7fc344154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:18.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.406+0000 7fc34bf1d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc34406c100 0x7fc3440c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:18.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.406+0000 7fc34bf1d640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3440c4890 con 0x7fc3440c67d0 2023-12-08T08:23:18.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.406+0000 7fc34bf1d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc344155460 con 0x7fc3440af4c0 2023-12-08T08:23:18.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.406+0000 7fc34bf1d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3440af8a0 con 0x7fc34406c100 2023-12-08T08:23:18.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.406+0000 7fc349cb9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc3440af4c0 0x7fc344154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:18.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.406+0000 7fc349cb9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc3440af4c0 0x7fc344154f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51946/0 (socket says 172.21.15.88:51946) 2023-12-08T08:23:18.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.406+0000 7fc349cb9640 1 -- 172.21.15.88:0/4007368973 learned_addr learned my addr 172.21.15.88:0/4007368973 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:18.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.406+0000 7fc349cb9640 1 -- 172.21.15.88:0/4007368973 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc34406c100 msgr2=0x7fc3440c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:18.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.406+0000 7fc349cb9640 1 --2- 172.21.15.88:0/4007368973 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc34406c100 0x7fc3440c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:18.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.406+0000 7fc349cb9640 1 -- 172.21.15.88:0/4007368973 >> v1:172.21.15.148:6789/0 conn(0x7fc3440c67d0 legacy=0x7fc34406b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:18.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.406+0000 7fc349cb9640 1 -- 172.21.15.88:0/4007368973 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3440c4b30 con 0x7fc3440af4c0 2023-12-08T08:23:18.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.410+0000 7fc349cb9640 1 --2- 172.21.15.88:0/4007368973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3440af4c0 0x7fc344154f20 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fc340009870 tx=0x7fc34001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5adfb5343e65a27d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:18.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.410+0000 7fc348cb7640 1 -- 172.21.15.88:0/4007368973 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3400ab600 con 0x7fc3440af4c0 2023-12-08T08:23:18.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.410+0000 7fc348cb7640 1 -- 172.21.15.88:0/4007368973 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3400ab760 con 0x7fc3440af4c0 2023-12-08T08:23:18.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.410+0000 7fc348cb7640 1 -- 172.21.15.88:0/4007368973 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3400abaf0 con 0x7fc3440af4c0 2023-12-08T08:23:18.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.410+0000 7fc34bf1d640 1 -- 172.21.15.88:0/4007368973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3440af4c0 msgr2=0x7fc344154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:18.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.410+0000 7fc34bf1d640 1 --2- 172.21.15.88:0/4007368973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3440af4c0 0x7fc344154f20 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fc340009870 tx=0x7fc34001c440 comp rx=0 tx=0).stop 2023-12-08T08:23:18.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.410+0000 7fc34bf1d640 1 -- 172.21.15.88:0/4007368973 shutdown_connections 2023-12-08T08:23:18.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.410+0000 7fc34bf1d640 1 --2- 172.21.15.88:0/4007368973 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc34406c100 0x7fc3440c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:18.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.410+0000 7fc34bf1d640 1 --2- 172.21.15.88:0/4007368973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3440af4c0 0x7fc344154f20 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:18.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.410+0000 7fc34bf1d640 1 -- 172.21.15.88:0/4007368973 >> 172.21.15.88:0/4007368973 conn(0x7fc3440ab9d0 msgr2=0x7fc3440abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:18.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.410+0000 7fc34bf1d640 1 -- 172.21.15.88:0/4007368973 shutdown_connections 2023-12-08T08:23:18.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.410+0000 7fc34bf1d640 1 -- 172.21.15.88:0/4007368973 wait complete. 2023-12-08T08:23:18.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.414+0000 7fc34bf1d640 1 Processor -- start 2023-12-08T08:23:18.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.414+0000 7fc34bf1d640 1 -- start start 2023-12-08T08:23:18.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.414+0000 7fc34bf1d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc34406c100 0x7fc3440c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:18.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.414+0000 7fc34bf1d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3440af4c0 0x7fc34414bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:18.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.414+0000 7fc34bf1d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3440c67d0 0x7fc34414c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:18.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.414+0000 7fc34bf1d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3441ed740 con 0x7fc3440c67d0 2023-12-08T08:23:18.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.414+0000 7fc34bf1d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc344152e70 con 0x7fc34406c100 2023-12-08T08:23:18.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.414+0000 7fc34bf1d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3441ecb90 con 0x7fc3440af4c0 2023-12-08T08:23:18.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.414+0000 7fc34a4ba640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3440c67d0 0x7fc34414c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:18.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.414+0000 7fc34a4ba640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3440c67d0 0x7fc34414c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51956/0 (socket says 172.21.15.88:51956) 2023-12-08T08:23:18.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.414+0000 7fc34a4ba640 1 -- 172.21.15.88:0/1950686646 learned_addr learned my addr 172.21.15.88:0/1950686646 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:18.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.414+0000 7fc3494b8640 1 --2- 172.21.15.88:0/1950686646 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3440af4c0 0x7fc34414bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:18.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.414+0000 7fc349cb9640 1 --2- 172.21.15.88:0/1950686646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc34406c100 0x7fc3440c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:18.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.414+0000 7fc34a4ba640 1 -- 172.21.15.88:0/1950686646 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3440af4c0 msgr2=0x7fc34414bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:18.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.414+0000 7fc34a4ba640 1 --2- 172.21.15.88:0/1950686646 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3440af4c0 0x7fc34414bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:18.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.414+0000 7fc34a4ba640 1 -- 172.21.15.88:0/1950686646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc34406c100 msgr2=0x7fc3440c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:18.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.414+0000 7fc34a4ba640 1 --2- 172.21.15.88:0/1950686646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc34406c100 0x7fc3440c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:18.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.414+0000 7fc34a4ba640 1 -- 172.21.15.88:0/1950686646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3400094d0 con 0x7fc3440c67d0 2023-12-08T08:23:18.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.414+0000 7fc34a4ba640 1 --2- 172.21.15.88:0/1950686646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3440c67d0 0x7fc34414c450 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00b9e0 tx=0x7fc33c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:18.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.414+0000 7fc33a7fc640 1 -- 172.21.15.88:0/1950686646 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c00cb20 con 0x7fc3440c67d0 2023-12-08T08:23:18.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.414+0000 7fc33a7fc640 1 -- 172.21.15.88:0/1950686646 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33c00cca0 con 0x7fc3440c67d0 2023-12-08T08:23:18.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.414+0000 7fc34bf1d640 1 -- 172.21.15.88:0/1950686646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3441edb60 con 0x7fc3440c67d0 2023-12-08T08:23:18.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.414+0000 7fc33a7fc640 1 -- 172.21.15.88:0/1950686646 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c014680 con 0x7fc3440c67d0 2023-12-08T08:23:18.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.414+0000 7fc34bf1d640 1 -- 172.21.15.88:0/1950686646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34414c990 con 0x7fc3440c67d0 2023-12-08T08:23:18.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.414+0000 7fc34bf1d640 1 -- 172.21.15.88:0/1950686646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3441ed880 con 0x7fc3440c67d0 2023-12-08T08:23:18.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.418+0000 7fc33a7fc640 1 -- 172.21.15.88:0/1950686646 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc33c01d3b0 con 0x7fc3440c67d0 2023-12-08T08:23:18.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.418+0000 7fc33a7fc640 1 --2- 172.21.15.88:0/1950686646 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc3280664a0 0x7fc328068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:18.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.418+0000 7fc33a7fc640 1 -- 172.21.15.88:0/1950686646 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc33c084000 con 0x7fc3440c67d0 2023-12-08T08:23:18.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.418+0000 7fc349cb9640 1 --2- 172.21.15.88:0/1950686646 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc3280664a0 0x7fc328068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:18.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.418+0000 7fc349cb9640 1 --2- 172.21.15.88:0/1950686646 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc3280664a0 0x7fc328068960 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc3400af000 tx=0x7fc3400b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:18.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.422+0000 7fc33a7fc640 1 -- 172.21.15.88:0/1950686646 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc3441ed880 con 0x7fc3440c67d0 2023-12-08T08:23:18.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.570+0000 7fc34bf1d640 1 -- 172.21.15.88:0/1950686646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3441ed880 con 0x7fc3440c67d0 2023-12-08T08:23:18.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.570+0000 7fc33a7fc640 1 -- 172.21.15.88:0/1950686646 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+20203 (secure 0 0 0) 0x7fc3441ed880 con 0x7fc3440c67d0 2023-12-08T08:23:18.576 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:18.577 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":71,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:23:17.267691+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:57.367467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:58.632605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:23:15.029129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:23:16.271716+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:23:18.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.574+0000 7fc34bf1d640 1 -- 172.21.15.88:0/1950686646 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc3280664a0 msgr2=0x7fc328068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:18.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.574+0000 7fc34bf1d640 1 --2- 172.21.15.88:0/1950686646 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc3280664a0 0x7fc328068960 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc3400af000 tx=0x7fc3400b6040 comp rx=0 tx=0).stop 2023-12-08T08:23:18.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.574+0000 7fc34bf1d640 1 -- 172.21.15.88:0/1950686646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3440c67d0 msgr2=0x7fc34414c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:18.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.574+0000 7fc34bf1d640 1 --2- 172.21.15.88:0/1950686646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3440c67d0 0x7fc34414c450 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00b9e0 tx=0x7fc33c00bea0 comp rx=0 tx=0).stop 2023-12-08T08:23:18.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.574+0000 7fc34bf1d640 1 -- 172.21.15.88:0/1950686646 shutdown_connections 2023-12-08T08:23:18.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.574+0000 7fc34bf1d640 1 --2- 172.21.15.88:0/1950686646 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc3280664a0 0x7fc328068960 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:18.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.574+0000 7fc34bf1d640 1 --2- 172.21.15.88:0/1950686646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3440c67d0 0x7fc34414c450 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:18.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.574+0000 7fc34bf1d640 1 --2- 172.21.15.88:0/1950686646 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc3440af4c0 0x7fc34414bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:18.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.574+0000 7fc34bf1d640 1 --2- 172.21.15.88:0/1950686646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc34406c100 0x7fc3440c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:18.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.574+0000 7fc34bf1d640 1 -- 172.21.15.88:0/1950686646 >> 172.21.15.88:0/1950686646 conn(0x7fc3440ab9d0 msgr2=0x7fc3440c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:18.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.574+0000 7fc34bf1d640 1 -- 172.21.15.88:0/1950686646 shutdown_connections 2023-12-08T08:23:18.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.574+0000 7fc34bf1d640 1 -- 172.21.15.88:0/1950686646 wait complete. 2023-12-08T08:23:18.598 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-12-08T08:23:18.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.734+0000 7f718c879640 1 Processor -- start 2023-12-08T08:23:18.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.734+0000 7f718c879640 1 -- start start 2023-12-08T08:23:18.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.734+0000 7f718c879640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f718814fc30 0x7f71880c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:18.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.734+0000 7f718c879640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f718806d840 0x7f71880c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:18.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.734+0000 7f718c879640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7188152910 con 0x7f718814f850 2023-12-08T08:23:18.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.734+0000 7f718c879640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71880c2240 con 0x7f718814fc30 2023-12-08T08:23:18.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.734+0000 7f718c879640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7188152bf0 con 0x7f718806d840 2023-12-08T08:23:18.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.734+0000 7f717dd9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f718814fc30 0x7f71880c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:18.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.734+0000 7f717dd9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f718814fc30 0x7f71880c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51972/0 (socket says 172.21.15.88:51972) 2023-12-08T08:23:18.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.734+0000 7f717dd9b640 1 -- 172.21.15.88:0/1186782712 learned_addr learned my addr 172.21.15.88:0/1186782712 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:18.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.734+0000 7f7186d9d640 1 --2- 172.21.15.88:0/1186782712 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f718806d840 0x7f71880c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:18.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.738+0000 7f717dd9b640 1 -- 172.21.15.88:0/1186782712 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f718806d840 msgr2=0x7f71880c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:18.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.738+0000 7f717dd9b640 1 --2- 172.21.15.88:0/1186782712 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f718806d840 0x7f71880c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:18.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.738+0000 7f717dd9b640 1 -- 172.21.15.88:0/1186782712 >> v1:172.21.15.148:6789/0 conn(0x7f718814f850 legacy=0x7f71880aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:18.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.738+0000 7f717dd9b640 1 -- 172.21.15.88:0/1186782712 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7188152ed0 con 0x7f718814fc30 2023-12-08T08:23:18.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.738+0000 7f7186d9d640 1 --2- 172.21.15.88:0/1186782712 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f718806d840 0x7f71880c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:18.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.738+0000 7f717dd9b640 1 --2- 172.21.15.88:0/1186782712 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f718814fc30 0x7f71880c3cd0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f7170009870 tx=0x7f717001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51c3325e8565403 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:18.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.738+0000 7f7185d9b640 1 -- 172.21.15.88:0/1186782712 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71700ab670 con 0x7f718814fc30 2023-12-08T08:23:18.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.738+0000 7f7185d9b640 1 -- 172.21.15.88:0/1186782712 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71700ab7d0 con 0x7f718814fc30 2023-12-08T08:23:18.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.738+0000 7f7185d9b640 1 -- 172.21.15.88:0/1186782712 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71700abb60 con 0x7f718814fc30 2023-12-08T08:23:18.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.738+0000 7f718c879640 1 -- 172.21.15.88:0/1186782712 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f718814fc30 msgr2=0x7f71880c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:18.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.738+0000 7f718c879640 1 --2- 172.21.15.88:0/1186782712 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f718814fc30 0x7f71880c3cd0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f7170009870 tx=0x7f717001c540 comp rx=0 tx=0).stop 2023-12-08T08:23:18.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.738+0000 7f718c879640 1 -- 172.21.15.88:0/1186782712 shutdown_connections 2023-12-08T08:23:18.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.738+0000 7f718c879640 1 --2- 172.21.15.88:0/1186782712 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f718806d840 0x7f71880c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:18.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.738+0000 7f718c879640 1 --2- 172.21.15.88:0/1186782712 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f718814fc30 0x7f71880c3cd0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:18.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.738+0000 7f718c879640 1 -- 172.21.15.88:0/1186782712 >> 172.21.15.88:0/1186782712 conn(0x7f71880c59f0 msgr2=0x7f71880c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:18.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.742+0000 7f718c879640 1 -- 172.21.15.88:0/1186782712 shutdown_connections 2023-12-08T08:23:18.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.742+0000 7f718c879640 1 -- 172.21.15.88:0/1186782712 wait complete. 2023-12-08T08:23:18.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.742+0000 7f718c879640 1 Processor -- start 2023-12-08T08:23:18.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.742+0000 7f718c879640 1 -- start start 2023-12-08T08:23:18.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.742+0000 7f718c879640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f718806d840 0x7f7188148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:18.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.742+0000 7f718c879640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f718814f850 0x7f71880a5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:18.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.742+0000 7f718c879640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f718814fc30 0x7f7188070a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:18.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.742+0000 7f718c879640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7188146e50 con 0x7f718814f850 2023-12-08T08:23:18.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.742+0000 7f718c879640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7188070600 con 0x7f718806d840 2023-12-08T08:23:18.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.742+0000 7f718c879640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71881482e0 con 0x7f718814fc30 2023-12-08T08:23:18.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.742+0000 7f717dd9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f718814f850 0x7f71880a5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:18.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.742+0000 7f717dd9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f718814f850 0x7f71880a5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51976/0 (socket says 172.21.15.88:51976) 2023-12-08T08:23:18.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.742+0000 7f717dd9b640 1 -- 172.21.15.88:0/4219901323 learned_addr learned my addr 172.21.15.88:0/4219901323 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:18.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.742+0000 7f718659c640 1 --2- 172.21.15.88:0/4219901323 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f718806d840 0x7f7188148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:18.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.742+0000 7f7186d9d640 1 --2- 172.21.15.88:0/4219901323 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f718814fc30 0x7f7188070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:18.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.742+0000 7f717dd9b640 1 -- 172.21.15.88:0/4219901323 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f718814fc30 msgr2=0x7f7188070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:18.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.742+0000 7f717dd9b640 1 --2- 172.21.15.88:0/4219901323 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f718814fc30 0x7f7188070a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:18.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.742+0000 7f717dd9b640 1 -- 172.21.15.88:0/4219901323 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f718806d840 msgr2=0x7f7188148d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:18.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.742+0000 7f717dd9b640 1 --2- 172.21.15.88:0/4219901323 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f718806d840 0x7f7188148d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:18.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.742+0000 7f717dd9b640 1 -- 172.21.15.88:0/4219901323 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71700094d0 con 0x7f718814f850 2023-12-08T08:23:18.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.742+0000 7f717dd9b640 1 --2- 172.21.15.88:0/4219901323 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f718814f850 0x7f71880a5f80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f71700ad040 tx=0x7f717001ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:18.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.746+0000 7f717f7fe640 1 -- 172.21.15.88:0/4219901323 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71700b4800 con 0x7f718814f850 2023-12-08T08:23:18.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.746+0000 7f717f7fe640 1 -- 172.21.15.88:0/4219901323 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71700b4980 con 0x7f718814f850 2023-12-08T08:23:18.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.746+0000 7f717f7fe640 1 -- 172.21.15.88:0/4219901323 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71700b4d30 con 0x7f718814f850 2023-12-08T08:23:18.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.746+0000 7f718c879640 1 -- 172.21.15.88:0/4219901323 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71881485c0 con 0x7f718814f850 2023-12-08T08:23:18.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.746+0000 7f718c879640 1 -- 172.21.15.88:0/4219901323 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71880a64c0 con 0x7f718814f850 2023-12-08T08:23:18.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.746+0000 7f718c879640 1 -- 172.21.15.88:0/4219901323 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7188150820 con 0x7f718814f850 2023-12-08T08:23:18.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.746+0000 7f717f7fe640 1 -- 172.21.15.88:0/4219901323 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f71700b3380 con 0x7f718814f850 2023-12-08T08:23:18.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.746+0000 7f717f7fe640 1 --2- 172.21.15.88:0/4219901323 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7168066470 0x7f7168068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:18.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.746+0000 7f717f7fe640 1 -- 172.21.15.88:0/4219901323 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f717011e810 con 0x7f718814f850 2023-12-08T08:23:18.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.746+0000 7f718659c640 1 --2- 172.21.15.88:0/4219901323 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7168066470 0x7f7168068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:18.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.746+0000 7f718659c640 1 --2- 172.21.15.88:0/4219901323 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7168066470 0x7f7168068930 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f71780012f0 tx=0x7f7178009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:18.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.750+0000 7f717f7fe640 1 -- 172.21.15.88:0/4219901323 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71700ebaf0 con 0x7f718814f850 2023-12-08T08:23:18.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:18.938+0000 7f718c879640 1 -- 172.21.15.88:0/4219901323 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7188067630 con 0x7f718814f850 2023-12-08T08:23:19.410 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:23:19.414 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:23:19.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:19.914+0000 7f717f7fe640 1 -- 172.21.15.88:0/4219901323 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v51) v1 ==== 119+0+0 (secure 0 0 0) 0x7f71700ef110 con 0x7f718814f850 2023-12-08T08:23:20.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:19.914+0000 7f718c879640 1 -- 172.21.15.88:0/4219901323 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7168066470 msgr2=0x7f7168068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:20.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:19.914+0000 7f718c879640 1 --2- 172.21.15.88:0/4219901323 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7168066470 0x7f7168068930 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f71780012f0 tx=0x7f7178009040 comp rx=0 tx=0).stop 2023-12-08T08:23:20.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:19.914+0000 7f718c879640 1 -- 172.21.15.88:0/4219901323 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f718814f850 msgr2=0x7f71880a5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:20.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:19.914+0000 7f718c879640 1 --2- 172.21.15.88:0/4219901323 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f718814f850 0x7f71880a5f80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f71700ad040 tx=0x7f717001ad80 comp rx=0 tx=0).stop 2023-12-08T08:23:20.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:19.914+0000 7f718c879640 1 -- 172.21.15.88:0/4219901323 shutdown_connections 2023-12-08T08:23:20.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:19.914+0000 7f718c879640 1 --2- 172.21.15.88:0/4219901323 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7168066470 0x7f7168068930 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:20.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:19.914+0000 7f718c879640 1 --2- 172.21.15.88:0/4219901323 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f718814fc30 0x7f7188070a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:20.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:19.914+0000 7f718c879640 1 --2- 172.21.15.88:0/4219901323 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f718814f850 0x7f71880a5f80 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:20.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:19.914+0000 7f718c879640 1 --2- 172.21.15.88:0/4219901323 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f718806d840 0x7f7188148d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:20.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:19.914+0000 7f718c879640 1 -- 172.21.15.88:0/4219901323 >> 172.21.15.88:0/4219901323 conn(0x7f71880c59f0 msgr2=0x7f718806cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:20.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:19.914+0000 7f718c879640 1 -- 172.21.15.88:0/4219901323 shutdown_connections 2023-12-08T08:23:20.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:19.914+0000 7f718c879640 1 -- 172.21.15.88:0/4219901323 wait complete. 2023-12-08T08:23:20.055 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-08T08:23:20.055 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-12-08T08:23:20.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.190+0000 7efcfe5df640 1 Processor -- start 2023-12-08T08:23:20.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.190+0000 7efcfe5df640 1 -- start start 2023-12-08T08:23:20.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.194+0000 7efcfe5df640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efcf8159c40 0x7efcf815c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:20.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.194+0000 7efcfe5df640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf80a4e20 con 0x7efcf814b1e0 2023-12-08T08:23:20.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.194+0000 7efcfe5df640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf80a50e0 con 0x7efcf80c5300 2023-12-08T08:23:20.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.194+0000 7efcfe5df640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf81558d0 con 0x7efcf8159c40 2023-12-08T08:23:20.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.194+0000 7efcf7fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7efcf814b1e0 0x7efcf80c1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37966/0 (socket says 172.21.15.88:37966) 2023-12-08T08:23:20.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.194+0000 7efcf7fff640 1 -- 172.21.15.88:0/3243297212 learned_addr learned my addr 172.21.15.88:0/3243297212 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:20.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.194+0000 7efcfcb7c640 1 --2- 172.21.15.88:0/3243297212 >> v2:172.21.15.88:3300/0 conn(0x7efcf8159c40 0x7efcf815c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:20.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.194+0000 7efcf6ffd640 1 -- 172.21.15.88:0/3243297212 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4230543433 0 0) 0x7efcf80a4e20 con 0x7efcf814b1e0 2023-12-08T08:23:20.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.194+0000 7efcfcb7c640 1 -- 172.21.15.88:0/3243297212 >> v1:172.21.15.148:6789/0 conn(0x7efcf80c5300 legacy=0x7efcf80a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:20.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.194+0000 7efcfcb7c640 1 -- 172.21.15.88:0/3243297212 >> v1:172.21.15.88:6789/0 conn(0x7efcf814b1e0 legacy=0x7efcf80c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:20.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.194+0000 7efcfcb7c640 1 -- 172.21.15.88:0/3243297212 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf80c0f00 con 0x7efcf8159c40 2023-12-08T08:23:20.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.198+0000 7efcfcb7c640 1 --2- 172.21.15.88:0/3243297212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcf8159c40 0x7efcf815c030 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7efcf80a5010 tx=0x7efcf001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d5e8fde60f6dec8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:20.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.198+0000 7efcf6ffd640 1 -- 172.21.15.88:0/3243297212 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf00a5900 con 0x7efcf8159c40 2023-12-08T08:23:20.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.198+0000 7efcf6ffd640 1 -- 172.21.15.88:0/3243297212 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf00a5a60 con 0x7efcf8159c40 2023-12-08T08:23:20.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.198+0000 7efcf6ffd640 1 -- 172.21.15.88:0/3243297212 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf00a5df0 con 0x7efcf8159c40 2023-12-08T08:23:20.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.198+0000 7efcfe5df640 1 -- 172.21.15.88:0/3243297212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcf8159c40 msgr2=0x7efcf815c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:20.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.198+0000 7efcfe5df640 1 --2- 172.21.15.88:0/3243297212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcf8159c40 0x7efcf815c030 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7efcf80a5010 tx=0x7efcf001c930 comp rx=0 tx=0).stop 2023-12-08T08:23:20.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.198+0000 7efcfe5df640 1 -- 172.21.15.88:0/3243297212 shutdown_connections 2023-12-08T08:23:20.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.198+0000 7efcfe5df640 1 --2- 172.21.15.88:0/3243297212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcf8159c40 0x7efcf815c030 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:20.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.198+0000 7efcfe5df640 1 -- 172.21.15.88:0/3243297212 >> 172.21.15.88:0/3243297212 conn(0x7efcf80c59f0 msgr2=0x7efcf80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:20.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.198+0000 7efcfe5df640 1 -- 172.21.15.88:0/3243297212 shutdown_connections 2023-12-08T08:23:20.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.198+0000 7efcfe5df640 1 -- 172.21.15.88:0/3243297212 wait complete. 2023-12-08T08:23:20.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.198+0000 7efcfe5df640 1 Processor -- start 2023-12-08T08:23:20.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.198+0000 7efcfe5df640 1 -- start start 2023-12-08T08:23:20.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.202+0000 7efcfe5df640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efcf80c5300 0x7efcf8151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:20.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.202+0000 7efcfe5df640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcf814b1e0 0x7efcf80c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:20.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.202+0000 7efcfe5df640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcf8159c40 0x7efcf81ed170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:20.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.202+0000 7efcfe5df640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf8151640 con 0x7efcf814b1e0 2023-12-08T08:23:20.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.202+0000 7efcfe5df640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf8150d00 con 0x7efcf8159c40 2023-12-08T08:23:20.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.202+0000 7efcfe5df640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf81ecce0 con 0x7efcf80c5300 2023-12-08T08:23:20.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.202+0000 7efcf77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcf814b1e0 0x7efcf80c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:20.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.202+0000 7efcf77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcf814b1e0 0x7efcf80c43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54278/0 (socket says 172.21.15.88:54278) 2023-12-08T08:23:20.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.202+0000 7efcf77fe640 1 -- 172.21.15.88:0/3394521002 learned_addr learned my addr 172.21.15.88:0/3394521002 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:20.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.202+0000 7efcf7fff640 1 --2- 172.21.15.88:0/3394521002 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efcf80c5300 0x7efcf8151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:20.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.202+0000 7efcfcb7c640 1 --2- 172.21.15.88:0/3394521002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcf8159c40 0x7efcf81ed170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:20.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.202+0000 7efcf77fe640 1 -- 172.21.15.88:0/3394521002 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efcf80c5300 msgr2=0x7efcf8151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:20.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.202+0000 7efcf77fe640 1 --2- 172.21.15.88:0/3394521002 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efcf80c5300 0x7efcf8151100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:20.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.202+0000 7efcf77fe640 1 -- 172.21.15.88:0/3394521002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcf8159c40 msgr2=0x7efcf81ed170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:20.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.202+0000 7efcf77fe640 1 --2- 172.21.15.88:0/3394521002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcf8159c40 0x7efcf81ed170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:20.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.202+0000 7efcf77fe640 1 -- 172.21.15.88:0/3394521002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf0009a70 con 0x7efcf814b1e0 2023-12-08T08:23:20.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.202+0000 7efcfcb7c640 1 --2- 172.21.15.88:0/3394521002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcf8159c40 0x7efcf81ed170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:20.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.202+0000 7efcf77fe640 1 --2- 172.21.15.88:0/3394521002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcf814b1e0 0x7efcf80c43e0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7efcec00c500 tx=0x7efcec00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:20.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.202+0000 7efcf4ff9640 1 -- 172.21.15.88:0/3394521002 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec0052d0 con 0x7efcf814b1e0 2023-12-08T08:23:20.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.202+0000 7efcf4ff9640 1 -- 172.21.15.88:0/3394521002 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcec005430 con 0x7efcf814b1e0 2023-12-08T08:23:20.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.202+0000 7efcfe5df640 1 -- 172.21.15.88:0/3394521002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf8143940 con 0x7efcf814b1e0 2023-12-08T08:23:20.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.202+0000 7efcf4ff9640 1 -- 172.21.15.88:0/3394521002 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec012830 con 0x7efcf814b1e0 2023-12-08T08:23:20.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.202+0000 7efcfe5df640 1 -- 172.21.15.88:0/3394521002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf815a880 con 0x7efcf814b1e0 2023-12-08T08:23:20.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.202+0000 7efcfe5df640 1 -- 172.21.15.88:0/3394521002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf81ece70 con 0x7efcf814b1e0 2023-12-08T08:23:20.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.202+0000 7efcf4ff9640 1 -- 172.21.15.88:0/3394521002 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efcec012990 con 0x7efcf814b1e0 2023-12-08T08:23:20.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.206+0000 7efcf4ff9640 1 --2- 172.21.15.88:0/3394521002 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efce40664a0 0x7efce4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:20.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.206+0000 7efcf4ff9640 1 -- 172.21.15.88:0/3394521002 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7efcec083ce0 con 0x7efcf814b1e0 2023-12-08T08:23:20.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.206+0000 7efcf7fff640 1 --2- 172.21.15.88:0/3394521002 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efce40664a0 0x7efce4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:20.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.206+0000 7efcf7fff640 1 --2- 172.21.15.88:0/3394521002 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efce40664a0 0x7efce4068960 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7efce8000f70 tx=0x7efce8007240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:20.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.210+0000 7efcf4ff9640 1 -- 172.21.15.88:0/3394521002 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efcec050d70 con 0x7efcf814b1e0 2023-12-08T08:23:20.237 INFO:tasks.ceph.mds.a.smithi088.stderr:2023-12-08T08:23:20.234+0000 7f85c5108640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:23:20.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.390+0000 7efcfe5df640 1 -- 172.21.15.88:0/3394521002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7efcf8067630 con 0x7efcf814b1e0 2023-12-08T08:23:20.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.914+0000 7efcf4ff9640 1 -- 172.21.15.88:0/3394521002 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v52) v1 ==== 123+0+0 (secure 0 0 0) 0x7efcec054390 con 0x7efcf814b1e0 2023-12-08T08:23:20.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.918+0000 7efcfe5df640 1 -- 172.21.15.88:0/3394521002 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efce40664a0 msgr2=0x7efce4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:20.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.918+0000 7efcfe5df640 1 --2- 172.21.15.88:0/3394521002 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efce40664a0 0x7efce4068960 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7efce8000f70 tx=0x7efce8007240 comp rx=0 tx=0).stop 2023-12-08T08:23:20.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.918+0000 7efcfe5df640 1 -- 172.21.15.88:0/3394521002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcf814b1e0 msgr2=0x7efcf80c43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:20.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.918+0000 7efcfe5df640 1 --2- 172.21.15.88:0/3394521002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcf814b1e0 0x7efcf80c43e0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7efcec00c500 tx=0x7efcec00c9c0 comp rx=0 tx=0).stop 2023-12-08T08:23:20.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.918+0000 7efcfe5df640 1 -- 172.21.15.88:0/3394521002 shutdown_connections 2023-12-08T08:23:20.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.918+0000 7efcfe5df640 1 --2- 172.21.15.88:0/3394521002 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efce40664a0 0x7efce4068960 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:20.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.918+0000 7efcfe5df640 1 --2- 172.21.15.88:0/3394521002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcf8159c40 0x7efcf81ed170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:20.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.918+0000 7efcfe5df640 1 --2- 172.21.15.88:0/3394521002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcf814b1e0 0x7efcf80c43e0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:20.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.918+0000 7efcfe5df640 1 --2- 172.21.15.88:0/3394521002 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7efcf80c5300 0x7efcf8151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:20.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.918+0000 7efcfe5df640 1 -- 172.21.15.88:0/3394521002 >> 172.21.15.88:0/3394521002 conn(0x7efcf80c59f0 msgr2=0x7efcf814a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:20.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.918+0000 7efcfe5df640 1 -- 172.21.15.88:0/3394521002 shutdown_connections 2023-12-08T08:23:20.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:20.918+0000 7efcfe5df640 1 -- 172.21.15.88:0/3394521002 wait complete. 2023-12-08T08:23:20.943 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-12-08T08:23:20.944 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:23:21.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.078+0000 7f6866a79640 1 Processor -- start 2023-12-08T08:23:21.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.078+0000 7f6866a79640 1 -- start start 2023-12-08T08:23:21.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.078+0000 7f6866a79640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6860157b10 0x7f6860157f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:21.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.078+0000 7f6866a79640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6860155110 con 0x7f68600c5e10 2023-12-08T08:23:21.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.078+0000 7f6866a79640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68600c2f20 con 0x7f686014e7e0 2023-12-08T08:23:21.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.078+0000 7f6866a79640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6860154520 con 0x7f6860157b10 2023-12-08T08:23:21.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.078+0000 7f685ffff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f68600c5e10 0x7f68600a6ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37968/0 (socket says 172.21.15.88:37968) 2023-12-08T08:23:21.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.078+0000 7f685ffff640 1 -- 172.21.15.88:0/205264737 learned_addr learned my addr 172.21.15.88:0/205264737 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:21.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.078+0000 7f6865016640 1 --2- 172.21.15.88:0/205264737 >> v2:172.21.15.148:3300/0 conn(0x7f6860157b10 0x7f6860157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:21.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.078+0000 7f685f7fe640 1 -- 172.21.15.88:0/205264737 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 217154909 0 0) 0x7f6860155110 con 0x7f68600c5e10 2023-12-08T08:23:21.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.078+0000 7f685f7fe640 1 -- 172.21.15.88:0/205264737 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6850003530 con 0x7f68600c5e10 2023-12-08T08:23:21.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.078+0000 7f6865016640 1 -- 172.21.15.88:0/205264737 >> v1:172.21.15.148:6789/0 conn(0x7f686014e7e0 legacy=0x7f68600c2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:21.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.078+0000 7f6865016640 1 -- 172.21.15.88:0/205264737 >> v1:172.21.15.88:6789/0 conn(0x7f68600c5e10 legacy=0x7f68600a6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:21.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.078+0000 7f6865016640 1 -- 172.21.15.88:0/205264737 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68601547e0 con 0x7f6860157b10 2023-12-08T08:23:21.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.082+0000 7f6865016640 1 --2- 172.21.15.88:0/205264737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6860157b10 0x7f6860157f80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6858009d90 tx=0x7f685801c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef80cee1a51cf97d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:21.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.082+0000 7f685f7fe640 1 -- 172.21.15.88:0/205264737 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68580a58c0 con 0x7f6860157b10 2023-12-08T08:23:21.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.082+0000 7f685f7fe640 1 -- 172.21.15.88:0/205264737 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68580a5a20 con 0x7f6860157b10 2023-12-08T08:23:21.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.082+0000 7f685f7fe640 1 -- 172.21.15.88:0/205264737 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68580a5db0 con 0x7f6860157b10 2023-12-08T08:23:21.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.082+0000 7f6866a79640 1 -- 172.21.15.88:0/205264737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6860157b10 msgr2=0x7f6860157f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:21.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.082+0000 7f6866a79640 1 --2- 172.21.15.88:0/205264737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6860157b10 0x7f6860157f80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6858009d90 tx=0x7f685801c800 comp rx=0 tx=0).stop 2023-12-08T08:23:21.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.082+0000 7f6866a79640 1 -- 172.21.15.88:0/205264737 shutdown_connections 2023-12-08T08:23:21.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.082+0000 7f6866a79640 1 --2- 172.21.15.88:0/205264737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6860157b10 0x7f6860157f80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:21.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.082+0000 7f6866a79640 1 -- 172.21.15.88:0/205264737 >> 172.21.15.88:0/205264737 conn(0x7f68600c7c60 msgr2=0x7f68600c8070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:21.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.082+0000 7f6866a79640 1 -- 172.21.15.88:0/205264737 shutdown_connections 2023-12-08T08:23:21.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.082+0000 7f6866a79640 1 -- 172.21.15.88:0/205264737 wait complete. 2023-12-08T08:23:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.086+0000 7f6866a79640 1 Processor -- start 2023-12-08T08:23:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.086+0000 7f6866a79640 1 -- start start 2023-12-08T08:23:21.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.086+0000 7f6866a79640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68600c5e10 0x7f6860146380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.086+0000 7f6866a79640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f686014e7e0 0x7f686006f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.086+0000 7f6866a79640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6860157b10 0x7f686006c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.086+0000 7f6866a79640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6860145ba0 con 0x7f68600c5e10 2023-12-08T08:23:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.086+0000 7f6866a79640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686006e170 con 0x7f686014e7e0 2023-12-08T08:23:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.086+0000 7f6866a79640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68601eda30 con 0x7f6860157b10 2023-12-08T08:23:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.086+0000 7f6864815640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68600c5e10 0x7f6860146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.086+0000 7f6864815640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68600c5e10 0x7f6860146380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54284/0 (socket says 172.21.15.88:54284) 2023-12-08T08:23:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.086+0000 7f6864815640 1 -- 172.21.15.88:0/2105733209 learned_addr learned my addr 172.21.15.88:0/2105733209 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.086+0000 7f685ffff640 1 --2- 172.21.15.88:0/2105733209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f686014e7e0 0x7f686006f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.086+0000 7f6865016640 1 --2- 172.21.15.88:0/2105733209 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6860157b10 0x7f686006c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.086+0000 7f6864815640 1 -- 172.21.15.88:0/2105733209 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6860157b10 msgr2=0x7f686006c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.086+0000 7f6864815640 1 --2- 172.21.15.88:0/2105733209 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6860157b10 0x7f686006c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.086+0000 7f6864815640 1 -- 172.21.15.88:0/2105733209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f686014e7e0 msgr2=0x7f686006f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.086+0000 7f6864815640 1 --2- 172.21.15.88:0/2105733209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f686014e7e0 0x7f686006f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.086+0000 7f6864815640 1 -- 172.21.15.88:0/2105733209 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6858009a70 con 0x7f68600c5e10 2023-12-08T08:23:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.086+0000 7f685ffff640 1 --2- 172.21.15.88:0/2105733209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f686014e7e0 0x7f686006f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.086+0000 7f6864815640 1 --2- 172.21.15.88:0/2105733209 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68600c5e10 0x7f6860146380 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f685400c500 tx=0x7f685400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.086+0000 7f685d7fa640 1 -- 172.21.15.88:0/2105733209 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6854005220 con 0x7f68600c5e10 2023-12-08T08:23:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.086+0000 7f685d7fa640 1 -- 172.21.15.88:0/2105733209 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6854005380 con 0x7f68600c5e10 2023-12-08T08:23:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.086+0000 7f685d7fa640 1 -- 172.21.15.88:0/2105733209 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6854007270 con 0x7f68600c5e10 2023-12-08T08:23:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.086+0000 7f6866a79640 1 -- 172.21.15.88:0/2105733209 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686006f1e0 con 0x7f68600c5e10 2023-12-08T08:23:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.086+0000 7f6866a79640 1 -- 172.21.15.88:0/2105733209 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68601ed750 con 0x7f68600c5e10 2023-12-08T08:23:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.086+0000 7f6866a79640 1 -- 172.21.15.88:0/2105733209 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6860067630 con 0x7f68600c5e10 2023-12-08T08:23:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.090+0000 7f685d7fa640 1 -- 172.21.15.88:0/2105733209 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f68540073d0 con 0x7f68600c5e10 2023-12-08T08:23:21.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.090+0000 7f685d7fa640 1 --2- 172.21.15.88:0/2105733209 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6844066470 0x7f6844068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:21.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.090+0000 7f685d7fa640 1 -- 172.21.15.88:0/2105733209 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6854083b60 con 0x7f68600c5e10 2023-12-08T08:23:21.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.090+0000 7f685ffff640 1 --2- 172.21.15.88:0/2105733209 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6844066470 0x7f6844068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:21.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.090+0000 7f685ffff640 1 --2- 172.21.15.88:0/2105733209 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6844066470 0x7f6844068930 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f686015f140 tx=0x7f684c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:21.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.094+0000 7f685d7fa640 1 -- 172.21.15.88:0/2105733209 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6854050c70 con 0x7f68600c5e10 2023-12-08T08:23:21.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.274+0000 7f6866a79640 1 -- 172.21.15.88:0/2105733209 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68601578f0 con 0x7f68600c5e10 2023-12-08T08:23:21.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.274+0000 7f685d7fa640 1 -- 172.21.15.88:0/2105733209 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+6137 (secure 0 0 0) 0x7f6854054290 con 0x7f68600c5e10 2023-12-08T08:23:21.278 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:21.278 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5693,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4194250074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4194250074},{"type":"v1","addr":"172.21.15.148:6833","nonce":4194250074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":5699,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3923000603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3923000603},{"type":"v1","addr":"172.21.15.148:6835","nonce":3923000603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:22:59.638045+0000","modified":"2023-12-08T08:23:02.646442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6525":{"gid":6525,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/698349615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":698349615},{"type":"v1","addr":"172.21.15.88:6837","nonce":698349615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:23:17.268042+0000","modified":"2023-12-08T08:23:20.393598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6519},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6519":{"gid":6519,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":7,"addr":"172.21.15.88:6835/1294328415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1294328415},{"type":"v1","addr":"172.21.15.88:6835","nonce":1294328415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-08T08:23:21.278 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 52 2023-12-08T08:23:21.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.274+0000 7f6866a79640 1 -- 172.21.15.88:0/2105733209 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6844066470 msgr2=0x7f6844068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:21.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.274+0000 7f6866a79640 1 --2- 172.21.15.88:0/2105733209 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6844066470 0x7f6844068930 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f686015f140 tx=0x7f684c009040 comp rx=0 tx=0).stop 2023-12-08T08:23:21.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.274+0000 7f6866a79640 1 -- 172.21.15.88:0/2105733209 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68600c5e10 msgr2=0x7f6860146380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:21.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.274+0000 7f6866a79640 1 --2- 172.21.15.88:0/2105733209 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68600c5e10 0x7f6860146380 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f685400c500 tx=0x7f685400c9c0 comp rx=0 tx=0).stop 2023-12-08T08:23:21.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.274+0000 7f6866a79640 1 -- 172.21.15.88:0/2105733209 shutdown_connections 2023-12-08T08:23:21.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.274+0000 7f6866a79640 1 --2- 172.21.15.88:0/2105733209 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6844066470 0x7f6844068930 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:21.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.274+0000 7f6866a79640 1 --2- 172.21.15.88:0/2105733209 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6860157b10 0x7f686006c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:21.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.274+0000 7f6866a79640 1 --2- 172.21.15.88:0/2105733209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f686014e7e0 0x7f686006f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:21.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.274+0000 7f6866a79640 1 --2- 172.21.15.88:0/2105733209 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68600c5e10 0x7f6860146380 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:21.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.274+0000 7f6866a79640 1 -- 172.21.15.88:0/2105733209 >> 172.21.15.88:0/2105733209 conn(0x7f68600c7c60 msgr2=0x7f68600c8040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:21.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.274+0000 7f6866a79640 1 -- 172.21.15.88:0/2105733209 shutdown_connections 2023-12-08T08:23:21.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.274+0000 7f6866a79640 1 -- 172.21.15.88:0/2105733209 wait complete. 2023-12-08T08:23:21.299 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:23:21.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.430+0000 7f2cd3f2a640 1 Processor -- start 2023-12-08T08:23:21.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.430+0000 7f2cd3f2a640 1 -- start start 2023-12-08T08:23:21.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.430+0000 7f2cd3f2a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2ccc06d2b0 0x7f2ccc06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:21.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.430+0000 7f2cd3f2a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ccc0c3b80 0x7f2ccc0c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:21.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.430+0000 7f2cd3f2a640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ccc06bb80 con 0x7f2ccc06c020 2023-12-08T08:23:21.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.430+0000 7f2cd3f2a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ccc0c5840 con 0x7f2ccc06d2b0 2023-12-08T08:23:21.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.430+0000 7f2cd3f2a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc1515c0 con 0x7f2ccc0c3b80 2023-12-08T08:23:21.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.430+0000 7f2cd1cc6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2ccc06d2b0 0x7f2ccc06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:21.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.434+0000 7f2cd1cc6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2ccc06d2b0 0x7f2ccc06d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54300/0 (socket says 172.21.15.88:54300) 2023-12-08T08:23:21.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.434+0000 7f2cd1cc6640 1 -- 172.21.15.88:0/2560405613 learned_addr learned my addr 172.21.15.88:0/2560405613 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:21.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.434+0000 7f2cd14c5640 1 --2- 172.21.15.88:0/2560405613 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ccc0c3b80 0x7f2ccc0c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:21.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.434+0000 7f2cd1cc6640 1 -- 172.21.15.88:0/2560405613 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ccc0c3b80 msgr2=0x7f2ccc0c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:21.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.434+0000 7f2cd1cc6640 1 --2- 172.21.15.88:0/2560405613 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ccc0c3b80 0x7f2ccc0c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:21.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.434+0000 7f2cd1cc6640 1 -- 172.21.15.88:0/2560405613 >> v1:172.21.15.148:6789/0 conn(0x7f2ccc06c020 legacy=0x7f2ccc06c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:21.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.434+0000 7f2cd1cc6640 1 -- 172.21.15.88:0/2560405613 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ccc1518a0 con 0x7f2ccc06d2b0 2023-12-08T08:23:21.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.434+0000 7f2cd1cc6640 1 --2- 172.21.15.88:0/2560405613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ccc06d2b0 0x7f2ccc06d690 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009870 tx=0x7f2cc801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c7b99767b436537 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:21.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.434+0000 7f2cd0cc4640 1 -- 172.21.15.88:0/2560405613 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc80ab620 con 0x7f2ccc06d2b0 2023-12-08T08:23:21.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.434+0000 7f2cd0cc4640 1 -- 172.21.15.88:0/2560405613 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc80ab780 con 0x7f2ccc06d2b0 2023-12-08T08:23:21.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.434+0000 7f2cd0cc4640 1 -- 172.21.15.88:0/2560405613 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc80abb10 con 0x7f2ccc06d2b0 2023-12-08T08:23:21.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd3f2a640 1 -- 172.21.15.88:0/2560405613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ccc06d2b0 msgr2=0x7f2ccc06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:21.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd3f2a640 1 --2- 172.21.15.88:0/2560405613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ccc06d2b0 0x7f2ccc06d690 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009870 tx=0x7f2cc801c510 comp rx=0 tx=0).stop 2023-12-08T08:23:21.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd3f2a640 1 -- 172.21.15.88:0/2560405613 shutdown_connections 2023-12-08T08:23:21.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd3f2a640 1 --2- 172.21.15.88:0/2560405613 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ccc0c3b80 0x7f2ccc0c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:21.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd3f2a640 1 --2- 172.21.15.88:0/2560405613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ccc06d2b0 0x7f2ccc06d690 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:21.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd3f2a640 1 -- 172.21.15.88:0/2560405613 >> 172.21.15.88:0/2560405613 conn(0x7f2ccc0a7810 msgr2=0x7f2ccc0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:21.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd3f2a640 1 -- 172.21.15.88:0/2560405613 shutdown_connections 2023-12-08T08:23:21.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd3f2a640 1 -- 172.21.15.88:0/2560405613 wait complete. 2023-12-08T08:23:21.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd3f2a640 1 Processor -- start 2023-12-08T08:23:21.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd3f2a640 1 -- start start 2023-12-08T08:23:21.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd3f2a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ccc06c020 0x7f2ccc0a9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:21.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd3f2a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ccc06d2b0 0x7f2ccc150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:21.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd3f2a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ccc0c3b80 0x7f2ccc1eec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:21.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd3f2a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc0bc010 con 0x7f2ccc06c020 2023-12-08T08:23:21.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd3f2a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc0bb520 con 0x7f2ccc06d2b0 2023-12-08T08:23:21.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd3f2a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc1ee510 con 0x7f2ccc0c3b80 2023-12-08T08:23:21.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd1cc6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ccc06c020 0x7f2ccc0a9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:21.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd1cc6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ccc06c020 0x7f2ccc0a9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54304/0 (socket says 172.21.15.88:54304) 2023-12-08T08:23:21.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd1cc6640 1 -- 172.21.15.88:0/2444728172 learned_addr learned my addr 172.21.15.88:0/2444728172 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:21.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd14c5640 1 --2- 172.21.15.88:0/2444728172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ccc06d2b0 0x7f2ccc150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:21.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd24c7640 1 --2- 172.21.15.88:0/2444728172 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ccc0c3b80 0x7f2ccc1eec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:21.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd1cc6640 1 -- 172.21.15.88:0/2444728172 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ccc0c3b80 msgr2=0x7f2ccc1eec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:21.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd1cc6640 1 --2- 172.21.15.88:0/2444728172 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ccc0c3b80 0x7f2ccc1eec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:21.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd1cc6640 1 -- 172.21.15.88:0/2444728172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ccc06d2b0 msgr2=0x7f2ccc150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:21.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd1cc6640 1 --2- 172.21.15.88:0/2444728172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ccc06d2b0 0x7f2ccc150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:21.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd1cc6640 1 -- 172.21.15.88:0/2444728172 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc80094d0 con 0x7f2ccc06c020 2023-12-08T08:23:21.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd24c7640 1 --2- 172.21.15.88:0/2444728172 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ccc0c3b80 0x7f2ccc1eec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:21.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.438+0000 7f2cd1cc6640 1 --2- 172.21.15.88:0/2444728172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ccc06c020 0x7f2ccc0a9c80 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80ad040 tx=0x7f2cc801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:21.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.442+0000 7f2cc27fc640 1 -- 172.21.15.88:0/2444728172 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc80be3f0 con 0x7f2ccc06c020 2023-12-08T08:23:21.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.442+0000 7f2cc27fc640 1 -- 172.21.15.88:0/2444728172 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc80be550 con 0x7f2ccc06c020 2023-12-08T08:23:21.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.442+0000 7f2cc27fc640 1 -- 172.21.15.88:0/2444728172 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc80be900 con 0x7f2ccc06c020 2023-12-08T08:23:21.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.442+0000 7f2cd3f2a640 1 -- 172.21.15.88:0/2444728172 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ccc14ef80 con 0x7f2ccc06c020 2023-12-08T08:23:21.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.442+0000 7f2cd3f2a640 1 -- 172.21.15.88:0/2444728172 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ccc0bb770 con 0x7f2ccc06c020 2023-12-08T08:23:21.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.442+0000 7f2cd3f2a640 1 -- 172.21.15.88:0/2444728172 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ccc067630 con 0x7f2ccc06c020 2023-12-08T08:23:21.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.442+0000 7f2cc27fc640 1 -- 172.21.15.88:0/2444728172 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2cc80b43f0 con 0x7f2ccc06c020 2023-12-08T08:23:21.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.442+0000 7f2cc27fc640 1 --2- 172.21.15.88:0/2444728172 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2cb0066470 0x7f2cb0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:21.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.442+0000 7f2cc27fc640 1 -- 172.21.15.88:0/2444728172 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2cc811e580 con 0x7f2ccc06c020 2023-12-08T08:23:21.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.442+0000 7f2cd14c5640 1 --2- 172.21.15.88:0/2444728172 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2cb0066470 0x7f2cb0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:21.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.442+0000 7f2cd14c5640 1 --2- 172.21.15.88:0/2444728172 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2cb0066470 0x7f2cb0068930 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc0c1180 tx=0x7f2cbc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:21.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.446+0000 7f2cc27fc640 1 -- 172.21.15.88:0/2444728172 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2cc80eb740 con 0x7f2ccc06c020 2023-12-08T08:23:21.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.598+0000 7f2cd3f2a640 1 -- 172.21.15.88:0/2444728172 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ccc06bd70 con 0x7f2ccc06c020 2023-12-08T08:23:21.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.602+0000 7f2cc27fc640 1 -- 172.21.15.88:0/2444728172 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20190 (secure 0 0 0) 0x7f2cc80eed60 con 0x7f2ccc06c020 2023-12-08T08:23:21.606 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:21.606 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":72,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:23:18.903336+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:57.367467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:58.632605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:23:15.029129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:23:16.271716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:23:21.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.602+0000 7f2cd3f2a640 1 -- 172.21.15.88:0/2444728172 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2cb0066470 msgr2=0x7f2cb0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:21.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.602+0000 7f2cd3f2a640 1 --2- 172.21.15.88:0/2444728172 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2cb0066470 0x7f2cb0068930 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc0c1180 tx=0x7f2cbc008040 comp rx=0 tx=0).stop 2023-12-08T08:23:21.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.602+0000 7f2cd3f2a640 1 -- 172.21.15.88:0/2444728172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ccc06c020 msgr2=0x7f2ccc0a9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:21.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.602+0000 7f2cd3f2a640 1 --2- 172.21.15.88:0/2444728172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ccc06c020 0x7f2ccc0a9c80 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80ad040 tx=0x7f2cc801ad50 comp rx=0 tx=0).stop 2023-12-08T08:23:21.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.602+0000 7f2cd3f2a640 1 -- 172.21.15.88:0/2444728172 shutdown_connections 2023-12-08T08:23:21.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.602+0000 7f2cd3f2a640 1 --2- 172.21.15.88:0/2444728172 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2cb0066470 0x7f2cb0068930 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:21.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.602+0000 7f2cd3f2a640 1 --2- 172.21.15.88:0/2444728172 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2ccc0c3b80 0x7f2ccc1eec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:21.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.602+0000 7f2cd3f2a640 1 --2- 172.21.15.88:0/2444728172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ccc06d2b0 0x7f2ccc150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:21.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.602+0000 7f2cd3f2a640 1 --2- 172.21.15.88:0/2444728172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ccc06c020 0x7f2ccc0a9c80 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:21.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.602+0000 7f2cd3f2a640 1 -- 172.21.15.88:0/2444728172 >> 172.21.15.88:0/2444728172 conn(0x7f2ccc0a7810 msgr2=0x7f2ccc071800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:21.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.602+0000 7f2cd3f2a640 1 -- 172.21.15.88:0/2444728172 shutdown_connections 2023-12-08T08:23:21.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.602+0000 7f2cd3f2a640 1 -- 172.21.15.88:0/2444728172 wait complete. 2023-12-08T08:23:21.626 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-08T08:23:21.627 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:23:21.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.758+0000 7f65f925a640 1 Processor -- start 2023-12-08T08:23:21.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.758+0000 7f65f925a640 1 -- start start 2023-12-08T08:23:21.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.762+0000 7f65f925a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f65f40c3b80 0x7f65f406d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:21.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.762+0000 7f65f925a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f406bb80 con 0x7f65f406d2b0 2023-12-08T08:23:21.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.762+0000 7f65f925a640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f40c5790 con 0x7f65f40c5300 2023-12-08T08:23:21.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.762+0000 7f65f925a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f41515c0 con 0x7f65f40c3b80 2023-12-08T08:23:21.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.762+0000 7f65ebfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f65f40c3b80 0x7f65f406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:21.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.762+0000 7f65ebfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f65f40c3b80 0x7f65f406d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54308/0 (socket says 172.21.15.88:54308) 2023-12-08T08:23:21.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.762+0000 7f65ebfff640 1 -- 172.21.15.88:0/1904536121 learned_addr learned my addr 172.21.15.88:0/1904536121 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:21.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.762+0000 7f65f2d9d640 1 --1- 172.21.15.88:0/1904536121 >> v1:172.21.15.88:6789/0 conn(0x7f65f406d2b0 0x7f65f406c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37982/0 (socket says 172.21.15.88:37982) 2023-12-08T08:23:21.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.762+0000 7f65ebfff640 1 -- 172.21.15.88:0/1904536121 >> v1:172.21.15.148:6789/0 conn(0x7f65f40c5300 legacy=0x7f65f406c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:21.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.762+0000 7f65ebfff640 1 -- 172.21.15.88:0/1904536121 >> v1:172.21.15.88:6789/0 conn(0x7f65f406d2b0 legacy=0x7f65f406c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:21.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.762+0000 7f65f259c640 1 -- 172.21.15.88:0/1904536121 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1423104216 0 0) 0x7f65f406bb80 con 0x7f65f406d2b0 2023-12-08T08:23:21.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.762+0000 7f65ebfff640 1 -- 172.21.15.88:0/1904536121 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f41518a0 con 0x7f65f40c3b80 2023-12-08T08:23:21.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.766+0000 7f65ebfff640 1 --2- 172.21.15.88:0/1904536121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65f40c3b80 0x7f65f406d690 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f65dc00bb10 tx=0x7f65dc01ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff7f6f1610bbb39 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:21.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.766+0000 7f65f259c640 1 -- 172.21.15.88:0/1904536121 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc0a7bb0 con 0x7f65f40c3b80 2023-12-08T08:23:21.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.766+0000 7f65f259c640 1 -- 172.21.15.88:0/1904536121 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65dc0a7d10 con 0x7f65f40c3b80 2023-12-08T08:23:21.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.766+0000 7f65f259c640 1 -- 172.21.15.88:0/1904536121 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc0af660 con 0x7f65f40c3b80 2023-12-08T08:23:21.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.766+0000 7f65f925a640 1 -- 172.21.15.88:0/1904536121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65f40c3b80 msgr2=0x7f65f406d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:21.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.766+0000 7f65f925a640 1 --2- 172.21.15.88:0/1904536121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65f40c3b80 0x7f65f406d690 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f65dc00bb10 tx=0x7f65dc01ebe0 comp rx=0 tx=0).stop 2023-12-08T08:23:21.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.766+0000 7f65f925a640 1 -- 172.21.15.88:0/1904536121 shutdown_connections 2023-12-08T08:23:21.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.766+0000 7f65f925a640 1 --2- 172.21.15.88:0/1904536121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65f40c3b80 0x7f65f406d690 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:21.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.766+0000 7f65f925a640 1 -- 172.21.15.88:0/1904536121 >> 172.21.15.88:0/1904536121 conn(0x7f65f40a7810 msgr2=0x7f65f40a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:21.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.766+0000 7f65f925a640 1 -- 172.21.15.88:0/1904536121 shutdown_connections 2023-12-08T08:23:21.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.766+0000 7f65f925a640 1 -- 172.21.15.88:0/1904536121 wait complete. 2023-12-08T08:23:21.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.766+0000 7f65f925a640 1 Processor -- start 2023-12-08T08:23:21.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.766+0000 7f65f925a640 1 -- start start 2023-12-08T08:23:21.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.770+0000 7f65f925a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65f406d2b0 0x7f65f41ed700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:21.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.770+0000 7f65f925a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65f40c3b80 0x7f65f41506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:21.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.770+0000 7f65f925a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65f40c5300 0x7f65f41463e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:21.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.770+0000 7f65f925a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f414e810 con 0x7f65f40c5300 2023-12-08T08:23:21.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.770+0000 7f65f925a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f41edc40 con 0x7f65f406d2b0 2023-12-08T08:23:21.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.770+0000 7f65f925a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f4145c70 con 0x7f65f40c3b80 2023-12-08T08:23:21.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.770+0000 7f65f359e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65f40c5300 0x7f65f41463e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:21.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.770+0000 7f65f359e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65f40c5300 0x7f65f41463e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54316/0 (socket says 172.21.15.88:54316) 2023-12-08T08:23:21.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.770+0000 7f65f359e640 1 -- 172.21.15.88:0/3748111205 learned_addr learned my addr 172.21.15.88:0/3748111205 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:21.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.770+0000 7f65ebfff640 1 --2- 172.21.15.88:0/3748111205 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65f40c3b80 0x7f65f41506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:21.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.770+0000 7f65f2d9d640 1 --2- 172.21.15.88:0/3748111205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65f406d2b0 0x7f65f41ed700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:21.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.770+0000 7f65f359e640 1 -- 172.21.15.88:0/3748111205 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65f40c3b80 msgr2=0x7f65f41506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:21.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.770+0000 7f65f359e640 1 --2- 172.21.15.88:0/3748111205 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65f40c3b80 0x7f65f41506c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:21.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.770+0000 7f65f359e640 1 -- 172.21.15.88:0/3748111205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65f406d2b0 msgr2=0x7f65f41ed700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:21.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.770+0000 7f65f359e640 1 --2- 172.21.15.88:0/3748111205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65f406d2b0 0x7f65f41ed700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:21.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.770+0000 7f65f359e640 1 -- 172.21.15.88:0/3748111205 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65dc00b770 con 0x7f65f40c5300 2023-12-08T08:23:21.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.770+0000 7f65f2d9d640 1 --2- 172.21.15.88:0/3748111205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65f406d2b0 0x7f65f41ed700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:21.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.770+0000 7f65f359e640 1 --2- 172.21.15.88:0/3748111205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65f40c5300 0x7f65f41463e0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f65ec00c730 tx=0x7f65ec00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:21.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.770+0000 7f65eb7fe640 1 -- 172.21.15.88:0/3748111205 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec003b80 con 0x7f65f40c5300 2023-12-08T08:23:21.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.770+0000 7f65eb7fe640 1 -- 172.21.15.88:0/3748111205 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ec003ce0 con 0x7f65f40c5300 2023-12-08T08:23:21.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.770+0000 7f65f925a640 1 -- 172.21.15.88:0/3748111205 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f414ef80 con 0x7f65f40c5300 2023-12-08T08:23:21.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.770+0000 7f65eb7fe640 1 -- 172.21.15.88:0/3748111205 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec005310 con 0x7f65f40c5300 2023-12-08T08:23:21.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.770+0000 7f65f925a640 1 -- 172.21.15.88:0/3748111205 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f41473b0 con 0x7f65f40c5300 2023-12-08T08:23:21.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.770+0000 7f65f925a640 1 -- 172.21.15.88:0/3748111205 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f4067630 con 0x7f65f40c5300 2023-12-08T08:23:21.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.770+0000 7f65eb7fe640 1 -- 172.21.15.88:0/3748111205 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f65ec005680 con 0x7f65f40c5300 2023-12-08T08:23:21.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.770+0000 7f65eb7fe640 1 --2- 172.21.15.88:0/3748111205 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f65d4066470 0x7f65d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:21.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.774+0000 7f65eb7fe640 1 -- 172.21.15.88:0/3748111205 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f65ec084110 con 0x7f65f40c5300 2023-12-08T08:23:21.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.774+0000 7f65f2d9d640 1 --2- 172.21.15.88:0/3748111205 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f65d4066470 0x7f65d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:21.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.774+0000 7f65f2d9d640 1 --2- 172.21.15.88:0/3748111205 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f65d4066470 0x7f65d4068930 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f65e4000f70 tx=0x7f65e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:21.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.774+0000 7f65eb7fe640 1 -- 172.21.15.88:0/3748111205 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f65ec051220 con 0x7f65f40c5300 2023-12-08T08:23:21.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.922+0000 7f65f925a640 1 -- 172.21.15.88:0/3748111205 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f65f406ba30 con 0x7f65d4066470 2023-12-08T08:23:21.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.934+0000 7f65eb7fe640 1 -- 172.21.15.88:0/3748111205 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+522584 (secure 0 0 0) 0x7f65f406ba30 con 0x7f65d4066470 2023-12-08T08:23:21.945 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:21.948 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:23:21.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.938+0000 7f65f925a640 1 -- 172.21.15.88:0/3748111205 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f65d4066470 msgr2=0x7f65d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:21.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.938+0000 7f65f925a640 1 --2- 172.21.15.88:0/3748111205 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f65d4066470 0x7f65d4068930 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f65e4000f70 tx=0x7f65e4009040 comp rx=0 tx=0).stop 2023-12-08T08:23:21.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.938+0000 7f65f925a640 1 -- 172.21.15.88:0/3748111205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65f40c5300 msgr2=0x7f65f41463e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:21.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.938+0000 7f65f925a640 1 --2- 172.21.15.88:0/3748111205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65f40c5300 0x7f65f41463e0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f65ec00c730 tx=0x7f65ec00cbf0 comp rx=0 tx=0).stop 2023-12-08T08:23:21.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.942+0000 7f65f925a640 1 -- 172.21.15.88:0/3748111205 shutdown_connections 2023-12-08T08:23:21.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.942+0000 7f65f925a640 1 --2- 172.21.15.88:0/3748111205 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f65d4066470 0x7f65d4068930 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:21.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.942+0000 7f65f925a640 1 --2- 172.21.15.88:0/3748111205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65f40c5300 0x7f65f41463e0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:21.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.942+0000 7f65f925a640 1 --2- 172.21.15.88:0/3748111205 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65f40c3b80 0x7f65f41506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:21.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.942+0000 7f65f925a640 1 --2- 172.21.15.88:0/3748111205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65f406d2b0 0x7f65f41ed700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:21.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.942+0000 7f65f925a640 1 -- 172.21.15.88:0/3748111205 >> 172.21.15.88:0/3748111205 conn(0x7f65f40a7810 msgr2=0x7f65f415c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:21.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.942+0000 7f65f925a640 1 -- 172.21.15.88:0/3748111205 shutdown_connections 2023-12-08T08:23:21.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:21.942+0000 7f65f925a640 1 -- 172.21.15.88:0/3748111205 wait complete. 2023-12-08T08:23:21.964 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2023-12-08T08:23:20.784087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":261,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252208,"kb_used_data":6900,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754722512,"statfs":{"total":773094113280,"available":772835852288,"internally_reserved":0,"allocated":7065600,"data_stored":4208008,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.902889"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.897424+0000","last_change":"2023-12-08T08:23:16.897424+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.897424+0000","last_undegraded":"2023-12-08T08:23:16.897424+0000","last_fullsized":"2023-12-08T08:23:16.897424+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889235+0000","last_change":"2023-12-08T08:23:00.281512+0000","last_active":"2023-12-08T08:23:15.889235+0000","last_peered":"2023-12-08T08:23:15.889235+0000","last_clean":"2023-12-08T08:23:15.889235+0000","last_became_active":"2023-12-08T08:23:00.281118+0000","last_became_peered":"2023-12-08T08:23:00.281118+0000","last_unstale":"2023-12-08T08:23:15.889235+0000","last_undegraded":"2023-12-08T08:23:15.889235+0000","last_fullsized":"2023-12-08T08:23:15.889235+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:15.472021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.903319+0000","last_change":"2023-12-08T08:23:16.903319+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.903319+0000","last_undegraded":"2023-12-08T08:23:16.903319+0000","last_fullsized":"2023-12-08T08:23:16.903319+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.891247+0000","last_change":"2023-12-08T08:23:00.276523+0000","last_active":"2023-12-08T08:23:15.891247+0000","last_peered":"2023-12-08T08:23:15.891247+0000","last_clean":"2023-12-08T08:23:15.891247+0000","last_became_active":"2023-12-08T08:23:00.276039+0000","last_became_peered":"2023-12-08T08:23:00.276039+0000","last_unstale":"2023-12-08T08:23:15.891247+0000","last_undegraded":"2023-12-08T08:23:15.891247+0000","last_fullsized":"2023-12-08T08:23:15.891247+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:31:16.893953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896828+0000","last_change":"2023-12-08T08:23:16.896828+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896828+0000","last_undegraded":"2023-12-08T08:23:16.896828+0000","last_fullsized":"2023-12-08T08:23:16.896828+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895520+0000","last_change":"2023-12-08T08:23:00.283198+0000","last_active":"2023-12-08T08:23:15.895520+0000","last_peered":"2023-12-08T08:23:15.895520+0000","last_clean":"2023-12-08T08:23:15.895520+0000","last_became_active":"2023-12-08T08:23:00.282944+0000","last_became_peered":"2023-12-08T08:23:00.282944+0000","last_unstale":"2023-12-08T08:23:15.895520+0000","last_undegraded":"2023-12-08T08:23:15.895520+0000","last_fullsized":"2023-12-08T08:23:15.895520+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:33.898137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.898081+0000","last_change":"2023-12-08T08:23:16.898081+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.898081+0000","last_undegraded":"2023-12-08T08:23:16.898081+0000","last_fullsized":"2023-12-08T08:23:16.898081+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.884023+0000","last_change":"2023-12-08T08:23:00.285685+0000","last_active":"2023-12-08T08:23:15.884023+0000","last_peered":"2023-12-08T08:23:15.884023+0000","last_clean":"2023-12-08T08:23:15.884023+0000","last_became_active":"2023-12-08T08:23:00.285351+0000","last_became_peered":"2023-12-08T08:23:00.285351+0000","last_unstale":"2023-12-08T08:23:15.884023+0000","last_undegraded":"2023-12-08T08:23:15.884023+0000","last_fullsized":"2023-12-08T08:23:15.884023+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:43:34.830332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900497+0000","last_change":"2023-12-08T08:23:16.900497+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900497+0000","last_undegraded":"2023-12-08T08:23:16.900497+0000","last_fullsized":"2023-12-08T08:23:16.900497+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885459+0000","last_change":"2023-12-08T08:23:00.264270+0000","last_active":"2023-12-08T08:23:15.885459+0000","last_peered":"2023-12-08T08:23:15.885459+0000","last_clean":"2023-12-08T08:23:15.885459+0000","last_became_active":"2023-12-08T08:23:00.263994+0000","last_became_peered":"2023-12-08T08:23:00.263994+0000","last_unstale":"2023-12-08T08:23:15.885459+0000","last_undegraded":"2023-12-08T08:23:15.885459+0000","last_fullsized":"2023-12-08T08:23:15.885459+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:33.905575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900421+0000","last_change":"2023-12-08T08:23:16.900421+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900421+0000","last_undegraded":"2023-12-08T08:23:16.900421+0000","last_fullsized":"2023-12-08T08:23:16.900421+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895579+0000","last_change":"2023-12-08T08:23:00.300354+0000","last_active":"2023-12-08T08:23:15.895579+0000","last_peered":"2023-12-08T08:23:15.895579+0000","last_clean":"2023-12-08T08:23:15.895579+0000","last_became_active":"2023-12-08T08:23:00.300026+0000","last_became_peered":"2023-12-08T08:23:00.300026+0000","last_unstale":"2023-12-08T08:23:15.895579+0000","last_undegraded":"2023-12-08T08:23:15.895579+0000","last_fullsized":"2023-12-08T08:23:15.895579+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.905320+0000","last_change":"2023-12-08T08:23:16.905320+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.905320+0000","last_undegraded":"2023-12-08T08:23:16.905320+0000","last_fullsized":"2023-12-08T08:23:16.905320+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883417+0000","last_change":"2023-12-08T08:23:00.278456+0000","last_active":"2023-12-08T08:23:15.883417+0000","last_peered":"2023-12-08T08:23:15.883417+0000","last_clean":"2023-12-08T08:23:15.883417+0000","last_became_active":"2023-12-08T08:23:00.277186+0000","last_became_peered":"2023-12-08T08:23:00.277186+0000","last_unstale":"2023-12-08T08:23:15.883417+0000","last_undegraded":"2023-12-08T08:23:15.883417+0000","last_fullsized":"2023-12-08T08:23:15.883417+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:20:16.170951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900665+0000","last_change":"2023-12-08T08:23:16.900665+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900665+0000","last_undegraded":"2023-12-08T08:23:16.900665+0000","last_fullsized":"2023-12-08T08:23:16.900665+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.893869+0000","last_change":"2023-12-08T08:23:00.272694+0000","last_active":"2023-12-08T08:23:15.893869+0000","last_peered":"2023-12-08T08:23:15.893869+0000","last_clean":"2023-12-08T08:23:15.893869+0000","last_became_active":"2023-12-08T08:23:00.272440+0000","last_became_peered":"2023-12-08T08:23:00.272440+0000","last_unstale":"2023-12-08T08:23:15.893869+0000","last_undegraded":"2023-12-08T08:23:15.893869+0000","last_fullsized":"2023-12-08T08:23:15.893869+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:15.472021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.908893+0000","last_change":"2023-12-08T08:23:16.908893+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.908893+0000","last_undegraded":"2023-12-08T08:23:16.908893+0000","last_fullsized":"2023-12-08T08:23:16.908893+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895866+0000","last_change":"2023-12-08T08:23:00.298447+0000","last_active":"2023-12-08T08:23:15.895866+0000","last_peered":"2023-12-08T08:23:15.895866+0000","last_clean":"2023-12-08T08:23:15.895866+0000","last_became_active":"2023-12-08T08:23:00.298113+0000","last_became_peered":"2023-12-08T08:23:00.298113+0000","last_unstale":"2023-12-08T08:23:15.895866+0000","last_undegraded":"2023-12-08T08:23:15.895866+0000","last_fullsized":"2023-12-08T08:23:15.895866+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896836+0000","last_change":"2023-12-08T08:23:16.896836+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896836+0000","last_undegraded":"2023-12-08T08:23:16.896836+0000","last_fullsized":"2023-12-08T08:23:16.896836+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889234+0000","last_change":"2023-12-08T08:23:00.277064+0000","last_active":"2023-12-08T08:23:15.889234+0000","last_peered":"2023-12-08T08:23:15.889234+0000","last_clean":"2023-12-08T08:23:15.889234+0000","last_became_active":"2023-12-08T08:23:00.276850+0000","last_became_peered":"2023-12-08T08:23:00.276850+0000","last_unstale":"2023-12-08T08:23:15.889234+0000","last_undegraded":"2023-12-08T08:23:15.889234+0000","last_fullsized":"2023-12-08T08:23:15.889234+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896062+0000","last_change":"2023-12-08T08:23:16.896062+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896062+0000","last_undegraded":"2023-12-08T08:23:16.896062+0000","last_fullsized":"2023-12-08T08:23:16.896062+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.891049+0000","last_change":"2023-12-08T08:23:00.286362+0000","last_active":"2023-12-08T08:23:15.891049+0000","last_peered":"2023-12-08T08:23:15.891049+0000","last_clean":"2023-12-08T08:23:15.891049+0000","last_became_active":"2023-12-08T08:23:00.286071+0000","last_became_peered":"2023-12-08T08:23:00.286071+0000","last_unstale":"2023-12-08T08:23:15.891049+0000","last_undegraded":"2023-12-08T08:23:15.891049+0000","last_fullsized":"2023-12-08T08:23:15.891049+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:50.890759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.905090+0000","last_change":"2023-12-08T08:23:16.905090+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.905090+0000","last_undegraded":"2023-12-08T08:23:16.905090+0000","last_fullsized":"2023-12-08T08:23:16.905090+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888742+0000","last_change":"2023-12-08T08:23:00.277187+0000","last_active":"2023-12-08T08:23:15.888742+0000","last_peered":"2023-12-08T08:23:15.888742+0000","last_clean":"2023-12-08T08:23:15.888742+0000","last_became_active":"2023-12-08T08:23:00.276929+0000","last_became_peered":"2023-12-08T08:23:00.276929+0000","last_unstale":"2023-12-08T08:23:15.888742+0000","last_undegraded":"2023-12-08T08:23:15.888742+0000","last_fullsized":"2023-12-08T08:23:15.888742+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:55:36.390421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.908607+0000","last_change":"2023-12-08T08:23:16.908607+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.908607+0000","last_undegraded":"2023-12-08T08:23:16.908607+0000","last_fullsized":"2023-12-08T08:23:16.908607+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894617+0000","last_change":"2023-12-08T08:23:00.275837+0000","last_active":"2023-12-08T08:23:15.894617+0000","last_peered":"2023-12-08T08:23:15.894617+0000","last_clean":"2023-12-08T08:23:15.894617+0000","last_became_active":"2023-12-08T08:23:00.275561+0000","last_became_peered":"2023-12-08T08:23:00.275561+0000","last_unstale":"2023-12-08T08:23:15.894617+0000","last_undegraded":"2023-12-08T08:23:15.894617+0000","last_fullsized":"2023-12-08T08:23:15.894617+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.901924+0000","last_change":"2023-12-08T08:23:16.901924+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.901924+0000","last_undegraded":"2023-12-08T08:23:16.901924+0000","last_fullsized":"2023-12-08T08:23:16.901924+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883534+0000","last_change":"2023-12-08T08:23:00.295614+0000","last_active":"2023-12-08T08:23:15.883534+0000","last_peered":"2023-12-08T08:23:15.883534+0000","last_clean":"2023-12-08T08:23:15.883534+0000","last_became_active":"2023-12-08T08:23:00.295111+0000","last_became_peered":"2023-12-08T08:23:00.295111+0000","last_unstale":"2023-12-08T08:23:15.883534+0000","last_undegraded":"2023-12-08T08:23:15.883534+0000","last_fullsized":"2023-12-08T08:23:15.883534+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:10:16.885890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.907581+0000","last_change":"2023-12-08T08:23:16.907581+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.907581+0000","last_undegraded":"2023-12-08T08:23:16.907581+0000","last_fullsized":"2023-12-08T08:23:16.907581+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888024+0000","last_change":"2023-12-08T08:23:00.292909+0000","last_active":"2023-12-08T08:23:15.888024+0000","last_peered":"2023-12-08T08:23:15.888024+0000","last_clean":"2023-12-08T08:23:15.888024+0000","last_became_active":"2023-12-08T08:23:00.292500+0000","last_became_peered":"2023-12-08T08:23:00.292500+0000","last_unstale":"2023-12-08T08:23:15.888024+0000","last_undegraded":"2023-12-08T08:23:15.888024+0000","last_fullsized":"2023-12-08T08:23:15.888024+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:21:14.553932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.902396+0000","last_change":"2023-12-08T08:23:16.902396+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.902396+0000","last_undegraded":"2023-12-08T08:23:16.902396+0000","last_fullsized":"2023-12-08T08:23:16.902396+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885220+0000","last_change":"2023-12-08T08:23:00.273084+0000","last_active":"2023-12-08T08:23:15.885220+0000","last_peered":"2023-12-08T08:23:15.885220+0000","last_clean":"2023-12-08T08:23:15.885220+0000","last_became_active":"2023-12-08T08:23:00.272803+0000","last_became_peered":"2023-12-08T08:23:00.272803+0000","last_unstale":"2023-12-08T08:23:15.885220+0000","last_undegraded":"2023-12-08T08:23:15.885220+0000","last_fullsized":"2023-12-08T08:23:15.885220+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:16.068318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900173+0000","last_change":"2023-12-08T08:23:16.900173+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900173+0000","last_undegraded":"2023-12-08T08:23:16.900173+0000","last_fullsized":"2023-12-08T08:23:16.900173+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.886059+0000","last_change":"2023-12-08T08:23:00.300292+0000","last_active":"2023-12-08T08:23:15.886059+0000","last_peered":"2023-12-08T08:23:15.886059+0000","last_clean":"2023-12-08T08:23:15.886059+0000","last_became_active":"2023-12-08T08:23:00.300008+0000","last_became_peered":"2023-12-08T08:23:00.300008+0000","last_unstale":"2023-12-08T08:23:15.886059+0000","last_undegraded":"2023-12-08T08:23:15.886059+0000","last_fullsized":"2023-12-08T08:23:15.886059+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:39.385907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896360+0000","last_change":"2023-12-08T08:23:16.896360+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896360+0000","last_undegraded":"2023-12-08T08:23:16.896360+0000","last_fullsized":"2023-12-08T08:23:16.896360+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.884197+0000","last_change":"2023-12-08T08:23:00.299621+0000","last_active":"2023-12-08T08:23:15.884197+0000","last_peered":"2023-12-08T08:23:15.884197+0000","last_clean":"2023-12-08T08:23:15.884197+0000","last_became_active":"2023-12-08T08:23:00.299255+0000","last_became_peered":"2023-12-08T08:23:00.299255+0000","last_unstale":"2023-12-08T08:23:15.884197+0000","last_undegraded":"2023-12-08T08:23:15.884197+0000","last_fullsized":"2023-12-08T08:23:15.884197+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:28:46.845466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896496+0000","last_change":"2023-12-08T08:23:16.896496+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896496+0000","last_undegraded":"2023-12-08T08:23:16.896496+0000","last_fullsized":"2023-12-08T08:23:16.896496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.896102+0000","last_change":"2023-12-08T08:23:00.296010+0000","last_active":"2023-12-08T08:23:15.896102+0000","last_peered":"2023-12-08T08:23:15.896102+0000","last_clean":"2023-12-08T08:23:15.896102+0000","last_became_active":"2023-12-08T08:23:00.295749+0000","last_became_peered":"2023-12-08T08:23:00.295749+0000","last_unstale":"2023-12-08T08:23:15.896102+0000","last_undegraded":"2023-12-08T08:23:15.896102+0000","last_fullsized":"2023-12-08T08:23:15.896102+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:39.385907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.902160+0000","last_change":"2023-12-08T08:23:16.902160+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.902160+0000","last_undegraded":"2023-12-08T08:23:16.902160+0000","last_fullsized":"2023-12-08T08:23:16.902160+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.884023+0000","last_change":"2023-12-08T08:23:00.301831+0000","last_active":"2023-12-08T08:23:15.884023+0000","last_peered":"2023-12-08T08:23:15.884023+0000","last_clean":"2023-12-08T08:23:15.884023+0000","last_became_active":"2023-12-08T08:23:00.301321+0000","last_became_peered":"2023-12-08T08:23:00.301321+0000","last_unstale":"2023-12-08T08:23:15.884023+0000","last_undegraded":"2023-12-08T08:23:15.884023+0000","last_fullsized":"2023-12-08T08:23:15.884023+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:14:54.964832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.895365+0000","last_change":"2023-12-08T08:23:16.895365+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.895365+0000","last_undegraded":"2023-12-08T08:23:16.895365+0000","last_fullsized":"2023-12-08T08:23:16.895365+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883777+0000","last_change":"2023-12-08T08:23:00.301605+0000","last_active":"2023-12-08T08:23:15.883777+0000","last_peered":"2023-12-08T08:23:15.883777+0000","last_clean":"2023-12-08T08:23:15.883777+0000","last_became_active":"2023-12-08T08:23:00.301346+0000","last_became_peered":"2023-12-08T08:23:00.301346+0000","last_unstale":"2023-12-08T08:23:15.883777+0000","last_undegraded":"2023-12-08T08:23:15.883777+0000","last_fullsized":"2023-12-08T08:23:15.883777+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:35:35.139064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900505+0000","last_change":"2023-12-08T08:23:16.900505+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900505+0000","last_undegraded":"2023-12-08T08:23:16.900505+0000","last_fullsized":"2023-12-08T08:23:16.900505+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889839+0000","last_change":"2023-12-08T08:23:00.301440+0000","last_active":"2023-12-08T08:23:15.889839+0000","last_peered":"2023-12-08T08:23:15.889839+0000","last_clean":"2023-12-08T08:23:15.889839+0000","last_became_active":"2023-12-08T08:23:00.301156+0000","last_became_peered":"2023-12-08T08:23:00.301156+0000","last_unstale":"2023-12-08T08:23:15.889839+0000","last_undegraded":"2023-12-08T08:23:15.889839+0000","last_fullsized":"2023-12-08T08:23:15.889839+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:04:21.562137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900540+0000","last_change":"2023-12-08T08:23:16.900540+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900540+0000","last_undegraded":"2023-12-08T08:23:16.900540+0000","last_fullsized":"2023-12-08T08:23:16.900540+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888706+0000","last_change":"2023-12-08T08:23:00.301914+0000","last_active":"2023-12-08T08:23:15.888706+0000","last_peered":"2023-12-08T08:23:15.888706+0000","last_clean":"2023-12-08T08:23:15.888706+0000","last_became_active":"2023-12-08T08:23:00.301688+0000","last_became_peered":"2023-12-08T08:23:00.301688+0000","last_unstale":"2023-12-08T08:23:15.888706+0000","last_undegraded":"2023-12-08T08:23:15.888706+0000","last_fullsized":"2023-12-08T08:23:15.888706+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:27:39.303886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896058+0000","last_change":"2023-12-08T08:23:16.896058+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896058+0000","last_undegraded":"2023-12-08T08:23:16.896058+0000","last_fullsized":"2023-12-08T08:23:16.896058+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883508+0000","last_change":"2023-12-08T08:23:00.298664+0000","last_active":"2023-12-08T08:23:15.883508+0000","last_peered":"2023-12-08T08:23:15.883508+0000","last_clean":"2023-12-08T08:23:15.883508+0000","last_became_active":"2023-12-08T08:23:00.298341+0000","last_became_peered":"2023-12-08T08:23:00.298341+0000","last_unstale":"2023-12-08T08:23:15.883508+0000","last_undegraded":"2023-12-08T08:23:15.883508+0000","last_fullsized":"2023-12-08T08:23:15.883508+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:20:20.944416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900528+0000","last_change":"2023-12-08T08:23:16.900528+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900528+0000","last_undegraded":"2023-12-08T08:23:16.900528+0000","last_fullsized":"2023-12-08T08:23:16.900528+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.891893+0000","last_change":"2023-12-08T08:23:00.280235+0000","last_active":"2023-12-08T08:23:15.891893+0000","last_peered":"2023-12-08T08:23:15.891893+0000","last_clean":"2023-12-08T08:23:15.891893+0000","last_became_active":"2023-12-08T08:23:00.278807+0000","last_became_peered":"2023-12-08T08:23:00.278807+0000","last_unstale":"2023-12-08T08:23:15.891893+0000","last_undegraded":"2023-12-08T08:23:15.891893+0000","last_fullsized":"2023-12-08T08:23:15.891893+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:30:44.391621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.905250+0000","last_change":"2023-12-08T08:23:16.905250+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.905250+0000","last_undegraded":"2023-12-08T08:23:16.905250+0000","last_fullsized":"2023-12-08T08:23:16.905250+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895888+0000","last_change":"2023-12-08T08:23:00.278532+0000","last_active":"2023-12-08T08:23:15.895888+0000","last_peered":"2023-12-08T08:23:15.895888+0000","last_clean":"2023-12-08T08:23:15.895888+0000","last_became_active":"2023-12-08T08:23:00.278177+0000","last_became_peered":"2023-12-08T08:23:00.278177+0000","last_unstale":"2023-12-08T08:23:15.895888+0000","last_undegraded":"2023-12-08T08:23:15.895888+0000","last_fullsized":"2023-12-08T08:23:15.895888+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:56.216551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.905136+0000","last_change":"2023-12-08T08:23:16.905136+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.905136+0000","last_undegraded":"2023-12-08T08:23:16.905136+0000","last_fullsized":"2023-12-08T08:23:16.905136+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885639+0000","last_change":"2023-12-08T08:23:00.284090+0000","last_active":"2023-12-08T08:23:15.885639+0000","last_peered":"2023-12-08T08:23:15.885639+0000","last_clean":"2023-12-08T08:23:15.885639+0000","last_became_active":"2023-12-08T08:23:00.283777+0000","last_became_peered":"2023-12-08T08:23:00.283777+0000","last_unstale":"2023-12-08T08:23:15.885639+0000","last_undegraded":"2023-12-08T08:23:15.885639+0000","last_fullsized":"2023-12-08T08:23:15.885639+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896936+0000","last_change":"2023-12-08T08:23:16.896936+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896936+0000","last_undegraded":"2023-12-08T08:23:16.896936+0000","last_fullsized":"2023-12-08T08:23:16.896936+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888780+0000","last_change":"2023-12-08T08:23:00.277149+0000","last_active":"2023-12-08T08:23:15.888780+0000","last_peered":"2023-12-08T08:23:15.888780+0000","last_clean":"2023-12-08T08:23:15.888780+0000","last_became_active":"2023-12-08T08:23:00.276879+0000","last_became_peered":"2023-12-08T08:23:00.276879+0000","last_unstale":"2023-12-08T08:23:15.888780+0000","last_undegraded":"2023-12-08T08:23:15.888780+0000","last_fullsized":"2023-12-08T08:23:15.888780+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:16.068318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.901831+0000","last_change":"2023-12-08T08:23:16.901831+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.901831+0000","last_undegraded":"2023-12-08T08:23:16.901831+0000","last_fullsized":"2023-12-08T08:23:16.901831+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.890291+0000","last_change":"2023-12-08T08:23:00.294726+0000","last_active":"2023-12-08T08:23:15.890291+0000","last_peered":"2023-12-08T08:23:15.890291+0000","last_clean":"2023-12-08T08:23:15.890291+0000","last_became_active":"2023-12-08T08:23:00.294450+0000","last_became_peered":"2023-12-08T08:23:00.294450+0000","last_unstale":"2023-12-08T08:23:15.890291+0000","last_undegraded":"2023-12-08T08:23:15.890291+0000","last_fullsized":"2023-12-08T08:23:15.890291+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:28:25.934029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.895819+0000","last_change":"2023-12-08T08:23:16.895819+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.895819+0000","last_undegraded":"2023-12-08T08:23:16.895819+0000","last_fullsized":"2023-12-08T08:23:16.895819+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889918+0000","last_change":"2023-12-08T08:23:00.288804+0000","last_active":"2023-12-08T08:23:15.889918+0000","last_peered":"2023-12-08T08:23:15.889918+0000","last_clean":"2023-12-08T08:23:15.889918+0000","last_became_active":"2023-12-08T08:23:00.288315+0000","last_became_peered":"2023-12-08T08:23:00.288315+0000","last_unstale":"2023-12-08T08:23:15.889918+0000","last_undegraded":"2023-12-08T08:23:15.889918+0000","last_fullsized":"2023-12-08T08:23:15.889918+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:23:06.925359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.895362+0000","last_change":"2023-12-08T08:23:16.895362+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.895362+0000","last_undegraded":"2023-12-08T08:23:16.895362+0000","last_fullsized":"2023-12-08T08:23:16.895362+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885385+0000","last_change":"2023-12-08T08:23:00.294482+0000","last_active":"2023-12-08T08:23:15.885385+0000","last_peered":"2023-12-08T08:23:15.885385+0000","last_clean":"2023-12-08T08:23:15.885385+0000","last_became_active":"2023-12-08T08:23:00.294057+0000","last_became_peered":"2023-12-08T08:23:00.294057+0000","last_unstale":"2023-12-08T08:23:15.885385+0000","last_undegraded":"2023-12-08T08:23:15.885385+0000","last_fullsized":"2023-12-08T08:23:15.885385+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:42:20.038693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.898306+0000","last_change":"2023-12-08T08:23:16.898306+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.898306+0000","last_undegraded":"2023-12-08T08:23:16.898306+0000","last_fullsized":"2023-12-08T08:23:16.898306+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888263+0000","last_change":"2023-12-08T08:23:00.272949+0000","last_active":"2023-12-08T08:23:15.888263+0000","last_peered":"2023-12-08T08:23:15.888263+0000","last_clean":"2023-12-08T08:23:15.888263+0000","last_became_active":"2023-12-08T08:23:00.272655+0000","last_became_peered":"2023-12-08T08:23:00.272655+0000","last_unstale":"2023-12-08T08:23:15.888263+0000","last_undegraded":"2023-12-08T08:23:15.888263+0000","last_fullsized":"2023-12-08T08:23:15.888263+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:28.275394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.897379+0000","last_change":"2023-12-08T08:23:16.897379+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.897379+0000","last_undegraded":"2023-12-08T08:23:16.897379+0000","last_fullsized":"2023-12-08T08:23:16.897379+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.921665+0000","last_change":"2023-12-08T08:23:16.917024+0000","last_active":"2023-12-08T08:23:16.921665+0000","last_peered":"2023-12-08T08:23:16.921665+0000","last_clean":"2023-12-08T08:23:16.921665+0000","last_became_active":"2023-12-08T08:23:16.916776+0000","last_became_peered":"2023-12-08T08:23:16.916776+0000","last_unstale":"2023-12-08T08:23:16.921665+0000","last_undegraded":"2023-12-08T08:23:16.921665+0000","last_fullsized":"2023-12-08T08:23:16.921665+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:14:23.904816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885919+0000","last_change":"2023-12-08T08:23:00.273779+0000","last_active":"2023-12-08T08:23:15.885919+0000","last_peered":"2023-12-08T08:23:15.885919+0000","last_clean":"2023-12-08T08:23:15.885919+0000","last_became_active":"2023-12-08T08:23:00.273256+0000","last_became_peered":"2023-12-08T08:23:00.273256+0000","last_unstale":"2023-12-08T08:23:15.885919+0000","last_undegraded":"2023-12-08T08:23:15.885919+0000","last_fullsized":"2023-12-08T08:23:15.885919+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"67'4","reported_seq":18,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889446+0000","last_change":"2023-12-08T08:22:59.285668+0000","last_active":"2023-12-08T08:23:15.889446+0000","last_peered":"2023-12-08T08:23:15.889446+0000","last_clean":"2023-12-08T08:23:15.889446+0000","last_became_active":"2023-12-08T08:22:59.285340+0000","last_became_peered":"2023-12-08T08:22:59.285340+0000","last_unstale":"2023-12-08T08:23:15.889446+0000","last_undegraded":"2023-12-08T08:23:15.889446+0000","last_fullsized":"2023-12-08T08:23:15.889446+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:35:15.000491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.895648+0000","last_change":"2023-12-08T08:23:16.895648+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.895648+0000","last_undegraded":"2023-12-08T08:23:16.895648+0000","last_fullsized":"2023-12-08T08:23:16.895648+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.911983+0000","last_change":"2023-12-08T08:23:16.905712+0000","last_active":"2023-12-08T08:23:16.911983+0000","last_peered":"2023-12-08T08:23:16.911983+0000","last_clean":"2023-12-08T08:23:16.911983+0000","last_became_active":"2023-12-08T08:23:16.905399+0000","last_became_peered":"2023-12-08T08:23:16.905399+0000","last_unstale":"2023-12-08T08:23:16.911983+0000","last_undegraded":"2023-12-08T08:23:16.911983+0000","last_fullsized":"2023-12-08T08:23:16.911983+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:10:23.005533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889328+0000","last_change":"2023-12-08T08:23:00.300874+0000","last_active":"2023-12-08T08:23:15.889328+0000","last_peered":"2023-12-08T08:23:15.889328+0000","last_clean":"2023-12-08T08:23:15.889328+0000","last_became_active":"2023-12-08T08:23:00.300595+0000","last_became_peered":"2023-12-08T08:23:00.300595+0000","last_unstale":"2023-12-08T08:23:15.889328+0000","last_undegraded":"2023-12-08T08:23:15.889328+0000","last_fullsized":"2023-12-08T08:23:15.889328+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"67'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.886098+0000","last_change":"2023-12-08T08:22:59.274595+0000","last_active":"2023-12-08T08:23:15.886098+0000","last_peered":"2023-12-08T08:23:15.886098+0000","last_clean":"2023-12-08T08:23:15.886098+0000","last_became_active":"2023-12-08T08:22:59.274280+0000","last_became_peered":"2023-12-08T08:22:59.274280+0000","last_unstale":"2023-12-08T08:23:15.886098+0000","last_undegraded":"2023-12-08T08:23:15.886098+0000","last_fullsized":"2023-12-08T08:23:15.886098+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:27.267774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.899707+0000","last_change":"2023-12-08T08:23:16.899707+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.899707+0000","last_undegraded":"2023-12-08T08:23:16.899707+0000","last_fullsized":"2023-12-08T08:23:16.899707+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920597+0000","last_change":"2023-12-08T08:23:16.915200+0000","last_active":"2023-12-08T08:23:16.920597+0000","last_peered":"2023-12-08T08:23:16.920597+0000","last_clean":"2023-12-08T08:23:16.920597+0000","last_became_active":"2023-12-08T08:23:16.914766+0000","last_became_peered":"2023-12-08T08:23:16.914766+0000","last_unstale":"2023-12-08T08:23:16.920597+0000","last_undegraded":"2023-12-08T08:23:16.920597+0000","last_fullsized":"2023-12-08T08:23:16.920597+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:53:48.202811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888831+0000","last_change":"2023-12-08T08:23:00.280594+0000","last_active":"2023-12-08T08:23:15.888831+0000","last_peered":"2023-12-08T08:23:15.888831+0000","last_clean":"2023-12-08T08:23:15.888831+0000","last_became_active":"2023-12-08T08:23:00.279794+0000","last_became_peered":"2023-12-08T08:23:00.279794+0000","last_unstale":"2023-12-08T08:23:15.888831+0000","last_undegraded":"2023-12-08T08:23:15.888831+0000","last_fullsized":"2023-12-08T08:23:15.888831+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:33.905575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"67'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.896121+0000","last_change":"2023-12-08T08:22:59.282892+0000","last_active":"2023-12-08T08:23:15.896121+0000","last_peered":"2023-12-08T08:23:15.896121+0000","last_clean":"2023-12-08T08:23:15.896121+0000","last_became_active":"2023-12-08T08:22:59.282172+0000","last_became_peered":"2023-12-08T08:22:59.282172+0000","last_unstale":"2023-12-08T08:23:15.896121+0000","last_undegraded":"2023-12-08T08:23:15.896121+0000","last_fullsized":"2023-12-08T08:23:15.896121+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:32.890517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.902603+0000","last_change":"2023-12-08T08:23:16.902603+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.902603+0000","last_undegraded":"2023-12-08T08:23:16.902603+0000","last_fullsized":"2023-12-08T08:23:16.902603+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920546+0000","last_change":"2023-12-08T08:23:16.917813+0000","last_active":"2023-12-08T08:23:16.920546+0000","last_peered":"2023-12-08T08:23:16.920546+0000","last_clean":"2023-12-08T08:23:16.920546+0000","last_became_active":"2023-12-08T08:23:16.917358+0000","last_became_peered":"2023-12-08T08:23:16.917358+0000","last_unstale":"2023-12-08T08:23:16.920546+0000","last_undegraded":"2023-12-08T08:23:16.920546+0000","last_fullsized":"2023-12-08T08:23:16.920546+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:18:49.227732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895498+0000","last_change":"2023-12-08T08:23:00.304580+0000","last_active":"2023-12-08T08:23:15.895498+0000","last_peered":"2023-12-08T08:23:15.895498+0000","last_clean":"2023-12-08T08:23:15.895498+0000","last_became_active":"2023-12-08T08:23:00.304098+0000","last_became_peered":"2023-12-08T08:23:00.304098+0000","last_unstale":"2023-12-08T08:23:15.895498+0000","last_undegraded":"2023-12-08T08:23:15.895498+0000","last_fullsized":"2023-12-08T08:23:15.895498+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:29:03.020360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"67'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895935+0000","last_change":"2023-12-08T08:22:59.283290+0000","last_active":"2023-12-08T08:23:15.895935+0000","last_peered":"2023-12-08T08:23:15.895935+0000","last_clean":"2023-12-08T08:23:15.895935+0000","last_became_active":"2023-12-08T08:22:59.282103+0000","last_became_peered":"2023-12-08T08:22:59.282103+0000","last_unstale":"2023-12-08T08:23:15.895935+0000","last_undegraded":"2023-12-08T08:23:15.895935+0000","last_fullsized":"2023-12-08T08:23:15.895935+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:15.256488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.903785+0000","last_change":"2023-12-08T08:23:16.903785+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.903785+0000","last_undegraded":"2023-12-08T08:23:16.903785+0000","last_fullsized":"2023-12-08T08:23:16.903785+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.919943+0000","last_change":"2023-12-08T08:23:16.916123+0000","last_active":"2023-12-08T08:23:16.919943+0000","last_peered":"2023-12-08T08:23:16.919943+0000","last_clean":"2023-12-08T08:23:16.919943+0000","last_became_active":"2023-12-08T08:23:16.915147+0000","last_became_peered":"2023-12-08T08:23:16.915147+0000","last_unstale":"2023-12-08T08:23:16.919943+0000","last_undegraded":"2023-12-08T08:23:16.919943+0000","last_fullsized":"2023-12-08T08:23:16.919943+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:48:31.917542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.890002+0000","last_change":"2023-12-08T08:23:00.288605+0000","last_active":"2023-12-08T08:23:15.890002+0000","last_peered":"2023-12-08T08:23:15.890002+0000","last_clean":"2023-12-08T08:23:15.890002+0000","last_became_active":"2023-12-08T08:23:00.287910+0000","last_became_peered":"2023-12-08T08:23:00.287910+0000","last_unstale":"2023-12-08T08:23:15.890002+0000","last_undegraded":"2023-12-08T08:23:15.890002+0000","last_fullsized":"2023-12-08T08:23:15.890002+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:55.193260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"67'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885593+0000","last_change":"2023-12-08T08:22:59.267027+0000","last_active":"2023-12-08T08:23:15.885593+0000","last_peered":"2023-12-08T08:23:15.885593+0000","last_clean":"2023-12-08T08:23:15.885593+0000","last_became_active":"2023-12-08T08:22:59.265676+0000","last_became_peered":"2023-12-08T08:22:59.265676+0000","last_unstale":"2023-12-08T08:23:15.885593+0000","last_undegraded":"2023-12-08T08:23:15.885593+0000","last_fullsized":"2023-12-08T08:23:15.885593+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:19.279362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.894564+0000","last_change":"2023-12-08T08:23:16.894564+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.894564+0000","last_undegraded":"2023-12-08T08:23:16.894564+0000","last_fullsized":"2023-12-08T08:23:16.894564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.921704+0000","last_change":"2023-12-08T08:23:16.918070+0000","last_active":"2023-12-08T08:23:16.921704+0000","last_peered":"2023-12-08T08:23:16.921704+0000","last_clean":"2023-12-08T08:23:16.921704+0000","last_became_active":"2023-12-08T08:23:16.917808+0000","last_became_peered":"2023-12-08T08:23:16.917808+0000","last_unstale":"2023-12-08T08:23:16.921704+0000","last_undegraded":"2023-12-08T08:23:16.921704+0000","last_fullsized":"2023-12-08T08:23:16.921704+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:35:32.637419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885437+0000","last_change":"2023-12-08T08:23:00.300280+0000","last_active":"2023-12-08T08:23:15.885437+0000","last_peered":"2023-12-08T08:23:15.885437+0000","last_clean":"2023-12-08T08:23:15.885437+0000","last_became_active":"2023-12-08T08:23:00.299998+0000","last_became_peered":"2023-12-08T08:23:00.299998+0000","last_unstale":"2023-12-08T08:23:15.885437+0000","last_undegraded":"2023-12-08T08:23:15.885437+0000","last_fullsized":"2023-12-08T08:23:15.885437+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:15.472021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"67'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885466+0000","last_change":"2023-12-08T08:22:59.274800+0000","last_active":"2023-12-08T08:23:15.885466+0000","last_peered":"2023-12-08T08:23:15.885466+0000","last_clean":"2023-12-08T08:23:15.885466+0000","last_became_active":"2023-12-08T08:22:59.274501+0000","last_became_peered":"2023-12-08T08:22:59.274501+0000","last_unstale":"2023-12-08T08:23:15.885466+0000","last_undegraded":"2023-12-08T08:23:15.885466+0000","last_fullsized":"2023-12-08T08:23:15.885466+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:54.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.901187+0000","last_change":"2023-12-08T08:23:16.901187+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.901187+0000","last_undegraded":"2023-12-08T08:23:16.901187+0000","last_fullsized":"2023-12-08T08:23:16.901187+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.918634+0000","last_change":"2023-12-08T08:23:16.915536+0000","last_active":"2023-12-08T08:23:16.918634+0000","last_peered":"2023-12-08T08:23:16.918634+0000","last_clean":"2023-12-08T08:23:16.918634+0000","last_became_active":"2023-12-08T08:23:16.915216+0000","last_became_peered":"2023-12-08T08:23:16.915216+0000","last_unstale":"2023-12-08T08:23:16.918634+0000","last_undegraded":"2023-12-08T08:23:16.918634+0000","last_fullsized":"2023-12-08T08:23:16.918634+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:18:18.945931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894156+0000","last_change":"2023-12-08T08:23:00.298811+0000","last_active":"2023-12-08T08:23:15.894156+0000","last_peered":"2023-12-08T08:23:15.894156+0000","last_clean":"2023-12-08T08:23:15.894156+0000","last_became_active":"2023-12-08T08:23:00.298524+0000","last_became_peered":"2023-12-08T08:23:00.298524+0000","last_unstale":"2023-12-08T08:23:15.894156+0000","last_undegraded":"2023-12-08T08:23:15.894156+0000","last_fullsized":"2023-12-08T08:23:15.894156+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895609+0000","last_change":"2023-12-08T08:22:59.274339+0000","last_active":"2023-12-08T08:23:15.895609+0000","last_peered":"2023-12-08T08:23:15.895609+0000","last_clean":"2023-12-08T08:23:15.895609+0000","last_became_active":"2023-12-08T08:22:59.272932+0000","last_became_peered":"2023-12-08T08:22:59.272932+0000","last_unstale":"2023-12-08T08:23:15.895609+0000","last_undegraded":"2023-12-08T08:23:15.895609+0000","last_fullsized":"2023-12-08T08:23:15.895609+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:14.464401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.901110+0000","last_change":"2023-12-08T08:23:16.901110+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.901110+0000","last_undegraded":"2023-12-08T08:23:16.901110+0000","last_fullsized":"2023-12-08T08:23:16.901110+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.913617+0000","last_change":"2023-12-08T08:23:16.907865+0000","last_active":"2023-12-08T08:23:16.913617+0000","last_peered":"2023-12-08T08:23:16.913617+0000","last_clean":"2023-12-08T08:23:16.913617+0000","last_became_active":"2023-12-08T08:23:16.907610+0000","last_became_peered":"2023-12-08T08:23:16.907610+0000","last_unstale":"2023-12-08T08:23:16.913617+0000","last_undegraded":"2023-12-08T08:23:16.913617+0000","last_fullsized":"2023-12-08T08:23:16.913617+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:03:24.914390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888104+0000","last_change":"2023-12-08T08:23:00.292745+0000","last_active":"2023-12-08T08:23:15.888104+0000","last_peered":"2023-12-08T08:23:15.888104+0000","last_clean":"2023-12-08T08:23:15.888104+0000","last_became_active":"2023-12-08T08:23:00.292132+0000","last_became_peered":"2023-12-08T08:23:00.292132+0000","last_unstale":"2023-12-08T08:23:15.888104+0000","last_undegraded":"2023-12-08T08:23:15.888104+0000","last_fullsized":"2023-12-08T08:23:15.888104+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:13.139346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.890037+0000","last_change":"2023-12-08T08:22:59.268769+0000","last_active":"2023-12-08T08:23:15.890037+0000","last_peered":"2023-12-08T08:23:15.890037+0000","last_clean":"2023-12-08T08:23:15.890037+0000","last_became_active":"2023-12-08T08:22:59.268494+0000","last_became_peered":"2023-12-08T08:22:59.268494+0000","last_unstale":"2023-12-08T08:23:15.890037+0000","last_undegraded":"2023-12-08T08:23:15.890037+0000","last_fullsized":"2023-12-08T08:23:15.890037+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:56:23.131251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.905977+0000","last_change":"2023-12-08T08:23:16.905977+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.905977+0000","last_undegraded":"2023-12-08T08:23:16.905977+0000","last_fullsized":"2023-12-08T08:23:16.905977+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920561+0000","last_change":"2023-12-08T08:23:16.918296+0000","last_active":"2023-12-08T08:23:16.920561+0000","last_peered":"2023-12-08T08:23:16.920561+0000","last_clean":"2023-12-08T08:23:16.920561+0000","last_became_active":"2023-12-08T08:23:16.917917+0000","last_became_peered":"2023-12-08T08:23:16.917917+0000","last_unstale":"2023-12-08T08:23:16.920561+0000","last_undegraded":"2023-12-08T08:23:16.920561+0000","last_fullsized":"2023-12-08T08:23:16.920561+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:16:38.108739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.890630+0000","last_change":"2023-12-08T08:23:00.275783+0000","last_active":"2023-12-08T08:23:15.890630+0000","last_peered":"2023-12-08T08:23:15.890630+0000","last_clean":"2023-12-08T08:23:15.890630+0000","last_became_active":"2023-12-08T08:23:00.275444+0000","last_became_peered":"2023-12-08T08:23:00.275444+0000","last_unstale":"2023-12-08T08:23:15.890630+0000","last_undegraded":"2023-12-08T08:23:15.890630+0000","last_fullsized":"2023-12-08T08:23:15.890630+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:56:00.436152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889577+0000","last_change":"2023-12-08T08:22:59.280443+0000","last_active":"2023-12-08T08:23:15.889577+0000","last_peered":"2023-12-08T08:23:15.889577+0000","last_clean":"2023-12-08T08:23:15.889577+0000","last_became_active":"2023-12-08T08:22:59.280138+0000","last_became_peered":"2023-12-08T08:22:59.280138+0000","last_unstale":"2023-12-08T08:23:15.889577+0000","last_undegraded":"2023-12-08T08:23:15.889577+0000","last_fullsized":"2023-12-08T08:23:15.889577+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:13:21.524504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.906770+0000","last_change":"2023-12-08T08:23:16.906770+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.906770+0000","last_undegraded":"2023-12-08T08:23:16.906770+0000","last_fullsized":"2023-12-08T08:23:16.906770+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.914455+0000","last_change":"2023-12-08T08:23:16.913111+0000","last_active":"2023-12-08T08:23:16.914455+0000","last_peered":"2023-12-08T08:23:16.914455+0000","last_clean":"2023-12-08T08:23:16.914455+0000","last_became_active":"2023-12-08T08:23:16.912617+0000","last_became_peered":"2023-12-08T08:23:16.912617+0000","last_unstale":"2023-12-08T08:23:16.914455+0000","last_undegraded":"2023-12-08T08:23:16.914455+0000","last_fullsized":"2023-12-08T08:23:16.914455+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:56:17.065460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895873+0000","last_change":"2023-12-08T08:23:00.304825+0000","last_active":"2023-12-08T08:23:15.895873+0000","last_peered":"2023-12-08T08:23:15.895873+0000","last_clean":"2023-12-08T08:23:15.895873+0000","last_became_active":"2023-12-08T08:23:00.304549+0000","last_became_peered":"2023-12-08T08:23:00.304549+0000","last_unstale":"2023-12-08T08:23:15.895873+0000","last_undegraded":"2023-12-08T08:23:15.895873+0000","last_fullsized":"2023-12-08T08:23:15.895873+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889328+0000","last_change":"2023-12-08T08:22:59.283795+0000","last_active":"2023-12-08T08:23:15.889328+0000","last_peered":"2023-12-08T08:23:15.889328+0000","last_clean":"2023-12-08T08:23:15.889328+0000","last_became_active":"2023-12-08T08:22:59.283486+0000","last_became_peered":"2023-12-08T08:22:59.283486+0000","last_unstale":"2023-12-08T08:23:15.889328+0000","last_undegraded":"2023-12-08T08:23:15.889328+0000","last_fullsized":"2023-12-08T08:23:15.889328+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:30:43.384001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896383+0000","last_change":"2023-12-08T08:23:16.896383+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896383+0000","last_undegraded":"2023-12-08T08:23:16.896383+0000","last_fullsized":"2023-12-08T08:23:16.896383+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.917021+0000","last_change":"2023-12-08T08:23:16.913609+0000","last_active":"2023-12-08T08:23:16.917021+0000","last_peered":"2023-12-08T08:23:16.917021+0000","last_clean":"2023-12-08T08:23:16.917021+0000","last_became_active":"2023-12-08T08:23:16.913308+0000","last_became_peered":"2023-12-08T08:23:16.913308+0000","last_unstale":"2023-12-08T08:23:16.917021+0000","last_undegraded":"2023-12-08T08:23:16.917021+0000","last_fullsized":"2023-12-08T08:23:16.917021+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:13:39.161432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895820+0000","last_change":"2023-12-08T08:23:00.293145+0000","last_active":"2023-12-08T08:23:15.895820+0000","last_peered":"2023-12-08T08:23:15.895820+0000","last_clean":"2023-12-08T08:23:15.895820+0000","last_became_active":"2023-12-08T08:23:00.292927+0000","last_became_peered":"2023-12-08T08:23:00.292927+0000","last_unstale":"2023-12-08T08:23:15.895820+0000","last_undegraded":"2023-12-08T08:23:15.895820+0000","last_fullsized":"2023-12-08T08:23:15.895820+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:56.216551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"67'3","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889145+0000","last_change":"2023-12-08T08:22:59.281141+0000","last_active":"2023-12-08T08:23:15.889145+0000","last_peered":"2023-12-08T08:23:15.889145+0000","last_clean":"2023-12-08T08:23:15.889145+0000","last_became_active":"2023-12-08T08:22:59.280748+0000","last_became_peered":"2023-12-08T08:22:59.280748+0000","last_unstale":"2023-12-08T08:23:15.889145+0000","last_undegraded":"2023-12-08T08:23:15.889145+0000","last_fullsized":"2023-12-08T08:23:15.889145+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:07:33.922762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.895287+0000","last_change":"2023-12-08T08:23:16.895287+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.895287+0000","last_undegraded":"2023-12-08T08:23:16.895287+0000","last_fullsized":"2023-12-08T08:23:16.895287+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.923465+0000","last_change":"2023-12-08T08:23:16.921554+0000","last_active":"2023-12-08T08:23:16.923465+0000","last_peered":"2023-12-08T08:23:16.923465+0000","last_clean":"2023-12-08T08:23:16.923465+0000","last_became_active":"2023-12-08T08:23:16.920531+0000","last_became_peered":"2023-12-08T08:23:16.920531+0000","last_unstale":"2023-12-08T08:23:16.923465+0000","last_undegraded":"2023-12-08T08:23:16.923465+0000","last_fullsized":"2023-12-08T08:23:16.923465+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:32:01.183284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885675+0000","last_change":"2023-12-08T08:23:00.299179+0000","last_active":"2023-12-08T08:23:15.885675+0000","last_peered":"2023-12-08T08:23:15.885675+0000","last_clean":"2023-12-08T08:23:15.885675+0000","last_became_active":"2023-12-08T08:23:00.298936+0000","last_became_peered":"2023-12-08T08:23:00.298936+0000","last_unstale":"2023-12-08T08:23:15.885675+0000","last_undegraded":"2023-12-08T08:23:15.885675+0000","last_fullsized":"2023-12-08T08:23:15.885675+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"68'8","reported_seq":22,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895665+0000","last_change":"2023-12-08T08:22:59.278612+0000","last_active":"2023-12-08T08:23:15.895665+0000","last_peered":"2023-12-08T08:23:15.895665+0000","last_clean":"2023-12-08T08:23:15.895665+0000","last_became_active":"2023-12-08T08:22:59.278325+0000","last_became_peered":"2023-12-08T08:22:59.278325+0000","last_unstale":"2023-12-08T08:23:15.895665+0000","last_undegraded":"2023-12-08T08:23:15.895665+0000","last_fullsized":"2023-12-08T08:23:15.895665+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:55:35.382801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.894542+0000","last_change":"2023-12-08T08:23:16.894542+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.894542+0000","last_undegraded":"2023-12-08T08:23:16.894542+0000","last_fullsized":"2023-12-08T08:23:16.894542+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920008+0000","last_change":"2023-12-08T08:23:16.915913+0000","last_active":"2023-12-08T08:23:16.920008+0000","last_peered":"2023-12-08T08:23:16.920008+0000","last_clean":"2023-12-08T08:23:16.920008+0000","last_became_active":"2023-12-08T08:23:16.915513+0000","last_became_peered":"2023-12-08T08:23:16.915513+0000","last_unstale":"2023-12-08T08:23:16.920008+0000","last_undegraded":"2023-12-08T08:23:16.920008+0000","last_fullsized":"2023-12-08T08:23:16.920008+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:29.768654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895664+0000","last_change":"2023-12-08T08:23:00.292867+0000","last_active":"2023-12-08T08:23:15.895664+0000","last_peered":"2023-12-08T08:23:15.895664+0000","last_clean":"2023-12-08T08:23:15.895664+0000","last_became_active":"2023-12-08T08:23:00.292648+0000","last_became_peered":"2023-12-08T08:23:00.292648+0000","last_unstale":"2023-12-08T08:23:15.895664+0000","last_undegraded":"2023-12-08T08:23:15.895664+0000","last_fullsized":"2023-12-08T08:23:15.895664+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:29:03.020360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"67'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.891587+0000","last_change":"2023-12-08T08:22:59.262821+0000","last_active":"2023-12-08T08:23:15.891587+0000","last_peered":"2023-12-08T08:23:15.891587+0000","last_clean":"2023-12-08T08:23:15.891587+0000","last_became_active":"2023-12-08T08:22:59.262569+0000","last_became_peered":"2023-12-08T08:22:59.262569+0000","last_unstale":"2023-12-08T08:23:15.891587+0000","last_undegraded":"2023-12-08T08:23:15.891587+0000","last_fullsized":"2023-12-08T08:23:15.891587+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:52:55.751217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.898771+0000","last_change":"2023-12-08T08:23:16.898771+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.898771+0000","last_undegraded":"2023-12-08T08:23:16.898771+0000","last_fullsized":"2023-12-08T08:23:16.898771+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.909363+0000","last_change":"2023-12-08T08:23:16.907121+0000","last_active":"2023-12-08T08:23:16.909363+0000","last_peered":"2023-12-08T08:23:16.909363+0000","last_clean":"2023-12-08T08:23:16.909363+0000","last_became_active":"2023-12-08T08:23:16.906517+0000","last_became_peered":"2023-12-08T08:23:16.906517+0000","last_unstale":"2023-12-08T08:23:16.909363+0000","last_undegraded":"2023-12-08T08:23:16.909363+0000","last_fullsized":"2023-12-08T08:23:16.909363+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:44:54.050763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894551+0000","last_change":"2023-12-08T08:23:00.298706+0000","last_active":"2023-12-08T08:23:15.894551+0000","last_peered":"2023-12-08T08:23:15.894551+0000","last_clean":"2023-12-08T08:23:15.894551+0000","last_became_active":"2023-12-08T08:23:00.298452+0000","last_became_peered":"2023-12-08T08:23:00.298452+0000","last_unstale":"2023-12-08T08:23:15.894551+0000","last_undegraded":"2023-12-08T08:23:15.894551+0000","last_fullsized":"2023-12-08T08:23:15.894551+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:39.385907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888371+0000","last_change":"2023-12-08T08:22:59.270322+0000","last_active":"2023-12-08T08:23:15.888371+0000","last_peered":"2023-12-08T08:23:15.888371+0000","last_clean":"2023-12-08T08:23:15.888371+0000","last_became_active":"2023-12-08T08:22:59.270059+0000","last_became_peered":"2023-12-08T08:22:59.270059+0000","last_unstale":"2023-12-08T08:23:15.888371+0000","last_undegraded":"2023-12-08T08:23:15.888371+0000","last_fullsized":"2023-12-08T08:23:15.888371+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:21:58.531919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.902866+0000","last_change":"2023-12-08T08:23:16.902866+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.902866+0000","last_undegraded":"2023-12-08T08:23:16.902866+0000","last_fullsized":"2023-12-08T08:23:16.902866+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920648+0000","last_change":"2023-12-08T08:23:16.914697+0000","last_active":"2023-12-08T08:23:16.920648+0000","last_peered":"2023-12-08T08:23:16.920648+0000","last_clean":"2023-12-08T08:23:16.920648+0000","last_became_active":"2023-12-08T08:23:16.914346+0000","last_became_peered":"2023-12-08T08:23:16.914346+0000","last_unstale":"2023-12-08T08:23:16.920648+0000","last_undegraded":"2023-12-08T08:23:16.920648+0000","last_fullsized":"2023-12-08T08:23:16.920648+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:08:11.306339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889955+0000","last_change":"2023-12-08T08:23:00.304324+0000","last_active":"2023-12-08T08:23:15.889955+0000","last_peered":"2023-12-08T08:23:15.889955+0000","last_clean":"2023-12-08T08:23:15.889955+0000","last_became_active":"2023-12-08T08:23:00.304038+0000","last_became_peered":"2023-12-08T08:23:00.304038+0000","last_unstale":"2023-12-08T08:23:15.889955+0000","last_undegraded":"2023-12-08T08:23:15.889955+0000","last_fullsized":"2023-12-08T08:23:15.889955+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:33:27.464394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894314+0000","last_change":"2023-12-08T08:22:59.270216+0000","last_active":"2023-12-08T08:23:15.894314+0000","last_peered":"2023-12-08T08:23:15.894314+0000","last_clean":"2023-12-08T08:23:15.894314+0000","last_became_active":"2023-12-08T08:22:59.269292+0000","last_became_peered":"2023-12-08T08:22:59.269292+0000","last_unstale":"2023-12-08T08:23:15.894314+0000","last_undegraded":"2023-12-08T08:23:15.894314+0000","last_fullsized":"2023-12-08T08:23:15.894314+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:18:01.309002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.899876+0000","last_change":"2023-12-08T08:23:16.899876+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.899876+0000","last_undegraded":"2023-12-08T08:23:16.899876+0000","last_fullsized":"2023-12-08T08:23:16.899876+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.916944+0000","last_change":"2023-12-08T08:23:16.910717+0000","last_active":"2023-12-08T08:23:16.916944+0000","last_peered":"2023-12-08T08:23:16.916944+0000","last_clean":"2023-12-08T08:23:16.916944+0000","last_became_active":"2023-12-08T08:23:16.910457+0000","last_became_peered":"2023-12-08T08:23:16.910457+0000","last_unstale":"2023-12-08T08:23:16.916944+0000","last_undegraded":"2023-12-08T08:23:16.916944+0000","last_fullsized":"2023-12-08T08:23:16.916944+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:53:13.388145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889558+0000","last_change":"2023-12-08T08:23:00.276305+0000","last_active":"2023-12-08T08:23:15.889558+0000","last_peered":"2023-12-08T08:23:15.889558+0000","last_clean":"2023-12-08T08:23:15.889558+0000","last_became_active":"2023-12-08T08:23:00.275989+0000","last_became_peered":"2023-12-08T08:23:00.275989+0000","last_unstale":"2023-12-08T08:23:15.889558+0000","last_undegraded":"2023-12-08T08:23:15.889558+0000","last_fullsized":"2023-12-08T08:23:15.889558+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:24:33.735501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"67'8","reported_seq":22,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894492+0000","last_change":"2023-12-08T08:22:59.271542+0000","last_active":"2023-12-08T08:23:15.894492+0000","last_peered":"2023-12-08T08:23:15.894492+0000","last_clean":"2023-12-08T08:23:15.894492+0000","last_became_active":"2023-12-08T08:22:59.271240+0000","last_became_peered":"2023-12-08T08:22:59.271240+0000","last_unstale":"2023-12-08T08:23:15.894492+0000","last_undegraded":"2023-12-08T08:23:15.894492+0000","last_fullsized":"2023-12-08T08:23:15.894492+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:32.897955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.901826+0000","last_change":"2023-12-08T08:23:16.901826+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.901826+0000","last_undegraded":"2023-12-08T08:23:16.901826+0000","last_fullsized":"2023-12-08T08:23:16.901826+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.919862+0000","last_change":"2023-12-08T08:23:16.915441+0000","last_active":"2023-12-08T08:23:16.919862+0000","last_peered":"2023-12-08T08:23:16.919862+0000","last_clean":"2023-12-08T08:23:16.919862+0000","last_became_active":"2023-12-08T08:23:16.915074+0000","last_became_peered":"2023-12-08T08:23:16.915074+0000","last_unstale":"2023-12-08T08:23:16.919862+0000","last_undegraded":"2023-12-08T08:23:16.919862+0000","last_fullsized":"2023-12-08T08:23:16.919862+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:33:12.118405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895946+0000","last_change":"2023-12-08T08:23:00.280374+0000","last_active":"2023-12-08T08:23:15.895946+0000","last_peered":"2023-12-08T08:23:15.895946+0000","last_clean":"2023-12-08T08:23:15.895946+0000","last_became_active":"2023-12-08T08:23:00.280096+0000","last_became_peered":"2023-12-08T08:23:00.280096+0000","last_unstale":"2023-12-08T08:23:15.895946+0000","last_undegraded":"2023-12-08T08:23:15.895946+0000","last_fullsized":"2023-12-08T08:23:15.895946+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:21:59.539539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"67'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889718+0000","last_change":"2023-12-08T08:22:59.283727+0000","last_active":"2023-12-08T08:23:15.889718+0000","last_peered":"2023-12-08T08:23:15.889718+0000","last_clean":"2023-12-08T08:23:15.889718+0000","last_became_active":"2023-12-08T08:22:59.283254+0000","last_became_peered":"2023-12-08T08:22:59.283254+0000","last_unstale":"2023-12-08T08:23:15.889718+0000","last_undegraded":"2023-12-08T08:23:15.889718+0000","last_fullsized":"2023-12-08T08:23:15.889718+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:18:01.309002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.902834+0000","last_change":"2023-12-08T08:23:16.902834+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.902834+0000","last_undegraded":"2023-12-08T08:23:16.902834+0000","last_fullsized":"2023-12-08T08:23:16.902834+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.909444+0000","last_change":"2023-12-08T08:23:16.901347+0000","last_active":"2023-12-08T08:23:16.909444+0000","last_peered":"2023-12-08T08:23:16.909444+0000","last_clean":"2023-12-08T08:23:16.909444+0000","last_became_active":"2023-12-08T08:23:16.901041+0000","last_became_peered":"2023-12-08T08:23:16.901041+0000","last_unstale":"2023-12-08T08:23:16.909444+0000","last_undegraded":"2023-12-08T08:23:16.909444+0000","last_fullsized":"2023-12-08T08:23:16.909444+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:16:38.108739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889393+0000","last_change":"2023-12-08T08:23:00.282901+0000","last_active":"2023-12-08T08:23:15.889393+0000","last_peered":"2023-12-08T08:23:15.889393+0000","last_clean":"2023-12-08T08:23:15.889393+0000","last_became_active":"2023-12-08T08:23:00.282646+0000","last_became_peered":"2023-12-08T08:23:00.282646+0000","last_unstale":"2023-12-08T08:23:15.889393+0000","last_undegraded":"2023-12-08T08:23:15.889393+0000","last_fullsized":"2023-12-08T08:23:15.889393+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"67'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.896118+0000","last_change":"2023-12-08T08:22:59.265669+0000","last_active":"2023-12-08T08:23:15.896118+0000","last_peered":"2023-12-08T08:23:15.896118+0000","last_clean":"2023-12-08T08:23:15.896118+0000","last_became_active":"2023-12-08T08:22:59.265364+0000","last_became_peered":"2023-12-08T08:22:59.265364+0000","last_unstale":"2023-12-08T08:23:15.896118+0000","last_undegraded":"2023-12-08T08:23:15.896118+0000","last_fullsized":"2023-12-08T08:23:15.896118+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:27:38.296266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.906380+0000","last_change":"2023-12-08T08:23:16.906380+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.906380+0000","last_undegraded":"2023-12-08T08:23:16.906380+0000","last_fullsized":"2023-12-08T08:23:16.906380+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920038+0000","last_change":"2023-12-08T08:23:16.916758+0000","last_active":"2023-12-08T08:23:16.920038+0000","last_peered":"2023-12-08T08:23:16.920038+0000","last_clean":"2023-12-08T08:23:16.920038+0000","last_became_active":"2023-12-08T08:23:16.916445+0000","last_became_peered":"2023-12-08T08:23:16.916445+0000","last_unstale":"2023-12-08T08:23:16.920038+0000","last_undegraded":"2023-12-08T08:23:16.920038+0000","last_fullsized":"2023-12-08T08:23:16.920038+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:18:49.227732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885732+0000","last_change":"2023-12-08T08:23:00.270198+0000","last_active":"2023-12-08T08:23:15.885732+0000","last_peered":"2023-12-08T08:23:15.885732+0000","last_clean":"2023-12-08T08:23:15.885732+0000","last_became_active":"2023-12-08T08:23:00.269930+0000","last_became_peered":"2023-12-08T08:23:00.269930+0000","last_unstale":"2023-12-08T08:23:15.885732+0000","last_undegraded":"2023-12-08T08:23:15.885732+0000","last_fullsized":"2023-12-08T08:23:15.885732+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895963+0000","last_change":"2023-12-08T08:22:59.273655+0000","last_active":"2023-12-08T08:23:15.895963+0000","last_peered":"2023-12-08T08:23:15.895963+0000","last_clean":"2023-12-08T08:23:15.895963+0000","last_became_active":"2023-12-08T08:22:59.273396+0000","last_became_peered":"2023-12-08T08:22:59.273396+0000","last_unstale":"2023-12-08T08:23:15.895963+0000","last_undegraded":"2023-12-08T08:23:15.895963+0000","last_fullsized":"2023-12-08T08:23:15.895963+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.886510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.899083+0000","last_change":"2023-12-08T08:23:16.899083+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.899083+0000","last_undegraded":"2023-12-08T08:23:16.899083+0000","last_fullsized":"2023-12-08T08:23:16.899083+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.923651+0000","last_change":"2023-12-08T08:23:16.922219+0000","last_active":"2023-12-08T08:23:16.923651+0000","last_peered":"2023-12-08T08:23:16.923651+0000","last_clean":"2023-12-08T08:23:16.923651+0000","last_became_active":"2023-12-08T08:23:16.921977+0000","last_became_peered":"2023-12-08T08:23:16.921977+0000","last_unstale":"2023-12-08T08:23:16.923651+0000","last_undegraded":"2023-12-08T08:23:16.923651+0000","last_fullsized":"2023-12-08T08:23:16.923651+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:22:16.168848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883583+0000","last_change":"2023-12-08T08:23:00.285854+0000","last_active":"2023-12-08T08:23:15.883583+0000","last_peered":"2023-12-08T08:23:15.883583+0000","last_clean":"2023-12-08T08:23:15.883583+0000","last_became_active":"2023-12-08T08:23:00.285553+0000","last_became_peered":"2023-12-08T08:23:00.285553+0000","last_unstale":"2023-12-08T08:23:15.883583+0000","last_undegraded":"2023-12-08T08:23:15.883583+0000","last_fullsized":"2023-12-08T08:23:15.883583+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:15:44.184576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"67'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888606+0000","last_change":"2023-12-08T08:22:59.282745+0000","last_active":"2023-12-08T08:23:15.888606+0000","last_peered":"2023-12-08T08:23:15.888606+0000","last_clean":"2023-12-08T08:23:15.888606+0000","last_became_active":"2023-12-08T08:22:59.282443+0000","last_became_peered":"2023-12-08T08:22:59.282443+0000","last_unstale":"2023-12-08T08:23:15.888606+0000","last_undegraded":"2023-12-08T08:23:15.888606+0000","last_fullsized":"2023-12-08T08:23:15.888606+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:21.899236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.908298+0000","last_change":"2023-12-08T08:23:16.908298+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.908298+0000","last_undegraded":"2023-12-08T08:23:16.908298+0000","last_fullsized":"2023-12-08T08:23:16.908298+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.911706+0000","last_change":"2023-12-08T08:23:16.906025+0000","last_active":"2023-12-08T08:23:16.911706+0000","last_peered":"2023-12-08T08:23:16.911706+0000","last_clean":"2023-12-08T08:23:16.911706+0000","last_became_active":"2023-12-08T08:23:16.905756+0000","last_became_peered":"2023-12-08T08:23:16.905756+0000","last_unstale":"2023-12-08T08:23:16.911706+0000","last_undegraded":"2023-12-08T08:23:16.911706+0000","last_fullsized":"2023-12-08T08:23:16.911706+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:56:17.065460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895380+0000","last_change":"2023-12-08T08:23:00.286165+0000","last_active":"2023-12-08T08:23:15.895380+0000","last_peered":"2023-12-08T08:23:15.895380+0000","last_clean":"2023-12-08T08:23:15.895380+0000","last_became_active":"2023-12-08T08:23:00.285209+0000","last_became_peered":"2023-12-08T08:23:00.285209+0000","last_unstale":"2023-12-08T08:23:15.895380+0000","last_undegraded":"2023-12-08T08:23:15.895380+0000","last_fullsized":"2023-12-08T08:23:15.895380+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:16.068318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883606+0000","last_change":"2023-12-08T08:22:59.272934+0000","last_active":"2023-12-08T08:23:15.883606+0000","last_peered":"2023-12-08T08:23:15.883606+0000","last_clean":"2023-12-08T08:23:15.883606+0000","last_became_active":"2023-12-08T08:22:59.272094+0000","last_became_peered":"2023-12-08T08:22:59.272094+0000","last_unstale":"2023-12-08T08:23:15.883606+0000","last_undegraded":"2023-12-08T08:23:15.883606+0000","last_fullsized":"2023-12-08T08:23:15.883606+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:33:18.775139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.901915+0000","last_change":"2023-12-08T08:23:16.901915+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.901915+0000","last_undegraded":"2023-12-08T08:23:16.901915+0000","last_fullsized":"2023-12-08T08:23:16.901915+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920431+0000","last_change":"2023-12-08T08:23:16.915895+0000","last_active":"2023-12-08T08:23:16.920431+0000","last_peered":"2023-12-08T08:23:16.920431+0000","last_clean":"2023-12-08T08:23:16.920431+0000","last_became_active":"2023-12-08T08:23:16.915631+0000","last_became_peered":"2023-12-08T08:23:16.915631+0000","last_unstale":"2023-12-08T08:23:16.920431+0000","last_undegraded":"2023-12-08T08:23:16.920431+0000","last_fullsized":"2023-12-08T08:23:16.920431+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:28:54.873126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883361+0000","last_change":"2023-12-08T08:23:00.287292+0000","last_active":"2023-12-08T08:23:15.883361+0000","last_peered":"2023-12-08T08:23:15.883361+0000","last_clean":"2023-12-08T08:23:15.883361+0000","last_became_active":"2023-12-08T08:23:00.284565+0000","last_became_peered":"2023-12-08T08:23:00.284565+0000","last_unstale":"2023-12-08T08:23:15.883361+0000","last_undegraded":"2023-12-08T08:23:15.883361+0000","last_fullsized":"2023-12-08T08:23:15.883361+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:17:25.641139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883435+0000","last_change":"2023-12-08T08:22:59.279857+0000","last_active":"2023-12-08T08:23:15.883435+0000","last_peered":"2023-12-08T08:23:15.883435+0000","last_clean":"2023-12-08T08:23:15.883435+0000","last_became_active":"2023-12-08T08:22:59.279508+0000","last_became_peered":"2023-12-08T08:22:59.279508+0000","last_unstale":"2023-12-08T08:23:15.883435+0000","last_undegraded":"2023-12-08T08:23:15.883435+0000","last_fullsized":"2023-12-08T08:23:15.883435+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:23.192834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900064+0000","last_change":"2023-12-08T08:23:16.900064+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900064+0000","last_undegraded":"2023-12-08T08:23:16.900064+0000","last_fullsized":"2023-12-08T08:23:16.900064+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.914553+0000","last_change":"2023-12-08T08:23:16.911088+0000","last_active":"2023-12-08T08:23:16.914553+0000","last_peered":"2023-12-08T08:23:16.914553+0000","last_clean":"2023-12-08T08:23:16.914553+0000","last_became_active":"2023-12-08T08:23:16.910534+0000","last_became_peered":"2023-12-08T08:23:16.910534+0000","last_unstale":"2023-12-08T08:23:16.914553+0000","last_undegraded":"2023-12-08T08:23:16.914553+0000","last_fullsized":"2023-12-08T08:23:16.914553+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:13:12.845859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894166+0000","last_change":"2023-12-08T08:23:00.291227+0000","last_active":"2023-12-08T08:23:15.894166+0000","last_peered":"2023-12-08T08:23:15.894166+0000","last_clean":"2023-12-08T08:23:15.894166+0000","last_became_active":"2023-12-08T08:23:00.290984+0000","last_became_peered":"2023-12-08T08:23:00.290984+0000","last_unstale":"2023-12-08T08:23:15.894166+0000","last_undegraded":"2023-12-08T08:23:15.894166+0000","last_fullsized":"2023-12-08T08:23:15.894166+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:33.905575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.887728+0000","last_change":"2023-12-08T08:22:59.282842+0000","last_active":"2023-12-08T08:23:15.887728+0000","last_peered":"2023-12-08T08:23:15.887728+0000","last_clean":"2023-12-08T08:23:15.887728+0000","last_became_active":"2023-12-08T08:22:59.282605+0000","last_became_peered":"2023-12-08T08:22:59.282605+0000","last_unstale":"2023-12-08T08:23:15.887728+0000","last_undegraded":"2023-12-08T08:23:15.887728+0000","last_fullsized":"2023-12-08T08:23:15.887728+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:55.208931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896938+0000","last_change":"2023-12-08T08:23:16.896938+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896938+0000","last_undegraded":"2023-12-08T08:23:16.896938+0000","last_fullsized":"2023-12-08T08:23:16.896938+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.908278+0000","last_change":"2023-12-08T08:23:16.900995+0000","last_active":"2023-12-08T08:23:16.908278+0000","last_peered":"2023-12-08T08:23:16.908278+0000","last_clean":"2023-12-08T08:23:16.908278+0000","last_became_active":"2023-12-08T08:23:16.900717+0000","last_became_peered":"2023-12-08T08:23:16.900717+0000","last_unstale":"2023-12-08T08:23:16.908278+0000","last_undegraded":"2023-12-08T08:23:16.908278+0000","last_fullsized":"2023-12-08T08:23:16.908278+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:27:04.256182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885973+0000","last_change":"2023-12-08T08:23:00.270620+0000","last_active":"2023-12-08T08:23:15.885973+0000","last_peered":"2023-12-08T08:23:15.885973+0000","last_clean":"2023-12-08T08:23:15.885973+0000","last_became_active":"2023-12-08T08:23:00.270369+0000","last_became_peered":"2023-12-08T08:23:00.270369+0000","last_unstale":"2023-12-08T08:23:15.885973+0000","last_undegraded":"2023-12-08T08:23:15.885973+0000","last_fullsized":"2023-12-08T08:23:15.885973+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:33.898137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"67'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.891985+0000","last_change":"2023-12-08T08:22:59.269712+0000","last_active":"2023-12-08T08:23:15.891985+0000","last_peered":"2023-12-08T08:23:15.891985+0000","last_clean":"2023-12-08T08:23:15.891985+0000","last_became_active":"2023-12-08T08:22:59.269426+0000","last_became_peered":"2023-12-08T08:22:59.269426+0000","last_unstale":"2023-12-08T08:23:15.891985+0000","last_undegraded":"2023-12-08T08:23:15.891985+0000","last_fullsized":"2023-12-08T08:23:15.891985+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:49:28.705874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.906727+0000","last_change":"2023-12-08T08:23:16.906727+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.906727+0000","last_undegraded":"2023-12-08T08:23:16.906727+0000","last_fullsized":"2023-12-08T08:23:16.906727+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920958+0000","last_change":"2023-12-08T08:23:16.918945+0000","last_active":"2023-12-08T08:23:16.920958+0000","last_peered":"2023-12-08T08:23:16.920958+0000","last_clean":"2023-12-08T08:23:16.920958+0000","last_became_active":"2023-12-08T08:23:16.918629+0000","last_became_peered":"2023-12-08T08:23:16.918629+0000","last_unstale":"2023-12-08T08:23:16.920958+0000","last_undegraded":"2023-12-08T08:23:16.920958+0000","last_fullsized":"2023-12-08T08:23:16.920958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:39.536165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.896176+0000","last_change":"2023-12-08T08:23:00.280543+0000","last_active":"2023-12-08T08:23:15.896176+0000","last_peered":"2023-12-08T08:23:15.896176+0000","last_clean":"2023-12-08T08:23:15.896176+0000","last_became_active":"2023-12-08T08:23:00.280152+0000","last_became_peered":"2023-12-08T08:23:00.280152+0000","last_unstale":"2023-12-08T08:23:15.896176+0000","last_undegraded":"2023-12-08T08:23:15.896176+0000","last_fullsized":"2023-12-08T08:23:15.896176+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:37:47.067543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"68'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.891331+0000","last_change":"2023-12-08T08:22:59.263185+0000","last_active":"2023-12-08T08:23:15.891331+0000","last_peered":"2023-12-08T08:23:15.891331+0000","last_clean":"2023-12-08T08:23:15.891331+0000","last_became_active":"2023-12-08T08:22:59.262924+0000","last_became_peered":"2023-12-08T08:22:59.262924+0000","last_unstale":"2023-12-08T08:23:15.891331+0000","last_undegraded":"2023-12-08T08:23:15.891331+0000","last_fullsized":"2023-12-08T08:23:15.891331+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:39:59.028170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.895437+0000","last_change":"2023-12-08T08:23:16.895437+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.895437+0000","last_undegraded":"2023-12-08T08:23:16.895437+0000","last_fullsized":"2023-12-08T08:23:16.895437+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.914570+0000","last_change":"2023-12-08T08:23:16.912250+0000","last_active":"2023-12-08T08:23:16.914570+0000","last_peered":"2023-12-08T08:23:16.914570+0000","last_clean":"2023-12-08T08:23:16.914570+0000","last_became_active":"2023-12-08T08:23:16.912031+0000","last_became_peered":"2023-12-08T08:23:16.912031+0000","last_unstale":"2023-12-08T08:23:16.914570+0000","last_undegraded":"2023-12-08T08:23:16.914570+0000","last_fullsized":"2023-12-08T08:23:16.914570+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:03.696851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888857+0000","last_change":"2023-12-08T08:23:00.304740+0000","last_active":"2023-12-08T08:23:15.888857+0000","last_peered":"2023-12-08T08:23:15.888857+0000","last_clean":"2023-12-08T08:23:15.888857+0000","last_became_active":"2023-12-08T08:23:00.304390+0000","last_became_peered":"2023-12-08T08:23:00.304390+0000","last_unstale":"2023-12-08T08:23:15.888857+0000","last_undegraded":"2023-12-08T08:23:15.888857+0000","last_fullsized":"2023-12-08T08:23:15.888857+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889133+0000","last_change":"2023-12-08T08:22:59.285952+0000","last_active":"2023-12-08T08:23:15.889133+0000","last_peered":"2023-12-08T08:23:15.889133+0000","last_clean":"2023-12-08T08:23:15.889133+0000","last_became_active":"2023-12-08T08:22:59.285309+0000","last_became_peered":"2023-12-08T08:22:59.285309+0000","last_unstale":"2023-12-08T08:23:15.889133+0000","last_undegraded":"2023-12-08T08:23:15.889133+0000","last_fullsized":"2023-12-08T08:23:15.889133+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:19.279362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896326+0000","last_change":"2023-12-08T08:23:16.896326+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896326+0000","last_undegraded":"2023-12-08T08:23:16.896326+0000","last_fullsized":"2023-12-08T08:23:16.896326+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.919262+0000","last_change":"2023-12-08T08:23:16.912270+0000","last_active":"2023-12-08T08:23:16.919262+0000","last_peered":"2023-12-08T08:23:16.919262+0000","last_clean":"2023-12-08T08:23:16.919262+0000","last_became_active":"2023-12-08T08:23:16.912007+0000","last_became_peered":"2023-12-08T08:23:16.912007+0000","last_unstale":"2023-12-08T08:23:16.919262+0000","last_undegraded":"2023-12-08T08:23:16.919262+0000","last_fullsized":"2023-12-08T08:23:16.919262+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:32:01.183284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885854+0000","last_change":"2023-12-08T08:23:00.299161+0000","last_active":"2023-12-08T08:23:15.885854+0000","last_peered":"2023-12-08T08:23:15.885854+0000","last_clean":"2023-12-08T08:23:15.885854+0000","last_became_active":"2023-12-08T08:23:00.298876+0000","last_became_peered":"2023-12-08T08:23:00.298876+0000","last_unstale":"2023-12-08T08:23:15.885854+0000","last_undegraded":"2023-12-08T08:23:15.885854+0000","last_fullsized":"2023-12-08T08:23:15.885854+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:29:03.020360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888918+0000","last_change":"2023-12-08T08:22:59.280536+0000","last_active":"2023-12-08T08:23:15.888918+0000","last_peered":"2023-12-08T08:23:15.888918+0000","last_clean":"2023-12-08T08:23:15.888918+0000","last_became_active":"2023-12-08T08:22:59.280213+0000","last_became_peered":"2023-12-08T08:22:59.280213+0000","last_unstale":"2023-12-08T08:23:15.888918+0000","last_undegraded":"2023-12-08T08:23:15.888918+0000","last_fullsized":"2023-12-08T08:23:15.888918+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:49.883139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.898593+0000","last_change":"2023-12-08T08:23:16.898593+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.898593+0000","last_undegraded":"2023-12-08T08:23:16.898593+0000","last_fullsized":"2023-12-08T08:23:16.898593+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.922617+0000","last_change":"2023-12-08T08:23:16.919692+0000","last_active":"2023-12-08T08:23:16.922617+0000","last_peered":"2023-12-08T08:23:16.922617+0000","last_clean":"2023-12-08T08:23:16.922617+0000","last_became_active":"2023-12-08T08:23:16.919433+0000","last_became_peered":"2023-12-08T08:23:16.919433+0000","last_unstale":"2023-12-08T08:23:16.922617+0000","last_undegraded":"2023-12-08T08:23:16.922617+0000","last_fullsized":"2023-12-08T08:23:16.922617+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:28:54.873126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895793+0000","last_change":"2023-12-08T08:23:00.285721+0000","last_active":"2023-12-08T08:23:15.895793+0000","last_peered":"2023-12-08T08:23:15.895793+0000","last_clean":"2023-12-08T08:23:15.895793+0000","last_became_active":"2023-12-08T08:23:00.285446+0000","last_became_peered":"2023-12-08T08:23:00.285446+0000","last_unstale":"2023-12-08T08:23:15.895793+0000","last_undegraded":"2023-12-08T08:23:15.895793+0000","last_fullsized":"2023-12-08T08:23:15.895793+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895893+0000","last_change":"2023-12-08T08:22:59.272111+0000","last_active":"2023-12-08T08:23:15.895893+0000","last_peered":"2023-12-08T08:23:15.895893+0000","last_clean":"2023-12-08T08:23:15.895893+0000","last_became_active":"2023-12-08T08:22:59.271849+0000","last_became_peered":"2023-12-08T08:22:59.271849+0000","last_unstale":"2023-12-08T08:23:15.895893+0000","last_undegraded":"2023-12-08T08:23:15.895893+0000","last_fullsized":"2023-12-08T08:23:15.895893+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:15.060698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.907737+0000","last_change":"2023-12-08T08:23:16.907737+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.907737+0000","last_undegraded":"2023-12-08T08:23:16.907737+0000","last_fullsized":"2023-12-08T08:23:16.907737+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.915051+0000","last_change":"2023-12-08T08:23:16.910225+0000","last_active":"2023-12-08T08:23:16.915051+0000","last_peered":"2023-12-08T08:23:16.915051+0000","last_clean":"2023-12-08T08:23:16.915051+0000","last_became_active":"2023-12-08T08:23:16.909947+0000","last_became_peered":"2023-12-08T08:23:16.909947+0000","last_unstale":"2023-12-08T08:23:16.915051+0000","last_undegraded":"2023-12-08T08:23:16.915051+0000","last_fullsized":"2023-12-08T08:23:16.915051+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:24:52.637443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895822+0000","last_change":"2023-12-08T08:23:00.292346+0000","last_active":"2023-12-08T08:23:15.895822+0000","last_peered":"2023-12-08T08:23:15.895822+0000","last_clean":"2023-12-08T08:23:15.895822+0000","last_became_active":"2023-12-08T08:23:00.292166+0000","last_became_peered":"2023-12-08T08:23:00.292166+0000","last_unstale":"2023-12-08T08:23:15.895822+0000","last_undegraded":"2023-12-08T08:23:15.895822+0000","last_fullsized":"2023-12-08T08:23:15.895822+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:21:59.539539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885488+0000","last_change":"2023-12-08T08:22:59.271088+0000","last_active":"2023-12-08T08:23:15.885488+0000","last_peered":"2023-12-08T08:23:15.885488+0000","last_clean":"2023-12-08T08:23:15.885488+0000","last_became_active":"2023-12-08T08:22:59.270783+0000","last_became_peered":"2023-12-08T08:22:59.270783+0000","last_unstale":"2023-12-08T08:23:15.885488+0000","last_undegraded":"2023-12-08T08:23:15.885488+0000","last_fullsized":"2023-12-08T08:23:15.885488+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:30:43.384001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.899218+0000","last_change":"2023-12-08T08:23:16.899218+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.899218+0000","last_undegraded":"2023-12-08T08:23:16.899218+0000","last_fullsized":"2023-12-08T08:23:16.899218+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.922449+0000","last_change":"2023-12-08T08:23:16.921099+0000","last_active":"2023-12-08T08:23:16.922449+0000","last_peered":"2023-12-08T08:23:16.922449+0000","last_clean":"2023-12-08T08:23:16.922449+0000","last_became_active":"2023-12-08T08:23:16.920243+0000","last_became_peered":"2023-12-08T08:23:16.920243+0000","last_unstale":"2023-12-08T08:23:16.922449+0000","last_undegraded":"2023-12-08T08:23:16.922449+0000","last_fullsized":"2023-12-08T08:23:16.922449+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:18:49.227732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894254+0000","last_change":"2023-12-08T08:23:00.283700+0000","last_active":"2023-12-08T08:23:15.894254+0000","last_peered":"2023-12-08T08:23:15.894254+0000","last_clean":"2023-12-08T08:23:15.894254+0000","last_became_active":"2023-12-08T08:23:00.283439+0000","last_became_peered":"2023-12-08T08:23:00.283439+0000","last_unstale":"2023-12-08T08:23:15.894254+0000","last_undegraded":"2023-12-08T08:23:15.894254+0000","last_fullsized":"2023-12-08T08:23:15.894254+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888620+0000","last_change":"2023-12-08T08:22:59.280725+0000","last_active":"2023-12-08T08:23:15.888620+0000","last_peered":"2023-12-08T08:23:15.888620+0000","last_clean":"2023-12-08T08:23:15.888620+0000","last_became_active":"2023-12-08T08:22:59.279736+0000","last_became_peered":"2023-12-08T08:22:59.279736+0000","last_unstale":"2023-12-08T08:23:15.888620+0000","last_undegraded":"2023-12-08T08:23:15.888620+0000","last_fullsized":"2023-12-08T08:23:15.888620+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:54.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.894537+0000","last_change":"2023-12-08T08:23:16.894537+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.894537+0000","last_undegraded":"2023-12-08T08:23:16.894537+0000","last_fullsized":"2023-12-08T08:23:16.894537+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920940+0000","last_change":"2023-12-08T08:23:16.918822+0000","last_active":"2023-12-08T08:23:16.920940+0000","last_peered":"2023-12-08T08:23:16.920940+0000","last_clean":"2023-12-08T08:23:16.920940+0000","last_became_active":"2023-12-08T08:23:16.918519+0000","last_became_peered":"2023-12-08T08:23:16.918519+0000","last_unstale":"2023-12-08T08:23:16.920940+0000","last_undegraded":"2023-12-08T08:23:16.920940+0000","last_fullsized":"2023-12-08T08:23:16.920940+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:03.696851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888527+0000","last_change":"2023-12-08T08:23:00.305076+0000","last_active":"2023-12-08T08:23:15.888527+0000","last_peered":"2023-12-08T08:23:15.888527+0000","last_clean":"2023-12-08T08:23:15.888527+0000","last_became_active":"2023-12-08T08:23:00.304435+0000","last_became_peered":"2023-12-08T08:23:00.304435+0000","last_unstale":"2023-12-08T08:23:15.888527+0000","last_undegraded":"2023-12-08T08:23:15.888527+0000","last_fullsized":"2023-12-08T08:23:15.888527+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:42:20.038693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885184+0000","last_change":"2023-12-08T08:22:59.278661+0000","last_active":"2023-12-08T08:23:15.885184+0000","last_peered":"2023-12-08T08:23:15.885184+0000","last_clean":"2023-12-08T08:23:15.885184+0000","last_became_active":"2023-12-08T08:22:59.278383+0000","last_became_peered":"2023-12-08T08:22:59.278383+0000","last_unstale":"2023-12-08T08:23:15.885184+0000","last_undegraded":"2023-12-08T08:23:15.885184+0000","last_fullsized":"2023-12-08T08:23:15.885184+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:35:15.000491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.899234+0000","last_change":"2023-12-08T08:23:16.899234+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.899234+0000","last_undegraded":"2023-12-08T08:23:16.899234+0000","last_fullsized":"2023-12-08T08:23:16.899234+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.923341+0000","last_change":"2023-12-08T08:23:16.918926+0000","last_active":"2023-12-08T08:23:16.923341+0000","last_peered":"2023-12-08T08:23:16.923341+0000","last_clean":"2023-12-08T08:23:16.923341+0000","last_became_active":"2023-12-08T08:23:16.918626+0000","last_became_peered":"2023-12-08T08:23:16.918626+0000","last_unstale":"2023-12-08T08:23:16.923341+0000","last_undegraded":"2023-12-08T08:23:16.923341+0000","last_fullsized":"2023-12-08T08:23:16.923341+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:10:23.005533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.890781+0000","last_change":"2023-12-08T08:23:00.270574+0000","last_active":"2023-12-08T08:23:15.890781+0000","last_peered":"2023-12-08T08:23:15.890781+0000","last_clean":"2023-12-08T08:23:15.890781+0000","last_became_active":"2023-12-08T08:23:00.270304+0000","last_became_peered":"2023-12-08T08:23:00.270304+0000","last_unstale":"2023-12-08T08:23:15.890781+0000","last_undegraded":"2023-12-08T08:23:15.890781+0000","last_fullsized":"2023-12-08T08:23:15.890781+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:15:55.762883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"67'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895591+0000","last_change":"2023-12-08T08:22:59.275324+0000","last_active":"2023-12-08T08:23:15.895591+0000","last_peered":"2023-12-08T08:23:15.895591+0000","last_clean":"2023-12-08T08:23:15.895591+0000","last_became_active":"2023-12-08T08:22:59.275038+0000","last_became_peered":"2023-12-08T08:22:59.275038+0000","last_unstale":"2023-12-08T08:23:15.895591+0000","last_undegraded":"2023-12-08T08:23:15.895591+0000","last_fullsized":"2023-12-08T08:23:15.895591+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:09.089659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":207,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894333+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:23:15.894333+0000","last_peered":"2023-12-08T08:23:15.894333+0000","last_clean":"2023-12-08T08:23:15.894333+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:23:15.894333+0000","last_undegraded":"2023-12-08T08:23:15.894333+0000","last_fullsized":"2023-12-08T08:23:15.894333+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":929792,"data_stored":968762,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89900000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.85299999999999998,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.77500000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85999999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89600000000000002,"5min":1.446,"15min":1.446},"last":0.873}]},{"osd":2,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.71999999999999997,"15min":0.72899999999999998},"min":{"1min":0.52100000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.871,"5min":1.379,"15min":1.379},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.47599999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.84599999999999997,"5min":1.706,"15min":1.706},"last":0.85999999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.751,"15min":0.76300000000000001},"min":{"1min":0.54500000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.88700000000000001,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.752},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.56699999999999995,"5min":0.496,"15min":0.496},"max":{"1min":0.83099999999999996,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.80000000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.46899999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.90000000000000002,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.72599999999999998,"15min":0.74199999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83999999999999997,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.59599999999999997}]},{"osd":5,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.77500000000000002,"15min":0.79500000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81399999999999995,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.78500000000000003,"15min":0.80200000000000005},"min":{"1min":0.499,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93300000000000005,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.72999999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.84799999999999998,"15min":0.86499999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.95899999999999996,"5min":1.573,"15min":1.573},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.80000000000000004,"15min":0.81499999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91100000000000003,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.82299999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":379018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.66800000000000004},"min":{"1min":0.49099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.56899999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94599999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.79400000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72499999999999998,"15min":0.71899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73599999999999999,"15min":0.73399999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.83399999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70899999999999996,"15min":0.72499999999999998},"min":{"1min":0.50700000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.90900000000000003,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73599999999999999,"15min":0.746},"min":{"1min":0.48899999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.877}]},{"osd":3,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.73799999999999999,"15min":0.75700000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.46600000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.96299999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.752}]},{"osd":4,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.70199999999999996,"15min":0.72599999999999998},"min":{"1min":0.42899999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83399999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.71699999999999997,"15min":0.755},"min":{"1min":0.496,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79700000000000004,"5min":1.014,"15min":1.014},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.75,"15min":0.79100000000000004},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83099999999999996,"5min":1.091,"15min":1.091},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.81699999999999995,"15min":0.84299999999999997},"min":{"1min":0.57199999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0149999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.93400000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78600000000000003,"15min":0.81599999999999995},"min":{"1min":0.61799999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.89000000000000001,"5min":1.04,"15min":1.04},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.84199999999999997,"15min":0.89200000000000002},"min":{"1min":0.55400000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96499999999999997,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.84799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":876544,"data_stored":381453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.621,"15min":0.622},"min":{"1min":0.47599999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.042,"5min":1.081,"15min":1.081},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68300000000000005,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.024,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.65800000000000003}]},{"osd":1,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69099999999999995,"15min":0.68100000000000005},"min":{"1min":0.42399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98599999999999999,"5min":1.194,"15min":1.194},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.006,"5min":1.143,"15min":1.143},"last":0.59199999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.47999999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0880000000000001,"5min":1.101,"15min":1.101},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72999999999999998,"15min":0.74199999999999999},"min":{"1min":0.52300000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.745},{"interface":"front","average":{"1min":0.75,"5min":0.76300000000000001,"15min":0.753},"min":{"1min":0.56200000000000006,"5min":0.5,"15min":0.5},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.73099999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.40899999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.96299999999999997,"5min":1.01,"15min":1.01},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.58899999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.048,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.83399999999999996}]},{"osd":6,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.75700000000000001,"15min":0.77900000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89900000000000002,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91000000000000003,"5min":1.073,"15min":1.073},"last":0.76500000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77600000000000002,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95999999999999996,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83599999999999997,"15min":0.85599999999999998},"min":{"1min":0.56299999999999994,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0800000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.61199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":378324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.68000000000000005,"15min":0.69399999999999995},"min":{"1min":0.502,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86099999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.68300000000000005,"15min":0.66800000000000004},"min":{"1min":0.59399999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95099999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.81399999999999995}]},{"osd":1,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70799999999999996,"15min":0.71299999999999997},"min":{"1min":0.52800000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90100000000000002,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68100000000000005,"15min":0.68200000000000005},"min":{"1min":0.505,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.84499999999999997,"5min":1.002,"15min":1.002},"last":0.71299999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68999999999999995},"min":{"1min":0.54200000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88400000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.751},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.54400000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.84699999999999998,"5min":1.056,"15min":1.056},"last":0.77400000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.58999999999999997,"5min":0.496,"15min":0.496},"max":{"1min":0.95299999999999996,"5min":1.359,"15min":1.359},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.755,"15min":0.78500000000000003},"min":{"1min":0.51800000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99399999999999999,"5min":1.232,"15min":1.232},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.64200000000000002,"15min":0.66800000000000004},"min":{"1min":0.39000000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90800000000000003,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.745,"15min":0.78100000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95199999999999996,"5min":1.091,"15min":1.091},"last":0.57699999999999996}]},{"osd":6,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.68600000000000005,"15min":0.71499999999999997},"min":{"1min":0.41699999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.92500000000000004,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.504},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.76300000000000001,"15min":0.78900000000000003},"min":{"1min":0.45300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98199999999999998,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.55000000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.97699999999999998,"5min":1.246,"15min":1.246},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.80200000000000005},"min":{"1min":0.50800000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.004,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.45700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":381431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41799999999999998,"15min":0.432},"min":{"1min":0.26500000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.56000000000000005,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45600000000000002,"15min":0.46300000000000002},"min":{"1min":0.309,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73999999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.42899999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.435,"15min":0.436},"min":{"1min":0.317,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.58099999999999996,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.504}]},{"osd":2,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.50900000000000001,"15min":0.52200000000000002},"min":{"1min":0.35299999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52900000000000003,"15min":0.54100000000000004},"min":{"1min":0.40600000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65200000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.52700000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0620000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":1.014},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.54300000000000004,"5min":0.497,"15min":0.497},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.95499999999999996}]},{"osd":5,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.52000000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":1},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.76200000000000001,"15min":0.77100000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.97199999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.56899999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.101,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.97899999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.76200000000000001,"15min":0.75900000000000001},"min":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.58599999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1080000000000001,"5min":1.121,"15min":1.121},"last":1.036}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":864256,"data_stored":378906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39100000000000001,"15min":0.40100000000000002},"min":{"1min":0.27900000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.497,"15min":0.53100000000000003},"min":{"1min":0.315,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67700000000000005,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.34399999999999997}]},{"osd":1,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.32200000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51500000000000001,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.40100000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.54300000000000004,"15min":0.57699999999999996},"min":{"1min":0.34899999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.57799999999999996,"5min":3.008,"15min":3.008},"last":0.44},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47799999999999998,"15min":0.48399999999999999},"min":{"1min":0.33800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.65400000000000003,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.36599999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78300000000000003,"15min":0.81699999999999995},"min":{"1min":0.50900000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.004,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0049999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.79300000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.75700000000000001,"15min":0.76800000000000002},"min":{"1min":0.51000000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98699999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78800000000000003,"15min":0.82899999999999996},"min":{"1min":0.52600000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98799999999999999,"5min":3.637,"15min":3.637},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.78000000000000003,"15min":0.79400000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97499999999999998,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.038,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.83499999999999996,"15min":0.89500000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.88400000000000001,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.82499999999999996,"15min":0.83899999999999997},"min":{"1min":0.56799999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0109999999999999,"5min":1.766,"15min":1.766},"last":0.83399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":378518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.59799999999999998,"15min":0.67600000000000005},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.80300000000000005,"5min":5.2210000000000001,"15min":5.2210000000000001},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.73399999999999999,"15min":0.85899999999999999},"min":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59599999999999997,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.38200000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.71299999999999997,"15min":0.83899999999999997},"min":{"1min":0.32800000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.60999999999999999,"5min":8.2070000000000007,"15min":8.2070000000000007},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.63500000000000001,"15min":0.70399999999999996},"min":{"1min":0.34300000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.69299999999999995,"5min":4.351,"15min":4.351},"last":0.37}]},{"osd":3,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.80900000000000005,"15min":0.94199999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.754,"5min":8.1479999999999997,"15min":8.1479999999999997},"last":0.308},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.67400000000000004,"15min":0.76900000000000002},"min":{"1min":0.32300000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.72599999999999998,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.32300000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.91000000000000003,"15min":1.012},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0049999999999999,"5min":4.8470000000000004,"15min":4.8470000000000004},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.97599999999999998,"15min":1.0820000000000001},"min":{"1min":0.55100000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93999999999999995,"5min":4.7939999999999996,"15min":4.7939999999999996},"last":0.66500000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.90500000000000003,"15min":0.98699999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99199999999999999,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.89900000000000002,"15min":0.97899999999999998},"min":{"1min":0.53000000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.107,"5min":4.5830000000000002,"15min":4.5830000000000002},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.97999999999999998,"15min":1.097},"min":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.95799999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.97199999999999998,"15min":1.075},"min":{"1min":0.59399999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.95799999999999996,"5min":4.6289999999999996,"15min":4.6289999999999996},"last":0.68400000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.91600000000000004,"15min":1.002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.97699999999999998,"5min":4.665,"15min":4.665},"last":0.505},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.98199999999999998,"15min":1.0860000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.089,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.57599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":917504,"data_stored":961596,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46899999999999997,"15min":0.495},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64000000000000001,"5min":1.863,"15min":1.863},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.75600000000000001,"15min":0.88600000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70799999999999996,"5min":8.2799999999999994,"15min":8.2799999999999994},"last":0.38}]},{"osd":2,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.78000000000000003,"15min":0.93200000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77300000000000002,"5min":7.9290000000000003,"15min":7.9290000000000003},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.78200000000000003,"15min":0.93700000000000006},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.628,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.435}]},{"osd":3,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.59799999999999998,"15min":0.67200000000000004},"min":{"1min":0.33100000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58699999999999997,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.75600000000000001,"15min":0.872},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82399999999999995,"5min":7.8890000000000002,"15min":7.8890000000000002},"last":0.41799999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.94899999999999995,"15min":1.0529999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95399999999999996,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.753,"15min":0.77800000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88600000000000001,"5min":1.607,"15min":1.607},"last":0.58499999999999996}]},{"osd":5,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.81100000000000005,"15min":0.83099999999999996},"min":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96899999999999997,"5min":1.514,"15min":1.514},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.98899999999999999,"15min":1.1100000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91000000000000003,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79200000000000004,"15min":0.82699999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.88,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.95399999999999996,"15min":1.0549999999999999},"min":{"1min":0.56100000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.89900000000000002,"5min":7.835,"15min":7.835},"last":0.56699999999999995}]},{"osd":7,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.97399999999999998,"15min":1.0800000000000001},"min":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.99299999999999999,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.81000000000000005,"15min":0.85399999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95199999999999996,"5min":1.794,"15min":1.794},"last":0.52900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:23:21.972 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:23:22.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a6d9f8640 1 Processor -- start 2023-12-08T08:23:22.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a6d9f8640 1 -- start start 2023-12-08T08:23:22.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a6d9f8640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5a68151a60 0x7f5a680c9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:22.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a6d9f8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a681579e0 con 0x7f5a680c45d0 2023-12-08T08:23:22.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a6d9f8640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a680c98e0 con 0x7f5a68158710 2023-12-08T08:23:22.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a6d9f8640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a68157c30 con 0x7f5a68151a60 2023-12-08T08:23:22.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a677fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5a680c45d0 0x7f5a680c7b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37994/0 (socket says 172.21.15.88:37994) 2023-12-08T08:23:22.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a677fe640 1 -- 172.21.15.88:0/3435760675 learned_addr learned my addr 172.21.15.88:0/3435760675 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:22.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a66ffd640 1 --2- 172.21.15.88:0/3435760675 >> v2:172.21.15.148:3300/0 conn(0x7f5a68151a60 0x7f5a680c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:22.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a667fc640 1 -- 172.21.15.88:0/3435760675 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1602667006 0 0) 0x7f5a681579e0 con 0x7f5a680c45d0 2023-12-08T08:23:22.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a667fc640 1 -- 172.21.15.88:0/3435760675 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a54003530 con 0x7f5a680c45d0 2023-12-08T08:23:22.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a667fc640 1 -- 172.21.15.88:0/3435760675 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1836949944 0 0) 0x7f5a54003530 con 0x7f5a680c45d0 2023-12-08T08:23:22.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a667fc640 1 -- 172.21.15.88:0/3435760675 >> v2:172.21.15.148:3300/0 conn(0x7f5a68151a60 msgr2=0x7f5a680c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:22.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a667fc640 1 --2- 172.21.15.88:0/3435760675 >> v2:172.21.15.148:3300/0 conn(0x7f5a68151a60 0x7f5a680c9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:22.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a667fc640 1 -- 172.21.15.88:0/3435760675 >> v1:172.21.15.148:6789/0 conn(0x7f5a68158710 legacy=0x7f5a680ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:22.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a667fc640 1 -- 172.21.15.88:0/3435760675 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a68157f10 con 0x7f5a680c45d0 2023-12-08T08:23:22.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a667fc640 1 -- 172.21.15.88:0/3435760675 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f5a60001680 con 0x7f5a680c45d0 2023-12-08T08:23:22.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a667fc640 1 -- 172.21.15.88:0/3435760675 >> v1:172.21.15.88:6789/0 conn(0x7f5a680c45d0 legacy=0x7f5a680c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:22.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a667fc640 1 --2- 172.21.15.88:0/3435760675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a54003980 0x7f5a54003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:22.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a667fc640 1 --2- 172.21.15.88:0/3435760675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a540047d0 0x7f5a54004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:22.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a667fc640 1 --2- 172.21.15.88:0/3435760675 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a54005190 0x7f5a5400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:22.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a667fc640 1 -- 172.21.15.88:0/3435760675 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a68157c30 con 0x7f5a54003980 2023-12-08T08:23:22.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a667fc640 1 -- 172.21.15.88:0/3435760675 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5400c130 con 0x7f5a540047d0 2023-12-08T08:23:22.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a667fc640 1 -- 172.21.15.88:0/3435760675 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5400c2f0 con 0x7f5a54005190 2023-12-08T08:23:22.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a66ffd640 1 --2- 172.21.15.88:0/3435760675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a54003980 0x7f5a54003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:22.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a5e7fc640 1 --2- 172.21.15.88:0/3435760675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a540047d0 0x7f5a54004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:22.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a677fe640 1 --2- 172.21.15.88:0/3435760675 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a54005190 0x7f5a5400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:22.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a66ffd640 1 -- 172.21.15.88:0/3435760675 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a54005190 msgr2=0x7f5a5400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:22.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a66ffd640 1 --2- 172.21.15.88:0/3435760675 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a54005190 0x7f5a5400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:22.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a66ffd640 1 -- 172.21.15.88:0/3435760675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a540047d0 msgr2=0x7f5a54004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:22.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a66ffd640 1 --2- 172.21.15.88:0/3435760675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a540047d0 0x7f5a54004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:22.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a66ffd640 1 -- 172.21.15.88:0/3435760675 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a54003530 con 0x7f5a54003980 2023-12-08T08:23:22.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.138+0000 7f5a677fe640 1 -- 172.21.15.88:0/3435760675 reap_dead start 2023-12-08T08:23:22.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.142+0000 7f5a66ffd640 1 --2- 172.21.15.88:0/3435760675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a54003980 0x7f5a54003da0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f5a58009ae0 tx=0x7f5a5801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2903e746da7a9b3f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:22.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.142+0000 7f5a667fc640 1 -- 172.21.15.88:0/3435760675 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a580a6430 con 0x7f5a54003980 2023-12-08T08:23:22.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.142+0000 7f5a667fc640 1 -- 172.21.15.88:0/3435760675 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a580a6590 con 0x7f5a54003980 2023-12-08T08:23:22.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.142+0000 7f5a667fc640 1 -- 172.21.15.88:0/3435760675 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a580a6940 con 0x7f5a54003980 2023-12-08T08:23:22.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.142+0000 7f5a6d9f8640 1 -- 172.21.15.88:0/3435760675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a54003980 msgr2=0x7f5a54003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:22.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.142+0000 7f5a6d9f8640 1 --2- 172.21.15.88:0/3435760675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a54003980 0x7f5a54003da0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f5a58009ae0 tx=0x7f5a5801ca50 comp rx=0 tx=0).stop 2023-12-08T08:23:22.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.142+0000 7f5a6d9f8640 1 -- 172.21.15.88:0/3435760675 shutdown_connections 2023-12-08T08:23:22.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.142+0000 7f5a6d9f8640 1 --2- 172.21.15.88:0/3435760675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a54003980 0x7f5a54003da0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:22.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.142+0000 7f5a6d9f8640 1 -- 172.21.15.88:0/3435760675 >> 172.21.15.88:0/3435760675 conn(0x7f5a680abe60 msgr2=0x7f5a680c9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:22.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.142+0000 7f5a6d9f8640 1 -- 172.21.15.88:0/3435760675 shutdown_connections 2023-12-08T08:23:22.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.142+0000 7f5a6d9f8640 1 -- 172.21.15.88:0/3435760675 wait complete. 2023-12-08T08:23:22.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.146+0000 7f5a6d9f8640 1 Processor -- start 2023-12-08T08:23:22.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.146+0000 7f5a6d9f8640 1 -- start start 2023-12-08T08:23:22.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.146+0000 7f5a6d9f8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a54003980 0x7f5a6814df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:22.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.146+0000 7f5a6d9f8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a68146b60 0x7f5a681458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:22.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.146+0000 7f5a6d9f8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a68146530 0x7f5a68145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:22.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.146+0000 7f5a6d9f8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a68154350 con 0x7f5a68146b60 2023-12-08T08:23:22.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.146+0000 7f5a6d9f8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a68146370 con 0x7f5a54003980 2023-12-08T08:23:22.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.146+0000 7f5a6d9f8640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a680adab0 con 0x7f5a68146530 2023-12-08T08:23:22.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.146+0000 7f5a5e7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a68146b60 0x7f5a681458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:22.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.146+0000 7f5a5e7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a68146b60 0x7f5a681458f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54344/0 (socket says 172.21.15.88:54344) 2023-12-08T08:23:22.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.146+0000 7f5a5e7fc640 1 -- 172.21.15.88:0/3856834585 learned_addr learned my addr 172.21.15.88:0/3856834585 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:22.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.146+0000 7f5a66ffd640 1 --2- 172.21.15.88:0/3856834585 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a54003980 0x7f5a6814df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:22.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.146+0000 7f5a677fe640 1 --2- 172.21.15.88:0/3856834585 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a68146530 0x7f5a68145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:22.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.146+0000 7f5a5e7fc640 1 -- 172.21.15.88:0/3856834585 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a68146530 msgr2=0x7f5a68145e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:22.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.146+0000 7f5a5e7fc640 1 --2- 172.21.15.88:0/3856834585 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a68146530 0x7f5a68145e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:22.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.146+0000 7f5a5e7fc640 1 -- 172.21.15.88:0/3856834585 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a54003980 msgr2=0x7f5a6814df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:22.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.146+0000 7f5a5e7fc640 1 --2- 172.21.15.88:0/3856834585 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a54003980 0x7f5a6814df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:22.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.146+0000 7f5a5e7fc640 1 -- 172.21.15.88:0/3856834585 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a680ad7d0 con 0x7f5a68146b60 2023-12-08T08:23:22.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.146+0000 7f5a5e7fc640 1 --2- 172.21.15.88:0/3856834585 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a68146b60 0x7f5a681458f0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000fbc0 tx=0x7f5a5000d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:22.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.146+0000 7f5a64ff9640 1 -- 172.21.15.88:0/3856834585 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a50001a20 con 0x7f5a68146b60 2023-12-08T08:23:22.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.146+0000 7f5a64ff9640 1 -- 172.21.15.88:0/3856834585 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5000fec0 con 0x7f5a68146b60 2023-12-08T08:23:22.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.146+0000 7f5a64ff9640 1 -- 172.21.15.88:0/3856834585 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5000ddf0 con 0x7f5a68146b60 2023-12-08T08:23:22.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.146+0000 7f5a6d9f8640 1 -- 172.21.15.88:0/3856834585 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a680adde0 con 0x7f5a68146b60 2023-12-08T08:23:22.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.146+0000 7f5a6d9f8640 1 -- 172.21.15.88:0/3856834585 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a680ae3a0 con 0x7f5a68146b60 2023-12-08T08:23:22.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.146+0000 7f5a6d9f8640 1 -- 172.21.15.88:0/3856834585 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a680ae560 con 0x7f5a68146b60 2023-12-08T08:23:22.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.150+0000 7f5a64ff9640 1 -- 172.21.15.88:0/3856834585 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5a50003980 con 0x7f5a68146b60 2023-12-08T08:23:22.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.150+0000 7f5a64ff9640 1 --2- 172.21.15.88:0/3856834585 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5a480664a0 0x7f5a48068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:22.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.150+0000 7f5a64ff9640 1 -- 172.21.15.88:0/3856834585 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5a50084320 con 0x7f5a68146b60 2023-12-08T08:23:22.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.150+0000 7f5a66ffd640 1 --2- 172.21.15.88:0/3856834585 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5a480664a0 0x7f5a48068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:22.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.150+0000 7f5a66ffd640 1 --2- 172.21.15.88:0/3856834585 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5a480664a0 0x7f5a48068960 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5a580ad000 tx=0x7f5a580046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:22.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.154+0000 7f5a64ff9640 1 -- 172.21.15.88:0/3856834585 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5a500514d0 con 0x7f5a68146b60 2023-12-08T08:23:22.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.302+0000 7f5a6d9f8640 1 -- 172.21.15.88:0/3856834585 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5a680674b0 con 0x7f5a480664a0 2023-12-08T08:23:22.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.314+0000 7f5a64ff9640 1 -- 172.21.15.88:0/3856834585 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+522584 (secure 0 0 0) 0x7f5a680674b0 con 0x7f5a480664a0 2023-12-08T08:23:22.323 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:22.327 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:23:22.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.318+0000 7f5a6d9f8640 1 -- 172.21.15.88:0/3856834585 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5a480664a0 msgr2=0x7f5a48068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:22.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.318+0000 7f5a6d9f8640 1 --2- 172.21.15.88:0/3856834585 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5a480664a0 0x7f5a48068960 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5a580ad000 tx=0x7f5a580046d0 comp rx=0 tx=0).stop 2023-12-08T08:23:22.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.318+0000 7f5a6d9f8640 1 -- 172.21.15.88:0/3856834585 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a68146b60 msgr2=0x7f5a681458f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:22.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.318+0000 7f5a6d9f8640 1 --2- 172.21.15.88:0/3856834585 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a68146b60 0x7f5a681458f0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000fbc0 tx=0x7f5a5000d520 comp rx=0 tx=0).stop 2023-12-08T08:23:22.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.318+0000 7f5a6d9f8640 1 -- 172.21.15.88:0/3856834585 shutdown_connections 2023-12-08T08:23:22.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.318+0000 7f5a6d9f8640 1 --2- 172.21.15.88:0/3856834585 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5a480664a0 0x7f5a48068960 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:22.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.318+0000 7f5a6d9f8640 1 --2- 172.21.15.88:0/3856834585 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5a68146530 0x7f5a68145e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:22.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.318+0000 7f5a6d9f8640 1 --2- 172.21.15.88:0/3856834585 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a68146b60 0x7f5a681458f0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:22.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.318+0000 7f5a6d9f8640 1 --2- 172.21.15.88:0/3856834585 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a54003980 0x7f5a6814df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:22.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.318+0000 7f5a6d9f8640 1 -- 172.21.15.88:0/3856834585 >> 172.21.15.88:0/3856834585 conn(0x7f5a680abe60 msgr2=0x7f5a680a9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:22.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.318+0000 7f5a6d9f8640 1 -- 172.21.15.88:0/3856834585 shutdown_connections 2023-12-08T08:23:22.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.318+0000 7f5a6d9f8640 1 -- 172.21.15.88:0/3856834585 wait complete. 2023-12-08T08:23:22.342 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2023-12-08T08:23:20.784087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":261,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252208,"kb_used_data":6900,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754722512,"statfs":{"total":773094113280,"available":772835852288,"internally_reserved":0,"allocated":7065600,"data_stored":4208008,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.902889"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.897424+0000","last_change":"2023-12-08T08:23:16.897424+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.897424+0000","last_undegraded":"2023-12-08T08:23:16.897424+0000","last_fullsized":"2023-12-08T08:23:16.897424+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889235+0000","last_change":"2023-12-08T08:23:00.281512+0000","last_active":"2023-12-08T08:23:15.889235+0000","last_peered":"2023-12-08T08:23:15.889235+0000","last_clean":"2023-12-08T08:23:15.889235+0000","last_became_active":"2023-12-08T08:23:00.281118+0000","last_became_peered":"2023-12-08T08:23:00.281118+0000","last_unstale":"2023-12-08T08:23:15.889235+0000","last_undegraded":"2023-12-08T08:23:15.889235+0000","last_fullsized":"2023-12-08T08:23:15.889235+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:15.472021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.903319+0000","last_change":"2023-12-08T08:23:16.903319+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.903319+0000","last_undegraded":"2023-12-08T08:23:16.903319+0000","last_fullsized":"2023-12-08T08:23:16.903319+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.891247+0000","last_change":"2023-12-08T08:23:00.276523+0000","last_active":"2023-12-08T08:23:15.891247+0000","last_peered":"2023-12-08T08:23:15.891247+0000","last_clean":"2023-12-08T08:23:15.891247+0000","last_became_active":"2023-12-08T08:23:00.276039+0000","last_became_peered":"2023-12-08T08:23:00.276039+0000","last_unstale":"2023-12-08T08:23:15.891247+0000","last_undegraded":"2023-12-08T08:23:15.891247+0000","last_fullsized":"2023-12-08T08:23:15.891247+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:31:16.893953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896828+0000","last_change":"2023-12-08T08:23:16.896828+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896828+0000","last_undegraded":"2023-12-08T08:23:16.896828+0000","last_fullsized":"2023-12-08T08:23:16.896828+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895520+0000","last_change":"2023-12-08T08:23:00.283198+0000","last_active":"2023-12-08T08:23:15.895520+0000","last_peered":"2023-12-08T08:23:15.895520+0000","last_clean":"2023-12-08T08:23:15.895520+0000","last_became_active":"2023-12-08T08:23:00.282944+0000","last_became_peered":"2023-12-08T08:23:00.282944+0000","last_unstale":"2023-12-08T08:23:15.895520+0000","last_undegraded":"2023-12-08T08:23:15.895520+0000","last_fullsized":"2023-12-08T08:23:15.895520+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:33.898137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.898081+0000","last_change":"2023-12-08T08:23:16.898081+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.898081+0000","last_undegraded":"2023-12-08T08:23:16.898081+0000","last_fullsized":"2023-12-08T08:23:16.898081+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.884023+0000","last_change":"2023-12-08T08:23:00.285685+0000","last_active":"2023-12-08T08:23:15.884023+0000","last_peered":"2023-12-08T08:23:15.884023+0000","last_clean":"2023-12-08T08:23:15.884023+0000","last_became_active":"2023-12-08T08:23:00.285351+0000","last_became_peered":"2023-12-08T08:23:00.285351+0000","last_unstale":"2023-12-08T08:23:15.884023+0000","last_undegraded":"2023-12-08T08:23:15.884023+0000","last_fullsized":"2023-12-08T08:23:15.884023+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:43:34.830332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900497+0000","last_change":"2023-12-08T08:23:16.900497+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900497+0000","last_undegraded":"2023-12-08T08:23:16.900497+0000","last_fullsized":"2023-12-08T08:23:16.900497+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885459+0000","last_change":"2023-12-08T08:23:00.264270+0000","last_active":"2023-12-08T08:23:15.885459+0000","last_peered":"2023-12-08T08:23:15.885459+0000","last_clean":"2023-12-08T08:23:15.885459+0000","last_became_active":"2023-12-08T08:23:00.263994+0000","last_became_peered":"2023-12-08T08:23:00.263994+0000","last_unstale":"2023-12-08T08:23:15.885459+0000","last_undegraded":"2023-12-08T08:23:15.885459+0000","last_fullsized":"2023-12-08T08:23:15.885459+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:33.905575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900421+0000","last_change":"2023-12-08T08:23:16.900421+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900421+0000","last_undegraded":"2023-12-08T08:23:16.900421+0000","last_fullsized":"2023-12-08T08:23:16.900421+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895579+0000","last_change":"2023-12-08T08:23:00.300354+0000","last_active":"2023-12-08T08:23:15.895579+0000","last_peered":"2023-12-08T08:23:15.895579+0000","last_clean":"2023-12-08T08:23:15.895579+0000","last_became_active":"2023-12-08T08:23:00.300026+0000","last_became_peered":"2023-12-08T08:23:00.300026+0000","last_unstale":"2023-12-08T08:23:15.895579+0000","last_undegraded":"2023-12-08T08:23:15.895579+0000","last_fullsized":"2023-12-08T08:23:15.895579+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.905320+0000","last_change":"2023-12-08T08:23:16.905320+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.905320+0000","last_undegraded":"2023-12-08T08:23:16.905320+0000","last_fullsized":"2023-12-08T08:23:16.905320+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883417+0000","last_change":"2023-12-08T08:23:00.278456+0000","last_active":"2023-12-08T08:23:15.883417+0000","last_peered":"2023-12-08T08:23:15.883417+0000","last_clean":"2023-12-08T08:23:15.883417+0000","last_became_active":"2023-12-08T08:23:00.277186+0000","last_became_peered":"2023-12-08T08:23:00.277186+0000","last_unstale":"2023-12-08T08:23:15.883417+0000","last_undegraded":"2023-12-08T08:23:15.883417+0000","last_fullsized":"2023-12-08T08:23:15.883417+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:20:16.170951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900665+0000","last_change":"2023-12-08T08:23:16.900665+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900665+0000","last_undegraded":"2023-12-08T08:23:16.900665+0000","last_fullsized":"2023-12-08T08:23:16.900665+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.893869+0000","last_change":"2023-12-08T08:23:00.272694+0000","last_active":"2023-12-08T08:23:15.893869+0000","last_peered":"2023-12-08T08:23:15.893869+0000","last_clean":"2023-12-08T08:23:15.893869+0000","last_became_active":"2023-12-08T08:23:00.272440+0000","last_became_peered":"2023-12-08T08:23:00.272440+0000","last_unstale":"2023-12-08T08:23:15.893869+0000","last_undegraded":"2023-12-08T08:23:15.893869+0000","last_fullsized":"2023-12-08T08:23:15.893869+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:15.472021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.908893+0000","last_change":"2023-12-08T08:23:16.908893+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.908893+0000","last_undegraded":"2023-12-08T08:23:16.908893+0000","last_fullsized":"2023-12-08T08:23:16.908893+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895866+0000","last_change":"2023-12-08T08:23:00.298447+0000","last_active":"2023-12-08T08:23:15.895866+0000","last_peered":"2023-12-08T08:23:15.895866+0000","last_clean":"2023-12-08T08:23:15.895866+0000","last_became_active":"2023-12-08T08:23:00.298113+0000","last_became_peered":"2023-12-08T08:23:00.298113+0000","last_unstale":"2023-12-08T08:23:15.895866+0000","last_undegraded":"2023-12-08T08:23:15.895866+0000","last_fullsized":"2023-12-08T08:23:15.895866+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896836+0000","last_change":"2023-12-08T08:23:16.896836+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896836+0000","last_undegraded":"2023-12-08T08:23:16.896836+0000","last_fullsized":"2023-12-08T08:23:16.896836+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889234+0000","last_change":"2023-12-08T08:23:00.277064+0000","last_active":"2023-12-08T08:23:15.889234+0000","last_peered":"2023-12-08T08:23:15.889234+0000","last_clean":"2023-12-08T08:23:15.889234+0000","last_became_active":"2023-12-08T08:23:00.276850+0000","last_became_peered":"2023-12-08T08:23:00.276850+0000","last_unstale":"2023-12-08T08:23:15.889234+0000","last_undegraded":"2023-12-08T08:23:15.889234+0000","last_fullsized":"2023-12-08T08:23:15.889234+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896062+0000","last_change":"2023-12-08T08:23:16.896062+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896062+0000","last_undegraded":"2023-12-08T08:23:16.896062+0000","last_fullsized":"2023-12-08T08:23:16.896062+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.891049+0000","last_change":"2023-12-08T08:23:00.286362+0000","last_active":"2023-12-08T08:23:15.891049+0000","last_peered":"2023-12-08T08:23:15.891049+0000","last_clean":"2023-12-08T08:23:15.891049+0000","last_became_active":"2023-12-08T08:23:00.286071+0000","last_became_peered":"2023-12-08T08:23:00.286071+0000","last_unstale":"2023-12-08T08:23:15.891049+0000","last_undegraded":"2023-12-08T08:23:15.891049+0000","last_fullsized":"2023-12-08T08:23:15.891049+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:50.890759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.905090+0000","last_change":"2023-12-08T08:23:16.905090+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.905090+0000","last_undegraded":"2023-12-08T08:23:16.905090+0000","last_fullsized":"2023-12-08T08:23:16.905090+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888742+0000","last_change":"2023-12-08T08:23:00.277187+0000","last_active":"2023-12-08T08:23:15.888742+0000","last_peered":"2023-12-08T08:23:15.888742+0000","last_clean":"2023-12-08T08:23:15.888742+0000","last_became_active":"2023-12-08T08:23:00.276929+0000","last_became_peered":"2023-12-08T08:23:00.276929+0000","last_unstale":"2023-12-08T08:23:15.888742+0000","last_undegraded":"2023-12-08T08:23:15.888742+0000","last_fullsized":"2023-12-08T08:23:15.888742+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:55:36.390421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.908607+0000","last_change":"2023-12-08T08:23:16.908607+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.908607+0000","last_undegraded":"2023-12-08T08:23:16.908607+0000","last_fullsized":"2023-12-08T08:23:16.908607+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894617+0000","last_change":"2023-12-08T08:23:00.275837+0000","last_active":"2023-12-08T08:23:15.894617+0000","last_peered":"2023-12-08T08:23:15.894617+0000","last_clean":"2023-12-08T08:23:15.894617+0000","last_became_active":"2023-12-08T08:23:00.275561+0000","last_became_peered":"2023-12-08T08:23:00.275561+0000","last_unstale":"2023-12-08T08:23:15.894617+0000","last_undegraded":"2023-12-08T08:23:15.894617+0000","last_fullsized":"2023-12-08T08:23:15.894617+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.901924+0000","last_change":"2023-12-08T08:23:16.901924+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.901924+0000","last_undegraded":"2023-12-08T08:23:16.901924+0000","last_fullsized":"2023-12-08T08:23:16.901924+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883534+0000","last_change":"2023-12-08T08:23:00.295614+0000","last_active":"2023-12-08T08:23:15.883534+0000","last_peered":"2023-12-08T08:23:15.883534+0000","last_clean":"2023-12-08T08:23:15.883534+0000","last_became_active":"2023-12-08T08:23:00.295111+0000","last_became_peered":"2023-12-08T08:23:00.295111+0000","last_unstale":"2023-12-08T08:23:15.883534+0000","last_undegraded":"2023-12-08T08:23:15.883534+0000","last_fullsized":"2023-12-08T08:23:15.883534+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:10:16.885890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.907581+0000","last_change":"2023-12-08T08:23:16.907581+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.907581+0000","last_undegraded":"2023-12-08T08:23:16.907581+0000","last_fullsized":"2023-12-08T08:23:16.907581+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888024+0000","last_change":"2023-12-08T08:23:00.292909+0000","last_active":"2023-12-08T08:23:15.888024+0000","last_peered":"2023-12-08T08:23:15.888024+0000","last_clean":"2023-12-08T08:23:15.888024+0000","last_became_active":"2023-12-08T08:23:00.292500+0000","last_became_peered":"2023-12-08T08:23:00.292500+0000","last_unstale":"2023-12-08T08:23:15.888024+0000","last_undegraded":"2023-12-08T08:23:15.888024+0000","last_fullsized":"2023-12-08T08:23:15.888024+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:21:14.553932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.902396+0000","last_change":"2023-12-08T08:23:16.902396+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.902396+0000","last_undegraded":"2023-12-08T08:23:16.902396+0000","last_fullsized":"2023-12-08T08:23:16.902396+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885220+0000","last_change":"2023-12-08T08:23:00.273084+0000","last_active":"2023-12-08T08:23:15.885220+0000","last_peered":"2023-12-08T08:23:15.885220+0000","last_clean":"2023-12-08T08:23:15.885220+0000","last_became_active":"2023-12-08T08:23:00.272803+0000","last_became_peered":"2023-12-08T08:23:00.272803+0000","last_unstale":"2023-12-08T08:23:15.885220+0000","last_undegraded":"2023-12-08T08:23:15.885220+0000","last_fullsized":"2023-12-08T08:23:15.885220+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:16.068318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900173+0000","last_change":"2023-12-08T08:23:16.900173+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900173+0000","last_undegraded":"2023-12-08T08:23:16.900173+0000","last_fullsized":"2023-12-08T08:23:16.900173+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.886059+0000","last_change":"2023-12-08T08:23:00.300292+0000","last_active":"2023-12-08T08:23:15.886059+0000","last_peered":"2023-12-08T08:23:15.886059+0000","last_clean":"2023-12-08T08:23:15.886059+0000","last_became_active":"2023-12-08T08:23:00.300008+0000","last_became_peered":"2023-12-08T08:23:00.300008+0000","last_unstale":"2023-12-08T08:23:15.886059+0000","last_undegraded":"2023-12-08T08:23:15.886059+0000","last_fullsized":"2023-12-08T08:23:15.886059+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:39.385907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896360+0000","last_change":"2023-12-08T08:23:16.896360+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896360+0000","last_undegraded":"2023-12-08T08:23:16.896360+0000","last_fullsized":"2023-12-08T08:23:16.896360+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.884197+0000","last_change":"2023-12-08T08:23:00.299621+0000","last_active":"2023-12-08T08:23:15.884197+0000","last_peered":"2023-12-08T08:23:15.884197+0000","last_clean":"2023-12-08T08:23:15.884197+0000","last_became_active":"2023-12-08T08:23:00.299255+0000","last_became_peered":"2023-12-08T08:23:00.299255+0000","last_unstale":"2023-12-08T08:23:15.884197+0000","last_undegraded":"2023-12-08T08:23:15.884197+0000","last_fullsized":"2023-12-08T08:23:15.884197+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:28:46.845466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896496+0000","last_change":"2023-12-08T08:23:16.896496+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896496+0000","last_undegraded":"2023-12-08T08:23:16.896496+0000","last_fullsized":"2023-12-08T08:23:16.896496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.896102+0000","last_change":"2023-12-08T08:23:00.296010+0000","last_active":"2023-12-08T08:23:15.896102+0000","last_peered":"2023-12-08T08:23:15.896102+0000","last_clean":"2023-12-08T08:23:15.896102+0000","last_became_active":"2023-12-08T08:23:00.295749+0000","last_became_peered":"2023-12-08T08:23:00.295749+0000","last_unstale":"2023-12-08T08:23:15.896102+0000","last_undegraded":"2023-12-08T08:23:15.896102+0000","last_fullsized":"2023-12-08T08:23:15.896102+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:39.385907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.902160+0000","last_change":"2023-12-08T08:23:16.902160+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.902160+0000","last_undegraded":"2023-12-08T08:23:16.902160+0000","last_fullsized":"2023-12-08T08:23:16.902160+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.884023+0000","last_change":"2023-12-08T08:23:00.301831+0000","last_active":"2023-12-08T08:23:15.884023+0000","last_peered":"2023-12-08T08:23:15.884023+0000","last_clean":"2023-12-08T08:23:15.884023+0000","last_became_active":"2023-12-08T08:23:00.301321+0000","last_became_peered":"2023-12-08T08:23:00.301321+0000","last_unstale":"2023-12-08T08:23:15.884023+0000","last_undegraded":"2023-12-08T08:23:15.884023+0000","last_fullsized":"2023-12-08T08:23:15.884023+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:14:54.964832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.895365+0000","last_change":"2023-12-08T08:23:16.895365+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.895365+0000","last_undegraded":"2023-12-08T08:23:16.895365+0000","last_fullsized":"2023-12-08T08:23:16.895365+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883777+0000","last_change":"2023-12-08T08:23:00.301605+0000","last_active":"2023-12-08T08:23:15.883777+0000","last_peered":"2023-12-08T08:23:15.883777+0000","last_clean":"2023-12-08T08:23:15.883777+0000","last_became_active":"2023-12-08T08:23:00.301346+0000","last_became_peered":"2023-12-08T08:23:00.301346+0000","last_unstale":"2023-12-08T08:23:15.883777+0000","last_undegraded":"2023-12-08T08:23:15.883777+0000","last_fullsized":"2023-12-08T08:23:15.883777+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:35:35.139064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900505+0000","last_change":"2023-12-08T08:23:16.900505+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900505+0000","last_undegraded":"2023-12-08T08:23:16.900505+0000","last_fullsized":"2023-12-08T08:23:16.900505+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889839+0000","last_change":"2023-12-08T08:23:00.301440+0000","last_active":"2023-12-08T08:23:15.889839+0000","last_peered":"2023-12-08T08:23:15.889839+0000","last_clean":"2023-12-08T08:23:15.889839+0000","last_became_active":"2023-12-08T08:23:00.301156+0000","last_became_peered":"2023-12-08T08:23:00.301156+0000","last_unstale":"2023-12-08T08:23:15.889839+0000","last_undegraded":"2023-12-08T08:23:15.889839+0000","last_fullsized":"2023-12-08T08:23:15.889839+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:04:21.562137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900540+0000","last_change":"2023-12-08T08:23:16.900540+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900540+0000","last_undegraded":"2023-12-08T08:23:16.900540+0000","last_fullsized":"2023-12-08T08:23:16.900540+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888706+0000","last_change":"2023-12-08T08:23:00.301914+0000","last_active":"2023-12-08T08:23:15.888706+0000","last_peered":"2023-12-08T08:23:15.888706+0000","last_clean":"2023-12-08T08:23:15.888706+0000","last_became_active":"2023-12-08T08:23:00.301688+0000","last_became_peered":"2023-12-08T08:23:00.301688+0000","last_unstale":"2023-12-08T08:23:15.888706+0000","last_undegraded":"2023-12-08T08:23:15.888706+0000","last_fullsized":"2023-12-08T08:23:15.888706+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:27:39.303886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896058+0000","last_change":"2023-12-08T08:23:16.896058+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896058+0000","last_undegraded":"2023-12-08T08:23:16.896058+0000","last_fullsized":"2023-12-08T08:23:16.896058+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883508+0000","last_change":"2023-12-08T08:23:00.298664+0000","last_active":"2023-12-08T08:23:15.883508+0000","last_peered":"2023-12-08T08:23:15.883508+0000","last_clean":"2023-12-08T08:23:15.883508+0000","last_became_active":"2023-12-08T08:23:00.298341+0000","last_became_peered":"2023-12-08T08:23:00.298341+0000","last_unstale":"2023-12-08T08:23:15.883508+0000","last_undegraded":"2023-12-08T08:23:15.883508+0000","last_fullsized":"2023-12-08T08:23:15.883508+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:20:20.944416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900528+0000","last_change":"2023-12-08T08:23:16.900528+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900528+0000","last_undegraded":"2023-12-08T08:23:16.900528+0000","last_fullsized":"2023-12-08T08:23:16.900528+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.891893+0000","last_change":"2023-12-08T08:23:00.280235+0000","last_active":"2023-12-08T08:23:15.891893+0000","last_peered":"2023-12-08T08:23:15.891893+0000","last_clean":"2023-12-08T08:23:15.891893+0000","last_became_active":"2023-12-08T08:23:00.278807+0000","last_became_peered":"2023-12-08T08:23:00.278807+0000","last_unstale":"2023-12-08T08:23:15.891893+0000","last_undegraded":"2023-12-08T08:23:15.891893+0000","last_fullsized":"2023-12-08T08:23:15.891893+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:30:44.391621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.905250+0000","last_change":"2023-12-08T08:23:16.905250+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.905250+0000","last_undegraded":"2023-12-08T08:23:16.905250+0000","last_fullsized":"2023-12-08T08:23:16.905250+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895888+0000","last_change":"2023-12-08T08:23:00.278532+0000","last_active":"2023-12-08T08:23:15.895888+0000","last_peered":"2023-12-08T08:23:15.895888+0000","last_clean":"2023-12-08T08:23:15.895888+0000","last_became_active":"2023-12-08T08:23:00.278177+0000","last_became_peered":"2023-12-08T08:23:00.278177+0000","last_unstale":"2023-12-08T08:23:15.895888+0000","last_undegraded":"2023-12-08T08:23:15.895888+0000","last_fullsized":"2023-12-08T08:23:15.895888+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:56.216551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.905136+0000","last_change":"2023-12-08T08:23:16.905136+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.905136+0000","last_undegraded":"2023-12-08T08:23:16.905136+0000","last_fullsized":"2023-12-08T08:23:16.905136+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885639+0000","last_change":"2023-12-08T08:23:00.284090+0000","last_active":"2023-12-08T08:23:15.885639+0000","last_peered":"2023-12-08T08:23:15.885639+0000","last_clean":"2023-12-08T08:23:15.885639+0000","last_became_active":"2023-12-08T08:23:00.283777+0000","last_became_peered":"2023-12-08T08:23:00.283777+0000","last_unstale":"2023-12-08T08:23:15.885639+0000","last_undegraded":"2023-12-08T08:23:15.885639+0000","last_fullsized":"2023-12-08T08:23:15.885639+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896936+0000","last_change":"2023-12-08T08:23:16.896936+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896936+0000","last_undegraded":"2023-12-08T08:23:16.896936+0000","last_fullsized":"2023-12-08T08:23:16.896936+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888780+0000","last_change":"2023-12-08T08:23:00.277149+0000","last_active":"2023-12-08T08:23:15.888780+0000","last_peered":"2023-12-08T08:23:15.888780+0000","last_clean":"2023-12-08T08:23:15.888780+0000","last_became_active":"2023-12-08T08:23:00.276879+0000","last_became_peered":"2023-12-08T08:23:00.276879+0000","last_unstale":"2023-12-08T08:23:15.888780+0000","last_undegraded":"2023-12-08T08:23:15.888780+0000","last_fullsized":"2023-12-08T08:23:15.888780+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:16.068318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.901831+0000","last_change":"2023-12-08T08:23:16.901831+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.901831+0000","last_undegraded":"2023-12-08T08:23:16.901831+0000","last_fullsized":"2023-12-08T08:23:16.901831+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.890291+0000","last_change":"2023-12-08T08:23:00.294726+0000","last_active":"2023-12-08T08:23:15.890291+0000","last_peered":"2023-12-08T08:23:15.890291+0000","last_clean":"2023-12-08T08:23:15.890291+0000","last_became_active":"2023-12-08T08:23:00.294450+0000","last_became_peered":"2023-12-08T08:23:00.294450+0000","last_unstale":"2023-12-08T08:23:15.890291+0000","last_undegraded":"2023-12-08T08:23:15.890291+0000","last_fullsized":"2023-12-08T08:23:15.890291+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:28:25.934029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.895819+0000","last_change":"2023-12-08T08:23:16.895819+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.895819+0000","last_undegraded":"2023-12-08T08:23:16.895819+0000","last_fullsized":"2023-12-08T08:23:16.895819+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889918+0000","last_change":"2023-12-08T08:23:00.288804+0000","last_active":"2023-12-08T08:23:15.889918+0000","last_peered":"2023-12-08T08:23:15.889918+0000","last_clean":"2023-12-08T08:23:15.889918+0000","last_became_active":"2023-12-08T08:23:00.288315+0000","last_became_peered":"2023-12-08T08:23:00.288315+0000","last_unstale":"2023-12-08T08:23:15.889918+0000","last_undegraded":"2023-12-08T08:23:15.889918+0000","last_fullsized":"2023-12-08T08:23:15.889918+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:23:06.925359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.895362+0000","last_change":"2023-12-08T08:23:16.895362+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.895362+0000","last_undegraded":"2023-12-08T08:23:16.895362+0000","last_fullsized":"2023-12-08T08:23:16.895362+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885385+0000","last_change":"2023-12-08T08:23:00.294482+0000","last_active":"2023-12-08T08:23:15.885385+0000","last_peered":"2023-12-08T08:23:15.885385+0000","last_clean":"2023-12-08T08:23:15.885385+0000","last_became_active":"2023-12-08T08:23:00.294057+0000","last_became_peered":"2023-12-08T08:23:00.294057+0000","last_unstale":"2023-12-08T08:23:15.885385+0000","last_undegraded":"2023-12-08T08:23:15.885385+0000","last_fullsized":"2023-12-08T08:23:15.885385+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:42:20.038693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.898306+0000","last_change":"2023-12-08T08:23:16.898306+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.898306+0000","last_undegraded":"2023-12-08T08:23:16.898306+0000","last_fullsized":"2023-12-08T08:23:16.898306+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888263+0000","last_change":"2023-12-08T08:23:00.272949+0000","last_active":"2023-12-08T08:23:15.888263+0000","last_peered":"2023-12-08T08:23:15.888263+0000","last_clean":"2023-12-08T08:23:15.888263+0000","last_became_active":"2023-12-08T08:23:00.272655+0000","last_became_peered":"2023-12-08T08:23:00.272655+0000","last_unstale":"2023-12-08T08:23:15.888263+0000","last_undegraded":"2023-12-08T08:23:15.888263+0000","last_fullsized":"2023-12-08T08:23:15.888263+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:28.275394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.897379+0000","last_change":"2023-12-08T08:23:16.897379+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.897379+0000","last_undegraded":"2023-12-08T08:23:16.897379+0000","last_fullsized":"2023-12-08T08:23:16.897379+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.921665+0000","last_change":"2023-12-08T08:23:16.917024+0000","last_active":"2023-12-08T08:23:16.921665+0000","last_peered":"2023-12-08T08:23:16.921665+0000","last_clean":"2023-12-08T08:23:16.921665+0000","last_became_active":"2023-12-08T08:23:16.916776+0000","last_became_peered":"2023-12-08T08:23:16.916776+0000","last_unstale":"2023-12-08T08:23:16.921665+0000","last_undegraded":"2023-12-08T08:23:16.921665+0000","last_fullsized":"2023-12-08T08:23:16.921665+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:14:23.904816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885919+0000","last_change":"2023-12-08T08:23:00.273779+0000","last_active":"2023-12-08T08:23:15.885919+0000","last_peered":"2023-12-08T08:23:15.885919+0000","last_clean":"2023-12-08T08:23:15.885919+0000","last_became_active":"2023-12-08T08:23:00.273256+0000","last_became_peered":"2023-12-08T08:23:00.273256+0000","last_unstale":"2023-12-08T08:23:15.885919+0000","last_undegraded":"2023-12-08T08:23:15.885919+0000","last_fullsized":"2023-12-08T08:23:15.885919+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"67'4","reported_seq":18,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889446+0000","last_change":"2023-12-08T08:22:59.285668+0000","last_active":"2023-12-08T08:23:15.889446+0000","last_peered":"2023-12-08T08:23:15.889446+0000","last_clean":"2023-12-08T08:23:15.889446+0000","last_became_active":"2023-12-08T08:22:59.285340+0000","last_became_peered":"2023-12-08T08:22:59.285340+0000","last_unstale":"2023-12-08T08:23:15.889446+0000","last_undegraded":"2023-12-08T08:23:15.889446+0000","last_fullsized":"2023-12-08T08:23:15.889446+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:35:15.000491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.895648+0000","last_change":"2023-12-08T08:23:16.895648+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.895648+0000","last_undegraded":"2023-12-08T08:23:16.895648+0000","last_fullsized":"2023-12-08T08:23:16.895648+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.911983+0000","last_change":"2023-12-08T08:23:16.905712+0000","last_active":"2023-12-08T08:23:16.911983+0000","last_peered":"2023-12-08T08:23:16.911983+0000","last_clean":"2023-12-08T08:23:16.911983+0000","last_became_active":"2023-12-08T08:23:16.905399+0000","last_became_peered":"2023-12-08T08:23:16.905399+0000","last_unstale":"2023-12-08T08:23:16.911983+0000","last_undegraded":"2023-12-08T08:23:16.911983+0000","last_fullsized":"2023-12-08T08:23:16.911983+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:10:23.005533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889328+0000","last_change":"2023-12-08T08:23:00.300874+0000","last_active":"2023-12-08T08:23:15.889328+0000","last_peered":"2023-12-08T08:23:15.889328+0000","last_clean":"2023-12-08T08:23:15.889328+0000","last_became_active":"2023-12-08T08:23:00.300595+0000","last_became_peered":"2023-12-08T08:23:00.300595+0000","last_unstale":"2023-12-08T08:23:15.889328+0000","last_undegraded":"2023-12-08T08:23:15.889328+0000","last_fullsized":"2023-12-08T08:23:15.889328+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"67'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.886098+0000","last_change":"2023-12-08T08:22:59.274595+0000","last_active":"2023-12-08T08:23:15.886098+0000","last_peered":"2023-12-08T08:23:15.886098+0000","last_clean":"2023-12-08T08:23:15.886098+0000","last_became_active":"2023-12-08T08:22:59.274280+0000","last_became_peered":"2023-12-08T08:22:59.274280+0000","last_unstale":"2023-12-08T08:23:15.886098+0000","last_undegraded":"2023-12-08T08:23:15.886098+0000","last_fullsized":"2023-12-08T08:23:15.886098+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:27.267774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.899707+0000","last_change":"2023-12-08T08:23:16.899707+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.899707+0000","last_undegraded":"2023-12-08T08:23:16.899707+0000","last_fullsized":"2023-12-08T08:23:16.899707+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920597+0000","last_change":"2023-12-08T08:23:16.915200+0000","last_active":"2023-12-08T08:23:16.920597+0000","last_peered":"2023-12-08T08:23:16.920597+0000","last_clean":"2023-12-08T08:23:16.920597+0000","last_became_active":"2023-12-08T08:23:16.914766+0000","last_became_peered":"2023-12-08T08:23:16.914766+0000","last_unstale":"2023-12-08T08:23:16.920597+0000","last_undegraded":"2023-12-08T08:23:16.920597+0000","last_fullsized":"2023-12-08T08:23:16.920597+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:53:48.202811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888831+0000","last_change":"2023-12-08T08:23:00.280594+0000","last_active":"2023-12-08T08:23:15.888831+0000","last_peered":"2023-12-08T08:23:15.888831+0000","last_clean":"2023-12-08T08:23:15.888831+0000","last_became_active":"2023-12-08T08:23:00.279794+0000","last_became_peered":"2023-12-08T08:23:00.279794+0000","last_unstale":"2023-12-08T08:23:15.888831+0000","last_undegraded":"2023-12-08T08:23:15.888831+0000","last_fullsized":"2023-12-08T08:23:15.888831+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:33.905575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"67'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.896121+0000","last_change":"2023-12-08T08:22:59.282892+0000","last_active":"2023-12-08T08:23:15.896121+0000","last_peered":"2023-12-08T08:23:15.896121+0000","last_clean":"2023-12-08T08:23:15.896121+0000","last_became_active":"2023-12-08T08:22:59.282172+0000","last_became_peered":"2023-12-08T08:22:59.282172+0000","last_unstale":"2023-12-08T08:23:15.896121+0000","last_undegraded":"2023-12-08T08:23:15.896121+0000","last_fullsized":"2023-12-08T08:23:15.896121+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:32.890517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.902603+0000","last_change":"2023-12-08T08:23:16.902603+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.902603+0000","last_undegraded":"2023-12-08T08:23:16.902603+0000","last_fullsized":"2023-12-08T08:23:16.902603+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920546+0000","last_change":"2023-12-08T08:23:16.917813+0000","last_active":"2023-12-08T08:23:16.920546+0000","last_peered":"2023-12-08T08:23:16.920546+0000","last_clean":"2023-12-08T08:23:16.920546+0000","last_became_active":"2023-12-08T08:23:16.917358+0000","last_became_peered":"2023-12-08T08:23:16.917358+0000","last_unstale":"2023-12-08T08:23:16.920546+0000","last_undegraded":"2023-12-08T08:23:16.920546+0000","last_fullsized":"2023-12-08T08:23:16.920546+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:18:49.227732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895498+0000","last_change":"2023-12-08T08:23:00.304580+0000","last_active":"2023-12-08T08:23:15.895498+0000","last_peered":"2023-12-08T08:23:15.895498+0000","last_clean":"2023-12-08T08:23:15.895498+0000","last_became_active":"2023-12-08T08:23:00.304098+0000","last_became_peered":"2023-12-08T08:23:00.304098+0000","last_unstale":"2023-12-08T08:23:15.895498+0000","last_undegraded":"2023-12-08T08:23:15.895498+0000","last_fullsized":"2023-12-08T08:23:15.895498+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:29:03.020360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"67'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895935+0000","last_change":"2023-12-08T08:22:59.283290+0000","last_active":"2023-12-08T08:23:15.895935+0000","last_peered":"2023-12-08T08:23:15.895935+0000","last_clean":"2023-12-08T08:23:15.895935+0000","last_became_active":"2023-12-08T08:22:59.282103+0000","last_became_peered":"2023-12-08T08:22:59.282103+0000","last_unstale":"2023-12-08T08:23:15.895935+0000","last_undegraded":"2023-12-08T08:23:15.895935+0000","last_fullsized":"2023-12-08T08:23:15.895935+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:15.256488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.903785+0000","last_change":"2023-12-08T08:23:16.903785+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.903785+0000","last_undegraded":"2023-12-08T08:23:16.903785+0000","last_fullsized":"2023-12-08T08:23:16.903785+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.919943+0000","last_change":"2023-12-08T08:23:16.916123+0000","last_active":"2023-12-08T08:23:16.919943+0000","last_peered":"2023-12-08T08:23:16.919943+0000","last_clean":"2023-12-08T08:23:16.919943+0000","last_became_active":"2023-12-08T08:23:16.915147+0000","last_became_peered":"2023-12-08T08:23:16.915147+0000","last_unstale":"2023-12-08T08:23:16.919943+0000","last_undegraded":"2023-12-08T08:23:16.919943+0000","last_fullsized":"2023-12-08T08:23:16.919943+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:48:31.917542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.890002+0000","last_change":"2023-12-08T08:23:00.288605+0000","last_active":"2023-12-08T08:23:15.890002+0000","last_peered":"2023-12-08T08:23:15.890002+0000","last_clean":"2023-12-08T08:23:15.890002+0000","last_became_active":"2023-12-08T08:23:00.287910+0000","last_became_peered":"2023-12-08T08:23:00.287910+0000","last_unstale":"2023-12-08T08:23:15.890002+0000","last_undegraded":"2023-12-08T08:23:15.890002+0000","last_fullsized":"2023-12-08T08:23:15.890002+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:55.193260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"67'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885593+0000","last_change":"2023-12-08T08:22:59.267027+0000","last_active":"2023-12-08T08:23:15.885593+0000","last_peered":"2023-12-08T08:23:15.885593+0000","last_clean":"2023-12-08T08:23:15.885593+0000","last_became_active":"2023-12-08T08:22:59.265676+0000","last_became_peered":"2023-12-08T08:22:59.265676+0000","last_unstale":"2023-12-08T08:23:15.885593+0000","last_undegraded":"2023-12-08T08:23:15.885593+0000","last_fullsized":"2023-12-08T08:23:15.885593+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:19.279362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.894564+0000","last_change":"2023-12-08T08:23:16.894564+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.894564+0000","last_undegraded":"2023-12-08T08:23:16.894564+0000","last_fullsized":"2023-12-08T08:23:16.894564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.921704+0000","last_change":"2023-12-08T08:23:16.918070+0000","last_active":"2023-12-08T08:23:16.921704+0000","last_peered":"2023-12-08T08:23:16.921704+0000","last_clean":"2023-12-08T08:23:16.921704+0000","last_became_active":"2023-12-08T08:23:16.917808+0000","last_became_peered":"2023-12-08T08:23:16.917808+0000","last_unstale":"2023-12-08T08:23:16.921704+0000","last_undegraded":"2023-12-08T08:23:16.921704+0000","last_fullsized":"2023-12-08T08:23:16.921704+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:35:32.637419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885437+0000","last_change":"2023-12-08T08:23:00.300280+0000","last_active":"2023-12-08T08:23:15.885437+0000","last_peered":"2023-12-08T08:23:15.885437+0000","last_clean":"2023-12-08T08:23:15.885437+0000","last_became_active":"2023-12-08T08:23:00.299998+0000","last_became_peered":"2023-12-08T08:23:00.299998+0000","last_unstale":"2023-12-08T08:23:15.885437+0000","last_undegraded":"2023-12-08T08:23:15.885437+0000","last_fullsized":"2023-12-08T08:23:15.885437+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:15.472021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"67'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885466+0000","last_change":"2023-12-08T08:22:59.274800+0000","last_active":"2023-12-08T08:23:15.885466+0000","last_peered":"2023-12-08T08:23:15.885466+0000","last_clean":"2023-12-08T08:23:15.885466+0000","last_became_active":"2023-12-08T08:22:59.274501+0000","last_became_peered":"2023-12-08T08:22:59.274501+0000","last_unstale":"2023-12-08T08:23:15.885466+0000","last_undegraded":"2023-12-08T08:23:15.885466+0000","last_fullsized":"2023-12-08T08:23:15.885466+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:54.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.901187+0000","last_change":"2023-12-08T08:23:16.901187+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.901187+0000","last_undegraded":"2023-12-08T08:23:16.901187+0000","last_fullsized":"2023-12-08T08:23:16.901187+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.918634+0000","last_change":"2023-12-08T08:23:16.915536+0000","last_active":"2023-12-08T08:23:16.918634+0000","last_peered":"2023-12-08T08:23:16.918634+0000","last_clean":"2023-12-08T08:23:16.918634+0000","last_became_active":"2023-12-08T08:23:16.915216+0000","last_became_peered":"2023-12-08T08:23:16.915216+0000","last_unstale":"2023-12-08T08:23:16.918634+0000","last_undegraded":"2023-12-08T08:23:16.918634+0000","last_fullsized":"2023-12-08T08:23:16.918634+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:18:18.945931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894156+0000","last_change":"2023-12-08T08:23:00.298811+0000","last_active":"2023-12-08T08:23:15.894156+0000","last_peered":"2023-12-08T08:23:15.894156+0000","last_clean":"2023-12-08T08:23:15.894156+0000","last_became_active":"2023-12-08T08:23:00.298524+0000","last_became_peered":"2023-12-08T08:23:00.298524+0000","last_unstale":"2023-12-08T08:23:15.894156+0000","last_undegraded":"2023-12-08T08:23:15.894156+0000","last_fullsized":"2023-12-08T08:23:15.894156+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895609+0000","last_change":"2023-12-08T08:22:59.274339+0000","last_active":"2023-12-08T08:23:15.895609+0000","last_peered":"2023-12-08T08:23:15.895609+0000","last_clean":"2023-12-08T08:23:15.895609+0000","last_became_active":"2023-12-08T08:22:59.272932+0000","last_became_peered":"2023-12-08T08:22:59.272932+0000","last_unstale":"2023-12-08T08:23:15.895609+0000","last_undegraded":"2023-12-08T08:23:15.895609+0000","last_fullsized":"2023-12-08T08:23:15.895609+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:14.464401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.901110+0000","last_change":"2023-12-08T08:23:16.901110+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.901110+0000","last_undegraded":"2023-12-08T08:23:16.901110+0000","last_fullsized":"2023-12-08T08:23:16.901110+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.913617+0000","last_change":"2023-12-08T08:23:16.907865+0000","last_active":"2023-12-08T08:23:16.913617+0000","last_peered":"2023-12-08T08:23:16.913617+0000","last_clean":"2023-12-08T08:23:16.913617+0000","last_became_active":"2023-12-08T08:23:16.907610+0000","last_became_peered":"2023-12-08T08:23:16.907610+0000","last_unstale":"2023-12-08T08:23:16.913617+0000","last_undegraded":"2023-12-08T08:23:16.913617+0000","last_fullsized":"2023-12-08T08:23:16.913617+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:03:24.914390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888104+0000","last_change":"2023-12-08T08:23:00.292745+0000","last_active":"2023-12-08T08:23:15.888104+0000","last_peered":"2023-12-08T08:23:15.888104+0000","last_clean":"2023-12-08T08:23:15.888104+0000","last_became_active":"2023-12-08T08:23:00.292132+0000","last_became_peered":"2023-12-08T08:23:00.292132+0000","last_unstale":"2023-12-08T08:23:15.888104+0000","last_undegraded":"2023-12-08T08:23:15.888104+0000","last_fullsized":"2023-12-08T08:23:15.888104+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:13.139346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.890037+0000","last_change":"2023-12-08T08:22:59.268769+0000","last_active":"2023-12-08T08:23:15.890037+0000","last_peered":"2023-12-08T08:23:15.890037+0000","last_clean":"2023-12-08T08:23:15.890037+0000","last_became_active":"2023-12-08T08:22:59.268494+0000","last_became_peered":"2023-12-08T08:22:59.268494+0000","last_unstale":"2023-12-08T08:23:15.890037+0000","last_undegraded":"2023-12-08T08:23:15.890037+0000","last_fullsized":"2023-12-08T08:23:15.890037+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:56:23.131251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.905977+0000","last_change":"2023-12-08T08:23:16.905977+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.905977+0000","last_undegraded":"2023-12-08T08:23:16.905977+0000","last_fullsized":"2023-12-08T08:23:16.905977+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920561+0000","last_change":"2023-12-08T08:23:16.918296+0000","last_active":"2023-12-08T08:23:16.920561+0000","last_peered":"2023-12-08T08:23:16.920561+0000","last_clean":"2023-12-08T08:23:16.920561+0000","last_became_active":"2023-12-08T08:23:16.917917+0000","last_became_peered":"2023-12-08T08:23:16.917917+0000","last_unstale":"2023-12-08T08:23:16.920561+0000","last_undegraded":"2023-12-08T08:23:16.920561+0000","last_fullsized":"2023-12-08T08:23:16.920561+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:16:38.108739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.890630+0000","last_change":"2023-12-08T08:23:00.275783+0000","last_active":"2023-12-08T08:23:15.890630+0000","last_peered":"2023-12-08T08:23:15.890630+0000","last_clean":"2023-12-08T08:23:15.890630+0000","last_became_active":"2023-12-08T08:23:00.275444+0000","last_became_peered":"2023-12-08T08:23:00.275444+0000","last_unstale":"2023-12-08T08:23:15.890630+0000","last_undegraded":"2023-12-08T08:23:15.890630+0000","last_fullsized":"2023-12-08T08:23:15.890630+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:56:00.436152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889577+0000","last_change":"2023-12-08T08:22:59.280443+0000","last_active":"2023-12-08T08:23:15.889577+0000","last_peered":"2023-12-08T08:23:15.889577+0000","last_clean":"2023-12-08T08:23:15.889577+0000","last_became_active":"2023-12-08T08:22:59.280138+0000","last_became_peered":"2023-12-08T08:22:59.280138+0000","last_unstale":"2023-12-08T08:23:15.889577+0000","last_undegraded":"2023-12-08T08:23:15.889577+0000","last_fullsized":"2023-12-08T08:23:15.889577+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:13:21.524504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.906770+0000","last_change":"2023-12-08T08:23:16.906770+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.906770+0000","last_undegraded":"2023-12-08T08:23:16.906770+0000","last_fullsized":"2023-12-08T08:23:16.906770+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.914455+0000","last_change":"2023-12-08T08:23:16.913111+0000","last_active":"2023-12-08T08:23:16.914455+0000","last_peered":"2023-12-08T08:23:16.914455+0000","last_clean":"2023-12-08T08:23:16.914455+0000","last_became_active":"2023-12-08T08:23:16.912617+0000","last_became_peered":"2023-12-08T08:23:16.912617+0000","last_unstale":"2023-12-08T08:23:16.914455+0000","last_undegraded":"2023-12-08T08:23:16.914455+0000","last_fullsized":"2023-12-08T08:23:16.914455+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:56:17.065460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895873+0000","last_change":"2023-12-08T08:23:00.304825+0000","last_active":"2023-12-08T08:23:15.895873+0000","last_peered":"2023-12-08T08:23:15.895873+0000","last_clean":"2023-12-08T08:23:15.895873+0000","last_became_active":"2023-12-08T08:23:00.304549+0000","last_became_peered":"2023-12-08T08:23:00.304549+0000","last_unstale":"2023-12-08T08:23:15.895873+0000","last_undegraded":"2023-12-08T08:23:15.895873+0000","last_fullsized":"2023-12-08T08:23:15.895873+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889328+0000","last_change":"2023-12-08T08:22:59.283795+0000","last_active":"2023-12-08T08:23:15.889328+0000","last_peered":"2023-12-08T08:23:15.889328+0000","last_clean":"2023-12-08T08:23:15.889328+0000","last_became_active":"2023-12-08T08:22:59.283486+0000","last_became_peered":"2023-12-08T08:22:59.283486+0000","last_unstale":"2023-12-08T08:23:15.889328+0000","last_undegraded":"2023-12-08T08:23:15.889328+0000","last_fullsized":"2023-12-08T08:23:15.889328+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:30:43.384001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896383+0000","last_change":"2023-12-08T08:23:16.896383+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896383+0000","last_undegraded":"2023-12-08T08:23:16.896383+0000","last_fullsized":"2023-12-08T08:23:16.896383+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.917021+0000","last_change":"2023-12-08T08:23:16.913609+0000","last_active":"2023-12-08T08:23:16.917021+0000","last_peered":"2023-12-08T08:23:16.917021+0000","last_clean":"2023-12-08T08:23:16.917021+0000","last_became_active":"2023-12-08T08:23:16.913308+0000","last_became_peered":"2023-12-08T08:23:16.913308+0000","last_unstale":"2023-12-08T08:23:16.917021+0000","last_undegraded":"2023-12-08T08:23:16.917021+0000","last_fullsized":"2023-12-08T08:23:16.917021+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:13:39.161432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895820+0000","last_change":"2023-12-08T08:23:00.293145+0000","last_active":"2023-12-08T08:23:15.895820+0000","last_peered":"2023-12-08T08:23:15.895820+0000","last_clean":"2023-12-08T08:23:15.895820+0000","last_became_active":"2023-12-08T08:23:00.292927+0000","last_became_peered":"2023-12-08T08:23:00.292927+0000","last_unstale":"2023-12-08T08:23:15.895820+0000","last_undegraded":"2023-12-08T08:23:15.895820+0000","last_fullsized":"2023-12-08T08:23:15.895820+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:56.216551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"67'3","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889145+0000","last_change":"2023-12-08T08:22:59.281141+0000","last_active":"2023-12-08T08:23:15.889145+0000","last_peered":"2023-12-08T08:23:15.889145+0000","last_clean":"2023-12-08T08:23:15.889145+0000","last_became_active":"2023-12-08T08:22:59.280748+0000","last_became_peered":"2023-12-08T08:22:59.280748+0000","last_unstale":"2023-12-08T08:23:15.889145+0000","last_undegraded":"2023-12-08T08:23:15.889145+0000","last_fullsized":"2023-12-08T08:23:15.889145+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:07:33.922762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.895287+0000","last_change":"2023-12-08T08:23:16.895287+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.895287+0000","last_undegraded":"2023-12-08T08:23:16.895287+0000","last_fullsized":"2023-12-08T08:23:16.895287+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.923465+0000","last_change":"2023-12-08T08:23:16.921554+0000","last_active":"2023-12-08T08:23:16.923465+0000","last_peered":"2023-12-08T08:23:16.923465+0000","last_clean":"2023-12-08T08:23:16.923465+0000","last_became_active":"2023-12-08T08:23:16.920531+0000","last_became_peered":"2023-12-08T08:23:16.920531+0000","last_unstale":"2023-12-08T08:23:16.923465+0000","last_undegraded":"2023-12-08T08:23:16.923465+0000","last_fullsized":"2023-12-08T08:23:16.923465+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:32:01.183284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885675+0000","last_change":"2023-12-08T08:23:00.299179+0000","last_active":"2023-12-08T08:23:15.885675+0000","last_peered":"2023-12-08T08:23:15.885675+0000","last_clean":"2023-12-08T08:23:15.885675+0000","last_became_active":"2023-12-08T08:23:00.298936+0000","last_became_peered":"2023-12-08T08:23:00.298936+0000","last_unstale":"2023-12-08T08:23:15.885675+0000","last_undegraded":"2023-12-08T08:23:15.885675+0000","last_fullsized":"2023-12-08T08:23:15.885675+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"68'8","reported_seq":22,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895665+0000","last_change":"2023-12-08T08:22:59.278612+0000","last_active":"2023-12-08T08:23:15.895665+0000","last_peered":"2023-12-08T08:23:15.895665+0000","last_clean":"2023-12-08T08:23:15.895665+0000","last_became_active":"2023-12-08T08:22:59.278325+0000","last_became_peered":"2023-12-08T08:22:59.278325+0000","last_unstale":"2023-12-08T08:23:15.895665+0000","last_undegraded":"2023-12-08T08:23:15.895665+0000","last_fullsized":"2023-12-08T08:23:15.895665+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:55:35.382801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.894542+0000","last_change":"2023-12-08T08:23:16.894542+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.894542+0000","last_undegraded":"2023-12-08T08:23:16.894542+0000","last_fullsized":"2023-12-08T08:23:16.894542+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920008+0000","last_change":"2023-12-08T08:23:16.915913+0000","last_active":"2023-12-08T08:23:16.920008+0000","last_peered":"2023-12-08T08:23:16.920008+0000","last_clean":"2023-12-08T08:23:16.920008+0000","last_became_active":"2023-12-08T08:23:16.915513+0000","last_became_peered":"2023-12-08T08:23:16.915513+0000","last_unstale":"2023-12-08T08:23:16.920008+0000","last_undegraded":"2023-12-08T08:23:16.920008+0000","last_fullsized":"2023-12-08T08:23:16.920008+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:29.768654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895664+0000","last_change":"2023-12-08T08:23:00.292867+0000","last_active":"2023-12-08T08:23:15.895664+0000","last_peered":"2023-12-08T08:23:15.895664+0000","last_clean":"2023-12-08T08:23:15.895664+0000","last_became_active":"2023-12-08T08:23:00.292648+0000","last_became_peered":"2023-12-08T08:23:00.292648+0000","last_unstale":"2023-12-08T08:23:15.895664+0000","last_undegraded":"2023-12-08T08:23:15.895664+0000","last_fullsized":"2023-12-08T08:23:15.895664+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:29:03.020360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"67'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.891587+0000","last_change":"2023-12-08T08:22:59.262821+0000","last_active":"2023-12-08T08:23:15.891587+0000","last_peered":"2023-12-08T08:23:15.891587+0000","last_clean":"2023-12-08T08:23:15.891587+0000","last_became_active":"2023-12-08T08:22:59.262569+0000","last_became_peered":"2023-12-08T08:22:59.262569+0000","last_unstale":"2023-12-08T08:23:15.891587+0000","last_undegraded":"2023-12-08T08:23:15.891587+0000","last_fullsized":"2023-12-08T08:23:15.891587+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:52:55.751217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.898771+0000","last_change":"2023-12-08T08:23:16.898771+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.898771+0000","last_undegraded":"2023-12-08T08:23:16.898771+0000","last_fullsized":"2023-12-08T08:23:16.898771+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.909363+0000","last_change":"2023-12-08T08:23:16.907121+0000","last_active":"2023-12-08T08:23:16.909363+0000","last_peered":"2023-12-08T08:23:16.909363+0000","last_clean":"2023-12-08T08:23:16.909363+0000","last_became_active":"2023-12-08T08:23:16.906517+0000","last_became_peered":"2023-12-08T08:23:16.906517+0000","last_unstale":"2023-12-08T08:23:16.909363+0000","last_undegraded":"2023-12-08T08:23:16.909363+0000","last_fullsized":"2023-12-08T08:23:16.909363+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:44:54.050763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894551+0000","last_change":"2023-12-08T08:23:00.298706+0000","last_active":"2023-12-08T08:23:15.894551+0000","last_peered":"2023-12-08T08:23:15.894551+0000","last_clean":"2023-12-08T08:23:15.894551+0000","last_became_active":"2023-12-08T08:23:00.298452+0000","last_became_peered":"2023-12-08T08:23:00.298452+0000","last_unstale":"2023-12-08T08:23:15.894551+0000","last_undegraded":"2023-12-08T08:23:15.894551+0000","last_fullsized":"2023-12-08T08:23:15.894551+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:39.385907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888371+0000","last_change":"2023-12-08T08:22:59.270322+0000","last_active":"2023-12-08T08:23:15.888371+0000","last_peered":"2023-12-08T08:23:15.888371+0000","last_clean":"2023-12-08T08:23:15.888371+0000","last_became_active":"2023-12-08T08:22:59.270059+0000","last_became_peered":"2023-12-08T08:22:59.270059+0000","last_unstale":"2023-12-08T08:23:15.888371+0000","last_undegraded":"2023-12-08T08:23:15.888371+0000","last_fullsized":"2023-12-08T08:23:15.888371+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:21:58.531919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.902866+0000","last_change":"2023-12-08T08:23:16.902866+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.902866+0000","last_undegraded":"2023-12-08T08:23:16.902866+0000","last_fullsized":"2023-12-08T08:23:16.902866+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920648+0000","last_change":"2023-12-08T08:23:16.914697+0000","last_active":"2023-12-08T08:23:16.920648+0000","last_peered":"2023-12-08T08:23:16.920648+0000","last_clean":"2023-12-08T08:23:16.920648+0000","last_became_active":"2023-12-08T08:23:16.914346+0000","last_became_peered":"2023-12-08T08:23:16.914346+0000","last_unstale":"2023-12-08T08:23:16.920648+0000","last_undegraded":"2023-12-08T08:23:16.920648+0000","last_fullsized":"2023-12-08T08:23:16.920648+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:08:11.306339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889955+0000","last_change":"2023-12-08T08:23:00.304324+0000","last_active":"2023-12-08T08:23:15.889955+0000","last_peered":"2023-12-08T08:23:15.889955+0000","last_clean":"2023-12-08T08:23:15.889955+0000","last_became_active":"2023-12-08T08:23:00.304038+0000","last_became_peered":"2023-12-08T08:23:00.304038+0000","last_unstale":"2023-12-08T08:23:15.889955+0000","last_undegraded":"2023-12-08T08:23:15.889955+0000","last_fullsized":"2023-12-08T08:23:15.889955+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:33:27.464394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894314+0000","last_change":"2023-12-08T08:22:59.270216+0000","last_active":"2023-12-08T08:23:15.894314+0000","last_peered":"2023-12-08T08:23:15.894314+0000","last_clean":"2023-12-08T08:23:15.894314+0000","last_became_active":"2023-12-08T08:22:59.269292+0000","last_became_peered":"2023-12-08T08:22:59.269292+0000","last_unstale":"2023-12-08T08:23:15.894314+0000","last_undegraded":"2023-12-08T08:23:15.894314+0000","last_fullsized":"2023-12-08T08:23:15.894314+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:18:01.309002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.899876+0000","last_change":"2023-12-08T08:23:16.899876+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.899876+0000","last_undegraded":"2023-12-08T08:23:16.899876+0000","last_fullsized":"2023-12-08T08:23:16.899876+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.916944+0000","last_change":"2023-12-08T08:23:16.910717+0000","last_active":"2023-12-08T08:23:16.916944+0000","last_peered":"2023-12-08T08:23:16.916944+0000","last_clean":"2023-12-08T08:23:16.916944+0000","last_became_active":"2023-12-08T08:23:16.910457+0000","last_became_peered":"2023-12-08T08:23:16.910457+0000","last_unstale":"2023-12-08T08:23:16.916944+0000","last_undegraded":"2023-12-08T08:23:16.916944+0000","last_fullsized":"2023-12-08T08:23:16.916944+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:53:13.388145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889558+0000","last_change":"2023-12-08T08:23:00.276305+0000","last_active":"2023-12-08T08:23:15.889558+0000","last_peered":"2023-12-08T08:23:15.889558+0000","last_clean":"2023-12-08T08:23:15.889558+0000","last_became_active":"2023-12-08T08:23:00.275989+0000","last_became_peered":"2023-12-08T08:23:00.275989+0000","last_unstale":"2023-12-08T08:23:15.889558+0000","last_undegraded":"2023-12-08T08:23:15.889558+0000","last_fullsized":"2023-12-08T08:23:15.889558+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:24:33.735501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"67'8","reported_seq":22,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894492+0000","last_change":"2023-12-08T08:22:59.271542+0000","last_active":"2023-12-08T08:23:15.894492+0000","last_peered":"2023-12-08T08:23:15.894492+0000","last_clean":"2023-12-08T08:23:15.894492+0000","last_became_active":"2023-12-08T08:22:59.271240+0000","last_became_peered":"2023-12-08T08:22:59.271240+0000","last_unstale":"2023-12-08T08:23:15.894492+0000","last_undegraded":"2023-12-08T08:23:15.894492+0000","last_fullsized":"2023-12-08T08:23:15.894492+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:32.897955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.901826+0000","last_change":"2023-12-08T08:23:16.901826+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.901826+0000","last_undegraded":"2023-12-08T08:23:16.901826+0000","last_fullsized":"2023-12-08T08:23:16.901826+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.919862+0000","last_change":"2023-12-08T08:23:16.915441+0000","last_active":"2023-12-08T08:23:16.919862+0000","last_peered":"2023-12-08T08:23:16.919862+0000","last_clean":"2023-12-08T08:23:16.919862+0000","last_became_active":"2023-12-08T08:23:16.915074+0000","last_became_peered":"2023-12-08T08:23:16.915074+0000","last_unstale":"2023-12-08T08:23:16.919862+0000","last_undegraded":"2023-12-08T08:23:16.919862+0000","last_fullsized":"2023-12-08T08:23:16.919862+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:33:12.118405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895946+0000","last_change":"2023-12-08T08:23:00.280374+0000","last_active":"2023-12-08T08:23:15.895946+0000","last_peered":"2023-12-08T08:23:15.895946+0000","last_clean":"2023-12-08T08:23:15.895946+0000","last_became_active":"2023-12-08T08:23:00.280096+0000","last_became_peered":"2023-12-08T08:23:00.280096+0000","last_unstale":"2023-12-08T08:23:15.895946+0000","last_undegraded":"2023-12-08T08:23:15.895946+0000","last_fullsized":"2023-12-08T08:23:15.895946+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:21:59.539539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"67'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889718+0000","last_change":"2023-12-08T08:22:59.283727+0000","last_active":"2023-12-08T08:23:15.889718+0000","last_peered":"2023-12-08T08:23:15.889718+0000","last_clean":"2023-12-08T08:23:15.889718+0000","last_became_active":"2023-12-08T08:22:59.283254+0000","last_became_peered":"2023-12-08T08:22:59.283254+0000","last_unstale":"2023-12-08T08:23:15.889718+0000","last_undegraded":"2023-12-08T08:23:15.889718+0000","last_fullsized":"2023-12-08T08:23:15.889718+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:18:01.309002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.902834+0000","last_change":"2023-12-08T08:23:16.902834+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.902834+0000","last_undegraded":"2023-12-08T08:23:16.902834+0000","last_fullsized":"2023-12-08T08:23:16.902834+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.909444+0000","last_change":"2023-12-08T08:23:16.901347+0000","last_active":"2023-12-08T08:23:16.909444+0000","last_peered":"2023-12-08T08:23:16.909444+0000","last_clean":"2023-12-08T08:23:16.909444+0000","last_became_active":"2023-12-08T08:23:16.901041+0000","last_became_peered":"2023-12-08T08:23:16.901041+0000","last_unstale":"2023-12-08T08:23:16.909444+0000","last_undegraded":"2023-12-08T08:23:16.909444+0000","last_fullsized":"2023-12-08T08:23:16.909444+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:16:38.108739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889393+0000","last_change":"2023-12-08T08:23:00.282901+0000","last_active":"2023-12-08T08:23:15.889393+0000","last_peered":"2023-12-08T08:23:15.889393+0000","last_clean":"2023-12-08T08:23:15.889393+0000","last_became_active":"2023-12-08T08:23:00.282646+0000","last_became_peered":"2023-12-08T08:23:00.282646+0000","last_unstale":"2023-12-08T08:23:15.889393+0000","last_undegraded":"2023-12-08T08:23:15.889393+0000","last_fullsized":"2023-12-08T08:23:15.889393+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"67'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.896118+0000","last_change":"2023-12-08T08:22:59.265669+0000","last_active":"2023-12-08T08:23:15.896118+0000","last_peered":"2023-12-08T08:23:15.896118+0000","last_clean":"2023-12-08T08:23:15.896118+0000","last_became_active":"2023-12-08T08:22:59.265364+0000","last_became_peered":"2023-12-08T08:22:59.265364+0000","last_unstale":"2023-12-08T08:23:15.896118+0000","last_undegraded":"2023-12-08T08:23:15.896118+0000","last_fullsized":"2023-12-08T08:23:15.896118+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:27:38.296266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.906380+0000","last_change":"2023-12-08T08:23:16.906380+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.906380+0000","last_undegraded":"2023-12-08T08:23:16.906380+0000","last_fullsized":"2023-12-08T08:23:16.906380+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920038+0000","last_change":"2023-12-08T08:23:16.916758+0000","last_active":"2023-12-08T08:23:16.920038+0000","last_peered":"2023-12-08T08:23:16.920038+0000","last_clean":"2023-12-08T08:23:16.920038+0000","last_became_active":"2023-12-08T08:23:16.916445+0000","last_became_peered":"2023-12-08T08:23:16.916445+0000","last_unstale":"2023-12-08T08:23:16.920038+0000","last_undegraded":"2023-12-08T08:23:16.920038+0000","last_fullsized":"2023-12-08T08:23:16.920038+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:18:49.227732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885732+0000","last_change":"2023-12-08T08:23:00.270198+0000","last_active":"2023-12-08T08:23:15.885732+0000","last_peered":"2023-12-08T08:23:15.885732+0000","last_clean":"2023-12-08T08:23:15.885732+0000","last_became_active":"2023-12-08T08:23:00.269930+0000","last_became_peered":"2023-12-08T08:23:00.269930+0000","last_unstale":"2023-12-08T08:23:15.885732+0000","last_undegraded":"2023-12-08T08:23:15.885732+0000","last_fullsized":"2023-12-08T08:23:15.885732+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895963+0000","last_change":"2023-12-08T08:22:59.273655+0000","last_active":"2023-12-08T08:23:15.895963+0000","last_peered":"2023-12-08T08:23:15.895963+0000","last_clean":"2023-12-08T08:23:15.895963+0000","last_became_active":"2023-12-08T08:22:59.273396+0000","last_became_peered":"2023-12-08T08:22:59.273396+0000","last_unstale":"2023-12-08T08:23:15.895963+0000","last_undegraded":"2023-12-08T08:23:15.895963+0000","last_fullsized":"2023-12-08T08:23:15.895963+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.886510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.899083+0000","last_change":"2023-12-08T08:23:16.899083+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.899083+0000","last_undegraded":"2023-12-08T08:23:16.899083+0000","last_fullsized":"2023-12-08T08:23:16.899083+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.923651+0000","last_change":"2023-12-08T08:23:16.922219+0000","last_active":"2023-12-08T08:23:16.923651+0000","last_peered":"2023-12-08T08:23:16.923651+0000","last_clean":"2023-12-08T08:23:16.923651+0000","last_became_active":"2023-12-08T08:23:16.921977+0000","last_became_peered":"2023-12-08T08:23:16.921977+0000","last_unstale":"2023-12-08T08:23:16.923651+0000","last_undegraded":"2023-12-08T08:23:16.923651+0000","last_fullsized":"2023-12-08T08:23:16.923651+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:22:16.168848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883583+0000","last_change":"2023-12-08T08:23:00.285854+0000","last_active":"2023-12-08T08:23:15.883583+0000","last_peered":"2023-12-08T08:23:15.883583+0000","last_clean":"2023-12-08T08:23:15.883583+0000","last_became_active":"2023-12-08T08:23:00.285553+0000","last_became_peered":"2023-12-08T08:23:00.285553+0000","last_unstale":"2023-12-08T08:23:15.883583+0000","last_undegraded":"2023-12-08T08:23:15.883583+0000","last_fullsized":"2023-12-08T08:23:15.883583+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:15:44.184576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"67'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888606+0000","last_change":"2023-12-08T08:22:59.282745+0000","last_active":"2023-12-08T08:23:15.888606+0000","last_peered":"2023-12-08T08:23:15.888606+0000","last_clean":"2023-12-08T08:23:15.888606+0000","last_became_active":"2023-12-08T08:22:59.282443+0000","last_became_peered":"2023-12-08T08:22:59.282443+0000","last_unstale":"2023-12-08T08:23:15.888606+0000","last_undegraded":"2023-12-08T08:23:15.888606+0000","last_fullsized":"2023-12-08T08:23:15.888606+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:21.899236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.908298+0000","last_change":"2023-12-08T08:23:16.908298+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.908298+0000","last_undegraded":"2023-12-08T08:23:16.908298+0000","last_fullsized":"2023-12-08T08:23:16.908298+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.911706+0000","last_change":"2023-12-08T08:23:16.906025+0000","last_active":"2023-12-08T08:23:16.911706+0000","last_peered":"2023-12-08T08:23:16.911706+0000","last_clean":"2023-12-08T08:23:16.911706+0000","last_became_active":"2023-12-08T08:23:16.905756+0000","last_became_peered":"2023-12-08T08:23:16.905756+0000","last_unstale":"2023-12-08T08:23:16.911706+0000","last_undegraded":"2023-12-08T08:23:16.911706+0000","last_fullsized":"2023-12-08T08:23:16.911706+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:56:17.065460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895380+0000","last_change":"2023-12-08T08:23:00.286165+0000","last_active":"2023-12-08T08:23:15.895380+0000","last_peered":"2023-12-08T08:23:15.895380+0000","last_clean":"2023-12-08T08:23:15.895380+0000","last_became_active":"2023-12-08T08:23:00.285209+0000","last_became_peered":"2023-12-08T08:23:00.285209+0000","last_unstale":"2023-12-08T08:23:15.895380+0000","last_undegraded":"2023-12-08T08:23:15.895380+0000","last_fullsized":"2023-12-08T08:23:15.895380+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:16.068318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883606+0000","last_change":"2023-12-08T08:22:59.272934+0000","last_active":"2023-12-08T08:23:15.883606+0000","last_peered":"2023-12-08T08:23:15.883606+0000","last_clean":"2023-12-08T08:23:15.883606+0000","last_became_active":"2023-12-08T08:22:59.272094+0000","last_became_peered":"2023-12-08T08:22:59.272094+0000","last_unstale":"2023-12-08T08:23:15.883606+0000","last_undegraded":"2023-12-08T08:23:15.883606+0000","last_fullsized":"2023-12-08T08:23:15.883606+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:33:18.775139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.901915+0000","last_change":"2023-12-08T08:23:16.901915+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.901915+0000","last_undegraded":"2023-12-08T08:23:16.901915+0000","last_fullsized":"2023-12-08T08:23:16.901915+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920431+0000","last_change":"2023-12-08T08:23:16.915895+0000","last_active":"2023-12-08T08:23:16.920431+0000","last_peered":"2023-12-08T08:23:16.920431+0000","last_clean":"2023-12-08T08:23:16.920431+0000","last_became_active":"2023-12-08T08:23:16.915631+0000","last_became_peered":"2023-12-08T08:23:16.915631+0000","last_unstale":"2023-12-08T08:23:16.920431+0000","last_undegraded":"2023-12-08T08:23:16.920431+0000","last_fullsized":"2023-12-08T08:23:16.920431+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:28:54.873126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883361+0000","last_change":"2023-12-08T08:23:00.287292+0000","last_active":"2023-12-08T08:23:15.883361+0000","last_peered":"2023-12-08T08:23:15.883361+0000","last_clean":"2023-12-08T08:23:15.883361+0000","last_became_active":"2023-12-08T08:23:00.284565+0000","last_became_peered":"2023-12-08T08:23:00.284565+0000","last_unstale":"2023-12-08T08:23:15.883361+0000","last_undegraded":"2023-12-08T08:23:15.883361+0000","last_fullsized":"2023-12-08T08:23:15.883361+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:17:25.641139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883435+0000","last_change":"2023-12-08T08:22:59.279857+0000","last_active":"2023-12-08T08:23:15.883435+0000","last_peered":"2023-12-08T08:23:15.883435+0000","last_clean":"2023-12-08T08:23:15.883435+0000","last_became_active":"2023-12-08T08:22:59.279508+0000","last_became_peered":"2023-12-08T08:22:59.279508+0000","last_unstale":"2023-12-08T08:23:15.883435+0000","last_undegraded":"2023-12-08T08:23:15.883435+0000","last_fullsized":"2023-12-08T08:23:15.883435+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:23.192834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900064+0000","last_change":"2023-12-08T08:23:16.900064+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900064+0000","last_undegraded":"2023-12-08T08:23:16.900064+0000","last_fullsized":"2023-12-08T08:23:16.900064+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.914553+0000","last_change":"2023-12-08T08:23:16.911088+0000","last_active":"2023-12-08T08:23:16.914553+0000","last_peered":"2023-12-08T08:23:16.914553+0000","last_clean":"2023-12-08T08:23:16.914553+0000","last_became_active":"2023-12-08T08:23:16.910534+0000","last_became_peered":"2023-12-08T08:23:16.910534+0000","last_unstale":"2023-12-08T08:23:16.914553+0000","last_undegraded":"2023-12-08T08:23:16.914553+0000","last_fullsized":"2023-12-08T08:23:16.914553+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:13:12.845859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894166+0000","last_change":"2023-12-08T08:23:00.291227+0000","last_active":"2023-12-08T08:23:15.894166+0000","last_peered":"2023-12-08T08:23:15.894166+0000","last_clean":"2023-12-08T08:23:15.894166+0000","last_became_active":"2023-12-08T08:23:00.290984+0000","last_became_peered":"2023-12-08T08:23:00.290984+0000","last_unstale":"2023-12-08T08:23:15.894166+0000","last_undegraded":"2023-12-08T08:23:15.894166+0000","last_fullsized":"2023-12-08T08:23:15.894166+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:33.905575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.887728+0000","last_change":"2023-12-08T08:22:59.282842+0000","last_active":"2023-12-08T08:23:15.887728+0000","last_peered":"2023-12-08T08:23:15.887728+0000","last_clean":"2023-12-08T08:23:15.887728+0000","last_became_active":"2023-12-08T08:22:59.282605+0000","last_became_peered":"2023-12-08T08:22:59.282605+0000","last_unstale":"2023-12-08T08:23:15.887728+0000","last_undegraded":"2023-12-08T08:23:15.887728+0000","last_fullsized":"2023-12-08T08:23:15.887728+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:55.208931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896938+0000","last_change":"2023-12-08T08:23:16.896938+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896938+0000","last_undegraded":"2023-12-08T08:23:16.896938+0000","last_fullsized":"2023-12-08T08:23:16.896938+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.908278+0000","last_change":"2023-12-08T08:23:16.900995+0000","last_active":"2023-12-08T08:23:16.908278+0000","last_peered":"2023-12-08T08:23:16.908278+0000","last_clean":"2023-12-08T08:23:16.908278+0000","last_became_active":"2023-12-08T08:23:16.900717+0000","last_became_peered":"2023-12-08T08:23:16.900717+0000","last_unstale":"2023-12-08T08:23:16.908278+0000","last_undegraded":"2023-12-08T08:23:16.908278+0000","last_fullsized":"2023-12-08T08:23:16.908278+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:27:04.256182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885973+0000","last_change":"2023-12-08T08:23:00.270620+0000","last_active":"2023-12-08T08:23:15.885973+0000","last_peered":"2023-12-08T08:23:15.885973+0000","last_clean":"2023-12-08T08:23:15.885973+0000","last_became_active":"2023-12-08T08:23:00.270369+0000","last_became_peered":"2023-12-08T08:23:00.270369+0000","last_unstale":"2023-12-08T08:23:15.885973+0000","last_undegraded":"2023-12-08T08:23:15.885973+0000","last_fullsized":"2023-12-08T08:23:15.885973+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:33.898137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"67'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.891985+0000","last_change":"2023-12-08T08:22:59.269712+0000","last_active":"2023-12-08T08:23:15.891985+0000","last_peered":"2023-12-08T08:23:15.891985+0000","last_clean":"2023-12-08T08:23:15.891985+0000","last_became_active":"2023-12-08T08:22:59.269426+0000","last_became_peered":"2023-12-08T08:22:59.269426+0000","last_unstale":"2023-12-08T08:23:15.891985+0000","last_undegraded":"2023-12-08T08:23:15.891985+0000","last_fullsized":"2023-12-08T08:23:15.891985+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:49:28.705874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.906727+0000","last_change":"2023-12-08T08:23:16.906727+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.906727+0000","last_undegraded":"2023-12-08T08:23:16.906727+0000","last_fullsized":"2023-12-08T08:23:16.906727+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920958+0000","last_change":"2023-12-08T08:23:16.918945+0000","last_active":"2023-12-08T08:23:16.920958+0000","last_peered":"2023-12-08T08:23:16.920958+0000","last_clean":"2023-12-08T08:23:16.920958+0000","last_became_active":"2023-12-08T08:23:16.918629+0000","last_became_peered":"2023-12-08T08:23:16.918629+0000","last_unstale":"2023-12-08T08:23:16.920958+0000","last_undegraded":"2023-12-08T08:23:16.920958+0000","last_fullsized":"2023-12-08T08:23:16.920958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:39.536165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.896176+0000","last_change":"2023-12-08T08:23:00.280543+0000","last_active":"2023-12-08T08:23:15.896176+0000","last_peered":"2023-12-08T08:23:15.896176+0000","last_clean":"2023-12-08T08:23:15.896176+0000","last_became_active":"2023-12-08T08:23:00.280152+0000","last_became_peered":"2023-12-08T08:23:00.280152+0000","last_unstale":"2023-12-08T08:23:15.896176+0000","last_undegraded":"2023-12-08T08:23:15.896176+0000","last_fullsized":"2023-12-08T08:23:15.896176+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:37:47.067543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"68'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.891331+0000","last_change":"2023-12-08T08:22:59.263185+0000","last_active":"2023-12-08T08:23:15.891331+0000","last_peered":"2023-12-08T08:23:15.891331+0000","last_clean":"2023-12-08T08:23:15.891331+0000","last_became_active":"2023-12-08T08:22:59.262924+0000","last_became_peered":"2023-12-08T08:22:59.262924+0000","last_unstale":"2023-12-08T08:23:15.891331+0000","last_undegraded":"2023-12-08T08:23:15.891331+0000","last_fullsized":"2023-12-08T08:23:15.891331+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:39:59.028170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.895437+0000","last_change":"2023-12-08T08:23:16.895437+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.895437+0000","last_undegraded":"2023-12-08T08:23:16.895437+0000","last_fullsized":"2023-12-08T08:23:16.895437+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.914570+0000","last_change":"2023-12-08T08:23:16.912250+0000","last_active":"2023-12-08T08:23:16.914570+0000","last_peered":"2023-12-08T08:23:16.914570+0000","last_clean":"2023-12-08T08:23:16.914570+0000","last_became_active":"2023-12-08T08:23:16.912031+0000","last_became_peered":"2023-12-08T08:23:16.912031+0000","last_unstale":"2023-12-08T08:23:16.914570+0000","last_undegraded":"2023-12-08T08:23:16.914570+0000","last_fullsized":"2023-12-08T08:23:16.914570+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:03.696851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888857+0000","last_change":"2023-12-08T08:23:00.304740+0000","last_active":"2023-12-08T08:23:15.888857+0000","last_peered":"2023-12-08T08:23:15.888857+0000","last_clean":"2023-12-08T08:23:15.888857+0000","last_became_active":"2023-12-08T08:23:00.304390+0000","last_became_peered":"2023-12-08T08:23:00.304390+0000","last_unstale":"2023-12-08T08:23:15.888857+0000","last_undegraded":"2023-12-08T08:23:15.888857+0000","last_fullsized":"2023-12-08T08:23:15.888857+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889133+0000","last_change":"2023-12-08T08:22:59.285952+0000","last_active":"2023-12-08T08:23:15.889133+0000","last_peered":"2023-12-08T08:23:15.889133+0000","last_clean":"2023-12-08T08:23:15.889133+0000","last_became_active":"2023-12-08T08:22:59.285309+0000","last_became_peered":"2023-12-08T08:22:59.285309+0000","last_unstale":"2023-12-08T08:23:15.889133+0000","last_undegraded":"2023-12-08T08:23:15.889133+0000","last_fullsized":"2023-12-08T08:23:15.889133+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:19.279362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896326+0000","last_change":"2023-12-08T08:23:16.896326+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896326+0000","last_undegraded":"2023-12-08T08:23:16.896326+0000","last_fullsized":"2023-12-08T08:23:16.896326+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.919262+0000","last_change":"2023-12-08T08:23:16.912270+0000","last_active":"2023-12-08T08:23:16.919262+0000","last_peered":"2023-12-08T08:23:16.919262+0000","last_clean":"2023-12-08T08:23:16.919262+0000","last_became_active":"2023-12-08T08:23:16.912007+0000","last_became_peered":"2023-12-08T08:23:16.912007+0000","last_unstale":"2023-12-08T08:23:16.919262+0000","last_undegraded":"2023-12-08T08:23:16.919262+0000","last_fullsized":"2023-12-08T08:23:16.919262+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:32:01.183284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885854+0000","last_change":"2023-12-08T08:23:00.299161+0000","last_active":"2023-12-08T08:23:15.885854+0000","last_peered":"2023-12-08T08:23:15.885854+0000","last_clean":"2023-12-08T08:23:15.885854+0000","last_became_active":"2023-12-08T08:23:00.298876+0000","last_became_peered":"2023-12-08T08:23:00.298876+0000","last_unstale":"2023-12-08T08:23:15.885854+0000","last_undegraded":"2023-12-08T08:23:15.885854+0000","last_fullsized":"2023-12-08T08:23:15.885854+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:29:03.020360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888918+0000","last_change":"2023-12-08T08:22:59.280536+0000","last_active":"2023-12-08T08:23:15.888918+0000","last_peered":"2023-12-08T08:23:15.888918+0000","last_clean":"2023-12-08T08:23:15.888918+0000","last_became_active":"2023-12-08T08:22:59.280213+0000","last_became_peered":"2023-12-08T08:22:59.280213+0000","last_unstale":"2023-12-08T08:23:15.888918+0000","last_undegraded":"2023-12-08T08:23:15.888918+0000","last_fullsized":"2023-12-08T08:23:15.888918+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:49.883139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.898593+0000","last_change":"2023-12-08T08:23:16.898593+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.898593+0000","last_undegraded":"2023-12-08T08:23:16.898593+0000","last_fullsized":"2023-12-08T08:23:16.898593+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.922617+0000","last_change":"2023-12-08T08:23:16.919692+0000","last_active":"2023-12-08T08:23:16.922617+0000","last_peered":"2023-12-08T08:23:16.922617+0000","last_clean":"2023-12-08T08:23:16.922617+0000","last_became_active":"2023-12-08T08:23:16.919433+0000","last_became_peered":"2023-12-08T08:23:16.919433+0000","last_unstale":"2023-12-08T08:23:16.922617+0000","last_undegraded":"2023-12-08T08:23:16.922617+0000","last_fullsized":"2023-12-08T08:23:16.922617+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:28:54.873126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895793+0000","last_change":"2023-12-08T08:23:00.285721+0000","last_active":"2023-12-08T08:23:15.895793+0000","last_peered":"2023-12-08T08:23:15.895793+0000","last_clean":"2023-12-08T08:23:15.895793+0000","last_became_active":"2023-12-08T08:23:00.285446+0000","last_became_peered":"2023-12-08T08:23:00.285446+0000","last_unstale":"2023-12-08T08:23:15.895793+0000","last_undegraded":"2023-12-08T08:23:15.895793+0000","last_fullsized":"2023-12-08T08:23:15.895793+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895893+0000","last_change":"2023-12-08T08:22:59.272111+0000","last_active":"2023-12-08T08:23:15.895893+0000","last_peered":"2023-12-08T08:23:15.895893+0000","last_clean":"2023-12-08T08:23:15.895893+0000","last_became_active":"2023-12-08T08:22:59.271849+0000","last_became_peered":"2023-12-08T08:22:59.271849+0000","last_unstale":"2023-12-08T08:23:15.895893+0000","last_undegraded":"2023-12-08T08:23:15.895893+0000","last_fullsized":"2023-12-08T08:23:15.895893+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:15.060698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.907737+0000","last_change":"2023-12-08T08:23:16.907737+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.907737+0000","last_undegraded":"2023-12-08T08:23:16.907737+0000","last_fullsized":"2023-12-08T08:23:16.907737+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.915051+0000","last_change":"2023-12-08T08:23:16.910225+0000","last_active":"2023-12-08T08:23:16.915051+0000","last_peered":"2023-12-08T08:23:16.915051+0000","last_clean":"2023-12-08T08:23:16.915051+0000","last_became_active":"2023-12-08T08:23:16.909947+0000","last_became_peered":"2023-12-08T08:23:16.909947+0000","last_unstale":"2023-12-08T08:23:16.915051+0000","last_undegraded":"2023-12-08T08:23:16.915051+0000","last_fullsized":"2023-12-08T08:23:16.915051+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:24:52.637443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895822+0000","last_change":"2023-12-08T08:23:00.292346+0000","last_active":"2023-12-08T08:23:15.895822+0000","last_peered":"2023-12-08T08:23:15.895822+0000","last_clean":"2023-12-08T08:23:15.895822+0000","last_became_active":"2023-12-08T08:23:00.292166+0000","last_became_peered":"2023-12-08T08:23:00.292166+0000","last_unstale":"2023-12-08T08:23:15.895822+0000","last_undegraded":"2023-12-08T08:23:15.895822+0000","last_fullsized":"2023-12-08T08:23:15.895822+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:21:59.539539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885488+0000","last_change":"2023-12-08T08:22:59.271088+0000","last_active":"2023-12-08T08:23:15.885488+0000","last_peered":"2023-12-08T08:23:15.885488+0000","last_clean":"2023-12-08T08:23:15.885488+0000","last_became_active":"2023-12-08T08:22:59.270783+0000","last_became_peered":"2023-12-08T08:22:59.270783+0000","last_unstale":"2023-12-08T08:23:15.885488+0000","last_undegraded":"2023-12-08T08:23:15.885488+0000","last_fullsized":"2023-12-08T08:23:15.885488+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:30:43.384001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.899218+0000","last_change":"2023-12-08T08:23:16.899218+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.899218+0000","last_undegraded":"2023-12-08T08:23:16.899218+0000","last_fullsized":"2023-12-08T08:23:16.899218+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.922449+0000","last_change":"2023-12-08T08:23:16.921099+0000","last_active":"2023-12-08T08:23:16.922449+0000","last_peered":"2023-12-08T08:23:16.922449+0000","last_clean":"2023-12-08T08:23:16.922449+0000","last_became_active":"2023-12-08T08:23:16.920243+0000","last_became_peered":"2023-12-08T08:23:16.920243+0000","last_unstale":"2023-12-08T08:23:16.922449+0000","last_undegraded":"2023-12-08T08:23:16.922449+0000","last_fullsized":"2023-12-08T08:23:16.922449+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:18:49.227732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894254+0000","last_change":"2023-12-08T08:23:00.283700+0000","last_active":"2023-12-08T08:23:15.894254+0000","last_peered":"2023-12-08T08:23:15.894254+0000","last_clean":"2023-12-08T08:23:15.894254+0000","last_became_active":"2023-12-08T08:23:00.283439+0000","last_became_peered":"2023-12-08T08:23:00.283439+0000","last_unstale":"2023-12-08T08:23:15.894254+0000","last_undegraded":"2023-12-08T08:23:15.894254+0000","last_fullsized":"2023-12-08T08:23:15.894254+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888620+0000","last_change":"2023-12-08T08:22:59.280725+0000","last_active":"2023-12-08T08:23:15.888620+0000","last_peered":"2023-12-08T08:23:15.888620+0000","last_clean":"2023-12-08T08:23:15.888620+0000","last_became_active":"2023-12-08T08:22:59.279736+0000","last_became_peered":"2023-12-08T08:22:59.279736+0000","last_unstale":"2023-12-08T08:23:15.888620+0000","last_undegraded":"2023-12-08T08:23:15.888620+0000","last_fullsized":"2023-12-08T08:23:15.888620+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:54.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.894537+0000","last_change":"2023-12-08T08:23:16.894537+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.894537+0000","last_undegraded":"2023-12-08T08:23:16.894537+0000","last_fullsized":"2023-12-08T08:23:16.894537+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920940+0000","last_change":"2023-12-08T08:23:16.918822+0000","last_active":"2023-12-08T08:23:16.920940+0000","last_peered":"2023-12-08T08:23:16.920940+0000","last_clean":"2023-12-08T08:23:16.920940+0000","last_became_active":"2023-12-08T08:23:16.918519+0000","last_became_peered":"2023-12-08T08:23:16.918519+0000","last_unstale":"2023-12-08T08:23:16.920940+0000","last_undegraded":"2023-12-08T08:23:16.920940+0000","last_fullsized":"2023-12-08T08:23:16.920940+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:03.696851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888527+0000","last_change":"2023-12-08T08:23:00.305076+0000","last_active":"2023-12-08T08:23:15.888527+0000","last_peered":"2023-12-08T08:23:15.888527+0000","last_clean":"2023-12-08T08:23:15.888527+0000","last_became_active":"2023-12-08T08:23:00.304435+0000","last_became_peered":"2023-12-08T08:23:00.304435+0000","last_unstale":"2023-12-08T08:23:15.888527+0000","last_undegraded":"2023-12-08T08:23:15.888527+0000","last_fullsized":"2023-12-08T08:23:15.888527+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:42:20.038693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885184+0000","last_change":"2023-12-08T08:22:59.278661+0000","last_active":"2023-12-08T08:23:15.885184+0000","last_peered":"2023-12-08T08:23:15.885184+0000","last_clean":"2023-12-08T08:23:15.885184+0000","last_became_active":"2023-12-08T08:22:59.278383+0000","last_became_peered":"2023-12-08T08:22:59.278383+0000","last_unstale":"2023-12-08T08:23:15.885184+0000","last_undegraded":"2023-12-08T08:23:15.885184+0000","last_fullsized":"2023-12-08T08:23:15.885184+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:35:15.000491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.899234+0000","last_change":"2023-12-08T08:23:16.899234+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.899234+0000","last_undegraded":"2023-12-08T08:23:16.899234+0000","last_fullsized":"2023-12-08T08:23:16.899234+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.923341+0000","last_change":"2023-12-08T08:23:16.918926+0000","last_active":"2023-12-08T08:23:16.923341+0000","last_peered":"2023-12-08T08:23:16.923341+0000","last_clean":"2023-12-08T08:23:16.923341+0000","last_became_active":"2023-12-08T08:23:16.918626+0000","last_became_peered":"2023-12-08T08:23:16.918626+0000","last_unstale":"2023-12-08T08:23:16.923341+0000","last_undegraded":"2023-12-08T08:23:16.923341+0000","last_fullsized":"2023-12-08T08:23:16.923341+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:10:23.005533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.890781+0000","last_change":"2023-12-08T08:23:00.270574+0000","last_active":"2023-12-08T08:23:15.890781+0000","last_peered":"2023-12-08T08:23:15.890781+0000","last_clean":"2023-12-08T08:23:15.890781+0000","last_became_active":"2023-12-08T08:23:00.270304+0000","last_became_peered":"2023-12-08T08:23:00.270304+0000","last_unstale":"2023-12-08T08:23:15.890781+0000","last_undegraded":"2023-12-08T08:23:15.890781+0000","last_fullsized":"2023-12-08T08:23:15.890781+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:15:55.762883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"67'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895591+0000","last_change":"2023-12-08T08:22:59.275324+0000","last_active":"2023-12-08T08:23:15.895591+0000","last_peered":"2023-12-08T08:23:15.895591+0000","last_clean":"2023-12-08T08:23:15.895591+0000","last_became_active":"2023-12-08T08:22:59.275038+0000","last_became_peered":"2023-12-08T08:22:59.275038+0000","last_unstale":"2023-12-08T08:23:15.895591+0000","last_undegraded":"2023-12-08T08:23:15.895591+0000","last_fullsized":"2023-12-08T08:23:15.895591+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:09.089659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":207,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894333+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:23:15.894333+0000","last_peered":"2023-12-08T08:23:15.894333+0000","last_clean":"2023-12-08T08:23:15.894333+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:23:15.894333+0000","last_undegraded":"2023-12-08T08:23:15.894333+0000","last_fullsized":"2023-12-08T08:23:15.894333+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":929792,"data_stored":968762,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89900000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.85299999999999998,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.77500000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85999999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89600000000000002,"5min":1.446,"15min":1.446},"last":0.873}]},{"osd":2,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.71999999999999997,"15min":0.72899999999999998},"min":{"1min":0.52100000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.871,"5min":1.379,"15min":1.379},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.47599999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.84599999999999997,"5min":1.706,"15min":1.706},"last":0.85999999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.751,"15min":0.76300000000000001},"min":{"1min":0.54500000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.88700000000000001,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.752},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.56699999999999995,"5min":0.496,"15min":0.496},"max":{"1min":0.83099999999999996,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.80000000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.46899999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.90000000000000002,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.72599999999999998,"15min":0.74199999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83999999999999997,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.59599999999999997}]},{"osd":5,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.77500000000000002,"15min":0.79500000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81399999999999995,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.78500000000000003,"15min":0.80200000000000005},"min":{"1min":0.499,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93300000000000005,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.72999999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.84799999999999998,"15min":0.86499999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.95899999999999996,"5min":1.573,"15min":1.573},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.80000000000000004,"15min":0.81499999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91100000000000003,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.82299999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":379018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.66800000000000004},"min":{"1min":0.49099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.56899999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94599999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.79400000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72499999999999998,"15min":0.71899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73599999999999999,"15min":0.73399999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.83399999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70899999999999996,"15min":0.72499999999999998},"min":{"1min":0.50700000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.90900000000000003,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73599999999999999,"15min":0.746},"min":{"1min":0.48899999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.877}]},{"osd":3,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.73799999999999999,"15min":0.75700000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.46600000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.96299999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.752}]},{"osd":4,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.70199999999999996,"15min":0.72599999999999998},"min":{"1min":0.42899999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83399999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.71699999999999997,"15min":0.755},"min":{"1min":0.496,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79700000000000004,"5min":1.014,"15min":1.014},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.75,"15min":0.79100000000000004},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83099999999999996,"5min":1.091,"15min":1.091},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.81699999999999995,"15min":0.84299999999999997},"min":{"1min":0.57199999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0149999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.93400000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78600000000000003,"15min":0.81599999999999995},"min":{"1min":0.61799999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.89000000000000001,"5min":1.04,"15min":1.04},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.84199999999999997,"15min":0.89200000000000002},"min":{"1min":0.55400000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96499999999999997,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.84799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":876544,"data_stored":381453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.621,"15min":0.622},"min":{"1min":0.47599999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.042,"5min":1.081,"15min":1.081},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68300000000000005,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.024,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.65800000000000003}]},{"osd":1,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69099999999999995,"15min":0.68100000000000005},"min":{"1min":0.42399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98599999999999999,"5min":1.194,"15min":1.194},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.006,"5min":1.143,"15min":1.143},"last":0.59199999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.47999999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0880000000000001,"5min":1.101,"15min":1.101},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72999999999999998,"15min":0.74199999999999999},"min":{"1min":0.52300000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.745},{"interface":"front","average":{"1min":0.75,"5min":0.76300000000000001,"15min":0.753},"min":{"1min":0.56200000000000006,"5min":0.5,"15min":0.5},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.73099999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.40899999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.96299999999999997,"5min":1.01,"15min":1.01},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.58899999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.048,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.83399999999999996}]},{"osd":6,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.75700000000000001,"15min":0.77900000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89900000000000002,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91000000000000003,"5min":1.073,"15min":1.073},"last":0.76500000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77600000000000002,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95999999999999996,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83599999999999997,"15min":0.85599999999999998},"min":{"1min":0.56299999999999994,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0800000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.61199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":378324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.68000000000000005,"15min":0.69399999999999995},"min":{"1min":0.502,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86099999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.68300000000000005,"15min":0.66800000000000004},"min":{"1min":0.59399999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95099999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.81399999999999995}]},{"osd":1,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70799999999999996,"15min":0.71299999999999997},"min":{"1min":0.52800000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90100000000000002,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68100000000000005,"15min":0.68200000000000005},"min":{"1min":0.505,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.84499999999999997,"5min":1.002,"15min":1.002},"last":0.71299999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68999999999999995},"min":{"1min":0.54200000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88400000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.751},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.54400000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.84699999999999998,"5min":1.056,"15min":1.056},"last":0.77400000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.58999999999999997,"5min":0.496,"15min":0.496},"max":{"1min":0.95299999999999996,"5min":1.359,"15min":1.359},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.755,"15min":0.78500000000000003},"min":{"1min":0.51800000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99399999999999999,"5min":1.232,"15min":1.232},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.64200000000000002,"15min":0.66800000000000004},"min":{"1min":0.39000000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90800000000000003,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.745,"15min":0.78100000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95199999999999996,"5min":1.091,"15min":1.091},"last":0.57699999999999996}]},{"osd":6,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.68600000000000005,"15min":0.71499999999999997},"min":{"1min":0.41699999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.92500000000000004,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.504},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.76300000000000001,"15min":0.78900000000000003},"min":{"1min":0.45300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98199999999999998,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.55000000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.97699999999999998,"5min":1.246,"15min":1.246},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.80200000000000005},"min":{"1min":0.50800000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.004,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.45700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":381431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41799999999999998,"15min":0.432},"min":{"1min":0.26500000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.56000000000000005,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45600000000000002,"15min":0.46300000000000002},"min":{"1min":0.309,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73999999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.42899999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.435,"15min":0.436},"min":{"1min":0.317,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.58099999999999996,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.504}]},{"osd":2,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.50900000000000001,"15min":0.52200000000000002},"min":{"1min":0.35299999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52900000000000003,"15min":0.54100000000000004},"min":{"1min":0.40600000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65200000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.52700000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0620000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":1.014},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.54300000000000004,"5min":0.497,"15min":0.497},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.95499999999999996}]},{"osd":5,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.52000000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":1},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.76200000000000001,"15min":0.77100000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.97199999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.56899999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.101,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.97899999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.76200000000000001,"15min":0.75900000000000001},"min":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.58599999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1080000000000001,"5min":1.121,"15min":1.121},"last":1.036}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":864256,"data_stored":378906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39100000000000001,"15min":0.40100000000000002},"min":{"1min":0.27900000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.497,"15min":0.53100000000000003},"min":{"1min":0.315,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67700000000000005,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.34399999999999997}]},{"osd":1,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.32200000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51500000000000001,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.40100000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.54300000000000004,"15min":0.57699999999999996},"min":{"1min":0.34899999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.57799999999999996,"5min":3.008,"15min":3.008},"last":0.44},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47799999999999998,"15min":0.48399999999999999},"min":{"1min":0.33800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.65400000000000003,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.36599999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78300000000000003,"15min":0.81699999999999995},"min":{"1min":0.50900000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.004,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0049999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.79300000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.75700000000000001,"15min":0.76800000000000002},"min":{"1min":0.51000000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98699999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78800000000000003,"15min":0.82899999999999996},"min":{"1min":0.52600000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98799999999999999,"5min":3.637,"15min":3.637},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.78000000000000003,"15min":0.79400000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97499999999999998,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.038,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.83499999999999996,"15min":0.89500000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.88400000000000001,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.82499999999999996,"15min":0.83899999999999997},"min":{"1min":0.56799999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0109999999999999,"5min":1.766,"15min":1.766},"last":0.83399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":378518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.59799999999999998,"15min":0.67600000000000005},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.80300000000000005,"5min":5.2210000000000001,"15min":5.2210000000000001},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.73399999999999999,"15min":0.85899999999999999},"min":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59599999999999997,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.38200000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.71299999999999997,"15min":0.83899999999999997},"min":{"1min":0.32800000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.60999999999999999,"5min":8.2070000000000007,"15min":8.2070000000000007},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.63500000000000001,"15min":0.70399999999999996},"min":{"1min":0.34300000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.69299999999999995,"5min":4.351,"15min":4.351},"last":0.37}]},{"osd":3,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.80900000000000005,"15min":0.94199999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.754,"5min":8.1479999999999997,"15min":8.1479999999999997},"last":0.308},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.67400000000000004,"15min":0.76900000000000002},"min":{"1min":0.32300000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.72599999999999998,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.32300000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.91000000000000003,"15min":1.012},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0049999999999999,"5min":4.8470000000000004,"15min":4.8470000000000004},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.97599999999999998,"15min":1.0820000000000001},"min":{"1min":0.55100000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93999999999999995,"5min":4.7939999999999996,"15min":4.7939999999999996},"last":0.66500000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.90500000000000003,"15min":0.98699999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99199999999999999,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.89900000000000002,"15min":0.97899999999999998},"min":{"1min":0.53000000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.107,"5min":4.5830000000000002,"15min":4.5830000000000002},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.97999999999999998,"15min":1.097},"min":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.95799999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.97199999999999998,"15min":1.075},"min":{"1min":0.59399999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.95799999999999996,"5min":4.6289999999999996,"15min":4.6289999999999996},"last":0.68400000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.91600000000000004,"15min":1.002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.97699999999999998,"5min":4.665,"15min":4.665},"last":0.505},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.98199999999999998,"15min":1.0860000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.089,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.57599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":917504,"data_stored":961596,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46899999999999997,"15min":0.495},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64000000000000001,"5min":1.863,"15min":1.863},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.75600000000000001,"15min":0.88600000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70799999999999996,"5min":8.2799999999999994,"15min":8.2799999999999994},"last":0.38}]},{"osd":2,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.78000000000000003,"15min":0.93200000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77300000000000002,"5min":7.9290000000000003,"15min":7.9290000000000003},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.78200000000000003,"15min":0.93700000000000006},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.628,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.435}]},{"osd":3,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.59799999999999998,"15min":0.67200000000000004},"min":{"1min":0.33100000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58699999999999997,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.75600000000000001,"15min":0.872},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82399999999999995,"5min":7.8890000000000002,"15min":7.8890000000000002},"last":0.41799999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.94899999999999995,"15min":1.0529999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95399999999999996,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.753,"15min":0.77800000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88600000000000001,"5min":1.607,"15min":1.607},"last":0.58499999999999996}]},{"osd":5,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.81100000000000005,"15min":0.83099999999999996},"min":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96899999999999997,"5min":1.514,"15min":1.514},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.98899999999999999,"15min":1.1100000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91000000000000003,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79200000000000004,"15min":0.82699999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.88,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.95399999999999996,"15min":1.0549999999999999},"min":{"1min":0.56100000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.89900000000000002,"5min":7.835,"15min":7.835},"last":0.56699999999999995}]},{"osd":7,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.97399999999999998,"15min":1.0800000000000001},"min":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.99299999999999999,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.81000000000000005,"15min":0.85399999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95199999999999996,"5min":1.794,"15min":1.794},"last":0.52900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:23:22.351 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:23:22.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.518+0000 7f3817780640 1 Processor -- start 2023-12-08T08:23:22.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.518+0000 7f3817780640 1 -- start start 2023-12-08T08:23:22.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.518+0000 7f3817780640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38100af4c0 0x7f3810154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:22.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.518+0000 7f3817780640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f38100c67d0 0x7f38100c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:22.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.518+0000 7f3817780640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38100c4890 con 0x7f381006b9f0 2023-12-08T08:23:22.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.518+0000 7f3817780640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3810155460 con 0x7f38100c67d0 2023-12-08T08:23:22.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.518+0000 7f3817780640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38100af8a0 con 0x7f38100af4c0 2023-12-08T08:23:22.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.518+0000 7f3814d1b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f38100c67d0 0x7f38100c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:22.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.518+0000 7f3814d1b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f38100c67d0 0x7f38100c6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54352/0 (socket says 172.21.15.88:54352) 2023-12-08T08:23:22.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.518+0000 7f3814d1b640 1 -- 172.21.15.88:0/1176802144 learned_addr learned my addr 172.21.15.88:0/1176802144 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:22.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.518+0000 7f381551c640 1 --2- 172.21.15.88:0/1176802144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38100af4c0 0x7f3810154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:22.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.518+0000 7f3814d1b640 1 -- 172.21.15.88:0/1176802144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38100af4c0 msgr2=0x7f3810154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:22.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.518+0000 7f3814d1b640 1 --2- 172.21.15.88:0/1176802144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38100af4c0 0x7f3810154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:22.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.518+0000 7f3814d1b640 1 -- 172.21.15.88:0/1176802144 >> v1:172.21.15.148:6789/0 conn(0x7f381006b9f0 legacy=0x7f3810157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:22.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.518+0000 7f3814d1b640 1 -- 172.21.15.88:0/1176802144 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38100c4b30 con 0x7f38100c67d0 2023-12-08T08:23:22.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.522+0000 7f3814d1b640 1 --2- 172.21.15.88:0/1176802144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38100c67d0 0x7f38100c6c50 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f3800009870 tx=0x7f380001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b527a71fa7fe349d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:22.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.522+0000 7f3807fff640 1 -- 172.21.15.88:0/1176802144 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38000ab680 con 0x7f38100c67d0 2023-12-08T08:23:22.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.522+0000 7f3807fff640 1 -- 172.21.15.88:0/1176802144 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38000ab7e0 con 0x7f38100c67d0 2023-12-08T08:23:22.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.522+0000 7f3807fff640 1 -- 172.21.15.88:0/1176802144 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38000abb70 con 0x7f38100c67d0 2023-12-08T08:23:22.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.522+0000 7f3817780640 1 -- 172.21.15.88:0/1176802144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38100c67d0 msgr2=0x7f38100c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:22.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.522+0000 7f3817780640 1 --2- 172.21.15.88:0/1176802144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38100c67d0 0x7f38100c6c50 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f3800009870 tx=0x7f380001c480 comp rx=0 tx=0).stop 2023-12-08T08:23:22.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.522+0000 7f3817780640 1 -- 172.21.15.88:0/1176802144 shutdown_connections 2023-12-08T08:23:22.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.522+0000 7f3817780640 1 --2- 172.21.15.88:0/1176802144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38100c67d0 0x7f38100c6c50 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:22.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.522+0000 7f3817780640 1 --2- 172.21.15.88:0/1176802144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38100af4c0 0x7f3810154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:22.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.522+0000 7f3817780640 1 -- 172.21.15.88:0/1176802144 >> 172.21.15.88:0/1176802144 conn(0x7f38100ab9d0 msgr2=0x7f38100abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:22.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.522+0000 7f3817780640 1 -- 172.21.15.88:0/1176802144 shutdown_connections 2023-12-08T08:23:22.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.522+0000 7f3817780640 1 -- 172.21.15.88:0/1176802144 wait complete. 2023-12-08T08:23:22.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.526+0000 7f3817780640 1 Processor -- start 2023-12-08T08:23:22.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.526+0000 7f3817780640 1 -- start start 2023-12-08T08:23:22.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.526+0000 7f3817780640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f381006b9f0 0x7f381014fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:22.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.526+0000 7f3817780640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38100af4c0 0x7f3810152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:22.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.526+0000 7f3817780640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38100c67d0 0x7f3810149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:22.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.526+0000 7f3817780640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38101ed6a0 con 0x7f38100c67d0 2023-12-08T08:23:22.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.526+0000 7f3817780640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3810153e60 con 0x7f381006b9f0 2023-12-08T08:23:22.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.526+0000 7f3817780640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3810153380 con 0x7f38100af4c0 2023-12-08T08:23:22.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.526+0000 7f3815d1d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38100c67d0 0x7f3810149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:22.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.526+0000 7f3815d1d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38100c67d0 0x7f3810149f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54360/0 (socket says 172.21.15.88:54360) 2023-12-08T08:23:22.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.526+0000 7f3815d1d640 1 -- 172.21.15.88:0/3432648209 learned_addr learned my addr 172.21.15.88:0/3432648209 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:22.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.526+0000 7f3814d1b640 1 --2- 172.21.15.88:0/3432648209 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38100af4c0 0x7f3810152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:22.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.526+0000 7f381551c640 1 --2- 172.21.15.88:0/3432648209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f381006b9f0 0x7f381014fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:22.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.526+0000 7f3815d1d640 1 -- 172.21.15.88:0/3432648209 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38100af4c0 msgr2=0x7f3810152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:22.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.526+0000 7f3815d1d640 1 --2- 172.21.15.88:0/3432648209 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38100af4c0 0x7f3810152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:22.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.526+0000 7f3815d1d640 1 -- 172.21.15.88:0/3432648209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f381006b9f0 msgr2=0x7f381014fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:22.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.526+0000 7f3815d1d640 1 --2- 172.21.15.88:0/3432648209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f381006b9f0 0x7f381014fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:22.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.526+0000 7f3815d1d640 1 -- 172.21.15.88:0/3432648209 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38000094d0 con 0x7f38100c67d0 2023-12-08T08:23:22.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.526+0000 7f3815d1d640 1 --2- 172.21.15.88:0/3432648209 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38100c67d0 0x7f3810149f20 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f380800c770 tx=0x7f380800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:22.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.526+0000 7f3805ffb640 1 -- 172.21.15.88:0/3432648209 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3808003b80 con 0x7f38100c67d0 2023-12-08T08:23:22.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.526+0000 7f3805ffb640 1 -- 172.21.15.88:0/3432648209 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3808003ce0 con 0x7f38100c67d0 2023-12-08T08:23:22.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.526+0000 7f3805ffb640 1 -- 172.21.15.88:0/3432648209 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380800aa90 con 0x7f38100c67d0 2023-12-08T08:23:22.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.526+0000 7f3817780640 1 -- 172.21.15.88:0/3432648209 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3810153660 con 0x7f38100c67d0 2023-12-08T08:23:22.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.526+0000 7f3817780640 1 -- 172.21.15.88:0/3432648209 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3810153070 con 0x7f38100c67d0 2023-12-08T08:23:22.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.526+0000 7f3817780640 1 -- 172.21.15.88:0/3432648209 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3810067630 con 0x7f38100c67d0 2023-12-08T08:23:22.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.530+0000 7f3805ffb640 1 -- 172.21.15.88:0/3432648209 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f380800abf0 con 0x7f38100c67d0 2023-12-08T08:23:22.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.530+0000 7f3805ffb640 1 --2- 172.21.15.88:0/3432648209 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f37f4066470 0x7f37f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:22.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.530+0000 7f3805ffb640 1 -- 172.21.15.88:0/3432648209 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3808083ee0 con 0x7f38100c67d0 2023-12-08T08:23:22.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.530+0000 7f381551c640 1 --2- 172.21.15.88:0/3432648209 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f37f4066470 0x7f37f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:22.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.530+0000 7f381551c640 1 --2- 172.21.15.88:0/3432648209 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f37f4066470 0x7f37f4068930 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f38100c4680 tx=0x7f380c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:22.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.534+0000 7f3805ffb640 1 -- 172.21.15.88:0/3432648209 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f38080510a0 con 0x7f38100c67d0 2023-12-08T08:23:22.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.678+0000 7f3817780640 1 -- 172.21.15.88:0/3432648209 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f381006cae0 con 0x7f37f4066470 2023-12-08T08:23:22.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.690+0000 7f3805ffb640 1 -- 172.21.15.88:0/3432648209 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+522584 (secure 0 0 0) 0x7f380c010990 con 0x7f37f4066470 2023-12-08T08:23:22.701 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:22.705 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:23:22.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.698+0000 7f3817780640 1 -- 172.21.15.88:0/3432648209 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f37f4066470 msgr2=0x7f37f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:22.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.698+0000 7f3817780640 1 --2- 172.21.15.88:0/3432648209 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f37f4066470 0x7f37f4068930 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f38100c4680 tx=0x7f380c008040 comp rx=0 tx=0).stop 2023-12-08T08:23:22.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.698+0000 7f3817780640 1 -- 172.21.15.88:0/3432648209 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38100c67d0 msgr2=0x7f3810149f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:22.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.698+0000 7f3817780640 1 --2- 172.21.15.88:0/3432648209 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38100c67d0 0x7f3810149f20 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f380800c770 tx=0x7f380800cc30 comp rx=0 tx=0).stop 2023-12-08T08:23:22.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.698+0000 7f3817780640 1 -- 172.21.15.88:0/3432648209 shutdown_connections 2023-12-08T08:23:22.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.698+0000 7f3817780640 1 --2- 172.21.15.88:0/3432648209 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f37f4066470 0x7f37f4068930 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:22.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.698+0000 7f3817780640 1 --2- 172.21.15.88:0/3432648209 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38100c67d0 0x7f3810149f20 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:22.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.698+0000 7f3817780640 1 --2- 172.21.15.88:0/3432648209 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f38100af4c0 0x7f3810152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:22.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.698+0000 7f3817780640 1 --2- 172.21.15.88:0/3432648209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f381006b9f0 0x7f381014fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:22.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.698+0000 7f3817780640 1 -- 172.21.15.88:0/3432648209 >> 172.21.15.88:0/3432648209 conn(0x7f38100ab9d0 msgr2=0x7f3810157a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:22.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.698+0000 7f3817780640 1 -- 172.21.15.88:0/3432648209 shutdown_connections 2023-12-08T08:23:22.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.698+0000 7f3817780640 1 -- 172.21.15.88:0/3432648209 wait complete. 2023-12-08T08:23:22.721 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2023-12-08T08:23:20.784087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":261,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252208,"kb_used_data":6900,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754722512,"statfs":{"total":773094113280,"available":772835852288,"internally_reserved":0,"allocated":7065600,"data_stored":4208008,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.902889"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.897424+0000","last_change":"2023-12-08T08:23:16.897424+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.897424+0000","last_undegraded":"2023-12-08T08:23:16.897424+0000","last_fullsized":"2023-12-08T08:23:16.897424+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889235+0000","last_change":"2023-12-08T08:23:00.281512+0000","last_active":"2023-12-08T08:23:15.889235+0000","last_peered":"2023-12-08T08:23:15.889235+0000","last_clean":"2023-12-08T08:23:15.889235+0000","last_became_active":"2023-12-08T08:23:00.281118+0000","last_became_peered":"2023-12-08T08:23:00.281118+0000","last_unstale":"2023-12-08T08:23:15.889235+0000","last_undegraded":"2023-12-08T08:23:15.889235+0000","last_fullsized":"2023-12-08T08:23:15.889235+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:15.472021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.903319+0000","last_change":"2023-12-08T08:23:16.903319+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.903319+0000","last_undegraded":"2023-12-08T08:23:16.903319+0000","last_fullsized":"2023-12-08T08:23:16.903319+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.891247+0000","last_change":"2023-12-08T08:23:00.276523+0000","last_active":"2023-12-08T08:23:15.891247+0000","last_peered":"2023-12-08T08:23:15.891247+0000","last_clean":"2023-12-08T08:23:15.891247+0000","last_became_active":"2023-12-08T08:23:00.276039+0000","last_became_peered":"2023-12-08T08:23:00.276039+0000","last_unstale":"2023-12-08T08:23:15.891247+0000","last_undegraded":"2023-12-08T08:23:15.891247+0000","last_fullsized":"2023-12-08T08:23:15.891247+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:31:16.893953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896828+0000","last_change":"2023-12-08T08:23:16.896828+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896828+0000","last_undegraded":"2023-12-08T08:23:16.896828+0000","last_fullsized":"2023-12-08T08:23:16.896828+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895520+0000","last_change":"2023-12-08T08:23:00.283198+0000","last_active":"2023-12-08T08:23:15.895520+0000","last_peered":"2023-12-08T08:23:15.895520+0000","last_clean":"2023-12-08T08:23:15.895520+0000","last_became_active":"2023-12-08T08:23:00.282944+0000","last_became_peered":"2023-12-08T08:23:00.282944+0000","last_unstale":"2023-12-08T08:23:15.895520+0000","last_undegraded":"2023-12-08T08:23:15.895520+0000","last_fullsized":"2023-12-08T08:23:15.895520+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:33.898137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.898081+0000","last_change":"2023-12-08T08:23:16.898081+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.898081+0000","last_undegraded":"2023-12-08T08:23:16.898081+0000","last_fullsized":"2023-12-08T08:23:16.898081+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.884023+0000","last_change":"2023-12-08T08:23:00.285685+0000","last_active":"2023-12-08T08:23:15.884023+0000","last_peered":"2023-12-08T08:23:15.884023+0000","last_clean":"2023-12-08T08:23:15.884023+0000","last_became_active":"2023-12-08T08:23:00.285351+0000","last_became_peered":"2023-12-08T08:23:00.285351+0000","last_unstale":"2023-12-08T08:23:15.884023+0000","last_undegraded":"2023-12-08T08:23:15.884023+0000","last_fullsized":"2023-12-08T08:23:15.884023+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:43:34.830332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900497+0000","last_change":"2023-12-08T08:23:16.900497+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900497+0000","last_undegraded":"2023-12-08T08:23:16.900497+0000","last_fullsized":"2023-12-08T08:23:16.900497+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885459+0000","last_change":"2023-12-08T08:23:00.264270+0000","last_active":"2023-12-08T08:23:15.885459+0000","last_peered":"2023-12-08T08:23:15.885459+0000","last_clean":"2023-12-08T08:23:15.885459+0000","last_became_active":"2023-12-08T08:23:00.263994+0000","last_became_peered":"2023-12-08T08:23:00.263994+0000","last_unstale":"2023-12-08T08:23:15.885459+0000","last_undegraded":"2023-12-08T08:23:15.885459+0000","last_fullsized":"2023-12-08T08:23:15.885459+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:33.905575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900421+0000","last_change":"2023-12-08T08:23:16.900421+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900421+0000","last_undegraded":"2023-12-08T08:23:16.900421+0000","last_fullsized":"2023-12-08T08:23:16.900421+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895579+0000","last_change":"2023-12-08T08:23:00.300354+0000","last_active":"2023-12-08T08:23:15.895579+0000","last_peered":"2023-12-08T08:23:15.895579+0000","last_clean":"2023-12-08T08:23:15.895579+0000","last_became_active":"2023-12-08T08:23:00.300026+0000","last_became_peered":"2023-12-08T08:23:00.300026+0000","last_unstale":"2023-12-08T08:23:15.895579+0000","last_undegraded":"2023-12-08T08:23:15.895579+0000","last_fullsized":"2023-12-08T08:23:15.895579+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.905320+0000","last_change":"2023-12-08T08:23:16.905320+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.905320+0000","last_undegraded":"2023-12-08T08:23:16.905320+0000","last_fullsized":"2023-12-08T08:23:16.905320+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883417+0000","last_change":"2023-12-08T08:23:00.278456+0000","last_active":"2023-12-08T08:23:15.883417+0000","last_peered":"2023-12-08T08:23:15.883417+0000","last_clean":"2023-12-08T08:23:15.883417+0000","last_became_active":"2023-12-08T08:23:00.277186+0000","last_became_peered":"2023-12-08T08:23:00.277186+0000","last_unstale":"2023-12-08T08:23:15.883417+0000","last_undegraded":"2023-12-08T08:23:15.883417+0000","last_fullsized":"2023-12-08T08:23:15.883417+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:20:16.170951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900665+0000","last_change":"2023-12-08T08:23:16.900665+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900665+0000","last_undegraded":"2023-12-08T08:23:16.900665+0000","last_fullsized":"2023-12-08T08:23:16.900665+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.893869+0000","last_change":"2023-12-08T08:23:00.272694+0000","last_active":"2023-12-08T08:23:15.893869+0000","last_peered":"2023-12-08T08:23:15.893869+0000","last_clean":"2023-12-08T08:23:15.893869+0000","last_became_active":"2023-12-08T08:23:00.272440+0000","last_became_peered":"2023-12-08T08:23:00.272440+0000","last_unstale":"2023-12-08T08:23:15.893869+0000","last_undegraded":"2023-12-08T08:23:15.893869+0000","last_fullsized":"2023-12-08T08:23:15.893869+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:15.472021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.908893+0000","last_change":"2023-12-08T08:23:16.908893+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.908893+0000","last_undegraded":"2023-12-08T08:23:16.908893+0000","last_fullsized":"2023-12-08T08:23:16.908893+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895866+0000","last_change":"2023-12-08T08:23:00.298447+0000","last_active":"2023-12-08T08:23:15.895866+0000","last_peered":"2023-12-08T08:23:15.895866+0000","last_clean":"2023-12-08T08:23:15.895866+0000","last_became_active":"2023-12-08T08:23:00.298113+0000","last_became_peered":"2023-12-08T08:23:00.298113+0000","last_unstale":"2023-12-08T08:23:15.895866+0000","last_undegraded":"2023-12-08T08:23:15.895866+0000","last_fullsized":"2023-12-08T08:23:15.895866+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896836+0000","last_change":"2023-12-08T08:23:16.896836+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896836+0000","last_undegraded":"2023-12-08T08:23:16.896836+0000","last_fullsized":"2023-12-08T08:23:16.896836+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889234+0000","last_change":"2023-12-08T08:23:00.277064+0000","last_active":"2023-12-08T08:23:15.889234+0000","last_peered":"2023-12-08T08:23:15.889234+0000","last_clean":"2023-12-08T08:23:15.889234+0000","last_became_active":"2023-12-08T08:23:00.276850+0000","last_became_peered":"2023-12-08T08:23:00.276850+0000","last_unstale":"2023-12-08T08:23:15.889234+0000","last_undegraded":"2023-12-08T08:23:15.889234+0000","last_fullsized":"2023-12-08T08:23:15.889234+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896062+0000","last_change":"2023-12-08T08:23:16.896062+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896062+0000","last_undegraded":"2023-12-08T08:23:16.896062+0000","last_fullsized":"2023-12-08T08:23:16.896062+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.891049+0000","last_change":"2023-12-08T08:23:00.286362+0000","last_active":"2023-12-08T08:23:15.891049+0000","last_peered":"2023-12-08T08:23:15.891049+0000","last_clean":"2023-12-08T08:23:15.891049+0000","last_became_active":"2023-12-08T08:23:00.286071+0000","last_became_peered":"2023-12-08T08:23:00.286071+0000","last_unstale":"2023-12-08T08:23:15.891049+0000","last_undegraded":"2023-12-08T08:23:15.891049+0000","last_fullsized":"2023-12-08T08:23:15.891049+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:50.890759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.905090+0000","last_change":"2023-12-08T08:23:16.905090+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.905090+0000","last_undegraded":"2023-12-08T08:23:16.905090+0000","last_fullsized":"2023-12-08T08:23:16.905090+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888742+0000","last_change":"2023-12-08T08:23:00.277187+0000","last_active":"2023-12-08T08:23:15.888742+0000","last_peered":"2023-12-08T08:23:15.888742+0000","last_clean":"2023-12-08T08:23:15.888742+0000","last_became_active":"2023-12-08T08:23:00.276929+0000","last_became_peered":"2023-12-08T08:23:00.276929+0000","last_unstale":"2023-12-08T08:23:15.888742+0000","last_undegraded":"2023-12-08T08:23:15.888742+0000","last_fullsized":"2023-12-08T08:23:15.888742+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:55:36.390421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.908607+0000","last_change":"2023-12-08T08:23:16.908607+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.908607+0000","last_undegraded":"2023-12-08T08:23:16.908607+0000","last_fullsized":"2023-12-08T08:23:16.908607+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894617+0000","last_change":"2023-12-08T08:23:00.275837+0000","last_active":"2023-12-08T08:23:15.894617+0000","last_peered":"2023-12-08T08:23:15.894617+0000","last_clean":"2023-12-08T08:23:15.894617+0000","last_became_active":"2023-12-08T08:23:00.275561+0000","last_became_peered":"2023-12-08T08:23:00.275561+0000","last_unstale":"2023-12-08T08:23:15.894617+0000","last_undegraded":"2023-12-08T08:23:15.894617+0000","last_fullsized":"2023-12-08T08:23:15.894617+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.901924+0000","last_change":"2023-12-08T08:23:16.901924+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.901924+0000","last_undegraded":"2023-12-08T08:23:16.901924+0000","last_fullsized":"2023-12-08T08:23:16.901924+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883534+0000","last_change":"2023-12-08T08:23:00.295614+0000","last_active":"2023-12-08T08:23:15.883534+0000","last_peered":"2023-12-08T08:23:15.883534+0000","last_clean":"2023-12-08T08:23:15.883534+0000","last_became_active":"2023-12-08T08:23:00.295111+0000","last_became_peered":"2023-12-08T08:23:00.295111+0000","last_unstale":"2023-12-08T08:23:15.883534+0000","last_undegraded":"2023-12-08T08:23:15.883534+0000","last_fullsized":"2023-12-08T08:23:15.883534+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:10:16.885890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.907581+0000","last_change":"2023-12-08T08:23:16.907581+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.907581+0000","last_undegraded":"2023-12-08T08:23:16.907581+0000","last_fullsized":"2023-12-08T08:23:16.907581+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888024+0000","last_change":"2023-12-08T08:23:00.292909+0000","last_active":"2023-12-08T08:23:15.888024+0000","last_peered":"2023-12-08T08:23:15.888024+0000","last_clean":"2023-12-08T08:23:15.888024+0000","last_became_active":"2023-12-08T08:23:00.292500+0000","last_became_peered":"2023-12-08T08:23:00.292500+0000","last_unstale":"2023-12-08T08:23:15.888024+0000","last_undegraded":"2023-12-08T08:23:15.888024+0000","last_fullsized":"2023-12-08T08:23:15.888024+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:21:14.553932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.902396+0000","last_change":"2023-12-08T08:23:16.902396+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.902396+0000","last_undegraded":"2023-12-08T08:23:16.902396+0000","last_fullsized":"2023-12-08T08:23:16.902396+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885220+0000","last_change":"2023-12-08T08:23:00.273084+0000","last_active":"2023-12-08T08:23:15.885220+0000","last_peered":"2023-12-08T08:23:15.885220+0000","last_clean":"2023-12-08T08:23:15.885220+0000","last_became_active":"2023-12-08T08:23:00.272803+0000","last_became_peered":"2023-12-08T08:23:00.272803+0000","last_unstale":"2023-12-08T08:23:15.885220+0000","last_undegraded":"2023-12-08T08:23:15.885220+0000","last_fullsized":"2023-12-08T08:23:15.885220+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:16.068318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900173+0000","last_change":"2023-12-08T08:23:16.900173+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900173+0000","last_undegraded":"2023-12-08T08:23:16.900173+0000","last_fullsized":"2023-12-08T08:23:16.900173+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.886059+0000","last_change":"2023-12-08T08:23:00.300292+0000","last_active":"2023-12-08T08:23:15.886059+0000","last_peered":"2023-12-08T08:23:15.886059+0000","last_clean":"2023-12-08T08:23:15.886059+0000","last_became_active":"2023-12-08T08:23:00.300008+0000","last_became_peered":"2023-12-08T08:23:00.300008+0000","last_unstale":"2023-12-08T08:23:15.886059+0000","last_undegraded":"2023-12-08T08:23:15.886059+0000","last_fullsized":"2023-12-08T08:23:15.886059+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:39.385907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896360+0000","last_change":"2023-12-08T08:23:16.896360+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896360+0000","last_undegraded":"2023-12-08T08:23:16.896360+0000","last_fullsized":"2023-12-08T08:23:16.896360+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.884197+0000","last_change":"2023-12-08T08:23:00.299621+0000","last_active":"2023-12-08T08:23:15.884197+0000","last_peered":"2023-12-08T08:23:15.884197+0000","last_clean":"2023-12-08T08:23:15.884197+0000","last_became_active":"2023-12-08T08:23:00.299255+0000","last_became_peered":"2023-12-08T08:23:00.299255+0000","last_unstale":"2023-12-08T08:23:15.884197+0000","last_undegraded":"2023-12-08T08:23:15.884197+0000","last_fullsized":"2023-12-08T08:23:15.884197+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:28:46.845466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896496+0000","last_change":"2023-12-08T08:23:16.896496+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896496+0000","last_undegraded":"2023-12-08T08:23:16.896496+0000","last_fullsized":"2023-12-08T08:23:16.896496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.896102+0000","last_change":"2023-12-08T08:23:00.296010+0000","last_active":"2023-12-08T08:23:15.896102+0000","last_peered":"2023-12-08T08:23:15.896102+0000","last_clean":"2023-12-08T08:23:15.896102+0000","last_became_active":"2023-12-08T08:23:00.295749+0000","last_became_peered":"2023-12-08T08:23:00.295749+0000","last_unstale":"2023-12-08T08:23:15.896102+0000","last_undegraded":"2023-12-08T08:23:15.896102+0000","last_fullsized":"2023-12-08T08:23:15.896102+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:39.385907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.902160+0000","last_change":"2023-12-08T08:23:16.902160+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.902160+0000","last_undegraded":"2023-12-08T08:23:16.902160+0000","last_fullsized":"2023-12-08T08:23:16.902160+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.884023+0000","last_change":"2023-12-08T08:23:00.301831+0000","last_active":"2023-12-08T08:23:15.884023+0000","last_peered":"2023-12-08T08:23:15.884023+0000","last_clean":"2023-12-08T08:23:15.884023+0000","last_became_active":"2023-12-08T08:23:00.301321+0000","last_became_peered":"2023-12-08T08:23:00.301321+0000","last_unstale":"2023-12-08T08:23:15.884023+0000","last_undegraded":"2023-12-08T08:23:15.884023+0000","last_fullsized":"2023-12-08T08:23:15.884023+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:14:54.964832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.895365+0000","last_change":"2023-12-08T08:23:16.895365+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.895365+0000","last_undegraded":"2023-12-08T08:23:16.895365+0000","last_fullsized":"2023-12-08T08:23:16.895365+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883777+0000","last_change":"2023-12-08T08:23:00.301605+0000","last_active":"2023-12-08T08:23:15.883777+0000","last_peered":"2023-12-08T08:23:15.883777+0000","last_clean":"2023-12-08T08:23:15.883777+0000","last_became_active":"2023-12-08T08:23:00.301346+0000","last_became_peered":"2023-12-08T08:23:00.301346+0000","last_unstale":"2023-12-08T08:23:15.883777+0000","last_undegraded":"2023-12-08T08:23:15.883777+0000","last_fullsized":"2023-12-08T08:23:15.883777+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:35:35.139064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900505+0000","last_change":"2023-12-08T08:23:16.900505+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900505+0000","last_undegraded":"2023-12-08T08:23:16.900505+0000","last_fullsized":"2023-12-08T08:23:16.900505+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889839+0000","last_change":"2023-12-08T08:23:00.301440+0000","last_active":"2023-12-08T08:23:15.889839+0000","last_peered":"2023-12-08T08:23:15.889839+0000","last_clean":"2023-12-08T08:23:15.889839+0000","last_became_active":"2023-12-08T08:23:00.301156+0000","last_became_peered":"2023-12-08T08:23:00.301156+0000","last_unstale":"2023-12-08T08:23:15.889839+0000","last_undegraded":"2023-12-08T08:23:15.889839+0000","last_fullsized":"2023-12-08T08:23:15.889839+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:04:21.562137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900540+0000","last_change":"2023-12-08T08:23:16.900540+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900540+0000","last_undegraded":"2023-12-08T08:23:16.900540+0000","last_fullsized":"2023-12-08T08:23:16.900540+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888706+0000","last_change":"2023-12-08T08:23:00.301914+0000","last_active":"2023-12-08T08:23:15.888706+0000","last_peered":"2023-12-08T08:23:15.888706+0000","last_clean":"2023-12-08T08:23:15.888706+0000","last_became_active":"2023-12-08T08:23:00.301688+0000","last_became_peered":"2023-12-08T08:23:00.301688+0000","last_unstale":"2023-12-08T08:23:15.888706+0000","last_undegraded":"2023-12-08T08:23:15.888706+0000","last_fullsized":"2023-12-08T08:23:15.888706+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:27:39.303886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896058+0000","last_change":"2023-12-08T08:23:16.896058+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896058+0000","last_undegraded":"2023-12-08T08:23:16.896058+0000","last_fullsized":"2023-12-08T08:23:16.896058+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883508+0000","last_change":"2023-12-08T08:23:00.298664+0000","last_active":"2023-12-08T08:23:15.883508+0000","last_peered":"2023-12-08T08:23:15.883508+0000","last_clean":"2023-12-08T08:23:15.883508+0000","last_became_active":"2023-12-08T08:23:00.298341+0000","last_became_peered":"2023-12-08T08:23:00.298341+0000","last_unstale":"2023-12-08T08:23:15.883508+0000","last_undegraded":"2023-12-08T08:23:15.883508+0000","last_fullsized":"2023-12-08T08:23:15.883508+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:20:20.944416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900528+0000","last_change":"2023-12-08T08:23:16.900528+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900528+0000","last_undegraded":"2023-12-08T08:23:16.900528+0000","last_fullsized":"2023-12-08T08:23:16.900528+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.891893+0000","last_change":"2023-12-08T08:23:00.280235+0000","last_active":"2023-12-08T08:23:15.891893+0000","last_peered":"2023-12-08T08:23:15.891893+0000","last_clean":"2023-12-08T08:23:15.891893+0000","last_became_active":"2023-12-08T08:23:00.278807+0000","last_became_peered":"2023-12-08T08:23:00.278807+0000","last_unstale":"2023-12-08T08:23:15.891893+0000","last_undegraded":"2023-12-08T08:23:15.891893+0000","last_fullsized":"2023-12-08T08:23:15.891893+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:30:44.391621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.905250+0000","last_change":"2023-12-08T08:23:16.905250+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.905250+0000","last_undegraded":"2023-12-08T08:23:16.905250+0000","last_fullsized":"2023-12-08T08:23:16.905250+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895888+0000","last_change":"2023-12-08T08:23:00.278532+0000","last_active":"2023-12-08T08:23:15.895888+0000","last_peered":"2023-12-08T08:23:15.895888+0000","last_clean":"2023-12-08T08:23:15.895888+0000","last_became_active":"2023-12-08T08:23:00.278177+0000","last_became_peered":"2023-12-08T08:23:00.278177+0000","last_unstale":"2023-12-08T08:23:15.895888+0000","last_undegraded":"2023-12-08T08:23:15.895888+0000","last_fullsized":"2023-12-08T08:23:15.895888+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:56.216551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.905136+0000","last_change":"2023-12-08T08:23:16.905136+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.905136+0000","last_undegraded":"2023-12-08T08:23:16.905136+0000","last_fullsized":"2023-12-08T08:23:16.905136+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885639+0000","last_change":"2023-12-08T08:23:00.284090+0000","last_active":"2023-12-08T08:23:15.885639+0000","last_peered":"2023-12-08T08:23:15.885639+0000","last_clean":"2023-12-08T08:23:15.885639+0000","last_became_active":"2023-12-08T08:23:00.283777+0000","last_became_peered":"2023-12-08T08:23:00.283777+0000","last_unstale":"2023-12-08T08:23:15.885639+0000","last_undegraded":"2023-12-08T08:23:15.885639+0000","last_fullsized":"2023-12-08T08:23:15.885639+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896936+0000","last_change":"2023-12-08T08:23:16.896936+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896936+0000","last_undegraded":"2023-12-08T08:23:16.896936+0000","last_fullsized":"2023-12-08T08:23:16.896936+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888780+0000","last_change":"2023-12-08T08:23:00.277149+0000","last_active":"2023-12-08T08:23:15.888780+0000","last_peered":"2023-12-08T08:23:15.888780+0000","last_clean":"2023-12-08T08:23:15.888780+0000","last_became_active":"2023-12-08T08:23:00.276879+0000","last_became_peered":"2023-12-08T08:23:00.276879+0000","last_unstale":"2023-12-08T08:23:15.888780+0000","last_undegraded":"2023-12-08T08:23:15.888780+0000","last_fullsized":"2023-12-08T08:23:15.888780+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:16.068318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.901831+0000","last_change":"2023-12-08T08:23:16.901831+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.901831+0000","last_undegraded":"2023-12-08T08:23:16.901831+0000","last_fullsized":"2023-12-08T08:23:16.901831+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.890291+0000","last_change":"2023-12-08T08:23:00.294726+0000","last_active":"2023-12-08T08:23:15.890291+0000","last_peered":"2023-12-08T08:23:15.890291+0000","last_clean":"2023-12-08T08:23:15.890291+0000","last_became_active":"2023-12-08T08:23:00.294450+0000","last_became_peered":"2023-12-08T08:23:00.294450+0000","last_unstale":"2023-12-08T08:23:15.890291+0000","last_undegraded":"2023-12-08T08:23:15.890291+0000","last_fullsized":"2023-12-08T08:23:15.890291+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:28:25.934029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.895819+0000","last_change":"2023-12-08T08:23:16.895819+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.895819+0000","last_undegraded":"2023-12-08T08:23:16.895819+0000","last_fullsized":"2023-12-08T08:23:16.895819+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889918+0000","last_change":"2023-12-08T08:23:00.288804+0000","last_active":"2023-12-08T08:23:15.889918+0000","last_peered":"2023-12-08T08:23:15.889918+0000","last_clean":"2023-12-08T08:23:15.889918+0000","last_became_active":"2023-12-08T08:23:00.288315+0000","last_became_peered":"2023-12-08T08:23:00.288315+0000","last_unstale":"2023-12-08T08:23:15.889918+0000","last_undegraded":"2023-12-08T08:23:15.889918+0000","last_fullsized":"2023-12-08T08:23:15.889918+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:23:06.925359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.895362+0000","last_change":"2023-12-08T08:23:16.895362+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.895362+0000","last_undegraded":"2023-12-08T08:23:16.895362+0000","last_fullsized":"2023-12-08T08:23:16.895362+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885385+0000","last_change":"2023-12-08T08:23:00.294482+0000","last_active":"2023-12-08T08:23:15.885385+0000","last_peered":"2023-12-08T08:23:15.885385+0000","last_clean":"2023-12-08T08:23:15.885385+0000","last_became_active":"2023-12-08T08:23:00.294057+0000","last_became_peered":"2023-12-08T08:23:00.294057+0000","last_unstale":"2023-12-08T08:23:15.885385+0000","last_undegraded":"2023-12-08T08:23:15.885385+0000","last_fullsized":"2023-12-08T08:23:15.885385+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:42:20.038693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.898306+0000","last_change":"2023-12-08T08:23:16.898306+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.898306+0000","last_undegraded":"2023-12-08T08:23:16.898306+0000","last_fullsized":"2023-12-08T08:23:16.898306+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888263+0000","last_change":"2023-12-08T08:23:00.272949+0000","last_active":"2023-12-08T08:23:15.888263+0000","last_peered":"2023-12-08T08:23:15.888263+0000","last_clean":"2023-12-08T08:23:15.888263+0000","last_became_active":"2023-12-08T08:23:00.272655+0000","last_became_peered":"2023-12-08T08:23:00.272655+0000","last_unstale":"2023-12-08T08:23:15.888263+0000","last_undegraded":"2023-12-08T08:23:15.888263+0000","last_fullsized":"2023-12-08T08:23:15.888263+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:28.275394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.897379+0000","last_change":"2023-12-08T08:23:16.897379+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.897379+0000","last_undegraded":"2023-12-08T08:23:16.897379+0000","last_fullsized":"2023-12-08T08:23:16.897379+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.921665+0000","last_change":"2023-12-08T08:23:16.917024+0000","last_active":"2023-12-08T08:23:16.921665+0000","last_peered":"2023-12-08T08:23:16.921665+0000","last_clean":"2023-12-08T08:23:16.921665+0000","last_became_active":"2023-12-08T08:23:16.916776+0000","last_became_peered":"2023-12-08T08:23:16.916776+0000","last_unstale":"2023-12-08T08:23:16.921665+0000","last_undegraded":"2023-12-08T08:23:16.921665+0000","last_fullsized":"2023-12-08T08:23:16.921665+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:14:23.904816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885919+0000","last_change":"2023-12-08T08:23:00.273779+0000","last_active":"2023-12-08T08:23:15.885919+0000","last_peered":"2023-12-08T08:23:15.885919+0000","last_clean":"2023-12-08T08:23:15.885919+0000","last_became_active":"2023-12-08T08:23:00.273256+0000","last_became_peered":"2023-12-08T08:23:00.273256+0000","last_unstale":"2023-12-08T08:23:15.885919+0000","last_undegraded":"2023-12-08T08:23:15.885919+0000","last_fullsized":"2023-12-08T08:23:15.885919+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"67'4","reported_seq":18,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889446+0000","last_change":"2023-12-08T08:22:59.285668+0000","last_active":"2023-12-08T08:23:15.889446+0000","last_peered":"2023-12-08T08:23:15.889446+0000","last_clean":"2023-12-08T08:23:15.889446+0000","last_became_active":"2023-12-08T08:22:59.285340+0000","last_became_peered":"2023-12-08T08:22:59.285340+0000","last_unstale":"2023-12-08T08:23:15.889446+0000","last_undegraded":"2023-12-08T08:23:15.889446+0000","last_fullsized":"2023-12-08T08:23:15.889446+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:35:15.000491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.895648+0000","last_change":"2023-12-08T08:23:16.895648+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.895648+0000","last_undegraded":"2023-12-08T08:23:16.895648+0000","last_fullsized":"2023-12-08T08:23:16.895648+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.911983+0000","last_change":"2023-12-08T08:23:16.905712+0000","last_active":"2023-12-08T08:23:16.911983+0000","last_peered":"2023-12-08T08:23:16.911983+0000","last_clean":"2023-12-08T08:23:16.911983+0000","last_became_active":"2023-12-08T08:23:16.905399+0000","last_became_peered":"2023-12-08T08:23:16.905399+0000","last_unstale":"2023-12-08T08:23:16.911983+0000","last_undegraded":"2023-12-08T08:23:16.911983+0000","last_fullsized":"2023-12-08T08:23:16.911983+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:10:23.005533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889328+0000","last_change":"2023-12-08T08:23:00.300874+0000","last_active":"2023-12-08T08:23:15.889328+0000","last_peered":"2023-12-08T08:23:15.889328+0000","last_clean":"2023-12-08T08:23:15.889328+0000","last_became_active":"2023-12-08T08:23:00.300595+0000","last_became_peered":"2023-12-08T08:23:00.300595+0000","last_unstale":"2023-12-08T08:23:15.889328+0000","last_undegraded":"2023-12-08T08:23:15.889328+0000","last_fullsized":"2023-12-08T08:23:15.889328+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"67'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.886098+0000","last_change":"2023-12-08T08:22:59.274595+0000","last_active":"2023-12-08T08:23:15.886098+0000","last_peered":"2023-12-08T08:23:15.886098+0000","last_clean":"2023-12-08T08:23:15.886098+0000","last_became_active":"2023-12-08T08:22:59.274280+0000","last_became_peered":"2023-12-08T08:22:59.274280+0000","last_unstale":"2023-12-08T08:23:15.886098+0000","last_undegraded":"2023-12-08T08:23:15.886098+0000","last_fullsized":"2023-12-08T08:23:15.886098+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:27.267774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.899707+0000","last_change":"2023-12-08T08:23:16.899707+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.899707+0000","last_undegraded":"2023-12-08T08:23:16.899707+0000","last_fullsized":"2023-12-08T08:23:16.899707+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920597+0000","last_change":"2023-12-08T08:23:16.915200+0000","last_active":"2023-12-08T08:23:16.920597+0000","last_peered":"2023-12-08T08:23:16.920597+0000","last_clean":"2023-12-08T08:23:16.920597+0000","last_became_active":"2023-12-08T08:23:16.914766+0000","last_became_peered":"2023-12-08T08:23:16.914766+0000","last_unstale":"2023-12-08T08:23:16.920597+0000","last_undegraded":"2023-12-08T08:23:16.920597+0000","last_fullsized":"2023-12-08T08:23:16.920597+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:53:48.202811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888831+0000","last_change":"2023-12-08T08:23:00.280594+0000","last_active":"2023-12-08T08:23:15.888831+0000","last_peered":"2023-12-08T08:23:15.888831+0000","last_clean":"2023-12-08T08:23:15.888831+0000","last_became_active":"2023-12-08T08:23:00.279794+0000","last_became_peered":"2023-12-08T08:23:00.279794+0000","last_unstale":"2023-12-08T08:23:15.888831+0000","last_undegraded":"2023-12-08T08:23:15.888831+0000","last_fullsized":"2023-12-08T08:23:15.888831+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:33.905575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"67'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.896121+0000","last_change":"2023-12-08T08:22:59.282892+0000","last_active":"2023-12-08T08:23:15.896121+0000","last_peered":"2023-12-08T08:23:15.896121+0000","last_clean":"2023-12-08T08:23:15.896121+0000","last_became_active":"2023-12-08T08:22:59.282172+0000","last_became_peered":"2023-12-08T08:22:59.282172+0000","last_unstale":"2023-12-08T08:23:15.896121+0000","last_undegraded":"2023-12-08T08:23:15.896121+0000","last_fullsized":"2023-12-08T08:23:15.896121+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:32.890517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.902603+0000","last_change":"2023-12-08T08:23:16.902603+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.902603+0000","last_undegraded":"2023-12-08T08:23:16.902603+0000","last_fullsized":"2023-12-08T08:23:16.902603+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920546+0000","last_change":"2023-12-08T08:23:16.917813+0000","last_active":"2023-12-08T08:23:16.920546+0000","last_peered":"2023-12-08T08:23:16.920546+0000","last_clean":"2023-12-08T08:23:16.920546+0000","last_became_active":"2023-12-08T08:23:16.917358+0000","last_became_peered":"2023-12-08T08:23:16.917358+0000","last_unstale":"2023-12-08T08:23:16.920546+0000","last_undegraded":"2023-12-08T08:23:16.920546+0000","last_fullsized":"2023-12-08T08:23:16.920546+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:18:49.227732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895498+0000","last_change":"2023-12-08T08:23:00.304580+0000","last_active":"2023-12-08T08:23:15.895498+0000","last_peered":"2023-12-08T08:23:15.895498+0000","last_clean":"2023-12-08T08:23:15.895498+0000","last_became_active":"2023-12-08T08:23:00.304098+0000","last_became_peered":"2023-12-08T08:23:00.304098+0000","last_unstale":"2023-12-08T08:23:15.895498+0000","last_undegraded":"2023-12-08T08:23:15.895498+0000","last_fullsized":"2023-12-08T08:23:15.895498+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:29:03.020360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"67'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895935+0000","last_change":"2023-12-08T08:22:59.283290+0000","last_active":"2023-12-08T08:23:15.895935+0000","last_peered":"2023-12-08T08:23:15.895935+0000","last_clean":"2023-12-08T08:23:15.895935+0000","last_became_active":"2023-12-08T08:22:59.282103+0000","last_became_peered":"2023-12-08T08:22:59.282103+0000","last_unstale":"2023-12-08T08:23:15.895935+0000","last_undegraded":"2023-12-08T08:23:15.895935+0000","last_fullsized":"2023-12-08T08:23:15.895935+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:15.256488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.903785+0000","last_change":"2023-12-08T08:23:16.903785+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.903785+0000","last_undegraded":"2023-12-08T08:23:16.903785+0000","last_fullsized":"2023-12-08T08:23:16.903785+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.919943+0000","last_change":"2023-12-08T08:23:16.916123+0000","last_active":"2023-12-08T08:23:16.919943+0000","last_peered":"2023-12-08T08:23:16.919943+0000","last_clean":"2023-12-08T08:23:16.919943+0000","last_became_active":"2023-12-08T08:23:16.915147+0000","last_became_peered":"2023-12-08T08:23:16.915147+0000","last_unstale":"2023-12-08T08:23:16.919943+0000","last_undegraded":"2023-12-08T08:23:16.919943+0000","last_fullsized":"2023-12-08T08:23:16.919943+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:48:31.917542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.890002+0000","last_change":"2023-12-08T08:23:00.288605+0000","last_active":"2023-12-08T08:23:15.890002+0000","last_peered":"2023-12-08T08:23:15.890002+0000","last_clean":"2023-12-08T08:23:15.890002+0000","last_became_active":"2023-12-08T08:23:00.287910+0000","last_became_peered":"2023-12-08T08:23:00.287910+0000","last_unstale":"2023-12-08T08:23:15.890002+0000","last_undegraded":"2023-12-08T08:23:15.890002+0000","last_fullsized":"2023-12-08T08:23:15.890002+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:55.193260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"67'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885593+0000","last_change":"2023-12-08T08:22:59.267027+0000","last_active":"2023-12-08T08:23:15.885593+0000","last_peered":"2023-12-08T08:23:15.885593+0000","last_clean":"2023-12-08T08:23:15.885593+0000","last_became_active":"2023-12-08T08:22:59.265676+0000","last_became_peered":"2023-12-08T08:22:59.265676+0000","last_unstale":"2023-12-08T08:23:15.885593+0000","last_undegraded":"2023-12-08T08:23:15.885593+0000","last_fullsized":"2023-12-08T08:23:15.885593+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:19.279362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.894564+0000","last_change":"2023-12-08T08:23:16.894564+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.894564+0000","last_undegraded":"2023-12-08T08:23:16.894564+0000","last_fullsized":"2023-12-08T08:23:16.894564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.921704+0000","last_change":"2023-12-08T08:23:16.918070+0000","last_active":"2023-12-08T08:23:16.921704+0000","last_peered":"2023-12-08T08:23:16.921704+0000","last_clean":"2023-12-08T08:23:16.921704+0000","last_became_active":"2023-12-08T08:23:16.917808+0000","last_became_peered":"2023-12-08T08:23:16.917808+0000","last_unstale":"2023-12-08T08:23:16.921704+0000","last_undegraded":"2023-12-08T08:23:16.921704+0000","last_fullsized":"2023-12-08T08:23:16.921704+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:35:32.637419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885437+0000","last_change":"2023-12-08T08:23:00.300280+0000","last_active":"2023-12-08T08:23:15.885437+0000","last_peered":"2023-12-08T08:23:15.885437+0000","last_clean":"2023-12-08T08:23:15.885437+0000","last_became_active":"2023-12-08T08:23:00.299998+0000","last_became_peered":"2023-12-08T08:23:00.299998+0000","last_unstale":"2023-12-08T08:23:15.885437+0000","last_undegraded":"2023-12-08T08:23:15.885437+0000","last_fullsized":"2023-12-08T08:23:15.885437+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:15.472021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"67'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885466+0000","last_change":"2023-12-08T08:22:59.274800+0000","last_active":"2023-12-08T08:23:15.885466+0000","last_peered":"2023-12-08T08:23:15.885466+0000","last_clean":"2023-12-08T08:23:15.885466+0000","last_became_active":"2023-12-08T08:22:59.274501+0000","last_became_peered":"2023-12-08T08:22:59.274501+0000","last_unstale":"2023-12-08T08:23:15.885466+0000","last_undegraded":"2023-12-08T08:23:15.885466+0000","last_fullsized":"2023-12-08T08:23:15.885466+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:54.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.901187+0000","last_change":"2023-12-08T08:23:16.901187+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.901187+0000","last_undegraded":"2023-12-08T08:23:16.901187+0000","last_fullsized":"2023-12-08T08:23:16.901187+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.918634+0000","last_change":"2023-12-08T08:23:16.915536+0000","last_active":"2023-12-08T08:23:16.918634+0000","last_peered":"2023-12-08T08:23:16.918634+0000","last_clean":"2023-12-08T08:23:16.918634+0000","last_became_active":"2023-12-08T08:23:16.915216+0000","last_became_peered":"2023-12-08T08:23:16.915216+0000","last_unstale":"2023-12-08T08:23:16.918634+0000","last_undegraded":"2023-12-08T08:23:16.918634+0000","last_fullsized":"2023-12-08T08:23:16.918634+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:18:18.945931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894156+0000","last_change":"2023-12-08T08:23:00.298811+0000","last_active":"2023-12-08T08:23:15.894156+0000","last_peered":"2023-12-08T08:23:15.894156+0000","last_clean":"2023-12-08T08:23:15.894156+0000","last_became_active":"2023-12-08T08:23:00.298524+0000","last_became_peered":"2023-12-08T08:23:00.298524+0000","last_unstale":"2023-12-08T08:23:15.894156+0000","last_undegraded":"2023-12-08T08:23:15.894156+0000","last_fullsized":"2023-12-08T08:23:15.894156+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895609+0000","last_change":"2023-12-08T08:22:59.274339+0000","last_active":"2023-12-08T08:23:15.895609+0000","last_peered":"2023-12-08T08:23:15.895609+0000","last_clean":"2023-12-08T08:23:15.895609+0000","last_became_active":"2023-12-08T08:22:59.272932+0000","last_became_peered":"2023-12-08T08:22:59.272932+0000","last_unstale":"2023-12-08T08:23:15.895609+0000","last_undegraded":"2023-12-08T08:23:15.895609+0000","last_fullsized":"2023-12-08T08:23:15.895609+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:14.464401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.901110+0000","last_change":"2023-12-08T08:23:16.901110+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.901110+0000","last_undegraded":"2023-12-08T08:23:16.901110+0000","last_fullsized":"2023-12-08T08:23:16.901110+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.913617+0000","last_change":"2023-12-08T08:23:16.907865+0000","last_active":"2023-12-08T08:23:16.913617+0000","last_peered":"2023-12-08T08:23:16.913617+0000","last_clean":"2023-12-08T08:23:16.913617+0000","last_became_active":"2023-12-08T08:23:16.907610+0000","last_became_peered":"2023-12-08T08:23:16.907610+0000","last_unstale":"2023-12-08T08:23:16.913617+0000","last_undegraded":"2023-12-08T08:23:16.913617+0000","last_fullsized":"2023-12-08T08:23:16.913617+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:03:24.914390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888104+0000","last_change":"2023-12-08T08:23:00.292745+0000","last_active":"2023-12-08T08:23:15.888104+0000","last_peered":"2023-12-08T08:23:15.888104+0000","last_clean":"2023-12-08T08:23:15.888104+0000","last_became_active":"2023-12-08T08:23:00.292132+0000","last_became_peered":"2023-12-08T08:23:00.292132+0000","last_unstale":"2023-12-08T08:23:15.888104+0000","last_undegraded":"2023-12-08T08:23:15.888104+0000","last_fullsized":"2023-12-08T08:23:15.888104+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:13.139346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.890037+0000","last_change":"2023-12-08T08:22:59.268769+0000","last_active":"2023-12-08T08:23:15.890037+0000","last_peered":"2023-12-08T08:23:15.890037+0000","last_clean":"2023-12-08T08:23:15.890037+0000","last_became_active":"2023-12-08T08:22:59.268494+0000","last_became_peered":"2023-12-08T08:22:59.268494+0000","last_unstale":"2023-12-08T08:23:15.890037+0000","last_undegraded":"2023-12-08T08:23:15.890037+0000","last_fullsized":"2023-12-08T08:23:15.890037+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:56:23.131251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.905977+0000","last_change":"2023-12-08T08:23:16.905977+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.905977+0000","last_undegraded":"2023-12-08T08:23:16.905977+0000","last_fullsized":"2023-12-08T08:23:16.905977+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920561+0000","last_change":"2023-12-08T08:23:16.918296+0000","last_active":"2023-12-08T08:23:16.920561+0000","last_peered":"2023-12-08T08:23:16.920561+0000","last_clean":"2023-12-08T08:23:16.920561+0000","last_became_active":"2023-12-08T08:23:16.917917+0000","last_became_peered":"2023-12-08T08:23:16.917917+0000","last_unstale":"2023-12-08T08:23:16.920561+0000","last_undegraded":"2023-12-08T08:23:16.920561+0000","last_fullsized":"2023-12-08T08:23:16.920561+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:16:38.108739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.890630+0000","last_change":"2023-12-08T08:23:00.275783+0000","last_active":"2023-12-08T08:23:15.890630+0000","last_peered":"2023-12-08T08:23:15.890630+0000","last_clean":"2023-12-08T08:23:15.890630+0000","last_became_active":"2023-12-08T08:23:00.275444+0000","last_became_peered":"2023-12-08T08:23:00.275444+0000","last_unstale":"2023-12-08T08:23:15.890630+0000","last_undegraded":"2023-12-08T08:23:15.890630+0000","last_fullsized":"2023-12-08T08:23:15.890630+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:56:00.436152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889577+0000","last_change":"2023-12-08T08:22:59.280443+0000","last_active":"2023-12-08T08:23:15.889577+0000","last_peered":"2023-12-08T08:23:15.889577+0000","last_clean":"2023-12-08T08:23:15.889577+0000","last_became_active":"2023-12-08T08:22:59.280138+0000","last_became_peered":"2023-12-08T08:22:59.280138+0000","last_unstale":"2023-12-08T08:23:15.889577+0000","last_undegraded":"2023-12-08T08:23:15.889577+0000","last_fullsized":"2023-12-08T08:23:15.889577+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:13:21.524504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.906770+0000","last_change":"2023-12-08T08:23:16.906770+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.906770+0000","last_undegraded":"2023-12-08T08:23:16.906770+0000","last_fullsized":"2023-12-08T08:23:16.906770+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.914455+0000","last_change":"2023-12-08T08:23:16.913111+0000","last_active":"2023-12-08T08:23:16.914455+0000","last_peered":"2023-12-08T08:23:16.914455+0000","last_clean":"2023-12-08T08:23:16.914455+0000","last_became_active":"2023-12-08T08:23:16.912617+0000","last_became_peered":"2023-12-08T08:23:16.912617+0000","last_unstale":"2023-12-08T08:23:16.914455+0000","last_undegraded":"2023-12-08T08:23:16.914455+0000","last_fullsized":"2023-12-08T08:23:16.914455+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:56:17.065460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895873+0000","last_change":"2023-12-08T08:23:00.304825+0000","last_active":"2023-12-08T08:23:15.895873+0000","last_peered":"2023-12-08T08:23:15.895873+0000","last_clean":"2023-12-08T08:23:15.895873+0000","last_became_active":"2023-12-08T08:23:00.304549+0000","last_became_peered":"2023-12-08T08:23:00.304549+0000","last_unstale":"2023-12-08T08:23:15.895873+0000","last_undegraded":"2023-12-08T08:23:15.895873+0000","last_fullsized":"2023-12-08T08:23:15.895873+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889328+0000","last_change":"2023-12-08T08:22:59.283795+0000","last_active":"2023-12-08T08:23:15.889328+0000","last_peered":"2023-12-08T08:23:15.889328+0000","last_clean":"2023-12-08T08:23:15.889328+0000","last_became_active":"2023-12-08T08:22:59.283486+0000","last_became_peered":"2023-12-08T08:22:59.283486+0000","last_unstale":"2023-12-08T08:23:15.889328+0000","last_undegraded":"2023-12-08T08:23:15.889328+0000","last_fullsized":"2023-12-08T08:23:15.889328+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:30:43.384001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896383+0000","last_change":"2023-12-08T08:23:16.896383+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896383+0000","last_undegraded":"2023-12-08T08:23:16.896383+0000","last_fullsized":"2023-12-08T08:23:16.896383+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.917021+0000","last_change":"2023-12-08T08:23:16.913609+0000","last_active":"2023-12-08T08:23:16.917021+0000","last_peered":"2023-12-08T08:23:16.917021+0000","last_clean":"2023-12-08T08:23:16.917021+0000","last_became_active":"2023-12-08T08:23:16.913308+0000","last_became_peered":"2023-12-08T08:23:16.913308+0000","last_unstale":"2023-12-08T08:23:16.917021+0000","last_undegraded":"2023-12-08T08:23:16.917021+0000","last_fullsized":"2023-12-08T08:23:16.917021+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:13:39.161432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895820+0000","last_change":"2023-12-08T08:23:00.293145+0000","last_active":"2023-12-08T08:23:15.895820+0000","last_peered":"2023-12-08T08:23:15.895820+0000","last_clean":"2023-12-08T08:23:15.895820+0000","last_became_active":"2023-12-08T08:23:00.292927+0000","last_became_peered":"2023-12-08T08:23:00.292927+0000","last_unstale":"2023-12-08T08:23:15.895820+0000","last_undegraded":"2023-12-08T08:23:15.895820+0000","last_fullsized":"2023-12-08T08:23:15.895820+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:56.216551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"67'3","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889145+0000","last_change":"2023-12-08T08:22:59.281141+0000","last_active":"2023-12-08T08:23:15.889145+0000","last_peered":"2023-12-08T08:23:15.889145+0000","last_clean":"2023-12-08T08:23:15.889145+0000","last_became_active":"2023-12-08T08:22:59.280748+0000","last_became_peered":"2023-12-08T08:22:59.280748+0000","last_unstale":"2023-12-08T08:23:15.889145+0000","last_undegraded":"2023-12-08T08:23:15.889145+0000","last_fullsized":"2023-12-08T08:23:15.889145+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:07:33.922762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.895287+0000","last_change":"2023-12-08T08:23:16.895287+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.895287+0000","last_undegraded":"2023-12-08T08:23:16.895287+0000","last_fullsized":"2023-12-08T08:23:16.895287+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.923465+0000","last_change":"2023-12-08T08:23:16.921554+0000","last_active":"2023-12-08T08:23:16.923465+0000","last_peered":"2023-12-08T08:23:16.923465+0000","last_clean":"2023-12-08T08:23:16.923465+0000","last_became_active":"2023-12-08T08:23:16.920531+0000","last_became_peered":"2023-12-08T08:23:16.920531+0000","last_unstale":"2023-12-08T08:23:16.923465+0000","last_undegraded":"2023-12-08T08:23:16.923465+0000","last_fullsized":"2023-12-08T08:23:16.923465+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:32:01.183284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885675+0000","last_change":"2023-12-08T08:23:00.299179+0000","last_active":"2023-12-08T08:23:15.885675+0000","last_peered":"2023-12-08T08:23:15.885675+0000","last_clean":"2023-12-08T08:23:15.885675+0000","last_became_active":"2023-12-08T08:23:00.298936+0000","last_became_peered":"2023-12-08T08:23:00.298936+0000","last_unstale":"2023-12-08T08:23:15.885675+0000","last_undegraded":"2023-12-08T08:23:15.885675+0000","last_fullsized":"2023-12-08T08:23:15.885675+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"68'8","reported_seq":22,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895665+0000","last_change":"2023-12-08T08:22:59.278612+0000","last_active":"2023-12-08T08:23:15.895665+0000","last_peered":"2023-12-08T08:23:15.895665+0000","last_clean":"2023-12-08T08:23:15.895665+0000","last_became_active":"2023-12-08T08:22:59.278325+0000","last_became_peered":"2023-12-08T08:22:59.278325+0000","last_unstale":"2023-12-08T08:23:15.895665+0000","last_undegraded":"2023-12-08T08:23:15.895665+0000","last_fullsized":"2023-12-08T08:23:15.895665+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:55:35.382801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.894542+0000","last_change":"2023-12-08T08:23:16.894542+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.894542+0000","last_undegraded":"2023-12-08T08:23:16.894542+0000","last_fullsized":"2023-12-08T08:23:16.894542+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920008+0000","last_change":"2023-12-08T08:23:16.915913+0000","last_active":"2023-12-08T08:23:16.920008+0000","last_peered":"2023-12-08T08:23:16.920008+0000","last_clean":"2023-12-08T08:23:16.920008+0000","last_became_active":"2023-12-08T08:23:16.915513+0000","last_became_peered":"2023-12-08T08:23:16.915513+0000","last_unstale":"2023-12-08T08:23:16.920008+0000","last_undegraded":"2023-12-08T08:23:16.920008+0000","last_fullsized":"2023-12-08T08:23:16.920008+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:29.768654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895664+0000","last_change":"2023-12-08T08:23:00.292867+0000","last_active":"2023-12-08T08:23:15.895664+0000","last_peered":"2023-12-08T08:23:15.895664+0000","last_clean":"2023-12-08T08:23:15.895664+0000","last_became_active":"2023-12-08T08:23:00.292648+0000","last_became_peered":"2023-12-08T08:23:00.292648+0000","last_unstale":"2023-12-08T08:23:15.895664+0000","last_undegraded":"2023-12-08T08:23:15.895664+0000","last_fullsized":"2023-12-08T08:23:15.895664+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:29:03.020360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"67'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.891587+0000","last_change":"2023-12-08T08:22:59.262821+0000","last_active":"2023-12-08T08:23:15.891587+0000","last_peered":"2023-12-08T08:23:15.891587+0000","last_clean":"2023-12-08T08:23:15.891587+0000","last_became_active":"2023-12-08T08:22:59.262569+0000","last_became_peered":"2023-12-08T08:22:59.262569+0000","last_unstale":"2023-12-08T08:23:15.891587+0000","last_undegraded":"2023-12-08T08:23:15.891587+0000","last_fullsized":"2023-12-08T08:23:15.891587+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:52:55.751217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.898771+0000","last_change":"2023-12-08T08:23:16.898771+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.898771+0000","last_undegraded":"2023-12-08T08:23:16.898771+0000","last_fullsized":"2023-12-08T08:23:16.898771+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.909363+0000","last_change":"2023-12-08T08:23:16.907121+0000","last_active":"2023-12-08T08:23:16.909363+0000","last_peered":"2023-12-08T08:23:16.909363+0000","last_clean":"2023-12-08T08:23:16.909363+0000","last_became_active":"2023-12-08T08:23:16.906517+0000","last_became_peered":"2023-12-08T08:23:16.906517+0000","last_unstale":"2023-12-08T08:23:16.909363+0000","last_undegraded":"2023-12-08T08:23:16.909363+0000","last_fullsized":"2023-12-08T08:23:16.909363+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:44:54.050763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894551+0000","last_change":"2023-12-08T08:23:00.298706+0000","last_active":"2023-12-08T08:23:15.894551+0000","last_peered":"2023-12-08T08:23:15.894551+0000","last_clean":"2023-12-08T08:23:15.894551+0000","last_became_active":"2023-12-08T08:23:00.298452+0000","last_became_peered":"2023-12-08T08:23:00.298452+0000","last_unstale":"2023-12-08T08:23:15.894551+0000","last_undegraded":"2023-12-08T08:23:15.894551+0000","last_fullsized":"2023-12-08T08:23:15.894551+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:39.385907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888371+0000","last_change":"2023-12-08T08:22:59.270322+0000","last_active":"2023-12-08T08:23:15.888371+0000","last_peered":"2023-12-08T08:23:15.888371+0000","last_clean":"2023-12-08T08:23:15.888371+0000","last_became_active":"2023-12-08T08:22:59.270059+0000","last_became_peered":"2023-12-08T08:22:59.270059+0000","last_unstale":"2023-12-08T08:23:15.888371+0000","last_undegraded":"2023-12-08T08:23:15.888371+0000","last_fullsized":"2023-12-08T08:23:15.888371+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:21:58.531919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.902866+0000","last_change":"2023-12-08T08:23:16.902866+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.902866+0000","last_undegraded":"2023-12-08T08:23:16.902866+0000","last_fullsized":"2023-12-08T08:23:16.902866+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920648+0000","last_change":"2023-12-08T08:23:16.914697+0000","last_active":"2023-12-08T08:23:16.920648+0000","last_peered":"2023-12-08T08:23:16.920648+0000","last_clean":"2023-12-08T08:23:16.920648+0000","last_became_active":"2023-12-08T08:23:16.914346+0000","last_became_peered":"2023-12-08T08:23:16.914346+0000","last_unstale":"2023-12-08T08:23:16.920648+0000","last_undegraded":"2023-12-08T08:23:16.920648+0000","last_fullsized":"2023-12-08T08:23:16.920648+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:08:11.306339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889955+0000","last_change":"2023-12-08T08:23:00.304324+0000","last_active":"2023-12-08T08:23:15.889955+0000","last_peered":"2023-12-08T08:23:15.889955+0000","last_clean":"2023-12-08T08:23:15.889955+0000","last_became_active":"2023-12-08T08:23:00.304038+0000","last_became_peered":"2023-12-08T08:23:00.304038+0000","last_unstale":"2023-12-08T08:23:15.889955+0000","last_undegraded":"2023-12-08T08:23:15.889955+0000","last_fullsized":"2023-12-08T08:23:15.889955+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:33:27.464394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894314+0000","last_change":"2023-12-08T08:22:59.270216+0000","last_active":"2023-12-08T08:23:15.894314+0000","last_peered":"2023-12-08T08:23:15.894314+0000","last_clean":"2023-12-08T08:23:15.894314+0000","last_became_active":"2023-12-08T08:22:59.269292+0000","last_became_peered":"2023-12-08T08:22:59.269292+0000","last_unstale":"2023-12-08T08:23:15.894314+0000","last_undegraded":"2023-12-08T08:23:15.894314+0000","last_fullsized":"2023-12-08T08:23:15.894314+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:18:01.309002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.899876+0000","last_change":"2023-12-08T08:23:16.899876+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.899876+0000","last_undegraded":"2023-12-08T08:23:16.899876+0000","last_fullsized":"2023-12-08T08:23:16.899876+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.916944+0000","last_change":"2023-12-08T08:23:16.910717+0000","last_active":"2023-12-08T08:23:16.916944+0000","last_peered":"2023-12-08T08:23:16.916944+0000","last_clean":"2023-12-08T08:23:16.916944+0000","last_became_active":"2023-12-08T08:23:16.910457+0000","last_became_peered":"2023-12-08T08:23:16.910457+0000","last_unstale":"2023-12-08T08:23:16.916944+0000","last_undegraded":"2023-12-08T08:23:16.916944+0000","last_fullsized":"2023-12-08T08:23:16.916944+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:53:13.388145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889558+0000","last_change":"2023-12-08T08:23:00.276305+0000","last_active":"2023-12-08T08:23:15.889558+0000","last_peered":"2023-12-08T08:23:15.889558+0000","last_clean":"2023-12-08T08:23:15.889558+0000","last_became_active":"2023-12-08T08:23:00.275989+0000","last_became_peered":"2023-12-08T08:23:00.275989+0000","last_unstale":"2023-12-08T08:23:15.889558+0000","last_undegraded":"2023-12-08T08:23:15.889558+0000","last_fullsized":"2023-12-08T08:23:15.889558+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:24:33.735501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"67'8","reported_seq":22,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894492+0000","last_change":"2023-12-08T08:22:59.271542+0000","last_active":"2023-12-08T08:23:15.894492+0000","last_peered":"2023-12-08T08:23:15.894492+0000","last_clean":"2023-12-08T08:23:15.894492+0000","last_became_active":"2023-12-08T08:22:59.271240+0000","last_became_peered":"2023-12-08T08:22:59.271240+0000","last_unstale":"2023-12-08T08:23:15.894492+0000","last_undegraded":"2023-12-08T08:23:15.894492+0000","last_fullsized":"2023-12-08T08:23:15.894492+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:32.897955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.901826+0000","last_change":"2023-12-08T08:23:16.901826+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.901826+0000","last_undegraded":"2023-12-08T08:23:16.901826+0000","last_fullsized":"2023-12-08T08:23:16.901826+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.919862+0000","last_change":"2023-12-08T08:23:16.915441+0000","last_active":"2023-12-08T08:23:16.919862+0000","last_peered":"2023-12-08T08:23:16.919862+0000","last_clean":"2023-12-08T08:23:16.919862+0000","last_became_active":"2023-12-08T08:23:16.915074+0000","last_became_peered":"2023-12-08T08:23:16.915074+0000","last_unstale":"2023-12-08T08:23:16.919862+0000","last_undegraded":"2023-12-08T08:23:16.919862+0000","last_fullsized":"2023-12-08T08:23:16.919862+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:33:12.118405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895946+0000","last_change":"2023-12-08T08:23:00.280374+0000","last_active":"2023-12-08T08:23:15.895946+0000","last_peered":"2023-12-08T08:23:15.895946+0000","last_clean":"2023-12-08T08:23:15.895946+0000","last_became_active":"2023-12-08T08:23:00.280096+0000","last_became_peered":"2023-12-08T08:23:00.280096+0000","last_unstale":"2023-12-08T08:23:15.895946+0000","last_undegraded":"2023-12-08T08:23:15.895946+0000","last_fullsized":"2023-12-08T08:23:15.895946+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:21:59.539539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"67'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889718+0000","last_change":"2023-12-08T08:22:59.283727+0000","last_active":"2023-12-08T08:23:15.889718+0000","last_peered":"2023-12-08T08:23:15.889718+0000","last_clean":"2023-12-08T08:23:15.889718+0000","last_became_active":"2023-12-08T08:22:59.283254+0000","last_became_peered":"2023-12-08T08:22:59.283254+0000","last_unstale":"2023-12-08T08:23:15.889718+0000","last_undegraded":"2023-12-08T08:23:15.889718+0000","last_fullsized":"2023-12-08T08:23:15.889718+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:18:01.309002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.902834+0000","last_change":"2023-12-08T08:23:16.902834+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.902834+0000","last_undegraded":"2023-12-08T08:23:16.902834+0000","last_fullsized":"2023-12-08T08:23:16.902834+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.909444+0000","last_change":"2023-12-08T08:23:16.901347+0000","last_active":"2023-12-08T08:23:16.909444+0000","last_peered":"2023-12-08T08:23:16.909444+0000","last_clean":"2023-12-08T08:23:16.909444+0000","last_became_active":"2023-12-08T08:23:16.901041+0000","last_became_peered":"2023-12-08T08:23:16.901041+0000","last_unstale":"2023-12-08T08:23:16.909444+0000","last_undegraded":"2023-12-08T08:23:16.909444+0000","last_fullsized":"2023-12-08T08:23:16.909444+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:16:38.108739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889393+0000","last_change":"2023-12-08T08:23:00.282901+0000","last_active":"2023-12-08T08:23:15.889393+0000","last_peered":"2023-12-08T08:23:15.889393+0000","last_clean":"2023-12-08T08:23:15.889393+0000","last_became_active":"2023-12-08T08:23:00.282646+0000","last_became_peered":"2023-12-08T08:23:00.282646+0000","last_unstale":"2023-12-08T08:23:15.889393+0000","last_undegraded":"2023-12-08T08:23:15.889393+0000","last_fullsized":"2023-12-08T08:23:15.889393+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"67'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.896118+0000","last_change":"2023-12-08T08:22:59.265669+0000","last_active":"2023-12-08T08:23:15.896118+0000","last_peered":"2023-12-08T08:23:15.896118+0000","last_clean":"2023-12-08T08:23:15.896118+0000","last_became_active":"2023-12-08T08:22:59.265364+0000","last_became_peered":"2023-12-08T08:22:59.265364+0000","last_unstale":"2023-12-08T08:23:15.896118+0000","last_undegraded":"2023-12-08T08:23:15.896118+0000","last_fullsized":"2023-12-08T08:23:15.896118+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:27:38.296266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.906380+0000","last_change":"2023-12-08T08:23:16.906380+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.906380+0000","last_undegraded":"2023-12-08T08:23:16.906380+0000","last_fullsized":"2023-12-08T08:23:16.906380+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920038+0000","last_change":"2023-12-08T08:23:16.916758+0000","last_active":"2023-12-08T08:23:16.920038+0000","last_peered":"2023-12-08T08:23:16.920038+0000","last_clean":"2023-12-08T08:23:16.920038+0000","last_became_active":"2023-12-08T08:23:16.916445+0000","last_became_peered":"2023-12-08T08:23:16.916445+0000","last_unstale":"2023-12-08T08:23:16.920038+0000","last_undegraded":"2023-12-08T08:23:16.920038+0000","last_fullsized":"2023-12-08T08:23:16.920038+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:18:49.227732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885732+0000","last_change":"2023-12-08T08:23:00.270198+0000","last_active":"2023-12-08T08:23:15.885732+0000","last_peered":"2023-12-08T08:23:15.885732+0000","last_clean":"2023-12-08T08:23:15.885732+0000","last_became_active":"2023-12-08T08:23:00.269930+0000","last_became_peered":"2023-12-08T08:23:00.269930+0000","last_unstale":"2023-12-08T08:23:15.885732+0000","last_undegraded":"2023-12-08T08:23:15.885732+0000","last_fullsized":"2023-12-08T08:23:15.885732+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895963+0000","last_change":"2023-12-08T08:22:59.273655+0000","last_active":"2023-12-08T08:23:15.895963+0000","last_peered":"2023-12-08T08:23:15.895963+0000","last_clean":"2023-12-08T08:23:15.895963+0000","last_became_active":"2023-12-08T08:22:59.273396+0000","last_became_peered":"2023-12-08T08:22:59.273396+0000","last_unstale":"2023-12-08T08:23:15.895963+0000","last_undegraded":"2023-12-08T08:23:15.895963+0000","last_fullsized":"2023-12-08T08:23:15.895963+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.886510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.899083+0000","last_change":"2023-12-08T08:23:16.899083+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.899083+0000","last_undegraded":"2023-12-08T08:23:16.899083+0000","last_fullsized":"2023-12-08T08:23:16.899083+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.923651+0000","last_change":"2023-12-08T08:23:16.922219+0000","last_active":"2023-12-08T08:23:16.923651+0000","last_peered":"2023-12-08T08:23:16.923651+0000","last_clean":"2023-12-08T08:23:16.923651+0000","last_became_active":"2023-12-08T08:23:16.921977+0000","last_became_peered":"2023-12-08T08:23:16.921977+0000","last_unstale":"2023-12-08T08:23:16.923651+0000","last_undegraded":"2023-12-08T08:23:16.923651+0000","last_fullsized":"2023-12-08T08:23:16.923651+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:22:16.168848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883583+0000","last_change":"2023-12-08T08:23:00.285854+0000","last_active":"2023-12-08T08:23:15.883583+0000","last_peered":"2023-12-08T08:23:15.883583+0000","last_clean":"2023-12-08T08:23:15.883583+0000","last_became_active":"2023-12-08T08:23:00.285553+0000","last_became_peered":"2023-12-08T08:23:00.285553+0000","last_unstale":"2023-12-08T08:23:15.883583+0000","last_undegraded":"2023-12-08T08:23:15.883583+0000","last_fullsized":"2023-12-08T08:23:15.883583+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:15:44.184576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"67'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888606+0000","last_change":"2023-12-08T08:22:59.282745+0000","last_active":"2023-12-08T08:23:15.888606+0000","last_peered":"2023-12-08T08:23:15.888606+0000","last_clean":"2023-12-08T08:23:15.888606+0000","last_became_active":"2023-12-08T08:22:59.282443+0000","last_became_peered":"2023-12-08T08:22:59.282443+0000","last_unstale":"2023-12-08T08:23:15.888606+0000","last_undegraded":"2023-12-08T08:23:15.888606+0000","last_fullsized":"2023-12-08T08:23:15.888606+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:21.899236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.908298+0000","last_change":"2023-12-08T08:23:16.908298+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.908298+0000","last_undegraded":"2023-12-08T08:23:16.908298+0000","last_fullsized":"2023-12-08T08:23:16.908298+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.911706+0000","last_change":"2023-12-08T08:23:16.906025+0000","last_active":"2023-12-08T08:23:16.911706+0000","last_peered":"2023-12-08T08:23:16.911706+0000","last_clean":"2023-12-08T08:23:16.911706+0000","last_became_active":"2023-12-08T08:23:16.905756+0000","last_became_peered":"2023-12-08T08:23:16.905756+0000","last_unstale":"2023-12-08T08:23:16.911706+0000","last_undegraded":"2023-12-08T08:23:16.911706+0000","last_fullsized":"2023-12-08T08:23:16.911706+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:56:17.065460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895380+0000","last_change":"2023-12-08T08:23:00.286165+0000","last_active":"2023-12-08T08:23:15.895380+0000","last_peered":"2023-12-08T08:23:15.895380+0000","last_clean":"2023-12-08T08:23:15.895380+0000","last_became_active":"2023-12-08T08:23:00.285209+0000","last_became_peered":"2023-12-08T08:23:00.285209+0000","last_unstale":"2023-12-08T08:23:15.895380+0000","last_undegraded":"2023-12-08T08:23:15.895380+0000","last_fullsized":"2023-12-08T08:23:15.895380+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:16.068318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883606+0000","last_change":"2023-12-08T08:22:59.272934+0000","last_active":"2023-12-08T08:23:15.883606+0000","last_peered":"2023-12-08T08:23:15.883606+0000","last_clean":"2023-12-08T08:23:15.883606+0000","last_became_active":"2023-12-08T08:22:59.272094+0000","last_became_peered":"2023-12-08T08:22:59.272094+0000","last_unstale":"2023-12-08T08:23:15.883606+0000","last_undegraded":"2023-12-08T08:23:15.883606+0000","last_fullsized":"2023-12-08T08:23:15.883606+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:33:18.775139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.901915+0000","last_change":"2023-12-08T08:23:16.901915+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.901915+0000","last_undegraded":"2023-12-08T08:23:16.901915+0000","last_fullsized":"2023-12-08T08:23:16.901915+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920431+0000","last_change":"2023-12-08T08:23:16.915895+0000","last_active":"2023-12-08T08:23:16.920431+0000","last_peered":"2023-12-08T08:23:16.920431+0000","last_clean":"2023-12-08T08:23:16.920431+0000","last_became_active":"2023-12-08T08:23:16.915631+0000","last_became_peered":"2023-12-08T08:23:16.915631+0000","last_unstale":"2023-12-08T08:23:16.920431+0000","last_undegraded":"2023-12-08T08:23:16.920431+0000","last_fullsized":"2023-12-08T08:23:16.920431+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:28:54.873126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883361+0000","last_change":"2023-12-08T08:23:00.287292+0000","last_active":"2023-12-08T08:23:15.883361+0000","last_peered":"2023-12-08T08:23:15.883361+0000","last_clean":"2023-12-08T08:23:15.883361+0000","last_became_active":"2023-12-08T08:23:00.284565+0000","last_became_peered":"2023-12-08T08:23:00.284565+0000","last_unstale":"2023-12-08T08:23:15.883361+0000","last_undegraded":"2023-12-08T08:23:15.883361+0000","last_fullsized":"2023-12-08T08:23:15.883361+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:17:25.641139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883435+0000","last_change":"2023-12-08T08:22:59.279857+0000","last_active":"2023-12-08T08:23:15.883435+0000","last_peered":"2023-12-08T08:23:15.883435+0000","last_clean":"2023-12-08T08:23:15.883435+0000","last_became_active":"2023-12-08T08:22:59.279508+0000","last_became_peered":"2023-12-08T08:22:59.279508+0000","last_unstale":"2023-12-08T08:23:15.883435+0000","last_undegraded":"2023-12-08T08:23:15.883435+0000","last_fullsized":"2023-12-08T08:23:15.883435+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:23.192834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900064+0000","last_change":"2023-12-08T08:23:16.900064+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900064+0000","last_undegraded":"2023-12-08T08:23:16.900064+0000","last_fullsized":"2023-12-08T08:23:16.900064+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.914553+0000","last_change":"2023-12-08T08:23:16.911088+0000","last_active":"2023-12-08T08:23:16.914553+0000","last_peered":"2023-12-08T08:23:16.914553+0000","last_clean":"2023-12-08T08:23:16.914553+0000","last_became_active":"2023-12-08T08:23:16.910534+0000","last_became_peered":"2023-12-08T08:23:16.910534+0000","last_unstale":"2023-12-08T08:23:16.914553+0000","last_undegraded":"2023-12-08T08:23:16.914553+0000","last_fullsized":"2023-12-08T08:23:16.914553+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:13:12.845859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894166+0000","last_change":"2023-12-08T08:23:00.291227+0000","last_active":"2023-12-08T08:23:15.894166+0000","last_peered":"2023-12-08T08:23:15.894166+0000","last_clean":"2023-12-08T08:23:15.894166+0000","last_became_active":"2023-12-08T08:23:00.290984+0000","last_became_peered":"2023-12-08T08:23:00.290984+0000","last_unstale":"2023-12-08T08:23:15.894166+0000","last_undegraded":"2023-12-08T08:23:15.894166+0000","last_fullsized":"2023-12-08T08:23:15.894166+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:33.905575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.887728+0000","last_change":"2023-12-08T08:22:59.282842+0000","last_active":"2023-12-08T08:23:15.887728+0000","last_peered":"2023-12-08T08:23:15.887728+0000","last_clean":"2023-12-08T08:23:15.887728+0000","last_became_active":"2023-12-08T08:22:59.282605+0000","last_became_peered":"2023-12-08T08:22:59.282605+0000","last_unstale":"2023-12-08T08:23:15.887728+0000","last_undegraded":"2023-12-08T08:23:15.887728+0000","last_fullsized":"2023-12-08T08:23:15.887728+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:55.208931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896938+0000","last_change":"2023-12-08T08:23:16.896938+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896938+0000","last_undegraded":"2023-12-08T08:23:16.896938+0000","last_fullsized":"2023-12-08T08:23:16.896938+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.908278+0000","last_change":"2023-12-08T08:23:16.900995+0000","last_active":"2023-12-08T08:23:16.908278+0000","last_peered":"2023-12-08T08:23:16.908278+0000","last_clean":"2023-12-08T08:23:16.908278+0000","last_became_active":"2023-12-08T08:23:16.900717+0000","last_became_peered":"2023-12-08T08:23:16.900717+0000","last_unstale":"2023-12-08T08:23:16.908278+0000","last_undegraded":"2023-12-08T08:23:16.908278+0000","last_fullsized":"2023-12-08T08:23:16.908278+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:27:04.256182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885973+0000","last_change":"2023-12-08T08:23:00.270620+0000","last_active":"2023-12-08T08:23:15.885973+0000","last_peered":"2023-12-08T08:23:15.885973+0000","last_clean":"2023-12-08T08:23:15.885973+0000","last_became_active":"2023-12-08T08:23:00.270369+0000","last_became_peered":"2023-12-08T08:23:00.270369+0000","last_unstale":"2023-12-08T08:23:15.885973+0000","last_undegraded":"2023-12-08T08:23:15.885973+0000","last_fullsized":"2023-12-08T08:23:15.885973+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:33.898137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"67'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.891985+0000","last_change":"2023-12-08T08:22:59.269712+0000","last_active":"2023-12-08T08:23:15.891985+0000","last_peered":"2023-12-08T08:23:15.891985+0000","last_clean":"2023-12-08T08:23:15.891985+0000","last_became_active":"2023-12-08T08:22:59.269426+0000","last_became_peered":"2023-12-08T08:22:59.269426+0000","last_unstale":"2023-12-08T08:23:15.891985+0000","last_undegraded":"2023-12-08T08:23:15.891985+0000","last_fullsized":"2023-12-08T08:23:15.891985+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:49:28.705874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.906727+0000","last_change":"2023-12-08T08:23:16.906727+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.906727+0000","last_undegraded":"2023-12-08T08:23:16.906727+0000","last_fullsized":"2023-12-08T08:23:16.906727+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920958+0000","last_change":"2023-12-08T08:23:16.918945+0000","last_active":"2023-12-08T08:23:16.920958+0000","last_peered":"2023-12-08T08:23:16.920958+0000","last_clean":"2023-12-08T08:23:16.920958+0000","last_became_active":"2023-12-08T08:23:16.918629+0000","last_became_peered":"2023-12-08T08:23:16.918629+0000","last_unstale":"2023-12-08T08:23:16.920958+0000","last_undegraded":"2023-12-08T08:23:16.920958+0000","last_fullsized":"2023-12-08T08:23:16.920958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:39.536165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.896176+0000","last_change":"2023-12-08T08:23:00.280543+0000","last_active":"2023-12-08T08:23:15.896176+0000","last_peered":"2023-12-08T08:23:15.896176+0000","last_clean":"2023-12-08T08:23:15.896176+0000","last_became_active":"2023-12-08T08:23:00.280152+0000","last_became_peered":"2023-12-08T08:23:00.280152+0000","last_unstale":"2023-12-08T08:23:15.896176+0000","last_undegraded":"2023-12-08T08:23:15.896176+0000","last_fullsized":"2023-12-08T08:23:15.896176+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:37:47.067543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"68'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.891331+0000","last_change":"2023-12-08T08:22:59.263185+0000","last_active":"2023-12-08T08:23:15.891331+0000","last_peered":"2023-12-08T08:23:15.891331+0000","last_clean":"2023-12-08T08:23:15.891331+0000","last_became_active":"2023-12-08T08:22:59.262924+0000","last_became_peered":"2023-12-08T08:22:59.262924+0000","last_unstale":"2023-12-08T08:23:15.891331+0000","last_undegraded":"2023-12-08T08:23:15.891331+0000","last_fullsized":"2023-12-08T08:23:15.891331+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:39:59.028170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.895437+0000","last_change":"2023-12-08T08:23:16.895437+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.895437+0000","last_undegraded":"2023-12-08T08:23:16.895437+0000","last_fullsized":"2023-12-08T08:23:16.895437+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.914570+0000","last_change":"2023-12-08T08:23:16.912250+0000","last_active":"2023-12-08T08:23:16.914570+0000","last_peered":"2023-12-08T08:23:16.914570+0000","last_clean":"2023-12-08T08:23:16.914570+0000","last_became_active":"2023-12-08T08:23:16.912031+0000","last_became_peered":"2023-12-08T08:23:16.912031+0000","last_unstale":"2023-12-08T08:23:16.914570+0000","last_undegraded":"2023-12-08T08:23:16.914570+0000","last_fullsized":"2023-12-08T08:23:16.914570+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:03.696851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888857+0000","last_change":"2023-12-08T08:23:00.304740+0000","last_active":"2023-12-08T08:23:15.888857+0000","last_peered":"2023-12-08T08:23:15.888857+0000","last_clean":"2023-12-08T08:23:15.888857+0000","last_became_active":"2023-12-08T08:23:00.304390+0000","last_became_peered":"2023-12-08T08:23:00.304390+0000","last_unstale":"2023-12-08T08:23:15.888857+0000","last_undegraded":"2023-12-08T08:23:15.888857+0000","last_fullsized":"2023-12-08T08:23:15.888857+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889133+0000","last_change":"2023-12-08T08:22:59.285952+0000","last_active":"2023-12-08T08:23:15.889133+0000","last_peered":"2023-12-08T08:23:15.889133+0000","last_clean":"2023-12-08T08:23:15.889133+0000","last_became_active":"2023-12-08T08:22:59.285309+0000","last_became_peered":"2023-12-08T08:22:59.285309+0000","last_unstale":"2023-12-08T08:23:15.889133+0000","last_undegraded":"2023-12-08T08:23:15.889133+0000","last_fullsized":"2023-12-08T08:23:15.889133+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:19.279362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896326+0000","last_change":"2023-12-08T08:23:16.896326+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896326+0000","last_undegraded":"2023-12-08T08:23:16.896326+0000","last_fullsized":"2023-12-08T08:23:16.896326+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.919262+0000","last_change":"2023-12-08T08:23:16.912270+0000","last_active":"2023-12-08T08:23:16.919262+0000","last_peered":"2023-12-08T08:23:16.919262+0000","last_clean":"2023-12-08T08:23:16.919262+0000","last_became_active":"2023-12-08T08:23:16.912007+0000","last_became_peered":"2023-12-08T08:23:16.912007+0000","last_unstale":"2023-12-08T08:23:16.919262+0000","last_undegraded":"2023-12-08T08:23:16.919262+0000","last_fullsized":"2023-12-08T08:23:16.919262+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:32:01.183284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885854+0000","last_change":"2023-12-08T08:23:00.299161+0000","last_active":"2023-12-08T08:23:15.885854+0000","last_peered":"2023-12-08T08:23:15.885854+0000","last_clean":"2023-12-08T08:23:15.885854+0000","last_became_active":"2023-12-08T08:23:00.298876+0000","last_became_peered":"2023-12-08T08:23:00.298876+0000","last_unstale":"2023-12-08T08:23:15.885854+0000","last_undegraded":"2023-12-08T08:23:15.885854+0000","last_fullsized":"2023-12-08T08:23:15.885854+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:29:03.020360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888918+0000","last_change":"2023-12-08T08:22:59.280536+0000","last_active":"2023-12-08T08:23:15.888918+0000","last_peered":"2023-12-08T08:23:15.888918+0000","last_clean":"2023-12-08T08:23:15.888918+0000","last_became_active":"2023-12-08T08:22:59.280213+0000","last_became_peered":"2023-12-08T08:22:59.280213+0000","last_unstale":"2023-12-08T08:23:15.888918+0000","last_undegraded":"2023-12-08T08:23:15.888918+0000","last_fullsized":"2023-12-08T08:23:15.888918+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:49.883139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.898593+0000","last_change":"2023-12-08T08:23:16.898593+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.898593+0000","last_undegraded":"2023-12-08T08:23:16.898593+0000","last_fullsized":"2023-12-08T08:23:16.898593+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.922617+0000","last_change":"2023-12-08T08:23:16.919692+0000","last_active":"2023-12-08T08:23:16.922617+0000","last_peered":"2023-12-08T08:23:16.922617+0000","last_clean":"2023-12-08T08:23:16.922617+0000","last_became_active":"2023-12-08T08:23:16.919433+0000","last_became_peered":"2023-12-08T08:23:16.919433+0000","last_unstale":"2023-12-08T08:23:16.922617+0000","last_undegraded":"2023-12-08T08:23:16.922617+0000","last_fullsized":"2023-12-08T08:23:16.922617+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:28:54.873126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895793+0000","last_change":"2023-12-08T08:23:00.285721+0000","last_active":"2023-12-08T08:23:15.895793+0000","last_peered":"2023-12-08T08:23:15.895793+0000","last_clean":"2023-12-08T08:23:15.895793+0000","last_became_active":"2023-12-08T08:23:00.285446+0000","last_became_peered":"2023-12-08T08:23:00.285446+0000","last_unstale":"2023-12-08T08:23:15.895793+0000","last_undegraded":"2023-12-08T08:23:15.895793+0000","last_fullsized":"2023-12-08T08:23:15.895793+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895893+0000","last_change":"2023-12-08T08:22:59.272111+0000","last_active":"2023-12-08T08:23:15.895893+0000","last_peered":"2023-12-08T08:23:15.895893+0000","last_clean":"2023-12-08T08:23:15.895893+0000","last_became_active":"2023-12-08T08:22:59.271849+0000","last_became_peered":"2023-12-08T08:22:59.271849+0000","last_unstale":"2023-12-08T08:23:15.895893+0000","last_undegraded":"2023-12-08T08:23:15.895893+0000","last_fullsized":"2023-12-08T08:23:15.895893+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:15.060698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.907737+0000","last_change":"2023-12-08T08:23:16.907737+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.907737+0000","last_undegraded":"2023-12-08T08:23:16.907737+0000","last_fullsized":"2023-12-08T08:23:16.907737+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.915051+0000","last_change":"2023-12-08T08:23:16.910225+0000","last_active":"2023-12-08T08:23:16.915051+0000","last_peered":"2023-12-08T08:23:16.915051+0000","last_clean":"2023-12-08T08:23:16.915051+0000","last_became_active":"2023-12-08T08:23:16.909947+0000","last_became_peered":"2023-12-08T08:23:16.909947+0000","last_unstale":"2023-12-08T08:23:16.915051+0000","last_undegraded":"2023-12-08T08:23:16.915051+0000","last_fullsized":"2023-12-08T08:23:16.915051+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:24:52.637443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895822+0000","last_change":"2023-12-08T08:23:00.292346+0000","last_active":"2023-12-08T08:23:15.895822+0000","last_peered":"2023-12-08T08:23:15.895822+0000","last_clean":"2023-12-08T08:23:15.895822+0000","last_became_active":"2023-12-08T08:23:00.292166+0000","last_became_peered":"2023-12-08T08:23:00.292166+0000","last_unstale":"2023-12-08T08:23:15.895822+0000","last_undegraded":"2023-12-08T08:23:15.895822+0000","last_fullsized":"2023-12-08T08:23:15.895822+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:21:59.539539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885488+0000","last_change":"2023-12-08T08:22:59.271088+0000","last_active":"2023-12-08T08:23:15.885488+0000","last_peered":"2023-12-08T08:23:15.885488+0000","last_clean":"2023-12-08T08:23:15.885488+0000","last_became_active":"2023-12-08T08:22:59.270783+0000","last_became_peered":"2023-12-08T08:22:59.270783+0000","last_unstale":"2023-12-08T08:23:15.885488+0000","last_undegraded":"2023-12-08T08:23:15.885488+0000","last_fullsized":"2023-12-08T08:23:15.885488+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:30:43.384001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.899218+0000","last_change":"2023-12-08T08:23:16.899218+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.899218+0000","last_undegraded":"2023-12-08T08:23:16.899218+0000","last_fullsized":"2023-12-08T08:23:16.899218+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.922449+0000","last_change":"2023-12-08T08:23:16.921099+0000","last_active":"2023-12-08T08:23:16.922449+0000","last_peered":"2023-12-08T08:23:16.922449+0000","last_clean":"2023-12-08T08:23:16.922449+0000","last_became_active":"2023-12-08T08:23:16.920243+0000","last_became_peered":"2023-12-08T08:23:16.920243+0000","last_unstale":"2023-12-08T08:23:16.922449+0000","last_undegraded":"2023-12-08T08:23:16.922449+0000","last_fullsized":"2023-12-08T08:23:16.922449+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:18:49.227732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894254+0000","last_change":"2023-12-08T08:23:00.283700+0000","last_active":"2023-12-08T08:23:15.894254+0000","last_peered":"2023-12-08T08:23:15.894254+0000","last_clean":"2023-12-08T08:23:15.894254+0000","last_became_active":"2023-12-08T08:23:00.283439+0000","last_became_peered":"2023-12-08T08:23:00.283439+0000","last_unstale":"2023-12-08T08:23:15.894254+0000","last_undegraded":"2023-12-08T08:23:15.894254+0000","last_fullsized":"2023-12-08T08:23:15.894254+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888620+0000","last_change":"2023-12-08T08:22:59.280725+0000","last_active":"2023-12-08T08:23:15.888620+0000","last_peered":"2023-12-08T08:23:15.888620+0000","last_clean":"2023-12-08T08:23:15.888620+0000","last_became_active":"2023-12-08T08:22:59.279736+0000","last_became_peered":"2023-12-08T08:22:59.279736+0000","last_unstale":"2023-12-08T08:23:15.888620+0000","last_undegraded":"2023-12-08T08:23:15.888620+0000","last_fullsized":"2023-12-08T08:23:15.888620+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:54.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.894537+0000","last_change":"2023-12-08T08:23:16.894537+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.894537+0000","last_undegraded":"2023-12-08T08:23:16.894537+0000","last_fullsized":"2023-12-08T08:23:16.894537+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920940+0000","last_change":"2023-12-08T08:23:16.918822+0000","last_active":"2023-12-08T08:23:16.920940+0000","last_peered":"2023-12-08T08:23:16.920940+0000","last_clean":"2023-12-08T08:23:16.920940+0000","last_became_active":"2023-12-08T08:23:16.918519+0000","last_became_peered":"2023-12-08T08:23:16.918519+0000","last_unstale":"2023-12-08T08:23:16.920940+0000","last_undegraded":"2023-12-08T08:23:16.920940+0000","last_fullsized":"2023-12-08T08:23:16.920940+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:03.696851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888527+0000","last_change":"2023-12-08T08:23:00.305076+0000","last_active":"2023-12-08T08:23:15.888527+0000","last_peered":"2023-12-08T08:23:15.888527+0000","last_clean":"2023-12-08T08:23:15.888527+0000","last_became_active":"2023-12-08T08:23:00.304435+0000","last_became_peered":"2023-12-08T08:23:00.304435+0000","last_unstale":"2023-12-08T08:23:15.888527+0000","last_undegraded":"2023-12-08T08:23:15.888527+0000","last_fullsized":"2023-12-08T08:23:15.888527+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:42:20.038693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885184+0000","last_change":"2023-12-08T08:22:59.278661+0000","last_active":"2023-12-08T08:23:15.885184+0000","last_peered":"2023-12-08T08:23:15.885184+0000","last_clean":"2023-12-08T08:23:15.885184+0000","last_became_active":"2023-12-08T08:22:59.278383+0000","last_became_peered":"2023-12-08T08:22:59.278383+0000","last_unstale":"2023-12-08T08:23:15.885184+0000","last_undegraded":"2023-12-08T08:23:15.885184+0000","last_fullsized":"2023-12-08T08:23:15.885184+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:35:15.000491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.899234+0000","last_change":"2023-12-08T08:23:16.899234+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.899234+0000","last_undegraded":"2023-12-08T08:23:16.899234+0000","last_fullsized":"2023-12-08T08:23:16.899234+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.923341+0000","last_change":"2023-12-08T08:23:16.918926+0000","last_active":"2023-12-08T08:23:16.923341+0000","last_peered":"2023-12-08T08:23:16.923341+0000","last_clean":"2023-12-08T08:23:16.923341+0000","last_became_active":"2023-12-08T08:23:16.918626+0000","last_became_peered":"2023-12-08T08:23:16.918626+0000","last_unstale":"2023-12-08T08:23:16.923341+0000","last_undegraded":"2023-12-08T08:23:16.923341+0000","last_fullsized":"2023-12-08T08:23:16.923341+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:10:23.005533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.890781+0000","last_change":"2023-12-08T08:23:00.270574+0000","last_active":"2023-12-08T08:23:15.890781+0000","last_peered":"2023-12-08T08:23:15.890781+0000","last_clean":"2023-12-08T08:23:15.890781+0000","last_became_active":"2023-12-08T08:23:00.270304+0000","last_became_peered":"2023-12-08T08:23:00.270304+0000","last_unstale":"2023-12-08T08:23:15.890781+0000","last_undegraded":"2023-12-08T08:23:15.890781+0000","last_fullsized":"2023-12-08T08:23:15.890781+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:15:55.762883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"67'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895591+0000","last_change":"2023-12-08T08:22:59.275324+0000","last_active":"2023-12-08T08:23:15.895591+0000","last_peered":"2023-12-08T08:23:15.895591+0000","last_clean":"2023-12-08T08:23:15.895591+0000","last_became_active":"2023-12-08T08:22:59.275038+0000","last_became_peered":"2023-12-08T08:22:59.275038+0000","last_unstale":"2023-12-08T08:23:15.895591+0000","last_undegraded":"2023-12-08T08:23:15.895591+0000","last_fullsized":"2023-12-08T08:23:15.895591+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:09.089659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":207,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894333+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:23:15.894333+0000","last_peered":"2023-12-08T08:23:15.894333+0000","last_clean":"2023-12-08T08:23:15.894333+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:23:15.894333+0000","last_undegraded":"2023-12-08T08:23:15.894333+0000","last_fullsized":"2023-12-08T08:23:15.894333+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":929792,"data_stored":968762,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89900000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.85299999999999998,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.77500000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85999999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89600000000000002,"5min":1.446,"15min":1.446},"last":0.873}]},{"osd":2,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.71999999999999997,"15min":0.72899999999999998},"min":{"1min":0.52100000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.871,"5min":1.379,"15min":1.379},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.47599999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.84599999999999997,"5min":1.706,"15min":1.706},"last":0.85999999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.751,"15min":0.76300000000000001},"min":{"1min":0.54500000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.88700000000000001,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.752},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.56699999999999995,"5min":0.496,"15min":0.496},"max":{"1min":0.83099999999999996,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.80000000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.46899999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.90000000000000002,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.72599999999999998,"15min":0.74199999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83999999999999997,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.59599999999999997}]},{"osd":5,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.77500000000000002,"15min":0.79500000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81399999999999995,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.78500000000000003,"15min":0.80200000000000005},"min":{"1min":0.499,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93300000000000005,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.72999999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.84799999999999998,"15min":0.86499999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.95899999999999996,"5min":1.573,"15min":1.573},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.80000000000000004,"15min":0.81499999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91100000000000003,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.82299999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":379018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.66800000000000004},"min":{"1min":0.49099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.56899999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94599999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.79400000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72499999999999998,"15min":0.71899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73599999999999999,"15min":0.73399999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.83399999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70899999999999996,"15min":0.72499999999999998},"min":{"1min":0.50700000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.90900000000000003,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73599999999999999,"15min":0.746},"min":{"1min":0.48899999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.877}]},{"osd":3,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.73799999999999999,"15min":0.75700000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.46600000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.96299999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.752}]},{"osd":4,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.70199999999999996,"15min":0.72599999999999998},"min":{"1min":0.42899999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83399999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.71699999999999997,"15min":0.755},"min":{"1min":0.496,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79700000000000004,"5min":1.014,"15min":1.014},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.75,"15min":0.79100000000000004},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83099999999999996,"5min":1.091,"15min":1.091},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.81699999999999995,"15min":0.84299999999999997},"min":{"1min":0.57199999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0149999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.93400000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78600000000000003,"15min":0.81599999999999995},"min":{"1min":0.61799999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.89000000000000001,"5min":1.04,"15min":1.04},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.84199999999999997,"15min":0.89200000000000002},"min":{"1min":0.55400000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96499999999999997,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.84799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":876544,"data_stored":381453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.621,"15min":0.622},"min":{"1min":0.47599999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.042,"5min":1.081,"15min":1.081},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68300000000000005,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.024,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.65800000000000003}]},{"osd":1,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69099999999999995,"15min":0.68100000000000005},"min":{"1min":0.42399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98599999999999999,"5min":1.194,"15min":1.194},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.006,"5min":1.143,"15min":1.143},"last":0.59199999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.47999999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0880000000000001,"5min":1.101,"15min":1.101},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72999999999999998,"15min":0.74199999999999999},"min":{"1min":0.52300000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.745},{"interface":"front","average":{"1min":0.75,"5min":0.76300000000000001,"15min":0.753},"min":{"1min":0.56200000000000006,"5min":0.5,"15min":0.5},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.73099999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.40899999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.96299999999999997,"5min":1.01,"15min":1.01},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.58899999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.048,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.83399999999999996}]},{"osd":6,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.75700000000000001,"15min":0.77900000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89900000000000002,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91000000000000003,"5min":1.073,"15min":1.073},"last":0.76500000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77600000000000002,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95999999999999996,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83599999999999997,"15min":0.85599999999999998},"min":{"1min":0.56299999999999994,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0800000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.61199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":378324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.68000000000000005,"15min":0.69399999999999995},"min":{"1min":0.502,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86099999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.68300000000000005,"15min":0.66800000000000004},"min":{"1min":0.59399999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95099999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.81399999999999995}]},{"osd":1,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70799999999999996,"15min":0.71299999999999997},"min":{"1min":0.52800000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90100000000000002,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68100000000000005,"15min":0.68200000000000005},"min":{"1min":0.505,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.84499999999999997,"5min":1.002,"15min":1.002},"last":0.71299999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68999999999999995},"min":{"1min":0.54200000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88400000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.751},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.54400000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.84699999999999998,"5min":1.056,"15min":1.056},"last":0.77400000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.58999999999999997,"5min":0.496,"15min":0.496},"max":{"1min":0.95299999999999996,"5min":1.359,"15min":1.359},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.755,"15min":0.78500000000000003},"min":{"1min":0.51800000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99399999999999999,"5min":1.232,"15min":1.232},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.64200000000000002,"15min":0.66800000000000004},"min":{"1min":0.39000000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90800000000000003,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.745,"15min":0.78100000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95199999999999996,"5min":1.091,"15min":1.091},"last":0.57699999999999996}]},{"osd":6,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.68600000000000005,"15min":0.71499999999999997},"min":{"1min":0.41699999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.92500000000000004,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.504},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.76300000000000001,"15min":0.78900000000000003},"min":{"1min":0.45300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98199999999999998,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.55000000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.97699999999999998,"5min":1.246,"15min":1.246},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.80200000000000005},"min":{"1min":0.50800000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.004,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.45700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":381431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41799999999999998,"15min":0.432},"min":{"1min":0.26500000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.56000000000000005,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45600000000000002,"15min":0.46300000000000002},"min":{"1min":0.309,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73999999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.42899999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.435,"15min":0.436},"min":{"1min":0.317,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.58099999999999996,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.504}]},{"osd":2,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.50900000000000001,"15min":0.52200000000000002},"min":{"1min":0.35299999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52900000000000003,"15min":0.54100000000000004},"min":{"1min":0.40600000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65200000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.52700000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0620000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":1.014},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.54300000000000004,"5min":0.497,"15min":0.497},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.95499999999999996}]},{"osd":5,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.52000000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":1},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.76200000000000001,"15min":0.77100000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.97199999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.56899999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.101,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.97899999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.76200000000000001,"15min":0.75900000000000001},"min":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.58599999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1080000000000001,"5min":1.121,"15min":1.121},"last":1.036}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":864256,"data_stored":378906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39100000000000001,"15min":0.40100000000000002},"min":{"1min":0.27900000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.497,"15min":0.53100000000000003},"min":{"1min":0.315,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67700000000000005,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.34399999999999997}]},{"osd":1,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.32200000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51500000000000001,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.40100000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.54300000000000004,"15min":0.57699999999999996},"min":{"1min":0.34899999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.57799999999999996,"5min":3.008,"15min":3.008},"last":0.44},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47799999999999998,"15min":0.48399999999999999},"min":{"1min":0.33800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.65400000000000003,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.36599999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78300000000000003,"15min":0.81699999999999995},"min":{"1min":0.50900000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.004,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0049999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.79300000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.75700000000000001,"15min":0.76800000000000002},"min":{"1min":0.51000000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98699999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78800000000000003,"15min":0.82899999999999996},"min":{"1min":0.52600000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98799999999999999,"5min":3.637,"15min":3.637},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.78000000000000003,"15min":0.79400000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97499999999999998,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.038,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.83499999999999996,"15min":0.89500000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.88400000000000001,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.82499999999999996,"15min":0.83899999999999997},"min":{"1min":0.56799999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0109999999999999,"5min":1.766,"15min":1.766},"last":0.83399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":378518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.59799999999999998,"15min":0.67600000000000005},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.80300000000000005,"5min":5.2210000000000001,"15min":5.2210000000000001},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.73399999999999999,"15min":0.85899999999999999},"min":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59599999999999997,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.38200000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.71299999999999997,"15min":0.83899999999999997},"min":{"1min":0.32800000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.60999999999999999,"5min":8.2070000000000007,"15min":8.2070000000000007},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.63500000000000001,"15min":0.70399999999999996},"min":{"1min":0.34300000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.69299999999999995,"5min":4.351,"15min":4.351},"last":0.37}]},{"osd":3,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.80900000000000005,"15min":0.94199999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.754,"5min":8.1479999999999997,"15min":8.1479999999999997},"last":0.308},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.67400000000000004,"15min":0.76900000000000002},"min":{"1min":0.32300000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.72599999999999998,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.32300000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.91000000000000003,"15min":1.012},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0049999999999999,"5min":4.8470000000000004,"15min":4.8470000000000004},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.97599999999999998,"15min":1.0820000000000001},"min":{"1min":0.55100000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93999999999999995,"5min":4.7939999999999996,"15min":4.7939999999999996},"last":0.66500000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.90500000000000003,"15min":0.98699999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99199999999999999,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.89900000000000002,"15min":0.97899999999999998},"min":{"1min":0.53000000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.107,"5min":4.5830000000000002,"15min":4.5830000000000002},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.97999999999999998,"15min":1.097},"min":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.95799999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.97199999999999998,"15min":1.075},"min":{"1min":0.59399999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.95799999999999996,"5min":4.6289999999999996,"15min":4.6289999999999996},"last":0.68400000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.91600000000000004,"15min":1.002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.97699999999999998,"5min":4.665,"15min":4.665},"last":0.505},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.98199999999999998,"15min":1.0860000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.089,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.57599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":917504,"data_stored":961596,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46899999999999997,"15min":0.495},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64000000000000001,"5min":1.863,"15min":1.863},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.75600000000000001,"15min":0.88600000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70799999999999996,"5min":8.2799999999999994,"15min":8.2799999999999994},"last":0.38}]},{"osd":2,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.78000000000000003,"15min":0.93200000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77300000000000002,"5min":7.9290000000000003,"15min":7.9290000000000003},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.78200000000000003,"15min":0.93700000000000006},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.628,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.435}]},{"osd":3,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.59799999999999998,"15min":0.67200000000000004},"min":{"1min":0.33100000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58699999999999997,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.75600000000000001,"15min":0.872},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82399999999999995,"5min":7.8890000000000002,"15min":7.8890000000000002},"last":0.41799999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.94899999999999995,"15min":1.0529999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95399999999999996,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.753,"15min":0.77800000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88600000000000001,"5min":1.607,"15min":1.607},"last":0.58499999999999996}]},{"osd":5,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.81100000000000005,"15min":0.83099999999999996},"min":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96899999999999997,"5min":1.514,"15min":1.514},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.98899999999999999,"15min":1.1100000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91000000000000003,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79200000000000004,"15min":0.82699999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.88,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.95399999999999996,"15min":1.0549999999999999},"min":{"1min":0.56100000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.89900000000000002,"5min":7.835,"15min":7.835},"last":0.56699999999999995}]},{"osd":7,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.97399999999999998,"15min":1.0800000000000001},"min":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.99299999999999999,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.81000000000000005,"15min":0.85399999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95199999999999996,"5min":1.794,"15min":1.794},"last":0.52900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:23:22.770 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3d is not active+clean 2023-12-08T08:23:22.770 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.897424+0000', 'last_change': '2023-12-08T08:23:16.897424+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.897424+0000', 'last_undegraded': '2023-12-08T08:23:16.897424+0000', 'last_fullsized': '2023-12-08T08:23:16.897424+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:23:22.771 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3c is not active+clean 2023-12-08T08:23:22.771 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.903319+0000', 'last_change': '2023-12-08T08:23:16.903319+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.903319+0000', 'last_undegraded': '2023-12-08T08:23:16.903319+0000', 'last_fullsized': '2023-12-08T08:23:16.903319+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:23:22.771 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3f is not active+clean 2023-12-08T08:23:22.771 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.896828+0000', 'last_change': '2023-12-08T08:23:16.896828+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.896828+0000', 'last_undegraded': '2023-12-08T08:23:16.896828+0000', 'last_fullsized': '2023-12-08T08:23:16.896828+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:23:22.771 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3e is not active+clean 2023-12-08T08:23:22.771 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.898081+0000', 'last_change': '2023-12-08T08:23:16.898081+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.898081+0000', 'last_undegraded': '2023-12-08T08:23:16.898081+0000', 'last_fullsized': '2023-12-08T08:23:16.898081+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:23:22.771 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.39 is not active+clean 2023-12-08T08:23:22.771 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.900497+0000', 'last_change': '2023-12-08T08:23:16.900497+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.900497+0000', 'last_undegraded': '2023-12-08T08:23:16.900497+0000', 'last_fullsized': '2023-12-08T08:23:16.900497+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:23:22.771 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.38 is not active+clean 2023-12-08T08:23:22.771 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.900421+0000', 'last_change': '2023-12-08T08:23:16.900421+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.900421+0000', 'last_undegraded': '2023-12-08T08:23:16.900421+0000', 'last_fullsized': '2023-12-08T08:23:16.900421+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:23:22.771 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3b is not active+clean 2023-12-08T08:23:22.772 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.905320+0000', 'last_change': '2023-12-08T08:23:16.905320+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.905320+0000', 'last_undegraded': '2023-12-08T08:23:16.905320+0000', 'last_fullsized': '2023-12-08T08:23:16.905320+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:23:22.772 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3a is not active+clean 2023-12-08T08:23:22.772 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.900665+0000', 'last_change': '2023-12-08T08:23:16.900665+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.900665+0000', 'last_undegraded': '2023-12-08T08:23:16.900665+0000', 'last_fullsized': '2023-12-08T08:23:16.900665+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:23:22.772 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.35 is not active+clean 2023-12-08T08:23:22.772 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.908893+0000', 'last_change': '2023-12-08T08:23:16.908893+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.908893+0000', 'last_undegraded': '2023-12-08T08:23:16.908893+0000', 'last_fullsized': '2023-12-08T08:23:16.908893+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:23:22.772 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.34 is not active+clean 2023-12-08T08:23:22.772 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.896836+0000', 'last_change': '2023-12-08T08:23:16.896836+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.896836+0000', 'last_undegraded': '2023-12-08T08:23:16.896836+0000', 'last_fullsized': '2023-12-08T08:23:16.896836+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:23:22.772 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.37 is not active+clean 2023-12-08T08:23:22.772 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.896062+0000', 'last_change': '2023-12-08T08:23:16.896062+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.896062+0000', 'last_undegraded': '2023-12-08T08:23:16.896062+0000', 'last_fullsized': '2023-12-08T08:23:16.896062+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:23:22.772 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.36 is not active+clean 2023-12-08T08:23:22.772 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.905090+0000', 'last_change': '2023-12-08T08:23:16.905090+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.905090+0000', 'last_undegraded': '2023-12-08T08:23:16.905090+0000', 'last_fullsized': '2023-12-08T08:23:16.905090+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:23:22.773 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.31 is not active+clean 2023-12-08T08:23:22.773 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.908607+0000', 'last_change': '2023-12-08T08:23:16.908607+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.908607+0000', 'last_undegraded': '2023-12-08T08:23:16.908607+0000', 'last_fullsized': '2023-12-08T08:23:16.908607+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:23:22.773 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.30 is not active+clean 2023-12-08T08:23:22.773 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.901924+0000', 'last_change': '2023-12-08T08:23:16.901924+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.901924+0000', 'last_undegraded': '2023-12-08T08:23:16.901924+0000', 'last_fullsized': '2023-12-08T08:23:16.901924+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:23:22.773 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.33 is not active+clean 2023-12-08T08:23:22.773 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.907581+0000', 'last_change': '2023-12-08T08:23:16.907581+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.907581+0000', 'last_undegraded': '2023-12-08T08:23:16.907581+0000', 'last_fullsized': '2023-12-08T08:23:16.907581+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:23:22.773 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.32 is not active+clean 2023-12-08T08:23:22.773 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.902396+0000', 'last_change': '2023-12-08T08:23:16.902396+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.902396+0000', 'last_undegraded': '2023-12-08T08:23:16.902396+0000', 'last_fullsized': '2023-12-08T08:23:16.902396+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:23:22.773 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2d is not active+clean 2023-12-08T08:23:22.773 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.900173+0000', 'last_change': '2023-12-08T08:23:16.900173+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.900173+0000', 'last_undegraded': '2023-12-08T08:23:16.900173+0000', 'last_fullsized': '2023-12-08T08:23:16.900173+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:23:22.773 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2c is not active+clean 2023-12-08T08:23:22.773 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.896360+0000', 'last_change': '2023-12-08T08:23:16.896360+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.896360+0000', 'last_undegraded': '2023-12-08T08:23:16.896360+0000', 'last_fullsized': '2023-12-08T08:23:16.896360+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:23:22.774 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2f is not active+clean 2023-12-08T08:23:22.774 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.896496+0000', 'last_change': '2023-12-08T08:23:16.896496+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.896496+0000', 'last_undegraded': '2023-12-08T08:23:16.896496+0000', 'last_fullsized': '2023-12-08T08:23:16.896496+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:23:22.774 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2e is not active+clean 2023-12-08T08:23:22.774 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.902160+0000', 'last_change': '2023-12-08T08:23:16.902160+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.902160+0000', 'last_undegraded': '2023-12-08T08:23:16.902160+0000', 'last_fullsized': '2023-12-08T08:23:16.902160+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:23:22.774 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.29 is not active+clean 2023-12-08T08:23:22.774 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.895365+0000', 'last_change': '2023-12-08T08:23:16.895365+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.895365+0000', 'last_undegraded': '2023-12-08T08:23:16.895365+0000', 'last_fullsized': '2023-12-08T08:23:16.895365+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:23:22.774 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.28 is not active+clean 2023-12-08T08:23:22.774 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.900505+0000', 'last_change': '2023-12-08T08:23:16.900505+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.900505+0000', 'last_undegraded': '2023-12-08T08:23:16.900505+0000', 'last_fullsized': '2023-12-08T08:23:16.900505+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:23:22.774 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2b is not active+clean 2023-12-08T08:23:22.774 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.900540+0000', 'last_change': '2023-12-08T08:23:16.900540+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.900540+0000', 'last_undegraded': '2023-12-08T08:23:16.900540+0000', 'last_fullsized': '2023-12-08T08:23:16.900540+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:23:22.775 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2a is not active+clean 2023-12-08T08:23:22.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.896058+0000', 'last_change': '2023-12-08T08:23:16.896058+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.896058+0000', 'last_undegraded': '2023-12-08T08:23:16.896058+0000', 'last_fullsized': '2023-12-08T08:23:16.896058+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:23:22.775 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.25 is not active+clean 2023-12-08T08:23:22.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.900528+0000', 'last_change': '2023-12-08T08:23:16.900528+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.900528+0000', 'last_undegraded': '2023-12-08T08:23:16.900528+0000', 'last_fullsized': '2023-12-08T08:23:16.900528+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:23:22.775 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.24 is not active+clean 2023-12-08T08:23:22.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.905250+0000', 'last_change': '2023-12-08T08:23:16.905250+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.905250+0000', 'last_undegraded': '2023-12-08T08:23:16.905250+0000', 'last_fullsized': '2023-12-08T08:23:16.905250+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:23:22.775 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.27 is not active+clean 2023-12-08T08:23:22.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.905136+0000', 'last_change': '2023-12-08T08:23:16.905136+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.905136+0000', 'last_undegraded': '2023-12-08T08:23:16.905136+0000', 'last_fullsized': '2023-12-08T08:23:16.905136+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:23:22.775 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.26 is not active+clean 2023-12-08T08:23:22.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.896936+0000', 'last_change': '2023-12-08T08:23:16.896936+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.896936+0000', 'last_undegraded': '2023-12-08T08:23:16.896936+0000', 'last_fullsized': '2023-12-08T08:23:16.896936+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:23:22.775 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.21 is not active+clean 2023-12-08T08:23:22.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.901831+0000', 'last_change': '2023-12-08T08:23:16.901831+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.901831+0000', 'last_undegraded': '2023-12-08T08:23:16.901831+0000', 'last_fullsized': '2023-12-08T08:23:16.901831+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:23:22.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.20 is not active+clean 2023-12-08T08:23:22.776 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.895819+0000', 'last_change': '2023-12-08T08:23:16.895819+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.895819+0000', 'last_undegraded': '2023-12-08T08:23:16.895819+0000', 'last_fullsized': '2023-12-08T08:23:16.895819+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:23:22.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.23 is not active+clean 2023-12-08T08:23:22.776 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.895362+0000', 'last_change': '2023-12-08T08:23:16.895362+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.895362+0000', 'last_undegraded': '2023-12-08T08:23:16.895362+0000', 'last_fullsized': '2023-12-08T08:23:16.895362+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:23:22.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.22 is not active+clean 2023-12-08T08:23:22.776 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.898306+0000', 'last_change': '2023-12-08T08:23:16.898306+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.898306+0000', 'last_undegraded': '2023-12-08T08:23:16.898306+0000', 'last_fullsized': '2023-12-08T08:23:16.898306+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:23:22.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1c is not active+clean 2023-12-08T08:23:22.776 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.897379+0000', 'last_change': '2023-12-08T08:23:16.897379+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.897379+0000', 'last_undegraded': '2023-12-08T08:23:16.897379+0000', 'last_fullsized': '2023-12-08T08:23:16.897379+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:23:22.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1d is not active+clean 2023-12-08T08:23:22.776 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.895648+0000', 'last_change': '2023-12-08T08:23:16.895648+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.895648+0000', 'last_undegraded': '2023-12-08T08:23:16.895648+0000', 'last_fullsized': '2023-12-08T08:23:16.895648+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:23:22.777 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1e is not active+clean 2023-12-08T08:23:22.777 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.899707+0000', 'last_change': '2023-12-08T08:23:16.899707+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.899707+0000', 'last_undegraded': '2023-12-08T08:23:16.899707+0000', 'last_fullsized': '2023-12-08T08:23:16.899707+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:23:22.777 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1f is not active+clean 2023-12-08T08:23:22.777 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.902603+0000', 'last_change': '2023-12-08T08:23:16.902603+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.902603+0000', 'last_undegraded': '2023-12-08T08:23:16.902603+0000', 'last_fullsized': '2023-12-08T08:23:16.902603+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:23:22.777 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.18 is not active+clean 2023-12-08T08:23:22.777 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.903785+0000', 'last_change': '2023-12-08T08:23:16.903785+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.903785+0000', 'last_undegraded': '2023-12-08T08:23:16.903785+0000', 'last_fullsized': '2023-12-08T08:23:16.903785+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:23:22.777 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.19 is not active+clean 2023-12-08T08:23:22.777 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.894564+0000', 'last_change': '2023-12-08T08:23:16.894564+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.894564+0000', 'last_undegraded': '2023-12-08T08:23:16.894564+0000', 'last_fullsized': '2023-12-08T08:23:16.894564+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:23:22.777 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1a is not active+clean 2023-12-08T08:23:22.777 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.901187+0000', 'last_change': '2023-12-08T08:23:16.901187+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.901187+0000', 'last_undegraded': '2023-12-08T08:23:16.901187+0000', 'last_fullsized': '2023-12-08T08:23:16.901187+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:23:22.777 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1b is not active+clean 2023-12-08T08:23:22.777 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.901110+0000', 'last_change': '2023-12-08T08:23:16.901110+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.901110+0000', 'last_undegraded': '2023-12-08T08:23:16.901110+0000', 'last_fullsized': '2023-12-08T08:23:16.901110+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:23:22.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.14 is not active+clean 2023-12-08T08:23:22.778 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.905977+0000', 'last_change': '2023-12-08T08:23:16.905977+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.905977+0000', 'last_undegraded': '2023-12-08T08:23:16.905977+0000', 'last_fullsized': '2023-12-08T08:23:16.905977+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:23:22.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.15 is not active+clean 2023-12-08T08:23:22.778 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.906770+0000', 'last_change': '2023-12-08T08:23:16.906770+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.906770+0000', 'last_undegraded': '2023-12-08T08:23:16.906770+0000', 'last_fullsized': '2023-12-08T08:23:16.906770+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:23:22.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.16 is not active+clean 2023-12-08T08:23:22.778 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.896383+0000', 'last_change': '2023-12-08T08:23:16.896383+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.896383+0000', 'last_undegraded': '2023-12-08T08:23:16.896383+0000', 'last_fullsized': '2023-12-08T08:23:16.896383+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:23:22.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.17 is not active+clean 2023-12-08T08:23:22.778 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.895287+0000', 'last_change': '2023-12-08T08:23:16.895287+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.895287+0000', 'last_undegraded': '2023-12-08T08:23:16.895287+0000', 'last_fullsized': '2023-12-08T08:23:16.895287+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:23:22.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.10 is not active+clean 2023-12-08T08:23:22.778 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.894542+0000', 'last_change': '2023-12-08T08:23:16.894542+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.894542+0000', 'last_undegraded': '2023-12-08T08:23:16.894542+0000', 'last_fullsized': '2023-12-08T08:23:16.894542+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:23:22.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.11 is not active+clean 2023-12-08T08:23:22.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.898771+0000', 'last_change': '2023-12-08T08:23:16.898771+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.898771+0000', 'last_undegraded': '2023-12-08T08:23:16.898771+0000', 'last_fullsized': '2023-12-08T08:23:16.898771+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:23:22.779 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.12 is not active+clean 2023-12-08T08:23:22.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.902866+0000', 'last_change': '2023-12-08T08:23:16.902866+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.902866+0000', 'last_undegraded': '2023-12-08T08:23:16.902866+0000', 'last_fullsized': '2023-12-08T08:23:16.902866+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:23:22.779 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.13 is not active+clean 2023-12-08T08:23:22.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.899876+0000', 'last_change': '2023-12-08T08:23:16.899876+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.899876+0000', 'last_undegraded': '2023-12-08T08:23:16.899876+0000', 'last_fullsized': '2023-12-08T08:23:16.899876+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:23:22.779 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.c is not active+clean 2023-12-08T08:23:22.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.901826+0000', 'last_change': '2023-12-08T08:23:16.901826+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.901826+0000', 'last_undegraded': '2023-12-08T08:23:16.901826+0000', 'last_fullsized': '2023-12-08T08:23:16.901826+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:23:22.779 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.d is not active+clean 2023-12-08T08:23:22.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.902834+0000', 'last_change': '2023-12-08T08:23:16.902834+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.902834+0000', 'last_undegraded': '2023-12-08T08:23:16.902834+0000', 'last_fullsized': '2023-12-08T08:23:16.902834+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:23:22.779 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.f is not active+clean 2023-12-08T08:23:22.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.906380+0000', 'last_change': '2023-12-08T08:23:16.906380+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.906380+0000', 'last_undegraded': '2023-12-08T08:23:16.906380+0000', 'last_fullsized': '2023-12-08T08:23:16.906380+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:23:22.780 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.8 is not active+clean 2023-12-08T08:23:22.780 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.899083+0000', 'last_change': '2023-12-08T08:23:16.899083+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.899083+0000', 'last_undegraded': '2023-12-08T08:23:16.899083+0000', 'last_fullsized': '2023-12-08T08:23:16.899083+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:23:22.780 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.9 is not active+clean 2023-12-08T08:23:22.780 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.908298+0000', 'last_change': '2023-12-08T08:23:16.908298+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.908298+0000', 'last_undegraded': '2023-12-08T08:23:16.908298+0000', 'last_fullsized': '2023-12-08T08:23:16.908298+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:23:22.780 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.a is not active+clean 2023-12-08T08:23:22.780 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.901915+0000', 'last_change': '2023-12-08T08:23:16.901915+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.901915+0000', 'last_undegraded': '2023-12-08T08:23:16.901915+0000', 'last_fullsized': '2023-12-08T08:23:16.901915+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:23:22.780 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.b is not active+clean 2023-12-08T08:23:22.780 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.900064+0000', 'last_change': '2023-12-08T08:23:16.900064+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.900064+0000', 'last_undegraded': '2023-12-08T08:23:16.900064+0000', 'last_fullsized': '2023-12-08T08:23:16.900064+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:23:22.780 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.4 is not active+clean 2023-12-08T08:23:22.780 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.896938+0000', 'last_change': '2023-12-08T08:23:16.896938+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.896938+0000', 'last_undegraded': '2023-12-08T08:23:16.896938+0000', 'last_fullsized': '2023-12-08T08:23:16.896938+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:23:22.780 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.5 is not active+clean 2023-12-08T08:23:22.780 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.906727+0000', 'last_change': '2023-12-08T08:23:16.906727+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.906727+0000', 'last_undegraded': '2023-12-08T08:23:16.906727+0000', 'last_fullsized': '2023-12-08T08:23:16.906727+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:23:22.781 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.6 is not active+clean 2023-12-08T08:23:22.781 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.895437+0000', 'last_change': '2023-12-08T08:23:16.895437+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.895437+0000', 'last_undegraded': '2023-12-08T08:23:16.895437+0000', 'last_fullsized': '2023-12-08T08:23:16.895437+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:23:22.781 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.7 is not active+clean 2023-12-08T08:23:22.781 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.896326+0000', 'last_change': '2023-12-08T08:23:16.896326+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.896326+0000', 'last_undegraded': '2023-12-08T08:23:16.896326+0000', 'last_fullsized': '2023-12-08T08:23:16.896326+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:23:22.781 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.0 is not active+clean 2023-12-08T08:23:22.781 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.898593+0000', 'last_change': '2023-12-08T08:23:16.898593+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.898593+0000', 'last_undegraded': '2023-12-08T08:23:16.898593+0000', 'last_fullsized': '2023-12-08T08:23:16.898593+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:23:22.781 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1 is not active+clean 2023-12-08T08:23:22.781 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.907737+0000', 'last_change': '2023-12-08T08:23:16.907737+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.907737+0000', 'last_undegraded': '2023-12-08T08:23:16.907737+0000', 'last_fullsized': '2023-12-08T08:23:16.907737+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:23:22.781 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2 is not active+clean 2023-12-08T08:23:22.781 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.899218+0000', 'last_change': '2023-12-08T08:23:16.899218+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.899218+0000', 'last_undegraded': '2023-12-08T08:23:16.899218+0000', 'last_fullsized': '2023-12-08T08:23:16.899218+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:23:22.781 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3 is not active+clean 2023-12-08T08:23:22.782 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.894537+0000', 'last_change': '2023-12-08T08:23:16.894537+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.894537+0000', 'last_undegraded': '2023-12-08T08:23:16.894537+0000', 'last_fullsized': '2023-12-08T08:23:16.894537+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:23:22.782 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.e is not active+clean 2023-12-08T08:23:22.782 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:23:16.899234+0000', 'last_change': '2023-12-08T08:23:16.899234+0000', 'last_active': '2023-12-08T08:23:16.880943+0000', 'last_peered': '2023-12-08T08:23:16.880943+0000', 'last_clean': '2023-12-08T08:23:16.880943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:23:16.899234+0000', 'last_undegraded': '2023-12-08T08:23:16.899234+0000', 'last_fullsized': '2023-12-08T08:23:16.899234+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'last_clean_scrub_stamp': '2023-12-08T08:23:16.880943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:23:22.782 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-08T08:23:22.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.914+0000 7f52b1a88640 1 Processor -- start 2023-12-08T08:23:22.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.914+0000 7f52b1a88640 1 -- start start 2023-12-08T08:23:22.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.918+0000 7f52b1a88640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f52ac158020 0x7f52ac15fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:22.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.918+0000 7f52b1a88640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52ac158490 con 0x7f52ac151b40 2023-12-08T08:23:22.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.918+0000 7f52b1a88640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52ac0c8460 con 0x7f52ac0c7fd0 2023-12-08T08:23:22.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.918+0000 7f52b1a88640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52ac154320 con 0x7f52ac158020 2023-12-08T08:23:22.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.918+0000 7f52b1287640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f52ac158020 0x7f52ac15fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:22.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.918+0000 7f52b0a86640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f52ac151b40 0x7f52ac0c9f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38010/0 (socket says 172.21.15.88:38010) 2023-12-08T08:23:22.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.918+0000 7f52b0a86640 1 -- 172.21.15.88:0/207573895 learned_addr learned my addr 172.21.15.88:0/207573895 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:22.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.918+0000 7f52b1287640 1 -- 172.21.15.88:0/207573895 >> v1:172.21.15.148:6789/0 conn(0x7f52ac0c7fd0 legacy=0x7f52ac157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:22.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.918+0000 7f52b1287640 1 -- 172.21.15.88:0/207573895 >> v1:172.21.15.88:6789/0 conn(0x7f52ac151b40 legacy=0x7f52ac0c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:22.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.918+0000 7f52b1287640 1 -- 172.21.15.88:0/207573895 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ac154530 con 0x7f52ac158020 2023-12-08T08:23:22.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.918+0000 7f52ab7fe640 1 -- 172.21.15.88:0/207573895 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4122602582 0 0) 0x7f52ac158490 con 0x7f52ac151b40 2023-12-08T08:23:22.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.918+0000 7f52b1287640 1 --2- 172.21.15.88:0/207573895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52ac158020 0x7f52ac15fcb0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f52a4009d90 tx=0x7f52a401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b53e70fb5baccf server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:22.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.922+0000 7f52ab7fe640 1 -- 172.21.15.88:0/207573895 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a40a5890 con 0x7f52ac158020 2023-12-08T08:23:22.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.922+0000 7f52ab7fe640 1 -- 172.21.15.88:0/207573895 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a40a59f0 con 0x7f52ac158020 2023-12-08T08:23:22.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.922+0000 7f52ab7fe640 1 -- 172.21.15.88:0/207573895 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a40a5d80 con 0x7f52ac158020 2023-12-08T08:23:22.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.922+0000 7f52b1a88640 1 -- 172.21.15.88:0/207573895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52ac158020 msgr2=0x7f52ac15fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:22.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.922+0000 7f52b1a88640 1 --2- 172.21.15.88:0/207573895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52ac158020 0x7f52ac15fcb0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f52a4009d90 tx=0x7f52a401c8c0 comp rx=0 tx=0).stop 2023-12-08T08:23:22.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.922+0000 7f52b1a88640 1 -- 172.21.15.88:0/207573895 shutdown_connections 2023-12-08T08:23:22.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.922+0000 7f52b1a88640 1 --2- 172.21.15.88:0/207573895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52ac158020 0x7f52ac15fcb0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:22.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.922+0000 7f52b1a88640 1 -- 172.21.15.88:0/207573895 >> 172.21.15.88:0/207573895 conn(0x7f52ac066470 msgr2=0x7f52ac066880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:22.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.922+0000 7f52b1a88640 1 -- 172.21.15.88:0/207573895 shutdown_connections 2023-12-08T08:23:22.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.922+0000 7f52b1a88640 1 -- 172.21.15.88:0/207573895 wait complete. 2023-12-08T08:23:22.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.922+0000 7f52b1a88640 1 Processor -- start 2023-12-08T08:23:22.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.922+0000 7f52b1a88640 1 -- start start 2023-12-08T08:23:22.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.922+0000 7f52b1a88640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52ac0c7fd0 0x7f52ac14db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:22.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.922+0000 7f52b1a88640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52ac151b40 0x7f52ac153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:22.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.922+0000 7f52b1a88640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52ac158020 0x7f52ac14f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:22.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.922+0000 7f52b1a88640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac14cd30 con 0x7f52ac151b40 2023-12-08T08:23:22.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.922+0000 7f52b1a88640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac14bdf0 con 0x7f52ac158020 2023-12-08T08:23:22.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.922+0000 7f52b1a88640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac14c090 con 0x7f52ac0c7fd0 2023-12-08T08:23:22.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.926+0000 7f52abfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52ac151b40 0x7f52ac153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:22.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.926+0000 7f52abfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52ac151b40 0x7f52ac153570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54376/0 (socket says 172.21.15.88:54376) 2023-12-08T08:23:22.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.926+0000 7f52abfff640 1 -- 172.21.15.88:0/546963603 learned_addr learned my addr 172.21.15.88:0/546963603 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:22.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.926+0000 7f52b0a86640 1 --2- 172.21.15.88:0/546963603 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52ac0c7fd0 0x7f52ac14db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:22.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.926+0000 7f52b1287640 1 --2- 172.21.15.88:0/546963603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52ac158020 0x7f52ac14f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:22.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.926+0000 7f52abfff640 1 -- 172.21.15.88:0/546963603 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52ac0c7fd0 msgr2=0x7f52ac14db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:22.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.926+0000 7f52abfff640 1 --2- 172.21.15.88:0/546963603 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52ac0c7fd0 0x7f52ac14db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:22.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.926+0000 7f52abfff640 1 -- 172.21.15.88:0/546963603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52ac158020 msgr2=0x7f52ac14f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:22.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.926+0000 7f52abfff640 1 --2- 172.21.15.88:0/546963603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52ac158020 0x7f52ac14f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:22.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.926+0000 7f52abfff640 1 -- 172.21.15.88:0/546963603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a4009a70 con 0x7f52ac151b40 2023-12-08T08:23:22.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.926+0000 7f52abfff640 1 --2- 172.21.15.88:0/546963603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52ac151b40 0x7f52ac153570 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f529800c500 tx=0x7f529800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:22.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.926+0000 7f52a97fa640 1 -- 172.21.15.88:0/546963603 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5298005220 con 0x7f52ac151b40 2023-12-08T08:23:22.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.926+0000 7f52a97fa640 1 -- 172.21.15.88:0/546963603 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5298005380 con 0x7f52ac151b40 2023-12-08T08:23:22.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.926+0000 7f52a97fa640 1 -- 172.21.15.88:0/546963603 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5298007270 con 0x7f52ac151b40 2023-12-08T08:23:22.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.926+0000 7f52b1a88640 1 -- 172.21.15.88:0/546963603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52ac1eda70 con 0x7f52ac151b40 2023-12-08T08:23:22.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.926+0000 7f52b1a88640 1 -- 172.21.15.88:0/546963603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ac1444b0 con 0x7f52ac151b40 2023-12-08T08:23:22.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.926+0000 7f52b1a88640 1 -- 172.21.15.88:0/546963603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52ac1446d0 con 0x7f52ac151b40 2023-12-08T08:23:22.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.926+0000 7f52a97fa640 1 -- 172.21.15.88:0/546963603 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f52980073d0 con 0x7f52ac151b40 2023-12-08T08:23:22.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.930+0000 7f52a97fa640 1 --2- 172.21.15.88:0/546963603 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5290066470 0x7f5290068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:22.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.930+0000 7f52a97fa640 1 -- 172.21.15.88:0/546963603 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5298083a40 con 0x7f52ac151b40 2023-12-08T08:23:22.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.930+0000 7f52b0a86640 1 --2- 172.21.15.88:0/546963603 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5290066470 0x7f5290068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:22.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.930+0000 7f52b0a86640 1 --2- 172.21.15.88:0/546963603 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5290066470 0x7f5290068930 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f52a0000f70 tx=0x7f52a0007240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:22.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:22.934+0000 7f52a97fa640 1 -- 172.21.15.88:0/546963603 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5298050b80 con 0x7f52ac151b40 2023-12-08T08:23:23.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.134+0000 7f52b1a88640 1 -- 172.21.15.88:0/546963603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f52ac14c240 con 0x7f52ac151b40 2023-12-08T08:23:23.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.134+0000 7f52a97fa640 1 -- 172.21.15.88:0/546963603 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1556 (secure 0 0 0) 0x7f52ac14c240 con 0x7f52ac151b40 2023-12-08T08:23:23.139 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:23.139 INFO:teuthology.orchestra.run.smithi088.stdout:{"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":207,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":72,"num_osds":8,"num_up_osds":8,"osd_up_since":1702023607,"num_in_osds":8,"osd_in_since":1702023598,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":129},{"state_name":"creating+peering","count":64}],"num_pgs":193,"num_pools":5,"num_objects":24,"data_bytes":594273,"bytes_used":258260992,"bytes_avail":772835852288,"bytes_total":773094113280,"inactive_pgs_ratio":0.33160620927810669},"fsmap":{"epoch":52,"id":6,"up":1,"in":1,"max":1,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":6519},{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":6525}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-12-08T08:22:40.776840+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-08T08:23:23.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.134+0000 7f52b1a88640 1 -- 172.21.15.88:0/546963603 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5290066470 msgr2=0x7f5290068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:23.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.134+0000 7f52b1a88640 1 --2- 172.21.15.88:0/546963603 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5290066470 0x7f5290068930 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f52a0000f70 tx=0x7f52a0007240 comp rx=0 tx=0).stop 2023-12-08T08:23:23.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.134+0000 7f52b1a88640 1 -- 172.21.15.88:0/546963603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52ac151b40 msgr2=0x7f52ac153570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:23.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.134+0000 7f52b1a88640 1 --2- 172.21.15.88:0/546963603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52ac151b40 0x7f52ac153570 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f529800c500 tx=0x7f529800c9c0 comp rx=0 tx=0).stop 2023-12-08T08:23:23.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.134+0000 7f52b1a88640 1 -- 172.21.15.88:0/546963603 shutdown_connections 2023-12-08T08:23:23.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.134+0000 7f52b1a88640 1 --2- 172.21.15.88:0/546963603 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5290066470 0x7f5290068930 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:23.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.134+0000 7f52b1a88640 1 --2- 172.21.15.88:0/546963603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52ac158020 0x7f52ac14f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:23.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.134+0000 7f52b1a88640 1 --2- 172.21.15.88:0/546963603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52ac151b40 0x7f52ac153570 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:23.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.134+0000 7f52b1a88640 1 --2- 172.21.15.88:0/546963603 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f52ac0c7fd0 0x7f52ac14db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:23.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.134+0000 7f52b1a88640 1 -- 172.21.15.88:0/546963603 >> 172.21.15.88:0/546963603 conn(0x7f52ac066470 msgr2=0x7f52ac0c6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:23.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.134+0000 7f52b1a88640 1 -- 172.21.15.88:0/546963603 shutdown_connections 2023-12-08T08:23:23.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.134+0000 7f52b1a88640 1 -- 172.21.15.88:0/546963603 wait complete. 2023-12-08T08:23:23.159 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-08T08:23:23.159 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:23:23.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.294+0000 7f16af832640 1 Processor -- start 2023-12-08T08:23:23.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.294+0000 7f16af832640 1 -- start start 2023-12-08T08:23:23.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.294+0000 7f16af832640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f16a814fd10 0x7f16a80a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:23.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.294+0000 7f16af832640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a80c5710 con 0x7f16a80a5300 2023-12-08T08:23:23.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.294+0000 7f16af832640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a8155c80 con 0x7f16a8156110 2023-12-08T08:23:23.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.294+0000 7f16af832640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a806c5e0 con 0x7f16a814fd10 2023-12-08T08:23:23.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.294+0000 7f16ad5ce640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f16a814fd10 0x7f16a80a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:23.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.294+0000 7f16acdcd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f16a80a5300 0x7f16a8071e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38012/0 (socket says 172.21.15.88:38012) 2023-12-08T08:23:23.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.294+0000 7f16acdcd640 1 -- 172.21.15.88:0/3264396616 learned_addr learned my addr 172.21.15.88:0/3264396616 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:23.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.294+0000 7f16ad5ce640 1 -- 172.21.15.88:0/3264396616 >> v1:172.21.15.148:6789/0 conn(0x7f16a8156110 legacy=0x7f16a815ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:23.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.294+0000 7f16ad5ce640 1 -- 172.21.15.88:0/3264396616 >> v1:172.21.15.88:6789/0 conn(0x7f16a80a5300 legacy=0x7f16a8071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:23.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.294+0000 7f169ffff640 1 -- 172.21.15.88:0/3264396616 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3106026172 0 0) 0x7f16a80c5710 con 0x7f16a80a5300 2023-12-08T08:23:23.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.294+0000 7f16ad5ce640 1 -- 172.21.15.88:0/3264396616 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a80c4e70 con 0x7f16a814fd10 2023-12-08T08:23:23.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.298+0000 7f16ad5ce640 1 --2- 172.21.15.88:0/3264396616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16a814fd10 0x7f16a80a4dc0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f16a40097c0 tx=0x7f16a401c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b694ad52dbae5b77 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:23.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.298+0000 7f169ffff640 1 -- 172.21.15.88:0/3264396616 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a40ab600 con 0x7f16a814fd10 2023-12-08T08:23:23.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.298+0000 7f169ffff640 1 -- 172.21.15.88:0/3264396616 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a40a7050 con 0x7f16a814fd10 2023-12-08T08:23:23.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.298+0000 7f169ffff640 1 -- 172.21.15.88:0/3264396616 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a40ab980 con 0x7f16a814fd10 2023-12-08T08:23:23.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.298+0000 7f16af832640 1 -- 172.21.15.88:0/3264396616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16a814fd10 msgr2=0x7f16a80a4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:23.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.298+0000 7f16af832640 1 --2- 172.21.15.88:0/3264396616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16a814fd10 0x7f16a80a4dc0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f16a40097c0 tx=0x7f16a401c2f0 comp rx=0 tx=0).stop 2023-12-08T08:23:23.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.298+0000 7f16af832640 1 -- 172.21.15.88:0/3264396616 shutdown_connections 2023-12-08T08:23:23.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.298+0000 7f16af832640 1 --2- 172.21.15.88:0/3264396616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16a814fd10 0x7f16a80a4dc0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:23.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.298+0000 7f16af832640 1 -- 172.21.15.88:0/3264396616 >> 172.21.15.88:0/3264396616 conn(0x7f16a80a7810 msgr2=0x7f16a80a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:23.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.298+0000 7f16af832640 1 -- 172.21.15.88:0/3264396616 shutdown_connections 2023-12-08T08:23:23.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.298+0000 7f16af832640 1 -- 172.21.15.88:0/3264396616 wait complete. 2023-12-08T08:23:23.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.302+0000 7f16af832640 1 Processor -- start 2023-12-08T08:23:23.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.302+0000 7f16af832640 1 -- start start 2023-12-08T08:23:23.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.302+0000 7f16af832640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16a80a5300 0x7f16a81518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:23.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.302+0000 7f16af832640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f16a814fd10 0x7f16a81505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.302+0000 7f16af832640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a8156110 0x7f16a8153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.302+0000 7f16af832640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a81ed480 con 0x7f16a80a5300 2023-12-08T08:23:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.302+0000 7f16af832640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a8152dc0 con 0x7f16a8156110 2023-12-08T08:23:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.302+0000 7f16af832640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a8152490 con 0x7f16a814fd10 2023-12-08T08:23:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.302+0000 7f16ad5ce640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16a80a5300 0x7f16a81518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.302+0000 7f16ad5ce640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16a80a5300 0x7f16a81518f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54398/0 (socket says 172.21.15.88:54398) 2023-12-08T08:23:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.302+0000 7f16ad5ce640 1 -- 172.21.15.88:0/2730362749 learned_addr learned my addr 172.21.15.88:0/2730362749 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.302+0000 7f16ad5ce640 1 -- 172.21.15.88:0/2730362749 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f16a814fd10 msgr2=0x7f16a81505e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.302+0000 7f16ad5ce640 1 --2- 172.21.15.88:0/2730362749 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f16a814fd10 0x7f16a81505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.302+0000 7f16ad5ce640 1 -- 172.21.15.88:0/2730362749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a8156110 msgr2=0x7f16a8153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.302+0000 7f16addcf640 1 --2- 172.21.15.88:0/2730362749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a8156110 0x7f16a8153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.302+0000 7f16ad5ce640 1 --2- 172.21.15.88:0/2730362749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a8156110 0x7f16a8153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.302+0000 7f16ad5ce640 1 -- 172.21.15.88:0/2730362749 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a4009420 con 0x7f16a80a5300 2023-12-08T08:23:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.302+0000 7f16addcf640 1 --2- 172.21.15.88:0/2730362749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a8156110 0x7f16a8153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:23.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.302+0000 7f16ad5ce640 1 --2- 172.21.15.88:0/2730362749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16a80a5300 0x7f16a81518f0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f16a40097c0 tx=0x7f16a4019090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:23.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.302+0000 7f169dffb640 1 -- 172.21.15.88:0/2730362749 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a40b4900 con 0x7f16a80a5300 2023-12-08T08:23:23.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.302+0000 7f169dffb640 1 -- 172.21.15.88:0/2730362749 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a40b4a80 con 0x7f16a80a5300 2023-12-08T08:23:23.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.302+0000 7f16af832640 1 -- 172.21.15.88:0/2730362749 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a8152770 con 0x7f16a80a5300 2023-12-08T08:23:23.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.302+0000 7f169dffb640 1 -- 172.21.15.88:0/2730362749 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a40b4e30 con 0x7f16a80a5300 2023-12-08T08:23:23.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.302+0000 7f16af832640 1 -- 172.21.15.88:0/2730362749 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a8153250 con 0x7f16a80a5300 2023-12-08T08:23:23.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.302+0000 7f16af832640 1 -- 172.21.15.88:0/2730362749 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a8067630 con 0x7f16a80a5300 2023-12-08T08:23:23.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.306+0000 7f169dffb640 1 -- 172.21.15.88:0/2730362749 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f16a40b2040 con 0x7f16a80a5300 2023-12-08T08:23:23.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.306+0000 7f169dffb640 1 --2- 172.21.15.88:0/2730362749 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f168c066470 0x7f168c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:23.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.306+0000 7f169dffb640 1 -- 172.21.15.88:0/2730362749 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f16a411e6c0 con 0x7f16a80a5300 2023-12-08T08:23:23.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.306+0000 7f16acdcd640 1 --2- 172.21.15.88:0/2730362749 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f168c066470 0x7f168c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:23.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.306+0000 7f16acdcd640 1 --2- 172.21.15.88:0/2730362749 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f168c066470 0x7f168c068930 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f16980011f0 tx=0x7f1698007930 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:23.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.310+0000 7f169dffb640 1 -- 172.21.15.88:0/2730362749 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f16a40eb7e0 con 0x7f16a80a5300 2023-12-08T08:23:23.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.458+0000 7f16af832640 1 -- 172.21.15.88:0/2730362749 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f16a80aba00 con 0x7f168c066470 2023-12-08T08:23:23.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.470+0000 7f169dffb640 1 -- 172.21.15.88:0/2730362749 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+522584 (secure 0 0 0) 0x7f16980070d0 con 0x7f168c066470 2023-12-08T08:23:23.479 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:23.482 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:23:23.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.474+0000 7f16af832640 1 -- 172.21.15.88:0/2730362749 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f168c066470 msgr2=0x7f168c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:23.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.474+0000 7f16af832640 1 --2- 172.21.15.88:0/2730362749 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f168c066470 0x7f168c068930 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f16980011f0 tx=0x7f1698007930 comp rx=0 tx=0).stop 2023-12-08T08:23:23.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.474+0000 7f16af832640 1 -- 172.21.15.88:0/2730362749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16a80a5300 msgr2=0x7f16a81518f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:23.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.474+0000 7f16af832640 1 --2- 172.21.15.88:0/2730362749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16a80a5300 0x7f16a81518f0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f16a40097c0 tx=0x7f16a4019090 comp rx=0 tx=0).stop 2023-12-08T08:23:23.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.474+0000 7f16af832640 1 -- 172.21.15.88:0/2730362749 shutdown_connections 2023-12-08T08:23:23.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.474+0000 7f16af832640 1 --2- 172.21.15.88:0/2730362749 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f168c066470 0x7f168c068930 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:23.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.474+0000 7f16af832640 1 --2- 172.21.15.88:0/2730362749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a8156110 0x7f16a8153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:23.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.474+0000 7f16af832640 1 --2- 172.21.15.88:0/2730362749 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f16a814fd10 0x7f16a81505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:23.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.474+0000 7f16af832640 1 --2- 172.21.15.88:0/2730362749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16a80a5300 0x7f16a81518f0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:23.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.474+0000 7f16af832640 1 -- 172.21.15.88:0/2730362749 >> 172.21.15.88:0/2730362749 conn(0x7f16a80a7810 msgr2=0x7f16a80a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:23.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.474+0000 7f16af832640 1 -- 172.21.15.88:0/2730362749 shutdown_connections 2023-12-08T08:23:23.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:23.474+0000 7f16af832640 1 -- 172.21.15.88:0/2730362749 wait complete. 2023-12-08T08:23:23.498 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2023-12-08T08:23:22.784419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":261,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252208,"kb_used_data":6900,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754722512,"statfs":{"total":773094113280,"available":772835852288,"internally_reserved":0,"allocated":7065600,"data_stored":4208008,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001078"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.897424+0000","last_change":"2023-12-08T08:23:16.897424+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.897424+0000","last_undegraded":"2023-12-08T08:23:16.897424+0000","last_fullsized":"2023-12-08T08:23:16.897424+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889235+0000","last_change":"2023-12-08T08:23:00.281512+0000","last_active":"2023-12-08T08:23:15.889235+0000","last_peered":"2023-12-08T08:23:15.889235+0000","last_clean":"2023-12-08T08:23:15.889235+0000","last_became_active":"2023-12-08T08:23:00.281118+0000","last_became_peered":"2023-12-08T08:23:00.281118+0000","last_unstale":"2023-12-08T08:23:15.889235+0000","last_undegraded":"2023-12-08T08:23:15.889235+0000","last_fullsized":"2023-12-08T08:23:15.889235+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:15.472021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.903319+0000","last_change":"2023-12-08T08:23:16.903319+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.903319+0000","last_undegraded":"2023-12-08T08:23:16.903319+0000","last_fullsized":"2023-12-08T08:23:16.903319+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.891247+0000","last_change":"2023-12-08T08:23:00.276523+0000","last_active":"2023-12-08T08:23:15.891247+0000","last_peered":"2023-12-08T08:23:15.891247+0000","last_clean":"2023-12-08T08:23:15.891247+0000","last_became_active":"2023-12-08T08:23:00.276039+0000","last_became_peered":"2023-12-08T08:23:00.276039+0000","last_unstale":"2023-12-08T08:23:15.891247+0000","last_undegraded":"2023-12-08T08:23:15.891247+0000","last_fullsized":"2023-12-08T08:23:15.891247+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:31:16.893953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896828+0000","last_change":"2023-12-08T08:23:16.896828+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896828+0000","last_undegraded":"2023-12-08T08:23:16.896828+0000","last_fullsized":"2023-12-08T08:23:16.896828+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895520+0000","last_change":"2023-12-08T08:23:00.283198+0000","last_active":"2023-12-08T08:23:15.895520+0000","last_peered":"2023-12-08T08:23:15.895520+0000","last_clean":"2023-12-08T08:23:15.895520+0000","last_became_active":"2023-12-08T08:23:00.282944+0000","last_became_peered":"2023-12-08T08:23:00.282944+0000","last_unstale":"2023-12-08T08:23:15.895520+0000","last_undegraded":"2023-12-08T08:23:15.895520+0000","last_fullsized":"2023-12-08T08:23:15.895520+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:33.898137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.898081+0000","last_change":"2023-12-08T08:23:16.898081+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.898081+0000","last_undegraded":"2023-12-08T08:23:16.898081+0000","last_fullsized":"2023-12-08T08:23:16.898081+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.884023+0000","last_change":"2023-12-08T08:23:00.285685+0000","last_active":"2023-12-08T08:23:15.884023+0000","last_peered":"2023-12-08T08:23:15.884023+0000","last_clean":"2023-12-08T08:23:15.884023+0000","last_became_active":"2023-12-08T08:23:00.285351+0000","last_became_peered":"2023-12-08T08:23:00.285351+0000","last_unstale":"2023-12-08T08:23:15.884023+0000","last_undegraded":"2023-12-08T08:23:15.884023+0000","last_fullsized":"2023-12-08T08:23:15.884023+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:43:34.830332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900497+0000","last_change":"2023-12-08T08:23:16.900497+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900497+0000","last_undegraded":"2023-12-08T08:23:16.900497+0000","last_fullsized":"2023-12-08T08:23:16.900497+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885459+0000","last_change":"2023-12-08T08:23:00.264270+0000","last_active":"2023-12-08T08:23:15.885459+0000","last_peered":"2023-12-08T08:23:15.885459+0000","last_clean":"2023-12-08T08:23:15.885459+0000","last_became_active":"2023-12-08T08:23:00.263994+0000","last_became_peered":"2023-12-08T08:23:00.263994+0000","last_unstale":"2023-12-08T08:23:15.885459+0000","last_undegraded":"2023-12-08T08:23:15.885459+0000","last_fullsized":"2023-12-08T08:23:15.885459+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:33.905575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900421+0000","last_change":"2023-12-08T08:23:16.900421+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900421+0000","last_undegraded":"2023-12-08T08:23:16.900421+0000","last_fullsized":"2023-12-08T08:23:16.900421+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895579+0000","last_change":"2023-12-08T08:23:00.300354+0000","last_active":"2023-12-08T08:23:15.895579+0000","last_peered":"2023-12-08T08:23:15.895579+0000","last_clean":"2023-12-08T08:23:15.895579+0000","last_became_active":"2023-12-08T08:23:00.300026+0000","last_became_peered":"2023-12-08T08:23:00.300026+0000","last_unstale":"2023-12-08T08:23:15.895579+0000","last_undegraded":"2023-12-08T08:23:15.895579+0000","last_fullsized":"2023-12-08T08:23:15.895579+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.905320+0000","last_change":"2023-12-08T08:23:16.905320+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.905320+0000","last_undegraded":"2023-12-08T08:23:16.905320+0000","last_fullsized":"2023-12-08T08:23:16.905320+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883417+0000","last_change":"2023-12-08T08:23:00.278456+0000","last_active":"2023-12-08T08:23:15.883417+0000","last_peered":"2023-12-08T08:23:15.883417+0000","last_clean":"2023-12-08T08:23:15.883417+0000","last_became_active":"2023-12-08T08:23:00.277186+0000","last_became_peered":"2023-12-08T08:23:00.277186+0000","last_unstale":"2023-12-08T08:23:15.883417+0000","last_undegraded":"2023-12-08T08:23:15.883417+0000","last_fullsized":"2023-12-08T08:23:15.883417+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:20:16.170951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900665+0000","last_change":"2023-12-08T08:23:16.900665+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900665+0000","last_undegraded":"2023-12-08T08:23:16.900665+0000","last_fullsized":"2023-12-08T08:23:16.900665+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.893869+0000","last_change":"2023-12-08T08:23:00.272694+0000","last_active":"2023-12-08T08:23:15.893869+0000","last_peered":"2023-12-08T08:23:15.893869+0000","last_clean":"2023-12-08T08:23:15.893869+0000","last_became_active":"2023-12-08T08:23:00.272440+0000","last_became_peered":"2023-12-08T08:23:00.272440+0000","last_unstale":"2023-12-08T08:23:15.893869+0000","last_undegraded":"2023-12-08T08:23:15.893869+0000","last_fullsized":"2023-12-08T08:23:15.893869+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:15.472021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.908893+0000","last_change":"2023-12-08T08:23:16.908893+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.908893+0000","last_undegraded":"2023-12-08T08:23:16.908893+0000","last_fullsized":"2023-12-08T08:23:16.908893+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895866+0000","last_change":"2023-12-08T08:23:00.298447+0000","last_active":"2023-12-08T08:23:15.895866+0000","last_peered":"2023-12-08T08:23:15.895866+0000","last_clean":"2023-12-08T08:23:15.895866+0000","last_became_active":"2023-12-08T08:23:00.298113+0000","last_became_peered":"2023-12-08T08:23:00.298113+0000","last_unstale":"2023-12-08T08:23:15.895866+0000","last_undegraded":"2023-12-08T08:23:15.895866+0000","last_fullsized":"2023-12-08T08:23:15.895866+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896836+0000","last_change":"2023-12-08T08:23:16.896836+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896836+0000","last_undegraded":"2023-12-08T08:23:16.896836+0000","last_fullsized":"2023-12-08T08:23:16.896836+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889234+0000","last_change":"2023-12-08T08:23:00.277064+0000","last_active":"2023-12-08T08:23:15.889234+0000","last_peered":"2023-12-08T08:23:15.889234+0000","last_clean":"2023-12-08T08:23:15.889234+0000","last_became_active":"2023-12-08T08:23:00.276850+0000","last_became_peered":"2023-12-08T08:23:00.276850+0000","last_unstale":"2023-12-08T08:23:15.889234+0000","last_undegraded":"2023-12-08T08:23:15.889234+0000","last_fullsized":"2023-12-08T08:23:15.889234+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896062+0000","last_change":"2023-12-08T08:23:16.896062+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896062+0000","last_undegraded":"2023-12-08T08:23:16.896062+0000","last_fullsized":"2023-12-08T08:23:16.896062+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.891049+0000","last_change":"2023-12-08T08:23:00.286362+0000","last_active":"2023-12-08T08:23:15.891049+0000","last_peered":"2023-12-08T08:23:15.891049+0000","last_clean":"2023-12-08T08:23:15.891049+0000","last_became_active":"2023-12-08T08:23:00.286071+0000","last_became_peered":"2023-12-08T08:23:00.286071+0000","last_unstale":"2023-12-08T08:23:15.891049+0000","last_undegraded":"2023-12-08T08:23:15.891049+0000","last_fullsized":"2023-12-08T08:23:15.891049+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:50.890759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.905090+0000","last_change":"2023-12-08T08:23:16.905090+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.905090+0000","last_undegraded":"2023-12-08T08:23:16.905090+0000","last_fullsized":"2023-12-08T08:23:16.905090+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888742+0000","last_change":"2023-12-08T08:23:00.277187+0000","last_active":"2023-12-08T08:23:15.888742+0000","last_peered":"2023-12-08T08:23:15.888742+0000","last_clean":"2023-12-08T08:23:15.888742+0000","last_became_active":"2023-12-08T08:23:00.276929+0000","last_became_peered":"2023-12-08T08:23:00.276929+0000","last_unstale":"2023-12-08T08:23:15.888742+0000","last_undegraded":"2023-12-08T08:23:15.888742+0000","last_fullsized":"2023-12-08T08:23:15.888742+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:55:36.390421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.908607+0000","last_change":"2023-12-08T08:23:16.908607+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.908607+0000","last_undegraded":"2023-12-08T08:23:16.908607+0000","last_fullsized":"2023-12-08T08:23:16.908607+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894617+0000","last_change":"2023-12-08T08:23:00.275837+0000","last_active":"2023-12-08T08:23:15.894617+0000","last_peered":"2023-12-08T08:23:15.894617+0000","last_clean":"2023-12-08T08:23:15.894617+0000","last_became_active":"2023-12-08T08:23:00.275561+0000","last_became_peered":"2023-12-08T08:23:00.275561+0000","last_unstale":"2023-12-08T08:23:15.894617+0000","last_undegraded":"2023-12-08T08:23:15.894617+0000","last_fullsized":"2023-12-08T08:23:15.894617+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.901924+0000","last_change":"2023-12-08T08:23:16.901924+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.901924+0000","last_undegraded":"2023-12-08T08:23:16.901924+0000","last_fullsized":"2023-12-08T08:23:16.901924+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883534+0000","last_change":"2023-12-08T08:23:00.295614+0000","last_active":"2023-12-08T08:23:15.883534+0000","last_peered":"2023-12-08T08:23:15.883534+0000","last_clean":"2023-12-08T08:23:15.883534+0000","last_became_active":"2023-12-08T08:23:00.295111+0000","last_became_peered":"2023-12-08T08:23:00.295111+0000","last_unstale":"2023-12-08T08:23:15.883534+0000","last_undegraded":"2023-12-08T08:23:15.883534+0000","last_fullsized":"2023-12-08T08:23:15.883534+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:10:16.885890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.907581+0000","last_change":"2023-12-08T08:23:16.907581+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.907581+0000","last_undegraded":"2023-12-08T08:23:16.907581+0000","last_fullsized":"2023-12-08T08:23:16.907581+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888024+0000","last_change":"2023-12-08T08:23:00.292909+0000","last_active":"2023-12-08T08:23:15.888024+0000","last_peered":"2023-12-08T08:23:15.888024+0000","last_clean":"2023-12-08T08:23:15.888024+0000","last_became_active":"2023-12-08T08:23:00.292500+0000","last_became_peered":"2023-12-08T08:23:00.292500+0000","last_unstale":"2023-12-08T08:23:15.888024+0000","last_undegraded":"2023-12-08T08:23:15.888024+0000","last_fullsized":"2023-12-08T08:23:15.888024+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:21:14.553932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.902396+0000","last_change":"2023-12-08T08:23:16.902396+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.902396+0000","last_undegraded":"2023-12-08T08:23:16.902396+0000","last_fullsized":"2023-12-08T08:23:16.902396+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885220+0000","last_change":"2023-12-08T08:23:00.273084+0000","last_active":"2023-12-08T08:23:15.885220+0000","last_peered":"2023-12-08T08:23:15.885220+0000","last_clean":"2023-12-08T08:23:15.885220+0000","last_became_active":"2023-12-08T08:23:00.272803+0000","last_became_peered":"2023-12-08T08:23:00.272803+0000","last_unstale":"2023-12-08T08:23:15.885220+0000","last_undegraded":"2023-12-08T08:23:15.885220+0000","last_fullsized":"2023-12-08T08:23:15.885220+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:16.068318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900173+0000","last_change":"2023-12-08T08:23:16.900173+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900173+0000","last_undegraded":"2023-12-08T08:23:16.900173+0000","last_fullsized":"2023-12-08T08:23:16.900173+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.886059+0000","last_change":"2023-12-08T08:23:00.300292+0000","last_active":"2023-12-08T08:23:15.886059+0000","last_peered":"2023-12-08T08:23:15.886059+0000","last_clean":"2023-12-08T08:23:15.886059+0000","last_became_active":"2023-12-08T08:23:00.300008+0000","last_became_peered":"2023-12-08T08:23:00.300008+0000","last_unstale":"2023-12-08T08:23:15.886059+0000","last_undegraded":"2023-12-08T08:23:15.886059+0000","last_fullsized":"2023-12-08T08:23:15.886059+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:39.385907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896360+0000","last_change":"2023-12-08T08:23:16.896360+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896360+0000","last_undegraded":"2023-12-08T08:23:16.896360+0000","last_fullsized":"2023-12-08T08:23:16.896360+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.884197+0000","last_change":"2023-12-08T08:23:00.299621+0000","last_active":"2023-12-08T08:23:15.884197+0000","last_peered":"2023-12-08T08:23:15.884197+0000","last_clean":"2023-12-08T08:23:15.884197+0000","last_became_active":"2023-12-08T08:23:00.299255+0000","last_became_peered":"2023-12-08T08:23:00.299255+0000","last_unstale":"2023-12-08T08:23:15.884197+0000","last_undegraded":"2023-12-08T08:23:15.884197+0000","last_fullsized":"2023-12-08T08:23:15.884197+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:28:46.845466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896496+0000","last_change":"2023-12-08T08:23:16.896496+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896496+0000","last_undegraded":"2023-12-08T08:23:16.896496+0000","last_fullsized":"2023-12-08T08:23:16.896496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.896102+0000","last_change":"2023-12-08T08:23:00.296010+0000","last_active":"2023-12-08T08:23:15.896102+0000","last_peered":"2023-12-08T08:23:15.896102+0000","last_clean":"2023-12-08T08:23:15.896102+0000","last_became_active":"2023-12-08T08:23:00.295749+0000","last_became_peered":"2023-12-08T08:23:00.295749+0000","last_unstale":"2023-12-08T08:23:15.896102+0000","last_undegraded":"2023-12-08T08:23:15.896102+0000","last_fullsized":"2023-12-08T08:23:15.896102+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:39.385907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.902160+0000","last_change":"2023-12-08T08:23:16.902160+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.902160+0000","last_undegraded":"2023-12-08T08:23:16.902160+0000","last_fullsized":"2023-12-08T08:23:16.902160+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.884023+0000","last_change":"2023-12-08T08:23:00.301831+0000","last_active":"2023-12-08T08:23:15.884023+0000","last_peered":"2023-12-08T08:23:15.884023+0000","last_clean":"2023-12-08T08:23:15.884023+0000","last_became_active":"2023-12-08T08:23:00.301321+0000","last_became_peered":"2023-12-08T08:23:00.301321+0000","last_unstale":"2023-12-08T08:23:15.884023+0000","last_undegraded":"2023-12-08T08:23:15.884023+0000","last_fullsized":"2023-12-08T08:23:15.884023+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:14:54.964832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.895365+0000","last_change":"2023-12-08T08:23:16.895365+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.895365+0000","last_undegraded":"2023-12-08T08:23:16.895365+0000","last_fullsized":"2023-12-08T08:23:16.895365+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883777+0000","last_change":"2023-12-08T08:23:00.301605+0000","last_active":"2023-12-08T08:23:15.883777+0000","last_peered":"2023-12-08T08:23:15.883777+0000","last_clean":"2023-12-08T08:23:15.883777+0000","last_became_active":"2023-12-08T08:23:00.301346+0000","last_became_peered":"2023-12-08T08:23:00.301346+0000","last_unstale":"2023-12-08T08:23:15.883777+0000","last_undegraded":"2023-12-08T08:23:15.883777+0000","last_fullsized":"2023-12-08T08:23:15.883777+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:35:35.139064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900505+0000","last_change":"2023-12-08T08:23:16.900505+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900505+0000","last_undegraded":"2023-12-08T08:23:16.900505+0000","last_fullsized":"2023-12-08T08:23:16.900505+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889839+0000","last_change":"2023-12-08T08:23:00.301440+0000","last_active":"2023-12-08T08:23:15.889839+0000","last_peered":"2023-12-08T08:23:15.889839+0000","last_clean":"2023-12-08T08:23:15.889839+0000","last_became_active":"2023-12-08T08:23:00.301156+0000","last_became_peered":"2023-12-08T08:23:00.301156+0000","last_unstale":"2023-12-08T08:23:15.889839+0000","last_undegraded":"2023-12-08T08:23:15.889839+0000","last_fullsized":"2023-12-08T08:23:15.889839+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:04:21.562137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900540+0000","last_change":"2023-12-08T08:23:16.900540+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900540+0000","last_undegraded":"2023-12-08T08:23:16.900540+0000","last_fullsized":"2023-12-08T08:23:16.900540+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888706+0000","last_change":"2023-12-08T08:23:00.301914+0000","last_active":"2023-12-08T08:23:15.888706+0000","last_peered":"2023-12-08T08:23:15.888706+0000","last_clean":"2023-12-08T08:23:15.888706+0000","last_became_active":"2023-12-08T08:23:00.301688+0000","last_became_peered":"2023-12-08T08:23:00.301688+0000","last_unstale":"2023-12-08T08:23:15.888706+0000","last_undegraded":"2023-12-08T08:23:15.888706+0000","last_fullsized":"2023-12-08T08:23:15.888706+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:27:39.303886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896058+0000","last_change":"2023-12-08T08:23:16.896058+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896058+0000","last_undegraded":"2023-12-08T08:23:16.896058+0000","last_fullsized":"2023-12-08T08:23:16.896058+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883508+0000","last_change":"2023-12-08T08:23:00.298664+0000","last_active":"2023-12-08T08:23:15.883508+0000","last_peered":"2023-12-08T08:23:15.883508+0000","last_clean":"2023-12-08T08:23:15.883508+0000","last_became_active":"2023-12-08T08:23:00.298341+0000","last_became_peered":"2023-12-08T08:23:00.298341+0000","last_unstale":"2023-12-08T08:23:15.883508+0000","last_undegraded":"2023-12-08T08:23:15.883508+0000","last_fullsized":"2023-12-08T08:23:15.883508+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:20:20.944416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900528+0000","last_change":"2023-12-08T08:23:16.900528+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900528+0000","last_undegraded":"2023-12-08T08:23:16.900528+0000","last_fullsized":"2023-12-08T08:23:16.900528+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.891893+0000","last_change":"2023-12-08T08:23:00.280235+0000","last_active":"2023-12-08T08:23:15.891893+0000","last_peered":"2023-12-08T08:23:15.891893+0000","last_clean":"2023-12-08T08:23:15.891893+0000","last_became_active":"2023-12-08T08:23:00.278807+0000","last_became_peered":"2023-12-08T08:23:00.278807+0000","last_unstale":"2023-12-08T08:23:15.891893+0000","last_undegraded":"2023-12-08T08:23:15.891893+0000","last_fullsized":"2023-12-08T08:23:15.891893+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:30:44.391621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.905250+0000","last_change":"2023-12-08T08:23:16.905250+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.905250+0000","last_undegraded":"2023-12-08T08:23:16.905250+0000","last_fullsized":"2023-12-08T08:23:16.905250+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895888+0000","last_change":"2023-12-08T08:23:00.278532+0000","last_active":"2023-12-08T08:23:15.895888+0000","last_peered":"2023-12-08T08:23:15.895888+0000","last_clean":"2023-12-08T08:23:15.895888+0000","last_became_active":"2023-12-08T08:23:00.278177+0000","last_became_peered":"2023-12-08T08:23:00.278177+0000","last_unstale":"2023-12-08T08:23:15.895888+0000","last_undegraded":"2023-12-08T08:23:15.895888+0000","last_fullsized":"2023-12-08T08:23:15.895888+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:56.216551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.905136+0000","last_change":"2023-12-08T08:23:16.905136+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.905136+0000","last_undegraded":"2023-12-08T08:23:16.905136+0000","last_fullsized":"2023-12-08T08:23:16.905136+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885639+0000","last_change":"2023-12-08T08:23:00.284090+0000","last_active":"2023-12-08T08:23:15.885639+0000","last_peered":"2023-12-08T08:23:15.885639+0000","last_clean":"2023-12-08T08:23:15.885639+0000","last_became_active":"2023-12-08T08:23:00.283777+0000","last_became_peered":"2023-12-08T08:23:00.283777+0000","last_unstale":"2023-12-08T08:23:15.885639+0000","last_undegraded":"2023-12-08T08:23:15.885639+0000","last_fullsized":"2023-12-08T08:23:15.885639+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896936+0000","last_change":"2023-12-08T08:23:16.896936+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896936+0000","last_undegraded":"2023-12-08T08:23:16.896936+0000","last_fullsized":"2023-12-08T08:23:16.896936+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888780+0000","last_change":"2023-12-08T08:23:00.277149+0000","last_active":"2023-12-08T08:23:15.888780+0000","last_peered":"2023-12-08T08:23:15.888780+0000","last_clean":"2023-12-08T08:23:15.888780+0000","last_became_active":"2023-12-08T08:23:00.276879+0000","last_became_peered":"2023-12-08T08:23:00.276879+0000","last_unstale":"2023-12-08T08:23:15.888780+0000","last_undegraded":"2023-12-08T08:23:15.888780+0000","last_fullsized":"2023-12-08T08:23:15.888780+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:16.068318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.901831+0000","last_change":"2023-12-08T08:23:16.901831+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.901831+0000","last_undegraded":"2023-12-08T08:23:16.901831+0000","last_fullsized":"2023-12-08T08:23:16.901831+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.890291+0000","last_change":"2023-12-08T08:23:00.294726+0000","last_active":"2023-12-08T08:23:15.890291+0000","last_peered":"2023-12-08T08:23:15.890291+0000","last_clean":"2023-12-08T08:23:15.890291+0000","last_became_active":"2023-12-08T08:23:00.294450+0000","last_became_peered":"2023-12-08T08:23:00.294450+0000","last_unstale":"2023-12-08T08:23:15.890291+0000","last_undegraded":"2023-12-08T08:23:15.890291+0000","last_fullsized":"2023-12-08T08:23:15.890291+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:28:25.934029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.895819+0000","last_change":"2023-12-08T08:23:16.895819+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.895819+0000","last_undegraded":"2023-12-08T08:23:16.895819+0000","last_fullsized":"2023-12-08T08:23:16.895819+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889918+0000","last_change":"2023-12-08T08:23:00.288804+0000","last_active":"2023-12-08T08:23:15.889918+0000","last_peered":"2023-12-08T08:23:15.889918+0000","last_clean":"2023-12-08T08:23:15.889918+0000","last_became_active":"2023-12-08T08:23:00.288315+0000","last_became_peered":"2023-12-08T08:23:00.288315+0000","last_unstale":"2023-12-08T08:23:15.889918+0000","last_undegraded":"2023-12-08T08:23:15.889918+0000","last_fullsized":"2023-12-08T08:23:15.889918+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:23:06.925359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.895362+0000","last_change":"2023-12-08T08:23:16.895362+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.895362+0000","last_undegraded":"2023-12-08T08:23:16.895362+0000","last_fullsized":"2023-12-08T08:23:16.895362+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885385+0000","last_change":"2023-12-08T08:23:00.294482+0000","last_active":"2023-12-08T08:23:15.885385+0000","last_peered":"2023-12-08T08:23:15.885385+0000","last_clean":"2023-12-08T08:23:15.885385+0000","last_became_active":"2023-12-08T08:23:00.294057+0000","last_became_peered":"2023-12-08T08:23:00.294057+0000","last_unstale":"2023-12-08T08:23:15.885385+0000","last_undegraded":"2023-12-08T08:23:15.885385+0000","last_fullsized":"2023-12-08T08:23:15.885385+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:42:20.038693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.898306+0000","last_change":"2023-12-08T08:23:16.898306+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.898306+0000","last_undegraded":"2023-12-08T08:23:16.898306+0000","last_fullsized":"2023-12-08T08:23:16.898306+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888263+0000","last_change":"2023-12-08T08:23:00.272949+0000","last_active":"2023-12-08T08:23:15.888263+0000","last_peered":"2023-12-08T08:23:15.888263+0000","last_clean":"2023-12-08T08:23:15.888263+0000","last_became_active":"2023-12-08T08:23:00.272655+0000","last_became_peered":"2023-12-08T08:23:00.272655+0000","last_unstale":"2023-12-08T08:23:15.888263+0000","last_undegraded":"2023-12-08T08:23:15.888263+0000","last_fullsized":"2023-12-08T08:23:15.888263+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:28.275394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.897379+0000","last_change":"2023-12-08T08:23:16.897379+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.897379+0000","last_undegraded":"2023-12-08T08:23:16.897379+0000","last_fullsized":"2023-12-08T08:23:16.897379+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.921665+0000","last_change":"2023-12-08T08:23:16.917024+0000","last_active":"2023-12-08T08:23:16.921665+0000","last_peered":"2023-12-08T08:23:16.921665+0000","last_clean":"2023-12-08T08:23:16.921665+0000","last_became_active":"2023-12-08T08:23:16.916776+0000","last_became_peered":"2023-12-08T08:23:16.916776+0000","last_unstale":"2023-12-08T08:23:16.921665+0000","last_undegraded":"2023-12-08T08:23:16.921665+0000","last_fullsized":"2023-12-08T08:23:16.921665+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:14:23.904816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885919+0000","last_change":"2023-12-08T08:23:00.273779+0000","last_active":"2023-12-08T08:23:15.885919+0000","last_peered":"2023-12-08T08:23:15.885919+0000","last_clean":"2023-12-08T08:23:15.885919+0000","last_became_active":"2023-12-08T08:23:00.273256+0000","last_became_peered":"2023-12-08T08:23:00.273256+0000","last_unstale":"2023-12-08T08:23:15.885919+0000","last_undegraded":"2023-12-08T08:23:15.885919+0000","last_fullsized":"2023-12-08T08:23:15.885919+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"67'4","reported_seq":18,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889446+0000","last_change":"2023-12-08T08:22:59.285668+0000","last_active":"2023-12-08T08:23:15.889446+0000","last_peered":"2023-12-08T08:23:15.889446+0000","last_clean":"2023-12-08T08:23:15.889446+0000","last_became_active":"2023-12-08T08:22:59.285340+0000","last_became_peered":"2023-12-08T08:22:59.285340+0000","last_unstale":"2023-12-08T08:23:15.889446+0000","last_undegraded":"2023-12-08T08:23:15.889446+0000","last_fullsized":"2023-12-08T08:23:15.889446+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:35:15.000491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.895648+0000","last_change":"2023-12-08T08:23:16.895648+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.895648+0000","last_undegraded":"2023-12-08T08:23:16.895648+0000","last_fullsized":"2023-12-08T08:23:16.895648+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.911983+0000","last_change":"2023-12-08T08:23:16.905712+0000","last_active":"2023-12-08T08:23:16.911983+0000","last_peered":"2023-12-08T08:23:16.911983+0000","last_clean":"2023-12-08T08:23:16.911983+0000","last_became_active":"2023-12-08T08:23:16.905399+0000","last_became_peered":"2023-12-08T08:23:16.905399+0000","last_unstale":"2023-12-08T08:23:16.911983+0000","last_undegraded":"2023-12-08T08:23:16.911983+0000","last_fullsized":"2023-12-08T08:23:16.911983+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:10:23.005533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889328+0000","last_change":"2023-12-08T08:23:00.300874+0000","last_active":"2023-12-08T08:23:15.889328+0000","last_peered":"2023-12-08T08:23:15.889328+0000","last_clean":"2023-12-08T08:23:15.889328+0000","last_became_active":"2023-12-08T08:23:00.300595+0000","last_became_peered":"2023-12-08T08:23:00.300595+0000","last_unstale":"2023-12-08T08:23:15.889328+0000","last_undegraded":"2023-12-08T08:23:15.889328+0000","last_fullsized":"2023-12-08T08:23:15.889328+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"67'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.886098+0000","last_change":"2023-12-08T08:22:59.274595+0000","last_active":"2023-12-08T08:23:15.886098+0000","last_peered":"2023-12-08T08:23:15.886098+0000","last_clean":"2023-12-08T08:23:15.886098+0000","last_became_active":"2023-12-08T08:22:59.274280+0000","last_became_peered":"2023-12-08T08:22:59.274280+0000","last_unstale":"2023-12-08T08:23:15.886098+0000","last_undegraded":"2023-12-08T08:23:15.886098+0000","last_fullsized":"2023-12-08T08:23:15.886098+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:27.267774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.899707+0000","last_change":"2023-12-08T08:23:16.899707+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.899707+0000","last_undegraded":"2023-12-08T08:23:16.899707+0000","last_fullsized":"2023-12-08T08:23:16.899707+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920597+0000","last_change":"2023-12-08T08:23:16.915200+0000","last_active":"2023-12-08T08:23:16.920597+0000","last_peered":"2023-12-08T08:23:16.920597+0000","last_clean":"2023-12-08T08:23:16.920597+0000","last_became_active":"2023-12-08T08:23:16.914766+0000","last_became_peered":"2023-12-08T08:23:16.914766+0000","last_unstale":"2023-12-08T08:23:16.920597+0000","last_undegraded":"2023-12-08T08:23:16.920597+0000","last_fullsized":"2023-12-08T08:23:16.920597+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:53:48.202811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888831+0000","last_change":"2023-12-08T08:23:00.280594+0000","last_active":"2023-12-08T08:23:15.888831+0000","last_peered":"2023-12-08T08:23:15.888831+0000","last_clean":"2023-12-08T08:23:15.888831+0000","last_became_active":"2023-12-08T08:23:00.279794+0000","last_became_peered":"2023-12-08T08:23:00.279794+0000","last_unstale":"2023-12-08T08:23:15.888831+0000","last_undegraded":"2023-12-08T08:23:15.888831+0000","last_fullsized":"2023-12-08T08:23:15.888831+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:33.905575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"67'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.896121+0000","last_change":"2023-12-08T08:22:59.282892+0000","last_active":"2023-12-08T08:23:15.896121+0000","last_peered":"2023-12-08T08:23:15.896121+0000","last_clean":"2023-12-08T08:23:15.896121+0000","last_became_active":"2023-12-08T08:22:59.282172+0000","last_became_peered":"2023-12-08T08:22:59.282172+0000","last_unstale":"2023-12-08T08:23:15.896121+0000","last_undegraded":"2023-12-08T08:23:15.896121+0000","last_fullsized":"2023-12-08T08:23:15.896121+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:32.890517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.902603+0000","last_change":"2023-12-08T08:23:16.902603+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.902603+0000","last_undegraded":"2023-12-08T08:23:16.902603+0000","last_fullsized":"2023-12-08T08:23:16.902603+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920546+0000","last_change":"2023-12-08T08:23:16.917813+0000","last_active":"2023-12-08T08:23:16.920546+0000","last_peered":"2023-12-08T08:23:16.920546+0000","last_clean":"2023-12-08T08:23:16.920546+0000","last_became_active":"2023-12-08T08:23:16.917358+0000","last_became_peered":"2023-12-08T08:23:16.917358+0000","last_unstale":"2023-12-08T08:23:16.920546+0000","last_undegraded":"2023-12-08T08:23:16.920546+0000","last_fullsized":"2023-12-08T08:23:16.920546+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:18:49.227732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895498+0000","last_change":"2023-12-08T08:23:00.304580+0000","last_active":"2023-12-08T08:23:15.895498+0000","last_peered":"2023-12-08T08:23:15.895498+0000","last_clean":"2023-12-08T08:23:15.895498+0000","last_became_active":"2023-12-08T08:23:00.304098+0000","last_became_peered":"2023-12-08T08:23:00.304098+0000","last_unstale":"2023-12-08T08:23:15.895498+0000","last_undegraded":"2023-12-08T08:23:15.895498+0000","last_fullsized":"2023-12-08T08:23:15.895498+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:29:03.020360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"67'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895935+0000","last_change":"2023-12-08T08:22:59.283290+0000","last_active":"2023-12-08T08:23:15.895935+0000","last_peered":"2023-12-08T08:23:15.895935+0000","last_clean":"2023-12-08T08:23:15.895935+0000","last_became_active":"2023-12-08T08:22:59.282103+0000","last_became_peered":"2023-12-08T08:22:59.282103+0000","last_unstale":"2023-12-08T08:23:15.895935+0000","last_undegraded":"2023-12-08T08:23:15.895935+0000","last_fullsized":"2023-12-08T08:23:15.895935+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:15.256488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.903785+0000","last_change":"2023-12-08T08:23:16.903785+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.903785+0000","last_undegraded":"2023-12-08T08:23:16.903785+0000","last_fullsized":"2023-12-08T08:23:16.903785+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.919943+0000","last_change":"2023-12-08T08:23:16.916123+0000","last_active":"2023-12-08T08:23:16.919943+0000","last_peered":"2023-12-08T08:23:16.919943+0000","last_clean":"2023-12-08T08:23:16.919943+0000","last_became_active":"2023-12-08T08:23:16.915147+0000","last_became_peered":"2023-12-08T08:23:16.915147+0000","last_unstale":"2023-12-08T08:23:16.919943+0000","last_undegraded":"2023-12-08T08:23:16.919943+0000","last_fullsized":"2023-12-08T08:23:16.919943+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:48:31.917542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.890002+0000","last_change":"2023-12-08T08:23:00.288605+0000","last_active":"2023-12-08T08:23:15.890002+0000","last_peered":"2023-12-08T08:23:15.890002+0000","last_clean":"2023-12-08T08:23:15.890002+0000","last_became_active":"2023-12-08T08:23:00.287910+0000","last_became_peered":"2023-12-08T08:23:00.287910+0000","last_unstale":"2023-12-08T08:23:15.890002+0000","last_undegraded":"2023-12-08T08:23:15.890002+0000","last_fullsized":"2023-12-08T08:23:15.890002+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:55.193260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"67'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885593+0000","last_change":"2023-12-08T08:22:59.267027+0000","last_active":"2023-12-08T08:23:15.885593+0000","last_peered":"2023-12-08T08:23:15.885593+0000","last_clean":"2023-12-08T08:23:15.885593+0000","last_became_active":"2023-12-08T08:22:59.265676+0000","last_became_peered":"2023-12-08T08:22:59.265676+0000","last_unstale":"2023-12-08T08:23:15.885593+0000","last_undegraded":"2023-12-08T08:23:15.885593+0000","last_fullsized":"2023-12-08T08:23:15.885593+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:19.279362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.894564+0000","last_change":"2023-12-08T08:23:16.894564+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.894564+0000","last_undegraded":"2023-12-08T08:23:16.894564+0000","last_fullsized":"2023-12-08T08:23:16.894564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.921704+0000","last_change":"2023-12-08T08:23:16.918070+0000","last_active":"2023-12-08T08:23:16.921704+0000","last_peered":"2023-12-08T08:23:16.921704+0000","last_clean":"2023-12-08T08:23:16.921704+0000","last_became_active":"2023-12-08T08:23:16.917808+0000","last_became_peered":"2023-12-08T08:23:16.917808+0000","last_unstale":"2023-12-08T08:23:16.921704+0000","last_undegraded":"2023-12-08T08:23:16.921704+0000","last_fullsized":"2023-12-08T08:23:16.921704+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:35:32.637419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885437+0000","last_change":"2023-12-08T08:23:00.300280+0000","last_active":"2023-12-08T08:23:15.885437+0000","last_peered":"2023-12-08T08:23:15.885437+0000","last_clean":"2023-12-08T08:23:15.885437+0000","last_became_active":"2023-12-08T08:23:00.299998+0000","last_became_peered":"2023-12-08T08:23:00.299998+0000","last_unstale":"2023-12-08T08:23:15.885437+0000","last_undegraded":"2023-12-08T08:23:15.885437+0000","last_fullsized":"2023-12-08T08:23:15.885437+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:15.472021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"67'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885466+0000","last_change":"2023-12-08T08:22:59.274800+0000","last_active":"2023-12-08T08:23:15.885466+0000","last_peered":"2023-12-08T08:23:15.885466+0000","last_clean":"2023-12-08T08:23:15.885466+0000","last_became_active":"2023-12-08T08:22:59.274501+0000","last_became_peered":"2023-12-08T08:22:59.274501+0000","last_unstale":"2023-12-08T08:23:15.885466+0000","last_undegraded":"2023-12-08T08:23:15.885466+0000","last_fullsized":"2023-12-08T08:23:15.885466+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:54.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.901187+0000","last_change":"2023-12-08T08:23:16.901187+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.901187+0000","last_undegraded":"2023-12-08T08:23:16.901187+0000","last_fullsized":"2023-12-08T08:23:16.901187+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.918634+0000","last_change":"2023-12-08T08:23:16.915536+0000","last_active":"2023-12-08T08:23:16.918634+0000","last_peered":"2023-12-08T08:23:16.918634+0000","last_clean":"2023-12-08T08:23:16.918634+0000","last_became_active":"2023-12-08T08:23:16.915216+0000","last_became_peered":"2023-12-08T08:23:16.915216+0000","last_unstale":"2023-12-08T08:23:16.918634+0000","last_undegraded":"2023-12-08T08:23:16.918634+0000","last_fullsized":"2023-12-08T08:23:16.918634+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:18:18.945931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894156+0000","last_change":"2023-12-08T08:23:00.298811+0000","last_active":"2023-12-08T08:23:15.894156+0000","last_peered":"2023-12-08T08:23:15.894156+0000","last_clean":"2023-12-08T08:23:15.894156+0000","last_became_active":"2023-12-08T08:23:00.298524+0000","last_became_peered":"2023-12-08T08:23:00.298524+0000","last_unstale":"2023-12-08T08:23:15.894156+0000","last_undegraded":"2023-12-08T08:23:15.894156+0000","last_fullsized":"2023-12-08T08:23:15.894156+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895609+0000","last_change":"2023-12-08T08:22:59.274339+0000","last_active":"2023-12-08T08:23:15.895609+0000","last_peered":"2023-12-08T08:23:15.895609+0000","last_clean":"2023-12-08T08:23:15.895609+0000","last_became_active":"2023-12-08T08:22:59.272932+0000","last_became_peered":"2023-12-08T08:22:59.272932+0000","last_unstale":"2023-12-08T08:23:15.895609+0000","last_undegraded":"2023-12-08T08:23:15.895609+0000","last_fullsized":"2023-12-08T08:23:15.895609+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:14.464401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.901110+0000","last_change":"2023-12-08T08:23:16.901110+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.901110+0000","last_undegraded":"2023-12-08T08:23:16.901110+0000","last_fullsized":"2023-12-08T08:23:16.901110+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.913617+0000","last_change":"2023-12-08T08:23:16.907865+0000","last_active":"2023-12-08T08:23:16.913617+0000","last_peered":"2023-12-08T08:23:16.913617+0000","last_clean":"2023-12-08T08:23:16.913617+0000","last_became_active":"2023-12-08T08:23:16.907610+0000","last_became_peered":"2023-12-08T08:23:16.907610+0000","last_unstale":"2023-12-08T08:23:16.913617+0000","last_undegraded":"2023-12-08T08:23:16.913617+0000","last_fullsized":"2023-12-08T08:23:16.913617+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:03:24.914390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888104+0000","last_change":"2023-12-08T08:23:00.292745+0000","last_active":"2023-12-08T08:23:15.888104+0000","last_peered":"2023-12-08T08:23:15.888104+0000","last_clean":"2023-12-08T08:23:15.888104+0000","last_became_active":"2023-12-08T08:23:00.292132+0000","last_became_peered":"2023-12-08T08:23:00.292132+0000","last_unstale":"2023-12-08T08:23:15.888104+0000","last_undegraded":"2023-12-08T08:23:15.888104+0000","last_fullsized":"2023-12-08T08:23:15.888104+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:13.139346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.890037+0000","last_change":"2023-12-08T08:22:59.268769+0000","last_active":"2023-12-08T08:23:15.890037+0000","last_peered":"2023-12-08T08:23:15.890037+0000","last_clean":"2023-12-08T08:23:15.890037+0000","last_became_active":"2023-12-08T08:22:59.268494+0000","last_became_peered":"2023-12-08T08:22:59.268494+0000","last_unstale":"2023-12-08T08:23:15.890037+0000","last_undegraded":"2023-12-08T08:23:15.890037+0000","last_fullsized":"2023-12-08T08:23:15.890037+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:56:23.131251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.905977+0000","last_change":"2023-12-08T08:23:16.905977+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.905977+0000","last_undegraded":"2023-12-08T08:23:16.905977+0000","last_fullsized":"2023-12-08T08:23:16.905977+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920561+0000","last_change":"2023-12-08T08:23:16.918296+0000","last_active":"2023-12-08T08:23:16.920561+0000","last_peered":"2023-12-08T08:23:16.920561+0000","last_clean":"2023-12-08T08:23:16.920561+0000","last_became_active":"2023-12-08T08:23:16.917917+0000","last_became_peered":"2023-12-08T08:23:16.917917+0000","last_unstale":"2023-12-08T08:23:16.920561+0000","last_undegraded":"2023-12-08T08:23:16.920561+0000","last_fullsized":"2023-12-08T08:23:16.920561+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:16:38.108739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.890630+0000","last_change":"2023-12-08T08:23:00.275783+0000","last_active":"2023-12-08T08:23:15.890630+0000","last_peered":"2023-12-08T08:23:15.890630+0000","last_clean":"2023-12-08T08:23:15.890630+0000","last_became_active":"2023-12-08T08:23:00.275444+0000","last_became_peered":"2023-12-08T08:23:00.275444+0000","last_unstale":"2023-12-08T08:23:15.890630+0000","last_undegraded":"2023-12-08T08:23:15.890630+0000","last_fullsized":"2023-12-08T08:23:15.890630+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:56:00.436152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889577+0000","last_change":"2023-12-08T08:22:59.280443+0000","last_active":"2023-12-08T08:23:15.889577+0000","last_peered":"2023-12-08T08:23:15.889577+0000","last_clean":"2023-12-08T08:23:15.889577+0000","last_became_active":"2023-12-08T08:22:59.280138+0000","last_became_peered":"2023-12-08T08:22:59.280138+0000","last_unstale":"2023-12-08T08:23:15.889577+0000","last_undegraded":"2023-12-08T08:23:15.889577+0000","last_fullsized":"2023-12-08T08:23:15.889577+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:13:21.524504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.906770+0000","last_change":"2023-12-08T08:23:16.906770+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.906770+0000","last_undegraded":"2023-12-08T08:23:16.906770+0000","last_fullsized":"2023-12-08T08:23:16.906770+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.914455+0000","last_change":"2023-12-08T08:23:16.913111+0000","last_active":"2023-12-08T08:23:16.914455+0000","last_peered":"2023-12-08T08:23:16.914455+0000","last_clean":"2023-12-08T08:23:16.914455+0000","last_became_active":"2023-12-08T08:23:16.912617+0000","last_became_peered":"2023-12-08T08:23:16.912617+0000","last_unstale":"2023-12-08T08:23:16.914455+0000","last_undegraded":"2023-12-08T08:23:16.914455+0000","last_fullsized":"2023-12-08T08:23:16.914455+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:56:17.065460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895873+0000","last_change":"2023-12-08T08:23:00.304825+0000","last_active":"2023-12-08T08:23:15.895873+0000","last_peered":"2023-12-08T08:23:15.895873+0000","last_clean":"2023-12-08T08:23:15.895873+0000","last_became_active":"2023-12-08T08:23:00.304549+0000","last_became_peered":"2023-12-08T08:23:00.304549+0000","last_unstale":"2023-12-08T08:23:15.895873+0000","last_undegraded":"2023-12-08T08:23:15.895873+0000","last_fullsized":"2023-12-08T08:23:15.895873+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889328+0000","last_change":"2023-12-08T08:22:59.283795+0000","last_active":"2023-12-08T08:23:15.889328+0000","last_peered":"2023-12-08T08:23:15.889328+0000","last_clean":"2023-12-08T08:23:15.889328+0000","last_became_active":"2023-12-08T08:22:59.283486+0000","last_became_peered":"2023-12-08T08:22:59.283486+0000","last_unstale":"2023-12-08T08:23:15.889328+0000","last_undegraded":"2023-12-08T08:23:15.889328+0000","last_fullsized":"2023-12-08T08:23:15.889328+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:30:43.384001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896383+0000","last_change":"2023-12-08T08:23:16.896383+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896383+0000","last_undegraded":"2023-12-08T08:23:16.896383+0000","last_fullsized":"2023-12-08T08:23:16.896383+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.917021+0000","last_change":"2023-12-08T08:23:16.913609+0000","last_active":"2023-12-08T08:23:16.917021+0000","last_peered":"2023-12-08T08:23:16.917021+0000","last_clean":"2023-12-08T08:23:16.917021+0000","last_became_active":"2023-12-08T08:23:16.913308+0000","last_became_peered":"2023-12-08T08:23:16.913308+0000","last_unstale":"2023-12-08T08:23:16.917021+0000","last_undegraded":"2023-12-08T08:23:16.917021+0000","last_fullsized":"2023-12-08T08:23:16.917021+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:13:39.161432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895820+0000","last_change":"2023-12-08T08:23:00.293145+0000","last_active":"2023-12-08T08:23:15.895820+0000","last_peered":"2023-12-08T08:23:15.895820+0000","last_clean":"2023-12-08T08:23:15.895820+0000","last_became_active":"2023-12-08T08:23:00.292927+0000","last_became_peered":"2023-12-08T08:23:00.292927+0000","last_unstale":"2023-12-08T08:23:15.895820+0000","last_undegraded":"2023-12-08T08:23:15.895820+0000","last_fullsized":"2023-12-08T08:23:15.895820+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:56.216551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"67'3","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889145+0000","last_change":"2023-12-08T08:22:59.281141+0000","last_active":"2023-12-08T08:23:15.889145+0000","last_peered":"2023-12-08T08:23:15.889145+0000","last_clean":"2023-12-08T08:23:15.889145+0000","last_became_active":"2023-12-08T08:22:59.280748+0000","last_became_peered":"2023-12-08T08:22:59.280748+0000","last_unstale":"2023-12-08T08:23:15.889145+0000","last_undegraded":"2023-12-08T08:23:15.889145+0000","last_fullsized":"2023-12-08T08:23:15.889145+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:07:33.922762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.895287+0000","last_change":"2023-12-08T08:23:16.895287+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.895287+0000","last_undegraded":"2023-12-08T08:23:16.895287+0000","last_fullsized":"2023-12-08T08:23:16.895287+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.923465+0000","last_change":"2023-12-08T08:23:16.921554+0000","last_active":"2023-12-08T08:23:16.923465+0000","last_peered":"2023-12-08T08:23:16.923465+0000","last_clean":"2023-12-08T08:23:16.923465+0000","last_became_active":"2023-12-08T08:23:16.920531+0000","last_became_peered":"2023-12-08T08:23:16.920531+0000","last_unstale":"2023-12-08T08:23:16.923465+0000","last_undegraded":"2023-12-08T08:23:16.923465+0000","last_fullsized":"2023-12-08T08:23:16.923465+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:32:01.183284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885675+0000","last_change":"2023-12-08T08:23:00.299179+0000","last_active":"2023-12-08T08:23:15.885675+0000","last_peered":"2023-12-08T08:23:15.885675+0000","last_clean":"2023-12-08T08:23:15.885675+0000","last_became_active":"2023-12-08T08:23:00.298936+0000","last_became_peered":"2023-12-08T08:23:00.298936+0000","last_unstale":"2023-12-08T08:23:15.885675+0000","last_undegraded":"2023-12-08T08:23:15.885675+0000","last_fullsized":"2023-12-08T08:23:15.885675+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"68'8","reported_seq":22,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895665+0000","last_change":"2023-12-08T08:22:59.278612+0000","last_active":"2023-12-08T08:23:15.895665+0000","last_peered":"2023-12-08T08:23:15.895665+0000","last_clean":"2023-12-08T08:23:15.895665+0000","last_became_active":"2023-12-08T08:22:59.278325+0000","last_became_peered":"2023-12-08T08:22:59.278325+0000","last_unstale":"2023-12-08T08:23:15.895665+0000","last_undegraded":"2023-12-08T08:23:15.895665+0000","last_fullsized":"2023-12-08T08:23:15.895665+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:55:35.382801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.894542+0000","last_change":"2023-12-08T08:23:16.894542+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.894542+0000","last_undegraded":"2023-12-08T08:23:16.894542+0000","last_fullsized":"2023-12-08T08:23:16.894542+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920008+0000","last_change":"2023-12-08T08:23:16.915913+0000","last_active":"2023-12-08T08:23:16.920008+0000","last_peered":"2023-12-08T08:23:16.920008+0000","last_clean":"2023-12-08T08:23:16.920008+0000","last_became_active":"2023-12-08T08:23:16.915513+0000","last_became_peered":"2023-12-08T08:23:16.915513+0000","last_unstale":"2023-12-08T08:23:16.920008+0000","last_undegraded":"2023-12-08T08:23:16.920008+0000","last_fullsized":"2023-12-08T08:23:16.920008+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:29.768654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895664+0000","last_change":"2023-12-08T08:23:00.292867+0000","last_active":"2023-12-08T08:23:15.895664+0000","last_peered":"2023-12-08T08:23:15.895664+0000","last_clean":"2023-12-08T08:23:15.895664+0000","last_became_active":"2023-12-08T08:23:00.292648+0000","last_became_peered":"2023-12-08T08:23:00.292648+0000","last_unstale":"2023-12-08T08:23:15.895664+0000","last_undegraded":"2023-12-08T08:23:15.895664+0000","last_fullsized":"2023-12-08T08:23:15.895664+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:29:03.020360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"67'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.891587+0000","last_change":"2023-12-08T08:22:59.262821+0000","last_active":"2023-12-08T08:23:15.891587+0000","last_peered":"2023-12-08T08:23:15.891587+0000","last_clean":"2023-12-08T08:23:15.891587+0000","last_became_active":"2023-12-08T08:22:59.262569+0000","last_became_peered":"2023-12-08T08:22:59.262569+0000","last_unstale":"2023-12-08T08:23:15.891587+0000","last_undegraded":"2023-12-08T08:23:15.891587+0000","last_fullsized":"2023-12-08T08:23:15.891587+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:52:55.751217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.898771+0000","last_change":"2023-12-08T08:23:16.898771+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.898771+0000","last_undegraded":"2023-12-08T08:23:16.898771+0000","last_fullsized":"2023-12-08T08:23:16.898771+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.909363+0000","last_change":"2023-12-08T08:23:16.907121+0000","last_active":"2023-12-08T08:23:16.909363+0000","last_peered":"2023-12-08T08:23:16.909363+0000","last_clean":"2023-12-08T08:23:16.909363+0000","last_became_active":"2023-12-08T08:23:16.906517+0000","last_became_peered":"2023-12-08T08:23:16.906517+0000","last_unstale":"2023-12-08T08:23:16.909363+0000","last_undegraded":"2023-12-08T08:23:16.909363+0000","last_fullsized":"2023-12-08T08:23:16.909363+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:44:54.050763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894551+0000","last_change":"2023-12-08T08:23:00.298706+0000","last_active":"2023-12-08T08:23:15.894551+0000","last_peered":"2023-12-08T08:23:15.894551+0000","last_clean":"2023-12-08T08:23:15.894551+0000","last_became_active":"2023-12-08T08:23:00.298452+0000","last_became_peered":"2023-12-08T08:23:00.298452+0000","last_unstale":"2023-12-08T08:23:15.894551+0000","last_undegraded":"2023-12-08T08:23:15.894551+0000","last_fullsized":"2023-12-08T08:23:15.894551+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:39.385907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888371+0000","last_change":"2023-12-08T08:22:59.270322+0000","last_active":"2023-12-08T08:23:15.888371+0000","last_peered":"2023-12-08T08:23:15.888371+0000","last_clean":"2023-12-08T08:23:15.888371+0000","last_became_active":"2023-12-08T08:22:59.270059+0000","last_became_peered":"2023-12-08T08:22:59.270059+0000","last_unstale":"2023-12-08T08:23:15.888371+0000","last_undegraded":"2023-12-08T08:23:15.888371+0000","last_fullsized":"2023-12-08T08:23:15.888371+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:21:58.531919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.902866+0000","last_change":"2023-12-08T08:23:16.902866+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.902866+0000","last_undegraded":"2023-12-08T08:23:16.902866+0000","last_fullsized":"2023-12-08T08:23:16.902866+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920648+0000","last_change":"2023-12-08T08:23:16.914697+0000","last_active":"2023-12-08T08:23:16.920648+0000","last_peered":"2023-12-08T08:23:16.920648+0000","last_clean":"2023-12-08T08:23:16.920648+0000","last_became_active":"2023-12-08T08:23:16.914346+0000","last_became_peered":"2023-12-08T08:23:16.914346+0000","last_unstale":"2023-12-08T08:23:16.920648+0000","last_undegraded":"2023-12-08T08:23:16.920648+0000","last_fullsized":"2023-12-08T08:23:16.920648+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:08:11.306339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889955+0000","last_change":"2023-12-08T08:23:00.304324+0000","last_active":"2023-12-08T08:23:15.889955+0000","last_peered":"2023-12-08T08:23:15.889955+0000","last_clean":"2023-12-08T08:23:15.889955+0000","last_became_active":"2023-12-08T08:23:00.304038+0000","last_became_peered":"2023-12-08T08:23:00.304038+0000","last_unstale":"2023-12-08T08:23:15.889955+0000","last_undegraded":"2023-12-08T08:23:15.889955+0000","last_fullsized":"2023-12-08T08:23:15.889955+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:33:27.464394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894314+0000","last_change":"2023-12-08T08:22:59.270216+0000","last_active":"2023-12-08T08:23:15.894314+0000","last_peered":"2023-12-08T08:23:15.894314+0000","last_clean":"2023-12-08T08:23:15.894314+0000","last_became_active":"2023-12-08T08:22:59.269292+0000","last_became_peered":"2023-12-08T08:22:59.269292+0000","last_unstale":"2023-12-08T08:23:15.894314+0000","last_undegraded":"2023-12-08T08:23:15.894314+0000","last_fullsized":"2023-12-08T08:23:15.894314+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:18:01.309002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.899876+0000","last_change":"2023-12-08T08:23:16.899876+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.899876+0000","last_undegraded":"2023-12-08T08:23:16.899876+0000","last_fullsized":"2023-12-08T08:23:16.899876+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.916944+0000","last_change":"2023-12-08T08:23:16.910717+0000","last_active":"2023-12-08T08:23:16.916944+0000","last_peered":"2023-12-08T08:23:16.916944+0000","last_clean":"2023-12-08T08:23:16.916944+0000","last_became_active":"2023-12-08T08:23:16.910457+0000","last_became_peered":"2023-12-08T08:23:16.910457+0000","last_unstale":"2023-12-08T08:23:16.916944+0000","last_undegraded":"2023-12-08T08:23:16.916944+0000","last_fullsized":"2023-12-08T08:23:16.916944+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:53:13.388145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889558+0000","last_change":"2023-12-08T08:23:00.276305+0000","last_active":"2023-12-08T08:23:15.889558+0000","last_peered":"2023-12-08T08:23:15.889558+0000","last_clean":"2023-12-08T08:23:15.889558+0000","last_became_active":"2023-12-08T08:23:00.275989+0000","last_became_peered":"2023-12-08T08:23:00.275989+0000","last_unstale":"2023-12-08T08:23:15.889558+0000","last_undegraded":"2023-12-08T08:23:15.889558+0000","last_fullsized":"2023-12-08T08:23:15.889558+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:24:33.735501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"67'8","reported_seq":22,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894492+0000","last_change":"2023-12-08T08:22:59.271542+0000","last_active":"2023-12-08T08:23:15.894492+0000","last_peered":"2023-12-08T08:23:15.894492+0000","last_clean":"2023-12-08T08:23:15.894492+0000","last_became_active":"2023-12-08T08:22:59.271240+0000","last_became_peered":"2023-12-08T08:22:59.271240+0000","last_unstale":"2023-12-08T08:23:15.894492+0000","last_undegraded":"2023-12-08T08:23:15.894492+0000","last_fullsized":"2023-12-08T08:23:15.894492+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:32.897955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.901826+0000","last_change":"2023-12-08T08:23:16.901826+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.901826+0000","last_undegraded":"2023-12-08T08:23:16.901826+0000","last_fullsized":"2023-12-08T08:23:16.901826+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.919862+0000","last_change":"2023-12-08T08:23:16.915441+0000","last_active":"2023-12-08T08:23:16.919862+0000","last_peered":"2023-12-08T08:23:16.919862+0000","last_clean":"2023-12-08T08:23:16.919862+0000","last_became_active":"2023-12-08T08:23:16.915074+0000","last_became_peered":"2023-12-08T08:23:16.915074+0000","last_unstale":"2023-12-08T08:23:16.919862+0000","last_undegraded":"2023-12-08T08:23:16.919862+0000","last_fullsized":"2023-12-08T08:23:16.919862+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:33:12.118405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895946+0000","last_change":"2023-12-08T08:23:00.280374+0000","last_active":"2023-12-08T08:23:15.895946+0000","last_peered":"2023-12-08T08:23:15.895946+0000","last_clean":"2023-12-08T08:23:15.895946+0000","last_became_active":"2023-12-08T08:23:00.280096+0000","last_became_peered":"2023-12-08T08:23:00.280096+0000","last_unstale":"2023-12-08T08:23:15.895946+0000","last_undegraded":"2023-12-08T08:23:15.895946+0000","last_fullsized":"2023-12-08T08:23:15.895946+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:21:59.539539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"67'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889718+0000","last_change":"2023-12-08T08:22:59.283727+0000","last_active":"2023-12-08T08:23:15.889718+0000","last_peered":"2023-12-08T08:23:15.889718+0000","last_clean":"2023-12-08T08:23:15.889718+0000","last_became_active":"2023-12-08T08:22:59.283254+0000","last_became_peered":"2023-12-08T08:22:59.283254+0000","last_unstale":"2023-12-08T08:23:15.889718+0000","last_undegraded":"2023-12-08T08:23:15.889718+0000","last_fullsized":"2023-12-08T08:23:15.889718+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:18:01.309002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.902834+0000","last_change":"2023-12-08T08:23:16.902834+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.902834+0000","last_undegraded":"2023-12-08T08:23:16.902834+0000","last_fullsized":"2023-12-08T08:23:16.902834+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.909444+0000","last_change":"2023-12-08T08:23:16.901347+0000","last_active":"2023-12-08T08:23:16.909444+0000","last_peered":"2023-12-08T08:23:16.909444+0000","last_clean":"2023-12-08T08:23:16.909444+0000","last_became_active":"2023-12-08T08:23:16.901041+0000","last_became_peered":"2023-12-08T08:23:16.901041+0000","last_unstale":"2023-12-08T08:23:16.909444+0000","last_undegraded":"2023-12-08T08:23:16.909444+0000","last_fullsized":"2023-12-08T08:23:16.909444+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:16:38.108739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889393+0000","last_change":"2023-12-08T08:23:00.282901+0000","last_active":"2023-12-08T08:23:15.889393+0000","last_peered":"2023-12-08T08:23:15.889393+0000","last_clean":"2023-12-08T08:23:15.889393+0000","last_became_active":"2023-12-08T08:23:00.282646+0000","last_became_peered":"2023-12-08T08:23:00.282646+0000","last_unstale":"2023-12-08T08:23:15.889393+0000","last_undegraded":"2023-12-08T08:23:15.889393+0000","last_fullsized":"2023-12-08T08:23:15.889393+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"67'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.896118+0000","last_change":"2023-12-08T08:22:59.265669+0000","last_active":"2023-12-08T08:23:15.896118+0000","last_peered":"2023-12-08T08:23:15.896118+0000","last_clean":"2023-12-08T08:23:15.896118+0000","last_became_active":"2023-12-08T08:22:59.265364+0000","last_became_peered":"2023-12-08T08:22:59.265364+0000","last_unstale":"2023-12-08T08:23:15.896118+0000","last_undegraded":"2023-12-08T08:23:15.896118+0000","last_fullsized":"2023-12-08T08:23:15.896118+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:27:38.296266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.906380+0000","last_change":"2023-12-08T08:23:16.906380+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.906380+0000","last_undegraded":"2023-12-08T08:23:16.906380+0000","last_fullsized":"2023-12-08T08:23:16.906380+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920038+0000","last_change":"2023-12-08T08:23:16.916758+0000","last_active":"2023-12-08T08:23:16.920038+0000","last_peered":"2023-12-08T08:23:16.920038+0000","last_clean":"2023-12-08T08:23:16.920038+0000","last_became_active":"2023-12-08T08:23:16.916445+0000","last_became_peered":"2023-12-08T08:23:16.916445+0000","last_unstale":"2023-12-08T08:23:16.920038+0000","last_undegraded":"2023-12-08T08:23:16.920038+0000","last_fullsized":"2023-12-08T08:23:16.920038+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:18:49.227732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885732+0000","last_change":"2023-12-08T08:23:00.270198+0000","last_active":"2023-12-08T08:23:15.885732+0000","last_peered":"2023-12-08T08:23:15.885732+0000","last_clean":"2023-12-08T08:23:15.885732+0000","last_became_active":"2023-12-08T08:23:00.269930+0000","last_became_peered":"2023-12-08T08:23:00.269930+0000","last_unstale":"2023-12-08T08:23:15.885732+0000","last_undegraded":"2023-12-08T08:23:15.885732+0000","last_fullsized":"2023-12-08T08:23:15.885732+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895963+0000","last_change":"2023-12-08T08:22:59.273655+0000","last_active":"2023-12-08T08:23:15.895963+0000","last_peered":"2023-12-08T08:23:15.895963+0000","last_clean":"2023-12-08T08:23:15.895963+0000","last_became_active":"2023-12-08T08:22:59.273396+0000","last_became_peered":"2023-12-08T08:22:59.273396+0000","last_unstale":"2023-12-08T08:23:15.895963+0000","last_undegraded":"2023-12-08T08:23:15.895963+0000","last_fullsized":"2023-12-08T08:23:15.895963+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.886510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.899083+0000","last_change":"2023-12-08T08:23:16.899083+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.899083+0000","last_undegraded":"2023-12-08T08:23:16.899083+0000","last_fullsized":"2023-12-08T08:23:16.899083+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.923651+0000","last_change":"2023-12-08T08:23:16.922219+0000","last_active":"2023-12-08T08:23:16.923651+0000","last_peered":"2023-12-08T08:23:16.923651+0000","last_clean":"2023-12-08T08:23:16.923651+0000","last_became_active":"2023-12-08T08:23:16.921977+0000","last_became_peered":"2023-12-08T08:23:16.921977+0000","last_unstale":"2023-12-08T08:23:16.923651+0000","last_undegraded":"2023-12-08T08:23:16.923651+0000","last_fullsized":"2023-12-08T08:23:16.923651+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:22:16.168848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883583+0000","last_change":"2023-12-08T08:23:00.285854+0000","last_active":"2023-12-08T08:23:15.883583+0000","last_peered":"2023-12-08T08:23:15.883583+0000","last_clean":"2023-12-08T08:23:15.883583+0000","last_became_active":"2023-12-08T08:23:00.285553+0000","last_became_peered":"2023-12-08T08:23:00.285553+0000","last_unstale":"2023-12-08T08:23:15.883583+0000","last_undegraded":"2023-12-08T08:23:15.883583+0000","last_fullsized":"2023-12-08T08:23:15.883583+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:15:44.184576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"67'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888606+0000","last_change":"2023-12-08T08:22:59.282745+0000","last_active":"2023-12-08T08:23:15.888606+0000","last_peered":"2023-12-08T08:23:15.888606+0000","last_clean":"2023-12-08T08:23:15.888606+0000","last_became_active":"2023-12-08T08:22:59.282443+0000","last_became_peered":"2023-12-08T08:22:59.282443+0000","last_unstale":"2023-12-08T08:23:15.888606+0000","last_undegraded":"2023-12-08T08:23:15.888606+0000","last_fullsized":"2023-12-08T08:23:15.888606+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:21.899236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.908298+0000","last_change":"2023-12-08T08:23:16.908298+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.908298+0000","last_undegraded":"2023-12-08T08:23:16.908298+0000","last_fullsized":"2023-12-08T08:23:16.908298+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.911706+0000","last_change":"2023-12-08T08:23:16.906025+0000","last_active":"2023-12-08T08:23:16.911706+0000","last_peered":"2023-12-08T08:23:16.911706+0000","last_clean":"2023-12-08T08:23:16.911706+0000","last_became_active":"2023-12-08T08:23:16.905756+0000","last_became_peered":"2023-12-08T08:23:16.905756+0000","last_unstale":"2023-12-08T08:23:16.911706+0000","last_undegraded":"2023-12-08T08:23:16.911706+0000","last_fullsized":"2023-12-08T08:23:16.911706+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:56:17.065460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895380+0000","last_change":"2023-12-08T08:23:00.286165+0000","last_active":"2023-12-08T08:23:15.895380+0000","last_peered":"2023-12-08T08:23:15.895380+0000","last_clean":"2023-12-08T08:23:15.895380+0000","last_became_active":"2023-12-08T08:23:00.285209+0000","last_became_peered":"2023-12-08T08:23:00.285209+0000","last_unstale":"2023-12-08T08:23:15.895380+0000","last_undegraded":"2023-12-08T08:23:15.895380+0000","last_fullsized":"2023-12-08T08:23:15.895380+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:16.068318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883606+0000","last_change":"2023-12-08T08:22:59.272934+0000","last_active":"2023-12-08T08:23:15.883606+0000","last_peered":"2023-12-08T08:23:15.883606+0000","last_clean":"2023-12-08T08:23:15.883606+0000","last_became_active":"2023-12-08T08:22:59.272094+0000","last_became_peered":"2023-12-08T08:22:59.272094+0000","last_unstale":"2023-12-08T08:23:15.883606+0000","last_undegraded":"2023-12-08T08:23:15.883606+0000","last_fullsized":"2023-12-08T08:23:15.883606+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:33:18.775139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.901915+0000","last_change":"2023-12-08T08:23:16.901915+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.901915+0000","last_undegraded":"2023-12-08T08:23:16.901915+0000","last_fullsized":"2023-12-08T08:23:16.901915+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920431+0000","last_change":"2023-12-08T08:23:16.915895+0000","last_active":"2023-12-08T08:23:16.920431+0000","last_peered":"2023-12-08T08:23:16.920431+0000","last_clean":"2023-12-08T08:23:16.920431+0000","last_became_active":"2023-12-08T08:23:16.915631+0000","last_became_peered":"2023-12-08T08:23:16.915631+0000","last_unstale":"2023-12-08T08:23:16.920431+0000","last_undegraded":"2023-12-08T08:23:16.920431+0000","last_fullsized":"2023-12-08T08:23:16.920431+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:28:54.873126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883361+0000","last_change":"2023-12-08T08:23:00.287292+0000","last_active":"2023-12-08T08:23:15.883361+0000","last_peered":"2023-12-08T08:23:15.883361+0000","last_clean":"2023-12-08T08:23:15.883361+0000","last_became_active":"2023-12-08T08:23:00.284565+0000","last_became_peered":"2023-12-08T08:23:00.284565+0000","last_unstale":"2023-12-08T08:23:15.883361+0000","last_undegraded":"2023-12-08T08:23:15.883361+0000","last_fullsized":"2023-12-08T08:23:15.883361+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:17:25.641139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.883435+0000","last_change":"2023-12-08T08:22:59.279857+0000","last_active":"2023-12-08T08:23:15.883435+0000","last_peered":"2023-12-08T08:23:15.883435+0000","last_clean":"2023-12-08T08:23:15.883435+0000","last_became_active":"2023-12-08T08:22:59.279508+0000","last_became_peered":"2023-12-08T08:22:59.279508+0000","last_unstale":"2023-12-08T08:23:15.883435+0000","last_undegraded":"2023-12-08T08:23:15.883435+0000","last_fullsized":"2023-12-08T08:23:15.883435+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:23.192834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.900064+0000","last_change":"2023-12-08T08:23:16.900064+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.900064+0000","last_undegraded":"2023-12-08T08:23:16.900064+0000","last_fullsized":"2023-12-08T08:23:16.900064+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.914553+0000","last_change":"2023-12-08T08:23:16.911088+0000","last_active":"2023-12-08T08:23:16.914553+0000","last_peered":"2023-12-08T08:23:16.914553+0000","last_clean":"2023-12-08T08:23:16.914553+0000","last_became_active":"2023-12-08T08:23:16.910534+0000","last_became_peered":"2023-12-08T08:23:16.910534+0000","last_unstale":"2023-12-08T08:23:16.914553+0000","last_undegraded":"2023-12-08T08:23:16.914553+0000","last_fullsized":"2023-12-08T08:23:16.914553+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:13:12.845859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894166+0000","last_change":"2023-12-08T08:23:00.291227+0000","last_active":"2023-12-08T08:23:15.894166+0000","last_peered":"2023-12-08T08:23:15.894166+0000","last_clean":"2023-12-08T08:23:15.894166+0000","last_became_active":"2023-12-08T08:23:00.290984+0000","last_became_peered":"2023-12-08T08:23:00.290984+0000","last_unstale":"2023-12-08T08:23:15.894166+0000","last_undegraded":"2023-12-08T08:23:15.894166+0000","last_fullsized":"2023-12-08T08:23:15.894166+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:33.905575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.887728+0000","last_change":"2023-12-08T08:22:59.282842+0000","last_active":"2023-12-08T08:23:15.887728+0000","last_peered":"2023-12-08T08:23:15.887728+0000","last_clean":"2023-12-08T08:23:15.887728+0000","last_became_active":"2023-12-08T08:22:59.282605+0000","last_became_peered":"2023-12-08T08:22:59.282605+0000","last_unstale":"2023-12-08T08:23:15.887728+0000","last_undegraded":"2023-12-08T08:23:15.887728+0000","last_fullsized":"2023-12-08T08:23:15.887728+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:55.208931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896938+0000","last_change":"2023-12-08T08:23:16.896938+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896938+0000","last_undegraded":"2023-12-08T08:23:16.896938+0000","last_fullsized":"2023-12-08T08:23:16.896938+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.908278+0000","last_change":"2023-12-08T08:23:16.900995+0000","last_active":"2023-12-08T08:23:16.908278+0000","last_peered":"2023-12-08T08:23:16.908278+0000","last_clean":"2023-12-08T08:23:16.908278+0000","last_became_active":"2023-12-08T08:23:16.900717+0000","last_became_peered":"2023-12-08T08:23:16.900717+0000","last_unstale":"2023-12-08T08:23:16.908278+0000","last_undegraded":"2023-12-08T08:23:16.908278+0000","last_fullsized":"2023-12-08T08:23:16.908278+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:27:04.256182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885973+0000","last_change":"2023-12-08T08:23:00.270620+0000","last_active":"2023-12-08T08:23:15.885973+0000","last_peered":"2023-12-08T08:23:15.885973+0000","last_clean":"2023-12-08T08:23:15.885973+0000","last_became_active":"2023-12-08T08:23:00.270369+0000","last_became_peered":"2023-12-08T08:23:00.270369+0000","last_unstale":"2023-12-08T08:23:15.885973+0000","last_undegraded":"2023-12-08T08:23:15.885973+0000","last_fullsized":"2023-12-08T08:23:15.885973+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:33.898137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"67'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.891985+0000","last_change":"2023-12-08T08:22:59.269712+0000","last_active":"2023-12-08T08:23:15.891985+0000","last_peered":"2023-12-08T08:23:15.891985+0000","last_clean":"2023-12-08T08:23:15.891985+0000","last_became_active":"2023-12-08T08:22:59.269426+0000","last_became_peered":"2023-12-08T08:22:59.269426+0000","last_unstale":"2023-12-08T08:23:15.891985+0000","last_undegraded":"2023-12-08T08:23:15.891985+0000","last_fullsized":"2023-12-08T08:23:15.891985+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:49:28.705874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.906727+0000","last_change":"2023-12-08T08:23:16.906727+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.906727+0000","last_undegraded":"2023-12-08T08:23:16.906727+0000","last_fullsized":"2023-12-08T08:23:16.906727+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920958+0000","last_change":"2023-12-08T08:23:16.918945+0000","last_active":"2023-12-08T08:23:16.920958+0000","last_peered":"2023-12-08T08:23:16.920958+0000","last_clean":"2023-12-08T08:23:16.920958+0000","last_became_active":"2023-12-08T08:23:16.918629+0000","last_became_peered":"2023-12-08T08:23:16.918629+0000","last_unstale":"2023-12-08T08:23:16.920958+0000","last_undegraded":"2023-12-08T08:23:16.920958+0000","last_fullsized":"2023-12-08T08:23:16.920958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:39.536165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.896176+0000","last_change":"2023-12-08T08:23:00.280543+0000","last_active":"2023-12-08T08:23:15.896176+0000","last_peered":"2023-12-08T08:23:15.896176+0000","last_clean":"2023-12-08T08:23:15.896176+0000","last_became_active":"2023-12-08T08:23:00.280152+0000","last_became_peered":"2023-12-08T08:23:00.280152+0000","last_unstale":"2023-12-08T08:23:15.896176+0000","last_undegraded":"2023-12-08T08:23:15.896176+0000","last_fullsized":"2023-12-08T08:23:15.896176+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:37:47.067543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"68'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.891331+0000","last_change":"2023-12-08T08:22:59.263185+0000","last_active":"2023-12-08T08:23:15.891331+0000","last_peered":"2023-12-08T08:23:15.891331+0000","last_clean":"2023-12-08T08:23:15.891331+0000","last_became_active":"2023-12-08T08:22:59.262924+0000","last_became_peered":"2023-12-08T08:22:59.262924+0000","last_unstale":"2023-12-08T08:23:15.891331+0000","last_undegraded":"2023-12-08T08:23:15.891331+0000","last_fullsized":"2023-12-08T08:23:15.891331+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:39:59.028170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.895437+0000","last_change":"2023-12-08T08:23:16.895437+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.895437+0000","last_undegraded":"2023-12-08T08:23:16.895437+0000","last_fullsized":"2023-12-08T08:23:16.895437+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.914570+0000","last_change":"2023-12-08T08:23:16.912250+0000","last_active":"2023-12-08T08:23:16.914570+0000","last_peered":"2023-12-08T08:23:16.914570+0000","last_clean":"2023-12-08T08:23:16.914570+0000","last_became_active":"2023-12-08T08:23:16.912031+0000","last_became_peered":"2023-12-08T08:23:16.912031+0000","last_unstale":"2023-12-08T08:23:16.914570+0000","last_undegraded":"2023-12-08T08:23:16.914570+0000","last_fullsized":"2023-12-08T08:23:16.914570+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:03.696851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888857+0000","last_change":"2023-12-08T08:23:00.304740+0000","last_active":"2023-12-08T08:23:15.888857+0000","last_peered":"2023-12-08T08:23:15.888857+0000","last_clean":"2023-12-08T08:23:15.888857+0000","last_became_active":"2023-12-08T08:23:00.304390+0000","last_became_peered":"2023-12-08T08:23:00.304390+0000","last_unstale":"2023-12-08T08:23:15.888857+0000","last_undegraded":"2023-12-08T08:23:15.888857+0000","last_fullsized":"2023-12-08T08:23:15.888857+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.889133+0000","last_change":"2023-12-08T08:22:59.285952+0000","last_active":"2023-12-08T08:23:15.889133+0000","last_peered":"2023-12-08T08:23:15.889133+0000","last_clean":"2023-12-08T08:23:15.889133+0000","last_became_active":"2023-12-08T08:22:59.285309+0000","last_became_peered":"2023-12-08T08:22:59.285309+0000","last_unstale":"2023-12-08T08:23:15.889133+0000","last_undegraded":"2023-12-08T08:23:15.889133+0000","last_fullsized":"2023-12-08T08:23:15.889133+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:19.279362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.896326+0000","last_change":"2023-12-08T08:23:16.896326+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.896326+0000","last_undegraded":"2023-12-08T08:23:16.896326+0000","last_fullsized":"2023-12-08T08:23:16.896326+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.919262+0000","last_change":"2023-12-08T08:23:16.912270+0000","last_active":"2023-12-08T08:23:16.919262+0000","last_peered":"2023-12-08T08:23:16.919262+0000","last_clean":"2023-12-08T08:23:16.919262+0000","last_became_active":"2023-12-08T08:23:16.912007+0000","last_became_peered":"2023-12-08T08:23:16.912007+0000","last_unstale":"2023-12-08T08:23:16.919262+0000","last_undegraded":"2023-12-08T08:23:16.919262+0000","last_fullsized":"2023-12-08T08:23:16.919262+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:32:01.183284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885854+0000","last_change":"2023-12-08T08:23:00.299161+0000","last_active":"2023-12-08T08:23:15.885854+0000","last_peered":"2023-12-08T08:23:15.885854+0000","last_clean":"2023-12-08T08:23:15.885854+0000","last_became_active":"2023-12-08T08:23:00.298876+0000","last_became_peered":"2023-12-08T08:23:00.298876+0000","last_unstale":"2023-12-08T08:23:15.885854+0000","last_undegraded":"2023-12-08T08:23:15.885854+0000","last_fullsized":"2023-12-08T08:23:15.885854+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:29:03.020360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888918+0000","last_change":"2023-12-08T08:22:59.280536+0000","last_active":"2023-12-08T08:23:15.888918+0000","last_peered":"2023-12-08T08:23:15.888918+0000","last_clean":"2023-12-08T08:23:15.888918+0000","last_became_active":"2023-12-08T08:22:59.280213+0000","last_became_peered":"2023-12-08T08:22:59.280213+0000","last_unstale":"2023-12-08T08:23:15.888918+0000","last_undegraded":"2023-12-08T08:23:15.888918+0000","last_fullsized":"2023-12-08T08:23:15.888918+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:49.883139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.898593+0000","last_change":"2023-12-08T08:23:16.898593+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.898593+0000","last_undegraded":"2023-12-08T08:23:16.898593+0000","last_fullsized":"2023-12-08T08:23:16.898593+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.922617+0000","last_change":"2023-12-08T08:23:16.919692+0000","last_active":"2023-12-08T08:23:16.922617+0000","last_peered":"2023-12-08T08:23:16.922617+0000","last_clean":"2023-12-08T08:23:16.922617+0000","last_became_active":"2023-12-08T08:23:16.919433+0000","last_became_peered":"2023-12-08T08:23:16.919433+0000","last_unstale":"2023-12-08T08:23:16.922617+0000","last_undegraded":"2023-12-08T08:23:16.922617+0000","last_fullsized":"2023-12-08T08:23:16.922617+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:28:54.873126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895793+0000","last_change":"2023-12-08T08:23:00.285721+0000","last_active":"2023-12-08T08:23:15.895793+0000","last_peered":"2023-12-08T08:23:15.895793+0000","last_clean":"2023-12-08T08:23:15.895793+0000","last_became_active":"2023-12-08T08:23:00.285446+0000","last_became_peered":"2023-12-08T08:23:00.285446+0000","last_unstale":"2023-12-08T08:23:15.895793+0000","last_undegraded":"2023-12-08T08:23:15.895793+0000","last_fullsized":"2023-12-08T08:23:15.895793+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895893+0000","last_change":"2023-12-08T08:22:59.272111+0000","last_active":"2023-12-08T08:23:15.895893+0000","last_peered":"2023-12-08T08:23:15.895893+0000","last_clean":"2023-12-08T08:23:15.895893+0000","last_became_active":"2023-12-08T08:22:59.271849+0000","last_became_peered":"2023-12-08T08:22:59.271849+0000","last_unstale":"2023-12-08T08:23:15.895893+0000","last_undegraded":"2023-12-08T08:23:15.895893+0000","last_fullsized":"2023-12-08T08:23:15.895893+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:15.060698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.907737+0000","last_change":"2023-12-08T08:23:16.907737+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.907737+0000","last_undegraded":"2023-12-08T08:23:16.907737+0000","last_fullsized":"2023-12-08T08:23:16.907737+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.915051+0000","last_change":"2023-12-08T08:23:16.910225+0000","last_active":"2023-12-08T08:23:16.915051+0000","last_peered":"2023-12-08T08:23:16.915051+0000","last_clean":"2023-12-08T08:23:16.915051+0000","last_became_active":"2023-12-08T08:23:16.909947+0000","last_became_peered":"2023-12-08T08:23:16.909947+0000","last_unstale":"2023-12-08T08:23:16.915051+0000","last_undegraded":"2023-12-08T08:23:16.915051+0000","last_fullsized":"2023-12-08T08:23:16.915051+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:24:52.637443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895822+0000","last_change":"2023-12-08T08:23:00.292346+0000","last_active":"2023-12-08T08:23:15.895822+0000","last_peered":"2023-12-08T08:23:15.895822+0000","last_clean":"2023-12-08T08:23:15.895822+0000","last_became_active":"2023-12-08T08:23:00.292166+0000","last_became_peered":"2023-12-08T08:23:00.292166+0000","last_unstale":"2023-12-08T08:23:15.895822+0000","last_undegraded":"2023-12-08T08:23:15.895822+0000","last_fullsized":"2023-12-08T08:23:15.895822+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:21:59.539539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885488+0000","last_change":"2023-12-08T08:22:59.271088+0000","last_active":"2023-12-08T08:23:15.885488+0000","last_peered":"2023-12-08T08:23:15.885488+0000","last_clean":"2023-12-08T08:23:15.885488+0000","last_became_active":"2023-12-08T08:22:59.270783+0000","last_became_peered":"2023-12-08T08:22:59.270783+0000","last_unstale":"2023-12-08T08:23:15.885488+0000","last_undegraded":"2023-12-08T08:23:15.885488+0000","last_fullsized":"2023-12-08T08:23:15.885488+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:30:43.384001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.899218+0000","last_change":"2023-12-08T08:23:16.899218+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.899218+0000","last_undegraded":"2023-12-08T08:23:16.899218+0000","last_fullsized":"2023-12-08T08:23:16.899218+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.922449+0000","last_change":"2023-12-08T08:23:16.921099+0000","last_active":"2023-12-08T08:23:16.922449+0000","last_peered":"2023-12-08T08:23:16.922449+0000","last_clean":"2023-12-08T08:23:16.922449+0000","last_became_active":"2023-12-08T08:23:16.920243+0000","last_became_peered":"2023-12-08T08:23:16.920243+0000","last_unstale":"2023-12-08T08:23:16.922449+0000","last_undegraded":"2023-12-08T08:23:16.922449+0000","last_fullsized":"2023-12-08T08:23:16.922449+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:18:49.227732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894254+0000","last_change":"2023-12-08T08:23:00.283700+0000","last_active":"2023-12-08T08:23:15.894254+0000","last_peered":"2023-12-08T08:23:15.894254+0000","last_clean":"2023-12-08T08:23:15.894254+0000","last_became_active":"2023-12-08T08:23:00.283439+0000","last_became_peered":"2023-12-08T08:23:00.283439+0000","last_unstale":"2023-12-08T08:23:15.894254+0000","last_undegraded":"2023-12-08T08:23:15.894254+0000","last_fullsized":"2023-12-08T08:23:15.894254+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888620+0000","last_change":"2023-12-08T08:22:59.280725+0000","last_active":"2023-12-08T08:23:15.888620+0000","last_peered":"2023-12-08T08:23:15.888620+0000","last_clean":"2023-12-08T08:23:15.888620+0000","last_became_active":"2023-12-08T08:22:59.279736+0000","last_became_peered":"2023-12-08T08:22:59.279736+0000","last_unstale":"2023-12-08T08:23:15.888620+0000","last_undegraded":"2023-12-08T08:23:15.888620+0000","last_fullsized":"2023-12-08T08:23:15.888620+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:54.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.894537+0000","last_change":"2023-12-08T08:23:16.894537+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.894537+0000","last_undegraded":"2023-12-08T08:23:16.894537+0000","last_fullsized":"2023-12-08T08:23:16.894537+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.920940+0000","last_change":"2023-12-08T08:23:16.918822+0000","last_active":"2023-12-08T08:23:16.920940+0000","last_peered":"2023-12-08T08:23:16.920940+0000","last_clean":"2023-12-08T08:23:16.920940+0000","last_became_active":"2023-12-08T08:23:16.918519+0000","last_became_peered":"2023-12-08T08:23:16.918519+0000","last_unstale":"2023-12-08T08:23:16.920940+0000","last_undegraded":"2023-12-08T08:23:16.920940+0000","last_fullsized":"2023-12-08T08:23:16.920940+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:03.696851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.888527+0000","last_change":"2023-12-08T08:23:00.305076+0000","last_active":"2023-12-08T08:23:15.888527+0000","last_peered":"2023-12-08T08:23:15.888527+0000","last_clean":"2023-12-08T08:23:15.888527+0000","last_became_active":"2023-12-08T08:23:00.304435+0000","last_became_peered":"2023-12-08T08:23:00.304435+0000","last_unstale":"2023-12-08T08:23:15.888527+0000","last_undegraded":"2023-12-08T08:23:15.888527+0000","last_fullsized":"2023-12-08T08:23:15.888527+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:42:20.038693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.885184+0000","last_change":"2023-12-08T08:22:59.278661+0000","last_active":"2023-12-08T08:23:15.885184+0000","last_peered":"2023-12-08T08:23:15.885184+0000","last_clean":"2023-12-08T08:23:15.885184+0000","last_became_active":"2023-12-08T08:22:59.278383+0000","last_became_peered":"2023-12-08T08:22:59.278383+0000","last_unstale":"2023-12-08T08:23:15.885184+0000","last_undegraded":"2023-12-08T08:23:15.885184+0000","last_fullsized":"2023-12-08T08:23:15.885184+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:35:15.000491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-08T08:23:16.899234+0000","last_change":"2023-12-08T08:23:16.899234+0000","last_active":"2023-12-08T08:23:16.880943+0000","last_peered":"2023-12-08T08:23:16.880943+0000","last_clean":"2023-12-08T08:23:16.880943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:23:16.899234+0000","last_undegraded":"2023-12-08T08:23:16.899234+0000","last_fullsized":"2023-12-08T08:23:16.899234+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-08T08:23:16.923341+0000","last_change":"2023-12-08T08:23:16.918926+0000","last_active":"2023-12-08T08:23:16.923341+0000","last_peered":"2023-12-08T08:23:16.923341+0000","last_clean":"2023-12-08T08:23:16.923341+0000","last_became_active":"2023-12-08T08:23:16.918626+0000","last_became_peered":"2023-12-08T08:23:16.918626+0000","last_unstale":"2023-12-08T08:23:16.923341+0000","last_undegraded":"2023-12-08T08:23:16.923341+0000","last_fullsized":"2023-12-08T08:23:16.923341+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:10:23.005533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.890781+0000","last_change":"2023-12-08T08:23:00.270574+0000","last_active":"2023-12-08T08:23:15.890781+0000","last_peered":"2023-12-08T08:23:15.890781+0000","last_clean":"2023-12-08T08:23:15.890781+0000","last_became_active":"2023-12-08T08:23:00.270304+0000","last_became_peered":"2023-12-08T08:23:00.270304+0000","last_unstale":"2023-12-08T08:23:15.890781+0000","last_undegraded":"2023-12-08T08:23:15.890781+0000","last_fullsized":"2023-12-08T08:23:15.890781+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:15:55.762883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"67'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.895591+0000","last_change":"2023-12-08T08:22:59.275324+0000","last_active":"2023-12-08T08:23:15.895591+0000","last_peered":"2023-12-08T08:23:15.895591+0000","last_clean":"2023-12-08T08:23:15.895591+0000","last_became_active":"2023-12-08T08:22:59.275038+0000","last_became_peered":"2023-12-08T08:22:59.275038+0000","last_unstale":"2023-12-08T08:23:15.895591+0000","last_undegraded":"2023-12-08T08:23:15.895591+0000","last_fullsized":"2023-12-08T08:23:15.895591+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:09.089659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":207,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-08T08:23:15.894333+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:23:15.894333+0000","last_peered":"2023-12-08T08:23:15.894333+0000","last_clean":"2023-12-08T08:23:15.894333+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:23:15.894333+0000","last_undegraded":"2023-12-08T08:23:15.894333+0000","last_fullsized":"2023-12-08T08:23:15.894333+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":929792,"data_stored":968762,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89900000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.85299999999999998,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.77500000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85999999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89600000000000002,"5min":1.446,"15min":1.446},"last":0.873}]},{"osd":2,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.71999999999999997,"15min":0.72899999999999998},"min":{"1min":0.52100000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.871,"5min":1.379,"15min":1.379},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.47599999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.84599999999999997,"5min":1.706,"15min":1.706},"last":0.85999999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.751,"15min":0.76300000000000001},"min":{"1min":0.54500000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.88700000000000001,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.752},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.56699999999999995,"5min":0.496,"15min":0.496},"max":{"1min":0.83099999999999996,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.80000000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.46899999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.90000000000000002,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.72599999999999998,"15min":0.74199999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83999999999999997,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.59599999999999997}]},{"osd":5,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.77500000000000002,"15min":0.79500000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81399999999999995,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.78500000000000003,"15min":0.80200000000000005},"min":{"1min":0.499,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93300000000000005,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.72999999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.84799999999999998,"15min":0.86499999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.95899999999999996,"5min":1.573,"15min":1.573},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.80000000000000004,"15min":0.81499999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91100000000000003,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.82299999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":379018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.66800000000000004},"min":{"1min":0.49099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.56899999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94599999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.79400000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72499999999999998,"15min":0.71899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73599999999999999,"15min":0.73399999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.83399999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70899999999999996,"15min":0.72499999999999998},"min":{"1min":0.50700000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.90900000000000003,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73599999999999999,"15min":0.746},"min":{"1min":0.48899999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.877}]},{"osd":3,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.73799999999999999,"15min":0.75700000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.46600000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.96299999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.752}]},{"osd":4,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.70199999999999996,"15min":0.72599999999999998},"min":{"1min":0.42899999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83399999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.71699999999999997,"15min":0.755},"min":{"1min":0.496,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79700000000000004,"5min":1.014,"15min":1.014},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.75,"15min":0.79100000000000004},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83099999999999996,"5min":1.091,"15min":1.091},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.81699999999999995,"15min":0.84299999999999997},"min":{"1min":0.57199999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0149999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.93400000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78600000000000003,"15min":0.81599999999999995},"min":{"1min":0.61799999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.89000000000000001,"5min":1.04,"15min":1.04},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.84199999999999997,"15min":0.89200000000000002},"min":{"1min":0.55400000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96499999999999997,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.84799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":876544,"data_stored":381453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.621,"15min":0.622},"min":{"1min":0.47599999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.042,"5min":1.081,"15min":1.081},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68300000000000005,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.024,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.65800000000000003}]},{"osd":1,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69099999999999995,"15min":0.68100000000000005},"min":{"1min":0.42399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98599999999999999,"5min":1.194,"15min":1.194},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.006,"5min":1.143,"15min":1.143},"last":0.59199999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.47999999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0880000000000001,"5min":1.101,"15min":1.101},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72999999999999998,"15min":0.74199999999999999},"min":{"1min":0.52300000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.745},{"interface":"front","average":{"1min":0.75,"5min":0.76300000000000001,"15min":0.753},"min":{"1min":0.56200000000000006,"5min":0.5,"15min":0.5},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.73099999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.40899999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.96299999999999997,"5min":1.01,"15min":1.01},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.58899999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.048,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.83399999999999996}]},{"osd":6,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.75700000000000001,"15min":0.77900000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89900000000000002,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91000000000000003,"5min":1.073,"15min":1.073},"last":0.76500000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77600000000000002,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95999999999999996,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83599999999999997,"15min":0.85599999999999998},"min":{"1min":0.56299999999999994,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0800000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.61199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":378324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.68000000000000005,"15min":0.69399999999999995},"min":{"1min":0.502,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86099999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.68300000000000005,"15min":0.66800000000000004},"min":{"1min":0.59399999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95099999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.81399999999999995}]},{"osd":1,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70799999999999996,"15min":0.71299999999999997},"min":{"1min":0.52800000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90100000000000002,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68100000000000005,"15min":0.68200000000000005},"min":{"1min":0.505,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.84499999999999997,"5min":1.002,"15min":1.002},"last":0.71299999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68999999999999995},"min":{"1min":0.54200000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88400000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.751},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.54400000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.84699999999999998,"5min":1.056,"15min":1.056},"last":0.77400000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.58999999999999997,"5min":0.496,"15min":0.496},"max":{"1min":0.95299999999999996,"5min":1.359,"15min":1.359},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.755,"15min":0.78500000000000003},"min":{"1min":0.51800000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99399999999999999,"5min":1.232,"15min":1.232},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.64200000000000002,"15min":0.66800000000000004},"min":{"1min":0.39000000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90800000000000003,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.745,"15min":0.78100000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95199999999999996,"5min":1.091,"15min":1.091},"last":0.57699999999999996}]},{"osd":6,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.68600000000000005,"15min":0.71499999999999997},"min":{"1min":0.41699999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.92500000000000004,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.504},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.76300000000000001,"15min":0.78900000000000003},"min":{"1min":0.45300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98199999999999998,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.55000000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.97699999999999998,"5min":1.246,"15min":1.246},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.80200000000000005},"min":{"1min":0.50800000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.004,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.45700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":381431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41799999999999998,"15min":0.432},"min":{"1min":0.26500000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.56000000000000005,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45600000000000002,"15min":0.46300000000000002},"min":{"1min":0.309,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73999999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.42899999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.435,"15min":0.436},"min":{"1min":0.317,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.58099999999999996,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.504}]},{"osd":2,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.50900000000000001,"15min":0.52200000000000002},"min":{"1min":0.35299999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52900000000000003,"15min":0.54100000000000004},"min":{"1min":0.40600000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65200000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.52700000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0620000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":1.014},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.54300000000000004,"5min":0.497,"15min":0.497},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.95499999999999996}]},{"osd":5,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.52000000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":1},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.76200000000000001,"15min":0.77100000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.97199999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.56899999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.101,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.97899999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.76200000000000001,"15min":0.75900000000000001},"min":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.58599999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1080000000000001,"5min":1.121,"15min":1.121},"last":1.036}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":864256,"data_stored":378906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39100000000000001,"15min":0.40100000000000002},"min":{"1min":0.27900000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.497,"15min":0.53100000000000003},"min":{"1min":0.315,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67700000000000005,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.34399999999999997}]},{"osd":1,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.32200000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51500000000000001,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.40100000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.54300000000000004,"15min":0.57699999999999996},"min":{"1min":0.34899999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.57799999999999996,"5min":3.008,"15min":3.008},"last":0.44},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47799999999999998,"15min":0.48399999999999999},"min":{"1min":0.33800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.65400000000000003,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.36599999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78300000000000003,"15min":0.81699999999999995},"min":{"1min":0.50900000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.004,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0049999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.79300000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.75700000000000001,"15min":0.76800000000000002},"min":{"1min":0.51000000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98699999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78800000000000003,"15min":0.82899999999999996},"min":{"1min":0.52600000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98799999999999999,"5min":3.637,"15min":3.637},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.78000000000000003,"15min":0.79400000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97499999999999998,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.038,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.83499999999999996,"15min":0.89500000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.88400000000000001,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.82499999999999996,"15min":0.83899999999999997},"min":{"1min":0.56799999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0109999999999999,"5min":1.766,"15min":1.766},"last":0.83399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":378518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.59799999999999998,"15min":0.67600000000000005},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.80300000000000005,"5min":5.2210000000000001,"15min":5.2210000000000001},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.73399999999999999,"15min":0.85899999999999999},"min":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59599999999999997,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.38200000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.71299999999999997,"15min":0.83899999999999997},"min":{"1min":0.32800000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.60999999999999999,"5min":8.2070000000000007,"15min":8.2070000000000007},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.63500000000000001,"15min":0.70399999999999996},"min":{"1min":0.34300000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.69299999999999995,"5min":4.351,"15min":4.351},"last":0.37}]},{"osd":3,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.80900000000000005,"15min":0.94199999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.754,"5min":8.1479999999999997,"15min":8.1479999999999997},"last":0.308},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.67400000000000004,"15min":0.76900000000000002},"min":{"1min":0.32300000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.72599999999999998,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.32300000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.91000000000000003,"15min":1.012},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0049999999999999,"5min":4.8470000000000004,"15min":4.8470000000000004},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.97599999999999998,"15min":1.0820000000000001},"min":{"1min":0.55100000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93999999999999995,"5min":4.7939999999999996,"15min":4.7939999999999996},"last":0.66500000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.90500000000000003,"15min":0.98699999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99199999999999999,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.89900000000000002,"15min":0.97899999999999998},"min":{"1min":0.53000000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.107,"5min":4.5830000000000002,"15min":4.5830000000000002},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.97999999999999998,"15min":1.097},"min":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.95799999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.97199999999999998,"15min":1.075},"min":{"1min":0.59399999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.95799999999999996,"5min":4.6289999999999996,"15min":4.6289999999999996},"last":0.68400000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.91600000000000004,"15min":1.002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.97699999999999998,"5min":4.665,"15min":4.665},"last":0.505},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.98199999999999998,"15min":1.0860000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.089,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.57599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":917504,"data_stored":961596,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46899999999999997,"15min":0.495},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64000000000000001,"5min":1.863,"15min":1.863},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.75600000000000001,"15min":0.88600000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70799999999999996,"5min":8.2799999999999994,"15min":8.2799999999999994},"last":0.38}]},{"osd":2,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.78000000000000003,"15min":0.93200000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77300000000000002,"5min":7.9290000000000003,"15min":7.9290000000000003},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.78200000000000003,"15min":0.93700000000000006},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.628,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.435}]},{"osd":3,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.59799999999999998,"15min":0.67200000000000004},"min":{"1min":0.33100000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58699999999999997,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.75600000000000001,"15min":0.872},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82399999999999995,"5min":7.8890000000000002,"15min":7.8890000000000002},"last":0.41799999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.94899999999999995,"15min":1.0529999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95399999999999996,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.753,"15min":0.77800000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88600000000000001,"5min":1.607,"15min":1.607},"last":0.58499999999999996}]},{"osd":5,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.81100000000000005,"15min":0.83099999999999996},"min":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96899999999999997,"5min":1.514,"15min":1.514},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.98899999999999999,"15min":1.1100000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91000000000000003,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79200000000000004,"15min":0.82699999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.88,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.95399999999999996,"15min":1.0549999999999999},"min":{"1min":0.56100000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.89900000000000002,"5min":7.835,"15min":7.835},"last":0.56699999999999995}]},{"osd":7,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.97399999999999998,"15min":1.0800000000000001},"min":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.99299999999999999,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.81000000000000005,"15min":0.85399999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95199999999999996,"5min":1.794,"15min":1.794},"last":0.52900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:23:26.507 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:23:26.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.650+0000 7f68c5b0f640 1 Processor -- start 2023-12-08T08:23:26.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.650+0000 7f68c5b0f640 1 -- start start 2023-12-08T08:23:26.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.650+0000 7f68c5b0f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f68c00c3b80 0x7f68c006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:26.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.650+0000 7f68c5b0f640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68c00c5300 0x7f68c006c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:26.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.650+0000 7f68c5b0f640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c006bb80 con 0x7f68c006d2b0 2023-12-08T08:23:26.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.650+0000 7f68c5b0f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c006cc70 con 0x7f68c00c3b80 2023-12-08T08:23:26.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.650+0000 7f68c5b0f640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c00c5790 con 0x7f68c00c5300 2023-12-08T08:23:26.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.650+0000 7f68b7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f68c00c3b80 0x7f68c006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:26.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.650+0000 7f68b7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f68c00c3b80 0x7f68c006d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54414/0 (socket says 172.21.15.88:54414) 2023-12-08T08:23:26.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.650+0000 7f68b7fff640 1 -- 172.21.15.88:0/2371715180 learned_addr learned my addr 172.21.15.88:0/2371715180 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:26.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.650+0000 7f68bffff640 1 --2- 172.21.15.88:0/2371715180 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68c00c5300 0x7f68c006c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:26.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.650+0000 7f68b7fff640 1 -- 172.21.15.88:0/2371715180 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68c00c5300 msgr2=0x7f68c006c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:26.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.650+0000 7f68b7fff640 1 --2- 172.21.15.88:0/2371715180 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68c00c5300 0x7f68c006c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:26.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.650+0000 7f68b7fff640 1 -- 172.21.15.88:0/2371715180 >> v1:172.21.15.148:6789/0 conn(0x7f68c006d2b0 legacy=0x7f68c006c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:26.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.650+0000 7f68b7fff640 1 -- 172.21.15.88:0/2371715180 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c01515c0 con 0x7f68c00c3b80 2023-12-08T08:23:26.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.650+0000 7f68bffff640 1 --2- 172.21.15.88:0/2371715180 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68c00c5300 0x7f68c006c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:26.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.654+0000 7f68b7fff640 1 --2- 172.21.15.88:0/2371715180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68c00c3b80 0x7f68c006d690 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f68a8009870 tx=0x7f68a801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16854e9539bf9078 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:26.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.654+0000 7f68beffd640 1 -- 172.21.15.88:0/2371715180 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a80aa5f0 con 0x7f68c00c3b80 2023-12-08T08:23:26.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.654+0000 7f68beffd640 1 -- 172.21.15.88:0/2371715180 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a80aa750 con 0x7f68c00c3b80 2023-12-08T08:23:26.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.654+0000 7f68beffd640 1 -- 172.21.15.88:0/2371715180 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a80aaae0 con 0x7f68c00c3b80 2023-12-08T08:23:26.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.654+0000 7f68c5b0f640 1 -- 172.21.15.88:0/2371715180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68c00c3b80 msgr2=0x7f68c006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:26.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.654+0000 7f68c5b0f640 1 --2- 172.21.15.88:0/2371715180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68c00c3b80 0x7f68c006d690 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f68a8009870 tx=0x7f68a801c4d0 comp rx=0 tx=0).stop 2023-12-08T08:23:26.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.654+0000 7f68c5b0f640 1 -- 172.21.15.88:0/2371715180 shutdown_connections 2023-12-08T08:23:26.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.654+0000 7f68c5b0f640 1 --2- 172.21.15.88:0/2371715180 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68c00c5300 0x7f68c006c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:26.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.654+0000 7f68c5b0f640 1 --2- 172.21.15.88:0/2371715180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68c00c3b80 0x7f68c006d690 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:26.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.654+0000 7f68c5b0f640 1 -- 172.21.15.88:0/2371715180 >> 172.21.15.88:0/2371715180 conn(0x7f68c00a7810 msgr2=0x7f68c00a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:26.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.654+0000 7f68c5b0f640 1 -- 172.21.15.88:0/2371715180 shutdown_connections 2023-12-08T08:23:26.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.654+0000 7f68c5b0f640 1 -- 172.21.15.88:0/2371715180 wait complete. 2023-12-08T08:23:26.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.658+0000 7f68c5b0f640 1 Processor -- start 2023-12-08T08:23:26.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.658+0000 7f68c5b0f640 1 -- start start 2023-12-08T08:23:26.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.658+0000 7f68c5b0f640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68c006d2b0 0x7f68c0143fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:26.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.658+0000 7f68c5b0f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68c00c3b80 0x7f68c014f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:26.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.658+0000 7f68c5b0f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68c00c5300 0x7f68c0153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:26.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.658+0000 7f68c5b0f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c0146a40 con 0x7f68c00c5300 2023-12-08T08:23:26.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.658+0000 7f68c5b0f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c0145f70 con 0x7f68c00c3b80 2023-12-08T08:23:26.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.658+0000 7f68c5b0f640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c0145640 con 0x7f68c006d2b0 2023-12-08T08:23:26.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.658+0000 7f68bffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68c00c5300 0x7f68c0153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:26.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.658+0000 7f68bffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68c00c5300 0x7f68c0153d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54418/0 (socket says 172.21.15.88:54418) 2023-12-08T08:23:26.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.658+0000 7f68bffff640 1 -- 172.21.15.88:0/965323901 learned_addr learned my addr 172.21.15.88:0/965323901 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:26.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.658+0000 7f68bf7fe640 1 --2- 172.21.15.88:0/965323901 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68c006d2b0 0x7f68c0143fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:26.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.658+0000 7f68b7fff640 1 --2- 172.21.15.88:0/965323901 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68c00c3b80 0x7f68c014f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:26.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.658+0000 7f68bffff640 1 -- 172.21.15.88:0/965323901 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68c006d2b0 msgr2=0x7f68c0143fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:26.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.658+0000 7f68bffff640 1 --2- 172.21.15.88:0/965323901 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68c006d2b0 0x7f68c0143fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:26.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.658+0000 7f68bffff640 1 -- 172.21.15.88:0/965323901 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68c00c3b80 msgr2=0x7f68c014f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:26.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.658+0000 7f68bffff640 1 --2- 172.21.15.88:0/965323901 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68c00c3b80 0x7f68c014f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:26.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.658+0000 7f68bffff640 1 -- 172.21.15.88:0/965323901 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a80094d0 con 0x7f68c00c5300 2023-12-08T08:23:26.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.658+0000 7f68bffff640 1 --2- 172.21.15.88:0/965323901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68c00c5300 0x7f68c0153d40 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f68b800cca0 tx=0x7f68b800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:26.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.658+0000 7f68bcff9640 1 -- 172.21.15.88:0/965323901 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b800f680 con 0x7f68c00c5300 2023-12-08T08:23:26.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.658+0000 7f68bcff9640 1 -- 172.21.15.88:0/965323901 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b800f800 con 0x7f68c00c5300 2023-12-08T08:23:26.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.658+0000 7f68bcff9640 1 -- 172.21.15.88:0/965323901 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b800fbb0 con 0x7f68c00c5300 2023-12-08T08:23:26.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.658+0000 7f68c5b0f640 1 -- 172.21.15.88:0/965323901 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c014ef80 con 0x7f68c00c5300 2023-12-08T08:23:26.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.658+0000 7f68c5b0f640 1 -- 172.21.15.88:0/965323901 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c0145c00 con 0x7f68c00c5300 2023-12-08T08:23:26.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.662+0000 7f68c5b0f640 1 -- 172.21.15.88:0/965323901 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c01460e0 con 0x7f68c00c5300 2023-12-08T08:23:26.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.662+0000 7f68bcff9640 1 -- 172.21.15.88:0/965323901 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f68b800b040 con 0x7f68c00c5300 2023-12-08T08:23:26.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.662+0000 7f68bcff9640 1 --2- 172.21.15.88:0/965323901 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f68a0066470 0x7f68a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:26.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.662+0000 7f68bcff9640 1 -- 172.21.15.88:0/965323901 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f68b8084a00 con 0x7f68c00c5300 2023-12-08T08:23:26.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.662+0000 7f68bf7fe640 1 --2- 172.21.15.88:0/965323901 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f68a0066470 0x7f68a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:26.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.662+0000 7f68bf7fe640 1 --2- 172.21.15.88:0/965323901 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f68a0066470 0x7f68a0068930 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f68c00c1360 tx=0x7f68b0007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:26.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.666+0000 7f68bcff9640 1 -- 172.21.15.88:0/965323901 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f68b8051bc0 con 0x7f68c00c5300 2023-12-08T08:23:26.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.814+0000 7f68c5b0f640 1 -- 172.21.15.88:0/965323901 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f68c00c0770 con 0x7f68a0066470 2023-12-08T08:23:26.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.830+0000 7f68bcff9640 1 -- 172.21.15.88:0/965323901 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+528083 (secure 0 0 0) 0x7f68c00c0770 con 0x7f68a0066470 2023-12-08T08:23:26.838 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:26.842 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:23:26.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.834+0000 7f68c5b0f640 1 -- 172.21.15.88:0/965323901 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f68a0066470 msgr2=0x7f68a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:26.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.834+0000 7f68c5b0f640 1 --2- 172.21.15.88:0/965323901 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f68a0066470 0x7f68a0068930 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f68c00c1360 tx=0x7f68b0007e40 comp rx=0 tx=0).stop 2023-12-08T08:23:26.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.834+0000 7f68c5b0f640 1 -- 172.21.15.88:0/965323901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68c00c5300 msgr2=0x7f68c0153d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:26.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.834+0000 7f68c5b0f640 1 --2- 172.21.15.88:0/965323901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68c00c5300 0x7f68c0153d40 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f68b800cca0 tx=0x7f68b800a650 comp rx=0 tx=0).stop 2023-12-08T08:23:26.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.834+0000 7f68c5b0f640 1 -- 172.21.15.88:0/965323901 shutdown_connections 2023-12-08T08:23:26.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.834+0000 7f68c5b0f640 1 --2- 172.21.15.88:0/965323901 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f68a0066470 0x7f68a0068930 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:26.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.834+0000 7f68c5b0f640 1 --2- 172.21.15.88:0/965323901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68c00c5300 0x7f68c0153d40 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:26.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.834+0000 7f68c5b0f640 1 --2- 172.21.15.88:0/965323901 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68c00c3b80 0x7f68c014f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:26.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.834+0000 7f68c5b0f640 1 --2- 172.21.15.88:0/965323901 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f68c006d2b0 0x7f68c0143fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:26.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.834+0000 7f68c5b0f640 1 -- 172.21.15.88:0/965323901 >> 172.21.15.88:0/965323901 conn(0x7f68c00a7810 msgr2=0x7f68c0150d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:26.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.834+0000 7f68c5b0f640 1 -- 172.21.15.88:0/965323901 shutdown_connections 2023-12-08T08:23:26.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:26.834+0000 7f68c5b0f640 1 -- 172.21.15.88:0/965323901 wait complete. 2023-12-08T08:23:26.858 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2023-12-08T08:23:26.785536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":375,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256632,"kb_used_data":7168,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718088,"statfs":{"total":773094113280,"available":772831322112,"internally_reserved":0,"allocated":7340032,"data_stored":4338278,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":53,"apply_latency_ms":53,"commit_latency_ns":53000000,"apply_latency_ns":53000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.893718"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:18.913590+0000","last_change":"2023-12-08T08:23:17.909371+0000","last_active":"2023-12-08T08:23:18.913590+0000","last_peered":"2023-12-08T08:23:18.913590+0000","last_clean":"2023-12-08T08:23:18.913590+0000","last_became_active":"2023-12-08T08:23:17.909109+0000","last_became_peered":"2023-12-08T08:23:17.909109+0000","last_unstale":"2023-12-08T08:23:18.913590+0000","last_undegraded":"2023-12-08T08:23:18.913590+0000","last_fullsized":"2023-12-08T08:23:18.913590+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:04.704782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.904808+0000","last_change":"2023-12-08T08:23:00.281512+0000","last_active":"2023-12-08T08:23:17.904808+0000","last_peered":"2023-12-08T08:23:17.904808+0000","last_clean":"2023-12-08T08:23:17.904808+0000","last_became_active":"2023-12-08T08:23:00.281118+0000","last_became_peered":"2023-12-08T08:23:00.281118+0000","last_unstale":"2023-12-08T08:23:17.904808+0000","last_undegraded":"2023-12-08T08:23:17.904808+0000","last_fullsized":"2023-12-08T08:23:17.904808+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:15.472021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.628939+0000","last_change":"2023-12-08T08:23:17.914468+0000","last_active":"2023-12-08T08:23:19.628939+0000","last_peered":"2023-12-08T08:23:19.628939+0000","last_clean":"2023-12-08T08:23:19.628939+0000","last_became_active":"2023-12-08T08:23:17.914152+0000","last_became_peered":"2023-12-08T08:23:17.914152+0000","last_unstale":"2023-12-08T08:23:19.628939+0000","last_undegraded":"2023-12-08T08:23:19.628939+0000","last_fullsized":"2023-12-08T08:23:19.628939+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:04:23.028891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.897225+0000","last_change":"2023-12-08T08:23:00.276523+0000","last_active":"2023-12-08T08:23:17.897225+0000","last_peered":"2023-12-08T08:23:17.897225+0000","last_clean":"2023-12-08T08:23:17.897225+0000","last_became_active":"2023-12-08T08:23:00.276039+0000","last_became_peered":"2023-12-08T08:23:00.276039+0000","last_unstale":"2023-12-08T08:23:17.897225+0000","last_undegraded":"2023-12-08T08:23:17.897225+0000","last_fullsized":"2023-12-08T08:23:17.897225+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:31:16.893953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:18.913903+0000","last_change":"2023-12-08T08:23:17.909268+0000","last_active":"2023-12-08T08:23:18.913903+0000","last_peered":"2023-12-08T08:23:18.913903+0000","last_clean":"2023-12-08T08:23:18.913903+0000","last_became_active":"2023-12-08T08:23:17.909009+0000","last_became_peered":"2023-12-08T08:23:17.909009+0000","last_unstale":"2023-12-08T08:23:18.913903+0000","last_undegraded":"2023-12-08T08:23:18.913903+0000","last_fullsized":"2023-12-08T08:23:18.913903+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:40.544096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.909286+0000","last_change":"2023-12-08T08:23:00.283198+0000","last_active":"2023-12-08T08:23:17.909286+0000","last_peered":"2023-12-08T08:23:17.909286+0000","last_clean":"2023-12-08T08:23:17.909286+0000","last_became_active":"2023-12-08T08:23:00.282944+0000","last_became_peered":"2023-12-08T08:23:00.282944+0000","last_unstale":"2023-12-08T08:23:17.909286+0000","last_undegraded":"2023-12-08T08:23:17.909286+0000","last_fullsized":"2023-12-08T08:23:17.909286+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:33.898137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.288856+0000","last_change":"2023-12-08T08:23:17.935391+0000","last_active":"2023-12-08T08:23:19.288856+0000","last_peered":"2023-12-08T08:23:19.288856+0000","last_clean":"2023-12-08T08:23:19.288856+0000","last_became_active":"2023-12-08T08:23:17.934884+0000","last_became_peered":"2023-12-08T08:23:17.934884+0000","last_unstale":"2023-12-08T08:23:19.288856+0000","last_undegraded":"2023-12-08T08:23:19.288856+0000","last_fullsized":"2023-12-08T08:23:19.288856+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:28:25.612721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.899268+0000","last_change":"2023-12-08T08:23:00.285685+0000","last_active":"2023-12-08T08:23:17.899268+0000","last_peered":"2023-12-08T08:23:17.899268+0000","last_clean":"2023-12-08T08:23:17.899268+0000","last_became_active":"2023-12-08T08:23:00.285351+0000","last_became_peered":"2023-12-08T08:23:00.285351+0000","last_unstale":"2023-12-08T08:23:17.899268+0000","last_undegraded":"2023-12-08T08:23:17.899268+0000","last_fullsized":"2023-12-08T08:23:17.899268+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:43:34.830332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.284688+0000","last_change":"2023-12-08T08:23:17.918348+0000","last_active":"2023-12-08T08:23:19.284688+0000","last_peered":"2023-12-08T08:23:19.284688+0000","last_clean":"2023-12-08T08:23:19.284688+0000","last_became_active":"2023-12-08T08:23:17.917832+0000","last_became_peered":"2023-12-08T08:23:17.917832+0000","last_unstale":"2023-12-08T08:23:19.284688+0000","last_undegraded":"2023-12-08T08:23:19.284688+0000","last_fullsized":"2023-12-08T08:23:19.284688+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:59:18.956399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.898112+0000","last_change":"2023-12-08T08:23:00.264270+0000","last_active":"2023-12-08T08:23:17.898112+0000","last_peered":"2023-12-08T08:23:17.898112+0000","last_clean":"2023-12-08T08:23:17.898112+0000","last_became_active":"2023-12-08T08:23:00.263994+0000","last_became_peered":"2023-12-08T08:23:00.263994+0000","last_unstale":"2023-12-08T08:23:17.898112+0000","last_undegraded":"2023-12-08T08:23:17.898112+0000","last_fullsized":"2023-12-08T08:23:17.898112+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:33.905575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.287853+0000","last_change":"2023-12-08T08:23:17.935613+0000","last_active":"2023-12-08T08:23:19.287853+0000","last_peered":"2023-12-08T08:23:19.287853+0000","last_clean":"2023-12-08T08:23:19.287853+0000","last_became_active":"2023-12-08T08:23:17.935324+0000","last_became_peered":"2023-12-08T08:23:17.935324+0000","last_unstale":"2023-12-08T08:23:19.287853+0000","last_undegraded":"2023-12-08T08:23:19.287853+0000","last_fullsized":"2023-12-08T08:23:19.287853+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:32:33.169907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.904594+0000","last_change":"2023-12-08T08:23:00.300354+0000","last_active":"2023-12-08T08:23:17.904594+0000","last_peered":"2023-12-08T08:23:17.904594+0000","last_clean":"2023-12-08T08:23:17.904594+0000","last_became_active":"2023-12-08T08:23:00.300026+0000","last_became_peered":"2023-12-08T08:23:00.300026+0000","last_unstale":"2023-12-08T08:23:17.904594+0000","last_undegraded":"2023-12-08T08:23:17.904594+0000","last_fullsized":"2023-12-08T08:23:17.904594+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.103106+0000","last_change":"2023-12-08T08:23:17.927628+0000","last_active":"2023-12-08T08:23:19.103106+0000","last_peered":"2023-12-08T08:23:19.103106+0000","last_clean":"2023-12-08T08:23:19.103106+0000","last_became_active":"2023-12-08T08:23:17.926997+0000","last_became_peered":"2023-12-08T08:23:17.926997+0000","last_unstale":"2023-12-08T08:23:19.103106+0000","last_undegraded":"2023-12-08T08:23:19.103106+0000","last_fullsized":"2023-12-08T08:23:19.103106+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:44:21.257367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.898593+0000","last_change":"2023-12-08T08:23:00.278456+0000","last_active":"2023-12-08T08:23:17.898593+0000","last_peered":"2023-12-08T08:23:17.898593+0000","last_clean":"2023-12-08T08:23:17.898593+0000","last_became_active":"2023-12-08T08:23:00.277186+0000","last_became_peered":"2023-12-08T08:23:00.277186+0000","last_unstale":"2023-12-08T08:23:17.898593+0000","last_undegraded":"2023-12-08T08:23:17.898593+0000","last_fullsized":"2023-12-08T08:23:17.898593+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:20:16.170951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.284758+0000","last_change":"2023-12-08T08:23:17.918053+0000","last_active":"2023-12-08T08:23:19.284758+0000","last_peered":"2023-12-08T08:23:19.284758+0000","last_clean":"2023-12-08T08:23:19.284758+0000","last_became_active":"2023-12-08T08:23:17.917710+0000","last_became_peered":"2023-12-08T08:23:17.917710+0000","last_unstale":"2023-12-08T08:23:19.284758+0000","last_undegraded":"2023-12-08T08:23:19.284758+0000","last_fullsized":"2023-12-08T08:23:19.284758+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:36:02.599520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.902738+0000","last_change":"2023-12-08T08:23:00.272694+0000","last_active":"2023-12-08T08:23:17.902738+0000","last_peered":"2023-12-08T08:23:17.902738+0000","last_clean":"2023-12-08T08:23:17.902738+0000","last_became_active":"2023-12-08T08:23:00.272440+0000","last_became_peered":"2023-12-08T08:23:00.272440+0000","last_unstale":"2023-12-08T08:23:17.902738+0000","last_undegraded":"2023-12-08T08:23:17.902738+0000","last_fullsized":"2023-12-08T08:23:17.902738+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:15.472021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.284937+0000","last_change":"2023-12-08T08:23:17.927875+0000","last_active":"2023-12-08T08:23:19.284937+0000","last_peered":"2023-12-08T08:23:19.284937+0000","last_clean":"2023-12-08T08:23:19.284937+0000","last_became_active":"2023-12-08T08:23:17.926501+0000","last_became_peered":"2023-12-08T08:23:17.926501+0000","last_unstale":"2023-12-08T08:23:19.284937+0000","last_undegraded":"2023-12-08T08:23:19.284937+0000","last_fullsized":"2023-12-08T08:23:19.284937+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:42:52.884648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.907399+0000","last_change":"2023-12-08T08:23:00.298447+0000","last_active":"2023-12-08T08:23:17.907399+0000","last_peered":"2023-12-08T08:23:17.907399+0000","last_clean":"2023-12-08T08:23:17.907399+0000","last_became_active":"2023-12-08T08:23:00.298113+0000","last_became_peered":"2023-12-08T08:23:00.298113+0000","last_unstale":"2023-12-08T08:23:17.907399+0000","last_undegraded":"2023-12-08T08:23:17.907399+0000","last_fullsized":"2023-12-08T08:23:17.907399+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:18.914588+0000","last_change":"2023-12-08T08:23:17.903069+0000","last_active":"2023-12-08T08:23:18.914588+0000","last_peered":"2023-12-08T08:23:18.914588+0000","last_clean":"2023-12-08T08:23:18.914588+0000","last_became_active":"2023-12-08T08:23:17.902663+0000","last_became_peered":"2023-12-08T08:23:17.902663+0000","last_unstale":"2023-12-08T08:23:18.914588+0000","last_undegraded":"2023-12-08T08:23:18.914588+0000","last_fullsized":"2023-12-08T08:23:18.914588+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:59:18.956399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.912321+0000","last_change":"2023-12-08T08:23:00.277064+0000","last_active":"2023-12-08T08:23:17.912321+0000","last_peered":"2023-12-08T08:23:17.912321+0000","last_clean":"2023-12-08T08:23:17.912321+0000","last_became_active":"2023-12-08T08:23:00.276850+0000","last_became_peered":"2023-12-08T08:23:00.276850+0000","last_unstale":"2023-12-08T08:23:17.912321+0000","last_undegraded":"2023-12-08T08:23:17.912321+0000","last_fullsized":"2023-12-08T08:23:17.912321+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:18.915361+0000","last_change":"2023-12-08T08:23:17.916965+0000","last_active":"2023-12-08T08:23:18.915361+0000","last_peered":"2023-12-08T08:23:18.915361+0000","last_clean":"2023-12-08T08:23:18.915361+0000","last_became_active":"2023-12-08T08:23:17.916688+0000","last_became_peered":"2023-12-08T08:23:17.916688+0000","last_unstale":"2023-12-08T08:23:18.915361+0000","last_undegraded":"2023-12-08T08:23:18.915361+0000","last_fullsized":"2023-12-08T08:23:18.915361+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:36:02.599520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.895469+0000","last_change":"2023-12-08T08:23:00.286362+0000","last_active":"2023-12-08T08:23:17.895469+0000","last_peered":"2023-12-08T08:23:17.895469+0000","last_clean":"2023-12-08T08:23:17.895469+0000","last_became_active":"2023-12-08T08:23:00.286071+0000","last_became_peered":"2023-12-08T08:23:00.286071+0000","last_unstale":"2023-12-08T08:23:17.895469+0000","last_undegraded":"2023-12-08T08:23:17.895469+0000","last_fullsized":"2023-12-08T08:23:17.895469+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:50.890759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.102705+0000","last_change":"2023-12-08T08:23:17.928821+0000","last_active":"2023-12-08T08:23:19.102705+0000","last_peered":"2023-12-08T08:23:19.102705+0000","last_clean":"2023-12-08T08:23:19.102705+0000","last_became_active":"2023-12-08T08:23:17.928539+0000","last_became_peered":"2023-12-08T08:23:17.928539+0000","last_unstale":"2023-12-08T08:23:19.102705+0000","last_undegraded":"2023-12-08T08:23:19.102705+0000","last_fullsized":"2023-12-08T08:23:19.102705+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:38:01.936015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.917118+0000","last_change":"2023-12-08T08:23:00.277187+0000","last_active":"2023-12-08T08:23:17.917118+0000","last_peered":"2023-12-08T08:23:17.917118+0000","last_clean":"2023-12-08T08:23:17.917118+0000","last_became_active":"2023-12-08T08:23:00.276929+0000","last_became_peered":"2023-12-08T08:23:00.276929+0000","last_unstale":"2023-12-08T08:23:17.917118+0000","last_undegraded":"2023-12-08T08:23:17.917118+0000","last_fullsized":"2023-12-08T08:23:17.917118+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:55:36.390421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.628566+0000","last_change":"2023-12-08T08:23:17.922908+0000","last_active":"2023-12-08T08:23:19.628566+0000","last_peered":"2023-12-08T08:23:19.628566+0000","last_clean":"2023-12-08T08:23:19.628566+0000","last_became_active":"2023-12-08T08:23:17.922598+0000","last_became_peered":"2023-12-08T08:23:17.922598+0000","last_unstale":"2023-12-08T08:23:19.628566+0000","last_undegraded":"2023-12-08T08:23:19.628566+0000","last_fullsized":"2023-12-08T08:23:19.628566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:52:55.911821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.904692+0000","last_change":"2023-12-08T08:23:00.275837+0000","last_active":"2023-12-08T08:23:17.904692+0000","last_peered":"2023-12-08T08:23:17.904692+0000","last_clean":"2023-12-08T08:23:17.904692+0000","last_became_active":"2023-12-08T08:23:00.275561+0000","last_became_peered":"2023-12-08T08:23:00.275561+0000","last_unstale":"2023-12-08T08:23:17.904692+0000","last_undegraded":"2023-12-08T08:23:17.904692+0000","last_fullsized":"2023-12-08T08:23:17.904692+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.284561+0000","last_change":"2023-12-08T08:23:17.923437+0000","last_active":"2023-12-08T08:23:19.284561+0000","last_peered":"2023-12-08T08:23:19.284561+0000","last_clean":"2023-12-08T08:23:19.284561+0000","last_became_active":"2023-12-08T08:23:17.921817+0000","last_became_peered":"2023-12-08T08:23:17.921817+0000","last_unstale":"2023-12-08T08:23:19.284561+0000","last_undegraded":"2023-12-08T08:23:19.284561+0000","last_fullsized":"2023-12-08T08:23:19.284561+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:44:21.257367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.901201+0000","last_change":"2023-12-08T08:23:00.295614+0000","last_active":"2023-12-08T08:23:17.901201+0000","last_peered":"2023-12-08T08:23:17.901201+0000","last_clean":"2023-12-08T08:23:17.901201+0000","last_became_active":"2023-12-08T08:23:00.295111+0000","last_became_peered":"2023-12-08T08:23:00.295111+0000","last_unstale":"2023-12-08T08:23:17.901201+0000","last_undegraded":"2023-12-08T08:23:17.901201+0000","last_fullsized":"2023-12-08T08:23:17.901201+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:10:16.885890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.628755+0000","last_change":"2023-12-08T08:23:17.929134+0000","last_active":"2023-12-08T08:23:19.628755+0000","last_peered":"2023-12-08T08:23:19.628755+0000","last_clean":"2023-12-08T08:23:19.628755+0000","last_became_active":"2023-12-08T08:23:17.928829+0000","last_became_peered":"2023-12-08T08:23:17.928829+0000","last_unstale":"2023-12-08T08:23:19.628755+0000","last_undegraded":"2023-12-08T08:23:19.628755+0000","last_fullsized":"2023-12-08T08:23:19.628755+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:50:42.741724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.904532+0000","last_change":"2023-12-08T08:23:00.292909+0000","last_active":"2023-12-08T08:23:17.904532+0000","last_peered":"2023-12-08T08:23:17.904532+0000","last_clean":"2023-12-08T08:23:17.904532+0000","last_became_active":"2023-12-08T08:23:00.292500+0000","last_became_peered":"2023-12-08T08:23:00.292500+0000","last_unstale":"2023-12-08T08:23:17.904532+0000","last_undegraded":"2023-12-08T08:23:17.904532+0000","last_fullsized":"2023-12-08T08:23:17.904532+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:21:14.553932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.291057+0000","last_change":"2023-12-08T08:23:17.921016+0000","last_active":"2023-12-08T08:23:19.291057+0000","last_peered":"2023-12-08T08:23:19.291057+0000","last_clean":"2023-12-08T08:23:19.291057+0000","last_became_active":"2023-12-08T08:23:17.920825+0000","last_became_peered":"2023-12-08T08:23:17.920825+0000","last_unstale":"2023-12-08T08:23:19.291057+0000","last_undegraded":"2023-12-08T08:23:19.291057+0000","last_fullsized":"2023-12-08T08:23:19.291057+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:07:52.567621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.896701+0000","last_change":"2023-12-08T08:23:00.273084+0000","last_active":"2023-12-08T08:23:17.896701+0000","last_peered":"2023-12-08T08:23:17.896701+0000","last_clean":"2023-12-08T08:23:17.896701+0000","last_became_active":"2023-12-08T08:23:00.272803+0000","last_became_peered":"2023-12-08T08:23:00.272803+0000","last_unstale":"2023-12-08T08:23:17.896701+0000","last_undegraded":"2023-12-08T08:23:17.896701+0000","last_fullsized":"2023-12-08T08:23:17.896701+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:16.068318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.291259+0000","last_change":"2023-12-08T08:23:17.912077+0000","last_active":"2023-12-08T08:23:19.291259+0000","last_peered":"2023-12-08T08:23:19.291259+0000","last_clean":"2023-12-08T08:23:19.291259+0000","last_became_active":"2023-12-08T08:23:17.911159+0000","last_became_peered":"2023-12-08T08:23:17.911159+0000","last_unstale":"2023-12-08T08:23:19.291259+0000","last_undegraded":"2023-12-08T08:23:19.291259+0000","last_fullsized":"2023-12-08T08:23:19.291259+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:18:19.953862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.898638+0000","last_change":"2023-12-08T08:23:00.300292+0000","last_active":"2023-12-08T08:23:17.898638+0000","last_peered":"2023-12-08T08:23:17.898638+0000","last_clean":"2023-12-08T08:23:17.898638+0000","last_became_active":"2023-12-08T08:23:00.300008+0000","last_became_peered":"2023-12-08T08:23:00.300008+0000","last_unstale":"2023-12-08T08:23:17.898638+0000","last_undegraded":"2023-12-08T08:23:17.898638+0000","last_fullsized":"2023-12-08T08:23:17.898638+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:39.385907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:18.914591+0000","last_change":"2023-12-08T08:23:17.919970+0000","last_active":"2023-12-08T08:23:18.914591+0000","last_peered":"2023-12-08T08:23:18.914591+0000","last_clean":"2023-12-08T08:23:18.914591+0000","last_became_active":"2023-12-08T08:23:17.919394+0000","last_became_peered":"2023-12-08T08:23:17.919394+0000","last_unstale":"2023-12-08T08:23:18.914591+0000","last_undegraded":"2023-12-08T08:23:18.914591+0000","last_fullsized":"2023-12-08T08:23:18.914591+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:22:56.949094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.901342+0000","last_change":"2023-12-08T08:23:00.299621+0000","last_active":"2023-12-08T08:23:17.901342+0000","last_peered":"2023-12-08T08:23:17.901342+0000","last_clean":"2023-12-08T08:23:17.901342+0000","last_became_active":"2023-12-08T08:23:00.299255+0000","last_became_peered":"2023-12-08T08:23:00.299255+0000","last_unstale":"2023-12-08T08:23:17.901342+0000","last_undegraded":"2023-12-08T08:23:17.901342+0000","last_fullsized":"2023-12-08T08:23:17.901342+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:28:46.845466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.288891+0000","last_change":"2023-12-08T08:23:17.934904+0000","last_active":"2023-12-08T08:23:19.288891+0000","last_peered":"2023-12-08T08:23:19.288891+0000","last_clean":"2023-12-08T08:23:19.288891+0000","last_became_active":"2023-12-08T08:23:17.934641+0000","last_became_peered":"2023-12-08T08:23:17.934641+0000","last_unstale":"2023-12-08T08:23:19.288891+0000","last_undegraded":"2023-12-08T08:23:19.288891+0000","last_fullsized":"2023-12-08T08:23:19.288891+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:49.038363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.924618+0000","last_change":"2023-12-08T08:23:00.296010+0000","last_active":"2023-12-08T08:23:17.924618+0000","last_peered":"2023-12-08T08:23:17.924618+0000","last_clean":"2023-12-08T08:23:17.924618+0000","last_became_active":"2023-12-08T08:23:00.295749+0000","last_became_peered":"2023-12-08T08:23:00.295749+0000","last_unstale":"2023-12-08T08:23:17.924618+0000","last_undegraded":"2023-12-08T08:23:17.924618+0000","last_fullsized":"2023-12-08T08:23:17.924618+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:39.385907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.629151+0000","last_change":"2023-12-08T08:23:17.919232+0000","last_active":"2023-12-08T08:23:19.629151+0000","last_peered":"2023-12-08T08:23:19.629151+0000","last_clean":"2023-12-08T08:23:19.629151+0000","last_became_active":"2023-12-08T08:23:17.914327+0000","last_became_peered":"2023-12-08T08:23:17.914327+0000","last_unstale":"2023-12-08T08:23:19.629151+0000","last_undegraded":"2023-12-08T08:23:19.629151+0000","last_fullsized":"2023-12-08T08:23:19.629151+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:05:30.565583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.899344+0000","last_change":"2023-12-08T08:23:00.301831+0000","last_active":"2023-12-08T08:23:17.899344+0000","last_peered":"2023-12-08T08:23:17.899344+0000","last_clean":"2023-12-08T08:23:17.899344+0000","last_became_active":"2023-12-08T08:23:00.301321+0000","last_became_peered":"2023-12-08T08:23:00.301321+0000","last_unstale":"2023-12-08T08:23:17.899344+0000","last_undegraded":"2023-12-08T08:23:17.899344+0000","last_fullsized":"2023-12-08T08:23:17.899344+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:14:54.964832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.287944+0000","last_change":"2023-12-08T08:23:17.917878+0000","last_active":"2023-12-08T08:23:19.287944+0000","last_peered":"2023-12-08T08:23:19.287944+0000","last_clean":"2023-12-08T08:23:19.287944+0000","last_became_active":"2023-12-08T08:23:17.917568+0000","last_became_peered":"2023-12-08T08:23:17.917568+0000","last_unstale":"2023-12-08T08:23:19.287944+0000","last_undegraded":"2023-12-08T08:23:19.287944+0000","last_fullsized":"2023-12-08T08:23:19.287944+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:03:47.802542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.898948+0000","last_change":"2023-12-08T08:23:00.301605+0000","last_active":"2023-12-08T08:23:17.898948+0000","last_peered":"2023-12-08T08:23:17.898948+0000","last_clean":"2023-12-08T08:23:17.898948+0000","last_became_active":"2023-12-08T08:23:00.301346+0000","last_became_peered":"2023-12-08T08:23:00.301346+0000","last_unstale":"2023-12-08T08:23:17.898948+0000","last_undegraded":"2023-12-08T08:23:17.898948+0000","last_fullsized":"2023-12-08T08:23:17.898948+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:35:35.139064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.284760+0000","last_change":"2023-12-08T08:23:17.924894+0000","last_active":"2023-12-08T08:23:19.284760+0000","last_peered":"2023-12-08T08:23:19.284760+0000","last_clean":"2023-12-08T08:23:19.284760+0000","last_became_active":"2023-12-08T08:23:17.924604+0000","last_became_peered":"2023-12-08T08:23:17.924604+0000","last_unstale":"2023-12-08T08:23:19.284760+0000","last_undegraded":"2023-12-08T08:23:19.284760+0000","last_fullsized":"2023-12-08T08:23:19.284760+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:05:22.733055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.894739+0000","last_change":"2023-12-08T08:23:00.301440+0000","last_active":"2023-12-08T08:23:17.894739+0000","last_peered":"2023-12-08T08:23:17.894739+0000","last_clean":"2023-12-08T08:23:17.894739+0000","last_became_active":"2023-12-08T08:23:00.301156+0000","last_became_peered":"2023-12-08T08:23:00.301156+0000","last_unstale":"2023-12-08T08:23:17.894739+0000","last_undegraded":"2023-12-08T08:23:17.894739+0000","last_fullsized":"2023-12-08T08:23:17.894739+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:04:21.562137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.291202+0000","last_change":"2023-12-08T08:23:17.913219+0000","last_active":"2023-12-08T08:23:19.291202+0000","last_peered":"2023-12-08T08:23:19.291202+0000","last_clean":"2023-12-08T08:23:19.291202+0000","last_became_active":"2023-12-08T08:23:17.912943+0000","last_became_peered":"2023-12-08T08:23:17.912943+0000","last_unstale":"2023-12-08T08:23:19.291202+0000","last_undegraded":"2023-12-08T08:23:19.291202+0000","last_fullsized":"2023-12-08T08:23:19.291202+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:35:33.645350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.902988+0000","last_change":"2023-12-08T08:23:00.301914+0000","last_active":"2023-12-08T08:23:17.902988+0000","last_peered":"2023-12-08T08:23:17.902988+0000","last_clean":"2023-12-08T08:23:17.902988+0000","last_became_active":"2023-12-08T08:23:00.301688+0000","last_became_peered":"2023-12-08T08:23:00.301688+0000","last_unstale":"2023-12-08T08:23:17.902988+0000","last_undegraded":"2023-12-08T08:23:17.902988+0000","last_fullsized":"2023-12-08T08:23:17.902988+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:27:39.303886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.288012+0000","last_change":"2023-12-08T08:23:17.927654+0000","last_active":"2023-12-08T08:23:19.288012+0000","last_peered":"2023-12-08T08:23:19.288012+0000","last_clean":"2023-12-08T08:23:19.288012+0000","last_became_active":"2023-12-08T08:23:17.918201+0000","last_became_peered":"2023-12-08T08:23:17.918201+0000","last_unstale":"2023-12-08T08:23:19.288012+0000","last_undegraded":"2023-12-08T08:23:19.288012+0000","last_fullsized":"2023-12-08T08:23:19.288012+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:32:05.212770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.900424+0000","last_change":"2023-12-08T08:23:00.298664+0000","last_active":"2023-12-08T08:23:17.900424+0000","last_peered":"2023-12-08T08:23:17.900424+0000","last_clean":"2023-12-08T08:23:17.900424+0000","last_became_active":"2023-12-08T08:23:00.298341+0000","last_became_peered":"2023-12-08T08:23:00.298341+0000","last_unstale":"2023-12-08T08:23:17.900424+0000","last_undegraded":"2023-12-08T08:23:17.900424+0000","last_fullsized":"2023-12-08T08:23:17.900424+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:20:20.944416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.285337+0000","last_change":"2023-12-08T08:23:17.917962+0000","last_active":"2023-12-08T08:23:19.285337+0000","last_peered":"2023-12-08T08:23:19.285337+0000","last_clean":"2023-12-08T08:23:19.285337+0000","last_became_active":"2023-12-08T08:23:17.917633+0000","last_became_peered":"2023-12-08T08:23:17.917633+0000","last_unstale":"2023-12-08T08:23:19.285337+0000","last_undegraded":"2023-12-08T08:23:19.285337+0000","last_fullsized":"2023-12-08T08:23:19.285337+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:05:30.565583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.897854+0000","last_change":"2023-12-08T08:23:00.280235+0000","last_active":"2023-12-08T08:23:17.897854+0000","last_peered":"2023-12-08T08:23:17.897854+0000","last_clean":"2023-12-08T08:23:17.897854+0000","last_became_active":"2023-12-08T08:23:00.278807+0000","last_became_peered":"2023-12-08T08:23:00.278807+0000","last_unstale":"2023-12-08T08:23:17.897854+0000","last_undegraded":"2023-12-08T08:23:17.897854+0000","last_fullsized":"2023-12-08T08:23:17.897854+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:30:44.391621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.103209+0000","last_change":"2023-12-08T08:23:17.935264+0000","last_active":"2023-12-08T08:23:19.103209+0000","last_peered":"2023-12-08T08:23:19.103209+0000","last_clean":"2023-12-08T08:23:19.103209+0000","last_became_active":"2023-12-08T08:23:17.935016+0000","last_became_peered":"2023-12-08T08:23:17.935016+0000","last_unstale":"2023-12-08T08:23:19.103209+0000","last_undegraded":"2023-12-08T08:23:19.103209+0000","last_fullsized":"2023-12-08T08:23:19.103209+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:36:02.599520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.908582+0000","last_change":"2023-12-08T08:23:00.278532+0000","last_active":"2023-12-08T08:23:17.908582+0000","last_peered":"2023-12-08T08:23:17.908582+0000","last_clean":"2023-12-08T08:23:17.908582+0000","last_became_active":"2023-12-08T08:23:00.278177+0000","last_became_peered":"2023-12-08T08:23:00.278177+0000","last_unstale":"2023-12-08T08:23:17.908582+0000","last_undegraded":"2023-12-08T08:23:17.908582+0000","last_fullsized":"2023-12-08T08:23:17.908582+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:56.216551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.103461+0000","last_change":"2023-12-08T08:23:17.940689+0000","last_active":"2023-12-08T08:23:19.103461+0000","last_peered":"2023-12-08T08:23:19.103461+0000","last_clean":"2023-12-08T08:23:19.103461+0000","last_became_active":"2023-12-08T08:23:17.940379+0000","last_became_peered":"2023-12-08T08:23:17.940379+0000","last_unstale":"2023-12-08T08:23:19.103461+0000","last_undegraded":"2023-12-08T08:23:19.103461+0000","last_fullsized":"2023-12-08T08:23:19.103461+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:52:55.911821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.898164+0000","last_change":"2023-12-08T08:23:00.284090+0000","last_active":"2023-12-08T08:23:17.898164+0000","last_peered":"2023-12-08T08:23:17.898164+0000","last_clean":"2023-12-08T08:23:17.898164+0000","last_became_active":"2023-12-08T08:23:00.283777+0000","last_became_peered":"2023-12-08T08:23:00.283777+0000","last_unstale":"2023-12-08T08:23:17.898164+0000","last_undegraded":"2023-12-08T08:23:17.898164+0000","last_fullsized":"2023-12-08T08:23:17.898164+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.288902+0000","last_change":"2023-12-08T08:23:17.933326+0000","last_active":"2023-12-08T08:23:19.288902+0000","last_peered":"2023-12-08T08:23:19.288902+0000","last_clean":"2023-12-08T08:23:19.288902+0000","last_became_active":"2023-12-08T08:23:17.933046+0000","last_became_peered":"2023-12-08T08:23:17.933046+0000","last_unstale":"2023-12-08T08:23:19.288902+0000","last_undegraded":"2023-12-08T08:23:19.288902+0000","last_fullsized":"2023-12-08T08:23:19.288902+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:42:46.583928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.917192+0000","last_change":"2023-12-08T08:23:00.277149+0000","last_active":"2023-12-08T08:23:17.917192+0000","last_peered":"2023-12-08T08:23:17.917192+0000","last_clean":"2023-12-08T08:23:17.917192+0000","last_became_active":"2023-12-08T08:23:00.276879+0000","last_became_peered":"2023-12-08T08:23:00.276879+0000","last_unstale":"2023-12-08T08:23:17.917192+0000","last_undegraded":"2023-12-08T08:23:17.917192+0000","last_fullsized":"2023-12-08T08:23:17.917192+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:16.068318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.628834+0000","last_change":"2023-12-08T08:23:17.924164+0000","last_active":"2023-12-08T08:23:19.628834+0000","last_peered":"2023-12-08T08:23:19.628834+0000","last_clean":"2023-12-08T08:23:19.628834+0000","last_became_active":"2023-12-08T08:23:17.923865+0000","last_became_peered":"2023-12-08T08:23:17.923865+0000","last_unstale":"2023-12-08T08:23:19.628834+0000","last_undegraded":"2023-12-08T08:23:19.628834+0000","last_fullsized":"2023-12-08T08:23:19.628834+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:42:52.884648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.894997+0000","last_change":"2023-12-08T08:23:00.294726+0000","last_active":"2023-12-08T08:23:17.894997+0000","last_peered":"2023-12-08T08:23:17.894997+0000","last_clean":"2023-12-08T08:23:17.894997+0000","last_became_active":"2023-12-08T08:23:00.294450+0000","last_became_peered":"2023-12-08T08:23:00.294450+0000","last_unstale":"2023-12-08T08:23:17.894997+0000","last_undegraded":"2023-12-08T08:23:17.894997+0000","last_fullsized":"2023-12-08T08:23:17.894997+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:28:25.934029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:18.912511+0000","last_change":"2023-12-08T08:23:17.937115+0000","last_active":"2023-12-08T08:23:18.912511+0000","last_peered":"2023-12-08T08:23:18.912511+0000","last_clean":"2023-12-08T08:23:18.912511+0000","last_became_active":"2023-12-08T08:23:17.936607+0000","last_became_peered":"2023-12-08T08:23:17.936607+0000","last_unstale":"2023-12-08T08:23:18.912511+0000","last_undegraded":"2023-12-08T08:23:18.912511+0000","last_fullsized":"2023-12-08T08:23:18.912511+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:29:20.657599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.894829+0000","last_change":"2023-12-08T08:23:00.288804+0000","last_active":"2023-12-08T08:23:17.894829+0000","last_peered":"2023-12-08T08:23:17.894829+0000","last_clean":"2023-12-08T08:23:17.894829+0000","last_became_active":"2023-12-08T08:23:00.288315+0000","last_became_peered":"2023-12-08T08:23:00.288315+0000","last_unstale":"2023-12-08T08:23:17.894829+0000","last_undegraded":"2023-12-08T08:23:17.894829+0000","last_fullsized":"2023-12-08T08:23:17.894829+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:23:06.925359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.288361+0000","last_change":"2023-12-08T08:23:17.934513+0000","last_active":"2023-12-08T08:23:19.288361+0000","last_peered":"2023-12-08T08:23:19.288361+0000","last_clean":"2023-12-08T08:23:19.288361+0000","last_became_active":"2023-12-08T08:23:17.934294+0000","last_became_peered":"2023-12-08T08:23:17.934294+0000","last_unstale":"2023-12-08T08:23:19.288361+0000","last_undegraded":"2023-12-08T08:23:19.288361+0000","last_fullsized":"2023-12-08T08:23:19.288361+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:19:40.302449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.897506+0000","last_change":"2023-12-08T08:23:00.294482+0000","last_active":"2023-12-08T08:23:17.897506+0000","last_peered":"2023-12-08T08:23:17.897506+0000","last_clean":"2023-12-08T08:23:17.897506+0000","last_became_active":"2023-12-08T08:23:00.294057+0000","last_became_peered":"2023-12-08T08:23:00.294057+0000","last_unstale":"2023-12-08T08:23:17.897506+0000","last_undegraded":"2023-12-08T08:23:17.897506+0000","last_fullsized":"2023-12-08T08:23:17.897506+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:42:20.038693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.291573+0000","last_change":"2023-12-08T08:23:17.911480+0000","last_active":"2023-12-08T08:23:19.291573+0000","last_peered":"2023-12-08T08:23:19.291573+0000","last_clean":"2023-12-08T08:23:19.291573+0000","last_became_active":"2023-12-08T08:23:17.911223+0000","last_became_peered":"2023-12-08T08:23:17.911223+0000","last_unstale":"2023-12-08T08:23:19.291573+0000","last_undegraded":"2023-12-08T08:23:19.291573+0000","last_fullsized":"2023-12-08T08:23:19.291573+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:27:56.941125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.901040+0000","last_change":"2023-12-08T08:23:00.272949+0000","last_active":"2023-12-08T08:23:17.901040+0000","last_peered":"2023-12-08T08:23:17.901040+0000","last_clean":"2023-12-08T08:23:17.901040+0000","last_became_active":"2023-12-08T08:23:00.272655+0000","last_became_peered":"2023-12-08T08:23:00.272655+0000","last_unstale":"2023-12-08T08:23:17.901040+0000","last_undegraded":"2023-12-08T08:23:17.901040+0000","last_fullsized":"2023-12-08T08:23:17.901040+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:28.275394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:18.913459+0000","last_change":"2023-12-08T08:23:17.907410+0000","last_active":"2023-12-08T08:23:18.913459+0000","last_peered":"2023-12-08T08:23:18.913459+0000","last_clean":"2023-12-08T08:23:18.913459+0000","last_became_active":"2023-12-08T08:23:17.906571+0000","last_became_peered":"2023-12-08T08:23:17.906571+0000","last_unstale":"2023-12-08T08:23:18.913459+0000","last_undegraded":"2023-12-08T08:23:18.913459+0000","last_fullsized":"2023-12-08T08:23:18.913459+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:13:13.853790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.939820+0000","last_change":"2023-12-08T08:23:16.917024+0000","last_active":"2023-12-08T08:23:17.939820+0000","last_peered":"2023-12-08T08:23:17.939820+0000","last_clean":"2023-12-08T08:23:17.939820+0000","last_became_active":"2023-12-08T08:23:16.916776+0000","last_became_peered":"2023-12-08T08:23:16.916776+0000","last_unstale":"2023-12-08T08:23:17.939820+0000","last_undegraded":"2023-12-08T08:23:17.939820+0000","last_fullsized":"2023-12-08T08:23:17.939820+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:05:21.725124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.898348+0000","last_change":"2023-12-08T08:23:00.273779+0000","last_active":"2023-12-08T08:23:17.898348+0000","last_peered":"2023-12-08T08:23:17.898348+0000","last_clean":"2023-12-08T08:23:17.898348+0000","last_became_active":"2023-12-08T08:23:00.273256+0000","last_became_peered":"2023-12-08T08:23:00.273256+0000","last_unstale":"2023-12-08T08:23:17.898348+0000","last_undegraded":"2023-12-08T08:23:17.898348+0000","last_fullsized":"2023-12-08T08:23:17.898348+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"67'4","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.905102+0000","last_change":"2023-12-08T08:22:59.285668+0000","last_active":"2023-12-08T08:23:17.905102+0000","last_peered":"2023-12-08T08:23:17.905102+0000","last_clean":"2023-12-08T08:23:17.905102+0000","last_became_active":"2023-12-08T08:22:59.285340+0000","last_became_peered":"2023-12-08T08:22:59.285340+0000","last_unstale":"2023-12-08T08:23:17.905102+0000","last_undegraded":"2023-12-08T08:23:17.905102+0000","last_fullsized":"2023-12-08T08:23:17.905102+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:35:15.000491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:18.914592+0000","last_change":"2023-12-08T08:23:17.908523+0000","last_active":"2023-12-08T08:23:18.914592+0000","last_peered":"2023-12-08T08:23:18.914592+0000","last_clean":"2023-12-08T08:23:18.914592+0000","last_became_active":"2023-12-08T08:23:17.908212+0000","last_became_peered":"2023-12-08T08:23:17.908212+0000","last_unstale":"2023-12-08T08:23:18.914592+0000","last_undegraded":"2023-12-08T08:23:18.914592+0000","last_fullsized":"2023-12-08T08:23:18.914592+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:44:21.257367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.940037+0000","last_change":"2023-12-08T08:23:16.905712+0000","last_active":"2023-12-08T08:23:17.940037+0000","last_peered":"2023-12-08T08:23:17.940037+0000","last_clean":"2023-12-08T08:23:17.940037+0000","last_became_active":"2023-12-08T08:23:16.905399+0000","last_became_peered":"2023-12-08T08:23:16.905399+0000","last_unstale":"2023-12-08T08:23:17.940037+0000","last_undegraded":"2023-12-08T08:23:17.940037+0000","last_fullsized":"2023-12-08T08:23:17.940037+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:38:15.539890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.904884+0000","last_change":"2023-12-08T08:23:00.300874+0000","last_active":"2023-12-08T08:23:17.904884+0000","last_peered":"2023-12-08T08:23:17.904884+0000","last_clean":"2023-12-08T08:23:17.904884+0000","last_became_active":"2023-12-08T08:23:00.300595+0000","last_became_peered":"2023-12-08T08:23:00.300595+0000","last_unstale":"2023-12-08T08:23:17.904884+0000","last_undegraded":"2023-12-08T08:23:17.904884+0000","last_fullsized":"2023-12-08T08:23:17.904884+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"67'1","reported_seq":17,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.898538+0000","last_change":"2023-12-08T08:22:59.274595+0000","last_active":"2023-12-08T08:23:17.898538+0000","last_peered":"2023-12-08T08:23:17.898538+0000","last_clean":"2023-12-08T08:23:17.898538+0000","last_became_active":"2023-12-08T08:22:59.274280+0000","last_became_peered":"2023-12-08T08:22:59.274280+0000","last_unstale":"2023-12-08T08:23:17.898538+0000","last_undegraded":"2023-12-08T08:23:17.898538+0000","last_fullsized":"2023-12-08T08:23:17.898538+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:27.267774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.291635+0000","last_change":"2023-12-08T08:23:17.911919+0000","last_active":"2023-12-08T08:23:19.291635+0000","last_peered":"2023-12-08T08:23:19.291635+0000","last_clean":"2023-12-08T08:23:19.291635+0000","last_became_active":"2023-12-08T08:23:17.911492+0000","last_became_peered":"2023-12-08T08:23:17.911492+0000","last_unstale":"2023-12-08T08:23:19.291635+0000","last_undegraded":"2023-12-08T08:23:19.291635+0000","last_fullsized":"2023-12-08T08:23:19.291635+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:55:54.027660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"71'4","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.940515+0000","last_change":"2023-12-08T08:23:16.915200+0000","last_active":"2023-12-08T08:23:17.940515+0000","last_peered":"2023-12-08T08:23:17.940515+0000","last_clean":"2023-12-08T08:23:17.940515+0000","last_became_active":"2023-12-08T08:23:16.914766+0000","last_became_peered":"2023-12-08T08:23:16.914766+0000","last_unstale":"2023-12-08T08:23:17.940515+0000","last_undegraded":"2023-12-08T08:23:17.940515+0000","last_fullsized":"2023-12-08T08:23:17.940515+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:36:30.850119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.917280+0000","last_change":"2023-12-08T08:23:00.280594+0000","last_active":"2023-12-08T08:23:17.917280+0000","last_peered":"2023-12-08T08:23:17.917280+0000","last_clean":"2023-12-08T08:23:17.917280+0000","last_became_active":"2023-12-08T08:23:00.279794+0000","last_became_peered":"2023-12-08T08:23:00.279794+0000","last_unstale":"2023-12-08T08:23:17.917280+0000","last_undegraded":"2023-12-08T08:23:17.917280+0000","last_fullsized":"2023-12-08T08:23:17.917280+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:33.905575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"67'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.924698+0000","last_change":"2023-12-08T08:22:59.282892+0000","last_active":"2023-12-08T08:23:17.924698+0000","last_peered":"2023-12-08T08:23:17.924698+0000","last_clean":"2023-12-08T08:23:17.924698+0000","last_became_active":"2023-12-08T08:22:59.282172+0000","last_became_peered":"2023-12-08T08:22:59.282172+0000","last_unstale":"2023-12-08T08:23:17.924698+0000","last_undegraded":"2023-12-08T08:23:17.924698+0000","last_fullsized":"2023-12-08T08:23:17.924698+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:32.890517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.629275+0000","last_change":"2023-12-08T08:23:17.927478+0000","last_active":"2023-12-08T08:23:19.629275+0000","last_peered":"2023-12-08T08:23:19.629275+0000","last_clean":"2023-12-08T08:23:19.629275+0000","last_became_active":"2023-12-08T08:23:17.925675+0000","last_became_peered":"2023-12-08T08:23:17.925675+0000","last_unstale":"2023-12-08T08:23:19.629275+0000","last_undegraded":"2023-12-08T08:23:19.629275+0000","last_fullsized":"2023-12-08T08:23:19.629275+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:38:16.547821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.926473+0000","last_change":"2023-12-08T08:23:16.917813+0000","last_active":"2023-12-08T08:23:17.926473+0000","last_peered":"2023-12-08T08:23:17.926473+0000","last_clean":"2023-12-08T08:23:17.926473+0000","last_became_active":"2023-12-08T08:23:16.917358+0000","last_became_peered":"2023-12-08T08:23:16.917358+0000","last_unstale":"2023-12-08T08:23:17.926473+0000","last_undegraded":"2023-12-08T08:23:17.926473+0000","last_fullsized":"2023-12-08T08:23:17.926473+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:14:23.904816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.910010+0000","last_change":"2023-12-08T08:23:00.304580+0000","last_active":"2023-12-08T08:23:17.910010+0000","last_peered":"2023-12-08T08:23:17.910010+0000","last_clean":"2023-12-08T08:23:17.910010+0000","last_became_active":"2023-12-08T08:23:00.304098+0000","last_became_peered":"2023-12-08T08:23:00.304098+0000","last_unstale":"2023-12-08T08:23:17.910010+0000","last_undegraded":"2023-12-08T08:23:17.910010+0000","last_fullsized":"2023-12-08T08:23:17.910010+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:29:03.020360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"67'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.926327+0000","last_change":"2023-12-08T08:22:59.283290+0000","last_active":"2023-12-08T08:23:17.926327+0000","last_peered":"2023-12-08T08:23:17.926327+0000","last_clean":"2023-12-08T08:23:17.926327+0000","last_became_active":"2023-12-08T08:22:59.282103+0000","last_became_peered":"2023-12-08T08:22:59.282103+0000","last_unstale":"2023-12-08T08:23:17.926327+0000","last_undegraded":"2023-12-08T08:23:17.926327+0000","last_fullsized":"2023-12-08T08:23:17.926327+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:15.256488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.628508+0000","last_change":"2023-12-08T08:23:17.927601+0000","last_active":"2023-12-08T08:23:19.628508+0000","last_peered":"2023-12-08T08:23:19.628508+0000","last_clean":"2023-12-08T08:23:19.628508+0000","last_became_active":"2023-12-08T08:23:17.925671+0000","last_became_peered":"2023-12-08T08:23:17.925671+0000","last_unstale":"2023-12-08T08:23:19.628508+0000","last_undegraded":"2023-12-08T08:23:19.628508+0000","last_fullsized":"2023-12-08T08:23:19.628508+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:36:02.599520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.902895+0000","last_change":"2023-12-08T08:23:16.916123+0000","last_active":"2023-12-08T08:23:17.902895+0000","last_peered":"2023-12-08T08:23:17.902895+0000","last_clean":"2023-12-08T08:23:17.902895+0000","last_became_active":"2023-12-08T08:23:16.915147+0000","last_became_peered":"2023-12-08T08:23:16.915147+0000","last_unstale":"2023-12-08T08:23:17.902895+0000","last_undegraded":"2023-12-08T08:23:17.902895+0000","last_fullsized":"2023-12-08T08:23:17.902895+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:18:49.227732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.894911+0000","last_change":"2023-12-08T08:23:00.288605+0000","last_active":"2023-12-08T08:23:17.894911+0000","last_peered":"2023-12-08T08:23:17.894911+0000","last_clean":"2023-12-08T08:23:17.894911+0000","last_became_active":"2023-12-08T08:23:00.287910+0000","last_became_peered":"2023-12-08T08:23:00.287910+0000","last_unstale":"2023-12-08T08:23:17.894911+0000","last_undegraded":"2023-12-08T08:23:17.894911+0000","last_fullsized":"2023-12-08T08:23:17.894911+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:55.193260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"67'1","reported_seq":17,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.898568+0000","last_change":"2023-12-08T08:22:59.267027+0000","last_active":"2023-12-08T08:23:17.898568+0000","last_peered":"2023-12-08T08:23:17.898568+0000","last_clean":"2023-12-08T08:23:17.898568+0000","last_became_active":"2023-12-08T08:22:59.265676+0000","last_became_peered":"2023-12-08T08:22:59.265676+0000","last_unstale":"2023-12-08T08:23:17.898568+0000","last_undegraded":"2023-12-08T08:23:17.898568+0000","last_fullsized":"2023-12-08T08:23:17.898568+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:19.279362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:18.913902+0000","last_change":"2023-12-08T08:23:17.908679+0000","last_active":"2023-12-08T08:23:18.913902+0000","last_peered":"2023-12-08T08:23:18.913902+0000","last_clean":"2023-12-08T08:23:18.913902+0000","last_became_active":"2023-12-08T08:23:17.908359+0000","last_became_peered":"2023-12-08T08:23:17.908359+0000","last_unstale":"2023-12-08T08:23:18.913902+0000","last_undegraded":"2023-12-08T08:23:18.913902+0000","last_fullsized":"2023-12-08T08:23:18.913902+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:02:17.072723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.894529+0000","last_change":"2023-12-08T08:23:16.918070+0000","last_active":"2023-12-08T08:23:17.894529+0000","last_peered":"2023-12-08T08:23:17.894529+0000","last_clean":"2023-12-08T08:23:17.894529+0000","last_became_active":"2023-12-08T08:23:16.917808+0000","last_became_peered":"2023-12-08T08:23:16.917808+0000","last_unstale":"2023-12-08T08:23:17.894529+0000","last_undegraded":"2023-12-08T08:23:17.894529+0000","last_fullsized":"2023-12-08T08:23:17.894529+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:55:53.019729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.898225+0000","last_change":"2023-12-08T08:23:00.300280+0000","last_active":"2023-12-08T08:23:17.898225+0000","last_peered":"2023-12-08T08:23:17.898225+0000","last_clean":"2023-12-08T08:23:17.898225+0000","last_became_active":"2023-12-08T08:23:00.299998+0000","last_became_peered":"2023-12-08T08:23:00.299998+0000","last_unstale":"2023-12-08T08:23:17.898225+0000","last_undegraded":"2023-12-08T08:23:17.898225+0000","last_fullsized":"2023-12-08T08:23:17.898225+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:15.472021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"67'1","reported_seq":17,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.898638+0000","last_change":"2023-12-08T08:22:59.274800+0000","last_active":"2023-12-08T08:23:17.898638+0000","last_peered":"2023-12-08T08:23:17.898638+0000","last_clean":"2023-12-08T08:23:17.898638+0000","last_became_active":"2023-12-08T08:22:59.274501+0000","last_became_peered":"2023-12-08T08:22:59.274501+0000","last_unstale":"2023-12-08T08:23:17.898638+0000","last_undegraded":"2023-12-08T08:23:17.898638+0000","last_fullsized":"2023-12-08T08:23:17.898638+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:54.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.787209+0000","last_change":"2023-12-08T08:23:17.919809+0000","last_active":"2023-12-08T08:23:19.787209+0000","last_peered":"2023-12-08T08:23:19.787209+0000","last_clean":"2023-12-08T08:23:19.787209+0000","last_became_active":"2023-12-08T08:23:17.919523+0000","last_became_peered":"2023-12-08T08:23:17.919523+0000","last_unstale":"2023-12-08T08:23:19.787209+0000","last_undegraded":"2023-12-08T08:23:19.787209+0000","last_fullsized":"2023-12-08T08:23:19.787209+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:10:24.013464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.926522+0000","last_change":"2023-12-08T08:23:16.915536+0000","last_active":"2023-12-08T08:23:17.926522+0000","last_peered":"2023-12-08T08:23:17.926522+0000","last_clean":"2023-12-08T08:23:17.926522+0000","last_became_active":"2023-12-08T08:23:16.915216+0000","last_became_peered":"2023-12-08T08:23:16.915216+0000","last_unstale":"2023-12-08T08:23:17.926522+0000","last_undegraded":"2023-12-08T08:23:17.926522+0000","last_fullsized":"2023-12-08T08:23:17.926522+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:27:55.933194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.904902+0000","last_change":"2023-12-08T08:23:00.298811+0000","last_active":"2023-12-08T08:23:17.904902+0000","last_peered":"2023-12-08T08:23:17.904902+0000","last_clean":"2023-12-08T08:23:17.904902+0000","last_became_active":"2023-12-08T08:23:00.298524+0000","last_became_peered":"2023-12-08T08:23:00.298524+0000","last_unstale":"2023-12-08T08:23:17.904902+0000","last_undegraded":"2023-12-08T08:23:17.904902+0000","last_fullsized":"2023-12-08T08:23:17.904902+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.917229+0000","last_change":"2023-12-08T08:22:59.274339+0000","last_active":"2023-12-08T08:23:17.917229+0000","last_peered":"2023-12-08T08:23:17.917229+0000","last_clean":"2023-12-08T08:23:17.917229+0000","last_became_active":"2023-12-08T08:22:59.272932+0000","last_became_peered":"2023-12-08T08:22:59.272932+0000","last_unstale":"2023-12-08T08:23:17.917229+0000","last_undegraded":"2023-12-08T08:23:17.917229+0000","last_fullsized":"2023-12-08T08:23:17.917229+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:27:14.464401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.284781+0000","last_change":"2023-12-08T08:23:17.924983+0000","last_active":"2023-12-08T08:23:19.284781+0000","last_peered":"2023-12-08T08:23:19.284781+0000","last_clean":"2023-12-08T08:23:19.284781+0000","last_became_active":"2023-12-08T08:23:17.924290+0000","last_became_peered":"2023-12-08T08:23:17.924290+0000","last_unstale":"2023-12-08T08:23:19.284781+0000","last_undegraded":"2023-12-08T08:23:19.284781+0000","last_fullsized":"2023-12-08T08:23:19.284781+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:52:55.911821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.939918+0000","last_change":"2023-12-08T08:23:16.907865+0000","last_active":"2023-12-08T08:23:17.939918+0000","last_peered":"2023-12-08T08:23:17.939918+0000","last_clean":"2023-12-08T08:23:17.939918+0000","last_became_active":"2023-12-08T08:23:16.907610+0000","last_became_peered":"2023-12-08T08:23:16.907610+0000","last_unstale":"2023-12-08T08:23:17.939918+0000","last_undegraded":"2023-12-08T08:23:17.939918+0000","last_fullsized":"2023-12-08T08:23:17.939918+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:04:22.020960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.909799+0000","last_change":"2023-12-08T08:23:00.292745+0000","last_active":"2023-12-08T08:23:17.909799+0000","last_peered":"2023-12-08T08:23:17.909799+0000","last_clean":"2023-12-08T08:23:17.909799+0000","last_became_active":"2023-12-08T08:23:00.292132+0000","last_became_peered":"2023-12-08T08:23:00.292132+0000","last_unstale":"2023-12-08T08:23:17.909799+0000","last_undegraded":"2023-12-08T08:23:17.909799+0000","last_fullsized":"2023-12-08T08:23:17.909799+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:13.139346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.895061+0000","last_change":"2023-12-08T08:22:59.268769+0000","last_active":"2023-12-08T08:23:17.895061+0000","last_peered":"2023-12-08T08:23:17.895061+0000","last_clean":"2023-12-08T08:23:17.895061+0000","last_became_active":"2023-12-08T08:22:59.268494+0000","last_became_peered":"2023-12-08T08:22:59.268494+0000","last_unstale":"2023-12-08T08:23:17.895061+0000","last_undegraded":"2023-12-08T08:23:17.895061+0000","last_fullsized":"2023-12-08T08:23:17.895061+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:56:23.131251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.102803+0000","last_change":"2023-12-08T08:23:17.940964+0000","last_active":"2023-12-08T08:23:19.102803+0000","last_peered":"2023-12-08T08:23:19.102803+0000","last_clean":"2023-12-08T08:23:19.102803+0000","last_became_active":"2023-12-08T08:23:17.940683+0000","last_became_peered":"2023-12-08T08:23:17.940683+0000","last_unstale":"2023-12-08T08:23:19.102803+0000","last_undegraded":"2023-12-08T08:23:19.102803+0000","last_fullsized":"2023-12-08T08:23:19.102803+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:22:56.949094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"71'3","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.931819+0000","last_change":"2023-12-08T08:23:16.918296+0000","last_active":"2023-12-08T08:23:17.931819+0000","last_peered":"2023-12-08T08:23:17.931819+0000","last_clean":"2023-12-08T08:23:17.931819+0000","last_became_active":"2023-12-08T08:23:16.917917+0000","last_became_peered":"2023-12-08T08:23:16.917917+0000","last_unstale":"2023-12-08T08:23:17.931819+0000","last_undegraded":"2023-12-08T08:23:17.931819+0000","last_fullsized":"2023-12-08T08:23:17.931819+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:38:00.928084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.904807+0000","last_change":"2023-12-08T08:23:00.275783+0000","last_active":"2023-12-08T08:23:17.904807+0000","last_peered":"2023-12-08T08:23:17.904807+0000","last_clean":"2023-12-08T08:23:17.904807+0000","last_became_active":"2023-12-08T08:23:00.275444+0000","last_became_peered":"2023-12-08T08:23:00.275444+0000","last_unstale":"2023-12-08T08:23:17.904807+0000","last_undegraded":"2023-12-08T08:23:17.904807+0000","last_fullsized":"2023-12-08T08:23:17.904807+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:56:00.436152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.905215+0000","last_change":"2023-12-08T08:22:59.280443+0000","last_active":"2023-12-08T08:23:17.905215+0000","last_peered":"2023-12-08T08:23:17.905215+0000","last_clean":"2023-12-08T08:23:17.905215+0000","last_became_active":"2023-12-08T08:22:59.280138+0000","last_became_peered":"2023-12-08T08:22:59.280138+0000","last_unstale":"2023-12-08T08:23:17.905215+0000","last_undegraded":"2023-12-08T08:23:17.905215+0000","last_fullsized":"2023-12-08T08:23:17.905215+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:13:21.524504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.285010+0000","last_change":"2023-12-08T08:23:17.936822+0000","last_active":"2023-12-08T08:23:19.285010+0000","last_peered":"2023-12-08T08:23:19.285010+0000","last_clean":"2023-12-08T08:23:19.285010+0000","last_became_active":"2023-12-08T08:23:17.936498+0000","last_became_peered":"2023-12-08T08:23:17.936498+0000","last_unstale":"2023-12-08T08:23:19.285010+0000","last_undegraded":"2023-12-08T08:23:19.285010+0000","last_fullsized":"2023-12-08T08:23:19.285010+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:50:42.741724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"71'6","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.940129+0000","last_change":"2023-12-08T08:23:16.913111+0000","last_active":"2023-12-08T08:23:17.940129+0000","last_peered":"2023-12-08T08:23:17.940129+0000","last_clean":"2023-12-08T08:23:17.940129+0000","last_became_active":"2023-12-08T08:23:16.912617+0000","last_became_peered":"2023-12-08T08:23:16.912617+0000","last_unstale":"2023-12-08T08:23:17.940129+0000","last_undegraded":"2023-12-08T08:23:17.940129+0000","last_fullsized":"2023-12-08T08:23:17.940129+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:59:41.402920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.907481+0000","last_change":"2023-12-08T08:23:00.304825+0000","last_active":"2023-12-08T08:23:17.907481+0000","last_peered":"2023-12-08T08:23:17.907481+0000","last_clean":"2023-12-08T08:23:17.907481+0000","last_became_active":"2023-12-08T08:23:00.304549+0000","last_became_peered":"2023-12-08T08:23:00.304549+0000","last_unstale":"2023-12-08T08:23:17.907481+0000","last_undegraded":"2023-12-08T08:23:17.907481+0000","last_fullsized":"2023-12-08T08:23:17.907481+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.912409+0000","last_change":"2023-12-08T08:22:59.283795+0000","last_active":"2023-12-08T08:23:17.912409+0000","last_peered":"2023-12-08T08:23:17.912409+0000","last_clean":"2023-12-08T08:23:17.912409+0000","last_became_active":"2023-12-08T08:22:59.283486+0000","last_became_peered":"2023-12-08T08:22:59.283486+0000","last_unstale":"2023-12-08T08:23:17.912409+0000","last_undegraded":"2023-12-08T08:23:17.912409+0000","last_fullsized":"2023-12-08T08:23:17.912409+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:30:43.384001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.288656+0000","last_change":"2023-12-08T08:23:17.935581+0000","last_active":"2023-12-08T08:23:19.288656+0000","last_peered":"2023-12-08T08:23:19.288656+0000","last_clean":"2023-12-08T08:23:19.288656+0000","last_became_active":"2023-12-08T08:23:17.935156+0000","last_became_peered":"2023-12-08T08:23:17.935156+0000","last_unstale":"2023-12-08T08:23:19.288656+0000","last_undegraded":"2023-12-08T08:23:19.288656+0000","last_fullsized":"2023-12-08T08:23:19.288656+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:57:10.038249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.897759+0000","last_change":"2023-12-08T08:23:16.913609+0000","last_active":"2023-12-08T08:23:17.897759+0000","last_peered":"2023-12-08T08:23:17.897759+0000","last_clean":"2023-12-08T08:23:17.897759+0000","last_became_active":"2023-12-08T08:23:16.913308+0000","last_became_peered":"2023-12-08T08:23:16.913308+0000","last_unstale":"2023-12-08T08:23:17.897759+0000","last_undegraded":"2023-12-08T08:23:17.897759+0000","last_fullsized":"2023-12-08T08:23:17.897759+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:21.523438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.926254+0000","last_change":"2023-12-08T08:23:00.293145+0000","last_active":"2023-12-08T08:23:17.926254+0000","last_peered":"2023-12-08T08:23:17.926254+0000","last_clean":"2023-12-08T08:23:17.926254+0000","last_became_active":"2023-12-08T08:23:00.292927+0000","last_became_peered":"2023-12-08T08:23:00.292927+0000","last_unstale":"2023-12-08T08:23:17.926254+0000","last_undegraded":"2023-12-08T08:23:17.926254+0000","last_fullsized":"2023-12-08T08:23:17.926254+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:56.216551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"67'3","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.906632+0000","last_change":"2023-12-08T08:22:59.281141+0000","last_active":"2023-12-08T08:23:17.906632+0000","last_peered":"2023-12-08T08:23:17.906632+0000","last_clean":"2023-12-08T08:23:17.906632+0000","last_became_active":"2023-12-08T08:22:59.280748+0000","last_became_peered":"2023-12-08T08:22:59.280748+0000","last_unstale":"2023-12-08T08:23:17.906632+0000","last_undegraded":"2023-12-08T08:23:17.906632+0000","last_fullsized":"2023-12-08T08:23:17.906632+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:07:33.922762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:18.915376+0000","last_change":"2023-12-08T08:23:17.916405+0000","last_active":"2023-12-08T08:23:18.915376+0000","last_peered":"2023-12-08T08:23:18.915376+0000","last_clean":"2023-12-08T08:23:18.915376+0000","last_became_active":"2023-12-08T08:23:17.912809+0000","last_became_peered":"2023-12-08T08:23:17.912809+0000","last_unstale":"2023-12-08T08:23:18.915376+0000","last_undegraded":"2023-12-08T08:23:18.915376+0000","last_fullsized":"2023-12-08T08:23:18.915376+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:52:55.911821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.904716+0000","last_change":"2023-12-08T08:23:16.921554+0000","last_active":"2023-12-08T08:23:17.904716+0000","last_peered":"2023-12-08T08:23:17.904716+0000","last_clean":"2023-12-08T08:23:17.904716+0000","last_became_active":"2023-12-08T08:23:16.920531+0000","last_became_peered":"2023-12-08T08:23:16.920531+0000","last_unstale":"2023-12-08T08:23:17.904716+0000","last_undegraded":"2023-12-08T08:23:17.904716+0000","last_fullsized":"2023-12-08T08:23:17.904716+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:38:00.928084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.898267+0000","last_change":"2023-12-08T08:23:00.299179+0000","last_active":"2023-12-08T08:23:17.898267+0000","last_peered":"2023-12-08T08:23:17.898267+0000","last_clean":"2023-12-08T08:23:17.898267+0000","last_became_active":"2023-12-08T08:23:00.298936+0000","last_became_peered":"2023-12-08T08:23:00.298936+0000","last_unstale":"2023-12-08T08:23:17.898267+0000","last_undegraded":"2023-12-08T08:23:17.898267+0000","last_fullsized":"2023-12-08T08:23:17.898267+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"68'8","reported_seq":24,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.906796+0000","last_change":"2023-12-08T08:22:59.278612+0000","last_active":"2023-12-08T08:23:17.906796+0000","last_peered":"2023-12-08T08:23:17.906796+0000","last_clean":"2023-12-08T08:23:17.906796+0000","last_became_active":"2023-12-08T08:22:59.278325+0000","last_became_peered":"2023-12-08T08:22:59.278325+0000","last_unstale":"2023-12-08T08:23:17.906796+0000","last_undegraded":"2023-12-08T08:23:17.906796+0000","last_fullsized":"2023-12-08T08:23:17.906796+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:55:35.382801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:18.913775+0000","last_change":"2023-12-08T08:23:17.912284+0000","last_active":"2023-12-08T08:23:18.913775+0000","last_peered":"2023-12-08T08:23:18.913775+0000","last_clean":"2023-12-08T08:23:18.913775+0000","last_became_active":"2023-12-08T08:23:17.906307+0000","last_became_peered":"2023-12-08T08:23:17.906307+0000","last_unstale":"2023-12-08T08:23:18.913775+0000","last_undegraded":"2023-12-08T08:23:18.913775+0000","last_fullsized":"2023-12-08T08:23:18.913775+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:04:46.095518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.897426+0000","last_change":"2023-12-08T08:23:16.915913+0000","last_active":"2023-12-08T08:23:17.897426+0000","last_peered":"2023-12-08T08:23:17.897426+0000","last_clean":"2023-12-08T08:23:17.897426+0000","last_became_active":"2023-12-08T08:23:16.915513+0000","last_became_peered":"2023-12-08T08:23:16.915513+0000","last_unstale":"2023-12-08T08:23:17.897426+0000","last_undegraded":"2023-12-08T08:23:17.897426+0000","last_fullsized":"2023-12-08T08:23:17.897426+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:27:04.256182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.927524+0000","last_change":"2023-12-08T08:23:00.292867+0000","last_active":"2023-12-08T08:23:17.927524+0000","last_peered":"2023-12-08T08:23:17.927524+0000","last_clean":"2023-12-08T08:23:17.927524+0000","last_became_active":"2023-12-08T08:23:00.292648+0000","last_became_peered":"2023-12-08T08:23:00.292648+0000","last_unstale":"2023-12-08T08:23:17.927524+0000","last_undegraded":"2023-12-08T08:23:17.927524+0000","last_fullsized":"2023-12-08T08:23:17.927524+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:29:03.020360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"67'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.895134+0000","last_change":"2023-12-08T08:22:59.262821+0000","last_active":"2023-12-08T08:23:17.895134+0000","last_peered":"2023-12-08T08:23:17.895134+0000","last_clean":"2023-12-08T08:23:17.895134+0000","last_became_active":"2023-12-08T08:22:59.262569+0000","last_became_peered":"2023-12-08T08:22:59.262569+0000","last_unstale":"2023-12-08T08:23:17.895134+0000","last_undegraded":"2023-12-08T08:23:17.895134+0000","last_fullsized":"2023-12-08T08:23:17.895134+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:52:55.751217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.290947+0000","last_change":"2023-12-08T08:23:17.928096+0000","last_active":"2023-12-08T08:23:19.290947+0000","last_peered":"2023-12-08T08:23:19.290947+0000","last_clean":"2023-12-08T08:23:19.290947+0000","last_became_active":"2023-12-08T08:23:17.927691+0000","last_became_peered":"2023-12-08T08:23:17.927691+0000","last_unstale":"2023-12-08T08:23:19.290947+0000","last_undegraded":"2023-12-08T08:23:19.290947+0000","last_fullsized":"2023-12-08T08:23:19.290947+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:37.924221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"71'8","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.930806+0000","last_change":"2023-12-08T08:23:16.907121+0000","last_active":"2023-12-08T08:23:17.930806+0000","last_peered":"2023-12-08T08:23:17.930806+0000","last_clean":"2023-12-08T08:23:17.930806+0000","last_became_active":"2023-12-08T08:23:16.906517+0000","last_became_peered":"2023-12-08T08:23:16.906517+0000","last_unstale":"2023-12-08T08:23:17.930806+0000","last_undegraded":"2023-12-08T08:23:17.930806+0000","last_fullsized":"2023-12-08T08:23:17.930806+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:42:36.668002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.907684+0000","last_change":"2023-12-08T08:23:00.298706+0000","last_active":"2023-12-08T08:23:17.907684+0000","last_peered":"2023-12-08T08:23:17.907684+0000","last_clean":"2023-12-08T08:23:17.907684+0000","last_became_active":"2023-12-08T08:23:00.298452+0000","last_became_peered":"2023-12-08T08:23:00.298452+0000","last_unstale":"2023-12-08T08:23:17.907684+0000","last_undegraded":"2023-12-08T08:23:17.907684+0000","last_fullsized":"2023-12-08T08:23:17.907684+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:39.385907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.902849+0000","last_change":"2023-12-08T08:22:59.270322+0000","last_active":"2023-12-08T08:23:17.902849+0000","last_peered":"2023-12-08T08:23:17.902849+0000","last_clean":"2023-12-08T08:23:17.902849+0000","last_became_active":"2023-12-08T08:22:59.270059+0000","last_became_peered":"2023-12-08T08:22:59.270059+0000","last_unstale":"2023-12-08T08:23:17.902849+0000","last_undegraded":"2023-12-08T08:23:17.902849+0000","last_fullsized":"2023-12-08T08:23:17.902849+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:21:58.531919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.628656+0000","last_change":"2023-12-08T08:23:17.921719+0000","last_active":"2023-12-08T08:23:19.628656+0000","last_peered":"2023-12-08T08:23:19.628656+0000","last_clean":"2023-12-08T08:23:19.628656+0000","last_became_active":"2023-12-08T08:23:17.921444+0000","last_became_peered":"2023-12-08T08:23:17.921444+0000","last_unstale":"2023-12-08T08:23:19.628656+0000","last_undegraded":"2023-12-08T08:23:19.628656+0000","last_fullsized":"2023-12-08T08:23:19.628656+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:05:22.733055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.930478+0000","last_change":"2023-12-08T08:23:16.914697+0000","last_active":"2023-12-08T08:23:17.930478+0000","last_peered":"2023-12-08T08:23:17.930478+0000","last_clean":"2023-12-08T08:23:17.930478+0000","last_became_active":"2023-12-08T08:23:16.914346+0000","last_became_peered":"2023-12-08T08:23:16.914346+0000","last_unstale":"2023-12-08T08:23:17.930478+0000","last_undegraded":"2023-12-08T08:23:17.930478+0000","last_fullsized":"2023-12-08T08:23:17.930478+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:49:46.342802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.894986+0000","last_change":"2023-12-08T08:23:00.304324+0000","last_active":"2023-12-08T08:23:17.894986+0000","last_peered":"2023-12-08T08:23:17.894986+0000","last_clean":"2023-12-08T08:23:17.894986+0000","last_became_active":"2023-12-08T08:23:00.304038+0000","last_became_peered":"2023-12-08T08:23:00.304038+0000","last_unstale":"2023-12-08T08:23:17.894986+0000","last_undegraded":"2023-12-08T08:23:17.894986+0000","last_fullsized":"2023-12-08T08:23:17.894986+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:33:27.464394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.904398+0000","last_change":"2023-12-08T08:22:59.270216+0000","last_active":"2023-12-08T08:23:17.904398+0000","last_peered":"2023-12-08T08:23:17.904398+0000","last_clean":"2023-12-08T08:23:17.904398+0000","last_became_active":"2023-12-08T08:22:59.269292+0000","last_became_peered":"2023-12-08T08:22:59.269292+0000","last_unstale":"2023-12-08T08:23:17.904398+0000","last_undegraded":"2023-12-08T08:23:17.904398+0000","last_fullsized":"2023-12-08T08:23:17.904398+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:18:01.309002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:18.913126+0000","last_change":"2023-12-08T08:23:17.913430+0000","last_active":"2023-12-08T08:23:18.913126+0000","last_peered":"2023-12-08T08:23:18.913126+0000","last_clean":"2023-12-08T08:23:18.913126+0000","last_became_active":"2023-12-08T08:23:17.912298+0000","last_became_peered":"2023-12-08T08:23:17.912298+0000","last_unstale":"2023-12-08T08:23:18.913126+0000","last_undegraded":"2023-12-08T08:23:18.913126+0000","last_fullsized":"2023-12-08T08:23:18.913126+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:37:57.023147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.900946+0000","last_change":"2023-12-08T08:23:16.910717+0000","last_active":"2023-12-08T08:23:17.900946+0000","last_peered":"2023-12-08T08:23:17.900946+0000","last_clean":"2023-12-08T08:23:17.900946+0000","last_became_active":"2023-12-08T08:23:16.910457+0000","last_became_peered":"2023-12-08T08:23:16.910457+0000","last_unstale":"2023-12-08T08:23:17.900946+0000","last_undegraded":"2023-12-08T08:23:17.900946+0000","last_fullsized":"2023-12-08T08:23:17.900946+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:34:11.822569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.894308+0000","last_change":"2023-12-08T08:23:00.276305+0000","last_active":"2023-12-08T08:23:17.894308+0000","last_peered":"2023-12-08T08:23:17.894308+0000","last_clean":"2023-12-08T08:23:17.894308+0000","last_became_active":"2023-12-08T08:23:00.275989+0000","last_became_peered":"2023-12-08T08:23:00.275989+0000","last_unstale":"2023-12-08T08:23:17.894308+0000","last_undegraded":"2023-12-08T08:23:17.894308+0000","last_fullsized":"2023-12-08T08:23:17.894308+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:24:33.735501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"67'8","reported_seq":24,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.917329+0000","last_change":"2023-12-08T08:22:59.271542+0000","last_active":"2023-12-08T08:23:17.917329+0000","last_peered":"2023-12-08T08:23:17.917329+0000","last_clean":"2023-12-08T08:23:17.917329+0000","last_became_active":"2023-12-08T08:22:59.271240+0000","last_became_peered":"2023-12-08T08:22:59.271240+0000","last_unstale":"2023-12-08T08:23:17.917329+0000","last_undegraded":"2023-12-08T08:23:17.917329+0000","last_fullsized":"2023-12-08T08:23:17.917329+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:32.897955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.787157+0000","last_change":"2023-12-08T08:23:17.924034+0000","last_active":"2023-12-08T08:23:19.787157+0000","last_peered":"2023-12-08T08:23:19.787157+0000","last_clean":"2023-12-08T08:23:19.787157+0000","last_became_active":"2023-12-08T08:23:17.923734+0000","last_became_peered":"2023-12-08T08:23:17.923734+0000","last_unstale":"2023-12-08T08:23:19.787157+0000","last_undegraded":"2023-12-08T08:23:19.787157+0000","last_fullsized":"2023-12-08T08:23:19.787157+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:18:50.235663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.933662+0000","last_change":"2023-12-08T08:23:16.915441+0000","last_active":"2023-12-08T08:23:17.933662+0000","last_peered":"2023-12-08T08:23:17.933662+0000","last_clean":"2023-12-08T08:23:17.933662+0000","last_became_active":"2023-12-08T08:23:16.915074+0000","last_became_peered":"2023-12-08T08:23:16.915074+0000","last_unstale":"2023-12-08T08:23:17.933662+0000","last_undegraded":"2023-12-08T08:23:17.933662+0000","last_fullsized":"2023-12-08T08:23:17.933662+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:28:54.873126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.908370+0000","last_change":"2023-12-08T08:23:00.280374+0000","last_active":"2023-12-08T08:23:17.908370+0000","last_peered":"2023-12-08T08:23:17.908370+0000","last_clean":"2023-12-08T08:23:17.908370+0000","last_became_active":"2023-12-08T08:23:00.280096+0000","last_became_peered":"2023-12-08T08:23:00.280096+0000","last_unstale":"2023-12-08T08:23:17.908370+0000","last_undegraded":"2023-12-08T08:23:17.908370+0000","last_fullsized":"2023-12-08T08:23:17.908370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:21:59.539539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"67'1","reported_seq":17,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.905361+0000","last_change":"2023-12-08T08:22:59.283727+0000","last_active":"2023-12-08T08:23:17.905361+0000","last_peered":"2023-12-08T08:23:17.905361+0000","last_clean":"2023-12-08T08:23:17.905361+0000","last_became_active":"2023-12-08T08:22:59.283254+0000","last_became_peered":"2023-12-08T08:22:59.283254+0000","last_unstale":"2023-12-08T08:23:17.905361+0000","last_undegraded":"2023-12-08T08:23:17.905361+0000","last_fullsized":"2023-12-08T08:23:17.905361+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:18:01.309002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.285187+0000","last_change":"2023-12-08T08:23:17.928442+0000","last_active":"2023-12-08T08:23:19.285187+0000","last_peered":"2023-12-08T08:23:19.285187+0000","last_clean":"2023-12-08T08:23:19.285187+0000","last_became_active":"2023-12-08T08:23:17.928161+0000","last_became_peered":"2023-12-08T08:23:17.928161+0000","last_unstale":"2023-12-08T08:23:19.285187+0000","last_undegraded":"2023-12-08T08:23:19.285187+0000","last_fullsized":"2023-12-08T08:23:19.285187+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:04:23.028891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.926122+0000","last_change":"2023-12-08T08:23:16.901347+0000","last_active":"2023-12-08T08:23:17.926122+0000","last_peered":"2023-12-08T08:23:17.926122+0000","last_clean":"2023-12-08T08:23:17.926122+0000","last_became_active":"2023-12-08T08:23:16.901041+0000","last_became_peered":"2023-12-08T08:23:16.901041+0000","last_unstale":"2023-12-08T08:23:17.926122+0000","last_undegraded":"2023-12-08T08:23:17.926122+0000","last_fullsized":"2023-12-08T08:23:17.926122+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:05:29.557652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.904971+0000","last_change":"2023-12-08T08:23:00.282901+0000","last_active":"2023-12-08T08:23:17.904971+0000","last_peered":"2023-12-08T08:23:17.904971+0000","last_clean":"2023-12-08T08:23:17.904971+0000","last_became_active":"2023-12-08T08:23:00.282646+0000","last_became_peered":"2023-12-08T08:23:00.282646+0000","last_unstale":"2023-12-08T08:23:17.904971+0000","last_undegraded":"2023-12-08T08:23:17.904971+0000","last_fullsized":"2023-12-08T08:23:17.904971+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:04.894129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"67'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.931262+0000","last_change":"2023-12-08T08:22:59.265669+0000","last_active":"2023-12-08T08:23:17.931262+0000","last_peered":"2023-12-08T08:23:17.931262+0000","last_clean":"2023-12-08T08:23:17.931262+0000","last_became_active":"2023-12-08T08:22:59.265364+0000","last_became_peered":"2023-12-08T08:22:59.265364+0000","last_unstale":"2023-12-08T08:23:17.931262+0000","last_undegraded":"2023-12-08T08:23:17.931262+0000","last_fullsized":"2023-12-08T08:23:17.931262+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:27:38.296266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.103200+0000","last_change":"2023-12-08T08:23:17.931685+0000","last_active":"2023-12-08T08:23:19.103200+0000","last_peered":"2023-12-08T08:23:19.103200+0000","last_clean":"2023-12-08T08:23:19.103200+0000","last_became_active":"2023-12-08T08:23:17.931297+0000","last_became_peered":"2023-12-08T08:23:17.931297+0000","last_unstale":"2023-12-08T08:23:19.103200+0000","last_undegraded":"2023-12-08T08:23:19.103200+0000","last_fullsized":"2023-12-08T08:23:19.103200+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:59:18.956399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.930865+0000","last_change":"2023-12-08T08:23:16.916758+0000","last_active":"2023-12-08T08:23:17.930865+0000","last_peered":"2023-12-08T08:23:17.930865+0000","last_clean":"2023-12-08T08:23:17.930865+0000","last_became_active":"2023-12-08T08:23:16.916445+0000","last_became_peered":"2023-12-08T08:23:16.916445+0000","last_unstale":"2023-12-08T08:23:17.930865+0000","last_undegraded":"2023-12-08T08:23:17.930865+0000","last_fullsized":"2023-12-08T08:23:17.930865+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:33:44.699786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.898379+0000","last_change":"2023-12-08T08:23:00.270198+0000","last_active":"2023-12-08T08:23:17.898379+0000","last_peered":"2023-12-08T08:23:17.898379+0000","last_clean":"2023-12-08T08:23:17.898379+0000","last_became_active":"2023-12-08T08:23:00.269930+0000","last_became_peered":"2023-12-08T08:23:00.269930+0000","last_unstale":"2023-12-08T08:23:17.898379+0000","last_undegraded":"2023-12-08T08:23:17.898379+0000","last_fullsized":"2023-12-08T08:23:17.898379+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.926430+0000","last_change":"2023-12-08T08:22:59.273655+0000","last_active":"2023-12-08T08:23:17.926430+0000","last_peered":"2023-12-08T08:23:17.926430+0000","last_clean":"2023-12-08T08:23:17.926430+0000","last_became_active":"2023-12-08T08:22:59.273396+0000","last_became_peered":"2023-12-08T08:22:59.273396+0000","last_unstale":"2023-12-08T08:23:17.926430+0000","last_undegraded":"2023-12-08T08:23:17.926430+0000","last_fullsized":"2023-12-08T08:23:17.926430+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:36:03.886510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.290909+0000","last_change":"2023-12-08T08:23:17.918328+0000","last_active":"2023-12-08T08:23:19.290909+0000","last_peered":"2023-12-08T08:23:19.290909+0000","last_clean":"2023-12-08T08:23:19.290909+0000","last_became_active":"2023-12-08T08:23:17.918101+0000","last_became_peered":"2023-12-08T08:23:17.918101+0000","last_unstale":"2023-12-08T08:23:19.290909+0000","last_undegraded":"2023-12-08T08:23:19.290909+0000","last_fullsized":"2023-12-08T08:23:19.290909+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:20:34.925454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.902990+0000","last_change":"2023-12-08T08:23:16.922219+0000","last_active":"2023-12-08T08:23:17.902990+0000","last_peered":"2023-12-08T08:23:17.902990+0000","last_clean":"2023-12-08T08:23:17.902990+0000","last_became_active":"2023-12-08T08:23:16.921977+0000","last_became_peered":"2023-12-08T08:23:16.921977+0000","last_unstale":"2023-12-08T08:23:17.902990+0000","last_undegraded":"2023-12-08T08:23:17.902990+0000","last_fullsized":"2023-12-08T08:23:17.902990+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:48:31.917542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.901277+0000","last_change":"2023-12-08T08:23:00.285854+0000","last_active":"2023-12-08T08:23:17.901277+0000","last_peered":"2023-12-08T08:23:17.901277+0000","last_clean":"2023-12-08T08:23:17.901277+0000","last_became_active":"2023-12-08T08:23:00.285553+0000","last_became_peered":"2023-12-08T08:23:00.285553+0000","last_unstale":"2023-12-08T08:23:17.901277+0000","last_undegraded":"2023-12-08T08:23:17.901277+0000","last_fullsized":"2023-12-08T08:23:17.901277+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:15:44.184576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"67'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.912363+0000","last_change":"2023-12-08T08:22:59.282745+0000","last_active":"2023-12-08T08:23:17.912363+0000","last_peered":"2023-12-08T08:23:17.912363+0000","last_clean":"2023-12-08T08:23:17.912363+0000","last_became_active":"2023-12-08T08:22:59.282443+0000","last_became_peered":"2023-12-08T08:22:59.282443+0000","last_unstale":"2023-12-08T08:23:17.912363+0000","last_undegraded":"2023-12-08T08:23:17.912363+0000","last_fullsized":"2023-12-08T08:23:17.912363+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:21.899236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.102333+0000","last_change":"2023-12-08T08:23:17.924044+0000","last_active":"2023-12-08T08:23:19.102333+0000","last_peered":"2023-12-08T08:23:19.102333+0000","last_clean":"2023-12-08T08:23:19.102333+0000","last_became_active":"2023-12-08T08:23:17.923718+0000","last_became_peered":"2023-12-08T08:23:17.923718+0000","last_unstale":"2023-12-08T08:23:19.102333+0000","last_undegraded":"2023-12-08T08:23:19.102333+0000","last_fullsized":"2023-12-08T08:23:19.102333+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:33:45.707717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.917604+0000","last_change":"2023-12-08T08:23:16.906025+0000","last_active":"2023-12-08T08:23:17.917604+0000","last_peered":"2023-12-08T08:23:17.917604+0000","last_clean":"2023-12-08T08:23:17.917604+0000","last_became_active":"2023-12-08T08:23:16.905756+0000","last_became_peered":"2023-12-08T08:23:16.905756+0000","last_unstale":"2023-12-08T08:23:17.917604+0000","last_undegraded":"2023-12-08T08:23:17.917604+0000","last_fullsized":"2023-12-08T08:23:17.917604+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:52:54.903890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.907876+0000","last_change":"2023-12-08T08:23:00.286165+0000","last_active":"2023-12-08T08:23:17.907876+0000","last_peered":"2023-12-08T08:23:17.907876+0000","last_clean":"2023-12-08T08:23:17.907876+0000","last_became_active":"2023-12-08T08:23:00.285209+0000","last_became_peered":"2023-12-08T08:23:00.285209+0000","last_unstale":"2023-12-08T08:23:17.907876+0000","last_undegraded":"2023-12-08T08:23:17.907876+0000","last_fullsized":"2023-12-08T08:23:17.907876+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:16.068318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.901381+0000","last_change":"2023-12-08T08:22:59.272934+0000","last_active":"2023-12-08T08:23:17.901381+0000","last_peered":"2023-12-08T08:23:17.901381+0000","last_clean":"2023-12-08T08:23:17.901381+0000","last_became_active":"2023-12-08T08:22:59.272094+0000","last_became_peered":"2023-12-08T08:22:59.272094+0000","last_unstale":"2023-12-08T08:23:17.901381+0000","last_undegraded":"2023-12-08T08:23:17.901381+0000","last_fullsized":"2023-12-08T08:23:17.901381+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:33:18.775139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.291077+0000","last_change":"2023-12-08T08:23:17.921121+0000","last_active":"2023-12-08T08:23:19.291077+0000","last_peered":"2023-12-08T08:23:19.291077+0000","last_clean":"2023-12-08T08:23:19.291077+0000","last_became_active":"2023-12-08T08:23:17.920830+0000","last_became_peered":"2023-12-08T08:23:17.920830+0000","last_unstale":"2023-12-08T08:23:19.291077+0000","last_undegraded":"2023-12-08T08:23:19.291077+0000","last_fullsized":"2023-12-08T08:23:19.291077+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:44:55.058694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.939820+0000","last_change":"2023-12-08T08:23:16.915895+0000","last_active":"2023-12-08T08:23:17.939820+0000","last_peered":"2023-12-08T08:23:17.939820+0000","last_clean":"2023-12-08T08:23:17.939820+0000","last_became_active":"2023-12-08T08:23:16.915631+0000","last_became_peered":"2023-12-08T08:23:16.915631+0000","last_unstale":"2023-12-08T08:23:17.939820+0000","last_undegraded":"2023-12-08T08:23:17.939820+0000","last_fullsized":"2023-12-08T08:23:17.939820+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:42:51.876717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.901021+0000","last_change":"2023-12-08T08:23:00.287292+0000","last_active":"2023-12-08T08:23:17.901021+0000","last_peered":"2023-12-08T08:23:17.901021+0000","last_clean":"2023-12-08T08:23:17.901021+0000","last_became_active":"2023-12-08T08:23:00.284565+0000","last_became_peered":"2023-12-08T08:23:00.284565+0000","last_unstale":"2023-12-08T08:23:17.901021+0000","last_undegraded":"2023-12-08T08:23:17.901021+0000","last_fullsized":"2023-12-08T08:23:17.901021+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:17:25.641139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.898670+0000","last_change":"2023-12-08T08:22:59.279857+0000","last_active":"2023-12-08T08:23:17.898670+0000","last_peered":"2023-12-08T08:23:17.898670+0000","last_clean":"2023-12-08T08:23:17.898670+0000","last_became_active":"2023-12-08T08:22:59.279508+0000","last_became_peered":"2023-12-08T08:22:59.279508+0000","last_unstale":"2023-12-08T08:23:17.898670+0000","last_undegraded":"2023-12-08T08:23:17.898670+0000","last_fullsized":"2023-12-08T08:23:17.898670+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:23.192834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.291424+0000","last_change":"2023-12-08T08:23:17.937306+0000","last_active":"2023-12-08T08:23:19.291424+0000","last_peered":"2023-12-08T08:23:19.291424+0000","last_clean":"2023-12-08T08:23:19.291424+0000","last_became_active":"2023-12-08T08:23:17.937037+0000","last_became_peered":"2023-12-08T08:23:17.937037+0000","last_unstale":"2023-12-08T08:23:19.291424+0000","last_undegraded":"2023-12-08T08:23:19.291424+0000","last_fullsized":"2023-12-08T08:23:19.291424+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:45.912633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.904499+0000","last_change":"2023-12-08T08:23:16.911088+0000","last_active":"2023-12-08T08:23:17.904499+0000","last_peered":"2023-12-08T08:23:17.904499+0000","last_clean":"2023-12-08T08:23:17.904499+0000","last_became_active":"2023-12-08T08:23:16.910534+0000","last_became_peered":"2023-12-08T08:23:16.910534+0000","last_unstale":"2023-12-08T08:23:17.904499+0000","last_undegraded":"2023-12-08T08:23:17.904499+0000","last_fullsized":"2023-12-08T08:23:17.904499+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:21:31.183240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.903635+0000","last_change":"2023-12-08T08:23:00.291227+0000","last_active":"2023-12-08T08:23:17.903635+0000","last_peered":"2023-12-08T08:23:17.903635+0000","last_clean":"2023-12-08T08:23:17.903635+0000","last_became_active":"2023-12-08T08:23:00.290984+0000","last_became_peered":"2023-12-08T08:23:00.290984+0000","last_unstale":"2023-12-08T08:23:17.903635+0000","last_undegraded":"2023-12-08T08:23:17.903635+0000","last_fullsized":"2023-12-08T08:23:17.903635+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:33.905575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.902369+0000","last_change":"2023-12-08T08:22:59.282842+0000","last_active":"2023-12-08T08:23:17.902369+0000","last_peered":"2023-12-08T08:23:17.902369+0000","last_clean":"2023-12-08T08:23:17.902369+0000","last_became_active":"2023-12-08T08:22:59.282605+0000","last_became_peered":"2023-12-08T08:22:59.282605+0000","last_unstale":"2023-12-08T08:23:17.902369+0000","last_undegraded":"2023-12-08T08:23:17.902369+0000","last_fullsized":"2023-12-08T08:23:17.902369+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:55.208931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:18.913537+0000","last_change":"2023-12-08T08:23:17.923984+0000","last_active":"2023-12-08T08:23:18.913537+0000","last_peered":"2023-12-08T08:23:18.913537+0000","last_clean":"2023-12-08T08:23:18.913537+0000","last_became_active":"2023-12-08T08:23:17.923681+0000","last_became_peered":"2023-12-08T08:23:17.923681+0000","last_unstale":"2023-12-08T08:23:18.913537+0000","last_undegraded":"2023-12-08T08:23:18.913537+0000","last_fullsized":"2023-12-08T08:23:18.913537+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:22:17.176779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.931947+0000","last_change":"2023-12-08T08:23:16.900995+0000","last_active":"2023-12-08T08:23:17.931947+0000","last_peered":"2023-12-08T08:23:17.931947+0000","last_clean":"2023-12-08T08:23:17.931947+0000","last_became_active":"2023-12-08T08:23:16.900717+0000","last_became_peered":"2023-12-08T08:23:16.900717+0000","last_unstale":"2023-12-08T08:23:17.931947+0000","last_undegraded":"2023-12-08T08:23:17.931947+0000","last_fullsized":"2023-12-08T08:23:17.931947+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:30:45.602162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.898364+0000","last_change":"2023-12-08T08:23:00.270620+0000","last_active":"2023-12-08T08:23:17.898364+0000","last_peered":"2023-12-08T08:23:17.898364+0000","last_clean":"2023-12-08T08:23:17.898364+0000","last_became_active":"2023-12-08T08:23:00.270369+0000","last_became_peered":"2023-12-08T08:23:00.270369+0000","last_unstale":"2023-12-08T08:23:17.898364+0000","last_undegraded":"2023-12-08T08:23:17.898364+0000","last_fullsized":"2023-12-08T08:23:17.898364+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:33.898137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"67'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.897892+0000","last_change":"2023-12-08T08:22:59.269712+0000","last_active":"2023-12-08T08:23:17.897892+0000","last_peered":"2023-12-08T08:23:17.897892+0000","last_clean":"2023-12-08T08:23:17.897892+0000","last_became_active":"2023-12-08T08:22:59.269426+0000","last_became_peered":"2023-12-08T08:22:59.269426+0000","last_unstale":"2023-12-08T08:23:17.897892+0000","last_undegraded":"2023-12-08T08:23:17.897892+0000","last_fullsized":"2023-12-08T08:23:17.897892+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:49:28.705874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.102619+0000","last_change":"2023-12-08T08:23:17.930428+0000","last_active":"2023-12-08T08:23:19.102619+0000","last_peered":"2023-12-08T08:23:19.102619+0000","last_clean":"2023-12-08T08:23:19.102619+0000","last_became_active":"2023-12-08T08:23:17.929698+0000","last_became_peered":"2023-12-08T08:23:17.929698+0000","last_unstale":"2023-12-08T08:23:19.102619+0000","last_undegraded":"2023-12-08T08:23:19.102619+0000","last_fullsized":"2023-12-08T08:23:19.102619+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:02:17.072723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.916978+0000","last_change":"2023-12-08T08:23:16.918945+0000","last_active":"2023-12-08T08:23:17.916978+0000","last_peered":"2023-12-08T08:23:17.916978+0000","last_clean":"2023-12-08T08:23:17.916978+0000","last_became_active":"2023-12-08T08:23:16.918629+0000","last_became_peered":"2023-12-08T08:23:16.918629+0000","last_unstale":"2023-12-08T08:23:17.916978+0000","last_undegraded":"2023-12-08T08:23:17.916978+0000","last_fullsized":"2023-12-08T08:23:17.916978+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:58:28.262993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.909009+0000","last_change":"2023-12-08T08:23:00.280543+0000","last_active":"2023-12-08T08:23:17.909009+0000","last_peered":"2023-12-08T08:23:17.909009+0000","last_clean":"2023-12-08T08:23:17.909009+0000","last_became_active":"2023-12-08T08:23:00.280152+0000","last_became_peered":"2023-12-08T08:23:00.280152+0000","last_unstale":"2023-12-08T08:23:17.909009+0000","last_undegraded":"2023-12-08T08:23:17.909009+0000","last_fullsized":"2023-12-08T08:23:17.909009+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:37:47.067543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"68'1","reported_seq":17,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.897316+0000","last_change":"2023-12-08T08:22:59.263185+0000","last_active":"2023-12-08T08:23:17.897316+0000","last_peered":"2023-12-08T08:23:17.897316+0000","last_clean":"2023-12-08T08:23:17.897316+0000","last_became_active":"2023-12-08T08:22:59.262924+0000","last_became_peered":"2023-12-08T08:22:59.262924+0000","last_unstale":"2023-12-08T08:23:17.897316+0000","last_undegraded":"2023-12-08T08:23:17.897316+0000","last_fullsized":"2023-12-08T08:23:17.897316+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:39:59.028170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.288697+0000","last_change":"2023-12-08T08:23:17.917830+0000","last_active":"2023-12-08T08:23:19.288697+0000","last_peered":"2023-12-08T08:23:19.288697+0000","last_clean":"2023-12-08T08:23:19.288697+0000","last_became_active":"2023-12-08T08:23:17.917545+0000","last_became_peered":"2023-12-08T08:23:17.917545+0000","last_unstale":"2023-12-08T08:23:19.288697+0000","last_undegraded":"2023-12-08T08:23:19.288697+0000","last_fullsized":"2023-12-08T08:23:19.288697+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:12:14.254128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.929273+0000","last_change":"2023-12-08T08:23:16.912250+0000","last_active":"2023-12-08T08:23:17.929273+0000","last_peered":"2023-12-08T08:23:17.929273+0000","last_clean":"2023-12-08T08:23:17.929273+0000","last_became_active":"2023-12-08T08:23:16.912031+0000","last_became_peered":"2023-12-08T08:23:16.912031+0000","last_unstale":"2023-12-08T08:23:17.929273+0000","last_undegraded":"2023-12-08T08:23:17.929273+0000","last_fullsized":"2023-12-08T08:23:17.929273+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:29.768654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.917358+0000","last_change":"2023-12-08T08:23:00.304740+0000","last_active":"2023-12-08T08:23:17.917358+0000","last_peered":"2023-12-08T08:23:17.917358+0000","last_clean":"2023-12-08T08:23:17.917358+0000","last_became_active":"2023-12-08T08:23:00.304390+0000","last_became_peered":"2023-12-08T08:23:00.304390+0000","last_unstale":"2023-12-08T08:23:17.917358+0000","last_undegraded":"2023-12-08T08:23:17.917358+0000","last_fullsized":"2023-12-08T08:23:17.917358+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.906777+0000","last_change":"2023-12-08T08:22:59.285952+0000","last_active":"2023-12-08T08:23:17.906777+0000","last_peered":"2023-12-08T08:23:17.906777+0000","last_clean":"2023-12-08T08:23:17.906777+0000","last_became_active":"2023-12-08T08:22:59.285309+0000","last_became_peered":"2023-12-08T08:22:59.285309+0000","last_unstale":"2023-12-08T08:23:17.906777+0000","last_undegraded":"2023-12-08T08:23:17.906777+0000","last_fullsized":"2023-12-08T08:23:17.906777+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:19.279362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:18.913946+0000","last_change":"2023-12-08T08:23:17.911247+0000","last_active":"2023-12-08T08:23:18.913946+0000","last_peered":"2023-12-08T08:23:18.913946+0000","last_clean":"2023-12-08T08:23:18.913946+0000","last_became_active":"2023-12-08T08:23:17.910989+0000","last_became_peered":"2023-12-08T08:23:17.910989+0000","last_unstale":"2023-12-08T08:23:18.913946+0000","last_undegraded":"2023-12-08T08:23:18.913946+0000","last_fullsized":"2023-12-08T08:23:18.913946+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:33:13.126336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"72'1","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.288766+0000","last_change":"2023-12-08T08:23:16.912270+0000","last_active":"2023-12-08T08:23:19.288766+0000","last_peered":"2023-12-08T08:23:19.288766+0000","last_clean":"2023-12-08T08:23:19.288766+0000","last_became_active":"2023-12-08T08:23:16.912007+0000","last_became_peered":"2023-12-08T08:23:16.912007+0000","last_unstale":"2023-12-08T08:23:19.288766+0000","last_undegraded":"2023-12-08T08:23:19.288766+0000","last_fullsized":"2023-12-08T08:23:19.288766+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:50:41.733793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.898454+0000","last_change":"2023-12-08T08:23:00.299161+0000","last_active":"2023-12-08T08:23:17.898454+0000","last_peered":"2023-12-08T08:23:17.898454+0000","last_clean":"2023-12-08T08:23:17.898454+0000","last_became_active":"2023-12-08T08:23:00.298876+0000","last_became_peered":"2023-12-08T08:23:00.298876+0000","last_unstale":"2023-12-08T08:23:17.898454+0000","last_undegraded":"2023-12-08T08:23:17.898454+0000","last_fullsized":"2023-12-08T08:23:17.898454+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:29:03.020360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.917437+0000","last_change":"2023-12-08T08:22:59.280536+0000","last_active":"2023-12-08T08:23:17.917437+0000","last_peered":"2023-12-08T08:23:17.917437+0000","last_clean":"2023-12-08T08:23:17.917437+0000","last_became_active":"2023-12-08T08:22:59.280213+0000","last_became_peered":"2023-12-08T08:22:59.280213+0000","last_unstale":"2023-12-08T08:23:17.917437+0000","last_undegraded":"2023-12-08T08:23:17.917437+0000","last_fullsized":"2023-12-08T08:23:17.917437+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:49.883139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.290908+0000","last_change":"2023-12-08T08:23:17.929827+0000","last_active":"2023-12-08T08:23:19.290908+0000","last_peered":"2023-12-08T08:23:19.290908+0000","last_clean":"2023-12-08T08:23:19.290908+0000","last_became_active":"2023-12-08T08:23:17.927682+0000","last_became_peered":"2023-12-08T08:23:17.927682+0000","last_unstale":"2023-12-08T08:23:19.290908+0000","last_undegraded":"2023-12-08T08:23:19.290908+0000","last_fullsized":"2023-12-08T08:23:19.290908+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:52:10.117841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.904372+0000","last_change":"2023-12-08T08:23:16.919692+0000","last_active":"2023-12-08T08:23:17.904372+0000","last_peered":"2023-12-08T08:23:17.904372+0000","last_clean":"2023-12-08T08:23:17.904372+0000","last_became_active":"2023-12-08T08:23:16.919433+0000","last_became_peered":"2023-12-08T08:23:16.919433+0000","last_unstale":"2023-12-08T08:23:17.904372+0000","last_undegraded":"2023-12-08T08:23:17.904372+0000","last_fullsized":"2023-12-08T08:23:17.904372+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:02:16.064792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.904621+0000","last_change":"2023-12-08T08:23:00.285721+0000","last_active":"2023-12-08T08:23:17.904621+0000","last_peered":"2023-12-08T08:23:17.904621+0000","last_clean":"2023-12-08T08:23:17.904621+0000","last_became_active":"2023-12-08T08:23:00.285446+0000","last_became_peered":"2023-12-08T08:23:00.285446+0000","last_unstale":"2023-12-08T08:23:17.904621+0000","last_undegraded":"2023-12-08T08:23:17.904621+0000","last_fullsized":"2023-12-08T08:23:17.904621+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:05:03.428367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.925153+0000","last_change":"2023-12-08T08:22:59.272111+0000","last_active":"2023-12-08T08:23:17.925153+0000","last_peered":"2023-12-08T08:23:17.925153+0000","last_clean":"2023-12-08T08:23:17.925153+0000","last_became_active":"2023-12-08T08:22:59.271849+0000","last_became_peered":"2023-12-08T08:22:59.271849+0000","last_unstale":"2023-12-08T08:23:17.925153+0000","last_undegraded":"2023-12-08T08:23:17.925153+0000","last_fullsized":"2023-12-08T08:23:17.925153+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:15.060698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.102422+0000","last_change":"2023-12-08T08:23:17.927067+0000","last_active":"2023-12-08T08:23:19.102422+0000","last_peered":"2023-12-08T08:23:19.102422+0000","last_clean":"2023-12-08T08:23:19.102422+0000","last_became_active":"2023-12-08T08:23:17.926524+0000","last_became_peered":"2023-12-08T08:23:17.926524+0000","last_unstale":"2023-12-08T08:23:19.102422+0000","last_undegraded":"2023-12-08T08:23:19.102422+0000","last_fullsized":"2023-12-08T08:23:19.102422+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:04:46.095518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.900229+0000","last_change":"2023-12-08T08:23:16.910225+0000","last_active":"2023-12-08T08:23:17.900229+0000","last_peered":"2023-12-08T08:23:17.900229+0000","last_clean":"2023-12-08T08:23:17.900229+0000","last_became_active":"2023-12-08T08:23:16.909947+0000","last_became_peered":"2023-12-08T08:23:16.909947+0000","last_unstale":"2023-12-08T08:23:17.900229+0000","last_undegraded":"2023-12-08T08:23:17.900229+0000","last_fullsized":"2023-12-08T08:23:17.900229+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:23:23.554667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.925082+0000","last_change":"2023-12-08T08:23:00.292346+0000","last_active":"2023-12-08T08:23:17.925082+0000","last_peered":"2023-12-08T08:23:17.925082+0000","last_clean":"2023-12-08T08:23:17.925082+0000","last_became_active":"2023-12-08T08:23:00.292166+0000","last_became_peered":"2023-12-08T08:23:00.292166+0000","last_unstale":"2023-12-08T08:23:17.925082+0000","last_undegraded":"2023-12-08T08:23:17.925082+0000","last_fullsized":"2023-12-08T08:23:17.925082+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:21:59.539539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.898728+0000","last_change":"2023-12-08T08:22:59.271088+0000","last_active":"2023-12-08T08:23:17.898728+0000","last_peered":"2023-12-08T08:23:17.898728+0000","last_clean":"2023-12-08T08:23:17.898728+0000","last_became_active":"2023-12-08T08:22:59.270783+0000","last_became_peered":"2023-12-08T08:22:59.270783+0000","last_unstale":"2023-12-08T08:23:17.898728+0000","last_undegraded":"2023-12-08T08:23:17.898728+0000","last_fullsized":"2023-12-08T08:23:17.898728+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:30:43.384001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.291237+0000","last_change":"2023-12-08T08:23:17.929090+0000","last_active":"2023-12-08T08:23:19.291237+0000","last_peered":"2023-12-08T08:23:19.291237+0000","last_clean":"2023-12-08T08:23:19.291237+0000","last_became_active":"2023-12-08T08:23:17.928802+0000","last_became_peered":"2023-12-08T08:23:17.928802+0000","last_unstale":"2023-12-08T08:23:19.291237+0000","last_undegraded":"2023-12-08T08:23:19.291237+0000","last_fullsized":"2023-12-08T08:23:19.291237+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:13:40.169364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.931821+0000","last_change":"2023-12-08T08:23:16.921099+0000","last_active":"2023-12-08T08:23:17.931821+0000","last_peered":"2023-12-08T08:23:17.931821+0000","last_clean":"2023-12-08T08:23:17.931821+0000","last_became_active":"2023-12-08T08:23:16.920243+0000","last_became_peered":"2023-12-08T08:23:16.920243+0000","last_unstale":"2023-12-08T08:23:17.931821+0000","last_undegraded":"2023-12-08T08:23:17.931821+0000","last_fullsized":"2023-12-08T08:23:17.931821+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:14:18.266353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.905498+0000","last_change":"2023-12-08T08:23:00.283700+0000","last_active":"2023-12-08T08:23:17.905498+0000","last_peered":"2023-12-08T08:23:17.905498+0000","last_clean":"2023-12-08T08:23:17.905498+0000","last_became_active":"2023-12-08T08:23:00.283439+0000","last_became_peered":"2023-12-08T08:23:00.283439+0000","last_unstale":"2023-12-08T08:23:17.905498+0000","last_undegraded":"2023-12-08T08:23:17.905498+0000","last_fullsized":"2023-12-08T08:23:17.905498+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:16.264107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.903176+0000","last_change":"2023-12-08T08:22:59.280725+0000","last_active":"2023-12-08T08:23:17.903176+0000","last_peered":"2023-12-08T08:23:17.903176+0000","last_clean":"2023-12-08T08:23:17.903176+0000","last_became_active":"2023-12-08T08:22:59.279736+0000","last_became_peered":"2023-12-08T08:22:59.279736+0000","last_unstale":"2023-12-08T08:23:17.903176+0000","last_undegraded":"2023-12-08T08:23:17.903176+0000","last_fullsized":"2023-12-08T08:23:17.903176+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:54.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:18.914476+0000","last_change":"2023-12-08T08:23:17.921715+0000","last_active":"2023-12-08T08:23:18.914476+0000","last_peered":"2023-12-08T08:23:18.914476+0000","last_clean":"2023-12-08T08:23:18.914476+0000","last_became_active":"2023-12-08T08:23:17.921150+0000","last_became_peered":"2023-12-08T08:23:17.921150+0000","last_unstale":"2023-12-08T08:23:18.914476+0000","last_undegraded":"2023-12-08T08:23:18.914476+0000","last_fullsized":"2023-12-08T08:23:18.914476+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:38:01.936015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.902575+0000","last_change":"2023-12-08T08:23:16.918822+0000","last_active":"2023-12-08T08:23:17.902575+0000","last_peered":"2023-12-08T08:23:17.902575+0000","last_clean":"2023-12-08T08:23:17.902575+0000","last_became_active":"2023-12-08T08:23:16.918519+0000","last_became_peered":"2023-12-08T08:23:16.918519+0000","last_unstale":"2023-12-08T08:23:17.902575+0000","last_undegraded":"2023-12-08T08:23:17.902575+0000","last_fullsized":"2023-12-08T08:23:17.902575+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:56:17.065460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.903080+0000","last_change":"2023-12-08T08:23:00.305076+0000","last_active":"2023-12-08T08:23:17.903080+0000","last_peered":"2023-12-08T08:23:17.903080+0000","last_clean":"2023-12-08T08:23:17.903080+0000","last_became_active":"2023-12-08T08:23:00.304435+0000","last_became_peered":"2023-12-08T08:23:00.304435+0000","last_unstale":"2023-12-08T08:23:17.903080+0000","last_undegraded":"2023-12-08T08:23:17.903080+0000","last_fullsized":"2023-12-08T08:23:17.903080+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:42:20.038693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.896802+0000","last_change":"2023-12-08T08:22:59.278661+0000","last_active":"2023-12-08T08:23:17.896802+0000","last_peered":"2023-12-08T08:23:17.896802+0000","last_clean":"2023-12-08T08:23:17.896802+0000","last_became_active":"2023-12-08T08:22:59.278383+0000","last_became_peered":"2023-12-08T08:22:59.278383+0000","last_unstale":"2023-12-08T08:23:17.896802+0000","last_undegraded":"2023-12-08T08:23:17.896802+0000","last_fullsized":"2023-12-08T08:23:17.896802+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:35:15.000491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-08T08:23:19.291700+0000","last_change":"2023-12-08T08:23:17.921657+0000","last_active":"2023-12-08T08:23:19.291700+0000","last_peered":"2023-12-08T08:23:19.291700+0000","last_clean":"2023-12-08T08:23:19.291700+0000","last_became_active":"2023-12-08T08:23:17.921400+0000","last_became_peered":"2023-12-08T08:23:17.921400+0000","last_unstale":"2023-12-08T08:23:19.291700+0000","last_undegraded":"2023-12-08T08:23:19.291700+0000","last_fullsized":"2023-12-08T08:23:19.291700+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:16.880943+0000","last_clean_scrub_stamp":"2023-12-08T08:23:16.880943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:42:37.675933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.926065+0000","last_change":"2023-12-08T08:23:16.918926+0000","last_active":"2023-12-08T08:23:17.926065+0000","last_peered":"2023-12-08T08:23:17.926065+0000","last_clean":"2023-12-08T08:23:17.926065+0000","last_became_active":"2023-12-08T08:23:16.918626+0000","last_became_peered":"2023-12-08T08:23:16.918626+0000","last_unstale":"2023-12-08T08:23:17.926065+0000","last_undegraded":"2023-12-08T08:23:17.926065+0000","last_fullsized":"2023-12-08T08:23:17.926065+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:23:15.873012+0000","last_clean_scrub_stamp":"2023-12-08T08:23:15.873012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:33:44.699786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.895468+0000","last_change":"2023-12-08T08:23:00.270574+0000","last_active":"2023-12-08T08:23:17.895468+0000","last_peered":"2023-12-08T08:23:17.895468+0000","last_clean":"2023-12-08T08:23:17.895468+0000","last_became_active":"2023-12-08T08:23:00.270304+0000","last_became_peered":"2023-12-08T08:23:00.270304+0000","last_unstale":"2023-12-08T08:23:17.895468+0000","last_undegraded":"2023-12-08T08:23:17.895468+0000","last_fullsized":"2023-12-08T08:23:17.895468+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:59.243703+0000","last_clean_scrub_stamp":"2023-12-08T08:22:59.243703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:15:55.762883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"67'1","reported_seq":17,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.910213+0000","last_change":"2023-12-08T08:22:59.275324+0000","last_active":"2023-12-08T08:23:17.910213+0000","last_peered":"2023-12-08T08:23:17.910213+0000","last_clean":"2023-12-08T08:23:17.910213+0000","last_became_active":"2023-12-08T08:22:59.275038+0000","last_became_peered":"2023-12-08T08:22:59.275038+0000","last_unstale":"2023-12-08T08:23:17.910213+0000","last_undegraded":"2023-12-08T08:23:17.910213+0000","last_fullsized":"2023-12-08T08:23:17.910213+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:22:58.236083+0000","last_clean_scrub_stamp":"2023-12-08T08:22:58.236083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:09.089659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":209,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-08T08:23:17.905657+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:23:17.905657+0000","last_peered":"2023-12-08T08:23:17.905657+0000","last_clean":"2023-12-08T08:23:17.905657+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:23:17.905657+0000","last_undegraded":"2023-12-08T08:23:17.905657+0000","last_fullsized":"2023-12-08T08:23:17.905657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":962560,"data_stored":983664,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.64900000000000002,"15min":0.64400000000000002},"min":{"1min":0.49399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.71899999999999997,"15min":0.74099999999999999},"min":{"1min":0.53400000000000003,"5min":0.372,"15min":0.372},"max":{"1min":1.0109999999999999,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.753}]},{"osd":1,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70099999999999996,"15min":0.71899999999999997},"min":{"1min":0.47199999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.94299999999999995,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.73499999999999999,"15min":0.753},"min":{"1min":0.54300000000000004,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.96099999999999997,"5min":1.446,"15min":1.446},"last":0.65600000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.98899999999999999,"5min":1.379,"15min":1.379},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71899999999999997,"15min":0.73099999999999998},"min":{"1min":0.56799999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.90500000000000003,"5min":1.706,"15min":1.706},"last":0.66800000000000004}]},{"osd":3,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73699999999999999,"15min":0.75900000000000001},"min":{"1min":0.51000000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93899999999999995,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.76100000000000001,"15min":0.78700000000000003},"min":{"1min":0.52100000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.90100000000000002,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.76600000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.69799999999999995,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88600000000000001,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.70699999999999996,"15min":0.73499999999999999},"min":{"1min":0.48799999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89800000000000002,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.64100000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.753,"15min":0.78800000000000003},"min":{"1min":0.44500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.94099999999999995,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.76000000000000001,"15min":0.79400000000000004},"min":{"1min":0.52300000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.95199999999999996,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.623}]},{"osd":6,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.82499999999999996,"15min":0.85699999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.92300000000000004,"5min":1.573,"15min":1.573},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.77800000000000002,"15min":0.80800000000000005},"min":{"1min":0.55100000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97099999999999997,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.69599999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":905216,"data_stored":394460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.66800000000000004},"min":{"1min":0.49099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.56899999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94599999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.70599999999999996}]},{"osd":1,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72499999999999998,"15min":0.71899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73599999999999999,"15min":0.73399999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.54300000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70899999999999996,"15min":0.72499999999999998},"min":{"1min":0.50700000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.90900000000000003,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73599999999999999,"15min":0.746},"min":{"1min":0.48899999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.66700000000000004}]},{"osd":3,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.73799999999999999,"15min":0.75700000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.46600000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.96299999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.64000000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.70199999999999996,"15min":0.72599999999999998},"min":{"1min":0.42899999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83399999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.71699999999999997,"15min":0.755},"min":{"1min":0.496,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79700000000000004,"5min":1.014,"15min":1.014},"last":0.746}]},{"osd":5,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.75,"15min":0.79100000000000004},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83099999999999996,"5min":1.091,"15min":1.091},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.81699999999999995,"15min":0.84299999999999997},"min":{"1min":0.57199999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0149999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.72199999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78600000000000003,"15min":0.81599999999999995},"min":{"1min":0.61799999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.89000000000000001,"5min":1.04,"15min":1.04},"last":0.62},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.84199999999999997,"15min":0.89200000000000002},"min":{"1min":0.55400000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96499999999999997,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.73399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":905216,"data_stored":396313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.621,"15min":0.622},"min":{"1min":0.47599999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.042,"5min":1.081,"15min":1.081},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68300000000000005,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.024,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.74199999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69099999999999995,"15min":0.68100000000000005},"min":{"1min":0.42399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98599999999999999,"5min":1.194,"15min":1.194},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.006,"5min":1.143,"15min":1.143},"last":0.58899999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.47999999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0880000000000001,"5min":1.101,"15min":1.101},"last":0.60999999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72999999999999998,"15min":0.74199999999999999},"min":{"1min":0.52300000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.76300000000000001,"15min":0.753},"min":{"1min":0.56200000000000006,"5min":0.5,"15min":0.5},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.72599999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.40899999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.96299999999999997,"5min":1.01,"15min":1.01},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.58899999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.048,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.75700000000000001,"15min":0.77900000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89900000000000002,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91000000000000003,"5min":1.073,"15min":1.073},"last":0.67600000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77600000000000002,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95999999999999996,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83599999999999997,"15min":0.85599999999999998},"min":{"1min":0.56299999999999994,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0800000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.76600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":905216,"data_stored":394850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.68000000000000005,"15min":0.69399999999999995},"min":{"1min":0.502,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86099999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.68300000000000005,"15min":0.66800000000000004},"min":{"1min":0.59399999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95099999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.73799999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70799999999999996,"15min":0.71299999999999997},"min":{"1min":0.52800000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90100000000000002,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68100000000000005,"15min":0.68200000000000005},"min":{"1min":0.505,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.84499999999999997,"5min":1.002,"15min":1.002},"last":0.63600000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68999999999999995},"min":{"1min":0.54200000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88400000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.54400000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.84699999999999998,"5min":1.056,"15min":1.056},"last":0.60599999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.58999999999999997,"5min":0.496,"15min":0.496},"max":{"1min":0.95299999999999996,"5min":1.359,"15min":1.359},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.755,"15min":0.78500000000000003},"min":{"1min":0.51800000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99399999999999999,"5min":1.232,"15min":1.232},"last":0.55600000000000005}]},{"osd":5,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.64200000000000002,"15min":0.66800000000000004},"min":{"1min":0.39000000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90800000000000003,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.745,"15min":0.78100000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95199999999999996,"5min":1.091,"15min":1.091},"last":0.70999999999999996}]},{"osd":6,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.68600000000000005,"15min":0.71499999999999997},"min":{"1min":0.41699999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.92500000000000004,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.624},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.76300000000000001,"15min":0.78900000000000003},"min":{"1min":0.45300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98199999999999998,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.78500000000000003}]},{"osd":7,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.97699999999999998,"5min":1.246,"15min":1.246},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.80200000000000005},"min":{"1min":0.50800000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.004,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.72499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":913408,"data_stored":397855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41799999999999998,"15min":0.432},"min":{"1min":0.26500000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.56000000000000005,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45600000000000002,"15min":0.46300000000000002},"min":{"1min":0.309,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73999999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.443}]},{"osd":1,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.435,"15min":0.436},"min":{"1min":0.317,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.58099999999999996,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.56599999999999995}]},{"osd":2,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.50900000000000001,"15min":0.52200000000000002},"min":{"1min":0.35299999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52900000000000003,"15min":0.54100000000000004},"min":{"1min":0.40600000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65200000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.59599999999999997}]},{"osd":4,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0620000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.54300000000000004,"5min":0.497,"15min":0.497},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.70499999999999996}]},{"osd":5,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.52000000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.76200000000000001,"15min":0.77100000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.82999999999999996}]},{"osd":6,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.56899999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.101,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.754}]},{"osd":7,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.76200000000000001,"15min":0.75900000000000001},"min":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.58599999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1080000000000001,"5min":1.121,"15min":1.121},"last":0.77700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":892928,"data_stored":393730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39100000000000001,"15min":0.40100000000000002},"min":{"1min":0.27900000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.497,"15min":0.53100000000000003},"min":{"1min":0.315,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67700000000000005,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.34399999999999997}]},{"osd":1,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.32200000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51500000000000001,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.40100000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.54300000000000004,"15min":0.57699999999999996},"min":{"1min":0.34899999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.57799999999999996,"5min":3.008,"15min":3.008},"last":0.44},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47799999999999998,"15min":0.48399999999999999},"min":{"1min":0.33800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.65400000000000003,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.36599999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78300000000000003,"15min":0.81699999999999995},"min":{"1min":0.50900000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.004,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0049999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.79300000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.75700000000000001,"15min":0.76800000000000002},"min":{"1min":0.51000000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98699999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78800000000000003,"15min":0.82899999999999996},"min":{"1min":0.52600000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98799999999999999,"5min":3.637,"15min":3.637},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.78000000000000003,"15min":0.79400000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97499999999999998,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.038,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.83499999999999996,"15min":0.89500000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.88400000000000001,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.82499999999999996,"15min":0.83899999999999997},"min":{"1min":0.56799999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0109999999999999,"5min":1.766,"15min":1.766},"last":0.83399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":897024,"data_stored":393308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.59799999999999998,"15min":0.67600000000000005},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.80300000000000005,"5min":5.2210000000000001,"15min":5.2210000000000001},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.73399999999999999,"15min":0.85899999999999999},"min":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59599999999999997,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.36799999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.71299999999999997,"15min":0.83899999999999997},"min":{"1min":0.32800000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.60999999999999999,"5min":8.2070000000000007,"15min":8.2070000000000007},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.5,"5min":0.63500000000000001,"15min":0.70399999999999996},"min":{"1min":0.34300000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.69299999999999995,"5min":4.351,"15min":4.351},"last":0.35499999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.80900000000000005,"15min":0.94199999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.754,"5min":8.1479999999999997,"15min":8.1479999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.67400000000000004,"15min":0.76900000000000002},"min":{"1min":0.32300000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.72599999999999998,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.33800000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.91000000000000003,"15min":1.012},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0049999999999999,"5min":4.8470000000000004,"15min":4.8470000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.97599999999999998,"15min":1.0820000000000001},"min":{"1min":0.55100000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93999999999999995,"5min":4.7939999999999996,"15min":4.7939999999999996},"last":0.54100000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.90500000000000003,"15min":0.98699999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99199999999999999,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.89900000000000002,"15min":0.97899999999999998},"min":{"1min":0.53000000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.107,"5min":4.5830000000000002,"15min":4.5830000000000002},"last":0.56000000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.97999999999999998,"15min":1.097},"min":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.95799999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.97199999999999998,"15min":1.075},"min":{"1min":0.59399999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.95799999999999996,"5min":4.6289999999999996,"15min":4.6289999999999996},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.91600000000000004,"15min":1.002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.97699999999999998,"5min":4.665,"15min":4.665},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.98199999999999998,"15min":1.0860000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.089,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.52900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":958464,"data_stored":984098,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46899999999999997,"15min":0.495},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64000000000000001,"5min":1.863,"15min":1.863},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.75600000000000001,"15min":0.88600000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70799999999999996,"5min":8.2799999999999994,"15min":8.2799999999999994},"last":0.38}]},{"osd":2,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.78000000000000003,"15min":0.93200000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77300000000000002,"5min":7.9290000000000003,"15min":7.9290000000000003},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.78200000000000003,"15min":0.93700000000000006},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.628,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.435}]},{"osd":3,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.59799999999999998,"15min":0.67200000000000004},"min":{"1min":0.33100000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58699999999999997,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.75600000000000001,"15min":0.872},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82399999999999995,"5min":7.8890000000000002,"15min":7.8890000000000002},"last":0.41799999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.94899999999999995,"15min":1.0529999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95399999999999996,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.753,"15min":0.77800000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88600000000000001,"5min":1.607,"15min":1.607},"last":0.58499999999999996}]},{"osd":5,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.81100000000000005,"15min":0.83099999999999996},"min":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96899999999999997,"5min":1.514,"15min":1.514},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.98899999999999999,"15min":1.1100000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91000000000000003,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79200000000000004,"15min":0.82699999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.88,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.95399999999999996,"15min":1.0549999999999999},"min":{"1min":0.56100000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.89900000000000002,"5min":7.835,"15min":7.835},"last":0.56699999999999995}]},{"osd":7,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.97399999999999998,"15min":1.0800000000000001},"min":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.99299999999999999,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.81000000000000005,"15min":0.85399999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95199999999999996,"5min":1.794,"15min":1.794},"last":0.52900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:23:26.866 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-08T08:23:26.867 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-12-08T08:23:27.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.038+0000 7fd9dac79640 1 Processor -- start 2023-12-08T08:23:27.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.038+0000 7fd9dac79640 1 -- start start 2023-12-08T08:23:27.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.042+0000 7fd9dac79640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd9d406d840 0x7fd9d40c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:27.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.042+0000 7fd9dac79640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d4152910 con 0x7fd9d414f850 2023-12-08T08:23:27.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.042+0000 7fd9dac79640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d4152bf0 con 0x7fd9d414fc30 2023-12-08T08:23:27.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.042+0000 7fd9dac79640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d40c2240 con 0x7fd9d406d840 2023-12-08T08:23:27.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.042+0000 7fd9d9216640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd9d406d840 0x7fd9d40c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:27.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.042+0000 7fd9d8a15640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd9d414f850 0x7fd9d40aacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38016/0 (socket says 172.21.15.88:38016) 2023-12-08T08:23:27.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.042+0000 7fd9d8a15640 1 -- 172.21.15.88:0/1155050925 learned_addr learned my addr 172.21.15.88:0/1155050925 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:27.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.042+0000 7fd9d9216640 1 -- 172.21.15.88:0/1155050925 >> v1:172.21.15.148:6789/0 conn(0x7fd9d414fc30 legacy=0x7fd9d40c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:27.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.042+0000 7fd9d9216640 1 -- 172.21.15.88:0/1155050925 >> v1:172.21.15.88:6789/0 conn(0x7fd9d414f850 legacy=0x7fd9d40aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:27.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.042+0000 7fd9d9216640 1 -- 172.21.15.88:0/1155050925 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d4152ed0 con 0x7fd9d406d840 2023-12-08T08:23:27.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.042+0000 7fd9d37fe640 1 -- 172.21.15.88:0/1155050925 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4143736431 0 0) 0x7fd9d4152910 con 0x7fd9d414f850 2023-12-08T08:23:27.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.046+0000 7fd9d9216640 1 --2- 172.21.15.88:0/1155050925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9d406d840 0x7fd9d40c43e0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc009d90 tx=0x7fd9cc01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5842d4d6363caaa3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:27.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.046+0000 7fd9d37fe640 1 -- 172.21.15.88:0/1155050925 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc0a5a30 con 0x7fd9d406d840 2023-12-08T08:23:27.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.046+0000 7fd9d37fe640 1 -- 172.21.15.88:0/1155050925 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc0a5b90 con 0x7fd9d406d840 2023-12-08T08:23:27.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.046+0000 7fd9d37fe640 1 -- 172.21.15.88:0/1155050925 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc0ad440 con 0x7fd9d406d840 2023-12-08T08:23:27.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.046+0000 7fd9dac79640 1 -- 172.21.15.88:0/1155050925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9d406d840 msgr2=0x7fd9d40c43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:27.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.046+0000 7fd9dac79640 1 --2- 172.21.15.88:0/1155050925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9d406d840 0x7fd9d40c43e0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc009d90 tx=0x7fd9cc01c950 comp rx=0 tx=0).stop 2023-12-08T08:23:27.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.046+0000 7fd9dac79640 1 -- 172.21.15.88:0/1155050925 shutdown_connections 2023-12-08T08:23:27.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.046+0000 7fd9dac79640 1 --2- 172.21.15.88:0/1155050925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9d406d840 0x7fd9d40c43e0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:27.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.046+0000 7fd9dac79640 1 -- 172.21.15.88:0/1155050925 >> 172.21.15.88:0/1155050925 conn(0x7fd9d40c59f0 msgr2=0x7fd9d40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:27.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.046+0000 7fd9dac79640 1 -- 172.21.15.88:0/1155050925 shutdown_connections 2023-12-08T08:23:27.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.046+0000 7fd9dac79640 1 -- 172.21.15.88:0/1155050925 wait complete. 2023-12-08T08:23:27.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.046+0000 7fd9dac79640 1 Processor -- start 2023-12-08T08:23:27.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.046+0000 7fd9dac79640 1 -- start start 2023-12-08T08:23:27.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.050+0000 7fd9dac79640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd9d406d840 0x7fd9d41ed830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:27.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.050+0000 7fd9dac79640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9d414f850 0x7fd9d414ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:27.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.050+0000 7fd9dac79640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9d414fc30 0x7fd9d4155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:27.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.050+0000 7fd9dac79640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d414c3e0 con 0x7fd9d414fc30 2023-12-08T08:23:27.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.050+0000 7fd9dac79640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d4070ee0 con 0x7fd9d414f850 2023-12-08T08:23:27.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.050+0000 7fd9dac79640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d4070bb0 con 0x7fd9d406d840 2023-12-08T08:23:27.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.050+0000 7fd9d9216640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9d414fc30 0x7fd9d4155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:27.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.050+0000 7fd9d9216640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9d414fc30 0x7fd9d4155860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54432/0 (socket says 172.21.15.88:54432) 2023-12-08T08:23:27.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.050+0000 7fd9d9216640 1 -- 172.21.15.88:0/3394507736 learned_addr learned my addr 172.21.15.88:0/3394507736 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:27.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.050+0000 7fd9d8a15640 1 --2- 172.21.15.88:0/3394507736 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd9d406d840 0x7fd9d41ed830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:27.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.050+0000 7fd9d3fff640 1 --2- 172.21.15.88:0/3394507736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9d414f850 0x7fd9d414ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:27.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.050+0000 7fd9d9216640 1 -- 172.21.15.88:0/3394507736 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd9d406d840 msgr2=0x7fd9d41ed830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:27.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.050+0000 7fd9d9216640 1 --2- 172.21.15.88:0/3394507736 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd9d406d840 0x7fd9d41ed830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:27.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.050+0000 7fd9d9216640 1 -- 172.21.15.88:0/3394507736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9d414f850 msgr2=0x7fd9d414ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:27.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.050+0000 7fd9d9216640 1 --2- 172.21.15.88:0/3394507736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9d414f850 0x7fd9d414ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:27.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.050+0000 7fd9d9216640 1 -- 172.21.15.88:0/3394507736 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9cc009a70 con 0x7fd9d414fc30 2023-12-08T08:23:27.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.050+0000 7fd9d9216640 1 --2- 172.21.15.88:0/3394507736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9d414fc30 0x7fd9d4155860 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc019560 tx=0x7fd9cc0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:27.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.050+0000 7fd9d17fa640 1 -- 172.21.15.88:0/3394507736 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc0ade20 con 0x7fd9d414fc30 2023-12-08T08:23:27.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.050+0000 7fd9d17fa640 1 -- 172.21.15.88:0/3394507736 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc0b7410 con 0x7fd9d414fc30 2023-12-08T08:23:27.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.050+0000 7fd9dac79640 1 -- 172.21.15.88:0/3394507736 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d41edd70 con 0x7fd9d414fc30 2023-12-08T08:23:27.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.050+0000 7fd9d17fa640 1 -- 172.21.15.88:0/3394507736 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc0b77c0 con 0x7fd9d414fc30 2023-12-08T08:23:27.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.050+0000 7fd9dac79640 1 -- 172.21.15.88:0/3394507736 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d4153a90 con 0x7fd9d414fc30 2023-12-08T08:23:27.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.050+0000 7fd9dac79640 1 -- 172.21.15.88:0/3394507736 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d4068010 con 0x7fd9d414fc30 2023-12-08T08:23:27.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.050+0000 7fd9d17fa640 1 -- 172.21.15.88:0/3394507736 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd9cc0b4050 con 0x7fd9d414fc30 2023-12-08T08:23:27.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.054+0000 7fd9d17fa640 1 --2- 172.21.15.88:0/3394507736 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd9b8066470 0x7fd9b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:27.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.054+0000 7fd9d17fa640 1 -- 172.21.15.88:0/3394507736 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd9cc11f570 con 0x7fd9d414fc30 2023-12-08T08:23:27.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.054+0000 7fd9d8a15640 1 --2- 172.21.15.88:0/3394507736 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd9b8066470 0x7fd9b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:27.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.054+0000 7fd9d8a15640 1 --2- 172.21.15.88:0/3394507736 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd9b8066470 0x7fd9b8068930 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8007a90 tx=0x7fd9c80079e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:27.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.058+0000 7fd9d17fa640 1 -- 172.21.15.88:0/3394507736 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd9cc0ec730 con 0x7fd9d414fc30 2023-12-08T08:23:27.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.254+0000 7fd9dac79640 1 -- 172.21.15.88:0/3394507736 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7fd9d41514d0 con 0x7fd9d414fc30 2023-12-08T08:23:27.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.258+0000 7fd9d17fa640 1 -- 172.21.15.88:0/3394507736 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v20) v1 ==== 185+0+142 (secure 0 0 0) 0x7fd9cc0b20a0 con 0x7fd9d414fc30 2023-12-08T08:23:27.263 INFO:teuthology.orchestra.run.smithi088.stdout:[client.1] 2023-12-08T08:23:27.263 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCJ0XJld2rjOBAAUnEIBuqXHktNpqFW/Ikf7g== 2023-12-08T08:23:27.263 INFO:teuthology.orchestra.run.smithi088.stdout: caps mds = "allow" 2023-12-08T08:23:27.263 INFO:teuthology.orchestra.run.smithi088.stdout: caps mon = "allow r" 2023-12-08T08:23:27.263 INFO:teuthology.orchestra.run.smithi088.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-12-08T08:23:27.263 INFO:teuthology.orchestra.run.smithi088.stderr:updated caps for client.1 2023-12-08T08:23:27.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.258+0000 7fd9dac79640 1 -- 172.21.15.88:0/3394507736 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd9b8066470 msgr2=0x7fd9b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:27.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.258+0000 7fd9dac79640 1 --2- 172.21.15.88:0/3394507736 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd9b8066470 0x7fd9b8068930 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8007a90 tx=0x7fd9c80079e0 comp rx=0 tx=0).stop 2023-12-08T08:23:27.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.258+0000 7fd9dac79640 1 -- 172.21.15.88:0/3394507736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9d414fc30 msgr2=0x7fd9d4155860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:27.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.258+0000 7fd9dac79640 1 --2- 172.21.15.88:0/3394507736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9d414fc30 0x7fd9d4155860 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc019560 tx=0x7fd9cc0196f0 comp rx=0 tx=0).stop 2023-12-08T08:23:27.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.258+0000 7fd9dac79640 1 -- 172.21.15.88:0/3394507736 shutdown_connections 2023-12-08T08:23:27.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.258+0000 7fd9dac79640 1 --2- 172.21.15.88:0/3394507736 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd9b8066470 0x7fd9b8068930 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:27.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.262+0000 7fd9dac79640 1 --2- 172.21.15.88:0/3394507736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9d414fc30 0x7fd9d4155860 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:27.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.262+0000 7fd9dac79640 1 --2- 172.21.15.88:0/3394507736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9d414f850 0x7fd9d414ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:27.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.262+0000 7fd9dac79640 1 --2- 172.21.15.88:0/3394507736 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd9d406d840 0x7fd9d41ed830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:27.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.262+0000 7fd9dac79640 1 -- 172.21.15.88:0/3394507736 >> 172.21.15.88:0/3394507736 conn(0x7fd9d40c59f0 msgr2=0x7fd9d40a6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:27.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.262+0000 7fd9dac79640 1 -- 172.21.15.88:0/3394507736 shutdown_connections 2023-12-08T08:23:27.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.262+0000 7fd9dac79640 1 -- 172.21.15.88:0/3394507736 wait complete. 2023-12-08T08:23:27.283 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:23:27.284 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:23:27.294 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:23:27.294 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:23:27.347 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:23:27.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.478+0000 7fbe65d2a640 1 Processor -- start 2023-12-08T08:23:27.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.478+0000 7fbe65d2a640 1 -- start start 2023-12-08T08:23:27.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.482+0000 7fbe65d2a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbe6006bef0 0x7fbe600bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:27.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.482+0000 7fbe65d2a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbe6006c5b0 0x7fbe6006ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:27.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.482+0000 7fbe65d2a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe60151690 con 0x7fbe6014e3f0 2023-12-08T08:23:27.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.482+0000 7fbe65d2a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe60151bc0 con 0x7fbe6006c5b0 2023-12-08T08:23:27.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.482+0000 7fbe65d2a640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe601518e0 con 0x7fbe6006bef0 2023-12-08T08:23:27.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.482+0000 7fbe5ffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbe6006c5b0 0x7fbe6006ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:27.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.482+0000 7fbe5f7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbe6014e3f0 0x7fbe600c41f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38032/0 (socket says 172.21.15.88:38032) 2023-12-08T08:23:27.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.482+0000 7fbe5ffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbe6006c5b0 0x7fbe6006ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54440/0 (socket says 172.21.15.88:54440) 2023-12-08T08:23:27.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.482+0000 7fbe5f7fe640 1 -- 172.21.15.88:0/2531692994 learned_addr learned my addr 172.21.15.88:0/2531692994 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:27.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.482+0000 7fbe5effd640 1 --2- 172.21.15.88:0/2531692994 >> v2:172.21.15.148:3300/0 conn(0x7fbe6006bef0 0x7fbe600bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:27.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.482+0000 7fbe5ffff640 1 -- 172.21.15.88:0/2531692994 >> v2:172.21.15.148:3300/0 conn(0x7fbe6006bef0 msgr2=0x7fbe600bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:27.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.482+0000 7fbe5ffff640 1 --2- 172.21.15.88:0/2531692994 >> v2:172.21.15.148:3300/0 conn(0x7fbe6006bef0 0x7fbe600bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:27.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.482+0000 7fbe5ffff640 1 -- 172.21.15.88:0/2531692994 >> v1:172.21.15.88:6789/0 conn(0x7fbe6014e3f0 legacy=0x7fbe600c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:27.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.482+0000 7fbe5ffff640 1 -- 172.21.15.88:0/2531692994 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe600c1de0 con 0x7fbe6006c5b0 2023-12-08T08:23:27.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.482+0000 7fbe5e7fc640 1 -- 172.21.15.88:0/2531692994 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2033039774 0 0) 0x7fbe60151690 con 0x7fbe6014e3f0 2023-12-08T08:23:27.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.486+0000 7fbe5ffff640 1 --2- 172.21.15.88:0/2531692994 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe6006c5b0 0x7fbe6006ca20 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fbe6006b520 tx=0x7fbe5801ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0652fa824dfe82 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:27.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.486+0000 7fbe5e7fc640 1 -- 172.21.15.88:0/2531692994 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5800b2d0 con 0x7fbe6006c5b0 2023-12-08T08:23:27.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.486+0000 7fbe5e7fc640 1 -- 172.21.15.88:0/2531692994 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe580a77b0 con 0x7fbe6006c5b0 2023-12-08T08:23:27.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.486+0000 7fbe5e7fc640 1 -- 172.21.15.88:0/2531692994 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe580a7b40 con 0x7fbe6006c5b0 2023-12-08T08:23:27.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.486+0000 7fbe65d2a640 1 -- 172.21.15.88:0/2531692994 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe6006c5b0 msgr2=0x7fbe6006ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:27.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.486+0000 7fbe65d2a640 1 --2- 172.21.15.88:0/2531692994 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe6006c5b0 0x7fbe6006ca20 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fbe6006b520 tx=0x7fbe5801ea50 comp rx=0 tx=0).stop 2023-12-08T08:23:27.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.486+0000 7fbe65d2a640 1 -- 172.21.15.88:0/2531692994 shutdown_connections 2023-12-08T08:23:27.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.486+0000 7fbe65d2a640 1 --2- 172.21.15.88:0/2531692994 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe6006c5b0 0x7fbe6006ca20 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:27.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.486+0000 7fbe65d2a640 1 --2- 172.21.15.88:0/2531692994 >> v2:172.21.15.148:3300/0 conn(0x7fbe6006bef0 0x7fbe600bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:27.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.486+0000 7fbe65d2a640 1 -- 172.21.15.88:0/2531692994 >> 172.21.15.88:0/2531692994 conn(0x7fbe600a7810 msgr2=0x7fbe600a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:27.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.486+0000 7fbe65d2a640 1 -- 172.21.15.88:0/2531692994 shutdown_connections 2023-12-08T08:23:27.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.486+0000 7fbe65d2a640 1 -- 172.21.15.88:0/2531692994 wait complete. 2023-12-08T08:23:27.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.486+0000 7fbe65d2a640 1 Processor -- start 2023-12-08T08:23:27.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.486+0000 7fbe65d2a640 1 -- start start 2023-12-08T08:23:27.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.486+0000 7fbe65d2a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe6006bef0 0x7fbe60151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:27.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.486+0000 7fbe65d2a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe6006c5b0 0x7fbe60149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:27.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.490+0000 7fbe65d2a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe6014e3f0 0x7fbe60153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:27.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.490+0000 7fbe65d2a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe60154960 con 0x7fbe6014e3f0 2023-12-08T08:23:27.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.490+0000 7fbe65d2a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe601f0ef0 con 0x7fbe6006c5b0 2023-12-08T08:23:27.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.490+0000 7fbe65d2a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe601f02e0 con 0x7fbe6006bef0 2023-12-08T08:23:27.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.490+0000 7fbe5ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe6014e3f0 0x7fbe60153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:27.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.490+0000 7fbe5ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe6014e3f0 0x7fbe60153990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54456/0 (socket says 172.21.15.88:54456) 2023-12-08T08:23:27.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.490+0000 7fbe5ffff640 1 -- 172.21.15.88:0/254734041 learned_addr learned my addr 172.21.15.88:0/254734041 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:27.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.490+0000 7fbe5ffff640 1 -- 172.21.15.88:0/254734041 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe6006bef0 msgr2=0x7fbe60151df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:27.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.490+0000 7fbe5ffff640 1 --2- 172.21.15.88:0/254734041 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe6006bef0 0x7fbe60151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:27.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.490+0000 7fbe5ffff640 1 -- 172.21.15.88:0/254734041 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe6006c5b0 msgr2=0x7fbe60149f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:27.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.490+0000 7fbe5ffff640 1 --2- 172.21.15.88:0/254734041 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe6006c5b0 0x7fbe60149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:27.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.490+0000 7fbe5ffff640 1 -- 172.21.15.88:0/254734041 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5800bc80 con 0x7fbe6014e3f0 2023-12-08T08:23:27.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.490+0000 7fbe5ffff640 1 --2- 172.21.15.88:0/254734041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe6014e3f0 0x7fbe60153990 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fbe5801c680 tx=0x7fbe5801b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:27.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.490+0000 7fbe47fff640 1 -- 172.21.15.88:0/254734041 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe58009540 con 0x7fbe6014e3f0 2023-12-08T08:23:27.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.490+0000 7fbe47fff640 1 -- 172.21.15.88:0/254734041 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe580096a0 con 0x7fbe6014e3f0 2023-12-08T08:23:27.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.490+0000 7fbe47fff640 1 -- 172.21.15.88:0/254734041 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe58009a50 con 0x7fbe6014e3f0 2023-12-08T08:23:27.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.490+0000 7fbe65d2a640 1 -- 172.21.15.88:0/254734041 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe601f05c0 con 0x7fbe6014e3f0 2023-12-08T08:23:27.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.490+0000 7fbe65d2a640 1 -- 172.21.15.88:0/254734041 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe601f0b80 con 0x7fbe6014e3f0 2023-12-08T08:23:27.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.490+0000 7fbe65d2a640 1 -- 172.21.15.88:0/254734041 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe600a82b0 con 0x7fbe6014e3f0 2023-12-08T08:23:27.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.490+0000 7fbe47fff640 1 -- 172.21.15.88:0/254734041 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbe58009bb0 con 0x7fbe6014e3f0 2023-12-08T08:23:27.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.490+0000 7fbe47fff640 1 --2- 172.21.15.88:0/254734041 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbe4c066470 0x7fbe4c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:27.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.494+0000 7fbe47fff640 1 -- 172.21.15.88:0/254734041 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fbe5811f600 con 0x7fbe6014e3f0 2023-12-08T08:23:27.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.494+0000 7fbe5f7fe640 1 --2- 172.21.15.88:0/254734041 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbe4c066470 0x7fbe4c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:27.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.494+0000 7fbe5f7fe640 1 --2- 172.21.15.88:0/254734041 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbe4c066470 0x7fbe4c068930 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fbe500011f0 tx=0x7fbe50007930 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:27.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.498+0000 7fbe47fff640 1 -- 172.21.15.88:0/254734041 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbe580ec7c0 con 0x7fbe6014e3f0 2023-12-08T08:23:27.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.646+0000 7fbe65d2a640 1 -- 172.21.15.88:0/254734041 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe600c5370 con 0x7fbe6014e3f0 2023-12-08T08:23:27.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.646+0000 7fbe47fff640 1 -- 172.21.15.88:0/254734041 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20190 (secure 0 0 0) 0x7fbe58009e60 con 0x7fbe6014e3f0 2023-12-08T08:23:27.652 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:27.652 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":72,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:23:18.903336+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:57.367467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:58.632605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:23:15.029129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:23:16.271716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:23:27.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.650+0000 7fbe65d2a640 1 -- 172.21.15.88:0/254734041 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbe4c066470 msgr2=0x7fbe4c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:27.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.650+0000 7fbe65d2a640 1 --2- 172.21.15.88:0/254734041 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbe4c066470 0x7fbe4c068930 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fbe500011f0 tx=0x7fbe50007930 comp rx=0 tx=0).stop 2023-12-08T08:23:27.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.650+0000 7fbe65d2a640 1 -- 172.21.15.88:0/254734041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe6014e3f0 msgr2=0x7fbe60153990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:27.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.650+0000 7fbe65d2a640 1 --2- 172.21.15.88:0/254734041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe6014e3f0 0x7fbe60153990 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fbe5801c680 tx=0x7fbe5801b7f0 comp rx=0 tx=0).stop 2023-12-08T08:23:27.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.650+0000 7fbe65d2a640 1 -- 172.21.15.88:0/254734041 shutdown_connections 2023-12-08T08:23:27.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.650+0000 7fbe65d2a640 1 --2- 172.21.15.88:0/254734041 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbe4c066470 0x7fbe4c068930 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:27.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.650+0000 7fbe65d2a640 1 --2- 172.21.15.88:0/254734041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe6014e3f0 0x7fbe60153990 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:27.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.650+0000 7fbe65d2a640 1 --2- 172.21.15.88:0/254734041 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe6006c5b0 0x7fbe60149f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:27.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.650+0000 7fbe65d2a640 1 --2- 172.21.15.88:0/254734041 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbe6006bef0 0x7fbe60151df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:27.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.650+0000 7fbe65d2a640 1 -- 172.21.15.88:0/254734041 >> 172.21.15.88:0/254734041 conn(0x7fbe600a7810 msgr2=0x7fbe6014aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:27.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.650+0000 7fbe65d2a640 1 -- 172.21.15.88:0/254734041 shutdown_connections 2023-12-08T08:23:27.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.650+0000 7fbe65d2a640 1 -- 172.21.15.88:0/254734041 wait complete. 2023-12-08T08:23:27.673 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:22:57.367467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:22:58.632605+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:23:15.029129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:23:16.271716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:23:27.674 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:23:27.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.810+0000 7feca9985640 1 Processor -- start 2023-12-08T08:23:27.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.810+0000 7feca9985640 1 -- start start 2023-12-08T08:23:27.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.810+0000 7feca9985640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feca40ca330 0x7feca40ca710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:27.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.810+0000 7feca9985640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca4151e40 con 0x7feca4154e80 2023-12-08T08:23:27.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.810+0000 7feca9985640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca406b9e0 con 0x7feca40c45a0 2023-12-08T08:23:27.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.810+0000 7feca9985640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca40c54b0 con 0x7feca40ca330 2023-12-08T08:23:27.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.814+0000 7feca9184640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7feca4154e80 0x7feca415ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38036/0 (socket says 172.21.15.88:38036) 2023-12-08T08:23:27.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.814+0000 7feca9184640 1 -- 172.21.15.88:0/3232615813 learned_addr learned my addr 172.21.15.88:0/3232615813 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:27.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.814+0000 7feca8983640 1 --2- 172.21.15.88:0/3232615813 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feca40ca330 0x7feca40ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:27.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.814+0000 7feca37fe640 1 -- 172.21.15.88:0/3232615813 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746229702 0 0) 0x7feca4151e40 con 0x7feca4154e80 2023-12-08T08:23:27.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.814+0000 7feca37fe640 1 -- 172.21.15.88:0/3232615813 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec94003530 con 0x7feca4154e80 2023-12-08T08:23:27.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.814+0000 7feca37fe640 1 -- 172.21.15.88:0/3232615813 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1661160880 0 0) 0x7feca406b9e0 con 0x7feca40c45a0 2023-12-08T08:23:27.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.814+0000 7feca37fe640 1 -- 172.21.15.88:0/3232615813 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feca4151e40 con 0x7feca40c45a0 2023-12-08T08:23:27.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.814+0000 7feca8983640 1 -- 172.21.15.88:0/3232615813 >> v1:172.21.15.148:6789/0 conn(0x7feca40c45a0 legacy=0x7feca40c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:27.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.814+0000 7feca8983640 1 -- 172.21.15.88:0/3232615813 >> v1:172.21.15.88:6789/0 conn(0x7feca4154e80 legacy=0x7feca415ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:27.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.814+0000 7feca8983640 1 -- 172.21.15.88:0/3232615813 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca40c4ca0 con 0x7feca40ca330 2023-12-08T08:23:27.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.814+0000 7feca8983640 1 --2- 172.21.15.88:0/3232615813 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feca40ca330 0x7feca40ca710 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fec980097f0 tx=0x7fec9801ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43be8bb3169246d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:27.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.814+0000 7feca37fe640 1 -- 172.21.15.88:0/3232615813 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec980a89b0 con 0x7feca40ca330 2023-12-08T08:23:27.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.814+0000 7feca37fe640 1 -- 172.21.15.88:0/3232615813 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec980a8b10 con 0x7feca40ca330 2023-12-08T08:23:27.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.814+0000 7feca37fe640 1 -- 172.21.15.88:0/3232615813 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec980a8ea0 con 0x7feca40ca330 2023-12-08T08:23:27.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.818+0000 7feca9985640 1 -- 172.21.15.88:0/3232615813 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feca40ca330 msgr2=0x7feca40ca710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:27.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.818+0000 7feca9985640 1 --2- 172.21.15.88:0/3232615813 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feca40ca330 0x7feca40ca710 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fec980097f0 tx=0x7fec9801ecb0 comp rx=0 tx=0).stop 2023-12-08T08:23:27.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.818+0000 7feca9985640 1 -- 172.21.15.88:0/3232615813 shutdown_connections 2023-12-08T08:23:27.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.818+0000 7feca9985640 1 --2- 172.21.15.88:0/3232615813 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feca40ca330 0x7feca40ca710 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:27.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.818+0000 7feca9985640 1 -- 172.21.15.88:0/3232615813 >> 172.21.15.88:0/3232615813 conn(0x7feca40abdb0 msgr2=0x7feca40c9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:27.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.818+0000 7feca9985640 1 -- 172.21.15.88:0/3232615813 shutdown_connections 2023-12-08T08:23:27.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.818+0000 7feca9985640 1 -- 172.21.15.88:0/3232615813 wait complete. 2023-12-08T08:23:27.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.818+0000 7feca9985640 1 Processor -- start 2023-12-08T08:23:27.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.818+0000 7feca9985640 1 -- start start 2023-12-08T08:23:27.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.818+0000 7feca9985640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feca40c45a0 0x7feca41ec950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:27.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.818+0000 7feca9985640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca40ca330 0x7feca41ed340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:27.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.818+0000 7feca9985640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feca4154e80 0x7feca41ed880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:27.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.818+0000 7feca9985640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca40c1830 con 0x7feca40ca330 2023-12-08T08:23:27.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.818+0000 7feca9985640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca40c3560 con 0x7feca4154e80 2023-12-08T08:23:27.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.818+0000 7feca9985640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca41eb240 con 0x7feca40c45a0 2023-12-08T08:23:27.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.818+0000 7feca3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca40ca330 0x7feca41ed340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:27.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.818+0000 7feca3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca40ca330 0x7feca41ed340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54472/0 (socket says 172.21.15.88:54472) 2023-12-08T08:23:27.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.818+0000 7feca3fff640 1 -- 172.21.15.88:0/377601666 learned_addr learned my addr 172.21.15.88:0/377601666 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:27.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.818+0000 7feca8983640 1 --2- 172.21.15.88:0/377601666 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feca40c45a0 0x7feca41ec950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:27.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.818+0000 7feca9184640 1 --2- 172.21.15.88:0/377601666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feca4154e80 0x7feca41ed880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:27.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.818+0000 7feca3fff640 1 -- 172.21.15.88:0/377601666 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feca40c45a0 msgr2=0x7feca41ec950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:27.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.818+0000 7feca3fff640 1 --2- 172.21.15.88:0/377601666 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feca40c45a0 0x7feca41ec950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:27.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.822+0000 7feca3fff640 1 -- 172.21.15.88:0/377601666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feca4154e80 msgr2=0x7feca41ed880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:27.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.822+0000 7feca3fff640 1 --2- 172.21.15.88:0/377601666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feca4154e80 0x7feca41ed880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:27.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.822+0000 7feca3fff640 1 -- 172.21.15.88:0/377601666 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec98009420 con 0x7feca40ca330 2023-12-08T08:23:27.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.822+0000 7feca9184640 1 --2- 172.21.15.88:0/377601666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feca4154e80 0x7feca41ed880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:27.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.822+0000 7feca3fff640 1 --2- 172.21.15.88:0/377601666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca40ca330 0x7feca41ed340 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fec9000c490 tx=0x7fec9000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:27.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.822+0000 7feca17fa640 1 -- 172.21.15.88:0/377601666 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec900052d0 con 0x7feca40ca330 2023-12-08T08:23:27.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.822+0000 7feca17fa640 1 -- 172.21.15.88:0/377601666 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec90005430 con 0x7feca40ca330 2023-12-08T08:23:27.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.822+0000 7feca9985640 1 -- 172.21.15.88:0/377601666 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca41edef0 con 0x7feca40ca330 2023-12-08T08:23:27.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.822+0000 7feca17fa640 1 -- 172.21.15.88:0/377601666 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec90012870 con 0x7feca40ca330 2023-12-08T08:23:27.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.822+0000 7feca9985640 1 -- 172.21.15.88:0/377601666 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca40c3ac0 con 0x7feca40ca330 2023-12-08T08:23:27.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.822+0000 7feca9985640 1 -- 172.21.15.88:0/377601666 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca40c19a0 con 0x7feca40ca330 2023-12-08T08:23:27.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.822+0000 7feca17fa640 1 -- 172.21.15.88:0/377601666 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fec900129d0 con 0x7feca40ca330 2023-12-08T08:23:27.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.822+0000 7feca17fa640 1 --2- 172.21.15.88:0/377601666 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fec88066470 0x7fec88068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:27.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.822+0000 7feca17fa640 1 -- 172.21.15.88:0/377601666 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fec90083c90 con 0x7feca40ca330 2023-12-08T08:23:27.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.822+0000 7feca8983640 1 --2- 172.21.15.88:0/377601666 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fec88066470 0x7fec88068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:27.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.826+0000 7feca8983640 1 --2- 172.21.15.88:0/377601666 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fec88066470 0x7fec88068930 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fec980b2000 tx=0x7fec98008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:27.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.826+0000 7feca17fa640 1 -- 172.21.15.88:0/377601666 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feca40c19a0 con 0x7feca40ca330 2023-12-08T08:23:27.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.978+0000 7feca9985640 1 -- 172.21.15.88:0/377601666 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feca40c1970 con 0x7feca40ca330 2023-12-08T08:23:27.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.978+0000 7feca17fa640 1 -- 172.21.15.88:0/377601666 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7fec900548d0 con 0x7feca40ca330 2023-12-08T08:23:27.985 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:23:27.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.982+0000 7feca9985640 1 -- 172.21.15.88:0/377601666 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fec88066470 msgr2=0x7fec88068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:27.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.982+0000 7feca9985640 1 --2- 172.21.15.88:0/377601666 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fec88066470 0x7fec88068930 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fec980b2000 tx=0x7fec98008040 comp rx=0 tx=0).stop 2023-12-08T08:23:27.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.982+0000 7feca9985640 1 -- 172.21.15.88:0/377601666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca40ca330 msgr2=0x7feca41ed340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:27.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.982+0000 7feca9985640 1 --2- 172.21.15.88:0/377601666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca40ca330 0x7feca41ed340 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fec9000c490 tx=0x7fec9000c950 comp rx=0 tx=0).stop 2023-12-08T08:23:27.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.982+0000 7feca9985640 1 -- 172.21.15.88:0/377601666 shutdown_connections 2023-12-08T08:23:27.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.982+0000 7feca9985640 1 --2- 172.21.15.88:0/377601666 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fec88066470 0x7fec88068930 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:27.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.982+0000 7feca9985640 1 --2- 172.21.15.88:0/377601666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feca4154e80 0x7feca41ed880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:27.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.982+0000 7feca9985640 1 --2- 172.21.15.88:0/377601666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca40ca330 0x7feca41ed340 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:27.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.982+0000 7feca9985640 1 --2- 172.21.15.88:0/377601666 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feca40c45a0 0x7feca41ec950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:27.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.982+0000 7feca9985640 1 -- 172.21.15.88:0/377601666 >> 172.21.15.88:0/377601666 conn(0x7feca40abdb0 msgr2=0x7feca414c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:27.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.982+0000 7feca9985640 1 -- 172.21.15.88:0/377601666 shutdown_connections 2023-12-08T08:23:27.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:27.982+0000 7feca9985640 1 -- 172.21.15.88:0/377601666 wait complete. 2023-12-08T08:23:28.005 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:23:28.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.138+0000 7fa54bc46640 1 Processor -- start 2023-12-08T08:23:28.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.142+0000 7fa54bc46640 1 -- start start 2023-12-08T08:23:28.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.142+0000 7fa54bc46640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa54414f850 0x7fa5440aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:28.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.142+0000 7fa54bc46640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa54414fc30 0x7fa5440c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:28.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.142+0000 7fa54bc46640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa54406d840 0x7fa5440c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:28.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.142+0000 7fa54bc46640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5440c2240 con 0x7fa54414f850 2023-12-08T08:23:28.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.142+0000 7fa54bc46640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa544152910 con 0x7fa54406d840 2023-12-08T08:23:28.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.142+0000 7fa54bc46640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa544152bf0 con 0x7fa54414fc30 2023-12-08T08:23:28.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.142+0000 7fa5499e2640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa54414f850 0x7fa5440aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:28.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.142+0000 7fa5499e2640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa54414f850 0x7fa5440aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54476/0 (socket says 172.21.15.88:54476) 2023-12-08T08:23:28.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.142+0000 7fa5499e2640 1 -- 172.21.15.88:0/1181424561 learned_addr learned my addr 172.21.15.88:0/1181424561 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:28.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.142+0000 7fa54a1e3640 1 --2- 172.21.15.88:0/1181424561 >> v2:172.21.15.148:3300/0 conn(0x7fa54406d840 0x7fa5440c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:28.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.142+0000 7fa5491e1640 1 --2- 172.21.15.88:0/1181424561 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa54414fc30 0x7fa5440c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:28.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.142+0000 7fa5499e2640 1 -- 172.21.15.88:0/1181424561 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa54414fc30 msgr2=0x7fa5440c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:28.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.142+0000 7fa5499e2640 1 --2- 172.21.15.88:0/1181424561 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa54414fc30 0x7fa5440c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.142+0000 7fa5499e2640 1 -- 172.21.15.88:0/1181424561 >> v2:172.21.15.148:3300/0 conn(0x7fa54406d840 msgr2=0x7fa5440c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:28.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.142+0000 7fa5499e2640 1 --2- 172.21.15.88:0/1181424561 >> v2:172.21.15.148:3300/0 conn(0x7fa54406d840 0x7fa5440c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.142+0000 7fa5499e2640 1 -- 172.21.15.88:0/1181424561 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa544152ed0 con 0x7fa54414f850 2023-12-08T08:23:28.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.146+0000 7fa5499e2640 1 --2- 172.21.15.88:0/1181424561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa54414f850 0x7fa5440aacf0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fa54406e1a0 tx=0x7fa54001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac01bf8d9d898507 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:28.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.146+0000 7fa5489e0640 1 -- 172.21.15.88:0/1181424561 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5400aa640 con 0x7fa54414f850 2023-12-08T08:23:28.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.146+0000 7fa5489e0640 1 -- 172.21.15.88:0/1181424561 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5400aa7a0 con 0x7fa54414f850 2023-12-08T08:23:28.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.146+0000 7fa5489e0640 1 -- 172.21.15.88:0/1181424561 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5400aab30 con 0x7fa54414f850 2023-12-08T08:23:28.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.146+0000 7fa54bc46640 1 -- 172.21.15.88:0/1181424561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa54414f850 msgr2=0x7fa5440aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:28.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.146+0000 7fa54bc46640 1 --2- 172.21.15.88:0/1181424561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa54414f850 0x7fa5440aacf0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fa54406e1a0 tx=0x7fa54001c500 comp rx=0 tx=0).stop 2023-12-08T08:23:28.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.146+0000 7fa54bc46640 1 -- 172.21.15.88:0/1181424561 shutdown_connections 2023-12-08T08:23:28.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.146+0000 7fa54bc46640 1 --2- 172.21.15.88:0/1181424561 >> v2:172.21.15.148:3300/0 conn(0x7fa54406d840 0x7fa5440c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.146+0000 7fa54bc46640 1 --2- 172.21.15.88:0/1181424561 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa54414fc30 0x7fa5440c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.146+0000 7fa54bc46640 1 --2- 172.21.15.88:0/1181424561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa54414f850 0x7fa5440aacf0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.146+0000 7fa54bc46640 1 -- 172.21.15.88:0/1181424561 >> 172.21.15.88:0/1181424561 conn(0x7fa5440c59f0 msgr2=0x7fa5440c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:28.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.146+0000 7fa54bc46640 1 -- 172.21.15.88:0/1181424561 shutdown_connections 2023-12-08T08:23:28.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.146+0000 7fa54bc46640 1 -- 172.21.15.88:0/1181424561 wait complete. 2023-12-08T08:23:28.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.146+0000 7fa54bc46640 1 Processor -- start 2023-12-08T08:23:28.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.146+0000 7fa54bc46640 1 -- start start 2023-12-08T08:23:28.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.150+0000 7fa54bc46640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa54406d840 0x7fa5441f1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:28.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.150+0000 7fa54bc46640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa54414f850 0x7fa54415b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:28.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.150+0000 7fa54bc46640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa54414fc30 0x7fa5441edae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:28.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.150+0000 7fa54bc46640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5441ed3d0 con 0x7fa54414f850 2023-12-08T08:23:28.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.150+0000 7fa54bc46640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5441f1890 con 0x7fa54406d840 2023-12-08T08:23:28.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.150+0000 7fa54bc46640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5440a6970 con 0x7fa54414fc30 2023-12-08T08:23:28.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.150+0000 7fa5491e1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa54414f850 0x7fa54415b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:28.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.150+0000 7fa5499e2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa54406d840 0x7fa5441f1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:28.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.150+0000 7fa5491e1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa54414f850 0x7fa54415b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54492/0 (socket says 172.21.15.88:54492) 2023-12-08T08:23:28.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.150+0000 7fa5499e2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa54406d840 0x7fa5441f1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:49518/0 (socket says 172.21.15.88:49518) 2023-12-08T08:23:28.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.150+0000 7fa5491e1640 1 -- 172.21.15.88:0/1534194935 learned_addr learned my addr 172.21.15.88:0/1534194935 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:28.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.150+0000 7fa54a1e3640 1 --2- 172.21.15.88:0/1534194935 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa54414fc30 0x7fa5441edae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:28.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.150+0000 7fa5491e1640 1 -- 172.21.15.88:0/1534194935 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa54414fc30 msgr2=0x7fa5441edae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:28.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.150+0000 7fa5491e1640 1 --2- 172.21.15.88:0/1534194935 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa54414fc30 0x7fa5441edae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.150+0000 7fa5491e1640 1 -- 172.21.15.88:0/1534194935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa54406d840 msgr2=0x7fa5441f1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:28.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.150+0000 7fa5491e1640 1 --2- 172.21.15.88:0/1534194935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa54406d840 0x7fa5441f1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.150+0000 7fa5491e1640 1 -- 172.21.15.88:0/1534194935 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5400094d0 con 0x7fa54414f850 2023-12-08T08:23:28.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.150+0000 7fa5499e2640 1 --2- 172.21.15.88:0/1534194935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa54406d840 0x7fa5441f1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:23:28.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.150+0000 7fa5491e1640 1 --2- 172.21.15.88:0/1534194935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa54414f850 0x7fa54415b480 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fa53400d620 tx=0x7fa53400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:28.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.150+0000 7fa53a7fc640 1 -- 172.21.15.88:0/1534194935 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5340125f0 con 0x7fa54414f850 2023-12-08T08:23:28.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.150+0000 7fa53a7fc640 1 -- 172.21.15.88:0/1534194935 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa534012750 con 0x7fa54414f850 2023-12-08T08:23:28.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.150+0000 7fa54bc46640 1 -- 172.21.15.88:0/1534194935 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5440a6c50 con 0x7fa54414f850 2023-12-08T08:23:28.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.150+0000 7fa53a7fc640 1 -- 172.21.15.88:0/1534194935 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa534012ae0 con 0x7fa54414f850 2023-12-08T08:23:28.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.150+0000 7fa54bc46640 1 -- 172.21.15.88:0/1534194935 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5440a7210 con 0x7fa54414f850 2023-12-08T08:23:28.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.150+0000 7fa54bc46640 1 -- 172.21.15.88:0/1534194935 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa544067630 con 0x7fa54414f850 2023-12-08T08:23:28.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.150+0000 7fa53a7fc640 1 -- 172.21.15.88:0/1534194935 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa534012c40 con 0x7fa54414f850 2023-12-08T08:23:28.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.154+0000 7fa53a7fc640 1 --2- 172.21.15.88:0/1534194935 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa528066470 0x7fa528068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:28.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.154+0000 7fa53a7fc640 1 -- 172.21.15.88:0/1534194935 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa5340845b0 con 0x7fa54414f850 2023-12-08T08:23:28.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.154+0000 7fa5499e2640 1 --2- 172.21.15.88:0/1534194935 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa528066470 0x7fa528068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:28.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.154+0000 7fa5499e2640 1 --2- 172.21.15.88:0/1534194935 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa528066470 0x7fa528068930 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa5400ae000 tx=0x7fa5400b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:28.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.158+0000 7fa53a7fc640 1 -- 172.21.15.88:0/1534194935 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa5340516e0 con 0x7fa54414f850 2023-12-08T08:23:28.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.310+0000 7fa54bc46640 1 -- 172.21.15.88:0/1534194935 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa5440a4a90 con 0x7fa54414f850 2023-12-08T08:23:28.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.310+0000 7fa53a7fc640 1 -- 172.21.15.88:0/1534194935 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa534007380 con 0x7fa54414f850 2023-12-08T08:23:28.313 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:23:28.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.310+0000 7fa54bc46640 1 -- 172.21.15.88:0/1534194935 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa528066470 msgr2=0x7fa528068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:28.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.310+0000 7fa54bc46640 1 --2- 172.21.15.88:0/1534194935 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa528066470 0x7fa528068930 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa5400ae000 tx=0x7fa5400b5040 comp rx=0 tx=0).stop 2023-12-08T08:23:28.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.310+0000 7fa54bc46640 1 -- 172.21.15.88:0/1534194935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa54414f850 msgr2=0x7fa54415b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:28.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.310+0000 7fa54bc46640 1 --2- 172.21.15.88:0/1534194935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa54414f850 0x7fa54415b480 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fa53400d620 tx=0x7fa53400dae0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.310+0000 7fa54bc46640 1 -- 172.21.15.88:0/1534194935 shutdown_connections 2023-12-08T08:23:28.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.310+0000 7fa54bc46640 1 --2- 172.21.15.88:0/1534194935 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa528066470 0x7fa528068930 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.310+0000 7fa54bc46640 1 --2- 172.21.15.88:0/1534194935 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa54414fc30 0x7fa5441edae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.310+0000 7fa54bc46640 1 --2- 172.21.15.88:0/1534194935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa54414f850 0x7fa54415b480 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.310+0000 7fa54bc46640 1 --2- 172.21.15.88:0/1534194935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa54406d840 0x7fa5441f1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.310+0000 7fa54bc46640 1 -- 172.21.15.88:0/1534194935 >> 172.21.15.88:0/1534194935 conn(0x7fa5440c59f0 msgr2=0x7fa544150ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:28.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.310+0000 7fa54bc46640 1 -- 172.21.15.88:0/1534194935 shutdown_connections 2023-12-08T08:23:28.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.310+0000 7fa54bc46640 1 -- 172.21.15.88:0/1534194935 wait complete. 2023-12-08T08:23:28.334 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:23:28.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.470+0000 7f8cd926b640 1 Processor -- start 2023-12-08T08:23:28.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.470+0000 7f8cd926b640 1 -- start start 2023-12-08T08:23:28.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.470+0000 7f8cd926b640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8cd40c8850 0x7f8cd40c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:28.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.470+0000 7f8cd926b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd40c2fd0 con 0x7f8cd4158120 2023-12-08T08:23:28.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.470+0000 7f8cd926b640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd40a6d90 con 0x7f8cd4158500 2023-12-08T08:23:28.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.470+0000 7f8cd926b640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd4158a50 con 0x7f8cd40c8850 2023-12-08T08:23:28.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.470+0000 7f8cd2ffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8cd4158120 0x7f8cd406bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38044/0 (socket says 172.21.15.88:38044) 2023-12-08T08:23:28.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.470+0000 7f8cd2ffd640 1 -- 172.21.15.88:0/1529594946 learned_addr learned my addr 172.21.15.88:0/1529594946 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:28.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.470+0000 7f8cca7fc640 1 --2- 172.21.15.88:0/1529594946 >> v2:172.21.15.148:3300/0 conn(0x7f8cd40c8850 0x7f8cd40c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:28.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.470+0000 7f8cd27fc640 1 -- 172.21.15.88:0/1529594946 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19577969 0 0) 0x7f8cd40c2fd0 con 0x7f8cd4158120 2023-12-08T08:23:28.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.470+0000 7f8cd27fc640 1 -- 172.21.15.88:0/1529594946 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cc0003530 con 0x7f8cd4158120 2023-12-08T08:23:28.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.470+0000 7f8cd27fc640 1 -- 172.21.15.88:0/1529594946 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1748213503 0 0) 0x7f8cc0003530 con 0x7f8cd4158120 2023-12-08T08:23:28.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.470+0000 7f8cd27fc640 1 -- 172.21.15.88:0/1529594946 >> v2:172.21.15.148:3300/0 conn(0x7f8cd40c8850 msgr2=0x7f8cd40c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:28.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.470+0000 7f8cd27fc640 1 --2- 172.21.15.88:0/1529594946 >> v2:172.21.15.148:3300/0 conn(0x7f8cd40c8850 0x7f8cd40c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.470+0000 7f8cd27fc640 1 -- 172.21.15.88:0/1529594946 >> v1:172.21.15.148:6789/0 conn(0x7f8cd4158500 legacy=0x7f8cd4154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:28.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.470+0000 7f8cd27fc640 1 -- 172.21.15.88:0/1529594946 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd4158d30 con 0x7f8cd4158120 2023-12-08T08:23:28.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.470+0000 7f8cd27fc640 1 -- 172.21.15.88:0/1529594946 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f8cc4001680 con 0x7f8cd4158120 2023-12-08T08:23:28.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.470+0000 7f8cd27fc640 1 -- 172.21.15.88:0/1529594946 >> v1:172.21.15.88:6789/0 conn(0x7f8cd4158120 legacy=0x7f8cd406bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:28.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.470+0000 7f8cd27fc640 1 --2- 172.21.15.88:0/1529594946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cc00039d0 0x7f8cc0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:28.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.470+0000 7f8cd27fc640 1 --2- 172.21.15.88:0/1529594946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cc00047d0 0x7f8cc0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:28.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.470+0000 7f8cd27fc640 1 --2- 172.21.15.88:0/1529594946 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8cc0005190 0x7f8cc000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:28.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.470+0000 7f8cd27fc640 1 -- 172.21.15.88:0/1529594946 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd4158a50 con 0x7f8cc00047d0 2023-12-08T08:23:28.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.470+0000 7f8cd27fc640 1 -- 172.21.15.88:0/1529594946 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc000c090 con 0x7f8cc00039d0 2023-12-08T08:23:28.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.470+0000 7f8cd27fc640 1 -- 172.21.15.88:0/1529594946 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc000c250 con 0x7f8cc0005190 2023-12-08T08:23:28.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.470+0000 7f8cca7fc640 1 --2- 172.21.15.88:0/1529594946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cc00047d0 0x7f8cc0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:28.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.470+0000 7f8cd2ffd640 1 --2- 172.21.15.88:0/1529594946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cc00039d0 0x7f8cc0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:28.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.474+0000 7f8cd37fe640 1 --2- 172.21.15.88:0/1529594946 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8cc0005190 0x7f8cc000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:28.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.474+0000 7f8cca7fc640 1 -- 172.21.15.88:0/1529594946 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8cc0005190 msgr2=0x7f8cc000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:28.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.474+0000 7f8cca7fc640 1 --2- 172.21.15.88:0/1529594946 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8cc0005190 0x7f8cc000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.474+0000 7f8cca7fc640 1 -- 172.21.15.88:0/1529594946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cc00039d0 msgr2=0x7f8cc0003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:28.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.474+0000 7f8cca7fc640 1 --2- 172.21.15.88:0/1529594946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cc00039d0 0x7f8cc0003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.474+0000 7f8cca7fc640 1 -- 172.21.15.88:0/1529594946 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc0003530 con 0x7f8cc00047d0 2023-12-08T08:23:28.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.474+0000 7f8cd37fe640 1 --2- 172.21.15.88:0/1529594946 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8cc0005190 0x7f8cc000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:28.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.474+0000 7f8cd37fe640 1 -- 172.21.15.88:0/1529594946 reap_dead start 2023-12-08T08:23:28.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.474+0000 7f8cca7fc640 1 --2- 172.21.15.88:0/1529594946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cc00047d0 0x7f8cc0004c50 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009ae0 tx=0x7f8cbc01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd10fd7f58a4547b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:28.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.474+0000 7f8cd27fc640 1 -- 172.21.15.88:0/1529594946 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc0a5530 con 0x7f8cc00047d0 2023-12-08T08:23:28.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.474+0000 7f8cd27fc640 1 -- 172.21.15.88:0/1529594946 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cbc0a5690 con 0x7f8cc00047d0 2023-12-08T08:23:28.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.474+0000 7f8cd27fc640 1 -- 172.21.15.88:0/1529594946 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc0a5a40 con 0x7f8cc00047d0 2023-12-08T08:23:28.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.474+0000 7f8cd926b640 1 -- 172.21.15.88:0/1529594946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cc00047d0 msgr2=0x7f8cc0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:28.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.474+0000 7f8cd926b640 1 --2- 172.21.15.88:0/1529594946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cc00047d0 0x7f8cc0004c50 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009ae0 tx=0x7f8cbc01ca50 comp rx=0 tx=0).stop 2023-12-08T08:23:28.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.474+0000 7f8cd926b640 1 -- 172.21.15.88:0/1529594946 shutdown_connections 2023-12-08T08:23:28.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.474+0000 7f8cd926b640 1 --2- 172.21.15.88:0/1529594946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cc00047d0 0x7f8cc0004c50 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.474+0000 7f8cd926b640 1 -- 172.21.15.88:0/1529594946 >> 172.21.15.88:0/1529594946 conn(0x7f8cd40c7ba0 msgr2=0x7f8cd40c7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:28.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.478+0000 7f8cd926b640 1 -- 172.21.15.88:0/1529594946 shutdown_connections 2023-12-08T08:23:28.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.478+0000 7f8cd926b640 1 -- 172.21.15.88:0/1529594946 wait complete. 2023-12-08T08:23:28.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.478+0000 7f8cd926b640 1 Processor -- start 2023-12-08T08:23:28.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.478+0000 7f8cd926b640 1 -- start start 2023-12-08T08:23:28.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.478+0000 7f8cd926b640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8cc00047d0 0x7f8cd40a7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:28.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.478+0000 7f8cd926b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cd41ee7c0 0x7f8cd40bf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:28.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.478+0000 7f8cd926b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cd40c0590 0x7f8cd40bf740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:28.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.478+0000 7f8cd926b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd40bebe0 con 0x7f8cd41ee7c0 2023-12-08T08:23:28.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.478+0000 7f8cd926b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd40aabd0 con 0x7f8cd40c0590 2023-12-08T08:23:28.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.478+0000 7f8cd926b640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd40aaeb0 con 0x7f8cc00047d0 2023-12-08T08:23:28.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.478+0000 7f8cca7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cd41ee7c0 0x7f8cd40bf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:28.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.478+0000 7f8cca7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cd41ee7c0 0x7f8cd40bf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54504/0 (socket says 172.21.15.88:54504) 2023-12-08T08:23:28.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.478+0000 7f8cca7fc640 1 -- 172.21.15.88:0/3722466387 learned_addr learned my addr 172.21.15.88:0/3722466387 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:28.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.478+0000 7f8cd2ffd640 1 --2- 172.21.15.88:0/3722466387 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8cc00047d0 0x7f8cd40a7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:28.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.478+0000 7f8cd37fe640 1 --2- 172.21.15.88:0/3722466387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cd40c0590 0x7f8cd40bf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:28.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.478+0000 7f8cca7fc640 1 -- 172.21.15.88:0/3722466387 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8cc00047d0 msgr2=0x7f8cd40a7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:28.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.478+0000 7f8cca7fc640 1 --2- 172.21.15.88:0/3722466387 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8cc00047d0 0x7f8cd40a7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.478+0000 7f8cca7fc640 1 -- 172.21.15.88:0/3722466387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cd40c0590 msgr2=0x7f8cd40bf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:28.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.478+0000 7f8cca7fc640 1 --2- 172.21.15.88:0/3722466387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cd40c0590 0x7f8cd40bf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.478+0000 7f8cca7fc640 1 -- 172.21.15.88:0/3722466387 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd40ab190 con 0x7f8cd41ee7c0 2023-12-08T08:23:28.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.478+0000 7f8cd2ffd640 1 --2- 172.21.15.88:0/3722466387 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8cc00047d0 0x7f8cd40a7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:28.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.478+0000 7f8cca7fc640 1 --2- 172.21.15.88:0/3722466387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cd41ee7c0 0x7f8cd40bf200 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc01c880 tx=0x7f8cbc0197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:28.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.482+0000 7f8ccbfff640 1 -- 172.21.15.88:0/3722466387 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc0a5530 con 0x7f8cd41ee7c0 2023-12-08T08:23:28.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.482+0000 7f8ccbfff640 1 -- 172.21.15.88:0/3722466387 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cbc004020 con 0x7f8cd41ee7c0 2023-12-08T08:23:28.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.482+0000 7f8ccbfff640 1 -- 172.21.15.88:0/3722466387 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc0043d0 con 0x7f8cd41ee7c0 2023-12-08T08:23:28.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.482+0000 7f8cd926b640 1 -- 172.21.15.88:0/3722466387 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd40ab470 con 0x7f8cd41ee7c0 2023-12-08T08:23:28.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.482+0000 7f8cd926b640 1 -- 172.21.15.88:0/3722466387 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd40a83d0 con 0x7f8cd41ee7c0 2023-12-08T08:23:28.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.482+0000 7f8cd926b640 1 -- 172.21.15.88:0/3722466387 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd40ab600 con 0x7f8cd41ee7c0 2023-12-08T08:23:28.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.482+0000 7f8ccbfff640 1 -- 172.21.15.88:0/3722466387 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8cbc0b4070 con 0x7f8cd41ee7c0 2023-12-08T08:23:28.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.482+0000 7f8ccbfff640 1 --2- 172.21.15.88:0/3722466387 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8cb40664a0 0x7f8cb4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:28.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.482+0000 7f8ccbfff640 1 -- 172.21.15.88:0/3722466387 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8cbc11e3d0 con 0x7f8cd41ee7c0 2023-12-08T08:23:28.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.482+0000 7f8cd2ffd640 1 --2- 172.21.15.88:0/3722466387 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8cb40664a0 0x7f8cb4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:28.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.482+0000 7f8cd2ffd640 1 --2- 172.21.15.88:0/3722466387 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8cb40664a0 0x7f8cb4068960 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4001060 tx=0x7f8cc4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:28.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.486+0000 7f8ccbfff640 1 -- 172.21.15.88:0/3722466387 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8cbc0eb4f0 con 0x7f8cd41ee7c0 2023-12-08T08:23:28.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.638+0000 7f8cd926b640 1 -- 172.21.15.88:0/3722466387 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8cd4067630 con 0x7f8cd41ee7c0 2023-12-08T08:23:28.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.638+0000 7f8ccbfff640 1 -- 172.21.15.88:0/3722466387 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8cbc0eeb10 con 0x7f8cd41ee7c0 2023-12-08T08:23:28.642 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:23:28.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.638+0000 7f8cd926b640 1 -- 172.21.15.88:0/3722466387 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8cb40664a0 msgr2=0x7f8cb4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:28.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.638+0000 7f8cd926b640 1 --2- 172.21.15.88:0/3722466387 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8cb40664a0 0x7f8cb4068960 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4001060 tx=0x7f8cc4009040 comp rx=0 tx=0).stop 2023-12-08T08:23:28.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.638+0000 7f8cd926b640 1 -- 172.21.15.88:0/3722466387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cd41ee7c0 msgr2=0x7f8cd40bf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:28.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.638+0000 7f8cd926b640 1 --2- 172.21.15.88:0/3722466387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cd41ee7c0 0x7f8cd40bf200 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc01c880 tx=0x7f8cbc0197f0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.638+0000 7f8cd926b640 1 -- 172.21.15.88:0/3722466387 shutdown_connections 2023-12-08T08:23:28.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.638+0000 7f8cd926b640 1 --2- 172.21.15.88:0/3722466387 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8cb40664a0 0x7f8cb4068960 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.638+0000 7f8cd926b640 1 --2- 172.21.15.88:0/3722466387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cd40c0590 0x7f8cd40bf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.638+0000 7f8cd926b640 1 --2- 172.21.15.88:0/3722466387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cd41ee7c0 0x7f8cd40bf200 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.638+0000 7f8cd926b640 1 --2- 172.21.15.88:0/3722466387 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8cc00047d0 0x7f8cd40a7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.638+0000 7f8cd926b640 1 -- 172.21.15.88:0/3722466387 >> 172.21.15.88:0/3722466387 conn(0x7f8cd40c7ba0 msgr2=0x7f8cd41551e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:28.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.638+0000 7f8cd926b640 1 -- 172.21.15.88:0/3722466387 shutdown_connections 2023-12-08T08:23:28.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.638+0000 7f8cd926b640 1 -- 172.21.15.88:0/3722466387 wait complete. 2023-12-08T08:23:28.662 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:23:28.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.798+0000 7f3e6cabb640 1 Processor -- start 2023-12-08T08:23:28.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.798+0000 7f3e6cabb640 1 -- start start 2023-12-08T08:23:28.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.798+0000 7f3e6cabb640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3e6814b1e0 0x7f3e680c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:28.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.798+0000 7f3e6cabb640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e680a4e20 con 0x7f3e681548c0 2023-12-08T08:23:28.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.798+0000 7f3e6cabb640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e680a50e0 con 0x7f3e680c5300 2023-12-08T08:23:28.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.798+0000 7f3e6cabb640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e680c0f00 con 0x7f3e6814b1e0 2023-12-08T08:23:28.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.798+0000 7f3e66d9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3e681548c0 0x7f3e68154d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38046/0 (socket says 172.21.15.88:38046) 2023-12-08T08:23:28.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.798+0000 7f3e66d9d640 1 -- 172.21.15.88:0/3457409815 learned_addr learned my addr 172.21.15.88:0/3457409815 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:28.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.798+0000 7f3e6659c640 1 --2- 172.21.15.88:0/3457409815 >> v2:172.21.15.148:3300/0 conn(0x7f3e6814b1e0 0x7f3e680c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:28.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.798+0000 7f3e6559a640 1 -- 172.21.15.88:0/3457409815 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271491679 0 0) 0x7f3e680a4e20 con 0x7f3e681548c0 2023-12-08T08:23:28.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.798+0000 7f3e6559a640 1 -- 172.21.15.88:0/3457409815 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e50003530 con 0x7f3e681548c0 2023-12-08T08:23:28.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.798+0000 7f3e6559a640 1 -- 172.21.15.88:0/3457409815 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 918462378 0 0) 0x7f3e50003530 con 0x7f3e681548c0 2023-12-08T08:23:28.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.798+0000 7f3e6559a640 1 -- 172.21.15.88:0/3457409815 >> v2:172.21.15.148:3300/0 conn(0x7f3e6814b1e0 msgr2=0x7f3e680c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:28.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.798+0000 7f3e6559a640 1 --2- 172.21.15.88:0/3457409815 >> v2:172.21.15.148:3300/0 conn(0x7f3e6814b1e0 0x7f3e680c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.798+0000 7f3e6559a640 1 -- 172.21.15.88:0/3457409815 >> v1:172.21.15.148:6789/0 conn(0x7f3e680c5300 legacy=0x7f3e680a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.798+0000 7f3e6559a640 1 -- 172.21.15.88:0/3457409815 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e680c11e0 con 0x7f3e681548c0 2023-12-08T08:23:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.798+0000 7f3e6559a640 1 -- 172.21.15.88:0/3457409815 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f3e60001a00 con 0x7f3e681548c0 2023-12-08T08:23:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.798+0000 7f3e6559a640 1 -- 172.21.15.88:0/3457409815 >> v1:172.21.15.88:6789/0 conn(0x7f3e681548c0 legacy=0x7f3e68154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.798+0000 7f3e6559a640 1 --2- 172.21.15.88:0/3457409815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e50003980 0x7f3e50003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.798+0000 7f3e6559a640 1 --2- 172.21.15.88:0/3457409815 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e50004380 0x7f3e50004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.798+0000 7f3e6559a640 1 --2- 172.21.15.88:0/3457409815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e50005050 0x7f3e5000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.798+0000 7f3e6559a640 1 -- 172.21.15.88:0/3457409815 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e680c0f00 con 0x7f3e50005050 2023-12-08T08:23:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.798+0000 7f3e6559a640 1 -- 172.21.15.88:0/3457409815 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5000bfb0 con 0x7f3e50003980 2023-12-08T08:23:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.798+0000 7f3e6559a640 1 -- 172.21.15.88:0/3457409815 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5000c170 con 0x7f3e50004380 2023-12-08T08:23:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.798+0000 7f3e66d9d640 1 --2- 172.21.15.88:0/3457409815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e50005050 0x7f3e5000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.798+0000 7f3e6659c640 1 --2- 172.21.15.88:0/3457409815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e50003980 0x7f3e50003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:28.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.798+0000 7f3e65d9b640 1 --2- 172.21.15.88:0/3457409815 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e50004380 0x7f3e50004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:28.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.802+0000 7f3e66d9d640 1 -- 172.21.15.88:0/3457409815 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e50004380 msgr2=0x7f3e50004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:28.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.802+0000 7f3e66d9d640 1 --2- 172.21.15.88:0/3457409815 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e50004380 0x7f3e50004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.802+0000 7f3e66d9d640 1 -- 172.21.15.88:0/3457409815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e50003980 msgr2=0x7f3e50003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:28.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.802+0000 7f3e66d9d640 1 --2- 172.21.15.88:0/3457409815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e50003980 0x7f3e50003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.802+0000 7f3e66d9d640 1 -- 172.21.15.88:0/3457409815 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e50003530 con 0x7f3e50005050 2023-12-08T08:23:28.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.802+0000 7f3e66d9d640 1 -- 172.21.15.88:0/3457409815 reap_dead start 2023-12-08T08:23:28.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.802+0000 7f3e66d9d640 1 --2- 172.21.15.88:0/3457409815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e50005050 0x7f3e5000b990 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000a830 tx=0x7f3e6001faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9334da5799044655 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:28.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.802+0000 7f3e6559a640 1 -- 172.21.15.88:0/3457409815 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e600af070 con 0x7f3e50005050 2023-12-08T08:23:28.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.802+0000 7f3e6559a640 1 -- 172.21.15.88:0/3457409815 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e600aa4d0 con 0x7f3e50005050 2023-12-08T08:23:28.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.802+0000 7f3e6559a640 1 -- 172.21.15.88:0/3457409815 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e600aa8a0 con 0x7f3e50005050 2023-12-08T08:23:28.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.802+0000 7f3e6cabb640 1 -- 172.21.15.88:0/3457409815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e50005050 msgr2=0x7f3e5000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:28.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.802+0000 7f3e6cabb640 1 --2- 172.21.15.88:0/3457409815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e50005050 0x7f3e5000b990 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000a830 tx=0x7f3e6001faa0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.802+0000 7f3e6cabb640 1 -- 172.21.15.88:0/3457409815 shutdown_connections 2023-12-08T08:23:28.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.802+0000 7f3e6cabb640 1 --2- 172.21.15.88:0/3457409815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e50005050 0x7f3e5000b990 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.802+0000 7f3e6cabb640 1 -- 172.21.15.88:0/3457409815 >> 172.21.15.88:0/3457409815 conn(0x7f3e680c59f0 msgr2=0x7f3e680c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:28.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.806+0000 7f3e6cabb640 1 -- 172.21.15.88:0/3457409815 shutdown_connections 2023-12-08T08:23:28.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.806+0000 7f3e6cabb640 1 -- 172.21.15.88:0/3457409815 wait complete. 2023-12-08T08:23:28.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.806+0000 7f3e6cabb640 1 Processor -- start 2023-12-08T08:23:28.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.806+0000 7f3e6cabb640 1 -- start start 2023-12-08T08:23:28.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.806+0000 7f3e6cabb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e50005050 0x7f3e68145110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:28.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.806+0000 7f3e6cabb640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e680a6970 0x7f3e68153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:28.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.806+0000 7f3e6cabb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e68154050 0x7f3e681e8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:28.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.806+0000 7f3e6cabb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e68071b90 con 0x7f3e50005050 2023-12-08T08:23:28.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.806+0000 7f3e6cabb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e680a74a0 con 0x7f3e68154050 2023-12-08T08:23:28.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.806+0000 7f3e6cabb640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e68145650 con 0x7f3e680a6970 2023-12-08T08:23:28.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.806+0000 7f3e6659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e50005050 0x7f3e68145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:28.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.806+0000 7f3e6659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e50005050 0x7f3e68145110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54522/0 (socket says 172.21.15.88:54522) 2023-12-08T08:23:28.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.806+0000 7f3e6659c640 1 -- 172.21.15.88:0/302725084 learned_addr learned my addr 172.21.15.88:0/302725084 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:28.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.806+0000 7f3e65d9b640 1 --2- 172.21.15.88:0/302725084 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e680a6970 0x7f3e68153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:28.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.806+0000 7f3e66d9d640 1 --2- 172.21.15.88:0/302725084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e68154050 0x7f3e681e8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:28.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.806+0000 7f3e6659c640 1 -- 172.21.15.88:0/302725084 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e680a6970 msgr2=0x7f3e68153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:28.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.806+0000 7f3e6659c640 1 --2- 172.21.15.88:0/302725084 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e680a6970 0x7f3e68153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.806+0000 7f3e6659c640 1 -- 172.21.15.88:0/302725084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e68154050 msgr2=0x7f3e681e8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:28.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.806+0000 7f3e6659c640 1 --2- 172.21.15.88:0/302725084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e68154050 0x7f3e681e8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.806+0000 7f3e6659c640 1 -- 172.21.15.88:0/302725084 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e680a71c0 con 0x7f3e50005050 2023-12-08T08:23:28.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.806+0000 7f3e65d9b640 1 --2- 172.21.15.88:0/302725084 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e680a6970 0x7f3e68153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:28.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.806+0000 7f3e6659c640 1 --2- 172.21.15.88:0/302725084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e50005050 0x7f3e68145110 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f3e58011960 tx=0x7f3e58011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:28.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.806+0000 7f3e56ffd640 1 -- 172.21.15.88:0/302725084 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5800faf0 con 0x7f3e50005050 2023-12-08T08:23:28.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.806+0000 7f3e56ffd640 1 -- 172.21.15.88:0/302725084 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5800fc50 con 0x7f3e50005050 2023-12-08T08:23:28.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.806+0000 7f3e6cabb640 1 -- 172.21.15.88:0/302725084 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e68071dc0 con 0x7f3e50005050 2023-12-08T08:23:28.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.806+0000 7f3e56ffd640 1 -- 172.21.15.88:0/302725084 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e58014440 con 0x7f3e50005050 2023-12-08T08:23:28.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.810+0000 7f3e6cabb640 1 -- 172.21.15.88:0/302725084 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e68072380 con 0x7f3e50005050 2023-12-08T08:23:28.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.810+0000 7f3e6cabb640 1 -- 172.21.15.88:0/302725084 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e68072540 con 0x7f3e50005050 2023-12-08T08:23:28.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.810+0000 7f3e56ffd640 1 -- 172.21.15.88:0/302725084 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3e580145a0 con 0x7f3e50005050 2023-12-08T08:23:28.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.810+0000 7f3e56ffd640 1 --2- 172.21.15.88:0/302725084 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3e480664a0 0x7f3e48068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:28.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.810+0000 7f3e56ffd640 1 -- 172.21.15.88:0/302725084 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3e58084a30 con 0x7f3e50005050 2023-12-08T08:23:28.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.810+0000 7f3e65d9b640 1 --2- 172.21.15.88:0/302725084 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3e480664a0 0x7f3e48068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:28.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.810+0000 7f3e65d9b640 1 --2- 172.21.15.88:0/302725084 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3e480664a0 0x7f3e48068960 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3e680bff80 tx=0x7f3e5c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:28.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.814+0000 7f3e56ffd640 1 -- 172.21.15.88:0/302725084 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3e58051b40 con 0x7f3e50005050 2023-12-08T08:23:28.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.966+0000 7f3e6cabb640 1 -- 172.21.15.88:0/302725084 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3e68067630 con 0x7f3e50005050 2023-12-08T08:23:28.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.966+0000 7f3e56ffd640 1 -- 172.21.15.88:0/302725084 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v72) v1 ==== 105+0+11 (secure 0 0 0) 0x7f3e58055160 con 0x7f3e50005050 2023-12-08T08:23:28.971 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:23:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.966+0000 7f3e6cabb640 1 -- 172.21.15.88:0/302725084 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3e480664a0 msgr2=0x7f3e48068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.966+0000 7f3e6cabb640 1 --2- 172.21.15.88:0/302725084 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3e480664a0 0x7f3e48068960 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3e680bff80 tx=0x7f3e5c009040 comp rx=0 tx=0).stop 2023-12-08T08:23:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.966+0000 7f3e6cabb640 1 -- 172.21.15.88:0/302725084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e50005050 msgr2=0x7f3e68145110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.966+0000 7f3e6cabb640 1 --2- 172.21.15.88:0/302725084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e50005050 0x7f3e68145110 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f3e58011960 tx=0x7f3e58011e20 comp rx=0 tx=0).stop 2023-12-08T08:23:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.970+0000 7f3e6cabb640 1 -- 172.21.15.88:0/302725084 shutdown_connections 2023-12-08T08:23:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.970+0000 7f3e6cabb640 1 --2- 172.21.15.88:0/302725084 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3e480664a0 0x7f3e48068960 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.970+0000 7f3e6cabb640 1 --2- 172.21.15.88:0/302725084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e68154050 0x7f3e681e8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.970+0000 7f3e6cabb640 1 --2- 172.21.15.88:0/302725084 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3e680a6970 0x7f3e68153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.970+0000 7f3e6cabb640 1 --2- 172.21.15.88:0/302725084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e50005050 0x7f3e68145110 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.970+0000 7f3e6cabb640 1 -- 172.21.15.88:0/302725084 >> 172.21.15.88:0/302725084 conn(0x7f3e680c59f0 msgr2=0x7f3e681480e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:28.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.970+0000 7f3e6cabb640 1 -- 172.21.15.88:0/302725084 shutdown_connections 2023-12-08T08:23:28.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:28.970+0000 7f3e6cabb640 1 -- 172.21.15.88:0/302725084 wait complete. 2023-12-08T08:23:28.992 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:23:29.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.126+0000 7f6558c09640 1 Processor -- start 2023-12-08T08:23:29.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.126+0000 7f6558c09640 1 -- start start 2023-12-08T08:23:29.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.130+0000 7f6558c09640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65540c45d0 0x7f65540c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:29.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.130+0000 7f6558c09640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f65540c3070 0x7f65541549e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:29.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.130+0000 7f6558c09640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65540c3520 con 0x7f65540a6e70 2023-12-08T08:23:29.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.130+0000 7f6558c09640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65540c7180 con 0x7f65540c3070 2023-12-08T08:23:29.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.130+0000 7f6558c09640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65540c7af0 con 0x7f65540c45d0 2023-12-08T08:23:29.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.130+0000 7f6553fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f65540c3070 0x7f65541549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:29.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.130+0000 7f6553fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f65540c3070 0x7f65541549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54538/0 (socket says 172.21.15.88:54538) 2023-12-08T08:23:29.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.130+0000 7f6553fff640 1 -- 172.21.15.88:0/3515416247 learned_addr learned my addr 172.21.15.88:0/3515416247 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:29.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.130+0000 7f65537fe640 1 --2- 172.21.15.88:0/3515416247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65540c45d0 0x7f65540c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:29.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.130+0000 7f6553fff640 1 -- 172.21.15.88:0/3515416247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65540c45d0 msgr2=0x7f65540c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:29.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.130+0000 7f6553fff640 1 --2- 172.21.15.88:0/3515416247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65540c45d0 0x7f65540c49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:29.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.130+0000 7f6553fff640 1 -- 172.21.15.88:0/3515416247 >> v1:172.21.15.148:6789/0 conn(0x7f65540a6e70 legacy=0x7f65541542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:29.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.130+0000 7f6553fff640 1 -- 172.21.15.88:0/3515416247 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6554154f20 con 0x7f65540c3070 2023-12-08T08:23:29.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.134+0000 7f6553fff640 1 --2- 172.21.15.88:0/3515416247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65540c3070 0x7f65541549e0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f654c009e50 tx=0x7f654c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107e3bd25d1a54eb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:29.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.134+0000 7f6552ffd640 1 -- 172.21.15.88:0/3515416247 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c0a5730 con 0x7f65540c3070 2023-12-08T08:23:29.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.134+0000 7f6552ffd640 1 -- 172.21.15.88:0/3515416247 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654c0a5890 con 0x7f65540c3070 2023-12-08T08:23:29.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.134+0000 7f6552ffd640 1 -- 172.21.15.88:0/3515416247 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c0a5c20 con 0x7f65540c3070 2023-12-08T08:23:29.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.134+0000 7f6558c09640 1 -- 172.21.15.88:0/3515416247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65540c3070 msgr2=0x7f65541549e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:29.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.134+0000 7f6558c09640 1 --2- 172.21.15.88:0/3515416247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65540c3070 0x7f65541549e0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f654c009e50 tx=0x7f654c01c980 comp rx=0 tx=0).stop 2023-12-08T08:23:29.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.134+0000 7f6558c09640 1 -- 172.21.15.88:0/3515416247 shutdown_connections 2023-12-08T08:23:29.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.134+0000 7f6558c09640 1 --2- 172.21.15.88:0/3515416247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65540c3070 0x7f65541549e0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:29.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.134+0000 7f6558c09640 1 --2- 172.21.15.88:0/3515416247 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65540c45d0 0x7f65540c49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:29.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.134+0000 7f6558c09640 1 -- 172.21.15.88:0/3515416247 >> 172.21.15.88:0/3515416247 conn(0x7f65540c7c60 msgr2=0x7f65540c8070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:29.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.134+0000 7f6558c09640 1 -- 172.21.15.88:0/3515416247 shutdown_connections 2023-12-08T08:23:29.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.134+0000 7f6558c09640 1 -- 172.21.15.88:0/3515416247 wait complete. 2023-12-08T08:23:29.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.134+0000 7f6558c09640 1 Processor -- start 2023-12-08T08:23:29.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.134+0000 7f6558c09640 1 -- start start 2023-12-08T08:23:29.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.138+0000 7f6558c09640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65540a6e70 0x7f65541f0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:29.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.138+0000 7f6558c09640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65540c3070 0x7f6554143090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:29.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.138+0000 7f6558c09640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65540c45d0 0x7f65541ecc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:29.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.138+0000 7f6558c09640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65541f0aa0 con 0x7f65540c3070 2023-12-08T08:23:29.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.138+0000 7f6558c09640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655414b7e0 con 0x7f65540c45d0 2023-12-08T08:23:29.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.138+0000 7f6558c09640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655414bac0 con 0x7f65540a6e70 2023-12-08T08:23:29.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.138+0000 7f654bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65540c3070 0x7f6554143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:29.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.138+0000 7f654bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65540c3070 0x7f6554143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54548/0 (socket says 172.21.15.88:54548) 2023-12-08T08:23:29.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.138+0000 7f654bfff640 1 -- 172.21.15.88:0/1401084831 learned_addr learned my addr 172.21.15.88:0/1401084831 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:29.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.138+0000 7f65537fe640 1 --2- 172.21.15.88:0/1401084831 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65540a6e70 0x7f65541f0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:29.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.138+0000 7f6553fff640 1 --2- 172.21.15.88:0/1401084831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65540c45d0 0x7f65541ecc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:29.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.138+0000 7f654bfff640 1 -- 172.21.15.88:0/1401084831 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65540a6e70 msgr2=0x7f65541f0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:29.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.138+0000 7f654bfff640 1 --2- 172.21.15.88:0/1401084831 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65540a6e70 0x7f65541f0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:29.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.138+0000 7f654bfff640 1 -- 172.21.15.88:0/1401084831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65540c45d0 msgr2=0x7f65541ecc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:29.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.138+0000 7f654bfff640 1 --2- 172.21.15.88:0/1401084831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65540c45d0 0x7f65541ecc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:29.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.138+0000 7f654bfff640 1 -- 172.21.15.88:0/1401084831 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654c009b30 con 0x7f65540c3070 2023-12-08T08:23:29.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.138+0000 7f654bfff640 1 --2- 172.21.15.88:0/1401084831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65540c3070 0x7f6554143090 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f653c00c390 tx=0x7f653c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:29.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.138+0000 7f6550ff9640 1 -- 172.21.15.88:0/1401084831 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653c0052d0 con 0x7f65540c3070 2023-12-08T08:23:29.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.138+0000 7f6550ff9640 1 -- 172.21.15.88:0/1401084831 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653c005430 con 0x7f65540c3070 2023-12-08T08:23:29.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.138+0000 7f6550ff9640 1 -- 172.21.15.88:0/1401084831 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653c003820 con 0x7f65540c3070 2023-12-08T08:23:29.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.138+0000 7f6558c09640 1 -- 172.21.15.88:0/1401084831 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655414bda0 con 0x7f65540c3070 2023-12-08T08:23:29.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.138+0000 7f6558c09640 1 -- 172.21.15.88:0/1401084831 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65541435d0 con 0x7f65540c3070 2023-12-08T08:23:29.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.138+0000 7f6558c09640 1 -- 172.21.15.88:0/1401084831 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65540c2ee0 con 0x7f65540c3070 2023-12-08T08:23:29.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.138+0000 7f6550ff9640 1 -- 172.21.15.88:0/1401084831 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f653c003980 con 0x7f65540c3070 2023-12-08T08:23:29.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.142+0000 7f6550ff9640 1 --2- 172.21.15.88:0/1401084831 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f65340664a0 0x7f6534068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:29.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.142+0000 7f6550ff9640 1 -- 172.21.15.88:0/1401084831 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f653c083660 con 0x7f65540c3070 2023-12-08T08:23:29.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.142+0000 7f65537fe640 1 --2- 172.21.15.88:0/1401084831 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f65340664a0 0x7f6534068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:29.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.142+0000 7f65537fe640 1 --2- 172.21.15.88:0/1401084831 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f65340664a0 0x7f6534068960 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6544007a60 tx=0x7f6544008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:29.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.142+0000 7f6550ff9640 1 -- 172.21.15.88:0/1401084831 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f653c050820 con 0x7f65540c3070 2023-12-08T08:23:29.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.290+0000 7f6558c09640 1 -- 172.21.15.88:0/1401084831 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f65540674b0 con 0x7f65540c3070 2023-12-08T08:23:29.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.294+0000 7f6550ff9640 1 -- 172.21.15.88:0/1401084831 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v72) v1 ==== 101+0+11 (secure 0 0 0) 0x7f653c053e40 con 0x7f65540c3070 2023-12-08T08:23:29.297 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:23:29.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.294+0000 7f6558c09640 1 -- 172.21.15.88:0/1401084831 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f65340664a0 msgr2=0x7f6534068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:29.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.294+0000 7f6558c09640 1 --2- 172.21.15.88:0/1401084831 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f65340664a0 0x7f6534068960 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6544007a60 tx=0x7f6544008040 comp rx=0 tx=0).stop 2023-12-08T08:23:29.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.294+0000 7f6558c09640 1 -- 172.21.15.88:0/1401084831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65540c3070 msgr2=0x7f6554143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:29.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.294+0000 7f6558c09640 1 --2- 172.21.15.88:0/1401084831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65540c3070 0x7f6554143090 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f653c00c390 tx=0x7f653c00c850 comp rx=0 tx=0).stop 2023-12-08T08:23:29.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.294+0000 7f6558c09640 1 -- 172.21.15.88:0/1401084831 shutdown_connections 2023-12-08T08:23:29.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.294+0000 7f6558c09640 1 --2- 172.21.15.88:0/1401084831 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f65340664a0 0x7f6534068960 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:29.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.294+0000 7f6558c09640 1 --2- 172.21.15.88:0/1401084831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65540c45d0 0x7f65541ecc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:29.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.294+0000 7f6558c09640 1 --2- 172.21.15.88:0/1401084831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65540c3070 0x7f6554143090 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:29.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.294+0000 7f6558c09640 1 --2- 172.21.15.88:0/1401084831 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f65540a6e70 0x7f65541f0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:29.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.294+0000 7f6558c09640 1 -- 172.21.15.88:0/1401084831 >> 172.21.15.88:0/1401084831 conn(0x7f65540c7c60 msgr2=0x7f655406f870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:29.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.294+0000 7f6558c09640 1 -- 172.21.15.88:0/1401084831 shutdown_connections 2023-12-08T08:23:29.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.294+0000 7f6558c09640 1 -- 172.21.15.88:0/1401084831 wait complete. 2023-12-08T08:23:29.318 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:23:29.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.450+0000 7f5ce7eea640 1 Processor -- start 2023-12-08T08:23:29.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.450+0000 7f5ce7eea640 1 -- start start 2023-12-08T08:23:29.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.450+0000 7f5ce7eea640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ce00c4b90 0x7f5ce0155950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:29.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.450+0000 7f5ce7eea640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce00c6840 con 0x7f5ce00bd550 2023-12-08T08:23:29.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.450+0000 7f5ce7eea640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce0158a00 con 0x7f5ce00c47b0 2023-12-08T08:23:29.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.450+0000 7f5ce7eea640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce00c4fe0 con 0x7f5ce00c4b90 2023-12-08T08:23:29.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.454+0000 7f5ce5485640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5ce00bd550 0x7f5ce01582f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38052/0 (socket says 172.21.15.88:38052) 2023-12-08T08:23:29.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.454+0000 7f5ce5485640 1 -- 172.21.15.88:0/4144814050 learned_addr learned my addr 172.21.15.88:0/4144814050 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:29.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.454+0000 7f5ce6487640 1 --2- 172.21.15.88:0/4144814050 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ce00c4b90 0x7f5ce0155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:29.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.454+0000 7f5ce4c84640 1 -- 172.21.15.88:0/4144814050 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2554440387 0 0) 0x7f5ce00c6840 con 0x7f5ce00bd550 2023-12-08T08:23:29.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.454+0000 7f5ce4c84640 1 -- 172.21.15.88:0/4144814050 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ccc003530 con 0x7f5ce00bd550 2023-12-08T08:23:29.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.454+0000 7f5ce4c84640 1 -- 172.21.15.88:0/4144814050 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3548709344 0 0) 0x7f5cdc001120 con 0x7f5ce00c47b0 2023-12-08T08:23:29.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.454+0000 7f5ce4c84640 1 -- 172.21.15.88:0/4144814050 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ce00c6840 con 0x7f5ce00c47b0 2023-12-08T08:23:29.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.454+0000 7f5ce6487640 1 -- 172.21.15.88:0/4144814050 >> v1:172.21.15.148:6789/0 conn(0x7f5ce00c47b0 legacy=0x7f5ce0154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:29.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.454+0000 7f5ce6487640 1 -- 172.21.15.88:0/4144814050 >> v1:172.21.15.88:6789/0 conn(0x7f5ce00bd550 legacy=0x7f5ce01582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:29.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.454+0000 7f5ce6487640 1 -- 172.21.15.88:0/4144814050 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce00af870 con 0x7f5ce00c4b90 2023-12-08T08:23:29.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.454+0000 7f5ce6487640 1 --2- 172.21.15.88:0/4144814050 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ce00c4b90 0x7f5ce0155950 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8009dc0 tx=0x7f5cd801c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa2d609e09929a6d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:29.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.458+0000 7f5ce4c84640 1 -- 172.21.15.88:0/4144814050 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd80a58b0 con 0x7f5ce00c4b90 2023-12-08T08:23:29.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.458+0000 7f5ce4c84640 1 -- 172.21.15.88:0/4144814050 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd80a5a10 con 0x7f5ce00c4b90 2023-12-08T08:23:29.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.458+0000 7f5ce4c84640 1 -- 172.21.15.88:0/4144814050 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd80a5d80 con 0x7f5ce00c4b90 2023-12-08T08:23:29.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.458+0000 7f5ce7eea640 1 -- 172.21.15.88:0/4144814050 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ce00c4b90 msgr2=0x7f5ce0155950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:29.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.458+0000 7f5ce7eea640 1 --2- 172.21.15.88:0/4144814050 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ce00c4b90 0x7f5ce0155950 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8009dc0 tx=0x7f5cd801c8e0 comp rx=0 tx=0).stop 2023-12-08T08:23:29.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.458+0000 7f5ce7eea640 1 -- 172.21.15.88:0/4144814050 shutdown_connections 2023-12-08T08:23:29.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.458+0000 7f5ce7eea640 1 --2- 172.21.15.88:0/4144814050 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ce00c4b90 0x7f5ce0155950 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:29.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.458+0000 7f5ce7eea640 1 -- 172.21.15.88:0/4144814050 >> 172.21.15.88:0/4144814050 conn(0x7f5ce00aba00 msgr2=0x7f5ce00abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:29.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.458+0000 7f5ce7eea640 1 -- 172.21.15.88:0/4144814050 shutdown_connections 2023-12-08T08:23:29.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.458+0000 7f5ce7eea640 1 -- 172.21.15.88:0/4144814050 wait complete. 2023-12-08T08:23:29.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.458+0000 7f5ce7eea640 1 Processor -- start 2023-12-08T08:23:29.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.458+0000 7f5ce7eea640 1 -- start start 2023-12-08T08:23:29.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.458+0000 7f5ce7eea640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ce00bd550 0x7f5ce00bea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:29.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.458+0000 7f5ce7eea640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ce00c47b0 0x7f5ce00bd930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:29.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.458+0000 7f5ce7eea640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ce00c4b90 0x7f5ce00bde70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:29.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.458+0000 7f5ce7eea640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce015ea70 con 0x7f5ce00bd550 2023-12-08T08:23:29.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.458+0000 7f5ce7eea640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce00bf570 con 0x7f5ce00c47b0 2023-12-08T08:23:29.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.458+0000 7f5ce7eea640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce00be3b0 con 0x7f5ce00c4b90 2023-12-08T08:23:29.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.458+0000 7f5ce5c86640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ce00bd550 0x7f5ce00bea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:29.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.458+0000 7f5ce5c86640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ce00bd550 0x7f5ce00bea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54554/0 (socket says 172.21.15.88:54554) 2023-12-08T08:23:29.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.458+0000 7f5ce5c86640 1 -- 172.21.15.88:0/1286483163 learned_addr learned my addr 172.21.15.88:0/1286483163 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:29.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.462+0000 7f5ce6487640 1 --2- 172.21.15.88:0/1286483163 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ce00c4b90 0x7f5ce00bde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:29.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.462+0000 7f5ce5485640 1 --2- 172.21.15.88:0/1286483163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ce00c47b0 0x7f5ce00bd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:29.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.462+0000 7f5ce5c86640 1 -- 172.21.15.88:0/1286483163 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ce00c4b90 msgr2=0x7f5ce00bde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:29.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.462+0000 7f5ce5c86640 1 --2- 172.21.15.88:0/1286483163 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ce00c4b90 0x7f5ce00bde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:29.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.462+0000 7f5ce5c86640 1 -- 172.21.15.88:0/1286483163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ce00c47b0 msgr2=0x7f5ce00bd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:29.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.462+0000 7f5ce5c86640 1 --2- 172.21.15.88:0/1286483163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ce00c47b0 0x7f5ce00bd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:29.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.462+0000 7f5ce5c86640 1 -- 172.21.15.88:0/1286483163 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd8009a70 con 0x7f5ce00bd550 2023-12-08T08:23:29.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.462+0000 7f5ce5485640 1 --2- 172.21.15.88:0/1286483163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ce00c47b0 0x7f5ce00bd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:29.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.462+0000 7f5ce5c86640 1 --2- 172.21.15.88:0/1286483163 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ce00bd550 0x7f5ce00bea20 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00c3a0 tx=0x7f5cdc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:29.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.462+0000 7f5cd67fc640 1 -- 172.21.15.88:0/1286483163 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc0052d0 con 0x7f5ce00bd550 2023-12-08T08:23:29.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.462+0000 7f5cd67fc640 1 -- 172.21.15.88:0/1286483163 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cdc005450 con 0x7f5ce00bd550 2023-12-08T08:23:29.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.462+0000 7f5ce7eea640 1 -- 172.21.15.88:0/1286483163 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce015eec0 con 0x7f5ce00bd550 2023-12-08T08:23:29.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.462+0000 7f5cd67fc640 1 -- 172.21.15.88:0/1286483163 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc003840 con 0x7f5ce00bd550 2023-12-08T08:23:29.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.462+0000 7f5ce7eea640 1 -- 172.21.15.88:0/1286483163 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce00c0650 con 0x7f5ce00bd550 2023-12-08T08:23:29.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.462+0000 7f5ce7eea640 1 -- 172.21.15.88:0/1286483163 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce0067630 con 0x7f5ce00bd550 2023-12-08T08:23:29.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.462+0000 7f5cd67fc640 1 -- 172.21.15.88:0/1286483163 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5cdc0039a0 con 0x7f5ce00bd550 2023-12-08T08:23:29.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.462+0000 7f5cd67fc640 1 --2- 172.21.15.88:0/1286483163 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5cc40664a0 0x7f5cc4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:29.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.462+0000 7f5cd67fc640 1 -- 172.21.15.88:0/1286483163 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5cdc083590 con 0x7f5ce00bd550 2023-12-08T08:23:29.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.462+0000 7f5ce5485640 1 --2- 172.21.15.88:0/1286483163 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5cc40664a0 0x7f5cc4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:29.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.466+0000 7f5ce5485640 1 --2- 172.21.15.88:0/1286483163 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5cc40664a0 0x7f5cc4068960 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5ce015e700 tx=0x7f5cd0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:29.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.466+0000 7f5cd67fc640 1 -- 172.21.15.88:0/1286483163 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5cdc0506a0 con 0x7f5ce00bd550 2023-12-08T08:23:29.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.630+0000 7f5ce7eea640 1 -- 172.21.15.88:0/1286483163 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5ce0158a00 con 0x7f5ce00bd550 2023-12-08T08:23:29.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.630+0000 7f5cd67fc640 1 -- 172.21.15.88:0/1286483163 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5ce0158a00 con 0x7f5ce00bd550 2023-12-08T08:23:29.635 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-12-08T08:23:29.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.630+0000 7f5ce7eea640 1 -- 172.21.15.88:0/1286483163 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5cc40664a0 msgr2=0x7f5cc4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:29.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.630+0000 7f5ce7eea640 1 --2- 172.21.15.88:0/1286483163 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5cc40664a0 0x7f5cc4068960 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5ce015e700 tx=0x7f5cd0009040 comp rx=0 tx=0).stop 2023-12-08T08:23:29.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.630+0000 7f5ce7eea640 1 -- 172.21.15.88:0/1286483163 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ce00bd550 msgr2=0x7f5ce00bea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:29.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.630+0000 7f5ce7eea640 1 --2- 172.21.15.88:0/1286483163 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ce00bd550 0x7f5ce00bea20 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00c3a0 tx=0x7f5cdc00c860 comp rx=0 tx=0).stop 2023-12-08T08:23:29.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.630+0000 7f5ce7eea640 1 -- 172.21.15.88:0/1286483163 shutdown_connections 2023-12-08T08:23:29.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.630+0000 7f5ce7eea640 1 --2- 172.21.15.88:0/1286483163 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5cc40664a0 0x7f5cc4068960 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:29.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.630+0000 7f5ce7eea640 1 --2- 172.21.15.88:0/1286483163 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5ce00c4b90 0x7f5ce00bde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:29.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.630+0000 7f5ce7eea640 1 --2- 172.21.15.88:0/1286483163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ce00c47b0 0x7f5ce00bd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:29.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.630+0000 7f5ce7eea640 1 --2- 172.21.15.88:0/1286483163 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ce00bd550 0x7f5ce00bea20 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:29.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.630+0000 7f5ce7eea640 1 -- 172.21.15.88:0/1286483163 >> 172.21.15.88:0/1286483163 conn(0x7f5ce00aba00 msgr2=0x7f5ce00c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:29.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.634+0000 7f5ce7eea640 1 -- 172.21.15.88:0/1286483163 shutdown_connections 2023-12-08T08:23:29.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.634+0000 7f5ce7eea640 1 -- 172.21.15.88:0/1286483163 wait complete. 2023-12-08T08:23:29.656 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-08T08:23:29.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:29.656 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-08T08:23:29.686 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-12-08T08:23:29.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:29.686 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-08T08:23:29.739 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:23:29.740 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:23:29.791 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354676k,nr_inodes=4088669,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9389 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-08T08:23:29.791 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:23:29.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.926+0000 7f9872281640 1 Processor -- start 2023-12-08T08:23:29.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.926+0000 7f9872281640 1 -- start start 2023-12-08T08:23:29.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.926+0000 7f9872281640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f986c0c8200 0x7f986c0c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:29.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.926+0000 7f9872281640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f986c151f20 con 0x7f986c0c65f0 2023-12-08T08:23:29.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.926+0000 7f9872281640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f986c154450 con 0x7f986c0c9210 2023-12-08T08:23:29.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.926+0000 7f9872281640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986c154710 con 0x7f986c0c8200 2023-12-08T08:23:29.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.926+0000 7f987127f640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f986c0c65f0 0x7f986c0c8b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38056/0 (socket says 172.21.15.88:38056) 2023-12-08T08:23:29.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.926+0000 7f987127f640 1 -- 172.21.15.88:0/823332693 learned_addr learned my addr 172.21.15.88:0/823332693 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:29.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.930+0000 7f9870a7e640 1 --2- 172.21.15.88:0/823332693 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f986c0c8200 0x7f986c0c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:29.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.930+0000 7f9863fff640 1 -- 172.21.15.88:0/823332693 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 65576212 0 0) 0x7f986c151f20 con 0x7f986c0c65f0 2023-12-08T08:23:29.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.930+0000 7f9863fff640 1 -- 172.21.15.88:0/823332693 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9858003530 con 0x7f986c0c65f0 2023-12-08T08:23:29.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.930+0000 7f9863fff640 1 -- 172.21.15.88:0/823332693 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3055542953 0 0) 0x7f9858003530 con 0x7f986c0c65f0 2023-12-08T08:23:29.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.930+0000 7f9863fff640 1 -- 172.21.15.88:0/823332693 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f986c0c8200 msgr2=0x7f986c0c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:29.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.930+0000 7f9863fff640 1 --2- 172.21.15.88:0/823332693 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f986c0c8200 0x7f986c0c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:29.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.930+0000 7f9863fff640 1 -- 172.21.15.88:0/823332693 >> v1:172.21.15.148:6789/0 conn(0x7f986c0c9210 legacy=0x7f986c15ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:29.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.930+0000 7f9863fff640 1 -- 172.21.15.88:0/823332693 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c1549f0 con 0x7f986c0c65f0 2023-12-08T08:23:29.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.930+0000 7f9863fff640 1 -- 172.21.15.88:0/823332693 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f9868001680 con 0x7f986c0c65f0 2023-12-08T08:23:29.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.930+0000 7f9863fff640 1 -- 172.21.15.88:0/823332693 >> v1:172.21.15.88:6789/0 conn(0x7f986c0c65f0 legacy=0x7f986c0c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:29.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.930+0000 7f9863fff640 1 --2- 172.21.15.88:0/823332693 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f986c0c8200 0x7f98580039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:29.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.930+0000 7f9863fff640 1 --2- 172.21.15.88:0/823332693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9858003ef0 0x7f98580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:29.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.930+0000 7f9863fff640 1 --2- 172.21.15.88:0/823332693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9858004d10 0x7f9858005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:29.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.930+0000 7f9863fff640 1 -- 172.21.15.88:0/823332693 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c154710 con 0x7f9858003ef0 2023-12-08T08:23:29.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.930+0000 7f9863fff640 1 -- 172.21.15.88:0/823332693 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985800baa0 con 0x7f9858004d10 2023-12-08T08:23:29.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.930+0000 7f9863fff640 1 -- 172.21.15.88:0/823332693 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985800bc60 con 0x7f986c0c8200 2023-12-08T08:23:29.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.930+0000 7f9870a7e640 1 --2- 172.21.15.88:0/823332693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9858003ef0 0x7f98580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:29.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.930+0000 7f987127f640 1 --2- 172.21.15.88:0/823332693 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f986c0c8200 0x7f98580039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:29.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.930+0000 7f9871a80640 1 --2- 172.21.15.88:0/823332693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9858004d10 0x7f9858005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:29.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.930+0000 7f9870a7e640 1 -- 172.21.15.88:0/823332693 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f986c0c8200 msgr2=0x7f98580039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:29.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.930+0000 7f9870a7e640 1 --2- 172.21.15.88:0/823332693 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f986c0c8200 0x7f98580039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:29.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.930+0000 7f9870a7e640 1 -- 172.21.15.88:0/823332693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9858004d10 msgr2=0x7f9858005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:29.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.930+0000 7f9870a7e640 1 --2- 172.21.15.88:0/823332693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9858004d10 0x7f9858005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:29.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.930+0000 7f9870a7e640 1 -- 172.21.15.88:0/823332693 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9858003530 con 0x7f9858003ef0 2023-12-08T08:23:29.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.934+0000 7f9870a7e640 1 --2- 172.21.15.88:0/823332693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9858003ef0 0x7f98580047d0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f985c009ab0 tx=0x7f985c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df78a6dd56470a3e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:29.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.934+0000 7f9863fff640 1 -- 172.21.15.88:0/823332693 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c0a5620 con 0x7f9858003ef0 2023-12-08T08:23:29.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.934+0000 7f9863fff640 1 -- 172.21.15.88:0/823332693 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c0a5780 con 0x7f9858003ef0 2023-12-08T08:23:29.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.934+0000 7f9863fff640 1 -- 172.21.15.88:0/823332693 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c0a5b30 con 0x7f9858003ef0 2023-12-08T08:23:29.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.934+0000 7f9872281640 1 -- 172.21.15.88:0/823332693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9858003ef0 msgr2=0x7f98580047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:29.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.934+0000 7f9872281640 1 --2- 172.21.15.88:0/823332693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9858003ef0 0x7f98580047d0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f985c009ab0 tx=0x7f985c01ca30 comp rx=0 tx=0).stop 2023-12-08T08:23:29.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.934+0000 7f9871a80640 1 -- 172.21.15.88:0/823332693 reap_dead start 2023-12-08T08:23:29.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.934+0000 7f9872281640 1 -- 172.21.15.88:0/823332693 shutdown_connections 2023-12-08T08:23:29.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.934+0000 7f9872281640 1 -- 172.21.15.88:0/823332693 >> 172.21.15.88:0/823332693 conn(0x7f986c0ab730 msgr2=0x7f986c0abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:29.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.934+0000 7f9872281640 1 -- 172.21.15.88:0/823332693 shutdown_connections 2023-12-08T08:23:29.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.934+0000 7f9872281640 1 -- 172.21.15.88:0/823332693 wait complete. 2023-12-08T08:23:29.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.934+0000 7f9872281640 1 Processor -- start 2023-12-08T08:23:29.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.934+0000 7f9872281640 1 -- start start 2023-12-08T08:23:29.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.934+0000 7f9872281640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9858003ef0 0x7f986c14eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:29.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.934+0000 7f9872281640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f986c1557d0 0x7f986c157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:29.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.934+0000 7f9872281640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f986c1579c0 0x7f986c14cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:29.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.934+0000 7f9872281640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c14c810 con 0x7f986c1557d0 2023-12-08T08:23:29.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.934+0000 7f9872281640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c14f0d0 con 0x7f986c1579c0 2023-12-08T08:23:29.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.934+0000 7f9872281640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986c1edb20 con 0x7f9858003ef0 2023-12-08T08:23:29.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.934+0000 7f9870a7e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f986c1557d0 0x7f986c157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:29.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.934+0000 7f9870a7e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f986c1557d0 0x7f986c157480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54582/0 (socket says 172.21.15.88:54582) 2023-12-08T08:23:29.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.934+0000 7f9870a7e640 1 -- 172.21.15.88:0/2174035265 learned_addr learned my addr 172.21.15.88:0/2174035265 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:29.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.934+0000 7f987127f640 1 --2- 172.21.15.88:0/2174035265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9858003ef0 0x7f986c14eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:29.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.938+0000 7f9871a80640 1 --2- 172.21.15.88:0/2174035265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f986c1579c0 0x7f986c14cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:29.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.938+0000 7f9870a7e640 1 -- 172.21.15.88:0/2174035265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9858003ef0 msgr2=0x7f986c14eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:29.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.938+0000 7f9870a7e640 1 --2- 172.21.15.88:0/2174035265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9858003ef0 0x7f986c14eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:29.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.938+0000 7f9870a7e640 1 -- 172.21.15.88:0/2174035265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f986c1579c0 msgr2=0x7f986c14cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:29.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.938+0000 7f9870a7e640 1 --2- 172.21.15.88:0/2174035265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f986c1579c0 0x7f986c14cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:29.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.938+0000 7f9870a7e640 1 -- 172.21.15.88:0/2174035265 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c14c1c0 con 0x7f986c1557d0 2023-12-08T08:23:29.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.938+0000 7f9871a80640 1 --2- 172.21.15.88:0/2174035265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f986c1579c0 0x7f986c14cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:29.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.938+0000 7f9870a7e640 1 --2- 172.21.15.88:0/2174035265 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f986c1557d0 0x7f986c157480 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f985c009ab0 tx=0x7f9858005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:29.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.938+0000 7f9861ffb640 1 -- 172.21.15.88:0/2174035265 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c0ad850 con 0x7f986c1557d0 2023-12-08T08:23:29.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.938+0000 7f9861ffb640 1 -- 172.21.15.88:0/2174035265 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c0ad9b0 con 0x7f986c1557d0 2023-12-08T08:23:29.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.938+0000 7f9872281640 1 -- 172.21.15.88:0/2174035265 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986c14c4a0 con 0x7f986c1557d0 2023-12-08T08:23:29.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.938+0000 7f9861ffb640 1 -- 172.21.15.88:0/2174035265 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c0add20 con 0x7f986c1557d0 2023-12-08T08:23:29.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.938+0000 7f9872281640 1 -- 172.21.15.88:0/2174035265 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986c1ed7d0 con 0x7f986c1557d0 2023-12-08T08:23:29.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.938+0000 7f9872281640 1 -- 172.21.15.88:0/2174035265 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f986c14c020 con 0x7f986c1557d0 2023-12-08T08:23:29.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.938+0000 7f9861ffb640 1 -- 172.21.15.88:0/2174035265 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f985c0b4040 con 0x7f986c1557d0 2023-12-08T08:23:29.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.938+0000 7f9861ffb640 1 --2- 172.21.15.88:0/2174035265 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9850066470 0x7f9850068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:29.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.938+0000 7f9861ffb640 1 -- 172.21.15.88:0/2174035265 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f985c11e8c0 con 0x7f986c1557d0 2023-12-08T08:23:29.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.942+0000 7f987127f640 1 --2- 172.21.15.88:0/2174035265 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9850066470 0x7f9850068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:29.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.942+0000 7f987127f640 1 --2- 172.21.15.88:0/2174035265 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9850066470 0x7f9850068930 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9868000fc0 tx=0x7f9868001b50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:29.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:29.942+0000 7f9861ffb640 1 -- 172.21.15.88:0/2174035265 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f986c14c020 con 0x7f986c1557d0 2023-12-08T08:23:30.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:30.126+0000 7f9872281640 1 -- 172.21.15.88:0/2174035265 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f986c14c020 con 0x7f986c1557d0 2023-12-08T08:23:30.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:30.126+0000 7f9861ffb640 1 -- 172.21.15.88:0/2174035265 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) v1 ==== 53+0+149 (secure 0 0 0) 0x7f986c14c020 con 0x7f986c1557d0 2023-12-08T08:23:30.131 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:23:30.132 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-08T08:23:30.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:30.130+0000 7f9872281640 1 -- 172.21.15.88:0/2174035265 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9850066470 msgr2=0x7f9850068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:30.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:30.130+0000 7f9872281640 1 --2- 172.21.15.88:0/2174035265 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9850066470 0x7f9850068930 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9868000fc0 tx=0x7f9868001b50 comp rx=0 tx=0).stop 2023-12-08T08:23:30.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:30.130+0000 7f9872281640 1 -- 172.21.15.88:0/2174035265 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f986c1557d0 msgr2=0x7f986c157480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:30.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:30.130+0000 7f9872281640 1 --2- 172.21.15.88:0/2174035265 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f986c1557d0 0x7f986c157480 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f985c009ab0 tx=0x7f9858005800 comp rx=0 tx=0).stop 2023-12-08T08:23:30.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:30.130+0000 7f9872281640 1 -- 172.21.15.88:0/2174035265 shutdown_connections 2023-12-08T08:23:30.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:30.130+0000 7f9872281640 1 --2- 172.21.15.88:0/2174035265 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9850066470 0x7f9850068930 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:30.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:30.130+0000 7f9872281640 1 --2- 172.21.15.88:0/2174035265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f986c1579c0 0x7f986c14cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:30.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:30.130+0000 7f9872281640 1 --2- 172.21.15.88:0/2174035265 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f986c1557d0 0x7f986c157480 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:30.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:30.130+0000 7f9872281640 1 --2- 172.21.15.88:0/2174035265 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9858003ef0 0x7f986c14eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:30.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:30.130+0000 7f9872281640 1 -- 172.21.15.88:0/2174035265 >> 172.21.15.88:0/2174035265 conn(0x7f986c0ab730 msgr2=0x7f986c06b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:30.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:30.130+0000 7f9872281640 1 -- 172.21.15.88:0/2174035265 shutdown_connections 2023-12-08T08:23:30.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:30.130+0000 7f9872281640 1 -- 172.21.15.88:0/2174035265 wait complete. 2023-12-08T08:23:30.152 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-08T08:23:30.152 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:23:30.152 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-12-08T08:23:30.152 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-08T08:23:30.152 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-08T08:23:30.153 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-08T08:23:30.153 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-08T08:23:30.153 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:23:30.153 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:23:30.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:30.153 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-12-08T08:23:30.163 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:23:30.163 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:23:30.164 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:23:30.164 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:30.164 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-12-08T08:23:30.164 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:30.164 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:23:30.164 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:30.164 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-12-08T08:23:30.164 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:23:30.164 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:30.164 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-12-08T08:23:30.164 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:23:30.164 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:30.164 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:23:30.164 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:30.165 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-08T08:23:30.165 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42229sec preferred_lft 42229sec 2023-12-08T08:23:30.165 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-12-08T08:23:30.165 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:30.165 INFO:teuthology.orchestra.run.smithi148.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-08T08:23:30.165 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 02:42:93:b7:1f:fa brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:30.165 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-08T08:23:30.165 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:30.165 INFO:teuthology.orchestra.run.smithi148.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:23:30.165 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:30.165 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:23:30.165 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:30.165 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-08T08:23:30.165 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:30.166 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:23:30.166 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:23:30.166 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-08T08:23:30.166 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:30.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:30.167 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:23:30.230 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-12-08T08:23:30.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:30.233 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-12-08T08:23:30.286 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-12-08T08:23:30.286 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:23:30.286 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-08T08:23:30.286 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-08T08:23:30.286 INFO:teuthology.orchestra.run.smithi148.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-08T08:23:30.286 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-08T08:23:30.286 INFO:teuthology.orchestra.run.smithi148.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:23:30.286 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:23:30.286 INFO:teuthology.orchestra.run.smithi148.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:23:30.287 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:23:30.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:30.287 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-12-08T08:23:30.287 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-12-08T08:23:30.287 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-08T08:23:30.287 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-08T08:23:30.287 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-08T08:23:30.287 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-12-08T08:23:30.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:30.385 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-12-08T08:23:30.394 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-08T08:23:30.395 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:23:30.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:30.395 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-12-08T08:23:30.463 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:23:30.463 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-08T08:23:30.518 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:23:30.519 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:23:30.519 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:23:30.570 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-12-08T08:23:30.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:30.570 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:23:30.665 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:23:30.665 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:23:30.679 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:23:30.679 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:23:30.679 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-12-08T08:23:30.679 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with new device syntax: 1@681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3.cephfs2=/ 2023-12-08T08:23:30.679 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.88:3300/172.21.15.148:3300/172.21.15.148:3301" will pass to kernel 2023-12-08T08:23:30.683 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T08:23:30.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:30.684 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:23:30.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:30.705 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:23:30.766 INFO:teuthology.orchestra.run.smithi148.stdout:client6622 2023-12-08T08:23:30.766 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:23:30.766 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:23:30.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:30.818 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/testdir) 2023-12-08T08:23:30.834 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:23:30.834 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/mnt.0/testdir/testfile 2023-12-08T08:23:30.890 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs" at path "/home/ubuntu/cephtest/mnt.0/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T08:23:30.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:30.890 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.1 && exec mkdir /home/ubuntu/cephtest/mnt.1/testdir) 2023-12-08T08:23:30.908 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:23:30.908 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/mnt.1/testdir/testfile 2023-12-08T08:23:30.963 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs2" at path "/home/ubuntu/cephtest/mnt.1/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.1/testdir/testfile cephfs_name = cephfs2 cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-08T08:23:30.964 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow r' osd 'allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2' mds 'allow r fsname=cephfs, allow r fsname=cephfs2' 2023-12-08T08:23:31.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.102+0000 7ff13d19d640 1 Processor -- start 2023-12-08T08:23:31.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.102+0000 7ff13d19d640 1 -- start start 2023-12-08T08:23:31.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.106+0000 7ff13d19d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff1380bf2d0 0x7ff138151970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.106+0000 7ff13d19d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff138158780 con 0x7ff1380c98f0 2023-12-08T08:23:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.106+0000 7ff13d19d640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff138157b70 con 0x7ff1380c6030 2023-12-08T08:23:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.106+0000 7ff13d19d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1380c0300 con 0x7ff1380bf2d0 2023-12-08T08:23:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.106+0000 7ff136d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff1380bf2d0 0x7ff138151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.106+0000 7ff13759e640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff1380c98f0 0x7ff13815ef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:32816/0 (socket says 172.21.15.88:32816) 2023-12-08T08:23:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.106+0000 7ff13759e640 1 -- 172.21.15.88:0/2837734822 learned_addr learned my addr 172.21.15.88:0/2837734822 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.106+0000 7ff136d9d640 1 -- 172.21.15.88:0/2837734822 >> v1:172.21.15.148:6789/0 conn(0x7ff1380c6030 legacy=0x7ff1380c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:31.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.106+0000 7ff136d9d640 1 -- 172.21.15.88:0/2837734822 >> v1:172.21.15.88:6789/0 conn(0x7ff1380c98f0 legacy=0x7ff13815ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:31.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.106+0000 7ff136d9d640 1 -- 172.21.15.88:0/2837734822 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff138157e50 con 0x7ff1380bf2d0 2023-12-08T08:23:31.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.110+0000 7ff136d9d640 1 --2- 172.21.15.88:0/2837734822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1380bf2d0 0x7ff138151970 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7ff1280097c0 tx=0x7ff12801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9349c70b5430ce73 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:31.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.110+0000 7ff135d9b640 1 -- 172.21.15.88:0/2837734822 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1280ab600 con 0x7ff1380bf2d0 2023-12-08T08:23:31.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.110+0000 7ff135d9b640 1 -- 172.21.15.88:0/2837734822 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1280a7050 con 0x7ff1380bf2d0 2023-12-08T08:23:31.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.110+0000 7ff135d9b640 1 -- 172.21.15.88:0/2837734822 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1280ab980 con 0x7ff1380bf2d0 2023-12-08T08:23:31.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.110+0000 7ff13d19d640 1 -- 172.21.15.88:0/2837734822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1380bf2d0 msgr2=0x7ff138151970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:31.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.110+0000 7ff13d19d640 1 --2- 172.21.15.88:0/2837734822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1380bf2d0 0x7ff138151970 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7ff1280097c0 tx=0x7ff12801c410 comp rx=0 tx=0).stop 2023-12-08T08:23:31.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.110+0000 7ff13d19d640 1 -- 172.21.15.88:0/2837734822 shutdown_connections 2023-12-08T08:23:31.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.110+0000 7ff13d19d640 1 --2- 172.21.15.88:0/2837734822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1380bf2d0 0x7ff138151970 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:31.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.110+0000 7ff13d19d640 1 -- 172.21.15.88:0/2837734822 >> 172.21.15.88:0/2837734822 conn(0x7ff1380c9dc0 msgr2=0x7ff1380ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:31.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.110+0000 7ff13d19d640 1 -- 172.21.15.88:0/2837734822 shutdown_connections 2023-12-08T08:23:31.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.110+0000 7ff13d19d640 1 -- 172.21.15.88:0/2837734822 wait complete. 2023-12-08T08:23:31.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.110+0000 7ff13d19d640 1 Processor -- start 2023-12-08T08:23:31.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.110+0000 7ff13d19d640 1 -- start start 2023-12-08T08:23:31.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.114+0000 7ff13d19d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1380bf2d0 0x7ff1381f0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:31.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.114+0000 7ff13d19d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1380c6030 0x7ff138142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:31.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.114+0000 7ff13d19d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1380c98f0 0x7ff1380adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:31.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.114+0000 7ff13d19d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13813e290 con 0x7ff1380c6030 2023-12-08T08:23:31.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.114+0000 7ff13d19d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1381f13e0 con 0x7ff1380bf2d0 2023-12-08T08:23:31.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.114+0000 7ff13d19d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13806c7d0 con 0x7ff1380c98f0 2023-12-08T08:23:31.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.114+0000 7ff13659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1380c6030 0x7ff138142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:31.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.114+0000 7ff13659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1380c6030 0x7ff138142fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54550/0 (socket says 172.21.15.88:54550) 2023-12-08T08:23:31.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.114+0000 7ff13659c640 1 -- 172.21.15.88:0/412613238 learned_addr learned my addr 172.21.15.88:0/412613238 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:31.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.114+0000 7ff136d9d640 1 --2- 172.21.15.88:0/412613238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1380bf2d0 0x7ff1381f0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:31.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.114+0000 7ff13759e640 1 --2- 172.21.15.88:0/412613238 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1380c98f0 0x7ff1380adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:31.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.114+0000 7ff13659c640 1 -- 172.21.15.88:0/412613238 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1380c98f0 msgr2=0x7ff1380adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:31.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.114+0000 7ff13659c640 1 --2- 172.21.15.88:0/412613238 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1380c98f0 0x7ff1380adfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:31.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.114+0000 7ff13659c640 1 -- 172.21.15.88:0/412613238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1380bf2d0 msgr2=0x7ff1381f0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:31.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.114+0000 7ff13659c640 1 --2- 172.21.15.88:0/412613238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1380bf2d0 0x7ff1381f0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:31.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.114+0000 7ff13659c640 1 -- 172.21.15.88:0/412613238 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff128009420 con 0x7ff1380c6030 2023-12-08T08:23:31.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.114+0000 7ff136d9d640 1 --2- 172.21.15.88:0/412613238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1380bf2d0 0x7ff1381f0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:23:31.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.114+0000 7ff13659c640 1 --2- 172.21.15.88:0/412613238 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1380c6030 0x7ff138142fd0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7ff12c00c450 tx=0x7ff12c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:31.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.114+0000 7ff11f7fe640 1 -- 172.21.15.88:0/412613238 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c011790 con 0x7ff1380c6030 2023-12-08T08:23:31.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.114+0000 7ff11f7fe640 1 -- 172.21.15.88:0/412613238 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12c011910 con 0x7ff1380c6030 2023-12-08T08:23:31.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.114+0000 7ff13d19d640 1 -- 172.21.15.88:0/412613238 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff13806c210 con 0x7ff1380c6030 2023-12-08T08:23:31.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.114+0000 7ff11f7fe640 1 -- 172.21.15.88:0/412613238 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c011cc0 con 0x7ff1380c6030 2023-12-08T08:23:31.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.114+0000 7ff13d19d640 1 -- 172.21.15.88:0/412613238 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1381ed0c0 con 0x7ff1380c6030 2023-12-08T08:23:31.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.114+0000 7ff13d19d640 1 -- 172.21.15.88:0/412613238 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1381ecf20 con 0x7ff1380c6030 2023-12-08T08:23:31.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.114+0000 7ff11f7fe640 1 -- 172.21.15.88:0/412613238 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff12c01c460 con 0x7ff1380c6030 2023-12-08T08:23:31.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.118+0000 7ff11f7fe640 1 --2- 172.21.15.88:0/412613238 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff124066470 0x7ff124068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:31.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.118+0000 7ff11f7fe640 1 -- 172.21.15.88:0/412613238 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff12c083f30 con 0x7ff1380c6030 2023-12-08T08:23:31.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.118+0000 7ff136d9d640 1 --2- 172.21.15.88:0/412613238 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff124066470 0x7ff124068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:31.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.118+0000 7ff136d9d640 1 --2- 172.21.15.88:0/412613238 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff124066470 0x7ff124068930 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff1280ad000 tx=0x7ff128008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:31.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.122+0000 7ff11f7fe640 1 -- 172.21.15.88:0/412613238 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff1381ecf20 con 0x7ff1380c6030 2023-12-08T08:23:31.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.326+0000 7ff13d19d640 1 -- 172.21.15.88:0/412613238 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]} v 0) v1 -- 0x7ff1381ecf20 con 0x7ff1380c6030 2023-12-08T08:23:31.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.326+0000 7ff11f7fe640 1 -- 172.21.15.88:0/412613238 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]}]=0 added key for client.testuser v21) v1 ==== 272+0+0 (secure 0 0 0) 0x7ff1381ecf20 con 0x7ff1380c6030 2023-12-08T08:23:31.332 INFO:teuthology.orchestra.run.smithi088.stderr:added key for client.testuser 2023-12-08T08:23:31.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.330+0000 7ff13d19d640 1 -- 172.21.15.88:0/412613238 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff124066470 msgr2=0x7ff124068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:31.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.330+0000 7ff13d19d640 1 --2- 172.21.15.88:0/412613238 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff124066470 0x7ff124068930 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff1280ad000 tx=0x7ff128008040 comp rx=0 tx=0).stop 2023-12-08T08:23:31.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.330+0000 7ff13d19d640 1 -- 172.21.15.88:0/412613238 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1380c6030 msgr2=0x7ff138142fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:31.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.330+0000 7ff13d19d640 1 --2- 172.21.15.88:0/412613238 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1380c6030 0x7ff138142fd0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7ff12c00c450 tx=0x7ff12c00c910 comp rx=0 tx=0).stop 2023-12-08T08:23:31.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.330+0000 7ff13d19d640 1 -- 172.21.15.88:0/412613238 shutdown_connections 2023-12-08T08:23:31.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.330+0000 7ff13d19d640 1 --2- 172.21.15.88:0/412613238 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff124066470 0x7ff124068930 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:31.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.330+0000 7ff13d19d640 1 --2- 172.21.15.88:0/412613238 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff1380c98f0 0x7ff1380adfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:31.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.330+0000 7ff13d19d640 1 --2- 172.21.15.88:0/412613238 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1380c6030 0x7ff138142fd0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:31.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.330+0000 7ff13d19d640 1 --2- 172.21.15.88:0/412613238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1380bf2d0 0x7ff1381f0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:31.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.330+0000 7ff13d19d640 1 -- 172.21.15.88:0/412613238 >> 172.21.15.88:0/412613238 conn(0x7ff1380c9dc0 msgr2=0x7ff1380c4990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:31.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.330+0000 7ff13d19d640 1 -- 172.21.15.88:0/412613238 shutdown_connections 2023-12-08T08:23:31.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.330+0000 7ff13d19d640 1 -- 172.21.15.88:0/412613238 wait complete. 2023-12-08T08:23:31.353 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2023-12-08T08:23:31.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.486+0000 7fa919b2a640 1 Processor -- start 2023-12-08T08:23:31.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.486+0000 7fa919b2a640 1 -- start start 2023-12-08T08:23:31.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.490+0000 7fa919b2a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa9140a5370 0x7fa91414f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:31.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.490+0000 7fa919b2a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa914072810 0x7fa91414fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:31.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.490+0000 7fa919b2a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9141524b0 con 0x7fa9140a4f90 2023-12-08T08:23:31.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.490+0000 7fa919b2a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9140c60d0 con 0x7fa9140a5370 2023-12-08T08:23:31.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.490+0000 7fa919b2a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9140c62f0 con 0x7fa914072810 2023-12-08T08:23:31.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.490+0000 7fa912ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa9140a5370 0x7fa91414f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:31.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.490+0000 7fa9137fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa9140a4f90 0x7fa9140c59c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:32822/0 (socket says 172.21.15.88:32822) 2023-12-08T08:23:31.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.490+0000 7fa9137fe640 1 -- 172.21.15.88:0/1184181437 learned_addr learned my addr 172.21.15.88:0/1184181437 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:31.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.490+0000 7fa913fff640 1 --2- 172.21.15.88:0/1184181437 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa914072810 0x7fa91414fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:31.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.490+0000 7fa912ffd640 1 -- 172.21.15.88:0/1184181437 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa914072810 msgr2=0x7fa91414fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:31.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.490+0000 7fa912ffd640 1 --2- 172.21.15.88:0/1184181437 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa914072810 0x7fa91414fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:31.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.490+0000 7fa912ffd640 1 -- 172.21.15.88:0/1184181437 >> v1:172.21.15.88:6789/0 conn(0x7fa9140a4f90 legacy=0x7fa9140c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:31.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.490+0000 7fa912ffd640 1 -- 172.21.15.88:0/1184181437 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa914152770 con 0x7fa9140a5370 2023-12-08T08:23:31.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.490+0000 7fa9127fc640 1 -- 172.21.15.88:0/1184181437 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2299455951 0 0) 0x7fa9141524b0 con 0x7fa9140a4f90 2023-12-08T08:23:31.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.490+0000 7fa912ffd640 1 --2- 172.21.15.88:0/1184181437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9140a5370 0x7fa91414f870 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fa9080097c0 tx=0x7fa90801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26cf4be5cbc30bf2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:31.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.490+0000 7fa9127fc640 1 -- 172.21.15.88:0/1184181437 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9080ab600 con 0x7fa9140a5370 2023-12-08T08:23:31.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.490+0000 7fa9127fc640 1 -- 172.21.15.88:0/1184181437 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9080a7050 con 0x7fa9140a5370 2023-12-08T08:23:31.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.490+0000 7fa9127fc640 1 -- 172.21.15.88:0/1184181437 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9080ab980 con 0x7fa9140a5370 2023-12-08T08:23:31.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.494+0000 7fa919b2a640 1 -- 172.21.15.88:0/1184181437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9140a5370 msgr2=0x7fa91414f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:31.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.494+0000 7fa919b2a640 1 --2- 172.21.15.88:0/1184181437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9140a5370 0x7fa91414f870 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fa9080097c0 tx=0x7fa90801c3f0 comp rx=0 tx=0).stop 2023-12-08T08:23:31.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.494+0000 7fa919b2a640 1 -- 172.21.15.88:0/1184181437 shutdown_connections 2023-12-08T08:23:31.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.494+0000 7fa919b2a640 1 --2- 172.21.15.88:0/1184181437 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa914072810 0x7fa91414fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:31.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.494+0000 7fa919b2a640 1 --2- 172.21.15.88:0/1184181437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa9140a5370 0x7fa91414f870 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:31.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.494+0000 7fa919b2a640 1 -- 172.21.15.88:0/1184181437 >> 172.21.15.88:0/1184181437 conn(0x7fa91406b220 msgr2=0x7fa9140a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:31.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.494+0000 7fa919b2a640 1 -- 172.21.15.88:0/1184181437 shutdown_connections 2023-12-08T08:23:31.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.494+0000 7fa919b2a640 1 -- 172.21.15.88:0/1184181437 wait complete. 2023-12-08T08:23:31.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.494+0000 7fa919b2a640 1 Processor -- start 2023-12-08T08:23:31.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.494+0000 7fa919b2a640 1 -- start start 2023-12-08T08:23:31.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.494+0000 7fa919b2a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa914072810 0x7fa914150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:31.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.494+0000 7fa919b2a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9140a4f90 0x7fa91414a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:31.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.494+0000 7fa919b2a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa9140a5370 0x7fa91414a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:31.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.494+0000 7fa919b2a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa914157400 con 0x7fa914072810 2023-12-08T08:23:31.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.494+0000 7fa919b2a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91414ccb0 con 0x7fa9140a4f90 2023-12-08T08:23:31.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.494+0000 7fa919b2a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91414af30 con 0x7fa9140a5370 2023-12-08T08:23:31.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.494+0000 7fa9137fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa914072810 0x7fa914150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:31.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.494+0000 7fa9137fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa914072810 0x7fa914150270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54572/0 (socket says 172.21.15.88:54572) 2023-12-08T08:23:31.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.494+0000 7fa9137fe640 1 -- 172.21.15.88:0/4096717208 learned_addr learned my addr 172.21.15.88:0/4096717208 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:31.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.494+0000 7fa913fff640 1 --2- 172.21.15.88:0/4096717208 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa9140a5370 0x7fa91414a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:31.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.494+0000 7fa912ffd640 1 --2- 172.21.15.88:0/4096717208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9140a4f90 0x7fa91414a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:31.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.494+0000 7fa9137fe640 1 -- 172.21.15.88:0/4096717208 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa9140a5370 msgr2=0x7fa91414a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:31.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.494+0000 7fa9137fe640 1 --2- 172.21.15.88:0/4096717208 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa9140a5370 0x7fa91414a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:31.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.498+0000 7fa9137fe640 1 -- 172.21.15.88:0/4096717208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9140a4f90 msgr2=0x7fa91414a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:31.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.498+0000 7fa9137fe640 1 --2- 172.21.15.88:0/4096717208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9140a4f90 0x7fa91414a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:31.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.498+0000 7fa9137fe640 1 -- 172.21.15.88:0/4096717208 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa908009420 con 0x7fa914072810 2023-12-08T08:23:31.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.498+0000 7fa912ffd640 1 --2- 172.21.15.88:0/4096717208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9140a4f90 0x7fa91414a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:31.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.498+0000 7fa9137fe640 1 --2- 172.21.15.88:0/4096717208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa914072810 0x7fa914150270 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fa9040011f0 tx=0x7fa90400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:31.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.498+0000 7fa8fbfff640 1 -- 172.21.15.88:0/4096717208 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9040074e0 con 0x7fa914072810 2023-12-08T08:23:31.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.498+0000 7fa8fbfff640 1 -- 172.21.15.88:0/4096717208 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa904007640 con 0x7fa914072810 2023-12-08T08:23:31.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.498+0000 7fa8fbfff640 1 -- 172.21.15.88:0/4096717208 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa904004a10 con 0x7fa914072810 2023-12-08T08:23:31.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.498+0000 7fa919b2a640 1 -- 172.21.15.88:0/4096717208 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa91414c6f0 con 0x7fa914072810 2023-12-08T08:23:31.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.498+0000 7fa919b2a640 1 -- 172.21.15.88:0/4096717208 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9141507b0 con 0x7fa914072810 2023-12-08T08:23:31.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.498+0000 7fa919b2a640 1 -- 172.21.15.88:0/4096717208 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa91414c520 con 0x7fa914072810 2023-12-08T08:23:31.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.498+0000 7fa8fbfff640 1 -- 172.21.15.88:0/4096717208 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa904004b70 con 0x7fa914072810 2023-12-08T08:23:31.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.498+0000 7fa8fbfff640 1 --2- 172.21.15.88:0/4096717208 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa900066470 0x7fa900068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:31.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.498+0000 7fa8fbfff640 1 -- 172.21.15.88:0/4096717208 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa9040832d0 con 0x7fa914072810 2023-12-08T08:23:31.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.498+0000 7fa912ffd640 1 --2- 172.21.15.88:0/4096717208 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa900066470 0x7fa900068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:31.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.502+0000 7fa912ffd640 1 --2- 172.21.15.88:0/4096717208 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa900066470 0x7fa900068930 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa9080ad000 tx=0x7fa9080a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:31.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.502+0000 7fa8fbfff640 1 -- 172.21.15.88:0/4096717208 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa904050490 con 0x7fa914072810 2023-12-08T08:23:31.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.706+0000 7fa919b2a640 1 -- 172.21.15.88:0/4096717208 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7fa914067630 con 0x7fa914072810 2023-12-08T08:23:31.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.710+0000 7fa8fbfff640 1 -- 172.21.15.88:0/4096717208 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v21) v1 ==== 85+0+226 (secure 0 0 0) 0x7fa904053ab0 con 0x7fa914072810 2023-12-08T08:23:31.713 INFO:teuthology.orchestra.run.smithi088.stdout:[client.testuser] 2023-12-08T08:23:31.713 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCD0nJlpwWiExAAMbkPnLBFpAMwBuADIemLSA== 2023-12-08T08:23:31.713 INFO:teuthology.orchestra.run.smithi088.stdout: caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" 2023-12-08T08:23:31.714 INFO:teuthology.orchestra.run.smithi088.stdout: caps mon = "allow r" 2023-12-08T08:23:31.714 INFO:teuthology.orchestra.run.smithi088.stdout: caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-08T08:23:31.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.710+0000 7fa919b2a640 1 -- 172.21.15.88:0/4096717208 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa900066470 msgr2=0x7fa900068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:31.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.710+0000 7fa919b2a640 1 --2- 172.21.15.88:0/4096717208 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa900066470 0x7fa900068930 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa9080ad000 tx=0x7fa9080a6000 comp rx=0 tx=0).stop 2023-12-08T08:23:31.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.710+0000 7fa919b2a640 1 -- 172.21.15.88:0/4096717208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa914072810 msgr2=0x7fa914150270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:31.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.710+0000 7fa919b2a640 1 --2- 172.21.15.88:0/4096717208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa914072810 0x7fa914150270 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fa9040011f0 tx=0x7fa90400c9b0 comp rx=0 tx=0).stop 2023-12-08T08:23:31.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.710+0000 7fa919b2a640 1 -- 172.21.15.88:0/4096717208 shutdown_connections 2023-12-08T08:23:31.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.710+0000 7fa919b2a640 1 --2- 172.21.15.88:0/4096717208 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa900066470 0x7fa900068930 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:31.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.710+0000 7fa919b2a640 1 --2- 172.21.15.88:0/4096717208 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa9140a5370 0x7fa91414a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:31.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.710+0000 7fa919b2a640 1 --2- 172.21.15.88:0/4096717208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9140a4f90 0x7fa91414a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:31.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.710+0000 7fa919b2a640 1 --2- 172.21.15.88:0/4096717208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa914072810 0x7fa914150270 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:31.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.710+0000 7fa919b2a640 1 -- 172.21.15.88:0/4096717208 >> 172.21.15.88:0/4096717208 conn(0x7fa91406b220 msgr2=0x7fa9140c1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:31.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.710+0000 7fa919b2a640 1 -- 172.21.15.88:0/4096717208 shutdown_connections 2023-12-08T08:23:31.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:31.710+0000 7fa919b2a640 1 -- 172.21.15.88:0/4096717208 wait complete. 2023-12-08T08:23:31.733 INFO:tasks.cephfs.test_multifs_auth:keyring generated for testing is - [client.testuser] key = AQCD0nJlpwWiExAAMbkPnLBFpAMwBuADIemLSA== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-08T08:23:31.734 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2023-12-08T08:23:31.742 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.O1Dx6JIs2G 2023-12-08T08:23:31.743 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:23:31.743 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/tmp/tmp.O1Dx6JIs2G 2023-12-08T08:23:31.793 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:23:31.793 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:23:31.845 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:23:31.845 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:23:31.897 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:23:32.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.070+0000 7fe675ee3640 1 Processor -- start 2023-12-08T08:23:32.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.074+0000 7fe675ee3640 1 -- start start 2023-12-08T08:23:32.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.074+0000 7fe675ee3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700af4c0 0x7fe670154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:32.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.074+0000 7fe675ee3640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe6700c67d0 0x7fe6700c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:32.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.074+0000 7fe675ee3640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6700c4890 con 0x7fe67006b9f0 2023-12-08T08:23:32.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.074+0000 7fe675ee3640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe670155460 con 0x7fe6700c67d0 2023-12-08T08:23:32.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.074+0000 7fe675ee3640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6700af8a0 con 0x7fe6700af4c0 2023-12-08T08:23:32.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.074+0000 7fe66f7fe640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700af4c0 0x7fe670154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:32.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.074+0000 7fe667fff640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe6700c67d0 0x7fe6700c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:32.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.074+0000 7fe66ffff640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe67006b9f0 0x7fe670157a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:47540/0 (socket says 172.21.15.88:47540) 2023-12-08T08:23:32.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.074+0000 7fe66ffff640 1 -- 172.21.15.88:0/3583075084 learned_addr learned my addr 172.21.15.88:0/3583075084 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:32.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.074+0000 7fe667fff640 1 -- 172.21.15.88:0/3583075084 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700af4c0 msgr2=0x7fe670154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:32.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.074+0000 7fe667fff640 1 --2- 172.21.15.88:0/3583075084 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700af4c0 0x7fe670154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.074+0000 7fe667fff640 1 -- 172.21.15.88:0/3583075084 >> v1:172.21.15.148:6789/0 conn(0x7fe67006b9f0 legacy=0x7fe670157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:32.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.074+0000 7fe667fff640 1 -- 172.21.15.88:0/3583075084 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6700c4b30 con 0x7fe6700c67d0 2023-12-08T08:23:32.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.074+0000 7fe66f7fe640 1 --2- 172.21.15.88:0/3583075084 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700af4c0 0x7fe670154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:23:32.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.078+0000 7fe667fff640 1 --2- 172.21.15.88:0/3583075084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6700c67d0 0x7fe6700c6c50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe6580097c0 tx=0x7fe65801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=904f7a8262ac90cb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:32.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.078+0000 7fe66effd640 1 -- 172.21.15.88:0/3583075084 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6580ac620 con 0x7fe6700c67d0 2023-12-08T08:23:32.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.078+0000 7fe66effd640 1 -- 172.21.15.88:0/3583075084 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6580ac780 con 0x7fe6700c67d0 2023-12-08T08:23:32.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.078+0000 7fe66effd640 1 -- 172.21.15.88:0/3583075084 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6580acb10 con 0x7fe6700c67d0 2023-12-08T08:23:32.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.078+0000 7fe675ee3640 1 -- 172.21.15.88:0/3583075084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6700c67d0 msgr2=0x7fe6700c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:32.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.078+0000 7fe675ee3640 1 --2- 172.21.15.88:0/3583075084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6700c67d0 0x7fe6700c6c50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe6580097c0 tx=0x7fe65801c3c0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.078+0000 7fe675ee3640 1 -- 172.21.15.88:0/3583075084 shutdown_connections 2023-12-08T08:23:32.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.078+0000 7fe675ee3640 1 --2- 172.21.15.88:0/3583075084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6700c67d0 0x7fe6700c6c50 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.078+0000 7fe675ee3640 1 --2- 172.21.15.88:0/3583075084 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700af4c0 0x7fe670154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.078+0000 7fe675ee3640 1 -- 172.21.15.88:0/3583075084 >> 172.21.15.88:0/3583075084 conn(0x7fe6700ab9d0 msgr2=0x7fe6700abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:32.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.078+0000 7fe675ee3640 1 -- 172.21.15.88:0/3583075084 shutdown_connections 2023-12-08T08:23:32.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.078+0000 7fe675ee3640 1 -- 172.21.15.88:0/3583075084 wait complete. 2023-12-08T08:23:32.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.082+0000 7fe675ee3640 1 Processor -- start 2023-12-08T08:23:32.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.082+0000 7fe675ee3640 1 -- start start 2023-12-08T08:23:32.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.082+0000 7fe675ee3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67006b9f0 0x7fe6700ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.082+0000 7fe675ee3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6700af4c0 0x7fe67014cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.082+0000 7fe675ee3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700c67d0 0x7fe6700acac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.082+0000 7fe675ee3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67014e3a0 con 0x7fe67006b9f0 2023-12-08T08:23:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.082+0000 7fe675ee3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6701f0bd0 con 0x7fe6700af4c0 2023-12-08T08:23:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.082+0000 7fe675ee3640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6701f0eb0 con 0x7fe6700c67d0 2023-12-08T08:23:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.082+0000 7fe66f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67006b9f0 0x7fe6700ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.082+0000 7fe66f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67006b9f0 0x7fe6700ae570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54586/0 (socket says 172.21.15.88:54586) 2023-12-08T08:23:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.082+0000 7fe66f7fe640 1 -- 172.21.15.88:0/11979729 learned_addr learned my addr 172.21.15.88:0/11979729 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.082+0000 7fe66ffff640 1 --2- 172.21.15.88:0/11979729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700c67d0 0x7fe6700acac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.082+0000 7fe667fff640 1 --2- 172.21.15.88:0/11979729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6700af4c0 0x7fe67014cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.082+0000 7fe66f7fe640 1 -- 172.21.15.88:0/11979729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700c67d0 msgr2=0x7fe6700acac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:32.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.082+0000 7fe66f7fe640 1 --2- 172.21.15.88:0/11979729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700c67d0 0x7fe6700acac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.082+0000 7fe66f7fe640 1 -- 172.21.15.88:0/11979729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6700af4c0 msgr2=0x7fe67014cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:32.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.082+0000 7fe66f7fe640 1 --2- 172.21.15.88:0/11979729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6700af4c0 0x7fe67014cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.082+0000 7fe66f7fe640 1 -- 172.21.15.88:0/11979729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe660009420 con 0x7fe67006b9f0 2023-12-08T08:23:32.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.082+0000 7fe66ffff640 1 --2- 172.21.15.88:0/11979729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700c67d0 0x7fe6700acac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:32.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.082+0000 7fe66f7fe640 1 --2- 172.21.15.88:0/11979729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67006b9f0 0x7fe6700ae570 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fe66000ebe0 tx=0x7fe66000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:32.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.082+0000 7fe66cff9640 1 -- 172.21.15.88:0/11979729 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66000eee0 con 0x7fe67006b9f0 2023-12-08T08:23:32.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.082+0000 7fe66cff9640 1 -- 172.21.15.88:0/11979729 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66000cc30 con 0x7fe67006b9f0 2023-12-08T08:23:32.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.082+0000 7fe66cff9640 1 -- 172.21.15.88:0/11979729 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe660013470 con 0x7fe67006b9f0 2023-12-08T08:23:32.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.082+0000 7fe675ee3640 1 -- 172.21.15.88:0/11979729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe658009420 con 0x7fe67006b9f0 2023-12-08T08:23:32.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.082+0000 7fe675ee3640 1 -- 172.21.15.88:0/11979729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe67014e680 con 0x7fe67006b9f0 2023-12-08T08:23:32.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.082+0000 7fe675ee3640 1 -- 172.21.15.88:0/11979729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe67014c820 con 0x7fe67006b9f0 2023-12-08T08:23:32.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.086+0000 7fe66cff9640 1 -- 172.21.15.88:0/11979729 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe6600135d0 con 0x7fe67006b9f0 2023-12-08T08:23:32.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.086+0000 7fe66cff9640 1 --2- 172.21.15.88:0/11979729 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe650066470 0x7fe650068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:32.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.086+0000 7fe66cff9640 1 -- 172.21.15.88:0/11979729 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe6600845e0 con 0x7fe67006b9f0 2023-12-08T08:23:32.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.086+0000 7fe667fff640 1 --2- 172.21.15.88:0/11979729 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe650066470 0x7fe650068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:32.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.086+0000 7fe667fff640 1 --2- 172.21.15.88:0/11979729 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe650066470 0x7fe650068930 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe6580ae000 tx=0x7fe6580a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:32.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.090+0000 7fe66cff9640 1 -- 172.21.15.88:0/11979729 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe67014c820 con 0x7fe67006b9f0 2023-12-08T08:23:32.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.242+0000 7fe675ee3640 1 -- 172.21.15.88:0/11979729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe67014c820 con 0x7fe67006b9f0 2023-12-08T08:23:32.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.242+0000 7fe66cff9640 1 -- 172.21.15.88:0/11979729 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20190 (secure 0 0 0) 0x7fe67014c820 con 0x7fe67006b9f0 2023-12-08T08:23:32.248 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:32.248 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":72,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:23:18.903336+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:57.367467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:58.632605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:23:15.029129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:23:16.271716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:23:32.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.246+0000 7fe675ee3640 1 -- 172.21.15.88:0/11979729 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe650066470 msgr2=0x7fe650068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:32.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.246+0000 7fe675ee3640 1 --2- 172.21.15.88:0/11979729 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe650066470 0x7fe650068930 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe6580ae000 tx=0x7fe6580a7000 comp rx=0 tx=0).stop 2023-12-08T08:23:32.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.246+0000 7fe675ee3640 1 -- 172.21.15.88:0/11979729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67006b9f0 msgr2=0x7fe6700ae570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:32.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.246+0000 7fe675ee3640 1 --2- 172.21.15.88:0/11979729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67006b9f0 0x7fe6700ae570 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fe66000ebe0 tx=0x7fe66000c520 comp rx=0 tx=0).stop 2023-12-08T08:23:32.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.246+0000 7fe675ee3640 1 -- 172.21.15.88:0/11979729 shutdown_connections 2023-12-08T08:23:32.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.246+0000 7fe675ee3640 1 --2- 172.21.15.88:0/11979729 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe650066470 0x7fe650068930 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.246+0000 7fe675ee3640 1 --2- 172.21.15.88:0/11979729 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe6700c67d0 0x7fe6700acac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.246+0000 7fe675ee3640 1 --2- 172.21.15.88:0/11979729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6700af4c0 0x7fe67014cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.246+0000 7fe675ee3640 1 --2- 172.21.15.88:0/11979729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe67006b9f0 0x7fe6700ae570 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.246+0000 7fe675ee3640 1 -- 172.21.15.88:0/11979729 >> 172.21.15.88:0/11979729 conn(0x7fe6700ab9d0 msgr2=0x7fe670157a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:32.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.246+0000 7fe675ee3640 1 -- 172.21.15.88:0/11979729 shutdown_connections 2023-12-08T08:23:32.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.246+0000 7fe675ee3640 1 -- 172.21.15.88:0/11979729 wait complete. 2023-12-08T08:23:32.269 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:22:57.367467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:22:58.632605+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:23:15.029129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:23:16.271716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:23:32.270 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:23:32.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a72dc640 1 Processor -- start 2023-12-08T08:23:32.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a72dc640 1 -- start start 2023-12-08T08:23:32.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a72dc640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54a00a4ca0 0x7f54a01543e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:32.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a72dc640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f54a00c51e0 0x7f54a0154920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:32.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a72dc640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a00a5210 con 0x7f54a0151760 2023-12-08T08:23:32.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a72dc640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a00c0380 con 0x7f54a00c51e0 2023-12-08T08:23:32.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a72dc640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a00c0660 con 0x7f54a00a4ca0 2023-12-08T08:23:32.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a62da640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f54a0151760 0x7f54a00c1250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:32828/0 (socket says 172.21.15.88:32828) 2023-12-08T08:23:32.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a62da640 1 -- 172.21.15.88:0/3759065580 learned_addr learned my addr 172.21.15.88:0/3759065580 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:32.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a5ad9640 1 --2- 172.21.15.88:0/3759065580 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54a00a4ca0 0x7f54a01543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:32.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a6adb640 1 --2- 172.21.15.88:0/3759065580 >> v2:172.21.15.148:3300/0 conn(0x7f54a00c51e0 0x7f54a0154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:32.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a52d8640 1 -- 172.21.15.88:0/3759065580 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3159964407 0 0) 0x7f54a00a5210 con 0x7f54a0151760 2023-12-08T08:23:32.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a52d8640 1 -- 172.21.15.88:0/3759065580 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f548c003530 con 0x7f54a0151760 2023-12-08T08:23:32.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a52d8640 1 -- 172.21.15.88:0/3759065580 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1030535649 0 0) 0x7f548c003530 con 0x7f54a0151760 2023-12-08T08:23:32.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a52d8640 1 -- 172.21.15.88:0/3759065580 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54a00a4ca0 msgr2=0x7f54a01543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:32.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a52d8640 1 --2- 172.21.15.88:0/3759065580 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54a00a4ca0 0x7f54a01543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a52d8640 1 -- 172.21.15.88:0/3759065580 >> v2:172.21.15.148:3300/0 conn(0x7f54a00c51e0 msgr2=0x7f54a0154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:32.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a52d8640 1 --2- 172.21.15.88:0/3759065580 >> v2:172.21.15.148:3300/0 conn(0x7f54a00c51e0 0x7f54a0154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a52d8640 1 -- 172.21.15.88:0/3759065580 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a00c0940 con 0x7f54a0151760 2023-12-08T08:23:32.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a52d8640 1 -- 172.21.15.88:0/3759065580 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f549c001680 con 0x7f54a0151760 2023-12-08T08:23:32.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a52d8640 1 -- 172.21.15.88:0/3759065580 >> v1:172.21.15.88:6789/0 conn(0x7f54a0151760 legacy=0x7f54a00c1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:32.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a52d8640 1 --2- 172.21.15.88:0/3759065580 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54a00a4ca0 0x7f548c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:32.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a52d8640 1 --2- 172.21.15.88:0/3759065580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f548c003f00 0x7f548c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:32.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a52d8640 1 --2- 172.21.15.88:0/3759065580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f548c004d10 0x7f548c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:32.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a52d8640 1 -- 172.21.15.88:0/3759065580 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a00c0380 con 0x7f548c003f00 2023-12-08T08:23:32.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a52d8640 1 -- 172.21.15.88:0/3759065580 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a00c0660 con 0x7f548c004d10 2023-12-08T08:23:32.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a52d8640 1 -- 172.21.15.88:0/3759065580 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548c00ba70 con 0x7f54a00a4ca0 2023-12-08T08:23:32.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a5ad9640 1 --2- 172.21.15.88:0/3759065580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f548c003f00 0x7f548c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:32.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a6adb640 1 --2- 172.21.15.88:0/3759065580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f548c004d10 0x7f548c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:32.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a62da640 1 --2- 172.21.15.88:0/3759065580 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54a00a4ca0 0x7f548c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:32.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a5ad9640 1 -- 172.21.15.88:0/3759065580 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54a00a4ca0 msgr2=0x7f548c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:32.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.410+0000 7f54a5ad9640 1 --2- 172.21.15.88:0/3759065580 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54a00a4ca0 0x7f548c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.414+0000 7f54a5ad9640 1 -- 172.21.15.88:0/3759065580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f548c004d10 msgr2=0x7f548c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:32.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.414+0000 7f54a5ad9640 1 --2- 172.21.15.88:0/3759065580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f548c004d10 0x7f548c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.414+0000 7f54a5ad9640 1 -- 172.21.15.88:0/3759065580 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c003530 con 0x7f548c003f00 2023-12-08T08:23:32.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.414+0000 7f54a5ad9640 1 --2- 172.21.15.88:0/3759065580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f548c003f00 0x7f548c0047d0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f5490009ae0 tx=0x7f549001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c043dde24e2c1f08 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:32.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.414+0000 7f54a52d8640 1 -- 172.21.15.88:0/3759065580 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54900a5610 con 0x7f548c003f00 2023-12-08T08:23:32.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.414+0000 7f54a52d8640 1 -- 172.21.15.88:0/3759065580 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54900a5770 con 0x7f548c003f00 2023-12-08T08:23:32.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.414+0000 7f54a52d8640 1 -- 172.21.15.88:0/3759065580 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54900a5b20 con 0x7f548c003f00 2023-12-08T08:23:32.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.414+0000 7f54a72dc640 1 -- 172.21.15.88:0/3759065580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f548c003f00 msgr2=0x7f548c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:32.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.414+0000 7f54a72dc640 1 --2- 172.21.15.88:0/3759065580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f548c003f00 0x7f548c0047d0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f5490009ae0 tx=0x7f549001ca20 comp rx=0 tx=0).stop 2023-12-08T08:23:32.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.414+0000 7f54a6adb640 1 -- 172.21.15.88:0/3759065580 reap_dead start 2023-12-08T08:23:32.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.414+0000 7f54a72dc640 1 -- 172.21.15.88:0/3759065580 shutdown_connections 2023-12-08T08:23:32.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.414+0000 7f54a72dc640 1 -- 172.21.15.88:0/3759065580 >> 172.21.15.88:0/3759065580 conn(0x7f54a00c2350 msgr2=0x7f54a00c2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:32.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.414+0000 7f54a72dc640 1 -- 172.21.15.88:0/3759065580 shutdown_connections 2023-12-08T08:23:32.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.414+0000 7f54a72dc640 1 -- 172.21.15.88:0/3759065580 wait complete. 2023-12-08T08:23:32.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.418+0000 7f54a72dc640 1 Processor -- start 2023-12-08T08:23:32.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.418+0000 7f54a72dc640 1 -- start start 2023-12-08T08:23:32.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.418+0000 7f54a72dc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f548c003f00 0x7f54a0152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:32.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.418+0000 7f54a72dc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54a014ef90 0x7f54a01f0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:32.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.418+0000 7f54a72dc640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54a00a6720 0x7f54a01ed570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:32.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.418+0000 7f54a72dc640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a01f0840 con 0x7f548c003f00 2023-12-08T08:23:32.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.418+0000 7f54a72dc640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a01ed0e0 con 0x7f54a014ef90 2023-12-08T08:23:32.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.418+0000 7f54a72dc640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a01ecd90 con 0x7f54a00a6720 2023-12-08T08:23:32.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.418+0000 7f54a62da640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f548c003f00 0x7f54a0152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:32.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.418+0000 7f54a62da640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f548c003f00 0x7f54a0152240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54596/0 (socket says 172.21.15.88:54596) 2023-12-08T08:23:32.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.418+0000 7f54a62da640 1 -- 172.21.15.88:0/3566746119 learned_addr learned my addr 172.21.15.88:0/3566746119 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:32.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.418+0000 7f54a5ad9640 1 --2- 172.21.15.88:0/3566746119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54a014ef90 0x7f54a01f0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:32.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.418+0000 7f54a6adb640 1 --2- 172.21.15.88:0/3566746119 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54a00a6720 0x7f54a01ed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:32.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.418+0000 7f54a62da640 1 -- 172.21.15.88:0/3566746119 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54a00a6720 msgr2=0x7f54a01ed570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:32.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.418+0000 7f54a62da640 1 --2- 172.21.15.88:0/3566746119 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54a00a6720 0x7f54a01ed570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.418+0000 7f54a62da640 1 -- 172.21.15.88:0/3566746119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54a014ef90 msgr2=0x7f54a01f0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:32.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.418+0000 7f54a62da640 1 --2- 172.21.15.88:0/3566746119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54a014ef90 0x7f54a01f0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.418+0000 7f54a62da640 1 -- 172.21.15.88:0/3566746119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a01f0a70 con 0x7f548c003f00 2023-12-08T08:23:32.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.418+0000 7f54a5ad9640 1 --2- 172.21.15.88:0/3566746119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54a014ef90 0x7f54a01f0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:32.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.418+0000 7f54a62da640 1 --2- 172.21.15.88:0/3566746119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f548c003f00 0x7f54a0152240 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f549c00e730 tx=0x7f549c00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:32.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.418+0000 7f5496ffd640 1 -- 172.21.15.88:0/3566746119 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c00c6c0 con 0x7f548c003f00 2023-12-08T08:23:32.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.418+0000 7f5496ffd640 1 -- 172.21.15.88:0/3566746119 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c00c840 con 0x7f548c003f00 2023-12-08T08:23:32.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.418+0000 7f5496ffd640 1 -- 172.21.15.88:0/3566746119 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c00cbf0 con 0x7f548c003f00 2023-12-08T08:23:32.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.418+0000 7f54a72dc640 1 -- 172.21.15.88:0/3566746119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a01f0d50 con 0x7f548c003f00 2023-12-08T08:23:32.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.418+0000 7f54a72dc640 1 -- 172.21.15.88:0/3566746119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a00a6ba0 con 0x7f548c003f00 2023-12-08T08:23:32.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.422+0000 7f54a72dc640 1 -- 172.21.15.88:0/3566746119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a00674b0 con 0x7f548c003f00 2023-12-08T08:23:32.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.422+0000 7f5496ffd640 1 -- 172.21.15.88:0/3566746119 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f549c00cd50 con 0x7f548c003f00 2023-12-08T08:23:32.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.422+0000 7f5496ffd640 1 --2- 172.21.15.88:0/3566746119 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5484066470 0x7f5484068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:32.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.422+0000 7f5496ffd640 1 -- 172.21.15.88:0/3566746119 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f549c083f70 con 0x7f548c003f00 2023-12-08T08:23:32.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.422+0000 7f54a5ad9640 1 --2- 172.21.15.88:0/3566746119 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5484066470 0x7f5484068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:32.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.422+0000 7f54a5ad9640 1 --2- 172.21.15.88:0/3566746119 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5484066470 0x7f5484068930 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f54900af000 tx=0x7f54900046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:32.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.426+0000 7f5496ffd640 1 -- 172.21.15.88:0/3566746119 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f549c0b5280 con 0x7f548c003f00 2023-12-08T08:23:32.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.578+0000 7f54a72dc640 1 -- 172.21.15.88:0/3566746119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f54a00bfc50 con 0x7f548c003f00 2023-12-08T08:23:32.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.578+0000 7f5496ffd640 1 -- 172.21.15.88:0/3566746119 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f549c051120 con 0x7f548c003f00 2023-12-08T08:23:32.582 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:23:32.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.578+0000 7f54a72dc640 1 -- 172.21.15.88:0/3566746119 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5484066470 msgr2=0x7f5484068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:32.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.578+0000 7f54a72dc640 1 --2- 172.21.15.88:0/3566746119 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5484066470 0x7f5484068930 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f54900af000 tx=0x7f54900046d0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.578+0000 7f54a72dc640 1 -- 172.21.15.88:0/3566746119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f548c003f00 msgr2=0x7f54a0152240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:32.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.578+0000 7f54a72dc640 1 --2- 172.21.15.88:0/3566746119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f548c003f00 0x7f54a0152240 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f549c00e730 tx=0x7f549c00ebf0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.578+0000 7f54a72dc640 1 -- 172.21.15.88:0/3566746119 shutdown_connections 2023-12-08T08:23:32.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.578+0000 7f54a72dc640 1 --2- 172.21.15.88:0/3566746119 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5484066470 0x7f5484068930 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.578+0000 7f54a72dc640 1 --2- 172.21.15.88:0/3566746119 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f54a00a6720 0x7f54a01ed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.578+0000 7f54a72dc640 1 --2- 172.21.15.88:0/3566746119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54a014ef90 0x7f54a01f0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.578+0000 7f54a72dc640 1 --2- 172.21.15.88:0/3566746119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f548c003f00 0x7f54a0152240 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.578+0000 7f54a72dc640 1 -- 172.21.15.88:0/3566746119 >> 172.21.15.88:0/3566746119 conn(0x7f54a00c2350 msgr2=0x7f54a006d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:32.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.578+0000 7f54a72dc640 1 -- 172.21.15.88:0/3566746119 shutdown_connections 2023-12-08T08:23:32.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.578+0000 7f54a72dc640 1 -- 172.21.15.88:0/3566746119 wait complete. 2023-12-08T08:23:32.603 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:23:32.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.738+0000 7f7a9d10e640 1 Processor -- start 2023-12-08T08:23:32.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.738+0000 7f7a9d10e640 1 -- start start 2023-12-08T08:23:32.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.738+0000 7f7a9d10e640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7a9814e2a0 0x7f7a981516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:32.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.738+0000 7f7a9d10e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a980a9910 0x7f7a9806bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:32.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.738+0000 7f7a9d10e640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a98151210 con 0x7f7a980a9460 2023-12-08T08:23:32.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.738+0000 7f7a9d10e640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a9814e680 con 0x7f7a9814e2a0 2023-12-08T08:23:32.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.738+0000 7f7a9d10e640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a98150be0 con 0x7f7a980a9910 2023-12-08T08:23:32.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.738+0000 7f7a9759e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a980a9910 0x7f7a9806bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:32.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.742+0000 7f7a9759e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a980a9910 0x7f7a9806bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:40530/0 (socket says 172.21.15.88:40530) 2023-12-08T08:23:32.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.742+0000 7f7a9759e640 1 -- 172.21.15.88:0/2779585587 learned_addr learned my addr 172.21.15.88:0/2779585587 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:32.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.742+0000 7f7a96d9d640 1 --2- 172.21.15.88:0/2779585587 >> v2:172.21.15.148:3300/0 conn(0x7f7a9814e2a0 0x7f7a981516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:32.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.742+0000 7f7a9759e640 1 -- 172.21.15.88:0/2779585587 >> v2:172.21.15.148:3300/0 conn(0x7f7a9814e2a0 msgr2=0x7f7a981516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:32.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.742+0000 7f7a9759e640 1 --2- 172.21.15.88:0/2779585587 >> v2:172.21.15.148:3300/0 conn(0x7f7a9814e2a0 0x7f7a981516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.742+0000 7f7a9759e640 1 -- 172.21.15.88:0/2779585587 >> v1:172.21.15.148:6789/0 conn(0x7f7a980a9460 legacy=0x7f7a980c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:32.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.742+0000 7f7a9759e640 1 -- 172.21.15.88:0/2779585587 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a980c53c0 con 0x7f7a980a9910 2023-12-08T08:23:32.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.742+0000 7f7a9759e640 1 --2- 172.21.15.88:0/2779585587 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a980a9910 0x7f7a9806bc80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7a90009e50 tx=0x7f7a9001ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e2913d7dd08fdae server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:32.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.742+0000 7f7a95d9b640 1 -- 172.21.15.88:0/2779585587 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a900a5660 con 0x7f7a980a9910 2023-12-08T08:23:32.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.742+0000 7f7a95d9b640 1 -- 172.21.15.88:0/2779585587 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a900a57c0 con 0x7f7a980a9910 2023-12-08T08:23:32.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.742+0000 7f7a95d9b640 1 -- 172.21.15.88:0/2779585587 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a900a5b50 con 0x7f7a980a9910 2023-12-08T08:23:32.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.746+0000 7f7a9d10e640 1 -- 172.21.15.88:0/2779585587 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a980a9910 msgr2=0x7f7a9806bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:32.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.746+0000 7f7a9d10e640 1 --2- 172.21.15.88:0/2779585587 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a980a9910 0x7f7a9806bc80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7a90009e50 tx=0x7f7a9001ca10 comp rx=0 tx=0).stop 2023-12-08T08:23:32.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.746+0000 7f7a9d10e640 1 -- 172.21.15.88:0/2779585587 shutdown_connections 2023-12-08T08:23:32.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.746+0000 7f7a9d10e640 1 --2- 172.21.15.88:0/2779585587 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a980a9910 0x7f7a9806bc80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.746+0000 7f7a9d10e640 1 --2- 172.21.15.88:0/2779585587 >> v2:172.21.15.148:3300/0 conn(0x7f7a9814e2a0 0x7f7a981516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.746+0000 7f7a9d10e640 1 -- 172.21.15.88:0/2779585587 >> 172.21.15.88:0/2779585587 conn(0x7f7a980c59f0 msgr2=0x7f7a980c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:32.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.746+0000 7f7a9d10e640 1 -- 172.21.15.88:0/2779585587 shutdown_connections 2023-12-08T08:23:32.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.746+0000 7f7a9d10e640 1 -- 172.21.15.88:0/2779585587 wait complete. 2023-12-08T08:23:32.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.746+0000 7f7a9d10e640 1 Processor -- start 2023-12-08T08:23:32.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.746+0000 7f7a9d10e640 1 -- start start 2023-12-08T08:23:32.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.746+0000 7f7a9d10e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a980a9460 0x7f7a981ed350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:32.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.746+0000 7f7a9d10e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a980a9910 0x7f7a9814d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:32.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.746+0000 7f7a9d10e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a9814e2a0 0x7f7a9814a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:32.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.746+0000 7f7a9d10e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a981ed890 con 0x7f7a9814e2a0 2023-12-08T08:23:32.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.746+0000 7f7a9d10e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9814d660 con 0x7f7a980a9910 2023-12-08T08:23:32.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.746+0000 7f7a9d10e640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a981f0c90 con 0x7f7a980a9460 2023-12-08T08:23:32.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.746+0000 7f7a9759e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a9814e2a0 0x7f7a9814a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:32.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.746+0000 7f7a9759e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a9814e2a0 0x7f7a9814a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54606/0 (socket says 172.21.15.88:54606) 2023-12-08T08:23:32.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.746+0000 7f7a9759e640 1 -- 172.21.15.88:0/2027483144 learned_addr learned my addr 172.21.15.88:0/2027483144 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:32.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.746+0000 7f7a96d9d640 1 --2- 172.21.15.88:0/2027483144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a980a9460 0x7f7a981ed350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:32.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.746+0000 7f7a9659c640 1 --2- 172.21.15.88:0/2027483144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a980a9910 0x7f7a9814d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:32.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.746+0000 7f7a9759e640 1 -- 172.21.15.88:0/2027483144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a980a9460 msgr2=0x7f7a981ed350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:32.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.746+0000 7f7a9759e640 1 --2- 172.21.15.88:0/2027483144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a980a9460 0x7f7a981ed350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.746+0000 7f7a9759e640 1 -- 172.21.15.88:0/2027483144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a980a9910 msgr2=0x7f7a9814d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:32.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.746+0000 7f7a9759e640 1 --2- 172.21.15.88:0/2027483144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a980a9910 0x7f7a9814d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.746+0000 7f7a9759e640 1 -- 172.21.15.88:0/2027483144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a90009b30 con 0x7f7a9814e2a0 2023-12-08T08:23:32.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.746+0000 7f7a9659c640 1 --2- 172.21.15.88:0/2027483144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a980a9910 0x7f7a9814d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:32.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.750+0000 7f7a9759e640 1 --2- 172.21.15.88:0/2027483144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a9814e2a0 0x7f7a9814a430 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f7a900af040 tx=0x7f7a900197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:32.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.750+0000 7f7a7f7fe640 1 -- 172.21.15.88:0/2027483144 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a900b8670 con 0x7f7a9814e2a0 2023-12-08T08:23:32.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.750+0000 7f7a7f7fe640 1 -- 172.21.15.88:0/2027483144 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a900b87f0 con 0x7f7a9814e2a0 2023-12-08T08:23:32.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.750+0000 7f7a9d10e640 1 -- 172.21.15.88:0/2027483144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a981f0960 con 0x7f7a9814e2a0 2023-12-08T08:23:32.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.750+0000 7f7a7f7fe640 1 -- 172.21.15.88:0/2027483144 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a900b8ba0 con 0x7f7a9814e2a0 2023-12-08T08:23:32.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.750+0000 7f7a9d10e640 1 -- 172.21.15.88:0/2027483144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a9814bd80 con 0x7f7a9814e2a0 2023-12-08T08:23:32.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.750+0000 7f7a9d10e640 1 -- 172.21.15.88:0/2027483144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a98067630 con 0x7f7a9814e2a0 2023-12-08T08:23:32.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.750+0000 7f7a7f7fe640 1 -- 172.21.15.88:0/2027483144 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7a900b8d00 con 0x7f7a9814e2a0 2023-12-08T08:23:32.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.750+0000 7f7a7f7fe640 1 --2- 172.21.15.88:0/2027483144 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7a84066470 0x7f7a84068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:32.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.750+0000 7f7a7f7fe640 1 -- 172.21.15.88:0/2027483144 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7a9011f580 con 0x7f7a9814e2a0 2023-12-08T08:23:32.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.750+0000 7f7a96d9d640 1 --2- 172.21.15.88:0/2027483144 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7a84066470 0x7f7a84068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:32.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.754+0000 7f7a96d9d640 1 --2- 172.21.15.88:0/2027483144 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7a84066470 0x7f7a84068930 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7a98155180 tx=0x7f7a88008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:32.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.754+0000 7f7a7f7fe640 1 -- 172.21.15.88:0/2027483144 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7a900ec750 con 0x7f7a9814e2a0 2023-12-08T08:23:32.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.910+0000 7f7a9d10e640 1 -- 172.21.15.88:0/2027483144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7a9806e1a0 con 0x7f7a9814e2a0 2023-12-08T08:23:32.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.910+0000 7f7a7f7fe640 1 -- 172.21.15.88:0/2027483144 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7a9806e1a0 con 0x7f7a9814e2a0 2023-12-08T08:23:32.914 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:23:32.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.910+0000 7f7a9d10e640 1 -- 172.21.15.88:0/2027483144 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7a84066470 msgr2=0x7f7a84068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:32.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.910+0000 7f7a9d10e640 1 --2- 172.21.15.88:0/2027483144 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7a84066470 0x7f7a84068930 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7a98155180 tx=0x7f7a88008040 comp rx=0 tx=0).stop 2023-12-08T08:23:32.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.910+0000 7f7a9d10e640 1 -- 172.21.15.88:0/2027483144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a9814e2a0 msgr2=0x7f7a9814a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:32.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.910+0000 7f7a9d10e640 1 --2- 172.21.15.88:0/2027483144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a9814e2a0 0x7f7a9814a430 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f7a900af040 tx=0x7f7a900197b0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.910+0000 7f7a9d10e640 1 -- 172.21.15.88:0/2027483144 shutdown_connections 2023-12-08T08:23:32.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.910+0000 7f7a9d10e640 1 --2- 172.21.15.88:0/2027483144 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7a84066470 0x7f7a84068930 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.910+0000 7f7a9d10e640 1 --2- 172.21.15.88:0/2027483144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a9814e2a0 0x7f7a9814a430 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.910+0000 7f7a9d10e640 1 --2- 172.21.15.88:0/2027483144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a980a9910 0x7f7a9814d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.910+0000 7f7a9d10e640 1 --2- 172.21.15.88:0/2027483144 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7a980a9460 0x7f7a981ed350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:32.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.910+0000 7f7a9d10e640 1 -- 172.21.15.88:0/2027483144 >> 172.21.15.88:0/2027483144 conn(0x7f7a980c59f0 msgr2=0x7f7a9815b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:32.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.910+0000 7f7a9d10e640 1 -- 172.21.15.88:0/2027483144 shutdown_connections 2023-12-08T08:23:32.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:32.910+0000 7f7a9d10e640 1 -- 172.21.15.88:0/2027483144 wait complete. 2023-12-08T08:23:32.936 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:23:33.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.070+0000 7fcc1c879640 1 Processor -- start 2023-12-08T08:23:33.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.074+0000 7fcc1c879640 1 -- start start 2023-12-08T08:23:33.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.074+0000 7fcc1c879640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc1814b1e0 0x7fcc180c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:33.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.074+0000 7fcc1c879640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcc181548c0 0x7fcc18154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:33.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.074+0000 7fcc1c879640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc180a4e20 con 0x7fcc180c5300 2023-12-08T08:23:33.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.074+0000 7fcc1c879640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc180a50e0 con 0x7fcc181548c0 2023-12-08T08:23:33.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.074+0000 7fcc1c879640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc180c0f00 con 0x7fcc1814b1e0 2023-12-08T08:23:33.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.074+0000 7fcc16d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcc181548c0 0x7fcc18154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:33.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.074+0000 7fcc16d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcc181548c0 0x7fcc18154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54616/0 (socket says 172.21.15.88:54616) 2023-12-08T08:23:33.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.074+0000 7fcc16d9d640 1 -- 172.21.15.88:0/282890222 learned_addr learned my addr 172.21.15.88:0/282890222 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:33.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.074+0000 7fcc1659c640 1 --2- 172.21.15.88:0/282890222 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc1814b1e0 0x7fcc180c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:33.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.074+0000 7fcc16d9d640 1 -- 172.21.15.88:0/282890222 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc1814b1e0 msgr2=0x7fcc180c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:33.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.074+0000 7fcc16d9d640 1 --2- 172.21.15.88:0/282890222 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc1814b1e0 0x7fcc180c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.074+0000 7fcc16d9d640 1 -- 172.21.15.88:0/282890222 >> v1:172.21.15.148:6789/0 conn(0x7fcc180c5300 legacy=0x7fcc180a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:33.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.074+0000 7fcc16d9d640 1 -- 172.21.15.88:0/282890222 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc180c11e0 con 0x7fcc181548c0 2023-12-08T08:23:33.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.078+0000 7fcc16d9d640 1 --2- 172.21.15.88:0/282890222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc181548c0 0x7fcc18154d50 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fcc100098a0 tx=0x7fcc1001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a76f7f9a76cf05 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:33.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.078+0000 7fcc1559a640 1 -- 172.21.15.88:0/282890222 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc100a7070 con 0x7fcc181548c0 2023-12-08T08:23:33.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.078+0000 7fcc1559a640 1 -- 172.21.15.88:0/282890222 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc100ab430 con 0x7fcc181548c0 2023-12-08T08:23:33.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.078+0000 7fcc1559a640 1 -- 172.21.15.88:0/282890222 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc181558b0 con 0x7fcc181548c0 2023-12-08T08:23:33.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.078+0000 7fcc1c879640 1 -- 172.21.15.88:0/282890222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc181548c0 msgr2=0x7fcc18154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:33.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.078+0000 7fcc1c879640 1 --2- 172.21.15.88:0/282890222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc181548c0 0x7fcc18154d50 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fcc100098a0 tx=0x7fcc1001c520 comp rx=0 tx=0).stop 2023-12-08T08:23:33.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.078+0000 7fcc1c879640 1 -- 172.21.15.88:0/282890222 shutdown_connections 2023-12-08T08:23:33.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.078+0000 7fcc1c879640 1 --2- 172.21.15.88:0/282890222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc181548c0 0x7fcc18154d50 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.078+0000 7fcc1c879640 1 --2- 172.21.15.88:0/282890222 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc1814b1e0 0x7fcc180c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.078+0000 7fcc1c879640 1 -- 172.21.15.88:0/282890222 >> 172.21.15.88:0/282890222 conn(0x7fcc180c59f0 msgr2=0x7fcc180c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:33.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.078+0000 7fcc1c879640 1 -- 172.21.15.88:0/282890222 shutdown_connections 2023-12-08T08:23:33.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.078+0000 7fcc1c879640 1 -- 172.21.15.88:0/282890222 wait complete. 2023-12-08T08:23:33.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.078+0000 7fcc1c879640 1 Processor -- start 2023-12-08T08:23:33.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.078+0000 7fcc1c879640 1 -- start start 2023-12-08T08:23:33.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.082+0000 7fcc1c879640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc180c5300 0x7fcc18071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:33.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.082+0000 7fcc1c879640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc1814b1e0 0x7fcc18147d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:33.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.082+0000 7fcc1c879640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc181548c0 0x7fcc181482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:33.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.082+0000 7fcc1c879640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc180c6670 con 0x7fcc181548c0 2023-12-08T08:23:33.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.082+0000 7fcc1c879640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1814e4b0 con 0x7fcc180c5300 2023-12-08T08:23:33.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.082+0000 7fcc1c879640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc18147480 con 0x7fcc1814b1e0 2023-12-08T08:23:33.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.082+0000 7fcc16d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc181548c0 0x7fcc181482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:33.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.082+0000 7fcc16d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc181548c0 0x7fcc181482c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54620/0 (socket says 172.21.15.88:54620) 2023-12-08T08:23:33.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.082+0000 7fcc16d9d640 1 -- 172.21.15.88:0/1683801684 learned_addr learned my addr 172.21.15.88:0/1683801684 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:33.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.082+0000 7fcc1659c640 1 --2- 172.21.15.88:0/1683801684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc180c5300 0x7fcc18071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:33.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.082+0000 7fcc15d9b640 1 --2- 172.21.15.88:0/1683801684 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc1814b1e0 0x7fcc18147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:33.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.082+0000 7fcc16d9d640 1 -- 172.21.15.88:0/1683801684 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc1814b1e0 msgr2=0x7fcc18147d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:33.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.082+0000 7fcc16d9d640 1 --2- 172.21.15.88:0/1683801684 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc1814b1e0 0x7fcc18147d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.082+0000 7fcc16d9d640 1 -- 172.21.15.88:0/1683801684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc180c5300 msgr2=0x7fcc18071ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:33.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.082+0000 7fcc16d9d640 1 --2- 172.21.15.88:0/1683801684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc180c5300 0x7fcc18071ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.082+0000 7fcc16d9d640 1 -- 172.21.15.88:0/1683801684 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc100094d0 con 0x7fcc181548c0 2023-12-08T08:23:33.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.082+0000 7fcc16d9d640 1 --2- 172.21.15.88:0/1683801684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc181548c0 0x7fcc181482c0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fcc1001a150 tx=0x7fcc100192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:33.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.082+0000 7fcc06ffd640 1 -- 172.21.15.88:0/1683801684 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc100b4620 con 0x7fcc181548c0 2023-12-08T08:23:33.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.082+0000 7fcc06ffd640 1 -- 172.21.15.88:0/1683801684 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc100b4780 con 0x7fcc181548c0 2023-12-08T08:23:33.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.082+0000 7fcc06ffd640 1 -- 172.21.15.88:0/1683801684 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc100b4af0 con 0x7fcc181548c0 2023-12-08T08:23:33.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.082+0000 7fcc1c879640 1 -- 172.21.15.88:0/1683801684 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc18147760 con 0x7fcc181548c0 2023-12-08T08:23:33.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.082+0000 7fcc1c879640 1 -- 172.21.15.88:0/1683801684 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1814ea50 con 0x7fcc181548c0 2023-12-08T08:23:33.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.082+0000 7fcc1c879640 1 -- 172.21.15.88:0/1683801684 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc181478f0 con 0x7fcc181548c0 2023-12-08T08:23:33.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.086+0000 7fcc06ffd640 1 -- 172.21.15.88:0/1683801684 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcc100b4c50 con 0x7fcc181548c0 2023-12-08T08:23:33.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.086+0000 7fcc06ffd640 1 --2- 172.21.15.88:0/1683801684 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcbf8066470 0x7fcbf8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:33.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.086+0000 7fcc06ffd640 1 -- 172.21.15.88:0/1683801684 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcc1011e2c0 con 0x7fcc181548c0 2023-12-08T08:23:33.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.086+0000 7fcc1659c640 1 --2- 172.21.15.88:0/1683801684 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcbf8066470 0x7fcbf8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:33.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.086+0000 7fcc1659c640 1 --2- 172.21.15.88:0/1683801684 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcbf8066470 0x7fcbf8068930 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcc08003b90 tx=0x7fcc080098d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:33.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.090+0000 7fcc06ffd640 1 -- 172.21.15.88:0/1683801684 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcc100eb520 con 0x7fcc181548c0 2023-12-08T08:23:33.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.242+0000 7fcc1c879640 1 -- 172.21.15.88:0/1683801684 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcc1814ec40 con 0x7fcc181548c0 2023-12-08T08:23:33.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.242+0000 7fcc06ffd640 1 -- 172.21.15.88:0/1683801684 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcc100eeb40 con 0x7fcc181548c0 2023-12-08T08:23:33.247 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:23:33.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.242+0000 7fcc1c879640 1 -- 172.21.15.88:0/1683801684 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcbf8066470 msgr2=0x7fcbf8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:33.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.242+0000 7fcc1c879640 1 --2- 172.21.15.88:0/1683801684 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcbf8066470 0x7fcbf8068930 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcc08003b90 tx=0x7fcc080098d0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.242+0000 7fcc1c879640 1 -- 172.21.15.88:0/1683801684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc181548c0 msgr2=0x7fcc181482c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:33.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.242+0000 7fcc1c879640 1 --2- 172.21.15.88:0/1683801684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc181548c0 0x7fcc181482c0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fcc1001a150 tx=0x7fcc100192c0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.242+0000 7fcc1c879640 1 -- 172.21.15.88:0/1683801684 shutdown_connections 2023-12-08T08:23:33.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.242+0000 7fcc1c879640 1 --2- 172.21.15.88:0/1683801684 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcbf8066470 0x7fcbf8068930 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.242+0000 7fcc1c879640 1 --2- 172.21.15.88:0/1683801684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc181548c0 0x7fcc181482c0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.242+0000 7fcc1c879640 1 --2- 172.21.15.88:0/1683801684 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc1814b1e0 0x7fcc18147d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.242+0000 7fcc1c879640 1 --2- 172.21.15.88:0/1683801684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc180c5300 0x7fcc18071ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.242+0000 7fcc1c879640 1 -- 172.21.15.88:0/1683801684 >> 172.21.15.88:0/1683801684 conn(0x7fcc180c59f0 msgr2=0x7fcc180c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:33.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.242+0000 7fcc1c879640 1 -- 172.21.15.88:0/1683801684 shutdown_connections 2023-12-08T08:23:33.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.242+0000 7fcc1c879640 1 -- 172.21.15.88:0/1683801684 wait complete. 2023-12-08T08:23:33.268 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:23:33.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.402+0000 7f74beddf640 1 Processor -- start 2023-12-08T08:23:33.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.402+0000 7f74beddf640 1 -- start start 2023-12-08T08:23:33.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.406+0000 7f74beddf640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f74b814e2a0 0x7f74b81516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:33.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.406+0000 7f74beddf640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f74b80a9910 0x7f74b806bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:33.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.406+0000 7f74beddf640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b8151210 con 0x7f74b80a9460 2023-12-08T08:23:33.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.406+0000 7f74beddf640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b814e680 con 0x7f74b80a9910 2023-12-08T08:23:33.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.406+0000 7f74beddf640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b8150be0 con 0x7f74b814e2a0 2023-12-08T08:23:33.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.406+0000 7f74bd37c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f74b80a9910 0x7f74b806bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:33.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.406+0000 7f74bd37c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f74b80a9910 0x7f74b806bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54636/0 (socket says 172.21.15.88:54636) 2023-12-08T08:23:33.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.406+0000 7f74bd37c640 1 -- 172.21.15.88:0/2044531781 learned_addr learned my addr 172.21.15.88:0/2044531781 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:33.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.406+0000 7f74bd37c640 1 -- 172.21.15.88:0/2044531781 >> v2:172.21.15.148:3300/0 conn(0x7f74b814e2a0 msgr2=0x7f74b81516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:33.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.406+0000 7f74bcb7b640 1 --2- 172.21.15.88:0/2044531781 >> v2:172.21.15.148:3300/0 conn(0x7f74b814e2a0 0x7f74b81516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:33.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.406+0000 7f74bd37c640 1 --2- 172.21.15.88:0/2044531781 >> v2:172.21.15.148:3300/0 conn(0x7f74b814e2a0 0x7f74b81516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.406+0000 7f74bd37c640 1 -- 172.21.15.88:0/2044531781 >> v1:172.21.15.148:6789/0 conn(0x7f74b80a9460 legacy=0x7f74b80c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:33.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.406+0000 7f74bd37c640 1 -- 172.21.15.88:0/2044531781 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b80c53c0 con 0x7f74b80a9910 2023-12-08T08:23:33.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.406+0000 7f74bcb7b640 1 --2- 172.21.15.88:0/2044531781 >> v2:172.21.15.148:3300/0 conn(0x7f74b814e2a0 0x7f74b81516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:33.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.410+0000 7f74bd37c640 1 --2- 172.21.15.88:0/2044531781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74b80a9910 0x7f74b806bc80 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f74b80c6910 tx=0x7f74b001c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ceb3620b8b1ee73 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:33.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.410+0000 7f74af7fe640 1 -- 172.21.15.88:0/2044531781 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b00a5650 con 0x7f74b80a9910 2023-12-08T08:23:33.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.410+0000 7f74af7fe640 1 -- 172.21.15.88:0/2044531781 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b00a57b0 con 0x7f74b80a9910 2023-12-08T08:23:33.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.410+0000 7f74af7fe640 1 -- 172.21.15.88:0/2044531781 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b00a5b40 con 0x7f74b80a9910 2023-12-08T08:23:33.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.410+0000 7f74beddf640 1 -- 172.21.15.88:0/2044531781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74b80a9910 msgr2=0x7f74b806bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:33.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.410+0000 7f74beddf640 1 --2- 172.21.15.88:0/2044531781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74b80a9910 0x7f74b806bc80 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f74b80c6910 tx=0x7f74b001c990 comp rx=0 tx=0).stop 2023-12-08T08:23:33.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.410+0000 7f74beddf640 1 -- 172.21.15.88:0/2044531781 shutdown_connections 2023-12-08T08:23:33.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.410+0000 7f74beddf640 1 --2- 172.21.15.88:0/2044531781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74b80a9910 0x7f74b806bc80 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.410+0000 7f74beddf640 1 --2- 172.21.15.88:0/2044531781 >> v2:172.21.15.148:3300/0 conn(0x7f74b814e2a0 0x7f74b81516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.410+0000 7f74beddf640 1 -- 172.21.15.88:0/2044531781 >> 172.21.15.88:0/2044531781 conn(0x7f74b80c59f0 msgr2=0x7f74b80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:33.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.410+0000 7f74beddf640 1 -- 172.21.15.88:0/2044531781 shutdown_connections 2023-12-08T08:23:33.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.410+0000 7f74beddf640 1 -- 172.21.15.88:0/2044531781 wait complete. 2023-12-08T08:23:33.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.410+0000 7f74beddf640 1 Processor -- start 2023-12-08T08:23:33.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.410+0000 7f74beddf640 1 -- start start 2023-12-08T08:23:33.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.414+0000 7f74beddf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74b80a9460 0x7f74b80befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:33.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.414+0000 7f74beddf640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74b80a9910 0x7f74b80c0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:33.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.414+0000 7f74beddf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74b814e2a0 0x7f74b80c1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:33.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.414+0000 7f74beddf640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b8146090 con 0x7f74b80a9460 2023-12-08T08:23:33.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.414+0000 7f74beddf640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b80c1570 con 0x7f74b814e2a0 2023-12-08T08:23:33.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.414+0000 7f74beddf640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b8146ec0 con 0x7f74b80a9910 2023-12-08T08:23:33.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.414+0000 7f74bcb7b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74b80a9460 0x7f74b80befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:33.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.414+0000 7f74bcb7b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74b80a9460 0x7f74b80befc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54650/0 (socket says 172.21.15.88:54650) 2023-12-08T08:23:33.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.414+0000 7f74bcb7b640 1 -- 172.21.15.88:0/783584124 learned_addr learned my addr 172.21.15.88:0/783584124 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:33.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.414+0000 7f74affff640 1 --2- 172.21.15.88:0/783584124 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74b80a9910 0x7f74b80c0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:33.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.414+0000 7f74bd37c640 1 --2- 172.21.15.88:0/783584124 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74b814e2a0 0x7f74b80c1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:33.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.414+0000 7f74bcb7b640 1 -- 172.21.15.88:0/783584124 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74b80a9910 msgr2=0x7f74b80c0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:33.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.414+0000 7f74bcb7b640 1 --2- 172.21.15.88:0/783584124 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74b80a9910 0x7f74b80c0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.414+0000 7f74bcb7b640 1 -- 172.21.15.88:0/783584124 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74b814e2a0 msgr2=0x7f74b80c1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:33.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.414+0000 7f74bcb7b640 1 --2- 172.21.15.88:0/783584124 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74b814e2a0 0x7f74b80c1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.414+0000 7f74bcb7b640 1 -- 172.21.15.88:0/783584124 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b0009b30 con 0x7f74b80a9460 2023-12-08T08:23:33.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.414+0000 7f74bcb7b640 1 --2- 172.21.15.88:0/783584124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74b80a9460 0x7f74b80befc0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f74b400c7f0 tx=0x7f74b400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:33.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.414+0000 7f74ad7fa640 1 -- 172.21.15.88:0/783584124 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b4007820 con 0x7f74b80a9460 2023-12-08T08:23:33.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.414+0000 7f74ad7fa640 1 -- 172.21.15.88:0/783584124 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b4007980 con 0x7f74b80a9460 2023-12-08T08:23:33.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.414+0000 7f74beddf640 1 -- 172.21.15.88:0/783584124 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b8145ad0 con 0x7f74b80a9460 2023-12-08T08:23:33.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.414+0000 7f74ad7fa640 1 -- 172.21.15.88:0/783584124 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b4007d30 con 0x7f74b80a9460 2023-12-08T08:23:33.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.414+0000 7f74beddf640 1 -- 172.21.15.88:0/783584124 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b81469a0 con 0x7f74b80a9460 2023-12-08T08:23:33.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.414+0000 7f74beddf640 1 -- 172.21.15.88:0/783584124 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b8067630 con 0x7f74b80a9460 2023-12-08T08:23:33.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.414+0000 7f74ad7fa640 1 -- 172.21.15.88:0/783584124 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f74b40113f0 con 0x7f74b80a9460 2023-12-08T08:23:33.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.418+0000 7f74ad7fa640 1 --2- 172.21.15.88:0/783584124 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f74a4066470 0x7f74a4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:33.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.418+0000 7f74ad7fa640 1 -- 172.21.15.88:0/783584124 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f74b4084440 con 0x7f74b80a9460 2023-12-08T08:23:33.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.418+0000 7f74affff640 1 --2- 172.21.15.88:0/783584124 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f74a4066470 0x7f74a4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:33.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.418+0000 7f74affff640 1 --2- 172.21.15.88:0/783584124 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f74a4066470 0x7f74a4068930 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f74b806d0e0 tx=0x7f74a8007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:33.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.422+0000 7f74ad7fa640 1 -- 172.21.15.88:0/783584124 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f74b4051600 con 0x7f74b80a9460 2023-12-08T08:23:33.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.570+0000 7f74beddf640 1 -- 172.21.15.88:0/783584124 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f74b80c5100 con 0x7f74b80a9460 2023-12-08T08:23:33.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.570+0000 7f74ad7fa640 1 -- 172.21.15.88:0/783584124 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v72) v1 ==== 105+0+11 (secure 0 0 0) 0x7f74b4054c20 con 0x7f74b80a9460 2023-12-08T08:23:33.575 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:23:33.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.570+0000 7f74beddf640 1 -- 172.21.15.88:0/783584124 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f74a4066470 msgr2=0x7f74a4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:33.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.570+0000 7f74beddf640 1 --2- 172.21.15.88:0/783584124 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f74a4066470 0x7f74a4068930 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f74b806d0e0 tx=0x7f74a8007e40 comp rx=0 tx=0).stop 2023-12-08T08:23:33.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.570+0000 7f74beddf640 1 -- 172.21.15.88:0/783584124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74b80a9460 msgr2=0x7f74b80befc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:33.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.570+0000 7f74beddf640 1 --2- 172.21.15.88:0/783584124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74b80a9460 0x7f74b80befc0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f74b400c7f0 tx=0x7f74b400ccb0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.574+0000 7f74beddf640 1 -- 172.21.15.88:0/783584124 shutdown_connections 2023-12-08T08:23:33.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.574+0000 7f74beddf640 1 --2- 172.21.15.88:0/783584124 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f74a4066470 0x7f74a4068930 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.574+0000 7f74beddf640 1 --2- 172.21.15.88:0/783584124 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74b814e2a0 0x7f74b80c1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.574+0000 7f74beddf640 1 --2- 172.21.15.88:0/783584124 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74b80a9910 0x7f74b80c0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.574+0000 7f74beddf640 1 --2- 172.21.15.88:0/783584124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74b80a9460 0x7f74b80befc0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.574+0000 7f74beddf640 1 -- 172.21.15.88:0/783584124 >> 172.21.15.88:0/783584124 conn(0x7f74b80c59f0 msgr2=0x7f74b8150430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:33.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.574+0000 7f74beddf640 1 -- 172.21.15.88:0/783584124 shutdown_connections 2023-12-08T08:23:33.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.574+0000 7f74beddf640 1 -- 172.21.15.88:0/783584124 wait complete. 2023-12-08T08:23:33.596 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:23:33.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.730+0000 7f3d05e54640 1 Processor -- start 2023-12-08T08:23:33.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.734+0000 7f3d05e54640 1 -- start start 2023-12-08T08:23:33.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.734+0000 7f3d05e54640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3d0006bc80 0x7f3d0006c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:33.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.734+0000 7f3d05e54640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d00151210 con 0x7f3d001516a0 2023-12-08T08:23:33.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.734+0000 7f3d05e54640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d0014e680 con 0x7f3d0014e2a0 2023-12-08T08:23:33.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.734+0000 7f3d05e54640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d00151b50 con 0x7f3d0006bc80 2023-12-08T08:23:33.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.734+0000 7f3cfffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3d0006bc80 0x7f3d0006c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:33.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.734+0000 7f3cfffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3d0006bc80 0x7f3d0006c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54662/0 (socket says 172.21.15.88:54662) 2023-12-08T08:23:33.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.734+0000 7f3cfeffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3d001516a0 0x7f3d000c4180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:32842/0 (socket says 172.21.15.88:32842) 2023-12-08T08:23:33.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.734+0000 7f3cfffff640 1 -- 172.21.15.88:0/2387023482 learned_addr learned my addr 172.21.15.88:0/2387023482 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:33.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.734+0000 7f3cfffff640 1 -- 172.21.15.88:0/2387023482 >> v1:172.21.15.148:6789/0 conn(0x7f3d0014e2a0 legacy=0x7f3d000a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:33.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.734+0000 7f3cfffff640 1 -- 172.21.15.88:0/2387023482 >> v1:172.21.15.88:6789/0 conn(0x7f3d001516a0 legacy=0x7f3d000c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:33.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.734+0000 7f3cfffff640 1 -- 172.21.15.88:0/2387023482 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d000a9b70 con 0x7f3d0006bc80 2023-12-08T08:23:33.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.738+0000 7f3cfffff640 1 --2- 172.21.15.88:0/2387023482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d0006bc80 0x7f3d0006c110 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009e50 tx=0x7f3cf801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88234777e7c767e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:33.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.738+0000 7f3cfe7fc640 1 -- 172.21.15.88:0/2387023482 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf80a5750 con 0x7f3d0006bc80 2023-12-08T08:23:33.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.738+0000 7f3cfe7fc640 1 -- 172.21.15.88:0/2387023482 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf80a58b0 con 0x7f3d0006bc80 2023-12-08T08:23:33.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.738+0000 7f3cfe7fc640 1 -- 172.21.15.88:0/2387023482 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf80a5c40 con 0x7f3d0006bc80 2023-12-08T08:23:33.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.738+0000 7f3d05e54640 1 -- 172.21.15.88:0/2387023482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d0006bc80 msgr2=0x7f3d0006c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:33.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.738+0000 7f3d05e54640 1 --2- 172.21.15.88:0/2387023482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d0006bc80 0x7f3d0006c110 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009e50 tx=0x7f3cf801c980 comp rx=0 tx=0).stop 2023-12-08T08:23:33.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.738+0000 7f3d05e54640 1 -- 172.21.15.88:0/2387023482 shutdown_connections 2023-12-08T08:23:33.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.738+0000 7f3d05e54640 1 --2- 172.21.15.88:0/2387023482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d0006bc80 0x7f3d0006c110 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.738+0000 7f3d05e54640 1 -- 172.21.15.88:0/2387023482 >> 172.21.15.88:0/2387023482 conn(0x7f3d000c59f0 msgr2=0x7f3d000c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:33.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.738+0000 7f3d05e54640 1 -- 172.21.15.88:0/2387023482 shutdown_connections 2023-12-08T08:23:33.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.738+0000 7f3d05e54640 1 -- 172.21.15.88:0/2387023482 wait complete. 2023-12-08T08:23:33.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.738+0000 7f3d05e54640 1 Processor -- start 2023-12-08T08:23:33.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.738+0000 7f3d05e54640 1 -- start start 2023-12-08T08:23:33.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.742+0000 7f3d05e54640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d0006bc80 0x7f3d000ba950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:33.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.742+0000 7f3d05e54640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d0014e2a0 0x7f3d0014f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:33.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.742+0000 7f3d05e54640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3d001516a0 0x7f3d0014ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:33.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.742+0000 7f3d05e54640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d00152d30 con 0x7f3d0006bc80 2023-12-08T08:23:33.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.742+0000 7f3d05e54640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d00152700 con 0x7f3d0014e2a0 2023-12-08T08:23:33.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.742+0000 7f3d05e54640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d000bae90 con 0x7f3d001516a0 2023-12-08T08:23:33.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.742+0000 7f3cff7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d0006bc80 0x7f3d000ba950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:33.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.742+0000 7f3cff7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d0006bc80 0x7f3d000ba950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54674/0 (socket says 172.21.15.88:54674) 2023-12-08T08:23:33.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.742+0000 7f3cff7fe640 1 -- 172.21.15.88:0/3586487029 learned_addr learned my addr 172.21.15.88:0/3586487029 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:33.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.742+0000 7f3cfeffd640 1 --2- 172.21.15.88:0/3586487029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d0014e2a0 0x7f3d0014f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:33.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.742+0000 7f3cfffff640 1 --2- 172.21.15.88:0/3586487029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3d001516a0 0x7f3d0014ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:33.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.742+0000 7f3cff7fe640 1 -- 172.21.15.88:0/3586487029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3d001516a0 msgr2=0x7f3d0014ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.742+0000 7f3cff7fe640 1 --2- 172.21.15.88:0/3586487029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3d001516a0 0x7f3d0014ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.742+0000 7f3cff7fe640 1 -- 172.21.15.88:0/3586487029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d0014e2a0 msgr2=0x7f3d0014f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.742+0000 7f3cff7fe640 1 --2- 172.21.15.88:0/3586487029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d0014e2a0 0x7f3d0014f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.742+0000 7f3cff7fe640 1 -- 172.21.15.88:0/3586487029 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf8009b30 con 0x7f3d0006bc80 2023-12-08T08:23:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.742+0000 7f3cfeffd640 1 --2- 172.21.15.88:0/3586487029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d0014e2a0 0x7f3d0014f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.742+0000 7f3cfffff640 1 --2- 172.21.15.88:0/3586487029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3d001516a0 0x7f3d0014ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.742+0000 7f3cff7fe640 1 --2- 172.21.15.88:0/3586487029 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d0006bc80 0x7f3d000ba950 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f3cf000c3c0 tx=0x7f3cf000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.742+0000 7f3ce7fff640 1 -- 172.21.15.88:0/3586487029 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf00052d0 con 0x7f3d0006bc80 2023-12-08T08:23:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.742+0000 7f3ce7fff640 1 -- 172.21.15.88:0/3586487029 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf0005430 con 0x7f3d0006bc80 2023-12-08T08:23:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.742+0000 7f3d05e54640 1 -- 172.21.15.88:0/3586487029 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d001eb550 con 0x7f3d0006bc80 2023-12-08T08:23:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.742+0000 7f3ce7fff640 1 -- 172.21.15.88:0/3586487029 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0003840 con 0x7f3d0006bc80 2023-12-08T08:23:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.742+0000 7f3d05e54640 1 -- 172.21.15.88:0/3586487029 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d00152950 con 0x7f3d0006bc80 2023-12-08T08:23:33.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.742+0000 7f3d05e54640 1 -- 172.21.15.88:0/3586487029 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d0014f160 con 0x7f3d0006bc80 2023-12-08T08:23:33.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.742+0000 7f3ce7fff640 1 -- 172.21.15.88:0/3586487029 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3cf00039a0 con 0x7f3d0006bc80 2023-12-08T08:23:33.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.746+0000 7f3ce7fff640 1 --2- 172.21.15.88:0/3586487029 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3cec066470 0x7f3cec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:33.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.746+0000 7f3ce7fff640 1 -- 172.21.15.88:0/3586487029 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3cf0083740 con 0x7f3d0006bc80 2023-12-08T08:23:33.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.746+0000 7f3cfeffd640 1 --2- 172.21.15.88:0/3586487029 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3cec066470 0x7f3cec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:33.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.746+0000 7f3cfeffd640 1 --2- 172.21.15.88:0/3586487029 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3cec066470 0x7f3cec068930 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3d000a7610 tx=0x7f3cf4007d70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:33.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.750+0000 7f3ce7fff640 1 -- 172.21.15.88:0/3586487029 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3cf0050850 con 0x7f3d0006bc80 2023-12-08T08:23:33.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.898+0000 7f3d05e54640 1 -- 172.21.15.88:0/3586487029 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f3d00067630 con 0x7f3d0006bc80 2023-12-08T08:23:33.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.898+0000 7f3ce7fff640 1 -- 172.21.15.88:0/3586487029 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v72) v1 ==== 101+0+11 (secure 0 0 0) 0x7f3cf0053e70 con 0x7f3d0006bc80 2023-12-08T08:23:33.904 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:23:33.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.902+0000 7f3d05e54640 1 -- 172.21.15.88:0/3586487029 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3cec066470 msgr2=0x7f3cec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:33.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.902+0000 7f3d05e54640 1 --2- 172.21.15.88:0/3586487029 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3cec066470 0x7f3cec068930 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3d000a7610 tx=0x7f3cf4007d70 comp rx=0 tx=0).stop 2023-12-08T08:23:33.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.902+0000 7f3d05e54640 1 -- 172.21.15.88:0/3586487029 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d0006bc80 msgr2=0x7f3d000ba950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:33.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.902+0000 7f3d05e54640 1 --2- 172.21.15.88:0/3586487029 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d0006bc80 0x7f3d000ba950 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f3cf000c3c0 tx=0x7f3cf000c880 comp rx=0 tx=0).stop 2023-12-08T08:23:33.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.902+0000 7f3d05e54640 1 -- 172.21.15.88:0/3586487029 shutdown_connections 2023-12-08T08:23:33.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.902+0000 7f3d05e54640 1 --2- 172.21.15.88:0/3586487029 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3cec066470 0x7f3cec068930 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.902+0000 7f3d05e54640 1 --2- 172.21.15.88:0/3586487029 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3d001516a0 0x7f3d0014ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.902+0000 7f3d05e54640 1 --2- 172.21.15.88:0/3586487029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d0014e2a0 0x7f3d0014f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.902+0000 7f3d05e54640 1 --2- 172.21.15.88:0/3586487029 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d0006bc80 0x7f3d000ba950 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:33.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.902+0000 7f3d05e54640 1 -- 172.21.15.88:0/3586487029 >> 172.21.15.88:0/3586487029 conn(0x7f3d000c59f0 msgr2=0x7f3d0014ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:33.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.902+0000 7f3d05e54640 1 -- 172.21.15.88:0/3586487029 shutdown_connections 2023-12-08T08:23:33.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:33.902+0000 7f3d05e54640 1 -- 172.21.15.88:0/3586487029 wait complete. 2023-12-08T08:23:33.926 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:23:34.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.062+0000 7f7d36217640 1 Processor -- start 2023-12-08T08:23:34.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.062+0000 7f7d36217640 1 -- start start 2023-12-08T08:23:34.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.062+0000 7f7d36217640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7d300c47b0 0x7f7d300c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:34.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.062+0000 7f7d36217640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7d30155950 0x7f7d301582f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:34.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.062+0000 7f7d36217640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d300c6840 con 0x7f7d300bd550 2023-12-08T08:23:34.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.062+0000 7f7d36217640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d300af870 con 0x7f7d30155950 2023-12-08T08:23:34.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.062+0000 7f7d36217640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d300c6a70 con 0x7f7d300c47b0 2023-12-08T08:23:34.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.062+0000 7f7d2effd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7d300bd550 0x7f7d30154ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:32856/0 (socket says 172.21.15.88:32856) 2023-12-08T08:23:34.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.062+0000 7f7d2effd640 1 -- 172.21.15.88:0/3915998327 learned_addr learned my addr 172.21.15.88:0/3915998327 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:34.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.062+0000 7f7d2ffff640 1 --2- 172.21.15.88:0/3915998327 >> v2:172.21.15.88:3300/0 conn(0x7f7d30155950 0x7f7d301582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:34.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.062+0000 7f7d2f7fe640 1 --2- 172.21.15.88:0/3915998327 >> v2:172.21.15.148:3300/0 conn(0x7f7d300c47b0 0x7f7d300c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:34.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.062+0000 7f7d2ffff640 1 -- 172.21.15.88:0/3915998327 >> v2:172.21.15.148:3300/0 conn(0x7f7d300c47b0 msgr2=0x7f7d300c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:34.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.062+0000 7f7d2ffff640 1 --2- 172.21.15.88:0/3915998327 >> v2:172.21.15.148:3300/0 conn(0x7f7d300c47b0 0x7f7d300c4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:34.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.062+0000 7f7d2ffff640 1 -- 172.21.15.88:0/3915998327 >> v1:172.21.15.88:6789/0 conn(0x7f7d300bd550 legacy=0x7f7d30154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:34.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.062+0000 7f7d2ffff640 1 -- 172.21.15.88:0/3915998327 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d300c6d50 con 0x7f7d30155950 2023-12-08T08:23:34.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.062+0000 7f7d2e7fc640 1 -- 172.21.15.88:0/3915998327 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2607534812 0 0) 0x7f7d300c6840 con 0x7f7d300bd550 2023-12-08T08:23:34.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.066+0000 7f7d2ffff640 1 --2- 172.21.15.88:0/3915998327 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d30155950 0x7f7d301582f0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f7d300c7980 tx=0x7f7d2801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a227ac2b2caa86c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:34.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.066+0000 7f7d2e7fc640 1 -- 172.21.15.88:0/3915998327 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d280a5830 con 0x7f7d30155950 2023-12-08T08:23:34.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.066+0000 7f7d2e7fc640 1 -- 172.21.15.88:0/3915998327 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d280a5990 con 0x7f7d30155950 2023-12-08T08:23:34.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.066+0000 7f7d2e7fc640 1 -- 172.21.15.88:0/3915998327 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d280a5d20 con 0x7f7d30155950 2023-12-08T08:23:34.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.066+0000 7f7d36217640 1 -- 172.21.15.88:0/3915998327 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d30155950 msgr2=0x7f7d301582f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:34.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.066+0000 7f7d36217640 1 --2- 172.21.15.88:0/3915998327 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d30155950 0x7f7d301582f0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f7d300c7980 tx=0x7f7d2801c880 comp rx=0 tx=0).stop 2023-12-08T08:23:34.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.066+0000 7f7d36217640 1 -- 172.21.15.88:0/3915998327 shutdown_connections 2023-12-08T08:23:34.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.066+0000 7f7d36217640 1 --2- 172.21.15.88:0/3915998327 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d30155950 0x7f7d301582f0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:34.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.066+0000 7f7d36217640 1 --2- 172.21.15.88:0/3915998327 >> v2:172.21.15.148:3300/0 conn(0x7f7d300c47b0 0x7f7d300c4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:34.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.066+0000 7f7d36217640 1 -- 172.21.15.88:0/3915998327 >> 172.21.15.88:0/3915998327 conn(0x7f7d300aba00 msgr2=0x7f7d300abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:34.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.066+0000 7f7d36217640 1 -- 172.21.15.88:0/3915998327 shutdown_connections 2023-12-08T08:23:34.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.066+0000 7f7d36217640 1 -- 172.21.15.88:0/3915998327 wait complete. 2023-12-08T08:23:34.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.070+0000 7f7d36217640 1 Processor -- start 2023-12-08T08:23:34.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.070+0000 7f7d36217640 1 -- start start 2023-12-08T08:23:34.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.070+0000 7f7d36217640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d300bd550 0x7f7d301505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:34.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.070+0000 7f7d36217640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d300c47b0 0x7f7d300c3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:34.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.070+0000 7f7d36217640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d30155950 0x7f7d300c35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:34.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.070+0000 7f7d36217640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d301f1a50 con 0x7f7d30155950 2023-12-08T08:23:34.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.070+0000 7f7d36217640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d301f1f80 con 0x7f7d300c47b0 2023-12-08T08:23:34.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.070+0000 7f7d36217640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d300c83b0 con 0x7f7d300bd550 2023-12-08T08:23:34.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.070+0000 7f7d2ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d30155950 0x7f7d300c35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:34.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.070+0000 7f7d2ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d30155950 0x7f7d300c35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54694/0 (socket says 172.21.15.88:54694) 2023-12-08T08:23:34.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.070+0000 7f7d2ffff640 1 -- 172.21.15.88:0/3362153652 learned_addr learned my addr 172.21.15.88:0/3362153652 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:34.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.070+0000 7f7d2effd640 1 --2- 172.21.15.88:0/3362153652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d300c47b0 0x7f7d300c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:34.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.070+0000 7f7d2f7fe640 1 --2- 172.21.15.88:0/3362153652 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d300bd550 0x7f7d301505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:34.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.070+0000 7f7d2ffff640 1 -- 172.21.15.88:0/3362153652 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d300bd550 msgr2=0x7f7d301505a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:34.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.070+0000 7f7d2ffff640 1 --2- 172.21.15.88:0/3362153652 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d300bd550 0x7f7d301505a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:34.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.070+0000 7f7d2ffff640 1 -- 172.21.15.88:0/3362153652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d300c47b0 msgr2=0x7f7d300c3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:34.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.070+0000 7f7d2ffff640 1 --2- 172.21.15.88:0/3362153652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d300c47b0 0x7f7d300c3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:34.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.070+0000 7f7d2ffff640 1 -- 172.21.15.88:0/3362153652 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d28009a70 con 0x7f7d30155950 2023-12-08T08:23:34.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.070+0000 7f7d2ffff640 1 --2- 172.21.15.88:0/3362153652 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d30155950 0x7f7d300c35c0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f7d2801cd60 tx=0x7f7d28019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:34.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.070+0000 7f7d17fff640 1 -- 172.21.15.88:0/3362153652 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d280ad850 con 0x7f7d30155950 2023-12-08T08:23:34.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.070+0000 7f7d17fff640 1 -- 172.21.15.88:0/3362153652 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d280a5820 con 0x7f7d30155950 2023-12-08T08:23:34.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.070+0000 7f7d17fff640 1 -- 172.21.15.88:0/3362153652 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d280adbd0 con 0x7f7d30155950 2023-12-08T08:23:34.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.070+0000 7f7d36217640 1 -- 172.21.15.88:0/3362153652 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d300c3b00 con 0x7f7d30155950 2023-12-08T08:23:34.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.070+0000 7f7d36217640 1 -- 172.21.15.88:0/3362153652 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d300c7d60 con 0x7f7d30155950 2023-12-08T08:23:34.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.070+0000 7f7d36217640 1 -- 172.21.15.88:0/3362153652 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d30067630 con 0x7f7d30155950 2023-12-08T08:23:34.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.074+0000 7f7d17fff640 1 -- 172.21.15.88:0/3362153652 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7d280b4070 con 0x7f7d30155950 2023-12-08T08:23:34.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.074+0000 7f7d17fff640 1 --2- 172.21.15.88:0/3362153652 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7d1c066470 0x7f7d1c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:34.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.074+0000 7f7d17fff640 1 -- 172.21.15.88:0/3362153652 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7d2811efe0 con 0x7f7d30155950 2023-12-08T08:23:34.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.074+0000 7f7d2f7fe640 1 --2- 172.21.15.88:0/3362153652 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7d1c066470 0x7f7d1c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:34.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.074+0000 7f7d2f7fe640 1 --2- 172.21.15.88:0/3362153652 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7d1c066470 0x7f7d1c068930 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7d20007a60 tx=0x7f7d20008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:34.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.078+0000 7f7d17fff640 1 -- 172.21.15.88:0/3362153652 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7d280ec1c0 con 0x7f7d30155950 2023-12-08T08:23:34.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.238+0000 7f7d36217640 1 -- 172.21.15.88:0/3362153652 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7d300c84f0 con 0x7f7d30155950 2023-12-08T08:23:34.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.242+0000 7f7d17fff640 1 -- 172.21.15.88:0/3362153652 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7d280ef7e0 con 0x7f7d30155950 2023-12-08T08:23:34.245 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-12-08T08:23:34.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.242+0000 7f7d36217640 1 -- 172.21.15.88:0/3362153652 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7d1c066470 msgr2=0x7f7d1c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:34.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.242+0000 7f7d36217640 1 --2- 172.21.15.88:0/3362153652 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7d1c066470 0x7f7d1c068930 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7d20007a60 tx=0x7f7d20008040 comp rx=0 tx=0).stop 2023-12-08T08:23:34.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.242+0000 7f7d36217640 1 -- 172.21.15.88:0/3362153652 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d30155950 msgr2=0x7f7d300c35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:34.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.242+0000 7f7d36217640 1 --2- 172.21.15.88:0/3362153652 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d30155950 0x7f7d300c35c0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f7d2801cd60 tx=0x7f7d28019620 comp rx=0 tx=0).stop 2023-12-08T08:23:34.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.242+0000 7f7d36217640 1 -- 172.21.15.88:0/3362153652 shutdown_connections 2023-12-08T08:23:34.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.242+0000 7f7d36217640 1 --2- 172.21.15.88:0/3362153652 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7d1c066470 0x7f7d1c068930 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:34.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.242+0000 7f7d36217640 1 --2- 172.21.15.88:0/3362153652 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d30155950 0x7f7d300c35c0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:34.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.242+0000 7f7d36217640 1 --2- 172.21.15.88:0/3362153652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d300c47b0 0x7f7d300c3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:34.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.242+0000 7f7d36217640 1 --2- 172.21.15.88:0/3362153652 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7d300bd550 0x7f7d301505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:34.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.242+0000 7f7d36217640 1 -- 172.21.15.88:0/3362153652 >> 172.21.15.88:0/3362153652 conn(0x7f7d300aba00 msgr2=0x7f7d301544d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:34.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.242+0000 7f7d36217640 1 -- 172.21.15.88:0/3362153652 shutdown_connections 2023-12-08T08:23:34.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.242+0000 7f7d36217640 1 -- 172.21.15.88:0/3362153652 wait complete. 2023-12-08T08:23:34.266 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-08T08:23:34.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:34.266 DEBUG:teuthology.orchestra.run.smithi088:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-08T08:23:34.332 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2023-12-08T08:23:34.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:34.332 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-08T08:23:34.356 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:23:34.356 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:23:34.405 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5383 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-08T08:23:34.405 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:23:34.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.582+0000 7f5251f80640 1 Processor -- start 2023-12-08T08:23:34.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.582+0000 7f5251f80640 1 -- start start 2023-12-08T08:23:34.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.582+0000 7f5251f80640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f524c06d2b0 0x7f524c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:34.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.582+0000 7f5251f80640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f524c0c3b80 0x7f524c0c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:34.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.582+0000 7f5251f80640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f524c06c020 0x7f524c06c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:34.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.582+0000 7f5251f80640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f524c0c5840 con 0x7f524c06c020 2023-12-08T08:23:34.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.582+0000 7f5251f80640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f524c06bb80 con 0x7f524c0c3b80 2023-12-08T08:23:34.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.582+0000 7f5251f80640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524c1515c0 con 0x7f524c06d2b0 2023-12-08T08:23:34.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.582+0000 7f524bfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f524c06c020 0x7f524c06c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:34.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.582+0000 7f524bfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f524c06c020 0x7f524c06c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54698/0 (socket says 172.21.15.88:54698) 2023-12-08T08:23:34.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.582+0000 7f524bfff640 1 -- 172.21.15.88:0/228208064 learned_addr learned my addr 172.21.15.88:0/228208064 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:34.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.582+0000 7f524b7fe640 1 --2- 172.21.15.88:0/228208064 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f524c06d2b0 0x7f524c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:34.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.582+0000 7f524affd640 1 --2- 172.21.15.88:0/228208064 >> v2:172.21.15.148:3300/0 conn(0x7f524c0c3b80 0x7f524c0c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:34.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.582+0000 7f524bfff640 1 -- 172.21.15.88:0/228208064 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f524c06d2b0 msgr2=0x7f524c06d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:34.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.582+0000 7f524bfff640 1 --2- 172.21.15.88:0/228208064 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f524c06d2b0 0x7f524c06d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:34.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.582+0000 7f524bfff640 1 -- 172.21.15.88:0/228208064 >> v2:172.21.15.148:3300/0 conn(0x7f524c0c3b80 msgr2=0x7f524c0c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:34.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.582+0000 7f524bfff640 1 --2- 172.21.15.88:0/228208064 >> v2:172.21.15.148:3300/0 conn(0x7f524c0c3b80 0x7f524c0c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:34.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.582+0000 7f524bfff640 1 -- 172.21.15.88:0/228208064 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524c1518a0 con 0x7f524c06c020 2023-12-08T08:23:34.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.586+0000 7f524bfff640 1 --2- 172.21.15.88:0/228208064 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f524c06c020 0x7f524c06c4b0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f524c0c59c0 tx=0x7f524401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30721ba265556b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:34.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.586+0000 7f524a7fc640 1 -- 172.21.15.88:0/228208064 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52440a5730 con 0x7f524c06c020 2023-12-08T08:23:34.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.586+0000 7f524a7fc640 1 -- 172.21.15.88:0/228208064 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52440a5890 con 0x7f524c06c020 2023-12-08T08:23:34.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.586+0000 7f524a7fc640 1 -- 172.21.15.88:0/228208064 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52440a5c20 con 0x7f524c06c020 2023-12-08T08:23:34.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.586+0000 7f5251f80640 1 -- 172.21.15.88:0/228208064 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f524c06c020 msgr2=0x7f524c06c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:34.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.586+0000 7f5251f80640 1 --2- 172.21.15.88:0/228208064 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f524c06c020 0x7f524c06c4b0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f524c0c59c0 tx=0x7f524401c9a0 comp rx=0 tx=0).stop 2023-12-08T08:23:34.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.586+0000 7f5251f80640 1 -- 172.21.15.88:0/228208064 shutdown_connections 2023-12-08T08:23:34.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.586+0000 7f5251f80640 1 --2- 172.21.15.88:0/228208064 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f524c06c020 0x7f524c06c4b0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:34.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.586+0000 7f5251f80640 1 --2- 172.21.15.88:0/228208064 >> v2:172.21.15.148:3300/0 conn(0x7f524c0c3b80 0x7f524c0c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:34.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.586+0000 7f5251f80640 1 --2- 172.21.15.88:0/228208064 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f524c06d2b0 0x7f524c06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:34.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.586+0000 7f5251f80640 1 -- 172.21.15.88:0/228208064 >> 172.21.15.88:0/228208064 conn(0x7f524c0a7810 msgr2=0x7f524c0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:34.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.586+0000 7f5251f80640 1 -- 172.21.15.88:0/228208064 shutdown_connections 2023-12-08T08:23:34.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.586+0000 7f5251f80640 1 -- 172.21.15.88:0/228208064 wait complete. 2023-12-08T08:23:34.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.590+0000 7f5251f80640 1 Processor -- start 2023-12-08T08:23:34.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.590+0000 7f5251f80640 1 -- start start 2023-12-08T08:23:34.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.590+0000 7f5251f80640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f524c06c020 0x7f524c1f0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:34.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.590+0000 7f5251f80640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f524c06d2b0 0x7f524c14c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:34.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.590+0000 7f5251f80640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f524c0c3b80 0x7f524c14dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:34.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.590+0000 7f5251f80640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c1f1220 con 0x7f524c06d2b0 2023-12-08T08:23:34.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.590+0000 7f5251f80640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c0c00c0 con 0x7f524c06c020 2023-12-08T08:23:34.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.590+0000 7f5251f80640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524c0a9800 con 0x7f524c0c3b80 2023-12-08T08:23:34.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.590+0000 7f524affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f524c06d2b0 0x7f524c14c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:34.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.590+0000 7f524affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f524c06d2b0 0x7f524c14c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54708/0 (socket says 172.21.15.88:54708) 2023-12-08T08:23:34.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.590+0000 7f524affd640 1 -- 172.21.15.88:0/2512924256 learned_addr learned my addr 172.21.15.88:0/2512924256 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:34.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.590+0000 7f524bfff640 1 --2- 172.21.15.88:0/2512924256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f524c0c3b80 0x7f524c14dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:34.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.590+0000 7f524b7fe640 1 --2- 172.21.15.88:0/2512924256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f524c06c020 0x7f524c1f0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:34.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.590+0000 7f524affd640 1 -- 172.21.15.88:0/2512924256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f524c0c3b80 msgr2=0x7f524c14dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:34.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.590+0000 7f524affd640 1 --2- 172.21.15.88:0/2512924256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f524c0c3b80 0x7f524c14dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:34.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.590+0000 7f524affd640 1 -- 172.21.15.88:0/2512924256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f524c06c020 msgr2=0x7f524c1f0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:34.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.590+0000 7f524affd640 1 --2- 172.21.15.88:0/2512924256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f524c06c020 0x7f524c1f0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:34.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.590+0000 7f524affd640 1 -- 172.21.15.88:0/2512924256 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5244009b30 con 0x7f524c06d2b0 2023-12-08T08:23:34.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.590+0000 7f524affd640 1 --2- 172.21.15.88:0/2512924256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f524c06d2b0 0x7f524c14c850 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f524000e8a0 tx=0x7f524000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:34.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.590+0000 7f5233fff640 1 -- 172.21.15.88:0/2512924256 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5240009510 con 0x7f524c06d2b0 2023-12-08T08:23:34.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.590+0000 7f5233fff640 1 -- 172.21.15.88:0/2512924256 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524000c940 con 0x7f524c06d2b0 2023-12-08T08:23:34.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.590+0000 7f5251f80640 1 -- 172.21.15.88:0/2512924256 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f524c14ef80 con 0x7f524c06d2b0 2023-12-08T08:23:34.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.590+0000 7f5233fff640 1 -- 172.21.15.88:0/2512924256 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524000ccb0 con 0x7f524c06d2b0 2023-12-08T08:23:34.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.590+0000 7f5251f80640 1 -- 172.21.15.88:0/2512924256 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524c0a8a50 con 0x7f524c06d2b0 2023-12-08T08:23:34.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.594+0000 7f5251f80640 1 -- 172.21.15.88:0/2512924256 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f524c067630 con 0x7f524c06d2b0 2023-12-08T08:23:34.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.594+0000 7f5233fff640 1 -- 172.21.15.88:0/2512924256 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5240013470 con 0x7f524c06d2b0 2023-12-08T08:23:34.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.594+0000 7f5233fff640 1 --2- 172.21.15.88:0/2512924256 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5238066470 0x7f5238068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:34.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.594+0000 7f5233fff640 1 -- 172.21.15.88:0/2512924256 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5240084a60 con 0x7f524c06d2b0 2023-12-08T08:23:34.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.594+0000 7f524b7fe640 1 --2- 172.21.15.88:0/2512924256 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5238066470 0x7f5238068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:34.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.594+0000 7f524b7fe640 1 --2- 172.21.15.88:0/2512924256 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5238066470 0x7f5238068930 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f523c009af0 tx=0x7f523c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:34.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.598+0000 7f5233fff640 1 -- 172.21.15.88:0/2512924256 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5240051b70 con 0x7f524c06d2b0 2023-12-08T08:23:34.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.782+0000 7f5251f80640 1 -- 172.21.15.88:0/2512924256 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f524c06bd70 con 0x7f524c06d2b0 2023-12-08T08:23:34.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.782+0000 7f5233fff640 1 -- 172.21.15.88:0/2512924256 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) v1 ==== 53+0+149 (secure 0 0 0) 0x7f5240055190 con 0x7f524c06d2b0 2023-12-08T08:23:34.786 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:23:34.786 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-08T08:23:34.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.782+0000 7f5251f80640 1 -- 172.21.15.88:0/2512924256 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5238066470 msgr2=0x7f5238068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:34.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.782+0000 7f5251f80640 1 --2- 172.21.15.88:0/2512924256 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5238066470 0x7f5238068930 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f523c009af0 tx=0x7f523c008040 comp rx=0 tx=0).stop 2023-12-08T08:23:34.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.782+0000 7f5251f80640 1 -- 172.21.15.88:0/2512924256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f524c06d2b0 msgr2=0x7f524c14c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:34.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.782+0000 7f5251f80640 1 --2- 172.21.15.88:0/2512924256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f524c06d2b0 0x7f524c14c850 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f524000e8a0 tx=0x7f524000eca0 comp rx=0 tx=0).stop 2023-12-08T08:23:34.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.782+0000 7f5251f80640 1 -- 172.21.15.88:0/2512924256 shutdown_connections 2023-12-08T08:23:34.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.782+0000 7f5251f80640 1 --2- 172.21.15.88:0/2512924256 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5238066470 0x7f5238068930 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:34.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.782+0000 7f5251f80640 1 --2- 172.21.15.88:0/2512924256 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f524c0c3b80 0x7f524c14dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:34.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.782+0000 7f5251f80640 1 --2- 172.21.15.88:0/2512924256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f524c06d2b0 0x7f524c14c850 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:34.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.782+0000 7f5251f80640 1 --2- 172.21.15.88:0/2512924256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f524c06c020 0x7f524c1f0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:34.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.782+0000 7f5251f80640 1 -- 172.21.15.88:0/2512924256 >> 172.21.15.88:0/2512924256 conn(0x7f524c0a7810 msgr2=0x7f524c0c41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:34.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.782+0000 7f5251f80640 1 -- 172.21.15.88:0/2512924256 shutdown_connections 2023-12-08T08:23:34.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:34.782+0000 7f5251f80640 1 -- 172.21.15.88:0/2512924256 wait complete. 2023-12-08T08:23:34.807 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-08T08:23:34.807 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:23:34.807 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2023-12-08T08:23:34.807 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-08T08:23:34.807 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T08:23:34.807 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-08T08:23:34.807 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-08T08:23:34.807 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.O1Dx6JIs2G 2023-12-08T08:23:34.807 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2023-12-08T08:23:34.816 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.XGoFSBcrOK 2023-12-08T08:23:34.816 DEBUG:teuthology.orchestra.run.smithi088:> sudo cp /tmp/tmp.O1Dx6JIs2G /tmp/tmp.XGoFSBcrOK 2023-12-08T08:23:34.876 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.XGoFSBcrOK 2023-12-08T08:23:35.001 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.XGoFSBcrOK is 226B 2023-12-08T08:23:35.016 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.XGoFSBcrOK 2023-12-08T08:23:35.025 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQCD0nJlpwWiExAAMbkPnLBFpAMwBuADIemLSA== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-08T08:23:35.025 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:23:35.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:35.025 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2023-12-08T08:23:35.076 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:23:35.077 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:23:35.077 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:23:35.077 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:35.077 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-12-08T08:23:35.077 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:35.077 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:23:35.077 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:35.077 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2023-12-08T08:23:35.077 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:23:35.077 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:35.077 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2023-12-08T08:23:35.077 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:23:35.077 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:35.077 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:23:35.078 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:35.078 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-08T08:23:35.078 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42244sec preferred_lft 42244sec 2023-12-08T08:23:35.078 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2023-12-08T08:23:35.078 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:35.078 INFO:teuthology.orchestra.run.smithi088.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-08T08:23:35.078 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 02:42:cd:51:97:e3 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:35.078 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-08T08:23:35.078 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:35.078 INFO:teuthology.orchestra.run.smithi088.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:23:35.078 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:35.078 INFO:teuthology.orchestra.run.smithi088.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:23:35.078 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:35.078 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-08T08:23:35.079 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:35.079 INFO:teuthology.orchestra.run.smithi088.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:23:35.079 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:23:35.079 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-08T08:23:35.079 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:35.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:35.080 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:23:35.143 INFO:teuthology.orchestra.run.smithi088.stdout:1 2023-12-08T08:23:35.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:35.145 DEBUG:teuthology.orchestra.run.smithi088:> route 2023-12-08T08:23:35.199 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2023-12-08T08:23:35.199 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:23:35.199 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-08T08:23:35.199 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-08T08:23:35.199 INFO:teuthology.orchestra.run.smithi088.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-08T08:23:35.199 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-08T08:23:35.199 INFO:teuthology.orchestra.run.smithi088.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:23:35.199 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:23:35.199 INFO:teuthology.orchestra.run.smithi088.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:23:35.199 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:23:35.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:35.200 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-12-08T08:23:35.200 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-12-08T08:23:35.200 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-08T08:23:35.200 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-08T08:23:35.200 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-08T08:23:35.200 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-12-08T08:23:35.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:35.291 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-12-08T08:23:35.301 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-08T08:23:35.301 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:23:35.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:35.301 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2023-12-08T08:23:35.364 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:23:35.364 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-08T08:23:35.416 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:23:35.416 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:23:35.417 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:23:35.468 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:23:35.468 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/tmp/tmp.O1Dx6JIs2G of=/dev/stdout 2023-12-08T08:23:35.516 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs=/ 2023-12-08T08:23:35.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:35.517 DEBUG:teuthology.orchestra.run.smithi088:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQCD0nJlpwWiExAAMbkPnLBFpAMwBuADIemLSA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:23:35.611 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,secret=AQCD0nJlpwWiExAAMbkPnLBFpAMwBuADIemLSA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:23:35.611 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:23:35.611 INFO:teuthology.orchestra.run.smithi088.stdout:keyring.get_secret failed 2023-12-08T08:23:35.623 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,secret=AQCD0nJlpwWiExAAMbkPnLBFpAMwBuADIemLSA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:23:35.623 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:23:35.623 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-12-08T08:23:35.623 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: trying mount with new device syntax: testuser@681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3.cephfs=/ 2023-12-08T08:23:35.623 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.88:3300/172.21.15.148:3300/172.21.15.148:3301" will pass to kernel 2023-12-08T08:23:35.627 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T08:23:35.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:35.627 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:23:35.645 INFO:teuthology.orchestra.run.smithi088.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.0': Permission denied 2023-12-08T08:23:35.647 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:23:35.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:35.647 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:23:35.703 INFO:teuthology.orchestra.run.smithi088.stdout:client6676 2023-12-08T08:23:35.704 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:23:35.704 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:23:35.752 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2023-12-08T08:23:35.762 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.cpbnJ4wSYl 2023-12-08T08:23:35.763 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:23:35.763 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/tmp/tmp.cpbnJ4wSYl 2023-12-08T08:23:35.819 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:23:35.819 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:23:35.874 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:23:35.875 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:23:35.927 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:23:36.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.058+0000 7f4c87079640 1 Processor -- start 2023-12-08T08:23:36.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.058+0000 7f4c87079640 1 -- start start 2023-12-08T08:23:36.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.062+0000 7f4c87079640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4c80151bf0 0x7f4c8006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:36.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.062+0000 7f4c87079640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c8006bb00 0x7f4c80154d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:36.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.062+0000 7f4c87079640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c80158a40 con 0x7f4c8006d890 2023-12-08T08:23:36.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.062+0000 7f4c87079640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c801584c0 con 0x7f4c80151bf0 2023-12-08T08:23:36.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.062+0000 7f4c87079640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c80155260 con 0x7f4c8006bb00 2023-12-08T08:23:36.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.062+0000 7f4c85616640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c8006bb00 0x7f4c80154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:36.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.062+0000 7f4c77fff640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f4c8006d890 0x7f4c80154610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:47580/0 (socket says 172.21.15.88:47580) 2023-12-08T08:23:36.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.062+0000 7f4c77fff640 1 -- 172.21.15.88:0/1014906956 learned_addr learned my addr 172.21.15.88:0/1014906956 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:36.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.062+0000 7f4c84e15640 1 --2- 172.21.15.88:0/1014906956 >> v2:172.21.15.148:3300/0 conn(0x7f4c80151bf0 0x7f4c8006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:36.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.062+0000 7f4c777fe640 1 -- 172.21.15.88:0/1014906956 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782160162 0 0) 0x7f4c80158a40 con 0x7f4c8006d890 2023-12-08T08:23:36.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.062+0000 7f4c85616640 1 -- 172.21.15.88:0/1014906956 >> v2:172.21.15.148:3300/0 conn(0x7f4c80151bf0 msgr2=0x7f4c8006b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:36.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.062+0000 7f4c85616640 1 --2- 172.21.15.88:0/1014906956 >> v2:172.21.15.148:3300/0 conn(0x7f4c80151bf0 0x7f4c8006b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.062+0000 7f4c85616640 1 -- 172.21.15.88:0/1014906956 >> v1:172.21.15.148:6789/0 conn(0x7f4c8006d890 legacy=0x7f4c80154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:36.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.062+0000 7f4c85616640 1 -- 172.21.15.88:0/1014906956 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c80158760 con 0x7f4c8006bb00 2023-12-08T08:23:36.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.066+0000 7f4c85616640 1 --2- 172.21.15.88:0/1014906956 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c8006bb00 0x7f4c80154d20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009d90 tx=0x7f4c7801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=109da71cfa167814 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:36.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.066+0000 7f4c777fe640 1 -- 172.21.15.88:0/1014906956 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c780a59e0 con 0x7f4c8006bb00 2023-12-08T08:23:36.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.066+0000 7f4c777fe640 1 -- 172.21.15.88:0/1014906956 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c780a5b40 con 0x7f4c8006bb00 2023-12-08T08:23:36.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.066+0000 7f4c777fe640 1 -- 172.21.15.88:0/1014906956 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c780ad440 con 0x7f4c8006bb00 2023-12-08T08:23:36.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.066+0000 7f4c87079640 1 -- 172.21.15.88:0/1014906956 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c8006bb00 msgr2=0x7f4c80154d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:36.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.066+0000 7f4c87079640 1 --2- 172.21.15.88:0/1014906956 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c8006bb00 0x7f4c80154d20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009d90 tx=0x7f4c7801c920 comp rx=0 tx=0).stop 2023-12-08T08:23:36.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.066+0000 7f4c87079640 1 -- 172.21.15.88:0/1014906956 shutdown_connections 2023-12-08T08:23:36.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.066+0000 7f4c87079640 1 --2- 172.21.15.88:0/1014906956 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c8006bb00 0x7f4c80154d20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.066+0000 7f4c87079640 1 --2- 172.21.15.88:0/1014906956 >> v2:172.21.15.148:3300/0 conn(0x7f4c80151bf0 0x7f4c8006b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.066+0000 7f4c87079640 1 -- 172.21.15.88:0/1014906956 >> 172.21.15.88:0/1014906956 conn(0x7f4c800c61f0 msgr2=0x7f4c800c6600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:36.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.066+0000 7f4c87079640 1 -- 172.21.15.88:0/1014906956 shutdown_connections 2023-12-08T08:23:36.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.066+0000 7f4c87079640 1 -- 172.21.15.88:0/1014906956 wait complete. 2023-12-08T08:23:36.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.066+0000 7f4c87079640 1 Processor -- start 2023-12-08T08:23:36.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.066+0000 7f4c87079640 1 -- start start 2023-12-08T08:23:36.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.070+0000 7f4c87079640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c8006bb00 0x7f4c80144c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:36.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.070+0000 7f4c87079640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c8006d890 0x7f4c801537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:36.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.070+0000 7f4c87079640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c80151bf0 0x7f4c800aa900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:36.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.070+0000 7f4c87079640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c800aa470 con 0x7f4c8006d890 2023-12-08T08:23:36.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.070+0000 7f4c87079640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c80071050 con 0x7f4c8006bb00 2023-12-08T08:23:36.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.070+0000 7f4c87079640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c801ecf10 con 0x7f4c80151bf0 2023-12-08T08:23:36.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.070+0000 7f4c77fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c8006d890 0x7f4c801537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:36.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.070+0000 7f4c77fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c8006d890 0x7f4c801537e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54722/0 (socket says 172.21.15.88:54722) 2023-12-08T08:23:36.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.070+0000 7f4c77fff640 1 -- 172.21.15.88:0/3572320213 learned_addr learned my addr 172.21.15.88:0/3572320213 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:36.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.070+0000 7f4c84e15640 1 --2- 172.21.15.88:0/3572320213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c8006bb00 0x7f4c80144c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:36.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.070+0000 7f4c85616640 1 --2- 172.21.15.88:0/3572320213 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c80151bf0 0x7f4c800aa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:36.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.070+0000 7f4c77fff640 1 -- 172.21.15.88:0/3572320213 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c80151bf0 msgr2=0x7f4c800aa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:36.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.070+0000 7f4c77fff640 1 --2- 172.21.15.88:0/3572320213 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c80151bf0 0x7f4c800aa900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.070+0000 7f4c77fff640 1 -- 172.21.15.88:0/3572320213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c8006bb00 msgr2=0x7f4c80144c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:36.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.070+0000 7f4c77fff640 1 --2- 172.21.15.88:0/3572320213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c8006bb00 0x7f4c80144c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.070+0000 7f4c77fff640 1 -- 172.21.15.88:0/3572320213 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c78009a70 con 0x7f4c8006d890 2023-12-08T08:23:36.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.070+0000 7f4c84e15640 1 --2- 172.21.15.88:0/3572320213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c8006bb00 0x7f4c80144c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:36.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.070+0000 7f4c77fff640 1 --2- 172.21.15.88:0/3572320213 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c8006d890 0x7f4c801537e0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000c520 tx=0x7f4c7000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:36.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.070+0000 7f4c757fa640 1 -- 172.21.15.88:0/3572320213 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c700074e0 con 0x7f4c8006d890 2023-12-08T08:23:36.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.070+0000 7f4c757fa640 1 -- 172.21.15.88:0/3572320213 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c70007640 con 0x7f4c8006d890 2023-12-08T08:23:36.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.070+0000 7f4c757fa640 1 -- 172.21.15.88:0/3572320213 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c700049f0 con 0x7f4c8006d890 2023-12-08T08:23:36.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.070+0000 7f4c87079640 1 -- 172.21.15.88:0/3572320213 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c801ed1f0 con 0x7f4c8006d890 2023-12-08T08:23:36.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.070+0000 7f4c87079640 1 -- 172.21.15.88:0/3572320213 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c800a9360 con 0x7f4c8006d890 2023-12-08T08:23:36.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.070+0000 7f4c87079640 1 -- 172.21.15.88:0/3572320213 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c800aa620 con 0x7f4c8006d890 2023-12-08T08:23:36.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.070+0000 7f4c757fa640 1 -- 172.21.15.88:0/3572320213 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4c70004b50 con 0x7f4c8006d890 2023-12-08T08:23:36.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.074+0000 7f4c757fa640 1 --2- 172.21.15.88:0/3572320213 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4c6c066470 0x7f4c6c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:36.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.074+0000 7f4c757fa640 1 -- 172.21.15.88:0/3572320213 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4c700833d0 con 0x7f4c8006d890 2023-12-08T08:23:36.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.074+0000 7f4c84e15640 1 --2- 172.21.15.88:0/3572320213 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4c6c066470 0x7f4c6c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:36.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.074+0000 7f4c84e15640 1 --2- 172.21.15.88:0/3572320213 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4c6c066470 0x7f4c6c068930 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4c801509b0 tx=0x7f4c7c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:36.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.078+0000 7f4c757fa640 1 -- 172.21.15.88:0/3572320213 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4c800aa620 con 0x7f4c8006d890 2023-12-08T08:23:36.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.230+0000 7f4c87079640 1 -- 172.21.15.88:0/3572320213 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c80145180 con 0x7f4c8006d890 2023-12-08T08:23:36.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.234+0000 7f4c757fa640 1 -- 172.21.15.88:0/3572320213 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20190 (secure 0 0 0) 0x7f4c70050590 con 0x7f4c8006d890 2023-12-08T08:23:36.237 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:36.237 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":72,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:23:18.903336+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:57.367467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:58.632605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:23:15.029129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:23:16.271716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:23:36.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.234+0000 7f4c87079640 1 -- 172.21.15.88:0/3572320213 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4c6c066470 msgr2=0x7f4c6c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:36.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.234+0000 7f4c87079640 1 --2- 172.21.15.88:0/3572320213 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4c6c066470 0x7f4c6c068930 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4c801509b0 tx=0x7f4c7c008040 comp rx=0 tx=0).stop 2023-12-08T08:23:36.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.234+0000 7f4c87079640 1 -- 172.21.15.88:0/3572320213 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c8006d890 msgr2=0x7f4c801537e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:36.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.234+0000 7f4c87079640 1 --2- 172.21.15.88:0/3572320213 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c8006d890 0x7f4c801537e0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000c520 tx=0x7f4c7000c9e0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.234+0000 7f4c87079640 1 -- 172.21.15.88:0/3572320213 shutdown_connections 2023-12-08T08:23:36.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.234+0000 7f4c87079640 1 --2- 172.21.15.88:0/3572320213 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4c6c066470 0x7f4c6c068930 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.234+0000 7f4c87079640 1 --2- 172.21.15.88:0/3572320213 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4c80151bf0 0x7f4c800aa900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.234+0000 7f4c87079640 1 --2- 172.21.15.88:0/3572320213 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c8006d890 0x7f4c801537e0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.234+0000 7f4c87079640 1 --2- 172.21.15.88:0/3572320213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c8006bb00 0x7f4c80144c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.234+0000 7f4c87079640 1 -- 172.21.15.88:0/3572320213 >> 172.21.15.88:0/3572320213 conn(0x7f4c800c61f0 msgr2=0x7f4c8014e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:36.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.234+0000 7f4c87079640 1 -- 172.21.15.88:0/3572320213 shutdown_connections 2023-12-08T08:23:36.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.234+0000 7f4c87079640 1 -- 172.21.15.88:0/3572320213 wait complete. 2023-12-08T08:23:36.258 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:22:57.367467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:22:58.632605+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:23:15.029129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:23:16.271716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:23:36.258 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:23:36.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.394+0000 7f499a0ea640 1 Processor -- start 2023-12-08T08:23:36.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.394+0000 7f499a0ea640 1 -- start start 2023-12-08T08:23:36.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.394+0000 7f499a0ea640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49940c47e0 0x7f49940c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:36.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.394+0000 7f499a0ea640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f49940c83d0 0x7f49940c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:36.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.394+0000 7f499a0ea640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f49940c9110 0x7f4994157b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:36.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.394+0000 7f499a0ea640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49940c5830 con 0x7f49940c83d0 2023-12-08T08:23:36.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.394+0000 7f499a0ea640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4994154620 con 0x7f49940c9110 2023-12-08T08:23:36.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.394+0000 7f499a0ea640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4994155400 con 0x7f49940c47e0 2023-12-08T08:23:36.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.394+0000 7f498bfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f49940c83d0 0x7f49940c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:36.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.394+0000 7f498bfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f49940c83d0 0x7f49940c8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54732/0 (socket says 172.21.15.88:54732) 2023-12-08T08:23:36.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.394+0000 7f498bfff640 1 -- 172.21.15.88:0/3792854368 learned_addr learned my addr 172.21.15.88:0/3792854368 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:36.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.394+0000 7f49937fe640 1 --2- 172.21.15.88:0/3792854368 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49940c47e0 0x7f49940c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:36.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.394+0000 7f4993fff640 1 --2- 172.21.15.88:0/3792854368 >> v2:172.21.15.148:3300/0 conn(0x7f49940c9110 0x7f4994157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:36.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.394+0000 7f498bfff640 1 -- 172.21.15.88:0/3792854368 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49940c47e0 msgr2=0x7f49940c4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:36.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.394+0000 7f498bfff640 1 --2- 172.21.15.88:0/3792854368 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49940c47e0 0x7f49940c4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.394+0000 7f498bfff640 1 -- 172.21.15.88:0/3792854368 >> v2:172.21.15.148:3300/0 conn(0x7f49940c9110 msgr2=0x7f4994157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:36.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.394+0000 7f498bfff640 1 --2- 172.21.15.88:0/3792854368 >> v2:172.21.15.148:3300/0 conn(0x7f49940c9110 0x7f4994157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.394+0000 7f498bfff640 1 -- 172.21.15.88:0/3792854368 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4994154830 con 0x7f49940c83d0 2023-12-08T08:23:36.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.394+0000 7f49937fe640 1 --2- 172.21.15.88:0/3792854368 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49940c47e0 0x7f49940c4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:36.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.394+0000 7f4993fff640 1 --2- 172.21.15.88:0/3792854368 >> v2:172.21.15.148:3300/0 conn(0x7f49940c9110 0x7f4994157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:36.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.398+0000 7f498bfff640 1 --2- 172.21.15.88:0/3792854368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49940c83d0 0x7f49940c8bd0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f4994072d00 tx=0x7f497c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913efdb4b80b1434 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:36.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.398+0000 7f4992ffd640 1 -- 172.21.15.88:0/3792854368 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c0ac640 con 0x7f49940c83d0 2023-12-08T08:23:36.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.398+0000 7f4992ffd640 1 -- 172.21.15.88:0/3792854368 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497c0ac7a0 con 0x7f49940c83d0 2023-12-08T08:23:36.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.398+0000 7f4992ffd640 1 -- 172.21.15.88:0/3792854368 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c0acb30 con 0x7f49940c83d0 2023-12-08T08:23:36.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.398+0000 7f499a0ea640 1 -- 172.21.15.88:0/3792854368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49940c83d0 msgr2=0x7f49940c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:36.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.398+0000 7f499a0ea640 1 --2- 172.21.15.88:0/3792854368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49940c83d0 0x7f49940c8bd0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f4994072d00 tx=0x7f497c01c440 comp rx=0 tx=0).stop 2023-12-08T08:23:36.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.398+0000 7f499a0ea640 1 -- 172.21.15.88:0/3792854368 shutdown_connections 2023-12-08T08:23:36.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.398+0000 7f499a0ea640 1 --2- 172.21.15.88:0/3792854368 >> v2:172.21.15.148:3300/0 conn(0x7f49940c9110 0x7f4994157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.398+0000 7f499a0ea640 1 --2- 172.21.15.88:0/3792854368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49940c83d0 0x7f49940c8bd0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.398+0000 7f499a0ea640 1 --2- 172.21.15.88:0/3792854368 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49940c47e0 0x7f49940c4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.398+0000 7f499a0ea640 1 -- 172.21.15.88:0/3792854368 >> 172.21.15.88:0/3792854368 conn(0x7f49940ab920 msgr2=0x7f49940abd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:36.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.398+0000 7f499a0ea640 1 -- 172.21.15.88:0/3792854368 shutdown_connections 2023-12-08T08:23:36.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.398+0000 7f499a0ea640 1 -- 172.21.15.88:0/3792854368 wait complete. 2023-12-08T08:23:36.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.402+0000 7f499a0ea640 1 Processor -- start 2023-12-08T08:23:36.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.402+0000 7f499a0ea640 1 -- start start 2023-12-08T08:23:36.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.402+0000 7f499a0ea640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49940c47e0 0x7f499415e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:36.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.402+0000 7f499a0ea640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49940c83d0 0x7f49940a9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:36.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.402+0000 7f499a0ea640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49940c9110 0x7f49940af350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:36.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.402+0000 7f499a0ea640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49940adcd0 con 0x7f49940c83d0 2023-12-08T08:23:36.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.402+0000 7f499a0ea640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49940c12a0 con 0x7f49940c47e0 2023-12-08T08:23:36.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.402+0000 7f499a0ea640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49941edf60 con 0x7f49940c9110 2023-12-08T08:23:36.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.402+0000 7f498bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49940c83d0 0x7f49940a9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:36.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.402+0000 7f498bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49940c83d0 0x7f49940a9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54734/0 (socket says 172.21.15.88:54734) 2023-12-08T08:23:36.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.402+0000 7f498bfff640 1 -- 172.21.15.88:0/3756073110 learned_addr learned my addr 172.21.15.88:0/3756073110 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:36.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.402+0000 7f49937fe640 1 --2- 172.21.15.88:0/3756073110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49940c47e0 0x7f499415e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:36.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.402+0000 7f4993fff640 1 --2- 172.21.15.88:0/3756073110 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49940c9110 0x7f49940af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:36.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.402+0000 7f498bfff640 1 -- 172.21.15.88:0/3756073110 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49940c9110 msgr2=0x7f49940af350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:36.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.402+0000 7f498bfff640 1 --2- 172.21.15.88:0/3756073110 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49940c9110 0x7f49940af350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.402+0000 7f498bfff640 1 -- 172.21.15.88:0/3756073110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49940c47e0 msgr2=0x7f499415e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:36.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.402+0000 7f498bfff640 1 --2- 172.21.15.88:0/3756073110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49940c47e0 0x7f499415e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.402+0000 7f498bfff640 1 -- 172.21.15.88:0/3756073110 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497c0094d0 con 0x7f49940c83d0 2023-12-08T08:23:36.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.402+0000 7f498bfff640 1 --2- 172.21.15.88:0/3756073110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49940c83d0 0x7f49940a9ed0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f497c01aaf0 tx=0x7f497c0191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:36.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.402+0000 7f4990ff9640 1 -- 172.21.15.88:0/3756073110 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c0b5640 con 0x7f49940c83d0 2023-12-08T08:23:36.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.402+0000 7f4990ff9640 1 -- 172.21.15.88:0/3756073110 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497c0b57a0 con 0x7f49940c83d0 2023-12-08T08:23:36.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.402+0000 7f4990ff9640 1 -- 172.21.15.88:0/3756073110 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c0b5b10 con 0x7f49940c83d0 2023-12-08T08:23:36.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.402+0000 7f499a0ea640 1 -- 172.21.15.88:0/3756073110 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49940c1540 con 0x7f49940c83d0 2023-12-08T08:23:36.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.402+0000 7f499a0ea640 1 -- 172.21.15.88:0/3756073110 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49940aa410 con 0x7f49940c83d0 2023-12-08T08:23:36.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.406+0000 7f499a0ea640 1 -- 172.21.15.88:0/3756073110 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4994067630 con 0x7f49940c83d0 2023-12-08T08:23:36.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.406+0000 7f4990ff9640 1 -- 172.21.15.88:0/3756073110 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f497c0b3070 con 0x7f49940c83d0 2023-12-08T08:23:36.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.406+0000 7f4990ff9640 1 --2- 172.21.15.88:0/3756073110 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4974066470 0x7f4974068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:36.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.406+0000 7f4990ff9640 1 -- 172.21.15.88:0/3756073110 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f497c11e310 con 0x7f49940c83d0 2023-12-08T08:23:36.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.406+0000 7f49937fe640 1 --2- 172.21.15.88:0/3756073110 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4974066470 0x7f4974068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:36.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.406+0000 7f49937fe640 1 --2- 172.21.15.88:0/3756073110 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4974066470 0x7f4974068930 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f49940c4de0 tx=0x7f4984008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:36.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.410+0000 7f4990ff9640 1 -- 172.21.15.88:0/3756073110 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f497c0eb450 con 0x7f49940c83d0 2023-12-08T08:23:36.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.558+0000 7f499a0ea640 1 -- 172.21.15.88:0/3756073110 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4994067f00 con 0x7f49940c83d0 2023-12-08T08:23:36.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.562+0000 7f4990ff9640 1 -- 172.21.15.88:0/3756073110 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f497c0eea70 con 0x7f49940c83d0 2023-12-08T08:23:36.565 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:23:36.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.562+0000 7f499a0ea640 1 -- 172.21.15.88:0/3756073110 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4974066470 msgr2=0x7f4974068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:36.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.562+0000 7f499a0ea640 1 --2- 172.21.15.88:0/3756073110 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4974066470 0x7f4974068930 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f49940c4de0 tx=0x7f4984008040 comp rx=0 tx=0).stop 2023-12-08T08:23:36.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.562+0000 7f499a0ea640 1 -- 172.21.15.88:0/3756073110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49940c83d0 msgr2=0x7f49940a9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:36.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.562+0000 7f499a0ea640 1 --2- 172.21.15.88:0/3756073110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49940c83d0 0x7f49940a9ed0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f497c01aaf0 tx=0x7f497c0191e0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.562+0000 7f499a0ea640 1 -- 172.21.15.88:0/3756073110 shutdown_connections 2023-12-08T08:23:36.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.562+0000 7f499a0ea640 1 --2- 172.21.15.88:0/3756073110 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4974066470 0x7f4974068930 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.562+0000 7f499a0ea640 1 --2- 172.21.15.88:0/3756073110 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f49940c9110 0x7f49940af350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.562+0000 7f499a0ea640 1 --2- 172.21.15.88:0/3756073110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49940c83d0 0x7f49940a9ed0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.562+0000 7f499a0ea640 1 --2- 172.21.15.88:0/3756073110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49940c47e0 0x7f499415e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.562+0000 7f499a0ea640 1 -- 172.21.15.88:0/3756073110 >> 172.21.15.88:0/3756073110 conn(0x7f49940ab920 msgr2=0x7f49940abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:36.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.562+0000 7f499a0ea640 1 -- 172.21.15.88:0/3756073110 shutdown_connections 2023-12-08T08:23:36.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.562+0000 7f499a0ea640 1 -- 172.21.15.88:0/3756073110 wait complete. 2023-12-08T08:23:36.585 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:23:36.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.722+0000 7f8cd4217640 1 Processor -- start 2023-12-08T08:23:36.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.722+0000 7f8cd4217640 1 -- start start 2023-12-08T08:23:36.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.722+0000 7f8cd4217640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8ccc14b1e0 0x7f8ccc0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:36.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.722+0000 7f8cd4217640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8ccc0c5300 0x7f8ccc0a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:36.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.722+0000 7f8cd4217640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ccc0a4e20 con 0x7f8ccc151280 2023-12-08T08:23:36.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.722+0000 7f8cd4217640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ccc1558d0 con 0x7f8ccc14b1e0 2023-12-08T08:23:36.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.722+0000 7f8cd4217640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ccc0a50e0 con 0x7f8ccc0c5300 2023-12-08T08:23:36.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.722+0000 7f8cd1fb3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8ccc14b1e0 0x7f8ccc0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:36.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.722+0000 7f8cd27b4640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8ccc151280 0x7f8ccc1516f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:32872/0 (socket says 172.21.15.88:32872) 2023-12-08T08:23:36.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.722+0000 7f8cd1fb3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8ccc14b1e0 0x7f8ccc0c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54738/0 (socket says 172.21.15.88:54738) 2023-12-08T08:23:36.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.722+0000 7f8cd27b4640 1 -- 172.21.15.88:0/1724978587 learned_addr learned my addr 172.21.15.88:0/1724978587 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:36.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.722+0000 7f8cd17b2640 1 --2- 172.21.15.88:0/1724978587 >> v2:172.21.15.148:3300/0 conn(0x7f8ccc0c5300 0x7f8ccc0a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:36.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.722+0000 7f8cd1fb3640 1 -- 172.21.15.88:0/1724978587 >> v2:172.21.15.148:3300/0 conn(0x7f8ccc0c5300 msgr2=0x7f8ccc0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:36.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.722+0000 7f8cd1fb3640 1 --2- 172.21.15.88:0/1724978587 >> v2:172.21.15.148:3300/0 conn(0x7f8ccc0c5300 0x7f8ccc0a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.722+0000 7f8cd1fb3640 1 -- 172.21.15.88:0/1724978587 >> v1:172.21.15.88:6789/0 conn(0x7f8ccc151280 legacy=0x7f8ccc1516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:36.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.722+0000 7f8cd1fb3640 1 -- 172.21.15.88:0/1724978587 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc0c0f00 con 0x7f8ccc14b1e0 2023-12-08T08:23:36.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.722+0000 7f8cd0fb1640 1 -- 172.21.15.88:0/1724978587 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330595518 0 0) 0x7f8ccc0a4e20 con 0x7f8ccc151280 2023-12-08T08:23:36.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.726+0000 7f8cd1fb3640 1 --2- 172.21.15.88:0/1724978587 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ccc14b1e0 0x7f8ccc0c1700 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0a9650 tx=0x7f8cc801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3645fced80db61a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:36.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.726+0000 7f8cd0fb1640 1 -- 172.21.15.88:0/1724978587 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc80ab600 con 0x7f8ccc14b1e0 2023-12-08T08:23:36.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.726+0000 7f8cd0fb1640 1 -- 172.21.15.88:0/1724978587 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc80a7050 con 0x7f8ccc14b1e0 2023-12-08T08:23:36.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.726+0000 7f8cd0fb1640 1 -- 172.21.15.88:0/1724978587 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc80ab980 con 0x7f8ccc14b1e0 2023-12-08T08:23:36.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.726+0000 7f8cd4217640 1 -- 172.21.15.88:0/1724978587 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ccc14b1e0 msgr2=0x7f8ccc0c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:36.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.726+0000 7f8cd4217640 1 --2- 172.21.15.88:0/1724978587 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ccc14b1e0 0x7f8ccc0c1700 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0a9650 tx=0x7f8cc801c460 comp rx=0 tx=0).stop 2023-12-08T08:23:36.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.726+0000 7f8cd4217640 1 -- 172.21.15.88:0/1724978587 shutdown_connections 2023-12-08T08:23:36.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.726+0000 7f8cd4217640 1 --2- 172.21.15.88:0/1724978587 >> v2:172.21.15.148:3300/0 conn(0x7f8ccc0c5300 0x7f8ccc0a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.726+0000 7f8cd4217640 1 --2- 172.21.15.88:0/1724978587 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ccc14b1e0 0x7f8ccc0c1700 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.726+0000 7f8cd4217640 1 -- 172.21.15.88:0/1724978587 >> 172.21.15.88:0/1724978587 conn(0x7f8ccc0c59f0 msgr2=0x7f8ccc0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:36.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.726+0000 7f8cd4217640 1 -- 172.21.15.88:0/1724978587 shutdown_connections 2023-12-08T08:23:36.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.726+0000 7f8cd4217640 1 -- 172.21.15.88:0/1724978587 wait complete. 2023-12-08T08:23:36.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.730+0000 7f8cd4217640 1 Processor -- start 2023-12-08T08:23:36.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.730+0000 7f8cd4217640 1 -- start start 2023-12-08T08:23:36.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.730+0000 7f8cd4217640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ccc0c5300 0x7f8ccc143d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:36.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.730+0000 7f8cd4217640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ccc14b1e0 0x7f8ccc1442c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:36.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.730+0000 7f8cd4217640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ccc151280 0x7f8ccc1ec360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:36.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.730+0000 7f8cd4217640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc147af0 con 0x7f8ccc151280 2023-12-08T08:23:36.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.730+0000 7f8cd4217640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc147810 con 0x7f8ccc14b1e0 2023-12-08T08:23:36.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.730+0000 7f8cd4217640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc071250 con 0x7f8ccc0c5300 2023-12-08T08:23:36.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.730+0000 7f8cd27b4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ccc151280 0x7f8ccc1ec360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:36.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.730+0000 7f8cd27b4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ccc151280 0x7f8ccc1ec360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54744/0 (socket says 172.21.15.88:54744) 2023-12-08T08:23:36.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.730+0000 7f8cd27b4640 1 -- 172.21.15.88:0/3598298528 learned_addr learned my addr 172.21.15.88:0/3598298528 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:36.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.730+0000 7f8cd1fb3640 1 --2- 172.21.15.88:0/3598298528 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ccc0c5300 0x7f8ccc143d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:36.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.730+0000 7f8cd17b2640 1 --2- 172.21.15.88:0/3598298528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ccc14b1e0 0x7f8ccc1442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:36.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.730+0000 7f8cd27b4640 1 -- 172.21.15.88:0/3598298528 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ccc0c5300 msgr2=0x7f8ccc143d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:36.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.730+0000 7f8cd27b4640 1 --2- 172.21.15.88:0/3598298528 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ccc0c5300 0x7f8ccc143d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.730+0000 7f8cd27b4640 1 -- 172.21.15.88:0/3598298528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ccc14b1e0 msgr2=0x7f8ccc1442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:36.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.730+0000 7f8cd27b4640 1 --2- 172.21.15.88:0/3598298528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ccc14b1e0 0x7f8ccc1442c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.730+0000 7f8cd27b4640 1 -- 172.21.15.88:0/3598298528 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc8009420 con 0x7f8ccc151280 2023-12-08T08:23:36.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.730+0000 7f8cd1fb3640 1 --2- 172.21.15.88:0/3598298528 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ccc0c5300 0x7f8ccc143d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:23:36.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.730+0000 7f8cd27b4640 1 --2- 172.21.15.88:0/3598298528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ccc151280 0x7f8ccc1ec360 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400c780 tx=0x7f8cc400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:36.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.730+0000 7f8cc27fc640 1 -- 172.21.15.88:0/3598298528 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc400ce90 con 0x7f8ccc151280 2023-12-08T08:23:36.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.730+0000 7f8cc27fc640 1 -- 172.21.15.88:0/3598298528 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc400a640 con 0x7f8ccc151280 2023-12-08T08:23:36.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.730+0000 7f8cc27fc640 1 -- 172.21.15.88:0/3598298528 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc400a9d0 con 0x7f8ccc151280 2023-12-08T08:23:36.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.730+0000 7f8cd4217640 1 -- 172.21.15.88:0/3598298528 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ccc071530 con 0x7f8ccc151280 2023-12-08T08:23:36.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.730+0000 7f8cd4217640 1 -- 172.21.15.88:0/3598298528 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ccc150230 con 0x7f8ccc151280 2023-12-08T08:23:36.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.730+0000 7f8cd4217640 1 -- 172.21.15.88:0/3598298528 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ccc0710b0 con 0x7f8ccc151280 2023-12-08T08:23:36.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.734+0000 7f8cc27fc640 1 -- 172.21.15.88:0/3598298528 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8cc400ab30 con 0x7f8ccc151280 2023-12-08T08:23:36.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.734+0000 7f8cc27fc640 1 --2- 172.21.15.88:0/3598298528 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8cb0066470 0x7f8cb0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:36.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.734+0000 7f8cc27fc640 1 -- 172.21.15.88:0/3598298528 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8cc4083670 con 0x7f8ccc151280 2023-12-08T08:23:36.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.734+0000 7f8cd1fb3640 1 --2- 172.21.15.88:0/3598298528 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8cb0066470 0x7f8cb0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:36.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.734+0000 7f8cd1fb3640 1 --2- 172.21.15.88:0/3598298528 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8cb0066470 0x7f8cb0068930 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8cc80ad000 tx=0x7f8cc80a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:36.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.738+0000 7f8cc27fc640 1 -- 172.21.15.88:0/3598298528 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8ccc0710b0 con 0x7f8ccc151280 2023-12-08T08:23:36.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.890+0000 7f8cd4217640 1 -- 172.21.15.88:0/3598298528 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ccc0710b0 con 0x7f8ccc151280 2023-12-08T08:23:36.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.890+0000 7f8cc27fc640 1 -- 172.21.15.88:0/3598298528 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8cc4018020 con 0x7f8ccc151280 2023-12-08T08:23:36.893 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:23:36.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.890+0000 7f8cd4217640 1 -- 172.21.15.88:0/3598298528 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8cb0066470 msgr2=0x7f8cb0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:36.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.890+0000 7f8cd4217640 1 --2- 172.21.15.88:0/3598298528 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8cb0066470 0x7f8cb0068930 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8cc80ad000 tx=0x7f8cc80a6000 comp rx=0 tx=0).stop 2023-12-08T08:23:36.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.890+0000 7f8cd4217640 1 -- 172.21.15.88:0/3598298528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ccc151280 msgr2=0x7f8ccc1ec360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:36.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.890+0000 7f8cd4217640 1 --2- 172.21.15.88:0/3598298528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ccc151280 0x7f8ccc1ec360 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400c780 tx=0x7f8cc400cc40 comp rx=0 tx=0).stop 2023-12-08T08:23:36.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.890+0000 7f8cd4217640 1 -- 172.21.15.88:0/3598298528 shutdown_connections 2023-12-08T08:23:36.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.890+0000 7f8cd4217640 1 --2- 172.21.15.88:0/3598298528 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8cb0066470 0x7f8cb0068930 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.890+0000 7f8cd4217640 1 --2- 172.21.15.88:0/3598298528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ccc151280 0x7f8ccc1ec360 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.890+0000 7f8cd4217640 1 --2- 172.21.15.88:0/3598298528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8ccc14b1e0 0x7f8ccc1442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.890+0000 7f8cd4217640 1 --2- 172.21.15.88:0/3598298528 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8ccc0c5300 0x7f8ccc143d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:36.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.890+0000 7f8cd4217640 1 -- 172.21.15.88:0/3598298528 >> 172.21.15.88:0/3598298528 conn(0x7f8ccc0c59f0 msgr2=0x7f8ccc149fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:36.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.890+0000 7f8cd4217640 1 -- 172.21.15.88:0/3598298528 shutdown_connections 2023-12-08T08:23:36.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:36.890+0000 7f8cd4217640 1 -- 172.21.15.88:0/3598298528 wait complete. 2023-12-08T08:23:36.914 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:23:37.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.050+0000 7fd71551d640 1 Processor -- start 2023-12-08T08:23:37.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.050+0000 7fd71551d640 1 -- start start 2023-12-08T08:23:37.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.050+0000 7fd71551d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd71006d840 0x7fd7100c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:37.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.050+0000 7fd71551d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd710152910 con 0x7fd71014fc30 2023-12-08T08:23:37.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.050+0000 7fd71551d640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd710152bf0 con 0x7fd71014f850 2023-12-08T08:23:37.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.050+0000 7fd71551d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7100c2240 con 0x7fd71006d840 2023-12-08T08:23:37.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.050+0000 7fd7067fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd71014fc30 0x7fd7100c3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:32880/0 (socket says 172.21.15.88:32880) 2023-12-08T08:23:37.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.050+0000 7fd7067fc640 1 -- 172.21.15.88:0/871454227 learned_addr learned my addr 172.21.15.88:0/871454227 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:37.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.050+0000 7fd70f7fe640 1 --2- 172.21.15.88:0/871454227 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd71006d840 0x7fd7100c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:37.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.050+0000 7fd70e7fc640 1 -- 172.21.15.88:0/871454227 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3539766132 0 0) 0x7fd710152910 con 0x7fd71014fc30 2023-12-08T08:23:37.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.050+0000 7fd70e7fc640 1 -- 172.21.15.88:0/871454227 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6fc003530 con 0x7fd71014fc30 2023-12-08T08:23:37.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.050+0000 7fd70e7fc640 1 -- 172.21.15.88:0/871454227 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3832668868 0 0) 0x7fd6fc003530 con 0x7fd71014fc30 2023-12-08T08:23:37.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.050+0000 7fd70e7fc640 1 -- 172.21.15.88:0/871454227 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd71006d840 msgr2=0x7fd7100c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:37.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.050+0000 7fd70e7fc640 1 --2- 172.21.15.88:0/871454227 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd71006d840 0x7fd7100c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:37.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.050+0000 7fd70e7fc640 1 -- 172.21.15.88:0/871454227 >> v1:172.21.15.148:6789/0 conn(0x7fd71014f850 legacy=0x7fd7100aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:37.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.050+0000 7fd70e7fc640 1 -- 172.21.15.88:0/871454227 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd710152ed0 con 0x7fd71014fc30 2023-12-08T08:23:37.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.050+0000 7fd70e7fc640 1 -- 172.21.15.88:0/871454227 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7fd6f80016a0 con 0x7fd71014fc30 2023-12-08T08:23:37.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.050+0000 7fd70e7fc640 1 -- 172.21.15.88:0/871454227 >> v1:172.21.15.88:6789/0 conn(0x7fd71014fc30 legacy=0x7fd7100c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:37.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.050+0000 7fd70e7fc640 1 --2- 172.21.15.88:0/871454227 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6fc0039b0 0x7fd6fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:37.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.050+0000 7fd70e7fc640 1 --2- 172.21.15.88:0/871454227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6fc004360 0x7fd6fc004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:37.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.050+0000 7fd70e7fc640 1 --2- 172.21.15.88:0/871454227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6fc005030 0x7fd6fc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:37.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.050+0000 7fd70e7fc640 1 -- 172.21.15.88:0/871454227 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7100c2240 con 0x7fd6fc005030 2023-12-08T08:23:37.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.050+0000 7fd70e7fc640 1 -- 172.21.15.88:0/871454227 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc00bf50 con 0x7fd6fc004360 2023-12-08T08:23:37.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.050+0000 7fd70e7fc640 1 -- 172.21.15.88:0/871454227 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc00c110 con 0x7fd6fc0039b0 2023-12-08T08:23:37.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.050+0000 7fd70f7fe640 1 --2- 172.21.15.88:0/871454227 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd71006d840 0x7fd7100c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:23:37.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.050+0000 7fd7067fc640 1 --2- 172.21.15.88:0/871454227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6fc004360 0x7fd6fc004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:37.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.050+0000 7fd70f7fe640 1 --2- 172.21.15.88:0/871454227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6fc005030 0x7fd6fc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:37.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.054+0000 7fd70effd640 1 --2- 172.21.15.88:0/871454227 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6fc0039b0 0x7fd6fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:37.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.054+0000 7fd70f7fe640 1 -- 172.21.15.88:0/871454227 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6fc0039b0 msgr2=0x7fd6fc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:37.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.054+0000 7fd70f7fe640 1 --2- 172.21.15.88:0/871454227 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6fc0039b0 0x7fd6fc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:37.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.054+0000 7fd70f7fe640 1 -- 172.21.15.88:0/871454227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6fc004360 msgr2=0x7fd6fc004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:37.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.054+0000 7fd70f7fe640 1 --2- 172.21.15.88:0/871454227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6fc004360 0x7fd6fc004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:37.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.054+0000 7fd70f7fe640 1 -- 172.21.15.88:0/871454227 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc003530 con 0x7fd6fc005030 2023-12-08T08:23:37.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.054+0000 7fd7067fc640 1 --2- 172.21.15.88:0/871454227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6fc004360 0x7fd6fc004830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:23:37.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.054+0000 7fd70f7fe640 1 --2- 172.21.15.88:0/871454227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6fc005030 0x7fd6fc00b990 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fd71006dc20 tx=0x7fd70801cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8564e31d2f8a8ab server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:37.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.054+0000 7fd70e7fc640 1 -- 172.21.15.88:0/871454227 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd708003c60 con 0x7fd6fc005030 2023-12-08T08:23:37.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.054+0000 7fd70e7fc640 1 -- 172.21.15.88:0/871454227 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70800f040 con 0x7fd6fc005030 2023-12-08T08:23:37.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.054+0000 7fd70e7fc640 1 -- 172.21.15.88:0/871454227 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7080a5870 con 0x7fd6fc005030 2023-12-08T08:23:37.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.058+0000 7fd71551d640 1 -- 172.21.15.88:0/871454227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6fc005030 msgr2=0x7fd6fc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:37.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.058+0000 7fd71551d640 1 --2- 172.21.15.88:0/871454227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6fc005030 0x7fd6fc00b990 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fd71006dc20 tx=0x7fd70801cd00 comp rx=0 tx=0).stop 2023-12-08T08:23:37.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.058+0000 7fd70f7fe640 1 -- 172.21.15.88:0/871454227 reap_dead start 2023-12-08T08:23:37.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.058+0000 7fd71551d640 1 -- 172.21.15.88:0/871454227 shutdown_connections 2023-12-08T08:23:37.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.058+0000 7fd71551d640 1 -- 172.21.15.88:0/871454227 >> 172.21.15.88:0/871454227 conn(0x7fd7100c59f0 msgr2=0x7fd7100c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:37.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.058+0000 7fd71551d640 1 -- 172.21.15.88:0/871454227 shutdown_connections 2023-12-08T08:23:37.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.058+0000 7fd71551d640 1 -- 172.21.15.88:0/871454227 wait complete. 2023-12-08T08:23:37.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.058+0000 7fd71551d640 1 Processor -- start 2023-12-08T08:23:37.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.058+0000 7fd71551d640 1 -- start start 2023-12-08T08:23:37.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.058+0000 7fd71551d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6fc005030 0x7fd710153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:37.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.058+0000 7fd71551d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7100aadf0 0x7fd710156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:37.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.058+0000 7fd71551d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7100704d0 0x7fd7100722a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:37.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.058+0000 7fd71551d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd710155570 con 0x7fd7100aadf0 2023-12-08T08:23:37.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.058+0000 7fd71551d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7100701b0 con 0x7fd7100704d0 2023-12-08T08:23:37.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.058+0000 7fd71551d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd710155290 con 0x7fd6fc005030 2023-12-08T08:23:37.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.058+0000 7fd7067fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7100aadf0 0x7fd710156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:37.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.058+0000 7fd7067fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7100aadf0 0x7fd710156140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54760/0 (socket says 172.21.15.88:54760) 2023-12-08T08:23:37.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.058+0000 7fd7067fc640 1 -- 172.21.15.88:0/938292934 learned_addr learned my addr 172.21.15.88:0/938292934 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:37.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.058+0000 7fd70effd640 1 --2- 172.21.15.88:0/938292934 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6fc005030 0x7fd710153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:37.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.058+0000 7fd70f7fe640 1 --2- 172.21.15.88:0/938292934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7100704d0 0x7fd7100722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:37.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.058+0000 7fd7067fc640 1 -- 172.21.15.88:0/938292934 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6fc005030 msgr2=0x7fd710153850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:37.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.058+0000 7fd7067fc640 1 --2- 172.21.15.88:0/938292934 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6fc005030 0x7fd710153850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:37.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.058+0000 7fd7067fc640 1 -- 172.21.15.88:0/938292934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7100704d0 msgr2=0x7fd7100722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:37.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.058+0000 7fd7067fc640 1 --2- 172.21.15.88:0/938292934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7100704d0 0x7fd7100722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:37.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.058+0000 7fd7067fc640 1 -- 172.21.15.88:0/938292934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71006fbf0 con 0x7fd7100aadf0 2023-12-08T08:23:37.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.058+0000 7fd7067fc640 1 --2- 172.21.15.88:0/938292934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7100aadf0 0x7fd710156140 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8001c10 tx=0x7fd6f8012920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:37.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.062+0000 7fd707fff640 1 -- 172.21.15.88:0/938292934 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8014810 con 0x7fd7100aadf0 2023-12-08T08:23:37.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.062+0000 7fd707fff640 1 -- 172.21.15.88:0/938292934 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f8014970 con 0x7fd7100aadf0 2023-12-08T08:23:37.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.062+0000 7fd707fff640 1 -- 172.21.15.88:0/938292934 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8014d00 con 0x7fd7100aadf0 2023-12-08T08:23:37.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.062+0000 7fd71551d640 1 -- 172.21.15.88:0/938292934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71006fed0 con 0x7fd7100aadf0 2023-12-08T08:23:37.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.062+0000 7fd71551d640 1 -- 172.21.15.88:0/938292934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd710156680 con 0x7fd7100aadf0 2023-12-08T08:23:37.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.062+0000 7fd71551d640 1 -- 172.21.15.88:0/938292934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd710070320 con 0x7fd7100aadf0 2023-12-08T08:23:37.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.062+0000 7fd707fff640 1 -- 172.21.15.88:0/938292934 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd6f80153e0 con 0x7fd7100aadf0 2023-12-08T08:23:37.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.062+0000 7fd707fff640 1 --2- 172.21.15.88:0/938292934 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd6f00664a0 0x7fd6f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:37.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.062+0000 7fd707fff640 1 -- 172.21.15.88:0/938292934 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd6f8086c00 con 0x7fd7100aadf0 2023-12-08T08:23:37.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.062+0000 7fd70effd640 1 --2- 172.21.15.88:0/938292934 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd6f00664a0 0x7fd6f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:37.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.066+0000 7fd70effd640 1 --2- 172.21.15.88:0/938292934 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd6f00664a0 0x7fd6f0068960 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd700007fd0 tx=0x7fd700009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:37.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.066+0000 7fd707fff640 1 -- 172.21.15.88:0/938292934 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd6f8053d10 con 0x7fd7100aadf0 2023-12-08T08:23:37.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.218+0000 7fd71551d640 1 -- 172.21.15.88:0/938292934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd710067630 con 0x7fd7100aadf0 2023-12-08T08:23:37.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.222+0000 7fd707fff640 1 -- 172.21.15.88:0/938292934 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd6f801c020 con 0x7fd7100aadf0 2023-12-08T08:23:37.225 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:23:37.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.222+0000 7fd71551d640 1 -- 172.21.15.88:0/938292934 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd6f00664a0 msgr2=0x7fd6f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:37.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.222+0000 7fd71551d640 1 --2- 172.21.15.88:0/938292934 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd6f00664a0 0x7fd6f0068960 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd700007fd0 tx=0x7fd700009040 comp rx=0 tx=0).stop 2023-12-08T08:23:37.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.222+0000 7fd71551d640 1 -- 172.21.15.88:0/938292934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7100aadf0 msgr2=0x7fd710156140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:37.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.222+0000 7fd71551d640 1 --2- 172.21.15.88:0/938292934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7100aadf0 0x7fd710156140 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8001c10 tx=0x7fd6f8012920 comp rx=0 tx=0).stop 2023-12-08T08:23:37.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.222+0000 7fd71551d640 1 -- 172.21.15.88:0/938292934 shutdown_connections 2023-12-08T08:23:37.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.222+0000 7fd71551d640 1 --2- 172.21.15.88:0/938292934 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd6f00664a0 0x7fd6f0068960 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:37.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.222+0000 7fd71551d640 1 --2- 172.21.15.88:0/938292934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7100704d0 0x7fd7100722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:37.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.222+0000 7fd71551d640 1 --2- 172.21.15.88:0/938292934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7100aadf0 0x7fd710156140 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:37.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.222+0000 7fd71551d640 1 --2- 172.21.15.88:0/938292934 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd6fc005030 0x7fd710153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:37.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.222+0000 7fd71551d640 1 -- 172.21.15.88:0/938292934 >> 172.21.15.88:0/938292934 conn(0x7fd7100c59f0 msgr2=0x7fd7100a6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:37.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.222+0000 7fd71551d640 1 -- 172.21.15.88:0/938292934 shutdown_connections 2023-12-08T08:23:37.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.222+0000 7fd71551d640 1 -- 172.21.15.88:0/938292934 wait complete. 2023-12-08T08:23:37.247 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:23:37.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.382+0000 7f6c685f8640 1 Processor -- start 2023-12-08T08:23:37.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.382+0000 7f6c685f8640 1 -- start start 2023-12-08T08:23:37.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.382+0000 7f6c685f8640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6c600bf2d0 0x7f6c60151970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:37.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.382+0000 7f6c685f8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c600c6030 0x7f6c60151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:37.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.382+0000 7f6c685f8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c60158780 con 0x7f6c600c98f0 2023-12-08T08:23:37.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.382+0000 7f6c685f8640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c600c0300 con 0x7f6c600bf2d0 2023-12-08T08:23:37.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.382+0000 7f6c685f8640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c60157b70 con 0x7f6c600c6030 2023-12-08T08:23:37.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.382+0000 7f6c66b95640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6c600c98f0 0x7f6c600c7cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:32886/0 (socket says 172.21.15.88:32886) 2023-12-08T08:23:37.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.382+0000 7f6c66b95640 1 -- 172.21.15.88:0/3660994911 learned_addr learned my addr 172.21.15.88:0/3660994911 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:37.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.382+0000 7f6c66394640 1 --2- 172.21.15.88:0/3660994911 >> v2:172.21.15.148:3300/0 conn(0x7f6c600bf2d0 0x7f6c60151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:37.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.382+0000 7f6c65b93640 1 --2- 172.21.15.88:0/3660994911 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c600c6030 0x7f6c60151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:37.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.382+0000 7f6c65392640 1 -- 172.21.15.88:0/3660994911 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1528782015 0 0) 0x7f6c60158780 con 0x7f6c600c98f0 2023-12-08T08:23:37.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.382+0000 7f6c65392640 1 -- 172.21.15.88:0/3660994911 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c4c003530 con 0x7f6c600c98f0 2023-12-08T08:23:37.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.382+0000 7f6c66394640 1 -- 172.21.15.88:0/3660994911 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c600c6030 msgr2=0x7f6c60151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:37.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.382+0000 7f6c66394640 1 --2- 172.21.15.88:0/3660994911 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c600c6030 0x7f6c60151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:37.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.382+0000 7f6c66394640 1 -- 172.21.15.88:0/3660994911 >> v1:172.21.15.88:6789/0 conn(0x7f6c600c98f0 legacy=0x7f6c600c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:37.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.382+0000 7f6c66394640 1 -- 172.21.15.88:0/3660994911 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c60157e50 con 0x7f6c600bf2d0 2023-12-08T08:23:37.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.382+0000 7f6c65b93640 1 --2- 172.21.15.88:0/3660994911 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c600c6030 0x7f6c60151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:23:37.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.386+0000 7f6c66394640 1 --2- 172.21.15.88:0/3660994911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c600bf2d0 0x7f6c60151970 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0097c0 tx=0x7f6c5c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cffa568938ca5e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:37.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.386+0000 7f6c65392640 1 -- 172.21.15.88:0/3660994911 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c0ab650 con 0x7f6c600bf2d0 2023-12-08T08:23:37.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.386+0000 7f6c65392640 1 -- 172.21.15.88:0/3660994911 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5c0ab7b0 con 0x7f6c600bf2d0 2023-12-08T08:23:37.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.386+0000 7f6c65392640 1 -- 172.21.15.88:0/3660994911 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c0abb20 con 0x7f6c600bf2d0 2023-12-08T08:23:37.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.386+0000 7f6c685f8640 1 -- 172.21.15.88:0/3660994911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c600bf2d0 msgr2=0x7f6c60151970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:37.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.386+0000 7f6c685f8640 1 --2- 172.21.15.88:0/3660994911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c600bf2d0 0x7f6c60151970 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0097c0 tx=0x7f6c5c01c450 comp rx=0 tx=0).stop 2023-12-08T08:23:37.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.386+0000 7f6c685f8640 1 -- 172.21.15.88:0/3660994911 shutdown_connections 2023-12-08T08:23:37.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.386+0000 7f6c685f8640 1 --2- 172.21.15.88:0/3660994911 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c600c6030 0x7f6c60151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:37.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.386+0000 7f6c685f8640 1 --2- 172.21.15.88:0/3660994911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c600bf2d0 0x7f6c60151970 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:37.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.386+0000 7f6c685f8640 1 -- 172.21.15.88:0/3660994911 >> 172.21.15.88:0/3660994911 conn(0x7f6c600c9dc0 msgr2=0x7f6c600ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:37.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.386+0000 7f6c685f8640 1 -- 172.21.15.88:0/3660994911 shutdown_connections 2023-12-08T08:23:37.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.386+0000 7f6c685f8640 1 -- 172.21.15.88:0/3660994911 wait complete. 2023-12-08T08:23:37.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.390+0000 7f6c685f8640 1 Processor -- start 2023-12-08T08:23:37.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.390+0000 7f6c685f8640 1 -- start start 2023-12-08T08:23:37.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.390+0000 7f6c685f8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c600bf2d0 0x7f6c60145be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:37.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.390+0000 7f6c685f8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c600c6030 0x7f6c6006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:37.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.390+0000 7f6c685f8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c600c98f0 0x7f6c601436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:37.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.390+0000 7f6c685f8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c60145210 con 0x7f6c600c6030 2023-12-08T08:23:37.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.390+0000 7f6c685f8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c60144690 con 0x7f6c600c98f0 2023-12-08T08:23:37.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.390+0000 7f6c685f8640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c60144970 con 0x7f6c600bf2d0 2023-12-08T08:23:37.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.390+0000 7f6c65b93640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c600c6030 0x7f6c6006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:37.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.390+0000 7f6c65b93640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c600c6030 0x7f6c6006c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54762/0 (socket says 172.21.15.88:54762) 2023-12-08T08:23:37.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.390+0000 7f6c65b93640 1 -- 172.21.15.88:0/2701772172 learned_addr learned my addr 172.21.15.88:0/2701772172 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:37.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.390+0000 7f6c66394640 1 --2- 172.21.15.88:0/2701772172 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c600bf2d0 0x7f6c60145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:37.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.390+0000 7f6c66b95640 1 --2- 172.21.15.88:0/2701772172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c600c98f0 0x7f6c601436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:37.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.390+0000 7f6c65b93640 1 -- 172.21.15.88:0/2701772172 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c600bf2d0 msgr2=0x7f6c60145be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:37.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.390+0000 7f6c65b93640 1 --2- 172.21.15.88:0/2701772172 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c600bf2d0 0x7f6c60145be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:37.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.390+0000 7f6c65b93640 1 -- 172.21.15.88:0/2701772172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c600c98f0 msgr2=0x7f6c601436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:37.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.390+0000 7f6c65b93640 1 --2- 172.21.15.88:0/2701772172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c600c98f0 0x7f6c601436f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:37.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.390+0000 7f6c65b93640 1 -- 172.21.15.88:0/2701772172 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c50009420 con 0x7f6c600c6030 2023-12-08T08:23:37.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.390+0000 7f6c66b95640 1 --2- 172.21.15.88:0/2701772172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c600c98f0 0x7f6c601436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:37.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.390+0000 7f6c65b93640 1 --2- 172.21.15.88:0/2701772172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c600c6030 0x7f6c6006c4f0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f6c5000ebe0 tx=0x7f6c5000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:37.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.390+0000 7f6c56ffd640 1 -- 172.21.15.88:0/2701772172 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5000eee0 con 0x7f6c600c6030 2023-12-08T08:23:37.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.390+0000 7f6c56ffd640 1 -- 172.21.15.88:0/2701772172 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5000cc30 con 0x7f6c600c6030 2023-12-08T08:23:37.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.390+0000 7f6c56ffd640 1 -- 172.21.15.88:0/2701772172 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c50013470 con 0x7f6c600c6030 2023-12-08T08:23:37.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.390+0000 7f6c685f8640 1 -- 172.21.15.88:0/2701772172 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c5c009420 con 0x7f6c600c6030 2023-12-08T08:23:37.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.390+0000 7f6c685f8640 1 -- 172.21.15.88:0/2701772172 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c60144f30 con 0x7f6c600c6030 2023-12-08T08:23:37.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.394+0000 7f6c685f8640 1 -- 172.21.15.88:0/2701772172 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c60067630 con 0x7f6c600c6030 2023-12-08T08:23:37.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.394+0000 7f6c56ffd640 1 -- 172.21.15.88:0/2701772172 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6c500135d0 con 0x7f6c600c6030 2023-12-08T08:23:37.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.394+0000 7f6c56ffd640 1 --2- 172.21.15.88:0/2701772172 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6c440664a0 0x7f6c44068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:37.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.394+0000 7f6c56ffd640 1 -- 172.21.15.88:0/2701772172 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6c50084430 con 0x7f6c600c6030 2023-12-08T08:23:37.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.394+0000 7f6c66394640 1 --2- 172.21.15.88:0/2701772172 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6c440664a0 0x7f6c44068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:37.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.394+0000 7f6c66394640 1 --2- 172.21.15.88:0/2701772172 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6c440664a0 0x7f6c44068960 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0af000 tx=0x7f6c5c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:37.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.398+0000 7f6c56ffd640 1 -- 172.21.15.88:0/2701772172 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c50051560 con 0x7f6c600c6030 2023-12-08T08:23:37.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.546+0000 7f6c685f8640 1 -- 172.21.15.88:0/2701772172 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c600c9190 con 0x7f6c600c6030 2023-12-08T08:23:37.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.546+0000 7f6c56ffd640 1 -- 172.21.15.88:0/2701772172 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v72) v1 ==== 105+0+11 (secure 0 0 0) 0x7f6c50054b80 con 0x7f6c600c6030 2023-12-08T08:23:37.552 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:23:37.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.550+0000 7f6c685f8640 1 -- 172.21.15.88:0/2701772172 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6c440664a0 msgr2=0x7f6c44068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:37.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.550+0000 7f6c685f8640 1 --2- 172.21.15.88:0/2701772172 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6c440664a0 0x7f6c44068960 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0af000 tx=0x7f6c5c0a7000 comp rx=0 tx=0).stop 2023-12-08T08:23:37.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.550+0000 7f6c685f8640 1 -- 172.21.15.88:0/2701772172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c600c6030 msgr2=0x7f6c6006c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:37.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.550+0000 7f6c685f8640 1 --2- 172.21.15.88:0/2701772172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c600c6030 0x7f6c6006c4f0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f6c5000ebe0 tx=0x7f6c5000c520 comp rx=0 tx=0).stop 2023-12-08T08:23:37.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.550+0000 7f6c685f8640 1 -- 172.21.15.88:0/2701772172 shutdown_connections 2023-12-08T08:23:37.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.550+0000 7f6c685f8640 1 --2- 172.21.15.88:0/2701772172 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6c440664a0 0x7f6c44068960 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:37.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.550+0000 7f6c685f8640 1 --2- 172.21.15.88:0/2701772172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c600c98f0 0x7f6c601436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:37.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.550+0000 7f6c685f8640 1 --2- 172.21.15.88:0/2701772172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c600c6030 0x7f6c6006c4f0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:37.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.550+0000 7f6c685f8640 1 --2- 172.21.15.88:0/2701772172 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6c600bf2d0 0x7f6c60145be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:37.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.550+0000 7f6c685f8640 1 -- 172.21.15.88:0/2701772172 >> 172.21.15.88:0/2701772172 conn(0x7f6c600c9dc0 msgr2=0x7f6c60156500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:37.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.550+0000 7f6c685f8640 1 -- 172.21.15.88:0/2701772172 shutdown_connections 2023-12-08T08:23:37.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.550+0000 7f6c685f8640 1 -- 172.21.15.88:0/2701772172 wait complete. 2023-12-08T08:23:37.574 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:23:37.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.710+0000 7f3abf29f640 1 Processor -- start 2023-12-08T08:23:37.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.710+0000 7f3abf29f640 1 -- start start 2023-12-08T08:23:37.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.710+0000 7f3abf29f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3ab81519f0 0x7f3ab80ca310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:37.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.710+0000 7f3abf29f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab80c85d0 con 0x7f3ab81585f0 2023-12-08T08:23:37.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.710+0000 7f3abf29f640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab8158160 con 0x7f3ab80c7b00 2023-12-08T08:23:37.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.710+0000 7f3abf29f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab80c5310 con 0x7f3ab81519f0 2023-12-08T08:23:37.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.710+0000 7f3abe29d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3ab81519f0 0x7f3ab80ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:37.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.710+0000 7f3abea9e640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3ab81585f0 0x7f3ab815ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:32894/0 (socket says 172.21.15.88:32894) 2023-12-08T08:23:37.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.710+0000 7f3abea9e640 1 -- 172.21.15.88:0/3963298020 learned_addr learned my addr 172.21.15.88:0/3963298020 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:37.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.710+0000 7f3abe29d640 1 -- 172.21.15.88:0/3963298020 >> v1:172.21.15.148:6789/0 conn(0x7f3ab80c7b00 legacy=0x7f3ab8154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:37.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.710+0000 7f3abe29d640 1 -- 172.21.15.88:0/3963298020 >> v1:172.21.15.88:6789/0 conn(0x7f3ab81585f0 legacy=0x7f3ab815ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:37.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.710+0000 7f3abe29d640 1 -- 172.21.15.88:0/3963298020 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab8151dd0 con 0x7f3ab81519f0 2023-12-08T08:23:37.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.714+0000 7f3abe29d640 1 --2- 172.21.15.88:0/3963298020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ab81519f0 0x7f3ab80ca310 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f3ab40097c0 tx=0x7f3ab401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e664969015d3ef server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:37.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.714+0000 7f3abd29b640 1 -- 172.21.15.88:0/3963298020 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab40a8050 con 0x7f3ab81519f0 2023-12-08T08:23:37.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.714+0000 7f3abd29b640 1 -- 172.21.15.88:0/3963298020 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab40ac5f0 con 0x7f3ab81519f0 2023-12-08T08:23:37.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.714+0000 7f3abd29b640 1 -- 172.21.15.88:0/3963298020 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab40ac980 con 0x7f3ab81519f0 2023-12-08T08:23:37.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.714+0000 7f3abf29f640 1 -- 172.21.15.88:0/3963298020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ab81519f0 msgr2=0x7f3ab80ca310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:37.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.714+0000 7f3abf29f640 1 --2- 172.21.15.88:0/3963298020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ab81519f0 0x7f3ab80ca310 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f3ab40097c0 tx=0x7f3ab401c390 comp rx=0 tx=0).stop 2023-12-08T08:23:37.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.714+0000 7f3abf29f640 1 -- 172.21.15.88:0/3963298020 shutdown_connections 2023-12-08T08:23:37.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.714+0000 7f3abf29f640 1 --2- 172.21.15.88:0/3963298020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ab81519f0 0x7f3ab80ca310 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:37.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.714+0000 7f3abf29f640 1 -- 172.21.15.88:0/3963298020 >> 172.21.15.88:0/3963298020 conn(0x7f3ab80abd90 msgr2=0x7f3ab80c9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:37.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.714+0000 7f3abf29f640 1 -- 172.21.15.88:0/3963298020 shutdown_connections 2023-12-08T08:23:37.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.714+0000 7f3abf29f640 1 -- 172.21.15.88:0/3963298020 wait complete. 2023-12-08T08:23:37.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.718+0000 7f3abf29f640 1 Processor -- start 2023-12-08T08:23:37.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.718+0000 7f3abf29f640 1 -- start start 2023-12-08T08:23:37.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.718+0000 7f3abf29f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ab80c7b00 0x7f3ab8148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:37.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.718+0000 7f3abf29f640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ab81519f0 0x7f3ab8149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:37.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.718+0000 7f3abf29f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ab81585f0 0x7f3ab80c0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:37.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.718+0000 7f3abf29f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab80ac9f0 con 0x7f3ab81585f0 2023-12-08T08:23:37.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.718+0000 7f3abf29f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab80c0580 con 0x7f3ab80c7b00 2023-12-08T08:23:37.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.718+0000 7f3abf29f640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab80c0860 con 0x7f3ab81519f0 2023-12-08T08:23:37.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.718+0000 7f3abea9e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ab81585f0 0x7f3ab80c0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:37.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.718+0000 7f3abea9e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ab81585f0 0x7f3ab80c0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54766/0 (socket says 172.21.15.88:54766) 2023-12-08T08:23:37.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.718+0000 7f3abea9e640 1 -- 172.21.15.88:0/49300668 learned_addr learned my addr 172.21.15.88:0/49300668 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:37.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.718+0000 7f3abea9e640 1 -- 172.21.15.88:0/49300668 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ab81519f0 msgr2=0x7f3ab8149d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:37.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.718+0000 7f3abea9e640 1 --2- 172.21.15.88:0/49300668 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ab81519f0 0x7f3ab8149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:37.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.718+0000 7f3abea9e640 1 -- 172.21.15.88:0/49300668 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ab80c7b00 msgr2=0x7f3ab8148280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:37.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.718+0000 7f3abea9e640 1 --2- 172.21.15.88:0/49300668 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ab80c7b00 0x7f3ab8148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:37.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.718+0000 7f3abea9e640 1 -- 172.21.15.88:0/49300668 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab4009420 con 0x7f3ab81585f0 2023-12-08T08:23:37.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.718+0000 7f3abea9e640 1 --2- 172.21.15.88:0/49300668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ab81585f0 0x7f3ab80c0df0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f3ab000ca80 tx=0x7f3ab000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:37.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.718+0000 7f3aaeffd640 1 -- 172.21.15.88:0/49300668 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab000ac30 con 0x7f3ab81585f0 2023-12-08T08:23:37.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.718+0000 7f3aaeffd640 1 -- 172.21.15.88:0/49300668 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab000ad90 con 0x7f3ab81585f0 2023-12-08T08:23:37.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.718+0000 7f3abf29f640 1 -- 172.21.15.88:0/49300668 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab80aec30 con 0x7f3ab81585f0 2023-12-08T08:23:37.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.718+0000 7f3aaeffd640 1 -- 172.21.15.88:0/49300668 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0012600 con 0x7f3ab81585f0 2023-12-08T08:23:37.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.718+0000 7f3abf29f640 1 -- 172.21.15.88:0/49300668 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab80ae920 con 0x7f3ab81585f0 2023-12-08T08:23:37.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.722+0000 7f3abf29f640 1 -- 172.21.15.88:0/49300668 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab8072960 con 0x7f3ab81585f0 2023-12-08T08:23:37.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.722+0000 7f3aaeffd640 1 -- 172.21.15.88:0/49300668 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3ab0007070 con 0x7f3ab81585f0 2023-12-08T08:23:37.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.722+0000 7f3aaeffd640 1 --2- 172.21.15.88:0/49300668 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3a9c066470 0x7f3a9c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:37.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.722+0000 7f3aaeffd640 1 -- 172.21.15.88:0/49300668 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3ab0083e70 con 0x7f3ab81585f0 2023-12-08T08:23:37.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.722+0000 7f3abe29d640 1 --2- 172.21.15.88:0/49300668 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3a9c066470 0x7f3a9c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:37.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.722+0000 7f3abe29d640 1 --2- 172.21.15.88:0/49300668 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3a9c066470 0x7f3a9c068930 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3ab40ae000 tx=0x7f3ab4004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:37.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.726+0000 7f3aaeffd640 1 -- 172.21.15.88:0/49300668 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3ab0050fa0 con 0x7f3ab81585f0 2023-12-08T08:23:37.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.878+0000 7f3abf29f640 1 -- 172.21.15.88:0/49300668 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f3ab8067bc0 con 0x7f3ab81585f0 2023-12-08T08:23:37.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.882+0000 7f3aaeffd640 1 -- 172.21.15.88:0/49300668 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v72) v1 ==== 101+0+11 (secure 0 0 0) 0x7f3ab0017020 con 0x7f3ab81585f0 2023-12-08T08:23:37.885 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:23:37.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.882+0000 7f3abf29f640 1 -- 172.21.15.88:0/49300668 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3a9c066470 msgr2=0x7f3a9c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:37.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.882+0000 7f3abf29f640 1 --2- 172.21.15.88:0/49300668 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3a9c066470 0x7f3a9c068930 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3ab40ae000 tx=0x7f3ab4004740 comp rx=0 tx=0).stop 2023-12-08T08:23:37.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.882+0000 7f3abf29f640 1 -- 172.21.15.88:0/49300668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ab81585f0 msgr2=0x7f3ab80c0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:37.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.882+0000 7f3abf29f640 1 --2- 172.21.15.88:0/49300668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ab81585f0 0x7f3ab80c0df0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f3ab000ca80 tx=0x7f3ab000cf40 comp rx=0 tx=0).stop 2023-12-08T08:23:37.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.882+0000 7f3abf29f640 1 -- 172.21.15.88:0/49300668 shutdown_connections 2023-12-08T08:23:37.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.882+0000 7f3abf29f640 1 --2- 172.21.15.88:0/49300668 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3a9c066470 0x7f3a9c068930 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:37.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.882+0000 7f3abf29f640 1 --2- 172.21.15.88:0/49300668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ab81585f0 0x7f3ab80c0df0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:37.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.882+0000 7f3abf29f640 1 --2- 172.21.15.88:0/49300668 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ab81519f0 0x7f3ab8149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:37.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.882+0000 7f3abf29f640 1 --2- 172.21.15.88:0/49300668 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ab80c7b00 0x7f3ab8148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:37.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.882+0000 7f3abf29f640 1 -- 172.21.15.88:0/49300668 >> 172.21.15.88:0/49300668 conn(0x7f3ab80abd90 msgr2=0x7f3ab814e520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:37.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.882+0000 7f3abf29f640 1 -- 172.21.15.88:0/49300668 shutdown_connections 2023-12-08T08:23:37.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:37.882+0000 7f3abf29f640 1 -- 172.21.15.88:0/49300668 wait complete. 2023-12-08T08:23:37.906 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:23:38.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.038+0000 7fc90b2ea640 1 Processor -- start 2023-12-08T08:23:38.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.042+0000 7fc90b2ea640 1 -- start start 2023-12-08T08:23:38.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.042+0000 7fc90b2ea640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9040c0c80 0x7fc9040c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:38.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.042+0000 7fc90b2ea640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9040a93d0 con 0x7fc904154390 2023-12-08T08:23:38.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.042+0000 7fc90b2ea640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9040a9640 con 0x7fc9040c2110 2023-12-08T08:23:38.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.042+0000 7fc90b2ea640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9040aa1c0 con 0x7fc9040c0c80 2023-12-08T08:23:38.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.042+0000 7fc909086640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc904154390 0x7fc9040c4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:32904/0 (socket says 172.21.15.88:32904) 2023-12-08T08:23:38.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.042+0000 7fc909086640 1 -- 172.21.15.88:0/3688790297 learned_addr learned my addr 172.21.15.88:0/3688790297 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:38.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.042+0000 7fc909887640 1 --2- 172.21.15.88:0/3688790297 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9040c0c80 0x7fc9040c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:38.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.042+0000 7fc8fbfff640 1 -- 172.21.15.88:0/3688790297 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 123017787 0 0) 0x7fc9040a93d0 con 0x7fc904154390 2023-12-08T08:23:38.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.042+0000 7fc8fbfff640 1 -- 172.21.15.88:0/3688790297 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8f0003530 con 0x7fc904154390 2023-12-08T08:23:38.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.042+0000 7fc8fbfff640 1 -- 172.21.15.88:0/3688790297 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3526015459 0 0) 0x7fc9040a9640 con 0x7fc9040c2110 2023-12-08T08:23:38.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.042+0000 7fc8fbfff640 1 -- 172.21.15.88:0/3688790297 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9040a93d0 con 0x7fc9040c2110 2023-12-08T08:23:38.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.042+0000 7fc909887640 1 -- 172.21.15.88:0/3688790297 >> v1:172.21.15.148:6789/0 conn(0x7fc9040c2110 legacy=0x7fc9040c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:38.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.042+0000 7fc909887640 1 -- 172.21.15.88:0/3688790297 >> v1:172.21.15.88:6789/0 conn(0x7fc904154390 legacy=0x7fc9040c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:38.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.042+0000 7fc909887640 1 -- 172.21.15.88:0/3688790297 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9040a9920 con 0x7fc9040c0c80 2023-12-08T08:23:38.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.046+0000 7fc909887640 1 --2- 172.21.15.88:0/3688790297 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9040c0c80 0x7fc9040c63b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc009dc0 tx=0x7fc8fc01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f14ec94a91cb18b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:38.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.046+0000 7fc8fbfff640 1 -- 172.21.15.88:0/3688790297 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc0a5940 con 0x7fc9040c0c80 2023-12-08T08:23:38.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.046+0000 7fc8fbfff640 1 -- 172.21.15.88:0/3688790297 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8fc0a5aa0 con 0x7fc9040c0c80 2023-12-08T08:23:38.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.046+0000 7fc8fbfff640 1 -- 172.21.15.88:0/3688790297 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc0a5e30 con 0x7fc9040c0c80 2023-12-08T08:23:38.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.046+0000 7fc90b2ea640 1 -- 172.21.15.88:0/3688790297 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9040c0c80 msgr2=0x7fc9040c63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:38.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.046+0000 7fc90b2ea640 1 --2- 172.21.15.88:0/3688790297 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9040c0c80 0x7fc9040c63b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc009dc0 tx=0x7fc8fc01c970 comp rx=0 tx=0).stop 2023-12-08T08:23:38.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.046+0000 7fc90b2ea640 1 -- 172.21.15.88:0/3688790297 shutdown_connections 2023-12-08T08:23:38.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.046+0000 7fc90b2ea640 1 --2- 172.21.15.88:0/3688790297 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9040c0c80 0x7fc9040c63b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:38.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.046+0000 7fc90b2ea640 1 -- 172.21.15.88:0/3688790297 >> 172.21.15.88:0/3688790297 conn(0x7fc90406b220 msgr2=0x7fc9040a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:38.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.046+0000 7fc90b2ea640 1 -- 172.21.15.88:0/3688790297 shutdown_connections 2023-12-08T08:23:38.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.046+0000 7fc90b2ea640 1 -- 172.21.15.88:0/3688790297 wait complete. 2023-12-08T08:23:38.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.046+0000 7fc90b2ea640 1 Processor -- start 2023-12-08T08:23:38.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.046+0000 7fc90b2ea640 1 -- start start 2023-12-08T08:23:38.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.050+0000 7fc90b2ea640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9040c0c80 0x7fc9040bf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:38.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.050+0000 7fc90b2ea640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9040c2110 0x7fc90414cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:38.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.050+0000 7fc90b2ea640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc904154390 0x7fc90414d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:38.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.050+0000 7fc90b2ea640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc904146970 con 0x7fc9040c0c80 2023-12-08T08:23:38.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.050+0000 7fc90b2ea640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9040a7800 con 0x7fc904154390 2023-12-08T08:23:38.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.050+0000 7fc90b2ea640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9040bf9b0 con 0x7fc9040c2110 2023-12-08T08:23:38.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.050+0000 7fc909086640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9040c0c80 0x7fc9040bf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:38.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.050+0000 7fc909086640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9040c0c80 0x7fc9040bf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54772/0 (socket says 172.21.15.88:54772) 2023-12-08T08:23:38.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.050+0000 7fc909086640 1 -- 172.21.15.88:0/1685586027 learned_addr learned my addr 172.21.15.88:0/1685586027 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:38.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.050+0000 7fc908885640 1 --2- 172.21.15.88:0/1685586027 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9040c2110 0x7fc90414cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:38.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.050+0000 7fc909887640 1 --2- 172.21.15.88:0/1685586027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc904154390 0x7fc90414d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:38.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.050+0000 7fc909086640 1 -- 172.21.15.88:0/1685586027 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9040c2110 msgr2=0x7fc90414cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:38.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.050+0000 7fc909086640 1 --2- 172.21.15.88:0/1685586027 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9040c2110 0x7fc90414cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:38.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.050+0000 7fc909086640 1 -- 172.21.15.88:0/1685586027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc904154390 msgr2=0x7fc90414d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:38.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.050+0000 7fc909086640 1 --2- 172.21.15.88:0/1685586027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc904154390 0x7fc90414d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:38.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.050+0000 7fc909086640 1 -- 172.21.15.88:0/1685586027 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8fc009a70 con 0x7fc9040c0c80 2023-12-08T08:23:38.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.050+0000 7fc909086640 1 --2- 172.21.15.88:0/1685586027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9040c0c80 0x7fc9040bf0c0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fc90000c500 tx=0x7fc90000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:38.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.050+0000 7fc8f9ffb640 1 -- 172.21.15.88:0/1685586027 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc900005cf0 con 0x7fc9040c0c80 2023-12-08T08:23:38.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.050+0000 7fc8f9ffb640 1 -- 172.21.15.88:0/1685586027 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc900005e50 con 0x7fc9040c0c80 2023-12-08T08:23:38.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.050+0000 7fc8f9ffb640 1 -- 172.21.15.88:0/1685586027 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc900007330 con 0x7fc9040c0c80 2023-12-08T08:23:38.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.050+0000 7fc90b2ea640 1 -- 172.21.15.88:0/1685586027 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9040a6ae0 con 0x7fc9040c0c80 2023-12-08T08:23:38.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.050+0000 7fc90b2ea640 1 -- 172.21.15.88:0/1685586027 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9040a7240 con 0x7fc9040c0c80 2023-12-08T08:23:38.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.050+0000 7fc90b2ea640 1 -- 172.21.15.88:0/1685586027 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc904067630 con 0x7fc9040c0c80 2023-12-08T08:23:38.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.054+0000 7fc8f9ffb640 1 -- 172.21.15.88:0/1685586027 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc900007490 con 0x7fc9040c0c80 2023-12-08T08:23:38.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.054+0000 7fc8f9ffb640 1 --2- 172.21.15.88:0/1685586027 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc8e80664a0 0x7fc8e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:38.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.054+0000 7fc8f9ffb640 1 -- 172.21.15.88:0/1685586027 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc9000836d0 con 0x7fc9040c0c80 2023-12-08T08:23:38.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.054+0000 7fc908885640 1 --2- 172.21.15.88:0/1685586027 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc8e80664a0 0x7fc8e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:38.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.054+0000 7fc908885640 1 --2- 172.21.15.88:0/1685586027 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc8e80664a0 0x7fc8e8068960 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc9040c5690 tx=0x7fc8f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:38.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.058+0000 7fc8f9ffb640 1 -- 172.21.15.88:0/1685586027 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc900050930 con 0x7fc9040c0c80 2023-12-08T08:23:38.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.214+0000 7fc90b2ea640 1 -- 172.21.15.88:0/1685586027 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc904067fc0 con 0x7fc9040c0c80 2023-12-08T08:23:38.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.218+0000 7fc8f9ffb640 1 -- 172.21.15.88:0/1685586027 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc900053f50 con 0x7fc9040c0c80 2023-12-08T08:23:38.221 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-12-08T08:23:38.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.218+0000 7fc90b2ea640 1 -- 172.21.15.88:0/1685586027 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc8e80664a0 msgr2=0x7fc8e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:38.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.218+0000 7fc90b2ea640 1 --2- 172.21.15.88:0/1685586027 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc8e80664a0 0x7fc8e8068960 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc9040c5690 tx=0x7fc8f4009040 comp rx=0 tx=0).stop 2023-12-08T08:23:38.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.218+0000 7fc90b2ea640 1 -- 172.21.15.88:0/1685586027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9040c0c80 msgr2=0x7fc9040bf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:38.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.218+0000 7fc90b2ea640 1 --2- 172.21.15.88:0/1685586027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9040c0c80 0x7fc9040bf0c0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fc90000c500 tx=0x7fc90000c9c0 comp rx=0 tx=0).stop 2023-12-08T08:23:38.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.218+0000 7fc90b2ea640 1 -- 172.21.15.88:0/1685586027 shutdown_connections 2023-12-08T08:23:38.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.218+0000 7fc90b2ea640 1 --2- 172.21.15.88:0/1685586027 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc8e80664a0 0x7fc8e8068960 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:38.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.218+0000 7fc90b2ea640 1 --2- 172.21.15.88:0/1685586027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc904154390 0x7fc90414d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:38.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.218+0000 7fc90b2ea640 1 --2- 172.21.15.88:0/1685586027 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9040c2110 0x7fc90414cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:38.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.218+0000 7fc90b2ea640 1 --2- 172.21.15.88:0/1685586027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9040c0c80 0x7fc9040bf0c0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:38.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.218+0000 7fc90b2ea640 1 -- 172.21.15.88:0/1685586027 >> 172.21.15.88:0/1685586027 conn(0x7fc90406b220 msgr2=0x7fc9040c4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:38.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.218+0000 7fc90b2ea640 1 -- 172.21.15.88:0/1685586027 shutdown_connections 2023-12-08T08:23:38.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.218+0000 7fc90b2ea640 1 -- 172.21.15.88:0/1685586027 wait complete. 2023-12-08T08:23:38.242 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-08T08:23:38.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:38.243 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-08T08:23:38.311 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-12-08T08:23:38.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:38.311 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-08T08:23:38.327 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:23:38.327 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:23:38.378 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354676k,nr_inodes=4088669,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9389 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-08T08:23:38.379 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:23:38.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.510+0000 7f9ec259d640 1 Processor -- start 2023-12-08T08:23:38.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.510+0000 7f9ec259d640 1 -- start start 2023-12-08T08:23:38.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.514+0000 7f9ec259d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ebc0c3b80 0x7f9ebc06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:38.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.514+0000 7f9ec259d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9ebc0c5300 0x7f9ebc06c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:38.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.514+0000 7f9ec259d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ebc06bb80 con 0x7f9ebc06d2b0 2023-12-08T08:23:38.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.514+0000 7f9ec259d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ebc06cc70 con 0x7f9ebc0c5300 2023-12-08T08:23:38.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.514+0000 7f9ec259d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc0c5790 con 0x7f9ebc0c3b80 2023-12-08T08:23:38.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.514+0000 7f9ebbfff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9ebc06d2b0 0x7f9ebc06c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:32920/0 (socket says 172.21.15.88:32920) 2023-12-08T08:23:38.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.514+0000 7f9ebbfff640 1 -- 172.21.15.88:0/144513741 learned_addr learned my addr 172.21.15.88:0/144513741 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:38.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.514+0000 7f9ec0b3a640 1 --2- 172.21.15.88:0/144513741 >> v2:172.21.15.88:3300/0 conn(0x7f9ebc0c5300 0x7f9ebc06c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:38.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.514+0000 7f9ebb7fe640 1 --2- 172.21.15.88:0/144513741 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ebc0c3b80 0x7f9ebc06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:38.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.514+0000 7f9ebaffd640 1 -- 172.21.15.88:0/144513741 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129750474 0 0) 0x7f9ebc06bb80 con 0x7f9ebc06d2b0 2023-12-08T08:23:38.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.514+0000 7f9ec0b3a640 1 -- 172.21.15.88:0/144513741 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ebc0c3b80 msgr2=0x7f9ebc06d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:38.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.514+0000 7f9ec0b3a640 1 --2- 172.21.15.88:0/144513741 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ebc0c3b80 0x7f9ebc06d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:38.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.514+0000 7f9ec0b3a640 1 -- 172.21.15.88:0/144513741 >> v1:172.21.15.88:6789/0 conn(0x7f9ebc06d2b0 legacy=0x7f9ebc06c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:38.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.514+0000 7f9ec0b3a640 1 -- 172.21.15.88:0/144513741 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ebc1515c0 con 0x7f9ebc0c5300 2023-12-08T08:23:38.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.518+0000 7f9ec0b3a640 1 --2- 172.21.15.88:0/144513741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ebc0c5300 0x7f9ebc06c730 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4009d90 tx=0x7f9eb401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9862337b4cbd7c0d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:38.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.518+0000 7f9ebaffd640 1 -- 172.21.15.88:0/144513741 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb40a58f0 con 0x7f9ebc0c5300 2023-12-08T08:23:38.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.518+0000 7f9ebaffd640 1 -- 172.21.15.88:0/144513741 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb40a5a50 con 0x7f9ebc0c5300 2023-12-08T08:23:38.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.518+0000 7f9ebaffd640 1 -- 172.21.15.88:0/144513741 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb40a5de0 con 0x7f9ebc0c5300 2023-12-08T08:23:38.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.518+0000 7f9ec259d640 1 -- 172.21.15.88:0/144513741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ebc0c5300 msgr2=0x7f9ebc06c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:38.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.518+0000 7f9ec259d640 1 --2- 172.21.15.88:0/144513741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ebc0c5300 0x7f9ebc06c730 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4009d90 tx=0x7f9eb401c920 comp rx=0 tx=0).stop 2023-12-08T08:23:38.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.518+0000 7f9ec259d640 1 -- 172.21.15.88:0/144513741 shutdown_connections 2023-12-08T08:23:38.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.518+0000 7f9ec259d640 1 --2- 172.21.15.88:0/144513741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ebc0c5300 0x7f9ebc06c730 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:38.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.518+0000 7f9ec259d640 1 --2- 172.21.15.88:0/144513741 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ebc0c3b80 0x7f9ebc06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:38.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.518+0000 7f9ec259d640 1 -- 172.21.15.88:0/144513741 >> 172.21.15.88:0/144513741 conn(0x7f9ebc0a7810 msgr2=0x7f9ebc0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:38.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.518+0000 7f9ec259d640 1 -- 172.21.15.88:0/144513741 shutdown_connections 2023-12-08T08:23:38.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.518+0000 7f9ec259d640 1 -- 172.21.15.88:0/144513741 wait complete. 2023-12-08T08:23:38.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.518+0000 7f9ec259d640 1 Processor -- start 2023-12-08T08:23:38.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.518+0000 7f9ec259d640 1 -- start start 2023-12-08T08:23:38.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.518+0000 7f9ec259d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ebc06d2b0 0x7f9ebc0c2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:38.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.518+0000 7f9ec259d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ebc0c3b80 0x7f9ebc0a9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:38.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.518+0000 7f9ec259d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ebc0c5300 0x7f9ebc0ab0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:38.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.518+0000 7f9ec259d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc0aa9c0 con 0x7f9ebc0c3b80 2023-12-08T08:23:38.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.518+0000 7f9ec259d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc0c2c30 con 0x7f9ebc06d2b0 2023-12-08T08:23:38.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.518+0000 7f9ec259d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc15bb30 con 0x7f9ebc0c5300 2023-12-08T08:23:38.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.518+0000 7f9ebb7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ebc0c3b80 0x7f9ebc0a9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:38.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.518+0000 7f9ebb7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ebc0c3b80 0x7f9ebc0a9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54782/0 (socket says 172.21.15.88:54782) 2023-12-08T08:23:38.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.518+0000 7f9ebb7fe640 1 -- 172.21.15.88:0/3210774238 learned_addr learned my addr 172.21.15.88:0/3210774238 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:38.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.522+0000 7f9ec0b3a640 1 --2- 172.21.15.88:0/3210774238 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ebc0c5300 0x7f9ebc0ab0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:38.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.522+0000 7f9ebbfff640 1 --2- 172.21.15.88:0/3210774238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ebc06d2b0 0x7f9ebc0c2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:38.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.522+0000 7f9ebb7fe640 1 -- 172.21.15.88:0/3210774238 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ebc0c5300 msgr2=0x7f9ebc0ab0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:38.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.522+0000 7f9ebb7fe640 1 --2- 172.21.15.88:0/3210774238 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ebc0c5300 0x7f9ebc0ab0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:38.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.522+0000 7f9ebb7fe640 1 -- 172.21.15.88:0/3210774238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ebc06d2b0 msgr2=0x7f9ebc0c2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:38.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.522+0000 7f9ebb7fe640 1 --2- 172.21.15.88:0/3210774238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ebc06d2b0 0x7f9ebc0c2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:38.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.522+0000 7f9ebb7fe640 1 -- 172.21.15.88:0/3210774238 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb4009a70 con 0x7f9ebc0c3b80 2023-12-08T08:23:38.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.522+0000 7f9ebbfff640 1 --2- 172.21.15.88:0/3210774238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ebc06d2b0 0x7f9ebc0c2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:38.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.522+0000 7f9ebb7fe640 1 --2- 172.21.15.88:0/3210774238 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ebc0c3b80 0x7f9ebc0a9220 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000d800 tx=0x7f9eb000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:38.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.522+0000 7f9eb8ff9640 1 -- 172.21.15.88:0/3210774238 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb000b6c0 con 0x7f9ebc0c3b80 2023-12-08T08:23:38.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.522+0000 7f9eb8ff9640 1 -- 172.21.15.88:0/3210774238 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb000b820 con 0x7f9ebc0c3b80 2023-12-08T08:23:38.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.522+0000 7f9ec259d640 1 -- 172.21.15.88:0/3210774238 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ebc14ef80 con 0x7f9ebc0c3b80 2023-12-08T08:23:38.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.522+0000 7f9eb8ff9640 1 -- 172.21.15.88:0/3210774238 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb000bb90 con 0x7f9ebc0c3b80 2023-12-08T08:23:38.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.522+0000 7f9ec259d640 1 -- 172.21.15.88:0/3210774238 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ebc15b4e0 con 0x7f9ebc0c3b80 2023-12-08T08:23:38.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.522+0000 7f9ec259d640 1 -- 172.21.15.88:0/3210774238 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ebc067630 con 0x7f9ebc0c3b80 2023-12-08T08:23:38.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.522+0000 7f9eb8ff9640 1 -- 172.21.15.88:0/3210774238 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9eb000bcf0 con 0x7f9ebc0c3b80 2023-12-08T08:23:38.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.522+0000 7f9eb8ff9640 1 --2- 172.21.15.88:0/3210774238 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9ea80664a0 0x7f9ea8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:38.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.522+0000 7f9eb8ff9640 1 -- 172.21.15.88:0/3210774238 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9eb0084670 con 0x7f9ebc0c3b80 2023-12-08T08:23:38.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.526+0000 7f9ebbfff640 1 --2- 172.21.15.88:0/3210774238 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9ea80664a0 0x7f9ea8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:38.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.526+0000 7f9ebbfff640 1 --2- 172.21.15.88:0/3210774238 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9ea80664a0 0x7f9ea8068960 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9eac007fd0 tx=0x7f9eac007c20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:38.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.526+0000 7f9eb8ff9640 1 -- 172.21.15.88:0/3210774238 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9eb0051780 con 0x7f9ebc0c3b80 2023-12-08T08:23:38.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.714+0000 7f9ec259d640 1 -- 172.21.15.88:0/3210774238 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9ebc0aae00 con 0x7f9ebc0c3b80 2023-12-08T08:23:38.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.714+0000 7f9eb8ff9640 1 -- 172.21.15.88:0/3210774238 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) v1 ==== 53+0+149 (secure 0 0 0) 0x7f9eb0054da0 con 0x7f9ebc0c3b80 2023-12-08T08:23:38.719 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:23:38.720 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-08T08:23:38.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.718+0000 7f9ec259d640 1 -- 172.21.15.88:0/3210774238 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9ea80664a0 msgr2=0x7f9ea8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:38.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.718+0000 7f9ec259d640 1 --2- 172.21.15.88:0/3210774238 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9ea80664a0 0x7f9ea8068960 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9eac007fd0 tx=0x7f9eac007c20 comp rx=0 tx=0).stop 2023-12-08T08:23:38.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.718+0000 7f9ec259d640 1 -- 172.21.15.88:0/3210774238 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ebc0c3b80 msgr2=0x7f9ebc0a9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:38.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.718+0000 7f9ec259d640 1 --2- 172.21.15.88:0/3210774238 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ebc0c3b80 0x7f9ebc0a9220 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000d800 tx=0x7f9eb000dcc0 comp rx=0 tx=0).stop 2023-12-08T08:23:38.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.718+0000 7f9ec259d640 1 -- 172.21.15.88:0/3210774238 shutdown_connections 2023-12-08T08:23:38.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.718+0000 7f9ec259d640 1 --2- 172.21.15.88:0/3210774238 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9ea80664a0 0x7f9ea8068960 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:38.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.718+0000 7f9ec259d640 1 --2- 172.21.15.88:0/3210774238 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9ebc0c5300 0x7f9ebc0ab0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:38.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.718+0000 7f9ec259d640 1 --2- 172.21.15.88:0/3210774238 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ebc0c3b80 0x7f9ebc0a9220 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:38.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.718+0000 7f9ec259d640 1 --2- 172.21.15.88:0/3210774238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ebc06d2b0 0x7f9ebc0c2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:38.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.718+0000 7f9ec259d640 1 -- 172.21.15.88:0/3210774238 >> 172.21.15.88:0/3210774238 conn(0x7f9ebc0a7810 msgr2=0x7f9ebc14dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:38.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.718+0000 7f9ec259d640 1 -- 172.21.15.88:0/3210774238 shutdown_connections 2023-12-08T08:23:38.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:38.718+0000 7f9ec259d640 1 -- 172.21.15.88:0/3210774238 wait complete. 2023-12-08T08:23:38.740 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-08T08:23:38.740 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:23:38.740 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-12-08T08:23:38.740 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-08T08:23:38.740 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-08T08:23:38.740 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-08T08:23:38.740 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-08T08:23:38.741 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.cpbnJ4wSYl 2023-12-08T08:23:38.741 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2023-12-08T08:23:38.750 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.ofQxEu4m2h 2023-12-08T08:23:38.750 DEBUG:teuthology.orchestra.run.smithi148:> sudo cp /tmp/tmp.cpbnJ4wSYl /tmp/tmp.ofQxEu4m2h 2023-12-08T08:23:38.815 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.ofQxEu4m2h 2023-12-08T08:23:38.935 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.ofQxEu4m2h is 226B 2023-12-08T08:23:38.950 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.ofQxEu4m2h 2023-12-08T08:23:38.958 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQCD0nJlpwWiExAAMbkPnLBFpAMwBuADIemLSA== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-08T08:23:38.958 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:23:38.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:38.959 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-12-08T08:23:39.015 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:23:39.015 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:23:39.015 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:23:39.015 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:39.015 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-12-08T08:23:39.015 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:39.015 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:23:39.016 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:39.016 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-12-08T08:23:39.016 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:23:39.016 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:39.016 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-12-08T08:23:39.016 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-08T08:23:39.016 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:39.016 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:23:39.016 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:39.016 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-08T08:23:39.016 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42220sec preferred_lft 42220sec 2023-12-08T08:23:39.016 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-12-08T08:23:39.016 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:39.016 INFO:teuthology.orchestra.run.smithi148.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-08T08:23:39.017 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 02:42:93:b7:1f:fa brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:39.017 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-08T08:23:39.017 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:39.017 INFO:teuthology.orchestra.run.smithi148.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:23:39.017 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-08T08:23:39.017 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:23:39.017 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:39.017 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-08T08:23:39.017 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:39.017 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:23:39.018 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:23:39.018 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-08T08:23:39.018 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:23:39.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:39.018 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:23:39.080 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-12-08T08:23:39.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:39.083 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-12-08T08:23:39.136 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-12-08T08:23:39.136 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:23:39.136 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-08T08:23:39.136 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-08T08:23:39.136 INFO:teuthology.orchestra.run.smithi148.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-08T08:23:39.136 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-08T08:23:39.137 INFO:teuthology.orchestra.run.smithi148.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:23:39.137 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:23:39.137 INFO:teuthology.orchestra.run.smithi148.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-08T08:23:39.137 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:23:39.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:39.137 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-12-08T08:23:39.137 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-12-08T08:23:39.137 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-08T08:23:39.138 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-08T08:23:39.138 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-08T08:23:39.138 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-12-08T08:23:39.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:39.232 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-12-08T08:23:39.241 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-08T08:23:39.242 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:23:39.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:39.242 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-12-08T08:23:39.310 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:23:39.310 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-08T08:23:39.362 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:23:39.362 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:23:39.363 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:23:39.414 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:23:39.414 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/tmp/tmp.cpbnJ4wSYl of=/dev/stdout 2023-12-08T08:23:39.470 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-12-08T08:23:39.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:39.471 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,secret=AQCD0nJlpwWiExAAMbkPnLBFpAMwBuADIemLSA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:23:39.569 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,secret=AQCD0nJlpwWiExAAMbkPnLBFpAMwBuADIemLSA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:23:39.569 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:23:39.569 INFO:teuthology.orchestra.run.smithi148.stdout:keyring.get_secret failed 2023-12-08T08:23:39.582 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,secret=AQCD0nJlpwWiExAAMbkPnLBFpAMwBuADIemLSA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:23:39.582 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:23:39.582 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.148:3300,172.21.15.148:3301" 2023-12-08T08:23:39.582 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with new device syntax: testuser@681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3.cephfs2=/ 2023-12-08T08:23:39.582 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.88:3300/172.21.15.148:3300/172.21.15.148:3301" will pass to kernel 2023-12-08T08:23:39.586 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T08:23:39.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:39.586 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:23:39.604 INFO:teuthology.orchestra.run.smithi148.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.1': Permission denied 2023-12-08T08:23:39.606 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:23:39.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:39.606 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:23:39.662 INFO:teuthology.orchestra.run.smithi148.stdout:client5996 2023-12-08T08:23:39.662 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:23:39.662 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:23:39.718 INFO:tasks.cephfs.caps_helper:test read perm: read file /home/ubuntu/cephtest/mnt.0/testdir/testfile and expect data "self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0" 2023-12-08T08:23:39.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:39.718 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile) 2023-12-08T08:23:39.729 INFO:teuthology.orchestra.run.smithi088.stderr:cat: /home/ubuntu/cephtest/mnt.0/testdir/testfile: Permission denied 2023-12-08T08:23:39.730 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:23:39.730 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:23:39.730 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:23:39.781 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:23:39.781 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:23:39.837 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:23:40.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.018+0000 7f1a64e79640 1 Processor -- start 2023-12-08T08:23:40.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.018+0000 7f1a64e79640 1 -- start start 2023-12-08T08:23:40.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.022+0000 7f1a64e79640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1a600c3b80 0x7f1a6006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:40.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.022+0000 7f1a64e79640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a600c5300 0x7f1a6006c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:40.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.022+0000 7f1a64e79640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a6006bb80 con 0x7f1a6006d2b0 2023-12-08T08:23:40.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.022+0000 7f1a64e79640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a6006cc70 con 0x7f1a600c3b80 2023-12-08T08:23:40.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.022+0000 7f1a64e79640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a600c5790 con 0x7f1a600c5300 2023-12-08T08:23:40.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.022+0000 7f1a5dd9b640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1a600c3b80 0x7f1a6006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:40.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.022+0000 7f1a5ed9d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a600c5300 0x7f1a6006c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:40.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.022+0000 7f1a5e59c640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f1a6006d2b0 0x7f1a6006c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:47610/0 (socket says 172.21.15.88:47610) 2023-12-08T08:23:40.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.022+0000 7f1a5e59c640 1 -- 172.21.15.88:0/2268099618 learned_addr learned my addr 172.21.15.88:0/2268099618 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:40.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.022+0000 7f1a5d59a640 1 -- 172.21.15.88:0/2268099618 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34323973 0 0) 0x7f1a6006bb80 con 0x7f1a6006d2b0 2023-12-08T08:23:40.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.022+0000 7f1a5d59a640 1 -- 172.21.15.88:0/2268099618 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a48005740 con 0x7f1a6006d2b0 2023-12-08T08:23:40.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.022+0000 7f1a5ed9d640 1 -- 172.21.15.88:0/2268099618 >> v2:172.21.15.148:3300/0 conn(0x7f1a600c3b80 msgr2=0x7f1a6006d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:40.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.022+0000 7f1a5ed9d640 1 --2- 172.21.15.88:0/2268099618 >> v2:172.21.15.148:3300/0 conn(0x7f1a600c3b80 0x7f1a6006d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.022+0000 7f1a5ed9d640 1 -- 172.21.15.88:0/2268099618 >> v1:172.21.15.148:6789/0 conn(0x7f1a6006d2b0 legacy=0x7f1a6006c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:40.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.022+0000 7f1a5ed9d640 1 -- 172.21.15.88:0/2268099618 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a601515c0 con 0x7f1a600c5300 2023-12-08T08:23:40.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.022+0000 7f1a5dd9b640 1 --2- 172.21.15.88:0/2268099618 >> v2:172.21.15.148:3300/0 conn(0x7f1a600c3b80 0x7f1a6006d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:23:40.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.026+0000 7f1a5ed9d640 1 --2- 172.21.15.88:0/2268099618 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a600c5300 0x7f1a6006c730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1a58009d90 tx=0x7f1a5801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af2e40214e326f11 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:40.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.026+0000 7f1a5d59a640 1 -- 172.21.15.88:0/2268099618 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a580a57f0 con 0x7f1a600c5300 2023-12-08T08:23:40.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.026+0000 7f1a5d59a640 1 -- 172.21.15.88:0/2268099618 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a580a5950 con 0x7f1a600c5300 2023-12-08T08:23:40.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.026+0000 7f1a5d59a640 1 -- 172.21.15.88:0/2268099618 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a580a5ce0 con 0x7f1a600c5300 2023-12-08T08:23:40.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.026+0000 7f1a64e79640 1 -- 172.21.15.88:0/2268099618 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a600c5300 msgr2=0x7f1a6006c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:40.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.026+0000 7f1a64e79640 1 --2- 172.21.15.88:0/2268099618 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a600c5300 0x7f1a6006c730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1a58009d90 tx=0x7f1a5801c920 comp rx=0 tx=0).stop 2023-12-08T08:23:40.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.026+0000 7f1a64e79640 1 -- 172.21.15.88:0/2268099618 shutdown_connections 2023-12-08T08:23:40.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.026+0000 7f1a64e79640 1 --2- 172.21.15.88:0/2268099618 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a600c5300 0x7f1a6006c730 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.026+0000 7f1a64e79640 1 --2- 172.21.15.88:0/2268099618 >> v2:172.21.15.148:3300/0 conn(0x7f1a600c3b80 0x7f1a6006d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.026+0000 7f1a64e79640 1 -- 172.21.15.88:0/2268099618 >> 172.21.15.88:0/2268099618 conn(0x7f1a600a7810 msgr2=0x7f1a600a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:40.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.026+0000 7f1a64e79640 1 -- 172.21.15.88:0/2268099618 shutdown_connections 2023-12-08T08:23:40.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.026+0000 7f1a64e79640 1 -- 172.21.15.88:0/2268099618 wait complete. 2023-12-08T08:23:40.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.026+0000 7f1a64e79640 1 Processor -- start 2023-12-08T08:23:40.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.026+0000 7f1a64e79640 1 -- start start 2023-12-08T08:23:40.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.030+0000 7f1a64e79640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a6006d2b0 0x7f1a601f0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:40.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.030+0000 7f1a64e79640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a600c3b80 0x7f1a60144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:40.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.030+0000 7f1a64e79640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a600c5300 0x7f1a600bee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:40.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.030+0000 7f1a64e79640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a601f1040 con 0x7f1a600c3b80 2023-12-08T08:23:40.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.030+0000 7f1a64e79640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a601ee500 con 0x7f1a6006d2b0 2023-12-08T08:23:40.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.030+0000 7f1a64e79640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a60144f50 con 0x7f1a600c5300 2023-12-08T08:23:40.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.030+0000 7f1a5dd9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a600c3b80 0x7f1a60144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:40.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.030+0000 7f1a5e59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a6006d2b0 0x7f1a601f0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:40.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.030+0000 7f1a5dd9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a600c3b80 0x7f1a60144a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54792/0 (socket says 172.21.15.88:54792) 2023-12-08T08:23:40.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.030+0000 7f1a5dd9b640 1 -- 172.21.15.88:0/2925958965 learned_addr learned my addr 172.21.15.88:0/2925958965 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:40.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.030+0000 7f1a5ed9d640 1 --2- 172.21.15.88:0/2925958965 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a600c5300 0x7f1a600bee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:40.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.030+0000 7f1a5e59c640 1 -- 172.21.15.88:0/2925958965 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a600c5300 msgr2=0x7f1a600bee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:40.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.030+0000 7f1a5e59c640 1 --2- 172.21.15.88:0/2925958965 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a600c5300 0x7f1a600bee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.030+0000 7f1a5e59c640 1 -- 172.21.15.88:0/2925958965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a600c3b80 msgr2=0x7f1a60144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:40.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.030+0000 7f1a5e59c640 1 --2- 172.21.15.88:0/2925958965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a600c3b80 0x7f1a60144a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.030+0000 7f1a5e59c640 1 -- 172.21.15.88:0/2925958965 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a54009420 con 0x7f1a6006d2b0 2023-12-08T08:23:40.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.030+0000 7f1a5dd9b640 1 --2- 172.21.15.88:0/2925958965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a600c3b80 0x7f1a60144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:23:40.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.030+0000 7f1a5e59c640 1 --2- 172.21.15.88:0/2925958965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a6006d2b0 0x7f1a601f0b00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1a5000c400 tx=0x7f1a5000c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:40.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.030+0000 7f1a4effd640 1 -- 172.21.15.88:0/2925958965 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a50005cf0 con 0x7f1a6006d2b0 2023-12-08T08:23:40.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.030+0000 7f1a4effd640 1 -- 172.21.15.88:0/2925958965 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a50005e50 con 0x7f1a6006d2b0 2023-12-08T08:23:40.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.030+0000 7f1a64e79640 1 -- 172.21.15.88:0/2925958965 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a58009a70 con 0x7f1a6006d2b0 2023-12-08T08:23:40.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.030+0000 7f1a4effd640 1 -- 172.21.15.88:0/2925958965 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a500072d0 con 0x7f1a6006d2b0 2023-12-08T08:23:40.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.030+0000 7f1a64e79640 1 -- 172.21.15.88:0/2925958965 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a6014ef80 con 0x7f1a6006d2b0 2023-12-08T08:23:40.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.030+0000 7f1a64e79640 1 -- 172.21.15.88:0/2925958965 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a60067630 con 0x7f1a6006d2b0 2023-12-08T08:23:40.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.034+0000 7f1a4effd640 1 -- 172.21.15.88:0/2925958965 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1a50007430 con 0x7f1a6006d2b0 2023-12-08T08:23:40.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.034+0000 7f1a4effd640 1 --2- 172.21.15.88:0/2925958965 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1a40066470 0x7f1a40068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:40.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.034+0000 7f1a4effd640 1 -- 172.21.15.88:0/2925958965 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1a500837a0 con 0x7f1a6006d2b0 2023-12-08T08:23:40.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.034+0000 7f1a5dd9b640 1 --2- 172.21.15.88:0/2925958965 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1a40066470 0x7f1a40068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:40.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.034+0000 7f1a5dd9b640 1 --2- 172.21.15.88:0/2925958965 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1a40066470 0x7f1a40068930 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009fd0 tx=0x7f1a54009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:40.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.038+0000 7f1a4effd640 1 -- 172.21.15.88:0/2925958965 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1a500508d0 con 0x7f1a6006d2b0 2023-12-08T08:23:40.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.190+0000 7f1a64e79640 1 -- 172.21.15.88:0/2925958965 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a600ab920 con 0x7f1a6006d2b0 2023-12-08T08:23:40.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.190+0000 7f1a4effd640 1 -- 172.21.15.88:0/2925958965 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20190 (secure 0 0 0) 0x7f1a50053ef0 con 0x7f1a6006d2b0 2023-12-08T08:23:40.195 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:40.195 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":72,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:23:18.903336+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:57.367467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:58.632605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:23:15.029129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:23:16.271716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:23:40.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.194+0000 7f1a64e79640 1 -- 172.21.15.88:0/2925958965 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1a40066470 msgr2=0x7f1a40068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:40.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.194+0000 7f1a64e79640 1 --2- 172.21.15.88:0/2925958965 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1a40066470 0x7f1a40068930 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009fd0 tx=0x7f1a54009190 comp rx=0 tx=0).stop 2023-12-08T08:23:40.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.194+0000 7f1a64e79640 1 -- 172.21.15.88:0/2925958965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a6006d2b0 msgr2=0x7f1a601f0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:40.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.194+0000 7f1a64e79640 1 --2- 172.21.15.88:0/2925958965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a6006d2b0 0x7f1a601f0b00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1a5000c400 tx=0x7f1a5000c8c0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.194+0000 7f1a64e79640 1 -- 172.21.15.88:0/2925958965 shutdown_connections 2023-12-08T08:23:40.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.194+0000 7f1a64e79640 1 --2- 172.21.15.88:0/2925958965 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1a40066470 0x7f1a40068930 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.194+0000 7f1a64e79640 1 --2- 172.21.15.88:0/2925958965 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1a600c5300 0x7f1a600bee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.194+0000 7f1a64e79640 1 --2- 172.21.15.88:0/2925958965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a600c3b80 0x7f1a60144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.194+0000 7f1a64e79640 1 --2- 172.21.15.88:0/2925958965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a6006d2b0 0x7f1a601f0b00 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.194+0000 7f1a64e79640 1 -- 172.21.15.88:0/2925958965 >> 172.21.15.88:0/2925958965 conn(0x7f1a600a7810 msgr2=0x7f1a600a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:40.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.194+0000 7f1a64e79640 1 -- 172.21.15.88:0/2925958965 shutdown_connections 2023-12-08T08:23:40.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.194+0000 7f1a64e79640 1 -- 172.21.15.88:0/2925958965 wait complete. 2023-12-08T08:23:40.216 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:22:57.367467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:22:58.632605+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:23:15.029129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:23:16.271716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:23:40.217 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:23:40.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.354+0000 7feaeefc1640 1 Processor -- start 2023-12-08T08:23:40.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.354+0000 7feaeefc1640 1 -- start start 2023-12-08T08:23:40.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.358+0000 7feaeefc1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feae814e2a0 0x7feae81516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:40.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.358+0000 7feaeefc1640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7feae80a98e0 0x7feae806bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:40.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.358+0000 7feaeefc1640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae8151210 con 0x7feae80a9460 2023-12-08T08:23:40.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.358+0000 7feaeefc1640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae814e680 con 0x7feae80a98e0 2023-12-08T08:23:40.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.358+0000 7feaeefc1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae8150be0 con 0x7feae814e2a0 2023-12-08T08:23:40.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.358+0000 7feadffff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7feae80a9460 0x7feae80c4180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41266/0 (socket says 172.21.15.88:41266) 2023-12-08T08:23:40.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.358+0000 7feadffff640 1 -- 172.21.15.88:0/3478302214 learned_addr learned my addr 172.21.15.88:0/3478302214 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:40.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.358+0000 7feaed55e640 1 --2- 172.21.15.88:0/3478302214 >> v2:172.21.15.148:3300/0 conn(0x7feae80a98e0 0x7feae806bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:40.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.358+0000 7feaecd5d640 1 --2- 172.21.15.88:0/3478302214 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feae814e2a0 0x7feae81516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:40.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.358+0000 7feadf7fe640 1 -- 172.21.15.88:0/3478302214 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2299298520 0 0) 0x7feae8151210 con 0x7feae80a9460 2023-12-08T08:23:40.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.358+0000 7feadf7fe640 1 -- 172.21.15.88:0/3478302214 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fead0003530 con 0x7feae80a9460 2023-12-08T08:23:40.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.358+0000 7feaed55e640 1 -- 172.21.15.88:0/3478302214 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feae814e2a0 msgr2=0x7feae81516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:40.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.358+0000 7feaed55e640 1 --2- 172.21.15.88:0/3478302214 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feae814e2a0 0x7feae81516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.358+0000 7feaed55e640 1 -- 172.21.15.88:0/3478302214 >> v1:172.21.15.88:6789/0 conn(0x7feae80a9460 legacy=0x7feae80c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:40.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.358+0000 7feaed55e640 1 -- 172.21.15.88:0/3478302214 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae80c53c0 con 0x7feae80a98e0 2023-12-08T08:23:40.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.358+0000 7feaecd5d640 1 --2- 172.21.15.88:0/3478302214 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feae814e2a0 0x7feae81516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:23:40.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.362+0000 7feaed55e640 1 --2- 172.21.15.88:0/3478302214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae80a98e0 0x7feae806bc80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7feae0009d90 tx=0x7feae001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab6aed63446504a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:40.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.362+0000 7feadf7fe640 1 -- 172.21.15.88:0/3478302214 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae00a6690 con 0x7feae80a98e0 2023-12-08T08:23:40.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.362+0000 7feadf7fe640 1 -- 172.21.15.88:0/3478302214 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae00a67f0 con 0x7feae80a98e0 2023-12-08T08:23:40.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.362+0000 7feadf7fe640 1 -- 172.21.15.88:0/3478302214 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae00a6b80 con 0x7feae80a98e0 2023-12-08T08:23:40.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.362+0000 7feaeefc1640 1 -- 172.21.15.88:0/3478302214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae80a98e0 msgr2=0x7feae806bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:40.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.362+0000 7feaeefc1640 1 --2- 172.21.15.88:0/3478302214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae80a98e0 0x7feae806bc80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7feae0009d90 tx=0x7feae001c950 comp rx=0 tx=0).stop 2023-12-08T08:23:40.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.362+0000 7feaeefc1640 1 -- 172.21.15.88:0/3478302214 shutdown_connections 2023-12-08T08:23:40.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.362+0000 7feaeefc1640 1 --2- 172.21.15.88:0/3478302214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae80a98e0 0x7feae806bc80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.362+0000 7feaeefc1640 1 --2- 172.21.15.88:0/3478302214 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feae814e2a0 0x7feae81516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.362+0000 7feaeefc1640 1 -- 172.21.15.88:0/3478302214 >> 172.21.15.88:0/3478302214 conn(0x7feae80c59f0 msgr2=0x7feae80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:40.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.362+0000 7feaeefc1640 1 -- 172.21.15.88:0/3478302214 shutdown_connections 2023-12-08T08:23:40.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.362+0000 7feaeefc1640 1 -- 172.21.15.88:0/3478302214 wait complete. 2023-12-08T08:23:40.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.362+0000 7feaeefc1640 1 Processor -- start 2023-12-08T08:23:40.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.362+0000 7feaeefc1640 1 -- start start 2023-12-08T08:23:40.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.366+0000 7feaeefc1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feae80a9460 0x7feae80c2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:40.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.366+0000 7feaeefc1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae80a98e0 0x7feae8159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.366+0000 7feaeefc1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feae814e2a0 0x7feae80c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.366+0000 7feaeefc1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae813fd70 con 0x7feae80a9460 2023-12-08T08:23:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.366+0000 7feaeefc1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae815ef30 con 0x7feae80a98e0 2023-12-08T08:23:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.366+0000 7feaeefc1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae815e320 con 0x7feae814e2a0 2023-12-08T08:23:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.366+0000 7feaecd5d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feae80a9460 0x7feae80c2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.366+0000 7feaecd5d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feae80a9460 0x7feae80c2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36644/0 (socket says 172.21.15.88:36644) 2023-12-08T08:23:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.366+0000 7feaecd5d640 1 -- 172.21.15.88:0/1791756091 learned_addr learned my addr 172.21.15.88:0/1791756091 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.366+0000 7feaed55e640 1 --2- 172.21.15.88:0/1791756091 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feae814e2a0 0x7feae80c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.366+0000 7feadffff640 1 --2- 172.21.15.88:0/1791756091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae80a98e0 0x7feae8159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.366+0000 7feaecd5d640 1 -- 172.21.15.88:0/1791756091 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feae814e2a0 msgr2=0x7feae80c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.366+0000 7feaecd5d640 1 --2- 172.21.15.88:0/1791756091 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feae814e2a0 0x7feae80c12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.366+0000 7feaecd5d640 1 -- 172.21.15.88:0/1791756091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae80a98e0 msgr2=0x7feae8159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.366+0000 7feaecd5d640 1 --2- 172.21.15.88:0/1791756091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae80a98e0 0x7feae8159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.366+0000 7feaecd5d640 1 -- 172.21.15.88:0/1791756091 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae4009420 con 0x7feae80a9460 2023-12-08T08:23:40.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.366+0000 7feaecd5d640 1 --2- 172.21.15.88:0/1791756091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feae80a9460 0x7feae80c2520 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7feae400e980 tx=0x7feae400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:40.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.366+0000 7feadd7fa640 1 -- 172.21.15.88:0/1791756091 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae400ca00 con 0x7feae80a9460 2023-12-08T08:23:40.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.366+0000 7feadd7fa640 1 -- 172.21.15.88:0/1791756091 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae400cb60 con 0x7feae80a9460 2023-12-08T08:23:40.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.366+0000 7feaeefc1640 1 -- 172.21.15.88:0/1791756091 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae0009a70 con 0x7feae80a9460 2023-12-08T08:23:40.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.366+0000 7feadd7fa640 1 -- 172.21.15.88:0/1791756091 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4013470 con 0x7feae80a9460 2023-12-08T08:23:40.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.366+0000 7feaeefc1640 1 -- 172.21.15.88:0/1791756091 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae815e8e0 con 0x7feae80a9460 2023-12-08T08:23:40.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.366+0000 7feaeefc1640 1 -- 172.21.15.88:0/1791756091 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae8067630 con 0x7feae80a9460 2023-12-08T08:23:40.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.366+0000 7feadd7fa640 1 -- 172.21.15.88:0/1791756091 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feae40135d0 con 0x7feae80a9460 2023-12-08T08:23:40.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.370+0000 7feadd7fa640 1 --2- 172.21.15.88:0/1791756091 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fead40664a0 0x7fead4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:40.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.370+0000 7feadd7fa640 1 -- 172.21.15.88:0/1791756091 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7feae4084670 con 0x7feae80a9460 2023-12-08T08:23:40.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.370+0000 7feadffff640 1 --2- 172.21.15.88:0/1791756091 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fead40664a0 0x7fead4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:40.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.370+0000 7feadffff640 1 --2- 172.21.15.88:0/1791756091 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fead40664a0 0x7fead4068960 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7feae806d0e0 tx=0x7fead8007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:40.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.374+0000 7feadd7fa640 1 -- 172.21.15.88:0/1791756091 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feae40518d0 con 0x7feae80a9460 2023-12-08T08:23:40.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.522+0000 7feaeefc1640 1 -- 172.21.15.88:0/1791756091 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feae80c5100 con 0x7feae80a9460 2023-12-08T08:23:40.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.522+0000 7feadd7fa640 1 -- 172.21.15.88:0/1791756091 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7feae4054ef0 con 0x7feae80a9460 2023-12-08T08:23:40.527 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:23:40.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.526+0000 7feaeefc1640 1 -- 172.21.15.88:0/1791756091 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fead40664a0 msgr2=0x7fead4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:40.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.526+0000 7feaeefc1640 1 --2- 172.21.15.88:0/1791756091 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fead40664a0 0x7fead4068960 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7feae806d0e0 tx=0x7fead8007d40 comp rx=0 tx=0).stop 2023-12-08T08:23:40.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.526+0000 7feaeefc1640 1 -- 172.21.15.88:0/1791756091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feae80a9460 msgr2=0x7feae80c2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:40.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.526+0000 7feaeefc1640 1 --2- 172.21.15.88:0/1791756091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feae80a9460 0x7feae80c2520 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7feae400e980 tx=0x7feae400ee40 comp rx=0 tx=0).stop 2023-12-08T08:23:40.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.526+0000 7feaeefc1640 1 -- 172.21.15.88:0/1791756091 shutdown_connections 2023-12-08T08:23:40.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.526+0000 7feaeefc1640 1 --2- 172.21.15.88:0/1791756091 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fead40664a0 0x7fead4068960 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.526+0000 7feaeefc1640 1 --2- 172.21.15.88:0/1791756091 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feae814e2a0 0x7feae80c12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.526+0000 7feaeefc1640 1 --2- 172.21.15.88:0/1791756091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae80a98e0 0x7feae8159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.526+0000 7feaeefc1640 1 --2- 172.21.15.88:0/1791756091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feae80a9460 0x7feae80c2520 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.526+0000 7feaeefc1640 1 -- 172.21.15.88:0/1791756091 >> 172.21.15.88:0/1791756091 conn(0x7feae80c59f0 msgr2=0x7feae814c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:40.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.526+0000 7feaeefc1640 1 -- 172.21.15.88:0/1791756091 shutdown_connections 2023-12-08T08:23:40.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.526+0000 7feaeefc1640 1 -- 172.21.15.88:0/1791756091 wait complete. 2023-12-08T08:23:40.548 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:23:40.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.686+0000 7f74d6279640 1 Processor -- start 2023-12-08T08:23:40.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.686+0000 7f74d6279640 1 -- start start 2023-12-08T08:23:40.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.686+0000 7f74d6279640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74d00bed60 0x7f74d00bf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:40.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.686+0000 7f74d6279640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f74d00a4f30 0x7f74d01585d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:40.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.686+0000 7f74d6279640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d0157b80 con 0x7f74d00c4b20 2023-12-08T08:23:40.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.686+0000 7f74d6279640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d0158b10 con 0x7f74d00a4f30 2023-12-08T08:23:40.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.686+0000 7f74d6279640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d006d6c0 con 0x7f74d00bed60 2023-12-08T08:23:40.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.686+0000 7f74cf7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f74d00a4f30 0x7f74d01585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:40.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.686+0000 7f74d4816640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f74d00c4b20 0x7f74d0154590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41282/0 (socket says 172.21.15.88:41282) 2023-12-08T08:23:40.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.686+0000 7f74d4816640 1 -- 172.21.15.88:0/3906639042 learned_addr learned my addr 172.21.15.88:0/3906639042 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:40.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.686+0000 7f74cffff640 1 --2- 172.21.15.88:0/3906639042 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74d00bed60 0x7f74d00bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:40.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.686+0000 7f74cf7fe640 1 -- 172.21.15.88:0/3906639042 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74d00bed60 msgr2=0x7f74d00bf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:40.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.686+0000 7f74cf7fe640 1 --2- 172.21.15.88:0/3906639042 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74d00bed60 0x7f74d00bf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.686+0000 7f74cf7fe640 1 -- 172.21.15.88:0/3906639042 >> v1:172.21.15.88:6789/0 conn(0x7f74d00c4b20 legacy=0x7f74d0154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:40.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.686+0000 7f74cf7fe640 1 -- 172.21.15.88:0/3906639042 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d006d960 con 0x7f74d00a4f30 2023-12-08T08:23:40.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.686+0000 7f74ceffd640 1 -- 172.21.15.88:0/3906639042 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1522689739 0 0) 0x7f74d0157b80 con 0x7f74d00c4b20 2023-12-08T08:23:40.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.690+0000 7f74cf7fe640 1 --2- 172.21.15.88:0/3906639042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74d00a4f30 0x7f74d01585d0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f74c40097c0 tx=0x7f74c401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6042ff361bf7d10 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:40.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.690+0000 7f74ceffd640 1 -- 172.21.15.88:0/3906639042 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c40ab600 con 0x7f74d00a4f30 2023-12-08T08:23:40.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.690+0000 7f74ceffd640 1 -- 172.21.15.88:0/3906639042 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c40a7050 con 0x7f74d00a4f30 2023-12-08T08:23:40.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.690+0000 7f74ceffd640 1 -- 172.21.15.88:0/3906639042 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c40ab980 con 0x7f74d00a4f30 2023-12-08T08:23:40.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.690+0000 7f74d6279640 1 -- 172.21.15.88:0/3906639042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74d00a4f30 msgr2=0x7f74d01585d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:40.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.690+0000 7f74d6279640 1 --2- 172.21.15.88:0/3906639042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74d00a4f30 0x7f74d01585d0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f74c40097c0 tx=0x7f74c401c3f0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.690+0000 7f74d6279640 1 -- 172.21.15.88:0/3906639042 shutdown_connections 2023-12-08T08:23:40.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.690+0000 7f74d6279640 1 --2- 172.21.15.88:0/3906639042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74d00a4f30 0x7f74d01585d0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.690+0000 7f74d6279640 1 --2- 172.21.15.88:0/3906639042 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74d00bed60 0x7f74d00bf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.690+0000 7f74d6279640 1 -- 172.21.15.88:0/3906639042 >> 172.21.15.88:0/3906639042 conn(0x7f74d00c59f0 msgr2=0x7f74d00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:40.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.690+0000 7f74d6279640 1 -- 172.21.15.88:0/3906639042 shutdown_connections 2023-12-08T08:23:40.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.690+0000 7f74d6279640 1 -- 172.21.15.88:0/3906639042 wait complete. 2023-12-08T08:23:40.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.690+0000 7f74d6279640 1 Processor -- start 2023-12-08T08:23:40.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.694+0000 7f74d6279640 1 -- start start 2023-12-08T08:23:40.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.694+0000 7f74d6279640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74d00a4f30 0x7f74d014ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:40.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.694+0000 7f74d6279640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74d00bed60 0x7f74d0150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:40.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.694+0000 7f74d6279640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74d00c4b20 0x7f74d0071470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:40.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.694+0000 7f74d6279640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d01f1420 con 0x7f74d00c4b20 2023-12-08T08:23:40.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.694+0000 7f74d6279640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d006fc20 con 0x7f74d00a4f30 2023-12-08T08:23:40.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.694+0000 7f74d6279640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d01524a0 con 0x7f74d00bed60 2023-12-08T08:23:40.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.694+0000 7f74d4816640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74d00c4b20 0x7f74d0071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:40.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.694+0000 7f74d4816640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74d00c4b20 0x7f74d0071470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36664/0 (socket says 172.21.15.88:36664) 2023-12-08T08:23:40.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.694+0000 7f74d4816640 1 -- 172.21.15.88:0/2163986320 learned_addr learned my addr 172.21.15.88:0/2163986320 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:40.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.694+0000 7f74cffff640 1 --2- 172.21.15.88:0/2163986320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74d00a4f30 0x7f74d014ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:40.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.694+0000 7f74cf7fe640 1 --2- 172.21.15.88:0/2163986320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74d00bed60 0x7f74d0150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:40.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.694+0000 7f74d4816640 1 -- 172.21.15.88:0/2163986320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74d00bed60 msgr2=0x7f74d0150150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:40.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.694+0000 7f74d4816640 1 --2- 172.21.15.88:0/2163986320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74d00bed60 0x7f74d0150150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.694+0000 7f74d4816640 1 -- 172.21.15.88:0/2163986320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74d00a4f30 msgr2=0x7f74d014ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:40.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.694+0000 7f74d4816640 1 --2- 172.21.15.88:0/2163986320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74d00a4f30 0x7f74d014ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.694+0000 7f74d4816640 1 -- 172.21.15.88:0/2163986320 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c4009420 con 0x7f74d00c4b20 2023-12-08T08:23:40.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.694+0000 7f74d4816640 1 --2- 172.21.15.88:0/2163986320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74d00c4b20 0x7f74d0071470 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f74c800c7a0 tx=0x7f74c800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:40.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.694+0000 7f74ccff9640 1 -- 172.21.15.88:0/2163986320 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c800a640 con 0x7f74d00c4b20 2023-12-08T08:23:40.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.694+0000 7f74ccff9640 1 -- 172.21.15.88:0/2163986320 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c800a7a0 con 0x7f74d00c4b20 2023-12-08T08:23:40.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.694+0000 7f74d6279640 1 -- 172.21.15.88:0/2163986320 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d0152780 con 0x7f74d00c4b20 2023-12-08T08:23:40.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.694+0000 7f74ccff9640 1 -- 172.21.15.88:0/2163986320 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c800abd0 con 0x7f74d00c4b20 2023-12-08T08:23:40.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.694+0000 7f74d6279640 1 -- 172.21.15.88:0/2163986320 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d006ff00 con 0x7f74d00c4b20 2023-12-08T08:23:40.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.694+0000 7f74d6279640 1 -- 172.21.15.88:0/2163986320 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d01f1590 con 0x7f74d00c4b20 2023-12-08T08:23:40.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.698+0000 7f74ccff9640 1 -- 172.21.15.88:0/2163986320 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f74c800ad30 con 0x7f74d00c4b20 2023-12-08T08:23:40.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.698+0000 7f74ccff9640 1 --2- 172.21.15.88:0/2163986320 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f74bc066470 0x7f74bc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:40.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.698+0000 7f74ccff9640 1 -- 172.21.15.88:0/2163986320 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f74c8083950 con 0x7f74d00c4b20 2023-12-08T08:23:40.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.698+0000 7f74cffff640 1 --2- 172.21.15.88:0/2163986320 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f74bc066470 0x7f74bc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:40.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.698+0000 7f74cffff640 1 --2- 172.21.15.88:0/2163986320 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f74bc066470 0x7f74bc068930 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f74c000b930 tx=0x7f74c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:40.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.702+0000 7f74ccff9640 1 -- 172.21.15.88:0/2163986320 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f74c8050b00 con 0x7f74d00c4b20 2023-12-08T08:23:40.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.854+0000 7f74d6279640 1 -- 172.21.15.88:0/2163986320 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f74d0067630 con 0x7f74d00c4b20 2023-12-08T08:23:40.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.854+0000 7f74ccff9640 1 -- 172.21.15.88:0/2163986320 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f74c8018020 con 0x7f74d00c4b20 2023-12-08T08:23:40.858 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:23:40.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.854+0000 7f74d6279640 1 -- 172.21.15.88:0/2163986320 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f74bc066470 msgr2=0x7f74bc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:40.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.854+0000 7f74d6279640 1 --2- 172.21.15.88:0/2163986320 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f74bc066470 0x7f74bc068930 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f74c000b930 tx=0x7f74c0008040 comp rx=0 tx=0).stop 2023-12-08T08:23:40.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.854+0000 7f74d6279640 1 -- 172.21.15.88:0/2163986320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74d00c4b20 msgr2=0x7f74d0071470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:40.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.854+0000 7f74d6279640 1 --2- 172.21.15.88:0/2163986320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74d00c4b20 0x7f74d0071470 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f74c800c7a0 tx=0x7f74c800cc60 comp rx=0 tx=0).stop 2023-12-08T08:23:40.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.854+0000 7f74d6279640 1 -- 172.21.15.88:0/2163986320 shutdown_connections 2023-12-08T08:23:40.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.854+0000 7f74d6279640 1 --2- 172.21.15.88:0/2163986320 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f74bc066470 0x7f74bc068930 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.854+0000 7f74d6279640 1 --2- 172.21.15.88:0/2163986320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74d00c4b20 0x7f74d0071470 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.854+0000 7f74d6279640 1 --2- 172.21.15.88:0/2163986320 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f74d00bed60 0x7f74d0150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.854+0000 7f74d6279640 1 --2- 172.21.15.88:0/2163986320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74d00a4f30 0x7f74d014ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:40.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.854+0000 7f74d6279640 1 -- 172.21.15.88:0/2163986320 >> 172.21.15.88:0/2163986320 conn(0x7f74d00c59f0 msgr2=0x7f74d006cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:40.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.854+0000 7f74d6279640 1 -- 172.21.15.88:0/2163986320 shutdown_connections 2023-12-08T08:23:40.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:40.854+0000 7f74d6279640 1 -- 172.21.15.88:0/2163986320 wait complete. 2023-12-08T08:23:40.879 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:23:41.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.018+0000 7f77096bb640 1 Processor -- start 2023-12-08T08:23:41.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.018+0000 7f77096bb640 1 -- start start 2023-12-08T08:23:41.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.018+0000 7f77096bb640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f77040af550 0x7f7704154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:41.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.018+0000 7f77096bb640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7704158760 0x7f77040c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:41.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.018+0000 7f77096bb640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77040c67a0 con 0x7f77040c4710 2023-12-08T08:23:41.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.018+0000 7f77096bb640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77040af930 con 0x7f7704158760 2023-12-08T08:23:41.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.018+0000 7f77096bb640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77040c69f0 con 0x7f77040af550 2023-12-08T08:23:41.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.018+0000 7f76fa7fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f77040c4710 0x7f7704158050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41284/0 (socket says 172.21.15.88:41284) 2023-12-08T08:23:41.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.018+0000 7f76fa7fc640 1 -- 172.21.15.88:0/1103629191 learned_addr learned my addr 172.21.15.88:0/1103629191 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:41.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.018+0000 7f77037fe640 1 --2- 172.21.15.88:0/1103629191 >> v2:172.21.15.88:3300/0 conn(0x7f7704158760 0x7f77040c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:41.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.022+0000 7f7702ffd640 1 --2- 172.21.15.88:0/1103629191 >> v2:172.21.15.148:3300/0 conn(0x7f77040af550 0x7f7704154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:41.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.022+0000 7f77037fe640 1 -- 172.21.15.88:0/1103629191 >> v2:172.21.15.148:3300/0 conn(0x7f77040af550 msgr2=0x7f7704154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:41.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.022+0000 7f77037fe640 1 --2- 172.21.15.88:0/1103629191 >> v2:172.21.15.148:3300/0 conn(0x7f77040af550 0x7f7704154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.022+0000 7f77037fe640 1 -- 172.21.15.88:0/1103629191 >> v1:172.21.15.88:6789/0 conn(0x7f77040c4710 legacy=0x7f7704158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:41.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.022+0000 7f77037fe640 1 -- 172.21.15.88:0/1103629191 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77040c6cd0 con 0x7f7704158760 2023-12-08T08:23:41.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.022+0000 7f77027fc640 1 -- 172.21.15.88:0/1103629191 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4274627395 0 0) 0x7f77040c67a0 con 0x7f77040c4710 2023-12-08T08:23:41.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.022+0000 7f77037fe640 1 --2- 172.21.15.88:0/1103629191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7704158760 0x7f77040c4bc0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f77040ac900 tx=0x7f76fc01c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65a2b3cda348577 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:41.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.022+0000 7f77027fc640 1 -- 172.21.15.88:0/1103629191 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76fc0a66c0 con 0x7f7704158760 2023-12-08T08:23:41.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.022+0000 7f77027fc640 1 -- 172.21.15.88:0/1103629191 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76fc0a6820 con 0x7f7704158760 2023-12-08T08:23:41.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.022+0000 7f77027fc640 1 -- 172.21.15.88:0/1103629191 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76fc0a6bb0 con 0x7f7704158760 2023-12-08T08:23:41.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.026+0000 7f77096bb640 1 -- 172.21.15.88:0/1103629191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7704158760 msgr2=0x7f77040c4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:41.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.026+0000 7f77096bb640 1 --2- 172.21.15.88:0/1103629191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7704158760 0x7f77040c4bc0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f77040ac900 tx=0x7f76fc01c7f0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.026+0000 7f77096bb640 1 -- 172.21.15.88:0/1103629191 shutdown_connections 2023-12-08T08:23:41.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.026+0000 7f77096bb640 1 --2- 172.21.15.88:0/1103629191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7704158760 0x7f77040c4bc0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.026+0000 7f77096bb640 1 --2- 172.21.15.88:0/1103629191 >> v2:172.21.15.148:3300/0 conn(0x7f77040af550 0x7f7704154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.026+0000 7f77096bb640 1 -- 172.21.15.88:0/1103629191 >> 172.21.15.88:0/1103629191 conn(0x7f77040668d0 msgr2=0x7f77040ab980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:41.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.026+0000 7f77096bb640 1 -- 172.21.15.88:0/1103629191 shutdown_connections 2023-12-08T08:23:41.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.026+0000 7f77096bb640 1 -- 172.21.15.88:0/1103629191 wait complete. 2023-12-08T08:23:41.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.026+0000 7f77096bb640 1 Processor -- start 2023-12-08T08:23:41.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.026+0000 7f77096bb640 1 -- start start 2023-12-08T08:23:41.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.026+0000 7f77096bb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77040af550 0x7f7704156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:41.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.026+0000 7f77096bb640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77040c4710 0x7f77040c2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:41.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.026+0000 7f77096bb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7704158760 0x7f770414dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:41.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.026+0000 7f77096bb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77040aae60 con 0x7f7704158760 2023-12-08T08:23:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.026+0000 7f77096bb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77040ac080 con 0x7f77040af550 2023-12-08T08:23:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.026+0000 7f77096bb640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7704151260 con 0x7f77040c4710 2023-12-08T08:23:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.026+0000 7f77037fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7704158760 0x7f770414dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.026+0000 7f77037fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7704158760 0x7f770414dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36684/0 (socket says 172.21.15.88:36684) 2023-12-08T08:23:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.026+0000 7f77037fe640 1 -- 172.21.15.88:0/905362183 learned_addr learned my addr 172.21.15.88:0/905362183 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.026+0000 7f7702ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77040af550 0x7f7704156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.026+0000 7f76fa7fc640 1 --2- 172.21.15.88:0/905362183 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77040c4710 0x7f77040c2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.026+0000 7f77037fe640 1 -- 172.21.15.88:0/905362183 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77040c4710 msgr2=0x7f77040c2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.026+0000 7f77037fe640 1 --2- 172.21.15.88:0/905362183 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77040c4710 0x7f77040c2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.026+0000 7f77037fe640 1 -- 172.21.15.88:0/905362183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77040af550 msgr2=0x7f7704156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.026+0000 7f77037fe640 1 --2- 172.21.15.88:0/905362183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77040af550 0x7f7704156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.026+0000 7f77037fe640 1 -- 172.21.15.88:0/905362183 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76fc009a70 con 0x7f7704158760 2023-12-08T08:23:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.030+0000 7f77037fe640 1 --2- 172.21.15.88:0/905362183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7704158760 0x7f770414dfc0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f76fc019400 tx=0x7f76fc019590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.030+0000 7f76fbfff640 1 -- 172.21.15.88:0/905362183 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76fc0b8630 con 0x7f7704158760 2023-12-08T08:23:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.030+0000 7f76fbfff640 1 -- 172.21.15.88:0/905362183 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76fc0b8790 con 0x7f7704158760 2023-12-08T08:23:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.030+0000 7f77096bb640 1 -- 172.21.15.88:0/905362183 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77040ac660 con 0x7f7704158760 2023-12-08T08:23:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.030+0000 7f76fbfff640 1 -- 172.21.15.88:0/905362183 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76fc0b8b00 con 0x7f7704158760 2023-12-08T08:23:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.030+0000 7f77096bb640 1 -- 172.21.15.88:0/905362183 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77040ac2f0 con 0x7f7704158760 2023-12-08T08:23:41.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.030+0000 7f77096bb640 1 -- 172.21.15.88:0/905362183 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77041ec730 con 0x7f7704158760 2023-12-08T08:23:41.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.030+0000 7f76fbfff640 1 -- 172.21.15.88:0/905362183 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f76fc0b8c60 con 0x7f7704158760 2023-12-08T08:23:41.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.030+0000 7f76fbfff640 1 --2- 172.21.15.88:0/905362183 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f76e4066470 0x7f76e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:41.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.030+0000 7f76fbfff640 1 -- 172.21.15.88:0/905362183 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f76fc0aa070 con 0x7f7704158760 2023-12-08T08:23:41.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.030+0000 7f7702ffd640 1 --2- 172.21.15.88:0/905362183 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f76e4066470 0x7f76e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:41.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.034+0000 7f7702ffd640 1 --2- 172.21.15.88:0/905362183 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f76e4066470 0x7f76e4068930 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f77041511a0 tx=0x7f76ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:41.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.034+0000 7f76fbfff640 1 -- 172.21.15.88:0/905362183 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f77041ec730 con 0x7f7704158760 2023-12-08T08:23:41.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.186+0000 7f77096bb640 1 -- 172.21.15.88:0/905362183 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f77041ec730 con 0x7f7704158760 2023-12-08T08:23:41.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.186+0000 7f76fbfff640 1 -- 172.21.15.88:0/905362183 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7f77041ec730 con 0x7f7704158760 2023-12-08T08:23:41.191 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:23:41.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.186+0000 7f77096bb640 1 -- 172.21.15.88:0/905362183 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f76e4066470 msgr2=0x7f76e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:41.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.186+0000 7f77096bb640 1 --2- 172.21.15.88:0/905362183 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f76e4066470 0x7f76e4068930 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f77041511a0 tx=0x7f76ec008040 comp rx=0 tx=0).stop 2023-12-08T08:23:41.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.186+0000 7f77096bb640 1 -- 172.21.15.88:0/905362183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7704158760 msgr2=0x7f770414dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:41.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.186+0000 7f77096bb640 1 --2- 172.21.15.88:0/905362183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7704158760 0x7f770414dfc0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f76fc019400 tx=0x7f76fc019590 comp rx=0 tx=0).stop 2023-12-08T08:23:41.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.186+0000 7f77096bb640 1 -- 172.21.15.88:0/905362183 shutdown_connections 2023-12-08T08:23:41.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.186+0000 7f77096bb640 1 --2- 172.21.15.88:0/905362183 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f76e4066470 0x7f76e4068930 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.186+0000 7f77096bb640 1 --2- 172.21.15.88:0/905362183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7704158760 0x7f770414dfc0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.186+0000 7f77096bb640 1 --2- 172.21.15.88:0/905362183 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f77040c4710 0x7f77040c2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.186+0000 7f77096bb640 1 --2- 172.21.15.88:0/905362183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77040af550 0x7f7704156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.186+0000 7f77096bb640 1 -- 172.21.15.88:0/905362183 >> 172.21.15.88:0/905362183 conn(0x7f77040668d0 msgr2=0x7f77041528f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:41.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.186+0000 7f77096bb640 1 -- 172.21.15.88:0/905362183 shutdown_connections 2023-12-08T08:23:41.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.186+0000 7f77096bb640 1 -- 172.21.15.88:0/905362183 wait complete. 2023-12-08T08:23:41.211 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:23:41.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.346+0000 7ff0cb572640 1 Processor -- start 2023-12-08T08:23:41.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.346+0000 7ff0cb572640 1 -- start start 2023-12-08T08:23:41.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.346+0000 7ff0cb572640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff0c414fc30 0x7ff0c40c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:41.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.346+0000 7ff0cb572640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff0c406d840 0x7ff0c40c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:41.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.346+0000 7ff0cb572640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c4152910 con 0x7ff0c414f850 2023-12-08T08:23:41.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.346+0000 7ff0cb572640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c40c2240 con 0x7ff0c414fc30 2023-12-08T08:23:41.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.346+0000 7ff0cb572640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c4152bf0 con 0x7ff0c406d840 2023-12-08T08:23:41.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.350+0000 7ff0c8b0d640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff0c414fc30 0x7ff0c40c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:41.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.350+0000 7ff0c930e640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ff0c414f850 0x7ff0c40aacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:57466/0 (socket says 172.21.15.88:57466) 2023-12-08T08:23:41.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.350+0000 7ff0c8b0d640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff0c414fc30 0x7ff0c40c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:42224/0 (socket says 172.21.15.88:42224) 2023-12-08T08:23:41.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.350+0000 7ff0c930e640 1 -- 172.21.15.88:0/2425073874 learned_addr learned my addr 172.21.15.88:0/2425073874 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:41.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.350+0000 7ff0c9b0f640 1 --2- 172.21.15.88:0/2425073874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff0c406d840 0x7ff0c40c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:41.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.350+0000 7ff0c8b0d640 1 -- 172.21.15.88:0/2425073874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff0c406d840 msgr2=0x7ff0c40c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:41.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.350+0000 7ff0c8b0d640 1 --2- 172.21.15.88:0/2425073874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff0c406d840 0x7ff0c40c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.350+0000 7ff0c8b0d640 1 -- 172.21.15.88:0/2425073874 >> v1:172.21.15.148:6789/0 conn(0x7ff0c414f850 legacy=0x7ff0c40aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:41.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.350+0000 7ff0c8b0d640 1 -- 172.21.15.88:0/2425073874 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c4152ed0 con 0x7ff0c414fc30 2023-12-08T08:23:41.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.350+0000 7ff0bbfff640 1 -- 172.21.15.88:0/2425073874 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 352380154 0 0) 0x7ff0c4152910 con 0x7ff0c414f850 2023-12-08T08:23:41.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.350+0000 7ff0c8b0d640 1 --2- 172.21.15.88:0/2425073874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0c414fc30 0x7ff0c40c3cd0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff0b40097c0 tx=0x7ff0b401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b59187ee74a31de0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:41.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.350+0000 7ff0bbfff640 1 -- 172.21.15.88:0/2425073874 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b40ac410 con 0x7ff0c414fc30 2023-12-08T08:23:41.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.350+0000 7ff0bbfff640 1 -- 172.21.15.88:0/2425073874 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b40ac570 con 0x7ff0c414fc30 2023-12-08T08:23:41.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.350+0000 7ff0bbfff640 1 -- 172.21.15.88:0/2425073874 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b40ac900 con 0x7ff0c414fc30 2023-12-08T08:23:41.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.354+0000 7ff0cb572640 1 -- 172.21.15.88:0/2425073874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0c414fc30 msgr2=0x7ff0c40c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:41.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.354+0000 7ff0cb572640 1 --2- 172.21.15.88:0/2425073874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0c414fc30 0x7ff0c40c3cd0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff0b40097c0 tx=0x7ff0b401c480 comp rx=0 tx=0).stop 2023-12-08T08:23:41.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.354+0000 7ff0cb572640 1 -- 172.21.15.88:0/2425073874 shutdown_connections 2023-12-08T08:23:41.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.354+0000 7ff0cb572640 1 --2- 172.21.15.88:0/2425073874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff0c406d840 0x7ff0c40c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.354+0000 7ff0cb572640 1 --2- 172.21.15.88:0/2425073874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0c414fc30 0x7ff0c40c3cd0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.354+0000 7ff0cb572640 1 -- 172.21.15.88:0/2425073874 >> 172.21.15.88:0/2425073874 conn(0x7ff0c40c59f0 msgr2=0x7ff0c40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:41.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.354+0000 7ff0cb572640 1 -- 172.21.15.88:0/2425073874 shutdown_connections 2023-12-08T08:23:41.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.354+0000 7ff0cb572640 1 -- 172.21.15.88:0/2425073874 wait complete. 2023-12-08T08:23:41.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.354+0000 7ff0cb572640 1 Processor -- start 2023-12-08T08:23:41.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.354+0000 7ff0cb572640 1 -- start start 2023-12-08T08:23:41.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.354+0000 7ff0cb572640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0c406d840 0x7ff0c414b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:41.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.354+0000 7ff0cb572640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0c414f850 0x7ff0c40a6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:41.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.354+0000 7ff0cb572640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff0c414fc30 0x7ff0c41ede10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.354+0000 7ff0cb572640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c40a74b0 con 0x7ff0c414f850 2023-12-08T08:23:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.354+0000 7ff0cb572640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c41f1800 con 0x7ff0c406d840 2023-12-08T08:23:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.354+0000 7ff0cb572640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c41f1d30 con 0x7ff0c414fc30 2023-12-08T08:23:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.354+0000 7ff0c8b0d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0c414f850 0x7ff0c40a6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.354+0000 7ff0c8b0d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0c414f850 0x7ff0c40a6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36692/0 (socket says 172.21.15.88:36692) 2023-12-08T08:23:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.354+0000 7ff0c8b0d640 1 -- 172.21.15.88:0/1334210454 learned_addr learned my addr 172.21.15.88:0/1334210454 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.354+0000 7ff0c930e640 1 --2- 172.21.15.88:0/1334210454 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0c406d840 0x7ff0c414b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.354+0000 7ff0c9b0f640 1 --2- 172.21.15.88:0/1334210454 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff0c414fc30 0x7ff0c41ede10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.354+0000 7ff0c8b0d640 1 -- 172.21.15.88:0/1334210454 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff0c414fc30 msgr2=0x7ff0c41ede10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.358+0000 7ff0c8b0d640 1 --2- 172.21.15.88:0/1334210454 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff0c414fc30 0x7ff0c41ede10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.358+0000 7ff0c8b0d640 1 -- 172.21.15.88:0/1334210454 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0c406d840 msgr2=0x7ff0c414b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.358+0000 7ff0c8b0d640 1 --2- 172.21.15.88:0/1334210454 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0c406d840 0x7ff0c414b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.358+0000 7ff0c8b0d640 1 -- 172.21.15.88:0/1334210454 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b4009420 con 0x7ff0c414f850 2023-12-08T08:23:41.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.358+0000 7ff0c8b0d640 1 --2- 172.21.15.88:0/1334210454 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0c414f850 0x7ff0c40a6910 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7ff0b40af040 tx=0x7ff0b4019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:41.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.358+0000 7ff0b9ffb640 1 -- 172.21.15.88:0/1334210454 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b40ac410 con 0x7ff0c414f850 2023-12-08T08:23:41.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.358+0000 7ff0b9ffb640 1 -- 172.21.15.88:0/1334210454 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b4006e20 con 0x7ff0c414f850 2023-12-08T08:23:41.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.358+0000 7ff0cb572640 1 -- 172.21.15.88:0/1334210454 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c41f1a50 con 0x7ff0c414f850 2023-12-08T08:23:41.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.358+0000 7ff0b9ffb640 1 -- 172.21.15.88:0/1334210454 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b40b5880 con 0x7ff0c414f850 2023-12-08T08:23:41.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.358+0000 7ff0cb572640 1 -- 172.21.15.88:0/1334210454 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c406fed0 con 0x7ff0c414f850 2023-12-08T08:23:41.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.358+0000 7ff0cb572640 1 -- 172.21.15.88:0/1334210454 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c4067630 con 0x7ff0c414f850 2023-12-08T08:23:41.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.358+0000 7ff0b9ffb640 1 -- 172.21.15.88:0/1334210454 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff0b40b3040 con 0x7ff0c414f850 2023-12-08T08:23:41.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.358+0000 7ff0b9ffb640 1 --2- 172.21.15.88:0/1334210454 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff0a8066470 0x7ff0a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:41.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.358+0000 7ff0b9ffb640 1 -- 172.21.15.88:0/1334210454 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff0b411e3a0 con 0x7ff0c414f850 2023-12-08T08:23:41.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.362+0000 7ff0c930e640 1 --2- 172.21.15.88:0/1334210454 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff0a8066470 0x7ff0a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:41.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.362+0000 7ff0c930e640 1 --2- 172.21.15.88:0/1334210454 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff0a8066470 0x7ff0a8068930 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0007fd0 tx=0x7ff0c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:41.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.362+0000 7ff0b9ffb640 1 -- 172.21.15.88:0/1334210454 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff0b40eb560 con 0x7ff0c414f850 2023-12-08T08:23:41.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.514+0000 7ff0cb572640 1 -- 172.21.15.88:0/1334210454 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff0c40ab1b0 con 0x7ff0c414f850 2023-12-08T08:23:41.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.514+0000 7ff0b9ffb640 1 -- 172.21.15.88:0/1334210454 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v72) v1 ==== 105+0+11 (secure 0 0 0) 0x7ff0b40eeb80 con 0x7ff0c414f850 2023-12-08T08:23:41.518 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:23:41.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.514+0000 7ff0cb572640 1 -- 172.21.15.88:0/1334210454 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff0a8066470 msgr2=0x7ff0a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:41.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.514+0000 7ff0cb572640 1 --2- 172.21.15.88:0/1334210454 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff0a8066470 0x7ff0a8068930 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0007fd0 tx=0x7ff0c0009040 comp rx=0 tx=0).stop 2023-12-08T08:23:41.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.514+0000 7ff0cb572640 1 -- 172.21.15.88:0/1334210454 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0c414f850 msgr2=0x7ff0c40a6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:41.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.514+0000 7ff0cb572640 1 --2- 172.21.15.88:0/1334210454 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0c414f850 0x7ff0c40a6910 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7ff0b40af040 tx=0x7ff0b4019220 comp rx=0 tx=0).stop 2023-12-08T08:23:41.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.514+0000 7ff0cb572640 1 -- 172.21.15.88:0/1334210454 shutdown_connections 2023-12-08T08:23:41.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.514+0000 7ff0cb572640 1 --2- 172.21.15.88:0/1334210454 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff0a8066470 0x7ff0a8068930 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.514+0000 7ff0cb572640 1 --2- 172.21.15.88:0/1334210454 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff0c414fc30 0x7ff0c41ede10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.514+0000 7ff0cb572640 1 --2- 172.21.15.88:0/1334210454 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0c414f850 0x7ff0c40a6910 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.514+0000 7ff0cb572640 1 --2- 172.21.15.88:0/1334210454 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0c406d840 0x7ff0c414b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.514+0000 7ff0cb572640 1 -- 172.21.15.88:0/1334210454 >> 172.21.15.88:0/1334210454 conn(0x7ff0c40c59f0 msgr2=0x7ff0c414ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:41.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.514+0000 7ff0cb572640 1 -- 172.21.15.88:0/1334210454 shutdown_connections 2023-12-08T08:23:41.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.514+0000 7ff0cb572640 1 -- 172.21.15.88:0/1334210454 wait complete. 2023-12-08T08:23:41.538 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:23:41.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.674+0000 7fd047d65640 1 Processor -- start 2023-12-08T08:23:41.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.674+0000 7fd047d65640 1 -- start start 2023-12-08T08:23:41.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.674+0000 7fd047d65640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd040156200 0x7fd0400c0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:41.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.674+0000 7fd047d65640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd0400c0e10 0x7fd0400c1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:41.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.674+0000 7fd047d65640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd04015bf70 0x7fd04015c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:41.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.674+0000 7fd047d65640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd04006d8d0 con 0x7fd0400c0e10 2023-12-08T08:23:41.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.674+0000 7fd047d65640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd04006bce0 con 0x7fd04015bf70 2023-12-08T08:23:41.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.674+0000 7fd047d65640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04015cc60 con 0x7fd040156200 2023-12-08T08:23:41.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.674+0000 7fd045300640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd0400c0e10 0x7fd0400c1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:41.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.674+0000 7fd045300640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd0400c0e10 0x7fd0400c1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36700/0 (socket says 172.21.15.88:36700) 2023-12-08T08:23:41.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.674+0000 7fd045300640 1 -- 172.21.15.88:0/2195261715 learned_addr learned my addr 172.21.15.88:0/2195261715 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:41.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.678+0000 7fd045b01640 1 --2- 172.21.15.88:0/2195261715 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd040156200 0x7fd0400c0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:41.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.678+0000 7fd046302640 1 --2- 172.21.15.88:0/2195261715 >> v2:172.21.15.148:3300/0 conn(0x7fd04015bf70 0x7fd04015c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:41.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.678+0000 7fd045300640 1 -- 172.21.15.88:0/2195261715 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd040156200 msgr2=0x7fd0400c0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:41.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.678+0000 7fd045300640 1 --2- 172.21.15.88:0/2195261715 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd040156200 0x7fd0400c0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.678+0000 7fd045300640 1 -- 172.21.15.88:0/2195261715 >> v2:172.21.15.148:3300/0 conn(0x7fd04015bf70 msgr2=0x7fd04015c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:41.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.678+0000 7fd045300640 1 --2- 172.21.15.88:0/2195261715 >> v2:172.21.15.148:3300/0 conn(0x7fd04015bf70 0x7fd04015c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.678+0000 7fd045300640 1 -- 172.21.15.88:0/2195261715 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04006bf30 con 0x7fd0400c0e10 2023-12-08T08:23:41.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.678+0000 7fd045300640 1 --2- 172.21.15.88:0/2195261715 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0400c0e10 0x7fd0400c1b60 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fd0400c59a0 tx=0x7fd03001ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4110564e2ae425e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:41.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.678+0000 7fd044aff640 1 -- 172.21.15.88:0/2195261715 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0300ac620 con 0x7fd0400c0e10 2023-12-08T08:23:41.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.678+0000 7fd044aff640 1 -- 172.21.15.88:0/2195261715 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0300ac780 con 0x7fd0400c0e10 2023-12-08T08:23:41.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.678+0000 7fd044aff640 1 -- 172.21.15.88:0/2195261715 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0300acb10 con 0x7fd0400c0e10 2023-12-08T08:23:41.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.678+0000 7fd047d65640 1 -- 172.21.15.88:0/2195261715 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0400c0e10 msgr2=0x7fd0400c1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:41.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.678+0000 7fd047d65640 1 --2- 172.21.15.88:0/2195261715 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0400c0e10 0x7fd0400c1b60 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fd0400c59a0 tx=0x7fd03001ce00 comp rx=0 tx=0).stop 2023-12-08T08:23:41.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd047d65640 1 -- 172.21.15.88:0/2195261715 shutdown_connections 2023-12-08T08:23:41.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd047d65640 1 --2- 172.21.15.88:0/2195261715 >> v2:172.21.15.148:3300/0 conn(0x7fd04015bf70 0x7fd04015c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd047d65640 1 --2- 172.21.15.88:0/2195261715 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0400c0e10 0x7fd0400c1b60 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd047d65640 1 --2- 172.21.15.88:0/2195261715 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd040156200 0x7fd0400c0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd047d65640 1 -- 172.21.15.88:0/2195261715 >> 172.21.15.88:0/2195261715 conn(0x7fd0400c59f0 msgr2=0x7fd0400c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:41.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd047d65640 1 -- 172.21.15.88:0/2195261715 shutdown_connections 2023-12-08T08:23:41.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd047d65640 1 -- 172.21.15.88:0/2195261715 wait complete. 2023-12-08T08:23:41.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd047d65640 1 Processor -- start 2023-12-08T08:23:41.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd047d65640 1 -- start start 2023-12-08T08:23:41.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd047d65640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0400c0e10 0x7fd0401509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:41.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd047d65640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd040156200 0x7fd04014b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:41.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd047d65640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd04015bf70 0x7fd040149340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:41.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd047d65640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04014e120 con 0x7fd040156200 2023-12-08T08:23:41.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd047d65640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd040150ee0 con 0x7fd0400c0e10 2023-12-08T08:23:41.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd047d65640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd040149fe0 con 0x7fd04015bf70 2023-12-08T08:23:41.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd045300640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd040156200 0x7fd04014b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:41.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd045300640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd040156200 0x7fd04014b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36710/0 (socket says 172.21.15.88:36710) 2023-12-08T08:23:41.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd045300640 1 -- 172.21.15.88:0/2476773784 learned_addr learned my addr 172.21.15.88:0/2476773784 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:41.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd045b01640 1 --2- 172.21.15.88:0/2476773784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0400c0e10 0x7fd0401509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:41.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd046302640 1 --2- 172.21.15.88:0/2476773784 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd04015bf70 0x7fd040149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:41.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd045300640 1 -- 172.21.15.88:0/2476773784 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd04015bf70 msgr2=0x7fd040149340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:41.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd045300640 1 --2- 172.21.15.88:0/2476773784 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd04015bf70 0x7fd040149340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd045300640 1 -- 172.21.15.88:0/2476773784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0400c0e10 msgr2=0x7fd0401509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:41.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd045300640 1 --2- 172.21.15.88:0/2476773784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0400c0e10 0x7fd0401509a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd045300640 1 -- 172.21.15.88:0/2476773784 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0300094d0 con 0x7fd040156200 2023-12-08T08:23:41.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd045b01640 1 --2- 172.21.15.88:0/2476773784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0400c0e10 0x7fd0401509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:41.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd046302640 1 --2- 172.21.15.88:0/2476773784 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd04015bf70 0x7fd040149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:41.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.682+0000 7fd045300640 1 --2- 172.21.15.88:0/2476773784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd040156200 0x7fd04014b950 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fd030000c10 tx=0x7fd0401599d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:41.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.686+0000 7fd0367fc640 1 -- 172.21.15.88:0/2476773784 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0300b7420 con 0x7fd040156200 2023-12-08T08:23:41.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.686+0000 7fd0367fc640 1 -- 172.21.15.88:0/2476773784 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0300b7580 con 0x7fd040156200 2023-12-08T08:23:41.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.686+0000 7fd047d65640 1 -- 172.21.15.88:0/2476773784 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0401f1d20 con 0x7fd040156200 2023-12-08T08:23:41.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.686+0000 7fd0367fc640 1 -- 172.21.15.88:0/2476773784 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0300b7930 con 0x7fd040156200 2023-12-08T08:23:41.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.686+0000 7fd047d65640 1 -- 172.21.15.88:0/2476773784 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0401f2000 con 0x7fd040156200 2023-12-08T08:23:41.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.686+0000 7fd047d65640 1 -- 172.21.15.88:0/2476773784 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd04014a4c0 con 0x7fd040156200 2023-12-08T08:23:41.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.686+0000 7fd0367fc640 1 -- 172.21.15.88:0/2476773784 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd0300b3040 con 0x7fd040156200 2023-12-08T08:23:41.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.686+0000 7fd0367fc640 1 --2- 172.21.15.88:0/2476773784 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd024066470 0x7fd024068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:41.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.686+0000 7fd0367fc640 1 -- 172.21.15.88:0/2476773784 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd03011dff0 con 0x7fd040156200 2023-12-08T08:23:41.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.686+0000 7fd045b01640 1 --2- 172.21.15.88:0/2476773784 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd024066470 0x7fd024068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:41.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.686+0000 7fd045b01640 1 --2- 172.21.15.88:0/2476773784 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd024066470 0x7fd024068930 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd03c00b9f0 tx=0x7fd03c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:41.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.690+0000 7fd0367fc640 1 -- 172.21.15.88:0/2476773784 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd04014a4c0 con 0x7fd040156200 2023-12-08T08:23:41.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.842+0000 7fd047d65640 1 -- 172.21.15.88:0/2476773784 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fd04014a4c0 con 0x7fd040156200 2023-12-08T08:23:41.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.842+0000 7fd0367fc640 1 -- 172.21.15.88:0/2476773784 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v72) v1 ==== 101+0+11 (secure 0 0 0) 0x7fd04014a4c0 con 0x7fd040156200 2023-12-08T08:23:41.846 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:23:41.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.842+0000 7fd047d65640 1 -- 172.21.15.88:0/2476773784 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd024066470 msgr2=0x7fd024068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:41.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.842+0000 7fd047d65640 1 --2- 172.21.15.88:0/2476773784 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd024066470 0x7fd024068930 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd03c00b9f0 tx=0x7fd03c008040 comp rx=0 tx=0).stop 2023-12-08T08:23:41.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.842+0000 7fd047d65640 1 -- 172.21.15.88:0/2476773784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd040156200 msgr2=0x7fd04014b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:41.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.842+0000 7fd047d65640 1 --2- 172.21.15.88:0/2476773784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd040156200 0x7fd04014b950 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fd030000c10 tx=0x7fd0401599d0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.842+0000 7fd047d65640 1 -- 172.21.15.88:0/2476773784 shutdown_connections 2023-12-08T08:23:41.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.842+0000 7fd047d65640 1 --2- 172.21.15.88:0/2476773784 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd024066470 0x7fd024068930 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.842+0000 7fd047d65640 1 --2- 172.21.15.88:0/2476773784 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd04015bf70 0x7fd040149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.842+0000 7fd047d65640 1 --2- 172.21.15.88:0/2476773784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd040156200 0x7fd04014b950 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.842+0000 7fd047d65640 1 --2- 172.21.15.88:0/2476773784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0400c0e10 0x7fd0401509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:41.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.842+0000 7fd047d65640 1 -- 172.21.15.88:0/2476773784 >> 172.21.15.88:0/2476773784 conn(0x7fd0400c59f0 msgr2=0x7fd040154320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:41.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.842+0000 7fd047d65640 1 -- 172.21.15.88:0/2476773784 shutdown_connections 2023-12-08T08:23:41.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:41.842+0000 7fd047d65640 1 -- 172.21.15.88:0/2476773784 wait complete. 2023-12-08T08:23:41.867 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:23:42.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.006+0000 7f66392c8640 1 Processor -- start 2023-12-08T08:23:42.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.006+0000 7f66392c8640 1 -- start start 2023-12-08T08:23:42.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.006+0000 7f66392c8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6634151900 0x7f66340c4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:42.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.006+0000 7f66392c8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66340ca0c0 con 0x7f66340c7b10 2023-12-08T08:23:42.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.006+0000 7f66392c8640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6634151ce0 con 0x7f66340bd2a0 2023-12-08T08:23:42.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.006+0000 7f66392c8640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66340cab10 con 0x7f6634151900 2023-12-08T08:23:42.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.006+0000 7f66337fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f66340c7b10 0x7f66341542d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41298/0 (socket says 172.21.15.88:41298) 2023-12-08T08:23:42.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.006+0000 7f66337fe640 1 -- 172.21.15.88:0/3913807518 learned_addr learned my addr 172.21.15.88:0/3913807518 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:42.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.006+0000 7f6633fff640 1 --2- 172.21.15.88:0/3913807518 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6634151900 0x7f66340c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:42.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.006+0000 7f6632ffd640 1 -- 172.21.15.88:0/3913807518 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 293233598 0 0) 0x7f66340ca0c0 con 0x7f66340c7b10 2023-12-08T08:23:42.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.006+0000 7f6632ffd640 1 -- 172.21.15.88:0/3913807518 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f661c003530 con 0x7f66340c7b10 2023-12-08T08:23:42.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.006+0000 7f6632ffd640 1 -- 172.21.15.88:0/3913807518 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2844267647 0 0) 0x7f661c003530 con 0x7f66340c7b10 2023-12-08T08:23:42.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.006+0000 7f6632ffd640 1 -- 172.21.15.88:0/3913807518 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6634151900 msgr2=0x7f66340c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:42.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.006+0000 7f6632ffd640 1 --2- 172.21.15.88:0/3913807518 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6634151900 0x7f66340c4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.006+0000 7f6632ffd640 1 -- 172.21.15.88:0/3913807518 >> v1:172.21.15.148:6789/0 conn(0x7f66340bd2a0 legacy=0x7f663415ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:42.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.006+0000 7f6632ffd640 1 -- 172.21.15.88:0/3913807518 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66341583e0 con 0x7f66340c7b10 2023-12-08T08:23:42.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.006+0000 7f6632ffd640 1 -- 172.21.15.88:0/3913807518 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f6628001680 con 0x7f66340c7b10 2023-12-08T08:23:42.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.006+0000 7f6632ffd640 1 -- 172.21.15.88:0/3913807518 >> v1:172.21.15.88:6789/0 conn(0x7f66340c7b10 legacy=0x7f66341542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:42.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.006+0000 7f6632ffd640 1 --2- 172.21.15.88:0/3913807518 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f661c0039b0 0x7f661c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:42.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.006+0000 7f6632ffd640 1 --2- 172.21.15.88:0/3913807518 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6634151900 0x7f661c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:42.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.006+0000 7f6632ffd640 1 --2- 172.21.15.88:0/3913807518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f661c004d10 0x7f661c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:42.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.006+0000 7f6632ffd640 1 -- 172.21.15.88:0/3913807518 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661c00ba40 con 0x7f661c004d10 2023-12-08T08:23:42.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.006+0000 7f6632ffd640 1 -- 172.21.15.88:0/3913807518 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661c00bb80 con 0x7f661c0039b0 2023-12-08T08:23:42.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.006+0000 7f6632ffd640 1 -- 172.21.15.88:0/3913807518 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661c00bd40 con 0x7f6634151900 2023-12-08T08:23:42.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.006+0000 7f6638ac7640 1 --2- 172.21.15.88:0/3913807518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f661c004d10 0x7f661c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:42.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.006+0000 7f6633fff640 1 --2- 172.21.15.88:0/3913807518 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f661c0039b0 0x7f661c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:42.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.006+0000 7f66337fe640 1 --2- 172.21.15.88:0/3913807518 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6634151900 0x7f661c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:42.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.010+0000 7f6633fff640 1 -- 172.21.15.88:0/3913807518 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6634151900 msgr2=0x7f661c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:42.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.010+0000 7f6633fff640 1 --2- 172.21.15.88:0/3913807518 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6634151900 0x7f661c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.010+0000 7f6633fff640 1 -- 172.21.15.88:0/3913807518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f661c004d10 msgr2=0x7f661c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:42.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.010+0000 7f6633fff640 1 --2- 172.21.15.88:0/3913807518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f661c004d10 0x7f661c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.010+0000 7f6633fff640 1 -- 172.21.15.88:0/3913807518 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661c003530 con 0x7f661c0039b0 2023-12-08T08:23:42.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.010+0000 7f6638ac7640 1 --2- 172.21.15.88:0/3913807518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f661c004d10 0x7f661c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:23:42.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.010+0000 7f6633fff640 1 --2- 172.21.15.88:0/3913807518 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f661c0039b0 0x7f661c003d90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6624009ae0 tx=0x7f662401ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=355fc7227096f185 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:42.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.010+0000 7f6632ffd640 1 -- 172.21.15.88:0/3913807518 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66240a5510 con 0x7f661c0039b0 2023-12-08T08:23:42.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.010+0000 7f6632ffd640 1 -- 172.21.15.88:0/3913807518 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66240a5670 con 0x7f661c0039b0 2023-12-08T08:23:42.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.010+0000 7f6632ffd640 1 -- 172.21.15.88:0/3913807518 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66240a5820 con 0x7f661c0039b0 2023-12-08T08:23:42.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.014+0000 7f66392c8640 1 -- 172.21.15.88:0/3913807518 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f661c0039b0 msgr2=0x7f661c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:42.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.014+0000 7f66392c8640 1 --2- 172.21.15.88:0/3913807518 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f661c0039b0 0x7f661c003d90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6624009ae0 tx=0x7f662401ca50 comp rx=0 tx=0).stop 2023-12-08T08:23:42.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.014+0000 7f6638ac7640 1 -- 172.21.15.88:0/3913807518 reap_dead start 2023-12-08T08:23:42.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.014+0000 7f66392c8640 1 -- 172.21.15.88:0/3913807518 shutdown_connections 2023-12-08T08:23:42.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.014+0000 7f66392c8640 1 -- 172.21.15.88:0/3913807518 >> 172.21.15.88:0/3913807518 conn(0x7f6634066670 msgr2=0x7f6634066a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:42.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.014+0000 7f66392c8640 1 -- 172.21.15.88:0/3913807518 shutdown_connections 2023-12-08T08:23:42.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.014+0000 7f66392c8640 1 -- 172.21.15.88:0/3913807518 wait complete. 2023-12-08T08:23:42.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.014+0000 7f66392c8640 1 Processor -- start 2023-12-08T08:23:42.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.014+0000 7f66392c8640 1 -- start start 2023-12-08T08:23:42.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.014+0000 7f66392c8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f661c0039b0 0x7f66340c3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:42.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.014+0000 7f66392c8640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f66340c0ce0 0x7f66340c2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:42.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.014+0000 7f66392c8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66340c2ab0 0x7f6634148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:42.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.014+0000 7f66392c8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66341ed600 con 0x7f66340c2ab0 2023-12-08T08:23:42.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.014+0000 7f66392c8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66340c2f30 con 0x7f661c0039b0 2023-12-08T08:23:42.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.014+0000 7f66392c8640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66341edac0 con 0x7f66340c0ce0 2023-12-08T08:23:42.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.014+0000 7f6638ac7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66340c2ab0 0x7f6634148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:42.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.014+0000 7f6638ac7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66340c2ab0 0x7f6634148fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36722/0 (socket says 172.21.15.88:36722) 2023-12-08T08:23:42.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.014+0000 7f6638ac7640 1 -- 172.21.15.88:0/1198399282 learned_addr learned my addr 172.21.15.88:0/1198399282 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:42.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.014+0000 7f6633fff640 1 --2- 172.21.15.88:0/1198399282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f661c0039b0 0x7f66340c3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:42.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.014+0000 7f66337fe640 1 --2- 172.21.15.88:0/1198399282 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f66340c0ce0 0x7f66340c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:42.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.014+0000 7f6638ac7640 1 -- 172.21.15.88:0/1198399282 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f66340c0ce0 msgr2=0x7f66340c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:42.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.014+0000 7f6638ac7640 1 --2- 172.21.15.88:0/1198399282 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f66340c0ce0 0x7f66340c2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.014+0000 7f6638ac7640 1 -- 172.21.15.88:0/1198399282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f661c0039b0 msgr2=0x7f66340c3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:42.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.014+0000 7f6638ac7640 1 --2- 172.21.15.88:0/1198399282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f661c0039b0 0x7f66340c3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.014+0000 7f6638ac7640 1 -- 172.21.15.88:0/1198399282 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66341ed7e0 con 0x7f66340c2ab0 2023-12-08T08:23:42.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.018+0000 7f6638ac7640 1 --2- 172.21.15.88:0/1198399282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66340c2ab0 0x7f6634148fb0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f662c007fd0 tx=0x7f662c00d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:42.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.018+0000 7f6630ff9640 1 -- 172.21.15.88:0/1198399282 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c018070 con 0x7f66340c2ab0 2023-12-08T08:23:42.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.018+0000 7f6630ff9640 1 -- 172.21.15.88:0/1198399282 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662c00dbb0 con 0x7f66340c2ab0 2023-12-08T08:23:42.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.018+0000 7f66392c8640 1 -- 172.21.15.88:0/1198399282 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66340c1a90 con 0x7f66340c2ab0 2023-12-08T08:23:42.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.018+0000 7f6630ff9640 1 -- 172.21.15.88:0/1198399282 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c00dd60 con 0x7f66340c2ab0 2023-12-08T08:23:42.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.018+0000 7f66392c8640 1 -- 172.21.15.88:0/1198399282 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66340c2050 con 0x7f66340c2ab0 2023-12-08T08:23:42.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.018+0000 7f66392c8640 1 -- 172.21.15.88:0/1198399282 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6634067bc0 con 0x7f66340c2ab0 2023-12-08T08:23:42.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.018+0000 7f6630ff9640 1 -- 172.21.15.88:0/1198399282 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f662c006b60 con 0x7f66340c2ab0 2023-12-08T08:23:42.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.018+0000 7f6630ff9640 1 --2- 172.21.15.88:0/1198399282 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6620066470 0x7f6620068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:42.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.018+0000 7f6630ff9640 1 -- 172.21.15.88:0/1198399282 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f662c083c00 con 0x7f66340c2ab0 2023-12-08T08:23:42.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.018+0000 7f6633fff640 1 --2- 172.21.15.88:0/1198399282 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6620066470 0x7f6620068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:42.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.018+0000 7f6633fff640 1 --2- 172.21.15.88:0/1198399282 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6620066470 0x7f6620068930 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f66240af000 tx=0x7f66240046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:42.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.022+0000 7f6630ff9640 1 -- 172.21.15.88:0/1198399282 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f662c050dc0 con 0x7f66340c2ab0 2023-12-08T08:23:42.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.186+0000 7f66392c8640 1 -- 172.21.15.88:0/1198399282 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f66340c92e0 con 0x7f66340c2ab0 2023-12-08T08:23:42.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.186+0000 7f6630ff9640 1 -- 172.21.15.88:0/1198399282 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7f662c0543e0 con 0x7f66340c2ab0 2023-12-08T08:23:42.190 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-12-08T08:23:42.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.186+0000 7f66392c8640 1 -- 172.21.15.88:0/1198399282 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6620066470 msgr2=0x7f6620068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:42.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.186+0000 7f66392c8640 1 --2- 172.21.15.88:0/1198399282 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6620066470 0x7f6620068930 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f66240af000 tx=0x7f66240046d0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.186+0000 7f66392c8640 1 -- 172.21.15.88:0/1198399282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66340c2ab0 msgr2=0x7f6634148fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:42.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.186+0000 7f66392c8640 1 --2- 172.21.15.88:0/1198399282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66340c2ab0 0x7f6634148fb0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f662c007fd0 tx=0x7f662c00d520 comp rx=0 tx=0).stop 2023-12-08T08:23:42.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.186+0000 7f66392c8640 1 -- 172.21.15.88:0/1198399282 shutdown_connections 2023-12-08T08:23:42.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.186+0000 7f66392c8640 1 --2- 172.21.15.88:0/1198399282 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6620066470 0x7f6620068930 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.186+0000 7f66392c8640 1 --2- 172.21.15.88:0/1198399282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66340c2ab0 0x7f6634148fb0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.186+0000 7f66392c8640 1 --2- 172.21.15.88:0/1198399282 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f66340c0ce0 0x7f66340c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.186+0000 7f66392c8640 1 --2- 172.21.15.88:0/1198399282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f661c0039b0 0x7f66340c3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.186+0000 7f66392c8640 1 -- 172.21.15.88:0/1198399282 >> 172.21.15.88:0/1198399282 conn(0x7f6634066670 msgr2=0x7f66340c80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:42.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.186+0000 7f66392c8640 1 -- 172.21.15.88:0/1198399282 shutdown_connections 2023-12-08T08:23:42.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.186+0000 7f66392c8640 1 -- 172.21.15.88:0/1198399282 wait complete. 2023-12-08T08:23:42.210 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2023-12-08T08:23:42.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:42.211 DEBUG:teuthology.orchestra.run.smithi088:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-08T08:23:42.237 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2023-12-08T08:23:42.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:42.237 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-08T08:23:42.290 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:23:42.290 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:23:42.300 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:23:42.300 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:23:42.352 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:23:42.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.486+0000 7f863192a640 1 Processor -- start 2023-12-08T08:23:42.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.486+0000 7f863192a640 1 -- start start 2023-12-08T08:23:42.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.486+0000 7f863192a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f862c0af4c0 0x7f862c154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:42.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.486+0000 7f863192a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f862c0c67d0 0x7f862c0c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:42.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.486+0000 7f863192a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f862c06b9f0 0x7f862c06be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:42.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.486+0000 7f863192a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f862c155460 con 0x7f862c06b9f0 2023-12-08T08:23:42.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.486+0000 7f863192a640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f862c06c380 con 0x7f862c0c67d0 2023-12-08T08:23:42.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.486+0000 7f863192a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862c0c4890 con 0x7f862c0af4c0 2023-12-08T08:23:42.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.486+0000 7f862b7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f862c06b9f0 0x7f862c06be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:42.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.486+0000 7f862b7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f862c06b9f0 0x7f862c06be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36730/0 (socket says 172.21.15.88:36730) 2023-12-08T08:23:42.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.486+0000 7f862b7fe640 1 -- 172.21.15.88:0/2136742016 learned_addr learned my addr 172.21.15.88:0/2136742016 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:42.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.486+0000 7f862affd640 1 --2- 172.21.15.88:0/2136742016 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f862c0af4c0 0x7f862c154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:42.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.486+0000 7f86227fc640 1 --2- 172.21.15.88:0/2136742016 >> v2:172.21.15.148:3300/0 conn(0x7f862c0c67d0 0x7f862c0c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:42.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.486+0000 7f862b7fe640 1 -- 172.21.15.88:0/2136742016 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f862c0af4c0 msgr2=0x7f862c154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:42.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.486+0000 7f862b7fe640 1 --2- 172.21.15.88:0/2136742016 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f862c0af4c0 0x7f862c154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.486+0000 7f862b7fe640 1 -- 172.21.15.88:0/2136742016 >> v2:172.21.15.148:3300/0 conn(0x7f862c0c67d0 msgr2=0x7f862c0c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:42.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.486+0000 7f862b7fe640 1 --2- 172.21.15.88:0/2136742016 >> v2:172.21.15.148:3300/0 conn(0x7f862c0c67d0 0x7f862c0c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.486+0000 7f862b7fe640 1 -- 172.21.15.88:0/2136742016 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862c0af8a0 con 0x7f862c06b9f0 2023-12-08T08:23:42.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.486+0000 7f86227fc640 1 --2- 172.21.15.88:0/2136742016 >> v2:172.21.15.148:3300/0 conn(0x7f862c0c67d0 0x7f862c0c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:42.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.490+0000 7f862b7fe640 1 --2- 172.21.15.88:0/2136742016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f862c06b9f0 0x7f862c06be40 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f862c0caee0 tx=0x7f862401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea0337b54aa890c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:42.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.490+0000 7f862a7fc640 1 -- 172.21.15.88:0/2136742016 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86240ab600 con 0x7f862c06b9f0 2023-12-08T08:23:42.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.490+0000 7f862a7fc640 1 -- 172.21.15.88:0/2136742016 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86240ab760 con 0x7f862c06b9f0 2023-12-08T08:23:42.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.490+0000 7f862a7fc640 1 -- 172.21.15.88:0/2136742016 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86240abaf0 con 0x7f862c06b9f0 2023-12-08T08:23:42.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.490+0000 7f863192a640 1 -- 172.21.15.88:0/2136742016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f862c06b9f0 msgr2=0x7f862c06be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:42.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.490+0000 7f863192a640 1 --2- 172.21.15.88:0/2136742016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f862c06b9f0 0x7f862c06be40 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f862c0caee0 tx=0x7f862401c440 comp rx=0 tx=0).stop 2023-12-08T08:23:42.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.490+0000 7f863192a640 1 -- 172.21.15.88:0/2136742016 shutdown_connections 2023-12-08T08:23:42.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.490+0000 7f863192a640 1 --2- 172.21.15.88:0/2136742016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f862c06b9f0 0x7f862c06be40 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.490+0000 7f863192a640 1 --2- 172.21.15.88:0/2136742016 >> v2:172.21.15.148:3300/0 conn(0x7f862c0c67d0 0x7f862c0c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.490+0000 7f863192a640 1 --2- 172.21.15.88:0/2136742016 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f862c0af4c0 0x7f862c154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.490+0000 7f863192a640 1 -- 172.21.15.88:0/2136742016 >> 172.21.15.88:0/2136742016 conn(0x7f862c0ab9d0 msgr2=0x7f862c0abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:42.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.490+0000 7f863192a640 1 -- 172.21.15.88:0/2136742016 shutdown_connections 2023-12-08T08:23:42.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.490+0000 7f863192a640 1 -- 172.21.15.88:0/2136742016 wait complete. 2023-12-08T08:23:42.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.494+0000 7f863192a640 1 Processor -- start 2023-12-08T08:23:42.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.494+0000 7f863192a640 1 -- start start 2023-12-08T08:23:42.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.494+0000 7f863192a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f862c06b9f0 0x7f862c0c36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:42.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.494+0000 7f863192a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f862c0af4c0 0x7f862c14c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:42.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.494+0000 7f863192a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f862c0c67d0 0x7f862c0c1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:42.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.494+0000 7f863192a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862c1f0870 con 0x7f862c0af4c0 2023-12-08T08:23:42.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.494+0000 7f863192a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862c1eff60 con 0x7f862c06b9f0 2023-12-08T08:23:42.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.494+0000 7f863192a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862c0c3c20 con 0x7f862c0c67d0 2023-12-08T08:23:42.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.494+0000 7f86227fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f862c0af4c0 0x7f862c14c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:42.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.494+0000 7f86227fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f862c0af4c0 0x7f862c14c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36744/0 (socket says 172.21.15.88:36744) 2023-12-08T08:23:42.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.494+0000 7f86227fc640 1 -- 172.21.15.88:0/1962183538 learned_addr learned my addr 172.21.15.88:0/1962183538 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:42.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.494+0000 7f862b7fe640 1 --2- 172.21.15.88:0/1962183538 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f862c0c67d0 0x7f862c0c1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:42.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.494+0000 7f862affd640 1 --2- 172.21.15.88:0/1962183538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f862c06b9f0 0x7f862c0c36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:42.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.494+0000 7f86227fc640 1 -- 172.21.15.88:0/1962183538 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f862c0c67d0 msgr2=0x7f862c0c1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:42.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.494+0000 7f86227fc640 1 --2- 172.21.15.88:0/1962183538 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f862c0c67d0 0x7f862c0c1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.494+0000 7f86227fc640 1 -- 172.21.15.88:0/1962183538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f862c06b9f0 msgr2=0x7f862c0c36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:42.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.494+0000 7f86227fc640 1 --2- 172.21.15.88:0/1962183538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f862c06b9f0 0x7f862c0c36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.494+0000 7f86227fc640 1 -- 172.21.15.88:0/1962183538 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86240094d0 con 0x7f862c0af4c0 2023-12-08T08:23:42.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.494+0000 7f862affd640 1 --2- 172.21.15.88:0/1962183538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f862c06b9f0 0x7f862c0c36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:42.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.494+0000 7f86227fc640 1 --2- 172.21.15.88:0/1962183538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f862c0af4c0 0x7f862c14c020 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f861400cf60 tx=0x7f861400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:42.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.494+0000 7f8628ff9640 1 -- 172.21.15.88:0/1962183538 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861400d840 con 0x7f862c0af4c0 2023-12-08T08:23:42.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.494+0000 7f8628ff9640 1 -- 172.21.15.88:0/1962183538 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861400d9a0 con 0x7f862c0af4c0 2023-12-08T08:23:42.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.494+0000 7f863192a640 1 -- 172.21.15.88:0/1962183538 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f862c14b6e0 con 0x7f862c0af4c0 2023-12-08T08:23:42.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.494+0000 7f8628ff9640 1 -- 172.21.15.88:0/1962183538 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861400dd30 con 0x7f862c0af4c0 2023-12-08T08:23:42.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.494+0000 7f863192a640 1 -- 172.21.15.88:0/1962183538 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f862c1f0490 con 0x7f862c0af4c0 2023-12-08T08:23:42.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.494+0000 7f863192a640 1 -- 172.21.15.88:0/1962183538 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f862c1f09b0 con 0x7f862c0af4c0 2023-12-08T08:23:42.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.498+0000 7f8628ff9640 1 -- 172.21.15.88:0/1962183538 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8614015440 con 0x7f862c0af4c0 2023-12-08T08:23:42.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.498+0000 7f8628ff9640 1 --2- 172.21.15.88:0/1962183538 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f860c066470 0x7f860c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:42.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.498+0000 7f8628ff9640 1 -- 172.21.15.88:0/1962183538 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8614084ac0 con 0x7f862c0af4c0 2023-12-08T08:23:42.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.498+0000 7f862affd640 1 --2- 172.21.15.88:0/1962183538 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f860c066470 0x7f860c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:42.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.498+0000 7f862affd640 1 --2- 172.21.15.88:0/1962183538 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f860c066470 0x7f860c068930 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f861c00b9f0 tx=0x7f861c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:42.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.502+0000 7f8628ff9640 1 -- 172.21.15.88:0/1962183538 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f862c1f09b0 con 0x7f862c0af4c0 2023-12-08T08:23:42.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.654+0000 7f863192a640 1 -- 172.21.15.88:0/1962183538 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f862c1f09b0 con 0x7f862c0af4c0 2023-12-08T08:23:42.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.654+0000 7f8628ff9640 1 -- 172.21.15.88:0/1962183538 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20190 (secure 0 0 0) 0x7f862c1f09b0 con 0x7f862c0af4c0 2023-12-08T08:23:42.660 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:42.660 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":72,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:23:18.903336+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:57.367467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:58.632605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:23:15.029129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:23:16.271716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:23:42.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.658+0000 7f863192a640 1 -- 172.21.15.88:0/1962183538 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f860c066470 msgr2=0x7f860c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:42.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.658+0000 7f863192a640 1 --2- 172.21.15.88:0/1962183538 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f860c066470 0x7f860c068930 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f861c00b9f0 tx=0x7f861c008040 comp rx=0 tx=0).stop 2023-12-08T08:23:42.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.658+0000 7f863192a640 1 -- 172.21.15.88:0/1962183538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f862c0af4c0 msgr2=0x7f862c14c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:42.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.658+0000 7f863192a640 1 --2- 172.21.15.88:0/1962183538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f862c0af4c0 0x7f862c14c020 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f861400cf60 tx=0x7f861400cf90 comp rx=0 tx=0).stop 2023-12-08T08:23:42.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.658+0000 7f863192a640 1 -- 172.21.15.88:0/1962183538 shutdown_connections 2023-12-08T08:23:42.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.658+0000 7f863192a640 1 --2- 172.21.15.88:0/1962183538 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f860c066470 0x7f860c068930 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.658+0000 7f863192a640 1 --2- 172.21.15.88:0/1962183538 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f862c0c67d0 0x7f862c0c1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.658+0000 7f863192a640 1 --2- 172.21.15.88:0/1962183538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f862c0af4c0 0x7f862c14c020 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.658+0000 7f863192a640 1 --2- 172.21.15.88:0/1962183538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f862c06b9f0 0x7f862c0c36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.658+0000 7f863192a640 1 -- 172.21.15.88:0/1962183538 >> 172.21.15.88:0/1962183538 conn(0x7f862c0ab9d0 msgr2=0x7f862c0abdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:42.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.658+0000 7f863192a640 1 -- 172.21.15.88:0/1962183538 shutdown_connections 2023-12-08T08:23:42.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.658+0000 7f863192a640 1 -- 172.21.15.88:0/1962183538 wait complete. 2023-12-08T08:23:42.681 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:22:57.367467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:22:58.632605+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:23:15.029129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:23:16.271716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:23:42.681 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:23:42.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.818+0000 7f2fa65e4640 1 Processor -- start 2023-12-08T08:23:42.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.818+0000 7f2fa65e4640 1 -- start start 2023-12-08T08:23:42.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.818+0000 7f2fa65e4640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2fa00ca710 0x7f2fa00c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:42.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.818+0000 7f2fa65e4640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fa0154e80 0x7f2fa006c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:42.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.818+0000 7f2fa65e4640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa0151e40 con 0x7f2fa00ca330 2023-12-08T08:23:42.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.818+0000 7f2fa65e4640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa00c54b0 con 0x7f2fa00ca710 2023-12-08T08:23:42.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.818+0000 7f2fa65e4640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa006c9c0 con 0x7f2fa0154e80 2023-12-08T08:23:42.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.818+0000 7f2fa55e2640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2fa00ca330 0x7f2fa00c7d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41302/0 (socket says 172.21.15.88:41302) 2023-12-08T08:23:42.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.818+0000 7f2fa55e2640 1 -- 172.21.15.88:0/502744747 learned_addr learned my addr 172.21.15.88:0/502744747 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:42.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.818+0000 7f2f97fff640 1 -- 172.21.15.88:0/502744747 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1880937134 0 0) 0x7f2fa0151e40 con 0x7f2fa00ca330 2023-12-08T08:23:42.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.818+0000 7f2f97fff640 1 -- 172.21.15.88:0/502744747 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f8c003530 con 0x7f2fa00ca330 2023-12-08T08:23:42.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.818+0000 7f2fa5de3640 1 --2- 172.21.15.88:0/502744747 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fa0154e80 0x7f2fa006c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:42.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.818+0000 7f2fa4de1640 1 --2- 172.21.15.88:0/502744747 >> v2:172.21.15.148:3300/0 conn(0x7f2fa00ca710 0x7f2fa00c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:42.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.822+0000 7f2f97fff640 1 -- 172.21.15.88:0/502744747 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2693059988 0 0) 0x7f2f8c003530 con 0x7f2fa00ca330 2023-12-08T08:23:42.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.822+0000 7f2f97fff640 1 -- 172.21.15.88:0/502744747 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fa0154e80 msgr2=0x7f2fa006c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:42.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.822+0000 7f2f97fff640 1 --2- 172.21.15.88:0/502744747 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fa0154e80 0x7f2fa006c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.822+0000 7f2f97fff640 1 -- 172.21.15.88:0/502744747 >> v2:172.21.15.148:3300/0 conn(0x7f2fa00ca710 msgr2=0x7f2fa00c45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:42.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.822+0000 7f2f97fff640 1 --2- 172.21.15.88:0/502744747 >> v2:172.21.15.148:3300/0 conn(0x7f2fa00ca710 0x7f2fa00c45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.822+0000 7f2f97fff640 1 -- 172.21.15.88:0/502744747 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa006b9e0 con 0x7f2fa00ca330 2023-12-08T08:23:42.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.822+0000 7f2f97fff640 1 -- 172.21.15.88:0/502744747 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f2f9c001680 con 0x7f2fa00ca330 2023-12-08T08:23:42.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.822+0000 7f2f97fff640 1 -- 172.21.15.88:0/502744747 >> v1:172.21.15.88:6789/0 conn(0x7f2fa00ca330 legacy=0x7f2fa00c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:42.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.822+0000 7f2f97fff640 1 --2- 172.21.15.88:0/502744747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f8c003980 0x7f2f8c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:42.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.822+0000 7f2f97fff640 1 --2- 172.21.15.88:0/502744747 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fa0154e80 0x7f2f8c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:42.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.822+0000 7f2f97fff640 1 --2- 172.21.15.88:0/502744747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f8c004d10 0x7f2f8c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:42.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.822+0000 7f2f97fff640 1 -- 172.21.15.88:0/502744747 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa00c54b0 con 0x7f2f8c003980 2023-12-08T08:23:42.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.822+0000 7f2f97fff640 1 -- 172.21.15.88:0/502744747 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa006c9c0 con 0x7f2f8c004d10 2023-12-08T08:23:42.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.822+0000 7f2f97fff640 1 -- 172.21.15.88:0/502744747 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c00baf0 con 0x7f2fa0154e80 2023-12-08T08:23:42.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.822+0000 7f2fa55e2640 1 --2- 172.21.15.88:0/502744747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f8c003980 0x7f2f8c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:42.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.822+0000 7f2fa4de1640 1 --2- 172.21.15.88:0/502744747 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fa0154e80 0x7f2f8c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:42.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.822+0000 7f2fa5de3640 1 --2- 172.21.15.88:0/502744747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f8c004d10 0x7f2f8c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:42.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.822+0000 7f2fa55e2640 1 -- 172.21.15.88:0/502744747 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fa0154e80 msgr2=0x7f2f8c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:42.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.822+0000 7f2fa55e2640 1 --2- 172.21.15.88:0/502744747 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fa0154e80 0x7f2f8c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.822+0000 7f2fa55e2640 1 -- 172.21.15.88:0/502744747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f8c004d10 msgr2=0x7f2f8c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:42.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.822+0000 7f2fa55e2640 1 --2- 172.21.15.88:0/502744747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f8c004d10 0x7f2f8c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.822+0000 7f2fa55e2640 1 -- 172.21.15.88:0/502744747 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c003530 con 0x7f2f8c003980 2023-12-08T08:23:42.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.822+0000 7f2fa5de3640 1 --2- 172.21.15.88:0/502744747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f8c004d10 0x7f2f8c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:42.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.822+0000 7f2fa55e2640 1 --2- 172.21.15.88:0/502744747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f8c003980 0x7f2f8c003da0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c00c240 tx=0x7f2f9c01f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddcf4ee5b34ff47f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:42.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.826+0000 7f2f97fff640 1 -- 172.21.15.88:0/502744747 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c005ae0 con 0x7f2f8c003980 2023-12-08T08:23:42.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.826+0000 7f2f97fff640 1 -- 172.21.15.88:0/502744747 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9c0ab070 con 0x7f2f8c003980 2023-12-08T08:23:42.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.826+0000 7f2f97fff640 1 -- 172.21.15.88:0/502744747 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c005ea0 con 0x7f2f8c003980 2023-12-08T08:23:42.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.826+0000 7f2fa65e4640 1 -- 172.21.15.88:0/502744747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f8c003980 msgr2=0x7f2f8c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:42.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.826+0000 7f2fa65e4640 1 --2- 172.21.15.88:0/502744747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f8c003980 0x7f2f8c003da0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c00c240 tx=0x7f2f9c01f3d0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.826+0000 7f2fa5de3640 1 -- 172.21.15.88:0/502744747 reap_dead start 2023-12-08T08:23:42.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.826+0000 7f2fa65e4640 1 -- 172.21.15.88:0/502744747 shutdown_connections 2023-12-08T08:23:42.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.826+0000 7f2fa65e4640 1 -- 172.21.15.88:0/502744747 >> 172.21.15.88:0/502744747 conn(0x7f2fa00abdb0 msgr2=0x7f2fa00c9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:42.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.826+0000 7f2fa65e4640 1 -- 172.21.15.88:0/502744747 shutdown_connections 2023-12-08T08:23:42.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.826+0000 7f2fa65e4640 1 -- 172.21.15.88:0/502744747 wait complete. 2023-12-08T08:23:42.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.826+0000 7f2fa65e4640 1 Processor -- start 2023-12-08T08:23:42.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.826+0000 7f2fa65e4640 1 -- start start 2023-12-08T08:23:42.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.826+0000 7f2fa65e4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f8c003980 0x7f2fa00c2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:42.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.826+0000 7f2fa65e4640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fa00c3870 0x7f2fa01ed200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:42.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.826+0000 7f2fa65e4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fa01ed740 0x7f2fa014add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:42.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.826+0000 7f2fa65e4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa01edea0 con 0x7f2fa01ed740 2023-12-08T08:23:42.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.826+0000 7f2fa65e4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa00c0ac0 con 0x7f2f8c003980 2023-12-08T08:23:42.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.826+0000 7f2fa65e4640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa00c32d0 con 0x7f2fa00c3870 2023-12-08T08:23:42.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.826+0000 7f2fa5de3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fa01ed740 0x7f2fa014add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:42.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.826+0000 7f2fa5de3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fa01ed740 0x7f2fa014add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36754/0 (socket says 172.21.15.88:36754) 2023-12-08T08:23:42.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.826+0000 7f2fa5de3640 1 -- 172.21.15.88:0/3829371682 learned_addr learned my addr 172.21.15.88:0/3829371682 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:42.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.826+0000 7f2fa55e2640 1 --2- 172.21.15.88:0/3829371682 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f8c003980 0x7f2fa00c2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:42.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.826+0000 7f2fa4de1640 1 --2- 172.21.15.88:0/3829371682 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fa00c3870 0x7f2fa01ed200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:42.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.830+0000 7f2fa5de3640 1 -- 172.21.15.88:0/3829371682 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fa00c3870 msgr2=0x7f2fa01ed200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:42.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.830+0000 7f2fa5de3640 1 --2- 172.21.15.88:0/3829371682 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fa00c3870 0x7f2fa01ed200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.830+0000 7f2fa5de3640 1 -- 172.21.15.88:0/3829371682 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f8c003980 msgr2=0x7f2fa00c2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:42.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.830+0000 7f2fa5de3640 1 --2- 172.21.15.88:0/3829371682 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f8c003980 0x7f2fa00c2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.830+0000 7f2fa5de3640 1 -- 172.21.15.88:0/3829371682 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa01edbc0 con 0x7f2fa01ed740 2023-12-08T08:23:42.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.830+0000 7f2fa5de3640 1 --2- 172.21.15.88:0/3829371682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fa01ed740 0x7f2fa014add0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0155260 tx=0x7f2f98004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:42.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.830+0000 7f2f95ffb640 1 -- 172.21.15.88:0/3829371682 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f98007cb0 con 0x7f2fa01ed740 2023-12-08T08:23:42.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.830+0000 7f2f95ffb640 1 -- 172.21.15.88:0/3829371682 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9800f050 con 0x7f2fa01ed740 2023-12-08T08:23:42.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.830+0000 7f2fa65e4640 1 -- 172.21.15.88:0/3829371682 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa0155c80 con 0x7f2fa01ed740 2023-12-08T08:23:42.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.830+0000 7f2f95ffb640 1 -- 172.21.15.88:0/3829371682 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f98014650 con 0x7f2fa01ed740 2023-12-08T08:23:42.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.830+0000 7f2fa65e4640 1 -- 172.21.15.88:0/3829371682 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa014b4e0 con 0x7f2fa01ed740 2023-12-08T08:23:42.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.830+0000 7f2fa65e4640 1 -- 172.21.15.88:0/3829371682 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa0155ae0 con 0x7f2fa01ed740 2023-12-08T08:23:42.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.830+0000 7f2f95ffb640 1 -- 172.21.15.88:0/3829371682 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2f980147b0 con 0x7f2fa01ed740 2023-12-08T08:23:42.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.830+0000 7f2f95ffb640 1 --2- 172.21.15.88:0/3829371682 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2f84066470 0x7f2f84068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:42.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.830+0000 7f2f95ffb640 1 -- 172.21.15.88:0/3829371682 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2f98084600 con 0x7f2fa01ed740 2023-12-08T08:23:42.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.830+0000 7f2fa55e2640 1 --2- 172.21.15.88:0/3829371682 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2f84066470 0x7f2f84068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:42.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.834+0000 7f2fa55e2640 1 --2- 172.21.15.88:0/3829371682 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2f84066470 0x7f2f84068930 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c0ae000 tx=0x7f2f9c0b4040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:42.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.834+0000 7f2f95ffb640 1 -- 172.21.15.88:0/3829371682 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2fa0155ae0 con 0x7f2fa01ed740 2023-12-08T08:23:42.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.986+0000 7f2fa65e4640 1 -- 172.21.15.88:0/3829371682 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2fa0155ae0 con 0x7f2fa01ed740 2023-12-08T08:23:42.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.986+0000 7f2f95ffb640 1 -- 172.21.15.88:0/3829371682 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2fa0155ae0 con 0x7f2fa01ed740 2023-12-08T08:23:42.990 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:23:42.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.986+0000 7f2fa65e4640 1 -- 172.21.15.88:0/3829371682 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2f84066470 msgr2=0x7f2f84068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:42.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.986+0000 7f2fa65e4640 1 --2- 172.21.15.88:0/3829371682 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2f84066470 0x7f2f84068930 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c0ae000 tx=0x7f2f9c0b4040 comp rx=0 tx=0).stop 2023-12-08T08:23:42.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.986+0000 7f2fa65e4640 1 -- 172.21.15.88:0/3829371682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fa01ed740 msgr2=0x7f2fa014add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:42.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.986+0000 7f2fa65e4640 1 --2- 172.21.15.88:0/3829371682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fa01ed740 0x7f2fa014add0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0155260 tx=0x7f2f98004840 comp rx=0 tx=0).stop 2023-12-08T08:23:42.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.986+0000 7f2fa65e4640 1 -- 172.21.15.88:0/3829371682 shutdown_connections 2023-12-08T08:23:42.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.986+0000 7f2fa65e4640 1 --2- 172.21.15.88:0/3829371682 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2f84066470 0x7f2f84068930 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.986+0000 7f2fa65e4640 1 --2- 172.21.15.88:0/3829371682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fa01ed740 0x7f2fa014add0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.986+0000 7f2fa65e4640 1 --2- 172.21.15.88:0/3829371682 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2fa00c3870 0x7f2fa01ed200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.986+0000 7f2fa65e4640 1 --2- 172.21.15.88:0/3829371682 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f8c003980 0x7f2fa00c2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:42.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.990+0000 7f2fa65e4640 1 -- 172.21.15.88:0/3829371682 >> 172.21.15.88:0/3829371682 conn(0x7f2fa00abdb0 msgr2=0x7f2fa0152230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:42.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.990+0000 7f2fa65e4640 1 -- 172.21.15.88:0/3829371682 shutdown_connections 2023-12-08T08:23:42.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:42.990+0000 7f2fa65e4640 1 -- 172.21.15.88:0/3829371682 wait complete. 2023-12-08T08:23:43.012 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:23:43.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.146+0000 7f3b5e6c9640 1 Processor -- start 2023-12-08T08:23:43.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.146+0000 7f3b5e6c9640 1 -- start start 2023-12-08T08:23:43.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.146+0000 7f3b5e6c9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3b5814fc30 0x7f3b580c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:43.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.146+0000 7f3b5e6c9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b58152910 con 0x7f3b5806d840 2023-12-08T08:23:43.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.150+0000 7f3b5e6c9640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b58152bf0 con 0x7f3b5814f850 2023-12-08T08:23:43.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.150+0000 7f3b5e6c9640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b580c2240 con 0x7f3b5814fc30 2023-12-08T08:23:43.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.150+0000 7f3b577fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3b5814fc30 0x7f3b580c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:43.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.150+0000 7f3b5cc66640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3b5806d840 0x7f3b580c4210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41312/0 (socket says 172.21.15.88:41312) 2023-12-08T08:23:43.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.150+0000 7f3b5cc66640 1 -- 172.21.15.88:0/1966697111 learned_addr learned my addr 172.21.15.88:0/1966697111 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:43.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.150+0000 7f3b577fe640 1 -- 172.21.15.88:0/1966697111 >> v1:172.21.15.148:6789/0 conn(0x7f3b5814f850 legacy=0x7f3b580aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:43.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.150+0000 7f3b577fe640 1 -- 172.21.15.88:0/1966697111 >> v1:172.21.15.88:6789/0 conn(0x7f3b5806d840 legacy=0x7f3b580c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:43.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.150+0000 7f3b577fe640 1 -- 172.21.15.88:0/1966697111 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b58152ed0 con 0x7f3b5814fc30 2023-12-08T08:23:43.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.150+0000 7f3b577fe640 1 --2- 172.21.15.88:0/1966697111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b5814fc30 0x7f3b580c3cd0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0097c0 tx=0x7f3b4c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b868fcb687ad3a9a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:43.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.150+0000 7f3b56ffd640 1 -- 172.21.15.88:0/1966697111 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0a6040 con 0x7f3b5814fc30 2023-12-08T08:23:43.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.150+0000 7f3b56ffd640 1 -- 172.21.15.88:0/1966697111 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c0aa600 con 0x7f3b5814fc30 2023-12-08T08:23:43.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.150+0000 7f3b56ffd640 1 -- 172.21.15.88:0/1966697111 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0aa990 con 0x7f3b5814fc30 2023-12-08T08:23:43.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.154+0000 7f3b5e6c9640 1 -- 172.21.15.88:0/1966697111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b5814fc30 msgr2=0x7f3b580c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:43.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.154+0000 7f3b5e6c9640 1 --2- 172.21.15.88:0/1966697111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b5814fc30 0x7f3b580c3cd0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0097c0 tx=0x7f3b4c01c480 comp rx=0 tx=0).stop 2023-12-08T08:23:43.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.154+0000 7f3b5e6c9640 1 -- 172.21.15.88:0/1966697111 shutdown_connections 2023-12-08T08:23:43.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.154+0000 7f3b5e6c9640 1 --2- 172.21.15.88:0/1966697111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b5814fc30 0x7f3b580c3cd0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:43.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.154+0000 7f3b5e6c9640 1 -- 172.21.15.88:0/1966697111 >> 172.21.15.88:0/1966697111 conn(0x7f3b580c59f0 msgr2=0x7f3b580c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:43.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.154+0000 7f3b5e6c9640 1 -- 172.21.15.88:0/1966697111 shutdown_connections 2023-12-08T08:23:43.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.154+0000 7f3b5e6c9640 1 -- 172.21.15.88:0/1966697111 wait complete. 2023-12-08T08:23:43.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.154+0000 7f3b5e6c9640 1 Processor -- start 2023-12-08T08:23:43.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.154+0000 7f3b5e6c9640 1 -- start start 2023-12-08T08:23:43.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.154+0000 7f3b5e6c9640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b5806d840 0x7f3b580c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:43.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.154+0000 7f3b5e6c9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b5814f850 0x7f3b58155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:43.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.154+0000 7f3b5e6c9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b5814fc30 0x7f3b58156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:43.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.154+0000 7f3b5e6c9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580719c0 con 0x7f3b5814fc30 2023-12-08T08:23:43.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.154+0000 7f3b5e6c9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5806fac0 con 0x7f3b5814f850 2023-12-08T08:23:43.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.154+0000 7f3b5e6c9640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b581568b0 con 0x7f3b5806d840 2023-12-08T08:23:43.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.154+0000 7f3b5cc66640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b5814fc30 0x7f3b58156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:43.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.154+0000 7f3b5cc66640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b5814fc30 0x7f3b58156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36768/0 (socket says 172.21.15.88:36768) 2023-12-08T08:23:43.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.154+0000 7f3b5cc66640 1 -- 172.21.15.88:0/700706628 learned_addr learned my addr 172.21.15.88:0/700706628 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:43.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.154+0000 7f3b577fe640 1 --2- 172.21.15.88:0/700706628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b5814f850 0x7f3b58155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:43.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.154+0000 7f3b57fff640 1 --2- 172.21.15.88:0/700706628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b5806d840 0x7f3b580c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:43.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.154+0000 7f3b5cc66640 1 -- 172.21.15.88:0/700706628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b5806d840 msgr2=0x7f3b580c3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:43.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.154+0000 7f3b5cc66640 1 --2- 172.21.15.88:0/700706628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b5806d840 0x7f3b580c3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:43.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.154+0000 7f3b5cc66640 1 -- 172.21.15.88:0/700706628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b5814f850 msgr2=0x7f3b58155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:43.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.154+0000 7f3b5cc66640 1 --2- 172.21.15.88:0/700706628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b5814f850 0x7f3b58155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:43.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.154+0000 7f3b5cc66640 1 -- 172.21.15.88:0/700706628 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4c009420 con 0x7f3b5814fc30 2023-12-08T08:23:43.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.158+0000 7f3b5cc66640 1 --2- 172.21.15.88:0/700706628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b5814fc30 0x7f3b58156370 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f3b5000cbc0 tx=0x7f3b5000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:43.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.158+0000 7f3b54ff9640 1 -- 172.21.15.88:0/700706628 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5000ad40 con 0x7f3b5814fc30 2023-12-08T08:23:43.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.158+0000 7f3b54ff9640 1 -- 172.21.15.88:0/700706628 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b50012400 con 0x7f3b5814fc30 2023-12-08T08:23:43.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.158+0000 7f3b5e6c9640 1 -- 172.21.15.88:0/700706628 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b581452d0 con 0x7f3b5814fc30 2023-12-08T08:23:43.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.158+0000 7f3b54ff9640 1 -- 172.21.15.88:0/700706628 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5000aea0 con 0x7f3b5814fc30 2023-12-08T08:23:43.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.158+0000 7f3b5e6c9640 1 -- 172.21.15.88:0/700706628 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b58145890 con 0x7f3b5814fc30 2023-12-08T08:23:43.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.158+0000 7f3b5e6c9640 1 -- 172.21.15.88:0/700706628 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b58067630 con 0x7f3b5814fc30 2023-12-08T08:23:43.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.158+0000 7f3b54ff9640 1 -- 172.21.15.88:0/700706628 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3b50007070 con 0x7f3b5814fc30 2023-12-08T08:23:43.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.158+0000 7f3b54ff9640 1 --2- 172.21.15.88:0/700706628 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3b44066470 0x7f3b44068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:43.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.158+0000 7f3b54ff9640 1 -- 172.21.15.88:0/700706628 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3b50084150 con 0x7f3b5814fc30 2023-12-08T08:23:43.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.158+0000 7f3b57fff640 1 --2- 172.21.15.88:0/700706628 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3b44066470 0x7f3b44068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:43.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.158+0000 7f3b57fff640 1 --2- 172.21.15.88:0/700706628 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3b44066470 0x7f3b44068930 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3b48000f70 tx=0x7f3b48009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:43.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.162+0000 7f3b54ff9640 1 -- 172.21.15.88:0/700706628 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3b50051280 con 0x7f3b5814fc30 2023-12-08T08:23:43.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.314+0000 7f3b5e6c9640 1 -- 172.21.15.88:0/700706628 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3b5806fc00 con 0x7f3b5814fc30 2023-12-08T08:23:43.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.314+0000 7f3b54ff9640 1 -- 172.21.15.88:0/700706628 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3b500548a0 con 0x7f3b5814fc30 2023-12-08T08:23:43.318 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:23:43.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.314+0000 7f3b5e6c9640 1 -- 172.21.15.88:0/700706628 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3b44066470 msgr2=0x7f3b44068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:43.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.314+0000 7f3b5e6c9640 1 --2- 172.21.15.88:0/700706628 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3b44066470 0x7f3b44068930 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3b48000f70 tx=0x7f3b48009040 comp rx=0 tx=0).stop 2023-12-08T08:23:43.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.314+0000 7f3b5e6c9640 1 -- 172.21.15.88:0/700706628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b5814fc30 msgr2=0x7f3b58156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:43.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.314+0000 7f3b5e6c9640 1 --2- 172.21.15.88:0/700706628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b5814fc30 0x7f3b58156370 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f3b5000cbc0 tx=0x7f3b5000a430 comp rx=0 tx=0).stop 2023-12-08T08:23:43.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.314+0000 7f3b5e6c9640 1 -- 172.21.15.88:0/700706628 shutdown_connections 2023-12-08T08:23:43.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.314+0000 7f3b5e6c9640 1 --2- 172.21.15.88:0/700706628 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3b44066470 0x7f3b44068930 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:43.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.314+0000 7f3b5e6c9640 1 --2- 172.21.15.88:0/700706628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b5814fc30 0x7f3b58156370 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:43.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.314+0000 7f3b5e6c9640 1 --2- 172.21.15.88:0/700706628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b5814f850 0x7f3b58155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:43.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.314+0000 7f3b5e6c9640 1 --2- 172.21.15.88:0/700706628 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3b5806d840 0x7f3b580c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:43.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.314+0000 7f3b5e6c9640 1 -- 172.21.15.88:0/700706628 >> 172.21.15.88:0/700706628 conn(0x7f3b580c59f0 msgr2=0x7f3b58150aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:43.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.314+0000 7f3b5e6c9640 1 -- 172.21.15.88:0/700706628 shutdown_connections 2023-12-08T08:23:43.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.314+0000 7f3b5e6c9640 1 -- 172.21.15.88:0/700706628 wait complete. 2023-12-08T08:23:43.339 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:23:43.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.474+0000 7fcca7279640 1 Processor -- start 2023-12-08T08:23:43.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.474+0000 7fcca7279640 1 -- start start 2023-12-08T08:23:43.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.474+0000 7fcca7279640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcca00bf2d0 0x7fcca0151970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:43.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.474+0000 7fcca7279640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca0158780 con 0x7fcca00c6030 2023-12-08T08:23:43.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.474+0000 7fcca7279640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca0157b70 con 0x7fcca00c98f0 2023-12-08T08:23:43.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.474+0000 7fcca7279640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca00c0300 con 0x7fcca00bf2d0 2023-12-08T08:23:43.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.474+0000 7fcca4814640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcca00c6030 0x7fcca00c7cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41322/0 (socket says 172.21.15.88:41322) 2023-12-08T08:23:43.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.474+0000 7fcca4814640 1 -- 172.21.15.88:0/3859381978 learned_addr learned my addr 172.21.15.88:0/3859381978 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:43.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.474+0000 7fcca5015640 1 --2- 172.21.15.88:0/3859381978 >> v2:172.21.15.148:3300/0 conn(0x7fcca00bf2d0 0x7fcca0151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:43.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.474+0000 7fcc97fff640 1 -- 172.21.15.88:0/3859381978 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831691279 0 0) 0x7fcca0158780 con 0x7fcca00c6030 2023-12-08T08:23:43.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.474+0000 7fcc97fff640 1 -- 172.21.15.88:0/3859381978 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc8c003530 con 0x7fcca00c6030 2023-12-08T08:23:43.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.474+0000 7fcc97fff640 1 -- 172.21.15.88:0/3859381978 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1299699337 0 0) 0x7fcc8c003530 con 0x7fcca00c6030 2023-12-08T08:23:43.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.474+0000 7fcc97fff640 1 -- 172.21.15.88:0/3859381978 >> v2:172.21.15.148:3300/0 conn(0x7fcca00bf2d0 msgr2=0x7fcca0151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:43.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.474+0000 7fcc97fff640 1 --2- 172.21.15.88:0/3859381978 >> v2:172.21.15.148:3300/0 conn(0x7fcca00bf2d0 0x7fcca0151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:43.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.474+0000 7fcc97fff640 1 -- 172.21.15.88:0/3859381978 >> v1:172.21.15.148:6789/0 conn(0x7fcca00c98f0 legacy=0x7fcca015ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:43.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.474+0000 7fcc97fff640 1 -- 172.21.15.88:0/3859381978 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca0157e50 con 0x7fcca00c6030 2023-12-08T08:23:43.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.474+0000 7fcc97fff640 1 -- 172.21.15.88:0/3859381978 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7fcc90001680 con 0x7fcca00c6030 2023-12-08T08:23:43.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.478+0000 7fcc97fff640 1 -- 172.21.15.88:0/3859381978 >> v1:172.21.15.88:6789/0 conn(0x7fcca00c6030 legacy=0x7fcca00c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:43.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.478+0000 7fcc97fff640 1 --2- 172.21.15.88:0/3859381978 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc8c003980 0x7fcc8c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:43.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.478+0000 7fcc97fff640 1 --2- 172.21.15.88:0/3859381978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc8c0047d0 0x7fcc8c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:43.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.478+0000 7fcc97fff640 1 --2- 172.21.15.88:0/3859381978 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc8c005190 0x7fcc8c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:43.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.478+0000 7fcc97fff640 1 -- 172.21.15.88:0/3859381978 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c00c000 con 0x7fcc8c003980 2023-12-08T08:23:43.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.478+0000 7fcc97fff640 1 -- 172.21.15.88:0/3859381978 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c00c170 con 0x7fcc8c0047d0 2023-12-08T08:23:43.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.478+0000 7fcc97fff640 1 -- 172.21.15.88:0/3859381978 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c00c330 con 0x7fcc8c005190 2023-12-08T08:23:43.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.478+0000 7fcca5015640 1 --2- 172.21.15.88:0/3859381978 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc8c003980 0x7fcc8c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:43.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.478+0000 7fcca4814640 1 --2- 172.21.15.88:0/3859381978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc8c0047d0 0x7fcc8c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:43.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.478+0000 7fcca5015640 1 -- 172.21.15.88:0/3859381978 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc8c005190 msgr2=0x7fcc8c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:43.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.478+0000 7fcca5816640 1 --2- 172.21.15.88:0/3859381978 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc8c005190 0x7fcc8c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:43.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.478+0000 7fcca5015640 1 --2- 172.21.15.88:0/3859381978 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc8c005190 0x7fcc8c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:43.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.478+0000 7fcca5015640 1 -- 172.21.15.88:0/3859381978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc8c0047d0 msgr2=0x7fcc8c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:43.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.478+0000 7fcca5015640 1 --2- 172.21.15.88:0/3859381978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc8c0047d0 0x7fcc8c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:43.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.478+0000 7fcca5015640 1 -- 172.21.15.88:0/3859381978 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8c003530 con 0x7fcc8c003980 2023-12-08T08:23:43.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.478+0000 7fcca4814640 1 --2- 172.21.15.88:0/3859381978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc8c0047d0 0x7fcc8c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:43.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.478+0000 7fcca5816640 1 --2- 172.21.15.88:0/3859381978 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc8c005190 0x7fcc8c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:43.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.478+0000 7fcca5816640 1 -- 172.21.15.88:0/3859381978 reap_dead start 2023-12-08T08:23:43.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.478+0000 7fcca5015640 1 --2- 172.21.15.88:0/3859381978 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc8c003980 0x7fcc8c003da0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c009ae0 tx=0x7fcc9c01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca415397e4c5737 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:43.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.478+0000 7fcc97fff640 1 -- 172.21.15.88:0/3859381978 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c0a55f0 con 0x7fcc8c003980 2023-12-08T08:23:43.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.478+0000 7fcc97fff640 1 -- 172.21.15.88:0/3859381978 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9c0a5750 con 0x7fcc8c003980 2023-12-08T08:23:43.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.478+0000 7fcc97fff640 1 -- 172.21.15.88:0/3859381978 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c0a5b00 con 0x7fcc8c003980 2023-12-08T08:23:43.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.482+0000 7fcca7279640 1 -- 172.21.15.88:0/3859381978 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc8c003980 msgr2=0x7fcc8c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:43.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.482+0000 7fcca7279640 1 --2- 172.21.15.88:0/3859381978 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc8c003980 0x7fcc8c003da0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c009ae0 tx=0x7fcc9c01ca20 comp rx=0 tx=0).stop 2023-12-08T08:23:43.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.482+0000 7fcca7279640 1 -- 172.21.15.88:0/3859381978 shutdown_connections 2023-12-08T08:23:43.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.482+0000 7fcca7279640 1 --2- 172.21.15.88:0/3859381978 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc8c003980 0x7fcc8c003da0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:43.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.482+0000 7fcca7279640 1 -- 172.21.15.88:0/3859381978 >> 172.21.15.88:0/3859381978 conn(0x7fcca00c9dc0 msgr2=0x7fcca00ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:43.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.482+0000 7fcca7279640 1 -- 172.21.15.88:0/3859381978 shutdown_connections 2023-12-08T08:23:43.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.482+0000 7fcca7279640 1 -- 172.21.15.88:0/3859381978 wait complete. 2023-12-08T08:23:43.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.482+0000 7fcca7279640 1 Processor -- start 2023-12-08T08:23:43.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.482+0000 7fcca7279640 1 -- start start 2023-12-08T08:23:43.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.482+0000 7fcca7279640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc8c003980 0x7fcca014bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:43.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.482+0000 7fcca7279640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcca00ab220 0x7fcca01e25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:43.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.482+0000 7fcca7279640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcca01ed370 0x7fcca00a99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:43.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.482+0000 7fcca7279640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca006b2a0 con 0x7fcca00ab220 2023-12-08T08:23:43.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.482+0000 7fcca7279640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca006b4f0 con 0x7fcca01ed370 2023-12-08T08:23:43.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.482+0000 7fcca7279640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca006b7d0 con 0x7fcc8c003980 2023-12-08T08:23:43.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.482+0000 7fcca4814640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcca00ab220 0x7fcca01e25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:43.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.482+0000 7fcca4814640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcca00ab220 0x7fcca01e25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36798/0 (socket says 172.21.15.88:36798) 2023-12-08T08:23:43.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.482+0000 7fcca4814640 1 -- 172.21.15.88:0/3540633804 learned_addr learned my addr 172.21.15.88:0/3540633804 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:43.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.482+0000 7fcca5816640 1 --2- 172.21.15.88:0/3540633804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcca01ed370 0x7fcca00a99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:43.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.482+0000 7fcca5015640 1 --2- 172.21.15.88:0/3540633804 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc8c003980 0x7fcca014bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:43.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.482+0000 7fcca4814640 1 -- 172.21.15.88:0/3540633804 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc8c003980 msgr2=0x7fcca014bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:43.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.482+0000 7fcca4814640 1 --2- 172.21.15.88:0/3540633804 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc8c003980 0x7fcca014bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:43.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.482+0000 7fcca4814640 1 -- 172.21.15.88:0/3540633804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcca01ed370 msgr2=0x7fcca00a99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:43.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.482+0000 7fcca4814640 1 --2- 172.21.15.88:0/3540633804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcca01ed370 0x7fcca00a99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:43.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.482+0000 7fcca4814640 1 -- 172.21.15.88:0/3540633804 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca01ece50 con 0x7fcca00ab220 2023-12-08T08:23:43.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.486+0000 7fcca4814640 1 --2- 172.21.15.88:0/3540633804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcca00ab220 0x7fcca01e25f0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fcc90000f70 tx=0x7fcc9000ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:43.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.486+0000 7fcc95ffb640 1 -- 172.21.15.88:0/3540633804 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc90004a00 con 0x7fcca00ab220 2023-12-08T08:23:43.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.486+0000 7fcc95ffb640 1 -- 172.21.15.88:0/3540633804 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc90004b60 con 0x7fcca00ab220 2023-12-08T08:23:43.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.486+0000 7fcc95ffb640 1 -- 172.21.15.88:0/3540633804 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc90005030 con 0x7fcca00ab220 2023-12-08T08:23:43.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.486+0000 7fcca7279640 1 -- 172.21.15.88:0/3540633804 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca006c7a0 con 0x7fcca00ab220 2023-12-08T08:23:43.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.486+0000 7fcca7279640 1 -- 172.21.15.88:0/3540633804 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca01ecb40 con 0x7fcca00ab220 2023-12-08T08:23:43.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.486+0000 7fcca7279640 1 -- 172.21.15.88:0/3540633804 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca0067630 con 0x7fcca00ab220 2023-12-08T08:23:43.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.486+0000 7fcc95ffb640 1 -- 172.21.15.88:0/3540633804 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcc90005190 con 0x7fcca00ab220 2023-12-08T08:23:43.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.486+0000 7fcc95ffb640 1 --2- 172.21.15.88:0/3540633804 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcc84066470 0x7fcc84068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:43.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.486+0000 7fcc95ffb640 1 -- 172.21.15.88:0/3540633804 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcc90083c10 con 0x7fcca00ab220 2023-12-08T08:23:43.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.486+0000 7fcca5015640 1 --2- 172.21.15.88:0/3540633804 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcc84066470 0x7fcc84068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:43.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.490+0000 7fcca5015640 1 --2- 172.21.15.88:0/3540633804 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcc84066470 0x7fcc84068930 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0af000 tx=0x7fcc9c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:43.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.490+0000 7fcc95ffb640 1 -- 172.21.15.88:0/3540633804 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcc90050e70 con 0x7fcca00ab220 2023-12-08T08:23:43.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.642+0000 7fcca7279640 1 -- 172.21.15.88:0/3540633804 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcca00c82a0 con 0x7fcca00ab220 2023-12-08T08:23:43.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.642+0000 7fcc95ffb640 1 -- 172.21.15.88:0/3540633804 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcc90019070 con 0x7fcca00ab220 2023-12-08T08:23:43.647 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:23:43.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.646+0000 7fcca7279640 1 -- 172.21.15.88:0/3540633804 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcc84066470 msgr2=0x7fcc84068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:43.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.646+0000 7fcca7279640 1 --2- 172.21.15.88:0/3540633804 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcc84066470 0x7fcc84068930 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0af000 tx=0x7fcc9c008040 comp rx=0 tx=0).stop 2023-12-08T08:23:43.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.646+0000 7fcca7279640 1 -- 172.21.15.88:0/3540633804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcca00ab220 msgr2=0x7fcca01e25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:43.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.646+0000 7fcca7279640 1 --2- 172.21.15.88:0/3540633804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcca00ab220 0x7fcca01e25f0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fcc90000f70 tx=0x7fcc9000ef80 comp rx=0 tx=0).stop 2023-12-08T08:23:43.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.646+0000 7fcca7279640 1 -- 172.21.15.88:0/3540633804 shutdown_connections 2023-12-08T08:23:43.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.646+0000 7fcca7279640 1 --2- 172.21.15.88:0/3540633804 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fcc84066470 0x7fcc84068930 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:43.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.646+0000 7fcca7279640 1 --2- 172.21.15.88:0/3540633804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcca01ed370 0x7fcca00a99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:43.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.646+0000 7fcca7279640 1 --2- 172.21.15.88:0/3540633804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcca00ab220 0x7fcca01e25f0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:43.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.646+0000 7fcca7279640 1 --2- 172.21.15.88:0/3540633804 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fcc8c003980 0x7fcca014bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:43.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.646+0000 7fcca7279640 1 -- 172.21.15.88:0/3540633804 >> 172.21.15.88:0/3540633804 conn(0x7fcca00c9dc0 msgr2=0x7fcca0147e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:43.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.646+0000 7fcca7279640 1 -- 172.21.15.88:0/3540633804 shutdown_connections 2023-12-08T08:23:43.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.646+0000 7fcca7279640 1 -- 172.21.15.88:0/3540633804 wait complete. 2023-12-08T08:23:43.668 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:23:43.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.806+0000 7fa52465a640 1 Processor -- start 2023-12-08T08:23:43.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.806+0000 7fa52465a640 1 -- start start 2023-12-08T08:23:43.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.806+0000 7fa52465a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa51c0c5300 0x7fa51c0a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:43.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.806+0000 7fa52465a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa51c0a4e20 con 0x7fa51c14b1e0 2023-12-08T08:23:43.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.806+0000 7fa52465a640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa51c0a50e0 con 0x7fa51c1548c0 2023-12-08T08:23:43.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.806+0000 7fa52465a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa51c0c0f00 con 0x7fa51c0c5300 2023-12-08T08:23:43.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.806+0000 7fa5223f6640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa51c14b1e0 0x7fa51c0c1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41324/0 (socket says 172.21.15.88:41324) 2023-12-08T08:23:43.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.806+0000 7fa5223f6640 1 -- 172.21.15.88:0/522373381 learned_addr learned my addr 172.21.15.88:0/522373381 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:43.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.806+0000 7fa521bf5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa51c0c5300 0x7fa51c0a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:43.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.806+0000 7fa521bf5640 1 -- 172.21.15.88:0/522373381 >> v1:172.21.15.148:6789/0 conn(0x7fa51c1548c0 legacy=0x7fa51c154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:43.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.806+0000 7fa521bf5640 1 -- 172.21.15.88:0/522373381 >> v1:172.21.15.88:6789/0 conn(0x7fa51c14b1e0 legacy=0x7fa51c0c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:43.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.806+0000 7fa5213f4640 1 -- 172.21.15.88:0/522373381 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1456820813 0 0) 0x7fa51c0a4e20 con 0x7fa51c14b1e0 2023-12-08T08:23:43.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.806+0000 7fa521bf5640 1 -- 172.21.15.88:0/522373381 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51c0c11e0 con 0x7fa51c0c5300 2023-12-08T08:23:43.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.810+0000 7fa521bf5640 1 --2- 172.21.15.88:0/522373381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa51c0c5300 0x7fa51c0a9c30 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0097c0 tx=0x7fa50c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae405d3b4e774f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:43.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.810+0000 7fa5213f4640 1 -- 172.21.15.88:0/522373381 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c0ab600 con 0x7fa51c0c5300 2023-12-08T08:23:43.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.810+0000 7fa5213f4640 1 -- 172.21.15.88:0/522373381 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50c0a7050 con 0x7fa51c0c5300 2023-12-08T08:23:43.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.810+0000 7fa5213f4640 1 -- 172.21.15.88:0/522373381 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c0ab980 con 0x7fa51c0c5300 2023-12-08T08:23:43.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.810+0000 7fa52465a640 1 -- 172.21.15.88:0/522373381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa51c0c5300 msgr2=0x7fa51c0a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:43.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.810+0000 7fa52465a640 1 --2- 172.21.15.88:0/522373381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa51c0c5300 0x7fa51c0a9c30 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0097c0 tx=0x7fa50c01c480 comp rx=0 tx=0).stop 2023-12-08T08:23:43.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.810+0000 7fa52465a640 1 -- 172.21.15.88:0/522373381 shutdown_connections 2023-12-08T08:23:43.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.810+0000 7fa52465a640 1 --2- 172.21.15.88:0/522373381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa51c0c5300 0x7fa51c0a9c30 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:43.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.810+0000 7fa52465a640 1 -- 172.21.15.88:0/522373381 >> 172.21.15.88:0/522373381 conn(0x7fa51c0c59f0 msgr2=0x7fa51c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:43.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.810+0000 7fa52465a640 1 -- 172.21.15.88:0/522373381 shutdown_connections 2023-12-08T08:23:43.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.810+0000 7fa52465a640 1 -- 172.21.15.88:0/522373381 wait complete. 2023-12-08T08:23:43.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.814+0000 7fa52465a640 1 Processor -- start 2023-12-08T08:23:43.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.814+0000 7fa52465a640 1 -- start start 2023-12-08T08:23:43.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.814+0000 7fa52465a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa51c0c5300 0x7fa51c14e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:43.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.814+0000 7fa52465a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa51c14b1e0 0x7fa51c14fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:43.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.814+0000 7fa52465a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa51c1548c0 0x7fa51c0a55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:43.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.814+0000 7fa52465a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c151300 con 0x7fa51c1548c0 2023-12-08T08:23:43.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.814+0000 7fa52465a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c1eca30 con 0x7fa51c14b1e0 2023-12-08T08:23:43.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.814+0000 7fa52465a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c150500 con 0x7fa51c0c5300 2023-12-08T08:23:43.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.814+0000 7fa522bf7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa51c1548c0 0x7fa51c0a55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:43.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.814+0000 7fa522bf7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa51c1548c0 0x7fa51c0a55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36818/0 (socket says 172.21.15.88:36818) 2023-12-08T08:23:43.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.814+0000 7fa522bf7640 1 -- 172.21.15.88:0/597299681 learned_addr learned my addr 172.21.15.88:0/597299681 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:43.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.814+0000 7fa521bf5640 1 --2- 172.21.15.88:0/597299681 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa51c14b1e0 0x7fa51c14fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:43.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.814+0000 7fa5223f6640 1 --2- 172.21.15.88:0/597299681 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa51c0c5300 0x7fa51c14e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:43.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.814+0000 7fa522bf7640 1 -- 172.21.15.88:0/597299681 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa51c0c5300 msgr2=0x7fa51c14e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:43.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.814+0000 7fa522bf7640 1 --2- 172.21.15.88:0/597299681 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa51c0c5300 0x7fa51c14e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:43.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.814+0000 7fa522bf7640 1 -- 172.21.15.88:0/597299681 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa51c14b1e0 msgr2=0x7fa51c14fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:43.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.814+0000 7fa522bf7640 1 --2- 172.21.15.88:0/597299681 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa51c14b1e0 0x7fa51c14fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:43.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.814+0000 7fa522bf7640 1 -- 172.21.15.88:0/597299681 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c009420 con 0x7fa51c1548c0 2023-12-08T08:23:43.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.814+0000 7fa522bf7640 1 --2- 172.21.15.88:0/597299681 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa51c1548c0 0x7fa51c0a55a0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fa51400c730 tx=0x7fa51400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:43.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.814+0000 7fa512ffd640 1 -- 172.21.15.88:0/597299681 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa514003b80 con 0x7fa51c1548c0 2023-12-08T08:23:43.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.814+0000 7fa512ffd640 1 -- 172.21.15.88:0/597299681 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa514003ce0 con 0x7fa51c1548c0 2023-12-08T08:23:43.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.814+0000 7fa512ffd640 1 -- 172.21.15.88:0/597299681 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa514005310 con 0x7fa51c1548c0 2023-12-08T08:23:43.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.814+0000 7fa52465a640 1 -- 172.21.15.88:0/597299681 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa51c0a7180 con 0x7fa51c1548c0 2023-12-08T08:23:43.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.814+0000 7fa52465a640 1 -- 172.21.15.88:0/597299681 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51c1ecf20 con 0x7fa51c1548c0 2023-12-08T08:23:43.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.814+0000 7fa52465a640 1 -- 172.21.15.88:0/597299681 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa51c067630 con 0x7fa51c1548c0 2023-12-08T08:23:43.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.818+0000 7fa512ffd640 1 -- 172.21.15.88:0/597299681 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa514005680 con 0x7fa51c1548c0 2023-12-08T08:23:43.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.818+0000 7fa512ffd640 1 --2- 172.21.15.88:0/597299681 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa500066470 0x7fa500068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:43.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.818+0000 7fa512ffd640 1 -- 172.21.15.88:0/597299681 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa514083fe0 con 0x7fa51c1548c0 2023-12-08T08:23:43.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.818+0000 7fa5223f6640 1 --2- 172.21.15.88:0/597299681 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa500066470 0x7fa500068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:43.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.818+0000 7fa5223f6640 1 --2- 172.21.15.88:0/597299681 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa500066470 0x7fa500068930 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa518007a90 tx=0x7fa5180079e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:43.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.822+0000 7fa512ffd640 1 -- 172.21.15.88:0/597299681 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa5140511c0 con 0x7fa51c1548c0 2023-12-08T08:23:43.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.970+0000 7fa52465a640 1 -- 172.21.15.88:0/597299681 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa51c150040 con 0x7fa51c1548c0 2023-12-08T08:23:43.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.970+0000 7fa512ffd640 1 -- 172.21.15.88:0/597299681 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v72) v1 ==== 105+0+11 (secure 0 0 0) 0x7fa5140547e0 con 0x7fa51c1548c0 2023-12-08T08:23:43.975 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:23:43.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.974+0000 7fa52465a640 1 -- 172.21.15.88:0/597299681 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa500066470 msgr2=0x7fa500068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:43.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.974+0000 7fa52465a640 1 --2- 172.21.15.88:0/597299681 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa500066470 0x7fa500068930 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa518007a90 tx=0x7fa5180079e0 comp rx=0 tx=0).stop 2023-12-08T08:23:43.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.974+0000 7fa52465a640 1 -- 172.21.15.88:0/597299681 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa51c1548c0 msgr2=0x7fa51c0a55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:43.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.974+0000 7fa52465a640 1 --2- 172.21.15.88:0/597299681 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa51c1548c0 0x7fa51c0a55a0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fa51400c730 tx=0x7fa51400cbf0 comp rx=0 tx=0).stop 2023-12-08T08:23:43.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.974+0000 7fa52465a640 1 -- 172.21.15.88:0/597299681 shutdown_connections 2023-12-08T08:23:43.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.974+0000 7fa52465a640 1 --2- 172.21.15.88:0/597299681 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa500066470 0x7fa500068930 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:43.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.974+0000 7fa52465a640 1 --2- 172.21.15.88:0/597299681 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa51c1548c0 0x7fa51c0a55a0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:43.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.974+0000 7fa52465a640 1 --2- 172.21.15.88:0/597299681 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa51c14b1e0 0x7fa51c14fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:43.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.974+0000 7fa52465a640 1 --2- 172.21.15.88:0/597299681 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa51c0c5300 0x7fa51c14e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:43.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.974+0000 7fa52465a640 1 -- 172.21.15.88:0/597299681 >> 172.21.15.88:0/597299681 conn(0x7fa51c0c59f0 msgr2=0x7fa51c0c35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:43.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.974+0000 7fa52465a640 1 -- 172.21.15.88:0/597299681 shutdown_connections 2023-12-08T08:23:43.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:43.974+0000 7fa52465a640 1 -- 172.21.15.88:0/597299681 wait complete. 2023-12-08T08:23:43.996 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:23:44.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.130+0000 7f881cf0e640 1 Processor -- start 2023-12-08T08:23:44.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.130+0000 7f881cf0e640 1 -- start start 2023-12-08T08:23:44.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.134+0000 7f881cf0e640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f881814fc30 0x7f88180c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:44.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.134+0000 7f881cf0e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f881806d840 0x7f88180c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:44.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.134+0000 7f881cf0e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8818152910 con 0x7f881814f850 2023-12-08T08:23:44.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.134+0000 7f881cf0e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88180c2240 con 0x7f881806d840 2023-12-08T08:23:44.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.134+0000 7f881cf0e640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8818152bf0 con 0x7f881814fc30 2023-12-08T08:23:44.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.134+0000 7f8816d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f881806d840 0x7f88180c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:44.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.134+0000 7f8816d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f881806d840 0x7f88180c4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36826/0 (socket says 172.21.15.88:36826) 2023-12-08T08:23:44.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.134+0000 7f8816d9d640 1 -- 172.21.15.88:0/748630922 learned_addr learned my addr 172.21.15.88:0/748630922 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:44.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.134+0000 7f881659c640 1 --1- 172.21.15.88:0/748630922 >> v1:172.21.15.88:6789/0 conn(0x7f881814f850 0x7f88180aacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41332/0 (socket says 172.21.15.88:41332) 2023-12-08T08:23:44.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.134+0000 7f8815d9b640 1 --2- 172.21.15.88:0/748630922 >> v2:172.21.15.148:3300/0 conn(0x7f881814fc30 0x7f88180c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:44.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.134+0000 7f8816d9d640 1 -- 172.21.15.88:0/748630922 >> v2:172.21.15.148:3300/0 conn(0x7f881814fc30 msgr2=0x7f88180c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:44.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.134+0000 7f8816d9d640 1 --2- 172.21.15.88:0/748630922 >> v2:172.21.15.148:3300/0 conn(0x7f881814fc30 0x7f88180c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:44.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.134+0000 7f8816d9d640 1 -- 172.21.15.88:0/748630922 >> v1:172.21.15.88:6789/0 conn(0x7f881814f850 legacy=0x7f88180aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:44.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.134+0000 7f8816d9d640 1 -- 172.21.15.88:0/748630922 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8818152ed0 con 0x7f881806d840 2023-12-08T08:23:44.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.138+0000 7f8816d9d640 1 --2- 172.21.15.88:0/748630922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f881806d840 0x7f88180c4210 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f881806cac0 tx=0x7f881001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f855af4da180bce server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:44.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.138+0000 7f881559a640 1 -- 172.21.15.88:0/748630922 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88100a57c0 con 0x7f881806d840 2023-12-08T08:23:44.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.138+0000 7f881559a640 1 -- 172.21.15.88:0/748630922 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88100a5920 con 0x7f881806d840 2023-12-08T08:23:44.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.138+0000 7f881559a640 1 -- 172.21.15.88:0/748630922 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88100a5cb0 con 0x7f881806d840 2023-12-08T08:23:44.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.138+0000 7f881cf0e640 1 -- 172.21.15.88:0/748630922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f881806d840 msgr2=0x7f88180c4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:44.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.138+0000 7f881cf0e640 1 --2- 172.21.15.88:0/748630922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f881806d840 0x7f88180c4210 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f881806cac0 tx=0x7f881001c9d0 comp rx=0 tx=0).stop 2023-12-08T08:23:44.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.138+0000 7f881cf0e640 1 -- 172.21.15.88:0/748630922 shutdown_connections 2023-12-08T08:23:44.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.138+0000 7f881cf0e640 1 --2- 172.21.15.88:0/748630922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f881806d840 0x7f88180c4210 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:44.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.138+0000 7f881cf0e640 1 --2- 172.21.15.88:0/748630922 >> v2:172.21.15.148:3300/0 conn(0x7f881814fc30 0x7f88180c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:44.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.138+0000 7f881cf0e640 1 -- 172.21.15.88:0/748630922 >> 172.21.15.88:0/748630922 conn(0x7f88180c59f0 msgr2=0x7f88180c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:44.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.138+0000 7f881cf0e640 1 -- 172.21.15.88:0/748630922 shutdown_connections 2023-12-08T08:23:44.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.138+0000 7f881cf0e640 1 -- 172.21.15.88:0/748630922 wait complete. 2023-12-08T08:23:44.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.138+0000 7f881cf0e640 1 Processor -- start 2023-12-08T08:23:44.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.138+0000 7f881cf0e640 1 -- start start 2023-12-08T08:23:44.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.138+0000 7f881cf0e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f881806d840 0x7f88181edb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:44.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.138+0000 7f881cf0e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f881814f850 0x7f881815b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:44.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.138+0000 7f881cf0e640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f881814fc30 0x7f8818146d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:44.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.138+0000 7f881cf0e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8818071f70 con 0x7f881806d840 2023-12-08T08:23:44.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.138+0000 7f881cf0e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88181ee0c0 con 0x7f881814f850 2023-12-08T08:23:44.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.138+0000 7f881cf0e640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8818156980 con 0x7f881814fc30 2023-12-08T08:23:44.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.142+0000 7f881659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f881806d840 0x7f88181edb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:44.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.142+0000 7f881659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f881806d840 0x7f88181edb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36842/0 (socket says 172.21.15.88:36842) 2023-12-08T08:23:44.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.142+0000 7f881659c640 1 -- 172.21.15.88:0/574171559 learned_addr learned my addr 172.21.15.88:0/574171559 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:44.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.142+0000 7f8815d9b640 1 --2- 172.21.15.88:0/574171559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f881814f850 0x7f881815b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:44.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.142+0000 7f8816d9d640 1 --2- 172.21.15.88:0/574171559 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f881814fc30 0x7f8818146d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:44.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.142+0000 7f881659c640 1 -- 172.21.15.88:0/574171559 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f881814fc30 msgr2=0x7f8818146d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:44.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.142+0000 7f881659c640 1 --2- 172.21.15.88:0/574171559 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f881814fc30 0x7f8818146d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:44.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.142+0000 7f881659c640 1 -- 172.21.15.88:0/574171559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f881814f850 msgr2=0x7f881815b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:44.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.142+0000 7f881659c640 1 --2- 172.21.15.88:0/574171559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f881814f850 0x7f881815b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:44.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.142+0000 7f881659c640 1 -- 172.21.15.88:0/574171559 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8810009b30 con 0x7f881806d840 2023-12-08T08:23:44.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.142+0000 7f881659c640 1 --2- 172.21.15.88:0/574171559 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f881806d840 0x7f88181edb80 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f880800c490 tx=0x7f880800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:44.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.142+0000 7f8806ffd640 1 -- 172.21.15.88:0/574171559 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808007480 con 0x7f881806d840 2023-12-08T08:23:44.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.142+0000 7f8806ffd640 1 -- 172.21.15.88:0/574171559 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88080075e0 con 0x7f881806d840 2023-12-08T08:23:44.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.142+0000 7f881cf0e640 1 -- 172.21.15.88:0/574171559 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88180aaaf0 con 0x7f881806d840 2023-12-08T08:23:44.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.142+0000 7f8806ffd640 1 -- 172.21.15.88:0/574171559 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808004a10 con 0x7f881806d840 2023-12-08T08:23:44.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.142+0000 7f881cf0e640 1 -- 172.21.15.88:0/574171559 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88180a9880 con 0x7f881806d840 2023-12-08T08:23:44.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.142+0000 7f881cf0e640 1 -- 172.21.15.88:0/574171559 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8818067630 con 0x7f881806d840 2023-12-08T08:23:44.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.142+0000 7f8806ffd640 1 -- 172.21.15.88:0/574171559 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8808004b70 con 0x7f881806d840 2023-12-08T08:23:44.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.146+0000 7f8806ffd640 1 --2- 172.21.15.88:0/574171559 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f87f8066470 0x7f87f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:44.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.146+0000 7f8806ffd640 1 -- 172.21.15.88:0/574171559 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8808083330 con 0x7f881806d840 2023-12-08T08:23:44.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.146+0000 7f8815d9b640 1 --2- 172.21.15.88:0/574171559 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f87f8066470 0x7f87f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:44.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.146+0000 7f8815d9b640 1 --2- 172.21.15.88:0/574171559 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f87f8066470 0x7f87f8068930 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f88181521b0 tx=0x7f880c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:44.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.150+0000 7f8806ffd640 1 -- 172.21.15.88:0/574171559 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f88080504f0 con 0x7f881806d840 2023-12-08T08:23:44.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.298+0000 7f881cf0e640 1 -- 172.21.15.88:0/574171559 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f881806b9b0 con 0x7f881806d840 2023-12-08T08:23:44.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.298+0000 7f8806ffd640 1 -- 172.21.15.88:0/574171559 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v72) v1 ==== 101+0+11 (secure 0 0 0) 0x7f8808053b10 con 0x7f881806d840 2023-12-08T08:23:44.303 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:23:44.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.298+0000 7f881cf0e640 1 -- 172.21.15.88:0/574171559 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f87f8066470 msgr2=0x7f87f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:44.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.298+0000 7f881cf0e640 1 --2- 172.21.15.88:0/574171559 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f87f8066470 0x7f87f8068930 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f88181521b0 tx=0x7f880c008040 comp rx=0 tx=0).stop 2023-12-08T08:23:44.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.298+0000 7f881cf0e640 1 -- 172.21.15.88:0/574171559 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f881806d840 msgr2=0x7f88181edb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:44.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.298+0000 7f881cf0e640 1 --2- 172.21.15.88:0/574171559 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f881806d840 0x7f88181edb80 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f880800c490 tx=0x7f880800c950 comp rx=0 tx=0).stop 2023-12-08T08:23:44.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.298+0000 7f881cf0e640 1 -- 172.21.15.88:0/574171559 shutdown_connections 2023-12-08T08:23:44.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.298+0000 7f881cf0e640 1 --2- 172.21.15.88:0/574171559 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f87f8066470 0x7f87f8068930 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:44.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.298+0000 7f881cf0e640 1 --2- 172.21.15.88:0/574171559 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f881814fc30 0x7f8818146d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:44.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.298+0000 7f881cf0e640 1 --2- 172.21.15.88:0/574171559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f881814f850 0x7f881815b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:44.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.298+0000 7f881cf0e640 1 --2- 172.21.15.88:0/574171559 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f881806d840 0x7f88181edb80 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:44.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.298+0000 7f881cf0e640 1 -- 172.21.15.88:0/574171559 >> 172.21.15.88:0/574171559 conn(0x7f88180c59f0 msgr2=0x7f881806cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:44.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.298+0000 7f881cf0e640 1 -- 172.21.15.88:0/574171559 shutdown_connections 2023-12-08T08:23:44.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.298+0000 7f881cf0e640 1 -- 172.21.15.88:0/574171559 wait complete. 2023-12-08T08:23:44.324 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:23:44.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4e07355640 1 Processor -- start 2023-12-08T08:23:44.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4e07355640 1 -- start start 2023-12-08T08:23:44.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4e07355640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e001562d0 0x7f4e0006f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:44.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4e07355640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4e000c3670 0x7f4e000c3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:44.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4e07355640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e000c2660 con 0x7f4e0014fa60 2023-12-08T08:23:44.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4e07355640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e000c28b0 con 0x7f4e000c3670 2023-12-08T08:23:44.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4e07355640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e000c2b90 con 0x7f4e001562d0 2023-12-08T08:23:44.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4e050f1640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4e0014fa60 0x7f4e000a6e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41334/0 (socket says 172.21.15.88:41334) 2023-12-08T08:23:44.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4e050f1640 1 -- 172.21.15.88:0/458912195 learned_addr learned my addr 172.21.15.88:0/458912195 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:44.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4e058f2640 1 --2- 172.21.15.88:0/458912195 >> v2:172.21.15.148:3300/0 conn(0x7f4e000c3670 0x7f4e000c3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:44.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4e048f0640 1 --2- 172.21.15.88:0/458912195 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e001562d0 0x7f4e0006f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:44.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4df7fff640 1 -- 172.21.15.88:0/458912195 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 413345059 0 0) 0x7f4e000c2660 con 0x7f4e0014fa60 2023-12-08T08:23:44.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4df7fff640 1 -- 172.21.15.88:0/458912195 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dec003530 con 0x7f4e0014fa60 2023-12-08T08:23:44.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4df7fff640 1 -- 172.21.15.88:0/458912195 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1721085931 0 0) 0x7f4dec003530 con 0x7f4e0014fa60 2023-12-08T08:23:44.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4df7fff640 1 -- 172.21.15.88:0/458912195 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e001562d0 msgr2=0x7f4e0006f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:44.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4df7fff640 1 --2- 172.21.15.88:0/458912195 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e001562d0 0x7f4e0006f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:44.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4df7fff640 1 -- 172.21.15.88:0/458912195 >> v2:172.21.15.148:3300/0 conn(0x7f4e000c3670 msgr2=0x7f4e000c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:44.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4df7fff640 1 --2- 172.21.15.88:0/458912195 >> v2:172.21.15.148:3300/0 conn(0x7f4e000c3670 0x7f4e000c3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:44.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4df7fff640 1 -- 172.21.15.88:0/458912195 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e000c2e70 con 0x7f4e0014fa60 2023-12-08T08:23:44.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4df7fff640 1 -- 172.21.15.88:0/458912195 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f4dfc001680 con 0x7f4e0014fa60 2023-12-08T08:23:44.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4df7fff640 1 -- 172.21.15.88:0/458912195 >> v1:172.21.15.88:6789/0 conn(0x7f4e0014fa60 legacy=0x7f4e000a6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:44.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4df7fff640 1 --2- 172.21.15.88:0/458912195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4dec003980 0x7f4dec003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:44.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4df7fff640 1 --2- 172.21.15.88:0/458912195 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e001562d0 0x7f4dec0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:44.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4df7fff640 1 --2- 172.21.15.88:0/458912195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4dec004d10 0x7f4dec005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:44.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4df7fff640 1 -- 172.21.15.88:0/458912195 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e000c28b0 con 0x7f4dec003980 2023-12-08T08:23:44.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4df7fff640 1 -- 172.21.15.88:0/458912195 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e000c2b90 con 0x7f4dec004d10 2023-12-08T08:23:44.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4df7fff640 1 -- 172.21.15.88:0/458912195 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec00b9c0 con 0x7f4e001562d0 2023-12-08T08:23:44.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4e050f1640 1 --2- 172.21.15.88:0/458912195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4dec003980 0x7f4dec003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:44.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4e048f0640 1 --2- 172.21.15.88:0/458912195 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e001562d0 0x7f4dec0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:44.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4e058f2640 1 --2- 172.21.15.88:0/458912195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4dec004d10 0x7f4dec005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:44.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4e050f1640 1 -- 172.21.15.88:0/458912195 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e001562d0 msgr2=0x7f4dec0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:44.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4e050f1640 1 --2- 172.21.15.88:0/458912195 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e001562d0 0x7f4dec0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:44.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4e050f1640 1 -- 172.21.15.88:0/458912195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4dec004d10 msgr2=0x7f4dec005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:44.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4e050f1640 1 --2- 172.21.15.88:0/458912195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4dec004d10 0x7f4dec005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:44.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4e050f1640 1 -- 172.21.15.88:0/458912195 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dec003530 con 0x7f4dec003980 2023-12-08T08:23:44.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.458+0000 7f4e058f2640 1 --2- 172.21.15.88:0/458912195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4dec004d10 0x7f4dec005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:44.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.462+0000 7f4e050f1640 1 --2- 172.21.15.88:0/458912195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4dec003980 0x7f4dec003da0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc00c240 tx=0x7f4dfc01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca974537f82b9b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:44.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.462+0000 7f4df7fff640 1 -- 172.21.15.88:0/458912195 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc0058e0 con 0x7f4dec003980 2023-12-08T08:23:44.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.462+0000 7f4df7fff640 1 -- 172.21.15.88:0/458912195 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dfc005a60 con 0x7f4dec003980 2023-12-08T08:23:44.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.462+0000 7f4df7fff640 1 -- 172.21.15.88:0/458912195 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc005e10 con 0x7f4dec003980 2023-12-08T08:23:44.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.462+0000 7f4e07355640 1 -- 172.21.15.88:0/458912195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4dec003980 msgr2=0x7f4dec003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:44.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.462+0000 7f4e07355640 1 --2- 172.21.15.88:0/458912195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4dec003980 0x7f4dec003da0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc00c240 tx=0x7f4dfc01cc80 comp rx=0 tx=0).stop 2023-12-08T08:23:44.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.462+0000 7f4e058f2640 1 -- 172.21.15.88:0/458912195 reap_dead start 2023-12-08T08:23:44.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.462+0000 7f4e07355640 1 -- 172.21.15.88:0/458912195 shutdown_connections 2023-12-08T08:23:44.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.462+0000 7f4e07355640 1 -- 172.21.15.88:0/458912195 >> 172.21.15.88:0/458912195 conn(0x7f4e000c7c60 msgr2=0x7f4e000c8070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:44.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.462+0000 7f4e07355640 1 -- 172.21.15.88:0/458912195 shutdown_connections 2023-12-08T08:23:44.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.462+0000 7f4e07355640 1 -- 172.21.15.88:0/458912195 wait complete. 2023-12-08T08:23:44.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.466+0000 7f4e07355640 1 Processor -- start 2023-12-08T08:23:44.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.466+0000 7f4e07355640 1 -- start start 2023-12-08T08:23:44.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.466+0000 7f4e07355640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4dec003980 0x7f4e001549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:44.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.466+0000 7f4e07355640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e000ad650 0x7f4e001ede20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:44.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.466+0000 7f4e07355640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e00148c50 0x7f4e000aad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:44.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.466+0000 7f4e07355640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e000ac800 con 0x7f4e000ad650 2023-12-08T08:23:44.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.466+0000 7f4e07355640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e00155da0 con 0x7f4dec003980 2023-12-08T08:23:44.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.466+0000 7f4e07355640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e001ed990 con 0x7f4e00148c50 2023-12-08T08:23:44.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.466+0000 7f4e048f0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e000ad650 0x7f4e001ede20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:44.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.466+0000 7f4e048f0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e000ad650 0x7f4e001ede20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36858/0 (socket says 172.21.15.88:36858) 2023-12-08T08:23:44.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.466+0000 7f4e048f0640 1 -- 172.21.15.88:0/3019687783 learned_addr learned my addr 172.21.15.88:0/3019687783 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:44.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.466+0000 7f4e050f1640 1 --2- 172.21.15.88:0/3019687783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4dec003980 0x7f4e001549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:44.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.466+0000 7f4e058f2640 1 --2- 172.21.15.88:0/3019687783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e00148c50 0x7f4e000aad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:44.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.466+0000 7f4e048f0640 1 -- 172.21.15.88:0/3019687783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e00148c50 msgr2=0x7f4e000aad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:44.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.466+0000 7f4e048f0640 1 --2- 172.21.15.88:0/3019687783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e00148c50 0x7f4e000aad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:44.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.466+0000 7f4e048f0640 1 -- 172.21.15.88:0/3019687783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4dec003980 msgr2=0x7f4e001549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:44.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.466+0000 7f4e048f0640 1 --2- 172.21.15.88:0/3019687783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4dec003980 0x7f4e001549e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:44.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.466+0000 7f4e048f0640 1 -- 172.21.15.88:0/3019687783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e001539c0 con 0x7f4e000ad650 2023-12-08T08:23:44.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.466+0000 7f4e050f1640 1 --2- 172.21.15.88:0/3019687783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4dec003980 0x7f4e001549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:44.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.466+0000 7f4e058f2640 1 --2- 172.21.15.88:0/3019687783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e00148c50 0x7f4e000aad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:44.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.466+0000 7f4e048f0640 1 --2- 172.21.15.88:0/3019687783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e000ad650 0x7f4e001ede20 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f4df00119d0 tx=0x7f4df0011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:44.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.466+0000 7f4df5ffb640 1 -- 172.21.15.88:0/3019687783 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df000fb50 con 0x7f4e000ad650 2023-12-08T08:23:44.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.466+0000 7f4df5ffb640 1 -- 172.21.15.88:0/3019687783 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df000fcb0 con 0x7f4e000ad650 2023-12-08T08:23:44.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.466+0000 7f4e07355640 1 -- 172.21.15.88:0/3019687783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e001ed620 con 0x7f4e000ad650 2023-12-08T08:23:44.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.466+0000 7f4df5ffb640 1 -- 172.21.15.88:0/3019687783 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df0014440 con 0x7f4e000ad650 2023-12-08T08:23:44.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.470+0000 7f4e07355640 1 -- 172.21.15.88:0/3019687783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e000adc60 con 0x7f4e000ad650 2023-12-08T08:23:44.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.470+0000 7f4e07355640 1 -- 172.21.15.88:0/3019687783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e001edb40 con 0x7f4e000ad650 2023-12-08T08:23:44.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.470+0000 7f4df5ffb640 1 -- 172.21.15.88:0/3019687783 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4df00145a0 con 0x7f4e000ad650 2023-12-08T08:23:44.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.470+0000 7f4df5ffb640 1 --2- 172.21.15.88:0/3019687783 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4de40664a0 0x7f4de4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:44.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.470+0000 7f4df5ffb640 1 -- 172.21.15.88:0/3019687783 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4df0084a80 con 0x7f4e000ad650 2023-12-08T08:23:44.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.470+0000 7f4e050f1640 1 --2- 172.21.15.88:0/3019687783 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4de40664a0 0x7f4de4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:44.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.470+0000 7f4e050f1640 1 --2- 172.21.15.88:0/3019687783 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4de40664a0 0x7f4de4068960 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0aa000 tx=0x7f4dfc001a80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:44.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.474+0000 7f4df5ffb640 1 -- 172.21.15.88:0/3019687783 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4e001edb40 con 0x7f4e000ad650 2023-12-08T08:23:44.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.638+0000 7f4e07355640 1 -- 172.21.15.88:0/3019687783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4e001edb00 con 0x7f4e000ad650 2023-12-08T08:23:44.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.638+0000 7f4df5ffb640 1 -- 172.21.15.88:0/3019687783 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4df0051c50 con 0x7f4e000ad650 2023-12-08T08:23:44.641 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-12-08T08:23:44.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.638+0000 7f4e07355640 1 -- 172.21.15.88:0/3019687783 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4de40664a0 msgr2=0x7f4de4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:44.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.638+0000 7f4e07355640 1 --2- 172.21.15.88:0/3019687783 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4de40664a0 0x7f4de4068960 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0aa000 tx=0x7f4dfc001a80 comp rx=0 tx=0).stop 2023-12-08T08:23:44.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.638+0000 7f4e07355640 1 -- 172.21.15.88:0/3019687783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e000ad650 msgr2=0x7f4e001ede20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:44.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.638+0000 7f4e07355640 1 --2- 172.21.15.88:0/3019687783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e000ad650 0x7f4e001ede20 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f4df00119d0 tx=0x7f4df0011e90 comp rx=0 tx=0).stop 2023-12-08T08:23:44.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.638+0000 7f4e07355640 1 -- 172.21.15.88:0/3019687783 shutdown_connections 2023-12-08T08:23:44.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.638+0000 7f4e07355640 1 --2- 172.21.15.88:0/3019687783 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f4de40664a0 0x7f4de4068960 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:44.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.638+0000 7f4e07355640 1 --2- 172.21.15.88:0/3019687783 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4e00148c50 0x7f4e000aad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:44.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.638+0000 7f4e07355640 1 --2- 172.21.15.88:0/3019687783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e000ad650 0x7f4e001ede20 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:44.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.638+0000 7f4e07355640 1 --2- 172.21.15.88:0/3019687783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4dec003980 0x7f4e001549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:44.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.638+0000 7f4e07355640 1 -- 172.21.15.88:0/3019687783 >> 172.21.15.88:0/3019687783 conn(0x7f4e000c7c60 msgr2=0x7f4e000c1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:44.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.638+0000 7f4e07355640 1 -- 172.21.15.88:0/3019687783 shutdown_connections 2023-12-08T08:23:44.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:44.638+0000 7f4e07355640 1 -- 172.21.15.88:0/3019687783 wait complete. 2023-12-08T08:23:44.663 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2023-12-08T08:23:44.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:44.663 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-08T08:23:44.692 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-12-08T08:23:44.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:23:44.693 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-08T08:23:44.747 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-08T08:23:44.748 DEBUG:teuthology.orchestra.run.smithi088:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:23:44.839 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:23:44.921 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-08T08:23:44.921 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:23:44.921 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:23:44.930 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5383 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-08T08:23:44.930 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:23:44.931 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:23:44.940 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354676k,nr_inodes=4088669,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9389 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-08T08:23:44.940 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:23:45.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.102+0000 7f9e134e3640 1 Processor -- start 2023-12-08T08:23:45.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.102+0000 7f9e134e3640 1 -- start start 2023-12-08T08:23:45.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.106+0000 7f9e134e3640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9e0c072580 0x7f9e0c0c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:45.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.106+0000 7f9e134e3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e0c0c0460 0x7f9e0c155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:45.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.106+0000 7f9e134e3640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e0c0c1a50 con 0x7f9e0c0c0f30 2023-12-08T08:23:45.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.106+0000 7f9e134e3640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e0c159990 con 0x7f9e0c072580 2023-12-08T08:23:45.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.106+0000 7f9e134e3640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c0c08d0 con 0x7f9e0c0c0460 2023-12-08T08:23:45.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.106+0000 7f9e11a80640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e0c0c0460 0x7f9e0c155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:45.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.106+0000 7f9e10a7e640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9e0c072580 0x7f9e0c0c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:45.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.106+0000 7f9e1127f640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f9e0c0c0f30 0x7f9e0c159280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:57500/0 (socket says 172.21.15.88:57500) 2023-12-08T08:23:45.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.106+0000 7f9e1127f640 1 -- 172.21.15.88:0/557238766 learned_addr learned my addr 172.21.15.88:0/557238766 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:45.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.106+0000 7f9e03fff640 1 -- 172.21.15.88:0/557238766 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1884220985 0 0) 0x7f9e0c0c1a50 con 0x7f9e0c0c0f30 2023-12-08T08:23:45.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.106+0000 7f9e03fff640 1 -- 172.21.15.88:0/557238766 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9df8003530 con 0x7f9e0c0c0f30 2023-12-08T08:23:45.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.106+0000 7f9e10a7e640 1 -- 172.21.15.88:0/557238766 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e0c0c0460 msgr2=0x7f9e0c155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:45.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.106+0000 7f9e10a7e640 1 --2- 172.21.15.88:0/557238766 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e0c0c0460 0x7f9e0c155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.106+0000 7f9e10a7e640 1 -- 172.21.15.88:0/557238766 >> v1:172.21.15.148:6789/0 conn(0x7f9e0c0c0f30 legacy=0x7f9e0c159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:45.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.106+0000 7f9e10a7e640 1 -- 172.21.15.88:0/557238766 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c0c1ca0 con 0x7f9e0c072580 2023-12-08T08:23:45.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.106+0000 7f9e11a80640 1 --2- 172.21.15.88:0/557238766 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e0c0c0460 0x7f9e0c155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:23:45.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.110+0000 7f9e10a7e640 1 --2- 172.21.15.88:0/557238766 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e0c072580 0x7f9e0c0c3960 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc0097c0 tx=0x7f9dfc01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2dee865255afbdc3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:45.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.110+0000 7f9e03fff640 1 -- 172.21.15.88:0/557238766 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc0ab5f0 con 0x7f9e0c072580 2023-12-08T08:23:45.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.110+0000 7f9e03fff640 1 -- 172.21.15.88:0/557238766 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dfc0ab750 con 0x7f9e0c072580 2023-12-08T08:23:45.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.110+0000 7f9e03fff640 1 -- 172.21.15.88:0/557238766 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc0abac0 con 0x7f9e0c072580 2023-12-08T08:23:45.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.110+0000 7f9e134e3640 1 -- 172.21.15.88:0/557238766 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e0c072580 msgr2=0x7f9e0c0c3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:45.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.110+0000 7f9e134e3640 1 --2- 172.21.15.88:0/557238766 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e0c072580 0x7f9e0c0c3960 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc0097c0 tx=0x7f9dfc01c3f0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.110+0000 7f9e134e3640 1 -- 172.21.15.88:0/557238766 shutdown_connections 2023-12-08T08:23:45.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.110+0000 7f9e134e3640 1 --2- 172.21.15.88:0/557238766 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e0c0c0460 0x7f9e0c155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.110+0000 7f9e134e3640 1 --2- 172.21.15.88:0/557238766 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e0c072580 0x7f9e0c0c3960 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.110+0000 7f9e134e3640 1 -- 172.21.15.88:0/557238766 >> 172.21.15.88:0/557238766 conn(0x7f9e0c0a7810 msgr2=0x7f9e0c0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:45.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.110+0000 7f9e134e3640 1 -- 172.21.15.88:0/557238766 shutdown_connections 2023-12-08T08:23:45.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.110+0000 7f9e134e3640 1 -- 172.21.15.88:0/557238766 wait complete. 2023-12-08T08:23:45.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.110+0000 7f9e134e3640 1 Processor -- start 2023-12-08T08:23:45.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.110+0000 7f9e134e3640 1 -- start start 2023-12-08T08:23:45.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.114+0000 7f9e134e3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e0c072580 0x7f9e0c1f1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:45.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.114+0000 7f9e134e3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e0c0c0460 0x7f9e0c14ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:45.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.114+0000 7f9e134e3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e0c0c0f30 0x7f9e0c151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:45.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.114+0000 7f9e134e3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c144be0 con 0x7f9e0c0c0f30 2023-12-08T08:23:45.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.114+0000 7f9e134e3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c1f21e0 con 0x7f9e0c0c0460 2023-12-08T08:23:45.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.114+0000 7f9e134e3640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c1530c0 con 0x7f9e0c072580 2023-12-08T08:23:45.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.114+0000 7f9e11a80640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e0c0c0f30 0x7f9e0c151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:45.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.114+0000 7f9e11a80640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e0c0c0f30 0x7f9e0c151920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36868/0 (socket says 172.21.15.88:36868) 2023-12-08T08:23:45.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.114+0000 7f9e11a80640 1 -- 172.21.15.88:0/3221490775 learned_addr learned my addr 172.21.15.88:0/3221490775 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:45.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.114+0000 7f9e1127f640 1 --2- 172.21.15.88:0/3221490775 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e0c072580 0x7f9e0c1f1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:45.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.114+0000 7f9e10a7e640 1 --2- 172.21.15.88:0/3221490775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e0c0c0460 0x7f9e0c14ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:45.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.114+0000 7f9e11a80640 1 -- 172.21.15.88:0/3221490775 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e0c072580 msgr2=0x7f9e0c1f1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:45.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.114+0000 7f9e11a80640 1 --2- 172.21.15.88:0/3221490775 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e0c072580 0x7f9e0c1f1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.114+0000 7f9e11a80640 1 -- 172.21.15.88:0/3221490775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e0c0c0460 msgr2=0x7f9e0c14ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:45.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.114+0000 7f9e11a80640 1 --2- 172.21.15.88:0/3221490775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e0c0c0460 0x7f9e0c14ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.114+0000 7f9e11a80640 1 -- 172.21.15.88:0/3221490775 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e04009a70 con 0x7f9e0c0c0f30 2023-12-08T08:23:45.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.114+0000 7f9e11a80640 1 --2- 172.21.15.88:0/3221490775 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e0c0c0f30 0x7f9e0c151920 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f9e0400efc0 tx=0x7f9e0400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:45.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.114+0000 7f9e01ffb640 1 -- 172.21.15.88:0/3221490775 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e04009c20 con 0x7f9e0c0c0f30 2023-12-08T08:23:45.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.114+0000 7f9e01ffb640 1 -- 172.21.15.88:0/3221490775 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0400f040 con 0x7f9e0c0c0f30 2023-12-08T08:23:45.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.114+0000 7f9e01ffb640 1 -- 172.21.15.88:0/3221490775 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e040039a0 con 0x7f9e0c0c0f30 2023-12-08T08:23:45.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.114+0000 7f9e134e3640 1 -- 172.21.15.88:0/3221490775 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dfc009420 con 0x7f9e0c0c0f30 2023-12-08T08:23:45.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.114+0000 7f9e134e3640 1 -- 172.21.15.88:0/3221490775 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0c153680 con 0x7f9e0c0c0f30 2023-12-08T08:23:45.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.114+0000 7f9e134e3640 1 -- 172.21.15.88:0/3221490775 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e0c067630 con 0x7f9e0c0c0f30 2023-12-08T08:23:45.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.118+0000 7f9e01ffb640 1 -- 172.21.15.88:0/3221490775 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9e04014480 con 0x7f9e0c0c0f30 2023-12-08T08:23:45.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.118+0000 7f9e01ffb640 1 --2- 172.21.15.88:0/3221490775 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9df0066470 0x7f9df0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:45.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.118+0000 7f9e01ffb640 1 -- 172.21.15.88:0/3221490775 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9e04084c80 con 0x7f9e0c0c0f30 2023-12-08T08:23:45.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.118+0000 7f9e1127f640 1 --2- 172.21.15.88:0/3221490775 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9df0066470 0x7f9df0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:45.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.118+0000 7f9e1127f640 1 --2- 172.21.15.88:0/3221490775 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9df0066470 0x7f9df0068930 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9e080011f0 tx=0x7f9e08007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:45.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.122+0000 7f9e01ffb640 1 -- 172.21.15.88:0/3221490775 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9e0408b080 con 0x7f9e0c0c0f30 2023-12-08T08:23:45.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.302+0000 7f9e134e3640 1 -- 172.21.15.88:0/3221490775 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e0c067ea0 con 0x7f9e0c0c0f30 2023-12-08T08:23:45.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.302+0000 7f9e01ffb640 1 -- 172.21.15.88:0/3221490775 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+6137 (secure 0 0 0) 0x7f9e04018090 con 0x7f9e0c0c0f30 2023-12-08T08:23:45.308 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:45.308 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5693,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4194250074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4194250074},{"type":"v1","addr":"172.21.15.148:6833","nonce":4194250074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":5699,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3923000603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3923000603},{"type":"v1","addr":"172.21.15.148:6835","nonce":3923000603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:22:59.638045+0000","modified":"2023-12-08T08:23:02.646442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6525":{"gid":6525,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/698349615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":698349615},{"type":"v1","addr":"172.21.15.88:6837","nonce":698349615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:23:17.268042+0000","modified":"2023-12-08T08:23:20.393598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6519},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6519":{"gid":6519,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":7,"addr":"172.21.15.88:6835/1294328415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1294328415},{"type":"v1","addr":"172.21.15.88:6835","nonce":1294328415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-08T08:23:45.308 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 52 2023-12-08T08:23:45.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.306+0000 7f9e134e3640 1 -- 172.21.15.88:0/3221490775 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9df0066470 msgr2=0x7f9df0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:45.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.306+0000 7f9e134e3640 1 --2- 172.21.15.88:0/3221490775 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9df0066470 0x7f9df0068930 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9e080011f0 tx=0x7f9e08007d40 comp rx=0 tx=0).stop 2023-12-08T08:23:45.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.306+0000 7f9e134e3640 1 -- 172.21.15.88:0/3221490775 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e0c0c0f30 msgr2=0x7f9e0c151920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:45.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.306+0000 7f9e134e3640 1 --2- 172.21.15.88:0/3221490775 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e0c0c0f30 0x7f9e0c151920 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f9e0400efc0 tx=0x7f9e0400c490 comp rx=0 tx=0).stop 2023-12-08T08:23:45.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.306+0000 7f9e134e3640 1 -- 172.21.15.88:0/3221490775 shutdown_connections 2023-12-08T08:23:45.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.306+0000 7f9e134e3640 1 --2- 172.21.15.88:0/3221490775 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9df0066470 0x7f9df0068930 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.306+0000 7f9e134e3640 1 --2- 172.21.15.88:0/3221490775 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e0c0c0f30 0x7f9e0c151920 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.306+0000 7f9e134e3640 1 --2- 172.21.15.88:0/3221490775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e0c0c0460 0x7f9e0c14ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.306+0000 7f9e134e3640 1 --2- 172.21.15.88:0/3221490775 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e0c072580 0x7f9e0c1f1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.306+0000 7f9e134e3640 1 -- 172.21.15.88:0/3221490775 >> 172.21.15.88:0/3221490775 conn(0x7f9e0c0a7810 msgr2=0x7f9e0c1568f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:45.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.306+0000 7f9e134e3640 1 -- 172.21.15.88:0/3221490775 shutdown_connections 2023-12-08T08:23:45.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.306+0000 7f9e134e3640 1 -- 172.21.15.88:0/3221490775 wait complete. 2023-12-08T08:23:45.329 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:23:45.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.462+0000 7faffcd65640 1 Processor -- start 2023-12-08T08:23:45.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.462+0000 7faffcd65640 1 -- start start 2023-12-08T08:23:45.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.462+0000 7faffcd65640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faff806d2b0 0x7faff806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:45.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.462+0000 7faffcd65640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faff80c3b80 0x7faff80c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:45.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.462+0000 7faffcd65640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff806bb80 con 0x7faff806c020 2023-12-08T08:23:45.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.462+0000 7faffcd65640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff80c5840 con 0x7faff80c3b80 2023-12-08T08:23:45.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.462+0000 7faffcd65640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff81515c0 con 0x7faff806d2b0 2023-12-08T08:23:45.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.462+0000 7faff6d9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7faff806c020 0x7faff806c4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41342/0 (socket says 172.21.15.88:41342) 2023-12-08T08:23:45.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.462+0000 7faff6d9d640 1 -- 172.21.15.88:0/472289563 learned_addr learned my addr 172.21.15.88:0/472289563 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:45.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.462+0000 7faff659c640 1 --2- 172.21.15.88:0/472289563 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faff806d2b0 0x7faff806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:45.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.462+0000 7fafedd9b640 1 --2- 172.21.15.88:0/472289563 >> v2:172.21.15.148:3300/0 conn(0x7faff80c3b80 0x7faff80c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:45.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.462+0000 7faff5d9b640 1 -- 172.21.15.88:0/472289563 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2940079134 0 0) 0x7faff806bb80 con 0x7faff806c020 2023-12-08T08:23:45.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.466+0000 7faff5d9b640 1 -- 172.21.15.88:0/472289563 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafe4003530 con 0x7faff806c020 2023-12-08T08:23:45.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.466+0000 7fafedd9b640 1 -- 172.21.15.88:0/472289563 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faff806d2b0 msgr2=0x7faff806d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:45.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.466+0000 7fafedd9b640 1 --2- 172.21.15.88:0/472289563 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faff806d2b0 0x7faff806d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.466+0000 7fafedd9b640 1 -- 172.21.15.88:0/472289563 >> v1:172.21.15.88:6789/0 conn(0x7faff806c020 legacy=0x7faff806c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:45.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.466+0000 7fafedd9b640 1 -- 172.21.15.88:0/472289563 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff81518a0 con 0x7faff80c3b80 2023-12-08T08:23:45.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.466+0000 7fafedd9b640 1 --2- 172.21.15.88:0/472289563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faff80c3b80 0x7faff80c5300 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fafe80097c0 tx=0x7fafe801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8d4d92fb8acd099 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:45.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.466+0000 7faff5d9b640 1 -- 172.21.15.88:0/472289563 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe80ab650 con 0x7faff80c3b80 2023-12-08T08:23:45.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.466+0000 7faff5d9b640 1 -- 172.21.15.88:0/472289563 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe80ab7b0 con 0x7faff80c3b80 2023-12-08T08:23:45.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.466+0000 7faff5d9b640 1 -- 172.21.15.88:0/472289563 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe80abb40 con 0x7faff80c3b80 2023-12-08T08:23:45.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.470+0000 7faffcd65640 1 -- 172.21.15.88:0/472289563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faff80c3b80 msgr2=0x7faff80c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:45.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.470+0000 7faffcd65640 1 --2- 172.21.15.88:0/472289563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faff80c3b80 0x7faff80c5300 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fafe80097c0 tx=0x7fafe801c450 comp rx=0 tx=0).stop 2023-12-08T08:23:45.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.470+0000 7faffcd65640 1 -- 172.21.15.88:0/472289563 shutdown_connections 2023-12-08T08:23:45.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.470+0000 7faffcd65640 1 --2- 172.21.15.88:0/472289563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faff80c3b80 0x7faff80c5300 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.470+0000 7faffcd65640 1 --2- 172.21.15.88:0/472289563 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faff806d2b0 0x7faff806d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.470+0000 7faffcd65640 1 -- 172.21.15.88:0/472289563 >> 172.21.15.88:0/472289563 conn(0x7faff80a7810 msgr2=0x7faff80a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:45.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.470+0000 7faffcd65640 1 -- 172.21.15.88:0/472289563 shutdown_connections 2023-12-08T08:23:45.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.470+0000 7faffcd65640 1 -- 172.21.15.88:0/472289563 wait complete. 2023-12-08T08:23:45.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.470+0000 7faffcd65640 1 Processor -- start 2023-12-08T08:23:45.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.470+0000 7faffcd65640 1 -- start start 2023-12-08T08:23:45.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.470+0000 7faffcd65640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faff806c020 0x7faff8154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:45.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.470+0000 7faffcd65640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faff806d2b0 0x7faff814def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:45.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.470+0000 7faffcd65640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faff80c3b80 0x7faff81ecce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:45.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.470+0000 7faffcd65640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff81f0a40 con 0x7faff80c3b80 2023-12-08T08:23:45.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.470+0000 7faffcd65640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff814fda0 con 0x7faff806d2b0 2023-12-08T08:23:45.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.470+0000 7faffcd65640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff81556d0 con 0x7faff806c020 2023-12-08T08:23:45.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.470+0000 7faff6d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faff80c3b80 0x7faff81ecce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:45.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.470+0000 7faff6d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faff80c3b80 0x7faff81ecce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36884/0 (socket says 172.21.15.88:36884) 2023-12-08T08:23:45.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.470+0000 7faff6d9d640 1 -- 172.21.15.88:0/2306986848 learned_addr learned my addr 172.21.15.88:0/2306986848 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:45.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.470+0000 7faff659c640 1 --2- 172.21.15.88:0/2306986848 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faff806c020 0x7faff8154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:45.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.470+0000 7fafedd9b640 1 --2- 172.21.15.88:0/2306986848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faff806d2b0 0x7faff814def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:45.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.470+0000 7faff6d9d640 1 -- 172.21.15.88:0/2306986848 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faff806c020 msgr2=0x7faff8154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:45.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.470+0000 7faff6d9d640 1 --2- 172.21.15.88:0/2306986848 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faff806c020 0x7faff8154ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.470+0000 7faff6d9d640 1 -- 172.21.15.88:0/2306986848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faff806d2b0 msgr2=0x7faff814def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:45.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.470+0000 7faff6d9d640 1 --2- 172.21.15.88:0/2306986848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faff806d2b0 0x7faff814def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.470+0000 7faff6d9d640 1 -- 172.21.15.88:0/2306986848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe8009420 con 0x7faff80c3b80 2023-12-08T08:23:45.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.474+0000 7faff6d9d640 1 --2- 172.21.15.88:0/2306986848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faff80c3b80 0x7faff81ecce0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7faff000caa0 tx=0x7faff000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:45.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.474+0000 7fafef7fe640 1 -- 172.21.15.88:0/2306986848 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff000ac00 con 0x7faff80c3b80 2023-12-08T08:23:45.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.474+0000 7fafef7fe640 1 -- 172.21.15.88:0/2306986848 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff000ad60 con 0x7faff80c3b80 2023-12-08T08:23:45.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.474+0000 7faffcd65640 1 -- 172.21.15.88:0/2306986848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff814ef80 con 0x7faff80c3b80 2023-12-08T08:23:45.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.474+0000 7fafef7fe640 1 -- 172.21.15.88:0/2306986848 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff0012620 con 0x7faff80c3b80 2023-12-08T08:23:45.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.474+0000 7faffcd65640 1 -- 172.21.15.88:0/2306986848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff81f06d0 con 0x7faff80c3b80 2023-12-08T08:23:45.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.474+0000 7faffcd65640 1 -- 172.21.15.88:0/2306986848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff81f0250 con 0x7faff80c3b80 2023-12-08T08:23:45.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.474+0000 7fafef7fe640 1 -- 172.21.15.88:0/2306986848 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faff0007070 con 0x7faff80c3b80 2023-12-08T08:23:45.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.474+0000 7fafef7fe640 1 --2- 172.21.15.88:0/2306986848 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fafd80664a0 0x7fafd8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:45.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.474+0000 7fafef7fe640 1 -- 172.21.15.88:0/2306986848 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7faff00840c0 con 0x7faff80c3b80 2023-12-08T08:23:45.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.474+0000 7faff659c640 1 --2- 172.21.15.88:0/2306986848 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fafd80664a0 0x7fafd8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:45.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.478+0000 7faff659c640 1 --2- 172.21.15.88:0/2306986848 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fafd80664a0 0x7fafd8068960 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fafe0009b60 tx=0x7fafe0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:45.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.478+0000 7fafef7fe640 1 -- 172.21.15.88:0/2306986848 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faff81f0250 con 0x7faff80c3b80 2023-12-08T08:23:45.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.634+0000 7faffcd65640 1 -- 172.21.15.88:0/2306986848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faff81f0250 con 0x7faff80c3b80 2023-12-08T08:23:45.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.634+0000 7fafef7fe640 1 -- 172.21.15.88:0/2306986848 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20190 (secure 0 0 0) 0x7faff81f0250 con 0x7faff80c3b80 2023-12-08T08:23:45.639 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:45.640 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":72,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:23:18.903336+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:57.367467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:58.632605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:23:15.029129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:23:16.271716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:23:45.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.638+0000 7faffcd65640 1 -- 172.21.15.88:0/2306986848 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fafd80664a0 msgr2=0x7fafd8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:45.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.638+0000 7faffcd65640 1 --2- 172.21.15.88:0/2306986848 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fafd80664a0 0x7fafd8068960 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fafe0009b60 tx=0x7fafe0009190 comp rx=0 tx=0).stop 2023-12-08T08:23:45.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.638+0000 7faffcd65640 1 -- 172.21.15.88:0/2306986848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faff80c3b80 msgr2=0x7faff81ecce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:45.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.638+0000 7faffcd65640 1 --2- 172.21.15.88:0/2306986848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faff80c3b80 0x7faff81ecce0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7faff000caa0 tx=0x7faff000cf60 comp rx=0 tx=0).stop 2023-12-08T08:23:45.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.638+0000 7faffcd65640 1 -- 172.21.15.88:0/2306986848 shutdown_connections 2023-12-08T08:23:45.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.638+0000 7faffcd65640 1 --2- 172.21.15.88:0/2306986848 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fafd80664a0 0x7fafd8068960 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.638+0000 7faffcd65640 1 --2- 172.21.15.88:0/2306986848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faff80c3b80 0x7faff81ecce0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.638+0000 7faffcd65640 1 --2- 172.21.15.88:0/2306986848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faff806d2b0 0x7faff814def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.638+0000 7faffcd65640 1 --2- 172.21.15.88:0/2306986848 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7faff806c020 0x7faff8154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.638+0000 7faffcd65640 1 -- 172.21.15.88:0/2306986848 >> 172.21.15.88:0/2306986848 conn(0x7faff80a7810 msgr2=0x7faff80bee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:45.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.638+0000 7faffcd65640 1 -- 172.21.15.88:0/2306986848 shutdown_connections 2023-12-08T08:23:45.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.638+0000 7faffcd65640 1 -- 172.21.15.88:0/2306986848 wait complete. 2023-12-08T08:23:45.662 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:22:57.367467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:22:58.632605+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:23:15.029129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:23:16.271716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:23:45.663 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:23:45.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.806+0000 7f8131017640 1 Processor -- start 2023-12-08T08:23:45.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.806+0000 7f8131017640 1 -- start start 2023-12-08T08:23:45.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.806+0000 7f8131017640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f812c14e4a0 0x7f812c154e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:45.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.806+0000 7f8131017640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f812c158370 0x7f812c1558d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:45.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.806+0000 7f8131017640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f812c14e880 con 0x7f812c0c66b0 2023-12-08T08:23:45.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.806+0000 7f8131017640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812c0c5960 con 0x7f812c14e4a0 2023-12-08T08:23:45.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.806+0000 7f8131017640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812c157ee0 con 0x7f812c158370 2023-12-08T08:23:45.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.810+0000 7f812bfff640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f812c14e4a0 0x7f812c154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:45.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.810+0000 7f812b7fe640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f812c158370 0x7f812c1558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:45.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.810+0000 7f812bfff640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f812c14e4a0 0x7f812c154e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:42440/0 (socket says 172.21.15.88:42440) 2023-12-08T08:23:45.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.810+0000 7f812bfff640 1 -- 172.21.15.88:0/3285354361 learned_addr learned my addr 172.21.15.88:0/3285354361 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:45.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.810+0000 7f8130816640 1 --1- 172.21.15.88:0/3285354361 >> v1:172.21.15.148:6789/0 conn(0x7f812c0c66b0 0x7f812c06b0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:57510/0 (socket says 172.21.15.88:57510) 2023-12-08T08:23:45.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.810+0000 7f812bfff640 1 -- 172.21.15.88:0/3285354361 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f812c158370 msgr2=0x7f812c1558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:45.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.810+0000 7f812bfff640 1 --2- 172.21.15.88:0/3285354361 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f812c158370 0x7f812c1558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.810+0000 7f812bfff640 1 -- 172.21.15.88:0/3285354361 >> v1:172.21.15.148:6789/0 conn(0x7f812c0c66b0 legacy=0x7f812c06b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:45.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.810+0000 7f812bfff640 1 -- 172.21.15.88:0/3285354361 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812c0c4fc0 con 0x7f812c14e4a0 2023-12-08T08:23:45.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.810+0000 7f812b7fe640 1 --2- 172.21.15.88:0/3285354361 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f812c158370 0x7f812c1558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:23:45.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.810+0000 7f812bfff640 1 --2- 172.21.15.88:0/3285354361 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f812c14e4a0 0x7f812c154e60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f811c009870 tx=0x7f811c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb1453dffacfb26e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:45.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.814+0000 7f812affd640 1 -- 172.21.15.88:0/3285354361 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c0ad640 con 0x7f812c14e4a0 2023-12-08T08:23:45.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.814+0000 7f812affd640 1 -- 172.21.15.88:0/3285354361 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811c0ad7a0 con 0x7f812c14e4a0 2023-12-08T08:23:45.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.814+0000 7f812affd640 1 -- 172.21.15.88:0/3285354361 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c0adb30 con 0x7f812c14e4a0 2023-12-08T08:23:45.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.814+0000 7f8131017640 1 -- 172.21.15.88:0/3285354361 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f812c14e4a0 msgr2=0x7f812c154e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:45.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.814+0000 7f8131017640 1 --2- 172.21.15.88:0/3285354361 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f812c14e4a0 0x7f812c154e60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f811c009870 tx=0x7f811c01c480 comp rx=0 tx=0).stop 2023-12-08T08:23:45.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.814+0000 7f8131017640 1 -- 172.21.15.88:0/3285354361 shutdown_connections 2023-12-08T08:23:45.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.814+0000 7f8131017640 1 --2- 172.21.15.88:0/3285354361 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f812c158370 0x7f812c1558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.814+0000 7f8131017640 1 --2- 172.21.15.88:0/3285354361 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f812c14e4a0 0x7f812c154e60 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.814+0000 7f8131017640 1 -- 172.21.15.88:0/3285354361 >> 172.21.15.88:0/3285354361 conn(0x7f812c0ab9e0 msgr2=0x7f812c0abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:45.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.814+0000 7f8131017640 1 -- 172.21.15.88:0/3285354361 shutdown_connections 2023-12-08T08:23:45.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.814+0000 7f8131017640 1 -- 172.21.15.88:0/3285354361 wait complete. 2023-12-08T08:23:45.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.814+0000 7f8131017640 1 Processor -- start 2023-12-08T08:23:45.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.814+0000 7f8131017640 1 -- start start 2023-12-08T08:23:45.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.814+0000 7f8131017640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f812c0c66b0 0x7f812c14b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:45.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.814+0000 7f8131017640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f812c14e4a0 0x7f812c0bf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:45.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.814+0000 7f8131017640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f812c158370 0x7f812c13aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:45.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.814+0000 7f8131017640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812c1ed8f0 con 0x7f812c158370 2023-12-08T08:23:45.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.814+0000 7f8131017640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812c0be050 con 0x7f812c14e4a0 2023-12-08T08:23:45.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.814+0000 7f8131017640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812c150890 con 0x7f812c0c66b0 2023-12-08T08:23:45.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.814+0000 7f8130816640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f812c158370 0x7f812c13aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:45.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.814+0000 7f8130816640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f812c158370 0x7f812c13aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36890/0 (socket says 172.21.15.88:36890) 2023-12-08T08:23:45.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.814+0000 7f8130816640 1 -- 172.21.15.88:0/1910805179 learned_addr learned my addr 172.21.15.88:0/1910805179 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:45.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.814+0000 7f812b7fe640 1 --2- 172.21.15.88:0/1910805179 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f812c14e4a0 0x7f812c0bf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:45.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.814+0000 7f812bfff640 1 --2- 172.21.15.88:0/1910805179 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f812c0c66b0 0x7f812c14b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:45.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.818+0000 7f8130816640 1 -- 172.21.15.88:0/1910805179 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f812c0c66b0 msgr2=0x7f812c14b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:45.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.818+0000 7f8130816640 1 --2- 172.21.15.88:0/1910805179 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f812c0c66b0 0x7f812c14b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.818+0000 7f8130816640 1 -- 172.21.15.88:0/1910805179 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f812c14e4a0 msgr2=0x7f812c0bf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:45.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.818+0000 7f8130816640 1 --2- 172.21.15.88:0/1910805179 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f812c14e4a0 0x7f812c0bf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.818+0000 7f8130816640 1 -- 172.21.15.88:0/1910805179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8120009420 con 0x7f812c158370 2023-12-08T08:23:45.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.818+0000 7f812bfff640 1 --2- 172.21.15.88:0/1910805179 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f812c0c66b0 0x7f812c14b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:23:45.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.818+0000 7f8130816640 1 --2- 172.21.15.88:0/1910805179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f812c158370 0x7f812c13aba0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f812400c7a0 tx=0x7f812400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:45.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.818+0000 7f8128ff9640 1 -- 172.21.15.88:0/1910805179 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812400a640 con 0x7f812c158370 2023-12-08T08:23:45.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.818+0000 7f8128ff9640 1 -- 172.21.15.88:0/1910805179 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812400a7a0 con 0x7f812c158370 2023-12-08T08:23:45.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.818+0000 7f8131017640 1 -- 172.21.15.88:0/1910805179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f811c0094d0 con 0x7f812c158370 2023-12-08T08:23:45.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.818+0000 7f8128ff9640 1 -- 172.21.15.88:0/1910805179 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812400ab10 con 0x7f812c158370 2023-12-08T08:23:45.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.818+0000 7f8131017640 1 -- 172.21.15.88:0/1910805179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f812c151530 con 0x7f812c158370 2023-12-08T08:23:45.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.818+0000 7f8131017640 1 -- 172.21.15.88:0/1910805179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f812c0be200 con 0x7f812c158370 2023-12-08T08:23:45.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.818+0000 7f8128ff9640 1 -- 172.21.15.88:0/1910805179 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f812400ac70 con 0x7f812c158370 2023-12-08T08:23:45.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.818+0000 7f8128ff9640 1 --2- 172.21.15.88:0/1910805179 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8118066470 0x7f8118068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:45.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.818+0000 7f8128ff9640 1 -- 172.21.15.88:0/1910805179 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8124083910 con 0x7f812c158370 2023-12-08T08:23:45.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.818+0000 7f812bfff640 1 --2- 172.21.15.88:0/1910805179 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8118066470 0x7f8118068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:45.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.822+0000 7f812bfff640 1 --2- 172.21.15.88:0/1910805179 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8118066470 0x7f8118068930 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f811c0af000 tx=0x7f811c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:45.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.826+0000 7f8128ff9640 1 -- 172.21.15.88:0/1910805179 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f812c0be200 con 0x7f812c158370 2023-12-08T08:23:45.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.974+0000 7f8131017640 1 -- 172.21.15.88:0/1910805179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f812c0be1c0 con 0x7f812c158370 2023-12-08T08:23:45.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.978+0000 7f8128ff9640 1 -- 172.21.15.88:0/1910805179 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f81240170a0 con 0x7f812c158370 2023-12-08T08:23:45.981 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:23:45.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.978+0000 7f8131017640 1 -- 172.21.15.88:0/1910805179 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8118066470 msgr2=0x7f8118068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:45.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.978+0000 7f8131017640 1 --2- 172.21.15.88:0/1910805179 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8118066470 0x7f8118068930 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f811c0af000 tx=0x7f811c008040 comp rx=0 tx=0).stop 2023-12-08T08:23:45.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.978+0000 7f8131017640 1 -- 172.21.15.88:0/1910805179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f812c158370 msgr2=0x7f812c13aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:45.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.978+0000 7f8131017640 1 --2- 172.21.15.88:0/1910805179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f812c158370 0x7f812c13aba0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f812400c7a0 tx=0x7f812400cc60 comp rx=0 tx=0).stop 2023-12-08T08:23:45.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.978+0000 7f8131017640 1 -- 172.21.15.88:0/1910805179 shutdown_connections 2023-12-08T08:23:45.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.978+0000 7f8131017640 1 --2- 172.21.15.88:0/1910805179 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8118066470 0x7f8118068930 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.978+0000 7f8131017640 1 --2- 172.21.15.88:0/1910805179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f812c158370 0x7f812c13aba0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.978+0000 7f8131017640 1 --2- 172.21.15.88:0/1910805179 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f812c14e4a0 0x7f812c0bf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.978+0000 7f8131017640 1 --2- 172.21.15.88:0/1910805179 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f812c0c66b0 0x7f812c14b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:45.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.978+0000 7f8131017640 1 -- 172.21.15.88:0/1910805179 >> 172.21.15.88:0/1910805179 conn(0x7f812c0ab9e0 msgr2=0x7f812c14d750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:45.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.978+0000 7f8131017640 1 -- 172.21.15.88:0/1910805179 shutdown_connections 2023-12-08T08:23:45.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:45.978+0000 7f8131017640 1 -- 172.21.15.88:0/1910805179 wait complete. 2023-12-08T08:23:46.001 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:23:46.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.138+0000 7f7e1bb8d640 1 Processor -- start 2023-12-08T08:23:46.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.138+0000 7f7e1bb8d640 1 -- start start 2023-12-08T08:23:46.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.142+0000 7f7e1bb8d640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7e1414b1e0 0x7f7e140c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:46.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.142+0000 7f7e1bb8d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e140a4e20 con 0x7f7e140c5300 2023-12-08T08:23:46.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.142+0000 7f7e1bb8d640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e140a50e0 con 0x7f7e141548c0 2023-12-08T08:23:46.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.142+0000 7f7e1bb8d640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e140c0f00 con 0x7f7e1414b1e0 2023-12-08T08:23:46.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.142+0000 7f7e19128640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7e140c5300 0x7f7e140a9c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41346/0 (socket says 172.21.15.88:41346) 2023-12-08T08:23:46.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.142+0000 7f7e19128640 1 -- 172.21.15.88:0/2431858755 learned_addr learned my addr 172.21.15.88:0/2431858755 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:46.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.142+0000 7f7e19929640 1 --2- 172.21.15.88:0/2431858755 >> v2:172.21.15.148:3300/0 conn(0x7f7e1414b1e0 0x7f7e140c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:46.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.142+0000 7f7e18927640 1 -- 172.21.15.88:0/2431858755 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3266882048 0 0) 0x7f7e140a4e20 con 0x7f7e140c5300 2023-12-08T08:23:46.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.142+0000 7f7e18927640 1 -- 172.21.15.88:0/2431858755 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e00005740 con 0x7f7e140c5300 2023-12-08T08:23:46.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.142+0000 7f7e18927640 1 -- 172.21.15.88:0/2431858755 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 671906072 0 0) 0x7f7e140a50e0 con 0x7f7e141548c0 2023-12-08T08:23:46.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.142+0000 7f7e18927640 1 -- 172.21.15.88:0/2431858755 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e140a4e20 con 0x7f7e141548c0 2023-12-08T08:23:46.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.142+0000 7f7e19929640 1 -- 172.21.15.88:0/2431858755 >> v1:172.21.15.148:6789/0 conn(0x7f7e141548c0 legacy=0x7f7e14154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:46.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.142+0000 7f7e19929640 1 -- 172.21.15.88:0/2431858755 >> v1:172.21.15.88:6789/0 conn(0x7f7e140c5300 legacy=0x7f7e140a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:46.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.142+0000 7f7e19929640 1 -- 172.21.15.88:0/2431858755 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e140c11e0 con 0x7f7e1414b1e0 2023-12-08T08:23:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.146+0000 7f7e19929640 1 --2- 172.21.15.88:0/2431858755 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e1414b1e0 0x7f7e140c1700 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7e100097c0 tx=0x7f7e1001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7497abf9510430d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.146+0000 7f7e18927640 1 -- 172.21.15.88:0/2431858755 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e100ab600 con 0x7f7e1414b1e0 2023-12-08T08:23:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.146+0000 7f7e18927640 1 -- 172.21.15.88:0/2431858755 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e100a7050 con 0x7f7e1414b1e0 2023-12-08T08:23:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.146+0000 7f7e18927640 1 -- 172.21.15.88:0/2431858755 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e100ab980 con 0x7f7e1414b1e0 2023-12-08T08:23:46.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.146+0000 7f7e1bb8d640 1 -- 172.21.15.88:0/2431858755 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e1414b1e0 msgr2=0x7f7e140c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:46.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.146+0000 7f7e1bb8d640 1 --2- 172.21.15.88:0/2431858755 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e1414b1e0 0x7f7e140c1700 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7e100097c0 tx=0x7f7e1001c480 comp rx=0 tx=0).stop 2023-12-08T08:23:46.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.146+0000 7f7e1bb8d640 1 -- 172.21.15.88:0/2431858755 shutdown_connections 2023-12-08T08:23:46.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.146+0000 7f7e1bb8d640 1 --2- 172.21.15.88:0/2431858755 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e1414b1e0 0x7f7e140c1700 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:46.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.146+0000 7f7e1bb8d640 1 -- 172.21.15.88:0/2431858755 >> 172.21.15.88:0/2431858755 conn(0x7f7e140c59f0 msgr2=0x7f7e140c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:46.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.146+0000 7f7e1bb8d640 1 -- 172.21.15.88:0/2431858755 shutdown_connections 2023-12-08T08:23:46.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.146+0000 7f7e1bb8d640 1 -- 172.21.15.88:0/2431858755 wait complete. 2023-12-08T08:23:46.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.146+0000 7f7e1bb8d640 1 Processor -- start 2023-12-08T08:23:46.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.146+0000 7f7e1bb8d640 1 -- start start 2023-12-08T08:23:46.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.150+0000 7f7e1bb8d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e140c5300 0x7f7e140a65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:46.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.150+0000 7f7e1bb8d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e1414b1e0 0x7f7e14143760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:46.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.150+0000 7f7e1bb8d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7e141548c0 0x7f7e1413ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:46.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.150+0000 7f7e1bb8d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e141e9b00 con 0x7f7e140c5300 2023-12-08T08:23:46.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.150+0000 7f7e1bb8d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e141e8ef0 con 0x7f7e1414b1e0 2023-12-08T08:23:46.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.150+0000 7f7e1bb8d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e141e91d0 con 0x7f7e141548c0 2023-12-08T08:23:46.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.150+0000 7f7e19929640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e140c5300 0x7f7e140a65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:46.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.150+0000 7f7e19929640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e140c5300 0x7f7e140a65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36894/0 (socket says 172.21.15.88:36894) 2023-12-08T08:23:46.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.150+0000 7f7e19929640 1 -- 172.21.15.88:0/3850285340 learned_addr learned my addr 172.21.15.88:0/3850285340 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:46.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.150+0000 7f7e19128640 1 --2- 172.21.15.88:0/3850285340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e1414b1e0 0x7f7e14143760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:46.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.150+0000 7f7e1a12a640 1 --2- 172.21.15.88:0/3850285340 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7e141548c0 0x7f7e1413ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:46.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.150+0000 7f7e19929640 1 -- 172.21.15.88:0/3850285340 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7e141548c0 msgr2=0x7f7e1413ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:46.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.150+0000 7f7e19929640 1 --2- 172.21.15.88:0/3850285340 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7e141548c0 0x7f7e1413ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:46.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.150+0000 7f7e19929640 1 -- 172.21.15.88:0/3850285340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e1414b1e0 msgr2=0x7f7e14143760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:46.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.150+0000 7f7e19929640 1 --2- 172.21.15.88:0/3850285340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e1414b1e0 0x7f7e14143760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:46.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.150+0000 7f7e19929640 1 -- 172.21.15.88:0/3850285340 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e10009420 con 0x7f7e140c5300 2023-12-08T08:23:46.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.150+0000 7f7e1a12a640 1 --2- 172.21.15.88:0/3850285340 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7e141548c0 0x7f7e1413ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:46.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.150+0000 7f7e19929640 1 --2- 172.21.15.88:0/3850285340 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e140c5300 0x7f7e140a65d0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f7e100ae040 tx=0x7f7e1001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:46.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.150+0000 7f7e0a7fc640 1 -- 172.21.15.88:0/3850285340 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e100b7450 con 0x7f7e140c5300 2023-12-08T08:23:46.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.150+0000 7f7e0a7fc640 1 -- 172.21.15.88:0/3850285340 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e100b75d0 con 0x7f7e140c5300 2023-12-08T08:23:46.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.150+0000 7f7e1bb8d640 1 -- 172.21.15.88:0/3850285340 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e141e94b0 con 0x7f7e140c5300 2023-12-08T08:23:46.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.150+0000 7f7e0a7fc640 1 -- 172.21.15.88:0/3850285340 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e100b7980 con 0x7f7e140c5300 2023-12-08T08:23:46.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.150+0000 7f7e1bb8d640 1 -- 172.21.15.88:0/3850285340 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1414ec50 con 0x7f7e140c5300 2023-12-08T08:23:46.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.150+0000 7f7e1bb8d640 1 -- 172.21.15.88:0/3850285340 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e141525f0 con 0x7f7e140c5300 2023-12-08T08:23:46.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.150+0000 7f7e0a7fc640 1 -- 172.21.15.88:0/3850285340 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7e100b7ae0 con 0x7f7e140c5300 2023-12-08T08:23:46.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.154+0000 7f7e0a7fc640 1 --2- 172.21.15.88:0/3850285340 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7df8066470 0x7f7df8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:46.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.154+0000 7f7e0a7fc640 1 -- 172.21.15.88:0/3850285340 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7e1011e9c0 con 0x7f7e140c5300 2023-12-08T08:23:46.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.154+0000 7f7e19128640 1 --2- 172.21.15.88:0/3850285340 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7df8066470 0x7f7df8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:46.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.154+0000 7f7e19128640 1 --2- 172.21.15.88:0/3850285340 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7df8066470 0x7f7df8068930 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7e14154520 tx=0x7f7e04009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:46.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.158+0000 7f7e0a7fc640 1 -- 172.21.15.88:0/3850285340 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7e100ebad0 con 0x7f7e140c5300 2023-12-08T08:23:46.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.306+0000 7f7e1bb8d640 1 -- 172.21.15.88:0/3850285340 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7e14067630 con 0x7f7e140c5300 2023-12-08T08:23:46.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.306+0000 7f7e0a7fc640 1 -- 172.21.15.88:0/3850285340 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7e100ef0f0 con 0x7f7e140c5300 2023-12-08T08:23:46.311 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:23:46.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.310+0000 7f7e1bb8d640 1 -- 172.21.15.88:0/3850285340 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7df8066470 msgr2=0x7f7df8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:46.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.310+0000 7f7e1bb8d640 1 --2- 172.21.15.88:0/3850285340 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7df8066470 0x7f7df8068930 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7e14154520 tx=0x7f7e04009040 comp rx=0 tx=0).stop 2023-12-08T08:23:46.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.310+0000 7f7e1bb8d640 1 -- 172.21.15.88:0/3850285340 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e140c5300 msgr2=0x7f7e140a65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:46.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.310+0000 7f7e1bb8d640 1 --2- 172.21.15.88:0/3850285340 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e140c5300 0x7f7e140a65d0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f7e100ae040 tx=0x7f7e1001acc0 comp rx=0 tx=0).stop 2023-12-08T08:23:46.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.310+0000 7f7e1bb8d640 1 -- 172.21.15.88:0/3850285340 shutdown_connections 2023-12-08T08:23:46.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.310+0000 7f7e1bb8d640 1 --2- 172.21.15.88:0/3850285340 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7df8066470 0x7f7df8068930 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:46.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.310+0000 7f7e1bb8d640 1 --2- 172.21.15.88:0/3850285340 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7e141548c0 0x7f7e1413ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:46.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.310+0000 7f7e1bb8d640 1 --2- 172.21.15.88:0/3850285340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e1414b1e0 0x7f7e14143760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:46.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.310+0000 7f7e1bb8d640 1 --2- 172.21.15.88:0/3850285340 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e140c5300 0x7f7e140a65d0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:46.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.310+0000 7f7e1bb8d640 1 -- 172.21.15.88:0/3850285340 >> 172.21.15.88:0/3850285340 conn(0x7f7e140c59f0 msgr2=0x7f7e140ab0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:46.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.310+0000 7f7e1bb8d640 1 -- 172.21.15.88:0/3850285340 shutdown_connections 2023-12-08T08:23:46.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.310+0000 7f7e1bb8d640 1 -- 172.21.15.88:0/3850285340 wait complete. 2023-12-08T08:23:46.332 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:23:46.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.466+0000 7f7ac6701640 1 Processor -- start 2023-12-08T08:23:46.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.466+0000 7f7ac6701640 1 -- start start 2023-12-08T08:23:46.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.466+0000 7f7ac6701640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7ac006bc80 0x7f7ac006c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:46.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.466+0000 7f7ac6701640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac0151210 con 0x7f7ac014e2a0 2023-12-08T08:23:46.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.466+0000 7f7ac6701640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac014e680 con 0x7f7ac01516a0 2023-12-08T08:23:46.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.466+0000 7f7ac6701640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac0151b50 con 0x7f7ac006bc80 2023-12-08T08:23:46.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.466+0000 7f7abffff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7ac014e2a0 0x7f7ac00a9460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41362/0 (socket says 172.21.15.88:41362) 2023-12-08T08:23:46.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.466+0000 7f7abffff640 1 -- 172.21.15.88:0/2859604469 learned_addr learned my addr 172.21.15.88:0/2859604469 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:46.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.470+0000 7f7ac4c9e640 1 --2- 172.21.15.88:0/2859604469 >> v2:172.21.15.148:3300/0 conn(0x7f7ac006bc80 0x7f7ac006c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:46.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.470+0000 7f7abeffd640 1 -- 172.21.15.88:0/2859604469 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952138393 0 0) 0x7f7ac0151210 con 0x7f7ac014e2a0 2023-12-08T08:23:46.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.470+0000 7f7abeffd640 1 -- 172.21.15.88:0/2859604469 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7aa8003530 con 0x7f7ac014e2a0 2023-12-08T08:23:46.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.470+0000 7f7ac4c9e640 1 -- 172.21.15.88:0/2859604469 >> v1:172.21.15.148:6789/0 conn(0x7f7ac01516a0 legacy=0x7f7ac00c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:46.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.470+0000 7f7ac4c9e640 1 -- 172.21.15.88:0/2859604469 >> v1:172.21.15.88:6789/0 conn(0x7f7ac014e2a0 legacy=0x7f7ac00a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:46.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.470+0000 7f7ac4c9e640 1 -- 172.21.15.88:0/2859604469 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac00a9b70 con 0x7f7ac006bc80 2023-12-08T08:23:46.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.470+0000 7f7ac4c9e640 1 --2- 172.21.15.88:0/2859604469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ac006bc80 0x7f7ac006c110 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800aea0 tx=0x7f7ab801d9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e6b1512d6bfa11 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:46.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.470+0000 7f7abeffd640 1 -- 172.21.15.88:0/2859604469 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab800a2d0 con 0x7f7ac006bc80 2023-12-08T08:23:46.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.470+0000 7f7abeffd640 1 -- 172.21.15.88:0/2859604469 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab80a6730 con 0x7f7ac006bc80 2023-12-08T08:23:46.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.470+0000 7f7abeffd640 1 -- 172.21.15.88:0/2859604469 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab80a6ac0 con 0x7f7ac006bc80 2023-12-08T08:23:46.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.474+0000 7f7ac6701640 1 -- 172.21.15.88:0/2859604469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ac006bc80 msgr2=0x7f7ac006c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:46.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.474+0000 7f7ac6701640 1 --2- 172.21.15.88:0/2859604469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ac006bc80 0x7f7ac006c110 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800aea0 tx=0x7f7ab801d9c0 comp rx=0 tx=0).stop 2023-12-08T08:23:46.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.474+0000 7f7ac6701640 1 -- 172.21.15.88:0/2859604469 shutdown_connections 2023-12-08T08:23:46.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.474+0000 7f7ac6701640 1 --2- 172.21.15.88:0/2859604469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ac006bc80 0x7f7ac006c110 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:46.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.474+0000 7f7ac6701640 1 -- 172.21.15.88:0/2859604469 >> 172.21.15.88:0/2859604469 conn(0x7f7ac00c59f0 msgr2=0x7f7ac00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:46.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.474+0000 7f7ac6701640 1 -- 172.21.15.88:0/2859604469 shutdown_connections 2023-12-08T08:23:46.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.474+0000 7f7ac6701640 1 -- 172.21.15.88:0/2859604469 wait complete. 2023-12-08T08:23:46.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.474+0000 7f7ac6701640 1 Processor -- start 2023-12-08T08:23:46.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.474+0000 7f7ac6701640 1 -- start start 2023-12-08T08:23:46.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.474+0000 7f7ac6701640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ac006bc80 0x7f7ac00befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:46.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.474+0000 7f7ac6701640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ac014e2a0 0x7f7ac01538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:46.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.474+0000 7f7ac6701640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ac01516a0 0x7f7ac0153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:46.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.474+0000 7f7ac6701640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac01f0df0 con 0x7f7ac006bc80 2023-12-08T08:23:46.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.474+0000 7f7ac6701640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac0152ca0 con 0x7f7ac014e2a0 2023-12-08T08:23:46.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.474+0000 7f7ac6701640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac014b1f0 con 0x7f7ac01516a0 2023-12-08T08:23:46.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.474+0000 7f7abffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ac006bc80 0x7f7ac00befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:46.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.474+0000 7f7abffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ac006bc80 0x7f7ac00befc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36908/0 (socket says 172.21.15.88:36908) 2023-12-08T08:23:46.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.474+0000 7f7abffff640 1 -- 172.21.15.88:0/1750246575 learned_addr learned my addr 172.21.15.88:0/1750246575 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:46.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.474+0000 7f7abf7fe640 1 --2- 172.21.15.88:0/1750246575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ac014e2a0 0x7f7ac01538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:46.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.474+0000 7f7ac4c9e640 1 --2- 172.21.15.88:0/1750246575 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ac01516a0 0x7f7ac0153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:46.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.474+0000 7f7abffff640 1 -- 172.21.15.88:0/1750246575 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ac01516a0 msgr2=0x7f7ac0153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:46.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.474+0000 7f7abffff640 1 --2- 172.21.15.88:0/1750246575 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ac01516a0 0x7f7ac0153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:46.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.474+0000 7f7abffff640 1 -- 172.21.15.88:0/1750246575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ac014e2a0 msgr2=0x7f7ac01538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:46.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.474+0000 7f7abffff640 1 --2- 172.21.15.88:0/1750246575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ac014e2a0 0x7f7ac01538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:46.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.474+0000 7f7abffff640 1 -- 172.21.15.88:0/1750246575 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab800ab80 con 0x7f7ac006bc80 2023-12-08T08:23:46.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.478+0000 7f7abffff640 1 --2- 172.21.15.88:0/1750246575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ac006bc80 0x7f7ac00befc0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000c420 tx=0x7f7ab000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:46.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.478+0000 7f7abcff9640 1 -- 172.21.15.88:0/1750246575 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0005cf0 con 0x7f7ac006bc80 2023-12-08T08:23:46.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.478+0000 7f7abcff9640 1 -- 172.21.15.88:0/1750246575 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab0005e50 con 0x7f7ac006bc80 2023-12-08T08:23:46.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.478+0000 7f7ac6701640 1 -- 172.21.15.88:0/1750246575 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac01f0170 con 0x7f7ac006bc80 2023-12-08T08:23:46.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.478+0000 7f7abcff9640 1 -- 172.21.15.88:0/1750246575 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab00072d0 con 0x7f7ac006bc80 2023-12-08T08:23:46.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.478+0000 7f7ac6701640 1 -- 172.21.15.88:0/1750246575 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac01f0730 con 0x7f7ac006bc80 2023-12-08T08:23:46.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.478+0000 7f7ac6701640 1 -- 172.21.15.88:0/1750246575 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac0067630 con 0x7f7ac006bc80 2023-12-08T08:23:46.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.478+0000 7f7abcff9640 1 -- 172.21.15.88:0/1750246575 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7ab0007430 con 0x7f7ac006bc80 2023-12-08T08:23:46.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.478+0000 7f7abcff9640 1 --2- 172.21.15.88:0/1750246575 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7aac066470 0x7f7aac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:46.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.478+0000 7f7abcff9640 1 -- 172.21.15.88:0/1750246575 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7ab0083770 con 0x7f7ac006bc80 2023-12-08T08:23:46.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.478+0000 7f7abf7fe640 1 --2- 172.21.15.88:0/1750246575 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7aac066470 0x7f7aac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:46.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.482+0000 7f7abf7fe640 1 --2- 172.21.15.88:0/1750246575 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7aac066470 0x7f7aac068930 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00a74a0 tx=0x7f7ab4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:46.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.482+0000 7f7abcff9640 1 -- 172.21.15.88:0/1750246575 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7ab0050930 con 0x7f7ac006bc80 2023-12-08T08:23:46.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.634+0000 7f7ac6701640 1 -- 172.21.15.88:0/1750246575 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7ac00c5100 con 0x7f7ac006bc80 2023-12-08T08:23:46.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.634+0000 7f7abcff9640 1 -- 172.21.15.88:0/1750246575 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7ab0053f50 con 0x7f7ac006bc80 2023-12-08T08:23:46.640 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:23:46.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.638+0000 7f7ac6701640 1 -- 172.21.15.88:0/1750246575 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7aac066470 msgr2=0x7f7aac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:46.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.638+0000 7f7ac6701640 1 --2- 172.21.15.88:0/1750246575 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7aac066470 0x7f7aac068930 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00a74a0 tx=0x7f7ab4009040 comp rx=0 tx=0).stop 2023-12-08T08:23:46.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.638+0000 7f7ac6701640 1 -- 172.21.15.88:0/1750246575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ac006bc80 msgr2=0x7f7ac00befc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:46.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.638+0000 7f7ac6701640 1 --2- 172.21.15.88:0/1750246575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ac006bc80 0x7f7ac00befc0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000c420 tx=0x7f7ab000c8e0 comp rx=0 tx=0).stop 2023-12-08T08:23:46.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.638+0000 7f7ac6701640 1 -- 172.21.15.88:0/1750246575 shutdown_connections 2023-12-08T08:23:46.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.638+0000 7f7ac6701640 1 --2- 172.21.15.88:0/1750246575 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7aac066470 0x7f7aac068930 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:46.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.638+0000 7f7ac6701640 1 --2- 172.21.15.88:0/1750246575 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7ac01516a0 0x7f7ac0153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:46.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.638+0000 7f7ac6701640 1 --2- 172.21.15.88:0/1750246575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ac014e2a0 0x7f7ac01538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:46.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.638+0000 7f7ac6701640 1 --2- 172.21.15.88:0/1750246575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ac006bc80 0x7f7ac00befc0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:46.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.638+0000 7f7ac6701640 1 -- 172.21.15.88:0/1750246575 >> 172.21.15.88:0/1750246575 conn(0x7f7ac00c59f0 msgr2=0x7f7ac00c4180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:46.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.638+0000 7f7ac6701640 1 -- 172.21.15.88:0/1750246575 shutdown_connections 2023-12-08T08:23:46.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.638+0000 7f7ac6701640 1 -- 172.21.15.88:0/1750246575 wait complete. 2023-12-08T08:23:46.662 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:23:46.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.798+0000 7f6b711aa640 1 Processor -- start 2023-12-08T08:23:46.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.798+0000 7f6b711aa640 1 -- start start 2023-12-08T08:23:46.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.798+0000 7f6b711aa640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6b6c0c5300 0x7f6b6c0a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:46.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.798+0000 7f6b711aa640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6b6c1548c0 0x7f6b6c154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:46.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.798+0000 7f6b711aa640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b6c0a4e20 con 0x7f6b6c14b1e0 2023-12-08T08:23:46.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.798+0000 7f6b711aa640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b6c0a50e0 con 0x7f6b6c0c5300 2023-12-08T08:23:46.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.798+0000 7f6b711aa640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c0c0f00 con 0x7f6b6c1548c0 2023-12-08T08:23:46.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.798+0000 7f6b6a59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6b6c0c5300 0x7f6b6c0a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:46.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.798+0000 7f6b6a59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6b6c0c5300 0x7f6b6c0a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36916/0 (socket says 172.21.15.88:36916) 2023-12-08T08:23:46.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.798+0000 7f6b6a59c640 1 -- 172.21.15.88:0/1328635071 learned_addr learned my addr 172.21.15.88:0/1328635071 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:46.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.798+0000 7f6b6b59e640 1 --2- 172.21.15.88:0/1328635071 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6b6c1548c0 0x7f6b6c154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:46.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.798+0000 7f6b6a59c640 1 -- 172.21.15.88:0/1328635071 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6b6c1548c0 msgr2=0x7f6b6c154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:46.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.798+0000 7f6b6a59c640 1 --2- 172.21.15.88:0/1328635071 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6b6c1548c0 0x7f6b6c154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:46.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.798+0000 7f6b6a59c640 1 -- 172.21.15.88:0/1328635071 >> v1:172.21.15.148:6789/0 conn(0x7f6b6c14b1e0 legacy=0x7f6b6c0c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:46.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.798+0000 7f6b6a59c640 1 -- 172.21.15.88:0/1328635071 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c0c11e0 con 0x7f6b6c0c5300 2023-12-08T08:23:46.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.802+0000 7f6b6a59c640 1 --2- 172.21.15.88:0/1328635071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b6c0c5300 0x7f6b6c0a9c30 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009870 tx=0x7f6b6001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd35e6c646af1827 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:46.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.802+0000 7f6b69d9b640 1 -- 172.21.15.88:0/1328635071 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b600ab650 con 0x7f6b6c0c5300 2023-12-08T08:23:46.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.802+0000 7f6b69d9b640 1 -- 172.21.15.88:0/1328635071 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b600ab7b0 con 0x7f6b6c0c5300 2023-12-08T08:23:46.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.802+0000 7f6b69d9b640 1 -- 172.21.15.88:0/1328635071 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b600abb40 con 0x7f6b6c0c5300 2023-12-08T08:23:46.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.802+0000 7f6b711aa640 1 -- 172.21.15.88:0/1328635071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b6c0c5300 msgr2=0x7f6b6c0a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:46.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.802+0000 7f6b711aa640 1 --2- 172.21.15.88:0/1328635071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b6c0c5300 0x7f6b6c0a9c30 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009870 tx=0x7f6b6001c540 comp rx=0 tx=0).stop 2023-12-08T08:23:46.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.802+0000 7f6b711aa640 1 -- 172.21.15.88:0/1328635071 shutdown_connections 2023-12-08T08:23:46.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.802+0000 7f6b711aa640 1 --2- 172.21.15.88:0/1328635071 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6b6c1548c0 0x7f6b6c154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:46.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.802+0000 7f6b711aa640 1 --2- 172.21.15.88:0/1328635071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b6c0c5300 0x7f6b6c0a9c30 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:46.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.802+0000 7f6b711aa640 1 -- 172.21.15.88:0/1328635071 >> 172.21.15.88:0/1328635071 conn(0x7f6b6c0c59f0 msgr2=0x7f6b6c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:46.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.802+0000 7f6b711aa640 1 -- 172.21.15.88:0/1328635071 shutdown_connections 2023-12-08T08:23:46.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.802+0000 7f6b711aa640 1 -- 172.21.15.88:0/1328635071 wait complete. 2023-12-08T08:23:46.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.806+0000 7f6b711aa640 1 Processor -- start 2023-12-08T08:23:46.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.806+0000 7f6b711aa640 1 -- start start 2023-12-08T08:23:46.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.806+0000 7f6b711aa640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b6c0c5300 0x7f6b6c1f0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:46.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.806+0000 7f6b711aa640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6b6c14b1e0 0x7f6b6c0befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:46.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.806+0000 7f6b711aa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b6c1548c0 0x7f6b6c1ecff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:46.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.806+0000 7f6b711aa640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c1f0520 con 0x7f6b6c1548c0 2023-12-08T08:23:46.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.806+0000 7f6b711aa640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c0aa4e0 con 0x7f6b6c0c5300 2023-12-08T08:23:46.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.806+0000 7f6b711aa640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c1454a0 con 0x7f6b6c14b1e0 2023-12-08T08:23:46.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.806+0000 7f6b6b59e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b6c1548c0 0x7f6b6c1ecff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:46.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.806+0000 7f6b6b59e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b6c1548c0 0x7f6b6c1ecff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36924/0 (socket says 172.21.15.88:36924) 2023-12-08T08:23:46.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.806+0000 7f6b6b59e640 1 -- 172.21.15.88:0/171168749 learned_addr learned my addr 172.21.15.88:0/171168749 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:46.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.806+0000 7f6b6a59c640 1 --2- 172.21.15.88:0/171168749 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6b6c14b1e0 0x7f6b6c0befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.806+0000 7f6b6ad9d640 1 --2- 172.21.15.88:0/171168749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b6c0c5300 0x7f6b6c1f0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.806+0000 7f6b6b59e640 1 -- 172.21.15.88:0/171168749 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6b6c14b1e0 msgr2=0x7f6b6c0befc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.806+0000 7f6b6b59e640 1 --2- 172.21.15.88:0/171168749 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6b6c14b1e0 0x7f6b6c0befc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.806+0000 7f6b6b59e640 1 -- 172.21.15.88:0/171168749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b6c0c5300 msgr2=0x7f6b6c1f0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.806+0000 7f6b6b59e640 1 --2- 172.21.15.88:0/171168749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b6c0c5300 0x7f6b6c1f0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.806+0000 7f6b6b59e640 1 -- 172.21.15.88:0/171168749 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b600094d0 con 0x7f6b6c1548c0 2023-12-08T08:23:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.806+0000 7f6b6ad9d640 1 --2- 172.21.15.88:0/171168749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b6c0c5300 0x7f6b6c1f0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.806+0000 7f6b6b59e640 1 --2- 172.21.15.88:0/171168749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b6c1548c0 0x7f6b6c1ecff0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400d560 tx=0x7f6b6400da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.810+0000 7f6b537fe640 1 -- 172.21.15.88:0/171168749 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b640125f0 con 0x7f6b6c1548c0 2023-12-08T08:23:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.810+0000 7f6b537fe640 1 -- 172.21.15.88:0/171168749 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b64012770 con 0x7f6b6c1548c0 2023-12-08T08:23:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.810+0000 7f6b537fe640 1 -- 172.21.15.88:0/171168749 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64012b20 con 0x7f6b6c1548c0 2023-12-08T08:23:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.810+0000 7f6b711aa640 1 -- 172.21.15.88:0/171168749 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b6c145780 con 0x7f6b6c1548c0 2023-12-08T08:23:46.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.810+0000 7f6b711aa640 1 -- 172.21.15.88:0/171168749 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b6c1f0a50 con 0x7f6b6c1548c0 2023-12-08T08:23:46.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.810+0000 7f6b711aa640 1 -- 172.21.15.88:0/171168749 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b6c145970 con 0x7f6b6c1548c0 2023-12-08T08:23:46.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.810+0000 7f6b537fe640 1 -- 172.21.15.88:0/171168749 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6b64012c80 con 0x7f6b6c1548c0 2023-12-08T08:23:46.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.810+0000 7f6b537fe640 1 --2- 172.21.15.88:0/171168749 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6b58066470 0x7f6b58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:46.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.810+0000 7f6b537fe640 1 -- 172.21.15.88:0/171168749 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6b640846e0 con 0x7f6b6c1548c0 2023-12-08T08:23:46.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.810+0000 7f6b6ad9d640 1 --2- 172.21.15.88:0/171168749 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6b58066470 0x7f6b58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:46.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.810+0000 7f6b6ad9d640 1 --2- 172.21.15.88:0/171168749 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6b58066470 0x7f6b58068930 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c0012f0 tx=0x7f6b5c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:46.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.814+0000 7f6b537fe640 1 -- 172.21.15.88:0/171168749 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6b64051760 con 0x7f6b6c1548c0 2023-12-08T08:23:46.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.966+0000 7f6b711aa640 1 -- 172.21.15.88:0/171168749 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6b6c067630 con 0x7f6b6c1548c0 2023-12-08T08:23:46.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.966+0000 7f6b537fe640 1 -- 172.21.15.88:0/171168749 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v72) v1 ==== 105+0+11 (secure 0 0 0) 0x7f6b64054d80 con 0x7f6b6c1548c0 2023-12-08T08:23:46.969 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:23:46.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.966+0000 7f6b711aa640 1 -- 172.21.15.88:0/171168749 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6b58066470 msgr2=0x7f6b58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:46.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.966+0000 7f6b711aa640 1 --2- 172.21.15.88:0/171168749 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6b58066470 0x7f6b58068930 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c0012f0 tx=0x7f6b5c009040 comp rx=0 tx=0).stop 2023-12-08T08:23:46.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.966+0000 7f6b711aa640 1 -- 172.21.15.88:0/171168749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b6c1548c0 msgr2=0x7f6b6c1ecff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:46.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.966+0000 7f6b711aa640 1 --2- 172.21.15.88:0/171168749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b6c1548c0 0x7f6b6c1ecff0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400d560 tx=0x7f6b6400da20 comp rx=0 tx=0).stop 2023-12-08T08:23:46.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.966+0000 7f6b711aa640 1 -- 172.21.15.88:0/171168749 shutdown_connections 2023-12-08T08:23:46.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.966+0000 7f6b711aa640 1 --2- 172.21.15.88:0/171168749 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f6b58066470 0x7f6b58068930 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:46.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.966+0000 7f6b711aa640 1 --2- 172.21.15.88:0/171168749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b6c1548c0 0x7f6b6c1ecff0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:46.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.966+0000 7f6b711aa640 1 --2- 172.21.15.88:0/171168749 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6b6c14b1e0 0x7f6b6c0befc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:46.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.966+0000 7f6b711aa640 1 --2- 172.21.15.88:0/171168749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b6c0c5300 0x7f6b6c1f0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:46.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.966+0000 7f6b711aa640 1 -- 172.21.15.88:0/171168749 >> 172.21.15.88:0/171168749 conn(0x7f6b6c0c59f0 msgr2=0x7f6b6c146330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:46.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.966+0000 7f6b711aa640 1 -- 172.21.15.88:0/171168749 shutdown_connections 2023-12-08T08:23:46.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:46.966+0000 7f6b711aa640 1 -- 172.21.15.88:0/171168749 wait complete. 2023-12-08T08:23:46.990 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:23:47.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.126+0000 7fe9eaf80640 1 Processor -- start 2023-12-08T08:23:47.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.126+0000 7fe9eaf80640 1 -- start start 2023-12-08T08:23:47.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.126+0000 7fe9eaf80640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe9e40c5300 0x7fe9e40a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:47.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.126+0000 7fe9eaf80640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe9e41548c0 0x7fe9e4154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:47.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.126+0000 7fe9eaf80640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e40a4e20 con 0x7fe9e414b1e0 2023-12-08T08:23:47.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.126+0000 7fe9eaf80640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e40a50e0 con 0x7fe9e40c5300 2023-12-08T08:23:47.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.126+0000 7fe9eaf80640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e40c0f00 con 0x7fe9e41548c0 2023-12-08T08:23:47.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.126+0000 7fe9e8d1c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe9e414b1e0 0x7fe9e40c1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41378/0 (socket says 172.21.15.88:41378) 2023-12-08T08:23:47.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.126+0000 7fe9e8d1c640 1 -- 172.21.15.88:0/48118315 learned_addr learned my addr 172.21.15.88:0/48118315 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:47.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.126+0000 7fe9e3fff640 1 --2- 172.21.15.88:0/48118315 >> v2:172.21.15.88:3300/0 conn(0x7fe9e40c5300 0x7fe9e40a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:47.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.126+0000 7fe9e3fff640 1 -- 172.21.15.88:0/48118315 >> v2:172.21.15.148:3300/0 conn(0x7fe9e41548c0 msgr2=0x7fe9e4154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:47.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.126+0000 7fe9e951d640 1 --2- 172.21.15.88:0/48118315 >> v2:172.21.15.148:3300/0 conn(0x7fe9e41548c0 0x7fe9e4154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:47.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.126+0000 7fe9e37fe640 1 -- 172.21.15.88:0/48118315 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3784863049 0 0) 0x7fe9e40a4e20 con 0x7fe9e414b1e0 2023-12-08T08:23:47.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.126+0000 7fe9e3fff640 1 --2- 172.21.15.88:0/48118315 >> v2:172.21.15.148:3300/0 conn(0x7fe9e41548c0 0x7fe9e4154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:47.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.126+0000 7fe9e3fff640 1 -- 172.21.15.88:0/48118315 >> v1:172.21.15.88:6789/0 conn(0x7fe9e414b1e0 legacy=0x7fe9e40c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:47.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.126+0000 7fe9e3fff640 1 -- 172.21.15.88:0/48118315 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e40c11e0 con 0x7fe9e40c5300 2023-12-08T08:23:47.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.126+0000 7fe9e951d640 1 --2- 172.21.15.88:0/48118315 >> v2:172.21.15.148:3300/0 conn(0x7fe9e41548c0 0x7fe9e4154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:47.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.130+0000 7fe9e3fff640 1 --2- 172.21.15.88:0/48118315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e40c5300 0x7fe9e40a9c30 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fe9e40c5850 tx=0x7fe9d001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d984a199bf0bf420 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:47.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.130+0000 7fe9e37fe640 1 -- 172.21.15.88:0/48118315 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d00ab600 con 0x7fe9e40c5300 2023-12-08T08:23:47.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.130+0000 7fe9e37fe640 1 -- 172.21.15.88:0/48118315 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d00a7050 con 0x7fe9e40c5300 2023-12-08T08:23:47.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.130+0000 7fe9e37fe640 1 -- 172.21.15.88:0/48118315 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d00ab980 con 0x7fe9e40c5300 2023-12-08T08:23:47.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.130+0000 7fe9eaf80640 1 -- 172.21.15.88:0/48118315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e40c5300 msgr2=0x7fe9e40a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:47.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.130+0000 7fe9eaf80640 1 --2- 172.21.15.88:0/48118315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e40c5300 0x7fe9e40a9c30 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fe9e40c5850 tx=0x7fe9d001c460 comp rx=0 tx=0).stop 2023-12-08T08:23:47.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.130+0000 7fe9eaf80640 1 -- 172.21.15.88:0/48118315 shutdown_connections 2023-12-08T08:23:47.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.130+0000 7fe9eaf80640 1 --2- 172.21.15.88:0/48118315 >> v2:172.21.15.148:3300/0 conn(0x7fe9e41548c0 0x7fe9e4154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:47.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.130+0000 7fe9eaf80640 1 --2- 172.21.15.88:0/48118315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e40c5300 0x7fe9e40a9c30 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:47.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.130+0000 7fe9eaf80640 1 -- 172.21.15.88:0/48118315 >> 172.21.15.88:0/48118315 conn(0x7fe9e40c59f0 msgr2=0x7fe9e40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:47.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.130+0000 7fe9eaf80640 1 -- 172.21.15.88:0/48118315 shutdown_connections 2023-12-08T08:23:47.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.130+0000 7fe9eaf80640 1 -- 172.21.15.88:0/48118315 wait complete. 2023-12-08T08:23:47.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.134+0000 7fe9eaf80640 1 Processor -- start 2023-12-08T08:23:47.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.134+0000 7fe9eaf80640 1 -- start start 2023-12-08T08:23:47.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.134+0000 7fe9eaf80640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e40c5300 0x7fe9e41f0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:47.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.134+0000 7fe9eaf80640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9e414b1e0 0x7fe9e40a5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:47.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.134+0000 7fe9eaf80640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9e41548c0 0x7fe9e4148420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:47.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.134+0000 7fe9eaf80640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e406d940 con 0x7fe9e40c5300 2023-12-08T08:23:47.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.134+0000 7fe9eaf80640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e40a5860 con 0x7fe9e414b1e0 2023-12-08T08:23:47.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.134+0000 7fe9eaf80640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e41f00b0 con 0x7fe9e41548c0 2023-12-08T08:23:47.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.134+0000 7fe9e8d1c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e40c5300 0x7fe9e41f0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:47.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.134+0000 7fe9e8d1c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e40c5300 0x7fe9e41f0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36938/0 (socket says 172.21.15.88:36938) 2023-12-08T08:23:47.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.134+0000 7fe9e8d1c640 1 -- 172.21.15.88:0/185087132 learned_addr learned my addr 172.21.15.88:0/185087132 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:47.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.134+0000 7fe9e3fff640 1 --2- 172.21.15.88:0/185087132 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9e414b1e0 0x7fe9e40a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:47.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.134+0000 7fe9e951d640 1 --2- 172.21.15.88:0/185087132 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9e41548c0 0x7fe9e4148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:47.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.134+0000 7fe9e8d1c640 1 -- 172.21.15.88:0/185087132 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9e41548c0 msgr2=0x7fe9e4148420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:47.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.134+0000 7fe9e8d1c640 1 --2- 172.21.15.88:0/185087132 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9e41548c0 0x7fe9e4148420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:47.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.134+0000 7fe9e8d1c640 1 -- 172.21.15.88:0/185087132 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9e414b1e0 msgr2=0x7fe9e40a5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:47.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.134+0000 7fe9e8d1c640 1 --2- 172.21.15.88:0/185087132 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9e414b1e0 0x7fe9e40a5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:47.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.134+0000 7fe9e8d1c640 1 -- 172.21.15.88:0/185087132 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d0009420 con 0x7fe9e40c5300 2023-12-08T08:23:47.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.134+0000 7fe9e8d1c640 1 --2- 172.21.15.88:0/185087132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e40c5300 0x7fe9e41f0b00 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800c520 tx=0x7fe9d800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:47.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.134+0000 7fe9e17fa640 1 -- 172.21.15.88:0/185087132 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80074e0 con 0x7fe9e40c5300 2023-12-08T08:23:47.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.134+0000 7fe9e17fa640 1 -- 172.21.15.88:0/185087132 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d8007640 con 0x7fe9e40c5300 2023-12-08T08:23:47.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.134+0000 7fe9eaf80640 1 -- 172.21.15.88:0/185087132 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e41f0670 con 0x7fe9e40c5300 2023-12-08T08:23:47.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.134+0000 7fe9e17fa640 1 -- 172.21.15.88:0/185087132 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80049f0 con 0x7fe9e40c5300 2023-12-08T08:23:47.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.134+0000 7fe9eaf80640 1 -- 172.21.15.88:0/185087132 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e40a5d70 con 0x7fe9e40c5300 2023-12-08T08:23:47.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.138+0000 7fe9eaf80640 1 -- 172.21.15.88:0/185087132 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e4067630 con 0x7fe9e40c5300 2023-12-08T08:23:47.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.138+0000 7fe9e17fa640 1 -- 172.21.15.88:0/185087132 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe9d8004b50 con 0x7fe9e40c5300 2023-12-08T08:23:47.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.138+0000 7fe9e17fa640 1 --2- 172.21.15.88:0/185087132 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe9c8066470 0x7fe9c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:47.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.138+0000 7fe9e17fa640 1 -- 172.21.15.88:0/185087132 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe9d80837c0 con 0x7fe9e40c5300 2023-12-08T08:23:47.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.138+0000 7fe9e3fff640 1 --2- 172.21.15.88:0/185087132 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe9c8066470 0x7fe9c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:47.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.138+0000 7fe9e3fff640 1 --2- 172.21.15.88:0/185087132 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe9c8066470 0x7fe9c8068930 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe9d00ad000 tx=0x7fe9d00a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:47.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.142+0000 7fe9e17fa640 1 -- 172.21.15.88:0/185087132 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe9d8050970 con 0x7fe9e40c5300 2023-12-08T08:23:47.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.298+0000 7fe9eaf80640 1 -- 172.21.15.88:0/185087132 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fe9e406dc80 con 0x7fe9e40c5300 2023-12-08T08:23:47.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.298+0000 7fe9e17fa640 1 -- 172.21.15.88:0/185087132 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v72) v1 ==== 101+0+11 (secure 0 0 0) 0x7fe9d8053f90 con 0x7fe9e40c5300 2023-12-08T08:23:47.302 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:23:47.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.298+0000 7fe9eaf80640 1 -- 172.21.15.88:0/185087132 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe9c8066470 msgr2=0x7fe9c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:47.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.298+0000 7fe9eaf80640 1 --2- 172.21.15.88:0/185087132 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe9c8066470 0x7fe9c8068930 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe9d00ad000 tx=0x7fe9d00a6000 comp rx=0 tx=0).stop 2023-12-08T08:23:47.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.298+0000 7fe9eaf80640 1 -- 172.21.15.88:0/185087132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e40c5300 msgr2=0x7fe9e41f0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:47.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.298+0000 7fe9eaf80640 1 --2- 172.21.15.88:0/185087132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e40c5300 0x7fe9e41f0b00 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800c520 tx=0x7fe9d800c9e0 comp rx=0 tx=0).stop 2023-12-08T08:23:47.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.298+0000 7fe9eaf80640 1 -- 172.21.15.88:0/185087132 shutdown_connections 2023-12-08T08:23:47.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.298+0000 7fe9eaf80640 1 --2- 172.21.15.88:0/185087132 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe9c8066470 0x7fe9c8068930 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:47.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.298+0000 7fe9eaf80640 1 --2- 172.21.15.88:0/185087132 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe9e41548c0 0x7fe9e4148420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:47.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.298+0000 7fe9eaf80640 1 --2- 172.21.15.88:0/185087132 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9e414b1e0 0x7fe9e40a5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:47.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.298+0000 7fe9eaf80640 1 --2- 172.21.15.88:0/185087132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9e40c5300 0x7fe9e41f0b00 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:47.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.298+0000 7fe9eaf80640 1 -- 172.21.15.88:0/185087132 >> 172.21.15.88:0/185087132 conn(0x7fe9e40c59f0 msgr2=0x7fe9e4148df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:47.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.298+0000 7fe9eaf80640 1 -- 172.21.15.88:0/185087132 shutdown_connections 2023-12-08T08:23:47.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.298+0000 7fe9eaf80640 1 -- 172.21.15.88:0/185087132 wait complete. 2023-12-08T08:23:47.324 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:23:47.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.458+0000 7f3cee6c9640 1 Processor -- start 2023-12-08T08:23:47.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.458+0000 7f3cee6c9640 1 -- start start 2023-12-08T08:23:47.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.458+0000 7f3cee6c9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3ce806d2b0 0x7f3ce806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:47.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.458+0000 7f3cee6c9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce806bb80 con 0x7f3ce80c5300 2023-12-08T08:23:47.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.458+0000 7f3cee6c9640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce80c5790 con 0x7f3ce80c3b80 2023-12-08T08:23:47.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.458+0000 7f3cee6c9640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce81515c0 con 0x7f3ce806d2b0 2023-12-08T08:23:47.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.458+0000 7f3ce7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3ce806d2b0 0x7f3ce806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:47.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.458+0000 7f3cecc66640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3ce80c5300 0x7f3ce806c730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41388/0 (socket says 172.21.15.88:41388) 2023-12-08T08:23:47.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.458+0000 7f3ce7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3ce806d2b0 0x7f3ce806d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36950/0 (socket says 172.21.15.88:36950) 2023-12-08T08:23:47.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.458+0000 7f3cecc66640 1 -- 172.21.15.88:0/261487822 learned_addr learned my addr 172.21.15.88:0/261487822 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:47.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.462+0000 7f3ce7fff640 1 -- 172.21.15.88:0/261487822 >> v1:172.21.15.148:6789/0 conn(0x7f3ce80c3b80 legacy=0x7f3ce806c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:47.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.462+0000 7f3ce7fff640 1 -- 172.21.15.88:0/261487822 >> v1:172.21.15.88:6789/0 conn(0x7f3ce80c5300 legacy=0x7f3ce806c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:47.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.462+0000 7f3ce7fff640 1 -- 172.21.15.88:0/261487822 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce81518a0 con 0x7f3ce806d2b0 2023-12-08T08:23:47.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.462+0000 7f3ce6ffd640 1 -- 172.21.15.88:0/261487822 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 206967711 0 0) 0x7f3ce806bb80 con 0x7f3ce80c5300 2023-12-08T08:23:47.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.462+0000 7f3ce7fff640 1 --2- 172.21.15.88:0/261487822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ce806d2b0 0x7f3ce806d690 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f3cd80097c0 tx=0x7f3cd801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b78a7e606cb6b2da server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:47.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.462+0000 7f3ce6ffd640 1 -- 172.21.15.88:0/261487822 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd80ab610 con 0x7f3ce806d2b0 2023-12-08T08:23:47.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.462+0000 7f3ce6ffd640 1 -- 172.21.15.88:0/261487822 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd80ab770 con 0x7f3ce806d2b0 2023-12-08T08:23:47.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.462+0000 7f3ce6ffd640 1 -- 172.21.15.88:0/261487822 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd80abb00 con 0x7f3ce806d2b0 2023-12-08T08:23:47.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.462+0000 7f3cee6c9640 1 -- 172.21.15.88:0/261487822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ce806d2b0 msgr2=0x7f3ce806d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:47.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.462+0000 7f3cee6c9640 1 --2- 172.21.15.88:0/261487822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ce806d2b0 0x7f3ce806d690 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f3cd80097c0 tx=0x7f3cd801c410 comp rx=0 tx=0).stop 2023-12-08T08:23:47.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.462+0000 7f3cee6c9640 1 -- 172.21.15.88:0/261487822 shutdown_connections 2023-12-08T08:23:47.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.462+0000 7f3cee6c9640 1 --2- 172.21.15.88:0/261487822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ce806d2b0 0x7f3ce806d690 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:47.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.462+0000 7f3cee6c9640 1 -- 172.21.15.88:0/261487822 >> 172.21.15.88:0/261487822 conn(0x7f3ce80a7810 msgr2=0x7f3ce80a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:47.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.462+0000 7f3cee6c9640 1 -- 172.21.15.88:0/261487822 shutdown_connections 2023-12-08T08:23:47.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.462+0000 7f3cee6c9640 1 -- 172.21.15.88:0/261487822 wait complete. 2023-12-08T08:23:47.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.466+0000 7f3cee6c9640 1 Processor -- start 2023-12-08T08:23:47.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.466+0000 7f3cee6c9640 1 -- start start 2023-12-08T08:23:47.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.466+0000 7f3cee6c9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ce806d2b0 0x7f3ce81f0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:47.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.466+0000 7f3cee6c9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ce80c3b80 0x7f3ce81505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:47.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.466+0000 7f3cee6c9640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ce80c5300 0x7f3ce81eca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:47.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.466+0000 7f3cee6c9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce80aaff0 con 0x7f3ce80c3b80 2023-12-08T08:23:47.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.466+0000 7f3cee6c9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce8147a10 con 0x7f3ce806d2b0 2023-12-08T08:23:47.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.466+0000 7f3cee6c9640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce81f04e0 con 0x7f3ce80c5300 2023-12-08T08:23:47.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.466+0000 7f3ce77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ce80c3b80 0x7f3ce81505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:47.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.466+0000 7f3ce77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ce80c3b80 0x7f3ce81505d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36956/0 (socket says 172.21.15.88:36956) 2023-12-08T08:23:47.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.466+0000 7f3ce77fe640 1 -- 172.21.15.88:0/412187162 learned_addr learned my addr 172.21.15.88:0/412187162 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:47.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.466+0000 7f3cecc66640 1 --2- 172.21.15.88:0/412187162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ce80c5300 0x7f3ce81eca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:47.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.466+0000 7f3ce7fff640 1 --2- 172.21.15.88:0/412187162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ce806d2b0 0x7f3ce81f0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:47.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.466+0000 7f3ce77fe640 1 -- 172.21.15.88:0/412187162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ce80c5300 msgr2=0x7f3ce81eca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:47.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.466+0000 7f3ce77fe640 1 --2- 172.21.15.88:0/412187162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ce80c5300 0x7f3ce81eca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:47.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.466+0000 7f3ce77fe640 1 -- 172.21.15.88:0/412187162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ce806d2b0 msgr2=0x7f3ce81f0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:47.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.466+0000 7f3ce77fe640 1 --2- 172.21.15.88:0/412187162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ce806d2b0 0x7f3ce81f0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:47.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.466+0000 7f3ce77fe640 1 -- 172.21.15.88:0/412187162 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd8009420 con 0x7f3ce80c3b80 2023-12-08T08:23:47.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.466+0000 7f3cecc66640 1 --2- 172.21.15.88:0/412187162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ce80c5300 0x7f3ce81eca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:47.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.466+0000 7f3ce7fff640 1 --2- 172.21.15.88:0/412187162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ce806d2b0 0x7f3ce81f0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:47.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.466+0000 7f3ce77fe640 1 --2- 172.21.15.88:0/412187162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ce80c3b80 0x7f3ce81505d0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00c480 tx=0x7f3cdc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:47.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.466+0000 7f3ce4ff9640 1 -- 172.21.15.88:0/412187162 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc012830 con 0x7f3ce80c3b80 2023-12-08T08:23:47.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.466+0000 7f3ce4ff9640 1 -- 172.21.15.88:0/412187162 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cdc0129b0 con 0x7f3ce80c3b80 2023-12-08T08:23:47.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.466+0000 7f3ce4ff9640 1 -- 172.21.15.88:0/412187162 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc012d60 con 0x7f3ce80c3b80 2023-12-08T08:23:47.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.466+0000 7f3cee6c9640 1 -- 172.21.15.88:0/412187162 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce814ef80 con 0x7f3ce80c3b80 2023-12-08T08:23:47.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.470+0000 7f3cee6c9640 1 -- 172.21.15.88:0/412187162 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce80aaa30 con 0x7f3ce80c3b80 2023-12-08T08:23:47.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.470+0000 7f3cee6c9640 1 -- 172.21.15.88:0/412187162 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce81f0670 con 0x7f3ce80c3b80 2023-12-08T08:23:47.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.470+0000 7f3ce4ff9640 1 -- 172.21.15.88:0/412187162 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3cdc01c460 con 0x7f3ce80c3b80 2023-12-08T08:23:47.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.470+0000 7f3ce4ff9640 1 --2- 172.21.15.88:0/412187162 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3cd40664a0 0x7f3cd4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:47.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.470+0000 7f3ce4ff9640 1 -- 172.21.15.88:0/412187162 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3cdc0840f0 con 0x7f3ce80c3b80 2023-12-08T08:23:47.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.470+0000 7f3ce7fff640 1 --2- 172.21.15.88:0/412187162 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3cd40664a0 0x7f3cd4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:47.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.470+0000 7f3ce7fff640 1 --2- 172.21.15.88:0/412187162 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3cd40664a0 0x7f3cd4068960 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3cd80af000 tx=0x7f3cd8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:47.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.474+0000 7f3ce4ff9640 1 -- 172.21.15.88:0/412187162 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3cdc051200 con 0x7f3ce80c3b80 2023-12-08T08:23:47.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.658+0000 7f3cee6c9640 1 -- 172.21.15.88:0/412187162 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ce8067630 con 0x7f3ce80c3b80 2023-12-08T08:23:47.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.658+0000 7f3ce4ff9640 1 -- 172.21.15.88:0/412187162 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+6137 (secure 0 0 0) 0x7f3cdc054820 con 0x7f3ce80c3b80 2023-12-08T08:23:47.663 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:47.663 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5693,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4194250074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4194250074},{"type":"v1","addr":"172.21.15.148:6833","nonce":4194250074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":5699,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3923000603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3923000603},{"type":"v1","addr":"172.21.15.148:6835","nonce":3923000603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:22:59.638045+0000","modified":"2023-12-08T08:23:02.646442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6525":{"gid":6525,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/698349615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":698349615},{"type":"v1","addr":"172.21.15.88:6837","nonce":698349615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:23:17.268042+0000","modified":"2023-12-08T08:23:20.393598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6519},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6519":{"gid":6519,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":7,"addr":"172.21.15.88:6835/1294328415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1294328415},{"type":"v1","addr":"172.21.15.88:6835","nonce":1294328415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-08T08:23:47.664 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 52 2023-12-08T08:23:47.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.662+0000 7f3cee6c9640 1 -- 172.21.15.88:0/412187162 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3cd40664a0 msgr2=0x7f3cd4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:47.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.662+0000 7f3cee6c9640 1 --2- 172.21.15.88:0/412187162 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3cd40664a0 0x7f3cd4068960 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3cd80af000 tx=0x7f3cd8008040 comp rx=0 tx=0).stop 2023-12-08T08:23:47.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.662+0000 7f3cee6c9640 1 -- 172.21.15.88:0/412187162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ce80c3b80 msgr2=0x7f3ce81505d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:47.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.662+0000 7f3cee6c9640 1 --2- 172.21.15.88:0/412187162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ce80c3b80 0x7f3ce81505d0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00c480 tx=0x7f3cdc00c940 comp rx=0 tx=0).stop 2023-12-08T08:23:47.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.662+0000 7f3cee6c9640 1 -- 172.21.15.88:0/412187162 shutdown_connections 2023-12-08T08:23:47.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.662+0000 7f3cee6c9640 1 --2- 172.21.15.88:0/412187162 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f3cd40664a0 0x7f3cd4068960 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:47.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.662+0000 7f3cee6c9640 1 --2- 172.21.15.88:0/412187162 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f3ce80c5300 0x7f3ce81eca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:47.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.662+0000 7f3cee6c9640 1 --2- 172.21.15.88:0/412187162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ce80c3b80 0x7f3ce81505d0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:47.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.662+0000 7f3cee6c9640 1 --2- 172.21.15.88:0/412187162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ce806d2b0 0x7f3ce81f0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:47.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.662+0000 7f3cee6c9640 1 -- 172.21.15.88:0/412187162 >> 172.21.15.88:0/412187162 conn(0x7f3ce80a7810 msgr2=0x7f3ce814e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:47.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.662+0000 7f3cee6c9640 1 -- 172.21.15.88:0/412187162 shutdown_connections 2023-12-08T08:23:47.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.662+0000 7f3cee6c9640 1 -- 172.21.15.88:0/412187162 wait complete. 2023-12-08T08:23:47.684 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:23:47.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.818+0000 7f757f18d640 1 Processor -- start 2023-12-08T08:23:47.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.818+0000 7f757f18d640 1 -- start start 2023-12-08T08:23:47.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.822+0000 7f757f18d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f757806d2b0 0x7f757806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:47.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.822+0000 7f757f18d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f75780c3b80 0x7f75780c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:47.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.822+0000 7f757f18d640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757806bb80 con 0x7f757806c020 2023-12-08T08:23:47.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.822+0000 7f757f18d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75780c5840 con 0x7f757806d2b0 2023-12-08T08:23:47.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.822+0000 7f757f18d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75781515c0 con 0x7f75780c3b80 2023-12-08T08:23:47.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.822+0000 7f757cf29640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f757806d2b0 0x7f757806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:47.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.822+0000 7f757cf29640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f757806d2b0 0x7f757806d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36960/0 (socket says 172.21.15.88:36960) 2023-12-08T08:23:47.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.822+0000 7f757cf29640 1 -- 172.21.15.88:0/3368951372 learned_addr learned my addr 172.21.15.88:0/3368951372 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:47.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.822+0000 7f7577fff640 1 --2- 172.21.15.88:0/3368951372 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f75780c3b80 0x7f75780c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:47.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.822+0000 7f757cf29640 1 -- 172.21.15.88:0/3368951372 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f75780c3b80 msgr2=0x7f75780c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:47.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.822+0000 7f757cf29640 1 --2- 172.21.15.88:0/3368951372 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f75780c3b80 0x7f75780c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:47.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.822+0000 7f757cf29640 1 -- 172.21.15.88:0/3368951372 >> v1:172.21.15.148:6789/0 conn(0x7f757806c020 legacy=0x7f757806c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:47.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.822+0000 7f757cf29640 1 -- 172.21.15.88:0/3368951372 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75781518a0 con 0x7f757806d2b0 2023-12-08T08:23:47.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.822+0000 7f757cf29640 1 --2- 172.21.15.88:0/3368951372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f757806d2b0 0x7f757806d690 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f756c009870 tx=0x7f756c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c7d26ef4746cd7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:47.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.822+0000 7f75777fe640 1 -- 172.21.15.88:0/3368951372 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c0ab620 con 0x7f757806d2b0 2023-12-08T08:23:47.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f75777fe640 1 -- 172.21.15.88:0/3368951372 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756c0ab780 con 0x7f757806d2b0 2023-12-08T08:23:47.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f75777fe640 1 -- 172.21.15.88:0/3368951372 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c0abb10 con 0x7f757806d2b0 2023-12-08T08:23:47.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f757f18d640 1 -- 172.21.15.88:0/3368951372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f757806d2b0 msgr2=0x7f757806d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:47.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f757f18d640 1 --2- 172.21.15.88:0/3368951372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f757806d2b0 0x7f757806d690 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f756c009870 tx=0x7f756c01c510 comp rx=0 tx=0).stop 2023-12-08T08:23:47.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f757f18d640 1 -- 172.21.15.88:0/3368951372 shutdown_connections 2023-12-08T08:23:47.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f757f18d640 1 --2- 172.21.15.88:0/3368951372 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f75780c3b80 0x7f75780c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:47.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f757f18d640 1 --2- 172.21.15.88:0/3368951372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f757806d2b0 0x7f757806d690 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:47.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f757f18d640 1 -- 172.21.15.88:0/3368951372 >> 172.21.15.88:0/3368951372 conn(0x7f75780a7810 msgr2=0x7f75780a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:47.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f757f18d640 1 -- 172.21.15.88:0/3368951372 shutdown_connections 2023-12-08T08:23:47.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f757f18d640 1 -- 172.21.15.88:0/3368951372 wait complete. 2023-12-08T08:23:47.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f757f18d640 1 Processor -- start 2023-12-08T08:23:47.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f757f18d640 1 -- start start 2023-12-08T08:23:47.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f757f18d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f757806c020 0x7f757814cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:47.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f757f18d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f757806d2b0 0x7f75780bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:47.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f757f18d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f75780c3b80 0x7f75780a9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:47.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f757f18d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75780aaf30 con 0x7f757806c020 2023-12-08T08:23:47.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f757f18d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75780ab140 con 0x7f757806d2b0 2023-12-08T08:23:47.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f757f18d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75781f11c0 con 0x7f75780c3b80 2023-12-08T08:23:47.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f757cf29640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f757806c020 0x7f757814cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:47.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f757cf29640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f757806c020 0x7f757814cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36974/0 (socket says 172.21.15.88:36974) 2023-12-08T08:23:47.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f757cf29640 1 -- 172.21.15.88:0/785608165 learned_addr learned my addr 172.21.15.88:0/785608165 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:47.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f757d72a640 1 --2- 172.21.15.88:0/785608165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f75780c3b80 0x7f75780a9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:47.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f7577fff640 1 --2- 172.21.15.88:0/785608165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f757806d2b0 0x7f75780bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:47.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f757cf29640 1 -- 172.21.15.88:0/785608165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f75780c3b80 msgr2=0x7f75780a9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:47.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f757cf29640 1 --2- 172.21.15.88:0/785608165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f75780c3b80 0x7f75780a9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:47.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f757cf29640 1 -- 172.21.15.88:0/785608165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f757806d2b0 msgr2=0x7f75780bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:47.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f757cf29640 1 --2- 172.21.15.88:0/785608165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f757806d2b0 0x7f75780bf0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:47.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f757cf29640 1 -- 172.21.15.88:0/785608165 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756c0094d0 con 0x7f757806c020 2023-12-08T08:23:47.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.826+0000 7f757d72a640 1 --2- 172.21.15.88:0/785608165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f75780c3b80 0x7f75780a9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:47.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.830+0000 7f757cf29640 1 --2- 172.21.15.88:0/785608165 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f757806c020 0x7f757814cbc0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f756c0ad040 tx=0x7f756c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:47.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.830+0000 7f75757fa640 1 -- 172.21.15.88:0/785608165 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c0be3f0 con 0x7f757806c020 2023-12-08T08:23:47.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.830+0000 7f75757fa640 1 -- 172.21.15.88:0/785608165 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756c0be550 con 0x7f757806c020 2023-12-08T08:23:47.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.830+0000 7f757f18d640 1 -- 172.21.15.88:0/785608165 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f757814ef80 con 0x7f757806c020 2023-12-08T08:23:47.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.830+0000 7f75757fa640 1 -- 172.21.15.88:0/785608165 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c0be900 con 0x7f757806c020 2023-12-08T08:23:47.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.830+0000 7f757f18d640 1 -- 172.21.15.88:0/785608165 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75780ab400 con 0x7f757806c020 2023-12-08T08:23:47.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.830+0000 7f757f18d640 1 -- 172.21.15.88:0/785608165 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75780a82b0 con 0x7f757806c020 2023-12-08T08:23:47.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.830+0000 7f75757fa640 1 -- 172.21.15.88:0/785608165 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f756c0b43f0 con 0x7f757806c020 2023-12-08T08:23:47.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.830+0000 7f75757fa640 1 --2- 172.21.15.88:0/785608165 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f755c066470 0x7f755c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:47.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.830+0000 7f75757fa640 1 -- 172.21.15.88:0/785608165 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f756c11e8d0 con 0x7f757806c020 2023-12-08T08:23:47.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.830+0000 7f7577fff640 1 --2- 172.21.15.88:0/785608165 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f755c066470 0x7f755c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:47.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.834+0000 7f7577fff640 1 --2- 172.21.15.88:0/785608165 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f755c066470 0x7f755c068930 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f75780ab8f0 tx=0x7f7564008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:47.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.834+0000 7f75757fa640 1 -- 172.21.15.88:0/785608165 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f756c0eba80 con 0x7f757806c020 2023-12-08T08:23:47.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.986+0000 7f757f18d640 1 -- 172.21.15.88:0/785608165 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75780ab5f0 con 0x7f757806c020 2023-12-08T08:23:47.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.990+0000 7f75757fa640 1 -- 172.21.15.88:0/785608165 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20190 (secure 0 0 0) 0x7f756c0ef0a0 con 0x7f757806c020 2023-12-08T08:23:47.994 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:47.995 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":72,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:23:18.903336+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:57.367467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:58.632605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:23:15.029129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:23:16.271716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:23:47.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.990+0000 7f757f18d640 1 -- 172.21.15.88:0/785608165 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f755c066470 msgr2=0x7f755c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:47.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.990+0000 7f757f18d640 1 --2- 172.21.15.88:0/785608165 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f755c066470 0x7f755c068930 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f75780ab8f0 tx=0x7f7564008040 comp rx=0 tx=0).stop 2023-12-08T08:23:47.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.990+0000 7f757f18d640 1 -- 172.21.15.88:0/785608165 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f757806c020 msgr2=0x7f757814cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:47.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.990+0000 7f757f18d640 1 --2- 172.21.15.88:0/785608165 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f757806c020 0x7f757814cbc0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f756c0ad040 tx=0x7f756c01ad50 comp rx=0 tx=0).stop 2023-12-08T08:23:47.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.990+0000 7f757f18d640 1 -- 172.21.15.88:0/785608165 shutdown_connections 2023-12-08T08:23:47.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.990+0000 7f757f18d640 1 --2- 172.21.15.88:0/785608165 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f755c066470 0x7f755c068930 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:47.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.990+0000 7f757f18d640 1 --2- 172.21.15.88:0/785608165 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f75780c3b80 0x7f75780a9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:47.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.990+0000 7f757f18d640 1 --2- 172.21.15.88:0/785608165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f757806d2b0 0x7f75780bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:47.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.990+0000 7f757f18d640 1 --2- 172.21.15.88:0/785608165 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f757806c020 0x7f757814cbc0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:47.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.990+0000 7f757f18d640 1 -- 172.21.15.88:0/785608165 >> 172.21.15.88:0/785608165 conn(0x7f75780a7810 msgr2=0x7f75780c41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:47.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.990+0000 7f757f18d640 1 -- 172.21.15.88:0/785608165 shutdown_connections 2023-12-08T08:23:47.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:47.990+0000 7f757f18d640 1 -- 172.21.15.88:0/785608165 wait complete. 2023-12-08T08:23:48.015 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-08T08:23:48.016 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:23:48.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.150+0000 7f80f7c17640 1 Processor -- start 2023-12-08T08:23:48.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.150+0000 7f80f7c17640 1 -- start start 2023-12-08T08:23:48.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.150+0000 7f80f7c17640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f80f014fd10 0x7f80f00a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:48.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.150+0000 7f80f7c17640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f80f00a5300 0x7f80f0071e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:48.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.150+0000 7f80f7c17640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f00c5710 con 0x7f80f0072370 2023-12-08T08:23:48.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.150+0000 7f80f7c17640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f006c5e0 con 0x7f80f014fd10 2023-12-08T08:23:48.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.150+0000 7f80f7c17640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f0155c80 con 0x7f80f00a5300 2023-12-08T08:23:48.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.150+0000 7f80f59b3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f80f014fd10 0x7f80f00a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:48.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.150+0000 7f80f61b4640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f80f0072370 0x7f80f0156110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41392/0 (socket says 172.21.15.88:41392) 2023-12-08T08:23:48.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.150+0000 7f80f59b3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f80f014fd10 0x7f80f00a4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36982/0 (socket says 172.21.15.88:36982) 2023-12-08T08:23:48.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.150+0000 7f80f61b4640 1 -- 172.21.15.88:0/518212268 learned_addr learned my addr 172.21.15.88:0/518212268 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:48.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.150+0000 7f80f51b2640 1 --2- 172.21.15.88:0/518212268 >> v2:172.21.15.148:3300/0 conn(0x7f80f00a5300 0x7f80f0071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:48.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.150+0000 7f80f59b3640 1 -- 172.21.15.88:0/518212268 >> v2:172.21.15.148:3300/0 conn(0x7f80f00a5300 msgr2=0x7f80f0071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:48.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.150+0000 7f80f59b3640 1 --2- 172.21.15.88:0/518212268 >> v2:172.21.15.148:3300/0 conn(0x7f80f00a5300 0x7f80f0071e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:48.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.150+0000 7f80f59b3640 1 -- 172.21.15.88:0/518212268 >> v1:172.21.15.88:6789/0 conn(0x7f80f0072370 legacy=0x7f80f0156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:48.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.150+0000 7f80f59b3640 1 -- 172.21.15.88:0/518212268 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f00c4e70 con 0x7f80f014fd10 2023-12-08T08:23:48.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.150+0000 7f80f49b1640 1 -- 172.21.15.88:0/518212268 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329558335 0 0) 0x7f80f00c5710 con 0x7f80f0072370 2023-12-08T08:23:48.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.154+0000 7f80f59b3640 1 --2- 172.21.15.88:0/518212268 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80f014fd10 0x7f80f00a4dc0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f80f0066e30 tx=0x7f80ec01c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b796a18626354de3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:48.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.154+0000 7f80f49b1640 1 -- 172.21.15.88:0/518212268 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec0ac640 con 0x7f80f014fd10 2023-12-08T08:23:48.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.154+0000 7f80f49b1640 1 -- 172.21.15.88:0/518212268 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ec0ac7a0 con 0x7f80f014fd10 2023-12-08T08:23:48.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.154+0000 7f80f49b1640 1 -- 172.21.15.88:0/518212268 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec0acb30 con 0x7f80f014fd10 2023-12-08T08:23:48.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.154+0000 7f80f7c17640 1 -- 172.21.15.88:0/518212268 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80f014fd10 msgr2=0x7f80f00a4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:48.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.154+0000 7f80f7c17640 1 --2- 172.21.15.88:0/518212268 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80f014fd10 0x7f80f00a4dc0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f80f0066e30 tx=0x7f80ec01c310 comp rx=0 tx=0).stop 2023-12-08T08:23:48.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.154+0000 7f80f7c17640 1 -- 172.21.15.88:0/518212268 shutdown_connections 2023-12-08T08:23:48.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.154+0000 7f80f7c17640 1 --2- 172.21.15.88:0/518212268 >> v2:172.21.15.148:3300/0 conn(0x7f80f00a5300 0x7f80f0071e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:48.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.154+0000 7f80f7c17640 1 --2- 172.21.15.88:0/518212268 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80f014fd10 0x7f80f00a4dc0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:48.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.154+0000 7f80f7c17640 1 -- 172.21.15.88:0/518212268 >> 172.21.15.88:0/518212268 conn(0x7f80f00a7810 msgr2=0x7f80f00a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:48.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.154+0000 7f80f7c17640 1 -- 172.21.15.88:0/518212268 shutdown_connections 2023-12-08T08:23:48.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.154+0000 7f80f7c17640 1 -- 172.21.15.88:0/518212268 wait complete. 2023-12-08T08:23:48.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.158+0000 7f80f7c17640 1 Processor -- start 2023-12-08T08:23:48.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.158+0000 7f80f7c17640 1 -- start start 2023-12-08T08:23:48.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.158+0000 7f80f7c17640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80f0072370 0x7f80f0070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:48.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.158+0000 7f80f7c17640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80f00a5300 0x7f80f00a8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:48.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.158+0000 7f80f7c17640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80f014fd10 0x7f80f00a9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:48.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.158+0000 7f80f7c17640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f0151260 con 0x7f80f00a5300 2023-12-08T08:23:48.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.158+0000 7f80f7c17640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f0150710 con 0x7f80f0072370 2023-12-08T08:23:48.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.158+0000 7f80f7c17640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f0150430 con 0x7f80f014fd10 2023-12-08T08:23:48.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.158+0000 7f80f51b2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80f00a5300 0x7f80f00a8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:48.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.158+0000 7f80f51b2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80f00a5300 0x7f80f00a8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36990/0 (socket says 172.21.15.88:36990) 2023-12-08T08:23:48.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.158+0000 7f80f51b2640 1 -- 172.21.15.88:0/2563938656 learned_addr learned my addr 172.21.15.88:0/2563938656 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:48.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.158+0000 7f80f59b3640 1 --2- 172.21.15.88:0/2563938656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80f0072370 0x7f80f0070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:48.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.158+0000 7f80f61b4640 1 --2- 172.21.15.88:0/2563938656 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80f014fd10 0x7f80f00a9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:48.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.158+0000 7f80f51b2640 1 -- 172.21.15.88:0/2563938656 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80f014fd10 msgr2=0x7f80f00a9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:48.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.158+0000 7f80f51b2640 1 --2- 172.21.15.88:0/2563938656 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80f014fd10 0x7f80f00a9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:48.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.158+0000 7f80f51b2640 1 -- 172.21.15.88:0/2563938656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80f0072370 msgr2=0x7f80f0070c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:48.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.158+0000 7f80f51b2640 1 --2- 172.21.15.88:0/2563938656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80f0072370 0x7f80f0070c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:48.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.158+0000 7f80f51b2640 1 -- 172.21.15.88:0/2563938656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec009420 con 0x7f80f00a5300 2023-12-08T08:23:48.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.158+0000 7f80f51b2640 1 --2- 172.21.15.88:0/2563938656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80f00a5300 0x7f80f00a8b40 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f80e000d800 tx=0x7f80e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:48.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.158+0000 7f80e67fc640 1 -- 172.21.15.88:0/2563938656 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e000b6c0 con 0x7f80f00a5300 2023-12-08T08:23:48.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.158+0000 7f80e67fc640 1 -- 172.21.15.88:0/2563938656 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e000b820 con 0x7f80f00a5300 2023-12-08T08:23:48.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.158+0000 7f80f7c17640 1 -- 172.21.15.88:0/2563938656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f0150c10 con 0x7f80f00a5300 2023-12-08T08:23:48.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.158+0000 7f80e67fc640 1 -- 172.21.15.88:0/2563938656 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e000bbd0 con 0x7f80f00a5300 2023-12-08T08:23:48.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.158+0000 7f80f7c17640 1 -- 172.21.15.88:0/2563938656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f01532d0 con 0x7f80f00a5300 2023-12-08T08:23:48.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.162+0000 7f80f7c17640 1 -- 172.21.15.88:0/2563938656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f00bfee0 con 0x7f80f00a5300 2023-12-08T08:23:48.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.162+0000 7f80e67fc640 1 -- 172.21.15.88:0/2563938656 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f80e000bd30 con 0x7f80f00a5300 2023-12-08T08:23:48.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.162+0000 7f80e67fc640 1 --2- 172.21.15.88:0/2563938656 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f80d4066470 0x7f80d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:48.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.162+0000 7f80e67fc640 1 -- 172.21.15.88:0/2563938656 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f80e0084640 con 0x7f80f00a5300 2023-12-08T08:23:48.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.162+0000 7f80f59b3640 1 --2- 172.21.15.88:0/2563938656 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f80d4066470 0x7f80d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:48.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.162+0000 7f80f59b3640 1 --2- 172.21.15.88:0/2563938656 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f80d4066470 0x7f80d4068930 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0ae000 tx=0x7f80ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:48.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.166+0000 7f80e67fc640 1 -- 172.21.15.88:0/2563938656 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f80e0051800 con 0x7f80f00a5300 2023-12-08T08:23:48.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.350+0000 7f80f7c17640 1 -- 172.21.15.88:0/2563938656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80f0067630 con 0x7f80f00a5300 2023-12-08T08:23:48.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.350+0000 7f80e67fc640 1 -- 172.21.15.88:0/2563938656 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+6137 (secure 0 0 0) 0x7f80e0054e20 con 0x7f80f00a5300 2023-12-08T08:23:48.356 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:48.356 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5693,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4194250074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4194250074},{"type":"v1","addr":"172.21.15.148:6833","nonce":4194250074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":5699,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3923000603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3923000603},{"type":"v1","addr":"172.21.15.148:6835","nonce":3923000603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:22:59.638045+0000","modified":"2023-12-08T08:23:02.646442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6525":{"gid":6525,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/698349615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":698349615},{"type":"v1","addr":"172.21.15.88:6837","nonce":698349615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:23:17.268042+0000","modified":"2023-12-08T08:23:20.393598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6519},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6519":{"gid":6519,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":7,"addr":"172.21.15.88:6835/1294328415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1294328415},{"type":"v1","addr":"172.21.15.88:6835","nonce":1294328415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-08T08:23:48.356 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 52 2023-12-08T08:23:48.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.354+0000 7f80f7c17640 1 -- 172.21.15.88:0/2563938656 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f80d4066470 msgr2=0x7f80d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:48.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.354+0000 7f80f7c17640 1 --2- 172.21.15.88:0/2563938656 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f80d4066470 0x7f80d4068930 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0ae000 tx=0x7f80ec008040 comp rx=0 tx=0).stop 2023-12-08T08:23:48.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.354+0000 7f80f7c17640 1 -- 172.21.15.88:0/2563938656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80f00a5300 msgr2=0x7f80f00a8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:48.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.354+0000 7f80f7c17640 1 --2- 172.21.15.88:0/2563938656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80f00a5300 0x7f80f00a8b40 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f80e000d800 tx=0x7f80e000dcc0 comp rx=0 tx=0).stop 2023-12-08T08:23:48.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.354+0000 7f80f7c17640 1 -- 172.21.15.88:0/2563938656 shutdown_connections 2023-12-08T08:23:48.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.354+0000 7f80f7c17640 1 --2- 172.21.15.88:0/2563938656 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f80d4066470 0x7f80d4068930 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:48.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.354+0000 7f80f7c17640 1 --2- 172.21.15.88:0/2563938656 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f80f014fd10 0x7f80f00a9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:48.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.354+0000 7f80f7c17640 1 --2- 172.21.15.88:0/2563938656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80f00a5300 0x7f80f00a8b40 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:48.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.354+0000 7f80f7c17640 1 --2- 172.21.15.88:0/2563938656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80f0072370 0x7f80f0070c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:48.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.354+0000 7f80f7c17640 1 -- 172.21.15.88:0/2563938656 >> 172.21.15.88:0/2563938656 conn(0x7f80f00a7810 msgr2=0x7f80f014eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:48.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.354+0000 7f80f7c17640 1 -- 172.21.15.88:0/2563938656 shutdown_connections 2023-12-08T08:23:48.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.354+0000 7f80f7c17640 1 -- 172.21.15.88:0/2563938656 wait complete. 2023-12-08T08:23:48.377 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:23:48.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.510+0000 7fda0fd1d640 1 Processor -- start 2023-12-08T08:23:48.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.510+0000 7fda0fd1d640 1 -- start start 2023-12-08T08:23:48.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.510+0000 7fda0fd1d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fda080c0f30 0x7fda08072580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:48.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.510+0000 7fda0fd1d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda080c1a50 con 0x7fda080c0460 2023-12-08T08:23:48.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.510+0000 7fda0fd1d640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda08159990 con 0x7fda080c3960 2023-12-08T08:23:48.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.510+0000 7fda0fd1d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda080c3de0 con 0x7fda080c0f30 2023-12-08T08:23:48.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.510+0000 7fda0dab9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fda080c0f30 0x7fda08072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:48.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.510+0000 7fda0dab9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fda080c0f30 0x7fda08072580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36998/0 (socket says 172.21.15.88:36998) 2023-12-08T08:23:48.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.510+0000 7fda0e2ba640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fda080c0460 0x7fda08155ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41406/0 (socket says 172.21.15.88:41406) 2023-12-08T08:23:48.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.510+0000 7fda0dab9640 1 -- 172.21.15.88:0/1149310867 learned_addr learned my addr 172.21.15.88:0/1149310867 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:48.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.514+0000 7fda0dab9640 1 -- 172.21.15.88:0/1149310867 >> v1:172.21.15.148:6789/0 conn(0x7fda080c3960 legacy=0x7fda08159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:48.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.514+0000 7fda0dab9640 1 -- 172.21.15.88:0/1149310867 >> v1:172.21.15.88:6789/0 conn(0x7fda080c0460 legacy=0x7fda08155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:48.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.514+0000 7fda0dab9640 1 -- 172.21.15.88:0/1149310867 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda080c0890 con 0x7fda080c0f30 2023-12-08T08:23:48.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.514+0000 7fda0dab9640 1 --2- 172.21.15.88:0/1149310867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda080c0f30 0x7fda08072580 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fda04009870 tx=0x7fda0401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7643dc9ae9bb83b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:48.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.514+0000 7fda0cab7640 1 -- 172.21.15.88:0/1149310867 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda040ab670 con 0x7fda080c0f30 2023-12-08T08:23:48.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.514+0000 7fda0cab7640 1 -- 172.21.15.88:0/1149310867 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda040ab7d0 con 0x7fda080c0f30 2023-12-08T08:23:48.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.514+0000 7fda0cab7640 1 -- 172.21.15.88:0/1149310867 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda040abb60 con 0x7fda080c0f30 2023-12-08T08:23:48.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.514+0000 7fda0fd1d640 1 -- 172.21.15.88:0/1149310867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda080c0f30 msgr2=0x7fda08072580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:48.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.514+0000 7fda0fd1d640 1 --2- 172.21.15.88:0/1149310867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda080c0f30 0x7fda08072580 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fda04009870 tx=0x7fda0401c470 comp rx=0 tx=0).stop 2023-12-08T08:23:48.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.514+0000 7fda0fd1d640 1 -- 172.21.15.88:0/1149310867 shutdown_connections 2023-12-08T08:23:48.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.514+0000 7fda0fd1d640 1 --2- 172.21.15.88:0/1149310867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda080c0f30 0x7fda08072580 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:48.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.518+0000 7fda0fd1d640 1 -- 172.21.15.88:0/1149310867 >> 172.21.15.88:0/1149310867 conn(0x7fda080a7810 msgr2=0x7fda080a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:48.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.518+0000 7fda0fd1d640 1 -- 172.21.15.88:0/1149310867 shutdown_connections 2023-12-08T08:23:48.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.518+0000 7fda0fd1d640 1 -- 172.21.15.88:0/1149310867 wait complete. 2023-12-08T08:23:48.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.518+0000 7fda0fd1d640 1 Processor -- start 2023-12-08T08:23:48.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.518+0000 7fda0fd1d640 1 -- start start 2023-12-08T08:23:48.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.518+0000 7fda0fd1d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda080c0460 0x7fda08071780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:48.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.518+0000 7fda0fd1d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda080c0f30 0x7fda08071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:48.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.518+0000 7fda0fd1d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda080c3960 0x7fda0814fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:48.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.518+0000 7fda0fd1d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda080ab9f0 con 0x7fda080c0460 2023-12-08T08:23:48.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.518+0000 7fda0fd1d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda081490a0 con 0x7fda080c0f30 2023-12-08T08:23:48.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.518+0000 7fda0fd1d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda08149f00 con 0x7fda080c3960 2023-12-08T08:23:48.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.518+0000 7fda0dab9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda080c0460 0x7fda08071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:48.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.518+0000 7fda0dab9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda080c0460 0x7fda08071780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37008/0 (socket says 172.21.15.88:37008) 2023-12-08T08:23:48.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.518+0000 7fda0dab9640 1 -- 172.21.15.88:0/394624540 learned_addr learned my addr 172.21.15.88:0/394624540 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:48.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.518+0000 7fda0dab9640 1 -- 172.21.15.88:0/394624540 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda080c3960 msgr2=0x7fda0814fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:48.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.518+0000 7fda0dab9640 1 --2- 172.21.15.88:0/394624540 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda080c3960 0x7fda0814fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:48.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.518+0000 7fda0dab9640 1 -- 172.21.15.88:0/394624540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda080c0f30 msgr2=0x7fda08071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:48.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.518+0000 7fda0d2b8640 1 --2- 172.21.15.88:0/394624540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda080c0f30 0x7fda08071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:48.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.518+0000 7fda0dab9640 1 --2- 172.21.15.88:0/394624540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda080c0f30 0x7fda08071cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:48.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.518+0000 7fda0dab9640 1 -- 172.21.15.88:0/394624540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda040094d0 con 0x7fda080c0460 2023-12-08T08:23:48.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.518+0000 7fda0d2b8640 1 --2- 172.21.15.88:0/394624540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda080c0f30 0x7fda08071cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:48.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.518+0000 7fda0dab9640 1 --2- 172.21.15.88:0/394624540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda080c0460 0x7fda08071780 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fda040ad040 tx=0x7fda0401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:48.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.518+0000 7fd9fe7fc640 1 -- 172.21.15.88:0/394624540 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda040b48c0 con 0x7fda080c0460 2023-12-08T08:23:48.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.518+0000 7fd9fe7fc640 1 -- 172.21.15.88:0/394624540 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda040b4a40 con 0x7fda080c0460 2023-12-08T08:23:48.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.518+0000 7fd9fe7fc640 1 -- 172.21.15.88:0/394624540 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda040b4df0 con 0x7fda080c0460 2023-12-08T08:23:48.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.518+0000 7fda0fd1d640 1 -- 172.21.15.88:0/394624540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda08156760 con 0x7fda080c0460 2023-12-08T08:23:48.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.522+0000 7fda0fd1d640 1 -- 172.21.15.88:0/394624540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda081492f0 con 0x7fda080c0460 2023-12-08T08:23:48.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.522+0000 7fda0fd1d640 1 -- 172.21.15.88:0/394624540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda08067630 con 0x7fda080c0460 2023-12-08T08:23:48.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.522+0000 7fd9fe7fc640 1 -- 172.21.15.88:0/394624540 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fda040c7440 con 0x7fda080c0460 2023-12-08T08:23:48.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.522+0000 7fd9fe7fc640 1 --2- 172.21.15.88:0/394624540 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd9ec0664a0 0x7fd9ec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:48.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.522+0000 7fd9fe7fc640 1 -- 172.21.15.88:0/394624540 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fda0411ee10 con 0x7fda080c0460 2023-12-08T08:23:48.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.522+0000 7fda0d2b8640 1 --2- 172.21.15.88:0/394624540 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd9ec0664a0 0x7fd9ec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:48.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.522+0000 7fda0d2b8640 1 --2- 172.21.15.88:0/394624540 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd9ec0664a0 0x7fd9ec068960 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fda0806de30 tx=0x7fd9f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:48.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.526+0000 7fd9fe7fc640 1 -- 172.21.15.88:0/394624540 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fda04122030 con 0x7fda080c0460 2023-12-08T08:23:48.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.710+0000 7fda0fd1d640 1 -- 172.21.15.88:0/394624540 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda081595d0 con 0x7fda080c0460 2023-12-08T08:23:48.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.710+0000 7fd9fe7fc640 1 -- 172.21.15.88:0/394624540 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+6137 (secure 0 0 0) 0x7fda040ec040 con 0x7fda080c0460 2023-12-08T08:23:48.714 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:48.714 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5693,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4194250074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4194250074},{"type":"v1","addr":"172.21.15.148:6833","nonce":4194250074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":5699,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3923000603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3923000603},{"type":"v1","addr":"172.21.15.148:6835","nonce":3923000603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:22:59.638045+0000","modified":"2023-12-08T08:23:02.646442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6525":{"gid":6525,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/698349615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":698349615},{"type":"v1","addr":"172.21.15.88:6837","nonce":698349615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:23:17.268042+0000","modified":"2023-12-08T08:23:20.393598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6519},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6519":{"gid":6519,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":7,"addr":"172.21.15.88:6835/1294328415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1294328415},{"type":"v1","addr":"172.21.15.88:6835","nonce":1294328415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-08T08:23:48.716 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 52 2023-12-08T08:23:48.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.710+0000 7fda0fd1d640 1 -- 172.21.15.88:0/394624540 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd9ec0664a0 msgr2=0x7fd9ec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:48.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.710+0000 7fda0fd1d640 1 --2- 172.21.15.88:0/394624540 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd9ec0664a0 0x7fd9ec068960 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fda0806de30 tx=0x7fd9f8008040 comp rx=0 tx=0).stop 2023-12-08T08:23:48.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.710+0000 7fda0fd1d640 1 -- 172.21.15.88:0/394624540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda080c0460 msgr2=0x7fda08071780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:48.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.710+0000 7fda0fd1d640 1 --2- 172.21.15.88:0/394624540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda080c0460 0x7fda08071780 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fda040ad040 tx=0x7fda0401acb0 comp rx=0 tx=0).stop 2023-12-08T08:23:48.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.710+0000 7fda0fd1d640 1 -- 172.21.15.88:0/394624540 shutdown_connections 2023-12-08T08:23:48.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.710+0000 7fda0fd1d640 1 --2- 172.21.15.88:0/394624540 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd9ec0664a0 0x7fd9ec068960 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:48.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.710+0000 7fda0fd1d640 1 --2- 172.21.15.88:0/394624540 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fda080c3960 0x7fda0814fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:48.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.710+0000 7fda0fd1d640 1 --2- 172.21.15.88:0/394624540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda080c0f30 0x7fda08071cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:48.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.710+0000 7fda0fd1d640 1 --2- 172.21.15.88:0/394624540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda080c0460 0x7fda08071780 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:48.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.710+0000 7fda0fd1d640 1 -- 172.21.15.88:0/394624540 >> 172.21.15.88:0/394624540 conn(0x7fda080a7810 msgr2=0x7fda080c3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:48.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.710+0000 7fda0fd1d640 1 -- 172.21.15.88:0/394624540 shutdown_connections 2023-12-08T08:23:48.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.710+0000 7fda0fd1d640 1 -- 172.21.15.88:0/394624540 wait complete. 2023-12-08T08:23:48.735 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:23:48.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.866+0000 7f46a0e79640 1 Processor -- start 2023-12-08T08:23:48.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.870+0000 7f46a0e79640 1 -- start start 2023-12-08T08:23:48.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.870+0000 7f46a0e79640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f469c071e30 0x7f469c0722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:48.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.870+0000 7f46a0e79640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f469c156110 0x7f469c1565a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:48.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.870+0000 7f46a0e79640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469c0c5710 con 0x7f469c14fd10 2023-12-08T08:23:48.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.870+0000 7f46a0e79640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469c06c5e0 con 0x7f469c071e30 2023-12-08T08:23:48.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.870+0000 7f46a0e79640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c155c80 con 0x7f469c156110 2023-12-08T08:23:48.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.870+0000 7f469ad9d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f469c156110 0x7f469c1565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:48.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.870+0000 7f4693fff640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f469c071e30 0x7f469c0722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:48.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.870+0000 7f469ad9d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f469c156110 0x7f469c1565a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:45268/0 (socket says 172.21.15.88:45268) 2023-12-08T08:23:48.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.870+0000 7f469ad9d640 1 -- 172.21.15.88:0/1458110691 learned_addr learned my addr 172.21.15.88:0/1458110691 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:48.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.870+0000 7f469ad9d640 1 -- 172.21.15.88:0/1458110691 >> v2:172.21.15.148:3300/0 conn(0x7f469c071e30 msgr2=0x7f469c0722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:48.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.870+0000 7f469ad9d640 1 --2- 172.21.15.88:0/1458110691 >> v2:172.21.15.148:3300/0 conn(0x7f469c071e30 0x7f469c0722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:48.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.870+0000 7f469ad9d640 1 -- 172.21.15.88:0/1458110691 >> v1:172.21.15.148:6789/0 conn(0x7f469c14fd10 legacy=0x7f469c0a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:48.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.870+0000 7f4699d9b640 1 -- 172.21.15.88:0/1458110691 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2984970179 0 0) 0x7f469c0c5710 con 0x7f469c14fd10 2023-12-08T08:23:48.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.870+0000 7f469ad9d640 1 -- 172.21.15.88:0/1458110691 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c0c4e70 con 0x7f469c156110 2023-12-08T08:23:48.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.874+0000 7f469ad9d640 1 --2- 172.21.15.88:0/1458110691 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f469c156110 0x7f469c1565a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4694009e50 tx=0x7f469401c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fba804c1b92ab00 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:48.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.874+0000 7f4699d9b640 1 -- 172.21.15.88:0/1458110691 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46940a5780 con 0x7f469c156110 2023-12-08T08:23:48.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.874+0000 7f4699d9b640 1 -- 172.21.15.88:0/1458110691 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46940a58e0 con 0x7f469c156110 2023-12-08T08:23:48.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.874+0000 7f4699d9b640 1 -- 172.21.15.88:0/1458110691 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46940a5c70 con 0x7f469c156110 2023-12-08T08:23:48.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.874+0000 7f46a0e79640 1 -- 172.21.15.88:0/1458110691 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f469c156110 msgr2=0x7f469c1565a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:48.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.874+0000 7f46a0e79640 1 --2- 172.21.15.88:0/1458110691 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f469c156110 0x7f469c1565a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4694009e50 tx=0x7f469401c8c0 comp rx=0 tx=0).stop 2023-12-08T08:23:48.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.874+0000 7f46a0e79640 1 -- 172.21.15.88:0/1458110691 shutdown_connections 2023-12-08T08:23:48.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.874+0000 7f46a0e79640 1 --2- 172.21.15.88:0/1458110691 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f469c156110 0x7f469c1565a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:48.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.874+0000 7f46a0e79640 1 --2- 172.21.15.88:0/1458110691 >> v2:172.21.15.148:3300/0 conn(0x7f469c071e30 0x7f469c0722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:48.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.874+0000 7f46a0e79640 1 -- 172.21.15.88:0/1458110691 >> 172.21.15.88:0/1458110691 conn(0x7f469c0a7810 msgr2=0x7f469c0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:48.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.874+0000 7f46a0e79640 1 -- 172.21.15.88:0/1458110691 shutdown_connections 2023-12-08T08:23:48.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.874+0000 7f46a0e79640 1 -- 172.21.15.88:0/1458110691 wait complete. 2023-12-08T08:23:48.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.878+0000 7f46a0e79640 1 Processor -- start 2023-12-08T08:23:48.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.878+0000 7f46a0e79640 1 -- start start 2023-12-08T08:23:48.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.878+0000 7f46a0e79640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f469c071e30 0x7f469c14ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:48.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.878+0000 7f46a0e79640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f469c14fd10 0x7f469c0aa7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:48.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.878+0000 7f46a0e79640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f469c156110 0x7f469c0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:48.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.878+0000 7f46a0e79640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c15be30 con 0x7f469c156110 2023-12-08T08:23:48.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.878+0000 7f46a0e79640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c1ec940 con 0x7f469c14fd10 2023-12-08T08:23:48.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.878+0000 7f46a0e79640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c1532c0 con 0x7f469c071e30 2023-12-08T08:23:48.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.878+0000 7f469ad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f469c156110 0x7f469c0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:48.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.878+0000 7f469ad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f469c156110 0x7f469c0aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37010/0 (socket says 172.21.15.88:37010) 2023-12-08T08:23:48.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.878+0000 7f469ad9d640 1 -- 172.21.15.88:0/3631504218 learned_addr learned my addr 172.21.15.88:0/3631504218 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:48.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.878+0000 7f469a59c640 1 --2- 172.21.15.88:0/3631504218 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f469c071e30 0x7f469c14ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:48.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.878+0000 7f4693fff640 1 --2- 172.21.15.88:0/3631504218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f469c14fd10 0x7f469c0aa7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:48.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.878+0000 7f469ad9d640 1 -- 172.21.15.88:0/3631504218 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f469c071e30 msgr2=0x7f469c14ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:48.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.878+0000 7f469ad9d640 1 --2- 172.21.15.88:0/3631504218 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f469c071e30 0x7f469c14ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:48.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.878+0000 7f469ad9d640 1 -- 172.21.15.88:0/3631504218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f469c14fd10 msgr2=0x7f469c0aa7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:48.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.878+0000 7f469ad9d640 1 --2- 172.21.15.88:0/3631504218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f469c14fd10 0x7f469c0aa7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:48.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.878+0000 7f469ad9d640 1 -- 172.21.15.88:0/3631504218 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4694009b30 con 0x7f469c156110 2023-12-08T08:23:48.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.878+0000 7f469ad9d640 1 --2- 172.21.15.88:0/3631504218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f469c156110 0x7f469c0aacf0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f46940af040 tx=0x7f4694019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:48.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.878+0000 7f4692ffd640 1 -- 172.21.15.88:0/3631504218 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46940b8640 con 0x7f469c156110 2023-12-08T08:23:48.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.878+0000 7f4692ffd640 1 -- 172.21.15.88:0/3631504218 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46940b87a0 con 0x7f469c156110 2023-12-08T08:23:48.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.878+0000 7f4692ffd640 1 -- 172.21.15.88:0/3631504218 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46940b8b50 con 0x7f469c156110 2023-12-08T08:23:48.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.878+0000 7f46a0e79640 1 -- 172.21.15.88:0/3631504218 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f469c0a99f0 con 0x7f469c156110 2023-12-08T08:23:48.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.878+0000 7f46a0e79640 1 -- 172.21.15.88:0/3631504218 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469c0a9fb0 con 0x7f469c156110 2023-12-08T08:23:48.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.878+0000 7f46a0e79640 1 -- 172.21.15.88:0/3631504218 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f469c072800 con 0x7f469c156110 2023-12-08T08:23:48.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.882+0000 7f4692ffd640 1 -- 172.21.15.88:0/3631504218 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f46940b8cb0 con 0x7f469c156110 2023-12-08T08:23:48.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.882+0000 7f4692ffd640 1 --2- 172.21.15.88:0/3631504218 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f467c066470 0x7f467c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:48.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.882+0000 7f4692ffd640 1 -- 172.21.15.88:0/3631504218 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f469411eb90 con 0x7f469c156110 2023-12-08T08:23:48.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.882+0000 7f469a59c640 1 --2- 172.21.15.88:0/3631504218 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f467c066470 0x7f467c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:48.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.882+0000 7f469a59c640 1 --2- 172.21.15.88:0/3631504218 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f467c066470 0x7f467c068930 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f468c000f70 tx=0x7f468c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:48.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:48.886+0000 7f4692ffd640 1 -- 172.21.15.88:0/3631504218 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f46940ebdf0 con 0x7f469c156110 2023-12-08T08:23:49.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.038+0000 7f46a0e79640 1 -- 172.21.15.88:0/3631504218 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f469c067630 con 0x7f469c156110 2023-12-08T08:23:49.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.042+0000 7f4692ffd640 1 -- 172.21.15.88:0/3631504218 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20190 (secure 0 0 0) 0x7f46940ef410 con 0x7f469c156110 2023-12-08T08:23:49.045 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:49.046 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":72,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:23:18.903336+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:22:57.367467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-08T08:22:58.632605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:23:15.029129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:23:16.271716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:23:49.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.042+0000 7f46a0e79640 1 -- 172.21.15.88:0/3631504218 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f467c066470 msgr2=0x7f467c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:49.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.042+0000 7f46a0e79640 1 --2- 172.21.15.88:0/3631504218 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f467c066470 0x7f467c068930 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f468c000f70 tx=0x7f468c009040 comp rx=0 tx=0).stop 2023-12-08T08:23:49.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.042+0000 7f46a0e79640 1 -- 172.21.15.88:0/3631504218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f469c156110 msgr2=0x7f469c0aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:49.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.042+0000 7f46a0e79640 1 --2- 172.21.15.88:0/3631504218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f469c156110 0x7f469c0aacf0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f46940af040 tx=0x7f4694019660 comp rx=0 tx=0).stop 2023-12-08T08:23:49.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.042+0000 7f46a0e79640 1 -- 172.21.15.88:0/3631504218 shutdown_connections 2023-12-08T08:23:49.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.042+0000 7f46a0e79640 1 --2- 172.21.15.88:0/3631504218 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f467c066470 0x7f467c068930 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:49.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.042+0000 7f46a0e79640 1 --2- 172.21.15.88:0/3631504218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f469c156110 0x7f469c0aacf0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:49.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.042+0000 7f46a0e79640 1 --2- 172.21.15.88:0/3631504218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f469c14fd10 0x7f469c0aa7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:49.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.042+0000 7f46a0e79640 1 --2- 172.21.15.88:0/3631504218 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f469c071e30 0x7f469c14ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:49.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.042+0000 7f46a0e79640 1 -- 172.21.15.88:0/3631504218 >> 172.21.15.88:0/3631504218 conn(0x7f469c0a7810 msgr2=0x7f469c0bf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:49.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.042+0000 7f46a0e79640 1 -- 172.21.15.88:0/3631504218 shutdown_connections 2023-12-08T08:23:49.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.042+0000 7f46a0e79640 1 -- 172.21.15.88:0/3631504218 wait complete. 2023-12-08T08:23:49.067 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-08T08:23:49.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.202+0000 7fd0f58f3640 1 Processor -- start 2023-12-08T08:23:49.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.202+0000 7fd0f58f3640 1 -- start start 2023-12-08T08:23:49.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.202+0000 7fd0f58f3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0f00c1d80 0x7fd0f00aab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:49.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.202+0000 7fd0f58f3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd0f00ab070 0x7fd0f00c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:49.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.202+0000 7fd0f58f3640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f006ce10 con 0x7fd0f00c4d80 2023-12-08T08:23:49.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.202+0000 7fd0f58f3640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0f006d620 con 0x7fd0f00ab070 2023-12-08T08:23:49.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.202+0000 7fd0f58f3640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f0152590 con 0x7fd0f00c1d80 2023-12-08T08:23:49.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.202+0000 7fd0f48f1640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd0f00c4d80 0x7fd0f0152a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41408/0 (socket says 172.21.15.88:41408) 2023-12-08T08:23:49.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.202+0000 7fd0f48f1640 1 -- 172.21.15.88:0/1821333497 learned_addr learned my addr 172.21.15.88:0/1821333497 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:49.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.202+0000 7fd0f50f2640 1 --2- 172.21.15.88:0/1821333497 >> v2:172.21.15.88:3300/0 conn(0x7fd0f00ab070 0x7fd0f00c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:49.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.202+0000 7fd0e7fff640 1 --2- 172.21.15.88:0/1821333497 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0f00c1d80 0x7fd0f00aab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:49.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.202+0000 7fd0e77fe640 1 -- 172.21.15.88:0/1821333497 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3273522538 0 0) 0x7fd0f006ce10 con 0x7fd0f00c4d80 2023-12-08T08:23:49.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.202+0000 7fd0e77fe640 1 -- 172.21.15.88:0/1821333497 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0d8003530 con 0x7fd0f00c4d80 2023-12-08T08:23:49.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.202+0000 7fd0f50f2640 1 -- 172.21.15.88:0/1821333497 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0f00c1d80 msgr2=0x7fd0f00aab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:49.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.202+0000 7fd0f50f2640 1 --2- 172.21.15.88:0/1821333497 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0f00c1d80 0x7fd0f00aab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:49.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.202+0000 7fd0f50f2640 1 -- 172.21.15.88:0/1821333497 >> v1:172.21.15.88:6789/0 conn(0x7fd0f00c4d80 legacy=0x7fd0f0152a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:49.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.202+0000 7fd0f50f2640 1 -- 172.21.15.88:0/1821333497 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f00a5230 con 0x7fd0f00ab070 2023-12-08T08:23:49.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.206+0000 7fd0f50f2640 1 --2- 172.21.15.88:0/1821333497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0f00ab070 0x7fd0f00c5160 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8009d90 tx=0x7fd0e801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509b44bdc1107234 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:49.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.206+0000 7fd0e77fe640 1 -- 172.21.15.88:0/1821333497 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e80a5950 con 0x7fd0f00ab070 2023-12-08T08:23:49.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.206+0000 7fd0e77fe640 1 -- 172.21.15.88:0/1821333497 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e80a5ab0 con 0x7fd0f00ab070 2023-12-08T08:23:49.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.206+0000 7fd0e77fe640 1 -- 172.21.15.88:0/1821333497 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e80a5e20 con 0x7fd0f00ab070 2023-12-08T08:23:49.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.206+0000 7fd0f58f3640 1 -- 172.21.15.88:0/1821333497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0f00ab070 msgr2=0x7fd0f00c5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:49.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.206+0000 7fd0f58f3640 1 --2- 172.21.15.88:0/1821333497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0f00ab070 0x7fd0f00c5160 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8009d90 tx=0x7fd0e801c890 comp rx=0 tx=0).stop 2023-12-08T08:23:49.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.206+0000 7fd0f58f3640 1 -- 172.21.15.88:0/1821333497 shutdown_connections 2023-12-08T08:23:49.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.206+0000 7fd0f58f3640 1 --2- 172.21.15.88:0/1821333497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0f00ab070 0x7fd0f00c5160 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:49.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.206+0000 7fd0f58f3640 1 --2- 172.21.15.88:0/1821333497 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0f00c1d80 0x7fd0f00aab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:49.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.206+0000 7fd0f58f3640 1 -- 172.21.15.88:0/1821333497 >> 172.21.15.88:0/1821333497 conn(0x7fd0f00c2270 msgr2=0x7fd0f00c2680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:49.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.206+0000 7fd0f58f3640 1 -- 172.21.15.88:0/1821333497 shutdown_connections 2023-12-08T08:23:49.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.206+0000 7fd0f58f3640 1 -- 172.21.15.88:0/1821333497 wait complete. 2023-12-08T08:23:49.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.210+0000 7fd0f58f3640 1 Processor -- start 2023-12-08T08:23:49.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.210+0000 7fd0f58f3640 1 -- start start 2023-12-08T08:23:49.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.210+0000 7fd0f58f3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0f00ab070 0x7fd0f01ecc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:49.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.210+0000 7fd0f58f3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0f00c1d80 0x7fd0f014dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:49.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.210+0000 7fd0f58f3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0f00c4d80 0x7fd0f01f0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:49.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.210+0000 7fd0f58f3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f0153470 con 0x7fd0f00c1d80 2023-12-08T08:23:49.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.210+0000 7fd0f58f3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f01536c0 con 0x7fd0f00c4d80 2023-12-08T08:23:49.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.210+0000 7fd0f58f3640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f01539a0 con 0x7fd0f00ab070 2023-12-08T08:23:49.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.210+0000 7fd0e7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0f00c1d80 0x7fd0f014dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:49.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.210+0000 7fd0e7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0f00c1d80 0x7fd0f014dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37028/0 (socket says 172.21.15.88:37028) 2023-12-08T08:23:49.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.210+0000 7fd0e7fff640 1 -- 172.21.15.88:0/76537629 learned_addr learned my addr 172.21.15.88:0/76537629 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:49.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.210+0000 7fd0f48f1640 1 --2- 172.21.15.88:0/76537629 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0f00ab070 0x7fd0f01ecc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:49.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.210+0000 7fd0f50f2640 1 --2- 172.21.15.88:0/76537629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0f00c4d80 0x7fd0f01f0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:49.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.210+0000 7fd0e7fff640 1 -- 172.21.15.88:0/76537629 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0f00ab070 msgr2=0x7fd0f01ecc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:49.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.210+0000 7fd0e7fff640 1 --2- 172.21.15.88:0/76537629 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0f00ab070 0x7fd0f01ecc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:49.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.210+0000 7fd0e7fff640 1 -- 172.21.15.88:0/76537629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0f00c4d80 msgr2=0x7fd0f01f0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:49.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.210+0000 7fd0e7fff640 1 --2- 172.21.15.88:0/76537629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0f00c4d80 0x7fd0f01f0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:49.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.210+0000 7fd0e7fff640 1 -- 172.21.15.88:0/76537629 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e8009a70 con 0x7fd0f00c1d80 2023-12-08T08:23:49.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.210+0000 7fd0f50f2640 1 --2- 172.21.15.88:0/76537629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0f00c4d80 0x7fd0f01f0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:49.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.210+0000 7fd0e7fff640 1 --2- 172.21.15.88:0/76537629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0f00c1d80 0x7fd0f014dfc0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd0e000d800 tx=0x7fd0e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:49.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.210+0000 7fd0e57fa640 1 -- 172.21.15.88:0/76537629 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e000b6c0 con 0x7fd0f00c1d80 2023-12-08T08:23:49.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.210+0000 7fd0e57fa640 1 -- 172.21.15.88:0/76537629 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e000b820 con 0x7fd0f00c1d80 2023-12-08T08:23:49.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.210+0000 7fd0e57fa640 1 -- 172.21.15.88:0/76537629 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e000bb90 con 0x7fd0f00c1d80 2023-12-08T08:23:49.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.210+0000 7fd0f58f3640 1 -- 172.21.15.88:0/76537629 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0f01f0240 con 0x7fd0f00c1d80 2023-12-08T08:23:49.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.210+0000 7fd0f58f3640 1 -- 172.21.15.88:0/76537629 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f014e500 con 0x7fd0f00c1d80 2023-12-08T08:23:49.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.214+0000 7fd0f58f3640 1 -- 172.21.15.88:0/76537629 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0f0153bc0 con 0x7fd0f00c1d80 2023-12-08T08:23:49.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.214+0000 7fd0e57fa640 1 -- 172.21.15.88:0/76537629 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd0e000bcf0 con 0x7fd0f00c1d80 2023-12-08T08:23:49.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.214+0000 7fd0e57fa640 1 --2- 172.21.15.88:0/76537629 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd0dc066470 0x7fd0dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:49.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.214+0000 7fd0e57fa640 1 -- 172.21.15.88:0/76537629 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd0e00845d0 con 0x7fd0f00c1d80 2023-12-08T08:23:49.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.214+0000 7fd0f48f1640 1 --2- 172.21.15.88:0/76537629 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd0dc066470 0x7fd0dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:49.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.214+0000 7fd0f48f1640 1 --2- 172.21.15.88:0/76537629 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd0dc066470 0x7fd0dc068930 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec007fd0 tx=0x7fd0ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:49.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.218+0000 7fd0e57fa640 1 -- 172.21.15.88:0/76537629 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd0e0051780 con 0x7fd0f00c1d80 2023-12-08T08:23:49.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.398+0000 7fd0f58f3640 1 -- 172.21.15.88:0/76537629 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd0f00674b0 con 0x7fd0f00c1d80 2023-12-08T08:23:49.404 INFO:tasks.ceph.mon.a.smithi088.stderr:2023-12-08T08:23:49.398+0000 7f9f56907640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-08T08:23:49.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.402+0000 7fd0e57fa640 1 -- 172.21.15.88:0/76537629 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v53) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd0e0054da0 con 0x7fd0f00c1d80 2023-12-08T08:23:49.407 INFO:teuthology.orchestra.run.smithi088.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-08T08:23:49.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.406+0000 7fd0f58f3640 1 -- 172.21.15.88:0/76537629 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd0dc066470 msgr2=0x7fd0dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:49.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.406+0000 7fd0f58f3640 1 --2- 172.21.15.88:0/76537629 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd0dc066470 0x7fd0dc068930 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec007fd0 tx=0x7fd0ec009040 comp rx=0 tx=0).stop 2023-12-08T08:23:49.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.406+0000 7fd0f58f3640 1 -- 172.21.15.88:0/76537629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0f00c1d80 msgr2=0x7fd0f014dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:49.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.406+0000 7fd0f58f3640 1 --2- 172.21.15.88:0/76537629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0f00c1d80 0x7fd0f014dfc0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd0e000d800 tx=0x7fd0e000dcc0 comp rx=0 tx=0).stop 2023-12-08T08:23:49.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.406+0000 7fd0f58f3640 1 -- 172.21.15.88:0/76537629 shutdown_connections 2023-12-08T08:23:49.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.406+0000 7fd0f58f3640 1 --2- 172.21.15.88:0/76537629 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd0dc066470 0x7fd0dc068930 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:49.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.406+0000 7fd0f58f3640 1 --2- 172.21.15.88:0/76537629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0f00c4d80 0x7fd0f01f0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:49.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.406+0000 7fd0f58f3640 1 --2- 172.21.15.88:0/76537629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0f00c1d80 0x7fd0f014dfc0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:49.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.406+0000 7fd0f58f3640 1 --2- 172.21.15.88:0/76537629 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd0f00ab070 0x7fd0f01ecc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:49.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.406+0000 7fd0f58f3640 1 -- 172.21.15.88:0/76537629 >> 172.21.15.88:0/76537629 conn(0x7fd0f00c2270 msgr2=0x7fd0f00aa930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:49.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.406+0000 7fd0f58f3640 1 -- 172.21.15.88:0/76537629 shutdown_connections 2023-12-08T08:23:49.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.406+0000 7fd0f58f3640 1 -- 172.21.15.88:0/76537629 wait complete. 2023-12-08T08:23:49.421 INFO:tasks.ceph.mds.c.smithi088.stderr: -5635> 2023-12-08T08:23:01.230+0000 7f8e66e3a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:23:49.432 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-08T08:23:49.470 INFO:tasks.ceph.mds.c.smithi088.stdout:starting mds.c at 2023-12-08T08:23:49.473 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:23:49.477 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:23:49.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.570+0000 7fd4c98ea640 1 Processor -- start 2023-12-08T08:23:49.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.570+0000 7fd4c98ea640 1 -- start start 2023-12-08T08:23:49.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.570+0000 7fd4c98ea640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd4c414e2a0 0x7fd4c41516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:49.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.570+0000 7fd4c98ea640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd4c40a9460 0x7fd4c40c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:49.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.570+0000 7fd4c98ea640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c4151210 con 0x7fd4c40a98e0 2023-12-08T08:23:49.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.570+0000 7fd4c98ea640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c414e680 con 0x7fd4c414e2a0 2023-12-08T08:23:49.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.570+0000 7fd4c98ea640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c4150be0 con 0x7fd4c40a9460 2023-12-08T08:23:49.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.570+0000 7fd4c2ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd4c414e2a0 0x7fd4c41516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:49.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.570+0000 7fd4c2ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd4c414e2a0 0x7fd4c41516a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37064/0 (socket says 172.21.15.88:37064) 2023-12-08T08:23:49.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.570+0000 7fd4c2ffd640 1 -- 172.21.15.88:0/2127829986 learned_addr learned my addr 172.21.15.88:0/2127829986 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:49.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.570+0000 7fd4bbfff640 1 --2- 172.21.15.88:0/2127829986 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd4c40a9460 0x7fd4c40c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:49.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.574+0000 7fd4c2ffd640 1 -- 172.21.15.88:0/2127829986 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd4c40a9460 msgr2=0x7fd4c40c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:49.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.574+0000 7fd4c2ffd640 1 --2- 172.21.15.88:0/2127829986 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd4c40a9460 0x7fd4c40c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:49.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.574+0000 7fd4c2ffd640 1 -- 172.21.15.88:0/2127829986 >> v1:172.21.15.148:6789/0 conn(0x7fd4c40a98e0 legacy=0x7fd4c406bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:49.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.574+0000 7fd4c2ffd640 1 -- 172.21.15.88:0/2127829986 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c40c53c0 con 0x7fd4c414e2a0 2023-12-08T08:23:49.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.574+0000 7fd4c2ffd640 1 --2- 172.21.15.88:0/2127829986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c414e2a0 0x7fd4c41516a0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4009870 tx=0x7fd4b401d650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1641c8bf98be5e56 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:49.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.574+0000 7fd4c27fc640 1 -- 172.21.15.88:0/2127829986 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b40ab650 con 0x7fd4c414e2a0 2023-12-08T08:23:49.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.574+0000 7fd4c27fc640 1 -- 172.21.15.88:0/2127829986 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b40ab7b0 con 0x7fd4c414e2a0 2023-12-08T08:23:49.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.574+0000 7fd4c27fc640 1 -- 172.21.15.88:0/2127829986 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b40abb40 con 0x7fd4c414e2a0 2023-12-08T08:23:49.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.574+0000 7fd4c98ea640 1 -- 172.21.15.88:0/2127829986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c414e2a0 msgr2=0x7fd4c41516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:49.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.574+0000 7fd4c98ea640 1 --2- 172.21.15.88:0/2127829986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c414e2a0 0x7fd4c41516a0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4009870 tx=0x7fd4b401d650 comp rx=0 tx=0).stop 2023-12-08T08:23:49.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c98ea640 1 -- 172.21.15.88:0/2127829986 shutdown_connections 2023-12-08T08:23:49.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c98ea640 1 --2- 172.21.15.88:0/2127829986 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd4c40a9460 0x7fd4c40c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:49.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c98ea640 1 --2- 172.21.15.88:0/2127829986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c414e2a0 0x7fd4c41516a0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:49.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c98ea640 1 -- 172.21.15.88:0/2127829986 >> 172.21.15.88:0/2127829986 conn(0x7fd4c40c59f0 msgr2=0x7fd4c40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:49.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c98ea640 1 -- 172.21.15.88:0/2127829986 shutdown_connections 2023-12-08T08:23:49.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c98ea640 1 -- 172.21.15.88:0/2127829986 wait complete. 2023-12-08T08:23:49.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c98ea640 1 Processor -- start 2023-12-08T08:23:49.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c98ea640 1 -- start start 2023-12-08T08:23:49.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c98ea640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c40a9460 0x7fd4c41eca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:49.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c98ea640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4c40a98e0 0x7fd4c414b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:49.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c98ea640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd4c414e2a0 0x7fd4c4142780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:49.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c98ea640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c4145450 con 0x7fd4c40a9460 2023-12-08T08:23:49.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c98ea640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c41ebe50 con 0x7fd4c40a98e0 2023-12-08T08:23:49.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c98ea640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c41ecf90 con 0x7fd4c414e2a0 2023-12-08T08:23:49.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c2ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c40a9460 0x7fd4c41eca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:49.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c2ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c40a9460 0x7fd4c41eca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37074/0 (socket says 172.21.15.88:37074) 2023-12-08T08:23:49.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c2ffd640 1 -- 172.21.15.88:0/1795563694 learned_addr learned my addr 172.21.15.88:0/1795563694 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:49.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4bbfff640 1 --2- 172.21.15.88:0/1795563694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4c40a98e0 0x7fd4c414b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:49.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c37fe640 1 --2- 172.21.15.88:0/1795563694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd4c414e2a0 0x7fd4c4142780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:49.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c2ffd640 1 -- 172.21.15.88:0/1795563694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd4c414e2a0 msgr2=0x7fd4c4142780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:49.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c2ffd640 1 --2- 172.21.15.88:0/1795563694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd4c414e2a0 0x7fd4c4142780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:49.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c2ffd640 1 -- 172.21.15.88:0/1795563694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4c40a98e0 msgr2=0x7fd4c414b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:49.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c2ffd640 1 --2- 172.21.15.88:0/1795563694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4c40a98e0 0x7fd4c414b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:49.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c2ffd640 1 -- 172.21.15.88:0/1795563694 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b40094d0 con 0x7fd4c40a9460 2023-12-08T08:23:49.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4bbfff640 1 --2- 172.21.15.88:0/1795563694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4c40a98e0 0x7fd4c414b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:49.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c2ffd640 1 --2- 172.21.15.88:0/1795563694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c40a9460 0x7fd4c41eca50 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fd4b401b280 tx=0x7fd4b401a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:49.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c0ff9640 1 -- 172.21.15.88:0/1795563694 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b40b4830 con 0x7fd4c40a9460 2023-12-08T08:23:49.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c0ff9640 1 -- 172.21.15.88:0/1795563694 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b40b4990 con 0x7fd4c40a9460 2023-12-08T08:23:49.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c98ea640 1 -- 172.21.15.88:0/1795563694 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c4144bb0 con 0x7fd4c40a9460 2023-12-08T08:23:49.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c0ff9640 1 -- 172.21.15.88:0/1795563694 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b40b4d20 con 0x7fd4c40a9460 2023-12-08T08:23:49.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.578+0000 7fd4c98ea640 1 -- 172.21.15.88:0/1795563694 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c4145170 con 0x7fd4c40a9460 2023-12-08T08:23:49.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.582+0000 7fd4c98ea640 1 -- 172.21.15.88:0/1795563694 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c414c0c0 con 0x7fd4c40a9460 2023-12-08T08:23:49.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.582+0000 7fd4c0ff9640 1 -- 172.21.15.88:0/1795563694 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd4b40c0460 con 0x7fd4c40a9460 2023-12-08T08:23:49.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.582+0000 7fd4c0ff9640 1 --2- 172.21.15.88:0/1795563694 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd4a40664a0 0x7fd4a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:49.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.582+0000 7fd4c0ff9640 1 -- 172.21.15.88:0/1795563694 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6651+0+0 (secure 0 0 0) 0x7fd4b411e8e0 con 0x7fd4c40a9460 2023-12-08T08:23:49.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.582+0000 7fd4bbfff640 1 --2- 172.21.15.88:0/1795563694 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd4a40664a0 0x7fd4a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:49.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.582+0000 7fd4bbfff640 1 --2- 172.21.15.88:0/1795563694 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd4a40664a0 0x7fd4a4068960 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4067e90 tx=0x7fd4ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:49.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.586+0000 7fd4c0ff9640 1 -- 172.21.15.88:0/1795563694 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd4b40ebad0 con 0x7fd4c40a9460 2023-12-08T08:23:49.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:49.774+0000 7fd4c98ea640 1 -- 172.21.15.88:0/1795563694 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd4c4067630 con 0x7fd4c40a9460 2023-12-08T08:23:50.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.406+0000 7fd4c0ff9640 1 -- 172.21.15.88:0/1795563694 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v54) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd4b40ef0f0 con 0x7fd4c40a9460 2023-12-08T08:23:50.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.406+0000 7fd4c98ea640 1 -- 172.21.15.88:0/1795563694 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd4a40664a0 msgr2=0x7fd4a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:50.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.406+0000 7fd4c98ea640 1 --2- 172.21.15.88:0/1795563694 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd4a40664a0 0x7fd4a4068960 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4067e90 tx=0x7fd4ac008040 comp rx=0 tx=0).stop 2023-12-08T08:23:50.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.406+0000 7fd4c98ea640 1 -- 172.21.15.88:0/1795563694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c40a9460 msgr2=0x7fd4c41eca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:50.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.406+0000 7fd4c98ea640 1 --2- 172.21.15.88:0/1795563694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c40a9460 0x7fd4c41eca50 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fd4b401b280 tx=0x7fd4b401a3f0 comp rx=0 tx=0).stop 2023-12-08T08:23:50.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.406+0000 7fd4c98ea640 1 -- 172.21.15.88:0/1795563694 shutdown_connections 2023-12-08T08:23:50.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.406+0000 7fd4c98ea640 1 --2- 172.21.15.88:0/1795563694 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fd4a40664a0 0x7fd4a4068960 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:50.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.406+0000 7fd4c98ea640 1 --2- 172.21.15.88:0/1795563694 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fd4c414e2a0 0x7fd4c4142780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:50.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.406+0000 7fd4c98ea640 1 --2- 172.21.15.88:0/1795563694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4c40a98e0 0x7fd4c414b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:50.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.406+0000 7fd4c98ea640 1 --2- 172.21.15.88:0/1795563694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4c40a9460 0x7fd4c41eca50 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:50.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.406+0000 7fd4c98ea640 1 -- 172.21.15.88:0/1795563694 >> 172.21.15.88:0/1795563694 conn(0x7fd4c40c59f0 msgr2=0x7fd4c406bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:50.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.410+0000 7fd4c98ea640 1 -- 172.21.15.88:0/1795563694 shutdown_connections 2023-12-08T08:23:50.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.410+0000 7fd4c98ea640 1 -- 172.21.15.88:0/1795563694 wait complete. 2023-12-08T08:23:50.433 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-08T08:23:50.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.570+0000 7f5f7972a640 1 Processor -- start 2023-12-08T08:23:50.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.570+0000 7f5f7972a640 1 -- start start 2023-12-08T08:23:50.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.570+0000 7f5f7972a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f740bf2d0 0x7f5f74151970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:50.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.570+0000 7f5f7972a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5f740c98f0 0x7f5f74151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:50.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.570+0000 7f5f7972a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f74158780 con 0x7f5f740c6030 2023-12-08T08:23:50.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.570+0000 7f5f7972a640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f740c0300 con 0x7f5f740c98f0 2023-12-08T08:23:50.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.570+0000 7f5f7972a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f74157b70 con 0x7f5f740bf2d0 2023-12-08T08:23:50.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.570+0000 7f5f6a7fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5f740c6030 0x7f5f740c7cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39708/0 (socket says 172.21.15.88:39708) 2023-12-08T08:23:50.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.570+0000 7f5f6a7fc640 1 -- 172.21.15.88:0/581072074 learned_addr learned my addr 172.21.15.88:0/581072074 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:50.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.570+0000 7f5f72ffd640 1 --2- 172.21.15.88:0/581072074 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f740bf2d0 0x7f5f74151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:50.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.570+0000 7f5f737fe640 1 --2- 172.21.15.88:0/581072074 >> v2:172.21.15.148:3300/0 conn(0x7f5f740c98f0 0x7f5f74151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:50.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.570+0000 7f5f727fc640 1 -- 172.21.15.88:0/581072074 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1771304179 0 0) 0x7f5f74158780 con 0x7f5f740c6030 2023-12-08T08:23:50.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.570+0000 7f5f727fc640 1 -- 172.21.15.88:0/581072074 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f54003530 con 0x7f5f740c6030 2023-12-08T08:23:50.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.574+0000 7f5f72ffd640 1 -- 172.21.15.88:0/581072074 >> v2:172.21.15.148:3300/0 conn(0x7f5f740c98f0 msgr2=0x7f5f74151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:50.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.574+0000 7f5f72ffd640 1 --2- 172.21.15.88:0/581072074 >> v2:172.21.15.148:3300/0 conn(0x7f5f740c98f0 0x7f5f74151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:50.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.574+0000 7f5f72ffd640 1 -- 172.21.15.88:0/581072074 >> v1:172.21.15.88:6789/0 conn(0x7f5f740c6030 legacy=0x7f5f740c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:50.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.574+0000 7f5f72ffd640 1 -- 172.21.15.88:0/581072074 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f74157e50 con 0x7f5f740bf2d0 2023-12-08T08:23:50.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.574+0000 7f5f72ffd640 1 --2- 172.21.15.88:0/581072074 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f740bf2d0 0x7f5f74151970 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5f640097c0 tx=0x7f5f6401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a22026ebd1387610 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:50.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.574+0000 7f5f727fc640 1 -- 172.21.15.88:0/581072074 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f640ab650 con 0x7f5f740bf2d0 2023-12-08T08:23:50.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.574+0000 7f5f727fc640 1 -- 172.21.15.88:0/581072074 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f640ab7b0 con 0x7f5f740bf2d0 2023-12-08T08:23:50.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.574+0000 7f5f727fc640 1 -- 172.21.15.88:0/581072074 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f640abb40 con 0x7f5f740bf2d0 2023-12-08T08:23:50.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.574+0000 7f5f7972a640 1 -- 172.21.15.88:0/581072074 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f740bf2d0 msgr2=0x7f5f74151970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:50.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.574+0000 7f5f7972a640 1 --2- 172.21.15.88:0/581072074 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f740bf2d0 0x7f5f74151970 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5f640097c0 tx=0x7f5f6401c450 comp rx=0 tx=0).stop 2023-12-08T08:23:50.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.578+0000 7f5f7972a640 1 -- 172.21.15.88:0/581072074 shutdown_connections 2023-12-08T08:23:50.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.578+0000 7f5f7972a640 1 --2- 172.21.15.88:0/581072074 >> v2:172.21.15.148:3300/0 conn(0x7f5f740c98f0 0x7f5f74151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:50.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.578+0000 7f5f7972a640 1 --2- 172.21.15.88:0/581072074 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f740bf2d0 0x7f5f74151970 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:50.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.578+0000 7f5f7972a640 1 -- 172.21.15.88:0/581072074 >> 172.21.15.88:0/581072074 conn(0x7f5f740c9dc0 msgr2=0x7f5f740ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:50.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.578+0000 7f5f7972a640 1 -- 172.21.15.88:0/581072074 shutdown_connections 2023-12-08T08:23:50.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.578+0000 7f5f7972a640 1 -- 172.21.15.88:0/581072074 wait complete. 2023-12-08T08:23:50.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.578+0000 7f5f7972a640 1 Processor -- start 2023-12-08T08:23:50.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.578+0000 7f5f7972a640 1 -- start start 2023-12-08T08:23:50.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.578+0000 7f5f7972a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f740bf2d0 0x7f5f740ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:50.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.578+0000 7f5f7972a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f740c6030 0x7f5f740ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:50.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.578+0000 7f5f7972a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f740c98f0 0x7f5f7406ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:50.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.578+0000 7f5f7972a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f741545f0 con 0x7f5f740bf2d0 2023-12-08T08:23:50.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.578+0000 7f5f7972a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f740ad9f0 con 0x7f5f740c98f0 2023-12-08T08:23:50.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.578+0000 7f5f7972a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f74153cc0 con 0x7f5f740c6030 2023-12-08T08:23:50.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.578+0000 7f5f72ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f740bf2d0 0x7f5f740ad4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:50.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.578+0000 7f5f72ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f740bf2d0 0x7f5f740ad4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43022/0 (socket says 172.21.15.88:43022) 2023-12-08T08:23:50.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.578+0000 7f5f72ffd640 1 -- 172.21.15.88:0/3881435874 learned_addr learned my addr 172.21.15.88:0/3881435874 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:50.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.578+0000 7f5f6a7fc640 1 --2- 172.21.15.88:0/3881435874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f740c6030 0x7f5f740ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:50.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.578+0000 7f5f72ffd640 1 -- 172.21.15.88:0/3881435874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f740c6030 msgr2=0x7f5f740ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:50.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.578+0000 7f5f737fe640 1 --2- 172.21.15.88:0/3881435874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f740c98f0 0x7f5f7406ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:50.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.578+0000 7f5f72ffd640 1 --2- 172.21.15.88:0/3881435874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f740c6030 0x7f5f740ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:50.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.578+0000 7f5f72ffd640 1 -- 172.21.15.88:0/3881435874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f740c98f0 msgr2=0x7f5f7406ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:50.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.578+0000 7f5f72ffd640 1 --2- 172.21.15.88:0/3881435874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f740c98f0 0x7f5f7406ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:50.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.578+0000 7f5f72ffd640 1 -- 172.21.15.88:0/3881435874 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f64009420 con 0x7f5f740bf2d0 2023-12-08T08:23:50.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.578+0000 7f5f6a7fc640 1 --2- 172.21.15.88:0/3881435874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f740c6030 0x7f5f740ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:50.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.578+0000 7f5f737fe640 1 --2- 172.21.15.88:0/3881435874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f740c98f0 0x7f5f7406ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:50.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.578+0000 7f5f72ffd640 1 --2- 172.21.15.88:0/3881435874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f740bf2d0 0x7f5f740ad4b0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f5f640ad040 tx=0x7f5f6401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:50.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.582+0000 7f5f6bfff640 1 -- 172.21.15.88:0/3881435874 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f640bf610 con 0x7f5f740bf2d0 2023-12-08T08:23:50.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.582+0000 7f5f6bfff640 1 -- 172.21.15.88:0/3881435874 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f640bf7b0 con 0x7f5f740bf2d0 2023-12-08T08:23:50.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.582+0000 7f5f6bfff640 1 -- 172.21.15.88:0/3881435874 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f640bfb60 con 0x7f5f740bf2d0 2023-12-08T08:23:50.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.582+0000 7f5f7972a640 1 -- 172.21.15.88:0/3881435874 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f740ae7f0 con 0x7f5f740bf2d0 2023-12-08T08:23:50.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.582+0000 7f5f7972a640 1 -- 172.21.15.88:0/3881435874 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f74153f10 con 0x7f5f740bf2d0 2023-12-08T08:23:50.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.582+0000 7f5f7972a640 1 -- 172.21.15.88:0/3881435874 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f74067630 con 0x7f5f740bf2d0 2023-12-08T08:23:50.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.582+0000 7f5f6bfff640 1 -- 172.21.15.88:0/3881435874 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5f640b5400 con 0x7f5f740bf2d0 2023-12-08T08:23:50.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.582+0000 7f5f6bfff640 1 --2- 172.21.15.88:0/3881435874 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5f58066470 0x7f5f58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:50.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.582+0000 7f5f6bfff640 1 -- 172.21.15.88:0/3881435874 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f5f6411f1d0 con 0x7f5f740bf2d0 2023-12-08T08:23:50.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.582+0000 7f5f6a7fc640 1 --2- 172.21.15.88:0/3881435874 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5f58066470 0x7f5f58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:50.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.582+0000 7f5f6a7fc640 1 --2- 172.21.15.88:0/3881435874 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5f58066470 0x7f5f58068930 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5f74156900 tx=0x7f5f5c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:50.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.586+0000 7f5f6bfff640 1 -- 172.21.15.88:0/3881435874 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5f640ec450 con 0x7f5f740bf2d0 2023-12-08T08:23:50.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:50.738+0000 7f5f7972a640 1 -- 172.21.15.88:0/3881435874 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5f740c5d00 con 0x7f5f740bf2d0 2023-12-08T08:23:51.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.622+0000 7f5f6bfff640 1 -- 172.21.15.88:0/3881435874 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v74) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5f640efa70 con 0x7f5f740bf2d0 2023-12-08T08:23:51.626 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' removed 2023-12-08T08:23:51.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.622+0000 7f5f7972a640 1 -- 172.21.15.88:0/3881435874 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5f58066470 msgr2=0x7f5f58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:51.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.622+0000 7f5f7972a640 1 --2- 172.21.15.88:0/3881435874 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5f58066470 0x7f5f58068930 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5f74156900 tx=0x7f5f5c009040 comp rx=0 tx=0).stop 2023-12-08T08:23:51.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.622+0000 7f5f7972a640 1 -- 172.21.15.88:0/3881435874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f740bf2d0 msgr2=0x7f5f740ad4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:51.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.622+0000 7f5f7972a640 1 --2- 172.21.15.88:0/3881435874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f740bf2d0 0x7f5f740ad4b0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f5f640ad040 tx=0x7f5f6401ac90 comp rx=0 tx=0).stop 2023-12-08T08:23:51.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.622+0000 7f5f7972a640 1 -- 172.21.15.88:0/3881435874 shutdown_connections 2023-12-08T08:23:51.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.626+0000 7f5f7972a640 1 --2- 172.21.15.88:0/3881435874 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f5f58066470 0x7f5f58068930 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:51.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.626+0000 7f5f7972a640 1 --2- 172.21.15.88:0/3881435874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f740c98f0 0x7f5f7406ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:51.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.626+0000 7f5f7972a640 1 --2- 172.21.15.88:0/3881435874 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f5f740c6030 0x7f5f740ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:51.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.626+0000 7f5f7972a640 1 --2- 172.21.15.88:0/3881435874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f740bf2d0 0x7f5f740ad4b0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:51.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.626+0000 7f5f7972a640 1 -- 172.21.15.88:0/3881435874 >> 172.21.15.88:0/3881435874 conn(0x7f5f740c9dc0 msgr2=0x7f5f74156930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:51.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.626+0000 7f5f7972a640 1 -- 172.21.15.88:0/3881435874 shutdown_connections 2023-12-08T08:23:51.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.626+0000 7f5f7972a640 1 -- 172.21.15.88:0/3881435874 wait complete. 2023-12-08T08:23:51.656 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-08T08:23:51.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.798+0000 7fc4200bb640 1 Processor -- start 2023-12-08T08:23:51.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.798+0000 7fc4200bb640 1 -- start start 2023-12-08T08:23:51.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.802+0000 7fc4200bb640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4180c6030 0x7fc4180c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:51.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.802+0000 7fc4200bb640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc4180c98f0 0x7fc4180c8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:51.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.802+0000 7fc4200bb640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc418158780 con 0x7fc4180bf2d0 2023-12-08T08:23:51.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.802+0000 7fc4200bb640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4180c0300 con 0x7fc4180c98f0 2023-12-08T08:23:51.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.802+0000 7fc4200bb640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc418157b70 con 0x7fc4180c6030 2023-12-08T08:23:51.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.802+0000 7fc41e658640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc4180c98f0 0x7fc4180c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:51.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.802+0000 7fc41e658640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc4180c98f0 0x7fc4180c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43032/0 (socket says 172.21.15.88:43032) 2023-12-08T08:23:51.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.802+0000 7fc41e658640 1 -- 172.21.15.88:0/531531772 learned_addr learned my addr 172.21.15.88:0/531531772 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:51.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.802+0000 7fc41d656640 1 --2- 172.21.15.88:0/531531772 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4180c6030 0x7fc4180c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:51.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.802+0000 7fc41e658640 1 -- 172.21.15.88:0/531531772 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4180c6030 msgr2=0x7fc4180c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:51.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.802+0000 7fc41e658640 1 --2- 172.21.15.88:0/531531772 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4180c6030 0x7fc4180c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:51.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.802+0000 7fc41e658640 1 -- 172.21.15.88:0/531531772 >> v1:172.21.15.148:6789/0 conn(0x7fc4180bf2d0 legacy=0x7fc418151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:51.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.802+0000 7fc41e658640 1 -- 172.21.15.88:0/531531772 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc418157e50 con 0x7fc4180c98f0 2023-12-08T08:23:51.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.806+0000 7fc41e658640 1 --2- 172.21.15.88:0/531531772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4180c98f0 0x7fc4180c8200 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fc410009e50 tx=0x7fc41001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdaa6a2827988b03 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:51.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.806+0000 7fc41ce55640 1 -- 172.21.15.88:0/531531772 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4100a58a0 con 0x7fc4180c98f0 2023-12-08T08:23:51.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.806+0000 7fc41ce55640 1 -- 172.21.15.88:0/531531772 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4100a5a00 con 0x7fc4180c98f0 2023-12-08T08:23:51.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.806+0000 7fc41ce55640 1 -- 172.21.15.88:0/531531772 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4100a5d90 con 0x7fc4180c98f0 2023-12-08T08:23:51.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.806+0000 7fc4200bb640 1 -- 172.21.15.88:0/531531772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4180c98f0 msgr2=0x7fc4180c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:51.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.806+0000 7fc4200bb640 1 --2- 172.21.15.88:0/531531772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4180c98f0 0x7fc4180c8200 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fc410009e50 tx=0x7fc41001c9e0 comp rx=0 tx=0).stop 2023-12-08T08:23:51.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.806+0000 7fc4200bb640 1 -- 172.21.15.88:0/531531772 shutdown_connections 2023-12-08T08:23:51.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.806+0000 7fc4200bb640 1 --2- 172.21.15.88:0/531531772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4180c98f0 0x7fc4180c8200 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:51.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.806+0000 7fc4200bb640 1 --2- 172.21.15.88:0/531531772 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4180c6030 0x7fc4180c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:51.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.806+0000 7fc4200bb640 1 -- 172.21.15.88:0/531531772 >> 172.21.15.88:0/531531772 conn(0x7fc4180c9dc0 msgr2=0x7fc4180ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:51.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.806+0000 7fc4200bb640 1 -- 172.21.15.88:0/531531772 shutdown_connections 2023-12-08T08:23:51.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.806+0000 7fc4200bb640 1 -- 172.21.15.88:0/531531772 wait complete. 2023-12-08T08:23:51.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.806+0000 7fc4200bb640 1 Processor -- start 2023-12-08T08:23:51.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.806+0000 7fc4200bb640 1 -- start start 2023-12-08T08:23:51.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.810+0000 7fc4200bb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4180bf2d0 0x7fc418140170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:51.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.810+0000 7fc4200bb640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4180c6030 0x7fc41806bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:51.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.810+0000 7fc4200bb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4180c98f0 0x7fc4181ece60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:51.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.810+0000 7fc4200bb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4181ec960 con 0x7fc4180bf2d0 2023-12-08T08:23:51.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.810+0000 7fc4200bb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc418153720 con 0x7fc4180c98f0 2023-12-08T08:23:51.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.810+0000 7fc4200bb640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc418153a00 con 0x7fc4180c6030 2023-12-08T08:23:51.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.810+0000 7fc41de57640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4180bf2d0 0x7fc418140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:51.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.810+0000 7fc41de57640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4180bf2d0 0x7fc418140170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43036/0 (socket says 172.21.15.88:43036) 2023-12-08T08:23:51.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.810+0000 7fc41de57640 1 -- 172.21.15.88:0/2182031842 learned_addr learned my addr 172.21.15.88:0/2182031842 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:51.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.810+0000 7fc41d656640 1 --2- 172.21.15.88:0/2182031842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4180c6030 0x7fc41806bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:51.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.810+0000 7fc41e658640 1 --2- 172.21.15.88:0/2182031842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4180c98f0 0x7fc4181ece60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:51.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.810+0000 7fc41de57640 1 -- 172.21.15.88:0/2182031842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4180c6030 msgr2=0x7fc41806bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:51.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.810+0000 7fc41de57640 1 --2- 172.21.15.88:0/2182031842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4180c6030 0x7fc41806bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:51.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.810+0000 7fc41de57640 1 -- 172.21.15.88:0/2182031842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4180c98f0 msgr2=0x7fc4181ece60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:51.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.810+0000 7fc41de57640 1 --2- 172.21.15.88:0/2182031842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4180c98f0 0x7fc4181ece60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:51.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.810+0000 7fc41de57640 1 -- 172.21.15.88:0/2182031842 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc410009b30 con 0x7fc4180bf2d0 2023-12-08T08:23:51.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.810+0000 7fc41e658640 1 --2- 172.21.15.88:0/2182031842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4180c98f0 0x7fc4181ece60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:51.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.810+0000 7fc41de57640 1 --2- 172.21.15.88:0/2182031842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4180bf2d0 0x7fc418140170 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fc41400c500 tx=0x7fc41400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:51.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.810+0000 7fc40e7fc640 1 -- 172.21.15.88:0/2182031842 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc414005220 con 0x7fc4180bf2d0 2023-12-08T08:23:51.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.810+0000 7fc40e7fc640 1 -- 172.21.15.88:0/2182031842 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc414005380 con 0x7fc4180bf2d0 2023-12-08T08:23:51.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.810+0000 7fc40e7fc640 1 -- 172.21.15.88:0/2182031842 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc414007270 con 0x7fc4180bf2d0 2023-12-08T08:23:51.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.810+0000 7fc4200bb640 1 -- 172.21.15.88:0/2182031842 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc418153ce0 con 0x7fc4180bf2d0 2023-12-08T08:23:51.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.810+0000 7fc4200bb640 1 -- 172.21.15.88:0/2182031842 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4181f0d50 con 0x7fc4180bf2d0 2023-12-08T08:23:51.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.810+0000 7fc4200bb640 1 -- 172.21.15.88:0/2182031842 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc418067630 con 0x7fc4180bf2d0 2023-12-08T08:23:51.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.810+0000 7fc40e7fc640 1 -- 172.21.15.88:0/2182031842 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc4140073d0 con 0x7fc4180bf2d0 2023-12-08T08:23:51.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.814+0000 7fc40e7fc640 1 --2- 172.21.15.88:0/2182031842 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc3fc066470 0x7fc3fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:51.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.814+0000 7fc40e7fc640 1 -- 172.21.15.88:0/2182031842 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6213+0+0 (secure 0 0 0) 0x7fc414083440 con 0x7fc4180bf2d0 2023-12-08T08:23:51.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.814+0000 7fc41d656640 1 --2- 172.21.15.88:0/2182031842 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc3fc066470 0x7fc3fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:51.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.814+0000 7fc41d656640 1 --2- 172.21.15.88:0/2182031842 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc3fc066470 0x7fc3fc068930 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc418152340 tx=0x7fc408009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:51.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.818+0000 7fc40e7fc640 1 -- 172.21.15.88:0/2182031842 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc4140506e0 con 0x7fc4180bf2d0 2023-12-08T08:23:51.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:51.966+0000 7fc4200bb640 1 -- 172.21.15.88:0/2182031842 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc41806cae0 con 0x7fc4180bf2d0 2023-12-08T08:23:52.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.622+0000 7fc40e7fc640 1 -- 172.21.15.88:0/2182031842 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v75) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc414053d00 con 0x7fc4180bf2d0 2023-12-08T08:23:52.629 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' removed 2023-12-08T08:23:52.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.626+0000 7fc4200bb640 1 -- 172.21.15.88:0/2182031842 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc3fc066470 msgr2=0x7fc3fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:52.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.626+0000 7fc4200bb640 1 --2- 172.21.15.88:0/2182031842 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc3fc066470 0x7fc3fc068930 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc418152340 tx=0x7fc408009190 comp rx=0 tx=0).stop 2023-12-08T08:23:52.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.626+0000 7fc4200bb640 1 -- 172.21.15.88:0/2182031842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4180bf2d0 msgr2=0x7fc418140170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:52.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.626+0000 7fc4200bb640 1 --2- 172.21.15.88:0/2182031842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4180bf2d0 0x7fc418140170 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fc41400c500 tx=0x7fc41400c9c0 comp rx=0 tx=0).stop 2023-12-08T08:23:52.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.626+0000 7fc4200bb640 1 -- 172.21.15.88:0/2182031842 shutdown_connections 2023-12-08T08:23:52.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.626+0000 7fc4200bb640 1 --2- 172.21.15.88:0/2182031842 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc3fc066470 0x7fc3fc068930 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:52.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.626+0000 7fc4200bb640 1 --2- 172.21.15.88:0/2182031842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4180c98f0 0x7fc4181ece60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:52.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.626+0000 7fc4200bb640 1 --2- 172.21.15.88:0/2182031842 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc4180c6030 0x7fc41806bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:52.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.626+0000 7fc4200bb640 1 --2- 172.21.15.88:0/2182031842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4180bf2d0 0x7fc418140170 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:52.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.626+0000 7fc4200bb640 1 -- 172.21.15.88:0/2182031842 >> 172.21.15.88:0/2182031842 conn(0x7fc4180c9dc0 msgr2=0x7fc418156f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:52.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.626+0000 7fc4200bb640 1 -- 172.21.15.88:0/2182031842 shutdown_connections 2023-12-08T08:23:52.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.626+0000 7fc4200bb640 1 -- 172.21.15.88:0/2182031842 wait complete. 2023-12-08T08:23:52.662 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:23:52.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.798+0000 7f0881da1640 1 Processor -- start 2023-12-08T08:23:52.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.798+0000 7f0881da1640 1 -- start start 2023-12-08T08:23:52.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.798+0000 7f0881da1640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f087c14fd10 0x7f087c0a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:52.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.798+0000 7f0881da1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f087c0a5300 0x7f087c071e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:52.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.798+0000 7f0881da1640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f087c0c5710 con 0x7f087c072370 2023-12-08T08:23:52.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.798+0000 7f0881da1640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f087c06c5e0 con 0x7f087c14fd10 2023-12-08T08:23:52.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.798+0000 7f0881da1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087c155c80 con 0x7f087c0a5300 2023-12-08T08:23:52.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.798+0000 7f087bfff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f087c072370 0x7f087c156110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39724/0 (socket says 172.21.15.88:39724) 2023-12-08T08:23:52.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.798+0000 7f087bfff640 1 -- 172.21.15.88:0/528952839 learned_addr learned my addr 172.21.15.88:0/528952839 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:52.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.798+0000 7f0873fff640 1 --2- 172.21.15.88:0/528952839 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f087c0a5300 0x7f087c071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:52.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.798+0000 7f087b7fe640 1 --2- 172.21.15.88:0/528952839 >> v2:172.21.15.148:3300/0 conn(0x7f087c14fd10 0x7f087c0a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:52.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.798+0000 7f087affd640 1 -- 172.21.15.88:0/528952839 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870677366 0 0) 0x7f087c0c5710 con 0x7f087c072370 2023-12-08T08:23:52.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.798+0000 7f087affd640 1 -- 172.21.15.88:0/528952839 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0868003530 con 0x7f087c072370 2023-12-08T08:23:52.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.798+0000 7f087affd640 1 -- 172.21.15.88:0/528952839 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1516869679 0 0) 0x7f0868003530 con 0x7f087c072370 2023-12-08T08:23:52.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.798+0000 7f087affd640 1 -- 172.21.15.88:0/528952839 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f087c0a5300 msgr2=0x7f087c071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:52.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.798+0000 7f087affd640 1 --2- 172.21.15.88:0/528952839 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f087c0a5300 0x7f087c071e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:52.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.798+0000 7f087affd640 1 -- 172.21.15.88:0/528952839 >> v2:172.21.15.148:3300/0 conn(0x7f087c14fd10 msgr2=0x7f087c0a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:52.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.798+0000 7f087affd640 1 --2- 172.21.15.88:0/528952839 >> v2:172.21.15.148:3300/0 conn(0x7f087c14fd10 0x7f087c0a4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:52.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.798+0000 7f087affd640 1 -- 172.21.15.88:0/528952839 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087c0c4e70 con 0x7f087c072370 2023-12-08T08:23:52.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.798+0000 7f087affd640 1 -- 172.21.15.88:0/528952839 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f0874001a00 con 0x7f087c072370 2023-12-08T08:23:52.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.798+0000 7f087affd640 1 -- 172.21.15.88:0/528952839 >> v1:172.21.15.88:6789/0 conn(0x7f087c072370 legacy=0x7f087c156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:52.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.798+0000 7f087affd640 1 --2- 172.21.15.88:0/528952839 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0868003980 0x7f0868003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:52.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.798+0000 7f087affd640 1 --2- 172.21.15.88:0/528952839 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f087c0a5300 0x7f08680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:52.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.798+0000 7f087affd640 1 --2- 172.21.15.88:0/528952839 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0868004d10 0x7f0868005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:52.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.798+0000 7f087affd640 1 -- 172.21.15.88:0/528952839 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087c155c80 con 0x7f0868004d10 2023-12-08T08:23:52.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.798+0000 7f087affd640 1 -- 172.21.15.88:0/528952839 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086800b990 con 0x7f0868003980 2023-12-08T08:23:52.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.798+0000 7f087affd640 1 -- 172.21.15.88:0/528952839 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086800bb50 con 0x7f087c0a5300 2023-12-08T08:23:52.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.802+0000 7f087bfff640 1 --2- 172.21.15.88:0/528952839 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0868004d10 0x7f0868005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:52.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.802+0000 7f0873fff640 1 --2- 172.21.15.88:0/528952839 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f087c0a5300 0x7f08680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:52.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.802+0000 7f087b7fe640 1 --2- 172.21.15.88:0/528952839 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0868003980 0x7f0868003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:52.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.802+0000 7f087bfff640 1 -- 172.21.15.88:0/528952839 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f087c0a5300 msgr2=0x7f08680047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:52.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.802+0000 7f087bfff640 1 --2- 172.21.15.88:0/528952839 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f087c0a5300 0x7f08680047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:52.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.802+0000 7f087bfff640 1 -- 172.21.15.88:0/528952839 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0868003980 msgr2=0x7f0868003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:52.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.802+0000 7f087bfff640 1 --2- 172.21.15.88:0/528952839 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0868003980 0x7f0868003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:52.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.802+0000 7f087bfff640 1 -- 172.21.15.88:0/528952839 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0868003530 con 0x7f0868004d10 2023-12-08T08:23:52.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.802+0000 7f087bfff640 1 --2- 172.21.15.88:0/528952839 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0868004d10 0x7f0868005190 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f087400a8d0 tx=0x7f087401d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a24fd80dc6ca389 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:52.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.802+0000 7f087affd640 1 -- 172.21.15.88:0/528952839 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08740ad630 con 0x7f0868004d10 2023-12-08T08:23:52.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.802+0000 7f087affd640 1 -- 172.21.15.88:0/528952839 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08740a8070 con 0x7f0868004d10 2023-12-08T08:23:52.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.802+0000 7f087affd640 1 -- 172.21.15.88:0/528952839 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08740ad9d0 con 0x7f0868004d10 2023-12-08T08:23:52.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.806+0000 7f0881da1640 1 -- 172.21.15.88:0/528952839 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0868004d10 msgr2=0x7f0868005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:52.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.806+0000 7f0881da1640 1 --2- 172.21.15.88:0/528952839 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0868004d10 0x7f0868005190 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f087400a8d0 tx=0x7f087401d3b0 comp rx=0 tx=0).stop 2023-12-08T08:23:52.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.806+0000 7f087bfff640 1 -- 172.21.15.88:0/528952839 reap_dead start 2023-12-08T08:23:52.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.806+0000 7f0881da1640 1 -- 172.21.15.88:0/528952839 shutdown_connections 2023-12-08T08:23:52.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.806+0000 7f0881da1640 1 -- 172.21.15.88:0/528952839 >> 172.21.15.88:0/528952839 conn(0x7f087c0a7810 msgr2=0x7f087c0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:52.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.806+0000 7f0881da1640 1 -- 172.21.15.88:0/528952839 shutdown_connections 2023-12-08T08:23:52.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.806+0000 7f0881da1640 1 -- 172.21.15.88:0/528952839 wait complete. 2023-12-08T08:23:52.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.806+0000 7f0881da1640 1 Processor -- start 2023-12-08T08:23:52.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.806+0000 7f0881da1640 1 -- start start 2023-12-08T08:23:52.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.806+0000 7f0881da1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0868004d10 0x7f087c0a6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:52.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.806+0000 7f0881da1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f087c1435c0 0x7f087c1eceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:52.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.806+0000 7f0881da1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f087c0c3cf0 0x7f087c1ed3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:52.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.806+0000 7f0881da1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087c148060 con 0x7f0868004d10 2023-12-08T08:23:52.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.806+0000 7f0881da1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087c148620 con 0x7f087c0c3cf0 2023-12-08T08:23:52.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.806+0000 7f0881da1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087c1f0cf0 con 0x7f087c1435c0 2023-12-08T08:23:52.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.806+0000 7f087b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0868004d10 0x7f087c0a6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:52.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.806+0000 7f087b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0868004d10 0x7f087c0a6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43048/0 (socket says 172.21.15.88:43048) 2023-12-08T08:23:52.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.806+0000 7f087b7fe640 1 -- 172.21.15.88:0/3924229798 learned_addr learned my addr 172.21.15.88:0/3924229798 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:52.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.806+0000 7f087bfff640 1 --2- 172.21.15.88:0/3924229798 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f087c0c3cf0 0x7f087c1ed3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:52.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.806+0000 7f0873fff640 1 --2- 172.21.15.88:0/3924229798 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f087c1435c0 0x7f087c1eceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:52.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.810+0000 7f087b7fe640 1 -- 172.21.15.88:0/3924229798 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f087c1435c0 msgr2=0x7f087c1eceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:52.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.810+0000 7f087b7fe640 1 --2- 172.21.15.88:0/3924229798 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f087c1435c0 0x7f087c1eceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:52.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.810+0000 7f087b7fe640 1 -- 172.21.15.88:0/3924229798 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f087c0c3cf0 msgr2=0x7f087c1ed3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:52.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.810+0000 7f087b7fe640 1 --2- 172.21.15.88:0/3924229798 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f087c0c3cf0 0x7f087c1ed3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:52.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.810+0000 7f087b7fe640 1 -- 172.21.15.88:0/3924229798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087c1f0fd0 con 0x7f0868004d10 2023-12-08T08:23:52.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.810+0000 7f0873fff640 1 --2- 172.21.15.88:0/3924229798 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f087c1435c0 0x7f087c1eceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:52.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.810+0000 7f087bfff640 1 --2- 172.21.15.88:0/3924229798 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f087c0c3cf0 0x7f087c1ed3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:52.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.810+0000 7f087b7fe640 1 --2- 172.21.15.88:0/3924229798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0868004d10 0x7f087c0a6da0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f086c011a00 tx=0x7f086c011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:52.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.810+0000 7f0878ff9640 1 -- 172.21.15.88:0/3924229798 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086c00fb50 con 0x7f0868004d10 2023-12-08T08:23:52.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.810+0000 7f0878ff9640 1 -- 172.21.15.88:0/3924229798 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086c00fcb0 con 0x7f0868004d10 2023-12-08T08:23:52.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.810+0000 7f0878ff9640 1 -- 172.21.15.88:0/3924229798 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086c014440 con 0x7f0868004d10 2023-12-08T08:23:52.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.810+0000 7f0881da1640 1 -- 172.21.15.88:0/3924229798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f087c1482b0 con 0x7f0868004d10 2023-12-08T08:23:52.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.810+0000 7f0881da1640 1 -- 172.21.15.88:0/3924229798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f087c1ed930 con 0x7f0868004d10 2023-12-08T08:23:52.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.810+0000 7f0881da1640 1 -- 172.21.15.88:0/3924229798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f087c072800 con 0x7f0868004d10 2023-12-08T08:23:52.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.810+0000 7f0878ff9640 1 -- 172.21.15.88:0/3924229798 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f086c0145a0 con 0x7f0868004d10 2023-12-08T08:23:52.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.810+0000 7f0878ff9640 1 --2- 172.21.15.88:0/3924229798 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f085c066470 0x7f085c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:52.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.810+0000 7f0878ff9640 1 -- 172.21.15.88:0/3924229798 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f086c084710 con 0x7f0868004d10 2023-12-08T08:23:52.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.814+0000 7f0873fff640 1 --2- 172.21.15.88:0/3924229798 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f085c066470 0x7f085c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:52.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.814+0000 7f0873fff640 1 --2- 172.21.15.88:0/3924229798 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f085c066470 0x7f085c068930 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f087c0c3830 tx=0x7f0864008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:52.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.814+0000 7f0878ff9640 1 -- 172.21.15.88:0/3924229798 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f086c051c80 con 0x7f0868004d10 2023-12-08T08:23:52.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.990+0000 7f0881da1640 1 -- 172.21.15.88:0/3924229798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f087c1edbb0 con 0x7f0868004d10 2023-12-08T08:23:52.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.990+0000 7f0878ff9640 1 -- 172.21.15.88:0/3924229798 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16615 (secure 0 0 0) 0x7f086c0552a0 con 0x7f0868004d10 2023-12-08T08:23:52.995 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:52.995 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":75,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:23:52.625379+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:23:15.029129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:23:16.271716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6837/698349615":"2023-12-09T08:23:49.403962+0000","172.21.15.88:6836/698349615":"2023-12-09T08:23:49.403962+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:23:52.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.994+0000 7f0881da1640 1 -- 172.21.15.88:0/3924229798 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f085c066470 msgr2=0x7f085c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:52.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.994+0000 7f0881da1640 1 --2- 172.21.15.88:0/3924229798 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f085c066470 0x7f085c068930 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f087c0c3830 tx=0x7f0864008040 comp rx=0 tx=0).stop 2023-12-08T08:23:52.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.994+0000 7f0881da1640 1 -- 172.21.15.88:0/3924229798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0868004d10 msgr2=0x7f087c0a6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:52.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.994+0000 7f0881da1640 1 --2- 172.21.15.88:0/3924229798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0868004d10 0x7f087c0a6da0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f086c011a00 tx=0x7f086c011ec0 comp rx=0 tx=0).stop 2023-12-08T08:23:52.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.994+0000 7f0881da1640 1 -- 172.21.15.88:0/3924229798 shutdown_connections 2023-12-08T08:23:52.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.994+0000 7f0881da1640 1 --2- 172.21.15.88:0/3924229798 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f085c066470 0x7f085c068930 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:52.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.994+0000 7f0881da1640 1 --2- 172.21.15.88:0/3924229798 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f087c0c3cf0 0x7f087c1ed3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:52.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.994+0000 7f0881da1640 1 --2- 172.21.15.88:0/3924229798 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f087c1435c0 0x7f087c1eceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:52.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.994+0000 7f0881da1640 1 --2- 172.21.15.88:0/3924229798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0868004d10 0x7f087c0a6da0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:52.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.994+0000 7f0881da1640 1 -- 172.21.15.88:0/3924229798 >> 172.21.15.88:0/3924229798 conn(0x7f087c0a7810 msgr2=0x7f087c147270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:52.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.994+0000 7f0881da1640 1 -- 172.21.15.88:0/3924229798 shutdown_connections 2023-12-08T08:23:52.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:52.994+0000 7f0881da1640 1 -- 172.21.15.88:0/3924229798 wait complete. 2023-12-08T08:23:53.016 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:20:08.801077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:23:15.029129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:23:16.271716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:23:53.017 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:23:53.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.154+0000 7f1ed0e17640 1 Processor -- start 2023-12-08T08:23:53.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.154+0000 7f1ed0e17640 1 -- start start 2023-12-08T08:23:53.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.154+0000 7f1ed0e17640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1ecc151a20 0x7f1ecc06e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:53.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.154+0000 7f1ed0e17640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1ecc157a90 0x7f1ecc06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:53.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.154+0000 7f1ed0e17640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc06bb00 0x7f1ecc154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:53.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.154+0000 7f1ed0e17640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ecc0c2720 con 0x7f1ecc157a90 2023-12-08T08:23:53.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.154+0000 7f1ed0e17640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ecc072c50 con 0x7f1ecc151a20 2023-12-08T08:23:53.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.154+0000 7f1ed0e17640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc1544a0 con 0x7f1ecc06bb00 2023-12-08T08:23:53.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.154+0000 7f1ec1d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1ecc157a90 0x7f1ecc06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:53.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.154+0000 7f1ec1d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1ecc157a90 0x7f1ecc06b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43050/0 (socket says 172.21.15.88:43050) 2023-12-08T08:23:53.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.154+0000 7f1ec1d9b640 1 -- 172.21.15.88:0/798763499 learned_addr learned my addr 172.21.15.88:0/798763499 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:53.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.154+0000 7f1eca59c640 1 --2- 172.21.15.88:0/798763499 >> v2:172.21.15.148:3300/0 conn(0x7f1ecc151a20 0x7f1ecc06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:53.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.154+0000 7f1ecad9d640 1 --2- 172.21.15.88:0/798763499 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc06bb00 0x7f1ecc154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:53.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.154+0000 7f1ec1d9b640 1 -- 172.21.15.88:0/798763499 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc06bb00 msgr2=0x7f1ecc154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:53.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.154+0000 7f1ec1d9b640 1 --2- 172.21.15.88:0/798763499 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc06bb00 0x7f1ecc154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.154+0000 7f1ec1d9b640 1 -- 172.21.15.88:0/798763499 >> v2:172.21.15.148:3300/0 conn(0x7f1ecc151a20 msgr2=0x7f1ecc06e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:53.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.154+0000 7f1ec1d9b640 1 --2- 172.21.15.88:0/798763499 >> v2:172.21.15.148:3300/0 conn(0x7f1ecc151a20 0x7f1ecc06e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.154+0000 7f1ec1d9b640 1 -- 172.21.15.88:0/798763499 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ecc0c1810 con 0x7f1ecc157a90 2023-12-08T08:23:53.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.154+0000 7f1eca59c640 1 --2- 172.21.15.88:0/798763499 >> v2:172.21.15.148:3300/0 conn(0x7f1ecc151a20 0x7f1ecc06e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:53.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.154+0000 7f1ecad9d640 1 --2- 172.21.15.88:0/798763499 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc06bb00 0x7f1ecc154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:53.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.158+0000 7f1ec1d9b640 1 --2- 172.21.15.88:0/798763499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ecc157a90 0x7f1ecc06b5c0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc06d1e0 tx=0x7f1eb401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e96213eeaa621c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:53.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.158+0000 7f1ec9d9b640 1 -- 172.21.15.88:0/798763499 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb40ab600 con 0x7f1ecc157a90 2023-12-08T08:23:53.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.158+0000 7f1ec9d9b640 1 -- 172.21.15.88:0/798763499 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb40a7050 con 0x7f1ecc157a90 2023-12-08T08:23:53.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.158+0000 7f1ec9d9b640 1 -- 172.21.15.88:0/798763499 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb40ab980 con 0x7f1ecc157a90 2023-12-08T08:23:53.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.158+0000 7f1ed0e17640 1 -- 172.21.15.88:0/798763499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ecc157a90 msgr2=0x7f1ecc06b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:53.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.158+0000 7f1ed0e17640 1 --2- 172.21.15.88:0/798763499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ecc157a90 0x7f1ecc06b5c0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc06d1e0 tx=0x7f1eb401c470 comp rx=0 tx=0).stop 2023-12-08T08:23:53.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.158+0000 7f1ed0e17640 1 -- 172.21.15.88:0/798763499 shutdown_connections 2023-12-08T08:23:53.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.158+0000 7f1ed0e17640 1 --2- 172.21.15.88:0/798763499 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc06bb00 0x7f1ecc154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.158+0000 7f1ed0e17640 1 --2- 172.21.15.88:0/798763499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ecc157a90 0x7f1ecc06b5c0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.158+0000 7f1ed0e17640 1 --2- 172.21.15.88:0/798763499 >> v2:172.21.15.148:3300/0 conn(0x7f1ecc151a20 0x7f1ecc06e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.158+0000 7f1ed0e17640 1 -- 172.21.15.88:0/798763499 >> 172.21.15.88:0/798763499 conn(0x7f1ecc0c2e20 msgr2=0x7f1ecc0c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:53.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.158+0000 7f1ed0e17640 1 -- 172.21.15.88:0/798763499 shutdown_connections 2023-12-08T08:23:53.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.158+0000 7f1ed0e17640 1 -- 172.21.15.88:0/798763499 wait complete. 2023-12-08T08:23:53.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.162+0000 7f1ed0e17640 1 Processor -- start 2023-12-08T08:23:53.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.162+0000 7f1ed0e17640 1 -- start start 2023-12-08T08:23:53.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.162+0000 7f1ed0e17640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ecc06bb00 0x7f1ecc0aac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:53.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.162+0000 7f1ed0e17640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc151a20 0x7f1ecc1f1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:53.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.162+0000 7f1ed0e17640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc157a90 0x7f1ecc156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:53.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.162+0000 7f1ed0e17640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc0ab170 con 0x7f1ecc06bb00 2023-12-08T08:23:53.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.162+0000 7f1ed0e17640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc1f18c0 con 0x7f1ecc151a20 2023-12-08T08:23:53.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.162+0000 7f1ed0e17640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc1ed8f0 con 0x7f1ecc157a90 2023-12-08T08:23:53.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.162+0000 7f1eca59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ecc06bb00 0x7f1ecc0aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:53.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.162+0000 7f1eca59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ecc06bb00 0x7f1ecc0aac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43066/0 (socket says 172.21.15.88:43066) 2023-12-08T08:23:53.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.162+0000 7f1eca59c640 1 -- 172.21.15.88:0/2569803300 learned_addr learned my addr 172.21.15.88:0/2569803300 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:53.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.162+0000 7f1ecad9d640 1 --2- 172.21.15.88:0/2569803300 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc157a90 0x7f1ecc156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:53.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.162+0000 7f1ec1d9b640 1 --2- 172.21.15.88:0/2569803300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc151a20 0x7f1ecc1f1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:53.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.162+0000 7f1eca59c640 1 -- 172.21.15.88:0/2569803300 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc157a90 msgr2=0x7f1ecc156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:53.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.162+0000 7f1eca59c640 1 --2- 172.21.15.88:0/2569803300 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc157a90 0x7f1ecc156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.162+0000 7f1eca59c640 1 -- 172.21.15.88:0/2569803300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc151a20 msgr2=0x7f1ecc1f1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:53.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.162+0000 7f1eca59c640 1 --2- 172.21.15.88:0/2569803300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc151a20 0x7f1ecc1f1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.162+0000 7f1eca59c640 1 -- 172.21.15.88:0/2569803300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb40094d0 con 0x7f1ecc06bb00 2023-12-08T08:23:53.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.162+0000 7f1eca59c640 1 --2- 172.21.15.88:0/2569803300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ecc06bb00 0x7f1ecc0aac30 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00e810 tx=0x7f1ebc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:53.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.162+0000 7f1ec37fe640 1 -- 172.21.15.88:0/2569803300 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc00c8d0 con 0x7f1ecc06bb00 2023-12-08T08:23:53.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.162+0000 7f1ec37fe640 1 -- 172.21.15.88:0/2569803300 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ebc00ca30 con 0x7f1ecc06bb00 2023-12-08T08:23:53.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.162+0000 7f1ed0e17640 1 -- 172.21.15.88:0/2569803300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ecc159e60 con 0x7f1ecc06bb00 2023-12-08T08:23:53.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.162+0000 7f1ec37fe640 1 -- 172.21.15.88:0/2569803300 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc00cde0 con 0x7f1ecc06bb00 2023-12-08T08:23:53.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.162+0000 7f1ed0e17640 1 -- 172.21.15.88:0/2569803300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ecc0a9e30 con 0x7f1ecc06bb00 2023-12-08T08:23:53.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.166+0000 7f1ed0e17640 1 -- 172.21.15.88:0/2569803300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ecc066660 con 0x7f1ecc06bb00 2023-12-08T08:23:53.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.166+0000 7f1ec37fe640 1 -- 172.21.15.88:0/2569803300 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1ebc013410 con 0x7f1ecc06bb00 2023-12-08T08:23:53.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.166+0000 7f1ec37fe640 1 --2- 172.21.15.88:0/2569803300 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1eac0664a0 0x7f1eac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:53.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.166+0000 7f1ec37fe640 1 -- 172.21.15.88:0/2569803300 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f1ebc083bc0 con 0x7f1ecc06bb00 2023-12-08T08:23:53.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.166+0000 7f1ec1d9b640 1 --2- 172.21.15.88:0/2569803300 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1eac0664a0 0x7f1eac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:53.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.166+0000 7f1ec1d9b640 1 --2- 172.21.15.88:0/2569803300 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1eac0664a0 0x7f1eac068960 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40ad000 tx=0x7f1eb4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:53.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.170+0000 7f1ec37fe640 1 -- 172.21.15.88:0/2569803300 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1ebc051080 con 0x7f1ecc06bb00 2023-12-08T08:23:53.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.322+0000 7f1ed0e17640 1 -- 172.21.15.88:0/2569803300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1ecc070790 con 0x7f1ecc06bb00 2023-12-08T08:23:53.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.322+0000 7f1ec37fe640 1 -- 172.21.15.88:0/2569803300 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1ebc0546a0 con 0x7f1ecc06bb00 2023-12-08T08:23:53.325 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-12-08T08:23:53.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.322+0000 7f1ed0e17640 1 -- 172.21.15.88:0/2569803300 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1eac0664a0 msgr2=0x7f1eac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:53.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.322+0000 7f1ed0e17640 1 --2- 172.21.15.88:0/2569803300 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1eac0664a0 0x7f1eac068960 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40ad000 tx=0x7f1eb4008040 comp rx=0 tx=0).stop 2023-12-08T08:23:53.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.322+0000 7f1ed0e17640 1 -- 172.21.15.88:0/2569803300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ecc06bb00 msgr2=0x7f1ecc0aac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:53.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.322+0000 7f1ed0e17640 1 --2- 172.21.15.88:0/2569803300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ecc06bb00 0x7f1ecc0aac30 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00e810 tx=0x7f1ebc00ecd0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.322+0000 7f1ed0e17640 1 -- 172.21.15.88:0/2569803300 shutdown_connections 2023-12-08T08:23:53.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.322+0000 7f1ed0e17640 1 --2- 172.21.15.88:0/2569803300 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1eac0664a0 0x7f1eac068960 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.322+0000 7f1ed0e17640 1 --2- 172.21.15.88:0/2569803300 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ecc157a90 0x7f1ecc156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.322+0000 7f1ed0e17640 1 --2- 172.21.15.88:0/2569803300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc151a20 0x7f1ecc1f1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.322+0000 7f1ed0e17640 1 --2- 172.21.15.88:0/2569803300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ecc06bb00 0x7f1ecc0aac30 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.322+0000 7f1ed0e17640 1 -- 172.21.15.88:0/2569803300 >> 172.21.15.88:0/2569803300 conn(0x7f1ecc0c2e20 msgr2=0x7f1ecc150c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:53.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.322+0000 7f1ed0e17640 1 -- 172.21.15.88:0/2569803300 shutdown_connections 2023-12-08T08:23:53.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.322+0000 7f1ed0e17640 1 -- 172.21.15.88:0/2569803300 wait complete. 2023-12-08T08:23:53.346 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:23:53.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.482+0000 7ff22c11d640 1 Processor -- start 2023-12-08T08:23:53.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.482+0000 7ff22c11d640 1 -- start start 2023-12-08T08:23:53.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.482+0000 7ff22c11d640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff22414fc30 0x7ff2240c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:53.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.482+0000 7ff22c11d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff224152910 con 0x7ff22406d840 2023-12-08T08:23:53.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.482+0000 7ff22c11d640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff224152bf0 con 0x7ff22414f850 2023-12-08T08:23:53.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.482+0000 7ff22c11d640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2240c2240 con 0x7ff22414fc30 2023-12-08T08:23:53.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.482+0000 7ff22a6ba640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff22406d840 0x7ff2240c4210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39734/0 (socket says 172.21.15.88:39734) 2023-12-08T08:23:53.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.482+0000 7ff22a6ba640 1 -- 172.21.15.88:0/572408285 learned_addr learned my addr 172.21.15.88:0/572408285 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:53.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.482+0000 7ff2296b8640 1 --2- 172.21.15.88:0/572408285 >> v2:172.21.15.148:3300/0 conn(0x7ff22414fc30 0x7ff2240c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:53.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.482+0000 7ff228eb7640 1 -- 172.21.15.88:0/572408285 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2761920522 0 0) 0x7ff224152910 con 0x7ff22406d840 2023-12-08T08:23:53.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.482+0000 7ff228eb7640 1 -- 172.21.15.88:0/572408285 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff210003530 con 0x7ff22406d840 2023-12-08T08:23:53.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.482+0000 7ff2296b8640 1 -- 172.21.15.88:0/572408285 >> v1:172.21.15.148:6789/0 conn(0x7ff22414f850 legacy=0x7ff2240aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:53.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.486+0000 7ff2296b8640 1 -- 172.21.15.88:0/572408285 >> v1:172.21.15.88:6789/0 conn(0x7ff22406d840 legacy=0x7ff2240c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:53.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.486+0000 7ff2296b8640 1 -- 172.21.15.88:0/572408285 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff224152ed0 con 0x7ff22414fc30 2023-12-08T08:23:53.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.486+0000 7ff2296b8640 1 --2- 172.21.15.88:0/572408285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff22414fc30 0x7ff2240c3cd0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff2140097c0 tx=0x7ff21401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3d56f32b39d09fe server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:53.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.486+0000 7ff228eb7640 1 -- 172.21.15.88:0/572408285 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2140a6040 con 0x7ff22414fc30 2023-12-08T08:23:53.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.486+0000 7ff228eb7640 1 -- 172.21.15.88:0/572408285 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2140aa600 con 0x7ff22414fc30 2023-12-08T08:23:53.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.486+0000 7ff228eb7640 1 -- 172.21.15.88:0/572408285 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2140aa990 con 0x7ff22414fc30 2023-12-08T08:23:53.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.486+0000 7ff22c11d640 1 -- 172.21.15.88:0/572408285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff22414fc30 msgr2=0x7ff2240c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:53.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.486+0000 7ff22c11d640 1 --2- 172.21.15.88:0/572408285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff22414fc30 0x7ff2240c3cd0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff2140097c0 tx=0x7ff21401c480 comp rx=0 tx=0).stop 2023-12-08T08:23:53.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.486+0000 7ff22c11d640 1 -- 172.21.15.88:0/572408285 shutdown_connections 2023-12-08T08:23:53.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.486+0000 7ff22c11d640 1 --2- 172.21.15.88:0/572408285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff22414fc30 0x7ff2240c3cd0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.486+0000 7ff22c11d640 1 -- 172.21.15.88:0/572408285 >> 172.21.15.88:0/572408285 conn(0x7ff2240c59f0 msgr2=0x7ff2240c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:53.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.486+0000 7ff22c11d640 1 -- 172.21.15.88:0/572408285 shutdown_connections 2023-12-08T08:23:53.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.486+0000 7ff22c11d640 1 -- 172.21.15.88:0/572408285 wait complete. 2023-12-08T08:23:53.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.490+0000 7ff22c11d640 1 Processor -- start 2023-12-08T08:23:53.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.490+0000 7ff22c11d640 1 -- start start 2023-12-08T08:23:53.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.490+0000 7ff22c11d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff22406d840 0x7ff22414e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:53.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.490+0000 7ff22c11d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff22414f850 0x7ff22414c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:53.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.490+0000 7ff22c11d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff22414fc30 0x7ff22414caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:53.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.490+0000 7ff22c11d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22414bac0 con 0x7ff22414fc30 2023-12-08T08:23:53.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.490+0000 7ff22c11d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2241eb380 con 0x7ff22406d840 2023-12-08T08:23:53.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.490+0000 7ff22c11d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22414bd60 con 0x7ff22414f850 2023-12-08T08:23:53.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.490+0000 7ff22a6ba640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff22414fc30 0x7ff22414caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:53.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.490+0000 7ff22a6ba640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff22414fc30 0x7ff22414caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43078/0 (socket says 172.21.15.88:43078) 2023-12-08T08:23:53.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.490+0000 7ff22a6ba640 1 -- 172.21.15.88:0/1700081670 learned_addr learned my addr 172.21.15.88:0/1700081670 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:53.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.490+0000 7ff229eb9640 1 --2- 172.21.15.88:0/1700081670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff22406d840 0x7ff22414e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:53.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.490+0000 7ff2296b8640 1 --2- 172.21.15.88:0/1700081670 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff22414f850 0x7ff22414c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:53.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.490+0000 7ff22a6ba640 1 -- 172.21.15.88:0/1700081670 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff22414f850 msgr2=0x7ff22414c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:53.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.490+0000 7ff22a6ba640 1 --2- 172.21.15.88:0/1700081670 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff22414f850 0x7ff22414c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.490+0000 7ff22a6ba640 1 -- 172.21.15.88:0/1700081670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff22406d840 msgr2=0x7ff22414e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:53.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.490+0000 7ff22a6ba640 1 --2- 172.21.15.88:0/1700081670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff22406d840 0x7ff22414e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.490+0000 7ff22a6ba640 1 -- 172.21.15.88:0/1700081670 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff214009420 con 0x7ff22414fc30 2023-12-08T08:23:53.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.490+0000 7ff229eb9640 1 --2- 172.21.15.88:0/1700081670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff22406d840 0x7ff22414e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:53.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.490+0000 7ff2296b8640 1 --2- 172.21.15.88:0/1700081670 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff22414f850 0x7ff22414c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:53.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.490+0000 7ff22a6ba640 1 --2- 172.21.15.88:0/1700081670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff22414fc30 0x7ff22414caa0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00cb40 tx=0x7ff21c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:53.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.490+0000 7ff21a7fc640 1 -- 172.21.15.88:0/1700081670 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c00aca0 con 0x7ff22414fc30 2023-12-08T08:23:53.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.490+0000 7ff21a7fc640 1 -- 172.21.15.88:0/1700081670 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21c00ae00 con 0x7ff22414fc30 2023-12-08T08:23:53.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.494+0000 7ff21a7fc640 1 -- 172.21.15.88:0/1700081670 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c012620 con 0x7ff22414fc30 2023-12-08T08:23:53.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.494+0000 7ff22c11d640 1 -- 172.21.15.88:0/1700081670 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff22414c040 con 0x7ff22414fc30 2023-12-08T08:23:53.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.494+0000 7ff22c11d640 1 -- 172.21.15.88:0/1700081670 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff224156740 con 0x7ff22414fc30 2023-12-08T08:23:53.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.494+0000 7ff22c11d640 1 -- 172.21.15.88:0/1700081670 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff224067630 con 0x7ff22414fc30 2023-12-08T08:23:53.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.494+0000 7ff21a7fc640 1 -- 172.21.15.88:0/1700081670 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff21c007070 con 0x7ff22414fc30 2023-12-08T08:23:53.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.494+0000 7ff21a7fc640 1 --2- 172.21.15.88:0/1700081670 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff208066540 0x7ff208068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:53.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.494+0000 7ff21a7fc640 1 -- 172.21.15.88:0/1700081670 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7ff21c083f00 con 0x7ff22414fc30 2023-12-08T08:23:53.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.494+0000 7ff229eb9640 1 --2- 172.21.15.88:0/1700081670 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff208066540 0x7ff208068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:53.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.494+0000 7ff229eb9640 1 --2- 172.21.15.88:0/1700081670 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff208066540 0x7ff208068a00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff22415dba0 tx=0x7ff220009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:53.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.498+0000 7ff21a7fc640 1 -- 172.21.15.88:0/1700081670 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff21c051390 con 0x7ff22414fc30 2023-12-08T08:23:53.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.650+0000 7ff22c11d640 1 -- 172.21.15.88:0/1700081670 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff2240a4a90 con 0x7ff22414fc30 2023-12-08T08:23:53.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.650+0000 7ff21a7fc640 1 -- 172.21.15.88:0/1700081670 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v75) v1 ==== 105+0+11 (secure 0 0 0) 0x7ff21c0170b0 con 0x7ff22414fc30 2023-12-08T08:23:53.656 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-12-08T08:23:53.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.654+0000 7ff22c11d640 1 -- 172.21.15.88:0/1700081670 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff208066540 msgr2=0x7ff208068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:53.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.654+0000 7ff22c11d640 1 --2- 172.21.15.88:0/1700081670 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff208066540 0x7ff208068a00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff22415dba0 tx=0x7ff220009040 comp rx=0 tx=0).stop 2023-12-08T08:23:53.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.654+0000 7ff22c11d640 1 -- 172.21.15.88:0/1700081670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff22414fc30 msgr2=0x7ff22414caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:53.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.654+0000 7ff22c11d640 1 --2- 172.21.15.88:0/1700081670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff22414fc30 0x7ff22414caa0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00cb40 tx=0x7ff21c00a060 comp rx=0 tx=0).stop 2023-12-08T08:23:53.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.654+0000 7ff22c11d640 1 -- 172.21.15.88:0/1700081670 shutdown_connections 2023-12-08T08:23:53.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.654+0000 7ff22c11d640 1 --2- 172.21.15.88:0/1700081670 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ff208066540 0x7ff208068a00 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.654+0000 7ff22c11d640 1 --2- 172.21.15.88:0/1700081670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff22414fc30 0x7ff22414caa0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.654+0000 7ff22c11d640 1 --2- 172.21.15.88:0/1700081670 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ff22414f850 0x7ff22414c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.654+0000 7ff22c11d640 1 --2- 172.21.15.88:0/1700081670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff22406d840 0x7ff22414e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.654+0000 7ff22c11d640 1 -- 172.21.15.88:0/1700081670 >> 172.21.15.88:0/1700081670 conn(0x7ff2240c59f0 msgr2=0x7ff22414ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:53.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.654+0000 7ff22c11d640 1 -- 172.21.15.88:0/1700081670 shutdown_connections 2023-12-08T08:23:53.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.654+0000 7ff22c11d640 1 -- 172.21.15.88:0/1700081670 wait complete. 2023-12-08T08:23:53.677 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:23:53.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.814+0000 7f177c5f5640 1 Processor -- start 2023-12-08T08:23:53.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.814+0000 7f177c5f5640 1 -- start start 2023-12-08T08:23:53.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.814+0000 7f177c5f5640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17741516a0 0x7f17740c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:53.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.814+0000 7f177c5f5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f17740c46c0 0x7f177406bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:53.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.814+0000 7f177c5f5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1774151b20 con 0x7f177414e2a0 2023-12-08T08:23:53.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.814+0000 7f177c5f5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1774151210 con 0x7f17740c46c0 2023-12-08T08:23:53.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.814+0000 7f177c5f5640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177414e680 con 0x7f17741516a0 2023-12-08T08:23:53.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.814+0000 7f177a391640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f177414e2a0 0x7f17740a9460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39746/0 (socket says 172.21.15.88:39746) 2023-12-08T08:23:53.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.814+0000 7f177a391640 1 -- 172.21.15.88:0/3272958710 learned_addr learned my addr 172.21.15.88:0/3272958710 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:53.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.814+0000 7f177ab92640 1 --2- 172.21.15.88:0/3272958710 >> v2:172.21.15.88:3300/0 conn(0x7f17740c46c0 0x7f177406bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:53.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.814+0000 7f177938f640 1 -- 172.21.15.88:0/3272958710 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 499497654 0 0) 0x7f1770001120 con 0x7f177414e2a0 2023-12-08T08:23:53.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.814+0000 7f1779b90640 1 --2- 172.21.15.88:0/3272958710 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17741516a0 0x7f17740c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:53.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.814+0000 7f177938f640 1 -- 172.21.15.88:0/3272958710 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1760003530 con 0x7f177414e2a0 2023-12-08T08:23:53.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.814+0000 7f177ab92640 1 -- 172.21.15.88:0/3272958710 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17741516a0 msgr2=0x7f17740c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:53.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.814+0000 7f177ab92640 1 --2- 172.21.15.88:0/3272958710 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17741516a0 0x7f17740c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.814+0000 7f177ab92640 1 -- 172.21.15.88:0/3272958710 >> v1:172.21.15.88:6789/0 conn(0x7f177414e2a0 legacy=0x7f17740a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:53.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.814+0000 7f177ab92640 1 -- 172.21.15.88:0/3272958710 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17740a9b70 con 0x7f17740c46c0 2023-12-08T08:23:53.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.814+0000 7f1779b90640 1 --2- 172.21.15.88:0/3272958710 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17741516a0 0x7f17740c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:53.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.818+0000 7f177ab92640 1 --2- 172.21.15.88:0/3272958710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17740c46c0 0x7f177406bc80 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f176c00aea0 tx=0x7f176c01da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7a6b5b80538bdf server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:53.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.818+0000 7f177938f640 1 -- 172.21.15.88:0/3272958710 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c00a2d0 con 0x7f17740c46c0 2023-12-08T08:23:53.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.818+0000 7f177938f640 1 -- 172.21.15.88:0/3272958710 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176c0a66b0 con 0x7f17740c46c0 2023-12-08T08:23:53.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.818+0000 7f177938f640 1 -- 172.21.15.88:0/3272958710 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c0a6a40 con 0x7f17740c46c0 2023-12-08T08:23:53.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.818+0000 7f177c5f5640 1 -- 172.21.15.88:0/3272958710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17740c46c0 msgr2=0x7f177406bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:53.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.818+0000 7f177c5f5640 1 --2- 172.21.15.88:0/3272958710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17740c46c0 0x7f177406bc80 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f176c00aea0 tx=0x7f176c01da50 comp rx=0 tx=0).stop 2023-12-08T08:23:53.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.818+0000 7f177c5f5640 1 -- 172.21.15.88:0/3272958710 shutdown_connections 2023-12-08T08:23:53.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.818+0000 7f177c5f5640 1 --2- 172.21.15.88:0/3272958710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17740c46c0 0x7f177406bc80 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.818+0000 7f177c5f5640 1 --2- 172.21.15.88:0/3272958710 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17741516a0 0x7f17740c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.818+0000 7f177c5f5640 1 -- 172.21.15.88:0/3272958710 >> 172.21.15.88:0/3272958710 conn(0x7f17740c59f0 msgr2=0x7f17740c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:53.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.818+0000 7f177c5f5640 1 -- 172.21.15.88:0/3272958710 shutdown_connections 2023-12-08T08:23:53.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.818+0000 7f177c5f5640 1 -- 172.21.15.88:0/3272958710 wait complete. 2023-12-08T08:23:53.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.822+0000 7f177c5f5640 1 Processor -- start 2023-12-08T08:23:53.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.822+0000 7f177c5f5640 1 -- start start 2023-12-08T08:23:53.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.822+0000 7f177c5f5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17740c46c0 0x7f1774154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:53.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.822+0000 7f177c5f5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f177414e2a0 0x7f1774149410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:53.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.822+0000 7f177c5f5640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17741516a0 0x7f1774149950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:53.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.822+0000 7f177c5f5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1774149190 con 0x7f17740c46c0 2023-12-08T08:23:53.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.822+0000 7f177c5f5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17741480f0 con 0x7f177414e2a0 2023-12-08T08:23:53.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.822+0000 7f177c5f5640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17741483d0 con 0x7f17741516a0 2023-12-08T08:23:53.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.822+0000 7f177a391640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17740c46c0 0x7f1774154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:53.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.822+0000 7f177a391640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17740c46c0 0x7f1774154a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43088/0 (socket says 172.21.15.88:43088) 2023-12-08T08:23:53.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.822+0000 7f177a391640 1 -- 172.21.15.88:0/2767959917 learned_addr learned my addr 172.21.15.88:0/2767959917 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:53.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.822+0000 7f177ab92640 1 --2- 172.21.15.88:0/2767959917 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17741516a0 0x7f1774149950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:53.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.822+0000 7f1779b90640 1 --2- 172.21.15.88:0/2767959917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f177414e2a0 0x7f1774149410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:53.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.822+0000 7f177a391640 1 -- 172.21.15.88:0/2767959917 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17741516a0 msgr2=0x7f1774149950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:53.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.822+0000 7f177a391640 1 --2- 172.21.15.88:0/2767959917 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17741516a0 0x7f1774149950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.822+0000 7f177a391640 1 -- 172.21.15.88:0/2767959917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f177414e2a0 msgr2=0x7f1774149410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:53.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.822+0000 7f177a391640 1 --2- 172.21.15.88:0/2767959917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f177414e2a0 0x7f1774149410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.822+0000 7f177a391640 1 -- 172.21.15.88:0/2767959917 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c00ab80 con 0x7f17740c46c0 2023-12-08T08:23:53.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.822+0000 7f177ab92640 1 --2- 172.21.15.88:0/2767959917 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17741516a0 0x7f1774149950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:53.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.822+0000 7f177a391640 1 --2- 172.21.15.88:0/2767959917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17740c46c0 0x7f1774154a80 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f177000c4d0 tx=0x7f177000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:53.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.822+0000 7f176affd640 1 -- 172.21.15.88:0/2767959917 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1770005cf0 con 0x7f17740c46c0 2023-12-08T08:23:53.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.822+0000 7f176affd640 1 -- 172.21.15.88:0/2767959917 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1770005e50 con 0x7f17740c46c0 2023-12-08T08:23:53.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.822+0000 7f176affd640 1 -- 172.21.15.88:0/2767959917 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1770007290 con 0x7f17740c46c0 2023-12-08T08:23:53.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.822+0000 7f177c5f5640 1 -- 172.21.15.88:0/2767959917 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17741486b0 con 0x7f17740c46c0 2023-12-08T08:23:53.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.822+0000 7f177c5f5640 1 -- 172.21.15.88:0/2767959917 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1774148c70 con 0x7f17740c46c0 2023-12-08T08:23:53.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.822+0000 7f177c5f5640 1 -- 172.21.15.88:0/2767959917 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1774148e90 con 0x7f17740c46c0 2023-12-08T08:23:53.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.826+0000 7f176affd640 1 -- 172.21.15.88:0/2767959917 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f17700073f0 con 0x7f17740c46c0 2023-12-08T08:23:53.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.826+0000 7f176affd640 1 --2- 172.21.15.88:0/2767959917 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f17580664a0 0x7f1758068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:53.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.826+0000 7f176affd640 1 -- 172.21.15.88:0/2767959917 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f17700833a0 con 0x7f17740c46c0 2023-12-08T08:23:53.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.826+0000 7f1779b90640 1 --2- 172.21.15.88:0/2767959917 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f17580664a0 0x7f1758068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:53.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.826+0000 7f1779b90640 1 --2- 172.21.15.88:0/2767959917 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f17580664a0 0x7f1758068960 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1764006fd0 tx=0x7f1764008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:53.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.830+0000 7f176affd640 1 -- 172.21.15.88:0/2767959917 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1770050720 con 0x7f17740c46c0 2023-12-08T08:23:53.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.978+0000 7f177c5f5640 1 -- 172.21.15.88:0/2767959917 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f1774151b20 con 0x7f17740c46c0 2023-12-08T08:23:53.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.978+0000 7f176affd640 1 -- 172.21.15.88:0/2767959917 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v75) v1 ==== 101+0+11 (secure 0 0 0) 0x7f1774151b20 con 0x7f17740c46c0 2023-12-08T08:23:53.983 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-12-08T08:23:53.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.982+0000 7f177c5f5640 1 -- 172.21.15.88:0/2767959917 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f17580664a0 msgr2=0x7f1758068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:53.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.982+0000 7f177c5f5640 1 --2- 172.21.15.88:0/2767959917 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f17580664a0 0x7f1758068960 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1764006fd0 tx=0x7f1764008040 comp rx=0 tx=0).stop 2023-12-08T08:23:53.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.982+0000 7f177c5f5640 1 -- 172.21.15.88:0/2767959917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17740c46c0 msgr2=0x7f1774154a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:53.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.982+0000 7f177c5f5640 1 --2- 172.21.15.88:0/2767959917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17740c46c0 0x7f1774154a80 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f177000c4d0 tx=0x7f177000c990 comp rx=0 tx=0).stop 2023-12-08T08:23:53.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.982+0000 7f177c5f5640 1 -- 172.21.15.88:0/2767959917 shutdown_connections 2023-12-08T08:23:53.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.982+0000 7f177c5f5640 1 --2- 172.21.15.88:0/2767959917 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f17580664a0 0x7f1758068960 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.982+0000 7f177c5f5640 1 --2- 172.21.15.88:0/2767959917 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f17741516a0 0x7f1774149950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.982+0000 7f177c5f5640 1 --2- 172.21.15.88:0/2767959917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f177414e2a0 0x7f1774149410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.982+0000 7f177c5f5640 1 --2- 172.21.15.88:0/2767959917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17740c46c0 0x7f1774154a80 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:53.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.982+0000 7f177c5f5640 1 -- 172.21.15.88:0/2767959917 >> 172.21.15.88:0/2767959917 conn(0x7f17740c59f0 msgr2=0x7f17740733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:53.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.982+0000 7f177c5f5640 1 -- 172.21.15.88:0/2767959917 shutdown_connections 2023-12-08T08:23:53.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:53.982+0000 7f177c5f5640 1 -- 172.21.15.88:0/2767959917 wait complete. 2023-12-08T08:23:54.004 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:23:54.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.138+0000 7f1ea8ee4640 1 Processor -- start 2023-12-08T08:23:54.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.138+0000 7f1ea8ee4640 1 -- start start 2023-12-08T08:23:54.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.138+0000 7f1ea8ee4640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ea4154f20 0x7f1ea406b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:54.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.138+0000 7f1ea8ee4640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea406c380 con 0x7f1ea406bf30 2023-12-08T08:23:54.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.138+0000 7f1ea8ee4640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea40c4890 con 0x7f1ea40af4c0 2023-12-08T08:23:54.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.138+0000 7f1ea8ee4640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea41553a0 con 0x7f1ea4154f20 2023-12-08T08:23:54.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.138+0000 7f1ea2d9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1ea406bf30 0x7f1ea415ee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39758/0 (socket says 172.21.15.88:39758) 2023-12-08T08:23:54.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.138+0000 7f1ea2d9d640 1 -- 172.21.15.88:0/2396710260 learned_addr learned my addr 172.21.15.88:0/2396710260 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:54.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.138+0000 7f1e99d9b640 1 --2- 172.21.15.88:0/2396710260 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ea4154f20 0x7f1ea406b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:54.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.138+0000 7f1ea1d9b640 1 -- 172.21.15.88:0/2396710260 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4096489363 0 0) 0x7f1ea406c380 con 0x7f1ea406bf30 2023-12-08T08:23:54.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.138+0000 7f1ea1d9b640 1 -- 172.21.15.88:0/2396710260 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e90003530 con 0x7f1ea406bf30 2023-12-08T08:23:54.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.138+0000 7f1ea1d9b640 1 -- 172.21.15.88:0/2396710260 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3218354880 0 0) 0x7f1e90003530 con 0x7f1ea406bf30 2023-12-08T08:23:54.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.138+0000 7f1ea1d9b640 1 -- 172.21.15.88:0/2396710260 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ea4154f20 msgr2=0x7f1ea406b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:54.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.138+0000 7f1ea1d9b640 1 --2- 172.21.15.88:0/2396710260 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ea4154f20 0x7f1ea406b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:54.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.138+0000 7f1ea1d9b640 1 -- 172.21.15.88:0/2396710260 >> v1:172.21.15.148:6789/0 conn(0x7f1ea40af4c0 legacy=0x7f1ea40c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:54.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.138+0000 7f1ea1d9b640 1 -- 172.21.15.88:0/2396710260 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea40af8a0 con 0x7f1ea406bf30 2023-12-08T08:23:54.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.138+0000 7f1ea1d9b640 1 -- 172.21.15.88:0/2396710260 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f1e9c001680 con 0x7f1ea406bf30 2023-12-08T08:23:54.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.138+0000 7f1ea1d9b640 1 -- 172.21.15.88:0/2396710260 >> v1:172.21.15.88:6789/0 conn(0x7f1ea406bf30 legacy=0x7f1ea415ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:54.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.138+0000 7f1ea1d9b640 1 --2- 172.21.15.88:0/2396710260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e900039b0 0x7f1e90003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:54.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.138+0000 7f1ea1d9b640 1 --2- 172.21.15.88:0/2396710260 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ea4154f20 0x7f1e900047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:54.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.138+0000 7f1ea1d9b640 1 --2- 172.21.15.88:0/2396710260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e90004d10 0x7f1e90005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:54.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.138+0000 7f1ea1d9b640 1 -- 172.21.15.88:0/2396710260 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea41553a0 con 0x7f1e90004d10 2023-12-08T08:23:54.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.138+0000 7f1ea1d9b640 1 -- 172.21.15.88:0/2396710260 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9000baf0 con 0x7f1e900039b0 2023-12-08T08:23:54.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.138+0000 7f1ea1d9b640 1 -- 172.21.15.88:0/2396710260 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9000bcb0 con 0x7f1ea4154f20 2023-12-08T08:23:54.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.142+0000 7f1ea2d9d640 1 --2- 172.21.15.88:0/2396710260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e90004d10 0x7f1e90005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:54.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.142+0000 7f1ea259c640 1 --2- 172.21.15.88:0/2396710260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e900039b0 0x7f1e90003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:54.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.142+0000 7f1e99d9b640 1 --2- 172.21.15.88:0/2396710260 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ea4154f20 0x7f1e900047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:54.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.142+0000 7f1ea2d9d640 1 -- 172.21.15.88:0/2396710260 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ea4154f20 msgr2=0x7f1e900047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:54.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.142+0000 7f1ea2d9d640 1 --2- 172.21.15.88:0/2396710260 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1ea4154f20 0x7f1e900047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:54.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.142+0000 7f1ea2d9d640 1 -- 172.21.15.88:0/2396710260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e900039b0 msgr2=0x7f1e90003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:54.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.142+0000 7f1ea2d9d640 1 --2- 172.21.15.88:0/2396710260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e900039b0 0x7f1e90003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:54.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.142+0000 7f1ea2d9d640 1 -- 172.21.15.88:0/2396710260 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e90003530 con 0x7f1e90004d10 2023-12-08T08:23:54.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.142+0000 7f1ea2d9d640 1 --2- 172.21.15.88:0/2396710260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e90004d10 0x7f1e90005190 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c00c1c0 tx=0x7f1e9c01f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d96d66b5d8bd8b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:54.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.142+0000 7f1ea1d9b640 1 -- 172.21.15.88:0/2396710260 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c005ae0 con 0x7f1e90004d10 2023-12-08T08:23:54.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.142+0000 7f1ea1d9b640 1 -- 172.21.15.88:0/2396710260 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9c0ab070 con 0x7f1e90004d10 2023-12-08T08:23:54.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.142+0000 7f1ea1d9b640 1 -- 172.21.15.88:0/2396710260 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c007070 con 0x7f1e90004d10 2023-12-08T08:23:54.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.146+0000 7f1ea8ee4640 1 -- 172.21.15.88:0/2396710260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e90004d10 msgr2=0x7f1e90005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:54.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.146+0000 7f1ea8ee4640 1 --2- 172.21.15.88:0/2396710260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e90004d10 0x7f1e90005190 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c00c1c0 tx=0x7f1e9c01f390 comp rx=0 tx=0).stop 2023-12-08T08:23:54.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.146+0000 7f1ea2d9d640 1 -- 172.21.15.88:0/2396710260 reap_dead start 2023-12-08T08:23:54.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.146+0000 7f1ea8ee4640 1 -- 172.21.15.88:0/2396710260 shutdown_connections 2023-12-08T08:23:54.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.146+0000 7f1ea8ee4640 1 -- 172.21.15.88:0/2396710260 >> 172.21.15.88:0/2396710260 conn(0x7f1ea40ab9d0 msgr2=0x7f1ea40abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:54.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.146+0000 7f1ea8ee4640 1 -- 172.21.15.88:0/2396710260 shutdown_connections 2023-12-08T08:23:54.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.146+0000 7f1ea8ee4640 1 -- 172.21.15.88:0/2396710260 wait complete. 2023-12-08T08:23:54.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.146+0000 7f1ea8ee4640 1 Processor -- start 2023-12-08T08:23:54.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.146+0000 7f1ea8ee4640 1 -- start start 2023-12-08T08:23:54.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.146+0000 7f1ea8ee4640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e90004d10 0x7f1ea41535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:54.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.146+0000 7f1ea8ee4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ea414dbc0 0x7f1ea41e9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:54.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.146+0000 7f1ea8ee4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ea414dfe0 0x7f1ea41ea100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:54.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.146+0000 7f1ea8ee4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea40c3800 con 0x7f1ea414dbc0 2023-12-08T08:23:54.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.146+0000 7f1ea8ee4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea40c3cf0 con 0x7f1ea414dfe0 2023-12-08T08:23:54.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.146+0000 7f1ea8ee4640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea414e6d0 con 0x7f1e90004d10 2023-12-08T08:23:54.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.146+0000 7f1e99d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ea414dbc0 0x7f1ea41e9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:54.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.146+0000 7f1e99d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ea414dbc0 0x7f1ea41e9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43104/0 (socket says 172.21.15.88:43104) 2023-12-08T08:23:54.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.146+0000 7f1e99d9b640 1 -- 172.21.15.88:0/1512325014 learned_addr learned my addr 172.21.15.88:0/1512325014 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:54.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.146+0000 7f1ea2d9d640 1 --2- 172.21.15.88:0/1512325014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ea414dfe0 0x7f1ea41ea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:54.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.146+0000 7f1ea259c640 1 --2- 172.21.15.88:0/1512325014 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e90004d10 0x7f1ea41535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:54.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.146+0000 7f1e99d9b640 1 -- 172.21.15.88:0/1512325014 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e90004d10 msgr2=0x7f1ea41535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:54.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.146+0000 7f1e99d9b640 1 --2- 172.21.15.88:0/1512325014 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e90004d10 0x7f1ea41535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:54.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.146+0000 7f1e99d9b640 1 -- 172.21.15.88:0/1512325014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ea414dfe0 msgr2=0x7f1ea41ea100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:54.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.146+0000 7f1e99d9b640 1 --2- 172.21.15.88:0/1512325014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ea414dfe0 0x7f1ea41ea100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:54.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.146+0000 7f1e99d9b640 1 -- 172.21.15.88:0/1512325014 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea40c3a10 con 0x7f1ea414dbc0 2023-12-08T08:23:54.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.150+0000 7f1e99d9b640 1 --2- 172.21.15.88:0/1512325014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ea414dbc0 0x7f1ea41e9bc0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c0119d0 tx=0x7f1e8c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:54.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.150+0000 7f1e9b7fe640 1 -- 172.21.15.88:0/1512325014 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c00fb50 con 0x7f1ea414dbc0 2023-12-08T08:23:54.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.150+0000 7f1e9b7fe640 1 -- 172.21.15.88:0/1512325014 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8c00fcb0 con 0x7f1ea414dbc0 2023-12-08T08:23:54.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.150+0000 7f1ea8ee4640 1 -- 172.21.15.88:0/1512325014 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea4153b00 con 0x7f1ea414dbc0 2023-12-08T08:23:54.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.150+0000 7f1e9b7fe640 1 -- 172.21.15.88:0/1512325014 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c014440 con 0x7f1ea414dbc0 2023-12-08T08:23:54.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.150+0000 7f1ea8ee4640 1 -- 172.21.15.88:0/1512325014 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea414f090 con 0x7f1ea414dbc0 2023-12-08T08:23:54.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.150+0000 7f1ea8ee4640 1 -- 172.21.15.88:0/1512325014 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea4067630 con 0x7f1ea414dbc0 2023-12-08T08:23:54.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.150+0000 7f1e9b7fe640 1 -- 172.21.15.88:0/1512325014 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1e8c0145a0 con 0x7f1ea414dbc0 2023-12-08T08:23:54.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.150+0000 7f1e9b7fe640 1 --2- 172.21.15.88:0/1512325014 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1e840664a0 0x7f1e84068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:54.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.150+0000 7f1e9b7fe640 1 -- 172.21.15.88:0/1512325014 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f1e8c084720 con 0x7f1ea414dbc0 2023-12-08T08:23:54.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.150+0000 7f1ea259c640 1 --2- 172.21.15.88:0/1512325014 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1e840664a0 0x7f1e84068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:54.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.154+0000 7f1ea259c640 1 --2- 172.21.15.88:0/1512325014 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1e840664a0 0x7f1e84068960 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1e94003fc0 tx=0x7f1e94009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:54.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.154+0000 7f1e9b7fe640 1 -- 172.21.15.88:0/1512325014 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1e8c051c90 con 0x7f1ea414dbc0 2023-12-08T08:23:54.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.338+0000 7f1ea8ee4640 1 -- 172.21.15.88:0/1512325014 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ea406b1c0 con 0x7f1ea414dbc0 2023-12-08T08:23:54.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.338+0000 7f1e9b7fe640 1 -- 172.21.15.88:0/1512325014 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f1e8c022090 con 0x7f1ea414dbc0 2023-12-08T08:23:54.342 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:54.342 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":54,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5693,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4194250074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4194250074},{"type":"v1","addr":"172.21.15.148:6833","nonce":4194250074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":5699,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3923000603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3923000603},{"type":"v1","addr":"172.21.15.148:6835","nonce":3923000603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/4138722471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":4138722471},{"type":"v1","addr":"172.21.15.88:6837","nonce":4138722471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:23:17.268042+0000","modified":"2023-12-08T08:23:20.393598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6519},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6519":{"gid":6519,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":7,"addr":"172.21.15.88:6835/1294328415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1294328415},{"type":"v1","addr":"172.21.15.88:6835","nonce":1294328415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-08T08:23:54.342 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 54 2023-12-08T08:23:54.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.338+0000 7f1ea8ee4640 1 -- 172.21.15.88:0/1512325014 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1e840664a0 msgr2=0x7f1e84068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:54.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.338+0000 7f1ea8ee4640 1 --2- 172.21.15.88:0/1512325014 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1e840664a0 0x7f1e84068960 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1e94003fc0 tx=0x7f1e94009040 comp rx=0 tx=0).stop 2023-12-08T08:23:54.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.338+0000 7f1ea8ee4640 1 -- 172.21.15.88:0/1512325014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ea414dbc0 msgr2=0x7f1ea41e9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:54.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.338+0000 7f1ea8ee4640 1 --2- 172.21.15.88:0/1512325014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ea414dbc0 0x7f1ea41e9bc0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c0119d0 tx=0x7f1e8c011e90 comp rx=0 tx=0).stop 2023-12-08T08:23:54.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.338+0000 7f1ea8ee4640 1 -- 172.21.15.88:0/1512325014 shutdown_connections 2023-12-08T08:23:54.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.338+0000 7f1ea8ee4640 1 --2- 172.21.15.88:0/1512325014 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1e840664a0 0x7f1e84068960 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:54.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.338+0000 7f1ea8ee4640 1 --2- 172.21.15.88:0/1512325014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ea414dfe0 0x7f1ea41ea100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:54.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.338+0000 7f1ea8ee4640 1 --2- 172.21.15.88:0/1512325014 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ea414dbc0 0x7f1ea41e9bc0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:54.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.338+0000 7f1ea8ee4640 1 --2- 172.21.15.88:0/1512325014 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1e90004d10 0x7f1ea41535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:54.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.338+0000 7f1ea8ee4640 1 -- 172.21.15.88:0/1512325014 >> 172.21.15.88:0/1512325014 conn(0x7f1ea40ab9d0 msgr2=0x7f1ea40c6540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:54.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.338+0000 7f1ea8ee4640 1 -- 172.21.15.88:0/1512325014 shutdown_connections 2023-12-08T08:23:54.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.338+0000 7f1ea8ee4640 1 -- 172.21.15.88:0/1512325014 wait complete. 2023-12-08T08:23:54.363 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:23:54.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.494+0000 7f2bc0b1c640 1 Processor -- start 2023-12-08T08:23:54.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.494+0000 7f2bc0b1c640 1 -- start start 2023-12-08T08:23:54.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.498+0000 7f2bc0b1c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2bbc06bef0 0x7f2bbc0bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:54.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.498+0000 7f2bc0b1c640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2bbc06c5b0 0x7f2bbc06ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:54.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.498+0000 7f2bc0b1c640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bbc151690 con 0x7f2bbc14e3f0 2023-12-08T08:23:54.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.498+0000 7f2bc0b1c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bbc151bc0 con 0x7f2bbc06bef0 2023-12-08T08:23:54.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.498+0000 7f2bc0b1c640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bbc1518e0 con 0x7f2bbc06c5b0 2023-12-08T08:23:54.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.498+0000 7f2bb3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2bbc06bef0 0x7f2bbc0bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:54.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.498+0000 7f2bb3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2bbc06bef0 0x7f2bbc0bfce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43118/0 (socket says 172.21.15.88:43118) 2023-12-08T08:23:54.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.498+0000 7f2bb3fff640 1 -- 172.21.15.88:0/3478285266 learned_addr learned my addr 172.21.15.88:0/3478285266 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:54.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.498+0000 7f2bbad9d640 1 --2- 172.21.15.88:0/3478285266 >> v2:172.21.15.148:3300/0 conn(0x7f2bbc06c5b0 0x7f2bbc06ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:54.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.498+0000 7f2bb3fff640 1 -- 172.21.15.88:0/3478285266 >> v2:172.21.15.148:3300/0 conn(0x7f2bbc06c5b0 msgr2=0x7f2bbc06ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:54.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.498+0000 7f2bb3fff640 1 --2- 172.21.15.88:0/3478285266 >> v2:172.21.15.148:3300/0 conn(0x7f2bbc06c5b0 0x7f2bbc06ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:54.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.498+0000 7f2bb3fff640 1 -- 172.21.15.88:0/3478285266 >> v1:172.21.15.148:6789/0 conn(0x7f2bbc14e3f0 legacy=0x7f2bbc0c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:54.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.498+0000 7f2bb3fff640 1 -- 172.21.15.88:0/3478285266 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bbc0c1de0 con 0x7f2bbc06bef0 2023-12-08T08:23:54.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.498+0000 7f2bbad9d640 1 --2- 172.21.15.88:0/3478285266 >> v2:172.21.15.148:3300/0 conn(0x7f2bbc06c5b0 0x7f2bbc06ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:54.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.502+0000 7f2bb3fff640 1 --2- 172.21.15.88:0/3478285266 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bbc06bef0 0x7f2bbc0bfce0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc070480 tx=0x7f2ba401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a9d95ef759ec6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:54.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.502+0000 7f2bb9d9b640 1 -- 172.21.15.88:0/3478285266 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba40ab600 con 0x7f2bbc06bef0 2023-12-08T08:23:54.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.502+0000 7f2bb9d9b640 1 -- 172.21.15.88:0/3478285266 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba40a7050 con 0x7f2bbc06bef0 2023-12-08T08:23:54.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.502+0000 7f2bb9d9b640 1 -- 172.21.15.88:0/3478285266 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba40ab980 con 0x7f2bbc06bef0 2023-12-08T08:23:54.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.502+0000 7f2bc0b1c640 1 -- 172.21.15.88:0/3478285266 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bbc06bef0 msgr2=0x7f2bbc0bfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:54.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.502+0000 7f2bc0b1c640 1 --2- 172.21.15.88:0/3478285266 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bbc06bef0 0x7f2bbc0bfce0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc070480 tx=0x7f2ba401c400 comp rx=0 tx=0).stop 2023-12-08T08:23:54.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.502+0000 7f2bc0b1c640 1 -- 172.21.15.88:0/3478285266 shutdown_connections 2023-12-08T08:23:54.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.502+0000 7f2bc0b1c640 1 --2- 172.21.15.88:0/3478285266 >> v2:172.21.15.148:3300/0 conn(0x7f2bbc06c5b0 0x7f2bbc06ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:54.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.502+0000 7f2bc0b1c640 1 --2- 172.21.15.88:0/3478285266 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bbc06bef0 0x7f2bbc0bfce0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:54.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.502+0000 7f2bc0b1c640 1 -- 172.21.15.88:0/3478285266 >> 172.21.15.88:0/3478285266 conn(0x7f2bbc0a7810 msgr2=0x7f2bbc0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:54.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.502+0000 7f2bc0b1c640 1 -- 172.21.15.88:0/3478285266 shutdown_connections 2023-12-08T08:23:54.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.502+0000 7f2bc0b1c640 1 -- 172.21.15.88:0/3478285266 wait complete. 2023-12-08T08:23:54.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.502+0000 7f2bc0b1c640 1 Processor -- start 2023-12-08T08:23:54.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.502+0000 7f2bc0b1c640 1 -- start start 2023-12-08T08:23:54.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.506+0000 7f2bc0b1c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bbc06bef0 0x7f2bbc146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:54.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.506+0000 7f2bc0b1c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bbc06c5b0 0x7f2bbc1471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:54.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.506+0000 7f2bc0b1c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2bbc14e3f0 0x7f2bbc1ee5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:54.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.506+0000 7f2bc0b1c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc151f00 con 0x7f2bbc06c5b0 2023-12-08T08:23:54.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.506+0000 7f2bc0b1c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc153360 con 0x7f2bbc06bef0 2023-12-08T08:23:54.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.506+0000 7f2bc0b1c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc153640 con 0x7f2bbc14e3f0 2023-12-08T08:23:54.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.506+0000 7f2bb3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bbc06c5b0 0x7f2bbc1471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:54.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.506+0000 7f2bb3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bbc06c5b0 0x7f2bbc1471f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43134/0 (socket says 172.21.15.88:43134) 2023-12-08T08:23:54.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.506+0000 7f2bb3fff640 1 -- 172.21.15.88:0/1697603667 learned_addr learned my addr 172.21.15.88:0/1697603667 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:54.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.506+0000 7f2bba59c640 1 --2- 172.21.15.88:0/1697603667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bbc06bef0 0x7f2bbc146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:54.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.506+0000 7f2bbad9d640 1 --2- 172.21.15.88:0/1697603667 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2bbc14e3f0 0x7f2bbc1ee5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:54.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.506+0000 7f2bb3fff640 1 -- 172.21.15.88:0/1697603667 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2bbc14e3f0 msgr2=0x7f2bbc1ee5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:54.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.506+0000 7f2bb3fff640 1 --2- 172.21.15.88:0/1697603667 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2bbc14e3f0 0x7f2bbc1ee5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:54.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.506+0000 7f2bb3fff640 1 -- 172.21.15.88:0/1697603667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bbc06bef0 msgr2=0x7f2bbc146cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:54.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.506+0000 7f2bb3fff640 1 --2- 172.21.15.88:0/1697603667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bbc06bef0 0x7f2bbc146cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:54.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.506+0000 7f2bb3fff640 1 -- 172.21.15.88:0/1697603667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba40094d0 con 0x7f2bbc06c5b0 2023-12-08T08:23:54.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.506+0000 7f2bb3fff640 1 --2- 172.21.15.88:0/1697603667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bbc06c5b0 0x7f2bbc1471f0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f2ba401a030 tx=0x7f2ba40191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:54.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.506+0000 7f2bb2ffd640 1 -- 172.21.15.88:0/1697603667 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba40b37d0 con 0x7f2bbc06c5b0 2023-12-08T08:23:54.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.506+0000 7f2bb2ffd640 1 -- 172.21.15.88:0/1697603667 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba40a4e90 con 0x7f2bbc06c5b0 2023-12-08T08:23:54.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.506+0000 7f2bc0b1c640 1 -- 172.21.15.88:0/1697603667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bbc153920 con 0x7f2bbc06c5b0 2023-12-08T08:23:54.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.506+0000 7f2bb2ffd640 1 -- 172.21.15.88:0/1697603667 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba40b3b70 con 0x7f2bbc06c5b0 2023-12-08T08:23:54.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.506+0000 7f2bc0b1c640 1 -- 172.21.15.88:0/1697603667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bbc153060 con 0x7f2bbc06c5b0 2023-12-08T08:23:54.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.506+0000 7f2bc0b1c640 1 -- 172.21.15.88:0/1697603667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bbc153e40 con 0x7f2bbc06c5b0 2023-12-08T08:23:54.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.506+0000 7f2bb2ffd640 1 -- 172.21.15.88:0/1697603667 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2ba40b2070 con 0x7f2bbc06c5b0 2023-12-08T08:23:54.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.510+0000 7f2bb2ffd640 1 --2- 172.21.15.88:0/1697603667 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2b9c066470 0x7f2b9c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:54.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.510+0000 7f2bb2ffd640 1 -- 172.21.15.88:0/1697603667 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f2ba411e070 con 0x7f2bbc06c5b0 2023-12-08T08:23:54.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.510+0000 7f2bba59c640 1 --2- 172.21.15.88:0/1697603667 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2b9c066470 0x7f2b9c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:54.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.510+0000 7f2bba59c640 1 --2- 172.21.15.88:0/1697603667 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2b9c066470 0x7f2b9c068930 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0098e0 tx=0x7f2bac009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:54.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.514+0000 7f2bb2ffd640 1 -- 172.21.15.88:0/1697603667 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2ba414f280 con 0x7f2bbc06c5b0 2023-12-08T08:23:54.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.662+0000 7f2bc0b1c640 1 -- 172.21.15.88:0/1697603667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2bbc067630 con 0x7f2bbc06c5b0 2023-12-08T08:23:54.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.662+0000 7f2bb2ffd640 1 -- 172.21.15.88:0/1697603667 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16615 (secure 0 0 0) 0x7f2bbc153e40 con 0x7f2bbc06c5b0 2023-12-08T08:23:54.668 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:54.668 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":75,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:23:52.625379+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:23:15.029129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:23:16.271716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6837/698349615":"2023-12-09T08:23:49.403962+0000","172.21.15.88:6836/698349615":"2023-12-09T08:23:49.403962+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:23:54.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.666+0000 7f2bc0b1c640 1 -- 172.21.15.88:0/1697603667 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2b9c066470 msgr2=0x7f2b9c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:54.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.666+0000 7f2bc0b1c640 1 --2- 172.21.15.88:0/1697603667 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2b9c066470 0x7f2b9c068930 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0098e0 tx=0x7f2bac009060 comp rx=0 tx=0).stop 2023-12-08T08:23:54.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.666+0000 7f2bc0b1c640 1 -- 172.21.15.88:0/1697603667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bbc06c5b0 msgr2=0x7f2bbc1471f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:54.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.666+0000 7f2bc0b1c640 1 --2- 172.21.15.88:0/1697603667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bbc06c5b0 0x7f2bbc1471f0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f2ba401a030 tx=0x7f2ba40191a0 comp rx=0 tx=0).stop 2023-12-08T08:23:54.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.666+0000 7f2bc0b1c640 1 -- 172.21.15.88:0/1697603667 shutdown_connections 2023-12-08T08:23:54.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.666+0000 7f2bc0b1c640 1 --2- 172.21.15.88:0/1697603667 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f2b9c066470 0x7f2b9c068930 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:54.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.666+0000 7f2bc0b1c640 1 --2- 172.21.15.88:0/1697603667 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f2bbc14e3f0 0x7f2bbc1ee5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:54.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.666+0000 7f2bc0b1c640 1 --2- 172.21.15.88:0/1697603667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bbc06c5b0 0x7f2bbc1471f0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:54.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.666+0000 7f2bc0b1c640 1 --2- 172.21.15.88:0/1697603667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bbc06bef0 0x7f2bbc146cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:54.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.666+0000 7f2bc0b1c640 1 -- 172.21.15.88:0/1697603667 >> 172.21.15.88:0/1697603667 conn(0x7f2bbc0a7810 msgr2=0x7f2bbc14ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:54.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.666+0000 7f2bc0b1c640 1 -- 172.21.15.88:0/1697603667 shutdown_connections 2023-12-08T08:23:54.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.666+0000 7f2bc0b1c640 1 -- 172.21.15.88:0/1697603667 wait complete. 2023-12-08T08:23:54.689 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-12-08T08:23:54.689 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:23:54.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.822+0000 7f6526a79640 1 Processor -- start 2023-12-08T08:23:54.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.822+0000 7f6526a79640 1 -- start start 2023-12-08T08:23:54.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.826+0000 7f6526a79640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f65200bee90 0x7f65200bf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:54.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.826+0000 7f6526a79640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6520157cf0 con 0x7f652014b2a0 2023-12-08T08:23:54.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.826+0000 7f6526a79640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6520157fd0 con 0x7f6520154740 2023-12-08T08:23:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.826+0000 7f6526a79640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f652006c3a0 con 0x7f65200bee90 2023-12-08T08:23:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.826+0000 7f6524815640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f652014b2a0 0x7f65200a4ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39768/0 (socket says 172.21.15.88:39768) 2023-12-08T08:23:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.826+0000 7f6524815640 1 -- 172.21.15.88:0/1820770777 learned_addr learned my addr 172.21.15.88:0/1820770777 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.826+0000 7f6517fff640 1 --2- 172.21.15.88:0/1820770777 >> v2:172.21.15.88:3300/0 conn(0x7f65200bee90 0x7f65200bf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.826+0000 7f65177fe640 1 -- 172.21.15.88:0/1820770777 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276268952 0 0) 0x7f6520157cf0 con 0x7f652014b2a0 2023-12-08T08:23:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.826+0000 7f65177fe640 1 -- 172.21.15.88:0/1820770777 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6508003530 con 0x7f652014b2a0 2023-12-08T08:23:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.826+0000 7f6517fff640 1 -- 172.21.15.88:0/1820770777 >> v1:172.21.15.148:6789/0 conn(0x7f6520154740 legacy=0x7f6520154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.826+0000 7f6517fff640 1 -- 172.21.15.88:0/1820770777 >> v1:172.21.15.88:6789/0 conn(0x7f652014b2a0 legacy=0x7f65200a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.826+0000 7f6517fff640 1 -- 172.21.15.88:0/1820770777 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65201582b0 con 0x7f65200bee90 2023-12-08T08:23:54.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.826+0000 7f6517fff640 1 --2- 172.21.15.88:0/1820770777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65200bee90 0x7f65200bf310 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f65100097c0 tx=0x7f651001c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b8de540f35e525 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:54.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.830+0000 7f65177fe640 1 -- 172.21.15.88:0/1820770777 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65100ab600 con 0x7f65200bee90 2023-12-08T08:23:54.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.830+0000 7f65177fe640 1 -- 172.21.15.88:0/1820770777 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65100a7050 con 0x7f65200bee90 2023-12-08T08:23:54.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.830+0000 7f65177fe640 1 -- 172.21.15.88:0/1820770777 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65100ab980 con 0x7f65200bee90 2023-12-08T08:23:54.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.830+0000 7f6526a79640 1 -- 172.21.15.88:0/1820770777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65200bee90 msgr2=0x7f65200bf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:54.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.830+0000 7f6526a79640 1 --2- 172.21.15.88:0/1820770777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65200bee90 0x7f65200bf310 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f65100097c0 tx=0x7f651001c320 comp rx=0 tx=0).stop 2023-12-08T08:23:54.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.830+0000 7f6526a79640 1 -- 172.21.15.88:0/1820770777 shutdown_connections 2023-12-08T08:23:54.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.830+0000 7f6526a79640 1 --2- 172.21.15.88:0/1820770777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65200bee90 0x7f65200bf310 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:54.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.830+0000 7f6526a79640 1 -- 172.21.15.88:0/1820770777 >> 172.21.15.88:0/1820770777 conn(0x7f65200a7810 msgr2=0x7f65200a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:54.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.830+0000 7f6526a79640 1 -- 172.21.15.88:0/1820770777 shutdown_connections 2023-12-08T08:23:54.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.830+0000 7f6526a79640 1 -- 172.21.15.88:0/1820770777 wait complete. 2023-12-08T08:23:54.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.830+0000 7f6526a79640 1 Processor -- start 2023-12-08T08:23:54.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.830+0000 7f6526a79640 1 -- start start 2023-12-08T08:23:54.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.830+0000 7f6526a79640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65200bee90 0x7f65200a6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:54.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.830+0000 7f6526a79640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f652014b2a0 0x7f65201f06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:54.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.830+0000 7f6526a79640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6520154740 0x7f65201f0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:54.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.830+0000 7f6526a79640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6520072800 con 0x7f65200bee90 2023-12-08T08:23:54.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.830+0000 7f6526a79640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65201f0240 con 0x7f652014b2a0 2023-12-08T08:23:54.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.830+0000 7f6526a79640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65201f1150 con 0x7f6520154740 2023-12-08T08:23:54.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.830+0000 7f6524815640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65200bee90 0x7f65200a6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:54.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.830+0000 7f6524815640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65200bee90 0x7f65200a6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43146/0 (socket says 172.21.15.88:43146) 2023-12-08T08:23:54.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.830+0000 7f6524815640 1 -- 172.21.15.88:0/4214778572 learned_addr learned my addr 172.21.15.88:0/4214778572 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:54.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.830+0000 7f6517fff640 1 --2- 172.21.15.88:0/4214778572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f652014b2a0 0x7f65201f06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:54.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.830+0000 7f6525016640 1 --2- 172.21.15.88:0/4214778572 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6520154740 0x7f65201f0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:54.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.834+0000 7f6524815640 1 -- 172.21.15.88:0/4214778572 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6520154740 msgr2=0x7f65201f0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:54.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.834+0000 7f6524815640 1 --2- 172.21.15.88:0/4214778572 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6520154740 0x7f65201f0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:54.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.834+0000 7f6524815640 1 -- 172.21.15.88:0/4214778572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f652014b2a0 msgr2=0x7f65201f06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:54.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.834+0000 7f6524815640 1 --2- 172.21.15.88:0/4214778572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f652014b2a0 0x7f65201f06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:54.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.834+0000 7f6524815640 1 -- 172.21.15.88:0/4214778572 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6510009420 con 0x7f65200bee90 2023-12-08T08:23:54.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.834+0000 7f6517fff640 1 --2- 172.21.15.88:0/4214778572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f652014b2a0 0x7f65201f06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:23:54.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.834+0000 7f6524815640 1 --2- 172.21.15.88:0/4214778572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65200bee90 0x7f65200a6d50 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f651c00c500 tx=0x7f651c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:54.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.834+0000 7f65157fa640 1 -- 172.21.15.88:0/4214778572 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651c005cf0 con 0x7f65200bee90 2023-12-08T08:23:54.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.834+0000 7f65157fa640 1 -- 172.21.15.88:0/4214778572 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651c005e50 con 0x7f65200bee90 2023-12-08T08:23:54.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.834+0000 7f6526a79640 1 -- 172.21.15.88:0/4214778572 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6520143c30 con 0x7f65200bee90 2023-12-08T08:23:54.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.834+0000 7f65157fa640 1 -- 172.21.15.88:0/4214778572 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651c0072f0 con 0x7f65200bee90 2023-12-08T08:23:54.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.834+0000 7f6526a79640 1 -- 172.21.15.88:0/4214778572 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65201441f0 con 0x7f65200bee90 2023-12-08T08:23:54.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.834+0000 7f6526a79640 1 -- 172.21.15.88:0/4214778572 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65200bfbe0 con 0x7f65200bee90 2023-12-08T08:23:54.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.834+0000 7f65157fa640 1 -- 172.21.15.88:0/4214778572 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f651c007450 con 0x7f65200bee90 2023-12-08T08:23:54.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.834+0000 7f65157fa640 1 --2- 172.21.15.88:0/4214778572 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f650c0664a0 0x7f650c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:54.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.834+0000 7f65157fa640 1 -- 172.21.15.88:0/4214778572 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f651c083350 con 0x7f65200bee90 2023-12-08T08:23:54.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.834+0000 7f6517fff640 1 --2- 172.21.15.88:0/4214778572 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f650c0664a0 0x7f650c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:54.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.838+0000 7f6517fff640 1 --2- 172.21.15.88:0/4214778572 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f650c0664a0 0x7f650c068960 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f65100ad000 tx=0x7f6510008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:54.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:54.838+0000 7f65157fa640 1 -- 172.21.15.88:0/4214778572 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f651c0508b0 con 0x7f65200bee90 2023-12-08T08:23:55.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.018+0000 7f6526a79640 1 -- 172.21.15.88:0/4214778572 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65200a82b0 con 0x7f65200bee90 2023-12-08T08:23:55.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.022+0000 7f65157fa640 1 -- 172.21.15.88:0/4214778572 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f651c053ed0 con 0x7f65200bee90 2023-12-08T08:23:55.025 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:55.025 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":54,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5693,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4194250074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4194250074},{"type":"v1","addr":"172.21.15.148:6833","nonce":4194250074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":5699,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3923000603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3923000603},{"type":"v1","addr":"172.21.15.148:6835","nonce":3923000603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/4138722471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":4138722471},{"type":"v1","addr":"172.21.15.88:6837","nonce":4138722471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:23:17.268042+0000","modified":"2023-12-08T08:23:20.393598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6519},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6519":{"gid":6519,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":7,"addr":"172.21.15.88:6835/1294328415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1294328415},{"type":"v1","addr":"172.21.15.88:6835","nonce":1294328415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-08T08:23:55.025 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 54 2023-12-08T08:23:55.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.022+0000 7f6526a79640 1 -- 172.21.15.88:0/4214778572 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f650c0664a0 msgr2=0x7f650c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:55.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.022+0000 7f6526a79640 1 --2- 172.21.15.88:0/4214778572 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f650c0664a0 0x7f650c068960 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f65100ad000 tx=0x7f6510008040 comp rx=0 tx=0).stop 2023-12-08T08:23:55.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.022+0000 7f6526a79640 1 -- 172.21.15.88:0/4214778572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65200bee90 msgr2=0x7f65200a6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:55.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.022+0000 7f6526a79640 1 --2- 172.21.15.88:0/4214778572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65200bee90 0x7f65200a6d50 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f651c00c500 tx=0x7f651c00c9c0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.022+0000 7f6526a79640 1 -- 172.21.15.88:0/4214778572 shutdown_connections 2023-12-08T08:23:55.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.022+0000 7f6526a79640 1 --2- 172.21.15.88:0/4214778572 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f650c0664a0 0x7f650c068960 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.022+0000 7f6526a79640 1 --2- 172.21.15.88:0/4214778572 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f6520154740 0x7f65201f0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.022+0000 7f6526a79640 1 --2- 172.21.15.88:0/4214778572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f652014b2a0 0x7f65201f06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.022+0000 7f6526a79640 1 --2- 172.21.15.88:0/4214778572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65200bee90 0x7f65200a6d50 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.022+0000 7f6526a79640 1 -- 172.21.15.88:0/4214778572 >> 172.21.15.88:0/4214778572 conn(0x7f65200a7810 msgr2=0x7f6520154b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:55.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.022+0000 7f6526a79640 1 -- 172.21.15.88:0/4214778572 shutdown_connections 2023-12-08T08:23:55.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.022+0000 7f6526a79640 1 -- 172.21.15.88:0/4214778572 wait complete. 2023-12-08T08:23:55.046 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:23:55.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.178+0000 7f51ef8bb640 1 Processor -- start 2023-12-08T08:23:55.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.178+0000 7f51ef8bb640 1 -- start start 2023-12-08T08:23:55.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.182+0000 7f51ef8bb640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f51e8071e30 0x7f51e80722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:55.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.182+0000 7f51ef8bb640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f51e8156110 0x7f51e8156580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:55.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.182+0000 7f51ef8bb640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e80c5710 con 0x7f51e814fd10 2023-12-08T08:23:55.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.182+0000 7f51ef8bb640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e806c5e0 con 0x7f51e8156110 2023-12-08T08:23:55.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.182+0000 7f51ef8bb640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e8155c80 con 0x7f51e8071e30 2023-12-08T08:23:55.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.182+0000 7f51ed657640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f51e814fd10 0x7f51e80a4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39770/0 (socket says 172.21.15.88:39770) 2023-12-08T08:23:55.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.182+0000 7f51ed657640 1 -- 172.21.15.88:0/3843033468 learned_addr learned my addr 172.21.15.88:0/3843033468 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:55.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.182+0000 7f51ede58640 1 --2- 172.21.15.88:0/3843033468 >> v2:172.21.15.88:3300/0 conn(0x7f51e8156110 0x7f51e8156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:55.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.182+0000 7f51ece56640 1 --2- 172.21.15.88:0/3843033468 >> v2:172.21.15.148:3300/0 conn(0x7f51e8071e30 0x7f51e80722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:55.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.182+0000 7f51dffff640 1 -- 172.21.15.88:0/3843033468 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 35251621 0 0) 0x7f51e80c5710 con 0x7f51e814fd10 2023-12-08T08:23:55.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.182+0000 7f51dffff640 1 -- 172.21.15.88:0/3843033468 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51d4003530 con 0x7f51e814fd10 2023-12-08T08:23:55.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.182+0000 7f51ede58640 1 -- 172.21.15.88:0/3843033468 >> v2:172.21.15.148:3300/0 conn(0x7f51e8071e30 msgr2=0x7f51e80722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:55.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.182+0000 7f51ede58640 1 --2- 172.21.15.88:0/3843033468 >> v2:172.21.15.148:3300/0 conn(0x7f51e8071e30 0x7f51e80722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.182+0000 7f51ede58640 1 -- 172.21.15.88:0/3843033468 >> v1:172.21.15.88:6789/0 conn(0x7f51e814fd10 legacy=0x7f51e80a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:55.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.182+0000 7f51ede58640 1 -- 172.21.15.88:0/3843033468 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e80c4e70 con 0x7f51e8156110 2023-12-08T08:23:55.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.186+0000 7f51ede58640 1 --2- 172.21.15.88:0/3843033468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51e8156110 0x7f51e8156580 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f51e8066e30 tx=0x7f51e001c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa54a4f2ace3da28 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:55.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.186+0000 7f51dffff640 1 -- 172.21.15.88:0/3843033468 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e00a58b0 con 0x7f51e8156110 2023-12-08T08:23:55.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.186+0000 7f51dffff640 1 -- 172.21.15.88:0/3843033468 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e00a5a10 con 0x7f51e8156110 2023-12-08T08:23:55.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.186+0000 7f51dffff640 1 -- 172.21.15.88:0/3843033468 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e00a5da0 con 0x7f51e8156110 2023-12-08T08:23:55.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.186+0000 7f51ef8bb640 1 -- 172.21.15.88:0/3843033468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51e8156110 msgr2=0x7f51e8156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:55.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.186+0000 7f51ef8bb640 1 --2- 172.21.15.88:0/3843033468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51e8156110 0x7f51e8156580 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f51e8066e30 tx=0x7f51e001c7f0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.186+0000 7f51ef8bb640 1 -- 172.21.15.88:0/3843033468 shutdown_connections 2023-12-08T08:23:55.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.186+0000 7f51ef8bb640 1 --2- 172.21.15.88:0/3843033468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51e8156110 0x7f51e8156580 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.186+0000 7f51ef8bb640 1 --2- 172.21.15.88:0/3843033468 >> v2:172.21.15.148:3300/0 conn(0x7f51e8071e30 0x7f51e80722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.186+0000 7f51ef8bb640 1 -- 172.21.15.88:0/3843033468 >> 172.21.15.88:0/3843033468 conn(0x7f51e80a7810 msgr2=0x7f51e80a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:55.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.186+0000 7f51ef8bb640 1 -- 172.21.15.88:0/3843033468 shutdown_connections 2023-12-08T08:23:55.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.186+0000 7f51ef8bb640 1 -- 172.21.15.88:0/3843033468 wait complete. 2023-12-08T08:23:55.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.186+0000 7f51ef8bb640 1 Processor -- start 2023-12-08T08:23:55.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.186+0000 7f51ef8bb640 1 -- start start 2023-12-08T08:23:55.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.186+0000 7f51ef8bb640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51e8071e30 0x7f51e81eab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:55.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.186+0000 7f51ef8bb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51e814fd10 0x7f51e814ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:55.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.186+0000 7f51ef8bb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e8156110 0x7f51e81476b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:55.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.186+0000 7f51ef8bb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e80a90a0 con 0x7f51e814fd10 2023-12-08T08:23:55.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.186+0000 7f51ef8bb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e81eb110 con 0x7f51e8156110 2023-12-08T08:23:55.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.186+0000 7f51ef8bb640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e81eb3f0 con 0x7f51e8071e30 2023-12-08T08:23:55.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.190+0000 7f51ece56640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51e814fd10 0x7f51e814ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:55.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.190+0000 7f51ece56640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51e814fd10 0x7f51e814ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43168/0 (socket says 172.21.15.88:43168) 2023-12-08T08:23:55.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.190+0000 7f51ece56640 1 -- 172.21.15.88:0/3660924395 learned_addr learned my addr 172.21.15.88:0/3660924395 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:55.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.190+0000 7f51ed657640 1 --2- 172.21.15.88:0/3660924395 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51e8071e30 0x7f51e81eab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:55.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.190+0000 7f51ede58640 1 --2- 172.21.15.88:0/3660924395 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e8156110 0x7f51e81476b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:55.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.190+0000 7f51ece56640 1 -- 172.21.15.88:0/3660924395 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51e8071e30 msgr2=0x7f51e81eab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:55.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.190+0000 7f51ece56640 1 --2- 172.21.15.88:0/3660924395 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51e8071e30 0x7f51e81eab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.190+0000 7f51ece56640 1 -- 172.21.15.88:0/3660924395 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e8156110 msgr2=0x7f51e81476b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:55.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.190+0000 7f51ece56640 1 --2- 172.21.15.88:0/3660924395 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e8156110 0x7f51e81476b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.190+0000 7f51ece56640 1 -- 172.21.15.88:0/3660924395 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e0009a70 con 0x7f51e814fd10 2023-12-08T08:23:55.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.190+0000 7f51ece56640 1 --2- 172.21.15.88:0/3660924395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51e814fd10 0x7f51e814ebc0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f51d800d800 tx=0x7f51d800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:55.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.190+0000 7f51ddffb640 1 -- 172.21.15.88:0/3660924395 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d800b6c0 con 0x7f51e814fd10 2023-12-08T08:23:55.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.190+0000 7f51ddffb640 1 -- 172.21.15.88:0/3660924395 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d800b820 con 0x7f51e814fd10 2023-12-08T08:23:55.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.190+0000 7f51ef8bb640 1 -- 172.21.15.88:0/3660924395 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e81eb6d0 con 0x7f51e814fd10 2023-12-08T08:23:55.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.190+0000 7f51ddffb640 1 -- 172.21.15.88:0/3660924395 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d800bb90 con 0x7f51e814fd10 2023-12-08T08:23:55.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.190+0000 7f51ef8bb640 1 -- 172.21.15.88:0/3660924395 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e8147190 con 0x7f51e814fd10 2023-12-08T08:23:55.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.190+0000 7f51ef8bb640 1 -- 172.21.15.88:0/3660924395 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e8067630 con 0x7f51e814fd10 2023-12-08T08:23:55.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.190+0000 7f51ddffb640 1 -- 172.21.15.88:0/3660924395 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f51d800bcf0 con 0x7f51e814fd10 2023-12-08T08:23:55.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.194+0000 7f51ddffb640 1 --2- 172.21.15.88:0/3660924395 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f51cc066470 0x7f51cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:55.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.194+0000 7f51ddffb640 1 -- 172.21.15.88:0/3660924395 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f51d80843e0 con 0x7f51e814fd10 2023-12-08T08:23:55.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.194+0000 7f51ed657640 1 --2- 172.21.15.88:0/3660924395 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f51cc066470 0x7f51cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:55.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.194+0000 7f51ed657640 1 --2- 172.21.15.88:0/3660924395 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f51cc066470 0x7f51cc068930 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f51e40011f0 tx=0x7f51e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:55.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.198+0000 7f51ddffb640 1 -- 172.21.15.88:0/3660924395 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f51d8051890 con 0x7f51e814fd10 2023-12-08T08:23:55.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.378+0000 7f51ef8bb640 1 -- 172.21.15.88:0/3660924395 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51e80c4b20 con 0x7f51e814fd10 2023-12-08T08:23:55.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.378+0000 7f51ddffb640 1 -- 172.21.15.88:0/3660924395 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f51d8011340 con 0x7f51e814fd10 2023-12-08T08:23:55.383 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:55.383 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":54,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5693,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4194250074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4194250074},{"type":"v1","addr":"172.21.15.148:6833","nonce":4194250074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":5699,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3923000603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3923000603},{"type":"v1","addr":"172.21.15.148:6835","nonce":3923000603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/4138722471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":4138722471},{"type":"v1","addr":"172.21.15.88:6837","nonce":4138722471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:23:17.268042+0000","modified":"2023-12-08T08:23:20.393598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6519},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6519":{"gid":6519,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":7,"addr":"172.21.15.88:6835/1294328415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1294328415},{"type":"v1","addr":"172.21.15.88:6835","nonce":1294328415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-08T08:23:55.383 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 54 2023-12-08T08:23:55.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.378+0000 7f51ef8bb640 1 -- 172.21.15.88:0/3660924395 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f51cc066470 msgr2=0x7f51cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:55.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.378+0000 7f51ef8bb640 1 --2- 172.21.15.88:0/3660924395 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f51cc066470 0x7f51cc068930 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f51e40011f0 tx=0x7f51e4009040 comp rx=0 tx=0).stop 2023-12-08T08:23:55.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.378+0000 7f51ef8bb640 1 -- 172.21.15.88:0/3660924395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51e814fd10 msgr2=0x7f51e814ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:55.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.378+0000 7f51ef8bb640 1 --2- 172.21.15.88:0/3660924395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51e814fd10 0x7f51e814ebc0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f51d800d800 tx=0x7f51d800dcc0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.382+0000 7f51ef8bb640 1 -- 172.21.15.88:0/3660924395 shutdown_connections 2023-12-08T08:23:55.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.382+0000 7f51ef8bb640 1 --2- 172.21.15.88:0/3660924395 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f51cc066470 0x7f51cc068930 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.382+0000 7f51ef8bb640 1 --2- 172.21.15.88:0/3660924395 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e8156110 0x7f51e81476b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.382+0000 7f51ef8bb640 1 --2- 172.21.15.88:0/3660924395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51e814fd10 0x7f51e814ebc0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.382+0000 7f51ef8bb640 1 --2- 172.21.15.88:0/3660924395 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f51e8071e30 0x7f51e81eab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.382+0000 7f51ef8bb640 1 -- 172.21.15.88:0/3660924395 >> 172.21.15.88:0/3660924395 conn(0x7f51e80a7810 msgr2=0x7f51e814c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:55.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.382+0000 7f51ef8bb640 1 -- 172.21.15.88:0/3660924395 shutdown_connections 2023-12-08T08:23:55.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.382+0000 7f51ef8bb640 1 -- 172.21.15.88:0/3660924395 wait complete. 2023-12-08T08:23:55.404 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:23:55.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.538+0000 7f61d9c9f640 1 Processor -- start 2023-12-08T08:23:55.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.538+0000 7f61d9c9f640 1 -- start start 2023-12-08T08:23:55.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.538+0000 7f61d9c9f640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f61d40c7fd0 0x7f61d4157910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:55.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.538+0000 7f61d9c9f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f61d4157e50 0x7f61d415eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:55.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.538+0000 7f61d9c9f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d40c8460 con 0x7f61d4151b40 2023-12-08T08:23:55.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.538+0000 7f61d9c9f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d4154320 con 0x7f61d4157e50 2023-12-08T08:23:55.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.538+0000 7f61d9c9f640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d41552f0 con 0x7f61d40c7fd0 2023-12-08T08:23:55.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.538+0000 7f61d8c9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f61d4151b40 0x7f61d40c9f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39774/0 (socket says 172.21.15.88:39774) 2023-12-08T08:23:55.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.538+0000 7f61d8c9d640 1 -- 172.21.15.88:0/1848376248 learned_addr learned my addr 172.21.15.88:0/1848376248 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:55.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.538+0000 7f61d949e640 1 --2- 172.21.15.88:0/1848376248 >> v2:172.21.15.88:3300/0 conn(0x7f61d4157e50 0x7f61d415eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:55.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.538+0000 7f61d949e640 1 -- 172.21.15.88:0/1848376248 >> v2:172.21.15.148:3300/0 conn(0x7f61d40c7fd0 msgr2=0x7f61d4157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:55.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.538+0000 7f61cbfff640 1 --2- 172.21.15.88:0/1848376248 >> v2:172.21.15.148:3300/0 conn(0x7f61d40c7fd0 0x7f61d4157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:55.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.538+0000 7f61d949e640 1 --2- 172.21.15.88:0/1848376248 >> v2:172.21.15.148:3300/0 conn(0x7f61d40c7fd0 0x7f61d4157910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.538+0000 7f61d949e640 1 -- 172.21.15.88:0/1848376248 >> v1:172.21.15.88:6789/0 conn(0x7f61d4151b40 legacy=0x7f61d40c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:55.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.538+0000 7f61cb7fe640 1 -- 172.21.15.88:0/1848376248 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 55921372 0 0) 0x7f61d40c8460 con 0x7f61d4151b40 2023-12-08T08:23:55.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.538+0000 7f61d949e640 1 -- 172.21.15.88:0/1848376248 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d4154530 con 0x7f61d4157e50 2023-12-08T08:23:55.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.538+0000 7f61cbfff640 1 --2- 172.21.15.88:0/1848376248 >> v2:172.21.15.148:3300/0 conn(0x7f61d40c7fd0 0x7f61d4157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:55.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.542+0000 7f61d949e640 1 --2- 172.21.15.88:0/1848376248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d4157e50 0x7f61d415eca0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f61d40c3ee0 tx=0x7f61cc01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ad0668c44d5547 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:55.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.542+0000 7f61cb7fe640 1 -- 172.21.15.88:0/1848376248 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc0a5850 con 0x7f61d4157e50 2023-12-08T08:23:55.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.542+0000 7f61cb7fe640 1 -- 172.21.15.88:0/1848376248 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61cc0a59b0 con 0x7f61d4157e50 2023-12-08T08:23:55.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.542+0000 7f61cb7fe640 1 -- 172.21.15.88:0/1848376248 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc0a5d40 con 0x7f61d4157e50 2023-12-08T08:23:55.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.542+0000 7f61d9c9f640 1 -- 172.21.15.88:0/1848376248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d4157e50 msgr2=0x7f61d415eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:55.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.542+0000 7f61d9c9f640 1 --2- 172.21.15.88:0/1848376248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d4157e50 0x7f61d415eca0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f61d40c3ee0 tx=0x7f61cc01c880 comp rx=0 tx=0).stop 2023-12-08T08:23:55.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.542+0000 7f61d9c9f640 1 -- 172.21.15.88:0/1848376248 shutdown_connections 2023-12-08T08:23:55.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.542+0000 7f61d9c9f640 1 --2- 172.21.15.88:0/1848376248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d4157e50 0x7f61d415eca0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.542+0000 7f61d9c9f640 1 --2- 172.21.15.88:0/1848376248 >> v2:172.21.15.148:3300/0 conn(0x7f61d40c7fd0 0x7f61d4157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.542+0000 7f61d9c9f640 1 -- 172.21.15.88:0/1848376248 >> 172.21.15.88:0/1848376248 conn(0x7f61d4066470 msgr2=0x7f61d4066880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:55.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.542+0000 7f61d9c9f640 1 -- 172.21.15.88:0/1848376248 shutdown_connections 2023-12-08T08:23:55.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.542+0000 7f61d9c9f640 1 -- 172.21.15.88:0/1848376248 wait complete. 2023-12-08T08:23:55.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.542+0000 7f61d9c9f640 1 Processor -- start 2023-12-08T08:23:55.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.542+0000 7f61d9c9f640 1 -- start start 2023-12-08T08:23:55.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.546+0000 7f61d9c9f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d40c7fd0 0x7f61d414f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:55.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.546+0000 7f61d9c9f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61d4151b40 0x7f61d414b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:55.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.546+0000 7f61d9c9f640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f61d4157e50 0x7f61d4157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:55.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.546+0000 7f61d9c9f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d414c510 con 0x7f61d40c7fd0 2023-12-08T08:23:55.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.546+0000 7f61d9c9f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d414eac0 con 0x7f61d4151b40 2023-12-08T08:23:55.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.546+0000 7f61d9c9f640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d414ed10 con 0x7f61d4157e50 2023-12-08T08:23:55.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.546+0000 7f61d8c9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d40c7fd0 0x7f61d414f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:55.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.546+0000 7f61d8c9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d40c7fd0 0x7f61d414f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43198/0 (socket says 172.21.15.88:43198) 2023-12-08T08:23:55.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.546+0000 7f61d8c9d640 1 -- 172.21.15.88:0/302517478 learned_addr learned my addr 172.21.15.88:0/302517478 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:55.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.546+0000 7f61d8c9d640 1 -- 172.21.15.88:0/302517478 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f61d4157e50 msgr2=0x7f61d4157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:55.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.546+0000 7f61d8c9d640 1 --2- 172.21.15.88:0/302517478 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f61d4157e50 0x7f61d4157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.546+0000 7f61d8c9d640 1 -- 172.21.15.88:0/302517478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61d4151b40 msgr2=0x7f61d414b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:55.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.546+0000 7f61d8c9d640 1 --2- 172.21.15.88:0/302517478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61d4151b40 0x7f61d414b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.546+0000 7f61d8c9d640 1 -- 172.21.15.88:0/302517478 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc009a70 con 0x7f61d40c7fd0 2023-12-08T08:23:55.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.546+0000 7f61d8c9d640 1 --2- 172.21.15.88:0/302517478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d40c7fd0 0x7f61d414f320 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f61d000c520 tx=0x7f61d000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:55.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.546+0000 7f61c97fa640 1 -- 172.21.15.88:0/302517478 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d00074e0 con 0x7f61d40c7fd0 2023-12-08T08:23:55.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.546+0000 7f61c97fa640 1 -- 172.21.15.88:0/302517478 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d0007640 con 0x7f61d40c7fd0 2023-12-08T08:23:55.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.546+0000 7f61d9c9f640 1 -- 172.21.15.88:0/302517478 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d4150fe0 con 0x7f61d40c7fd0 2023-12-08T08:23:55.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.546+0000 7f61c97fa640 1 -- 172.21.15.88:0/302517478 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d00049f0 con 0x7f61d40c7fd0 2023-12-08T08:23:55.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.546+0000 7f61d9c9f640 1 -- 172.21.15.88:0/302517478 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d41ed610 con 0x7f61d40c7fd0 2023-12-08T08:23:55.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.546+0000 7f61d9c9f640 1 -- 172.21.15.88:0/302517478 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d4067bc0 con 0x7f61d40c7fd0 2023-12-08T08:23:55.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.546+0000 7f61c97fa640 1 -- 172.21.15.88:0/302517478 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f61d0004b50 con 0x7f61d40c7fd0 2023-12-08T08:23:55.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.550+0000 7f61c97fa640 1 --2- 172.21.15.88:0/302517478 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f61c00664a0 0x7f61c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:55.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.550+0000 7f61c97fa640 1 -- 172.21.15.88:0/302517478 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f61d0083160 con 0x7f61d40c7fd0 2023-12-08T08:23:55.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.550+0000 7f61cbfff640 1 --2- 172.21.15.88:0/302517478 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f61c00664a0 0x7f61c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:55.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.550+0000 7f61cbfff640 1 --2- 172.21.15.88:0/302517478 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f61c00664a0 0x7f61c0068960 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f61d414eff0 tx=0x7f61c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:55.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.554+0000 7f61c97fa640 1 -- 172.21.15.88:0/302517478 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f61d0050610 con 0x7f61d40c7fd0 2023-12-08T08:23:55.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.710+0000 7f61d9c9f640 1 -- 172.21.15.88:0/302517478 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61d40c4970 con 0x7f61d40c7fd0 2023-12-08T08:23:55.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.710+0000 7f61c97fa640 1 -- 172.21.15.88:0/302517478 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16615 (secure 0 0 0) 0x7f61d0018090 con 0x7f61d40c7fd0 2023-12-08T08:23:55.715 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:23:55.715 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":75,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:23:52.625379+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:23:15.029129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:23:16.271716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6837/698349615":"2023-12-09T08:23:49.403962+0000","172.21.15.88:6836/698349615":"2023-12-09T08:23:49.403962+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:23:55.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.714+0000 7f61d9c9f640 1 -- 172.21.15.88:0/302517478 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f61c00664a0 msgr2=0x7f61c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:55.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.714+0000 7f61d9c9f640 1 --2- 172.21.15.88:0/302517478 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f61c00664a0 0x7f61c0068960 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f61d414eff0 tx=0x7f61c4008040 comp rx=0 tx=0).stop 2023-12-08T08:23:55.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.714+0000 7f61d9c9f640 1 -- 172.21.15.88:0/302517478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d40c7fd0 msgr2=0x7f61d414f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:55.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.714+0000 7f61d9c9f640 1 --2- 172.21.15.88:0/302517478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d40c7fd0 0x7f61d414f320 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f61d000c520 tx=0x7f61d000c9e0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.714+0000 7f61d9c9f640 1 -- 172.21.15.88:0/302517478 shutdown_connections 2023-12-08T08:23:55.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.714+0000 7f61d9c9f640 1 --2- 172.21.15.88:0/302517478 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f61c00664a0 0x7f61c0068960 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.714+0000 7f61d9c9f640 1 --2- 172.21.15.88:0/302517478 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f61d4157e50 0x7f61d4157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.714+0000 7f61d9c9f640 1 --2- 172.21.15.88:0/302517478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61d4151b40 0x7f61d414b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.714+0000 7f61d9c9f640 1 --2- 172.21.15.88:0/302517478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61d40c7fd0 0x7f61d414f320 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.714+0000 7f61d9c9f640 1 -- 172.21.15.88:0/302517478 >> 172.21.15.88:0/302517478 conn(0x7f61d4066470 msgr2=0x7f61d4066850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:55.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.714+0000 7f61d9c9f640 1 -- 172.21.15.88:0/302517478 shutdown_connections 2023-12-08T08:23:55.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.714+0000 7f61d9c9f640 1 -- 172.21.15.88:0/302517478 wait complete. 2023-12-08T08:23:55.737 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-12-08T08:23:55.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.870+0000 7fdee3217640 1 Processor -- start 2023-12-08T08:23:55.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.870+0000 7fdee3217640 1 -- start start 2023-12-08T08:23:55.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fdee3217640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdedc072810 0x7fdedc0c0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:55.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fdee3217640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdedc1524b0 con 0x7fdedc0a4f90 2023-12-08T08:23:55.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fdee3217640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdedc0c62f0 con 0x7fdedc0a5370 2023-12-08T08:23:55.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fdee3217640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc0c60d0 con 0x7fdedc072810 2023-12-08T08:23:55.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fdee0fb3640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdedc0a4f90 0x7fdedc0c59c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39776/0 (socket says 172.21.15.88:39776) 2023-12-08T08:23:55.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fdee0fb3640 1 -- 172.21.15.88:0/572229117 learned_addr learned my addr 172.21.15.88:0/572229117 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:55.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fdee17b4640 1 --2- 172.21.15.88:0/572229117 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdedc072810 0x7fdedc0c0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:55.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fded37fe640 1 -- 172.21.15.88:0/572229117 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895314245 0 0) 0x7fdedc1524b0 con 0x7fdedc0a4f90 2023-12-08T08:23:55.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fded37fe640 1 -- 172.21.15.88:0/572229117 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdec4003530 con 0x7fdedc0a4f90 2023-12-08T08:23:55.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fded37fe640 1 -- 172.21.15.88:0/572229117 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1406495836 0 0) 0x7fdec4003530 con 0x7fdedc0a4f90 2023-12-08T08:23:55.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fded37fe640 1 -- 172.21.15.88:0/572229117 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdedc072810 msgr2=0x7fdedc0c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:55.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fded37fe640 1 --2- 172.21.15.88:0/572229117 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdedc072810 0x7fdedc0c0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fded37fe640 1 -- 172.21.15.88:0/572229117 >> v1:172.21.15.148:6789/0 conn(0x7fdedc0a5370 legacy=0x7fdedc14f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:55.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fded37fe640 1 -- 172.21.15.88:0/572229117 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdedc152770 con 0x7fdedc0a4f90 2023-12-08T08:23:55.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fded37fe640 1 -- 172.21.15.88:0/572229117 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7fded8001680 con 0x7fdedc0a4f90 2023-12-08T08:23:55.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fded37fe640 1 -- 172.21.15.88:0/572229117 >> v1:172.21.15.88:6789/0 conn(0x7fdedc0a4f90 legacy=0x7fdedc0c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:55.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fded37fe640 1 --2- 172.21.15.88:0/572229117 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdedc072810 0x7fdec40039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:55.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fded37fe640 1 --2- 172.21.15.88:0/572229117 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdec4003fa0 0x7fdec40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:55.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fded37fe640 1 --2- 172.21.15.88:0/572229117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdec4004d10 0x7fdec4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:55.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fded37fe640 1 -- 172.21.15.88:0/572229117 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc0c60d0 con 0x7fdec4003fa0 2023-12-08T08:23:55.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fded37fe640 1 -- 172.21.15.88:0/572229117 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec400bb80 con 0x7fdec4004d10 2023-12-08T08:23:55.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fded37fe640 1 -- 172.21.15.88:0/572229117 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec400bd40 con 0x7fdedc072810 2023-12-08T08:23:55.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fded3fff640 1 --2- 172.21.15.88:0/572229117 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdec4003fa0 0x7fdec40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:55.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fdee17b4640 1 --2- 172.21.15.88:0/572229117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdec4004d10 0x7fdec4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:55.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fdee0fb3640 1 --2- 172.21.15.88:0/572229117 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdedc072810 0x7fdec40039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:55.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fded3fff640 1 -- 172.21.15.88:0/572229117 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdedc072810 msgr2=0x7fdec40039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:55.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fded3fff640 1 --2- 172.21.15.88:0/572229117 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdedc072810 0x7fdec40039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fded3fff640 1 -- 172.21.15.88:0/572229117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdec4004d10 msgr2=0x7fdec4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:55.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fded3fff640 1 --2- 172.21.15.88:0/572229117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdec4004d10 0x7fdec4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.874+0000 7fded3fff640 1 -- 172.21.15.88:0/572229117 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec4003530 con 0x7fdec4003fa0 2023-12-08T08:23:55.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.878+0000 7fded3fff640 1 --2- 172.21.15.88:0/572229117 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdec4003fa0 0x7fdec40047d0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fdecc001780 tx=0x7fdecc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=566b389058f1aa83 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:55.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.878+0000 7fded37fe640 1 -- 172.21.15.88:0/572229117 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc0052d0 con 0x7fdec4003fa0 2023-12-08T08:23:55.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.878+0000 7fded37fe640 1 -- 172.21.15.88:0/572229117 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdecc0a7050 con 0x7fdec4003fa0 2023-12-08T08:23:55.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.878+0000 7fded37fe640 1 -- 172.21.15.88:0/572229117 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc003600 con 0x7fdec4003fa0 2023-12-08T08:23:55.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.878+0000 7fdee3217640 1 -- 172.21.15.88:0/572229117 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdec4003fa0 msgr2=0x7fdec40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:55.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.878+0000 7fdee3217640 1 --2- 172.21.15.88:0/572229117 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdec4003fa0 0x7fdec40047d0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fdecc001780 tx=0x7fdecc01c400 comp rx=0 tx=0).stop 2023-12-08T08:23:55.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.878+0000 7fdee17b4640 1 -- 172.21.15.88:0/572229117 reap_dead start 2023-12-08T08:23:55.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.878+0000 7fdee3217640 1 -- 172.21.15.88:0/572229117 shutdown_connections 2023-12-08T08:23:55.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.878+0000 7fdee3217640 1 -- 172.21.15.88:0/572229117 >> 172.21.15.88:0/572229117 conn(0x7fdedc06b220 msgr2=0x7fdedc0a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:55.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.878+0000 7fdee3217640 1 -- 172.21.15.88:0/572229117 shutdown_connections 2023-12-08T08:23:55.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.878+0000 7fdee3217640 1 -- 172.21.15.88:0/572229117 wait complete. 2023-12-08T08:23:55.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.882+0000 7fdee3217640 1 Processor -- start 2023-12-08T08:23:55.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.882+0000 7fdee3217640 1 -- start start 2023-12-08T08:23:55.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.882+0000 7fdee3217640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdec4003fa0 0x7fdedc1553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:55.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.882+0000 7fdee3217640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdedc1558f0 0x7fdedc0a97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:55.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.882+0000 7fdee3217640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdedc0a9d30 0x7fdedc14e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:55.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.882+0000 7fdee3217640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc1edc50 con 0x7fdedc1558f0 2023-12-08T08:23:55.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.882+0000 7fdee3217640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc1ee180 con 0x7fdedc0a9d30 2023-12-08T08:23:55.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.882+0000 7fdee3217640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc0bfbc0 con 0x7fdec4003fa0 2023-12-08T08:23:55.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.882+0000 7fded3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdedc1558f0 0x7fdedc0a97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:55.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.882+0000 7fded3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdedc1558f0 0x7fdedc0a97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43212/0 (socket says 172.21.15.88:43212) 2023-12-08T08:23:55.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.882+0000 7fded3fff640 1 -- 172.21.15.88:0/3359864971 learned_addr learned my addr 172.21.15.88:0/3359864971 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:55.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.882+0000 7fdee0fb3640 1 --2- 172.21.15.88:0/3359864971 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdec4003fa0 0x7fdedc1553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:55.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.882+0000 7fdee17b4640 1 --2- 172.21.15.88:0/3359864971 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdedc0a9d30 0x7fdedc14e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:55.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.882+0000 7fded3fff640 1 -- 172.21.15.88:0/3359864971 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdec4003fa0 msgr2=0x7fdedc1553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:55.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.882+0000 7fded3fff640 1 --2- 172.21.15.88:0/3359864971 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdec4003fa0 0x7fdedc1553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.882+0000 7fded3fff640 1 -- 172.21.15.88:0/3359864971 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdedc0a9d30 msgr2=0x7fdedc14e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:55.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.882+0000 7fded3fff640 1 --2- 172.21.15.88:0/3359864971 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdedc0a9d30 0x7fdedc14e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:55.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.882+0000 7fded3fff640 1 -- 172.21.15.88:0/3359864971 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdedc1edea0 con 0x7fdedc1558f0 2023-12-08T08:23:55.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.882+0000 7fded3fff640 1 --2- 172.21.15.88:0/3359864971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdedc1558f0 0x7fdedc0a97f0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fdecc001780 tx=0x7fdec4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:55.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.882+0000 7fded17fa640 1 -- 172.21.15.88:0/3359864971 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc007180 con 0x7fdedc1558f0 2023-12-08T08:23:55.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.882+0000 7fded17fa640 1 -- 172.21.15.88:0/3359864971 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdecc0072e0 con 0x7fdedc1558f0 2023-12-08T08:23:55.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.882+0000 7fded17fa640 1 -- 172.21.15.88:0/3359864971 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc007650 con 0x7fdedc1558f0 2023-12-08T08:23:55.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.882+0000 7fdee3217640 1 -- 172.21.15.88:0/3359864971 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdedc0a8d10 con 0x7fdedc1558f0 2023-12-08T08:23:55.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.882+0000 7fdee3217640 1 -- 172.21.15.88:0/3359864971 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdedc0a92d0 con 0x7fdedc1558f0 2023-12-08T08:23:55.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.882+0000 7fdee3217640 1 -- 172.21.15.88:0/3359864971 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdedc067630 con 0x7fdedc1558f0 2023-12-08T08:23:55.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.886+0000 7fded17fa640 1 -- 172.21.15.88:0/3359864971 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdecc0067e0 con 0x7fdedc1558f0 2023-12-08T08:23:55.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.886+0000 7fded17fa640 1 --2- 172.21.15.88:0/3359864971 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdec8066470 0x7fdec8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:55.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.886+0000 7fded17fa640 1 -- 172.21.15.88:0/3359864971 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fdecc11e1b0 con 0x7fdedc1558f0 2023-12-08T08:23:55.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.886+0000 7fdee0fb3640 1 --2- 172.21.15.88:0/3359864971 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdec8066470 0x7fdec8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:55.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.886+0000 7fdee0fb3640 1 --2- 172.21.15.88:0/3359864971 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdec8066470 0x7fdec8068930 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fdedc0c55c0 tx=0x7fded8000bd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:55.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:55.890+0000 7fded17fa640 1 -- 172.21.15.88:0/3359864971 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdecc0eb790 con 0x7fdedc1558f0 2023-12-08T08:23:56.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.070+0000 7fdee3217640 1 -- 172.21.15.88:0/3359864971 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7fdedc0c1df0 con 0x7fdedc1558f0 2023-12-08T08:23:56.075 INFO:tasks.ceph.mon.a.smithi088.stderr:2023-12-08T08:23:56.070+0000 7f9f56907640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-08T08:23:56.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.074+0000 7fded17fa640 1 -- 172.21.15.88:0/3359864971 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v55) v1 ==== 163+0+0 (secure 0 0 0) 0x7fdecc0eedb0 con 0x7fdedc1558f0 2023-12-08T08:23:56.079 INFO:teuthology.orchestra.run.smithi088.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-08T08:23:56.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.078+0000 7fdee3217640 1 -- 172.21.15.88:0/3359864971 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdec8066470 msgr2=0x7fdec8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:56.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.078+0000 7fdee3217640 1 --2- 172.21.15.88:0/3359864971 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdec8066470 0x7fdec8068930 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fdedc0c55c0 tx=0x7fded8000bd0 comp rx=0 tx=0).stop 2023-12-08T08:23:56.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.078+0000 7fdee3217640 1 -- 172.21.15.88:0/3359864971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdedc1558f0 msgr2=0x7fdedc0a97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:56.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.078+0000 7fdee3217640 1 --2- 172.21.15.88:0/3359864971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdedc1558f0 0x7fdedc0a97f0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fdecc001780 tx=0x7fdec4005800 comp rx=0 tx=0).stop 2023-12-08T08:23:56.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.078+0000 7fdee3217640 1 -- 172.21.15.88:0/3359864971 shutdown_connections 2023-12-08T08:23:56.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.078+0000 7fdee3217640 1 --2- 172.21.15.88:0/3359864971 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdec8066470 0x7fdec8068930 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:56.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.078+0000 7fdee3217640 1 --2- 172.21.15.88:0/3359864971 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdedc0a9d30 0x7fdedc14e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:56.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.078+0000 7fdee3217640 1 --2- 172.21.15.88:0/3359864971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdedc1558f0 0x7fdedc0a97f0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:56.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.078+0000 7fdee3217640 1 --2- 172.21.15.88:0/3359864971 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdec4003fa0 0x7fdedc1553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:56.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.078+0000 7fdee3217640 1 -- 172.21.15.88:0/3359864971 >> 172.21.15.88:0/3359864971 conn(0x7fdedc06b220 msgr2=0x7fdedc151dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:56.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.078+0000 7fdee3217640 1 -- 172.21.15.88:0/3359864971 shutdown_connections 2023-12-08T08:23:56.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.078+0000 7fdee3217640 1 -- 172.21.15.88:0/3359864971 wait complete. 2023-12-08T08:23:56.095 INFO:tasks.ceph.mds.a.smithi088.stderr: -4659> 2023-12-08T08:23:20.234+0000 7f85c5108640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:23:56.111 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-12-08T08:23:56.149 INFO:tasks.ceph.mds.a.smithi088.stdout:starting mds.a at 2023-12-08T08:23:56.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.250+0000 7fadc8c32640 1 Processor -- start 2023-12-08T08:23:56.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.250+0000 7fadc8c32640 1 -- start start 2023-12-08T08:23:56.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.250+0000 7fadc8c32640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc40c98f0 0x7fadc40c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:56.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.250+0000 7fadc8c32640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc4158780 con 0x7fadc40c6030 2023-12-08T08:23:56.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.250+0000 7fadc8c32640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc40c8910 con 0x7fadc40bf2d0 2023-12-08T08:23:56.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.250+0000 7fadc8c32640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc40c0300 con 0x7fadc40c98f0 2023-12-08T08:23:56.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.250+0000 7fadbbfff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fadc40c6030 0x7fadc40c7cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39796/0 (socket says 172.21.15.88:39796) 2023-12-08T08:23:56.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.250+0000 7fadbbfff640 1 -- 172.21.15.88:0/52605209 learned_addr learned my addr 172.21.15.88:0/52605209 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:56.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.250+0000 7fadc2d9d640 1 --2- 172.21.15.88:0/52605209 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc40c98f0 0x7fadc40c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:56.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.250+0000 7fadc1d9b640 1 -- 172.21.15.88:0/52605209 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538556516 0 0) 0x7fadc4158780 con 0x7fadc40c6030 2023-12-08T08:23:56.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.250+0000 7fadc1d9b640 1 -- 172.21.15.88:0/52605209 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadb0003530 con 0x7fadc40c6030 2023-12-08T08:23:56.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.250+0000 7fadc2d9d640 1 -- 172.21.15.88:0/52605209 >> v1:172.21.15.148:6789/0 conn(0x7fadc40bf2d0 legacy=0x7fadc4151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:56.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.250+0000 7fadc1d9b640 1 -- 172.21.15.88:0/52605209 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3805732896 0 0) 0x7fadc40c8910 con 0x7fadc40bf2d0 2023-12-08T08:23:56.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.250+0000 7fadc2d9d640 1 -- 172.21.15.88:0/52605209 >> v1:172.21.15.88:6789/0 conn(0x7fadc40c6030 legacy=0x7fadc40c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:56.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.250+0000 7fadc2d9d640 1 -- 172.21.15.88:0/52605209 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc4157b70 con 0x7fadc40c98f0 2023-12-08T08:23:56.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.254+0000 7fadc2d9d640 1 --2- 172.21.15.88:0/52605209 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc40c98f0 0x7fadc40c83d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fadbc009dc0 tx=0x7fadbc01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3387cf15643a94df server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:56.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.254+0000 7fadc1d9b640 1 -- 172.21.15.88:0/52605209 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc0a5a00 con 0x7fadc40c98f0 2023-12-08T08:23:56.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.254+0000 7fadc1d9b640 1 -- 172.21.15.88:0/52605209 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadbc0a5b60 con 0x7fadc40c98f0 2023-12-08T08:23:56.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.254+0000 7fadc1d9b640 1 -- 172.21.15.88:0/52605209 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc0ad440 con 0x7fadc40c98f0 2023-12-08T08:23:56.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.254+0000 7fadc8c32640 1 -- 172.21.15.88:0/52605209 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc40c98f0 msgr2=0x7fadc40c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:56.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.254+0000 7fadc8c32640 1 --2- 172.21.15.88:0/52605209 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc40c98f0 0x7fadc40c83d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fadbc009dc0 tx=0x7fadbc01c940 comp rx=0 tx=0).stop 2023-12-08T08:23:56.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.254+0000 7fadc8c32640 1 -- 172.21.15.88:0/52605209 shutdown_connections 2023-12-08T08:23:56.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.254+0000 7fadc8c32640 1 --2- 172.21.15.88:0/52605209 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc40c98f0 0x7fadc40c83d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:56.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.254+0000 7fadc8c32640 1 -- 172.21.15.88:0/52605209 >> 172.21.15.88:0/52605209 conn(0x7fadc40c9dc0 msgr2=0x7fadc40ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:56.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.254+0000 7fadc8c32640 1 -- 172.21.15.88:0/52605209 shutdown_connections 2023-12-08T08:23:56.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.254+0000 7fadc8c32640 1 -- 172.21.15.88:0/52605209 wait complete. 2023-12-08T08:23:56.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.258+0000 7fadc8c32640 1 Processor -- start 2023-12-08T08:23:56.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.258+0000 7fadc8c32640 1 -- start start 2023-12-08T08:23:56.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.258+0000 7fadc8c32640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc40bf2d0 0x7fadc40adac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:56.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.258+0000 7fadc8c32640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc40c6030 0x7fadc40af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:56.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.258+0000 7fadc8c32640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadc40c98f0 0x7fadc40a9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:56.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.258+0000 7fadc8c32640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc40aef50 con 0x7fadc40c98f0 2023-12-08T08:23:56.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.258+0000 7fadc8c32640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc413d240 con 0x7fadc40c6030 2023-12-08T08:23:56.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.258+0000 7fadc8c32640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc4148f20 con 0x7fadc40bf2d0 2023-12-08T08:23:56.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.258+0000 7fadc2d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadc40c98f0 0x7fadc40a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:56.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.258+0000 7fadc2d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadc40c98f0 0x7fadc40a9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43234/0 (socket says 172.21.15.88:43234) 2023-12-08T08:23:56.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.258+0000 7fadc2d9d640 1 -- 172.21.15.88:0/3317319798 learned_addr learned my addr 172.21.15.88:0/3317319798 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:56.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.258+0000 7fadbbfff640 1 --2- 172.21.15.88:0/3317319798 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc40c6030 0x7fadc40af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:56.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.258+0000 7fadc259c640 1 --2- 172.21.15.88:0/3317319798 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc40bf2d0 0x7fadc40adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:56.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.258+0000 7fadc2d9d640 1 -- 172.21.15.88:0/3317319798 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc40bf2d0 msgr2=0x7fadc40adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:56.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.258+0000 7fadc2d9d640 1 --2- 172.21.15.88:0/3317319798 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc40bf2d0 0x7fadc40adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:56.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.258+0000 7fadc2d9d640 1 -- 172.21.15.88:0/3317319798 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc40c6030 msgr2=0x7fadc40af5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:56.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.258+0000 7fadc2d9d640 1 --2- 172.21.15.88:0/3317319798 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc40c6030 0x7fadc40af5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:56.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.258+0000 7fadc2d9d640 1 -- 172.21.15.88:0/3317319798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadbc009a70 con 0x7fadc40c98f0 2023-12-08T08:23:56.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.258+0000 7fadc2d9d640 1 --2- 172.21.15.88:0/3317319798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadc40c98f0 0x7fadc40a9860 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fadbc0b0040 tx=0x7fadbc0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:56.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.258+0000 7fadbaffd640 1 -- 172.21.15.88:0/3317319798 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc0add50 con 0x7fadc40c98f0 2023-12-08T08:23:56.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.258+0000 7fadbaffd640 1 -- 172.21.15.88:0/3317319798 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadbc009450 con 0x7fadc40c98f0 2023-12-08T08:23:56.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.258+0000 7fadc8c32640 1 -- 172.21.15.88:0/3317319798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc4149200 con 0x7fadc40c98f0 2023-12-08T08:23:56.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.258+0000 7fadbaffd640 1 -- 172.21.15.88:0/3317319798 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc003bc0 con 0x7fadc40c98f0 2023-12-08T08:23:56.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.262+0000 7fadc8c32640 1 -- 172.21.15.88:0/3317319798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc41497c0 con 0x7fadc40c98f0 2023-12-08T08:23:56.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.262+0000 7fadc8c32640 1 -- 172.21.15.88:0/3317319798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc40ab130 con 0x7fadc40c98f0 2023-12-08T08:23:56.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.262+0000 7fadbaffd640 1 -- 172.21.15.88:0/3317319798 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fadbc0b4050 con 0x7fadc40c98f0 2023-12-08T08:23:56.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.262+0000 7fadbaffd640 1 --2- 172.21.15.88:0/3317319798 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fada4066470 0x7fada4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:56.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.262+0000 7fadbaffd640 1 -- 172.21.15.88:0/3317319798 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5885+0+0 (secure 0 0 0) 0x7fadbc11f320 con 0x7fadc40c98f0 2023-12-08T08:23:56.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.262+0000 7fadc259c640 1 --2- 172.21.15.88:0/3317319798 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fada4066470 0x7fada4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:56.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.262+0000 7fadc259c640 1 --2- 172.21.15.88:0/3317319798 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fada4066470 0x7fada4068930 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fadb4007fd0 tx=0x7fadb4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:56.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.266+0000 7fadbaffd640 1 -- 172.21.15.88:0/3317319798 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fadbc0ec8b0 con 0x7fadc40c98f0 2023-12-08T08:23:56.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:56.450+0000 7fadc8c32640 1 -- 172.21.15.88:0/3317319798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fadc41499b0 con 0x7fadc40c98f0 2023-12-08T08:23:57.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.078+0000 7fadbaffd640 1 -- 172.21.15.88:0/3317319798 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v56) v1 ==== 105+0+0 (secure 0 0 0) 0x7fadbc0efed0 con 0x7fadc40c98f0 2023-12-08T08:23:57.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.082+0000 7fadc8c32640 1 -- 172.21.15.88:0/3317319798 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fada4066470 msgr2=0x7fada4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:57.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.082+0000 7fadc8c32640 1 --2- 172.21.15.88:0/3317319798 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fada4066470 0x7fada4068930 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fadb4007fd0 tx=0x7fadb4009040 comp rx=0 tx=0).stop 2023-12-08T08:23:57.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.082+0000 7fadc8c32640 1 -- 172.21.15.88:0/3317319798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadc40c98f0 msgr2=0x7fadc40a9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:57.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.082+0000 7fadc8c32640 1 --2- 172.21.15.88:0/3317319798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadc40c98f0 0x7fadc40a9860 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fadbc0b0040 tx=0x7fadbc0196e0 comp rx=0 tx=0).stop 2023-12-08T08:23:57.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.082+0000 7fadc8c32640 1 -- 172.21.15.88:0/3317319798 shutdown_connections 2023-12-08T08:23:57.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.082+0000 7fadc8c32640 1 --2- 172.21.15.88:0/3317319798 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fada4066470 0x7fada4068930 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:57.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.082+0000 7fadc8c32640 1 --2- 172.21.15.88:0/3317319798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadc40c98f0 0x7fadc40a9860 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:57.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.082+0000 7fadc8c32640 1 --2- 172.21.15.88:0/3317319798 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadc40c6030 0x7fadc40af5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:57.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.082+0000 7fadc8c32640 1 --2- 172.21.15.88:0/3317319798 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fadc40bf2d0 0x7fadc40adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:57.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.082+0000 7fadc8c32640 1 -- 172.21.15.88:0/3317319798 >> 172.21.15.88:0/3317319798 conn(0x7fadc40c9dc0 msgr2=0x7fadc40c8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:57.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.082+0000 7fadc8c32640 1 -- 172.21.15.88:0/3317319798 shutdown_connections 2023-12-08T08:23:57.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.082+0000 7fadc8c32640 1 -- 172.21.15.88:0/3317319798 wait complete. 2023-12-08T08:23:57.108 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-12-08T08:23:57.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.286+0000 7fe4f67ec640 1 Processor -- start 2023-12-08T08:23:57.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.286+0000 7fe4f67ec640 1 -- start start 2023-12-08T08:23:57.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.290+0000 7fe4f67ec640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe4f0159c40 0x7fe4f015c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:57.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.290+0000 7fe4f67ec640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f00a4e20 con 0x7fe4f00c5300 2023-12-08T08:23:57.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.290+0000 7fe4f67ec640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f00a50e0 con 0x7fe4f014b1e0 2023-12-08T08:23:57.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.290+0000 7fe4f67ec640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f01558d0 con 0x7fe4f0159c40 2023-12-08T08:23:57.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.290+0000 7fe4f4d89640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe4f0159c40 0x7fe4f015c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:57.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.290+0000 7fe4f4d89640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe4f0159c40 0x7fe4f015c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43240/0 (socket says 172.21.15.88:43240) 2023-12-08T08:23:57.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.290+0000 7fe4f4d89640 1 -- 172.21.15.88:0/395023325 learned_addr learned my addr 172.21.15.88:0/395023325 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:57.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.290+0000 7fe4ef7fe640 1 --1- 172.21.15.88:0/395023325 >> v1:172.21.15.88:6789/0 conn(0x7fe4f00c5300 0x7fe4f00a9c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39806/0 (socket says 172.21.15.88:39806) 2023-12-08T08:23:57.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.290+0000 7fe4f4d89640 1 -- 172.21.15.88:0/395023325 >> v1:172.21.15.148:6789/0 conn(0x7fe4f014b1e0 legacy=0x7fe4f00c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:57.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.290+0000 7fe4f4d89640 1 -- 172.21.15.88:0/395023325 >> v1:172.21.15.88:6789/0 conn(0x7fe4f00c5300 legacy=0x7fe4f00a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:57.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.290+0000 7fe4f4d89640 1 -- 172.21.15.88:0/395023325 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f00c0f00 con 0x7fe4f0159c40 2023-12-08T08:23:57.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.294+0000 7fe4f4d89640 1 --2- 172.21.15.88:0/395023325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4f0159c40 0x7fe4f015c030 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fe4f00a5010 tx=0x7fe4e801ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b548b1c89a2264 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:57.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.294+0000 7fe4eeffd640 1 -- 172.21.15.88:0/395023325 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e80a78e0 con 0x7fe4f0159c40 2023-12-08T08:23:57.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.294+0000 7fe4eeffd640 1 -- 172.21.15.88:0/395023325 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e80a7a40 con 0x7fe4f0159c40 2023-12-08T08:23:57.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.294+0000 7fe4eeffd640 1 -- 172.21.15.88:0/395023325 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e80a7dd0 con 0x7fe4f0159c40 2023-12-08T08:23:57.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.294+0000 7fe4f67ec640 1 -- 172.21.15.88:0/395023325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4f0159c40 msgr2=0x7fe4f015c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:57.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.294+0000 7fe4f67ec640 1 --2- 172.21.15.88:0/395023325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4f0159c40 0x7fe4f015c030 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fe4f00a5010 tx=0x7fe4e801ec00 comp rx=0 tx=0).stop 2023-12-08T08:23:57.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.294+0000 7fe4f67ec640 1 -- 172.21.15.88:0/395023325 shutdown_connections 2023-12-08T08:23:57.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.294+0000 7fe4f67ec640 1 --2- 172.21.15.88:0/395023325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4f0159c40 0x7fe4f015c030 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:57.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.294+0000 7fe4f67ec640 1 -- 172.21.15.88:0/395023325 >> 172.21.15.88:0/395023325 conn(0x7fe4f00c59f0 msgr2=0x7fe4f00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:57.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.294+0000 7fe4f67ec640 1 -- 172.21.15.88:0/395023325 shutdown_connections 2023-12-08T08:23:57.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.294+0000 7fe4f67ec640 1 -- 172.21.15.88:0/395023325 wait complete. 2023-12-08T08:23:57.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.294+0000 7fe4f67ec640 1 Processor -- start 2023-12-08T08:23:57.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.294+0000 7fe4f67ec640 1 -- start start 2023-12-08T08:23:57.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.298+0000 7fe4f67ec640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4f00c5300 0x7fe4f0154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:57.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.298+0000 7fe4f67ec640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4f014b1e0 0x7fe4f0154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:57.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.298+0000 7fe4f67ec640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4f0159c40 0x7fe4f01ec0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:57.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.298+0000 7fe4f67ec640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f0150720 con 0x7fe4f0159c40 2023-12-08T08:23:57.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.298+0000 7fe4f67ec640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f0155500 con 0x7fe4f00c5300 2023-12-08T08:23:57.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.298+0000 7fe4f67ec640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f015af10 con 0x7fe4f014b1e0 2023-12-08T08:23:57.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.298+0000 7fe4f4d89640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4f0159c40 0x7fe4f01ec0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:57.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.298+0000 7fe4f4d89640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4f0159c40 0x7fe4f01ec0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43248/0 (socket says 172.21.15.88:43248) 2023-12-08T08:23:57.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.298+0000 7fe4f4d89640 1 -- 172.21.15.88:0/2636135811 learned_addr learned my addr 172.21.15.88:0/2636135811 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:57.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.298+0000 7fe4f4d89640 1 -- 172.21.15.88:0/2636135811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4f014b1e0 msgr2=0x7fe4f0154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:57.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.298+0000 7fe4ef7fe640 1 --2- 172.21.15.88:0/2636135811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4f014b1e0 0x7fe4f0154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:57.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.298+0000 7fe4effff640 1 --2- 172.21.15.88:0/2636135811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4f00c5300 0x7fe4f0154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:57.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.298+0000 7fe4f4d89640 1 --2- 172.21.15.88:0/2636135811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4f014b1e0 0x7fe4f0154fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:57.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.298+0000 7fe4f4d89640 1 -- 172.21.15.88:0/2636135811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4f00c5300 msgr2=0x7fe4f0154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:57.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.298+0000 7fe4f4d89640 1 --2- 172.21.15.88:0/2636135811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4f00c5300 0x7fe4f0154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:57.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.298+0000 7fe4f4d89640 1 -- 172.21.15.88:0/2636135811 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e8009b30 con 0x7fe4f0159c40 2023-12-08T08:23:57.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.298+0000 7fe4ef7fe640 1 --2- 172.21.15.88:0/2636135811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4f014b1e0 0x7fe4f0154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:57.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.298+0000 7fe4effff640 1 --2- 172.21.15.88:0/2636135811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4f00c5300 0x7fe4f0154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:57.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.298+0000 7fe4f4d89640 1 --2- 172.21.15.88:0/2636135811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4f0159c40 0x7fe4f01ec0f0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80b1040 tx=0x7fe4e801b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:57.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.298+0000 7fe4ecff9640 1 -- 172.21.15.88:0/2636135811 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e80ba850 con 0x7fe4f0159c40 2023-12-08T08:23:57.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.298+0000 7fe4ecff9640 1 -- 172.21.15.88:0/2636135811 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e80ba9b0 con 0x7fe4f0159c40 2023-12-08T08:23:57.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.298+0000 7fe4f67ec640 1 -- 172.21.15.88:0/2636135811 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f015b1f0 con 0x7fe4f0159c40 2023-12-08T08:23:57.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.298+0000 7fe4ecff9640 1 -- 172.21.15.88:0/2636135811 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e80bad60 con 0x7fe4f0159c40 2023-12-08T08:23:57.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.298+0000 7fe4f67ec640 1 -- 172.21.15.88:0/2636135811 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f015b7b0 con 0x7fe4f0159c40 2023-12-08T08:23:57.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.298+0000 7fe4f67ec640 1 -- 172.21.15.88:0/2636135811 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f0150890 con 0x7fe4f0159c40 2023-12-08T08:23:57.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.298+0000 7fe4ecff9640 1 -- 172.21.15.88:0/2636135811 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe4e80b8410 con 0x7fe4f0159c40 2023-12-08T08:23:57.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.302+0000 7fe4ecff9640 1 --2- 172.21.15.88:0/2636135811 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe4dc066470 0x7fe4dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:57.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.302+0000 7fe4ecff9640 1 -- 172.21.15.88:0/2636135811 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5885+0+0 (secure 0 0 0) 0x7fe4f014b7d0 con 0x7fe4f0159c40 2023-12-08T08:23:57.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.302+0000 7fe4effff640 1 --2- 172.21.15.88:0/2636135811 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe4dc066470 0x7fe4dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:57.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.302+0000 7fe4effff640 1 --2- 172.21.15.88:0/2636135811 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe4dc066470 0x7fe4dc068930 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe4e00016f0 tx=0x7fe4e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:57.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.306+0000 7fe4ecff9640 1 -- 172.21.15.88:0/2636135811 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe4e80eecb0 con 0x7fe4f0159c40 2023-12-08T08:23:57.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:57.454+0000 7fe4f67ec640 1 -- 172.21.15.88:0/2636135811 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe4f0067630 con 0x7fe4f0159c40 2023-12-08T08:23:58.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.082+0000 7fe4ecff9640 1 -- 172.21.15.88:0/2636135811 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v77) v1 ==== 184+0+0 (secure 0 0 0) 0x7fe4e80f22d0 con 0x7fe4f0159c40 2023-12-08T08:23:58.086 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs2_metadata' removed 2023-12-08T08:23:58.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.082+0000 7fe4f67ec640 1 -- 172.21.15.88:0/2636135811 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe4dc066470 msgr2=0x7fe4dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:58.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.082+0000 7fe4f67ec640 1 --2- 172.21.15.88:0/2636135811 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe4dc066470 0x7fe4dc068930 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe4e00016f0 tx=0x7fe4e0009040 comp rx=0 tx=0).stop 2023-12-08T08:23:58.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.082+0000 7fe4f67ec640 1 -- 172.21.15.88:0/2636135811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4f0159c40 msgr2=0x7fe4f01ec0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:58.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.082+0000 7fe4f67ec640 1 --2- 172.21.15.88:0/2636135811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4f0159c40 0x7fe4f01ec0f0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80b1040 tx=0x7fe4e801b9a0 comp rx=0 tx=0).stop 2023-12-08T08:23:58.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.082+0000 7fe4f67ec640 1 -- 172.21.15.88:0/2636135811 shutdown_connections 2023-12-08T08:23:58.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.082+0000 7fe4f67ec640 1 --2- 172.21.15.88:0/2636135811 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe4dc066470 0x7fe4dc068930 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:58.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.082+0000 7fe4f67ec640 1 --2- 172.21.15.88:0/2636135811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4f0159c40 0x7fe4f01ec0f0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:58.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.082+0000 7fe4f67ec640 1 --2- 172.21.15.88:0/2636135811 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe4f014b1e0 0x7fe4f0154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:58.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.082+0000 7fe4f67ec640 1 --2- 172.21.15.88:0/2636135811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4f00c5300 0x7fe4f0154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:58.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.082+0000 7fe4f67ec640 1 -- 172.21.15.88:0/2636135811 >> 172.21.15.88:0/2636135811 conn(0x7fe4f00c59f0 msgr2=0x7fe4f0148d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:58.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.086+0000 7fe4f67ec640 1 -- 172.21.15.88:0/2636135811 shutdown_connections 2023-12-08T08:23:58.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.086+0000 7fe4f67ec640 1 -- 172.21.15.88:0/2636135811 wait complete. 2023-12-08T08:23:58.112 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-12-08T08:23:58.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.250+0000 7f646ece3640 1 Processor -- start 2023-12-08T08:23:58.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.250+0000 7f646ece3640 1 -- start start 2023-12-08T08:23:58.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.250+0000 7f646ece3640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f64680bed60 0x7f64680bf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:58.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.250+0000 7f646ece3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64680c4b20 0x7f64681585d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:58.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.250+0000 7f646ece3640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6468157b80 con 0x7f64680a4f30 2023-12-08T08:23:58.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.250+0000 7f646ece3640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6468158b10 con 0x7f64680bed60 2023-12-08T08:23:58.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.250+0000 7f646ece3640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646806d6c0 con 0x7f64680c4b20 2023-12-08T08:23:58.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.250+0000 7f646d280640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64680c4b20 0x7f64681585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:58.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.250+0000 7f646ca7f640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f64680bed60 0x7f64680bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:58.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.250+0000 7f646d280640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64680c4b20 0x7f64681585d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:40226/0 (socket says 172.21.15.88:40226) 2023-12-08T08:23:58.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.250+0000 7f6467fff640 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f64680a4f30 0x7f6468154590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.88:39474/0 (socket says 172.21.15.88:39474) 2023-12-08T08:23:58.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.250+0000 7f646d280640 1 -- 172.21.15.88:0/221677877 learned_addr learned my addr 172.21.15.88:0/221677877 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:58.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.250+0000 7f64677fe640 1 -- 172.21.15.88:0/221677877 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1436092638 0 0) 0x7f6468157b80 con 0x7f64680a4f30 2023-12-08T08:23:58.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.250+0000 7f64677fe640 1 -- 172.21.15.88:0/221677877 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6458003530 con 0x7f64680a4f30 2023-12-08T08:23:58.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.250+0000 7f646ca7f640 1 -- 172.21.15.88:0/221677877 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64680c4b20 msgr2=0x7f64681585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:58.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.250+0000 7f646ca7f640 1 --2- 172.21.15.88:0/221677877 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64680c4b20 0x7f64681585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:58.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.250+0000 7f646ca7f640 1 -- 172.21.15.88:0/221677877 >> v1:172.21.15.148:6789/0 conn(0x7f64680a4f30 legacy=0x7f6468154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:58.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.250+0000 7f646ca7f640 1 -- 172.21.15.88:0/221677877 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646806d960 con 0x7f64680bed60 2023-12-08T08:23:58.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.250+0000 7f646d280640 1 --2- 172.21.15.88:0/221677877 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64680c4b20 0x7f64681585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:23:58.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.254+0000 7f646ca7f640 1 --2- 172.21.15.88:0/221677877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64680bed60 0x7f64680bf140 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f645c0097c0 tx=0x7f645c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d21b2f70a525b006 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:58.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.254+0000 7f64677fe640 1 -- 172.21.15.88:0/221677877 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c0ab600 con 0x7f64680bed60 2023-12-08T08:23:58.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.254+0000 7f64677fe640 1 -- 172.21.15.88:0/221677877 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c0a7050 con 0x7f64680bed60 2023-12-08T08:23:58.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.254+0000 7f64677fe640 1 -- 172.21.15.88:0/221677877 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c0ab980 con 0x7f64680bed60 2023-12-08T08:23:58.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.254+0000 7f646ece3640 1 -- 172.21.15.88:0/221677877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64680bed60 msgr2=0x7f64680bf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:58.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.254+0000 7f646ece3640 1 --2- 172.21.15.88:0/221677877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64680bed60 0x7f64680bf140 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f645c0097c0 tx=0x7f645c01c3f0 comp rx=0 tx=0).stop 2023-12-08T08:23:58.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.254+0000 7f646ece3640 1 -- 172.21.15.88:0/221677877 shutdown_connections 2023-12-08T08:23:58.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.254+0000 7f646ece3640 1 --2- 172.21.15.88:0/221677877 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64680c4b20 0x7f64681585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:58.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.254+0000 7f646ece3640 1 --2- 172.21.15.88:0/221677877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64680bed60 0x7f64680bf140 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:58.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.254+0000 7f646ece3640 1 -- 172.21.15.88:0/221677877 >> 172.21.15.88:0/221677877 conn(0x7f64680c59f0 msgr2=0x7f64680c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:58.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.254+0000 7f646ece3640 1 -- 172.21.15.88:0/221677877 shutdown_connections 2023-12-08T08:23:58.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.254+0000 7f646ece3640 1 -- 172.21.15.88:0/221677877 wait complete. 2023-12-08T08:23:58.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.258+0000 7f646ece3640 1 Processor -- start 2023-12-08T08:23:58.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.258+0000 7f646ece3640 1 -- start start 2023-12-08T08:23:58.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.258+0000 7f646ece3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64680a4f30 0x7f64680c04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:58.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.258+0000 7f646ece3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64680bed60 0x7f6468140990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:58.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.258+0000 7f646ece3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64680c4b20 0x7f6468140ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:58.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.258+0000 7f646ece3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6468142e20 con 0x7f64680a4f30 2023-12-08T08:23:58.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.258+0000 7f646ece3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6468145340 con 0x7f64680bed60 2023-12-08T08:23:58.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.258+0000 7f646ece3640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64681486b0 con 0x7f64680c4b20 2023-12-08T08:23:58.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.258+0000 7f646ca7f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64680a4f30 0x7f64680c04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:58.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.258+0000 7f646ca7f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64680a4f30 0x7f64680c04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43250/0 (socket says 172.21.15.88:43250) 2023-12-08T08:23:58.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.258+0000 7f646ca7f640 1 -- 172.21.15.88:0/1827995547 learned_addr learned my addr 172.21.15.88:0/1827995547 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:58.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.258+0000 7f646d280640 1 --2- 172.21.15.88:0/1827995547 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64680c4b20 0x7f6468140ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:58.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.258+0000 7f6467fff640 1 --2- 172.21.15.88:0/1827995547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64680bed60 0x7f6468140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:58.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.258+0000 7f646ca7f640 1 -- 172.21.15.88:0/1827995547 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64680c4b20 msgr2=0x7f6468140ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:58.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.258+0000 7f646ca7f640 1 --2- 172.21.15.88:0/1827995547 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64680c4b20 0x7f6468140ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:58.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.258+0000 7f646ca7f640 1 -- 172.21.15.88:0/1827995547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64680bed60 msgr2=0x7f6468140990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:58.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.258+0000 7f646ca7f640 1 --2- 172.21.15.88:0/1827995547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64680bed60 0x7f6468140990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:58.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.258+0000 7f646ca7f640 1 -- 172.21.15.88:0/1827995547 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6460009b30 con 0x7f64680a4f30 2023-12-08T08:23:58.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.258+0000 7f6467fff640 1 --2- 172.21.15.88:0/1827995547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64680bed60 0x7f6468140990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:23:58.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.258+0000 7f646ca7f640 1 --2- 172.21.15.88:0/1827995547 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64680a4f30 0x7f64680c04d0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f645c0ae040 tx=0x7f645c01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:58.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.258+0000 7f64657fa640 1 -- 172.21.15.88:0/1827995547 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c0abea0 con 0x7f64680a4f30 2023-12-08T08:23:58.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.258+0000 7f64657fa640 1 -- 172.21.15.88:0/1827995547 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c0b7450 con 0x7f64680a4f30 2023-12-08T08:23:58.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.258+0000 7f64657fa640 1 -- 172.21.15.88:0/1827995547 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c0b7820 con 0x7f64680a4f30 2023-12-08T08:23:58.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.258+0000 7f646ece3640 1 -- 172.21.15.88:0/1827995547 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f645c009420 con 0x7f64680a4f30 2023-12-08T08:23:58.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.258+0000 7f646ece3640 1 -- 172.21.15.88:0/1827995547 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6468145810 con 0x7f64680a4f30 2023-12-08T08:23:58.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.262+0000 7f646ece3640 1 -- 172.21.15.88:0/1827995547 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6468067630 con 0x7f64680a4f30 2023-12-08T08:23:58.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.262+0000 7f64657fa640 1 -- 172.21.15.88:0/1827995547 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f645c0b7980 con 0x7f64680a4f30 2023-12-08T08:23:58.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.262+0000 7f64657fa640 1 --2- 172.21.15.88:0/1827995547 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f644c066470 0x7f644c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:58.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.262+0000 7f64657fa640 1 -- 172.21.15.88:0/1827995547 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5445+0+0 (secure 0 0 0) 0x7f645c11e220 con 0x7f64680a4f30 2023-12-08T08:23:58.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.262+0000 7f6467fff640 1 --2- 172.21.15.88:0/1827995547 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f644c066470 0x7f644c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:58.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.262+0000 7f6467fff640 1 --2- 172.21.15.88:0/1827995547 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f644c066470 0x7f644c068930 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f64681431d0 tx=0x7f6454009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:58.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.266+0000 7f64657fa640 1 -- 172.21.15.88:0/1827995547 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f645c0eb830 con 0x7f64680a4f30 2023-12-08T08:23:58.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:58.413+0000 7f646ece3640 1 -- 172.21.15.88:0/1827995547 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f64681516c0 con 0x7f64680a4f30 2023-12-08T08:23:59.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.089+0000 7f64657fa640 1 -- 172.21.15.88:0/1827995547 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v78) v1 ==== 172+0+0 (secure 0 0 0) 0x7f645c0eee50 con 0x7f64680a4f30 2023-12-08T08:23:59.094 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs2_data' removed 2023-12-08T08:23:59.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.093+0000 7f646ece3640 1 -- 172.21.15.88:0/1827995547 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f644c066470 msgr2=0x7f644c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:59.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.093+0000 7f646ece3640 1 --2- 172.21.15.88:0/1827995547 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f644c066470 0x7f644c068930 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f64681431d0 tx=0x7f6454009040 comp rx=0 tx=0).stop 2023-12-08T08:23:59.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.093+0000 7f646ece3640 1 -- 172.21.15.88:0/1827995547 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64680a4f30 msgr2=0x7f64680c04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:59.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.093+0000 7f646ece3640 1 --2- 172.21.15.88:0/1827995547 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64680a4f30 0x7f64680c04d0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f645c0ae040 tx=0x7f645c01ac30 comp rx=0 tx=0).stop 2023-12-08T08:23:59.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.093+0000 7f646ece3640 1 -- 172.21.15.88:0/1827995547 shutdown_connections 2023-12-08T08:23:59.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.093+0000 7f646ece3640 1 --2- 172.21.15.88:0/1827995547 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f644c066470 0x7f644c068930 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:59.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.093+0000 7f646ece3640 1 --2- 172.21.15.88:0/1827995547 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f64680c4b20 0x7f6468140ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:59.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.093+0000 7f646ece3640 1 --2- 172.21.15.88:0/1827995547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64680bed60 0x7f6468140990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:59.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.093+0000 7f646ece3640 1 --2- 172.21.15.88:0/1827995547 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64680a4f30 0x7f64680c04d0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:59.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.093+0000 7f646ece3640 1 -- 172.21.15.88:0/1827995547 >> 172.21.15.88:0/1827995547 conn(0x7f64680c59f0 msgr2=0x7f64680c35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:59.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.093+0000 7f646ece3640 1 -- 172.21.15.88:0/1827995547 shutdown_connections 2023-12-08T08:23:59.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.093+0000 7f646ece3640 1 -- 172.21.15.88:0/1827995547 wait complete. 2023-12-08T08:23:59.120 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-08T08:23:59.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.257+0000 7f8bf8abb640 1 Processor -- start 2023-12-08T08:23:59.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.257+0000 7f8bf8abb640 1 -- start start 2023-12-08T08:23:59.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.257+0000 7f8bf8abb640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8bf4151a90 0x7f8bf406c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:59.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.257+0000 7f8bf8abb640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf4151e70 con 0x7f8bf40c66b0 2023-12-08T08:23:59.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.257+0000 7f8bf8abb640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf40c4e00 con 0x7f8bf40c9580 2023-12-08T08:23:59.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.257+0000 7f8bf8abb640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf40c5790 con 0x7f8bf4151a90 2023-12-08T08:23:59.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.257+0000 7f8bf3fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8bf40c66b0 0x7f8bf4157a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39818/0 (socket says 172.21.15.88:39818) 2023-12-08T08:23:59.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.257+0000 7f8bf3fff640 1 -- 172.21.15.88:0/249105455 learned_addr learned my addr 172.21.15.88:0/249105455 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:23:59.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.261+0000 7f8bf37fe640 1 --2- 172.21.15.88:0/249105455 >> v2:172.21.15.148:3300/0 conn(0x7f8bf4151a90 0x7f8bf406c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:59.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.261+0000 7f8bf27fc640 1 -- 172.21.15.88:0/249105455 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1331510804 0 0) 0x7f8bf4151e70 con 0x7f8bf40c66b0 2023-12-08T08:23:59.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.261+0000 7f8bf27fc640 1 -- 172.21.15.88:0/249105455 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bdc003530 con 0x7f8bf40c66b0 2023-12-08T08:23:59.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.261+0000 7f8bf37fe640 1 -- 172.21.15.88:0/249105455 >> v1:172.21.15.148:6789/0 conn(0x7f8bf40c9580 legacy=0x7f8bf40c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:59.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.261+0000 7f8bf37fe640 1 -- 172.21.15.88:0/249105455 >> v1:172.21.15.88:6789/0 conn(0x7f8bf40c66b0 legacy=0x7f8bf4157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:59.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.261+0000 7f8bf37fe640 1 -- 172.21.15.88:0/249105455 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf40c8aa0 con 0x7f8bf4151a90 2023-12-08T08:23:59.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.261+0000 7f8bf37fe640 1 --2- 172.21.15.88:0/249105455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bf4151a90 0x7f8bf406c760 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8be40097c0 tx=0x7f8be401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db4e7cf40ea46bf9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:59.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.261+0000 7f8bf27fc640 1 -- 172.21.15.88:0/249105455 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be40ab600 con 0x7f8bf4151a90 2023-12-08T08:23:59.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.261+0000 7f8bf27fc640 1 -- 172.21.15.88:0/249105455 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be40a7050 con 0x7f8bf4151a90 2023-12-08T08:23:59.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.261+0000 7f8bf27fc640 1 -- 172.21.15.88:0/249105455 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be40ab980 con 0x7f8bf4151a90 2023-12-08T08:23:59.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.265+0000 7f8bf8abb640 1 -- 172.21.15.88:0/249105455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bf4151a90 msgr2=0x7f8bf406c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:59.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.265+0000 7f8bf8abb640 1 --2- 172.21.15.88:0/249105455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bf4151a90 0x7f8bf406c760 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8be40097c0 tx=0x7f8be401c3c0 comp rx=0 tx=0).stop 2023-12-08T08:23:59.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.265+0000 7f8bf8abb640 1 -- 172.21.15.88:0/249105455 shutdown_connections 2023-12-08T08:23:59.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.265+0000 7f8bf8abb640 1 --2- 172.21.15.88:0/249105455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bf4151a90 0x7f8bf406c760 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:59.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.265+0000 7f8bf8abb640 1 -- 172.21.15.88:0/249105455 >> 172.21.15.88:0/249105455 conn(0x7f8bf40ab9e0 msgr2=0x7f8bf40abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:59.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.265+0000 7f8bf8abb640 1 -- 172.21.15.88:0/249105455 shutdown_connections 2023-12-08T08:23:59.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.265+0000 7f8bf8abb640 1 -- 172.21.15.88:0/249105455 wait complete. 2023-12-08T08:23:59.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.265+0000 7f8bf8abb640 1 Processor -- start 2023-12-08T08:23:59.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.265+0000 7f8bf8abb640 1 -- start start 2023-12-08T08:23:59.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.265+0000 7f8bf8abb640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bf40c66b0 0x7f8bf40aad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:59.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.265+0000 7f8bf8abb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8bf40c9580 0x7f8bf4144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:59.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.265+0000 7f8bf8abb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bf4151a90 0x7f8bf4145430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:59.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.265+0000 7f8bf8abb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf4156760 con 0x7f8bf40c9580 2023-12-08T08:23:59.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.265+0000 7f8bf8abb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf41ecb20 con 0x7f8bf4151a90 2023-12-08T08:23:59.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.265+0000 7f8bf8abb640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf4157460 con 0x7f8bf40c66b0 2023-12-08T08:23:59.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.265+0000 7f8bf2ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8bf40c9580 0x7f8bf4144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:59.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.265+0000 7f8bf2ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8bf40c9580 0x7f8bf4144ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43262/0 (socket says 172.21.15.88:43262) 2023-12-08T08:23:59.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.265+0000 7f8bf2ffd640 1 -- 172.21.15.88:0/112063038 learned_addr learned my addr 172.21.15.88:0/112063038 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:59.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.265+0000 7f8bf3fff640 1 --2- 172.21.15.88:0/112063038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bf4151a90 0x7f8bf4145430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:59.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.265+0000 7f8bf37fe640 1 --2- 172.21.15.88:0/112063038 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bf40c66b0 0x7f8bf40aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:59.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.269+0000 7f8bf2ffd640 1 -- 172.21.15.88:0/112063038 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bf40c66b0 msgr2=0x7f8bf40aad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:59.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.269+0000 7f8bf2ffd640 1 --2- 172.21.15.88:0/112063038 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bf40c66b0 0x7f8bf40aad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:59.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.269+0000 7f8bf2ffd640 1 -- 172.21.15.88:0/112063038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bf4151a90 msgr2=0x7f8bf4145430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:59.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.269+0000 7f8bf2ffd640 1 --2- 172.21.15.88:0/112063038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bf4151a90 0x7f8bf4145430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:59.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.269+0000 7f8bf2ffd640 1 -- 172.21.15.88:0/112063038 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be4009420 con 0x7f8bf40c9580 2023-12-08T08:23:59.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.269+0000 7f8bf2ffd640 1 --2- 172.21.15.88:0/112063038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8bf40c9580 0x7f8bf4144ef0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f8be800c3c0 tx=0x7f8be800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:59.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.269+0000 7f8bdbfff640 1 -- 172.21.15.88:0/112063038 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be80052d0 con 0x7f8bf40c9580 2023-12-08T08:23:59.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.269+0000 7f8bdbfff640 1 -- 172.21.15.88:0/112063038 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be8005430 con 0x7f8bf40c9580 2023-12-08T08:23:59.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.269+0000 7f8bdbfff640 1 -- 172.21.15.88:0/112063038 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be8003820 con 0x7f8bf40c9580 2023-12-08T08:23:59.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.269+0000 7f8bf8abb640 1 -- 172.21.15.88:0/112063038 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf4157f90 con 0x7f8bf40c9580 2023-12-08T08:23:59.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.269+0000 7f8bf8abb640 1 -- 172.21.15.88:0/112063038 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf4157cb0 con 0x7f8bf40c9580 2023-12-08T08:23:59.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.269+0000 7f8bf8abb640 1 -- 172.21.15.88:0/112063038 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf40674b0 con 0x7f8bf40c9580 2023-12-08T08:23:59.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.269+0000 7f8bdbfff640 1 -- 172.21.15.88:0/112063038 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8be8003980 con 0x7f8bf40c9580 2023-12-08T08:23:59.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.269+0000 7f8bdbfff640 1 --2- 172.21.15.88:0/112063038 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8be0066470 0x7f8be0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:59.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.269+0000 7f8bdbfff640 1 -- 172.21.15.88:0/112063038 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8be8082fe0 con 0x7f8bf40c9580 2023-12-08T08:23:59.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.269+0000 7f8bf37fe640 1 --2- 172.21.15.88:0/112063038 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8be0066470 0x7f8be0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:59.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.273+0000 7f8bf37fe640 1 --2- 172.21.15.88:0/112063038 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8be0066470 0x7f8be0068930 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8be40ad000 tx=0x7f8be4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:59.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.273+0000 7f8bdbfff640 1 -- 172.21.15.88:0/112063038 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8be8050800 con 0x7f8bf40c9580 2023-12-08T08:23:59.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.425+0000 7f8bf8abb640 1 -- 172.21.15.88:0/112063038 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8bf40c7ba0 con 0x7f8bf40c9580 2023-12-08T08:23:59.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.429+0000 7f8bdbfff640 1 -- 172.21.15.88:0/112063038 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8be8053e20 con 0x7f8bf40c9580 2023-12-08T08:23:59.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.429+0000 7f8bf8abb640 1 -- 172.21.15.88:0/112063038 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8be0066470 msgr2=0x7f8be0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:59.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.429+0000 7f8bf8abb640 1 --2- 172.21.15.88:0/112063038 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8be0066470 0x7f8be0068930 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8be40ad000 tx=0x7f8be4008040 comp rx=0 tx=0).stop 2023-12-08T08:23:59.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.429+0000 7f8bf8abb640 1 -- 172.21.15.88:0/112063038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8bf40c9580 msgr2=0x7f8bf4144ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:59.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.429+0000 7f8bf8abb640 1 --2- 172.21.15.88:0/112063038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8bf40c9580 0x7f8bf4144ef0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f8be800c3c0 tx=0x7f8be800c880 comp rx=0 tx=0).stop 2023-12-08T08:23:59.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.429+0000 7f8bf8abb640 1 -- 172.21.15.88:0/112063038 shutdown_connections 2023-12-08T08:23:59.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.429+0000 7f8bf8abb640 1 --2- 172.21.15.88:0/112063038 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8be0066470 0x7f8be0068930 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:59.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.429+0000 7f8bf8abb640 1 --2- 172.21.15.88:0/112063038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bf4151a90 0x7f8bf4145430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:59.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.429+0000 7f8bf8abb640 1 --2- 172.21.15.88:0/112063038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8bf40c9580 0x7f8bf4144ef0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:59.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.429+0000 7f8bf8abb640 1 --2- 172.21.15.88:0/112063038 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8bf40c66b0 0x7f8bf40aad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:59.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.429+0000 7f8bf8abb640 1 -- 172.21.15.88:0/112063038 >> 172.21.15.88:0/112063038 conn(0x7f8bf40ab9e0 msgr2=0x7f8bf4152990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:59.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.429+0000 7f8bf8abb640 1 -- 172.21.15.88:0/112063038 shutdown_connections 2023-12-08T08:23:59.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.429+0000 7f8bf8abb640 1 -- 172.21.15.88:0/112063038 wait complete. 2023-12-08T08:23:59.456 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2023-12-08T08:23:59.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.589+0000 7f8aa32bb640 1 Processor -- start 2023-12-08T08:23:59.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.589+0000 7f8aa32bb640 1 -- start start 2023-12-08T08:23:59.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.589+0000 7f8aa32bb640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a9c06d2b0 0x7f8a9c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:59.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.589+0000 7f8aa32bb640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8a9c0c5300 0x7f8a9c06c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:59.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.589+0000 7f8aa32bb640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a9c06bb80 con 0x7f8a9c0c3b80 2023-12-08T08:23:59.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.589+0000 7f8aa32bb640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a9c06cc70 con 0x7f8a9c0c5300 2023-12-08T08:23:59.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.589+0000 7f8aa32bb640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c0c5790 con 0x7f8a9c06d2b0 2023-12-08T08:23:59.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.589+0000 7f8aa1057640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a9c06d2b0 0x7f8a9c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:59.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.589+0000 7f8aa1858640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8a9c0c5300 0x7f8a9c06c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:59.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.589+0000 7f8aa1057640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a9c06d2b0 0x7f8a9c06d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:40262/0 (socket says 172.21.15.88:40262) 2023-12-08T08:23:59.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.589+0000 7f8aa1057640 1 -- 172.21.15.88:0/3381828216 learned_addr learned my addr 172.21.15.88:0/3381828216 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:59.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.589+0000 7f8aa1057640 1 -- 172.21.15.88:0/3381828216 >> v2:172.21.15.148:3300/0 conn(0x7f8a9c0c5300 msgr2=0x7f8a9c06c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:23:59.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.589+0000 7f8aa1057640 1 --2- 172.21.15.88:0/3381828216 >> v2:172.21.15.148:3300/0 conn(0x7f8a9c0c5300 0x7f8a9c06c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:59.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.589+0000 7f8aa1057640 1 -- 172.21.15.88:0/3381828216 >> v1:172.21.15.148:6789/0 conn(0x7f8a9c0c3b80 legacy=0x7f8a9c06c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:59.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.589+0000 7f8aa1057640 1 -- 172.21.15.88:0/3381828216 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9c1515c0 con 0x7f8a9c06d2b0 2023-12-08T08:23:59.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.593+0000 7f8aa1057640 1 --2- 172.21.15.88:0/3381828216 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a9c06d2b0 0x7f8a9c06d690 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8a98009870 tx=0x7f8a9801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5609c779e01cc67 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:59.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.593+0000 7f8a93fff640 1 -- 172.21.15.88:0/3381828216 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a980ab620 con 0x7f8a9c06d2b0 2023-12-08T08:23:59.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.593+0000 7f8a93fff640 1 -- 172.21.15.88:0/3381828216 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a980ab780 con 0x7f8a9c06d2b0 2023-12-08T08:23:59.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.593+0000 7f8a93fff640 1 -- 172.21.15.88:0/3381828216 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a980abb10 con 0x7f8a9c06d2b0 2023-12-08T08:23:59.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.593+0000 7f8aa32bb640 1 -- 172.21.15.88:0/3381828216 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a9c06d2b0 msgr2=0x7f8a9c06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:59.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.593+0000 7f8aa32bb640 1 --2- 172.21.15.88:0/3381828216 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a9c06d2b0 0x7f8a9c06d690 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8a98009870 tx=0x7f8a9801c510 comp rx=0 tx=0).stop 2023-12-08T08:23:59.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.593+0000 7f8aa32bb640 1 -- 172.21.15.88:0/3381828216 shutdown_connections 2023-12-08T08:23:59.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.593+0000 7f8aa32bb640 1 --2- 172.21.15.88:0/3381828216 >> v2:172.21.15.148:3300/0 conn(0x7f8a9c0c5300 0x7f8a9c06c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:59.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.593+0000 7f8aa32bb640 1 --2- 172.21.15.88:0/3381828216 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a9c06d2b0 0x7f8a9c06d690 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:59.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.593+0000 7f8aa32bb640 1 -- 172.21.15.88:0/3381828216 >> 172.21.15.88:0/3381828216 conn(0x7f8a9c0a7810 msgr2=0x7f8a9c0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:23:59.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.593+0000 7f8aa32bb640 1 -- 172.21.15.88:0/3381828216 shutdown_connections 2023-12-08T08:23:59.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.593+0000 7f8aa32bb640 1 -- 172.21.15.88:0/3381828216 wait complete. 2023-12-08T08:23:59.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.597+0000 7f8aa32bb640 1 Processor -- start 2023-12-08T08:23:59.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.597+0000 7f8aa32bb640 1 -- start start 2023-12-08T08:23:59.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.597+0000 7f8aa32bb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a9c06d2b0 0x7f8a9c1490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:59.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.597+0000 7f8aa32bb640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a9c0c3b80 0x7f8a9c143f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:59.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.597+0000 7f8aa32bb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a9c0c5300 0x7f8a9c144480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:59.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.597+0000 7f8aa32bb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c1ecd00 con 0x7f8a9c0c5300 2023-12-08T08:23:59.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.597+0000 7f8aa32bb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c14bb50 con 0x7f8a9c06d2b0 2023-12-08T08:23:59.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.597+0000 7f8aa32bb640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c1449c0 con 0x7f8a9c0c3b80 2023-12-08T08:23:59.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.597+0000 7f8aa1858640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a9c0c5300 0x7f8a9c144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:59.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.597+0000 7f8aa1858640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a9c0c5300 0x7f8a9c144480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43264/0 (socket says 172.21.15.88:43264) 2023-12-08T08:23:59.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.597+0000 7f8aa1858640 1 -- 172.21.15.88:0/1672260109 learned_addr learned my addr 172.21.15.88:0/1672260109 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:23:59.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.597+0000 7f8aa0856640 1 --2- 172.21.15.88:0/1672260109 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a9c0c3b80 0x7f8a9c143f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:59.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.597+0000 7f8aa1057640 1 --2- 172.21.15.88:0/1672260109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a9c06d2b0 0x7f8a9c1490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:59.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.597+0000 7f8aa1858640 1 -- 172.21.15.88:0/1672260109 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a9c0c3b80 msgr2=0x7f8a9c143f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:59.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.597+0000 7f8aa1858640 1 --2- 172.21.15.88:0/1672260109 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a9c0c3b80 0x7f8a9c143f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:59.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.597+0000 7f8aa1858640 1 -- 172.21.15.88:0/1672260109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a9c06d2b0 msgr2=0x7f8a9c1490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:23:59.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.597+0000 7f8aa1858640 1 --2- 172.21.15.88:0/1672260109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a9c06d2b0 0x7f8a9c1490f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:23:59.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.597+0000 7f8aa1858640 1 -- 172.21.15.88:0/1672260109 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a980094d0 con 0x7f8a9c0c5300 2023-12-08T08:23:59.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.597+0000 7f8aa1858640 1 --2- 172.21.15.88:0/1672260109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a9c0c5300 0x7f8a9c144480 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f8a9400ec10 tx=0x7f8a9400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:59.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.597+0000 7f8a91ffb640 1 -- 172.21.15.88:0/1672260109 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9400cd20 con 0x7f8a9c0c5300 2023-12-08T08:23:59.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.597+0000 7f8a91ffb640 1 -- 172.21.15.88:0/1672260109 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9400f040 con 0x7f8a9c0c5300 2023-12-08T08:23:59.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.597+0000 7f8a91ffb640 1 -- 172.21.15.88:0/1672260109 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a940146c0 con 0x7f8a9c0c5300 2023-12-08T08:23:59.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.597+0000 7f8aa32bb640 1 -- 172.21.15.88:0/1672260109 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a9c14ef80 con 0x7f8a9c0c5300 2023-12-08T08:23:59.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.597+0000 7f8aa32bb640 1 -- 172.21.15.88:0/1672260109 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a9c14b500 con 0x7f8a9c0c5300 2023-12-08T08:23:59.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.601+0000 7f8aa32bb640 1 -- 172.21.15.88:0/1672260109 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a9c067630 con 0x7f8a9c0c5300 2023-12-08T08:23:59.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.601+0000 7f8a91ffb640 1 -- 172.21.15.88:0/1672260109 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8a94014a30 con 0x7f8a9c0c5300 2023-12-08T08:23:59.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.601+0000 7f8a91ffb640 1 --2- 172.21.15.88:0/1672260109 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8a80066470 0x7f8a80068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:23:59.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.601+0000 7f8a91ffb640 1 -- 172.21.15.88:0/1672260109 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8a940846f0 con 0x7f8a9c0c5300 2023-12-08T08:23:59.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.601+0000 7f8aa1057640 1 --2- 172.21.15.88:0/1672260109 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8a80066470 0x7f8a80068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:23:59.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.601+0000 7f8aa1057640 1 --2- 172.21.15.88:0/1672260109 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8a80066470 0x7f8a80068930 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8a980af000 tx=0x7f8a980b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:23:59.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.609+0000 7f8a91ffb640 1 -- 172.21.15.88:0/1672260109 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8a94051eb0 con 0x7f8a9c0c5300 2023-12-08T08:23:59.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:23:59.829+0000 7f8aa32bb640 1 -- 172.21.15.88:0/1672260109 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7f8a9c067c50 con 0x7f8a9c0c5300 2023-12-08T08:24:00.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.093+0000 7f8a91ffb640 1 -- 172.21.15.88:0/1672260109 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v234) v1 ==== 159+0+0 (secure 0 0 0) 0x7f8a940554d0 con 0x7f8a9c0c5300 2023-12-08T08:24:00.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.097+0000 7f8aa32bb640 1 -- 172.21.15.88:0/1672260109 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8a80066470 msgr2=0x7f8a80068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:00.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.097+0000 7f8aa32bb640 1 --2- 172.21.15.88:0/1672260109 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8a80066470 0x7f8a80068930 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8a980af000 tx=0x7f8a980b6040 comp rx=0 tx=0).stop 2023-12-08T08:24:00.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.097+0000 7f8aa32bb640 1 -- 172.21.15.88:0/1672260109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a9c0c5300 msgr2=0x7f8a9c144480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:00.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.097+0000 7f8aa32bb640 1 --2- 172.21.15.88:0/1672260109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a9c0c5300 0x7f8a9c144480 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f8a9400ec10 tx=0x7f8a9400c490 comp rx=0 tx=0).stop 2023-12-08T08:24:00.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.097+0000 7f8aa32bb640 1 -- 172.21.15.88:0/1672260109 shutdown_connections 2023-12-08T08:24:00.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.097+0000 7f8aa32bb640 1 --2- 172.21.15.88:0/1672260109 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f8a80066470 0x7f8a80068930 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:00.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.097+0000 7f8aa32bb640 1 --2- 172.21.15.88:0/1672260109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a9c0c5300 0x7f8a9c144480 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:00.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.097+0000 7f8aa32bb640 1 --2- 172.21.15.88:0/1672260109 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f8a9c0c3b80 0x7f8a9c143f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:00.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.097+0000 7f8aa32bb640 1 --2- 172.21.15.88:0/1672260109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a9c06d2b0 0x7f8a9c1490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:00.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.097+0000 7f8aa32bb640 1 -- 172.21.15.88:0/1672260109 >> 172.21.15.88:0/1672260109 conn(0x7f8a9c0a7810 msgr2=0x7f8a9c0bee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:00.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.097+0000 7f8aa32bb640 1 -- 172.21.15.88:0/1672260109 shutdown_connections 2023-12-08T08:24:00.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.097+0000 7f8aa32bb640 1 -- 172.21.15.88:0/1672260109 wait complete. 2023-12-08T08:24:00.123 INFO:tasks.cephfs_test_runner:test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) ... ERROR 2023-12-08T08:24:00.123 INFO:tasks.cephfs_test_runner: 2023-12-08T08:24:00.123 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-08T08:24:00.123 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-08T08:24:00.124 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-08T08:24:00.124 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-08T08:24:00.124 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2023-12-08T08:24:00.124 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2023-12-08T08:24:00.124 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2023-12-08T08:24:00.124 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2023-12-08T08:24:00.124 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2023-12-08T08:24:00.124 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2023-12-08T08:24:00.124 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs/mount.py", line 749, in read_file 2023-12-08T08:24:00.124 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2023-12-08T08:24:00.124 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-12-08T08:24:00.124 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-12-08T08:24:00.124 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run 2023-12-08T08:24:00.124 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-12-08T08:24:00.124 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run 2023-12-08T08:24:00.124 INFO:tasks.cephfs_test_runner: r.wait() 2023-12-08T08:24:00.124 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait 2023-12-08T08:24:00.125 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-12-08T08:24:00.125 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-12-08T08:24:00.125 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-12-08T08:24:00.125 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi088 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2023-12-08T08:24:00.125 INFO:tasks.cephfs_test_runner: 2023-12-08T08:24:00.125 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-08T08:24:00.125 INFO:tasks.cephfs_test_runner:Ran 3 tests in 194.404s 2023-12-08T08:24:00.125 INFO:tasks.cephfs_test_runner: 2023-12-08T08:24:00.125 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-12-08T08:24:00.125 INFO:tasks.cephfs_test_runner: 2023-12-08T08:24:00.125 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-08T08:24:00.125 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-08T08:24:00.125 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-08T08:24:00.125 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-08T08:24:00.125 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2023-12-08T08:24:00.125 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2023-12-08T08:24:00.126 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2023-12-08T08:24:00.126 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2023-12-08T08:24:00.126 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2023-12-08T08:24:00.126 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2023-12-08T08:24:00.126 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs/mount.py", line 749, in read_file 2023-12-08T08:24:00.126 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2023-12-08T08:24:00.126 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-12-08T08:24:00.126 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-12-08T08:24:00.126 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run 2023-12-08T08:24:00.126 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-12-08T08:24:00.126 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run 2023-12-08T08:24:00.126 INFO:tasks.cephfs_test_runner: r.wait() 2023-12-08T08:24:00.126 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait 2023-12-08T08:24:00.126 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-12-08T08:24:00.126 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-12-08T08:24:00.126 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-12-08T08:24:00.126 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi088 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2023-12-08T08:24:00.126 INFO:tasks.cephfs_test_runner: 2023-12-08T08:24:00.127 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-08T08:24:00.198 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=b990591071154df597341136331fde74 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-08T08:24:00.199 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-12-08T08:24:00.209 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-08T08:24:00.227 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-08T08:24:00.227 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-12-08T08:24:00.227 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:24:00.244 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5383 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-08T08:24:00.244 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-08T08:24:00.244 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:24:00.253 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354676k,nr_inodes=4088669,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9389 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-08T08:24:00.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:24:00.254 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-12-08T08:24:00.292 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-08T08:24:00.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:24:00.294 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:24:00.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:24:00.358 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2023-12-08T08:24:00.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:24:00.535 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-12-08T08:24:00.545 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-08T08:24:00.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:24:00.545 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:24:00.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:24:00.611 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link delete ceph-brx 2023-12-08T08:24:00.828 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-08T08:24:00.844 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-08T08:24:00.844 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:24:00.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.977+0000 7f7af4a9c640 1 Processor -- start 2023-12-08T08:24:00.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.977+0000 7f7af4a9c640 1 -- start start 2023-12-08T08:24:00.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.977+0000 7f7af4a9c640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7af006d2b0 0x7f7af006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:00.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.977+0000 7f7af4a9c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7af00c3b80 0x7f7af00c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:00.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.977+0000 7f7af4a9c640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7af006bb80 con 0x7f7af006c020 2023-12-08T08:24:00.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.977+0000 7f7af4a9c640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7af00c5840 con 0x7f7af006d2b0 2023-12-08T08:24:00.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.977+0000 7f7af4a9c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af01515c0 con 0x7f7af00c3b80 2023-12-08T08:24:00.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.977+0000 7f7ae7fff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7af00c3b80 0x7f7af00c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:00.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.977+0000 7f7aee59c640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7af006d2b0 0x7f7af006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:00.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.977+0000 7f7ae7fff640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7af00c3b80 0x7f7af00c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:57860/0 (socket says 172.21.15.88:57860) 2023-12-08T08:24:00.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.977+0000 7f7ae7fff640 1 -- 172.21.15.88:0/2832120387 learned_addr learned my addr 172.21.15.88:0/2832120387 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:00.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.977+0000 7f7aee59c640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7af006d2b0 0x7f7af006d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:35214/0 (socket says 172.21.15.88:35214) 2023-12-08T08:24:00.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.981+0000 7f7ae7fff640 1 -- 172.21.15.88:0/2832120387 >> v2:172.21.15.148:3300/0 conn(0x7f7af006d2b0 msgr2=0x7f7af006d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:00.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.981+0000 7f7ae7fff640 1 --2- 172.21.15.88:0/2832120387 >> v2:172.21.15.148:3300/0 conn(0x7f7af006d2b0 0x7f7af006d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:00.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.981+0000 7f7ae7fff640 1 -- 172.21.15.88:0/2832120387 >> v1:172.21.15.148:6789/0 conn(0x7f7af006c020 legacy=0x7f7af006c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:00.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.981+0000 7f7ae7fff640 1 -- 172.21.15.88:0/2832120387 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af01518a0 con 0x7f7af00c3b80 2023-12-08T08:24:00.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.981+0000 7f7aee59c640 1 --2- 172.21.15.88:0/2832120387 >> v2:172.21.15.148:3300/0 conn(0x7f7af006d2b0 0x7f7af006d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:24:00.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.981+0000 7f7ae7fff640 1 --2- 172.21.15.88:0/2832120387 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7af00c3b80 0x7f7af00c5300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800b920 tx=0x7f7ad801c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a359d6dc3109166 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:00.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.981+0000 7f7aedd9b640 1 -- 172.21.15.88:0/2832120387 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad80a5970 con 0x7f7af00c3b80 2023-12-08T08:24:00.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.981+0000 7f7aedd9b640 1 -- 172.21.15.88:0/2832120387 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad80a5ad0 con 0x7f7af00c3b80 2023-12-08T08:24:00.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.981+0000 7f7aedd9b640 1 -- 172.21.15.88:0/2832120387 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad80a5e60 con 0x7f7af00c3b80 2023-12-08T08:24:00.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.981+0000 7f7af4a9c640 1 -- 172.21.15.88:0/2832120387 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7af00c3b80 msgr2=0x7f7af00c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:00.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.981+0000 7f7af4a9c640 1 --2- 172.21.15.88:0/2832120387 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7af00c3b80 0x7f7af00c5300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800b920 tx=0x7f7ad801c9b0 comp rx=0 tx=0).stop 2023-12-08T08:24:00.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.981+0000 7f7af4a9c640 1 -- 172.21.15.88:0/2832120387 shutdown_connections 2023-12-08T08:24:00.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.981+0000 7f7af4a9c640 1 --2- 172.21.15.88:0/2832120387 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7af00c3b80 0x7f7af00c5300 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:00.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.981+0000 7f7af4a9c640 1 --2- 172.21.15.88:0/2832120387 >> v2:172.21.15.148:3300/0 conn(0x7f7af006d2b0 0x7f7af006d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:00.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.981+0000 7f7af4a9c640 1 -- 172.21.15.88:0/2832120387 >> 172.21.15.88:0/2832120387 conn(0x7f7af00a7810 msgr2=0x7f7af00a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:00.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.981+0000 7f7af4a9c640 1 -- 172.21.15.88:0/2832120387 shutdown_connections 2023-12-08T08:24:00.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.985+0000 7f7af4a9c640 1 -- 172.21.15.88:0/2832120387 wait complete. 2023-12-08T08:24:00.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.985+0000 7f7af4a9c640 1 Processor -- start 2023-12-08T08:24:00.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.985+0000 7f7af4a9c640 1 -- start start 2023-12-08T08:24:00.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.985+0000 7f7af4a9c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7af006c020 0x7f7af00a8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:00.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.985+0000 7f7af4a9c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7af006d2b0 0x7f7af00a93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:00.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.985+0000 7f7af4a9c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7af00c3b80 0x7f7af0146550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:00.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.985+0000 7f7af4a9c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af00a98e0 con 0x7f7af006d2b0 2023-12-08T08:24:00.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.985+0000 7f7af4a9c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af01e97f0 con 0x7f7af006c020 2023-12-08T08:24:00.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.985+0000 7f7af4a9c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af01e9ad0 con 0x7f7af00c3b80 2023-12-08T08:24:00.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.985+0000 7f7ae7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7af006d2b0 0x7f7af00a93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:00.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.985+0000 7f7ae7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7af006d2b0 0x7f7af00a93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42910/0 (socket says 172.21.15.88:42910) 2023-12-08T08:24:00.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.985+0000 7f7ae7fff640 1 -- 172.21.15.88:0/3296686114 learned_addr learned my addr 172.21.15.88:0/3296686114 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:00.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.985+0000 7f7aee59c640 1 --2- 172.21.15.88:0/3296686114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7af006c020 0x7f7af00a8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:00.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.985+0000 7f7aeed9d640 1 --2- 172.21.15.88:0/3296686114 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7af00c3b80 0x7f7af0146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:00.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.985+0000 7f7aee59c640 1 -- 172.21.15.88:0/3296686114 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7af00c3b80 msgr2=0x7f7af0146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:00.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.985+0000 7f7aee59c640 1 --2- 172.21.15.88:0/3296686114 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7af00c3b80 0x7f7af0146550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:00.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.985+0000 7f7aee59c640 1 -- 172.21.15.88:0/3296686114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7af006d2b0 msgr2=0x7f7af00a93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:00.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.985+0000 7f7aee59c640 1 --2- 172.21.15.88:0/3296686114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7af006d2b0 0x7f7af00a93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:00.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.985+0000 7f7aee59c640 1 -- 172.21.15.88:0/3296686114 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae000d8c0 con 0x7f7af006c020 2023-12-08T08:24:00.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.985+0000 7f7ae7fff640 1 --2- 172.21.15.88:0/3296686114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7af006d2b0 0x7f7af00a93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:24:00.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.985+0000 7f7aee59c640 1 --2- 172.21.15.88:0/3296686114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7af006c020 0x7f7af00a8e60 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0012fc0 tx=0x7f7ae0010490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:00.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.985+0000 7f7ae6ffd640 1 -- 172.21.15.88:0/3296686114 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0010da0 con 0x7f7af006c020 2023-12-08T08:24:00.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.985+0000 7f7ae6ffd640 1 -- 172.21.15.88:0/3296686114 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae0013040 con 0x7f7af006c020 2023-12-08T08:24:00.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.985+0000 7f7ae6ffd640 1 -- 172.21.15.88:0/3296686114 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae00186c0 con 0x7f7af006c020 2023-12-08T08:24:00.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.985+0000 7f7af4a9c640 1 -- 172.21.15.88:0/3296686114 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad800b580 con 0x7f7af006c020 2023-12-08T08:24:00.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.989+0000 7f7af4a9c640 1 -- 172.21.15.88:0/3296686114 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af014ef80 con 0x7f7af006c020 2023-12-08T08:24:00.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.989+0000 7f7af4a9c640 1 -- 172.21.15.88:0/3296686114 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7af0067630 con 0x7f7af006c020 2023-12-08T08:24:00.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.989+0000 7f7ae6ffd640 1 -- 172.21.15.88:0/3296686114 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7ae0018820 con 0x7f7af006c020 2023-12-08T08:24:00.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.989+0000 7f7ae6ffd640 1 --2- 172.21.15.88:0/3296686114 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7ad0066470 0x7f7ad0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:00.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.989+0000 7f7ae6ffd640 1 -- 172.21.15.88:0/3296686114 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f7ae0087c20 con 0x7f7af006c020 2023-12-08T08:24:00.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.989+0000 7f7ae7fff640 1 --2- 172.21.15.88:0/3296686114 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7ad0066470 0x7f7ad0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:00.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.989+0000 7f7ae7fff640 1 --2- 172.21.15.88:0/3296686114 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7ad0066470 0x7f7ad0068930 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800b920 tx=0x7f7ad80a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:01.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:00.993+0000 7f7ae6ffd640 1 -- 172.21.15.88:0/3296686114 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7ae00553e0 con 0x7f7af006c020 2023-12-08T08:24:01.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.141+0000 7f7af4a9c640 1 -- 172.21.15.88:0/3296686114 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7af00c1800 con 0x7f7ad0066470 2023-12-08T08:24:01.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.145+0000 7f7ae6ffd640 1 -- 172.21.15.88:0/3296686114 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50834 (secure 0 0 0) 0x7f7af00c1800 con 0x7f7ad0066470 2023-12-08T08:24:01.150 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:24:01.151 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:24:01.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.145+0000 7f7af4a9c640 1 -- 172.21.15.88:0/3296686114 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7ad0066470 msgr2=0x7f7ad0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:01.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.145+0000 7f7af4a9c640 1 --2- 172.21.15.88:0/3296686114 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7ad0066470 0x7f7ad0068930 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800b920 tx=0x7f7ad80a7070 comp rx=0 tx=0).stop 2023-12-08T08:24:01.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.145+0000 7f7af4a9c640 1 -- 172.21.15.88:0/3296686114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7af006c020 msgr2=0x7f7af00a8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:01.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.145+0000 7f7af4a9c640 1 --2- 172.21.15.88:0/3296686114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7af006c020 0x7f7af00a8e60 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0012fc0 tx=0x7f7ae0010490 comp rx=0 tx=0).stop 2023-12-08T08:24:01.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.145+0000 7f7af4a9c640 1 -- 172.21.15.88:0/3296686114 shutdown_connections 2023-12-08T08:24:01.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.145+0000 7f7af4a9c640 1 --2- 172.21.15.88:0/3296686114 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f7ad0066470 0x7f7ad0068930 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.145+0000 7f7af4a9c640 1 --2- 172.21.15.88:0/3296686114 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f7af00c3b80 0x7f7af0146550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.145+0000 7f7af4a9c640 1 --2- 172.21.15.88:0/3296686114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7af006d2b0 0x7f7af00a93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.145+0000 7f7af4a9c640 1 --2- 172.21.15.88:0/3296686114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7af006c020 0x7f7af00a8e60 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.145+0000 7f7af4a9c640 1 -- 172.21.15.88:0/3296686114 >> 172.21.15.88:0/3296686114 conn(0x7f7af00a7810 msgr2=0x7f7af006c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:01.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.145+0000 7f7af4a9c640 1 -- 172.21.15.88:0/3296686114 shutdown_connections 2023-12-08T08:24:01.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.145+0000 7f7af4a9c640 1 -- 172.21.15.88:0/3296686114 wait complete. 2023-12-08T08:24:01.169 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2023-12-08T08:24:00.794090+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256972,"kb_used_data":7528,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717748,"statfs":{"total":773094113280,"available":772830973952,"internally_reserved":0,"allocated":7708672,"data_stored":4536226,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12079,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-60,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001329"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":212,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-08T08:23:52.635443+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:23:52.635443+0000","last_peered":"2023-12-08T08:23:52.635443+0000","last_clean":"2023-12-08T08:23:52.635443+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:23:52.635443+0000","last_undegraded":"2023-12-08T08:23:52.635443+0000","last_fullsized":"2023-12-08T08:23:52.635443+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":1003520,"data_stored":1003811,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.64900000000000002,"15min":0.64400000000000002},"min":{"1min":0.49399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.71899999999999997,"15min":0.74099999999999999},"min":{"1min":0.53400000000000003,"5min":0.372,"15min":0.372},"max":{"1min":1.0109999999999999,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.73399999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70099999999999996,"15min":0.71899999999999997},"min":{"1min":0.47199999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.94299999999999995,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.73499999999999999,"15min":0.753},"min":{"1min":0.54300000000000004,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.96099999999999997,"5min":1.446,"15min":1.446},"last":0.95499999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.98899999999999999,"5min":1.379,"15min":1.379},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71899999999999997,"15min":0.73099999999999998},"min":{"1min":0.56799999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.90500000000000003,"5min":1.706,"15min":1.706},"last":0.80900000000000005}]},{"osd":3,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73699999999999999,"15min":0.75900000000000001},"min":{"1min":0.51000000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93899999999999995,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.76100000000000001,"15min":0.78700000000000003},"min":{"1min":0.52100000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.90100000000000002,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.0920000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.69799999999999995,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88600000000000001,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.70699999999999996,"15min":0.73499999999999999},"min":{"1min":0.48799999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89800000000000002,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.98599999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.753,"15min":0.78800000000000003},"min":{"1min":0.44500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.94099999999999995,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.76000000000000001,"15min":0.79400000000000004},"min":{"1min":0.52300000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.95199999999999996,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.78000000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.82499999999999996,"15min":0.85699999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.92300000000000004,"5min":1.573,"15min":1.573},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.77800000000000002,"15min":0.80800000000000005},"min":{"1min":0.55100000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97099999999999997,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.92900000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":937984,"data_stored":413983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.66800000000000004},"min":{"1min":0.49099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.56899999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94599999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.67000000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72499999999999998,"15min":0.71899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73599999999999999,"15min":0.73399999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70899999999999996,"15min":0.72499999999999998},"min":{"1min":0.50700000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.90900000000000003,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73599999999999999,"15min":0.746},"min":{"1min":0.48899999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.76200000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.73799999999999999,"15min":0.75700000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.875},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.46600000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.96299999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.81699999999999995}]},{"osd":4,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.70199999999999996,"15min":0.72599999999999998},"min":{"1min":0.42899999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83399999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.71699999999999997,"15min":0.755},"min":{"1min":0.496,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79700000000000004,"5min":1.014,"15min":1.014},"last":0.79900000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.75,"15min":0.79100000000000004},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83099999999999996,"5min":1.091,"15min":1.091},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.81699999999999995,"15min":0.84299999999999997},"min":{"1min":0.57199999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0149999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.89400000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78600000000000003,"15min":0.81599999999999995},"min":{"1min":0.61799999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.89000000000000001,"5min":1.04,"15min":1.04},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.84199999999999997,"15min":0.89200000000000002},"min":{"1min":0.55400000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96499999999999997,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.85699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":946176,"data_stored":419572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.621,"15min":0.622},"min":{"1min":0.47599999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.042,"5min":1.081,"15min":1.081},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68300000000000005,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.024,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.82799999999999996}]},{"osd":1,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69099999999999995,"15min":0.68100000000000005},"min":{"1min":0.42399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98599999999999999,"5min":1.194,"15min":1.194},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.006,"5min":1.143,"15min":1.143},"last":0.80700000000000005}]},{"osd":2,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.47999999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0880000000000001,"5min":1.101,"15min":1.101},"last":0.95699999999999996}]},{"osd":3,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72999999999999998,"15min":0.74199999999999999},"min":{"1min":0.52300000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.76300000000000001,"15min":0.753},"min":{"1min":0.56200000000000006,"5min":0.5,"15min":0.5},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":1.173}]},{"osd":4,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.40899999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.96299999999999997,"5min":1.01,"15min":1.01},"last":0.879},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.58899999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.048,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.99399999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.75700000000000001,"15min":0.77900000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89900000000000002,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":1.115},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91000000000000003,"5min":1.073,"15min":1.073},"last":0.92200000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77600000000000002,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95999999999999996,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83599999999999997,"15min":0.85599999999999998},"min":{"1min":0.56299999999999994,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0800000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":1.353}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":430769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.68000000000000005,"15min":0.69399999999999995},"min":{"1min":0.502,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86099999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.68300000000000005,"15min":0.66800000000000004},"min":{"1min":0.59399999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95099999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.436}]},{"osd":1,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70799999999999996,"15min":0.71299999999999997},"min":{"1min":0.52800000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90100000000000002,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68100000000000005,"15min":0.68200000000000005},"min":{"1min":0.505,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.84499999999999997,"5min":1.002,"15min":1.002},"last":0.61499999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68999999999999995},"min":{"1min":0.54200000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88400000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.54400000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.84699999999999998,"5min":1.056,"15min":1.056},"last":0.505}]},{"osd":3,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.58999999999999997,"5min":0.496,"15min":0.496},"max":{"1min":0.95299999999999996,"5min":1.359,"15min":1.359},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.755,"15min":0.78500000000000003},"min":{"1min":0.51800000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99399999999999999,"5min":1.232,"15min":1.232},"last":0.63200000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.64200000000000002,"15min":0.66800000000000004},"min":{"1min":0.39000000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90800000000000003,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.745,"15min":0.78100000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95199999999999996,"5min":1.091,"15min":1.091},"last":0.55300000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.68600000000000005,"15min":0.71499999999999997},"min":{"1min":0.41699999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.92500000000000004,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.76300000000000001,"15min":0.78900000000000003},"min":{"1min":0.45300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98199999999999998,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.68700000000000006}]},{"osd":7,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.97699999999999998,"5min":1.246,"15min":1.246},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.80200000000000005},"min":{"1min":0.50800000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.004,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.70799999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":966656,"data_stored":430667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41799999999999998,"15min":0.432},"min":{"1min":0.26500000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.56000000000000005,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45600000000000002,"15min":0.46300000000000002},"min":{"1min":0.309,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73999999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.40200000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.435,"15min":0.436},"min":{"1min":0.317,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.58099999999999996,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.58999999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.50900000000000001,"15min":0.52200000000000002},"min":{"1min":0.35299999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52900000000000003,"15min":0.54100000000000004},"min":{"1min":0.40600000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65200000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.45300000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0620000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.54300000000000004,"5min":0.497,"15min":0.497},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.878}]},{"osd":5,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.52000000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.76200000000000001,"15min":0.77100000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.91200000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.56899999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.101,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.93300000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.76200000000000001,"15min":0.75900000000000001},"min":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.753},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.58599999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1080000000000001,"5min":1.121,"15min":1.121},"last":0.83499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":937984,"data_stored":413503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39100000000000001,"15min":0.40100000000000002},"min":{"1min":0.27900000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.497,"15min":0.53100000000000003},"min":{"1min":0.315,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67700000000000005,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.32300000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.32200000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.437},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51500000000000001,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.65200000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.54300000000000004,"15min":0.57699999999999996},"min":{"1min":0.34899999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.57799999999999996,"5min":3.008,"15min":3.008},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47799999999999998,"15min":0.48399999999999999},"min":{"1min":0.33800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.65400000000000003,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.56799999999999995}]},{"osd":4,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78300000000000003,"15min":0.81699999999999995},"min":{"1min":0.50900000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.004,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0049999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.63400000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.75700000000000001,"15min":0.76800000000000002},"min":{"1min":0.51000000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98699999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78800000000000003,"15min":0.82899999999999996},"min":{"1min":0.52600000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98799999999999999,"5min":3.637,"15min":3.637},"last":0.46400000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.78000000000000003,"15min":0.79400000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97499999999999998,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.038,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.81499999999999995}]},{"osd":7,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.83499999999999996,"15min":0.89500000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.88400000000000001,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.82499999999999996,"15min":0.83899999999999997},"min":{"1min":0.56799999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0109999999999999,"5min":1.766,"15min":1.766},"last":0.77600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":933888,"data_stored":413469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.59799999999999998,"15min":0.67600000000000005},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.80300000000000005,"5min":5.2210000000000001,"15min":5.2210000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.73399999999999999,"15min":0.85899999999999999},"min":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59599999999999997,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.45300000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.71299999999999997,"15min":0.83899999999999997},"min":{"1min":0.32800000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.60999999999999999,"5min":8.2070000000000007,"15min":8.2070000000000007},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.63500000000000001,"15min":0.70399999999999996},"min":{"1min":0.34300000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.69299999999999995,"5min":4.351,"15min":4.351},"last":0.36499999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.80900000000000005,"15min":0.94199999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.754,"5min":8.1479999999999997,"15min":8.1479999999999997},"last":0.432},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.67400000000000004,"15min":0.76900000000000002},"min":{"1min":0.32300000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.72599999999999998,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.505}]},{"osd":4,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.91000000000000003,"15min":1.012},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0049999999999999,"5min":4.8470000000000004,"15min":4.8470000000000004},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.97599999999999998,"15min":1.0820000000000001},"min":{"1min":0.55100000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93999999999999995,"5min":4.7939999999999996,"15min":4.7939999999999996},"last":0.81799999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.90500000000000003,"15min":0.98699999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99199999999999999,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.89900000000000002,"15min":0.97899999999999998},"min":{"1min":0.53000000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.107,"5min":4.5830000000000002,"15min":4.5830000000000002},"last":0.751}]},{"osd":6,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.97999999999999998,"15min":1.097},"min":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.95799999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.97199999999999998,"15min":1.075},"min":{"1min":0.59399999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.95799999999999996,"5min":4.6289999999999996,"15min":4.6289999999999996},"last":0.70199999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.91600000000000004,"15min":1.002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.97699999999999998,"5min":4.665,"15min":4.665},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.98199999999999998,"15min":1.0860000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.089,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.89300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":1011712,"data_stored":1010452,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46899999999999997,"15min":0.495},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64000000000000001,"5min":1.863,"15min":1.863},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.75600000000000001,"15min":0.88600000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70799999999999996,"5min":8.2799999999999994,"15min":8.2799999999999994},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.78000000000000003,"15min":0.93200000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77300000000000002,"5min":7.9290000000000003,"15min":7.9290000000000003},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.434,"5min":0.78200000000000003,"15min":0.93700000000000006},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.628,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.44}]},{"osd":3,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.59799999999999998,"15min":0.67200000000000004},"min":{"1min":0.33100000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58699999999999997,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.75600000000000001,"15min":0.872},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82399999999999995,"5min":7.8890000000000002,"15min":7.8890000000000002},"last":0.497}]},{"osd":4,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.94899999999999995,"15min":1.0529999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95399999999999996,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.753,"15min":0.77800000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88600000000000001,"5min":1.607,"15min":1.607},"last":0.624}]},{"osd":5,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.81100000000000005,"15min":0.83099999999999996},"min":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96899999999999997,"5min":1.514,"15min":1.514},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.98899999999999999,"15min":1.1100000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91000000000000003,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.64000000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79200000000000004,"15min":0.82699999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.88,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.95399999999999996,"15min":1.0549999999999999},"min":{"1min":0.56100000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.89900000000000002,"5min":7.835,"15min":7.835},"last":0.65500000000000003}]},{"osd":7,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.97399999999999998,"15min":1.0800000000000001},"min":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.99299999999999999,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.81000000000000005,"15min":0.85399999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95199999999999996,"5min":1.794,"15min":1.794},"last":0.67700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:24:01.172 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:24:01.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.309+0000 7fc9287f5640 1 Processor -- start 2023-12-08T08:24:01.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.309+0000 7fc9287f5640 1 -- start start 2023-12-08T08:24:01.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.309+0000 7fc9287f5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc9200af4c0 0x7fc920154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:01.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.309+0000 7fc9287f5640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc92006c100 0x7fc9200c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:01.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.309+0000 7fc9287f5640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9200c4890 con 0x7fc9200c67d0 2023-12-08T08:24:01.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.309+0000 7fc9287f5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc920155460 con 0x7fc9200af4c0 2023-12-08T08:24:01.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.309+0000 7fc9287f5640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9200af8a0 con 0x7fc92006c100 2023-12-08T08:24:01.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.309+0000 7fc926591640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc9200af4c0 0x7fc920154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:01.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.309+0000 7fc926591640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc9200af4c0 0x7fc920154f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42916/0 (socket says 172.21.15.88:42916) 2023-12-08T08:24:01.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.309+0000 7fc926591640 1 -- 172.21.15.88:0/310376841 learned_addr learned my addr 172.21.15.88:0/310376841 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:01.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.309+0000 7fc926d92640 1 --2- 172.21.15.88:0/310376841 >> v2:172.21.15.148:3300/0 conn(0x7fc92006c100 0x7fc9200c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:01.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.309+0000 7fc926591640 1 -- 172.21.15.88:0/310376841 >> v2:172.21.15.148:3300/0 conn(0x7fc92006c100 msgr2=0x7fc9200c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:01.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.309+0000 7fc926591640 1 --2- 172.21.15.88:0/310376841 >> v2:172.21.15.148:3300/0 conn(0x7fc92006c100 0x7fc9200c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.309+0000 7fc926591640 1 -- 172.21.15.88:0/310376841 >> v1:172.21.15.148:6789/0 conn(0x7fc9200c67d0 legacy=0x7fc92006b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:01.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.309+0000 7fc926591640 1 -- 172.21.15.88:0/310376841 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9200c4b30 con 0x7fc9200af4c0 2023-12-08T08:24:01.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.309+0000 7fc926d92640 1 --2- 172.21.15.88:0/310376841 >> v2:172.21.15.148:3300/0 conn(0x7fc92006c100 0x7fc9200c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:24:01.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.313+0000 7fc926591640 1 --2- 172.21.15.88:0/310376841 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9200af4c0 0x7fc920154f20 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fc9200c9d90 tx=0x7fc91c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d4fd68e141693b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:01.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.313+0000 7fc92558f640 1 -- 172.21.15.88:0/310376841 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c0ab640 con 0x7fc9200af4c0 2023-12-08T08:24:01.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.313+0000 7fc92558f640 1 -- 172.21.15.88:0/310376841 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91c0a7070 con 0x7fc9200af4c0 2023-12-08T08:24:01.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.313+0000 7fc92558f640 1 -- 172.21.15.88:0/310376841 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c0ab9c0 con 0x7fc9200af4c0 2023-12-08T08:24:01.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.313+0000 7fc9287f5640 1 -- 172.21.15.88:0/310376841 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9200af4c0 msgr2=0x7fc920154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:01.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.313+0000 7fc9287f5640 1 --2- 172.21.15.88:0/310376841 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9200af4c0 0x7fc920154f20 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fc9200c9d90 tx=0x7fc91c01c440 comp rx=0 tx=0).stop 2023-12-08T08:24:01.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.313+0000 7fc9287f5640 1 -- 172.21.15.88:0/310376841 shutdown_connections 2023-12-08T08:24:01.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.313+0000 7fc9287f5640 1 --2- 172.21.15.88:0/310376841 >> v2:172.21.15.148:3300/0 conn(0x7fc92006c100 0x7fc9200c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.313+0000 7fc9287f5640 1 --2- 172.21.15.88:0/310376841 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9200af4c0 0x7fc920154f20 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.313+0000 7fc9287f5640 1 -- 172.21.15.88:0/310376841 >> 172.21.15.88:0/310376841 conn(0x7fc9200ab9d0 msgr2=0x7fc9200abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:01.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.313+0000 7fc9287f5640 1 -- 172.21.15.88:0/310376841 shutdown_connections 2023-12-08T08:24:01.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.313+0000 7fc9287f5640 1 -- 172.21.15.88:0/310376841 wait complete. 2023-12-08T08:24:01.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.317+0000 7fc9287f5640 1 Processor -- start 2023-12-08T08:24:01.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.317+0000 7fc9287f5640 1 -- start start 2023-12-08T08:24:01.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.317+0000 7fc9287f5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc92006c100 0x7fc9201ed560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:01.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.317+0000 7fc9287f5640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9200af4c0 0x7fc920152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:01.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.317+0000 7fc9287f5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9200c67d0 0x7fc9201f0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:01.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.317+0000 7fc9287f5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9200c24a0 con 0x7fc92006c100 2023-12-08T08:24:01.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.317+0000 7fc9287f5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9200bce80 con 0x7fc9200c67d0 2023-12-08T08:24:01.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.317+0000 7fc9287f5640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9200bd160 con 0x7fc9200af4c0 2023-12-08T08:24:01.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.317+0000 7fc926591640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc92006c100 0x7fc9201ed560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:01.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.317+0000 7fc926591640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc92006c100 0x7fc9201ed560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42922/0 (socket says 172.21.15.88:42922) 2023-12-08T08:24:01.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.317+0000 7fc926591640 1 -- 172.21.15.88:0/2507520007 learned_addr learned my addr 172.21.15.88:0/2507520007 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:01.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.317+0000 7fc925d90640 1 --2- 172.21.15.88:0/2507520007 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9200af4c0 0x7fc920152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:01.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.317+0000 7fc926d92640 1 --2- 172.21.15.88:0/2507520007 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9200c67d0 0x7fc9201f0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:01.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.317+0000 7fc926591640 1 -- 172.21.15.88:0/2507520007 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9200af4c0 msgr2=0x7fc920152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:01.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.317+0000 7fc926591640 1 --2- 172.21.15.88:0/2507520007 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9200af4c0 0x7fc920152310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.317+0000 7fc926591640 1 -- 172.21.15.88:0/2507520007 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9200c67d0 msgr2=0x7fc9201f0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:01.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.317+0000 7fc926591640 1 --2- 172.21.15.88:0/2507520007 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9200c67d0 0x7fc9201f0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.317+0000 7fc926591640 1 -- 172.21.15.88:0/2507520007 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91c0094d0 con 0x7fc92006c100 2023-12-08T08:24:01.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.317+0000 7fc926591640 1 --2- 172.21.15.88:0/2507520007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc92006c100 0x7fc9201ed560 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fc91c019050 tx=0x7fc91c01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:01.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.317+0000 7fc916ffd640 1 -- 172.21.15.88:0/2507520007 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c0be3f0 con 0x7fc92006c100 2023-12-08T08:24:01.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.317+0000 7fc916ffd640 1 -- 172.21.15.88:0/2507520007 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91c0be550 con 0x7fc92006c100 2023-12-08T08:24:01.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.317+0000 7fc9287f5640 1 -- 172.21.15.88:0/2507520007 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9201ecd80 con 0x7fc92006c100 2023-12-08T08:24:01.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.317+0000 7fc916ffd640 1 -- 172.21.15.88:0/2507520007 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c0be900 con 0x7fc92006c100 2023-12-08T08:24:01.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.317+0000 7fc9287f5640 1 -- 172.21.15.88:0/2507520007 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9201edaa0 con 0x7fc92006c100 2023-12-08T08:24:01.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.321+0000 7fc9287f5640 1 -- 172.21.15.88:0/2507520007 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc920067630 con 0x7fc92006c100 2023-12-08T08:24:01.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.321+0000 7fc916ffd640 1 -- 172.21.15.88:0/2507520007 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc91c0c7440 con 0x7fc92006c100 2023-12-08T08:24:01.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.321+0000 7fc916ffd640 1 --2- 172.21.15.88:0/2507520007 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc904066470 0x7fc904068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:01.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.321+0000 7fc916ffd640 1 -- 172.21.15.88:0/2507520007 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fc91c11e490 con 0x7fc92006c100 2023-12-08T08:24:01.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.321+0000 7fc925d90640 1 --2- 172.21.15.88:0/2507520007 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc904066470 0x7fc904068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:01.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.321+0000 7fc925d90640 1 --2- 172.21.15.88:0/2507520007 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc904066470 0x7fc904068930 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc9201f12a0 tx=0x7fc910009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:01.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.325+0000 7fc916ffd640 1 -- 172.21.15.88:0/2507520007 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc91c0ebcf0 con 0x7fc92006c100 2023-12-08T08:24:01.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.473+0000 7fc9287f5640 1 -- 172.21.15.88:0/2507520007 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc92006cae0 con 0x7fc904066470 2023-12-08T08:24:01.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.473+0000 7fc916ffd640 1 -- 172.21.15.88:0/2507520007 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50834 (secure 0 0 0) 0x7fc9100014f0 con 0x7fc904066470 2023-12-08T08:24:01.480 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:24:01.480 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:24:01.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.477+0000 7fc9287f5640 1 -- 172.21.15.88:0/2507520007 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc904066470 msgr2=0x7fc904068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:01.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.477+0000 7fc9287f5640 1 --2- 172.21.15.88:0/2507520007 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc904066470 0x7fc904068930 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc9201f12a0 tx=0x7fc910009040 comp rx=0 tx=0).stop 2023-12-08T08:24:01.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.477+0000 7fc9287f5640 1 -- 172.21.15.88:0/2507520007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc92006c100 msgr2=0x7fc9201ed560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:01.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.477+0000 7fc9287f5640 1 --2- 172.21.15.88:0/2507520007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc92006c100 0x7fc9201ed560 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fc91c019050 tx=0x7fc91c01ac80 comp rx=0 tx=0).stop 2023-12-08T08:24:01.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.477+0000 7fc9287f5640 1 -- 172.21.15.88:0/2507520007 shutdown_connections 2023-12-08T08:24:01.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.477+0000 7fc9287f5640 1 --2- 172.21.15.88:0/2507520007 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc904066470 0x7fc904068930 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.477+0000 7fc9287f5640 1 --2- 172.21.15.88:0/2507520007 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9200c67d0 0x7fc9201f0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.477+0000 7fc9287f5640 1 --2- 172.21.15.88:0/2507520007 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc9200af4c0 0x7fc920152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.477+0000 7fc9287f5640 1 --2- 172.21.15.88:0/2507520007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc92006c100 0x7fc9201ed560 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.477+0000 7fc9287f5640 1 -- 172.21.15.88:0/2507520007 >> 172.21.15.88:0/2507520007 conn(0x7fc9200ab9d0 msgr2=0x7fc9200733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:01.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.477+0000 7fc9287f5640 1 -- 172.21.15.88:0/2507520007 shutdown_connections 2023-12-08T08:24:01.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.477+0000 7fc9287f5640 1 -- 172.21.15.88:0/2507520007 wait complete. 2023-12-08T08:24:01.500 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2023-12-08T08:24:00.794090+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256972,"kb_used_data":7528,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717748,"statfs":{"total":773094113280,"available":772830973952,"internally_reserved":0,"allocated":7708672,"data_stored":4536226,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12079,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-60,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001329"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":212,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-08T08:23:52.635443+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:23:52.635443+0000","last_peered":"2023-12-08T08:23:52.635443+0000","last_clean":"2023-12-08T08:23:52.635443+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:23:52.635443+0000","last_undegraded":"2023-12-08T08:23:52.635443+0000","last_fullsized":"2023-12-08T08:23:52.635443+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":1003520,"data_stored":1003811,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.64900000000000002,"15min":0.64400000000000002},"min":{"1min":0.49399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.71899999999999997,"15min":0.74099999999999999},"min":{"1min":0.53400000000000003,"5min":0.372,"15min":0.372},"max":{"1min":1.0109999999999999,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.73399999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70099999999999996,"15min":0.71899999999999997},"min":{"1min":0.47199999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.94299999999999995,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.73499999999999999,"15min":0.753},"min":{"1min":0.54300000000000004,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.96099999999999997,"5min":1.446,"15min":1.446},"last":0.95499999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.98899999999999999,"5min":1.379,"15min":1.379},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71899999999999997,"15min":0.73099999999999998},"min":{"1min":0.56799999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.90500000000000003,"5min":1.706,"15min":1.706},"last":0.80900000000000005}]},{"osd":3,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73699999999999999,"15min":0.75900000000000001},"min":{"1min":0.51000000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93899999999999995,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.76100000000000001,"15min":0.78700000000000003},"min":{"1min":0.52100000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.90100000000000002,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.0920000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.69799999999999995,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88600000000000001,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.70699999999999996,"15min":0.73499999999999999},"min":{"1min":0.48799999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89800000000000002,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.98599999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.753,"15min":0.78800000000000003},"min":{"1min":0.44500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.94099999999999995,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.76000000000000001,"15min":0.79400000000000004},"min":{"1min":0.52300000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.95199999999999996,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.78000000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.82499999999999996,"15min":0.85699999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.92300000000000004,"5min":1.573,"15min":1.573},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.77800000000000002,"15min":0.80800000000000005},"min":{"1min":0.55100000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97099999999999997,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.92900000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":937984,"data_stored":413983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.66800000000000004},"min":{"1min":0.49099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.56899999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94599999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.67000000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72499999999999998,"15min":0.71899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73599999999999999,"15min":0.73399999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70899999999999996,"15min":0.72499999999999998},"min":{"1min":0.50700000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.90900000000000003,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73599999999999999,"15min":0.746},"min":{"1min":0.48899999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.76200000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.73799999999999999,"15min":0.75700000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.875},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.46600000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.96299999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.81699999999999995}]},{"osd":4,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.70199999999999996,"15min":0.72599999999999998},"min":{"1min":0.42899999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83399999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.71699999999999997,"15min":0.755},"min":{"1min":0.496,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79700000000000004,"5min":1.014,"15min":1.014},"last":0.79900000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.75,"15min":0.79100000000000004},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83099999999999996,"5min":1.091,"15min":1.091},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.81699999999999995,"15min":0.84299999999999997},"min":{"1min":0.57199999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0149999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.89400000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78600000000000003,"15min":0.81599999999999995},"min":{"1min":0.61799999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.89000000000000001,"5min":1.04,"15min":1.04},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.84199999999999997,"15min":0.89200000000000002},"min":{"1min":0.55400000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96499999999999997,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.85699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":946176,"data_stored":419572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.621,"15min":0.622},"min":{"1min":0.47599999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.042,"5min":1.081,"15min":1.081},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68300000000000005,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.024,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.82799999999999996}]},{"osd":1,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69099999999999995,"15min":0.68100000000000005},"min":{"1min":0.42399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98599999999999999,"5min":1.194,"15min":1.194},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.006,"5min":1.143,"15min":1.143},"last":0.80700000000000005}]},{"osd":2,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.47999999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0880000000000001,"5min":1.101,"15min":1.101},"last":0.95699999999999996}]},{"osd":3,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72999999999999998,"15min":0.74199999999999999},"min":{"1min":0.52300000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.76300000000000001,"15min":0.753},"min":{"1min":0.56200000000000006,"5min":0.5,"15min":0.5},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":1.173}]},{"osd":4,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.40899999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.96299999999999997,"5min":1.01,"15min":1.01},"last":0.879},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.58899999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.048,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.99399999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.75700000000000001,"15min":0.77900000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89900000000000002,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":1.115},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91000000000000003,"5min":1.073,"15min":1.073},"last":0.92200000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77600000000000002,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95999999999999996,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83599999999999997,"15min":0.85599999999999998},"min":{"1min":0.56299999999999994,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0800000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":1.353}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":430769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.68000000000000005,"15min":0.69399999999999995},"min":{"1min":0.502,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86099999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.68300000000000005,"15min":0.66800000000000004},"min":{"1min":0.59399999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95099999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.436}]},{"osd":1,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70799999999999996,"15min":0.71299999999999997},"min":{"1min":0.52800000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90100000000000002,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68100000000000005,"15min":0.68200000000000005},"min":{"1min":0.505,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.84499999999999997,"5min":1.002,"15min":1.002},"last":0.61499999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68999999999999995},"min":{"1min":0.54200000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88400000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.54400000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.84699999999999998,"5min":1.056,"15min":1.056},"last":0.505}]},{"osd":3,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.58999999999999997,"5min":0.496,"15min":0.496},"max":{"1min":0.95299999999999996,"5min":1.359,"15min":1.359},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.755,"15min":0.78500000000000003},"min":{"1min":0.51800000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99399999999999999,"5min":1.232,"15min":1.232},"last":0.63200000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.64200000000000002,"15min":0.66800000000000004},"min":{"1min":0.39000000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90800000000000003,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.745,"15min":0.78100000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95199999999999996,"5min":1.091,"15min":1.091},"last":0.55300000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.68600000000000005,"15min":0.71499999999999997},"min":{"1min":0.41699999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.92500000000000004,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.76300000000000001,"15min":0.78900000000000003},"min":{"1min":0.45300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98199999999999998,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.68700000000000006}]},{"osd":7,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.97699999999999998,"5min":1.246,"15min":1.246},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.80200000000000005},"min":{"1min":0.50800000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.004,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.70799999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":966656,"data_stored":430667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41799999999999998,"15min":0.432},"min":{"1min":0.26500000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.56000000000000005,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45600000000000002,"15min":0.46300000000000002},"min":{"1min":0.309,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73999999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.40200000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.435,"15min":0.436},"min":{"1min":0.317,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.58099999999999996,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.58999999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.50900000000000001,"15min":0.52200000000000002},"min":{"1min":0.35299999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52900000000000003,"15min":0.54100000000000004},"min":{"1min":0.40600000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65200000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.45300000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0620000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.54300000000000004,"5min":0.497,"15min":0.497},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.878}]},{"osd":5,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.52000000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.76200000000000001,"15min":0.77100000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.91200000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.56899999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.101,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.93300000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.76200000000000001,"15min":0.75900000000000001},"min":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.753},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.58599999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1080000000000001,"5min":1.121,"15min":1.121},"last":0.83499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":937984,"data_stored":413503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39100000000000001,"15min":0.40100000000000002},"min":{"1min":0.27900000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.497,"15min":0.53100000000000003},"min":{"1min":0.315,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67700000000000005,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.32300000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.32200000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.437},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51500000000000001,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.65200000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.54300000000000004,"15min":0.57699999999999996},"min":{"1min":0.34899999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.57799999999999996,"5min":3.008,"15min":3.008},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47799999999999998,"15min":0.48399999999999999},"min":{"1min":0.33800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.65400000000000003,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.56799999999999995}]},{"osd":4,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78300000000000003,"15min":0.81699999999999995},"min":{"1min":0.50900000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.004,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0049999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.63400000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.75700000000000001,"15min":0.76800000000000002},"min":{"1min":0.51000000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98699999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78800000000000003,"15min":0.82899999999999996},"min":{"1min":0.52600000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98799999999999999,"5min":3.637,"15min":3.637},"last":0.46400000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.78000000000000003,"15min":0.79400000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97499999999999998,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.038,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.81499999999999995}]},{"osd":7,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.83499999999999996,"15min":0.89500000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.88400000000000001,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.82499999999999996,"15min":0.83899999999999997},"min":{"1min":0.56799999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0109999999999999,"5min":1.766,"15min":1.766},"last":0.77600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":933888,"data_stored":413469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.59799999999999998,"15min":0.67600000000000005},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.80300000000000005,"5min":5.2210000000000001,"15min":5.2210000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.73399999999999999,"15min":0.85899999999999999},"min":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59599999999999997,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.45300000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.71299999999999997,"15min":0.83899999999999997},"min":{"1min":0.32800000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.60999999999999999,"5min":8.2070000000000007,"15min":8.2070000000000007},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.63500000000000001,"15min":0.70399999999999996},"min":{"1min":0.34300000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.69299999999999995,"5min":4.351,"15min":4.351},"last":0.36499999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.80900000000000005,"15min":0.94199999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.754,"5min":8.1479999999999997,"15min":8.1479999999999997},"last":0.432},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.67400000000000004,"15min":0.76900000000000002},"min":{"1min":0.32300000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.72599999999999998,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.505}]},{"osd":4,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.91000000000000003,"15min":1.012},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0049999999999999,"5min":4.8470000000000004,"15min":4.8470000000000004},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.97599999999999998,"15min":1.0820000000000001},"min":{"1min":0.55100000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93999999999999995,"5min":4.7939999999999996,"15min":4.7939999999999996},"last":0.81799999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.90500000000000003,"15min":0.98699999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99199999999999999,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.89900000000000002,"15min":0.97899999999999998},"min":{"1min":0.53000000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.107,"5min":4.5830000000000002,"15min":4.5830000000000002},"last":0.751}]},{"osd":6,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.97999999999999998,"15min":1.097},"min":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.95799999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.97199999999999998,"15min":1.075},"min":{"1min":0.59399999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.95799999999999996,"5min":4.6289999999999996,"15min":4.6289999999999996},"last":0.70199999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.91600000000000004,"15min":1.002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.97699999999999998,"5min":4.665,"15min":4.665},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.98199999999999998,"15min":1.0860000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.089,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.89300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":1011712,"data_stored":1010452,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46899999999999997,"15min":0.495},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64000000000000001,"5min":1.863,"15min":1.863},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.75600000000000001,"15min":0.88600000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70799999999999996,"5min":8.2799999999999994,"15min":8.2799999999999994},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.78000000000000003,"15min":0.93200000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77300000000000002,"5min":7.9290000000000003,"15min":7.9290000000000003},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.434,"5min":0.78200000000000003,"15min":0.93700000000000006},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.628,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.44}]},{"osd":3,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.59799999999999998,"15min":0.67200000000000004},"min":{"1min":0.33100000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58699999999999997,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.75600000000000001,"15min":0.872},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82399999999999995,"5min":7.8890000000000002,"15min":7.8890000000000002},"last":0.497}]},{"osd":4,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.94899999999999995,"15min":1.0529999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95399999999999996,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.753,"15min":0.77800000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88600000000000001,"5min":1.607,"15min":1.607},"last":0.624}]},{"osd":5,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.81100000000000005,"15min":0.83099999999999996},"min":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96899999999999997,"5min":1.514,"15min":1.514},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.98899999999999999,"15min":1.1100000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91000000000000003,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.64000000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79200000000000004,"15min":0.82699999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.88,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.95399999999999996,"15min":1.0549999999999999},"min":{"1min":0.56100000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.89900000000000002,"5min":7.835,"15min":7.835},"last":0.65500000000000003}]},{"osd":7,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.97399999999999998,"15min":1.0800000000000001},"min":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.99299999999999999,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.81000000000000005,"15min":0.85399999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95199999999999996,"5min":1.794,"15min":1.794},"last":0.67700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:24:01.502 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-08T08:24:01.502 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:24:01.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.633+0000 7f187fafe640 1 Processor -- start 2023-12-08T08:24:01.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.633+0000 7f187fafe640 1 -- start start 2023-12-08T08:24:01.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.637+0000 7f187fafe640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f187806d2b0 0x7f187806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:01.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.637+0000 7f187fafe640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f18780c3b80 0x7f18780c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:01.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.637+0000 7f187fafe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f187806c020 0x7f187806c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:01.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.637+0000 7f187fafe640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18780c5840 con 0x7f187806c020 2023-12-08T08:24:01.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.637+0000 7f187fafe640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f187806bb80 con 0x7f18780c3b80 2023-12-08T08:24:01.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.637+0000 7f187fafe640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18781515c0 con 0x7f187806d2b0 2023-12-08T08:24:01.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.637+0000 7f187e09b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f187806c020 0x7f187806c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:01.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.637+0000 7f187d099640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f18780c3b80 0x7f18780c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:01.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.637+0000 7f187d89a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f187806d2b0 0x7f187806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:01.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.637+0000 7f187e09b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f187806c020 0x7f187806c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42934/0 (socket says 172.21.15.88:42934) 2023-12-08T08:24:01.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.637+0000 7f187e09b640 1 -- 172.21.15.88:0/161845613 learned_addr learned my addr 172.21.15.88:0/161845613 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:01.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.637+0000 7f187e09b640 1 -- 172.21.15.88:0/161845613 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f187806d2b0 msgr2=0x7f187806d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:01.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.637+0000 7f187e09b640 1 --2- 172.21.15.88:0/161845613 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f187806d2b0 0x7f187806d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.637+0000 7f187e09b640 1 -- 172.21.15.88:0/161845613 >> v2:172.21.15.148:3300/0 conn(0x7f18780c3b80 msgr2=0x7f18780c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:01.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.637+0000 7f187e09b640 1 --2- 172.21.15.88:0/161845613 >> v2:172.21.15.148:3300/0 conn(0x7f18780c3b80 0x7f18780c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.637+0000 7f187e09b640 1 -- 172.21.15.88:0/161845613 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18781518a0 con 0x7f187806c020 2023-12-08T08:24:01.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.637+0000 7f187d099640 1 --2- 172.21.15.88:0/161845613 >> v2:172.21.15.148:3300/0 conn(0x7f18780c3b80 0x7f18780c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:24:01.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.641+0000 7f187e09b640 1 --2- 172.21.15.88:0/161845613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f187806c020 0x7f187806c4b0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f18780c59c0 tx=0x7f187001eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f9c5acaa5a881c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:01.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.641+0000 7f187c898640 1 -- 172.21.15.88:0/161845613 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187000b2d0 con 0x7f187806c020 2023-12-08T08:24:01.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.641+0000 7f187c898640 1 -- 172.21.15.88:0/161845613 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187000b430 con 0x7f187806c020 2023-12-08T08:24:01.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.641+0000 7f187c898640 1 -- 172.21.15.88:0/161845613 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18700a7b60 con 0x7f187806c020 2023-12-08T08:24:01.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.641+0000 7f187fafe640 1 -- 172.21.15.88:0/161845613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f187806c020 msgr2=0x7f187806c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:01.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.641+0000 7f187fafe640 1 --2- 172.21.15.88:0/161845613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f187806c020 0x7f187806c4b0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f18780c59c0 tx=0x7f187001eba0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.641+0000 7f187fafe640 1 -- 172.21.15.88:0/161845613 shutdown_connections 2023-12-08T08:24:01.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.641+0000 7f187fafe640 1 --2- 172.21.15.88:0/161845613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f187806c020 0x7f187806c4b0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.641+0000 7f187fafe640 1 --2- 172.21.15.88:0/161845613 >> v2:172.21.15.148:3300/0 conn(0x7f18780c3b80 0x7f18780c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.641+0000 7f187fafe640 1 --2- 172.21.15.88:0/161845613 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f187806d2b0 0x7f187806d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.641+0000 7f187fafe640 1 -- 172.21.15.88:0/161845613 >> 172.21.15.88:0/161845613 conn(0x7f18780a7810 msgr2=0x7f18780a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:01.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.641+0000 7f187fafe640 1 -- 172.21.15.88:0/161845613 shutdown_connections 2023-12-08T08:24:01.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.641+0000 7f187fafe640 1 -- 172.21.15.88:0/161845613 wait complete. 2023-12-08T08:24:01.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.641+0000 7f187fafe640 1 Processor -- start 2023-12-08T08:24:01.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.641+0000 7f187fafe640 1 -- start start 2023-12-08T08:24:01.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.645+0000 7f187fafe640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f187806c020 0x7f1878146090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:01.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.645+0000 7f187fafe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f187806d2b0 0x7f18781e3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:01.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.645+0000 7f187fafe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18780c3b80 0x7f18781ece70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:01.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.645+0000 7f187fafe640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18781e4980 con 0x7f187806d2b0 2023-12-08T08:24:01.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.645+0000 7f187fafe640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18780c43d0 con 0x7f18780c3b80 2023-12-08T08:24:01.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.645+0000 7f187fafe640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1878145db0 con 0x7f187806c020 2023-12-08T08:24:01.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.645+0000 7f187d099640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f187806d2b0 0x7f18781e3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:01.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.645+0000 7f187d099640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f187806d2b0 0x7f18781e3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42938/0 (socket says 172.21.15.88:42938) 2023-12-08T08:24:01.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.645+0000 7f187d099640 1 -- 172.21.15.88:0/3771560600 learned_addr learned my addr 172.21.15.88:0/3771560600 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:01.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.645+0000 7f187e09b640 1 --2- 172.21.15.88:0/3771560600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18780c3b80 0x7f18781ece70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:01.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.645+0000 7f187d89a640 1 --2- 172.21.15.88:0/3771560600 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f187806c020 0x7f1878146090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:01.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.645+0000 7f187d099640 1 -- 172.21.15.88:0/3771560600 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f187806c020 msgr2=0x7f1878146090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:01.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.645+0000 7f187d099640 1 --2- 172.21.15.88:0/3771560600 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f187806c020 0x7f1878146090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.645+0000 7f187d099640 1 -- 172.21.15.88:0/3771560600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18780c3b80 msgr2=0x7f18781ece70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:01.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.645+0000 7f187d099640 1 --2- 172.21.15.88:0/3771560600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18780c3b80 0x7f18781ece70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.645+0000 7f187d099640 1 -- 172.21.15.88:0/3771560600 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1868009420 con 0x7f187806d2b0 2023-12-08T08:24:01.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.645+0000 7f187d099640 1 --2- 172.21.15.88:0/3771560600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f187806d2b0 0x7f18781e3ce0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f186800e980 tx=0x7f186800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:01.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.645+0000 7f186e7fc640 1 -- 172.21.15.88:0/3771560600 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186800ca00 con 0x7f187806d2b0 2023-12-08T08:24:01.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.645+0000 7f186e7fc640 1 -- 172.21.15.88:0/3771560600 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186800cb60 con 0x7f187806d2b0 2023-12-08T08:24:01.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.645+0000 7f187fafe640 1 -- 172.21.15.88:0/3771560600 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f187000bd40 con 0x7f187806d2b0 2023-12-08T08:24:01.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.645+0000 7f186e7fc640 1 -- 172.21.15.88:0/3771560600 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1868013470 con 0x7f187806d2b0 2023-12-08T08:24:01.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.645+0000 7f187fafe640 1 -- 172.21.15.88:0/3771560600 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f187814ef80 con 0x7f187806d2b0 2023-12-08T08:24:01.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.645+0000 7f187fafe640 1 -- 172.21.15.88:0/3771560600 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18780c4230 con 0x7f187806d2b0 2023-12-08T08:24:01.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.645+0000 7f186e7fc640 1 -- 172.21.15.88:0/3771560600 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f18680135d0 con 0x7f187806d2b0 2023-12-08T08:24:01.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.649+0000 7f186e7fc640 1 --2- 172.21.15.88:0/3771560600 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f185c0664a0 0x7f185c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:01.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.649+0000 7f186e7fc640 1 -- 172.21.15.88:0/3771560600 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f18680841c0 con 0x7f187806d2b0 2023-12-08T08:24:01.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.649+0000 7f187d89a640 1 --2- 172.21.15.88:0/3771560600 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f185c0664a0 0x7f185c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:01.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.649+0000 7f187d89a640 1 --2- 172.21.15.88:0/3771560600 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f185c0664a0 0x7f185c068960 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1878145bc0 tx=0x7f1874009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:01.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.653+0000 7f186e7fc640 1 -- 172.21.15.88:0/3771560600 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f18780c4230 con 0x7f187806d2b0 2023-12-08T08:24:01.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.797+0000 7f187fafe640 1 -- 172.21.15.88:0/3771560600 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f187814ee00 con 0x7f185c0664a0 2023-12-08T08:24:01.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.801+0000 7f186e7fc640 1 -- 172.21.15.88:0/3771560600 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50834 (secure 0 0 0) 0x7f1874011a60 con 0x7f185c0664a0 2023-12-08T08:24:01.807 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:24:01.807 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:24:01.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.801+0000 7f187fafe640 1 -- 172.21.15.88:0/3771560600 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f185c0664a0 msgr2=0x7f185c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:01.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.801+0000 7f187fafe640 1 --2- 172.21.15.88:0/3771560600 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f185c0664a0 0x7f185c068960 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1878145bc0 tx=0x7f1874009190 comp rx=0 tx=0).stop 2023-12-08T08:24:01.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.801+0000 7f187fafe640 1 -- 172.21.15.88:0/3771560600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f187806d2b0 msgr2=0x7f18781e3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:01.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.801+0000 7f187fafe640 1 --2- 172.21.15.88:0/3771560600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f187806d2b0 0x7f18781e3ce0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f186800e980 tx=0x7f186800ee40 comp rx=0 tx=0).stop 2023-12-08T08:24:01.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.801+0000 7f187fafe640 1 -- 172.21.15.88:0/3771560600 shutdown_connections 2023-12-08T08:24:01.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.801+0000 7f187fafe640 1 --2- 172.21.15.88:0/3771560600 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f185c0664a0 0x7f185c068960 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.801+0000 7f187fafe640 1 --2- 172.21.15.88:0/3771560600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18780c3b80 0x7f18781ece70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.801+0000 7f187fafe640 1 --2- 172.21.15.88:0/3771560600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f187806d2b0 0x7f18781e3ce0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.801+0000 7f187fafe640 1 --2- 172.21.15.88:0/3771560600 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f187806c020 0x7f1878146090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.801+0000 7f187fafe640 1 -- 172.21.15.88:0/3771560600 >> 172.21.15.88:0/3771560600 conn(0x7f18780a7810 msgr2=0x7f187815af80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:01.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.801+0000 7f187fafe640 1 -- 172.21.15.88:0/3771560600 shutdown_connections 2023-12-08T08:24:01.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.801+0000 7f187fafe640 1 -- 172.21.15.88:0/3771560600 wait complete. 2023-12-08T08:24:01.827 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2023-12-08T08:24:00.794090+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256972,"kb_used_data":7528,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717748,"statfs":{"total":773094113280,"available":772830973952,"internally_reserved":0,"allocated":7708672,"data_stored":4536226,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12079,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-60,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001329"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":212,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-08T08:23:52.635443+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:23:52.635443+0000","last_peered":"2023-12-08T08:23:52.635443+0000","last_clean":"2023-12-08T08:23:52.635443+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:23:52.635443+0000","last_undegraded":"2023-12-08T08:23:52.635443+0000","last_fullsized":"2023-12-08T08:23:52.635443+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":1003520,"data_stored":1003811,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.64900000000000002,"15min":0.64400000000000002},"min":{"1min":0.49399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.71899999999999997,"15min":0.74099999999999999},"min":{"1min":0.53400000000000003,"5min":0.372,"15min":0.372},"max":{"1min":1.0109999999999999,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.73399999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70099999999999996,"15min":0.71899999999999997},"min":{"1min":0.47199999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.94299999999999995,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.73499999999999999,"15min":0.753},"min":{"1min":0.54300000000000004,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.96099999999999997,"5min":1.446,"15min":1.446},"last":0.95499999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.98899999999999999,"5min":1.379,"15min":1.379},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71899999999999997,"15min":0.73099999999999998},"min":{"1min":0.56799999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.90500000000000003,"5min":1.706,"15min":1.706},"last":0.80900000000000005}]},{"osd":3,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73699999999999999,"15min":0.75900000000000001},"min":{"1min":0.51000000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93899999999999995,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.76100000000000001,"15min":0.78700000000000003},"min":{"1min":0.52100000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.90100000000000002,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.0920000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.69799999999999995,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88600000000000001,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.70699999999999996,"15min":0.73499999999999999},"min":{"1min":0.48799999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89800000000000002,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.98599999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.753,"15min":0.78800000000000003},"min":{"1min":0.44500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.94099999999999995,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.76000000000000001,"15min":0.79400000000000004},"min":{"1min":0.52300000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.95199999999999996,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.78000000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.82499999999999996,"15min":0.85699999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.92300000000000004,"5min":1.573,"15min":1.573},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.77800000000000002,"15min":0.80800000000000005},"min":{"1min":0.55100000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97099999999999997,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.92900000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":937984,"data_stored":413983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.66800000000000004},"min":{"1min":0.49099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.56899999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94599999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.67000000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72499999999999998,"15min":0.71899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73599999999999999,"15min":0.73399999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70899999999999996,"15min":0.72499999999999998},"min":{"1min":0.50700000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.90900000000000003,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73599999999999999,"15min":0.746},"min":{"1min":0.48899999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.76200000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.73799999999999999,"15min":0.75700000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.875},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.46600000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.96299999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.81699999999999995}]},{"osd":4,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.70199999999999996,"15min":0.72599999999999998},"min":{"1min":0.42899999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83399999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.71699999999999997,"15min":0.755},"min":{"1min":0.496,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79700000000000004,"5min":1.014,"15min":1.014},"last":0.79900000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.75,"15min":0.79100000000000004},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83099999999999996,"5min":1.091,"15min":1.091},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.81699999999999995,"15min":0.84299999999999997},"min":{"1min":0.57199999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0149999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.89400000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78600000000000003,"15min":0.81599999999999995},"min":{"1min":0.61799999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.89000000000000001,"5min":1.04,"15min":1.04},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.84199999999999997,"15min":0.89200000000000002},"min":{"1min":0.55400000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96499999999999997,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.85699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":946176,"data_stored":419572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.621,"15min":0.622},"min":{"1min":0.47599999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.042,"5min":1.081,"15min":1.081},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68300000000000005,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.024,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.82799999999999996}]},{"osd":1,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69099999999999995,"15min":0.68100000000000005},"min":{"1min":0.42399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98599999999999999,"5min":1.194,"15min":1.194},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.006,"5min":1.143,"15min":1.143},"last":0.80700000000000005}]},{"osd":2,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.47999999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0880000000000001,"5min":1.101,"15min":1.101},"last":0.95699999999999996}]},{"osd":3,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72999999999999998,"15min":0.74199999999999999},"min":{"1min":0.52300000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.76300000000000001,"15min":0.753},"min":{"1min":0.56200000000000006,"5min":0.5,"15min":0.5},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":1.173}]},{"osd":4,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.40899999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.96299999999999997,"5min":1.01,"15min":1.01},"last":0.879},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.58899999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.048,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.99399999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.75700000000000001,"15min":0.77900000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89900000000000002,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":1.115},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91000000000000003,"5min":1.073,"15min":1.073},"last":0.92200000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77600000000000002,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95999999999999996,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83599999999999997,"15min":0.85599999999999998},"min":{"1min":0.56299999999999994,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0800000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":1.353}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":430769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.68000000000000005,"15min":0.69399999999999995},"min":{"1min":0.502,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86099999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.68300000000000005,"15min":0.66800000000000004},"min":{"1min":0.59399999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95099999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.436}]},{"osd":1,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70799999999999996,"15min":0.71299999999999997},"min":{"1min":0.52800000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90100000000000002,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68100000000000005,"15min":0.68200000000000005},"min":{"1min":0.505,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.84499999999999997,"5min":1.002,"15min":1.002},"last":0.61499999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68999999999999995},"min":{"1min":0.54200000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88400000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.54400000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.84699999999999998,"5min":1.056,"15min":1.056},"last":0.505}]},{"osd":3,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.58999999999999997,"5min":0.496,"15min":0.496},"max":{"1min":0.95299999999999996,"5min":1.359,"15min":1.359},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.755,"15min":0.78500000000000003},"min":{"1min":0.51800000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99399999999999999,"5min":1.232,"15min":1.232},"last":0.63200000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.64200000000000002,"15min":0.66800000000000004},"min":{"1min":0.39000000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90800000000000003,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.745,"15min":0.78100000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95199999999999996,"5min":1.091,"15min":1.091},"last":0.55300000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.68600000000000005,"15min":0.71499999999999997},"min":{"1min":0.41699999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.92500000000000004,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.76300000000000001,"15min":0.78900000000000003},"min":{"1min":0.45300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98199999999999998,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.68700000000000006}]},{"osd":7,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.97699999999999998,"5min":1.246,"15min":1.246},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.80200000000000005},"min":{"1min":0.50800000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.004,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.70799999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":966656,"data_stored":430667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41799999999999998,"15min":0.432},"min":{"1min":0.26500000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.56000000000000005,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45600000000000002,"15min":0.46300000000000002},"min":{"1min":0.309,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73999999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.40200000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.435,"15min":0.436},"min":{"1min":0.317,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.58099999999999996,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.58999999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.50900000000000001,"15min":0.52200000000000002},"min":{"1min":0.35299999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52900000000000003,"15min":0.54100000000000004},"min":{"1min":0.40600000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65200000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.45300000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0620000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.54300000000000004,"5min":0.497,"15min":0.497},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.878}]},{"osd":5,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.52000000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.76200000000000001,"15min":0.77100000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.91200000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.56899999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.101,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.93300000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.76200000000000001,"15min":0.75900000000000001},"min":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.753},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.58599999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1080000000000001,"5min":1.121,"15min":1.121},"last":0.83499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":937984,"data_stored":413503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39100000000000001,"15min":0.40100000000000002},"min":{"1min":0.27900000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.497,"15min":0.53100000000000003},"min":{"1min":0.315,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67700000000000005,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.32300000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.32200000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.437},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51500000000000001,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.65200000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.54300000000000004,"15min":0.57699999999999996},"min":{"1min":0.34899999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.57799999999999996,"5min":3.008,"15min":3.008},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47799999999999998,"15min":0.48399999999999999},"min":{"1min":0.33800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.65400000000000003,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.56799999999999995}]},{"osd":4,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78300000000000003,"15min":0.81699999999999995},"min":{"1min":0.50900000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.004,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0049999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.63400000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.75700000000000001,"15min":0.76800000000000002},"min":{"1min":0.51000000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98699999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78800000000000003,"15min":0.82899999999999996},"min":{"1min":0.52600000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98799999999999999,"5min":3.637,"15min":3.637},"last":0.46400000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.78000000000000003,"15min":0.79400000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97499999999999998,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.038,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.81499999999999995}]},{"osd":7,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.83499999999999996,"15min":0.89500000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.88400000000000001,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.82499999999999996,"15min":0.83899999999999997},"min":{"1min":0.56799999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0109999999999999,"5min":1.766,"15min":1.766},"last":0.77600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":933888,"data_stored":413469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.59799999999999998,"15min":0.67600000000000005},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.80300000000000005,"5min":5.2210000000000001,"15min":5.2210000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.73399999999999999,"15min":0.85899999999999999},"min":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59599999999999997,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.45300000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.71299999999999997,"15min":0.83899999999999997},"min":{"1min":0.32800000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.60999999999999999,"5min":8.2070000000000007,"15min":8.2070000000000007},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.63500000000000001,"15min":0.70399999999999996},"min":{"1min":0.34300000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.69299999999999995,"5min":4.351,"15min":4.351},"last":0.36499999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.80900000000000005,"15min":0.94199999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.754,"5min":8.1479999999999997,"15min":8.1479999999999997},"last":0.432},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.67400000000000004,"15min":0.76900000000000002},"min":{"1min":0.32300000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.72599999999999998,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.505}]},{"osd":4,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.91000000000000003,"15min":1.012},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0049999999999999,"5min":4.8470000000000004,"15min":4.8470000000000004},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.97599999999999998,"15min":1.0820000000000001},"min":{"1min":0.55100000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93999999999999995,"5min":4.7939999999999996,"15min":4.7939999999999996},"last":0.81799999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.90500000000000003,"15min":0.98699999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99199999999999999,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.89900000000000002,"15min":0.97899999999999998},"min":{"1min":0.53000000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.107,"5min":4.5830000000000002,"15min":4.5830000000000002},"last":0.751}]},{"osd":6,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.97999999999999998,"15min":1.097},"min":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.95799999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.97199999999999998,"15min":1.075},"min":{"1min":0.59399999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.95799999999999996,"5min":4.6289999999999996,"15min":4.6289999999999996},"last":0.70199999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.91600000000000004,"15min":1.002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.97699999999999998,"5min":4.665,"15min":4.665},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.98199999999999998,"15min":1.0860000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.089,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.89300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":1011712,"data_stored":1010452,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46899999999999997,"15min":0.495},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64000000000000001,"5min":1.863,"15min":1.863},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.75600000000000001,"15min":0.88600000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70799999999999996,"5min":8.2799999999999994,"15min":8.2799999999999994},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.78000000000000003,"15min":0.93200000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77300000000000002,"5min":7.9290000000000003,"15min":7.9290000000000003},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.434,"5min":0.78200000000000003,"15min":0.93700000000000006},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.628,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.44}]},{"osd":3,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.59799999999999998,"15min":0.67200000000000004},"min":{"1min":0.33100000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58699999999999997,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.75600000000000001,"15min":0.872},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82399999999999995,"5min":7.8890000000000002,"15min":7.8890000000000002},"last":0.497}]},{"osd":4,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.94899999999999995,"15min":1.0529999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95399999999999996,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.753,"15min":0.77800000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88600000000000001,"5min":1.607,"15min":1.607},"last":0.624}]},{"osd":5,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.81100000000000005,"15min":0.83099999999999996},"min":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96899999999999997,"5min":1.514,"15min":1.514},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.98899999999999999,"15min":1.1100000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91000000000000003,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.64000000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79200000000000004,"15min":0.82699999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.88,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.95399999999999996,"15min":1.0549999999999999},"min":{"1min":0.56100000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.89900000000000002,"5min":7.835,"15min":7.835},"last":0.65500000000000003}]},{"osd":7,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.97399999999999998,"15min":1.0800000000000001},"min":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.99299999999999999,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.81000000000000005,"15min":0.85399999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95199999999999996,"5min":1.794,"15min":1.794},"last":0.67700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:24:01.829 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:24:01.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.961+0000 7f20c6c5a640 1 Processor -- start 2023-12-08T08:24:01.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.961+0000 7f20c6c5a640 1 -- start start 2023-12-08T08:24:01.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.961+0000 7f20c6c5a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20c014fd10 0x7f20c00a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:01.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20c6c5a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f20c0156110 0x7f20c01565c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:01.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20c6c5a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c00c5710 con 0x7f20c00a5300 2023-12-08T08:24:01.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20c6c5a640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c006c5e0 con 0x7f20c0156110 2023-12-08T08:24:01.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20c6c5a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c0155c80 con 0x7f20c014fd10 2023-12-08T08:24:01.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20b7fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f20c00a5300 0x7f20c0071e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45912/0 (socket says 172.21.15.88:45912) 2023-12-08T08:24:01.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20b7fff640 1 -- 172.21.15.88:0/2345300779 learned_addr learned my addr 172.21.15.88:0/2345300779 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:24:01.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20c51f7640 1 --2- 172.21.15.88:0/2345300779 >> v2:172.21.15.148:3300/0 conn(0x7f20c0156110 0x7f20c01565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:01.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20c49f6640 1 --2- 172.21.15.88:0/2345300779 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20c014fd10 0x7f20c00a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:01.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20b77fe640 1 -- 172.21.15.88:0/2345300779 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1336035298 0 0) 0x7f20c00c5710 con 0x7f20c00a5300 2023-12-08T08:24:01.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20b77fe640 1 -- 172.21.15.88:0/2345300779 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20a8003530 con 0x7f20c00a5300 2023-12-08T08:24:01.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20b77fe640 1 -- 172.21.15.88:0/2345300779 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3950870726 0 0) 0x7f20a8003530 con 0x7f20c00a5300 2023-12-08T08:24:01.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20b77fe640 1 -- 172.21.15.88:0/2345300779 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20c014fd10 msgr2=0x7f20c00a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:01.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20b77fe640 1 --2- 172.21.15.88:0/2345300779 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20c014fd10 0x7f20c00a4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20b77fe640 1 -- 172.21.15.88:0/2345300779 >> v2:172.21.15.148:3300/0 conn(0x7f20c0156110 msgr2=0x7f20c01565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:01.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20b77fe640 1 --2- 172.21.15.88:0/2345300779 >> v2:172.21.15.148:3300/0 conn(0x7f20c0156110 0x7f20c01565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20b77fe640 1 -- 172.21.15.88:0/2345300779 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c00c4e70 con 0x7f20c00a5300 2023-12-08T08:24:01.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20b77fe640 1 -- 172.21.15.88:0/2345300779 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f20b0001680 con 0x7f20c00a5300 2023-12-08T08:24:01.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20c51f7640 1 --2- 172.21.15.88:0/2345300779 >> v2:172.21.15.148:3300/0 conn(0x7f20c0156110 0x7f20c01565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:24:01.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20b77fe640 1 -- 172.21.15.88:0/2345300779 >> v1:172.21.15.88:6789/0 conn(0x7f20c00a5300 legacy=0x7f20c0071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:01.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20b77fe640 1 --2- 172.21.15.88:0/2345300779 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20c014fd10 0x7f20a8003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:01.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20b77fe640 1 --2- 172.21.15.88:0/2345300779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20a8003f00 0x7f20a80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:01.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20b77fe640 1 --2- 172.21.15.88:0/2345300779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20a8004d10 0x7f20a8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:01.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20b77fe640 1 -- 172.21.15.88:0/2345300779 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c0155c80 con 0x7f20a8003f00 2023-12-08T08:24:01.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20b77fe640 1 -- 172.21.15.88:0/2345300779 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a800b9f0 con 0x7f20a8004d10 2023-12-08T08:24:01.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20b77fe640 1 -- 172.21.15.88:0/2345300779 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a800bbb0 con 0x7f20c014fd10 2023-12-08T08:24:01.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20b7fff640 1 --2- 172.21.15.88:0/2345300779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20a8003f00 0x7f20a80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:01.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20c49f6640 1 --2- 172.21.15.88:0/2345300779 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20c014fd10 0x7f20a8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:01.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20c51f7640 1 --2- 172.21.15.88:0/2345300779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20a8004d10 0x7f20a8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:01.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20c49f6640 1 -- 172.21.15.88:0/2345300779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20a8004d10 msgr2=0x7f20a8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:01.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20c49f6640 1 --2- 172.21.15.88:0/2345300779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20a8004d10 0x7f20a8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20c49f6640 1 -- 172.21.15.88:0/2345300779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20a8003f00 msgr2=0x7f20a80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:01.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20c49f6640 1 --2- 172.21.15.88:0/2345300779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20a8003f00 0x7f20a80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20c49f6640 1 -- 172.21.15.88:0/2345300779 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a8003530 con 0x7f20c014fd10 2023-12-08T08:24:01.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.965+0000 7f20b7fff640 1 --2- 172.21.15.88:0/2345300779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20a8003f00 0x7f20a80047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:24:01.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.969+0000 7f20c49f6640 1 --2- 172.21.15.88:0/2345300779 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20c014fd10 0x7f20a8003980 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f20bc009ae0 tx=0x7f20bc01ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfe61cc57940d7be server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:01.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.969+0000 7f20b77fe640 1 -- 172.21.15.88:0/2345300779 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc0a5540 con 0x7f20c014fd10 2023-12-08T08:24:01.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.969+0000 7f20b77fe640 1 -- 172.21.15.88:0/2345300779 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20bc0a56a0 con 0x7f20c014fd10 2023-12-08T08:24:01.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.969+0000 7f20b77fe640 1 -- 172.21.15.88:0/2345300779 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc0a5a50 con 0x7f20c014fd10 2023-12-08T08:24:01.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.969+0000 7f20c6c5a640 1 -- 172.21.15.88:0/2345300779 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20c014fd10 msgr2=0x7f20a8003980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:01.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.969+0000 7f20c6c5a640 1 --2- 172.21.15.88:0/2345300779 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20c014fd10 0x7f20a8003980 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f20bc009ae0 tx=0x7f20bc01ca60 comp rx=0 tx=0).stop 2023-12-08T08:24:01.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.969+0000 7f20c51f7640 1 -- 172.21.15.88:0/2345300779 reap_dead start 2023-12-08T08:24:01.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.969+0000 7f20c6c5a640 1 -- 172.21.15.88:0/2345300779 shutdown_connections 2023-12-08T08:24:01.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.969+0000 7f20c6c5a640 1 -- 172.21.15.88:0/2345300779 >> 172.21.15.88:0/2345300779 conn(0x7f20c00a7810 msgr2=0x7f20c00a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:01.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.969+0000 7f20c6c5a640 1 -- 172.21.15.88:0/2345300779 shutdown_connections 2023-12-08T08:24:01.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.969+0000 7f20c6c5a640 1 -- 172.21.15.88:0/2345300779 wait complete. 2023-12-08T08:24:01.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.969+0000 7f20c6c5a640 1 Processor -- start 2023-12-08T08:24:01.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.969+0000 7f20c6c5a640 1 -- start start 2023-12-08T08:24:01.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.973+0000 7f20c6c5a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20c014fd10 0x7f20c00bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:01.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.973+0000 7f20c6c5a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20c00ab0f0 0x7f20c01f03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:01.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.973+0000 7f20c6c5a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20c01f08e0 0x7f20c0143b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:01.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.973+0000 7f20c6c5a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c00c1e70 con 0x7f20c00ab0f0 2023-12-08T08:24:01.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.973+0000 7f20c6c5a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c01eca50 con 0x7f20c014fd10 2023-12-08T08:24:01.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.973+0000 7f20c6c5a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c00a89a0 con 0x7f20c01f08e0 2023-12-08T08:24:01.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.973+0000 7f20b7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20c00ab0f0 0x7f20c01f03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:01.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.973+0000 7f20b7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20c00ab0f0 0x7f20c01f03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42958/0 (socket says 172.21.15.88:42958) 2023-12-08T08:24:01.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.973+0000 7f20b7fff640 1 -- 172.21.15.88:0/2634802424 learned_addr learned my addr 172.21.15.88:0/2634802424 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:01.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.973+0000 7f20c51f7640 1 --2- 172.21.15.88:0/2634802424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20c01f08e0 0x7f20c0143b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:01.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.973+0000 7f20c49f6640 1 --2- 172.21.15.88:0/2634802424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20c014fd10 0x7f20c00bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:01.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.973+0000 7f20b7fff640 1 -- 172.21.15.88:0/2634802424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20c01f08e0 msgr2=0x7f20c0143b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:01.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.973+0000 7f20b7fff640 1 --2- 172.21.15.88:0/2634802424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20c01f08e0 0x7f20c0143b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.973+0000 7f20b7fff640 1 -- 172.21.15.88:0/2634802424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20c014fd10 msgr2=0x7f20c00bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:01.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.973+0000 7f20b7fff640 1 --2- 172.21.15.88:0/2634802424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20c014fd10 0x7f20c00bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:01.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.973+0000 7f20b7fff640 1 -- 172.21.15.88:0/2634802424 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c00a8c80 con 0x7f20c00ab0f0 2023-12-08T08:24:01.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.973+0000 7f20b7fff640 1 --2- 172.21.15.88:0/2634802424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20c00ab0f0 0x7f20c01f03a0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f20b0007310 tx=0x7f20b00077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:01.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.973+0000 7f20b57fa640 1 -- 172.21.15.88:0/2634802424 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b000f960 con 0x7f20c00ab0f0 2023-12-08T08:24:01.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.973+0000 7f20b57fa640 1 -- 172.21.15.88:0/2634802424 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b000fac0 con 0x7f20c00ab0f0 2023-12-08T08:24:01.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.973+0000 7f20c6c5a640 1 -- 172.21.15.88:0/2634802424 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c00a8f60 con 0x7f20c00ab0f0 2023-12-08T08:24:01.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.973+0000 7f20b57fa640 1 -- 172.21.15.88:0/2634802424 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b000fe30 con 0x7f20c00ab0f0 2023-12-08T08:24:01.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.973+0000 7f20c6c5a640 1 -- 172.21.15.88:0/2634802424 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c00c20c0 con 0x7f20c00ab0f0 2023-12-08T08:24:01.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.973+0000 7f20c6c5a640 1 -- 172.21.15.88:0/2634802424 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20c01f00c0 con 0x7f20c00ab0f0 2023-12-08T08:24:01.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.973+0000 7f20b57fa640 1 -- 172.21.15.88:0/2634802424 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f20b001d460 con 0x7f20c00ab0f0 2023-12-08T08:24:01.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.977+0000 7f20b57fa640 1 --2- 172.21.15.88:0/2634802424 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f20ac0664a0 0x7f20ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:01.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.977+0000 7f20b57fa640 1 -- 172.21.15.88:0/2634802424 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f20b0083c30 con 0x7f20c00ab0f0 2023-12-08T08:24:01.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.977+0000 7f20c49f6640 1 --2- 172.21.15.88:0/2634802424 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f20ac0664a0 0x7f20ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:01.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.977+0000 7f20c49f6640 1 --2- 172.21.15.88:0/2634802424 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f20ac0664a0 0x7f20ac068960 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0af000 tx=0x7f20bc0046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:01.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:01.981+0000 7f20b57fa640 1 -- 172.21.15.88:0/2634802424 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f20c01f00c0 con 0x7f20c00ab0f0 2023-12-08T08:24:02.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:02.129+0000 7f20c6c5a640 1 -- 172.21.15.88:0/2634802424 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20c01f00c0 con 0x7f20c00ab0f0 2023-12-08T08:24:02.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:02.129+0000 7f20b57fa640 1 -- 172.21.15.88:0/2634802424 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+13091 (secure 0 0 0) 0x7f20c01f00c0 con 0x7f20c00ab0f0 2023-12-08T08:24:02.136 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:24:02.136 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":78,"fsid":"681b9f71-c98a-4fa5-a77e-1c03fe2c4bb3","created":"2023-12-08T08:19:55.731165+0000","modified":"2023-12-08T08:23:59.086210+0000","last_up_change":"2023-12-08T08:20:07.352919+0000","last_in_change":"2023-12-08T08:19:58.328978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:20:08.801077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85eae6f9-2b88-49ee-a806-d33aae2ff8e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6809","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6811","nonce":1840118353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6815","nonce":1840118353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6823","nonce":1840118353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":1840118353},{"type":"v1","addr":"172.21.15.88:6819","nonce":1840118353}]},"public_addr":"172.21.15.88:6811/1840118353","cluster_addr":"172.21.15.88:6815/1840118353","heartbeat_back_addr":"172.21.15.88:6823/1840118353","heartbeat_front_addr":"172.21.15.88:6819/1840118353","state":["exists","up"]},{"osd":1,"uuid":"7171cf27-1f7f-4981-83bd-764bb42d78e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6810","nonce":1011316311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6814","nonce":1011316311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6821","nonce":1011316311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1011316311},{"type":"v1","addr":"172.21.15.88:6818","nonce":1011316311}]},"public_addr":"172.21.15.88:6810/1011316311","cluster_addr":"172.21.15.88:6814/1011316311","heartbeat_back_addr":"172.21.15.88:6821/1011316311","heartbeat_front_addr":"172.21.15.88:6818/1011316311","state":["exists","up"]},{"osd":2,"uuid":"19a3387b-9d32-41bf-a244-d153e2edbba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6825","nonce":4207137329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6827","nonce":4207137329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6831","nonce":4207137329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":4207137329},{"type":"v1","addr":"172.21.15.88:6829","nonce":4207137329}]},"public_addr":"172.21.15.88:6825/4207137329","cluster_addr":"172.21.15.88:6827/4207137329","heartbeat_back_addr":"172.21.15.88:6831/4207137329","heartbeat_front_addr":"172.21.15.88:6829/4207137329","state":["exists","up"]},{"osd":3,"uuid":"fe969642-9698-4f55-b118-08dc96bced0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6801","nonce":22961328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6803","nonce":22961328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6807","nonce":22961328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":22961328},{"type":"v1","addr":"172.21.15.88:6805","nonce":22961328}]},"public_addr":"172.21.15.88:6801/22961328","cluster_addr":"172.21.15.88:6803/22961328","heartbeat_back_addr":"172.21.15.88:6807/22961328","heartbeat_front_addr":"172.21.15.88:6805/22961328","state":["exists","up"]},{"osd":4,"uuid":"1de2647e-90ab-4557-93fa-207ec702c775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6817","nonce":3755626047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6819","nonce":3755626047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6823","nonce":3755626047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":3755626047},{"type":"v1","addr":"172.21.15.148:6821","nonce":3755626047}]},"public_addr":"172.21.15.148:6817/3755626047","cluster_addr":"172.21.15.148:6819/3755626047","heartbeat_back_addr":"172.21.15.148:6823/3755626047","heartbeat_front_addr":"172.21.15.148:6821/3755626047","state":["exists","up"]},{"osd":5,"uuid":"1d3867e2-c10b-4691-940c-bf0d8fa0ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6809","nonce":1016572025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6811","nonce":1016572025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6815","nonce":1016572025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1016572025},{"type":"v1","addr":"172.21.15.148:6813","nonce":1016572025}]},"public_addr":"172.21.15.148:6809/1016572025","cluster_addr":"172.21.15.148:6811/1016572025","heartbeat_back_addr":"172.21.15.148:6815/1016572025","heartbeat_front_addr":"172.21.15.148:6813/1016572025","state":["exists","up"]},{"osd":6,"uuid":"d716a895-88c0-49c0-944f-69a4dfee3d47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6801","nonce":2515642018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6803","nonce":2515642018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6807","nonce":2515642018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2515642018},{"type":"v1","addr":"172.21.15.148:6805","nonce":2515642018}]},"public_addr":"172.21.15.148:6801/2515642018","cluster_addr":"172.21.15.148:6803/2515642018","heartbeat_back_addr":"172.21.15.148:6807/2515642018","heartbeat_front_addr":"172.21.15.148:6805/2515642018","state":["exists","up"]},{"osd":7,"uuid":"b0ac65a5-8d00-4df3-b011-053e54a8051d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6825","nonce":227078704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6827","nonce":227078704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6831","nonce":227078704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":227078704},{"type":"v1","addr":"172.21.15.148:6829","nonce":227078704}]},"public_addr":"172.21.15.148:6825/227078704","cluster_addr":"172.21.15.148:6827/227078704","heartbeat_back_addr":"172.21.15.148:6831/227078704","heartbeat_front_addr":"172.21.15.148:6829/227078704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.030793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.834943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.103247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.004914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.006562+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.070874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:03.909759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:20:04.141099+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6835/1294328415":"2023-12-09T08:23:56.075471+0000","172.21.15.88:6834/1294328415":"2023-12-09T08:23:56.075471+0000","172.21.15.88:6837/698349615":"2023-12-09T08:23:49.403962+0000","172.21.15.88:6836/698349615":"2023-12-09T08:23:49.403962+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:24:02.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:02.133+0000 7f20c6c5a640 1 -- 172.21.15.88:0/2634802424 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f20ac0664a0 msgr2=0x7f20ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:02.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:02.133+0000 7f20c6c5a640 1 --2- 172.21.15.88:0/2634802424 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f20ac0664a0 0x7f20ac068960 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0af000 tx=0x7f20bc0046d0 comp rx=0 tx=0).stop 2023-12-08T08:24:02.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:02.133+0000 7f20c6c5a640 1 -- 172.21.15.88:0/2634802424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20c00ab0f0 msgr2=0x7f20c01f03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:02.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:02.133+0000 7f20c6c5a640 1 --2- 172.21.15.88:0/2634802424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20c00ab0f0 0x7f20c01f03a0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f20b0007310 tx=0x7f20b00077d0 comp rx=0 tx=0).stop 2023-12-08T08:24:02.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:02.133+0000 7f20c6c5a640 1 -- 172.21.15.88:0/2634802424 shutdown_connections 2023-12-08T08:24:02.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:02.133+0000 7f20c6c5a640 1 --2- 172.21.15.88:0/2634802424 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f20ac0664a0 0x7f20ac068960 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:02.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:02.133+0000 7f20c6c5a640 1 --2- 172.21.15.88:0/2634802424 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f20c01f08e0 0x7f20c0143b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:02.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:02.133+0000 7f20c6c5a640 1 --2- 172.21.15.88:0/2634802424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20c00ab0f0 0x7f20c01f03a0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:02.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:02.133+0000 7f20c6c5a640 1 --2- 172.21.15.88:0/2634802424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20c014fd10 0x7f20c00bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:02.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:02.133+0000 7f20c6c5a640 1 -- 172.21.15.88:0/2634802424 >> 172.21.15.88:0/2634802424 conn(0x7f20c00a7810 msgr2=0x7f20c0071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:02.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:02.133+0000 7f20c6c5a640 1 -- 172.21.15.88:0/2634802424 shutdown_connections 2023-12-08T08:24:02.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:02.133+0000 7f20c6c5a640 1 -- 172.21.15.88:0/2634802424 wait complete. 2023-12-08T08:24:03.158 INFO:tasks.ceph:Scrubbing osd.0 2023-12-08T08:24:03.159 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-08T08:24:03.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.305+0000 7f000e4c9640 1 Processor -- start 2023-12-08T08:24:03.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.305+0000 7f000e4c9640 1 -- start start 2023-12-08T08:24:03.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.309+0000 7f000e4c9640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f000814e2a0 0x7f00081516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:03.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.309+0000 7f000e4c9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f00080a9910 0x7f000806bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:03.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.309+0000 7f000e4c9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0008151210 con 0x7f00080a9460 2023-12-08T08:24:03.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.309+0000 7f000e4c9640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f000814e680 con 0x7f00080a9910 2023-12-08T08:24:03.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.309+0000 7f000e4c9640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0008150be0 con 0x7f000814e2a0 2023-12-08T08:24:03.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.309+0000 7f000ca66640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f00080a9910 0x7f000806bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:03.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.309+0000 7f00077fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f00080a9460 0x7f00080c4180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45922/0 (socket says 172.21.15.88:45922) 2023-12-08T08:24:03.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.309+0000 7f00077fe640 1 -- 172.21.15.88:0/629561842 learned_addr learned my addr 172.21.15.88:0/629561842 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:24:03.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.309+0000 7f0007fff640 1 --2- 172.21.15.88:0/629561842 >> v2:172.21.15.148:3300/0 conn(0x7f000814e2a0 0x7f00081516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:03.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.309+0000 7f000ca66640 1 -- 172.21.15.88:0/629561842 >> v2:172.21.15.148:3300/0 conn(0x7f000814e2a0 msgr2=0x7f00081516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:03.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.309+0000 7f000ca66640 1 --2- 172.21.15.88:0/629561842 >> v2:172.21.15.148:3300/0 conn(0x7f000814e2a0 0x7f00081516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:03.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.309+0000 7f000ca66640 1 -- 172.21.15.88:0/629561842 >> v1:172.21.15.88:6789/0 conn(0x7f00080a9460 legacy=0x7f00080c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:03.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.309+0000 7f000ca66640 1 -- 172.21.15.88:0/629561842 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00080c53c0 con 0x7f00080a9910 2023-12-08T08:24:03.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.309+0000 7f0007fff640 1 --2- 172.21.15.88:0/629561842 >> v2:172.21.15.148:3300/0 conn(0x7f000814e2a0 0x7f00081516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:24:03.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.313+0000 7f000ca66640 1 --2- 172.21.15.88:0/629561842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00080a9910 0x7f000806bc80 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f00080c6910 tx=0x7f000001da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=581dbe3cb0f3959e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:03.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.313+0000 7f0006ffd640 1 -- 172.21.15.88:0/629561842 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00000a6880 con 0x7f00080a9910 2023-12-08T08:24:03.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.313+0000 7f0006ffd640 1 -- 172.21.15.88:0/629561842 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00000a69e0 con 0x7f00080a9910 2023-12-08T08:24:03.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.313+0000 7f0006ffd640 1 -- 172.21.15.88:0/629561842 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00000a6d70 con 0x7f00080a9910 2023-12-08T08:24:03.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.313+0000 7f000e4c9640 1 -- 172.21.15.88:0/629561842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00080a9910 msgr2=0x7f000806bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:03.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.313+0000 7f000e4c9640 1 --2- 172.21.15.88:0/629561842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00080a9910 0x7f000806bc80 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f00080c6910 tx=0x7f000001da20 comp rx=0 tx=0).stop 2023-12-08T08:24:03.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.313+0000 7f000e4c9640 1 -- 172.21.15.88:0/629561842 shutdown_connections 2023-12-08T08:24:03.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.313+0000 7f000e4c9640 1 --2- 172.21.15.88:0/629561842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00080a9910 0x7f000806bc80 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:03.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.313+0000 7f000e4c9640 1 --2- 172.21.15.88:0/629561842 >> v2:172.21.15.148:3300/0 conn(0x7f000814e2a0 0x7f00081516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:03.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.313+0000 7f000e4c9640 1 -- 172.21.15.88:0/629561842 >> 172.21.15.88:0/629561842 conn(0x7f00080c59f0 msgr2=0x7f00080c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:03.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.313+0000 7f000e4c9640 1 -- 172.21.15.88:0/629561842 shutdown_connections 2023-12-08T08:24:03.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.313+0000 7f000e4c9640 1 -- 172.21.15.88:0/629561842 wait complete. 2023-12-08T08:24:03.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.313+0000 7f000e4c9640 1 Processor -- start 2023-12-08T08:24:03.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.313+0000 7f000e4c9640 1 -- start start 2023-12-08T08:24:03.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.313+0000 7f000e4c9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00080a9460 0x7f0008072530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:03.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.313+0000 7f000e4c9640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00080a9910 0x7f000806fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:03.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.313+0000 7f000e4c9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f000814e2a0 0x7f00081ea120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:03.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.313+0000 7f000e4c9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00080704a0 con 0x7f000814e2a0 2023-12-08T08:24:03.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.313+0000 7f000e4c9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0008070780 con 0x7f00080a9460 2023-12-08T08:24:03.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.313+0000 7f000e4c9640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0008070a60 con 0x7f00080a9910 2023-12-08T08:24:03.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.317+0000 7f000ca66640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f000814e2a0 0x7f00081ea120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:03.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.317+0000 7f000ca66640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f000814e2a0 0x7f00081ea120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42976/0 (socket says 172.21.15.88:42976) 2023-12-08T08:24:03.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.317+0000 7f000ca66640 1 -- 172.21.15.88:0/1897764042 learned_addr learned my addr 172.21.15.88:0/1897764042 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:03.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.317+0000 7f00077fe640 1 --2- 172.21.15.88:0/1897764042 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00080a9910 0x7f000806fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:03.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.317+0000 7f0007fff640 1 --2- 172.21.15.88:0/1897764042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00080a9460 0x7f0008072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:03.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.317+0000 7f000ca66640 1 -- 172.21.15.88:0/1897764042 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00080a9910 msgr2=0x7f000806fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:03.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.317+0000 7f000ca66640 1 --2- 172.21.15.88:0/1897764042 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00080a9910 0x7f000806fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:03.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.317+0000 7f000ca66640 1 -- 172.21.15.88:0/1897764042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00080a9460 msgr2=0x7f0008072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:03.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.317+0000 7f000ca66640 1 --2- 172.21.15.88:0/1897764042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00080a9460 0x7f0008072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:03.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.317+0000 7f000ca66640 1 -- 172.21.15.88:0/1897764042 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0000009a70 con 0x7f000814e2a0 2023-12-08T08:24:03.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.317+0000 7f00077fe640 1 --2- 172.21.15.88:0/1897764042 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f00080a9910 0x7f000806fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:24:03.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.317+0000 7f000ca66640 1 --2- 172.21.15.88:0/1897764042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f000814e2a0 0x7f00081ea120 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f00000b1040 tx=0x7f000001c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:03.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.317+0000 7f0004ff9640 1 -- 172.21.15.88:0/1897764042 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00000ae850 con 0x7f000814e2a0 2023-12-08T08:24:03.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.317+0000 7f0004ff9640 1 -- 172.21.15.88:0/1897764042 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00000ae9b0 con 0x7f000814e2a0 2023-12-08T08:24:03.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.317+0000 7f0004ff9640 1 -- 172.21.15.88:0/1897764042 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00000aed80 con 0x7f000814e2a0 2023-12-08T08:24:03.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.317+0000 7f000e4c9640 1 -- 172.21.15.88:0/1897764042 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0008070d40 con 0x7f000814e2a0 2023-12-08T08:24:03.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.317+0000 7f000e4c9640 1 -- 172.21.15.88:0/1897764042 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0008072a70 con 0x7f000814e2a0 2023-12-08T08:24:03.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.317+0000 7f000e4c9640 1 -- 172.21.15.88:0/1897764042 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f00080708f0 con 0x7f000814e2a0 2023-12-08T08:24:03.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.317+0000 7f0004ff9640 1 -- 172.21.15.88:0/1897764042 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f00000b5040 con 0x7f000814e2a0 2023-12-08T08:24:03.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.317+0000 7f0004ff9640 1 --2- 172.21.15.88:0/1897764042 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efff4066470 0x7efff4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:03.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.317+0000 7f0004ff9640 1 -- 172.21.15.88:0/1897764042 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f000011efe0 con 0x7f000814e2a0 2023-12-08T08:24:03.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.321+0000 7f0007fff640 1 --2- 172.21.15.88:0/1897764042 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efff4066470 0x7efff4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:03.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.321+0000 7f0004ff9640 1 --2- 172.21.15.88:0/1897764042 >> [v2:172.21.15.88:6809/1840118353,v1:172.21.15.88:6811/1840118353] conn(0x7efff406c370 0x7efff406e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:03.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.321+0000 7f0004ff9640 1 -- 172.21.15.88:0/1897764042 --> [v2:172.21.15.88:6809/1840118353,v1:172.21.15.88:6811/1840118353] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efff406ee40 con 0x7efff406c370 2023-12-08T08:24:03.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.321+0000 7f0004ff9640 1 -- 172.21.15.88:0/1897764042 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f000011f370 con 0x7f000814e2a0 2023-12-08T08:24:03.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.321+0000 7f00077fe640 1 --2- 172.21.15.88:0/1897764042 >> [v2:172.21.15.88:6809/1840118353,v1:172.21.15.88:6811/1840118353] conn(0x7efff406c370 0x7efff406e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:03.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.321+0000 7f0007fff640 1 --2- 172.21.15.88:0/1897764042 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efff4066470 0x7efff4068930 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7efff8009950 tx=0x7efff8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:03.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.321+0000 7f00077fe640 1 --2- 172.21.15.88:0/1897764042 >> [v2:172.21.15.88:6809/1840118353,v1:172.21.15.88:6811/1840118353] conn(0x7efff406c370 0x7efff406e790 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:03.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.321+0000 7f0004ff9640 1 -- 172.21.15.88:0/1897764042 <== osd.0 v2:172.21.15.88:6809/1840118353 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7efff406ee40 con 0x7efff406c370 2023-12-08T08:24:03.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.333+0000 7f000e4c9640 1 -- 172.21.15.88:0/1897764042 --> [v2:172.21.15.88:6809/1840118353,v1:172.21.15.88:6811/1840118353] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f000815d490 con 0x7efff406c370 2023-12-08T08:24:03.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.333+0000 7f0004ff9640 1 -- 172.21.15.88:0/1897764042 <== osd.0 v2:172.21.15.88:6809/1840118353 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7efffc001880 con 0x7efff406c370 2023-12-08T08:24:03.339 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-08T08:24:03.340 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T08:24:03.340 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-08T08:24:03.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.333+0000 7f000e4c9640 1 -- 172.21.15.88:0/1897764042 >> [v2:172.21.15.88:6809/1840118353,v1:172.21.15.88:6811/1840118353] conn(0x7efff406c370 msgr2=0x7efff406e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:03.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.333+0000 7f000e4c9640 1 --2- 172.21.15.88:0/1897764042 >> [v2:172.21.15.88:6809/1840118353,v1:172.21.15.88:6811/1840118353] conn(0x7efff406c370 0x7efff406e790 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:03.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.333+0000 7f000e4c9640 1 -- 172.21.15.88:0/1897764042 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efff4066470 msgr2=0x7efff4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:03.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.333+0000 7f000e4c9640 1 --2- 172.21.15.88:0/1897764042 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7efff4066470 0x7efff4068930 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7efff8009950 tx=0x7efff8008040 comp rx=0 tx=0).stop 2023-12-08T08:24:03.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.333+0000 7f000e4c9640 1 -- 172.21.15.88:0/1897764042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f000814e2a0 msgr2=0x7f00081ea120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:03.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.333+0000 7f000e4c9640 1 --2- 172.21.15.88:0/1897764042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f000814e2a0 0x7f00081ea120 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f00000b1040 tx=0x7f000001c260 comp rx=0 tx=0).stop 2023-12-08T08:24:03.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.333+0000 7f000ca66640 1 -- 172.21.15.88:0/1897764042 reap_dead start 2023-12-08T08:24:03.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.333+0000 7f000e4c9640 1 -- 172.21.15.88:0/1897764042 shutdown_connections 2023-12-08T08:24:03.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.333+0000 7f000e4c9640 1 -- 172.21.15.88:0/1897764042 >> 172.21.15.88:0/1897764042 conn(0x7f00080c59f0 msgr2=0x7f00080c4180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:03.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.333+0000 7f000e4c9640 1 -- 172.21.15.88:0/1897764042 shutdown_connections 2023-12-08T08:24:03.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.333+0000 7f000e4c9640 1 -- 172.21.15.88:0/1897764042 wait complete. 2023-12-08T08:24:03.358 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-08T08:24:03.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.489+0000 7fdda551c640 1 Processor -- start 2023-12-08T08:24:03.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.489+0000 7fdda551c640 1 -- start start 2023-12-08T08:24:03.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.493+0000 7fdda551c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdda00bd550 0x7fdda00c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:03.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.493+0000 7fdda551c640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdda0155950 0x7fdda01582f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:03.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.493+0000 7fdda551c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda00c6840 con 0x7fdda00c47b0 2023-12-08T08:24:03.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.493+0000 7fdda551c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda00af870 con 0x7fdda00bd550 2023-12-08T08:24:03.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.493+0000 7fdda551c640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda00c6a70 con 0x7fdda0155950 2023-12-08T08:24:03.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.493+0000 7fdd9e7fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdda00bd550 0x7fdda00c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:03.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.493+0000 7fdd9e7fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdda00bd550 0x7fdda00c4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42978/0 (socket says 172.21.15.88:42978) 2023-12-08T08:24:03.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.493+0000 7fdd9e7fc640 1 -- 172.21.15.88:0/2276120607 learned_addr learned my addr 172.21.15.88:0/2276120607 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:03.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.493+0000 7fdd9effd640 1 --1- 172.21.15.88:0/2276120607 >> v1:172.21.15.88:6789/0 conn(0x7fdda00c47b0 0x7fdda0154ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45932/0 (socket says 172.21.15.88:45932) 2023-12-08T08:24:03.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.493+0000 7fdd9e7fc640 1 -- 172.21.15.88:0/2276120607 >> v2:172.21.15.148:3300/0 conn(0x7fdda0155950 msgr2=0x7fdda01582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:03.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.493+0000 7fdd9e7fc640 1 --2- 172.21.15.88:0/2276120607 >> v2:172.21.15.148:3300/0 conn(0x7fdda0155950 0x7fdda01582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:03.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.493+0000 7fdd9e7fc640 1 -- 172.21.15.88:0/2276120607 >> v1:172.21.15.88:6789/0 conn(0x7fdda00c47b0 legacy=0x7fdda0154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:03.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.493+0000 7fdd9e7fc640 1 -- 172.21.15.88:0/2276120607 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda00c6d50 con 0x7fdda00bd550 2023-12-08T08:24:03.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.493+0000 7fdd9e7fc640 1 --2- 172.21.15.88:0/2276120607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdda00bd550 0x7fdda00c4b90 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fdda006c5d0 tx=0x7fdd9401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3540d9d494376ed9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:03.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.493+0000 7fdd9dffb640 1 -- 172.21.15.88:0/2276120607 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd940ad660 con 0x7fdda00bd550 2023-12-08T08:24:03.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.497+0000 7fdd9dffb640 1 -- 172.21.15.88:0/2276120607 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd940ad7c0 con 0x7fdda00bd550 2023-12-08T08:24:03.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.497+0000 7fdd9dffb640 1 -- 172.21.15.88:0/2276120607 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd940adb50 con 0x7fdda00bd550 2023-12-08T08:24:03.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.497+0000 7fdda551c640 1 -- 172.21.15.88:0/2276120607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdda00bd550 msgr2=0x7fdda00c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:03.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.497+0000 7fdda551c640 1 --2- 172.21.15.88:0/2276120607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdda00bd550 0x7fdda00c4b90 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fdda006c5d0 tx=0x7fdd9401c470 comp rx=0 tx=0).stop 2023-12-08T08:24:03.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.497+0000 7fdda551c640 1 -- 172.21.15.88:0/2276120607 shutdown_connections 2023-12-08T08:24:03.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.497+0000 7fdda551c640 1 --2- 172.21.15.88:0/2276120607 >> v2:172.21.15.148:3300/0 conn(0x7fdda0155950 0x7fdda01582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:03.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.497+0000 7fdda551c640 1 --2- 172.21.15.88:0/2276120607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdda00bd550 0x7fdda00c4b90 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:03.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.497+0000 7fdda551c640 1 -- 172.21.15.88:0/2276120607 >> 172.21.15.88:0/2276120607 conn(0x7fdda00aba00 msgr2=0x7fdda00abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:03.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.497+0000 7fdda551c640 1 -- 172.21.15.88:0/2276120607 shutdown_connections 2023-12-08T08:24:03.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.497+0000 7fdda551c640 1 -- 172.21.15.88:0/2276120607 wait complete. 2023-12-08T08:24:03.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.497+0000 7fdda551c640 1 Processor -- start 2023-12-08T08:24:03.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.497+0000 7fdda551c640 1 -- start start 2023-12-08T08:24:03.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.497+0000 7fdda551c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdda00bd550 0x7fdda00c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:03.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.497+0000 7fdda551c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdda00c47b0 0x7fdda00ad810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:03.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.497+0000 7fdda551c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdda0155950 0x7fdda014a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:03.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.497+0000 7fdda551c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda00c83b0 con 0x7fdda0155950 2023-12-08T08:24:03.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.497+0000 7fdda551c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda00c98a0 con 0x7fdda00bd550 2023-12-08T08:24:03.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.497+0000 7fdda551c640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda00c8600 con 0x7fdda00c47b0 2023-12-08T08:24:03.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.497+0000 7fdd9f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdda0155950 0x7fdda014a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:03.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.497+0000 7fdd9f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdda0155950 0x7fdda014a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42980/0 (socket says 172.21.15.88:42980) 2023-12-08T08:24:03.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.497+0000 7fdd9f7fe640 1 -- 172.21.15.88:0/157534398 learned_addr learned my addr 172.21.15.88:0/157534398 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:03.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.497+0000 7fdd9effd640 1 --2- 172.21.15.88:0/157534398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdda00bd550 0x7fdda00c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:03.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.497+0000 7fdd9e7fc640 1 --2- 172.21.15.88:0/157534398 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdda00c47b0 0x7fdda00ad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:03.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.501+0000 7fdd9f7fe640 1 -- 172.21.15.88:0/157534398 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdda00c47b0 msgr2=0x7fdda00ad810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:03.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.501+0000 7fdd9f7fe640 1 --2- 172.21.15.88:0/157534398 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdda00c47b0 0x7fdda00ad810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:03.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.501+0000 7fdd9f7fe640 1 -- 172.21.15.88:0/157534398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdda00bd550 msgr2=0x7fdda00c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:03.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.501+0000 7fdd9f7fe640 1 --2- 172.21.15.88:0/157534398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdda00bd550 0x7fdda00c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:03.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.501+0000 7fdd9f7fe640 1 -- 172.21.15.88:0/157534398 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd940094d0 con 0x7fdda0155950 2023-12-08T08:24:03.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.501+0000 7fdd9effd640 1 --2- 172.21.15.88:0/157534398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdda00bd550 0x7fdda00c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:24:03.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.501+0000 7fdd9e7fc640 1 --2- 172.21.15.88:0/157534398 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdda00c47b0 0x7fdda00ad810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:24:03.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.501+0000 7fdd9f7fe640 1 --2- 172.21.15.88:0/157534398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdda0155950 0x7fdda014a370 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800b970 tx=0x7fdd9800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:03.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.501+0000 7fdd877fe640 1 -- 172.21.15.88:0/157534398 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9800cb40 con 0x7fdda0155950 2023-12-08T08:24:03.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.501+0000 7fdd877fe640 1 -- 172.21.15.88:0/157534398 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9800ccc0 con 0x7fdda0155950 2023-12-08T08:24:03.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.501+0000 7fdd877fe640 1 -- 172.21.15.88:0/157534398 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd98014680 con 0x7fdda0155950 2023-12-08T08:24:03.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.501+0000 7fdda551c640 1 -- 172.21.15.88:0/157534398 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda00c88e0 con 0x7fdda0155950 2023-12-08T08:24:03.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.501+0000 7fdda551c640 1 -- 172.21.15.88:0/157534398 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda00c8ea0 con 0x7fdda0155950 2023-12-08T08:24:03.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.501+0000 7fdda551c640 1 -- 172.21.15.88:0/157534398 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda00c90c0 con 0x7fdda0155950 2023-12-08T08:24:03.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.501+0000 7fdd877fe640 1 -- 172.21.15.88:0/157534398 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdd9801d3b0 con 0x7fdda0155950 2023-12-08T08:24:03.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.501+0000 7fdd877fe640 1 --2- 172.21.15.88:0/157534398 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdd8c066470 0x7fdd8c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:03.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.501+0000 7fdd877fe640 1 -- 172.21.15.88:0/157534398 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fdd98083b40 con 0x7fdda0155950 2023-12-08T08:24:03.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.501+0000 7fdd9effd640 1 --2- 172.21.15.88:0/157534398 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdd8c066470 0x7fdd8c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:03.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.505+0000 7fdd9effd640 1 --2- 172.21.15.88:0/157534398 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdd8c066470 0x7fdd8c068930 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdd90007fd0 tx=0x7fdd90009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:03.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.505+0000 7fdd877fe640 1 -- 172.21.15.88:0/157534398 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdd98051250 con 0x7fdda0155950 2023-12-08T08:24:03.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.657+0000 7fdda551c640 1 -- 172.21.15.88:0/157534398 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fdda0155d60 con 0x7fdd8c066470 2023-12-08T08:24:03.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.657+0000 7fdd877fe640 1 -- 172.21.15.88:0/157534398 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdd90001cf0 con 0x7fdd8c066470 2023-12-08T08:24:03.664 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 0 to deep-scrub 2023-12-08T08:24:03.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.661+0000 7fdda551c640 1 -- 172.21.15.88:0/157534398 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdd8c066470 msgr2=0x7fdd8c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:03.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.661+0000 7fdda551c640 1 --2- 172.21.15.88:0/157534398 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdd8c066470 0x7fdd8c068930 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdd90007fd0 tx=0x7fdd90009040 comp rx=0 tx=0).stop 2023-12-08T08:24:03.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.661+0000 7fdda551c640 1 -- 172.21.15.88:0/157534398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdda0155950 msgr2=0x7fdda014a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:03.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.661+0000 7fdda551c640 1 --2- 172.21.15.88:0/157534398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdda0155950 0x7fdda014a370 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800b970 tx=0x7fdd9800be30 comp rx=0 tx=0).stop 2023-12-08T08:24:03.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.661+0000 7fdda551c640 1 -- 172.21.15.88:0/157534398 shutdown_connections 2023-12-08T08:24:03.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.661+0000 7fdda551c640 1 --2- 172.21.15.88:0/157534398 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fdd8c066470 0x7fdd8c068930 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:03.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.661+0000 7fdda551c640 1 --2- 172.21.15.88:0/157534398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdda0155950 0x7fdda014a370 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:03.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.661+0000 7fdda551c640 1 --2- 172.21.15.88:0/157534398 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fdda00c47b0 0x7fdda00ad810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:03.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.661+0000 7fdda551c640 1 --2- 172.21.15.88:0/157534398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdda00bd550 0x7fdda00c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:03.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.661+0000 7fdda551c640 1 -- 172.21.15.88:0/157534398 >> 172.21.15.88:0/157534398 conn(0x7fdda00aba00 msgr2=0x7fdda00abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:03.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.661+0000 7fdda551c640 1 -- 172.21.15.88:0/157534398 shutdown_connections 2023-12-08T08:24:03.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.661+0000 7fdda551c640 1 -- 172.21.15.88:0/157534398 wait complete. 2023-12-08T08:24:03.685 INFO:tasks.ceph:Scrubbing osd.1 2023-12-08T08:24:03.685 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-08T08:24:03.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.821+0000 7fbd25d01640 1 Processor -- start 2023-12-08T08:24:03.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.821+0000 7fbd25d01640 1 -- start start 2023-12-08T08:24:03.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.821+0000 7fbd25d01640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbd2014f850 0x7fbd200aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:03.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.821+0000 7fbd25d01640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbd2014fc30 0x7fbd200c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:03.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.821+0000 7fbd25d01640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd2006d840 0x7fbd200c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:03.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.821+0000 7fbd25d01640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd200c2240 con 0x7fbd2014fc30 2023-12-08T08:24:03.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.821+0000 7fbd25d01640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd20152910 con 0x7fbd2014f850 2023-12-08T08:24:03.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.821+0000 7fbd25d01640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd20152bf0 con 0x7fbd2006d840 2023-12-08T08:24:03.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.825+0000 7fbd1effd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbd2014fc30 0x7fbd200c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:03.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.825+0000 7fbd1effd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbd2014fc30 0x7fbd200c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42994/0 (socket says 172.21.15.88:42994) 2023-12-08T08:24:03.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.825+0000 7fbd1effd640 1 -- 172.21.15.88:0/2940261370 learned_addr learned my addr 172.21.15.88:0/2940261370 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:03.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.825+0000 7fbd1ffff640 1 --2- 172.21.15.88:0/2940261370 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd2006d840 0x7fbd200c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:03.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.825+0000 7fbd1f7fe640 1 --2- 172.21.15.88:0/2940261370 >> v2:172.21.15.148:3300/0 conn(0x7fbd2014f850 0x7fbd200aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:03.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.825+0000 7fbd1effd640 1 -- 172.21.15.88:0/2940261370 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd2006d840 msgr2=0x7fbd200c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:03.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.825+0000 7fbd1effd640 1 --2- 172.21.15.88:0/2940261370 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd2006d840 0x7fbd200c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:03.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.825+0000 7fbd1effd640 1 -- 172.21.15.88:0/2940261370 >> v2:172.21.15.148:3300/0 conn(0x7fbd2014f850 msgr2=0x7fbd200aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:03.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.825+0000 7fbd1effd640 1 --2- 172.21.15.88:0/2940261370 >> v2:172.21.15.148:3300/0 conn(0x7fbd2014f850 0x7fbd200aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:03.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.825+0000 7fbd1effd640 1 -- 172.21.15.88:0/2940261370 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd20152ed0 con 0x7fbd2014fc30 2023-12-08T08:24:03.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.825+0000 7fbd1effd640 1 --2- 172.21.15.88:0/2940261370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd2014fc30 0x7fbd200c3cd0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fbd20066f50 tx=0x7fbd1401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f8bf5b27d302194 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:03.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.825+0000 7fbd1e7fc640 1 -- 172.21.15.88:0/2940261370 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd140aa640 con 0x7fbd2014fc30 2023-12-08T08:24:03.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.825+0000 7fbd1e7fc640 1 -- 172.21.15.88:0/2940261370 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd140aa7a0 con 0x7fbd2014fc30 2023-12-08T08:24:03.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.825+0000 7fbd1e7fc640 1 -- 172.21.15.88:0/2940261370 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd140aab30 con 0x7fbd2014fc30 2023-12-08T08:24:03.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd25d01640 1 -- 172.21.15.88:0/2940261370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd2014fc30 msgr2=0x7fbd200c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:03.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd25d01640 1 --2- 172.21.15.88:0/2940261370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd2014fc30 0x7fbd200c3cd0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fbd20066f50 tx=0x7fbd1401c500 comp rx=0 tx=0).stop 2023-12-08T08:24:03.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd25d01640 1 -- 172.21.15.88:0/2940261370 shutdown_connections 2023-12-08T08:24:03.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd25d01640 1 --2- 172.21.15.88:0/2940261370 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd2006d840 0x7fbd200c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:03.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd25d01640 1 --2- 172.21.15.88:0/2940261370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd2014fc30 0x7fbd200c3cd0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:03.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd25d01640 1 --2- 172.21.15.88:0/2940261370 >> v2:172.21.15.148:3300/0 conn(0x7fbd2014f850 0x7fbd200aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:03.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd25d01640 1 -- 172.21.15.88:0/2940261370 >> 172.21.15.88:0/2940261370 conn(0x7fbd200c59f0 msgr2=0x7fbd200c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:03.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd25d01640 1 -- 172.21.15.88:0/2940261370 shutdown_connections 2023-12-08T08:24:03.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd25d01640 1 -- 172.21.15.88:0/2940261370 wait complete. 2023-12-08T08:24:03.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd25d01640 1 Processor -- start 2023-12-08T08:24:03.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd25d01640 1 -- start start 2023-12-08T08:24:03.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd25d01640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd2006d840 0x7fbd201eef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:03.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd25d01640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd2014f850 0x7fbd201551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:03.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd25d01640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd2014fc30 0x7fbd2014c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:03.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd25d01640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd20070d70 con 0x7fbd2014fc30 2023-12-08T08:24:03.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd25d01640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd200bce40 con 0x7fbd2006d840 2023-12-08T08:24:03.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd25d01640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd200720e0 con 0x7fbd2014f850 2023-12-08T08:24:03.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd1ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd2014fc30 0x7fbd2014c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:03.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd1ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd2014fc30 0x7fbd2014c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42998/0 (socket says 172.21.15.88:42998) 2023-12-08T08:24:03.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd1ffff640 1 -- 172.21.15.88:0/1132201808 learned_addr learned my addr 172.21.15.88:0/1132201808 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:03.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd1f7fe640 1 --2- 172.21.15.88:0/1132201808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd2006d840 0x7fbd201eef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:03.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd1effd640 1 --2- 172.21.15.88:0/1132201808 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd2014f850 0x7fbd201551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:03.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd1ffff640 1 -- 172.21.15.88:0/1132201808 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd2014f850 msgr2=0x7fbd201551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:03.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd1ffff640 1 --2- 172.21.15.88:0/1132201808 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd2014f850 0x7fbd201551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:03.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd1ffff640 1 -- 172.21.15.88:0/1132201808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd2006d840 msgr2=0x7fbd201eef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:03.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd1ffff640 1 --2- 172.21.15.88:0/1132201808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd2006d840 0x7fbd201eef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:03.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd1ffff640 1 -- 172.21.15.88:0/1132201808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd140094d0 con 0x7fbd2014fc30 2023-12-08T08:24:03.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd1effd640 1 --2- 172.21.15.88:0/1132201808 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fbd2014f850 0x7fbd201551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:24:03.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.829+0000 7fbd1ffff640 1 --2- 172.21.15.88:0/1132201808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd2014fc30 0x7fbd2014c820 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fbd18007e60 tx=0x7fbd1800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:03.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.833+0000 7fbd07fff640 1 -- 172.21.15.88:0/1132201808 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd18014620 con 0x7fbd2014fc30 2023-12-08T08:24:03.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.833+0000 7fbd07fff640 1 -- 172.21.15.88:0/1132201808 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1800ee90 con 0x7fbd2014fc30 2023-12-08T08:24:03.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.833+0000 7fbd25d01640 1 -- 172.21.15.88:0/1132201808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd20072380 con 0x7fbd2014fc30 2023-12-08T08:24:03.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.833+0000 7fbd07fff640 1 -- 172.21.15.88:0/1132201808 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd180149e0 con 0x7fbd2014fc30 2023-12-08T08:24:03.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.833+0000 7fbd25d01640 1 -- 172.21.15.88:0/1132201808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd201ef450 con 0x7fbd2014fc30 2023-12-08T08:24:03.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.833+0000 7fbd25d01640 1 -- 172.21.15.88:0/1132201808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbd200a50d0 con 0x7fbd2014fc30 2023-12-08T08:24:03.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.833+0000 7fbd07fff640 1 -- 172.21.15.88:0/1132201808 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbd18014b40 con 0x7fbd2014fc30 2023-12-08T08:24:03.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.833+0000 7fbd07fff640 1 --2- 172.21.15.88:0/1132201808 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbd0c066470 0x7fbd0c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:03.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.833+0000 7fbd07fff640 1 -- 172.21.15.88:0/1132201808 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fbd18084530 con 0x7fbd2014fc30 2023-12-08T08:24:03.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.833+0000 7fbd07fff640 1 --2- 172.21.15.88:0/1132201808 >> [v2:172.21.15.88:6808/1011316311,v1:172.21.15.88:6810/1011316311] conn(0x7fbd0c06c370 0x7fbd0c06e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:03.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.833+0000 7fbd1f7fe640 1 --2- 172.21.15.88:0/1132201808 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbd0c066470 0x7fbd0c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:03.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.833+0000 7fbd07fff640 1 -- 172.21.15.88:0/1132201808 --> [v2:172.21.15.88:6808/1011316311,v1:172.21.15.88:6810/1011316311] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd0c06ee40 con 0x7fbd0c06c370 2023-12-08T08:24:03.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.833+0000 7fbd07fff640 1 -- 172.21.15.88:0/1132201808 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd18086b10 con 0x7fbd2014fc30 2023-12-08T08:24:03.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.833+0000 7fbd1effd640 1 --2- 172.21.15.88:0/1132201808 >> [v2:172.21.15.88:6808/1011316311,v1:172.21.15.88:6810/1011316311] conn(0x7fbd0c06c370 0x7fbd0c06e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:03.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.833+0000 7fbd1f7fe640 1 --2- 172.21.15.88:0/1132201808 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbd0c066470 0x7fbd0c068930 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000b9d0 tx=0x7fbd10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:03.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.837+0000 7fbd1effd640 1 --2- 172.21.15.88:0/1132201808 >> [v2:172.21.15.88:6808/1011316311,v1:172.21.15.88:6810/1011316311] conn(0x7fbd0c06c370 0x7fbd0c06e790 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:03.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.837+0000 7fbd07fff640 1 -- 172.21.15.88:0/1132201808 <== osd.1 v2:172.21.15.88:6808/1011316311 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fbd0c06ee40 con 0x7fbd0c06c370 2023-12-08T08:24:03.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.849+0000 7fbd25d01640 1 -- 172.21.15.88:0/1132201808 --> [v2:172.21.15.88:6808/1011316311,v1:172.21.15.88:6810/1011316311] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbd20070eb0 con 0x7fbd0c06c370 2023-12-08T08:24:03.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.849+0000 7fbd07fff640 1 -- 172.21.15.88:0/1132201808 <== osd.1 v2:172.21.15.88:6808/1011316311 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fbd20070eb0 con 0x7fbd0c06c370 2023-12-08T08:24:03.855 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-08T08:24:03.855 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T08:24:03.855 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-08T08:24:03.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.849+0000 7fbd25d01640 1 -- 172.21.15.88:0/1132201808 >> [v2:172.21.15.88:6808/1011316311,v1:172.21.15.88:6810/1011316311] conn(0x7fbd0c06c370 msgr2=0x7fbd0c06e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:03.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.849+0000 7fbd25d01640 1 --2- 172.21.15.88:0/1132201808 >> [v2:172.21.15.88:6808/1011316311,v1:172.21.15.88:6810/1011316311] conn(0x7fbd0c06c370 0x7fbd0c06e790 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:03.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.849+0000 7fbd25d01640 1 -- 172.21.15.88:0/1132201808 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbd0c066470 msgr2=0x7fbd0c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:03.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.849+0000 7fbd25d01640 1 --2- 172.21.15.88:0/1132201808 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fbd0c066470 0x7fbd0c068930 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000b9d0 tx=0x7fbd10008040 comp rx=0 tx=0).stop 2023-12-08T08:24:03.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.849+0000 7fbd25d01640 1 -- 172.21.15.88:0/1132201808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd2014fc30 msgr2=0x7fbd2014c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:03.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.849+0000 7fbd25d01640 1 --2- 172.21.15.88:0/1132201808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd2014fc30 0x7fbd2014c820 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fbd18007e60 tx=0x7fbd1800e4b0 comp rx=0 tx=0).stop 2023-12-08T08:24:03.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.849+0000 7fbd1ffff640 1 -- 172.21.15.88:0/1132201808 reap_dead start 2023-12-08T08:24:03.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.849+0000 7fbd25d01640 1 -- 172.21.15.88:0/1132201808 shutdown_connections 2023-12-08T08:24:03.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.849+0000 7fbd25d01640 1 -- 172.21.15.88:0/1132201808 >> 172.21.15.88:0/1132201808 conn(0x7fbd200c59f0 msgr2=0x7fbd2006d060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:03.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.849+0000 7fbd25d01640 1 -- 172.21.15.88:0/1132201808 shutdown_connections 2023-12-08T08:24:03.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:03.849+0000 7fbd25d01640 1 -- 172.21.15.88:0/1132201808 wait complete. 2023-12-08T08:24:03.873 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-08T08:24:04.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.005+0000 7f564098d640 1 Processor -- start 2023-12-08T08:24:04.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.005+0000 7f564098d640 1 -- start start 2023-12-08T08:24:04.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.009+0000 7f564098d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f563c06bc70 0x7f563c0a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:04.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.009+0000 7f564098d640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f563c14e550 0x7f563c150f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:04.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.009+0000 7f564098d640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563c0a4cc0 con 0x7f563c0c66b0 2023-12-08T08:24:04.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.009+0000 7f564098d640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f563c0c23d0 con 0x7f563c14e550 2023-12-08T08:24:04.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.009+0000 7f564098d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563c0c1b70 con 0x7f563c06bc70 2023-12-08T08:24:04.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.009+0000 7f563a59c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f563c06bc70 0x7f563c0a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:04.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.009+0000 7f563a59c640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f563c06bc70 0x7f563c0a4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3301/0 says I am v2:172.21.15.88:57948/0 (socket says 172.21.15.88:57948) 2023-12-08T08:24:04.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.009+0000 7f563ad9d640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f563c14e550 0x7f563c150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:04.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.009+0000 7f563a59c640 1 -- 172.21.15.88:0/3806885447 learned_addr learned my addr 172.21.15.88:0/3806885447 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:04.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.009+0000 7f563a59c640 1 -- 172.21.15.88:0/3806885447 >> v2:172.21.15.148:3300/0 conn(0x7f563c14e550 msgr2=0x7f563c150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:04.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.009+0000 7f563a59c640 1 --2- 172.21.15.88:0/3806885447 >> v2:172.21.15.148:3300/0 conn(0x7f563c14e550 0x7f563c150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.009+0000 7f563a59c640 1 -- 172.21.15.88:0/3806885447 >> v1:172.21.15.148:6789/0 conn(0x7f563c0c66b0 legacy=0x7f563c14de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:04.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.009+0000 7f563a59c640 1 -- 172.21.15.88:0/3806885447 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563c0c1d80 con 0x7f563c06bc70 2023-12-08T08:24:04.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.013+0000 7f563a59c640 1 --2- 172.21.15.88:0/3806885447 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f563c06bc70 0x7f563c0a4fa0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f562c0098a0 tx=0x7f562c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62b16d5c52415e12 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:04.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.013+0000 7f5639d9b640 1 -- 172.21.15.88:0/3806885447 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c0ab600 con 0x7f563c06bc70 2023-12-08T08:24:04.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.013+0000 7f5639d9b640 1 -- 172.21.15.88:0/3806885447 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562c0a7050 con 0x7f563c06bc70 2023-12-08T08:24:04.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.013+0000 7f5639d9b640 1 -- 172.21.15.88:0/3806885447 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c0ab980 con 0x7f563c06bc70 2023-12-08T08:24:04.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.013+0000 7f564098d640 1 -- 172.21.15.88:0/3806885447 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f563c06bc70 msgr2=0x7f563c0a4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:04.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.013+0000 7f564098d640 1 --2- 172.21.15.88:0/3806885447 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f563c06bc70 0x7f563c0a4fa0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f562c0098a0 tx=0x7f562c01c3c0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.013+0000 7f564098d640 1 -- 172.21.15.88:0/3806885447 shutdown_connections 2023-12-08T08:24:04.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.013+0000 7f564098d640 1 --2- 172.21.15.88:0/3806885447 >> v2:172.21.15.148:3300/0 conn(0x7f563c14e550 0x7f563c150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.013+0000 7f564098d640 1 --2- 172.21.15.88:0/3806885447 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f563c06bc70 0x7f563c0a4fa0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.013+0000 7f564098d640 1 -- 172.21.15.88:0/3806885447 >> 172.21.15.88:0/3806885447 conn(0x7f563c06b220 msgr2=0x7f563c0a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:04.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.013+0000 7f564098d640 1 -- 172.21.15.88:0/3806885447 shutdown_connections 2023-12-08T08:24:04.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.013+0000 7f564098d640 1 -- 172.21.15.88:0/3806885447 wait complete. 2023-12-08T08:24:04.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.013+0000 7f564098d640 1 Processor -- start 2023-12-08T08:24:04.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.013+0000 7f564098d640 1 -- start start 2023-12-08T08:24:04.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.017+0000 7f564098d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f563c06bc70 0x7f563c0bf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:04.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.017+0000 7f564098d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f563c0c66b0 0x7f563c148c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:04.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.017+0000 7f564098d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f563c14e550 0x7f563c1491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:04.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.017+0000 7f564098d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c1471e0 con 0x7f563c06bc70 2023-12-08T08:24:04.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.017+0000 7f564098d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c147480 con 0x7f563c14e550 2023-12-08T08:24:04.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.017+0000 7f564098d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563c15d5f0 con 0x7f563c0c66b0 2023-12-08T08:24:04.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.017+0000 7f563a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f563c06bc70 0x7f563c0bf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:04.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.017+0000 7f563a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f563c06bc70 0x7f563c0bf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43000/0 (socket says 172.21.15.88:43000) 2023-12-08T08:24:04.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.017+0000 7f563a59c640 1 -- 172.21.15.88:0/3640361691 learned_addr learned my addr 172.21.15.88:0/3640361691 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:04.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.017+0000 7f563ad9d640 1 --2- 172.21.15.88:0/3640361691 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f563c14e550 0x7f563c1491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:04.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.017+0000 7f5631d9b640 1 --2- 172.21.15.88:0/3640361691 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f563c0c66b0 0x7f563c148c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:04.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.017+0000 7f563a59c640 1 -- 172.21.15.88:0/3640361691 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f563c0c66b0 msgr2=0x7f563c148c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:04.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.017+0000 7f563a59c640 1 --2- 172.21.15.88:0/3640361691 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f563c0c66b0 0x7f563c148c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.017+0000 7f563a59c640 1 -- 172.21.15.88:0/3640361691 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f563c14e550 msgr2=0x7f563c1491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:04.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.017+0000 7f563a59c640 1 --2- 172.21.15.88:0/3640361691 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f563c14e550 0x7f563c1491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.017+0000 7f563a59c640 1 -- 172.21.15.88:0/3640361691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f562c0094d0 con 0x7f563c06bc70 2023-12-08T08:24:04.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.017+0000 7f563a59c640 1 --2- 172.21.15.88:0/3640361691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f563c06bc70 0x7f563c0bf0c0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f562c0ae040 tx=0x7f562c01ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:04.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.017+0000 7f56337fe640 1 -- 172.21.15.88:0/3640361691 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c0abe50 con 0x7f563c06bc70 2023-12-08T08:24:04.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.017+0000 7f56337fe640 1 -- 172.21.15.88:0/3640361691 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562c0b6420 con 0x7f563c06bc70 2023-12-08T08:24:04.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.017+0000 7f56337fe640 1 -- 172.21.15.88:0/3640361691 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c0b67d0 con 0x7f563c06bc70 2023-12-08T08:24:04.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.017+0000 7f564098d640 1 -- 172.21.15.88:0/3640361691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f563c15d8d0 con 0x7f563c06bc70 2023-12-08T08:24:04.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.017+0000 7f564098d640 1 -- 172.21.15.88:0/3640361691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f563c0bf600 con 0x7f563c06bc70 2023-12-08T08:24:04.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.017+0000 7f564098d640 1 -- 172.21.15.88:0/3640361691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f563c0aafc0 con 0x7f563c06bc70 2023-12-08T08:24:04.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.021+0000 7f56337fe640 1 -- 172.21.15.88:0/3640361691 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f562c0b2040 con 0x7f563c06bc70 2023-12-08T08:24:04.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.021+0000 7f56337fe640 1 --2- 172.21.15.88:0/3640361691 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f561c066470 0x7f561c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:04.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.021+0000 7f56337fe640 1 -- 172.21.15.88:0/3640361691 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f562c11ddf0 con 0x7f563c06bc70 2023-12-08T08:24:04.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.021+0000 7f5631d9b640 1 --2- 172.21.15.88:0/3640361691 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f561c066470 0x7f561c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:04.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.021+0000 7f5631d9b640 1 --2- 172.21.15.88:0/3640361691 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f561c066470 0x7f561c068930 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f563c1f1370 tx=0x7f5624009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:04.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.025+0000 7f56337fe640 1 -- 172.21.15.88:0/3640361691 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f562c0eb510 con 0x7f563c06bc70 2023-12-08T08:24:04.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.173+0000 7f564098d640 1 -- 172.21.15.88:0/3640361691 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f563c06c260 con 0x7f561c066470 2023-12-08T08:24:04.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.173+0000 7f56337fe640 1 -- 172.21.15.88:0/3640361691 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5624001c80 con 0x7f561c066470 2023-12-08T08:24:04.180 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 1 to deep-scrub 2023-12-08T08:24:04.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.177+0000 7f564098d640 1 -- 172.21.15.88:0/3640361691 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f561c066470 msgr2=0x7f561c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:04.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.177+0000 7f564098d640 1 --2- 172.21.15.88:0/3640361691 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f561c066470 0x7f561c068930 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f563c1f1370 tx=0x7f5624009040 comp rx=0 tx=0).stop 2023-12-08T08:24:04.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.177+0000 7f564098d640 1 -- 172.21.15.88:0/3640361691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f563c06bc70 msgr2=0x7f563c0bf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:04.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.177+0000 7f564098d640 1 --2- 172.21.15.88:0/3640361691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f563c06bc70 0x7f563c0bf0c0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f562c0ae040 tx=0x7f562c01ac00 comp rx=0 tx=0).stop 2023-12-08T08:24:04.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.177+0000 7f564098d640 1 -- 172.21.15.88:0/3640361691 shutdown_connections 2023-12-08T08:24:04.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.177+0000 7f564098d640 1 --2- 172.21.15.88:0/3640361691 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f561c066470 0x7f561c068930 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.177+0000 7f564098d640 1 --2- 172.21.15.88:0/3640361691 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f563c14e550 0x7f563c1491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.177+0000 7f564098d640 1 --2- 172.21.15.88:0/3640361691 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f563c0c66b0 0x7f563c148c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.177+0000 7f564098d640 1 --2- 172.21.15.88:0/3640361691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f563c06bc70 0x7f563c0bf0c0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.177+0000 7f564098d640 1 -- 172.21.15.88:0/3640361691 >> 172.21.15.88:0/3640361691 conn(0x7f563c06b220 msgr2=0x7f563c0a6530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:04.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.177+0000 7f564098d640 1 -- 172.21.15.88:0/3640361691 shutdown_connections 2023-12-08T08:24:04.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.177+0000 7f564098d640 1 -- 172.21.15.88:0/3640361691 wait complete. 2023-12-08T08:24:04.201 INFO:tasks.ceph:Scrubbing osd.2 2023-12-08T08:24:04.201 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-08T08:24:04.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.337+0000 7fe571772640 1 Processor -- start 2023-12-08T08:24:04.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.337+0000 7fe571772640 1 -- start start 2023-12-08T08:24:04.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.337+0000 7fe571772640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe56c0c98f0 0x7fe56c0c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:04.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.337+0000 7fe571772640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe56c158780 con 0x7fe56c0bf2d0 2023-12-08T08:24:04.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.337+0000 7fe571772640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe56c0c8910 con 0x7fe56c0c6030 2023-12-08T08:24:04.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.337+0000 7fe571772640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c0c0300 con 0x7fe56c0c98f0 2023-12-08T08:24:04.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.337+0000 7fe56affd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe56c0bf2d0 0x7fe56c151970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45934/0 (socket says 172.21.15.88:45934) 2023-12-08T08:24:04.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.337+0000 7fe56affd640 1 -- 172.21.15.88:0/3408479160 learned_addr learned my addr 172.21.15.88:0/3408479160 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:24:04.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.337+0000 7fe56b7fe640 1 --2- 172.21.15.88:0/3408479160 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe56c0c98f0 0x7fe56c0c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:04.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.337+0000 7fe56a7fc640 1 -- 172.21.15.88:0/3408479160 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1018012977 0 0) 0x7fe56c158780 con 0x7fe56c0bf2d0 2023-12-08T08:24:04.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.337+0000 7fe56a7fc640 1 -- 172.21.15.88:0/3408479160 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe558003530 con 0x7fe56c0bf2d0 2023-12-08T08:24:04.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.341+0000 7fe56a7fc640 1 -- 172.21.15.88:0/3408479160 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 796572488 0 0) 0x7fe56c0c8910 con 0x7fe56c0c6030 2023-12-08T08:24:04.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.341+0000 7fe56a7fc640 1 -- 172.21.15.88:0/3408479160 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe56c158780 con 0x7fe56c0c6030 2023-12-08T08:24:04.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.341+0000 7fe56a7fc640 1 -- 172.21.15.88:0/3408479160 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1019941646 0 0) 0x7fe558003530 con 0x7fe56c0bf2d0 2023-12-08T08:24:04.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.341+0000 7fe56b7fe640 1 -- 172.21.15.88:0/3408479160 >> v1:172.21.15.148:6789/0 conn(0x7fe56c0c6030 legacy=0x7fe56c0c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:04.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.341+0000 7fe56b7fe640 1 -- 172.21.15.88:0/3408479160 >> v1:172.21.15.88:6789/0 conn(0x7fe56c0bf2d0 legacy=0x7fe56c151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:04.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.341+0000 7fe56b7fe640 1 -- 172.21.15.88:0/3408479160 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56c157b70 con 0x7fe56c0c98f0 2023-12-08T08:24:04.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.341+0000 7fe56b7fe640 1 --2- 172.21.15.88:0/3408479160 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe56c0c98f0 0x7fe56c0c83d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe5640097f0 tx=0x7fe56401c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c22ebdaa0cbfc2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:04.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.341+0000 7fe56a7fc640 1 -- 172.21.15.88:0/3408479160 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c001a00 con 0x7fe56c0c98f0 2023-12-08T08:24:04.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.341+0000 7fe56a7fc640 1 -- 172.21.15.88:0/3408479160 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5640a7050 con 0x7fe56c0c98f0 2023-12-08T08:24:04.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.341+0000 7fe56a7fc640 1 -- 172.21.15.88:0/3408479160 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5640ab600 con 0x7fe56c0c98f0 2023-12-08T08:24:04.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.345+0000 7fe571772640 1 -- 172.21.15.88:0/3408479160 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe56c0c98f0 msgr2=0x7fe56c0c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:04.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.345+0000 7fe571772640 1 --2- 172.21.15.88:0/3408479160 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe56c0c98f0 0x7fe56c0c83d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe5640097f0 tx=0x7fe56401c3b0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.345+0000 7fe571772640 1 -- 172.21.15.88:0/3408479160 shutdown_connections 2023-12-08T08:24:04.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.345+0000 7fe571772640 1 --2- 172.21.15.88:0/3408479160 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe56c0c98f0 0x7fe56c0c83d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.345+0000 7fe571772640 1 -- 172.21.15.88:0/3408479160 >> 172.21.15.88:0/3408479160 conn(0x7fe56c0c9dc0 msgr2=0x7fe56c0ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:04.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.345+0000 7fe571772640 1 -- 172.21.15.88:0/3408479160 shutdown_connections 2023-12-08T08:24:04.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.345+0000 7fe571772640 1 -- 172.21.15.88:0/3408479160 wait complete. 2023-12-08T08:24:04.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.345+0000 7fe571772640 1 Processor -- start 2023-12-08T08:24:04.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.345+0000 7fe571772640 1 -- start start 2023-12-08T08:24:04.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.345+0000 7fe571772640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe56c0bf2d0 0x7fe56c140870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:04.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.345+0000 7fe571772640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe56c0c6030 0x7fe56c1ed020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:04.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.345+0000 7fe571772640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe56c0c98f0 0x7fe56c1ed560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:04.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.345+0000 7fe571772640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c148c50 con 0x7fe56c0c98f0 2023-12-08T08:24:04.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.345+0000 7fe571772640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c1f0c30 con 0x7fe56c0bf2d0 2023-12-08T08:24:04.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.345+0000 7fe571772640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c148e60 con 0x7fe56c0c6030 2023-12-08T08:24:04.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.345+0000 7fe56b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe56c0c98f0 0x7fe56c1ed560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:04.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.345+0000 7fe56affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe56c0bf2d0 0x7fe56c140870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:04.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.345+0000 7fe56b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe56c0c98f0 0x7fe56c1ed560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43008/0 (socket says 172.21.15.88:43008) 2023-12-08T08:24:04.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.345+0000 7fe56b7fe640 1 -- 172.21.15.88:0/3955694158 learned_addr learned my addr 172.21.15.88:0/3955694158 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:04.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.345+0000 7fe5627fc640 1 --2- 172.21.15.88:0/3955694158 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe56c0c6030 0x7fe56c1ed020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:04.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.345+0000 7fe56b7fe640 1 -- 172.21.15.88:0/3955694158 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe56c0c6030 msgr2=0x7fe56c1ed020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:04.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.345+0000 7fe56b7fe640 1 --2- 172.21.15.88:0/3955694158 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe56c0c6030 0x7fe56c1ed020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.349+0000 7fe56b7fe640 1 -- 172.21.15.88:0/3955694158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe56c0bf2d0 msgr2=0x7fe56c140870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:04.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.349+0000 7fe56b7fe640 1 --2- 172.21.15.88:0/3955694158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe56c0bf2d0 0x7fe56c140870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.349+0000 7fe56b7fe640 1 -- 172.21.15.88:0/3955694158 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe564009420 con 0x7fe56c0c98f0 2023-12-08T08:24:04.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.349+0000 7fe56b7fe640 1 --2- 172.21.15.88:0/3955694158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe56c0c98f0 0x7fe56c1ed560 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fe5640097f0 tx=0x7fe564019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:04.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.349+0000 7fe563fff640 1 -- 172.21.15.88:0/3955694158 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe564003a30 con 0x7fe56c0c98f0 2023-12-08T08:24:04.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.349+0000 7fe563fff640 1 -- 172.21.15.88:0/3955694158 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe564003b90 con 0x7fe56c0c98f0 2023-12-08T08:24:04.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.349+0000 7fe563fff640 1 -- 172.21.15.88:0/3955694158 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5640b5410 con 0x7fe56c0c98f0 2023-12-08T08:24:04.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.349+0000 7fe571772640 1 -- 172.21.15.88:0/3955694158 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe56c1ecb00 con 0x7fe56c0c98f0 2023-12-08T08:24:04.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.349+0000 7fe571772640 1 -- 172.21.15.88:0/3955694158 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe56c149140 con 0x7fe56c0c98f0 2023-12-08T08:24:04.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.349+0000 7fe571772640 1 -- 172.21.15.88:0/3955694158 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe56c0c8b60 con 0x7fe56c0c98f0 2023-12-08T08:24:04.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.349+0000 7fe563fff640 1 -- 172.21.15.88:0/3955694158 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe5640b2050 con 0x7fe56c0c98f0 2023-12-08T08:24:04.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.349+0000 7fe563fff640 1 --2- 172.21.15.88:0/3955694158 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe54c066470 0x7fe54c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:04.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.349+0000 7fe563fff640 1 -- 172.21.15.88:0/3955694158 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fe56411dcd0 con 0x7fe56c0c98f0 2023-12-08T08:24:04.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.349+0000 7fe56affd640 1 --2- 172.21.15.88:0/3955694158 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe54c066470 0x7fe54c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:04.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.349+0000 7fe563fff640 1 --2- 172.21.15.88:0/3955694158 >> [v2:172.21.15.88:6824/4207137329,v1:172.21.15.88:6825/4207137329] conn(0x7fe54c06c370 0x7fe54c06e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:04.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.349+0000 7fe563fff640 1 -- 172.21.15.88:0/3955694158 --> [v2:172.21.15.88:6824/4207137329,v1:172.21.15.88:6825/4207137329] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe54c06ee40 con 0x7fe54c06c370 2023-12-08T08:24:04.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.349+0000 7fe563fff640 1 -- 172.21.15.88:0/3955694158 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe564120390 con 0x7fe56c0c98f0 2023-12-08T08:24:04.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.349+0000 7fe5627fc640 1 --2- 172.21.15.88:0/3955694158 >> [v2:172.21.15.88:6824/4207137329,v1:172.21.15.88:6825/4207137329] conn(0x7fe54c06c370 0x7fe54c06e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:04.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.353+0000 7fe56affd640 1 --2- 172.21.15.88:0/3955694158 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe54c066470 0x7fe54c068930 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe55c001360 tx=0x7fe55c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:04.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.353+0000 7fe5627fc640 1 --2- 172.21.15.88:0/3955694158 >> [v2:172.21.15.88:6824/4207137329,v1:172.21.15.88:6825/4207137329] conn(0x7fe54c06c370 0x7fe54c06e790 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:04.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.353+0000 7fe563fff640 1 -- 172.21.15.88:0/3955694158 <== osd.2 v2:172.21.15.88:6824/4207137329 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe54c06ee40 con 0x7fe54c06c370 2023-12-08T08:24:04.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.365+0000 7fe571772640 1 -- 172.21.15.88:0/3955694158 --> [v2:172.21.15.88:6824/4207137329,v1:172.21.15.88:6825/4207137329] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe56c0bf6b0 con 0x7fe54c06c370 2023-12-08T08:24:04.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.365+0000 7fe563fff640 1 -- 172.21.15.88:0/3955694158 <== osd.2 v2:172.21.15.88:6824/4207137329 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe554001910 con 0x7fe54c06c370 2023-12-08T08:24:04.371 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-08T08:24:04.371 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T08:24:04.371 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-08T08:24:04.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.365+0000 7fe571772640 1 -- 172.21.15.88:0/3955694158 >> [v2:172.21.15.88:6824/4207137329,v1:172.21.15.88:6825/4207137329] conn(0x7fe54c06c370 msgr2=0x7fe54c06e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:04.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.365+0000 7fe571772640 1 --2- 172.21.15.88:0/3955694158 >> [v2:172.21.15.88:6824/4207137329,v1:172.21.15.88:6825/4207137329] conn(0x7fe54c06c370 0x7fe54c06e790 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.365+0000 7fe571772640 1 -- 172.21.15.88:0/3955694158 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe54c066470 msgr2=0x7fe54c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:04.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.365+0000 7fe571772640 1 --2- 172.21.15.88:0/3955694158 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe54c066470 0x7fe54c068930 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe55c001360 tx=0x7fe55c009040 comp rx=0 tx=0).stop 2023-12-08T08:24:04.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.365+0000 7fe571772640 1 -- 172.21.15.88:0/3955694158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe56c0c98f0 msgr2=0x7fe56c1ed560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:04.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.365+0000 7fe571772640 1 --2- 172.21.15.88:0/3955694158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe56c0c98f0 0x7fe56c1ed560 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fe5640097f0 tx=0x7fe564019150 comp rx=0 tx=0).stop 2023-12-08T08:24:04.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.365+0000 7fe56b7fe640 1 -- 172.21.15.88:0/3955694158 reap_dead start 2023-12-08T08:24:04.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.365+0000 7fe571772640 1 -- 172.21.15.88:0/3955694158 shutdown_connections 2023-12-08T08:24:04.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.365+0000 7fe571772640 1 -- 172.21.15.88:0/3955694158 >> 172.21.15.88:0/3955694158 conn(0x7fe56c0c9dc0 msgr2=0x7fe56c155720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:04.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.365+0000 7fe571772640 1 -- 172.21.15.88:0/3955694158 shutdown_connections 2023-12-08T08:24:04.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.365+0000 7fe571772640 1 -- 172.21.15.88:0/3955694158 wait complete. 2023-12-08T08:24:04.389 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-08T08:24:04.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.521+0000 7f1524a16640 1 Processor -- start 2023-12-08T08:24:04.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.521+0000 7f1524a16640 1 -- start start 2023-12-08T08:24:04.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.525+0000 7f1524a16640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f15200a4f90 0x7f15200c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:04.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.525+0000 7f1524a16640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1520072810 0x7f15200c0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:04.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.525+0000 7f1524a16640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15201524b0 con 0x7f15200a5370 2023-12-08T08:24:04.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.525+0000 7f1524a16640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15200c62f0 con 0x7f15200a4f90 2023-12-08T08:24:04.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.525+0000 7f1524a16640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1520152770 con 0x7f1520072810 2023-12-08T08:24:04.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.525+0000 7f1515d9b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f15200a5370 0x7f152014f870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45950/0 (socket says 172.21.15.88:45950) 2023-12-08T08:24:04.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.525+0000 7f1515d9b640 1 -- 172.21.15.88:0/1345560228 learned_addr learned my addr 172.21.15.88:0/1345560228 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:24:04.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.525+0000 7f151ed9d640 1 --2- 172.21.15.88:0/1345560228 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1520072810 0x7f15200c0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:04.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.525+0000 7f151e59c640 1 --2- 172.21.15.88:0/1345560228 >> v2:172.21.15.148:3300/0 conn(0x7f15200a4f90 0x7f15200c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:04.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.525+0000 7f151dd9b640 1 -- 172.21.15.88:0/1345560228 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3390042311 0 0) 0x7f15201524b0 con 0x7f15200a5370 2023-12-08T08:24:04.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.525+0000 7f151dd9b640 1 -- 172.21.15.88:0/1345560228 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f150c003530 con 0x7f15200a5370 2023-12-08T08:24:04.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.525+0000 7f151ed9d640 1 -- 172.21.15.88:0/1345560228 >> v2:172.21.15.148:3300/0 conn(0x7f15200a4f90 msgr2=0x7f15200c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:04.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.525+0000 7f151ed9d640 1 --2- 172.21.15.88:0/1345560228 >> v2:172.21.15.148:3300/0 conn(0x7f15200a4f90 0x7f15200c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.525+0000 7f151dd9b640 1 -- 172.21.15.88:0/1345560228 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3338937682 0 0) 0x7f150c003530 con 0x7f15200a5370 2023-12-08T08:24:04.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.525+0000 7f151ed9d640 1 -- 172.21.15.88:0/1345560228 >> v1:172.21.15.88:6789/0 conn(0x7f15200a5370 legacy=0x7f152014f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:04.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.525+0000 7f151ed9d640 1 -- 172.21.15.88:0/1345560228 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1520152a50 con 0x7f1520072810 2023-12-08T08:24:04.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.529+0000 7f151ed9d640 1 --2- 172.21.15.88:0/1345560228 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1520072810 0x7f15200c0800 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1518009d90 tx=0x7f151801c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aacc3ad6612781e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:04.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.529+0000 7f151dd9b640 1 -- 172.21.15.88:0/1345560228 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1508001680 con 0x7f1520072810 2023-12-08T08:24:04.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.529+0000 7f151dd9b640 1 -- 172.21.15.88:0/1345560228 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15180a8450 con 0x7f1520072810 2023-12-08T08:24:04.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.529+0000 7f151dd9b640 1 -- 172.21.15.88:0/1345560228 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15180a87c0 con 0x7f1520072810 2023-12-08T08:24:04.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.529+0000 7f1524a16640 1 -- 172.21.15.88:0/1345560228 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1520072810 msgr2=0x7f15200c0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:04.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.529+0000 7f1524a16640 1 --2- 172.21.15.88:0/1345560228 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1520072810 0x7f15200c0800 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1518009d90 tx=0x7f151801c7e0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.529+0000 7f1524a16640 1 -- 172.21.15.88:0/1345560228 shutdown_connections 2023-12-08T08:24:04.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.529+0000 7f1524a16640 1 --2- 172.21.15.88:0/1345560228 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1520072810 0x7f15200c0800 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.529+0000 7f1524a16640 1 --2- 172.21.15.88:0/1345560228 >> v2:172.21.15.148:3300/0 conn(0x7f15200a4f90 0x7f15200c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.529+0000 7f1524a16640 1 -- 172.21.15.88:0/1345560228 >> 172.21.15.88:0/1345560228 conn(0x7f152006b220 msgr2=0x7f15200a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:04.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.529+0000 7f1524a16640 1 -- 172.21.15.88:0/1345560228 shutdown_connections 2023-12-08T08:24:04.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.529+0000 7f1524a16640 1 -- 172.21.15.88:0/1345560228 wait complete. 2023-12-08T08:24:04.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.529+0000 7f1524a16640 1 Processor -- start 2023-12-08T08:24:04.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.529+0000 7f1524a16640 1 -- start start 2023-12-08T08:24:04.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.533+0000 7f1524a16640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1520072810 0x7f15200bf750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:04.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.533+0000 7f1524a16640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15200a4f90 0x7f152015b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:04.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.533+0000 7f1524a16640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15200a5370 0x7f15201f08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:04.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.533+0000 7f1524a16640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15200bff80 con 0x7f15200a5370 2023-12-08T08:24:04.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.533+0000 7f1524a16640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15201f03d0 con 0x7f15200a4f90 2023-12-08T08:24:04.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.533+0000 7f1524a16640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15201557a0 con 0x7f1520072810 2023-12-08T08:24:04.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.533+0000 7f151ed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15200a5370 0x7f15201f08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:04.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.533+0000 7f151ed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15200a5370 0x7f15201f08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43012/0 (socket says 172.21.15.88:43012) 2023-12-08T08:24:04.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.533+0000 7f151ed9d640 1 -- 172.21.15.88:0/117487005 learned_addr learned my addr 172.21.15.88:0/117487005 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:04.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.533+0000 7f151e59c640 1 --2- 172.21.15.88:0/117487005 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1520072810 0x7f15200bf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:04.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.533+0000 7f1515d9b640 1 --2- 172.21.15.88:0/117487005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15200a4f90 0x7f152015b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:04.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.533+0000 7f151ed9d640 1 -- 172.21.15.88:0/117487005 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1520072810 msgr2=0x7f15200bf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:04.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.533+0000 7f151ed9d640 1 --2- 172.21.15.88:0/117487005 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1520072810 0x7f15200bf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.533+0000 7f151ed9d640 1 -- 172.21.15.88:0/117487005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15200a4f90 msgr2=0x7f152015b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:04.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.533+0000 7f151ed9d640 1 --2- 172.21.15.88:0/117487005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15200a4f90 0x7f152015b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.533+0000 7f151ed9d640 1 -- 172.21.15.88:0/117487005 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1518009a70 con 0x7f15200a5370 2023-12-08T08:24:04.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.533+0000 7f151ed9d640 1 --2- 172.21.15.88:0/117487005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15200a5370 0x7f15201f08b0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f151801ae90 tx=0x7f1518019580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:04.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.533+0000 7f15177fe640 1 -- 172.21.15.88:0/117487005 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1518004450 con 0x7f15200a5370 2023-12-08T08:24:04.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.533+0000 7f15177fe640 1 -- 172.21.15.88:0/117487005 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15180b5070 con 0x7f15200a5370 2023-12-08T08:24:04.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.533+0000 7f1524a16640 1 -- 172.21.15.88:0/117487005 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1520155a80 con 0x7f15200a5370 2023-12-08T08:24:04.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.533+0000 7f15177fe640 1 -- 172.21.15.88:0/117487005 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15180047f0 con 0x7f15200a5370 2023-12-08T08:24:04.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.533+0000 7f1524a16640 1 -- 172.21.15.88:0/117487005 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15200bfc90 con 0x7f15200a5370 2023-12-08T08:24:04.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.533+0000 7f1524a16640 1 -- 172.21.15.88:0/117487005 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15201f0590 con 0x7f15200a5370 2023-12-08T08:24:04.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.533+0000 7f15177fe640 1 -- 172.21.15.88:0/117487005 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f15180a85c0 con 0x7f15200a5370 2023-12-08T08:24:04.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.537+0000 7f15177fe640 1 --2- 172.21.15.88:0/117487005 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1500066470 0x7f1500068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:04.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.537+0000 7f15177fe640 1 -- 172.21.15.88:0/117487005 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f151811ea70 con 0x7f15200a5370 2023-12-08T08:24:04.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.537+0000 7f151e59c640 1 --2- 172.21.15.88:0/117487005 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1500066470 0x7f1500068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:04.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.537+0000 7f151e59c640 1 --2- 172.21.15.88:0/117487005 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1500066470 0x7f1500068930 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1520071d60 tx=0x7f1510009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:04.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.541+0000 7f15177fe640 1 -- 172.21.15.88:0/117487005 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f15180ec2d0 con 0x7f15200a5370 2023-12-08T08:24:04.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.693+0000 7f1524a16640 1 -- 172.21.15.88:0/117487005 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f15200c1150 con 0x7f1500066470 2023-12-08T08:24:04.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.693+0000 7f15177fe640 1 -- 172.21.15.88:0/117487005 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1510011a60 con 0x7f1500066470 2023-12-08T08:24:04.699 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 2 to deep-scrub 2023-12-08T08:24:04.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.693+0000 7f1524a16640 1 -- 172.21.15.88:0/117487005 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1500066470 msgr2=0x7f1500068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:04.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.693+0000 7f1524a16640 1 --2- 172.21.15.88:0/117487005 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1500066470 0x7f1500068930 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1520071d60 tx=0x7f1510009190 comp rx=0 tx=0).stop 2023-12-08T08:24:04.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.693+0000 7f1524a16640 1 -- 172.21.15.88:0/117487005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15200a5370 msgr2=0x7f15201f08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:04.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.693+0000 7f1524a16640 1 --2- 172.21.15.88:0/117487005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15200a5370 0x7f15201f08b0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f151801ae90 tx=0x7f1518019580 comp rx=0 tx=0).stop 2023-12-08T08:24:04.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.693+0000 7f1524a16640 1 -- 172.21.15.88:0/117487005 shutdown_connections 2023-12-08T08:24:04.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.693+0000 7f1524a16640 1 --2- 172.21.15.88:0/117487005 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f1500066470 0x7f1500068930 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.693+0000 7f1524a16640 1 --2- 172.21.15.88:0/117487005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15200a5370 0x7f15201f08b0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.693+0000 7f1524a16640 1 --2- 172.21.15.88:0/117487005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15200a4f90 0x7f152015b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.693+0000 7f1524a16640 1 --2- 172.21.15.88:0/117487005 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f1520072810 0x7f15200bf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.693+0000 7f1524a16640 1 -- 172.21.15.88:0/117487005 >> 172.21.15.88:0/117487005 conn(0x7f152006b220 msgr2=0x7f15200a77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:04.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.693+0000 7f1524a16640 1 -- 172.21.15.88:0/117487005 shutdown_connections 2023-12-08T08:24:04.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.693+0000 7f1524a16640 1 -- 172.21.15.88:0/117487005 wait complete. 2023-12-08T08:24:04.719 INFO:tasks.ceph:Scrubbing osd.3 2023-12-08T08:24:04.719 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-08T08:24:04.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.857+0000 7f9e66a79640 1 Processor -- start 2023-12-08T08:24:04.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.857+0000 7f9e66a79640 1 -- start start 2023-12-08T08:24:04.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.857+0000 7f9e66a79640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9e6014b1e0 0x7f9e600c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:04.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.857+0000 7f9e66a79640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e601548c0 0x7f9e60154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:04.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.857+0000 7f9e66a79640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e600a4e20 con 0x7f9e600c5300 2023-12-08T08:24:04.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.857+0000 7f9e66a79640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e600a50e0 con 0x7f9e6014b1e0 2023-12-08T08:24:04.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.857+0000 7f9e66a79640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e600c0f00 con 0x7f9e601548c0 2023-12-08T08:24:04.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.857+0000 7f9e64815640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9e6014b1e0 0x7f9e600c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:04.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.857+0000 7f9e5ffff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9e600c5300 0x7f9e600a9c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45952/0 (socket says 172.21.15.88:45952) 2023-12-08T08:24:04.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.857+0000 7f9e64815640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9e6014b1e0 0x7f9e600c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43026/0 (socket says 172.21.15.88:43026) 2023-12-08T08:24:04.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.857+0000 7f9e5ffff640 1 -- 172.21.15.88:0/3188890501 learned_addr learned my addr 172.21.15.88:0/3188890501 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:24:04.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.857+0000 7f9e65016640 1 --2- 172.21.15.88:0/3188890501 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e601548c0 0x7f9e60154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:04.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.857+0000 7f9e64815640 1 -- 172.21.15.88:0/3188890501 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e601548c0 msgr2=0x7f9e60154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:04.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.857+0000 7f9e64815640 1 --2- 172.21.15.88:0/3188890501 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e601548c0 0x7f9e60154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.857+0000 7f9e64815640 1 -- 172.21.15.88:0/3188890501 >> v1:172.21.15.88:6789/0 conn(0x7f9e600c5300 legacy=0x7f9e600a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:04.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.857+0000 7f9e64815640 1 -- 172.21.15.88:0/3188890501 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e600c11e0 con 0x7f9e6014b1e0 2023-12-08T08:24:04.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.861+0000 7f9e64815640 1 --2- 172.21.15.88:0/3188890501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e6014b1e0 0x7f9e600c1700 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f9e540097f0 tx=0x7f9e5401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341ab505ba5b1e7b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:04.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.861+0000 7f9e5f7fe640 1 -- 172.21.15.88:0/3188890501 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e540ad640 con 0x7f9e6014b1e0 2023-12-08T08:24:04.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.861+0000 7f9e5f7fe640 1 -- 172.21.15.88:0/3188890501 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e540ad7a0 con 0x7f9e6014b1e0 2023-12-08T08:24:04.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.861+0000 7f9e5f7fe640 1 -- 172.21.15.88:0/3188890501 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e540adb30 con 0x7f9e6014b1e0 2023-12-08T08:24:04.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.861+0000 7f9e66a79640 1 -- 172.21.15.88:0/3188890501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e6014b1e0 msgr2=0x7f9e600c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:04.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.861+0000 7f9e66a79640 1 --2- 172.21.15.88:0/3188890501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e6014b1e0 0x7f9e600c1700 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f9e540097f0 tx=0x7f9e5401c480 comp rx=0 tx=0).stop 2023-12-08T08:24:04.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.861+0000 7f9e66a79640 1 -- 172.21.15.88:0/3188890501 shutdown_connections 2023-12-08T08:24:04.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.861+0000 7f9e66a79640 1 --2- 172.21.15.88:0/3188890501 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e601548c0 0x7f9e60154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.861+0000 7f9e66a79640 1 --2- 172.21.15.88:0/3188890501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e6014b1e0 0x7f9e600c1700 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.861+0000 7f9e66a79640 1 -- 172.21.15.88:0/3188890501 >> 172.21.15.88:0/3188890501 conn(0x7f9e600c59f0 msgr2=0x7f9e600c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:04.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.861+0000 7f9e66a79640 1 -- 172.21.15.88:0/3188890501 shutdown_connections 2023-12-08T08:24:04.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.861+0000 7f9e66a79640 1 -- 172.21.15.88:0/3188890501 wait complete. 2023-12-08T08:24:04.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.865+0000 7f9e66a79640 1 Processor -- start 2023-12-08T08:24:04.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.865+0000 7f9e66a79640 1 -- start start 2023-12-08T08:24:04.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.865+0000 7f9e66a79640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e600c5300 0x7f9e601467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:04.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.865+0000 7f9e66a79640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e6014b1e0 0x7f9e60153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:04.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.865+0000 7f9e66a79640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e601548c0 0x7f9e601ee4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:04.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.865+0000 7f9e66a79640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e601ebf10 con 0x7f9e601548c0 2023-12-08T08:24:04.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.865+0000 7f9e66a79640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e601eb990 con 0x7f9e600c5300 2023-12-08T08:24:04.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.865+0000 7f9e66a79640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e601ebc30 con 0x7f9e6014b1e0 2023-12-08T08:24:04.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.865+0000 7f9e65016640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e601548c0 0x7f9e601ee4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:04.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.865+0000 7f9e65016640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e601548c0 0x7f9e601ee4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43042/0 (socket says 172.21.15.88:43042) 2023-12-08T08:24:04.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.865+0000 7f9e65016640 1 -- 172.21.15.88:0/2546851108 learned_addr learned my addr 172.21.15.88:0/2546851108 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:04.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.865+0000 7f9e5ffff640 1 --2- 172.21.15.88:0/2546851108 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e6014b1e0 0x7f9e60153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:04.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.865+0000 7f9e64815640 1 --2- 172.21.15.88:0/2546851108 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e600c5300 0x7f9e601467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:04.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.865+0000 7f9e65016640 1 -- 172.21.15.88:0/2546851108 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e6014b1e0 msgr2=0x7f9e60153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:04.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.865+0000 7f9e65016640 1 --2- 172.21.15.88:0/2546851108 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e6014b1e0 0x7f9e60153740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.865+0000 7f9e65016640 1 -- 172.21.15.88:0/2546851108 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e600c5300 msgr2=0x7f9e601467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:04.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.865+0000 7f9e65016640 1 --2- 172.21.15.88:0/2546851108 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e600c5300 0x7f9e601467f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.865+0000 7f9e65016640 1 -- 172.21.15.88:0/2546851108 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e54009420 con 0x7f9e601548c0 2023-12-08T08:24:04.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.865+0000 7f9e5ffff640 1 --2- 172.21.15.88:0/2546851108 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9e6014b1e0 0x7f9e60153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:24:04.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.865+0000 7f9e64815640 1 --2- 172.21.15.88:0/2546851108 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e600c5300 0x7f9e601467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:24:04.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.865+0000 7f9e65016640 1 --2- 172.21.15.88:0/2546851108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e601548c0 0x7f9e601ee4d0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f9e58007e60 tx=0x7f9e5800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:04.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.865+0000 7f9e5d7fa640 1 -- 172.21.15.88:0/2546851108 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e58014420 con 0x7f9e601548c0 2023-12-08T08:24:04.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.865+0000 7f9e5d7fa640 1 -- 172.21.15.88:0/2546851108 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e580145a0 con 0x7f9e601548c0 2023-12-08T08:24:04.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.865+0000 7f9e66a79640 1 -- 172.21.15.88:0/2546851108 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e60145d10 con 0x7f9e601548c0 2023-12-08T08:24:04.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.865+0000 7f9e5d7fa640 1 -- 172.21.15.88:0/2546851108 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e58014950 con 0x7f9e601548c0 2023-12-08T08:24:04.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.865+0000 7f9e66a79640 1 -- 172.21.15.88:0/2546851108 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e601462d0 con 0x7f9e601548c0 2023-12-08T08:24:04.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.865+0000 7f9e66a79640 1 -- 172.21.15.88:0/2546851108 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9e6014b7d0 con 0x7f9e601548c0 2023-12-08T08:24:04.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.869+0000 7f9e5d7fa640 1 -- 172.21.15.88:0/2546851108 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9e58014ab0 con 0x7f9e601548c0 2023-12-08T08:24:04.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.869+0000 7f9e5d7fa640 1 --2- 172.21.15.88:0/2546851108 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9e440664a0 0x7f9e44068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:04.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.869+0000 7f9e5d7fa640 1 -- 172.21.15.88:0/2546851108 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f9e580844c0 con 0x7f9e601548c0 2023-12-08T08:24:04.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.869+0000 7f9e5d7fa640 1 --2- 172.21.15.88:0/2546851108 >> [v2:172.21.15.88:6800/22961328,v1:172.21.15.88:6801/22961328] conn(0x7f9e4406c3a0 0x7f9e4406e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:04.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.869+0000 7f9e64815640 1 --2- 172.21.15.88:0/2546851108 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9e440664a0 0x7f9e44068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:04.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.869+0000 7f9e5d7fa640 1 -- 172.21.15.88:0/2546851108 --> [v2:172.21.15.88:6800/22961328,v1:172.21.15.88:6801/22961328] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e4406ee70 con 0x7f9e4406c3a0 2023-12-08T08:24:04.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.869+0000 7f9e5d7fa640 1 -- 172.21.15.88:0/2546851108 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e58086aa0 con 0x7f9e601548c0 2023-12-08T08:24:04.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.869+0000 7f9e5ffff640 1 --2- 172.21.15.88:0/2546851108 >> [v2:172.21.15.88:6800/22961328,v1:172.21.15.88:6801/22961328] conn(0x7f9e4406c3a0 0x7f9e4406e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:04.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.869+0000 7f9e64815640 1 --2- 172.21.15.88:0/2546851108 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9e440664a0 0x7f9e44068960 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9e540af000 tx=0x7f9e54008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:04.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.869+0000 7f9e5ffff640 1 --2- 172.21.15.88:0/2546851108 >> [v2:172.21.15.88:6800/22961328,v1:172.21.15.88:6801/22961328] conn(0x7f9e4406c3a0 0x7f9e4406e7c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:04.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.869+0000 7f9e5d7fa640 1 -- 172.21.15.88:0/2546851108 <== osd.3 v2:172.21.15.88:6800/22961328 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9e4406ee70 con 0x7f9e4406c3a0 2023-12-08T08:24:04.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.881+0000 7f9e66a79640 1 -- 172.21.15.88:0/2546851108 --> [v2:172.21.15.88:6800/22961328,v1:172.21.15.88:6801/22961328] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9e60067630 con 0x7f9e4406c3a0 2023-12-08T08:24:04.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.881+0000 7f9e5d7fa640 1 -- 172.21.15.88:0/2546851108 <== osd.3 v2:172.21.15.88:6800/22961328 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9e60067630 con 0x7f9e4406c3a0 2023-12-08T08:24:04.889 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-08T08:24:04.889 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T08:24:04.889 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-08T08:24:04.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.885+0000 7f9e66a79640 1 -- 172.21.15.88:0/2546851108 >> [v2:172.21.15.88:6800/22961328,v1:172.21.15.88:6801/22961328] conn(0x7f9e4406c3a0 msgr2=0x7f9e4406e7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:04.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.885+0000 7f9e66a79640 1 --2- 172.21.15.88:0/2546851108 >> [v2:172.21.15.88:6800/22961328,v1:172.21.15.88:6801/22961328] conn(0x7f9e4406c3a0 0x7f9e4406e7c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.885+0000 7f9e66a79640 1 -- 172.21.15.88:0/2546851108 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9e440664a0 msgr2=0x7f9e44068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:04.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.885+0000 7f9e66a79640 1 --2- 172.21.15.88:0/2546851108 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f9e440664a0 0x7f9e44068960 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9e540af000 tx=0x7f9e54008040 comp rx=0 tx=0).stop 2023-12-08T08:24:04.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.885+0000 7f9e66a79640 1 -- 172.21.15.88:0/2546851108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e601548c0 msgr2=0x7f9e601ee4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:04.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.885+0000 7f9e66a79640 1 --2- 172.21.15.88:0/2546851108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e601548c0 0x7f9e601ee4d0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f9e58007e60 tx=0x7f9e5800e4b0 comp rx=0 tx=0).stop 2023-12-08T08:24:04.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.885+0000 7f9e65016640 1 -- 172.21.15.88:0/2546851108 reap_dead start 2023-12-08T08:24:04.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.885+0000 7f9e66a79640 1 -- 172.21.15.88:0/2546851108 shutdown_connections 2023-12-08T08:24:04.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.885+0000 7f9e66a79640 1 -- 172.21.15.88:0/2546851108 >> 172.21.15.88:0/2546851108 conn(0x7f9e600c59f0 msgr2=0x7f9e600c2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:04.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.885+0000 7f9e66a79640 1 -- 172.21.15.88:0/2546851108 shutdown_connections 2023-12-08T08:24:04.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:04.885+0000 7f9e66a79640 1 -- 172.21.15.88:0/2546851108 wait complete. 2023-12-08T08:24:04.907 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-08T08:24:05.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.041+0000 7f62e66e3640 1 Processor -- start 2023-12-08T08:24:05.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.041+0000 7f62e66e3640 1 -- start start 2023-12-08T08:24:05.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.041+0000 7f62e66e3640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f62e00a5200 0x7f62e0154960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:05.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.041+0000 7f62e66e3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f62e00c40c0 0x7f62e0154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:05.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.041+0000 7f62e66e3640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e0152170 con 0x7f62e0151d90 2023-12-08T08:24:05.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.041+0000 7f62e66e3640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e0158630 con 0x7f62e00c40c0 2023-12-08T08:24:05.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.041+0000 7f62e66e3640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e0158b60 con 0x7f62e00a5200 2023-12-08T08:24:05.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.041+0000 7f62e4c80640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f62e00c40c0 0x7f62e0154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:05.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.041+0000 7f62dffff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f62e0151d90 0x7f62e00c4530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45954/0 (socket says 172.21.15.88:45954) 2023-12-08T08:24:05.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.041+0000 7f62dffff640 1 -- 172.21.15.88:0/2500920452 learned_addr learned my addr 172.21.15.88:0/2500920452 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:24:05.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.045+0000 7f62df7fe640 1 --2- 172.21.15.88:0/2500920452 >> v2:172.21.15.148:3300/0 conn(0x7f62e00a5200 0x7f62e0154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:05.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.045+0000 7f62e4c80640 1 -- 172.21.15.88:0/2500920452 >> v2:172.21.15.148:3300/0 conn(0x7f62e00a5200 msgr2=0x7f62e0154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:05.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.045+0000 7f62e4c80640 1 --2- 172.21.15.88:0/2500920452 >> v2:172.21.15.148:3300/0 conn(0x7f62e00a5200 0x7f62e0154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.045+0000 7f62e4c80640 1 -- 172.21.15.88:0/2500920452 >> v1:172.21.15.88:6789/0 conn(0x7f62e0151d90 legacy=0x7f62e00c4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:05.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.045+0000 7f62e4c80640 1 -- 172.21.15.88:0/2500920452 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e0158880 con 0x7f62e00c40c0 2023-12-08T08:24:05.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.045+0000 7f62df7fe640 1 --2- 172.21.15.88:0/2500920452 >> v2:172.21.15.148:3300/0 conn(0x7f62e00a5200 0x7f62e0154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:24:05.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.045+0000 7f62e4c80640 1 --2- 172.21.15.88:0/2500920452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62e00c40c0 0x7f62e0154ea0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f62e00c2490 tx=0x7f62d801c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93b3efd7c5f4cae server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:05.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.045+0000 7f62deffd640 1 -- 172.21.15.88:0/2500920452 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d80a5880 con 0x7f62e00c40c0 2023-12-08T08:24:05.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.045+0000 7f62deffd640 1 -- 172.21.15.88:0/2500920452 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d80a59e0 con 0x7f62e00c40c0 2023-12-08T08:24:05.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.045+0000 7f62deffd640 1 -- 172.21.15.88:0/2500920452 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d80a5d70 con 0x7f62e00c40c0 2023-12-08T08:24:05.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.049+0000 7f62e66e3640 1 -- 172.21.15.88:0/2500920452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62e00c40c0 msgr2=0x7f62e0154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:05.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.049+0000 7f62e66e3640 1 --2- 172.21.15.88:0/2500920452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62e00c40c0 0x7f62e0154ea0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f62e00c2490 tx=0x7f62d801c7c0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.049+0000 7f62e66e3640 1 -- 172.21.15.88:0/2500920452 shutdown_connections 2023-12-08T08:24:05.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.049+0000 7f62e66e3640 1 --2- 172.21.15.88:0/2500920452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62e00c40c0 0x7f62e0154ea0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.049+0000 7f62e66e3640 1 --2- 172.21.15.88:0/2500920452 >> v2:172.21.15.148:3300/0 conn(0x7f62e00a5200 0x7f62e0154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.049+0000 7f62e66e3640 1 -- 172.21.15.88:0/2500920452 >> 172.21.15.88:0/2500920452 conn(0x7f62e006b220 msgr2=0x7f62e00a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:05.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.049+0000 7f62e66e3640 1 -- 172.21.15.88:0/2500920452 shutdown_connections 2023-12-08T08:24:05.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.049+0000 7f62e66e3640 1 -- 172.21.15.88:0/2500920452 wait complete. 2023-12-08T08:24:05.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.049+0000 7f62e66e3640 1 Processor -- start 2023-12-08T08:24:05.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.049+0000 7f62e66e3640 1 -- start start 2023-12-08T08:24:05.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.049+0000 7f62e66e3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62e00c40c0 0x7f62e0156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:05.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.049+0000 7f62e66e3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62e0151d90 0x7f62e01f0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:05.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.049+0000 7f62e66e3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f62e00aa380 0x7f62e01f12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:05.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.049+0000 7f62e66e3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e01541c0 con 0x7f62e00c40c0 2023-12-08T08:24:05.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.049+0000 7f62e66e3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e0147e50 con 0x7f62e0151d90 2023-12-08T08:24:05.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.049+0000 7f62e66e3640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e0148130 con 0x7f62e00aa380 2023-12-08T08:24:05.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.049+0000 7f62dffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62e00c40c0 0x7f62e0156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:05.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.049+0000 7f62dffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62e00c40c0 0x7f62e0156cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43070/0 (socket says 172.21.15.88:43070) 2023-12-08T08:24:05.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.049+0000 7f62dffff640 1 -- 172.21.15.88:0/6507166 learned_addr learned my addr 172.21.15.88:0/6507166 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:05.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.049+0000 7f62e4c80640 1 --2- 172.21.15.88:0/6507166 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f62e00aa380 0x7f62e01f12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:05.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.049+0000 7f62df7fe640 1 --2- 172.21.15.88:0/6507166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62e0151d90 0x7f62e01f0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:05.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.049+0000 7f62dffff640 1 -- 172.21.15.88:0/6507166 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f62e00aa380 msgr2=0x7f62e01f12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:05.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.049+0000 7f62dffff640 1 --2- 172.21.15.88:0/6507166 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f62e00aa380 0x7f62e01f12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.049+0000 7f62dffff640 1 -- 172.21.15.88:0/6507166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62e0151d90 msgr2=0x7f62e01f0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:05.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.049+0000 7f62dffff640 1 --2- 172.21.15.88:0/6507166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62e0151d90 0x7f62e01f0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.049+0000 7f62dffff640 1 -- 172.21.15.88:0/6507166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d8009a70 con 0x7f62e00c40c0 2023-12-08T08:24:05.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.049+0000 7f62dffff640 1 --2- 172.21.15.88:0/6507166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62e00c40c0 0x7f62e0156cd0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f62d000c400 tx=0x7f62d000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:05.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.053+0000 7f62dcff9640 1 -- 172.21.15.88:0/6507166 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d0005cf0 con 0x7f62e00c40c0 2023-12-08T08:24:05.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.053+0000 7f62dcff9640 1 -- 172.21.15.88:0/6507166 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d0005e50 con 0x7f62e00c40c0 2023-12-08T08:24:05.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.053+0000 7f62dcff9640 1 -- 172.21.15.88:0/6507166 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d00072d0 con 0x7f62e00c40c0 2023-12-08T08:24:05.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.053+0000 7f62e66e3640 1 -- 172.21.15.88:0/6507166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e01536f0 con 0x7f62e00c40c0 2023-12-08T08:24:05.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.053+0000 7f62e66e3640 1 -- 172.21.15.88:0/6507166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e0154410 con 0x7f62e00c40c0 2023-12-08T08:24:05.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.053+0000 7f62e66e3640 1 -- 172.21.15.88:0/6507166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e00aad60 con 0x7f62e00c40c0 2023-12-08T08:24:05.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.053+0000 7f62dcff9640 1 -- 172.21.15.88:0/6507166 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f62d0007430 con 0x7f62e00c40c0 2023-12-08T08:24:05.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.053+0000 7f62dcff9640 1 --2- 172.21.15.88:0/6507166 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f62cc0664a0 0x7f62cc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:05.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.053+0000 7f62dcff9640 1 -- 172.21.15.88:0/6507166 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f62d0082eb0 con 0x7f62e00c40c0 2023-12-08T08:24:05.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.053+0000 7f62df7fe640 1 --2- 172.21.15.88:0/6507166 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f62cc0664a0 0x7f62cc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:05.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.053+0000 7f62df7fe640 1 --2- 172.21.15.88:0/6507166 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f62cc0664a0 0x7f62cc068960 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f62e0157b20 tx=0x7f62d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:05.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.057+0000 7f62dcff9640 1 -- 172.21.15.88:0/6507166 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f62d0050670 con 0x7f62e00c40c0 2023-12-08T08:24:05.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.209+0000 7f62e66e3640 1 -- 172.21.15.88:0/6507166 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f62e0157bd0 con 0x7f62cc0664a0 2023-12-08T08:24:05.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.209+0000 7f62dcff9640 1 -- 172.21.15.88:0/6507166 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f62e0157bd0 con 0x7f62cc0664a0 2023-12-08T08:24:05.213 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 3 to deep-scrub 2023-12-08T08:24:05.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.209+0000 7f62e66e3640 1 -- 172.21.15.88:0/6507166 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f62cc0664a0 msgr2=0x7f62cc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:05.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.209+0000 7f62e66e3640 1 --2- 172.21.15.88:0/6507166 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f62cc0664a0 0x7f62cc068960 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f62e0157b20 tx=0x7f62d4008040 comp rx=0 tx=0).stop 2023-12-08T08:24:05.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.209+0000 7f62e66e3640 1 -- 172.21.15.88:0/6507166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62e00c40c0 msgr2=0x7f62e0156cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:05.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.209+0000 7f62e66e3640 1 --2- 172.21.15.88:0/6507166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62e00c40c0 0x7f62e0156cd0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f62d000c400 tx=0x7f62d000c8c0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.209+0000 7f62e66e3640 1 -- 172.21.15.88:0/6507166 shutdown_connections 2023-12-08T08:24:05.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.209+0000 7f62e66e3640 1 --2- 172.21.15.88:0/6507166 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f62cc0664a0 0x7f62cc068960 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.209+0000 7f62e66e3640 1 --2- 172.21.15.88:0/6507166 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f62e00aa380 0x7f62e01f12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.209+0000 7f62e66e3640 1 --2- 172.21.15.88:0/6507166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62e0151d90 0x7f62e01f0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.209+0000 7f62e66e3640 1 --2- 172.21.15.88:0/6507166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62e00c40c0 0x7f62e0156cd0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.209+0000 7f62e66e3640 1 -- 172.21.15.88:0/6507166 >> 172.21.15.88:0/6507166 conn(0x7f62e006b220 msgr2=0x7f62e00a5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:05.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.209+0000 7f62e66e3640 1 -- 172.21.15.88:0/6507166 shutdown_connections 2023-12-08T08:24:05.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.209+0000 7f62e66e3640 1 -- 172.21.15.88:0/6507166 wait complete. 2023-12-08T08:24:05.235 INFO:tasks.ceph:Scrubbing osd.4 2023-12-08T08:24:05.235 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-08T08:24:05.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.369+0000 7ffabe85a640 1 Processor -- start 2023-12-08T08:24:05.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.369+0000 7ffabe85a640 1 -- start start 2023-12-08T08:24:05.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.373+0000 7ffabe85a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffab814e2a0 0x7ffab81516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:05.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.373+0000 7ffabe85a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffab80a98e0 0x7ffab806bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:05.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.373+0000 7ffabe85a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab8151210 con 0x7ffab80a9460 2023-12-08T08:24:05.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.373+0000 7ffabe85a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab814e680 con 0x7ffab80a98e0 2023-12-08T08:24:05.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.373+0000 7ffabe85a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab8150be0 con 0x7ffab814e2a0 2023-12-08T08:24:05.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.373+0000 7ffab77fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ffab80a9460 0x7ffab80c4180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45964/0 (socket says 172.21.15.88:45964) 2023-12-08T08:24:05.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.373+0000 7ffab77fe640 1 -- 172.21.15.88:0/4098024661 learned_addr learned my addr 172.21.15.88:0/4098024661 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:24:05.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.373+0000 7ffabcdf7640 1 --2- 172.21.15.88:0/4098024661 >> v2:172.21.15.88:3300/0 conn(0x7ffab80a98e0 0x7ffab806bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:05.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.373+0000 7ffab7fff640 1 --2- 172.21.15.88:0/4098024661 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffab814e2a0 0x7ffab81516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:05.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.373+0000 7ffab6ffd640 1 -- 172.21.15.88:0/4098024661 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2007636108 0 0) 0x7ffab8151210 con 0x7ffab80a9460 2023-12-08T08:24:05.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.373+0000 7ffab6ffd640 1 -- 172.21.15.88:0/4098024661 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffaa0003530 con 0x7ffab80a9460 2023-12-08T08:24:05.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.373+0000 7ffabcdf7640 1 -- 172.21.15.88:0/4098024661 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffab814e2a0 msgr2=0x7ffab81516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:05.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.373+0000 7ffabcdf7640 1 --2- 172.21.15.88:0/4098024661 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffab814e2a0 0x7ffab81516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.373+0000 7ffabcdf7640 1 -- 172.21.15.88:0/4098024661 >> v1:172.21.15.88:6789/0 conn(0x7ffab80a9460 legacy=0x7ffab80c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:05.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.373+0000 7ffabcdf7640 1 -- 172.21.15.88:0/4098024661 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab80c53c0 con 0x7ffab80a98e0 2023-12-08T08:24:05.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.377+0000 7ffabcdf7640 1 --2- 172.21.15.88:0/4098024661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffab80a98e0 0x7ffab806bc80 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7ffab0009d90 tx=0x7ffab001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eeb09b7b5ea588e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:05.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.377+0000 7ffab6ffd640 1 -- 172.21.15.88:0/4098024661 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab00a5790 con 0x7ffab80a98e0 2023-12-08T08:24:05.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.377+0000 7ffab6ffd640 1 -- 172.21.15.88:0/4098024661 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab00a58f0 con 0x7ffab80a98e0 2023-12-08T08:24:05.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.377+0000 7ffab6ffd640 1 -- 172.21.15.88:0/4098024661 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab00a5c80 con 0x7ffab80a98e0 2023-12-08T08:24:05.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.377+0000 7ffabe85a640 1 -- 172.21.15.88:0/4098024661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffab80a98e0 msgr2=0x7ffab806bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:05.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.377+0000 7ffabe85a640 1 --2- 172.21.15.88:0/4098024661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffab80a98e0 0x7ffab806bc80 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7ffab0009d90 tx=0x7ffab001c950 comp rx=0 tx=0).stop 2023-12-08T08:24:05.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.377+0000 7ffabe85a640 1 -- 172.21.15.88:0/4098024661 shutdown_connections 2023-12-08T08:24:05.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.377+0000 7ffabe85a640 1 --2- 172.21.15.88:0/4098024661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffab80a98e0 0x7ffab806bc80 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.377+0000 7ffabe85a640 1 --2- 172.21.15.88:0/4098024661 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffab814e2a0 0x7ffab81516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.377+0000 7ffabe85a640 1 -- 172.21.15.88:0/4098024661 >> 172.21.15.88:0/4098024661 conn(0x7ffab80c59f0 msgr2=0x7ffab80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:05.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.377+0000 7ffabe85a640 1 -- 172.21.15.88:0/4098024661 shutdown_connections 2023-12-08T08:24:05.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.377+0000 7ffabe85a640 1 -- 172.21.15.88:0/4098024661 wait complete. 2023-12-08T08:24:05.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.377+0000 7ffabe85a640 1 Processor -- start 2023-12-08T08:24:05.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.377+0000 7ffabe85a640 1 -- start start 2023-12-08T08:24:05.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.381+0000 7ffabe85a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffab80a9460 0x7ffab8072030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:05.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.381+0000 7ffabe85a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffab80a98e0 0x7ffab815a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:05.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.381+0000 7ffabe85a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffab814e2a0 0x7ffab81ecee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:05.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.381+0000 7ffabe85a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab815b1c0 con 0x7ffab80a98e0 2023-12-08T08:24:05.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.381+0000 7ffabe85a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab806fba0 con 0x7ffab814e2a0 2023-12-08T08:24:05.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.381+0000 7ffabe85a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab81eca20 con 0x7ffab80a9460 2023-12-08T08:24:05.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.381+0000 7ffab77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffab80a98e0 0x7ffab815a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:05.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.381+0000 7ffab77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffab80a98e0 0x7ffab815a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43090/0 (socket says 172.21.15.88:43090) 2023-12-08T08:24:05.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.381+0000 7ffab77fe640 1 -- 172.21.15.88:0/4057905674 learned_addr learned my addr 172.21.15.88:0/4057905674 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:05.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.381+0000 7ffab77fe640 1 -- 172.21.15.88:0/4057905674 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffab80a9460 msgr2=0x7ffab8072030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:05.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.381+0000 7ffab7fff640 1 --2- 172.21.15.88:0/4057905674 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffab80a9460 0x7ffab8072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:05.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.381+0000 7ffabcdf7640 1 --2- 172.21.15.88:0/4057905674 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffab814e2a0 0x7ffab81ecee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:05.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.381+0000 7ffab77fe640 1 --2- 172.21.15.88:0/4057905674 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffab80a9460 0x7ffab8072030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.381+0000 7ffab77fe640 1 -- 172.21.15.88:0/4057905674 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffab814e2a0 msgr2=0x7ffab81ecee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:05.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.381+0000 7ffab77fe640 1 --2- 172.21.15.88:0/4057905674 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffab814e2a0 0x7ffab81ecee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.381+0000 7ffab77fe640 1 -- 172.21.15.88:0/4057905674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab0009a70 con 0x7ffab80a98e0 2023-12-08T08:24:05.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.381+0000 7ffab7fff640 1 --2- 172.21.15.88:0/4057905674 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffab80a9460 0x7ffab8072030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:24:05.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.381+0000 7ffabcdf7640 1 --2- 172.21.15.88:0/4057905674 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffab814e2a0 0x7ffab81ecee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:24:05.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.381+0000 7ffab77fe640 1 --2- 172.21.15.88:0/4057905674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffab80a98e0 0x7ffab815a6d0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00c500 tx=0x7ffaac00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:05.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.381+0000 7ffab4ff9640 1 -- 172.21.15.88:0/4057905674 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac005cf0 con 0x7ffab80a98e0 2023-12-08T08:24:05.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.381+0000 7ffab4ff9640 1 -- 172.21.15.88:0/4057905674 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac005e50 con 0x7ffab80a98e0 2023-12-08T08:24:05.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.381+0000 7ffabe85a640 1 -- 172.21.15.88:0/4057905674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab81f0d10 con 0x7ffab80a98e0 2023-12-08T08:24:05.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.381+0000 7ffab4ff9640 1 -- 172.21.15.88:0/4057905674 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac0072f0 con 0x7ffab80a98e0 2023-12-08T08:24:05.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.381+0000 7ffabe85a640 1 -- 172.21.15.88:0/4057905674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab80700d0 con 0x7ffab80a98e0 2023-12-08T08:24:05.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.381+0000 7ffabe85a640 1 -- 172.21.15.88:0/4057905674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffab815b480 con 0x7ffab80a98e0 2023-12-08T08:24:05.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.381+0000 7ffab4ff9640 1 -- 172.21.15.88:0/4057905674 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffaac007450 con 0x7ffab80a98e0 2023-12-08T08:24:05.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.385+0000 7ffab4ff9640 1 --2- 172.21.15.88:0/4057905674 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffaa4066470 0x7ffaa4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:05.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.385+0000 7ffab4ff9640 1 -- 172.21.15.88:0/4057905674 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ffaac083910 con 0x7ffab80a98e0 2023-12-08T08:24:05.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.385+0000 7ffab7fff640 1 --2- 172.21.15.88:0/4057905674 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffaa4066470 0x7ffaa4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:05.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.385+0000 7ffab4ff9640 1 --2- 172.21.15.88:0/4057905674 >> [v2:172.21.15.148:6816/3755626047,v1:172.21.15.148:6817/3755626047] conn(0x7ffaa406c370 0x7ffaa406e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:05.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.385+0000 7ffab4ff9640 1 -- 172.21.15.88:0/4057905674 --> [v2:172.21.15.148:6816/3755626047,v1:172.21.15.148:6817/3755626047] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffaa406ee40 con 0x7ffaa406c370 2023-12-08T08:24:05.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.385+0000 7ffab4ff9640 1 -- 172.21.15.88:0/4057905674 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffaac083c80 con 0x7ffab80a98e0 2023-12-08T08:24:05.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.385+0000 7ffabcdf7640 1 --2- 172.21.15.88:0/4057905674 >> [v2:172.21.15.148:6816/3755626047,v1:172.21.15.148:6817/3755626047] conn(0x7ffaa406c370 0x7ffaa406e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:05.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.385+0000 7ffab7fff640 1 --2- 172.21.15.88:0/4057905674 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffaa4066470 0x7ffaa4068930 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8009a40 tx=0x7ffaa8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:05.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.385+0000 7ffabcdf7640 1 --2- 172.21.15.88:0/4057905674 >> [v2:172.21.15.148:6816/3755626047,v1:172.21.15.148:6817/3755626047] conn(0x7ffaa406c370 0x7ffaa406e790 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:05.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.385+0000 7ffab4ff9640 1 -- 172.21.15.88:0/4057905674 <== osd.4 v2:172.21.15.148:6816/3755626047 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ffaa406ee40 con 0x7ffaa406c370 2023-12-08T08:24:05.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.397+0000 7ffabe85a640 1 -- 172.21.15.88:0/4057905674 --> [v2:172.21.15.148:6816/3755626047,v1:172.21.15.148:6817/3755626047] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffab81ecc00 con 0x7ffaa406c370 2023-12-08T08:24:05.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.401+0000 7ffab4ff9640 1 -- 172.21.15.88:0/4057905674 <== osd.4 v2:172.21.15.148:6816/3755626047 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ffab81ecc00 con 0x7ffaa406c370 2023-12-08T08:24:05.405 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-08T08:24:05.405 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T08:24:05.405 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-08T08:24:05.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.401+0000 7ffabe85a640 1 -- 172.21.15.88:0/4057905674 >> [v2:172.21.15.148:6816/3755626047,v1:172.21.15.148:6817/3755626047] conn(0x7ffaa406c370 msgr2=0x7ffaa406e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:05.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.401+0000 7ffabe85a640 1 --2- 172.21.15.88:0/4057905674 >> [v2:172.21.15.148:6816/3755626047,v1:172.21.15.148:6817/3755626047] conn(0x7ffaa406c370 0x7ffaa406e790 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.401+0000 7ffabe85a640 1 -- 172.21.15.88:0/4057905674 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffaa4066470 msgr2=0x7ffaa4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:05.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.401+0000 7ffabe85a640 1 --2- 172.21.15.88:0/4057905674 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffaa4066470 0x7ffaa4068930 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8009a40 tx=0x7ffaa8008040 comp rx=0 tx=0).stop 2023-12-08T08:24:05.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.401+0000 7ffabe85a640 1 -- 172.21.15.88:0/4057905674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffab80a98e0 msgr2=0x7ffab815a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:05.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.401+0000 7ffabe85a640 1 --2- 172.21.15.88:0/4057905674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffab80a98e0 0x7ffab815a6d0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00c500 tx=0x7ffaac00c9c0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.401+0000 7ffabcdf7640 1 -- 172.21.15.88:0/4057905674 reap_dead start 2023-12-08T08:24:05.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.401+0000 7ffabe85a640 1 -- 172.21.15.88:0/4057905674 shutdown_connections 2023-12-08T08:24:05.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.401+0000 7ffabe85a640 1 -- 172.21.15.88:0/4057905674 >> 172.21.15.88:0/4057905674 conn(0x7ffab80c59f0 msgr2=0x7ffab80c4180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:05.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.401+0000 7ffabe85a640 1 -- 172.21.15.88:0/4057905674 shutdown_connections 2023-12-08T08:24:05.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.401+0000 7ffabe85a640 1 -- 172.21.15.88:0/4057905674 wait complete. 2023-12-08T08:24:05.424 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-08T08:24:05.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.557+0000 7fb0dae68640 1 Processor -- start 2023-12-08T08:24:05.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.557+0000 7fb0dae68640 1 -- start start 2023-12-08T08:24:05.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.561+0000 7fb0dae68640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb0d4155030 0x7fb0d406e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:05.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.561+0000 7fb0dae68640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb0d41582a0 0x7fb0d406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:05.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.561+0000 7fb0dae68640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d406da80 con 0x7fb0d41519f0 2023-12-08T08:24:05.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.561+0000 7fb0dae68640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d406e000 con 0x7fb0d41582a0 2023-12-08T08:24:05.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.561+0000 7fb0dae68640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d4157ae0 con 0x7fb0d4155030 2023-12-08T08:24:05.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.561+0000 7fb0d9405640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb0d41582a0 0x7fb0d406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:05.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.561+0000 7fb0d8c04640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb0d41519f0 0x7fb0d40c0fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45972/0 (socket says 172.21.15.88:45972) 2023-12-08T08:24:05.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.561+0000 7fb0d8c04640 1 -- 172.21.15.88:0/2129559895 learned_addr learned my addr 172.21.15.88:0/2129559895 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:24:05.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.561+0000 7fb0d3fff640 1 --2- 172.21.15.88:0/2129559895 >> v2:172.21.15.148:3300/0 conn(0x7fb0d4155030 0x7fb0d406e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:05.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.561+0000 7fb0d9405640 1 -- 172.21.15.88:0/2129559895 >> v2:172.21.15.148:3300/0 conn(0x7fb0d4155030 msgr2=0x7fb0d406e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:05.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.561+0000 7fb0d9405640 1 --2- 172.21.15.88:0/2129559895 >> v2:172.21.15.148:3300/0 conn(0x7fb0d4155030 0x7fb0d406e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.561+0000 7fb0d9405640 1 -- 172.21.15.88:0/2129559895 >> v1:172.21.15.88:6789/0 conn(0x7fb0d41519f0 legacy=0x7fb0d40c0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:05.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.561+0000 7fb0d9405640 1 -- 172.21.15.88:0/2129559895 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d4151dd0 con 0x7fb0d41582a0 2023-12-08T08:24:05.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.561+0000 7fb0d37fe640 1 -- 172.21.15.88:0/2129559895 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009557128 0 0) 0x7fb0d406da80 con 0x7fb0d41519f0 2023-12-08T08:24:05.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.565+0000 7fb0d9405640 1 --2- 172.21.15.88:0/2129559895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0d41582a0 0x7fb0d406b5c0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc009d90 tx=0x7fb0cc01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39523891a4e1596 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:05.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.565+0000 7fb0d37fe640 1 -- 172.21.15.88:0/2129559895 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc0a5830 con 0x7fb0d41582a0 2023-12-08T08:24:05.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.565+0000 7fb0d37fe640 1 -- 172.21.15.88:0/2129559895 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc0a5990 con 0x7fb0d41582a0 2023-12-08T08:24:05.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.565+0000 7fb0d37fe640 1 -- 172.21.15.88:0/2129559895 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc0a5d20 con 0x7fb0d41582a0 2023-12-08T08:24:05.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.565+0000 7fb0dae68640 1 -- 172.21.15.88:0/2129559895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0d41582a0 msgr2=0x7fb0d406b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:05.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.565+0000 7fb0dae68640 1 --2- 172.21.15.88:0/2129559895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0d41582a0 0x7fb0d406b5c0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc009d90 tx=0x7fb0cc01c880 comp rx=0 tx=0).stop 2023-12-08T08:24:05.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.565+0000 7fb0dae68640 1 -- 172.21.15.88:0/2129559895 shutdown_connections 2023-12-08T08:24:05.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.565+0000 7fb0dae68640 1 --2- 172.21.15.88:0/2129559895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0d41582a0 0x7fb0d406b5c0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.565+0000 7fb0dae68640 1 --2- 172.21.15.88:0/2129559895 >> v2:172.21.15.148:3300/0 conn(0x7fb0d4155030 0x7fb0d406e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.565+0000 7fb0dae68640 1 -- 172.21.15.88:0/2129559895 >> 172.21.15.88:0/2129559895 conn(0x7fb0d40c2e20 msgr2=0x7fb0d40c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:05.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.565+0000 7fb0dae68640 1 -- 172.21.15.88:0/2129559895 shutdown_connections 2023-12-08T08:24:05.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.565+0000 7fb0dae68640 1 -- 172.21.15.88:0/2129559895 wait complete. 2023-12-08T08:24:05.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.569+0000 7fb0dae68640 1 Processor -- start 2023-12-08T08:24:05.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.569+0000 7fb0dae68640 1 -- start start 2023-12-08T08:24:05.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.569+0000 7fb0dae68640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0d41519f0 0x7fb0d41f0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:05.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.569+0000 7fb0dae68640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb0d4155030 0x7fb0d41ed820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:05.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.569+0000 7fb0dae68640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0d41582a0 0x7fb0d40a91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:05.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.569+0000 7fb0dae68640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d40a9700 con 0x7fb0d41519f0 2023-12-08T08:24:05.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.569+0000 7fb0dae68640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d40a9910 con 0x7fb0d41582a0 2023-12-08T08:24:05.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.569+0000 7fb0dae68640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d40a9bf0 con 0x7fb0d4155030 2023-12-08T08:24:05.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.569+0000 7fb0d8c04640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0d41519f0 0x7fb0d41f0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:05.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.569+0000 7fb0d8c04640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0d41519f0 0x7fb0d41f0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43102/0 (socket says 172.21.15.88:43102) 2023-12-08T08:24:05.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.569+0000 7fb0d8c04640 1 -- 172.21.15.88:0/2708011889 learned_addr learned my addr 172.21.15.88:0/2708011889 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:05.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.569+0000 7fb0d3fff640 1 --2- 172.21.15.88:0/2708011889 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb0d4155030 0x7fb0d41ed820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:05.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.569+0000 7fb0d9405640 1 --2- 172.21.15.88:0/2708011889 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0d41582a0 0x7fb0d40a91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:05.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.569+0000 7fb0d8c04640 1 -- 172.21.15.88:0/2708011889 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb0d4155030 msgr2=0x7fb0d41ed820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:05.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.569+0000 7fb0d8c04640 1 --2- 172.21.15.88:0/2708011889 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb0d4155030 0x7fb0d41ed820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.569+0000 7fb0d8c04640 1 -- 172.21.15.88:0/2708011889 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0d41582a0 msgr2=0x7fb0d40a91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:05.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.569+0000 7fb0d8c04640 1 --2- 172.21.15.88:0/2708011889 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0d41582a0 0x7fb0d40a91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.569+0000 7fb0d8c04640 1 -- 172.21.15.88:0/2708011889 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0cc009a70 con 0x7fb0d41519f0 2023-12-08T08:24:05.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.569+0000 7fb0d9405640 1 --2- 172.21.15.88:0/2708011889 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0d41582a0 0x7fb0d40a91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:24:05.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.569+0000 7fb0d8c04640 1 --2- 172.21.15.88:0/2708011889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0d41519f0 0x7fb0d41f0da0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fb0c800c480 tx=0x7fb0c800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:05.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.569+0000 7fb0d17fa640 1 -- 172.21.15.88:0/2708011889 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c80074e0 con 0x7fb0d41519f0 2023-12-08T08:24:05.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.569+0000 7fb0d17fa640 1 -- 172.21.15.88:0/2708011889 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c8007660 con 0x7fb0d41519f0 2023-12-08T08:24:05.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.569+0000 7fb0d17fa640 1 -- 172.21.15.88:0/2708011889 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8004a30 con 0x7fb0d41519f0 2023-12-08T08:24:05.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.569+0000 7fb0dae68640 1 -- 172.21.15.88:0/2708011889 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d41f02c0 con 0x7fb0d41519f0 2023-12-08T08:24:05.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.569+0000 7fb0dae68640 1 -- 172.21.15.88:0/2708011889 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d41f0880 con 0x7fb0d41519f0 2023-12-08T08:24:05.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.573+0000 7fb0dae68640 1 -- 172.21.15.88:0/2708011889 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d40c3770 con 0x7fb0d41519f0 2023-12-08T08:24:05.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.573+0000 7fb0d17fa640 1 -- 172.21.15.88:0/2708011889 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb0c8004b90 con 0x7fb0d41519f0 2023-12-08T08:24:05.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.573+0000 7fb0d17fa640 1 --2- 172.21.15.88:0/2708011889 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb0b8066470 0x7fb0b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:05.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.573+0000 7fb0d17fa640 1 -- 172.21.15.88:0/2708011889 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fb0c8082d50 con 0x7fb0d41519f0 2023-12-08T08:24:05.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.573+0000 7fb0d3fff640 1 --2- 172.21.15.88:0/2708011889 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb0b8066470 0x7fb0b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:05.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.573+0000 7fb0d3fff640 1 --2- 172.21.15.88:0/2708011889 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb0b8066470 0x7fb0b8068930 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4145d20 tx=0x7fb0c0006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:05.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.577+0000 7fb0d17fa640 1 -- 172.21.15.88:0/2708011889 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb0c8053fa0 con 0x7fb0d41519f0 2023-12-08T08:24:05.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.725+0000 7fb0dae68640 1 -- 172.21.15.88:0/2708011889 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0d41614f0 con 0x7fb0b8066470 2023-12-08T08:24:05.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.725+0000 7fb0d17fa640 1 -- 172.21.15.88:0/2708011889 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb0c00059a0 con 0x7fb0b8066470 2023-12-08T08:24:05.731 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 4 to deep-scrub 2023-12-08T08:24:05.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.729+0000 7fb0dae68640 1 -- 172.21.15.88:0/2708011889 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb0b8066470 msgr2=0x7fb0b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:05.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.729+0000 7fb0dae68640 1 --2- 172.21.15.88:0/2708011889 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb0b8066470 0x7fb0b8068930 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4145d20 tx=0x7fb0c0006f90 comp rx=0 tx=0).stop 2023-12-08T08:24:05.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.729+0000 7fb0dae68640 1 -- 172.21.15.88:0/2708011889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0d41519f0 msgr2=0x7fb0d41f0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:05.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.729+0000 7fb0dae68640 1 --2- 172.21.15.88:0/2708011889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0d41519f0 0x7fb0d41f0da0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fb0c800c480 tx=0x7fb0c800c940 comp rx=0 tx=0).stop 2023-12-08T08:24:05.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.729+0000 7fb0dae68640 1 -- 172.21.15.88:0/2708011889 shutdown_connections 2023-12-08T08:24:05.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.729+0000 7fb0dae68640 1 --2- 172.21.15.88:0/2708011889 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fb0b8066470 0x7fb0b8068930 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.729+0000 7fb0dae68640 1 --2- 172.21.15.88:0/2708011889 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0d41582a0 0x7fb0d40a91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.729+0000 7fb0dae68640 1 --2- 172.21.15.88:0/2708011889 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fb0d4155030 0x7fb0d41ed820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.729+0000 7fb0dae68640 1 --2- 172.21.15.88:0/2708011889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0d41519f0 0x7fb0d41f0da0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.729+0000 7fb0dae68640 1 -- 172.21.15.88:0/2708011889 >> 172.21.15.88:0/2708011889 conn(0x7fb0d40c2e20 msgr2=0x7fb0d4070f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:05.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.729+0000 7fb0dae68640 1 -- 172.21.15.88:0/2708011889 shutdown_connections 2023-12-08T08:24:05.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.729+0000 7fb0dae68640 1 -- 172.21.15.88:0/2708011889 wait complete. 2023-12-08T08:24:05.752 INFO:tasks.ceph:Scrubbing osd.5 2023-12-08T08:24:05.752 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-08T08:24:05.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.889+0000 7f753652a640 1 Processor -- start 2023-12-08T08:24:05.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.889+0000 7f753652a640 1 -- start start 2023-12-08T08:24:05.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.889+0000 7f753652a640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f753014fc30 0x7f75300c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:05.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.889+0000 7f753652a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f753006d840 0x7f75300c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:05.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.889+0000 7f753652a640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7530152910 con 0x7f753014f850 2023-12-08T08:24:05.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.889+0000 7f753652a640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75300c2240 con 0x7f753014fc30 2023-12-08T08:24:05.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.889+0000 7f753652a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7530152bf0 con 0x7f753006d840 2023-12-08T08:24:05.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.889+0000 7f752f7fe640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f753014fc30 0x7f75300c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:05.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.889+0000 7f7534ac7640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f753006d840 0x7f75300c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:05.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.889+0000 7f752f7fe640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f753014fc30 0x7f75300c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.88:35434/0 (socket says 172.21.15.88:35434) 2023-12-08T08:24:05.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.889+0000 7f752f7fe640 1 -- 172.21.15.88:0/4120910208 learned_addr learned my addr 172.21.15.88:0/4120910208 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:05.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.889+0000 7f752f7fe640 1 -- 172.21.15.88:0/4120910208 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f753006d840 msgr2=0x7f75300c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:05.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.889+0000 7f752f7fe640 1 --2- 172.21.15.88:0/4120910208 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f753006d840 0x7f75300c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.889+0000 7f752f7fe640 1 -- 172.21.15.88:0/4120910208 >> v1:172.21.15.148:6789/0 conn(0x7f753014f850 legacy=0x7f75300aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:05.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.889+0000 7f752f7fe640 1 -- 172.21.15.88:0/4120910208 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7530152ed0 con 0x7f753014fc30 2023-12-08T08:24:05.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.893+0000 7f752f7fe640 1 --2- 172.21.15.88:0/4120910208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f753014fc30 0x7f75300c3cd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7524009870 tx=0x7f752401c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e42d0cfd02d2998 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:05.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.893+0000 7f752effd640 1 -- 172.21.15.88:0/4120910208 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75240ab670 con 0x7f753014fc30 2023-12-08T08:24:05.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.893+0000 7f752effd640 1 -- 172.21.15.88:0/4120910208 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75240ab7d0 con 0x7f753014fc30 2023-12-08T08:24:05.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.893+0000 7f752effd640 1 -- 172.21.15.88:0/4120910208 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75240abb60 con 0x7f753014fc30 2023-12-08T08:24:05.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.893+0000 7f753652a640 1 -- 172.21.15.88:0/4120910208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f753014fc30 msgr2=0x7f75300c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:05.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.893+0000 7f753652a640 1 --2- 172.21.15.88:0/4120910208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f753014fc30 0x7f75300c3cd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7524009870 tx=0x7f752401c540 comp rx=0 tx=0).stop 2023-12-08T08:24:05.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.893+0000 7f753652a640 1 -- 172.21.15.88:0/4120910208 shutdown_connections 2023-12-08T08:24:05.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.893+0000 7f753652a640 1 --2- 172.21.15.88:0/4120910208 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f753006d840 0x7f75300c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.893+0000 7f753652a640 1 --2- 172.21.15.88:0/4120910208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f753014fc30 0x7f75300c3cd0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.893+0000 7f753652a640 1 -- 172.21.15.88:0/4120910208 >> 172.21.15.88:0/4120910208 conn(0x7f75300c59f0 msgr2=0x7f75300c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:05.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.893+0000 7f753652a640 1 -- 172.21.15.88:0/4120910208 shutdown_connections 2023-12-08T08:24:05.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.893+0000 7f753652a640 1 -- 172.21.15.88:0/4120910208 wait complete. 2023-12-08T08:24:05.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.897+0000 7f753652a640 1 Processor -- start 2023-12-08T08:24:05.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.897+0000 7f753652a640 1 -- start start 2023-12-08T08:24:05.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.897+0000 7f753652a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f753006d840 0x7f75300a6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:05.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.897+0000 7f753652a640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f753014f850 0x7f75301ed130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:05.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.897+0000 7f753652a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f753014fc30 0x7f75301ed670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:05.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.897+0000 7f753652a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75301f1620 con 0x7f753006d840 2023-12-08T08:24:05.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.897+0000 7f753652a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75300723f0 con 0x7f753014fc30 2023-12-08T08:24:05.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.897+0000 7f753652a640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7530153a30 con 0x7f753014f850 2023-12-08T08:24:05.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.897+0000 7f752ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f753006d840 0x7f75300a6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:05.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.897+0000 7f752ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f753006d840 0x7f75300a6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43116/0 (socket says 172.21.15.88:43116) 2023-12-08T08:24:05.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.897+0000 7f752ffff640 1 -- 172.21.15.88:0/2823363444 learned_addr learned my addr 172.21.15.88:0/2823363444 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:05.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.897+0000 7f752f7fe640 1 --2- 172.21.15.88:0/2823363444 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f753014f850 0x7f75301ed130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:05.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.897+0000 7f7534ac7640 1 --2- 172.21.15.88:0/2823363444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f753014fc30 0x7f75301ed670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:05.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.897+0000 7f752ffff640 1 -- 172.21.15.88:0/2823363444 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f753014f850 msgr2=0x7f75301ed130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:05.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.897+0000 7f752ffff640 1 --2- 172.21.15.88:0/2823363444 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f753014f850 0x7f75301ed130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.897+0000 7f752ffff640 1 -- 172.21.15.88:0/2823363444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f753014fc30 msgr2=0x7f75301ed670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:05.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.897+0000 7f752ffff640 1 --2- 172.21.15.88:0/2823363444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f753014fc30 0x7f75301ed670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.897+0000 7f752ffff640 1 -- 172.21.15.88:0/2823363444 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75240094d0 con 0x7f753006d840 2023-12-08T08:24:05.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.897+0000 7f752ffff640 1 --2- 172.21.15.88:0/2823363444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f753006d840 0x7f75300a6ac0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f752000c450 tx=0x7f752000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:05.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.897+0000 7f752cff9640 1 -- 172.21.15.88:0/2823363444 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75200052d0 con 0x7f753006d840 2023-12-08T08:24:05.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.897+0000 7f752cff9640 1 -- 172.21.15.88:0/2823363444 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7520005450 con 0x7f753006d840 2023-12-08T08:24:05.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.897+0000 7f753652a640 1 -- 172.21.15.88:0/2823363444 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7530153d10 con 0x7f753006d840 2023-12-08T08:24:05.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.897+0000 7f752cff9640 1 -- 172.21.15.88:0/2823363444 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520012870 con 0x7f753006d840 2023-12-08T08:24:05.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.897+0000 7f753652a640 1 -- 172.21.15.88:0/2823363444 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75300c4cf0 con 0x7f753006d840 2023-12-08T08:24:05.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.901+0000 7f753652a640 1 -- 172.21.15.88:0/2823363444 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7530153f50 con 0x7f753006d840 2023-12-08T08:24:05.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.901+0000 7f752cff9640 1 -- 172.21.15.88:0/2823363444 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f75200129d0 con 0x7f753006d840 2023-12-08T08:24:05.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.901+0000 7f752cff9640 1 --2- 172.21.15.88:0/2823363444 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f751c0664a0 0x7f751c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:05.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.901+0000 7f752cff9640 1 -- 172.21.15.88:0/2823363444 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f7520083570 con 0x7f753006d840 2023-12-08T08:24:05.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.901+0000 7f752f7fe640 1 --2- 172.21.15.88:0/2823363444 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f751c0664a0 0x7f751c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:05.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.901+0000 7f752cff9640 1 --2- 172.21.15.88:0/2823363444 >> [v2:172.21.15.148:6808/1016572025,v1:172.21.15.148:6809/1016572025] conn(0x7f751c06c3a0 0x7f751c06e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:05.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.901+0000 7f752cff9640 1 -- 172.21.15.88:0/2823363444 --> [v2:172.21.15.148:6808/1016572025,v1:172.21.15.148:6809/1016572025] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f751c06ee70 con 0x7f751c06c3a0 2023-12-08T08:24:05.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.901+0000 7f752cff9640 1 -- 172.21.15.88:0/2823363444 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7520085ad0 con 0x7f753006d840 2023-12-08T08:24:05.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.901+0000 7f752f7fe640 1 --2- 172.21.15.88:0/2823363444 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f751c0664a0 0x7f751c068960 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f75240af000 tx=0x7f75240b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:05.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.901+0000 7f7534ac7640 1 --2- 172.21.15.88:0/2823363444 >> [v2:172.21.15.148:6808/1016572025,v1:172.21.15.148:6809/1016572025] conn(0x7f751c06c3a0 0x7f751c06e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:05.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.901+0000 7f7534ac7640 1 --2- 172.21.15.88:0/2823363444 >> [v2:172.21.15.148:6808/1016572025,v1:172.21.15.148:6809/1016572025] conn(0x7f751c06c3a0 0x7f751c06e7c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:05.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.905+0000 7f752cff9640 1 -- 172.21.15.88:0/2823363444 <== osd.5 v2:172.21.15.148:6808/1016572025 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f751c06ee70 con 0x7f751c06c3a0 2023-12-08T08:24:05.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.917+0000 7f753652a640 1 -- 172.21.15.88:0/2823363444 --> [v2:172.21.15.148:6808/1016572025,v1:172.21.15.148:6809/1016572025] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7530067630 con 0x7f751c06c3a0 2023-12-08T08:24:05.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.917+0000 7f752cff9640 1 -- 172.21.15.88:0/2823363444 <== osd.5 v2:172.21.15.148:6808/1016572025 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7530067630 con 0x7f751c06c3a0 2023-12-08T08:24:05.923 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-08T08:24:05.923 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T08:24:05.923 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-08T08:24:05.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.917+0000 7f753652a640 1 -- 172.21.15.88:0/2823363444 >> [v2:172.21.15.148:6808/1016572025,v1:172.21.15.148:6809/1016572025] conn(0x7f751c06c3a0 msgr2=0x7f751c06e7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:05.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.917+0000 7f753652a640 1 --2- 172.21.15.88:0/2823363444 >> [v2:172.21.15.148:6808/1016572025,v1:172.21.15.148:6809/1016572025] conn(0x7f751c06c3a0 0x7f751c06e7c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:05.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.917+0000 7f753652a640 1 -- 172.21.15.88:0/2823363444 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f751c0664a0 msgr2=0x7f751c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:05.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.917+0000 7f753652a640 1 --2- 172.21.15.88:0/2823363444 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f751c0664a0 0x7f751c068960 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f75240af000 tx=0x7f75240b6040 comp rx=0 tx=0).stop 2023-12-08T08:24:05.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.917+0000 7f753652a640 1 -- 172.21.15.88:0/2823363444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f753006d840 msgr2=0x7f75300a6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:05.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.917+0000 7f753652a640 1 --2- 172.21.15.88:0/2823363444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f753006d840 0x7f75300a6ac0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f752000c450 tx=0x7f752000c910 comp rx=0 tx=0).stop 2023-12-08T08:24:05.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.917+0000 7f7534ac7640 1 -- 172.21.15.88:0/2823363444 reap_dead start 2023-12-08T08:24:05.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.917+0000 7f753652a640 1 -- 172.21.15.88:0/2823363444 shutdown_connections 2023-12-08T08:24:05.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.917+0000 7f753652a640 1 -- 172.21.15.88:0/2823363444 >> 172.21.15.88:0/2823363444 conn(0x7f75300c59f0 msgr2=0x7f753006cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:05.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.917+0000 7f753652a640 1 -- 172.21.15.88:0/2823363444 shutdown_connections 2023-12-08T08:24:05.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:05.917+0000 7f753652a640 1 -- 172.21.15.88:0/2823363444 wait complete. 2023-12-08T08:24:05.942 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-08T08:24:06.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.077+0000 7feb73972640 1 Processor -- start 2023-12-08T08:24:06.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.077+0000 7feb73972640 1 -- start start 2023-12-08T08:24:06.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.077+0000 7feb73972640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feb6c0bd550 0x7feb6c0c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.077+0000 7feb73972640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7feb6c155950 0x7feb6c1582f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.077+0000 7feb73972640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb6c0c6840 con 0x7feb6c0c47b0 2023-12-08T08:24:06.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.077+0000 7feb73972640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb6c0af870 con 0x7feb6c0bd550 2023-12-08T08:24:06.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.077+0000 7feb73972640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb6c0c6a70 con 0x7feb6c155950 2023-12-08T08:24:06.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.077+0000 7feb70f0d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feb6c0bd550 0x7feb6c0c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.077+0000 7feb70f0d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feb6c0bd550 0x7feb6c0c4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43124/0 (socket says 172.21.15.88:43124) 2023-12-08T08:24:06.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.077+0000 7feb70f0d640 1 -- 172.21.15.88:0/308413371 learned_addr learned my addr 172.21.15.88:0/308413371 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:06.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.077+0000 7feb71f0f640 1 --2- 172.21.15.88:0/308413371 >> v2:172.21.15.148:3300/0 conn(0x7feb6c155950 0x7feb6c1582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.077+0000 7feb70f0d640 1 -- 172.21.15.88:0/308413371 >> v2:172.21.15.148:3300/0 conn(0x7feb6c155950 msgr2=0x7feb6c1582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:06.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.077+0000 7feb70f0d640 1 --2- 172.21.15.88:0/308413371 >> v2:172.21.15.148:3300/0 conn(0x7feb6c155950 0x7feb6c1582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.077+0000 7feb70f0d640 1 -- 172.21.15.88:0/308413371 >> v1:172.21.15.148:6789/0 conn(0x7feb6c0c47b0 legacy=0x7feb6c154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:06.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.077+0000 7feb70f0d640 1 -- 172.21.15.88:0/308413371 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb6c0c6d50 con 0x7feb6c0bd550 2023-12-08T08:24:06.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.077+0000 7feb71f0f640 1 --2- 172.21.15.88:0/308413371 >> v2:172.21.15.148:3300/0 conn(0x7feb6c155950 0x7feb6c1582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:24:06.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.081+0000 7feb70f0d640 1 --2- 172.21.15.88:0/308413371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb6c0bd550 0x7feb6c0c4b90 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7feb6c06c5d0 tx=0x7feb5c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=559a5724b9367e1a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:06.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.081+0000 7feb63fff640 1 -- 172.21.15.88:0/308413371 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c0ab600 con 0x7feb6c0bd550 2023-12-08T08:24:06.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.081+0000 7feb63fff640 1 -- 172.21.15.88:0/308413371 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5c0a7050 con 0x7feb6c0bd550 2023-12-08T08:24:06.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.081+0000 7feb63fff640 1 -- 172.21.15.88:0/308413371 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c0ab980 con 0x7feb6c0bd550 2023-12-08T08:24:06.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.081+0000 7feb73972640 1 -- 172.21.15.88:0/308413371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb6c0bd550 msgr2=0x7feb6c0c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:06.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.081+0000 7feb73972640 1 --2- 172.21.15.88:0/308413371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb6c0bd550 0x7feb6c0c4b90 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7feb6c06c5d0 tx=0x7feb5c01c430 comp rx=0 tx=0).stop 2023-12-08T08:24:06.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.081+0000 7feb73972640 1 -- 172.21.15.88:0/308413371 shutdown_connections 2023-12-08T08:24:06.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.081+0000 7feb73972640 1 --2- 172.21.15.88:0/308413371 >> v2:172.21.15.148:3300/0 conn(0x7feb6c155950 0x7feb6c1582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.081+0000 7feb73972640 1 --2- 172.21.15.88:0/308413371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb6c0bd550 0x7feb6c0c4b90 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.081+0000 7feb73972640 1 -- 172.21.15.88:0/308413371 >> 172.21.15.88:0/308413371 conn(0x7feb6c0aba00 msgr2=0x7feb6c0abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:06.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.081+0000 7feb73972640 1 -- 172.21.15.88:0/308413371 shutdown_connections 2023-12-08T08:24:06.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.081+0000 7feb73972640 1 -- 172.21.15.88:0/308413371 wait complete. 2023-12-08T08:24:06.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.085+0000 7feb73972640 1 Processor -- start 2023-12-08T08:24:06.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.085+0000 7feb73972640 1 -- start start 2023-12-08T08:24:06.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.085+0000 7feb73972640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb6c0bd550 0x7feb6c14af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.085+0000 7feb73972640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feb6c0c47b0 0x7feb6c148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.085+0000 7feb73972640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb6c155950 0x7feb6c1f0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.085+0000 7feb73972640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c0aeed0 con 0x7feb6c155950 2023-12-08T08:24:06.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.085+0000 7feb73972640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c14c940 con 0x7feb6c0bd550 2023-12-08T08:24:06.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.085+0000 7feb73972640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c14cc20 con 0x7feb6c0c47b0 2023-12-08T08:24:06.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.085+0000 7feb71f0f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb6c155950 0x7feb6c1f0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.085+0000 7feb71f0f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb6c155950 0x7feb6c1f0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43136/0 (socket says 172.21.15.88:43136) 2023-12-08T08:24:06.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.085+0000 7feb71f0f640 1 -- 172.21.15.88:0/64594986 learned_addr learned my addr 172.21.15.88:0/64594986 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:06.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.085+0000 7feb70f0d640 1 --2- 172.21.15.88:0/64594986 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feb6c0c47b0 0x7feb6c148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.085+0000 7feb7170e640 1 --2- 172.21.15.88:0/64594986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb6c0bd550 0x7feb6c14af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.085+0000 7feb71f0f640 1 -- 172.21.15.88:0/64594986 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feb6c0c47b0 msgr2=0x7feb6c148d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:06.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.085+0000 7feb71f0f640 1 --2- 172.21.15.88:0/64594986 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feb6c0c47b0 0x7feb6c148d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.085+0000 7feb71f0f640 1 -- 172.21.15.88:0/64594986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb6c0bd550 msgr2=0x7feb6c14af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:06.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.085+0000 7feb71f0f640 1 --2- 172.21.15.88:0/64594986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb6c0bd550 0x7feb6c14af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.085+0000 7feb71f0f640 1 -- 172.21.15.88:0/64594986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5c0094d0 con 0x7feb6c155950 2023-12-08T08:24:06.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.085+0000 7feb71f0f640 1 --2- 172.21.15.88:0/64594986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb6c155950 0x7feb6c1f0d90 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7feb6400cd50 tx=0x7feb6400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:06.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.085+0000 7feb61ffb640 1 -- 172.21.15.88:0/64594986 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6400f680 con 0x7feb6c155950 2023-12-08T08:24:06.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.085+0000 7feb61ffb640 1 -- 172.21.15.88:0/64594986 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6400f800 con 0x7feb6c155950 2023-12-08T08:24:06.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.085+0000 7feb61ffb640 1 -- 172.21.15.88:0/64594986 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6400fbb0 con 0x7feb6c155950 2023-12-08T08:24:06.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.085+0000 7feb73972640 1 -- 172.21.15.88:0/64594986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb6c1513a0 con 0x7feb6c155950 2023-12-08T08:24:06.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.085+0000 7feb73972640 1 -- 172.21.15.88:0/64594986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb6c1f0870 con 0x7feb6c155950 2023-12-08T08:24:06.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.089+0000 7feb73972640 1 -- 172.21.15.88:0/64594986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb6c1f0a60 con 0x7feb6c155950 2023-12-08T08:24:06.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.089+0000 7feb61ffb640 1 -- 172.21.15.88:0/64594986 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feb6400b040 con 0x7feb6c155950 2023-12-08T08:24:06.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.089+0000 7feb61ffb640 1 --2- 172.21.15.88:0/64594986 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7feb50066470 0x7feb50068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.089+0000 7feb61ffb640 1 -- 172.21.15.88:0/64594986 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7feb64084530 con 0x7feb6c155950 2023-12-08T08:24:06.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.089+0000 7feb7170e640 1 --2- 172.21.15.88:0/64594986 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7feb50066470 0x7feb50068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.089+0000 7feb7170e640 1 --2- 172.21.15.88:0/64594986 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7feb50066470 0x7feb50068930 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7feb68007fd0 tx=0x7feb68007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:06.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.093+0000 7feb61ffb640 1 -- 172.21.15.88:0/64594986 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feb64051cf0 con 0x7feb6c155950 2023-12-08T08:24:06.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.241+0000 7feb73972640 1 -- 172.21.15.88:0/64594986 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7feb6c0c4b90 con 0x7feb50066470 2023-12-08T08:24:06.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.241+0000 7feb61ffb640 1 -- 172.21.15.88:0/64594986 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7feb6c0c4b90 con 0x7feb50066470 2023-12-08T08:24:06.248 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 5 to deep-scrub 2023-12-08T08:24:06.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.245+0000 7feb73972640 1 -- 172.21.15.88:0/64594986 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7feb50066470 msgr2=0x7feb50068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:06.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.245+0000 7feb73972640 1 --2- 172.21.15.88:0/64594986 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7feb50066470 0x7feb50068930 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7feb68007fd0 tx=0x7feb68007e40 comp rx=0 tx=0).stop 2023-12-08T08:24:06.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.245+0000 7feb73972640 1 -- 172.21.15.88:0/64594986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb6c155950 msgr2=0x7feb6c1f0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:06.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.245+0000 7feb73972640 1 --2- 172.21.15.88:0/64594986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb6c155950 0x7feb6c1f0d90 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7feb6400cd50 tx=0x7feb6400a650 comp rx=0 tx=0).stop 2023-12-08T08:24:06.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.245+0000 7feb73972640 1 -- 172.21.15.88:0/64594986 shutdown_connections 2023-12-08T08:24:06.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.245+0000 7feb73972640 1 --2- 172.21.15.88:0/64594986 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7feb50066470 0x7feb50068930 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.245+0000 7feb73972640 1 --2- 172.21.15.88:0/64594986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb6c155950 0x7feb6c1f0d90 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.245+0000 7feb73972640 1 --2- 172.21.15.88:0/64594986 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7feb6c0c47b0 0x7feb6c148d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.245+0000 7feb73972640 1 --2- 172.21.15.88:0/64594986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb6c0bd550 0x7feb6c14af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.245+0000 7feb73972640 1 -- 172.21.15.88:0/64594986 >> 172.21.15.88:0/64594986 conn(0x7feb6c0aba00 msgr2=0x7feb6c0abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:06.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.245+0000 7feb73972640 1 -- 172.21.15.88:0/64594986 shutdown_connections 2023-12-08T08:24:06.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.245+0000 7feb73972640 1 -- 172.21.15.88:0/64594986 wait complete. 2023-12-08T08:24:06.269 INFO:tasks.ceph:Scrubbing osd.6 2023-12-08T08:24:06.269 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-08T08:24:06.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.405+0000 7fe0a6d65640 1 Processor -- start 2023-12-08T08:24:06.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.405+0000 7fe0a6d65640 1 -- start start 2023-12-08T08:24:06.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.405+0000 7fe0a6d65640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe0a014b1e0 0x7fe0a00c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.405+0000 7fe0a6d65640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe0a01548c0 0x7fe0a0154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.405+0000 7fe0a6d65640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a00a4e20 con 0x7fe0a00c5300 2023-12-08T08:24:06.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.405+0000 7fe0a6d65640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a00a50e0 con 0x7fe0a01548c0 2023-12-08T08:24:06.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.405+0000 7fe0a6d65640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a00c0f00 con 0x7fe0a014b1e0 2023-12-08T08:24:06.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.405+0000 7fe0a5302640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe0a01548c0 0x7fe0a0154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.405+0000 7fe0a5302640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe0a01548c0 0x7fe0a0154d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43138/0 (socket says 172.21.15.88:43138) 2023-12-08T08:24:06.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.405+0000 7fe0a5302640 1 -- 172.21.15.88:0/2066592890 learned_addr learned my addr 172.21.15.88:0/2066592890 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:06.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.405+0000 7fe0a4b01640 1 --2- 172.21.15.88:0/2066592890 >> v2:172.21.15.148:3300/0 conn(0x7fe0a014b1e0 0x7fe0a00c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.405+0000 7fe0a5302640 1 -- 172.21.15.88:0/2066592890 >> v2:172.21.15.148:3300/0 conn(0x7fe0a014b1e0 msgr2=0x7fe0a00c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:06.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.405+0000 7fe0a5302640 1 --2- 172.21.15.88:0/2066592890 >> v2:172.21.15.148:3300/0 conn(0x7fe0a014b1e0 0x7fe0a00c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.405+0000 7fe0a5302640 1 -- 172.21.15.88:0/2066592890 >> v1:172.21.15.148:6789/0 conn(0x7fe0a00c5300 legacy=0x7fe0a00a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:06.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.405+0000 7fe0a5302640 1 -- 172.21.15.88:0/2066592890 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a00c11e0 con 0x7fe0a01548c0 2023-12-08T08:24:06.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.405+0000 7fe0a4b01640 1 --2- 172.21.15.88:0/2066592890 >> v2:172.21.15.148:3300/0 conn(0x7fe0a014b1e0 0x7fe0a00c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:24:06.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.409+0000 7fe0a5302640 1 --2- 172.21.15.88:0/2066592890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0a01548c0 0x7fe0a0154d30 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00c4150 tx=0x7fe09801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c643ebba1145ada0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:06.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.409+0000 7fe0977fe640 1 -- 172.21.15.88:0/2066592890 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0980a57a0 con 0x7fe0a01548c0 2023-12-08T08:24:06.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.409+0000 7fe0977fe640 1 -- 172.21.15.88:0/2066592890 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0980a5900 con 0x7fe0a01548c0 2023-12-08T08:24:06.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.409+0000 7fe0977fe640 1 -- 172.21.15.88:0/2066592890 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0980a5c90 con 0x7fe0a01548c0 2023-12-08T08:24:06.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.409+0000 7fe0a6d65640 1 -- 172.21.15.88:0/2066592890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0a01548c0 msgr2=0x7fe0a0154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:06.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.409+0000 7fe0a6d65640 1 --2- 172.21.15.88:0/2066592890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0a01548c0 0x7fe0a0154d30 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00c4150 tx=0x7fe09801c9d0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.409+0000 7fe0a6d65640 1 -- 172.21.15.88:0/2066592890 shutdown_connections 2023-12-08T08:24:06.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.409+0000 7fe0a6d65640 1 --2- 172.21.15.88:0/2066592890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0a01548c0 0x7fe0a0154d30 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.409+0000 7fe0a6d65640 1 --2- 172.21.15.88:0/2066592890 >> v2:172.21.15.148:3300/0 conn(0x7fe0a014b1e0 0x7fe0a00c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.409+0000 7fe0a6d65640 1 -- 172.21.15.88:0/2066592890 >> 172.21.15.88:0/2066592890 conn(0x7fe0a00c59f0 msgr2=0x7fe0a00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:06.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.409+0000 7fe0a6d65640 1 -- 172.21.15.88:0/2066592890 shutdown_connections 2023-12-08T08:24:06.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.409+0000 7fe0a6d65640 1 -- 172.21.15.88:0/2066592890 wait complete. 2023-12-08T08:24:06.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.413+0000 7fe0a6d65640 1 Processor -- start 2023-12-08T08:24:06.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.413+0000 7fe0a6d65640 1 -- start start 2023-12-08T08:24:06.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.413+0000 7fe0a6d65640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0a00c5300 0x7fe0a00aa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.413+0000 7fe0a6d65640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe0a014b1e0 0x7fe0a01459e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.413+0000 7fe0a6d65640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0a01548c0 0x7fe0a0145f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.413+0000 7fe0a6d65640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a01f1410 con 0x7fe0a01548c0 2023-12-08T08:24:06.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.413+0000 7fe0a6d65640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a0151a70 con 0x7fe0a00c5300 2023-12-08T08:24:06.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.413+0000 7fe0a6d65640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a0150300 con 0x7fe0a014b1e0 2023-12-08T08:24:06.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.413+0000 7fe0a5302640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0a01548c0 0x7fe0a0145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.413+0000 7fe0a5302640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0a01548c0 0x7fe0a0145f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43140/0 (socket says 172.21.15.88:43140) 2023-12-08T08:24:06.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.413+0000 7fe0a5302640 1 -- 172.21.15.88:0/440615555 learned_addr learned my addr 172.21.15.88:0/440615555 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:06.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.413+0000 7fe0a4b01640 1 --2- 172.21.15.88:0/440615555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0a00c5300 0x7fe0a00aa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.413+0000 7fe097fff640 1 --2- 172.21.15.88:0/440615555 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe0a014b1e0 0x7fe0a01459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.413+0000 7fe0a5302640 1 -- 172.21.15.88:0/440615555 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe0a014b1e0 msgr2=0x7fe0a01459e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:06.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.413+0000 7fe0a5302640 1 --2- 172.21.15.88:0/440615555 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe0a014b1e0 0x7fe0a01459e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.413+0000 7fe0a5302640 1 -- 172.21.15.88:0/440615555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0a00c5300 msgr2=0x7fe0a00aa7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:06.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.413+0000 7fe0a5302640 1 --2- 172.21.15.88:0/440615555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0a00c5300 0x7fe0a00aa7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.413+0000 7fe0a5302640 1 -- 172.21.15.88:0/440615555 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe098009b30 con 0x7fe0a01548c0 2023-12-08T08:24:06.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.413+0000 7fe0a5302640 1 --2- 172.21.15.88:0/440615555 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0a01548c0 0x7fe0a0145f20 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fe0980af040 tx=0x7fe098019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:06.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.413+0000 7fe0957fa640 1 -- 172.21.15.88:0/440615555 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0980b8670 con 0x7fe0a01548c0 2023-12-08T08:24:06.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.413+0000 7fe0957fa640 1 -- 172.21.15.88:0/440615555 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0980b87d0 con 0x7fe0a01548c0 2023-12-08T08:24:06.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.413+0000 7fe0a6d65640 1 -- 172.21.15.88:0/440615555 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a01edb80 con 0x7fe0a01548c0 2023-12-08T08:24:06.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.413+0000 7fe0957fa640 1 -- 172.21.15.88:0/440615555 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0980b8b80 con 0x7fe0a01548c0 2023-12-08T08:24:06.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.413+0000 7fe0a6d65640 1 -- 172.21.15.88:0/440615555 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a0151500 con 0x7fe0a01548c0 2023-12-08T08:24:06.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.417+0000 7fe0a6d65640 1 -- 172.21.15.88:0/440615555 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe0a014b810 con 0x7fe0a01548c0 2023-12-08T08:24:06.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.417+0000 7fe0957fa640 1 -- 172.21.15.88:0/440615555 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe0980b8ce0 con 0x7fe0a01548c0 2023-12-08T08:24:06.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.417+0000 7fe0957fa640 1 --2- 172.21.15.88:0/440615555 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe08c066470 0x7fe08c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.417+0000 7fe0957fa640 1 -- 172.21.15.88:0/440615555 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fe09811f6d0 con 0x7fe0a01548c0 2023-12-08T08:24:06.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.417+0000 7fe0a4b01640 1 --2- 172.21.15.88:0/440615555 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe08c066470 0x7fe08c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.417+0000 7fe0957fa640 1 --2- 172.21.15.88:0/440615555 >> [v2:172.21.15.148:6800/2515642018,v1:172.21.15.148:6801/2515642018] conn(0x7fe08c06c370 0x7fe08c06e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.417+0000 7fe0957fa640 1 -- 172.21.15.88:0/440615555 --> [v2:172.21.15.148:6800/2515642018,v1:172.21.15.148:6801/2515642018] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe08c06ee40 con 0x7fe08c06c370 2023-12-08T08:24:06.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.417+0000 7fe0957fa640 1 -- 172.21.15.88:0/440615555 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe09811fa80 con 0x7fe0a01548c0 2023-12-08T08:24:06.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.417+0000 7fe097fff640 1 --2- 172.21.15.88:0/440615555 >> [v2:172.21.15.148:6800/2515642018,v1:172.21.15.148:6801/2515642018] conn(0x7fe08c06c370 0x7fe08c06e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.417+0000 7fe0a4b01640 1 --2- 172.21.15.88:0/440615555 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe08c066470 0x7fe08c068930 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe09c009950 tx=0x7fe09c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:06.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.417+0000 7fe097fff640 1 --2- 172.21.15.88:0/440615555 >> [v2:172.21.15.148:6800/2515642018,v1:172.21.15.148:6801/2515642018] conn(0x7fe08c06c370 0x7fe08c06e790 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:06.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.421+0000 7fe0957fa640 1 -- 172.21.15.88:0/440615555 <== osd.6 v2:172.21.15.148:6800/2515642018 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe08c06ee40 con 0x7fe08c06c370 2023-12-08T08:24:06.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.433+0000 7fe0a6d65640 1 -- 172.21.15.88:0/440615555 --> [v2:172.21.15.148:6800/2515642018,v1:172.21.15.148:6801/2515642018] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe0a0067630 con 0x7fe08c06c370 2023-12-08T08:24:06.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.433+0000 7fe0957fa640 1 -- 172.21.15.88:0/440615555 <== osd.6 v2:172.21.15.148:6800/2515642018 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe0a0067630 con 0x7fe08c06c370 2023-12-08T08:24:06.439 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-08T08:24:06.439 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T08:24:06.439 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-08T08:24:06.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.433+0000 7fe0a6d65640 1 -- 172.21.15.88:0/440615555 >> [v2:172.21.15.148:6800/2515642018,v1:172.21.15.148:6801/2515642018] conn(0x7fe08c06c370 msgr2=0x7fe08c06e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:06.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.433+0000 7fe0a6d65640 1 --2- 172.21.15.88:0/440615555 >> [v2:172.21.15.148:6800/2515642018,v1:172.21.15.148:6801/2515642018] conn(0x7fe08c06c370 0x7fe08c06e790 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.433+0000 7fe0a6d65640 1 -- 172.21.15.88:0/440615555 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe08c066470 msgr2=0x7fe08c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:06.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.433+0000 7fe0a6d65640 1 --2- 172.21.15.88:0/440615555 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe08c066470 0x7fe08c068930 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe09c009950 tx=0x7fe09c008040 comp rx=0 tx=0).stop 2023-12-08T08:24:06.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.433+0000 7fe0a6d65640 1 -- 172.21.15.88:0/440615555 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0a01548c0 msgr2=0x7fe0a0145f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:06.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.433+0000 7fe0a6d65640 1 --2- 172.21.15.88:0/440615555 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0a01548c0 0x7fe0a0145f20 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fe0980af040 tx=0x7fe098019770 comp rx=0 tx=0).stop 2023-12-08T08:24:06.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.433+0000 7fe0a5302640 1 -- 172.21.15.88:0/440615555 reap_dead start 2023-12-08T08:24:06.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.433+0000 7fe0a6d65640 1 -- 172.21.15.88:0/440615555 shutdown_connections 2023-12-08T08:24:06.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.433+0000 7fe0a6d65640 1 -- 172.21.15.88:0/440615555 >> 172.21.15.88:0/440615555 conn(0x7fe0a00c59f0 msgr2=0x7fe0a01494b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:06.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.433+0000 7fe0a6d65640 1 -- 172.21.15.88:0/440615555 shutdown_connections 2023-12-08T08:24:06.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.433+0000 7fe0a6d65640 1 -- 172.21.15.88:0/440615555 wait complete. 2023-12-08T08:24:06.457 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-08T08:24:06.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.589+0000 7fc6d338d640 1 Processor -- start 2023-12-08T08:24:06.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.589+0000 7fc6d338d640 1 -- start start 2023-12-08T08:24:06.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.593+0000 7fc6d338d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc6cc0a4fa0 0x7fc6cc0c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.593+0000 7fc6d338d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6cc0a4cc0 con 0x7fc6cc0c66b0 2023-12-08T08:24:06.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.593+0000 7fc6d338d640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6cc0c1d80 con 0x7fc6cc14de40 2023-12-08T08:24:06.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.593+0000 7fc6d338d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6cc0c23d0 con 0x7fc6cc0a4fa0 2023-12-08T08:24:06.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.593+0000 7fc6d0928640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc6cc0a4fa0 0x7fc6cc0c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.593+0000 7fc6d0928640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc6cc0a4fa0 0x7fc6cc0c5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43150/0 (socket says 172.21.15.88:43150) 2023-12-08T08:24:06.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.593+0000 7fc6d0928640 1 -- 172.21.15.88:0/4283340043 learned_addr learned my addr 172.21.15.88:0/4283340043 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:06.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.593+0000 7fc6d0928640 1 -- 172.21.15.88:0/4283340043 >> v1:172.21.15.148:6789/0 conn(0x7fc6cc14de40 legacy=0x7fc6cc14e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:06.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.593+0000 7fc6d0928640 1 -- 172.21.15.88:0/4283340043 >> v1:172.21.15.88:6789/0 conn(0x7fc6cc0c66b0 legacy=0x7fc6cc06bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:06.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.593+0000 7fc6d0928640 1 -- 172.21.15.88:0/4283340043 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6cc0c2060 con 0x7fc6cc0a4fa0 2023-12-08T08:24:06.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.593+0000 7fc6c3fff640 1 -- 172.21.15.88:0/4283340043 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3594598615 0 0) 0x7fc6cc0a4cc0 con 0x7fc6cc0c66b0 2023-12-08T08:24:06.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.597+0000 7fc6d0928640 1 --2- 172.21.15.88:0/4283340043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6cc0a4fa0 0x7fc6cc0c5a30 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0098a0 tx=0x7fc6bc01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d368e14bc7bebd1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:06.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.597+0000 7fc6c3fff640 1 -- 172.21.15.88:0/4283340043 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc0ab600 con 0x7fc6cc0a4fa0 2023-12-08T08:24:06.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.597+0000 7fc6c3fff640 1 -- 172.21.15.88:0/4283340043 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc0a7050 con 0x7fc6cc0a4fa0 2023-12-08T08:24:06.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.597+0000 7fc6c3fff640 1 -- 172.21.15.88:0/4283340043 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc0ab980 con 0x7fc6cc0a4fa0 2023-12-08T08:24:06.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.597+0000 7fc6d338d640 1 -- 172.21.15.88:0/4283340043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6cc0a4fa0 msgr2=0x7fc6cc0c5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:06.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.597+0000 7fc6d338d640 1 --2- 172.21.15.88:0/4283340043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6cc0a4fa0 0x7fc6cc0c5a30 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0098a0 tx=0x7fc6bc01c3c0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.597+0000 7fc6d338d640 1 -- 172.21.15.88:0/4283340043 shutdown_connections 2023-12-08T08:24:06.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.597+0000 7fc6d338d640 1 --2- 172.21.15.88:0/4283340043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6cc0a4fa0 0x7fc6cc0c5a30 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.597+0000 7fc6d338d640 1 -- 172.21.15.88:0/4283340043 >> 172.21.15.88:0/4283340043 conn(0x7fc6cc06b220 msgr2=0x7fc6cc0a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:06.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.597+0000 7fc6d338d640 1 -- 172.21.15.88:0/4283340043 shutdown_connections 2023-12-08T08:24:06.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.597+0000 7fc6d338d640 1 -- 172.21.15.88:0/4283340043 wait complete. 2023-12-08T08:24:06.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.597+0000 7fc6d338d640 1 Processor -- start 2023-12-08T08:24:06.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.597+0000 7fc6d338d640 1 -- start start 2023-12-08T08:24:06.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.597+0000 7fc6d338d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6cc0a4fa0 0x7fc6cc0a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.597+0000 7fc6d338d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6cc0c66b0 0x7fc6cc152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.597+0000 7fc6d338d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6cc14de40 0x7fc6cc1ead60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.597+0000 7fc6d338d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc0aac50 con 0x7fc6cc0c66b0 2023-12-08T08:24:06.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.597+0000 7fc6d338d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc154210 con 0x7fc6cc14de40 2023-12-08T08:24:06.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.597+0000 7fc6d338d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc154480 con 0x7fc6cc0a4fa0 2023-12-08T08:24:06.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.601+0000 7fc6d0928640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6cc0c66b0 0x7fc6cc152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.601+0000 7fc6d0928640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6cc0c66b0 0x7fc6cc152910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43156/0 (socket says 172.21.15.88:43156) 2023-12-08T08:24:06.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.601+0000 7fc6d0928640 1 -- 172.21.15.88:0/2136932017 learned_addr learned my addr 172.21.15.88:0/2136932017 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:06.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.601+0000 7fc6d1129640 1 --2- 172.21.15.88:0/2136932017 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6cc0a4fa0 0x7fc6cc0a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.601+0000 7fc6d192a640 1 --2- 172.21.15.88:0/2136932017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6cc14de40 0x7fc6cc1ead60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.601+0000 7fc6d0928640 1 -- 172.21.15.88:0/2136932017 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6cc0a4fa0 msgr2=0x7fc6cc0a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:06.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.601+0000 7fc6d0928640 1 --2- 172.21.15.88:0/2136932017 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6cc0a4fa0 0x7fc6cc0a98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.601+0000 7fc6d0928640 1 -- 172.21.15.88:0/2136932017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6cc14de40 msgr2=0x7fc6cc1ead60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:06.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.601+0000 7fc6d0928640 1 --2- 172.21.15.88:0/2136932017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6cc14de40 0x7fc6cc1ead60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.601+0000 7fc6d0928640 1 -- 172.21.15.88:0/2136932017 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6bc0094d0 con 0x7fc6cc0c66b0 2023-12-08T08:24:06.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.601+0000 7fc6d192a640 1 --2- 172.21.15.88:0/2136932017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6cc14de40 0x7fc6cc1ead60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:24:06.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.601+0000 7fc6d0928640 1 --2- 172.21.15.88:0/2136932017 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6cc0c66b0 0x7fc6cc152910 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0ae040 tx=0x7fc6bc019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:06.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.601+0000 7fc6c1ffb640 1 -- 172.21.15.88:0/2136932017 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc0b4640 con 0x7fc6cc0c66b0 2023-12-08T08:24:06.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.601+0000 7fc6c1ffb640 1 -- 172.21.15.88:0/2136932017 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc0b47a0 con 0x7fc6cc0c66b0 2023-12-08T08:24:06.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.601+0000 7fc6d338d640 1 -- 172.21.15.88:0/2136932017 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6cc154ad0 con 0x7fc6cc0c66b0 2023-12-08T08:24:06.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.601+0000 7fc6c1ffb640 1 -- 172.21.15.88:0/2136932017 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc0b4b30 con 0x7fc6cc0c66b0 2023-12-08T08:24:06.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.601+0000 7fc6d338d640 1 -- 172.21.15.88:0/2136932017 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6cc0aa600 con 0x7fc6cc0c66b0 2023-12-08T08:24:06.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.601+0000 7fc6d338d640 1 -- 172.21.15.88:0/2136932017 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6cc0a9610 con 0x7fc6cc0c66b0 2023-12-08T08:24:06.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.601+0000 7fc6c1ffb640 1 -- 172.21.15.88:0/2136932017 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc6bc0b2070 con 0x7fc6cc0c66b0 2023-12-08T08:24:06.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.605+0000 7fc6c1ffb640 1 --2- 172.21.15.88:0/2136932017 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc6b00664a0 0x7fc6b0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.605+0000 7fc6c1ffb640 1 -- 172.21.15.88:0/2136932017 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fc6bc11db80 con 0x7fc6cc0c66b0 2023-12-08T08:24:06.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.605+0000 7fc6d1129640 1 --2- 172.21.15.88:0/2136932017 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc6b00664a0 0x7fc6b0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.605+0000 7fc6d1129640 1 --2- 172.21.15.88:0/2136932017 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc6b00664a0 0x7fc6b0068960 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8000f70 tx=0x7fc6c8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:06.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.605+0000 7fc6c1ffb640 1 -- 172.21.15.88:0/2136932017 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc6cc0a9610 con 0x7fc6cc0c66b0 2023-12-08T08:24:06.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.757+0000 7fc6d338d640 1 -- 172.21.15.88:0/2136932017 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6cc15f560 con 0x7fc6b00664a0 2023-12-08T08:24:06.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.757+0000 7fc6c1ffb640 1 -- 172.21.15.88:0/2136932017 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc6c8001d00 con 0x7fc6b00664a0 2023-12-08T08:24:06.762 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 6 to deep-scrub 2023-12-08T08:24:06.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.757+0000 7fc6d338d640 1 -- 172.21.15.88:0/2136932017 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc6b00664a0 msgr2=0x7fc6b0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:06.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.757+0000 7fc6d338d640 1 --2- 172.21.15.88:0/2136932017 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc6b00664a0 0x7fc6b0068960 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8000f70 tx=0x7fc6c8009040 comp rx=0 tx=0).stop 2023-12-08T08:24:06.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.757+0000 7fc6d338d640 1 -- 172.21.15.88:0/2136932017 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6cc0c66b0 msgr2=0x7fc6cc152910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:06.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.757+0000 7fc6d338d640 1 --2- 172.21.15.88:0/2136932017 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6cc0c66b0 0x7fc6cc152910 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0ae040 tx=0x7fc6bc019160 comp rx=0 tx=0).stop 2023-12-08T08:24:06.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.757+0000 7fc6d338d640 1 -- 172.21.15.88:0/2136932017 shutdown_connections 2023-12-08T08:24:06.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.757+0000 7fc6d338d640 1 --2- 172.21.15.88:0/2136932017 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fc6b00664a0 0x7fc6b0068960 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.757+0000 7fc6d338d640 1 --2- 172.21.15.88:0/2136932017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6cc14de40 0x7fc6cc1ead60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.757+0000 7fc6d338d640 1 --2- 172.21.15.88:0/2136932017 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6cc0c66b0 0x7fc6cc152910 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.757+0000 7fc6d338d640 1 --2- 172.21.15.88:0/2136932017 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fc6cc0a4fa0 0x7fc6cc0a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.757+0000 7fc6d338d640 1 -- 172.21.15.88:0/2136932017 >> 172.21.15.88:0/2136932017 conn(0x7fc6cc06b220 msgr2=0x7fc6cc0c0330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:06.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.757+0000 7fc6d338d640 1 -- 172.21.15.88:0/2136932017 shutdown_connections 2023-12-08T08:24:06.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.757+0000 7fc6d338d640 1 -- 172.21.15.88:0/2136932017 wait complete. 2023-12-08T08:24:06.786 INFO:tasks.ceph:Scrubbing osd.7 2023-12-08T08:24:06.786 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-08T08:24:06.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.921+0000 7f4435068640 1 Processor -- start 2023-12-08T08:24:06.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.921+0000 7f4435068640 1 -- start start 2023-12-08T08:24:06.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.921+0000 7f4435068640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f44300c5f60 0x7f44300c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.921+0000 7f4435068640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44300c4870 0x7f44300c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f4435068640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44300c6a10 con 0x7f4430155310 2023-12-08T08:24:06.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f4435068640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44300c2740 con 0x7f44300c5f60 2023-12-08T08:24:06.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f4435068640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443006bc80 con 0x7f44300c4870 2023-12-08T08:24:06.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442ed9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4430155310 0x7f4430158590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45988/0 (socket says 172.21.15.88:45988) 2023-12-08T08:24:06.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442ed9d640 1 -- 172.21.15.88:0/1277951044 learned_addr learned my addr 172.21.15.88:0/1277951044 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:24:06.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442dd9b640 1 -- 172.21.15.88:0/1277951044 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2656961462 0 0) 0x7f44300c6a10 con 0x7f4430155310 2023-12-08T08:24:06.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442dd9b640 1 -- 172.21.15.88:0/1277951044 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4418003530 con 0x7f4430155310 2023-12-08T08:24:06.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442e59c640 1 --2- 172.21.15.88:0/1277951044 >> v2:172.21.15.148:3300/0 conn(0x7f44300c5f60 0x7f44300c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442f59e640 1 --2- 172.21.15.88:0/1277951044 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44300c4870 0x7f44300c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442dd9b640 1 -- 172.21.15.88:0/1277951044 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1866200195 0 0) 0x7f4418003530 con 0x7f4430155310 2023-12-08T08:24:06.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442dd9b640 1 -- 172.21.15.88:0/1277951044 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44300c4870 msgr2=0x7f44300c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:06.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442dd9b640 1 --2- 172.21.15.88:0/1277951044 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44300c4870 0x7f44300c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442dd9b640 1 -- 172.21.15.88:0/1277951044 >> v2:172.21.15.148:3300/0 conn(0x7f44300c5f60 msgr2=0x7f44300c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:06.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442dd9b640 1 --2- 172.21.15.88:0/1277951044 >> v2:172.21.15.148:3300/0 conn(0x7f44300c5f60 0x7f44300c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442dd9b640 1 -- 172.21.15.88:0/1277951044 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44300c2f80 con 0x7f4430155310 2023-12-08T08:24:06.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442dd9b640 1 -- 172.21.15.88:0/1277951044 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f4420001680 con 0x7f4430155310 2023-12-08T08:24:06.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442dd9b640 1 -- 172.21.15.88:0/1277951044 >> v1:172.21.15.88:6789/0 conn(0x7f4430155310 legacy=0x7f4430158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:06.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442dd9b640 1 --2- 172.21.15.88:0/1277951044 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44300c4870 0x7f4418003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442dd9b640 1 --2- 172.21.15.88:0/1277951044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4418003f00 0x7f44180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442dd9b640 1 --2- 172.21.15.88:0/1277951044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4418004d10 0x7f4418005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442dd9b640 1 -- 172.21.15.88:0/1277951044 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44300c2740 con 0x7f4418003f00 2023-12-08T08:24:06.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442dd9b640 1 -- 172.21.15.88:0/1277951044 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443006bc80 con 0x7f4418004d10 2023-12-08T08:24:06.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442dd9b640 1 -- 172.21.15.88:0/1277951044 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441800b990 con 0x7f44300c4870 2023-12-08T08:24:06.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442e59c640 1 --2- 172.21.15.88:0/1277951044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4418003f00 0x7f44180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442ed9d640 1 --2- 172.21.15.88:0/1277951044 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44300c4870 0x7f4418003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442f59e640 1 --2- 172.21.15.88:0/1277951044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4418004d10 0x7f4418005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442e59c640 1 -- 172.21.15.88:0/1277951044 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44300c4870 msgr2=0x7f4418003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:06.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442e59c640 1 --2- 172.21.15.88:0/1277951044 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f44300c4870 0x7f4418003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442e59c640 1 -- 172.21.15.88:0/1277951044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4418004d10 msgr2=0x7f4418005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:06.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442e59c640 1 --2- 172.21.15.88:0/1277951044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4418004d10 0x7f4418005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.925+0000 7f442e59c640 1 -- 172.21.15.88:0/1277951044 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4418003530 con 0x7f4418003f00 2023-12-08T08:24:06.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.929+0000 7f442e59c640 1 --2- 172.21.15.88:0/1277951044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4418003f00 0x7f44180047d0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f4424009ab0 tx=0x7f442401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd2be44ea4ec87 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:06.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.929+0000 7f442dd9b640 1 -- 172.21.15.88:0/1277951044 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44240a5660 con 0x7f4418003f00 2023-12-08T08:24:06.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.929+0000 7f442dd9b640 1 -- 172.21.15.88:0/1277951044 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44240a57c0 con 0x7f4418003f00 2023-12-08T08:24:06.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.929+0000 7f442dd9b640 1 -- 172.21.15.88:0/1277951044 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44240a5b70 con 0x7f4418003f00 2023-12-08T08:24:06.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.929+0000 7f4435068640 1 -- 172.21.15.88:0/1277951044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4418003f00 msgr2=0x7f44180047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:06.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.929+0000 7f4435068640 1 --2- 172.21.15.88:0/1277951044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4418003f00 0x7f44180047d0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f4424009ab0 tx=0x7f442401ca10 comp rx=0 tx=0).stop 2023-12-08T08:24:06.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.929+0000 7f442f59e640 1 -- 172.21.15.88:0/1277951044 reap_dead start 2023-12-08T08:24:06.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.929+0000 7f4435068640 1 -- 172.21.15.88:0/1277951044 shutdown_connections 2023-12-08T08:24:06.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.929+0000 7f4435068640 1 -- 172.21.15.88:0/1277951044 >> 172.21.15.88:0/1277951044 conn(0x7f44300a9830 msgr2=0x7f44300a9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:06.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.929+0000 7f4435068640 1 -- 172.21.15.88:0/1277951044 shutdown_connections 2023-12-08T08:24:06.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.929+0000 7f4435068640 1 -- 172.21.15.88:0/1277951044 wait complete. 2023-12-08T08:24:06.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.929+0000 7f4435068640 1 Processor -- start 2023-12-08T08:24:06.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.929+0000 7f4435068640 1 -- start start 2023-12-08T08:24:06.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.933+0000 7f4435068640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4418003f00 0x7f4430155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.933+0000 7f4435068640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4430143310 0x7f44301e9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.933+0000 7f4435068640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4430142dc0 0x7f44301ea2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.933+0000 7f4435068640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44300aab20 con 0x7f4430143310 2023-12-08T08:24:06.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.933+0000 7f4435068640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4430143810 con 0x7f4430142dc0 2023-12-08T08:24:06.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.933+0000 7f4435068640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44301ee2d0 con 0x7f4418003f00 2023-12-08T08:24:06.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.933+0000 7f442e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4430143310 0x7f44301e9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.933+0000 7f442e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4430143310 0x7f44301e9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43174/0 (socket says 172.21.15.88:43174) 2023-12-08T08:24:06.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.933+0000 7f442e59c640 1 -- 172.21.15.88:0/3378147420 learned_addr learned my addr 172.21.15.88:0/3378147420 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:06.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.933+0000 7f442ed9d640 1 --2- 172.21.15.88:0/3378147420 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4418003f00 0x7f4430155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.933+0000 7f442f59e640 1 --2- 172.21.15.88:0/3378147420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4430142dc0 0x7f44301ea2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.933+0000 7f442e59c640 1 -- 172.21.15.88:0/3378147420 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4418003f00 msgr2=0x7f4430155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:06.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.933+0000 7f442e59c640 1 --2- 172.21.15.88:0/3378147420 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f4418003f00 0x7f4430155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.933+0000 7f442e59c640 1 -- 172.21.15.88:0/3378147420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4430142dc0 msgr2=0x7f44301ea2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:06.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.933+0000 7f442e59c640 1 --2- 172.21.15.88:0/3378147420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4430142dc0 0x7f44301ea2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.933+0000 7f442e59c640 1 -- 172.21.15.88:0/3378147420 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44301ed510 con 0x7f4430143310 2023-12-08T08:24:06.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.933+0000 7f442e59c640 1 --2- 172.21.15.88:0/3378147420 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4430143310 0x7f44301e9d80 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f442401d2b0 tx=0x7f4418005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:06.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.933+0000 7f44177fe640 1 -- 172.21.15.88:0/3378147420 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44240a5660 con 0x7f4430143310 2023-12-08T08:24:06.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.933+0000 7f44177fe640 1 -- 172.21.15.88:0/3378147420 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4424004220 con 0x7f4430143310 2023-12-08T08:24:06.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.933+0000 7f44177fe640 1 -- 172.21.15.88:0/3378147420 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4424003620 con 0x7f4430143310 2023-12-08T08:24:06.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.933+0000 7f4435068640 1 -- 172.21.15.88:0/3378147420 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44301ed7f0 con 0x7f4430143310 2023-12-08T08:24:06.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.933+0000 7f4435068640 1 -- 172.21.15.88:0/3378147420 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44301eddb0 con 0x7f4430143310 2023-12-08T08:24:06.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.933+0000 7f4435068640 1 -- 172.21.15.88:0/3378147420 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f44300c6460 con 0x7f4430143310 2023-12-08T08:24:06.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.933+0000 7f44177fe640 1 -- 172.21.15.88:0/3378147420 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f44240b4040 con 0x7f4430143310 2023-12-08T08:24:06.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.937+0000 7f44177fe640 1 --2- 172.21.15.88:0/3378147420 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f441c0664a0 0x7f441c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.937+0000 7f44177fe640 1 -- 172.21.15.88:0/3378147420 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f442411e600 con 0x7f4430143310 2023-12-08T08:24:06.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.937+0000 7f442ed9d640 1 --2- 172.21.15.88:0/3378147420 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f441c0664a0 0x7f441c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.937+0000 7f44177fe640 1 --2- 172.21.15.88:0/3378147420 >> [v2:172.21.15.148:6824/227078704,v1:172.21.15.148:6825/227078704] conn(0x7f441c06c3a0 0x7f441c06e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:06.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.937+0000 7f44177fe640 1 -- 172.21.15.88:0/3378147420 --> [v2:172.21.15.148:6824/227078704,v1:172.21.15.148:6825/227078704] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f441c06ee70 con 0x7f441c06c3a0 2023-12-08T08:24:06.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.937+0000 7f44177fe640 1 -- 172.21.15.88:0/3378147420 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f442411e970 con 0x7f4430143310 2023-12-08T08:24:06.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.937+0000 7f442f59e640 1 --2- 172.21.15.88:0/3378147420 >> [v2:172.21.15.148:6824/227078704,v1:172.21.15.148:6825/227078704] conn(0x7f441c06c3a0 0x7f441c06e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:06.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.937+0000 7f442ed9d640 1 --2- 172.21.15.88:0/3378147420 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f441c0664a0 0x7f441c068960 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4420001ec0 tx=0x7f4420007900 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:06.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.937+0000 7f442f59e640 1 --2- 172.21.15.88:0/3378147420 >> [v2:172.21.15.148:6824/227078704,v1:172.21.15.148:6825/227078704] conn(0x7f441c06c3a0 0x7f441c06e7c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:06.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.937+0000 7f44177fe640 1 -- 172.21.15.88:0/3378147420 <== osd.7 v2:172.21.15.148:6824/227078704 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f441c06ee70 con 0x7f441c06c3a0 2023-12-08T08:24:06.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.949+0000 7f4435068640 1 -- 172.21.15.88:0/3378147420 --> [v2:172.21.15.148:6824/227078704,v1:172.21.15.148:6825/227078704] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f44300c3540 con 0x7f441c06c3a0 2023-12-08T08:24:06.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.953+0000 7f44177fe640 1 -- 172.21.15.88:0/3378147420 <== osd.7 v2:172.21.15.148:6824/227078704 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f442800f040 con 0x7f441c06c3a0 2023-12-08T08:24:06.957 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-12-08T08:24:06.957 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T08:24:06.957 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-12-08T08:24:06.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.953+0000 7f4435068640 1 -- 172.21.15.88:0/3378147420 >> [v2:172.21.15.148:6824/227078704,v1:172.21.15.148:6825/227078704] conn(0x7f441c06c3a0 msgr2=0x7f441c06e7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:06.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.953+0000 7f4435068640 1 --2- 172.21.15.88:0/3378147420 >> [v2:172.21.15.148:6824/227078704,v1:172.21.15.148:6825/227078704] conn(0x7f441c06c3a0 0x7f441c06e7c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:06.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.953+0000 7f4435068640 1 -- 172.21.15.88:0/3378147420 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f441c0664a0 msgr2=0x7f441c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:06.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.953+0000 7f4435068640 1 --2- 172.21.15.88:0/3378147420 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f441c0664a0 0x7f441c068960 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4420001ec0 tx=0x7f4420007900 comp rx=0 tx=0).stop 2023-12-08T08:24:06.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.953+0000 7f4435068640 1 -- 172.21.15.88:0/3378147420 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4430143310 msgr2=0x7f44301e9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:06.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.953+0000 7f4435068640 1 --2- 172.21.15.88:0/3378147420 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4430143310 0x7f44301e9d80 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f442401d2b0 tx=0x7f4418005800 comp rx=0 tx=0).stop 2023-12-08T08:24:06.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.953+0000 7f442f59e640 1 -- 172.21.15.88:0/3378147420 reap_dead start 2023-12-08T08:24:06.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.953+0000 7f4435068640 1 -- 172.21.15.88:0/3378147420 shutdown_connections 2023-12-08T08:24:06.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.953+0000 7f4435068640 1 -- 172.21.15.88:0/3378147420 >> 172.21.15.88:0/3378147420 conn(0x7f44300a9830 msgr2=0x7f443006ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:06.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.953+0000 7f4435068640 1 -- 172.21.15.88:0/3378147420 shutdown_connections 2023-12-08T08:24:06.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:06.953+0000 7f4435068640 1 -- 172.21.15.88:0/3378147420 wait complete. 2023-12-08T08:24:06.975 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-08T08:24:07.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.109+0000 7f8312e05640 1 Processor -- start 2023-12-08T08:24:07.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.109+0000 7f8312e05640 1 -- start start 2023-12-08T08:24:07.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.109+0000 7f8312e05640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f830c0c47b0 0x7f830c0c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:07.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.109+0000 7f8312e05640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f830c0bd550 0x7f830c155950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:07.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.109+0000 7f8312e05640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f830c0c6840 con 0x7f830c154ee0 2023-12-08T08:24:07.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.109+0000 7f8312e05640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f830c158a00 con 0x7f830c0bd550 2023-12-08T08:24:07.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.109+0000 7f8312e05640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f830c0af870 con 0x7f830c0c47b0 2023-12-08T08:24:07.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.109+0000 7f83113a2640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f830c154ee0 0x7f830c1582f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45994/0 (socket says 172.21.15.88:45994) 2023-12-08T08:24:07.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.109+0000 7f83113a2640 1 -- 172.21.15.88:0/2620453182 learned_addr learned my addr 172.21.15.88:0/2620453182 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:24:07.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.109+0000 7f8310ba1640 1 --2- 172.21.15.88:0/2620453182 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f830c0c47b0 0x7f830c0c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:07.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.109+0000 7f830bfff640 1 --2- 172.21.15.88:0/2620453182 >> v2:172.21.15.148:3300/0 conn(0x7f830c0bd550 0x7f830c155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:07.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.109+0000 7f830b7fe640 1 -- 172.21.15.88:0/2620453182 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 629528488 0 0) 0x7f830c0c6840 con 0x7f830c154ee0 2023-12-08T08:24:07.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.109+0000 7f830b7fe640 1 -- 172.21.15.88:0/2620453182 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82fc003530 con 0x7f830c154ee0 2023-12-08T08:24:07.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.109+0000 7f830b7fe640 1 -- 172.21.15.88:0/2620453182 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2643476405 0 0) 0x7f82fc003530 con 0x7f830c154ee0 2023-12-08T08:24:07.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.109+0000 7f8310ba1640 1 -- 172.21.15.88:0/2620453182 >> v2:172.21.15.148:3300/0 conn(0x7f830c0bd550 msgr2=0x7f830c155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:07.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.109+0000 7f8310ba1640 1 --2- 172.21.15.88:0/2620453182 >> v2:172.21.15.148:3300/0 conn(0x7f830c0bd550 0x7f830c155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:07.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.109+0000 7f8310ba1640 1 -- 172.21.15.88:0/2620453182 >> v1:172.21.15.88:6789/0 conn(0x7f830c154ee0 legacy=0x7f830c1582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:07.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.109+0000 7f8310ba1640 1 -- 172.21.15.88:0/2620453182 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830c0c6a70 con 0x7f830c0c47b0 2023-12-08T08:24:07.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.113+0000 7f8310ba1640 1 --2- 172.21.15.88:0/2620453182 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f830c0c47b0 0x7f830c0c4b90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f83000097c0 tx=0x7f830001c310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78e06d6bc8dfa974 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:07.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.113+0000 7f830b7fe640 1 -- 172.21.15.88:0/2620453182 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8304001a00 con 0x7f830c0c47b0 2023-12-08T08:24:07.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.113+0000 7f830b7fe640 1 -- 172.21.15.88:0/2620453182 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83000a7050 con 0x7f830c0c47b0 2023-12-08T08:24:07.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.113+0000 7f830b7fe640 1 -- 172.21.15.88:0/2620453182 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83000ab620 con 0x7f830c0c47b0 2023-12-08T08:24:07.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.113+0000 7f8312e05640 1 -- 172.21.15.88:0/2620453182 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f830c0c47b0 msgr2=0x7f830c0c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:07.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.113+0000 7f8312e05640 1 --2- 172.21.15.88:0/2620453182 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f830c0c47b0 0x7f830c0c4b90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f83000097c0 tx=0x7f830001c310 comp rx=0 tx=0).stop 2023-12-08T08:24:07.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.113+0000 7f8312e05640 1 -- 172.21.15.88:0/2620453182 shutdown_connections 2023-12-08T08:24:07.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.113+0000 7f8312e05640 1 --2- 172.21.15.88:0/2620453182 >> v2:172.21.15.148:3300/0 conn(0x7f830c0bd550 0x7f830c155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:07.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.113+0000 7f8312e05640 1 --2- 172.21.15.88:0/2620453182 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f830c0c47b0 0x7f830c0c4b90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:07.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.113+0000 7f8312e05640 1 -- 172.21.15.88:0/2620453182 >> 172.21.15.88:0/2620453182 conn(0x7f830c0aba00 msgr2=0x7f830c0abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:07.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.113+0000 7f8312e05640 1 -- 172.21.15.88:0/2620453182 shutdown_connections 2023-12-08T08:24:07.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.113+0000 7f8312e05640 1 -- 172.21.15.88:0/2620453182 wait complete. 2023-12-08T08:24:07.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.117+0000 7f8312e05640 1 Processor -- start 2023-12-08T08:24:07.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.117+0000 7f8312e05640 1 -- start start 2023-12-08T08:24:07.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.117+0000 7f8312e05640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f830c0bd550 0x7f830c0c0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:07.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.117+0000 7f8312e05640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f830c0c47b0 0x7f830c0adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:07.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.117+0000 7f8312e05640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f830c154ee0 0x7f830c1511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:07.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.117+0000 7f8312e05640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830c0c29b0 con 0x7f830c154ee0 2023-12-08T08:24:07.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.117+0000 7f8312e05640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830c0c05f0 con 0x7f830c0c47b0 2023-12-08T08:24:07.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.117+0000 7f8312e05640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f830c1ed470 con 0x7f830c0bd550 2023-12-08T08:24:07.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.117+0000 7f83113a2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f830c154ee0 0x7f830c1511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:07.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.117+0000 7f83113a2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f830c154ee0 0x7f830c1511f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43188/0 (socket says 172.21.15.88:43188) 2023-12-08T08:24:07.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.117+0000 7f83113a2640 1 -- 172.21.15.88:0/748351051 learned_addr learned my addr 172.21.15.88:0/748351051 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:07.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.117+0000 7f8310ba1640 1 --2- 172.21.15.88:0/748351051 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f830c0bd550 0x7f830c0c0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:07.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.117+0000 7f830bfff640 1 --2- 172.21.15.88:0/748351051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f830c0c47b0 0x7f830c0adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:07.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.117+0000 7f83113a2640 1 -- 172.21.15.88:0/748351051 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f830c0bd550 msgr2=0x7f830c0c0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:07.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.117+0000 7f83113a2640 1 --2- 172.21.15.88:0/748351051 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f830c0bd550 0x7f830c0c0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:07.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.117+0000 7f83113a2640 1 -- 172.21.15.88:0/748351051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f830c0c47b0 msgr2=0x7f830c0adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:07.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.117+0000 7f83113a2640 1 --2- 172.21.15.88:0/748351051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f830c0c47b0 0x7f830c0adad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:07.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.117+0000 7f83113a2640 1 -- 172.21.15.88:0/748351051 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8300009420 con 0x7f830c154ee0 2023-12-08T08:24:07.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.117+0000 7f83113a2640 1 --2- 172.21.15.88:0/748351051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f830c154ee0 0x7f830c1511f0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f83040018a0 tx=0x7f830400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:07.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.117+0000 7f83097fa640 1 -- 172.21.15.88:0/748351051 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8304012400 con 0x7f830c154ee0 2023-12-08T08:24:07.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.117+0000 7f83097fa640 1 -- 172.21.15.88:0/748351051 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8304012560 con 0x7f830c154ee0 2023-12-08T08:24:07.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.117+0000 7f83097fa640 1 -- 172.21.15.88:0/748351051 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8304012910 con 0x7f830c154ee0 2023-12-08T08:24:07.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.117+0000 7f8312e05640 1 -- 172.21.15.88:0/748351051 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f830c0c1910 con 0x7f830c154ee0 2023-12-08T08:24:07.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.117+0000 7f8312e05640 1 -- 172.21.15.88:0/748351051 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f830c0c0840 con 0x7f830c154ee0 2023-12-08T08:24:07.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.121+0000 7f8312e05640 1 -- 172.21.15.88:0/748351051 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f830c0c0a60 con 0x7f830c154ee0 2023-12-08T08:24:07.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.121+0000 7f83097fa640 1 -- 172.21.15.88:0/748351051 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8304012a70 con 0x7f830c154ee0 2023-12-08T08:24:07.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.121+0000 7f83097fa640 1 --2- 172.21.15.88:0/748351051 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f82f0066470 0x7f82f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:07.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.121+0000 7f83097fa640 1 -- 172.21.15.88:0/748351051 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8304084290 con 0x7f830c154ee0 2023-12-08T08:24:07.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.121+0000 7f8310ba1640 1 --2- 172.21.15.88:0/748351051 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f82f0066470 0x7f82f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:07.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.121+0000 7f8310ba1640 1 --2- 172.21.15.88:0/748351051 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f82f0066470 0x7f82f0068930 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f83000ad000 tx=0x7f83000a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:07.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.125+0000 7f83097fa640 1 -- 172.21.15.88:0/748351051 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8304051af0 con 0x7f830c154ee0 2023-12-08T08:24:07.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.273+0000 7f8312e05640 1 -- 172.21.15.88:0/748351051 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f830c155310 con 0x7f82f0066470 2023-12-08T08:24:07.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.273+0000 7f83097fa640 1 -- 172.21.15.88:0/748351051 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8300006e20 con 0x7f82f0066470 2023-12-08T08:24:07.279 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 7 to deep-scrub 2023-12-08T08:24:07.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.277+0000 7f8312e05640 1 -- 172.21.15.88:0/748351051 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f82f0066470 msgr2=0x7f82f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:07.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.277+0000 7f8312e05640 1 --2- 172.21.15.88:0/748351051 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f82f0066470 0x7f82f0068930 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f83000ad000 tx=0x7f83000a6000 comp rx=0 tx=0).stop 2023-12-08T08:24:07.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.277+0000 7f8312e05640 1 -- 172.21.15.88:0/748351051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f830c154ee0 msgr2=0x7f830c1511f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:07.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.277+0000 7f8312e05640 1 --2- 172.21.15.88:0/748351051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f830c154ee0 0x7f830c1511f0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f83040018a0 tx=0x7f830400a430 comp rx=0 tx=0).stop 2023-12-08T08:24:07.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.277+0000 7f8312e05640 1 -- 172.21.15.88:0/748351051 shutdown_connections 2023-12-08T08:24:07.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.277+0000 7f8312e05640 1 --2- 172.21.15.88:0/748351051 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f82f0066470 0x7f82f0068930 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:07.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.277+0000 7f8312e05640 1 --2- 172.21.15.88:0/748351051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f830c154ee0 0x7f830c1511f0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:07.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.277+0000 7f8312e05640 1 --2- 172.21.15.88:0/748351051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f830c0c47b0 0x7f830c0adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:07.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.277+0000 7f8312e05640 1 --2- 172.21.15.88:0/748351051 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f830c0bd550 0x7f830c0c0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:07.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.277+0000 7f8312e05640 1 -- 172.21.15.88:0/748351051 >> 172.21.15.88:0/748351051 conn(0x7f830c0aba00 msgr2=0x7f830c0abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:07.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.277+0000 7f8312e05640 1 -- 172.21.15.88:0/748351051 shutdown_connections 2023-12-08T08:24:07.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.277+0000 7f8312e05640 1 -- 172.21.15.88:0/748351051 wait complete. 2023-12-08T08:24:07.300 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:24:07.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.433+0000 7fe32d4e3640 1 Processor -- start 2023-12-08T08:24:07.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.433+0000 7fe32d4e3640 1 -- start start 2023-12-08T08:24:07.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.433+0000 7fe32d4e3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe32814e3f0 0x7fe3280bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:07.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.433+0000 7fe32d4e3640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe32806c5b0 0x7fe32806ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:07.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.433+0000 7fe32d4e3640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe328151690 con 0x7fe32806bef0 2023-12-08T08:24:07.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.433+0000 7fe32d4e3640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe328151bc0 con 0x7fe32814e3f0 2023-12-08T08:24:07.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.433+0000 7fe32d4e3640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3281518e0 con 0x7fe32806c5b0 2023-12-08T08:24:07.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.433+0000 7fe326ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe32814e3f0 0x7fe3280bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:07.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.433+0000 7fe326ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe32814e3f0 0x7fe3280bfce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43200/0 (socket says 172.21.15.88:43200) 2023-12-08T08:24:07.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.433+0000 7fe326ffd640 1 -- 172.21.15.88:0/4031220625 learned_addr learned my addr 172.21.15.88:0/4031220625 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:07.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.437+0000 7fe3277fe640 1 --2- 172.21.15.88:0/4031220625 >> v2:172.21.15.148:3300/0 conn(0x7fe32806c5b0 0x7fe32806ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:07.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.437+0000 7fe326ffd640 1 -- 172.21.15.88:0/4031220625 >> v2:172.21.15.148:3300/0 conn(0x7fe32806c5b0 msgr2=0x7fe32806ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:07.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.437+0000 7fe326ffd640 1 --2- 172.21.15.88:0/4031220625 >> v2:172.21.15.148:3300/0 conn(0x7fe32806c5b0 0x7fe32806ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:07.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.437+0000 7fe326ffd640 1 -- 172.21.15.88:0/4031220625 >> v1:172.21.15.148:6789/0 conn(0x7fe32806bef0 legacy=0x7fe3280c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:07.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.437+0000 7fe326ffd640 1 -- 172.21.15.88:0/4031220625 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3280c1de0 con 0x7fe32814e3f0 2023-12-08T08:24:07.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.437+0000 7fe326ffd640 1 --2- 172.21.15.88:0/4031220625 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe32814e3f0 0x7fe3280bfce0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fe328070480 tx=0x7fe31001e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f532f5b3f479efae server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:07.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.437+0000 7fe3267fc640 1 -- 172.21.15.88:0/4031220625 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3100ac650 con 0x7fe32814e3f0 2023-12-08T08:24:07.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.437+0000 7fe3267fc640 1 -- 172.21.15.88:0/4031220625 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3100ac7b0 con 0x7fe32814e3f0 2023-12-08T08:24:07.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.437+0000 7fe3267fc640 1 -- 172.21.15.88:0/4031220625 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3100acb40 con 0x7fe32814e3f0 2023-12-08T08:24:07.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.437+0000 7fe32d4e3640 1 -- 172.21.15.88:0/4031220625 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe32814e3f0 msgr2=0x7fe3280bfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:07.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.437+0000 7fe32d4e3640 1 --2- 172.21.15.88:0/4031220625 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe32814e3f0 0x7fe3280bfce0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fe328070480 tx=0x7fe31001e650 comp rx=0 tx=0).stop 2023-12-08T08:24:07.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.441+0000 7fe32d4e3640 1 -- 172.21.15.88:0/4031220625 shutdown_connections 2023-12-08T08:24:07.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.441+0000 7fe32d4e3640 1 --2- 172.21.15.88:0/4031220625 >> v2:172.21.15.148:3300/0 conn(0x7fe32806c5b0 0x7fe32806ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:07.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.441+0000 7fe32d4e3640 1 --2- 172.21.15.88:0/4031220625 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe32814e3f0 0x7fe3280bfce0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:07.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.441+0000 7fe32d4e3640 1 -- 172.21.15.88:0/4031220625 >> 172.21.15.88:0/4031220625 conn(0x7fe3280a7810 msgr2=0x7fe3280a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:07.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.441+0000 7fe32d4e3640 1 -- 172.21.15.88:0/4031220625 shutdown_connections 2023-12-08T08:24:07.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.441+0000 7fe32d4e3640 1 -- 172.21.15.88:0/4031220625 wait complete. 2023-12-08T08:24:07.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.441+0000 7fe32d4e3640 1 Processor -- start 2023-12-08T08:24:07.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.441+0000 7fe32d4e3640 1 -- start start 2023-12-08T08:24:07.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.441+0000 7fe32d4e3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe32806bef0 0x7fe32815a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:07.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.441+0000 7fe32d4e3640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe32806c5b0 0x7fe3281f2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:07.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.441+0000 7fe32d4e3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe32814e3f0 0x7fe3281ee990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:07.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.441+0000 7fe32d4e3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3281f2580 con 0x7fe32814e3f0 2023-12-08T08:24:07.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.441+0000 7fe32d4e3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32806ca20 con 0x7fe32806bef0 2023-12-08T08:24:07.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.441+0000 7fe32d4e3640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3281f1fc0 con 0x7fe32806c5b0 2023-12-08T08:24:07.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.441+0000 7fe3277fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe32814e3f0 0x7fe3281ee990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:07.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.441+0000 7fe3277fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe32814e3f0 0x7fe3281ee990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43202/0 (socket says 172.21.15.88:43202) 2023-12-08T08:24:07.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.441+0000 7fe3277fe640 1 -- 172.21.15.88:0/3990686879 learned_addr learned my addr 172.21.15.88:0/3990686879 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:07.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.441+0000 7fe326ffd640 1 --2- 172.21.15.88:0/3990686879 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe32806bef0 0x7fe32815a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:07.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.441+0000 7fe31e7fc640 1 --2- 172.21.15.88:0/3990686879 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe32806c5b0 0x7fe3281f2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:07.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.441+0000 7fe3277fe640 1 -- 172.21.15.88:0/3990686879 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe32806c5b0 msgr2=0x7fe3281f2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:07.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.441+0000 7fe3277fe640 1 --2- 172.21.15.88:0/3990686879 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe32806c5b0 0x7fe3281f2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:07.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.441+0000 7fe3277fe640 1 -- 172.21.15.88:0/3990686879 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe32806bef0 msgr2=0x7fe32815a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:07.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.441+0000 7fe3277fe640 1 --2- 172.21.15.88:0/3990686879 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe32806bef0 0x7fe32815a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:07.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.441+0000 7fe3277fe640 1 -- 172.21.15.88:0/3990686879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3100094d0 con 0x7fe32814e3f0 2023-12-08T08:24:07.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.441+0000 7fe31e7fc640 1 --2- 172.21.15.88:0/3990686879 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe32806c5b0 0x7fe3281f2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:24:07.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.445+0000 7fe3277fe640 1 --2- 172.21.15.88:0/3990686879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe32814e3f0 0x7fe3281ee990 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fe320007d90 tx=0x7fe32000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:07.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.445+0000 7fe31ffff640 1 -- 172.21.15.88:0/3990686879 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe320014420 con 0x7fe32814e3f0 2023-12-08T08:24:07.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.445+0000 7fe31ffff640 1 -- 172.21.15.88:0/3990686879 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3200145a0 con 0x7fe32814e3f0 2023-12-08T08:24:07.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.445+0000 7fe32d4e3640 1 -- 172.21.15.88:0/3990686879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3281f22a0 con 0x7fe32814e3f0 2023-12-08T08:24:07.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.445+0000 7fe31ffff640 1 -- 172.21.15.88:0/3990686879 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe320014950 con 0x7fe32814e3f0 2023-12-08T08:24:07.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.445+0000 7fe32d4e3640 1 -- 172.21.15.88:0/3990686879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3281f4f90 con 0x7fe32814e3f0 2023-12-08T08:24:07.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.445+0000 7fe32d4e3640 1 -- 172.21.15.88:0/3990686879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe328067630 con 0x7fe32814e3f0 2023-12-08T08:24:07.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.445+0000 7fe31ffff640 1 -- 172.21.15.88:0/3990686879 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe320014ab0 con 0x7fe32814e3f0 2023-12-08T08:24:07.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.445+0000 7fe31ffff640 1 --2- 172.21.15.88:0/3990686879 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe308066470 0x7fe308068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:07.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.445+0000 7fe31ffff640 1 -- 172.21.15.88:0/3990686879 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fe320084400 con 0x7fe32814e3f0 2023-12-08T08:24:07.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.445+0000 7fe326ffd640 1 --2- 172.21.15.88:0/3990686879 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe308066470 0x7fe308068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:07.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.449+0000 7fe326ffd640 1 --2- 172.21.15.88:0/3990686879 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe308066470 0x7fe308068930 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe3100b0000 tx=0x7fe3100a9000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:07.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.449+0000 7fe31ffff640 1 -- 172.21.15.88:0/3990686879 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe320051bb0 con 0x7fe32814e3f0 2023-12-08T08:24:07.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.601+0000 7fe32d4e3640 1 -- 172.21.15.88:0/3990686879 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe3280a7d20 con 0x7fe308066470 2023-12-08T08:24:07.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.601+0000 7fe31ffff640 1 -- 172.21.15.88:0/3990686879 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50950 (secure 0 0 0) 0x7fe3280a7d20 con 0x7fe308066470 2023-12-08T08:24:07.609 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:24:07.610 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:24:07.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.605+0000 7fe32d4e3640 1 -- 172.21.15.88:0/3990686879 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe308066470 msgr2=0x7fe308068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:07.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.605+0000 7fe32d4e3640 1 --2- 172.21.15.88:0/3990686879 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe308066470 0x7fe308068930 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe3100b0000 tx=0x7fe3100a9000 comp rx=0 tx=0).stop 2023-12-08T08:24:07.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.605+0000 7fe32d4e3640 1 -- 172.21.15.88:0/3990686879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe32814e3f0 msgr2=0x7fe3281ee990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:07.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.605+0000 7fe32d4e3640 1 --2- 172.21.15.88:0/3990686879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe32814e3f0 0x7fe3281ee990 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fe320007d90 tx=0x7fe32000e4b0 comp rx=0 tx=0).stop 2023-12-08T08:24:07.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.605+0000 7fe32d4e3640 1 -- 172.21.15.88:0/3990686879 shutdown_connections 2023-12-08T08:24:07.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.605+0000 7fe32d4e3640 1 --2- 172.21.15.88:0/3990686879 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fe308066470 0x7fe308068930 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:07.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.605+0000 7fe32d4e3640 1 --2- 172.21.15.88:0/3990686879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe32814e3f0 0x7fe3281ee990 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:07.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.605+0000 7fe32d4e3640 1 --2- 172.21.15.88:0/3990686879 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fe32806c5b0 0x7fe3281f2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:07.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.605+0000 7fe32d4e3640 1 --2- 172.21.15.88:0/3990686879 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe32806bef0 0x7fe32815a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:07.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.605+0000 7fe32d4e3640 1 -- 172.21.15.88:0/3990686879 >> 172.21.15.88:0/3990686879 conn(0x7fe3280a7810 msgr2=0x7fe328148e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:07.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.605+0000 7fe32d4e3640 1 -- 172.21.15.88:0/3990686879 shutdown_connections 2023-12-08T08:24:07.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:07.605+0000 7fe32d4e3640 1 -- 172.21.15.88:0/3990686879 wait complete. 2023-12-08T08:24:07.629 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2023-12-08T08:24:06.795051+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":257212,"kb_used_data":7744,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717508,"statfs":{"total":773094113280,"available":772830728192,"internally_reserved":0,"allocated":7929856,"data_stored":4630720,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-138,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-1,"num_write_kb":-1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.707110"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":214,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:23:58.791457+0000","last_change":"2023-12-08T08:20:09.933366+0000","last_active":"2023-12-08T08:23:58.791457+0000","last_peered":"2023-12-08T08:23:58.791457+0000","last_clean":"2023-12-08T08:23:58.791457+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:23:58.791457+0000","last_undegraded":"2023-12-08T08:23:58.791457+0000","last_fullsized":"2023-12-08T08:23:58.791457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:08.801906+0000","last_clean_scrub_stamp":"2023-12-08T08:20:08.801906+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:18:57.022043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1040384,"data_stored":1021616,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.64900000000000002,"15min":0.64400000000000002},"min":{"1min":0.49399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.755},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.71899999999999997,"15min":0.74099999999999999},"min":{"1min":0.53400000000000003,"5min":0.372,"15min":0.372},"max":{"1min":1.0109999999999999,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.78800000000000003}]},{"osd":1,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70099999999999996,"15min":0.71899999999999997},"min":{"1min":0.47199999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.94299999999999995,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.73499999999999999,"15min":0.753},"min":{"1min":0.54300000000000004,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.96099999999999997,"5min":1.446,"15min":1.446},"last":0.84999999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.98899999999999999,"5min":1.379,"15min":1.379},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71899999999999997,"15min":0.73099999999999998},"min":{"1min":0.56799999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.90500000000000003,"5min":1.706,"15min":1.706},"last":0.83899999999999997}]},{"osd":3,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73699999999999999,"15min":0.75900000000000001},"min":{"1min":0.51000000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93899999999999995,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.76100000000000001,"15min":0.78700000000000003},"min":{"1min":0.52100000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.90100000000000002,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.67500000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.69799999999999995,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88600000000000001,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.70699999999999996,"15min":0.73499999999999999},"min":{"1min":0.48799999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89800000000000002,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.70199999999999996}]},{"osd":5,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.753,"15min":0.78800000000000003},"min":{"1min":0.44500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.94099999999999995,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.76000000000000001,"15min":0.79400000000000004},"min":{"1min":0.52300000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.95199999999999996,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Dec 8 08:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.82499999999999996,"15min":0.85699999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.92300000000000004,"5min":1.573,"15min":1.573},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.77800000000000002,"15min":0.80800000000000005},"min":{"1min":0.55100000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97099999999999997,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.54500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":431248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.66800000000000004},"min":{"1min":0.49099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.56899999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94599999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.55400000000000005}]},{"osd":1,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72499999999999998,"15min":0.71899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73599999999999999,"15min":0.73399999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.58899999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70899999999999996,"15min":0.72499999999999998},"min":{"1min":0.50700000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.90900000000000003,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73599999999999999,"15min":0.746},"min":{"1min":0.48899999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.73799999999999999,"15min":0.75700000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.46600000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.96299999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.57199999999999995}]},{"osd":4,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.70199999999999996,"15min":0.72599999999999998},"min":{"1min":0.42899999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83399999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.71699999999999997,"15min":0.755},"min":{"1min":0.496,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79700000000000004,"5min":1.014,"15min":1.014},"last":0.47499999999999998}]},{"osd":5,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.75,"15min":0.79100000000000004},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83099999999999996,"5min":1.091,"15min":1.091},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.81699999999999995,"15min":0.84299999999999997},"min":{"1min":0.57199999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0149999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78600000000000003,"15min":0.81599999999999995},"min":{"1min":0.61799999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.89000000000000001,"5min":1.04,"15min":1.04},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.84199999999999997,"15min":0.89200000000000002},"min":{"1min":0.55400000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96499999999999997,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.45100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":431248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.621,"15min":0.622},"min":{"1min":0.47599999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.042,"5min":1.081,"15min":1.081},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68300000000000005,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.024,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.75800000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69099999999999995,"15min":0.68100000000000005},"min":{"1min":0.42399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98599999999999999,"5min":1.194,"15min":1.194},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.006,"5min":1.143,"15min":1.143},"last":0.72799999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.47999999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0880000000000001,"5min":1.101,"15min":1.101},"last":0.745}]},{"osd":3,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72999999999999998,"15min":0.74199999999999999},"min":{"1min":0.52300000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.75,"5min":0.76300000000000001,"15min":0.753},"min":{"1min":0.56200000000000006,"5min":0.5,"15min":0.5},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.67100000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.40899999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.96299999999999997,"5min":1.01,"15min":1.01},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.58899999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.048,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.82499999999999996}]},{"osd":6,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.75700000000000001,"15min":0.77900000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89900000000000002,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91000000000000003,"5min":1.073,"15min":1.073},"last":0.58699999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77600000000000002,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95999999999999996,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83599999999999997,"15min":0.85599999999999998},"min":{"1min":0.56299999999999994,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0800000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.63400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":431248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.68000000000000005,"15min":0.69399999999999995},"min":{"1min":0.502,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86099999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.68300000000000005,"15min":0.66800000000000004},"min":{"1min":0.59399999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95099999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.51200000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70799999999999996,"15min":0.71299999999999997},"min":{"1min":0.52800000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90100000000000002,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68100000000000005,"15min":0.68200000000000005},"min":{"1min":0.505,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.84499999999999997,"5min":1.002,"15min":1.002},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68999999999999995},"min":{"1min":0.54200000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88400000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.54400000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.84699999999999998,"5min":1.056,"15min":1.056},"last":0.76400000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.58999999999999997,"5min":0.496,"15min":0.496},"max":{"1min":0.95299999999999996,"5min":1.359,"15min":1.359},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.755,"15min":0.78500000000000003},"min":{"1min":0.51800000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99399999999999999,"5min":1.232,"15min":1.232},"last":0.79200000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.64200000000000002,"15min":0.66800000000000004},"min":{"1min":0.39000000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90800000000000003,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.745,"15min":0.78100000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95199999999999996,"5min":1.091,"15min":1.091},"last":0.80900000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.68600000000000005,"15min":0.71499999999999997},"min":{"1min":0.41699999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.92500000000000004,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.76300000000000001,"15min":0.78900000000000003},"min":{"1min":0.45300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98199999999999998,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.97699999999999998,"5min":1.246,"15min":1.246},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.80200000000000005},"min":{"1min":0.50800000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.004,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.66700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32128,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":974848,"data_stored":431248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41799999999999998,"15min":0.432},"min":{"1min":0.26500000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.56000000000000005,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45600000000000002,"15min":0.46300000000000002},"min":{"1min":0.309,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73999999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.38500000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.435,"15min":0.436},"min":{"1min":0.317,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.58099999999999996,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.40899999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.50900000000000001,"15min":0.52200000000000002},"min":{"1min":0.35299999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52900000000000003,"15min":0.54100000000000004},"min":{"1min":0.40600000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65200000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.46400000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0620000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.54300000000000004,"5min":0.497,"15min":0.497},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.66400000000000003}]},{"osd":5,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.52000000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.76200000000000001,"15min":0.77100000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.68600000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.629},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.56899999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.101,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.58599999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.76200000000000001,"15min":0.75900000000000001},"min":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.58599999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1080000000000001,"5min":1.121,"15min":1.121},"last":0.55500000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":974848,"data_stored":431248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39100000000000001,"15min":0.40100000000000002},"min":{"1min":0.27900000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.497,"15min":0.53100000000000003},"min":{"1min":0.315,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67700000000000005,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.42799999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.32200000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51500000000000001,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.54800000000000004}]},{"osd":3,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.54300000000000004,"15min":0.57699999999999996},"min":{"1min":0.34899999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.57799999999999996,"5min":3.008,"15min":3.008},"last":0.497},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47799999999999998,"15min":0.48399999999999999},"min":{"1min":0.33800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.65400000000000003,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.67400000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78300000000000003,"15min":0.81699999999999995},"min":{"1min":0.50900000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.004,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0049999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.75700000000000001,"15min":0.76800000000000002},"min":{"1min":0.51000000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98699999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78800000000000003,"15min":0.82899999999999996},"min":{"1min":0.52600000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98799999999999999,"5min":3.637,"15min":3.637},"last":0.56999999999999995}]},{"osd":6,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.78000000000000003,"15min":0.79400000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97499999999999998,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77600000000000002,"15min":0.79400000000000004},"min":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.038,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.72699999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.83499999999999996,"15min":0.89500000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.88400000000000001,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.82499999999999996,"15min":0.83899999999999997},"min":{"1min":0.56799999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0109999999999999,"5min":1.766,"15min":1.766},"last":0.74099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":431248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.59799999999999998,"15min":0.67600000000000005},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.80300000000000005,"5min":5.2210000000000001,"15min":5.2210000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.73399999999999999,"15min":0.85899999999999999},"min":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59599999999999997,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.39100000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.71299999999999997,"15min":0.83899999999999997},"min":{"1min":0.32800000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.60999999999999999,"5min":8.2070000000000007,"15min":8.2070000000000007},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.63500000000000001,"15min":0.70399999999999996},"min":{"1min":0.34300000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.69299999999999995,"5min":4.351,"15min":4.351},"last":0.46600000000000003}]},{"osd":3,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.80900000000000005,"15min":0.94199999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.754,"5min":8.1479999999999997,"15min":8.1479999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.67400000000000004,"15min":0.76900000000000002},"min":{"1min":0.32300000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.72599999999999998,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.44900000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.91000000000000003,"15min":1.012},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0049999999999999,"5min":4.8470000000000004,"15min":4.8470000000000004},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.97599999999999998,"15min":1.0820000000000001},"min":{"1min":0.55100000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93999999999999995,"5min":4.7939999999999996,"15min":4.7939999999999996},"last":0.871}]},{"osd":5,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.90500000000000003,"15min":0.98699999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99199999999999999,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.89900000000000002,"15min":0.97899999999999998},"min":{"1min":0.53000000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.107,"5min":4.5830000000000002,"15min":4.5830000000000002},"last":0.75800000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.97999999999999998,"15min":1.097},"min":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.95799999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.97199999999999998,"15min":1.075},"min":{"1min":0.59399999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.95799999999999996,"5min":4.6289999999999996,"15min":4.6289999999999996},"last":0.84299999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.91600000000000004,"15min":1.002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.97699999999999998,"5min":4.665,"15min":4.665},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.98199999999999998,"15min":1.0860000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.089,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.82499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1040384,"data_stored":1021616,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46899999999999997,"15min":0.495},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64000000000000001,"5min":1.863,"15min":1.863},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.75600000000000001,"15min":0.88600000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70799999999999996,"5min":8.2799999999999994,"15min":8.2799999999999994},"last":0.46999999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.78000000000000003,"15min":0.93200000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77300000000000002,"5min":7.9290000000000003,"15min":7.9290000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.78200000000000003,"15min":0.93700000000000006},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.628,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.43099999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.59799999999999998,"15min":0.67200000000000004},"min":{"1min":0.33100000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58699999999999997,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.372},{"interface":"front","average":{"1min":0.5,"5min":0.75600000000000001,"15min":0.872},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82399999999999995,"5min":7.8890000000000002,"15min":7.8890000000000002},"last":0.45100000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.94899999999999995,"15min":1.0529999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95399999999999996,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.753,"15min":0.77800000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88600000000000001,"5min":1.607,"15min":1.607},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.81100000000000005,"15min":0.83099999999999996},"min":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96899999999999997,"5min":1.514,"15min":1.514},"last":0.621},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.98899999999999999,"15min":1.1100000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91000000000000003,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.54500000000000004}]},{"osd":6,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79200000000000004,"15min":0.82699999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.88,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.95399999999999996,"15min":1.0549999999999999},"min":{"1min":0.56100000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.89900000000000002,"5min":7.835,"15min":7.835},"last":0.65000000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:23:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.97399999999999998,"15min":1.0800000000000001},"min":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.99299999999999999,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.81000000000000005,"15min":0.85399999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95199999999999996,"5min":1.794,"15min":1.794},"last":0.56499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:24:07.634 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-08T08:20:08.801906+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=8, tm_min=20, tm_sec=8, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=8, tm_min=24, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T08:24:07.634 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-08T08:24:19.531 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:24:19.535 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:24:27.635 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:24:27.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.777+0000 7ffadbbc1640 1 Processor -- start 2023-12-08T08:24:27.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.777+0000 7ffadbbc1640 1 -- start start 2023-12-08T08:24:27.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.777+0000 7ffadbbc1640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ffad4154f20 0x7ffad406b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:27.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.777+0000 7ffadbbc1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffad406bf30 0x7ffad415ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:27.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.777+0000 7ffadbbc1640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad40c4890 con 0x7ffad40af4c0 2023-12-08T08:24:27.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.777+0000 7ffadbbc1640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad41553d0 con 0x7ffad406bf30 2023-12-08T08:24:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.777+0000 7ffadbbc1640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad406c340 con 0x7ffad4154f20 2023-12-08T08:24:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.777+0000 7ffada15e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffad406bf30 0x7ffad415ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.777+0000 7ffada15e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffad406bf30 0x7ffad415ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41348/0 (socket says 172.21.15.88:41348) 2023-12-08T08:24:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.777+0000 7ffada15e640 1 -- 172.21.15.88:0/599694071 learned_addr learned my addr 172.21.15.88:0/599694071 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.777+0000 7ffad915c640 1 --2- 172.21.15.88:0/599694071 >> v2:172.21.15.148:3300/0 conn(0x7ffad4154f20 0x7ffad406b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.777+0000 7ffada15e640 1 -- 172.21.15.88:0/599694071 >> v2:172.21.15.148:3300/0 conn(0x7ffad4154f20 msgr2=0x7ffad406b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.777+0000 7ffada15e640 1 --2- 172.21.15.88:0/599694071 >> v2:172.21.15.148:3300/0 conn(0x7ffad4154f20 0x7ffad406b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.777+0000 7ffada15e640 1 -- 172.21.15.88:0/599694071 >> v1:172.21.15.148:6789/0 conn(0x7ffad40af4c0 legacy=0x7ffad40c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:27.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.777+0000 7ffada15e640 1 -- 172.21.15.88:0/599694071 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad40af8a0 con 0x7ffad406bf30 2023-12-08T08:24:27.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.781+0000 7ffada15e640 1 --2- 172.21.15.88:0/599694071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffad406bf30 0x7ffad415ee20 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7ffad40c7290 tx=0x7ffacc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=418cf2a312e8d5f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:27.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.781+0000 7ffad895b640 1 -- 172.21.15.88:0/599694071 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc0a57d0 con 0x7ffad406bf30 2023-12-08T08:24:27.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.781+0000 7ffad895b640 1 -- 172.21.15.88:0/599694071 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffacc0a5930 con 0x7ffad406bf30 2023-12-08T08:24:27.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.781+0000 7ffad895b640 1 -- 172.21.15.88:0/599694071 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc0a5cc0 con 0x7ffad406bf30 2023-12-08T08:24:27.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.781+0000 7ffadbbc1640 1 -- 172.21.15.88:0/599694071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffad406bf30 msgr2=0x7ffad415ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:27.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.781+0000 7ffadbbc1640 1 --2- 172.21.15.88:0/599694071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffad406bf30 0x7ffad415ee20 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7ffad40c7290 tx=0x7ffacc01c910 comp rx=0 tx=0).stop 2023-12-08T08:24:27.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.781+0000 7ffadbbc1640 1 -- 172.21.15.88:0/599694071 shutdown_connections 2023-12-08T08:24:27.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.781+0000 7ffadbbc1640 1 --2- 172.21.15.88:0/599694071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffad406bf30 0x7ffad415ee20 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:27.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.781+0000 7ffadbbc1640 1 --2- 172.21.15.88:0/599694071 >> v2:172.21.15.148:3300/0 conn(0x7ffad4154f20 0x7ffad406b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:27.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.781+0000 7ffadbbc1640 1 -- 172.21.15.88:0/599694071 >> 172.21.15.88:0/599694071 conn(0x7ffad40ab9d0 msgr2=0x7ffad40abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:27.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.781+0000 7ffadbbc1640 1 -- 172.21.15.88:0/599694071 shutdown_connections 2023-12-08T08:24:27.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.781+0000 7ffadbbc1640 1 -- 172.21.15.88:0/599694071 wait complete. 2023-12-08T08:24:27.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.785+0000 7ffadbbc1640 1 Processor -- start 2023-12-08T08:24:27.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.785+0000 7ffadbbc1640 1 -- start start 2023-12-08T08:24:27.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.785+0000 7ffadbbc1640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffad406bf30 0x7ffad414bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:27.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.785+0000 7ffadbbc1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffad40af4c0 0x7ffad4144000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:27.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.785+0000 7ffadbbc1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffad4154f20 0x7ffad4144540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:27.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.785+0000 7ffadbbc1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad40ad520 con 0x7ffad4154f20 2023-12-08T08:24:27.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.785+0000 7ffadbbc1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad40ad800 con 0x7ffad40af4c0 2023-12-08T08:24:27.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.785+0000 7ffadbbc1640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad414d0a0 con 0x7ffad406bf30 2023-12-08T08:24:27.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.785+0000 7ffada15e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffad4154f20 0x7ffad4144540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:27.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.785+0000 7ffada15e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffad4154f20 0x7ffad4144540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41350/0 (socket says 172.21.15.88:41350) 2023-12-08T08:24:27.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.785+0000 7ffada15e640 1 -- 172.21.15.88:0/2058104356 learned_addr learned my addr 172.21.15.88:0/2058104356 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:27.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.785+0000 7ffad995d640 1 --2- 172.21.15.88:0/2058104356 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffad406bf30 0x7ffad414bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:27.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.785+0000 7ffad915c640 1 --2- 172.21.15.88:0/2058104356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffad40af4c0 0x7ffad4144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:27.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.785+0000 7ffada15e640 1 -- 172.21.15.88:0/2058104356 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffad406bf30 msgr2=0x7ffad414bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:27.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.785+0000 7ffada15e640 1 --2- 172.21.15.88:0/2058104356 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffad406bf30 0x7ffad414bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:27.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.785+0000 7ffada15e640 1 -- 172.21.15.88:0/2058104356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffad40af4c0 msgr2=0x7ffad4144000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:27.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.785+0000 7ffada15e640 1 --2- 172.21.15.88:0/2058104356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffad40af4c0 0x7ffad4144000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:27.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.785+0000 7ffada15e640 1 -- 172.21.15.88:0/2058104356 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc009b30 con 0x7ffad4154f20 2023-12-08T08:24:27.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.785+0000 7ffad915c640 1 --2- 172.21.15.88:0/2058104356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffad40af4c0 0x7ffad4144000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:24:27.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.785+0000 7ffad995d640 1 --2- 172.21.15.88:0/2058104356 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffad406bf30 0x7ffad414bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:24:27.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.785+0000 7ffada15e640 1 --2- 172.21.15.88:0/2058104356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffad4154f20 0x7ffad4144540 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7ffacc019520 tx=0x7ffacc0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:27.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.785+0000 7ffaca7fc640 1 -- 172.21.15.88:0/2058104356 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc0b8670 con 0x7ffad4154f20 2023-12-08T08:24:27.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.785+0000 7ffaca7fc640 1 -- 172.21.15.88:0/2058104356 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffacc0b87f0 con 0x7ffad4154f20 2023-12-08T08:24:27.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.785+0000 7ffaca7fc640 1 -- 172.21.15.88:0/2058104356 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc0b8ba0 con 0x7ffad4154f20 2023-12-08T08:24:27.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.785+0000 7ffadbbc1640 1 -- 172.21.15.88:0/2058104356 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad414c700 con 0x7ffad4154f20 2023-12-08T08:24:27.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.785+0000 7ffadbbc1640 1 -- 172.21.15.88:0/2058104356 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad41476f0 con 0x7ffad4154f20 2023-12-08T08:24:27.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.789+0000 7ffadbbc1640 1 -- 172.21.15.88:0/2058104356 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad40adb50 con 0x7ffad4154f20 2023-12-08T08:24:27.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.789+0000 7ffaca7fc640 1 -- 172.21.15.88:0/2058104356 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffacc0b8d00 con 0x7ffad4154f20 2023-12-08T08:24:27.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.789+0000 7ffaca7fc640 1 --2- 172.21.15.88:0/2058104356 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffab8066470 0x7ffab8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:27.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.789+0000 7ffaca7fc640 1 -- 172.21.15.88:0/2058104356 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ffacc11f200 con 0x7ffad4154f20 2023-12-08T08:24:27.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.789+0000 7ffad995d640 1 --2- 172.21.15.88:0/2058104356 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffab8066470 0x7ffab8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:27.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.789+0000 7ffad995d640 1 --2- 172.21.15.88:0/2058104356 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffab8066470 0x7ffab8068930 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ffad0000f70 tx=0x7ffad0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:27.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.793+0000 7ffaca7fc640 1 -- 172.21.15.88:0/2058104356 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffacc0ecae0 con 0x7ffad4154f20 2023-12-08T08:24:27.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.941+0000 7ffadbbc1640 1 -- 172.21.15.88:0/2058104356 --> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffad40ad970 con 0x7ffab8066470 2023-12-08T08:24:27.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.941+0000 7ffaca7fc640 1 -- 172.21.15.88:0/2058104356 <== mgr.4107 v2:172.21.15.88:6832/187352875 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50497 (secure 0 0 0) 0x7ffad40ad970 con 0x7ffab8066470 2023-12-08T08:24:27.949 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:24:27.949 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-12-08T08:24:27.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.945+0000 7ffadbbc1640 1 -- 172.21.15.88:0/2058104356 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffab8066470 msgr2=0x7ffab8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:27.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.945+0000 7ffadbbc1640 1 --2- 172.21.15.88:0/2058104356 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffab8066470 0x7ffab8068930 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ffad0000f70 tx=0x7ffad0009040 comp rx=0 tx=0).stop 2023-12-08T08:24:27.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.945+0000 7ffadbbc1640 1 -- 172.21.15.88:0/2058104356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffad4154f20 msgr2=0x7ffad4144540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:27.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.945+0000 7ffadbbc1640 1 --2- 172.21.15.88:0/2058104356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffad4154f20 0x7ffad4144540 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7ffacc019520 tx=0x7ffacc0196b0 comp rx=0 tx=0).stop 2023-12-08T08:24:27.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.945+0000 7ffadbbc1640 1 -- 172.21.15.88:0/2058104356 shutdown_connections 2023-12-08T08:24:27.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.945+0000 7ffadbbc1640 1 --2- 172.21.15.88:0/2058104356 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7ffab8066470 0x7ffab8068930 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:27.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.945+0000 7ffadbbc1640 1 --2- 172.21.15.88:0/2058104356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffad4154f20 0x7ffad4144540 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:27.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.945+0000 7ffadbbc1640 1 --2- 172.21.15.88:0/2058104356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffad40af4c0 0x7ffad4144000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:27.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.945+0000 7ffadbbc1640 1 --2- 172.21.15.88:0/2058104356 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7ffad406bf30 0x7ffad414bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:27.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.945+0000 7ffadbbc1640 1 -- 172.21.15.88:0/2058104356 >> 172.21.15.88:0/2058104356 conn(0x7ffad40ab9d0 msgr2=0x7ffad40733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:27.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.945+0000 7ffadbbc1640 1 -- 172.21.15.88:0/2058104356 shutdown_connections 2023-12-08T08:24:27.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:27.945+0000 7ffadbbc1640 1 -- 172.21.15.88:0/2058104356 wait complete. 2023-12-08T08:24:27.968 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2023-12-08T08:24:26.799233+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":257192,"kb_used_data":7744,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717528,"statfs":{"total":773094113280,"available":772830748672,"internally_reserved":0,"allocated":7929856,"data_stored":4630720,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002470"},"pg_stats":[{"pgid":"1.0","version":"78'119","reported_seq":226,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:24:09.100031+0000","last_change":"2023-12-08T08:24:09.100031+0000","last_active":"2023-12-08T08:24:09.100031+0000","last_peered":"2023-12-08T08:24:09.100031+0000","last_clean":"2023-12-08T08:24:09.100031+0000","last_became_active":"2023-12-08T08:20:09.931899+0000","last_became_peered":"2023-12-08T08:20:09.931899+0000","last_unstale":"2023-12-08T08:24:09.100031+0000","last_undegraded":"2023-12-08T08:24:09.100031+0000","last_fullsized":"2023-12-08T08:24:09.100031+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"78'119","last_scrub_stamp":"2023-12-08T08:24:09.099911+0000","last_deep_scrub":"78'119","last_deep_scrub_stamp":"2023-12-08T08:24:09.099911+0000","last_clean_scrub_stamp":"2023-12-08T08:24:09.099911+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:09:31.744788+0000","scrub_duration":0.0071683149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66406,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574902,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1040384,"data_stored":1021616,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:24:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.65500000000000003,"15min":0.64600000000000002},"min":{"1min":0.499,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.873,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70799999999999996,"15min":0.73699999999999999},"min":{"1min":0.50900000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.90800000000000003,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.82799999999999996}]},{"osd":1,"last update":"Fri Dec 8 08:24:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.70299999999999996,"15min":0.71899999999999997},"min":{"1min":0.63900000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91500000000000004,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72499999999999998,"15min":0.75},"min":{"1min":0.50800000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95499999999999996,"5min":1.446,"15min":1.446},"last":0.90900000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:24:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70999999999999996,"15min":0.72599999999999998},"min":{"1min":0.52000000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.88700000000000001,"5min":1.379,"15min":1.379},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71799999999999997,"15min":0.72999999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.90600000000000003,"5min":1.706,"15min":1.706},"last":0.70299999999999996}]},{"osd":3,"last update":"Fri Dec 8 08:24:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.72999999999999998,"15min":0.75600000000000001},"min":{"1min":0.52500000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.92600000000000005,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.752,"15min":0.78400000000000003},"min":{"1min":0.55700000000000005,"5min":0.496,"15min":0.496},"max":{"1min":1.0920000000000001,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.752}]},{"osd":4,"last update":"Fri Dec 8 08:24:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.66500000000000004,"15min":0.72399999999999998},"min":{"1min":0.40300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78200000000000003,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.69099999999999995,"15min":0.72999999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.98599999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.36499999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:24:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73499999999999999,"15min":0.78200000000000003},"min":{"1min":0.51800000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.1240000000000001,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73899999999999999,"15min":0.78700000000000003},"min":{"1min":0.48699999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.95499999999999996,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.499}]},{"osd":6,"last update":"Fri Dec 8 08:24:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.80300000000000005,"15min":0.84999999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.026,"5min":1.573,"15min":1.573},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.76400000000000001,"15min":0.80300000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.96399999999999997,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.46999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":431248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67500000000000004,"15min":0.66700000000000004},"min":{"1min":0.436,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90000000000000002,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.72599999999999998,"15min":0.73299999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.034,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.80500000000000005}]},{"osd":1,"last update":"Fri Dec 8 08:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71799999999999997,"15min":0.71699999999999997},"min":{"1min":0.499,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91600000000000004,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.72899999999999998,"15min":0.73199999999999998},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0029999999999999,"5min":1.119,"15min":1.119},"last":0.85299999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68899999999999995,"15min":0.71799999999999997},"min":{"1min":0.52400000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.80500000000000005,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.72199999999999998,"15min":0.74099999999999999},"min":{"1min":0.505,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94999999999999996,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.68600000000000005}]},{"osd":3,"last update":"Fri Dec 8 08:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.71899999999999997,"15min":0.751},"min":{"1min":0.48199999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.94899999999999995,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72299999999999998,"15min":0.74399999999999999},"min":{"1min":0.52400000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.88100000000000001,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.749}]},{"osd":4,"last update":"Fri Dec 8 08:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69099999999999995,"15min":0.72299999999999998},"min":{"1min":0.42199999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.98299999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.69899999999999995,"15min":0.749},"min":{"1min":0.45100000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90400000000000003,"5min":1.014,"15min":1.014},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Dec 8 08:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.72099999999999997,"15min":0.78100000000000003},"min":{"1min":0.47299999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92900000000000005,"5min":1.091,"15min":1.091},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.79700000000000004,"15min":0.83599999999999997},"min":{"1min":0.51400000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.01,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.54700000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76700000000000002,"15min":0.81000000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97099999999999997,"5min":1.04,"15min":1.04},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.80800000000000005,"15min":0.88},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98399999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.63100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":431248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.62,"15min":0.622},"min":{"1min":0.439,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77600000000000002,"5min":1.081,"15min":1.081},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67600000000000005,"15min":0.68899999999999995},"min":{"1min":0.50700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83999999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.81399999999999995}]},{"osd":1,"last update":"Fri Dec 8 08:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.68600000000000005,"15min":0.67900000000000005},"min":{"1min":0.45400000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89600000000000002,"5min":1.194,"15min":1.194},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68899999999999995,"15min":0.70899999999999996},"min":{"1min":0.54900000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.05,"5min":1.143,"15min":1.143},"last":0.83599999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.58799999999999997,"5min":0.438,"15min":0.438},"max":{"1min":1.048,"5min":1.071,"15min":1.071},"last":0.754},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71699999999999997,"15min":0.72899999999999998},"min":{"1min":0.51000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95699999999999996,"5min":1.101,"15min":1.101},"last":0.74199999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71899999999999997,"15min":0.73899999999999999},"min":{"1min":0.49099999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95099999999999996,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76600000000000001,"15min":0.754},"min":{"1min":0.57299999999999995,"5min":0.5,"15min":0.5},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.77700000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.66000000000000003,"15min":0.67000000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91400000000000003,"5min":1.01,"15min":1.01},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78800000000000003,"15min":0.80600000000000005},"min":{"1min":0.56000000000000005,"5min":0.503,"15min":0.503},"max":{"1min":0.99399999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.64500000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.74199999999999999,"15min":0.77400000000000002},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72499999999999998,"15min":0.73799999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.92200000000000004,"5min":1.073,"15min":1.073},"last":0.54300000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77200000000000002,"15min":0.78900000000000003},"min":{"1min":0.51400000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0409999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.82299999999999995,"15min":0.85099999999999998},"min":{"1min":0.53400000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.61299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":431248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.67100000000000004,"15min":0.69099999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88600000000000001,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.548,"5min":0.85999999999999999,"15min":0.72699999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":18.882999999999999,"5min":18.882999999999999,"15min":18.882999999999999},"last":0.89000000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:24:14 2023","interfaces":[{"interface":"back","average":{"1min":1.595,"5min":0.88400000000000001,"15min":0.77200000000000002},"min":{"1min":0.54500000000000004,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":19.048999999999999,"5min":19.048999999999999,"15min":19.048999999999999},"last":1.038},{"interface":"front","average":{"1min":1.7290000000000001,"5min":0.89000000000000001,"15min":0.752},"min":{"1min":0.51200000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":22.335000000000001,"5min":22.335000000000001,"15min":22.335000000000001},"last":0.91300000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:24:14 2023","interfaces":[{"interface":"back","average":{"1min":2.254,"5min":0.995,"15min":0.79400000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":33.661999999999999,"5min":33.661999999999999,"15min":33.661999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.613,"5min":0.89600000000000002,"15min":0.77700000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":18.984999999999999,"5min":18.984999999999999,"15min":18.984999999999999},"last":0.998}]},{"osd":3,"last update":"Fri Dec 8 08:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.77100000000000002,"15min":0.76100000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":5.0899999999999999,"5min":5.0899999999999999,"15min":5.0899999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.609,"5min":0.91700000000000004,"15min":0.83899999999999997},"min":{"1min":0.55600000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":18.949000000000002,"5min":18.949000000000002,"15min":18.949000000000002},"last":0.95099999999999996}]},{"osd":5,"last update":"Fri Dec 8 08:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.64900000000000002,"15min":0.67000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":2.706,"5min":2.706,"15min":2.706},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72299999999999998,"15min":0.77300000000000002},"min":{"1min":0.47699999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91800000000000004,"5min":1.091,"15min":1.091},"last":0.65500000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.68999999999999995,"15min":0.71599999999999997},"min":{"1min":0.44,"5min":0.376,"15min":0.376},"max":{"1min":2.8359999999999999,"5min":2.8359999999999999,"15min":2.8359999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":1.6060000000000001,"5min":0.92400000000000004,"15min":0.84299999999999997},"min":{"1min":0.45100000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":19.013999999999999,"5min":19.013999999999999,"15min":19.013999999999999},"last":0.71699999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78500000000000003,"15min":0.82099999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2350000000000001,"5min":1.246,"15min":1.246},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.75,"15min":0.79500000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.874}]}]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32128,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":974848,"data_stored":431248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:24:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.41899999999999998,"15min":0.432},"min":{"1min":0.29799999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.5},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.44700000000000001,"15min":0.46000000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.627,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.627}]},{"osd":1,"last update":"Fri Dec 8 08:24:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42899999999999999,"15min":0.434},"min":{"1min":0.30299999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.54900000000000004,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.505,"5min":0.48899999999999999,"15min":0.496},"min":{"1min":0.34000000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.65700000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:24:20 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.501,"15min":0.51900000000000002},"min":{"1min":0.36499999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52600000000000002,"15min":0.54000000000000004},"min":{"1min":0.40799999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.70099999999999996}]},{"osd":4,"last update":"Fri Dec 8 08:24:20 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.72499999999999998,"15min":0.72799999999999998},"min":{"1min":0.54900000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.996,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.73999999999999999,"15min":0.75800000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.02,"5min":1.143,"15min":1.143},"last":0.82599999999999996}]},{"osd":5,"last update":"Fri Dec 8 08:24:20 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73199999999999998,"15min":0.73899999999999999},"min":{"1min":0.58499999999999996,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98199999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76300000000000001,"15min":0.77100000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0009999999999999,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.84499999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:24:20 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79300000000000004,"15min":0.80700000000000005},"min":{"1min":0.60299999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.97799999999999998,"5min":1.75,"15min":1.75},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.79200000000000004,"15min":0.80200000000000005},"min":{"1min":0.58599999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.99399999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.95199999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:24:20 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.76800000000000002,"15min":0.76100000000000001},"min":{"1min":0.56899999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.99399999999999999,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.77600000000000002,"15min":0.78400000000000003},"min":{"1min":0.55500000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.046,"5min":1.121,"15min":1.121},"last":0.92700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":974848,"data_stored":431248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.42699999999999999,"15min":0.41299999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":3.7639999999999998,"5min":3.7639999999999998,"15min":3.7639999999999998},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.51700000000000002,"15min":0.53800000000000003},"min":{"1min":0.307,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":4.4359999999999999,"5min":4.4359999999999999,"15min":4.4359999999999999},"last":0.77300000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:24:11 2023","interfaces":[{"interface":"back","average":{"1min":1.833,"5min":0.73699999999999999,"15min":0.56299999999999994},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":24.222999999999999,"5min":24.222999999999999,"15min":24.222999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":1.554,"5min":0.71999999999999997,"15min":0.59199999999999997},"min":{"1min":0.38100000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":18.344000000000001,"5min":18.344000000000001,"15min":18.344000000000001},"last":0.745}]},{"osd":3,"last update":"Fri Dec 8 08:24:11 2023","interfaces":[{"interface":"back","average":{"1min":1.823,"5min":0.78800000000000003,"15min":0.65900000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":24.094000000000001,"5min":24.094000000000001,"15min":24.094000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.51900000000000002,"15min":0.498},"min":{"1min":0.36599999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":3.8660000000000001,"5min":3.8660000000000001,"15min":3.8660000000000001},"last":0.80600000000000005}]},{"osd":4,"last update":"Fri Dec 8 08:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.753,"15min":0.80700000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3740000000000001,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.83999999999999997},{"interface":"front","average":{"1min":2.1150000000000002,"5min":1.01,"15min":0.84899999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":24.571000000000002,"5min":24.571000000000002,"15min":24.571000000000002},"last":0.86799999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.747,"15min":0.76500000000000001},"min":{"1min":0.59199999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.85699999999999998,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.755,"15min":0.81799999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.327,"5min":3.637,"15min":3.637},"last":0.88200000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:24:11 2023","interfaces":[{"interface":"back","average":{"1min":2.1360000000000001,"5min":1.0469999999999999,"15min":0.88300000000000001},"min":{"1min":0.58499999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":24.611000000000001,"5min":24.611000000000001,"15min":24.611000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.2589999999999999,"5min":0.86699999999999999,"15min":0.82499999999999996},"min":{"1min":0.622,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":9.2579999999999991,"5min":9.2579999999999991,"15min":9.2579999999999991},"last":1.036}]},{"osd":7,"last update":"Fri Dec 8 08:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.83099999999999996,"15min":0.89400000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":4.3979999999999997,"5min":4.3979999999999997,"15min":4.3979999999999997},"last":0.998},{"interface":"front","average":{"1min":2.0899999999999999,"5min":1.0740000000000001,"15min":0.92200000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":24.16,"5min":24.16,"15min":24.16},"last":0.90900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":431248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.53900000000000003,"15min":0.65600000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68799999999999994,"5min":5.2210000000000001,"15min":5.2210000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.64800000000000002,"15min":0.82999999999999996},"min":{"1min":0.28799999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70599999999999996,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.63400000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.626,"15min":0.81000000000000005},"min":{"1min":0.317,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.753,"5min":8.2070000000000007,"15min":8.2070000000000007},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.58499999999999996,"15min":0.68700000000000006},"min":{"1min":0.33100000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.77600000000000002,"5min":4.351,"15min":4.351},"last":0.52500000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.71599999999999997,"15min":0.91100000000000003},"min":{"1min":0.41199999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.73599999999999999,"5min":8.1479999999999997,"15min":8.1479999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.501,"5min":0.61099999999999999,"15min":0.748},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.74199999999999999,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.71199999999999997}]},{"osd":4,"last update":"Fri Dec 8 08:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.84599999999999997,"15min":0.98999999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.155,"5min":4.8470000000000004,"15min":4.8470000000000004},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.89200000000000002,"15min":1.054},"min":{"1min":0.501,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.02,"5min":4.7939999999999996,"15min":4.7939999999999996},"last":0.83199999999999996}]},{"osd":5,"last update":"Fri Dec 8 08:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.84499999999999997,"15min":0.96699999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0289999999999999,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.84299999999999997,"15min":0.96099999999999997},"min":{"1min":0.56000000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1220000000000001,"5min":4.5830000000000002,"15min":4.5830000000000002},"last":0.77100000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:24:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.89000000000000001,"15min":1.0669999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0960000000000001,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.874},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.90100000000000002,"15min":1.0509999999999999},"min":{"1min":0.626,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.04,"5min":4.6289999999999996,"15min":4.6289999999999996},"last":0.68100000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:24:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.85399999999999998,"15min":0.98199999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0589999999999999,"5min":4.665,"15min":4.665},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.90300000000000002,"15min":1.0589999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.002,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.91700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1040384,"data_stored":1021616,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:24:14 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":0.624,"15min":0.54700000000000004},"min":{"1min":0.26100000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":15.353,"5min":15.353,"15min":15.353},"last":0.372},{"interface":"front","average":{"1min":1.3859999999999999,"5min":0.84299999999999997,"15min":0.91500000000000004},"min":{"1min":0.377,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":16.207000000000001,"5min":16.207000000000001,"15min":16.207000000000001},"last":0.55400000000000005}]},{"osd":2,"last update":"Fri Dec 8 08:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71699999999999997,"15min":0.91100000000000003},"min":{"1min":0.30299999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":4.7569999999999997,"5min":7.9290000000000003,"15min":7.9290000000000003},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.69699999999999995,"15min":0.90900000000000003},"min":{"1min":0.32600000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":2.7109999999999999,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.60699999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.63800000000000001,"15min":0.68500000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":8.4529999999999994,"5min":8.4529999999999994,"15min":8.4529999999999994},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.71899999999999997,"15min":0.85899999999999999},"min":{"1min":0.373,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":4.7190000000000003,"5min":7.8890000000000002,"15min":7.8890000000000002},"last":0.58399999999999996}]},{"osd":4,"last update":"Fri Dec 8 08:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.90500000000000003,"15min":1.038},"min":{"1min":0.50600000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":3.6800000000000002,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":1.054},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.77700000000000002,"15min":0.78600000000000003},"min":{"1min":0.57699999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":4.1210000000000004,"5min":4.1210000000000004,"15min":4.1210000000000004},"last":0.90000000000000002}]},{"osd":5,"last update":"Fri Dec 8 08:24:14 2023","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":0.96199999999999997,"15min":0.88200000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":15.456,"5min":15.456,"15min":15.456},"last":1.036},{"interface":"front","average":{"1min":1.613,"5min":1.077,"15min":1.139},"min":{"1min":0.54500000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":16.251000000000001,"5min":16.251000000000001,"15min":16.251000000000001},"last":0.95499999999999996}]},{"osd":6,"last update":"Fri Dec 8 08:24:14 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":0.86299999999999999,"15min":0.85099999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":9.1159999999999997,"5min":9.1159999999999997,"15min":9.1159999999999997},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.92100000000000004,"15min":1.044},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":4.7960000000000003,"5min":7.835,"15min":7.835},"last":1.0700000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.92700000000000005,"15min":1.0649999999999999},"min":{"1min":0.56100000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":3.7160000000000002,"5min":8.0239999999999991,"15min":8.0239999999999991},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.81799999999999995,"15min":0.85599999999999998},"min":{"1min":0.52900000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":4.1970000000000001,"5min":4.1970000000000001,"15min":4.1970000000000001},"last":0.96699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33203,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:24:27.971 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-08T08:24:28.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.101+0000 7f930e18d640 1 Processor -- start 2023-12-08T08:24:28.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.101+0000 7f930e18d640 1 -- start start 2023-12-08T08:24:28.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.101+0000 7f930e18d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f93080c4b20 0x7f93080bf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:28.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.101+0000 7f930e18d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9308157b80 con 0x7f93080bed60 2023-12-08T08:24:28.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.101+0000 7f930e18d640 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f930806d6c0 con 0x7f93080a4f30 2023-12-08T08:24:28.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.101+0000 7f930e18d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930806d960 con 0x7f93080c4b20 2023-12-08T08:24:28.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.101+0000 7f93077fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f93080bed60 0x7f9308154590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57804/0 (socket says 172.21.15.88:57804) 2023-12-08T08:24:28.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.101+0000 7f93077fe640 1 -- 172.21.15.88:0/1825764645 learned_addr learned my addr 172.21.15.88:0/1825764645 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:24:28.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.105+0000 7f9307fff640 1 --2- 172.21.15.88:0/1825764645 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f93080c4b20 0x7f93080bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:28.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.105+0000 7f93067fc640 1 -- 172.21.15.88:0/1825764645 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 56699056 0 0) 0x7f9308157b80 con 0x7f93080bed60 2023-12-08T08:24:28.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.105+0000 7f93067fc640 1 -- 172.21.15.88:0/1825764645 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92f0003530 con 0x7f93080bed60 2023-12-08T08:24:28.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.105+0000 7f93067fc640 1 -- 172.21.15.88:0/1825764645 <== mon.1 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1355916658 0 0) 0x7f930806d6c0 con 0x7f93080a4f30 2023-12-08T08:24:28.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.105+0000 7f93067fc640 1 -- 172.21.15.88:0/1825764645 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9308157b80 con 0x7f93080a4f30 2023-12-08T08:24:28.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.105+0000 7f93067fc640 1 -- 172.21.15.88:0/1825764645 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2474873098 0 0) 0x7f92f0003530 con 0x7f93080bed60 2023-12-08T08:24:28.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.105+0000 7f93067fc640 1 -- 172.21.15.88:0/1825764645 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f93080c4b20 msgr2=0x7f93080bf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:28.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.105+0000 7f93067fc640 1 --2- 172.21.15.88:0/1825764645 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f93080c4b20 0x7f93080bf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:28.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.105+0000 7f93067fc640 1 -- 172.21.15.88:0/1825764645 >> v1:172.21.15.148:6789/0 conn(0x7f93080a4f30 legacy=0x7f930815cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:28.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.105+0000 7f93067fc640 1 -- 172.21.15.88:0/1825764645 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9308157dd0 con 0x7f93080bed60 2023-12-08T08:24:28.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.105+0000 7f93067fc640 1 -- 172.21.15.88:0/1825764645 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4285958840 0 0) 0x7f92f8001680 con 0x7f93080bed60 2023-12-08T08:24:28.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.105+0000 7f93067fc640 1 -- 172.21.15.88:0/1825764645 >> v1:172.21.15.88:6789/0 conn(0x7f93080bed60 legacy=0x7f9308154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:28.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.105+0000 7f93067fc640 1 --2- 172.21.15.88:0/1825764645 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f93080c4b20 0x7f92f0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:28.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.105+0000 7f93067fc640 1 --2- 172.21.15.88:0/1825764645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92f00040f0 0x7f92f00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:28.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.105+0000 7f93067fc640 1 --2- 172.21.15.88:0/1825764645 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92f0004d10 0x7f92f0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:28.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.105+0000 7f93067fc640 1 -- 172.21.15.88:0/1825764645 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930806d960 con 0x7f92f0004d10 2023-12-08T08:24:28.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.105+0000 7f93067fc640 1 -- 172.21.15.88:0/1825764645 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f000bb50 con 0x7f92f00040f0 2023-12-08T08:24:28.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.105+0000 7f93067fc640 1 -- 172.21.15.88:0/1825764645 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f000bd10 con 0x7f93080c4b20 2023-12-08T08:24:28.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.105+0000 7f9307fff640 1 --2- 172.21.15.88:0/1825764645 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92f0004d10 0x7f92f0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:28.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.105+0000 7f9306ffd640 1 --2- 172.21.15.88:0/1825764645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92f00040f0 0x7f92f00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:28.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.105+0000 7f93077fe640 1 --2- 172.21.15.88:0/1825764645 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f93080c4b20 0x7f92f0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:28.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.105+0000 7f9307fff640 1 -- 172.21.15.88:0/1825764645 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f93080c4b20 msgr2=0x7f92f0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:28.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.105+0000 7f9307fff640 1 --2- 172.21.15.88:0/1825764645 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f93080c4b20 0x7f92f0003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:28.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.105+0000 7f9307fff640 1 -- 172.21.15.88:0/1825764645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92f00040f0 msgr2=0x7f92f00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:28.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.105+0000 7f9307fff640 1 --2- 172.21.15.88:0/1825764645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92f00040f0 0x7f92f00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:28.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.105+0000 7f9307fff640 1 -- 172.21.15.88:0/1825764645 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f0003530 con 0x7f92f0004d10 2023-12-08T08:24:28.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.105+0000 7f93077fe640 1 --2- 172.21.15.88:0/1825764645 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f93080c4b20 0x7f92f0003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:24:28.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.109+0000 7f9307fff640 1 --2- 172.21.15.88:0/1825764645 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92f0004d10 0x7f92f0005190 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f9300009fc0 tx=0x7f930001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212bb747f56d367d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:28.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.109+0000 7f93067fc640 1 -- 172.21.15.88:0/1825764645 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93000a5c70 con 0x7f92f0004d10 2023-12-08T08:24:28.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.109+0000 7f93067fc640 1 -- 172.21.15.88:0/1825764645 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930000f040 con 0x7f92f0004d10 2023-12-08T08:24:28.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.109+0000 7f93067fc640 1 -- 172.21.15.88:0/1825764645 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93000ad440 con 0x7f92f0004d10 2023-12-08T08:24:28.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.109+0000 7f930e18d640 1 -- 172.21.15.88:0/1825764645 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92f0004d10 msgr2=0x7f92f0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:28.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.109+0000 7f930e18d640 1 --2- 172.21.15.88:0/1825764645 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92f0004d10 0x7f92f0005190 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f9300009fc0 tx=0x7f930001cc60 comp rx=0 tx=0).stop 2023-12-08T08:24:28.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.109+0000 7f9307fff640 1 -- 172.21.15.88:0/1825764645 reap_dead start 2023-12-08T08:24:28.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.109+0000 7f930e18d640 1 -- 172.21.15.88:0/1825764645 shutdown_connections 2023-12-08T08:24:28.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.109+0000 7f930e18d640 1 -- 172.21.15.88:0/1825764645 >> 172.21.15.88:0/1825764645 conn(0x7f93080c59f0 msgr2=0x7f93080c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:28.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.109+0000 7f930e18d640 1 -- 172.21.15.88:0/1825764645 shutdown_connections 2023-12-08T08:24:28.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.109+0000 7f930e18d640 1 -- 172.21.15.88:0/1825764645 wait complete. 2023-12-08T08:24:28.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.109+0000 7f930e18d640 1 Processor -- start 2023-12-08T08:24:28.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.109+0000 7f930e18d640 1 -- start start 2023-12-08T08:24:28.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.109+0000 7f930e18d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92f0004d10 0x7f9308143e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:28.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.109+0000 7f930e18d640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9308145660 0x7f9308144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:28.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.109+0000 7f930e18d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f930814f240 0x7f930814f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:28.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.113+0000 7f930e18d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9308144890 con 0x7f92f0004d10 2023-12-08T08:24:28.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.113+0000 7f930e18d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93081ed860 con 0x7f930814f240 2023-12-08T08:24:28.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.113+0000 7f930e18d640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93081edb40 con 0x7f9308145660 2023-12-08T08:24:28.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.113+0000 7f93077fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92f0004d10 0x7f9308143e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:28.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.113+0000 7f93077fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92f0004d10 0x7f9308143e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41372/0 (socket says 172.21.15.88:41372) 2023-12-08T08:24:28.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.113+0000 7f93077fe640 1 -- 172.21.15.88:0/1081141267 learned_addr learned my addr 172.21.15.88:0/1081141267 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:28.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.113+0000 7f9306ffd640 1 --2- 172.21.15.88:0/1081141267 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9308145660 0x7f9308144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:28.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.113+0000 7f9307fff640 1 --2- 172.21.15.88:0/1081141267 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f930814f240 0x7f930814f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:28.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.113+0000 7f93077fe640 1 -- 172.21.15.88:0/1081141267 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9308145660 msgr2=0x7f9308144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:28.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.113+0000 7f93077fe640 1 --2- 172.21.15.88:0/1081141267 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9308145660 0x7f9308144350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:28.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.113+0000 7f93077fe640 1 -- 172.21.15.88:0/1081141267 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f930814f240 msgr2=0x7f930814f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:28.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.113+0000 7f93077fe640 1 --2- 172.21.15.88:0/1081141267 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f930814f240 0x7f930814f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:28.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.113+0000 7f93077fe640 1 -- 172.21.15.88:0/1081141267 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93081ede20 con 0x7f92f0004d10 2023-12-08T08:24:28.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.113+0000 7f9307fff640 1 --2- 172.21.15.88:0/1081141267 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f930814f240 0x7f930814f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:24:28.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.113+0000 7f9306ffd640 1 --2- 172.21.15.88:0/1081141267 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9308145660 0x7f9308144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:24:28.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.113+0000 7f93077fe640 1 --2- 172.21.15.88:0/1081141267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92f0004d10 0x7f9308143e10 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f92f800e800 tx=0x7f92f800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:28.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.113+0000 7f92effff640 1 -- 172.21.15.88:0/1081141267 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f800c6c0 con 0x7f92f0004d10 2023-12-08T08:24:28.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.113+0000 7f92effff640 1 -- 172.21.15.88:0/1081141267 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f800c820 con 0x7f92f0004d10 2023-12-08T08:24:28.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.113+0000 7f92effff640 1 -- 172.21.15.88:0/1081141267 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f800cbb0 con 0x7f92f0004d10 2023-12-08T08:24:28.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.113+0000 7f930e18d640 1 -- 172.21.15.88:0/1081141267 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93081ee100 con 0x7f92f0004d10 2023-12-08T08:24:28.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.113+0000 7f930e18d640 1 -- 172.21.15.88:0/1081141267 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f930814fc30 con 0x7f92f0004d10 2023-12-08T08:24:28.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.113+0000 7f930e18d640 1 -- 172.21.15.88:0/1081141267 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9308067630 con 0x7f92f0004d10 2023-12-08T08:24:28.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.113+0000 7f92effff640 1 -- 172.21.15.88:0/1081141267 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f92f800cd10 con 0x7f92f0004d10 2023-12-08T08:24:28.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.113+0000 7f92effff640 1 --2- 172.21.15.88:0/1081141267 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f92f4066470 0x7f92f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:28.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.117+0000 7f92effff640 1 -- 172.21.15.88:0/1081141267 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f92f8083ad0 con 0x7f92f0004d10 2023-12-08T08:24:28.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.117+0000 7f9306ffd640 1 --2- 172.21.15.88:0/1081141267 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f92f4066470 0x7f92f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:28.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.117+0000 7f9306ffd640 1 --2- 172.21.15.88:0/1081141267 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f92f4066470 0x7f92f4068930 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f92fc000c10 tx=0x7f92fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:28.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.117+0000 7f92effff640 1 -- 172.21.15.88:0/1081141267 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f92f8054d10 con 0x7f92f0004d10 2023-12-08T08:24:28.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.273+0000 7f930e18d640 1 -- 172.21.15.88:0/1081141267 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f93080a74c0 con 0x7f92f0004d10 2023-12-08T08:24:28.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.277+0000 7f92effff640 1 -- 172.21.15.88:0/1081141267 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7f92f80548a0 con 0x7f92f0004d10 2023-12-08T08:24:28.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.277+0000 7f92effff640 1 -- 172.21.15.88:0/1081141267 <== mon.0 v2:172.21.15.88:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f92f8083e70 con 0x7f92f0004d10 2023-12-08T08:24:28.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.277+0000 7f930e18d640 1 -- 172.21.15.88:0/1081141267 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f92f4066470 msgr2=0x7f92f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:28.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.277+0000 7f930e18d640 1 --2- 172.21.15.88:0/1081141267 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f92f4066470 0x7f92f4068930 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f92fc000c10 tx=0x7f92fc009040 comp rx=0 tx=0).stop 2023-12-08T08:24:28.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.277+0000 7f930e18d640 1 -- 172.21.15.88:0/1081141267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92f0004d10 msgr2=0x7f9308143e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:28.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.277+0000 7f930e18d640 1 --2- 172.21.15.88:0/1081141267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92f0004d10 0x7f9308143e10 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f92f800e800 tx=0x7f92f800ecc0 comp rx=0 tx=0).stop 2023-12-08T08:24:28.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.281+0000 7f930e18d640 1 -- 172.21.15.88:0/1081141267 shutdown_connections 2023-12-08T08:24:28.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.281+0000 7f930e18d640 1 --2- 172.21.15.88:0/1081141267 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7f92f4066470 0x7f92f4068930 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:28.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.281+0000 7f930e18d640 1 --2- 172.21.15.88:0/1081141267 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f930814f240 0x7f930814f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:28.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.281+0000 7f930e18d640 1 --2- 172.21.15.88:0/1081141267 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f9308145660 0x7f9308144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:28.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.281+0000 7f930e18d640 1 --2- 172.21.15.88:0/1081141267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92f0004d10 0x7f9308143e10 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:28.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.281+0000 7f930e18d640 1 -- 172.21.15.88:0/1081141267 >> 172.21.15.88:0/1081141267 conn(0x7f93080c59f0 msgr2=0x7f93080c07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:28.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.281+0000 7f930e18d640 1 -- 172.21.15.88:0/1081141267 shutdown_connections 2023-12-08T08:24:28.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.281+0000 7f930e18d640 1 -- 172.21.15.88:0/1081141267 wait complete. 2023-12-08T08:24:28.304 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-08T08:24:28.305 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:24:28.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.437+0000 7fa45d7f5640 1 Processor -- start 2023-12-08T08:24:28.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.437+0000 7fa45d7f5640 1 -- start start 2023-12-08T08:24:28.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.437+0000 7fa45d7f5640 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa45814e3f0 0x7fa4580bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:28.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.437+0000 7fa45d7f5640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa45806bef0 0x7fa4580c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:28.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.437+0000 7fa45d7f5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa458151690 con 0x7fa4580c4730 2023-12-08T08:24:28.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.437+0000 7fa45d7f5640 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa458151bc0 con 0x7fa45814e3f0 2023-12-08T08:24:28.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.437+0000 7fa45d7f5640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4581518e0 con 0x7fa45806bef0 2023-12-08T08:24:28.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.437+0000 7fa4577fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa4580c4730 0x7fa45806c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57812/0 (socket says 172.21.15.88:57812) 2023-12-08T08:24:28.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.437+0000 7fa4577fe640 1 -- 172.21.15.88:0/3613450168 learned_addr learned my addr 172.21.15.88:0/3613450168 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-12-08T08:24:28.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.437+0000 7fa456ffd640 1 --2- 172.21.15.88:0/3613450168 >> v2:172.21.15.148:3300/0 conn(0x7fa45814e3f0 0x7fa4580bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:28.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.437+0000 7fa44e7fc640 1 --2- 172.21.15.88:0/3613450168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa45806bef0 0x7fa4580c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:28.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.437+0000 7fa4567fc640 1 -- 172.21.15.88:0/3613450168 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277548881 0 0) 0x7fa458151690 con 0x7fa4580c4730 2023-12-08T08:24:28.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.441+0000 7fa4567fc640 1 -- 172.21.15.88:0/3613450168 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa444005740 con 0x7fa4580c4730 2023-12-08T08:24:28.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.441+0000 7fa44e7fc640 1 -- 172.21.15.88:0/3613450168 >> v2:172.21.15.148:3300/0 conn(0x7fa45814e3f0 msgr2=0x7fa4580bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:24:28.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.441+0000 7fa44e7fc640 1 --2- 172.21.15.88:0/3613450168 >> v2:172.21.15.148:3300/0 conn(0x7fa45814e3f0 0x7fa4580bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:28.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.441+0000 7fa44e7fc640 1 -- 172.21.15.88:0/3613450168 >> v1:172.21.15.88:6789/0 conn(0x7fa4580c4730 legacy=0x7fa45806c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:28.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.441+0000 7fa44e7fc640 1 -- 172.21.15.88:0/3613450168 --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4580c1de0 con 0x7fa45806bef0 2023-12-08T08:24:28.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.441+0000 7fa44e7fc640 1 --2- 172.21.15.88:0/3613450168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa45806bef0 0x7fa4580c41f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa4400097c0 tx=0x7fa44001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c69e90a08ddb4c1e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:28.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.441+0000 7fa4567fc640 1 -- 172.21.15.88:0/3613450168 <== mon.2 v2:172.21.15.148:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4400ab600 con 0x7fa45806bef0 2023-12-08T08:24:28.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.441+0000 7fa4567fc640 1 -- 172.21.15.88:0/3613450168 <== mon.2 v2:172.21.15.148:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa4400a7050 con 0x7fa45806bef0 2023-12-08T08:24:28.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.441+0000 7fa4567fc640 1 -- 172.21.15.88:0/3613450168 <== mon.2 v2:172.21.15.148:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4400ab9a0 con 0x7fa45806bef0 2023-12-08T08:24:28.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.445+0000 7fa45d7f5640 1 -- 172.21.15.88:0/3613450168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa45806bef0 msgr2=0x7fa4580c41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:28.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.445+0000 7fa45d7f5640 1 --2- 172.21.15.88:0/3613450168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa45806bef0 0x7fa4580c41f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa4400097c0 tx=0x7fa44001c3c0 comp rx=0 tx=0).stop 2023-12-08T08:24:28.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.445+0000 7fa45d7f5640 1 -- 172.21.15.88:0/3613450168 shutdown_connections 2023-12-08T08:24:28.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.445+0000 7fa45d7f5640 1 --2- 172.21.15.88:0/3613450168 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa45806bef0 0x7fa4580c41f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:28.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.445+0000 7fa45d7f5640 1 --2- 172.21.15.88:0/3613450168 >> v2:172.21.15.148:3300/0 conn(0x7fa45814e3f0 0x7fa4580bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:28.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.445+0000 7fa45d7f5640 1 -- 172.21.15.88:0/3613450168 >> 172.21.15.88:0/3613450168 conn(0x7fa4580a7810 msgr2=0x7fa4580a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:28.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.445+0000 7fa45d7f5640 1 -- 172.21.15.88:0/3613450168 shutdown_connections 2023-12-08T08:24:28.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.445+0000 7fa45d7f5640 1 -- 172.21.15.88:0/3613450168 wait complete. 2023-12-08T08:24:28.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.445+0000 7fa45d7f5640 1 Processor -- start 2023-12-08T08:24:28.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.445+0000 7fa45d7f5640 1 -- start start 2023-12-08T08:24:28.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.445+0000 7fa45d7f5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa45806bef0 0x7fa4580bf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:28.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.445+0000 7fa45d7f5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4580c4730 0x7fa458153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:28.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.445+0000 7fa45d7f5640 1 --2- >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa45814e3f0 0x7fa458154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:28.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.445+0000 7fa45d7f5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4581549d0 con 0x7fa45806bef0 2023-12-08T08:24:28.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.445+0000 7fa45d7f5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4581f0400 con 0x7fa4580c4730 2023-12-08T08:24:28.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.445+0000 7fa45d7f5640 1 -- --> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4581f0f80 con 0x7fa45814e3f0 2023-12-08T08:24:28.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.445+0000 7fa456ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa45806bef0 0x7fa4580bf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:28.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.445+0000 7fa456ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa45806bef0 0x7fa4580bf700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41376/0 (socket says 172.21.15.88:41376) 2023-12-08T08:24:28.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.445+0000 7fa456ffd640 1 -- 172.21.15.88:0/4018551194 learned_addr learned my addr 172.21.15.88:0/4018551194 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-12-08T08:24:28.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.445+0000 7fa44e7fc640 1 --2- 172.21.15.88:0/4018551194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4580c4730 0x7fa458153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:28.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.445+0000 7fa4577fe640 1 --2- 172.21.15.88:0/4018551194 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa45814e3f0 0x7fa458154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:28.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.445+0000 7fa456ffd640 1 -- 172.21.15.88:0/4018551194 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa45814e3f0 msgr2=0x7fa458154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:28.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.445+0000 7fa456ffd640 1 --2- 172.21.15.88:0/4018551194 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa45814e3f0 0x7fa458154490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:28.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.445+0000 7fa456ffd640 1 -- 172.21.15.88:0/4018551194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4580c4730 msgr2=0x7fa458153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:28.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.445+0000 7fa456ffd640 1 --2- 172.21.15.88:0/4018551194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4580c4730 0x7fa458153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:28.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.445+0000 7fa456ffd640 1 -- 172.21.15.88:0/4018551194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa440009420 con 0x7fa45806bef0 2023-12-08T08:24:28.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.445+0000 7fa456ffd640 1 --2- 172.21.15.88:0/4018551194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa45806bef0 0x7fa4580bf700 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fa44800e870 tx=0x7fa44800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:28.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.449+0000 7fa44ffff640 1 -- 172.21.15.88:0/4018551194 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa448009510 con 0x7fa45806bef0 2023-12-08T08:24:28.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.449+0000 7fa44ffff640 1 -- 172.21.15.88:0/4018551194 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa44800eec0 con 0x7fa45806bef0 2023-12-08T08:24:28.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.449+0000 7fa45d7f5640 1 -- 172.21.15.88:0/4018551194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4581f0650 con 0x7fa45806bef0 2023-12-08T08:24:28.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.449+0000 7fa44ffff640 1 -- 172.21.15.88:0/4018551194 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44800cb60 con 0x7fa45806bef0 2023-12-08T08:24:28.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.449+0000 7fa45d7f5640 1 -- 172.21.15.88:0/4018551194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4581f0c10 con 0x7fa45806bef0 2023-12-08T08:24:28.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.449+0000 7fa45d7f5640 1 -- 172.21.15.88:0/4018551194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4580679d0 con 0x7fa45806bef0 2023-12-08T08:24:28.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.449+0000 7fa44ffff640 1 -- 172.21.15.88:0/4018551194 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa44800ccc0 con 0x7fa45806bef0 2023-12-08T08:24:28.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.449+0000 7fa44ffff640 1 --2- 172.21.15.88:0/4018551194 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa4380664a0 0x7fa438068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:24:28.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.449+0000 7fa44ffff640 1 -- 172.21.15.88:0/4018551194 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa448083d60 con 0x7fa45806bef0 2023-12-08T08:24:28.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.449+0000 7fa44e7fc640 1 --2- 172.21.15.88:0/4018551194 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa4380664a0 0x7fa438068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:24:28.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.449+0000 7fa44e7fc640 1 --2- 172.21.15.88:0/4018551194 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa4380664a0 0x7fa438068960 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa4400ad000 tx=0x7fa440008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:24:28.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.453+0000 7fa44ffff640 1 -- 172.21.15.88:0/4018551194 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa4480513e0 con 0x7fa45806bef0 2023-12-08T08:24:28.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.633+0000 7fa45d7f5640 1 -- 172.21.15.88:0/4018551194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa458067630 con 0x7fa45806bef0 2023-12-08T08:24:28.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.637+0000 7fa44ffff640 1 -- 172.21.15.88:0/4018551194 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+3705 (secure 0 0 0) 0x7fa448021e90 con 0x7fa45806bef0 2023-12-08T08:24:28.641 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-08T08:24:28.641 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":56,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5693,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/4194250074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4194250074},{"type":"v1","addr":"172.21.15.148:6833","nonce":4194250074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":5699,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3923000603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3923000603},{"type":"v1","addr":"172.21.15.148:6835","nonce":3923000603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/4138722471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":4138722471},{"type":"v1","addr":"172.21.15.88:6837","nonce":4138722471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7338,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/1231395129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1231395129},{"type":"v1","addr":"172.21.15.88:6835","nonce":1231395129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":56}],"filesystems":[]} 2023-12-08T08:24:28.641 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 56 2023-12-08T08:24:28.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.637+0000 7fa45d7f5640 1 -- 172.21.15.88:0/4018551194 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa4380664a0 msgr2=0x7fa438068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:28.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.637+0000 7fa45d7f5640 1 --2- 172.21.15.88:0/4018551194 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa4380664a0 0x7fa438068960 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa4400ad000 tx=0x7fa440008040 comp rx=0 tx=0).stop 2023-12-08T08:24:28.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.637+0000 7fa45d7f5640 1 -- 172.21.15.88:0/4018551194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa45806bef0 msgr2=0x7fa4580bf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:24:28.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.637+0000 7fa45d7f5640 1 --2- 172.21.15.88:0/4018551194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa45806bef0 0x7fa4580bf700 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fa44800e870 tx=0x7fa44800ec70 comp rx=0 tx=0).stop 2023-12-08T08:24:28.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.637+0000 7fa45d7f5640 1 -- 172.21.15.88:0/4018551194 shutdown_connections 2023-12-08T08:24:28.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.637+0000 7fa45d7f5640 1 --2- 172.21.15.88:0/4018551194 >> [v2:172.21.15.88:6832/187352875,v1:172.21.15.88:6833/187352875] conn(0x7fa4380664a0 0x7fa438068960 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:28.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.637+0000 7fa45d7f5640 1 --2- 172.21.15.88:0/4018551194 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7fa45814e3f0 0x7fa458154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:28.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.637+0000 7fa45d7f5640 1 --2- 172.21.15.88:0/4018551194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4580c4730 0x7fa458153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:28.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.637+0000 7fa45d7f5640 1 --2- 172.21.15.88:0/4018551194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa45806bef0 0x7fa4580bf700 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:24:28.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.637+0000 7fa45d7f5640 1 -- 172.21.15.88:0/4018551194 >> 172.21.15.88:0/4018551194 conn(0x7fa4580a7810 msgr2=0x7fa45814ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:24:28.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.637+0000 7fa45d7f5640 1 -- 172.21.15.88:0/4018551194 shutdown_connections 2023-12-08T08:24:28.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-12-08T08:24:28.637+0000 7fa45d7f5640 1 -- 172.21.15.88:0/4018551194 wait complete. 2023-12-08T08:24:28.662 DEBUG:tasks.cephfs.filesystem:already dead... 2023-12-08T08:24:28.662 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-08T08:24:28.662 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-08T08:24:28.662 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:24:28.675 INFO:tasks.ceph.mds.a:Stopped 2023-12-08T08:24:28.675 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-08T08:24:28.675 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:24:28.732 INFO:tasks.ceph.mds.c:Stopped 2023-12-08T08:24:28.732 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-08T08:24:28.732 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:24:28.747 INFO:tasks.ceph.mds.b:Stopped 2023-12-08T08:24:28.748 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-08T08:24:28.748 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:24:28.804 INFO:tasks.ceph.mds.d:Stopped 2023-12-08T08:24:28.804 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-08T08:24:28.805 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-08T08:24:28.805 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:24:28.883 INFO:tasks.ceph.osd.0:Stopped 2023-12-08T08:24:28.883 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-08T08:24:28.883 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:24:28.962 INFO:tasks.ceph.osd.1:Stopped 2023-12-08T08:24:28.962 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-08T08:24:28.963 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:24:29.006 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-12-08T08:24:29.006 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-12-08T08:24:29.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-12-08T08:24:29.062 INFO:tasks.ceph.osd.2:Stopped 2023-12-08T08:24:29.062 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-08T08:24:29.062 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:24:29.139 INFO:tasks.ceph.osd.3:Stopped 2023-12-08T08:24:29.139 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-08T08:24:29.139 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:24:29.235 INFO:tasks.ceph.osd.4:Stopped 2023-12-08T08:24:29.235 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-08T08:24:29.235 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:24:29.323 INFO:tasks.ceph.osd.5:Stopped 2023-12-08T08:24:29.323 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-08T08:24:29.323 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:24:29.398 INFO:tasks.ceph.osd.6:Stopped 2023-12-08T08:24:29.398 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-08T08:24:29.399 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:24:34.512 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-12-08T08:24:34.512 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-12-08T08:24:34.512 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-12-08T08:24:34.512 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-12-08T08:24:35.500 INFO:tasks.ceph.osd.7:Stopped 2023-12-08T08:24:35.500 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-08T08:24:35.501 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-08T08:24:35.501 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:24:35.558 INFO:tasks.ceph.mgr.y:Stopped 2023-12-08T08:24:35.559 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-08T08:24:35.559 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:24:35.612 INFO:tasks.ceph.mgr.x:Stopped 2023-12-08T08:24:35.612 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-08T08:24:35.612 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-08T08:24:35.612 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:24:35.632 INFO:tasks.ceph.mon.a:Stopped 2023-12-08T08:24:35.632 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-08T08:24:35.632 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:24:35.650 INFO:tasks.ceph.mon.b:Stopped 2023-12-08T08:24:35.650 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-08T08:24:35.651 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:24:35.714 INFO:tasks.ceph.mon.c:Stopped 2023-12-08T08:24:35.714 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-08T08:24:35.715 DEBUG:teuthology.orchestra.run.smithi088:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-08T08:24:35.744 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi088.front.sepia.ceph.com 2023-12-08T08:24:35.745 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-08T08:24:36.044 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi088.front.sepia.ceph.com 2023-12-08T08:24:36.044 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-08T08:24:36.197 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi088.front.sepia.ceph.com 2023-12-08T08:24:36.197 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-08T08:24:36.346 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi088.front.sepia.ceph.com 2023-12-08T08:24:36.347 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-08T08:24:36.497 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi148.front.sepia.ceph.com 2023-12-08T08:24:36.497 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-08T08:24:36.710 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi148.front.sepia.ceph.com 2023-12-08T08:24:36.710 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-08T08:24:36.896 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi148.front.sepia.ceph.com 2023-12-08T08:24:36.897 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-08T08:24:37.070 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi148.front.sepia.ceph.com 2023-12-08T08:24:37.071 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-08T08:24:37.272 INFO:tasks.ceph:Archiving mon data... 2023-12-08T08:24:37.273 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483775/data/mon.a.tgz 2023-12-08T08:24:37.273 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2023-12-08T08:24:37.283 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.zbxKUq714V 2023-12-08T08:24:37.284 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.zbxKUq714V 2023-12-08T08:24:37.437 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.zbxKUq714V 2023-12-08T08:24:37.513 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.zbxKUq714V is 449KB 2023-12-08T08:24:37.578 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.zbxKUq714V 2023-12-08T08:24:37.587 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483775/data/mon.b.tgz 2023-12-08T08:24:37.587 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2023-12-08T08:24:37.596 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.ztQcLmd05m 2023-12-08T08:24:37.597 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ztQcLmd05m 2023-12-08T08:24:37.781 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.ztQcLmd05m 2023-12-08T08:24:37.854 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.ztQcLmd05m is 579KB 2023-12-08T08:24:37.920 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.ztQcLmd05m 2023-12-08T08:24:37.928 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483775/data/mon.c.tgz 2023-12-08T08:24:37.929 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2023-12-08T08:24:37.981 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.FyC3iylXah 2023-12-08T08:24:37.982 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.FyC3iylXah 2023-12-08T08:24:38.162 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.FyC3iylXah 2023-12-08T08:24:38.242 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.FyC3iylXah is 579KB 2023-12-08T08:24:38.313 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.FyC3iylXah 2023-12-08T08:24:38.321 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-08T08:24:38.321 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-08T08:24:38.325 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-08T08:24:38.401 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-08T08:24:38.433 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-08T08:24:38.434 INFO:tasks.ceph:Archiving crash dumps... 2023-12-08T08:24:38.435 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483775/remote/smithi088/crash 2023-12-08T08:24:38.436 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-08T08:24:38.465 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483775/remote/smithi148/crash 2023-12-08T08:24:38.466 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-08T08:24:38.496 INFO:tasks.ceph:Shutting down logrotate 2023-12-08T08:24:38.497 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:24:38.510 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:24:38.594 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-08T08:24:38.615 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-08T08:24:38.635 INFO:tasks.ceph:Compressing logs... 2023-12-08T08:24:38.636 DEBUG:teuthology.orchestra.run.smithi088:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-08T08:24:38.659 DEBUG:teuthology.orchestra.run.smithi148:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-08T08:24:38.687 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46171.log 2023-12-08T08:24:38.688 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53749.log 2023-12-08T08:24:38.689 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42813.log 2023-12-08T08:24:38.689 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46171.log.gz 2023-12-08T08:24:38.690 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55082.log 2023-12-08T08:24:38.690 INFO:teuthology.orchestra.run.smithi088.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53749.log.gz 2023-12-08T08:24:38.691 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45602.log 2023-12-08T08:24:38.691 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42813.log.gz 2023-12-08T08:24:38.692 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55082.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55082.log.gz 2023-12-08T08:24:38.692 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46733.log 2023-12-08T08:24:38.693 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48348.log 2023-12-08T08:24:38.693 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45602.log.gz 2023-12-08T08:24:38.694 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46733.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46733.log.gz -5 2023-12-08T08:24:38.694 INFO:teuthology.orchestra.run.smithi088.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46863.log 2023-12-08T08:24:38.695 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52669.log 2023-12-08T08:24:38.695 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48348.log.gz 2023-12-08T08:24:38.696 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54400.log 2023-12-08T08:24:38.696 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46863.log.gz 2023-12-08T08:24:38.697 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55056.log 2023-12-08T08:24:38.697 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52669.log.gz 2023-12-08T08:24:38.698 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49431.log 2023-12-08T08:24:38.698 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54400.log.gz 2023-12-08T08:24:38.699 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48284.log 2023-12-08T08:24:38.699 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55056.log.gz 2023-12-08T08:24:38.700 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44991.log 2023-12-08T08:24:38.700 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49431.log.gz 2023-12-08T08:24:38.701 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49717.log 2023-12-08T08:24:38.701 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48284.log.gz 2023-12-08T08:24:38.702 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49097.log 2023-12-08T08:24:38.702 INFO:teuthology.orchestra.run.smithi088.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44991.log.gz 2023-12-08T08:24:38.703 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49982.log 2023-12-08T08:24:38.703 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49717.log.gz 2023-12-08T08:24:38.704 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.49097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49097.log.gz 2023-12-08T08:24:38.704 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43582.log 2023-12-08T08:24:38.705 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42829.log 2023-12-08T08:24:38.705 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49982.log.gz 2023-12-08T08:24:38.706 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43582.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43582.log.gz 2023-12-08T08:24:38.706 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51226.log 2023-12-08T08:24:38.711 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52643.log 2023-12-08T08:24:38.712 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42829.log.gz 2023-12-08T08:24:38.712 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51200.log 2023-12-08T08:24:38.712 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51226.log.gz 2023-12-08T08:24:38.712 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42616.log 2023-12-08T08:24:38.712 INFO:teuthology.orchestra.run.smithi088.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52643.log.gz 2023-12-08T08:24:38.712 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53066.log 2023-12-08T08:24:38.712 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51200.log.gz 2023-12-08T08:24:38.712 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49509.log 2023-12-08T08:24:38.712 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42616.log.gz 2023-12-08T08:24:38.713 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53066.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53066.log.gz 2023-12-08T08:24:38.713 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50165.log 2023-12-08T08:24:38.714 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47568.log 89.1% 2023-12-08T08:24:38.714 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49509.log.gz 2023-12-08T08:24:38.714 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50165.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50165.log.gz 2023-12-08T08:24:38.715 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53833.log 2023-12-08T08:24:38.715 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47568.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-12-08T08:24:38.715 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47568.log.gz 2023-12-08T08:24:38.716 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53458.log 2023-12-08T08:24:38.716 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53833.log.gz 2023-12-08T08:24:38.718 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50990.log 2023-12-08T08:24:38.718 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42493.log 2023-12-08T08:24:38.718 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-12-08T08:24:38.718 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.42493.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42493.log.gz 2023-12-08T08:24:38.719 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42288.log 2023-12-08T08:24:38.720 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-12-08T08:24:38.720 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.42288.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42288.log.gz 2023-12-08T08:24:38.720 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38326.log 2023-12-08T08:24:38.721 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53458.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.53458.log.gz 2023-12-08T08:24:38.721 INFO:teuthology.orchestra.run.smithi088.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51381.log 2023-12-08T08:24:38.721 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46393.log 2023-12-08T08:24:38.722 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50990.log.gz 2023-12-08T08:24:38.722 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53781.log 2023-12-08T08:24:38.722 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51381.log.gz 2023-12-08T08:24:38.722 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46393.log: gzip 88.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.46393.log.gz 2023-12-08T08:24:38.722 INFO:teuthology.orchestra.run.smithi088.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46837.log 2023-12-08T08:24:38.725 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53781.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53781.log.gz 2023-12-08T08:24:38.725 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46473.log 2023-12-08T08:24:38.726 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44040.log 2023-12-08T08:24:38.726 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46837.log.gz 2023-12-08T08:24:38.726 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51460.log 2023-12-08T08:24:38.726 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46473.log.gz 2023-12-08T08:24:38.727 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50477.log 2023-12-08T08:24:38.727 INFO:teuthology.orchestra.run.smithi088.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44040.log.gz 2023-12-08T08:24:38.728 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42616.log 2023-12-08T08:24:38.728 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38326.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38326.log.gz 2023-12-08T08:24:38.728 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38254.log 2023-12-08T08:24:38.729 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.42616.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42616.log.gz 2023-12-08T08:24:38.729 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-12-08T08:24:38.729 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42177.log 2023-12-08T08:24:38.729 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38254.log.gz 2023-12-08T08:24:38.729 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-12-08T08:24:38.729 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.42177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42177.log.gz 2023-12-08T08:24:38.729 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42334.log 2023-12-08T08:24:38.729 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-08T08:24:38.731 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.42334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42334.log.gz 2023-12-08T08:24:38.731 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38182.log 2023-12-08T08:24:38.731 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-12-08T08:24:38.733 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51460.log: 89.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.51460.log.gz -5 2023-12-08T08:24:38.733 INFO:teuthology.orchestra.run.smithi088.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52353.log 2023-12-08T08:24:38.734 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51514.log 2023-12-08T08:24:38.734 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50477.log.gz 2023-12-08T08:24:38.734 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54244.log 2023-12-08T08:24:38.734 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52353.log.gz 2023-12-08T08:24:38.734 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46339.log 2023-12-08T08:24:38.734 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51514.log.gz 2023-12-08T08:24:38.734 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47023.log 2023-12-08T08:24:38.734 INFO:teuthology.orchestra.run.smithi088.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54244.log.gz 2023-12-08T08:24:38.735 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46339.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46339.log.gz 2023-12-08T08:24:38.735 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54665.log 2023-12-08T08:24:38.735 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47023.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47023.log.gz 2023-12-08T08:24:38.735 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53324.log 2023-12-08T08:24:38.735 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53350.log 2023-12-08T08:24:38.735 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54665.log.gz 2023-12-08T08:24:38.740 INFO:teuthology.orchestra.run.smithi148.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-08T08:24:38.740 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38182.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38182.log.gz 2023-12-08T08:24:38.740 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38206.log 2023-12-08T08:24:38.740 INFO:teuthology.orchestra.run.smithi148.stderr: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-08T08:24:38.740 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.42719.log 2023-12-08T08:24:38.740 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38206.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38206.log.gz 2023-12-08T08:24:38.740 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-08T08:24:38.740 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.testuser.42719.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-12-08T08:24:38.741 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.42719.log.gz 2023-12-08T08:24:38.741 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38302.log 2023-12-08T08:24:38.741 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42437.log 2023-12-08T08:24:38.743 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53324.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53324.log.gz 2023-12-08T08:24:38.744 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54952.log 2023-12-08T08:24:38.744 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44300.log 2023-12-08T08:24:38.744 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53350.log.gz 2023-12-08T08:24:38.744 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54952.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54952.log.gz 2023-12-08T08:24:38.744 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45955.log 2023-12-08T08:24:38.744 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46525.log 2023-12-08T08:24:38.744 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44300.log.gz 2023-12-08T08:24:38.744 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46655.log 2023-12-08T08:24:38.745 INFO:teuthology.orchestra.run.smithi088.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.45955.log.gz 2023-12-08T08:24:38.745 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51839.log 2023-12-08T08:24:38.745 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46525.log.gz 2023-12-08T08:24:38.745 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45069.log 2023-12-08T08:24:38.745 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46655.log.gz 2023-12-08T08:24:38.745 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51839.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51839.log.gz 2023-12-08T08:24:38.745 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47438.log 2023-12-08T08:24:38.745 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53124.log 2023-12-08T08:24:38.746 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45069.log.gz 2023-12-08T08:24:38.747 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38302.log: 93.5% 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38302.log.gz 2023-12-08T08:24:38.747 INFO:teuthology.orchestra.run.smithi148.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-08T08:24:38.747 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38278.log 2023-12-08T08:24:38.747 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.42437.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42437.log.gz 2023-12-08T08:24:38.747 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42662.log 2023-12-08T08:24:38.747 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38278.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38278.log.gz 2023-12-08T08:24:38.747 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-12-08T08:24:38.748 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.1.42662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42662.log.gz 2023-12-08T08:24:38.748 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-12-08T08:24:38.748 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-12-08T08:24:38.749 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-mon.b.log: 93.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-12-08T08:24:38.749 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38230.log 2023-12-08T08:24:38.751 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49561.log 2023-12-08T08:24:38.752 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47438.log.gz 2023-12-08T08:24:38.752 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53246.log 2023-12-08T08:24:38.752 INFO:teuthology.orchestra.run.smithi088.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.53124.log.gz 2023-12-08T08:24:38.752 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49561.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49561.log.gz 2023-12-08T08:24:38.752 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-12-08T08:24:38.752 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53885.log 2023-12-08T08:24:38.752 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53246.log.gz 2023-12-08T08:24:38.752 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49930.log 2023-12-08T08:24:38.753 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47075.log 2023-12-08T08:24:38.753 INFO:teuthology.orchestra.run.smithi088.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53885.log.gz 2023-12-08T08:24:38.753 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49930.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49930.log.gz 2023-12-08T08:24:38.753 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46971.log 2023-12-08T08:24:38.753 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43038.log 2023-12-08T08:24:38.753 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47075.log.gz 2023-12-08T08:24:38.754 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.38230.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38230.log.gz 2023-12-08T08:24:38.754 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38158.log 2023-12-08T08:24:38.755 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54523.log 2023-12-08T08:24:38.755 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46971.log.gz 2023-12-08T08:24:38.755 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44326.log 2023-12-08T08:24:38.756 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43038.log.gz 2023-12-08T08:24:38.756 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54523.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54523.log.gz 2023-12-08T08:24:38.756 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48414.log 2023-12-08T08:24:38.756 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.38158.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38158.log.gz 2023-12-08T08:24:38.757 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48819.log 2023-12-08T08:24:38.757 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44326.log.gz 2023-12-08T08:24:38.758 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48414.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48414.log.gz 2023-12-08T08:24:38.758 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49139.log 2023-12-08T08:24:38.758 INFO:teuthology.orchestra.run.smithi148.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-12-08T08:24:38.759 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44534.log 2023-12-08T08:24:38.759 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48819.log.gz 2023-12-08T08:24:38.760 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49139.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49139.log.gz 2023-12-08T08:24:38.760 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49904.log 2023-12-08T08:24:38.761 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48686.log 2023-12-08T08:24:38.762 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44534.log.gz 2023-12-08T08:24:38.762 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49904.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49904.log.gz 2023-12-08T08:24:38.762 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47464.log 2023-12-08T08:24:38.763 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52617.log 2023-12-08T08:24:38.764 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48686.log.gz 2023-12-08T08:24:38.765 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47464.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47464.log.gz 2023-12-08T08:24:38.765 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45446.log 2023-12-08T08:24:38.766 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55238.log 2023-12-08T08:24:38.766 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52617.log.gz 2023-12-08T08:24:38.767 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45446.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45446.log.gz 2023-12-08T08:24:38.767 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49295.log 2023-12-08T08:24:38.768 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51542.log 2023-12-08T08:24:38.768 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55238.log.gz 2023-12-08T08:24:38.769 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49295.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49295.log.gz 2023-12-08T08:24:38.770 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47698.log 2023-12-08T08:24:38.771 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50860.log 2023-12-08T08:24:38.771 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51542.log.gz 2023-12-08T08:24:38.772 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47698.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47698.log.gz 2023-12-08T08:24:38.772 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48572.log 2023-12-08T08:24:38.773 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42358.log 2023-12-08T08:24:38.773 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50860.log.gz 2023-12-08T08:24:38.774 INFO:teuthology.orchestra.run.smithi088.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-12-08T08:24:38.774 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48572.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48572.log.gz 2023-12-08T08:24:38.775 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54717.log 2023-12-08T08:24:38.776 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45472.log 2023-12-08T08:24:38.776 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42358.log.gz 2023-12-08T08:24:38.777 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42490.log 2023-12-08T08:24:38.777 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54717.log.gz 2023-12-08T08:24:38.778 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54270.log 2023-12-08T08:24:38.778 INFO:teuthology.orchestra.run.smithi088.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45472.log.gz 2023-12-08T08:24:38.779 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42490.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42490.log.gz 2023-12-08T08:24:38.779 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48102.log 2023-12-08T08:24:38.780 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54795.log 2023-12-08T08:24:38.780 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54270.log.gz 2023-12-08T08:24:38.781 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43764.log 2023-12-08T08:24:38.781 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48102.log.gz 2023-12-08T08:24:38.782 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50217.log 2023-12-08T08:24:38.782 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54795.log.gz 2023-12-08T08:24:38.783 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43764.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43764.log.gz 2023-12-08T08:24:38.783 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50243.log 2023-12-08T08:24:38.784 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45017.log 2023-12-08T08:24:38.784 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50217.log.gz 2023-12-08T08:24:38.785 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44646.log 88.8% 2023-12-08T08:24:38.785 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50243.log.gz 2023-12-08T08:24:38.786 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44066.log 2023-12-08T08:24:38.786 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45017.log.gz 2023-12-08T08:24:38.787 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44646.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44646.log.gz 2023-12-08T08:24:38.787 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45903.log 2023-12-08T08:24:38.788 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42083.log 2023-12-08T08:24:38.788 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44066.log.gz 2023-12-08T08:24:38.789 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52265.log 2023-12-08T08:24:38.789 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45903.log.gz 2023-12-08T08:24:38.790 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48897.log 2023-12-08T08:24:38.790 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42083.log.gz 2023-12-08T08:24:38.791 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52265.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52265.log.gz 2023-12-08T08:24:38.791 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46421.log 2023-12-08T08:24:38.792 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48466.log 2023-12-08T08:24:38.792 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48897.log.gz 2023-12-08T08:24:38.793 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45121.log 2023-12-08T08:24:38.793 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46421.log.gz 2023-12-08T08:24:38.794 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47256.log 2023-12-08T08:24:38.794 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48466.log.gz 2023-12-08T08:24:38.795 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45121.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45121.log.gz 2023-12-08T08:24:38.795 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52962.log 2023-12-08T08:24:38.796 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46447.log 2023-12-08T08:24:38.796 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47256.log.gz 2023-12-08T08:24:38.797 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53194.log 2023-12-08T08:24:38.797 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52962.log.gz 2023-12-08T08:24:38.798 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51760.log 2023-12-08T08:24:38.798 INFO:teuthology.orchestra.run.smithi088.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46447.log.gz 2023-12-08T08:24:38.799 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53194.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53194.log.gz 2023-12-08T08:24:38.799 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54899.log 2023-12-08T08:24:38.800 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42188.log 2023-12-08T08:24:38.800 INFO:teuthology.orchestra.run.smithi088.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51760.log.gz 2023-12-08T08:24:38.801 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51786.log 2023-12-08T08:24:38.801 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54899.log.gz 2023-12-08T08:24:38.802 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42620.log 2023-12-08T08:24:38.802 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42188.log.gz 2023-12-08T08:24:38.803 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51786.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51786.log.gz 2023-12-08T08:24:38.803 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47977.log 2023-12-08T08:24:38.804 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47951.log 2023-12-08T08:24:38.804 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42620.log.gz 2023-12-08T08:24:38.805 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46681.log 2023-12-08T08:24:38.805 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47977.log.gz 2023-12-08T08:24:38.806 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45773.log 2023-12-08T08:24:38.806 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47951.log.gz 2023-12-08T08:24:38.807 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46681.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46681.log.gz 2023-12-08T08:24:38.807 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-12-08T08:24:38.808 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45773.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45773.log.gz 2023-12-08T08:24:38.808 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43029.log 2023-12-08T08:24:38.809 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50581.log 2023-12-08T08:24:38.810 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43985.log 2023-12-08T08:24:38.810 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43029.log.gz 2023-12-08T08:24:38.811 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38127.log 2023-12-08T08:24:38.811 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50581.log.gz 2023-12-08T08:24:38.812 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.43985.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43985.log.gz 2023-12-08T08:24:38.812 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42162.log 2023-12-08T08:24:38.813 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38127.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38127.log.gz 2023-12-08T08:24:38.813 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51434.log 2023-12-08T08:24:38.814 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51865.log 2023-12-08T08:24:38.815 INFO:teuthology.orchestra.run.smithi088.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42162.log.gz 2023-12-08T08:24:38.815 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51434.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51434.log.gz 2023-12-08T08:24:38.816 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54192.log 2023-12-08T08:24:38.817 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53963.log 2023-12-08T08:24:38.817 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51865.log.gz 2023-12-08T08:24:38.818 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54192.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54192.log.gz 2023-12-08T08:24:38.818 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49691.log 2023-12-08T08:24:38.819 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46119.log 2023-12-08T08:24:38.820 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53963.log.gz 2023-12-08T08:24:38.821 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49691.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49691.log.gz 2023-12-08T08:24:38.821 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46629.log 2023-12-08T08:24:38.822 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50938.log 2023-12-08T08:24:38.822 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46119.log.gz 2023-12-08T08:24:38.823 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46629.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46629.log.gz 2023-12-08T08:24:38.823 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49665.log 2023-12-08T08:24:38.824 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49353.log 2023-12-08T08:24:38.824 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50938.log.gz 2023-12-08T08:24:38.825 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49665.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49665.log.gz 2023-12-08T08:24:38.825 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50808.log 2023-12-08T08:24:38.826 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49353.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49353.log.gz 2023-12-08T08:24:38.827 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48660.log 2023-12-08T08:24:38.827 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50808.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50808.log.gz 2023-12-08T08:24:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50347.log 2023-12-08T08:24:38.829 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48660.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48660.log.gz 2023-12-08T08:24:38.829 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46759.log 2023-12-08T08:24:38.830 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50347.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50347.log.gz 2023-12-08T08:24:38.830 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52747.log 2023-12-08T08:24:38.831 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46759.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46759.log.gz 2023-12-08T08:24:38.831 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48949.log 2023-12-08T08:24:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52747.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52747.log.gz 2023-12-08T08:24:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46997.log 2023-12-08T08:24:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48949.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48949.log.gz 2023-12-08T08:24:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44092.log 2023-12-08T08:24:38.834 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46997.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46997.log.gz 2023-12-08T08:24:38.834 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-12-08T08:24:38.835 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44092.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44092.log.gz 2023-12-08T08:24:38.835 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46945.log 2023-12-08T08:24:38.836 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49379.log 2023-12-08T08:24:38.838 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46945.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46945.log.gz 2023-12-08T08:24:38.838 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42332.log 2023-12-08T08:24:38.839 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49379.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49379.log.gz 2023-12-08T08:24:38.839 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52293.log 2023-12-08T08:24:38.840 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46249.log 2023-12-08T08:24:38.841 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42332.log.gz 2023-12-08T08:24:38.842 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52293.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52293.log.gz 2023-12-08T08:24:38.842 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48180.log 2023-12-08T08:24:38.843 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46249.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46249.log.gz 2023-12-08T08:24:38.843 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54769.log 2023-12-08T08:24:38.844 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47620.log 2023-12-08T08:24:38.845 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48180.log.gz 2023-12-08T08:24:38.845 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54769.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54769.log.gz 2023-12-08T08:24:38.846 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48128.log 2023-12-08T08:24:38.847 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47620.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47620.log.gz 2023-12-08T08:24:38.847 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49165.log 2023-12-08T08:24:38.848 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48634.log 2023-12-08T08:24:38.849 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48128.log.gz 2023-12-08T08:24:38.850 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49165.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49165.log.gz 2023-12-08T08:24:38.850 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54575.log 2023-12-08T08:24:38.851 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48634.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48634.log.gz 2023-12-08T08:24:38.851 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41892.log 2023-12-08T08:24:38.852 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43738.log 2023-12-08T08:24:38.853 INFO:teuthology.orchestra.run.smithi088.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54575.log.gz 2023-12-08T08:24:38.853 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41892.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41892.log.gz 2023-12-08T08:24:38.854 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42817.log 2023-12-08T08:24:38.855 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43738.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43738.log.gz 2023-12-08T08:24:38.855 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50912.log 2023-12-08T08:24:38.856 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47873.log 2023-12-08T08:24:38.857 INFO:teuthology.orchestra.run.smithi088.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42817.log.gz 2023-12-08T08:24:38.857 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50912.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50912.log.gz 2023-12-08T08:24:38.858 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52799.log 2023-12-08T08:24:38.859 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47873.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47873.log.gz 2023-12-08T08:24:38.859 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52880.log 2023-12-08T08:24:38.860 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47847.log 2023-12-08T08:24:38.861 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52799.log.gz 2023-12-08T08:24:38.862 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52880.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52880.log.gz 2023-12-08T08:24:38.862 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49822.log 2023-12-08T08:24:38.863 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47847.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47847.log.gz 2023-12-08T08:24:38.863 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54426.log 2023-12-08T08:24:38.865 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51258.log 2023-12-08T08:24:38.865 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49822.log.gz 2023-12-08T08:24:38.866 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54426.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54426.log.gz 2023-12-08T08:24:38.866 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52435.log 2023-12-08T08:24:38.867 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51258.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51258.log.gz 2023-12-08T08:24:38.867 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45877.log 2023-12-08T08:24:38.868 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51042.log 2023-12-08T08:24:38.869 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52435.log.gz 2023-12-08T08:24:38.870 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45877.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45877.log.gz 2023-12-08T08:24:38.870 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46005.log 2023-12-08T08:24:38.871 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51042.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51042.log.gz 2023-12-08T08:24:38.871 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45825.log 2023-12-08T08:24:38.873 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46889.log 2023-12-08T08:24:38.873 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46005.log.gz 2023-12-08T08:24:38.874 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45825.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45825.log.gz 2023-12-08T08:24:38.874 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43712.log 2023-12-08T08:24:38.875 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46889.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46889.log.gz 2023-12-08T08:24:38.875 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44672.log 2023-12-08T08:24:38.877 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42609.log 2023-12-08T08:24:38.877 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43712.log.gz 2023-12-08T08:24:38.878 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44672.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44672.log.gz 2023-12-08T08:24:38.878 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52591.log 2023-12-08T08:24:38.879 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42609.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42609.log.gz 2023-12-08T08:24:38.880 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49956.log 2023-12-08T08:24:38.881 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52513.log 2023-12-08T08:24:38.881 INFO:teuthology.orchestra.run.smithi088.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52591.log.gz 2023-12-08T08:24:38.882 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49956.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49956.log.gz 2023-12-08T08:24:38.883 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43871.log 2023-12-08T08:24:38.883 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52513.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52513.log.gz 2023-12-08T08:24:38.884 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55030.log 2023-12-08T08:24:38.885 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52159.log 2023-12-08T08:24:38.885 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43871.log.gz 2023-12-08T08:24:38.886 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55030.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55030.log.gz 2023-12-08T08:24:38.886 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47925.log 2023-12-08T08:24:38.887 INFO:teuthology.orchestra.run.smithi148.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-12-08T08:24:38.887 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52159.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52159.log.gz 2023-12-08T08:24:38.888 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44700.log 2023-12-08T08:24:38.889 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53298.log 2023-12-08T08:24:38.890 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47925.log.gz 2023-12-08T08:24:38.890 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44700.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44700.log.gz 2023-12-08T08:24:38.891 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47360.log 2023-12-08T08:24:38.891 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53298.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53298.log.gz 2023-12-08T08:24:38.892 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54847.log 2023-12-08T08:24:38.893 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43252.log 2023-12-08T08:24:38.893 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47360.log.gz 2023-12-08T08:24:38.894 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54847.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54847.log.gz 2023-12-08T08:24:38.894 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41992.log 2023-12-08T08:24:38.896 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43252.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43252.log.gz 2023-12-08T08:24:38.896 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38228.log 2023-12-08T08:24:38.897 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41992.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41992.log.gz 2023-12-08T08:24:38.897 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51812.log 2023-12-08T08:24:38.899 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38228.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38228.log.gz 2023-12-08T08:24:38.899 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48715.log 2023-12-08T08:24:38.900 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47230.log 2023-12-08T08:24:38.901 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51812.log.gz 2023-12-08T08:24:38.902 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48715.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48715.log.gz 2023-12-08T08:24:38.902 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45095.log 2023-12-08T08:24:38.903 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43660.log 2023-12-08T08:24:38.903 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47230.log.gz 2023-12-08T08:24:38.904 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45095.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45095.log.gz 2023-12-08T08:24:38.905 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55134.log 2023-12-08T08:24:38.906 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52851.log 2023-12-08T08:24:38.906 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43660.log.gz 2023-12-08T08:24:38.907 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55134.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55134.log.gz 2023-12-08T08:24:38.907 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50269.log 2023-12-08T08:24:38.908 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49051.log 2023-12-08T08:24:38.909 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52851.log.gz 2023-12-08T08:24:38.910 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50269.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50269.log.gz 2023-12-08T08:24:38.910 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43037.log 2023-12-08T08:24:38.911 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49051.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.49051.log.gz 2023-12-08T08:24:38.911 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53911.log 2023-12-08T08:24:38.913 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42542.log 2023-12-08T08:24:38.914 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43037.log.gz 2023-12-08T08:24:38.914 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53911.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53911.log.gz 2023-12-08T08:24:38.914 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50321.log 2023-12-08T08:24:38.915 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42542.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42542.log.gz 2023-12-08T08:24:38.916 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45745.log 2023-12-08T08:24:38.917 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50321.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50321.log.gz 2023-12-08T08:24:38.917 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53432.log 2023-12-08T08:24:38.919 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47594.log 2023-12-08T08:24:38.919 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45745.log.gz 2023-12-08T08:24:38.919 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53432.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53432.log.gz 2023-12-08T08:24:38.920 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47334.log 2023-12-08T08:24:38.921 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54873.log 2023-12-08T08:24:38.922 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47594.log.gz 2023-12-08T08:24:38.922 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47334.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47334.log.gz 2023-12-08T08:24:38.923 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48258.log 2023-12-08T08:24:38.924 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54873.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54873.log.gz 2023-12-08T08:24:38.924 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54015.log 2023-12-08T08:24:38.925 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48258.log: gzip -5 --verbose -- 89.1% /var/log/ceph/ceph-client.admin.50704.log -- replaced with /var/log/ceph/ceph-client.admin.48258.log.gz 2023-12-08T08:24:38.926 INFO:teuthology.orchestra.run.smithi088.stderr: 2023-12-08T08:24:38.927 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48767.log 2023-12-08T08:24:38.927 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54015.log.gz 2023-12-08T08:24:38.929 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47672.log 2023-12-08T08:24:38.929 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50704.log.gz 2023-12-08T08:24:38.930 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48767.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48767.log.gz 2023-12-08T08:24:38.930 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52773.log 2023-12-08T08:24:38.932 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53619.log 2023-12-08T08:24:38.932 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47672.log.gz 2023-12-08T08:24:38.932 INFO:teuthology.orchestra.run.smithi148.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-12-08T08:24:38.933 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52773.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52773.log.gz 2023-12-08T08:24:38.933 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44248.log 2023-12-08T08:24:38.934 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53593.log 2023-12-08T08:24:38.935 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53619.log.gz 2023-12-08T08:24:38.935 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44248.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44248.log.gz 2023-12-08T08:24:38.936 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54067.log 2023-12-08T08:24:38.937 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53593.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53593.log.gz 2023-12-08T08:24:38.937 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-12-08T08:24:38.938 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51708.log 2023-12-08T08:24:38.939 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54067.log.gz 2023-12-08T08:24:38.940 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43816.log 2023-12-08T08:24:38.941 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51708.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51708.log.gz 2023-12-08T08:24:38.941 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54691.log 2023-12-08T08:24:38.943 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42306.log 2023-12-08T08:24:38.943 INFO:teuthology.orchestra.run.smithi088.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.43816.log.gz 2023-12-08T08:24:38.944 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41959.log 2023-12-08T08:24:38.944 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54691.log.gz 2023-12-08T08:24:38.946 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42306.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.33219.log 2023-12-08T08:24:38.946 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42306.log.gz 2023-12-08T08:24:38.947 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52461.log 2023-12-08T08:24:38.947 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41959.log.gz 2023-12-08T08:24:38.948 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph.tmp-client.admin.33219.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.33219.log.gz 2023-12-08T08:24:38.949 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51656.log 2023-12-08T08:24:38.950 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42605.log 2023-12-08T08:24:38.950 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52461.log.gz 2023-12-08T08:24:38.951 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49001.log 2023-12-08T08:24:38.951 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51656.log.gz 2023-12-08T08:24:38.953 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42412.log 2023-12-08T08:24:38.953 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42605.log.gz 2023-12-08T08:24:38.954 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46223.log 2023-12-08T08:24:38.955 INFO:teuthology.orchestra.run.smithi088.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49001.log.gz 2023-12-08T08:24:38.955 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51174.log 2023-12-08T08:24:38.956 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42412.log.gz 2023-12-08T08:24:38.957 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47769.log 2023-12-08T08:24:38.957 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46223.log.gz 2023-12-08T08:24:38.959 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44144.log 2023-12-08T08:24:38.959 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51174.log.gz 2023-12-08T08:24:38.960 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54478.log 2023-12-08T08:24:38.960 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47769.log.gz 2023-12-08T08:24:38.961 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44144.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44144.log.gz 2023-12-08T08:24:38.961 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48544.log 2023-12-08T08:24:38.963 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44170.log 2023-12-08T08:24:38.963 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54478.log.gz 2023-12-08T08:24:38.964 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44430.log 2023-12-08T08:24:38.965 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48544.log.gz 2023-12-08T08:24:38.966 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47049.log 2023-12-08T08:24:38.966 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44170.log.gz 2023-12-08T08:24:38.967 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46145.log 2023-12-08T08:24:38.968 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44430.log.gz 2023-12-08T08:24:38.969 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52133.log 2023-12-08T08:24:38.969 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47049.log.gz 2023-12-08T08:24:38.970 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53536.log 2023-12-08T08:24:38.971 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46145.log.gz 2023-12-08T08:24:38.972 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42057.log 2023-12-08T08:24:38.972 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52133.log.gz 2023-12-08T08:24:38.973 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53092.log 2023-12-08T08:24:38.973 INFO:teuthology.orchestra.run.smithi088.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.53536.log.gz 2023-12-08T08:24:38.974 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49878.log 2023-12-08T08:24:38.975 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42057.log.gz 2023-12-08T08:24:38.976 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53092.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53092.log.gz 2023-12-08T08:24:38.976 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45851.log 2023-12-08T08:24:38.978 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51407.log 2023-12-08T08:24:38.978 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49878.log.gz 2023-12-08T08:24:38.979 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44887.log 2023-12-08T08:24:38.979 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45851.log.gz 2023-12-08T08:24:38.980 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.50123.log 2023-12-08T08:24:38.980 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51407.log.gz 2023-12-08T08:24:38.982 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53723.log 2023-12-08T08:24:38.982 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44887.log.gz 2023-12-08T08:24:38.982 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.testuser.50123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.50123.log.gz 2023-12-08T08:24:38.983 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52409.log 2023-12-08T08:24:38.985 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53723.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-12-08T08:24:38.985 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53723.log.gz 2023-12-08T08:24:38.986 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52409.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52409.log.gz 2023-12-08T08:24:38.986 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53484.log 2023-12-08T08:24:38.987 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44560.log 2023-12-08T08:24:38.989 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46603.log 2023-12-08T08:24:38.989 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53484.log.gz 2023-12-08T08:24:38.990 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44560.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44560.log.gz 2023-12-08T08:24:38.991 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50139.log 2023-12-08T08:24:38.992 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46603.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46603.log.gz 2023-12-08T08:24:38.993 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47282.log 2023-12-08T08:24:38.994 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50139.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50139.log.gz 2023-12-08T08:24:38.994 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48440.log 2023-12-08T08:24:38.995 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48600.log 2023-12-08T08:24:38.995 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47282.log.gz 2023-12-08T08:24:38.997 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42386.log 2023-12-08T08:24:38.997 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48440.log.gz 2023-12-08T08:24:38.998 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42110.log 2023-12-08T08:24:38.998 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48600.log.gz 2023-12-08T08:24:39.000 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50633.log 2023-12-08T08:24:39.000 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42386.log.gz 2023-12-08T08:24:39.001 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.53179.log 2023-12-08T08:24:39.001 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42110.log.gz 2023-12-08T08:24:39.002 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52039.log 2023-12-08T08:24:39.003 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50633.log.gz 2023-12-08T08:24:39.003 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.testuser.53179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.53179.log.gz 2023-12-08T08:24:39.004 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44835.log 2023-12-08T08:24:39.005 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.52039.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.52039.log.gz 2023-12-08T08:24:39.005 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47795.log 2023-12-08T08:24:39.007 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44835.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44835.log.gz 2023-12-08T08:24:39.008 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47795.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47795.log.gz 2023-12-08T08:24:39.008 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44726.log 2023-12-08T08:24:39.010 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45524.log 2023-12-08T08:24:39.012 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51148.log 2023-12-08T08:24:39.012 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44726.log.gz 2023-12-08T08:24:39.013 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54978.log 2023-12-08T08:24:39.013 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45524.log.gz 2023-12-08T08:24:39.014 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46093.log 2023-12-08T08:24:39.014 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51148.log.gz 2023-12-08T08:24:39.016 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42604.log 2023-12-08T08:24:39.016 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54978.log.gz 2023-12-08T08:24:39.017 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51604.log 2023-12-08T08:24:39.018 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46093.log.gz 2023-12-08T08:24:39.019 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44965.log 2023-12-08T08:24:39.019 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42604.log.gz 2023-12-08T08:24:39.020 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51604.log: gzip -5 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51604.log.gz 2023-12-08T08:24:39.020 INFO:teuthology.orchestra.run.smithi088.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47204.log 2023-12-08T08:24:39.022 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52539.log 2023-12-08T08:24:39.022 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44965.log.gz 2023-12-08T08:24:39.023 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50529.log 2023-12-08T08:24:39.023 INFO:teuthology.orchestra.run.smithi088.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.47204.log.gz 2023-12-08T08:24:39.024 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52539.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52539.log.gz 2023-12-08T08:24:39.026 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55188.log 2023-12-08T08:24:39.026 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50529.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50529.log.gz 2023-12-08T08:24:39.026 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45173.log 2023-12-08T08:24:39.028 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52695.log 2023-12-08T08:24:39.028 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55188.log.gz 2023-12-08T08:24:39.029 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45173.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45173.log.gz 2023-12-08T08:24:39.031 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52695.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52695.log.gz 2023-12-08T08:24:39.031 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51734.log 2023-12-08T08:24:39.032 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52081.log 2023-12-08T08:24:39.034 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49217.log 2023-12-08T08:24:39.034 INFO:teuthology.orchestra.run.smithi088.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51734.log.gz 2023-12-08T08:24:39.036 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52081.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52081.log.gz 2023-12-08T08:24:39.036 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48316.log 2023-12-08T08:24:39.037 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49217.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49217.log.gz 2023-12-08T08:24:39.037 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51486.log 2023-12-08T08:24:39.039 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53859.log 2023-12-08T08:24:39.039 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48316.log.gz 2023-12-08T08:24:39.040 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50451.log 2023-12-08T08:24:39.040 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51486.log.gz 2023-12-08T08:24:39.042 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53859.log: gzip -5 --verbose -- 87.7% /var/log/ceph/ceph-client.admin.48003.log 2023-12-08T08:24:39.042 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53859.log.gz 2023-12-08T08:24:39.043 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42615.log 2023-12-08T08:24:39.043 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50451.log.gz 2023-12-08T08:24:39.044 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48003.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48003.log.gz 2023-12-08T08:24:39.045 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43259.log 2023-12-08T08:24:39.046 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52936.log 2023-12-08T08:24:39.047 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42615.log.gz 2023-12-08T08:24:39.048 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48492.log 2023-12-08T08:24:39.048 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43259.log.gz 2023-12-08T08:24:39.049 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52936.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52936.log.gz 2023-12-08T08:24:39.049 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42438.log 2023-12-08T08:24:39.051 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51068.log 2023-12-08T08:24:39.051 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48492.log.gz 2023-12-08T08:24:39.052 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44939.log 2023-12-08T08:24:39.052 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42438.log.gz 2023-12-08T08:24:39.053 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51068.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51068.log.gz 2023-12-08T08:24:39.054 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53562.log 2023-12-08T08:24:39.055 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44939.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44939.log.gz 2023-12-08T08:24:39.055 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50034.log 2023-12-08T08:24:39.057 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53562.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53562.log.gz 2023-12-08T08:24:39.058 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50008.log 2023-12-08T08:24:39.059 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54821.log 2023-12-08T08:24:39.059 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50034.log.gz 2023-12-08T08:24:39.061 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53937.log 2023-12-08T08:24:39.061 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50008.log.gz 2023-12-08T08:24:39.061 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54821.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54821.log.gz 2023-12-08T08:24:39.062 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52211.log 2023-12-08T08:24:39.063 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53937.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53937.log.gz 2023-12-08T08:24:39.063 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50607.log 2023-12-08T08:24:39.065 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52237.log 2023-12-08T08:24:39.066 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52211.log.gz 2023-12-08T08:24:39.066 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50607.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50607.log.gz 2023-12-08T08:24:39.066 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43686.log 2023-12-08T08:24:39.068 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53406.log 2023-12-08T08:24:39.068 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52237.log.gz 2023-12-08T08:24:39.069 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43790.log 2023-12-08T08:24:39.069 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43686.log.gz 2023-12-08T08:24:39.071 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53406.log: gzip -5 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53406.log.gz 2023-12-08T08:24:39.071 INFO:teuthology.orchestra.run.smithi088.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49483.log 2023-12-08T08:24:39.072 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53807.log 2023-12-08T08:24:39.072 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43790.log.gz 2023-12-08T08:24:39.074 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49483.log: gzip -5 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49483.log.gz 2023-12-08T08:24:39.074 INFO:teuthology.orchestra.run.smithi088.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47490.log 2023-12-08T08:24:39.075 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53807.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53807.log.gz 2023-12-08T08:24:39.075 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54549.log 2023-12-08T08:24:39.076 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47490.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47490.log.gz 2023-12-08T08:24:39.077 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52825.log 2023-12-08T08:24:39.078 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50730.log 2023-12-08T08:24:39.078 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54549.log.gz 2023-12-08T08:24:39.080 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46277.log 2023-12-08T08:24:39.081 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52825.log.gz 2023-12-08T08:24:39.081 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50730.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.50730.log.gz 2023-12-08T08:24:39.081 INFO:teuthology.orchestra.run.smithi088.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53376.log 2023-12-08T08:24:39.083 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45550.log 2023-12-08T08:24:39.083 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46277.log.gz 2023-12-08T08:24:39.084 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44352.log 2023-12-08T08:24:39.084 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53376.log.gz 2023-12-08T08:24:39.086 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45550.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45550.log.gz 2023-12-08T08:24:39.086 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47899.log 2023-12-08T08:24:39.087 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48923.log 88.5% 2023-12-08T08:24:39.087 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44352.log.gz 2023-12-08T08:24:39.089 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47899.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-08T08:24:39.089 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47899.log.gz 2023-12-08T08:24:39.090 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50964.log 2023-12-08T08:24:39.090 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48923.log.gz 2023-12-08T08:24:39.092 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52487.log 2023-12-08T08:24:39.093 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50964.log: 86.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-08T08:24:39.093 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50964.log.gz 2023-12-08T08:24:39.094 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52487.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52487.log.gz 2023-12-08T08:24:39.095 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44508.log 2023-12-08T08:24:39.096 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53014.log 2023-12-08T08:24:39.098 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44508.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.44508.log.gz 2023-12-08T08:24:39.098 INFO:teuthology.orchestra.run.smithi088.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52327.log 2023-12-08T08:24:39.099 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53014.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.53014.log.gz -5 2023-12-08T08:24:39.099 INFO:teuthology.orchestra.run.smithi088.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45043.log 2023-12-08T08:24:39.101 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49796.log 2023-12-08T08:24:39.101 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52327.log.gz 2023-12-08T08:24:39.102 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45043.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45043.log.gz 2023-12-08T08:24:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49796.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49796.log.gz 2023-12-08T08:24:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42812.log 2023-12-08T08:24:39.105 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51355.log 2023-12-08T08:24:39.107 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46499.log 2023-12-08T08:24:39.107 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42812.log.gz 2023-12-08T08:24:39.108 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55108.log 2023-12-08T08:24:39.109 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51355.log.gz 2023-12-08T08:24:39.110 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46499.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46499.log.gz 2023-12-08T08:24:39.110 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44118.log 2023-12-08T08:24:39.111 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55108.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55108.log.gz 2023-12-08T08:24:39.112 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54348.log 2023-12-08T08:24:39.113 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44118.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44118.log.gz 2023-12-08T08:24:39.113 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47412.log 2023-12-08T08:24:39.115 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54348.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54348.log.gz 2023-12-08T08:24:39.115 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50068.log 2023-12-08T08:24:39.116 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45218.log 2023-12-08T08:24:39.117 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47412.log.gz 2023-12-08T08:24:39.118 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50068.log: gzip -5 --verbose 88.5% -- -- replaced with /var/log/ceph/ceph-client.admin.50068.log.gz /var/log/ceph/ceph-client.admin.45276.log 2023-12-08T08:24:39.118 INFO:teuthology.orchestra.run.smithi088.stderr: 2023-12-08T08:24:39.119 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54119.log 2023-12-08T08:24:39.121 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45218.log.gz 2023-12-08T08:24:39.122 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45276.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45276.log.gz 2023-12-08T08:24:39.122 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54119.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54119.log.gz 2023-12-08T08:24:39.122 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44620.log 2023-12-08T08:24:39.124 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42136.log 2023-12-08T08:24:39.126 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42621.log 2023-12-08T08:24:39.126 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44620.log.gz 2023-12-08T08:24:39.127 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42136.log: gzip 88.2% -5 --verbose -- /var/log/ceph/ceph-client.admin.47646.log 2023-12-08T08:24:39.127 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42136.log.gz 2023-12-08T08:24:39.129 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42621.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42621.log.gz 2023-12-08T08:24:39.129 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48206.log 2023-12-08T08:24:39.130 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47646.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47646.log.gz 2023-12-08T08:24:39.131 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47542.log 2023-12-08T08:24:39.132 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52906.log 2023-12-08T08:24:39.132 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48206.log.gz 2023-12-08T08:24:39.134 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47542.log: gzip 88.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.47542.log.gz -- 2023-12-08T08:24:39.134 INFO:teuthology.orchestra.run.smithi088.stderr: /var/log/ceph/ceph-client.admin.46707.log 2023-12-08T08:24:39.135 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49743.log 2023-12-08T08:24:39.135 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52906.log.gz 2023-12-08T08:24:39.136 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43010.log 2023-12-08T08:24:39.137 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46707.log.gz 2023-12-08T08:24:39.138 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45244.log 2023-12-08T08:24:39.138 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49743.log.gz 2023-12-08T08:24:39.139 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46067.log 2023-12-08T08:24:39.140 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43010.log.gz 2023-12-08T08:24:39.141 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45244.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45244.log.gz 2023-12-08T08:24:39.141 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55160.log 2023-12-08T08:24:39.142 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46067.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46067.log.gz 2023-12-08T08:24:39.144 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55160.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55160.log.gz 2023-12-08T08:24:39.144 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49587.log 2023-12-08T08:24:39.145 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43262.log 2023-12-08T08:24:39.147 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51891.log 2023-12-08T08:24:39.147 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49587.log.gz 2023-12-08T08:24:39.148 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43262.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43262.log.gz 2023-12-08T08:24:39.150 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51891.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51891.log.gz 2023-12-08T08:24:39.150 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54374.log 2023-12-08T08:24:39.151 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44404.log 2023-12-08T08:24:39.154 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46551.log 2023-12-08T08:24:39.154 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54374.log.gz 2023-12-08T08:24:39.155 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44404.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44404.log.gz 2023-12-08T08:24:39.156 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46551.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46551.log.gz 2023-12-08T08:24:39.157 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49243.log 2023-12-08T08:24:39.158 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42214.log 2023-12-08T08:24:39.160 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43222.log 2023-12-08T08:24:39.160 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49243.log.gz 2023-12-08T08:24:39.161 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46365.log 2023-12-08T08:24:39.161 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42214.log.gz 2023-12-08T08:24:39.162 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51682.log 2023-12-08T08:24:39.163 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43222.log.gz 2023-12-08T08:24:39.164 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46811.log 2023-12-08T08:24:39.164 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46365.log.gz 2023-12-08T08:24:39.165 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51682.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51682.log.gz 2023-12-08T08:24:39.166 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44378.log 2023-12-08T08:24:39.167 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46811.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.46811.log.gz 2023-12-08T08:24:39.167 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48845.log 2023-12-08T08:24:39.169 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48031.log 2023-12-08T08:24:39.169 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44378.log.gz 2023-12-08T08:24:39.170 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46051.log 2023-12-08T08:24:39.170 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48845.log.gz 2023-12-08T08:24:39.171 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43530.log 2023-12-08T08:24:39.172 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48031.log.gz 2023-12-08T08:24:39.173 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.46051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46051.log.gz 2023-12-08T08:24:39.173 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51993.log 2023-12-08T08:24:39.175 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43530.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43530.log.gz 2023-12-08T08:24:39.175 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46785.log 2023-12-08T08:24:39.175 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51993.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51993.log.gz 2023-12-08T08:24:39.176 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42464.log 2023-12-08T08:24:39.178 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48741.log 2023-12-08T08:24:39.178 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46785.log.gz 2023-12-08T08:24:39.179 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43266.log 2023-12-08T08:24:39.179 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42464.log.gz 2023-12-08T08:24:39.181 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43478.log 2023-12-08T08:24:39.181 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48741.log.gz 2023-12-08T08:24:39.182 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53989.log 2023-12-08T08:24:39.182 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43266.log.gz 2023-12-08T08:24:39.183 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52055.log 88.6% 2023-12-08T08:24:39.184 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43478.log.gz 2023-12-08T08:24:39.185 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46919.log 2023-12-08T08:24:39.185 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53989.log.gz 2023-12-08T08:24:39.187 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54743.log 2023-12-08T08:24:39.187 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52055.log.gz 2023-12-08T08:24:39.188 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53220.log 2023-12-08T08:24:39.188 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46919.log.gz 2023-12-08T08:24:39.189 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49323.log 2023-12-08T08:24:39.189 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54743.log.gz 2023-12-08T08:24:39.191 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53220.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53220.log.gz 2023-12-08T08:24:39.191 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49535.log 2023-12-08T08:24:39.192 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49323.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49323.log.gz 2023-12-08T08:24:39.193 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49457.log 2023-12-08T08:24:39.194 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45719.log 2023-12-08T08:24:39.194 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49535.log.gz 2023-12-08T08:24:39.196 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50555.log 2023-12-08T08:24:39.196 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49457.log.gz 2023-12-08T08:24:39.197 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43608.log 2023-12-08T08:24:39.197 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45719.log.gz 2023-12-08T08:24:39.198 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50555.log: gzip -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.44783.log -- replaced with /var/log/ceph/ceph-client.admin.50555.log.gz 2023-12-08T08:24:39.199 INFO:teuthology.orchestra.run.smithi088.stderr: 2023-12-08T08:24:39.200 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44586.log 2023-12-08T08:24:39.200 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43608.log.gz 2023-12-08T08:24:39.201 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44783.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44783.log.gz 2023-12-08T08:24:39.202 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43504.log 2023-12-08T08:24:39.203 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44586.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-08T08:24:39.203 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44586.log.gz 2023-12-08T08:24:39.205 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43504.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43504.log.gz 2023-12-08T08:24:39.205 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54925.log 2023-12-08T08:24:39.206 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-12-08T08:24:39.208 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54925.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54925.log.gz 2023-12-08T08:24:39.209 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-08T08:24:39.212 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44913.log 2023-12-08T08:24:39.213 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-12-08T08:24:39.215 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53671.log 2023-12-08T08:24:39.215 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44913.log.gz 2023-12-08T08:24:39.219 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43426.log 2023-12-08T08:24:39.220 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44196.log 2023-12-08T08:24:39.221 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53671.log: /var/log/ceph/ceph-client.admin.43426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48975.log 2023-12-08T08:24:39.222 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44196.log: 87.4% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43426.log.gz 2023-12-08T08:24:39.223 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53671.log.gz 2023-12-08T08:24:39.225 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42622.log 2023-12-08T08:24:39.230 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42622.log: -- replaced with /var/log/ceph/ceph-client.admin.44196.log.gz 2023-12-08T08:24:39.230 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42622.log.gz 2023-12-08T08:24:39.230 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48975.log.gz 2023-12-08T08:24:39.230 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46577.log 2023-12-08T08:24:39.232 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45366.log 2023-12-08T08:24:39.236 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46577.log: /var/log/ceph/ceph-client.admin.45366.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45366.log.gz 2023-12-08T08:24:39.236 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45658.log 2023-12-08T08:24:39.236 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46577.log.gz 2023-12-08T08:24:39.239 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45799.log 2023-12-08T08:24:39.239 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45658.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45658.log.gz 2023-12-08T08:24:39.240 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53697.log 2023-12-08T08:24:39.245 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45799.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45799.log.gz 2023-12-08T08:24:39.245 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54639.log 2023-12-08T08:24:39.245 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53697.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53697.log.gz 2023-12-08T08:24:39.248 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43025.log 2023-12-08T08:24:39.248 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54639.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54639.log.gz 2023-12-08T08:24:39.251 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43025.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43025.log.gz 2023-12-08T08:24:39.251 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49769.log 2023-12-08T08:24:39.255 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49769.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49769.log.gz 2023-12-08T08:24:39.255 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.47162.log 2023-12-08T08:24:39.258 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.testuser.47162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.47162.log.gz 2023-12-08T08:24:39.258 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43634.log 2023-12-08T08:24:39.260 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44861.log 2023-12-08T08:24:39.261 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43634.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43634.log.gz 2023-12-08T08:24:39.264 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44861.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44861.log.gz 2023-12-08T08:24:39.264 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46197.log 2023-12-08T08:24:39.268 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46197.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46197.log.gz 2023-12-08T08:24:39.268 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48154.log 2023-12-08T08:24:39.270 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48154.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48154.log.gz 2023-12-08T08:24:39.271 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55004.log 2023-12-08T08:24:39.273 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47821.log 2023-12-08T08:24:39.274 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55004.log.gz 2023-12-08T08:24:39.277 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43030.log 2023-12-08T08:24:39.280 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49405.log 2023-12-08T08:24:39.280 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43030.log.gz 2023-12-08T08:24:39.281 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47821.log.gz 2023-12-08T08:24:39.284 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50373.log 2023-12-08T08:24:39.286 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54601.log 2023-12-08T08:24:39.287 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50373.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50373.log.gz 2023-12-08T08:24:39.287 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49405.log.gz 2023-12-08T08:24:39.290 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54601.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54601.log.gz 2023-12-08T08:24:39.291 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51630.log 2023-12-08T08:24:39.295 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51630.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51630.log.gz 2023-12-08T08:24:39.295 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54452.log 2023-12-08T08:24:39.298 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54452.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54452.log.gz 2023-12-08T08:24:39.299 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50399.log 2023-12-08T08:24:39.302 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50399.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50399.log.gz 2023-12-08T08:24:39.302 INFO:teuthology.orchestra.run.smithi088.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-12-08T08:24:39.302 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52988.log 2023-12-08T08:24:39.303 INFO:teuthology.orchestra.run.smithi088.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-08T08:24:39.304 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49848.log 2023-12-08T08:24:39.305 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43022.log 2023-12-08T08:24:39.306 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52988.log.gz 2023-12-08T08:24:39.306 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49848.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49848.log.gz 2023-12-08T08:24:39.307 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54218.log 2023-12-08T08:24:39.307 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43022.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43022.log.gz 2023-12-08T08:24:39.308 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45420.log 2023-12-08T08:24:39.310 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43218.log 2023-12-08T08:24:39.310 INFO:teuthology.orchestra.run.smithi088.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54218.log.gz 2023-12-08T08:24:39.311 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45420.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45420.log.gz 2023-12-08T08:24:39.311 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43264.log 2023-12-08T08:24:39.312 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43218.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43218.log.gz 2023-12-08T08:24:39.312 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44757.log 2023-12-08T08:24:39.314 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47308.log 2023-12-08T08:24:39.314 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43264.log.gz 2023-12-08T08:24:39.315 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44757.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44757.log.gz 2023-12-08T08:24:39.315 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42808.log 2023-12-08T08:24:39.316 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47308.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47308.log.gz 2023-12-08T08:24:39.317 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48518.log 2023-12-08T08:24:39.317 INFO:teuthology.orchestra.run.smithi088.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-12-08T08:24:39.318 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42830.log 2023-12-08T08:24:39.318 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42808.log.gz 2023-12-08T08:24:39.319 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48518.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48518.log.gz 2023-12-08T08:24:39.319 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47107.log 2023-12-08T08:24:39.320 INFO:teuthology.orchestra.run.smithi088.stderr:gzip/var/log/ceph/ceph-client.admin.42830.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44274.log 2023-12-08T08:24:39.321 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42830.log.gz 2023-12-08T08:24:39.321 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47107.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47107.log.gz 2023-12-08T08:24:39.322 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55212.log 2023-12-08T08:24:39.323 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43261.log 2023-12-08T08:24:39.326 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44274.log.gz 2023-12-08T08:24:39.327 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55212.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55212.log.gz 2023-12-08T08:24:39.327 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52565.log 2023-12-08T08:24:39.327 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53040.log 2023-12-08T08:24:39.327 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43261.log.gz 2023-12-08T08:24:39.327 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52565.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52565.log.gz 2023-12-08T08:24:39.327 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51016.log 2023-12-08T08:24:39.328 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52379.log 2023-12-08T08:24:39.328 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53040.log.gz 2023-12-08T08:24:39.329 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51016.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51016.log.gz 2023-12-08T08:24:39.329 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54322.log 2023-12-08T08:24:39.330 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53645.log 2023-12-08T08:24:39.331 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52379.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52379.log.gz 2023-12-08T08:24:39.331 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54322.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54322.log.gz 2023-12-08T08:24:39.332 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49113.log 2023-12-08T08:24:39.333 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45693.log 2023-12-08T08:24:39.333 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53645.log.gz 2023-12-08T08:24:39.334 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49113.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49113.log.gz 2023-12-08T08:24:39.334 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48232.log 2023-12-08T08:24:39.335 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42516.log 2023-12-08T08:24:39.336 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45693.log.gz 2023-12-08T08:24:39.336 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48232.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48232.log.gz 2023-12-08T08:24:39.337 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44456.log 2023-12-08T08:24:39.338 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45630.log 2023-12-08T08:24:39.338 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42516.log.gz 2023-12-08T08:24:39.339 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44456.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44456.log.gz 2023-12-08T08:24:39.339 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49613.log 2023-12-08T08:24:39.340 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50756.log 2023-12-08T08:24:39.340 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45630.log.gz 2023-12-08T08:24:39.341 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49613.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49613.log.gz 2023-12-08T08:24:39.342 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53510.log 2023-12-08T08:24:39.342 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45576.log 2023-12-08T08:24:39.343 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50756.log.gz 2023-12-08T08:24:39.344 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53510.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53510.log.gz 2023-12-08T08:24:39.344 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46305.log 2023-12-08T08:24:39.345 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45147.log 2023-12-08T08:24:39.346 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45576.log.gz 2023-12-08T08:24:39.346 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46305.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46305.log.gz 2023-12-08T08:24:39.346 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42821.log 2023-12-08T08:24:39.347 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54093.log 2023-12-08T08:24:39.348 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45147.log.gz 2023-12-08T08:24:39.349 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42821.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42821.log.gz 2023-12-08T08:24:39.349 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44014.log 2023-12-08T08:24:39.350 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54093.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54093.log.gz 2023-12-08T08:24:39.351 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53272.log 2023-12-08T08:24:39.352 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42822.log 2023-12-08T08:24:39.352 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44014.log.gz 2023-12-08T08:24:39.353 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53272.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53272.log.gz 2023-12-08T08:24:39.353 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44482.log 2023-12-08T08:24:39.354 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49191.log 2023-12-08T08:24:39.355 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42822.log.gz 2023-12-08T08:24:39.355 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44482.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44482.log.gz 2023-12-08T08:24:39.356 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51943.log 2023-12-08T08:24:39.357 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43023.log 2023-12-08T08:24:39.357 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49191.log.gz 2023-12-08T08:24:39.358 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47743.log 2023-12-08T08:24:39.358 INFO:teuthology.orchestra.run.smithi088.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51943.log.gz 2023-12-08T08:24:39.359 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51917.log 2023-12-08T08:24:39.360 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43023.log.gz 2023-12-08T08:24:39.361 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47743.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47743.log.gz 2023-12-08T08:24:39.361 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48793.log 2023-12-08T08:24:39.363 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49639.log 2023-12-08T08:24:39.363 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51917.log.gz 2023-12-08T08:24:39.364 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48793.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48793.log.gz 2023-12-08T08:24:39.364 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50886.log 2023-12-08T08:24:39.365 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42244.log 2023-12-08T08:24:39.366 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49639.log.gz 2023-12-08T08:24:39.366 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50886.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50886.log.gz 2023-12-08T08:24:39.366 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49269.log 2023-12-08T08:24:39.368 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42244.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42244.log.gz 2023-12-08T08:24:39.368 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51290.log 2023-12-08T08:24:39.370 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49269.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49269.log.gz 2023-12-08T08:24:39.370 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50425.log 2023-12-08T08:24:39.371 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51290.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51290.log.gz 2023-12-08T08:24:39.371 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38009.log 2023-12-08T08:24:39.373 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50425.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50425.log.gz 2023-12-08T08:24:39.373 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50191.log 2023-12-08T08:24:39.374 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45929.log 2023-12-08T08:24:39.374 INFO:teuthology.orchestra.run.smithi088.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38009.log.gz 2023-12-08T08:24:39.376 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45340.log 2023-12-08T08:24:39.376 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50191.log.gz 2023-12-08T08:24:39.377 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43556.log 2023-12-08T08:24:39.377 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45929.log.gz 2023-12-08T08:24:39.379 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45340.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45340.log.gz 2023-12-08T08:24:39.379 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50659.log 2023-12-08T08:24:39.380 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48058.log 2023-12-08T08:24:39.380 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43556.log.gz 2023-12-08T08:24:39.381 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50659.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50659.log.gz 2023-12-08T08:24:39.382 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51096.log 2023-12-08T08:24:39.382 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51576.log 2023-12-08T08:24:39.383 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48058.log.gz 2023-12-08T08:24:39.384 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51096.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51096.log.gz 2023-12-08T08:24:39.384 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52107.log 2023-12-08T08:24:39.386 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51576.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51576.log.gz 2023-12-08T08:24:39.387 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54296.log 2023-12-08T08:24:39.387 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52107.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52107.log.gz 2023-12-08T08:24:39.388 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54041.log 2023-12-08T08:24:39.389 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52185.log 2023-12-08T08:24:39.389 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54296.log.gz 2023-12-08T08:24:39.390 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54041.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54041.log.gz 2023-12-08T08:24:39.390 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43452.log 2023-12-08T08:24:39.392 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52185.log: gzip 88.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.52185.log.gz -- 2023-12-08T08:24:39.392 INFO:teuthology.orchestra.run.smithi088.stderr: /var/log/ceph/ceph-client.admin.50503.log 2023-12-08T08:24:39.393 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45392.log 2023-12-08T08:24:39.393 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43452.log.gz 2023-12-08T08:24:39.395 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52721.log 2023-12-08T08:24:39.395 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50503.log.gz 2023-12-08T08:24:39.396 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47178.log 2023-12-08T08:24:39.397 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45392.log.gz 2023-12-08T08:24:39.398 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44222.log 2023-12-08T08:24:39.398 INFO:teuthology.orchestra.run.smithi088.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52721.log.gz 2023-12-08T08:24:39.399 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47178.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47178.log.gz 2023-12-08T08:24:39.399 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50295.log 2023-12-08T08:24:39.401 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44222.log: gzip -5 89.1% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.44222.log.gz 2023-12-08T08:24:39.401 INFO:teuthology.orchestra.run.smithi088.stderr: /var/log/ceph/ceph-client.admin.42568.log 2023-12-08T08:24:39.402 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44809.log 2023-12-08T08:24:39.402 INFO:teuthology.orchestra.run.smithi088.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50295.log.gz 2023-12-08T08:24:39.403 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42568.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42568.log.gz 2023-12-08T08:24:39.404 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42272.log 2023-12-08T08:24:39.405 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44809.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44809.log.gz 2023-12-08T08:24:39.405 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51122.log 2023-12-08T08:24:39.407 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50834.log 2023-12-08T08:24:39.407 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42272.log.gz 2023-12-08T08:24:39.408 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51122.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51122.log.gz 2023-12-08T08:24:39.408 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48871.log 2023-12-08T08:24:39.409 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45498.log 2023-12-08T08:24:39.409 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50834.log.gz 2023-12-08T08:24:39.410 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48871.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48871.log.gz 2023-12-08T08:24:39.411 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50782.log 2023-12-08T08:24:39.412 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45498.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45498.log.gz 2023-12-08T08:24:39.412 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54166.log 2023-12-08T08:24:39.413 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50782.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50782.log.gz 2023-12-08T08:24:39.413 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47386.log 2023-12-08T08:24:39.415 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54166.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54166.log.gz 2023-12-08T08:24:39.415 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47516.log 2023-12-08T08:24:39.416 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47386.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47386.log.gz 2023-12-08T08:24:39.417 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47516.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47516.log.gz 2023-12-08T08:24:39.513 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-12-08T08:24:39.631 INFO:teuthology.orchestra.run.smithi148.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-12-08T08:24:39.631 INFO:teuthology.orchestra.run.smithi148.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-12-08T08:24:39.656 INFO:teuthology.orchestra.run.smithi148.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-12-08T08:24:39.699 INFO:teuthology.orchestra.run.smithi148.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-12-08T08:24:39.701 INFO:teuthology.orchestra.run.smithi148.stderr: 2023-12-08T08:24:39.701 INFO:teuthology.orchestra.run.smithi148.stderr:real 0m1.014s 2023-12-08T08:24:39.701 INFO:teuthology.orchestra.run.smithi148.stderr:user 0m3.727s 2023-12-08T08:24:39.702 INFO:teuthology.orchestra.run.smithi148.stderr:sys 0m0.444s 2023-12-08T08:24:39.780 INFO:teuthology.orchestra.run.smithi088.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-08T08:24:39.828 INFO:teuthology.orchestra.run.smithi088.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-08T08:24:39.937 INFO:teuthology.orchestra.run.smithi088.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-12-08T08:24:40.031 INFO:teuthology.orchestra.run.smithi088.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-08T08:24:40.034 INFO:teuthology.orchestra.run.smithi088.stderr: 2023-12-08T08:24:40.034 INFO:teuthology.orchestra.run.smithi088.stderr:real 0m1.371s 2023-12-08T08:24:40.034 INFO:teuthology.orchestra.run.smithi088.stderr:user 0m5.051s 2023-12-08T08:24:40.034 INFO:teuthology.orchestra.run.smithi088.stderr:sys 0m1.256s 2023-12-08T08:24:40.034 INFO:tasks.ceph:Archiving logs... 2023-12-08T08:24:40.035 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483775/remote/smithi088/log 2023-12-08T08:24:40.036 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-08T08:24:40.975 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483775/remote/smithi148/log 2023-12-08T08:24:40.976 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-08T08:24:41.476 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-08T08:24:41.486 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-08T08:24:41.487 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-08T08:24:41.491 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-08T08:24:41.578 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-08T08:24:41.587 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-08T08:24:41.587 DEBUG:teuthology.orchestra.run.smithi088:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-08T08:24:41.591 DEBUG:teuthology.orchestra.run.smithi148:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-08T08:24:41.602 INFO:teuthology.orchestra.run.smithi088.stdout: remote refid st t when poll reach delay offset jitter 2023-12-08T08:24:41.603 INFO:teuthology.orchestra.run.smithi088.stdout:============================================================================== 2023-12-08T08:24:41.603 INFO:teuthology.orchestra.run.smithi088.stdout:*hv01.front.sepi 44.4.53.2 2 u 22 64 377 0.105 -1.161 0.852 2023-12-08T08:24:41.603 INFO:teuthology.orchestra.run.smithi088.stdout:+hv02.front.sepi 63.231.80.2 3 u 24 64 377 0.083 +0.161 1.321 2023-12-08T08:24:41.603 INFO:teuthology.orchestra.run.smithi088.stdout:+hv03.front.sepi 74.6.168.72 3 u 16 64 377 0.082 +0.294 1.225 2023-12-08T08:24:41.603 INFO:teuthology.orchestra.run.smithi088.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-08T08:24:41.607 INFO:teuthology.orchestra.run.smithi148.stdout: remote refid st t when poll reach delay offset jitter 2023-12-08T08:24:41.607 INFO:teuthology.orchestra.run.smithi148.stdout:============================================================================== 2023-12-08T08:24:41.607 INFO:teuthology.orchestra.run.smithi148.stdout:*hv01.front.sepi 44.4.53.2 2 u 17 64 377 0.127 -1.645 0.885 2023-12-08T08:24:41.608 INFO:teuthology.orchestra.run.smithi148.stdout:+hv02.front.sepi 63.231.80.2 3 u 23 64 377 0.163 -0.933 0.880 2023-12-08T08:24:41.608 INFO:teuthology.orchestra.run.smithi148.stdout:+hv03.front.sepi 74.6.168.72 3 u 15 64 377 0.105 -0.819 0.833 2023-12-08T08:24:41.608 INFO:teuthology.orchestra.run.smithi148.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-08T08:24:41.609 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-08T08:24:41.658 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-08T08:24:41.658 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-08T08:24:41.675 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-08T08:24:41.690 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-08T08:24:41.705 INFO:teuthology.task.internal:Duration was 1013.001288 seconds 2023-12-08T08:24:41.706 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-08T08:24:41.736 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-08T08:24:41.737 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-08T08:24:41.741 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-08T08:24:41.856 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-08T08:24:41.857 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi088.front.sepia.ceph.com 2023-12-08T08:24:41.857 DEBUG:teuthology.orchestra.run.smithi088:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-08T08:24:41.879 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi148.front.sepia.ceph.com 2023-12-08T08:24:41.880 DEBUG:teuthology.orchestra.run.smithi148:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-08T08:24:41.903 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-08T08:24:41.903 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-08T08:24:41.931 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-08T08:24:41.981 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-08T08:24:41.981 DEBUG:teuthology.orchestra.run.smithi088:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-08T08:24:42.007 DEBUG:teuthology.orchestra.run.smithi148:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-08T08:24:42.089 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-08T08:24:42.100 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-08T08:24:42.100 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-08T08:24:42.120 DEBUG:teuthology.orchestra.run.smithi148:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-08T08:24:42.141 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-08T08:24:42.154 DEBUG:teuthology.orchestra.run.smithi088:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-08T08:24:42.166 DEBUG:teuthology.orchestra.run.smithi148:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-08T08:24:42.181 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = core 2023-12-08T08:24:42.201 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = core 2023-12-08T08:24:42.219 DEBUG:teuthology.orchestra.run.smithi088:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-08T08:24:42.250 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:24:42.251 DEBUG:teuthology.orchestra.run.smithi148:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-08T08:24:42.268 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:24:42.269 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-08T08:24:42.283 INFO:teuthology.task.internal:Transferring archived files... 2023-12-08T08:24:42.283 DEBUG:teuthology.misc:Transferring archived files from smithi088:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483775/remote/smithi088 2023-12-08T08:24:42.284 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-08T08:24:42.316 DEBUG:teuthology.misc:Transferring archived files from smithi148:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483775/remote/smithi148 2023-12-08T08:24:42.317 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-08T08:24:42.341 INFO:teuthology.task.internal:Removing archive directory... 2023-12-08T08:24:42.342 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-08T08:24:42.359 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-08T08:24:42.393 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-08T08:24:42.416 INFO:teuthology.task.internal:Not uploading archives. 2023-12-08T08:24:42.416 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-08T08:24:42.441 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-08T08:24:42.441 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-08T08:24:42.445 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-08T08:24:42.450 INFO:teuthology.orchestra.run.smithi088.stdout: 658043 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 8 08:24 /home/ubuntu/cephtest 2023-12-08T08:24:42.454 INFO:teuthology.orchestra.run.smithi148.stdout: 658042 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 8 08:24 /home/ubuntu/cephtest 2023-12-08T08:24:42.456 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-08T08:24:42.468 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-08T08:24:42.505 INFO:teuthology.nuke:Checking targets against current locks 2023-12-08T08:24:42.532 DEBUG:teuthology.nuke:shortname: smithi088 2023-12-08T08:24:42.533 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-08T08:24:42.559 DEBUG:teuthology.nuke:shortname: smithi148 2023-12-08T08:24:42.560 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-08T08:24:42.563 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483775', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-08 07:57:53.185587', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJPCr2txKdrKf9QnVelFuE+wn/m9+lLN+r7qen3FqGpJXpxAxebzzsQ5a4U12llyPIl2twavOnDhInUZ62jUq4Q='} 2023-12-08T08:24:42.584 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483775', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-08 07:57:53.186982', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEZ4o2xJekQI9+TdCETQ2M9T3DLEpNouMY7fkhItHCoYvLU++jEUfbgjPeq/lGtbmsSFWoZPbDPIFYXVu5sMDvs='} 2023-12-08T08:24:42.616 INFO:teuthology.orchestra.console.smithi088:Power off 2023-12-08T08:24:42.616 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-08T08:24:42.642 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2023-12-08T08:24:42.643 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T08:24:42.661 INFO:teuthology.orchestra.console.smithi148:Power off 2023-12-08T08:24:42.661 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-08T08:24:42.671 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-12-08T08:24:42.683 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2023-12-08T08:24:42.683 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T08:24:42.707 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-12-08T08:24:46.673 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T08:24:46.709 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T08:24:46.785 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-12-08T08:24:46.821 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-12-08T08:24:50.786 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T08:24:50.822 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T08:24:50.897 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-12-08T08:24:50.935 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-12-08T08:24:50.998 INFO:teuthology.orchestra.console.smithi088:Power off completed 2023-12-08T08:24:51.036 INFO:teuthology.orchestra.console.smithi148:Power off completed 2023-12-08T08:24:51.142 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 6bcacf46b7888ce2bf7abad8aec37024810025d4 client.1-kernel-sha1: 6bcacf46b7888ce2bf7abad8aec37024810025d4 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} duration: 1013.0012881755829 failure_reason: 'Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps)' flavor: default owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=b990591071154df597341136331fde74 status: fail success: false 2023-12-08T08:24:51.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T08:24:51.219 INFO:teuthology.run:FAIL